Hpc server - 4th gen. intel xeon scalable server - 2u dp 8-gpu nvme/sata/sas hpc server - 4th gen. intel xeon scalable server - 2u dp 4-gpu nvme/sata/sas (118 pages)
Hpc server - 4th gen intel xeon scalable server - 2u dp 8-gpu nvme/sata/sas, hpc server - 4th gen intel xeon scalable server - 2u dp 4-gpu nvme/sata/sas, hpc server - 4th gen intel xeon scalable server - 2u dp 8-gpu nvme/sata/sas, hpc server - 4th gen int (120 pages)
Dual lga3647 sockets motherboard for intel xeon scalable family processors (139 pages)
Summary of Contents for Gigabyte G293-S45-IAP1
Page 1
G293-S45-IAP1 HPC/AI Server - 4th/5th Gen Intel® Xeon® Scalable - 2U DP 8 x PCIe Gen5 GPUs User Manual Rev. 1.0...
Page 2
For GIGABYTE distributors and resellers, additional sales & marketing materials are available from our reseller portal: http://reseller.b2b.gigabyte.com For further technical assistance, please contact your GIGABYTE representative or visit https://esupport.gigabyte.com/ to create a new support ticket For any general sales or marketing enquiries, you may also message GIGABYTE server directly by email: server.grp@gigabyte.com...
Page 3
Conventions The following conventions are used in this user's guide: NOTE! Gives bits and pieces of additional information related to the current topic. CAUTION! Gives precautionary measures to avoid possible hardware or software problems. WARNING! Alerts you to any damage that might result from doing or not doing specific actions.
Page 4
Server Warnings and Cautions Before installing a server, be sure that you understand the following warnings and cautions. WARNING! To reduce the risk of electric shock or damage to the equipment: • Do not disable the power cord grounding plug. The grounding plug is an important safety feature.
Page 5
Electrostatic Discharge (ESD) CAUTION! ESD CAN DAMAGE DRIVES, BOARDS, AND OTHER PARTS. WE RECOMMEND THAT YOU PERFORM ALL PROCEDURES AT AN ESD WORKSTATION. IF ONE IS NOT AVAILABLE, PROVIDE SOME ESD PROTECTION BY WEARING AN ANTI-STATIC WRIST STRAP AT- TACHED TO CHASSIS GROUND -- ANY UNPAINTED METAL SURFACE -- ON YOUR SERVER WHEN HANDLING PARTS.
Page 6
CAUTION! Risk of explosion if battery is replaced incorrectly or with an incorrect type. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used bat- teries according to the manufacturer’s instructions.
Table of Contents Chapter 1 Hardware Installation ..................9 Installation Precautions ..................9 Product Specifications ..................10 System Block Diagram ................... 14 Chapter 2 System Appearance ..................15 Front View ...................... 15 Rear View ....................... 15 Rear System Button and LEDs ..............16 Power Supply Unit (PSU) LED ...............
Chapter 1 Hardware Installation Installation Precautions The motherboard/system contain numerous delicate electronic circuits and components which can become damaged as a result of electrostatic discharge (ESD). Prior to installation, carefully read the service guide and follow these procedures: • Prior to installation, do not remove or break motherboard S/N (Serial Number) sticker or warranty sticker provided by your dealer.
Product Specifications NOTE: We reserve the right to make any changes to the product specifications and product-related information without prior notice. System 448mm (W) x 87.5mm (H) x 800mm (D) Dimension 5th Generation Intel® Xeon® Scalable Processors 4th Generation Intel®...
Page 11
- Maximum limitation of GPU card: 285mm (L) x 111.5mm (W) x 39.5mm (H) - System is validated for population with a uniform GPU model - Support is not provided for mixed GPU populations - For the latest GPU cards QVL, please contact your GIGABYTE representative Internal 1 x TPM header ...
Page 12
Power Supply Dual 3000W 80 PLUS Titanium redundant power supply AC Input: - 100-127V~/ 15.5A, 50-60Hz - 200-220V~/ 15.5A, 50-60Hz - 220-240V~/ 15.5A, 50-60Hz DC Input: 240Vdc/ 15.5A(Only for China) DC Output: - Max 1000W/ 100-127V~ + 12.2V/ 81A + 12Vsb/ 3A - Max 2600W/ 200-220V~...
Page 13
System Aspeed® AST2600 management controller Management GIGABYTE Management Console (AMI MegaRAC SP-X) web interface Dashboard HTML5 KVM Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.) Sensor Reading History Data FRU Information SEL Log in Linear Storage / Circular Storage Policy ...
Rear System Button and LEDs Name Color Status Description Green System is powered on Power Button with LED System is not powered on or in ACPI S5 state (power off) ID Button Press the button to activate system identification Reset Button Press the button to reset the system.
Power Supply Unit (PSU) LED PSU LED State Description No AC power to all power supplies 1Hz Green Blinking AC present / only standby on / Cold redundant mode 2Hz Green Blinking Power supply firmware updating mode AC cord unplugged or AC power lost; with a second power supply in parallel still with AC input power Amber Power supply critical event causing shut down:...
Hard Disk Drive LEDs HDD Present RAID SKU Rebuilding LED1 Locate HDD Fault Access (No Access) Disk LED Green ON(*1) BLINK (*2) (LED on Back Panel) Amber No RAID configuration Green ON(*1) (via PCH, HBA) Removed HDD Slot (LED on Back Panel) Amber Green BLINK (*2)
Chapter 3 System Hardware Installation Pre-installation Instructions Computer components and electronic circuit boards can be damaged by discharges of static electricity. Working on computers that are still connected to a power supply can be extremely dangerous. Follow the simple guidelines below to avoid damage to your computer or injury to yourself.
Removing Chassis Cover Before you remove or install the system cover • Make sure the system is not turned on or connected to AC power. System Hardware Installation - 20 -...
Installing the Memory Read the following guidelines before you begin to install the memory: • Make sure that the motherboard supports the memory. It is recommended that memory of the same capacity, brand, speed, and chips be used. • Always turn off the computer and unplug the power cord from the power outlet before installing the memory to prevent hardware damage.
3-2-2 Installing a Memory Before installing a memory module, make sure to turn off the computer and unplug the power cord from the power outlet to prevent damage to the memory module. Be sure to install DDR5 DIMMs on this motherboard. Follow these instructions to install the Memory: Insert the DIMM memory module vertically into the DIMM slot, and push it down.
3-2-4 Memory Population Table 4 th Gen Intel Xeon Scalable Processors-SP Memory Support Speed (MT/s); Voltage (V); DIMM per Channel (DPC) Ranks Per DIMM and DIMM Capacity (GB) Type Data Width 1DPC 2DPC 16Gb 24Gb 36Gb 1.1V SRx8 (RC D) 16GB 24GB SRx4 (RC C)
Installing the GPU Card • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to installing a PCI card.
Page 27
For Slot3/Slot4/Slot5/Slot6 Follow these instructions to install the GPU card: [For GPU8/GPU9/GPU10/GPU11] Loosen and remove the two screws securing the PCI cage at the top of the system. [For GPU0/GPU1/GPU2/GPU3] Loosen and remove the single screw at the top of the system and the two screws at the rear of the system securing the PCI cage.
Page 28
(For Slot5/Slot6) System Hardware Installation - 28 -...
Installing a PCI Express Card • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to installing a PCI card.
Page 31
Follow these instructions to install a PCI Express x16 card on left side of the system: Loosen the thumbnail screw securing the PCI Express card bracket on the left side of the system. Remove the PCI Express card bracket from the system. Install the PCI Express card into the bracket.
Reinsert the HDD tray into the slot and close the locking lever. CAUTION! We strongly recommend using enterprise level hard disk drives in the Gigabyte server system. For more information of recommended HDDs, please visit the Gigabyte website: https://www.gigabyte.com and search for the specific product QVL from Support & Downloads.
Replacing the Power Supply CAUTION! • In order to reduce the risk of injury from electric shock, disconnect AC power from the power supply before removing it from the system. Follow these instructions to replace the power supply: Pull up the power supply handle and press the retaining clip on the right side of the power supply along the direction of the arrow.
• Consult with immersion cooling tank vendor to ensure compatibility and read their tank manual thoroughly. • Do not install a GPU into the system without consulting GIGABYTE first, doing so may cause compatibility issues. Installing Server: Attach the two carabiners to server handles.
Page 36
Installing Optional Handles: Attach the handles to server. Secure the handles with screws. Install server into the tank. NOTE! The optional handles are only for Asperitas tank. System Hardware Installation - 36 -...
Cable Routing Top/Motherboard Bo om/Power Distribu on Board Front Panel IO Cable CPU0 CPU1 A B C D E F G H J K L M N P R T U V W Y AAABAC AD Front Switch/LED Cable Motherboard FP_1 Front IO FP_1...
Page 42
12V Standby Power Connector 2 x 9 Pin Power Connector 2 x 2 Pin Power Connector Front Panel Header (Secondary) System Battery Cable Connector Motherboard Components - 42 -...
Chapter 5 BIOS Setup BIOS (Basic Input and Output System) records hardware parameters of the system in the EFI on the motherboard. Its major functions include conducting the Power-On Self-Test (POST) during system startup, saving system parameters, loading the operating system etc. The BIOS includes a BIOS Setup program that allows the user to modify basic system configuration settings or to activate certain system features.
Page 46
Main This setup page includes all the items of the standard compatible BIOS. Advanced This setup page includes all the items of AMI BIOS special enhanced features. (ex: Auto detect fan and temperature status, automatically configure hard disk parameters.) ...
The Main Menu Once you enter the BIOS Setup program, the Main Menu (as shown below) appears on the screen. Use arrow keys to move among the items and press <Enter> to accept or enter other sub-menu. Main Menu Help The on-screen description of a highlighted setup option is displayed on the bottom line of the Main Menu.
Page 48
Parameter Description BIOS Information Project Name Displays the project name information. Project Version Displays version number of the BIOS setup utility. Build Date and Time Displays the date and time when the BIOS setup utility was created. BMC Information (Note1) BMC Firmware Version (Note1) Displays BMC firmware version information.
Page 49
Parameter Description Memory Frequency Displays the frequency information of the installed memory. (Note2) Onboard LAN Information LAN# MAC Address Displays LAN MAC address information. (Note3) System Date Sets the date following the weekday-month-day-year format. System Time Sets the system time following the hour-minute-second format. (Note2) This section will display capacity and frequency information of the memory that the customer has installed.
Advanced Menu The Advanced Menu displays submenu options for configuring the function of various hardware components. Select a submenu item, then press <Enter> to access the related submenu screen. When Boot Mode Select is set to UEFI (Default) When "Boot Mode Select" is set to Legacy in the Boot > Boot Mode Select section BIOS Setup - 50 -...
5-2-1 Trusted Computing Parameter Description Configuration Enable/Disable BIOS support for security device. OS will not show security device. TCG EFI protocol and INT1A interface will not be Security Device Support available. Options available: Enable, Disable. Default setting is Enable. BIOS Setup - 51 -...
5-2-2 Serial Port Console Redirection Parameter Description Console redirection enables the users to manage the system from a COM1 Console remote location. Redirection (Note) Options available: Enabled, Disabled. Default setting is Disabled. Press [Enter] to configure advanced items. Please note that this item is configurable when COM1 Console Redirection is set to Enabled.
Page 53
Parameter Description Parity – A parity bit can be sent with the data bits to detect some transmission errors. – Even: parity bit is 0 if the num of 1's in the data bits is even. – Odd: parity bit is 0 if num of 1's in the data bits is odd. –...
Page 54
Parameter Description Legacy Console Redirection Press [Enter] to configure advanced items. Redirection COM Port – Selects a COM port for Legacy serial redirection. – Default setting is COM1. Resolution – Selects the number of rows and columns used in Console Redirection for legacy OS support.
Page 55
Parameter Description Flow Control EMS – Flow control can prevent data loss from buffer overflow. When sending data, if the receiving buffers are full, a 'stop' signal can Serial Port for Out-of-Band be sent to stop the data flow. Once the buffers are empty, a 'start' EMS Console Redirection signal can be sent to re-start the flow.
5-2-3 SIO Configuration Description Parameter Displays the AMI SIO driver version information. AMI SIO Driver Version Super IO Chip Logical Device(s) Configuration Press [Enter] to configure advanced items. Use This Device – When set to Enabled allows you to configure the serial port settings. When set to Disabled, displays no configuration for the serial port.
Page 58
Parameter Description PCI Bus Driver Version Displays the PCI Bus Driver version information. When enabled, this setting will initialize the device expansion PCI Express Slot # I/O ROM (Note1) ROM for the related PCI-E slot. Options available: Enabled, Disabled. Default setting is Enabled. Enable/Disable the onboard LAN1/ LAN2 devices, and initializes Onboard LAN1/ LAN2 I/O ROM (Note2)
5-2-5 USB Configuration Parameter Description USB Configuration USB Devices: Displays the USB devices connected to the system. Enable/Disable the XHCI (USB 3.0) Hand-off support. XHCI Hand-off Options available: Enabled, Disabled. Default setting is Enabled. USB Mass Storage Driver Enable/Disable the USB Mass Storage Driver Support. Support Options available: Enabled, Disabled.
5-2-9 Chipset Configuration Parameter Description Defines the power state to resume to after a system shutdown that is due to an interruption in AC power. When set to Last State, the system will return to the active power state prior to shutdown. When set to Restore on AC Power Loss (Note) Power Off, the system remains off after power shutdown.
5-2-10 Tls Auth Configuration Parameter Description Press [Enter] for configuration of advanced items. Enroll Cert – Press [Enter] to enroll a certificate • Enroll Cert Using File • Cert GUID Server CA Configuration Input digit character in 1111111-2222-3333-4444-1234567890ab format. –...
Page 68
Description Parameter Press [Enter] to view the firmware version information of the device. Firmware Image Properties Press [Enter] to configure advanced items. Link Speed – Default setting is Auto Negotiated. Wake On LAN – Enables power on of the system via LAN. Note that configuring Wake on LAN in the operating system does not change the value of NIC Configuration this setting, but does override the behavior of Wake on LAN in OS...
Page 70
Parameter Description Press [Enter] to configure advanced items. Create new VLAN VLAN ID – Sets VLAN ID for a new VLAN or an existing VLAN. – Press the <+> / <-> keys to increase or decrease the desired values. –...
Chipset Menu Chipset Setup menu displays submenu options for configuring the function of Platform Controller Hub(PCH). Select a submenu item, then press <Enter> to access the related submenu screen. BIOS Setup - 72 -...
Description Parameter Processor Configuration Press [Enter] to configure advanced items. CPU Socket 0/1 Configuration – Core Disable Bitmap(Hex) • Number of Cores to enable. 0 means all cores. FFFFFFF Pre-Socket Configuration means to disable all cores. The maximum value depends on the number of CPUs available.
Page 75
Description Parameter Options available: Enable, Disable. Default setting is Disable. Debug Consent Enable/Disable total memory encryption (TME). Total Memory Encryption (TME) Options available: Enabled, Disabled. Default setting is Disabled. BIOS Setup - 75 -...
5-3-2 Common RefCode Configuration Parameter Description Common RefCode Configuration Selects the MMIO High Base setting. MMIO High Base Options available: 56T, 40T, 32T, 24T, 16T, 4T, 2T, 1T, 512G, 3584T. Default setting is 56T. Selects the allocation size used to assign memory-mapped I/O (MMIO) resources.
5-3-3 UPI Configuration Description Parameter Press [Enter] to configure advanced items. Uncore Status – Press [Enter] to view the Uncore status. Link Frequency Select – Selects the UPI link frequency. – Options available: 9.6GT/s, 10.4GT/s, 11.2GT/s, Auto. Default setting is Auto.
5-3-4 Memory Configuration Description Parameter Integrated Memory Controller (iMC) When set to Enable, the system enforces Plan Of Record restrictions for DDR4 frequency and voltage programming. Enforce POR Options available: POR, Disable. Default setting is Disable. Configures the maximum memory frequency. If Enforce POR is disabled, user will be able to run at higher frequencies than the Memory Frequency memory support (limited by processor support).
Page 79
Description Parameter Enable/Disable Automatic restoring of NVDIMMs. Restore NVDIMMs Options available: Enable, Disable. Default setting is Enable. Controls if NVDIMMs are interleaved together or not. Interleave NVDIMMs Options available: Enable, Disable. Default setting is Enable. Enable/Disable Assert ADR on Reset. Assert ADR on Reset Options available: Enabled, Disabled.
Page 80
Description Parameter Sparing SW Error Match Threshold – Correctable Error Threshold (1-32767) used for bank level information. – Press the <+> / <-> keys to increase or decrease the desired values. Correctable Error Time Window – Correctable Error time window based interface in hour (0-24). –...
5-3-5 IIO Configuration Description Parameter IIO Configuration Press [Enter] to configure advanced items. ® Intel VT for Directed I/O – Enable/Disable the Intel VT for Directed I/O (VT-d) support function by reporting the I/O device assignment to VMM through DMAR ACPI Tables.
5-3-6 Advanced Power Management Configuration Description Parameter Advanced Power Management Configuration Press [Enter] to configure advanced items. SpeedStep (Pstates) – Conventional Intel SpeedStep Technology switches both voltage and frequency in tandem between high and low levels in response to processor load. –...
Page 84
Description Parameter Press [Enter] to configure advanced items. Hardware P-States – When this item is disabled, the processor hardware chooses a P-state based on OS Request (Legacy P-States). – In Native mode, the processor hardware chooses a P-state based Hardware PM State Control on OS guidance.
Description Parameter PCH Configuration Press [Enter] to configure advanced items. SATA Controller – Enable/Disable SATA controller. – Options available: Enable, Disable. Default setting is Enable. Configure SATA as – Configures on chip SATA type. – AHCI Mode: When set to AHCI, the SATA controller enables its AHCI functionality.
Page 87
Description Parameter Port 0/1/2/3/4/5/6/7 – Enable/Disable Port 0/1/2/3/4/5/6/7 device. – Options available: Enable, Disable. Default setting is Enable. Hot Plug (for Port 0/1/2/3/4/5/6/7) (Note 2) – Enable/Disable HDD Hot-Plug function. PCH SATA Configuration – Options available: Enable, Disable. Default setting is Enable. (continued) Spin Up Device (for Port 0/1/2/3/4/5/6/7) (Note 2)
5-3-8 Miscellaneous Configuration Description Parameter Miscellaneous Configuration Selects the active video type. Options available: Auto, Onboard Device, PCIE Device, Specific PCIE Active Video Device. Default setting is Auto. BIOS Setup - 88 -...
5-3-9 Server ME Configuration Parameter Description General ME Configuration Oper. Firmware Version Displays the operational firmware version. ME Firmware Status #1/#2 Displays ME Firmware status information. Current State Displays ME Firmware current status information. Error Code Displays ME Firmware status error code. Recovery Cause Displays ME Firmware recovery cause.
5-3-11 Power Policy Description Parameter Selects a Power Policy Quick Setting. Options available: Standard, Best Performance, Energy Efficient, Turbo Power Policy Quick Settings Lock. Default setting is Standard. Conventional Intel SpeedStep Technology switches both voltage and frequency in tandem between high and low levels in response to processor SpeedStep (Pstates) load.
Page 93
Description Parameter The Hyper Threading Technology allows a single processor to execute two or more separate threads concurrently. When hyper-threading is enabled, multi-threaded software applications can execute their threads, Hyper-Threading [ALL] thereby improving performance. Options available: Enabled, Disabled. Default setting is Enabled. Options available: Enabled, Disabled.
Server Management Menu Parameter Description Enable/Disable FRB-2 timer (POST timer). FRB-2 Timer Options available: Enabled, Disabled. Default setting is Disabled. FRB-2 Timer (Note1) Configures the FRB2 Timer timeout. The value is between 1 to 30 minutes. timeout Default setting is 6 minutes. Configures the FRB2 Timer policy.
Page 95
Parameter Description System Event Log Press [Enter] to configure advanced items. View FRU Press [Enter] to view the FRU information. Information BMC VLAN Press [Enter] to configure advanced items. Configuration BMC network Press [Enter] to configure advanced items. Configuration IPv6 BMC Network Press [Enter] to configure advanced items.
5-4-1 System Event Log Parameter Description Enabling / Disabling Options Change this item to enable or disable all features of System Event SEL Components Logging during boot. Options available: Enabled, Disabled. Default setting is Enabled. Erasing Settings Choose options for erasing SEL. Options available: No, Erase SEL Yes, On next reset,...
5-4-2 View FRU Information The FRU page is a simple display page for basic system ID information, as well as System product information. Items on this window are non-configurable. (Note) The model name will vary depends on the product you purchased BIOS Setup - 97 -...
5-4-3 BMC VLAN Configuration Description Parameter BMC VLAN Configuration Select to configure BMC VLAN ID. The valid range is from 0 to 4094. When BMC VLAN ID set to 0, BMC VLAN ID will be disabled. Select to configure BMC VLAN Priority. The valid range is from 0 to 7. BMC VLAN Priority When BMC VLAN ID is set to 0, BMC VLAN Priority will not be selected.
5-4-4 BMC Network Configuration Parameter Description BMC network configuration Lan Channel 1 Selects to configure LAN channel parameters statically or dynamically (DHCP). Do nothing option will not modify any BMC network parameters Configuration Address source during BIOS phase. Options available: Unspecified, Static, DynamicBmcDhcp. Default setting is DynamicBmcDhcp.
5-4-5 IPv6 BMC Network Configuration Parameter Description IPv6 BMC network configuration IPv6 BMC Lan Channel 1 Enable/Disable IPv6 BMC LAN channel function. When this item is disabled, the system will not modify any BMC network during BIOS IPv6 BMC Lan Option phase.
Security Menu The Security menu allows you to safeguard and protect the system from unauthorized use by setting up access passwords. There are two types of passwords that you can set: • Administrator Password Entering this password will allow the user to access and change all settings in the Setup Utility. •...
5-5-1 Secure Boot The Secure Boot feature is applicable if supported by your Operating System. If your Operating System is not supporting Secure Boot, the system will hang when starting the Operating System. Parameter Description System Mode Displays if the system is in User mode or Setup mode. Enable/ Disable the Secure Boot function.
Page 103
Parameter Description Press [Enter] to configure advanced items. Please note that this item is configurable when Secure Boot Mode is set to Custom. Factory Key Provision – Allows to provision factory default Secure Boot keys when system is in Setup Mode.
Page 104
Parameter Description Authorized TimeStamps (DBT) – Displays the current status of the Authorized TimeStamps Database. – Press [Enter] to configure a new DBT or load additional DBT from storage devices. Key Management – Options available: Update, Append. (continued) OsRecovery Signatures ...
Boot Menu The Boot menu allows you to set the drive priority during system boot-up. BIOS setup will display an error message if the legacy drive(s) specified is not bootable. Parameter Description Boot Configuration Number of seconds to wait for setup activation key. 65535 (0xFFFF) Setup Prompt Timeout means indefinite waiting.
Page 106
Parameter Description FIXED BOOT ORDER Priorities Press [Enter] to configure the boot order priority. By default, the server searches for boot devices in the following sequence: Hard drive. Boot Option #1 / #2 / #3 / #4 / #5 CD-COM/DVD drive. USB device.
Save & Exit Menu The Save & Exit menu displays the various options to quit from the BIOS setup. Highlight any of the exit options then press <Enter>. Parameter Description Save Options Saves changes made and closes the BIOS setup. Save Changes and Exit Options available: Yes, No.
Page 108
Parameter Description Loads the default settings for all BIOS setup parameters. Setup Defaults are quite demanding in terms of resources consumption. If you are using low-speed memory chips or other kinds of low-performance components Restore Defaults and you choose to load these settings, the system might not function properly.
BIOS POST Beep code (AMI standard) 5-8-1 PEI Beep Codes # of Beeps Description Memory not Installed. Memory was installed twice (InstallPeiMemory routine in PEI Core called twice) Recovery started DXEIPL was not found DXE Core Firmware Volume was not found Recovery failed S3 Resume failed Reset PPI is not available...