Page 1
S251-3O0 Intel Xeon Scalable UP Server System - 2U 26-Bay User Manual Rev. 1.0...
Page 2
GIGABYTE's prior written permission. Documentation Classifications In order to assist in the use of this product, GIGABYTE provides the following types of documentation: User Manual: detailed information & steps about the installation, configuration and use of this product (e.g.
Page 3
Conventions The following conventions are used in this user's guide: NOTE! Gives bits and pieces of additional information related to the current topic. CAUTION! Gives precautionary measures to avoid possible hardware or software problems. WARNING! Alerts you to any damage that might result from doing or not doing specific actions.
Page 4
Server Warnings and Cautions Before installing a server, be sure that you understand the following warnings and cautions. WARNING! To reduce the risk of electric shock or damage to the equipment: • Do not disable the power cord grounding plug. The grounding plug is an important safety feature.
Page 5
Electrostatic Discharge (ESD) CAUTION! ESD CAN DAMAGE DRIVES, BOARDS, AND OTHER PARTS. WE RECOMMEND THAT YOU PERFORM ALL PROCEDURES AT AN ESD WORKSTATION. IF ONE IS NOT AVAILABLE, PROVIDE SOME ESD PROTECTION BY WEARING AN ANTI-STATIC WRIST STRAP AT- TACHED TO CHASSIS GROUND -- ANY UNPAINTED METAL SURFACE -- ON YOUR SERVER WHEN HANDLING PARTS.
Page 6
CAUTION! Risk of explosion if battery is replaced incorrectly or with an incorrect type. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used bat- teries according to the manufacturer’s instructions.
Chapter 1 Hardware Installation Installation Precautions The motherboard/system contain numerous delicate electronic circuits and components which can become damaged as a result of electrostatic discharge (ESD). Prior to installation, carefully read the service guide and follow these procedures: • Prior to installation, do not remove or break motherboard S/N (Serial Number) sticker or warranty sticker provided by your dealer.
Product Specifications NOTE: We reserve the right to make any changes to the product specifications and product-related information without prior notice. 3rd Generation Intel® Xeon® Scalable Processors Intel® Xeon® Platinum Processor, Intel® Xeon® Gold Processor, Intel® Xeon® Silver Processor 10nm technology, CPU TDP up to 270W ...
Page 13
Power Supply Redundant 800W 80 PLUS Platinum hot-swap power supply Socket Security System Aspeed® AST2600 management controller Management GIGABYTE Management Console (AMI MegaRAC SP-X) web interface Security Socket Dashboard ocket Security JAVA Based Serial Over LAN ...
Page 14
Environment Operating temperature: 10°C to 35°C Non-operating temperature: -40°C to 60°C Ambient Security Socket Temperature Operating humidity: 8-80% (non-condensing) Relative Non-operating humidity: 20%-95% (non-condensing) Humidity NOTE! Ambient temperature limited to 30°C if using 280W CPU System ...
Chapter 2 System Appearance System Overview Description Front Panel Buttons and LEDs Side 3.5" Hard Drives Cover System Middle Cover System Back Cover Power Supply Units - 17 - System Appearance...
Front View Description Front Panel LEDs and Buttons USB 3.0 Port x 2 Rear View 2 3 4 5 6 7 PSU2 PSU1 Description VGA Port Serial Port USB 3.0 Port x 4 1 GbE Ethernet LAN Port #2 1 GbE Ethernet LAN Port #1 Server Management LAN Port ID Button with LED 2-5 Front Panel LEDs and Buttons...
Front Panel LEDs and Buttons Name Color Status Description Press the button to activate system identification ID Button Press this button to reset the system. Reset button Indicates the system is powered on. Green Power button System is in ACPI S1 state (sleep mode). Green Blink with LED...
Rear System LEDs and Buttons Name Color Status Description Yellow 1 Gbps data rate 1GbE Green 100 Mbps data rate Speed LED 10 Mbps data rate Link between system and network or no access Green 1GbE Link/ Blink Data transmission or receiving is occurring Activity LED No data transmission or receiving is occurring ID Button...
Power Supply Unit LED PSU LED State Description No AC power to all power supplies 1Hz Green Blinking AC present / only standby on / Cold redundant mode 2Hz Green Blinking Power supply firmware updating mode AC cord unplugged or AC power lost; with a second power supply in parallel still with AC input power Amber Power supply critical event causing shut down:...
Hard Disk Drive LEDs LED2 LED1 LED1 (Green) LED1 (Red) LED2 (Blue) Indicator Drive activity Drive locate/fault/rebuild Drive present BLINK: Drives is active ON: Fault ON: Drive is plugged in Behavior ON or OFF: Idle BLINK 4Hz: Locate OFF: No drive (depend on drive) BLINK 1Hz: Rebuild - 23 -...
Page 24
This page intentionally left blank System Appearance - 24 -...
Chapter 3 System Hardware Installation Pre-installation Instructions Computer components and electronic circuit boards can be damaged by electrostatic discharge. Working on computers that are still connected to a power supply can be extremely dangerous. Follow the simple guidelines below to avoid damage to your computer or injury to yourself. •...
Removing Chassis Cover Before you remove or install the system cover • Make sure the system is not turned on or connected to AC power. Follow these instructions to remove the middle chassis cover: Loosen the thumbscrew securing the chassis cover. Lift up to remove the middle chassis cover.
Removing and Installing the Fan Duct Follow these instructions to remove the fan duct: Lift up to remove the fan duct. To reinstall the fan duct, align the fan duct with the guiding groove. Push down the fan duct until it is firmly seated on the system.
Installing the CPU and Heat Sink Read the following guidelines before you begin to install the CPU: • Make sure that the motherboard supports the CPU. • Always turn off the computer and unplug the power cord from the power outlet before installing the CPU to prevent hardware damage.
Page 29
• To install/remove the Intel heatsink use a T30-Lobe screwdriver or drill bit with a screw torque of 8.0 +/- 0.5kgf*cm - 25 - System Hardware Installation...
Installing the Memory Read the following guidelines before you begin to install the memory: • Make sure that the motherboard supports the memory. It is recommended that memory of the same capacity, brand, speed, and chips be used. • Always turn off the computer and unplug the power cord from the power outlet before installing the memory to prevent hardware damage.
3-4-2 Installing a Memory Before installing a memory module, make sure to turn off the computer and unplug the power cord from the power outlet to prevent damage to the memory module. Be sure to install DDR4 DIMMs on this motherboard. Follow these instructions to install the Memory: Insert the DIMM memory module vertically into the DIMM slot, and push it down.
Installing the PCI Expansion Card • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to installing a PCIe card.
Installing the Hard Disk Drive Read the following guidelines before you begin to install the Hard disk drive: • Take note of the drive tray orientation before sliding it out. • The tray will not fit back into the bay if inserted incorrectly. •...
Page 34
Follow these instructions to install a 2.5" hard disk drive: Press the release button. Extend the locking lever. Pull the locking lever in the direction indicated to remove the HDD tray. Align the hard disk drive with the positioning stud on the HDD tray. Slide the hard disk drive into the HDD tray.
Removing and installing the Fan Wall • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to replacing a system fan.
Replacing the Fan Assembly • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to replacing a system fan.
Replacing the Power Supply Follow these instructions to replace the power supply: Press the retaining clip on the right side of the power supply along the direction of the arrow. Pull out the power supply handle at the same time and pull out the power supply. Insert the replacement power supply firmly into the chassis.
Jumper Setting Clear CMOS CLR_CMOS Enable Default HOST_SMBUS_SEL BIOS defined PMBUS_SEL BIOS defined Stop initial power on S3_MASK Normal [Default] when BMC is not ready DB_PLD CPLD debug mode Normal [Default] ME_UPDATE Force ME update Normal [Default] BIOS_PWD Clear supervisor password Normal [Default] BIOS_RCVR BIOS recovery mode...
Page 48
This page left intentionally blankThis Motherboard Components - 48 -...
Chapter 5 BIOS Setup BIOS (Basic Input and Output System) records hardware parameters of the system in the EFI on the motherboard. Its major functions include conducting the Power-On Self-Test (POST) during system startup, saving system parameters, loading the operating system etc. The BIOS includes a BIOS Setup program that allows the user to modify basic system configuration settings or to activate certain system features.
Page 50
Main This setup page includes all the items of the standard compatible BIOS. Advanced This setup page includes all the items of AMI BIOS special enhanced features. (ex: Auto detect fan and temperature status, automatically configure hard disk parameters.) ...
The Main Menu Once you enter the BIOS Setup program, the Main Menu (as shown below) appears on the screen. Use arrow keys to move among the items and press <Enter> to accept or enter other sub-menu. Main Menu Help The on-screen description of a highlighted setup option is displayed on the bottom line of the Main Menu.
Page 52
Parameter Description BIOS Information Project Name Displays the project name information. Project Version Displays version number of the BIOS setup utility. Build Date and Time Displays the date and time when the BIOS setup utility was created. BMC Information (Note1) BMC Firmware Version Displays BMC firmware version information.
Page 53
Parameter Description Onboard LAN Information LAN1 MAC Address (Note) Displays LAN MAC address information. LAN2 MAC Address (Note) Displays LAN MAC address information. System Date Sets the date following the weekday-month-day-year format. System Time Sets the system time following the hour-minute-second format. (Note) The number of LAN ports listed will depend on the motherboard / system model.
Advanced Menu The Advanced Menu displays submenu options for configuring the function of various hardware components. Select a submenu item, then press <Enter> to access the related submenu screen. BIOS Setup - 54 -...
5-2-1 Trusted Computing Parameter Description Configuration Enable/Disable the TPM support feature. Security Device Support Options available: Enable/Disable. Default setting is Enable. Current Status Information Displays current TPM status information. - 55 - BIOS Setup...
5-2-2 Serial Port Console Redirection Parameter Description Console redirection enables the users to manage the system from a COM1 Console remote location. Redirection (Note)) Options available: Enabled/Disabled. Default setting is Disabled. Press [Enter] to configure advanced items. Please note that this item is configurable when COM1 Console Redirection is set to Enabled.
Page 57
Parameter Description Parity – A parity bit can be sent with the data bits to detect some transmission errors. – Even: parity bit is 0 if the num of 1's in the data bits is even. – Odd: parity bit is 0 if num of 1's in the data bits is odd. –...
Page 58
Parameter Description Legacy Console Redirection Press [Enter] to configure advanced items. Redirection COM Port – Selects a COM port for Legacy serial redirection. – Default setting is COM1. Resolution – Selects the number of rows and columns used in Console Redirection for legacy OS support.
Page 59
Parameter Description Flow Control – Flow control can prevent data loss from buffer overflow. When sending data, if the receiving buffers are full, a 'stop' signal can Serial Port for Out-of-Band be sent to stop the data flow. Once the buffers are empty, a 'start' EMS Console Redirection signal can be sent to re-start the flow.
5-2-3 SIO Configuration Description Parameter Displays the AMI SIO driver version information. AMI SIO Driver Version Super IO Chip Logical Device(s) Configuration Press [Enter] to configure advanced items. Use This Device – When set to Enabled allows you to configure the serial port settings. When set to Disabled, displays no configuration for the serial port.
5-2-4 PCI Subsystem Settings Parameter Description PCI Bus Driver Version Displays the PCI Bus Driver version information. When enabled, this setting will initialize the device expansion PCI Express Slot # I/O ROM (Note1) ROM for the related PCI-E slot. Options available: Enabled/Disabled. Default setting is Enabled. Enable/Disable the onboard LAN1/ LAN2 controller.
5-2-5 USB Configuration Parameter Description USB Configuration USB Devices: Displays the USB devices connected to the system. Enable/Disable the XHCI (USB 3.0) Hand-off support. XHCI Hand-off Options available: Enabled/Disabled. Default setting is Enabled. USB Mass Storage Driver Enable/Disable the USB Mass Storage Driver Support. Support (Note) Options available: Enabled/Disabled.
5-2-8 Chipset Configuration Parameter Description Defines the power state to resume to after a system shutdown that is due to an interruption in AC power. When set to Last State, the system will return to the active power state prior to shutdown. When set to Restore on AC Power Loss (Note) Power Off, the system remains off after power shutdown.
Page 69
Parameter Description Press [Enter] to configure advanced items. Link Speed – Allows for automatic link speed adjustment. – Options available: Auto Negotiated, 10 Mbps Half, 10 Mbps Full, 100 Mbps Half, 100 Mbps Full. Default setting is Auto Negotiated. NIC Configuration Wake On LAN ...
Page 71
Parameter Description Press [Enter] to configure advanced items. Create new VLAN VLAN ID – Sets VLAN ID for a new VLAN or an existing VLAN. – Press the <+> / <-> keys to increase or decrease the desired values. –...
Chipset Setup Menu Chipset Setup menu displays submenu options for configuring the function of Platform Controller Hub(PCH). Select a submenu item, then press <Enter> to access the related submenu screen. - 73 - BIOS Setup...
5-3-1 Processor Configuration Description Parameter Processor Configuration Press [Enter] to configure advanced items. CPU Socket 0 Configuration – Press [Enter] to configure advanced items. Core Disable Bitmap(Hex) Pre-Socket Configuration – Number of Cores to enable. 0 means all cores. FFFFFFF means to disable all cores.
Page 75
Description Parameter Enable/Disable the Intel Trusted Execution Technology support function. Enable Intel(R) TXT Options available: Enable/Disable. Default setting is Disable. Enable/Disable the Vanderpool Technology. This will take effect after rebooting the system. VMX (Vanderpool Technology) Options available: Enable/Disable. Default setting is Enable. Enable/Disable the Safer Mode Extensions (SMX) support function.
5-3-2 Common RefCode Configuration Parameter Description Common RefCode Configuration Selects the MMIO High Base setting. MMIO High Base Options available: 56T, 40T, 24T, 16T, 4T, 1T. Default setting is 56T. Selects the allocation size used to assign mmioh resources. Total mmioh space can be up to 32xgranularity. Per stack mmioh resource assignments are multiples of the granularity where 1 unit MMIO High Granularity Size per stack is the default allocation.
Description Parameter UPI Configuration Press [Enter] to configure advanced items. UPI Status – Press [Enter] to view the UPI status. Link Frequency Select – Selects the UPI link frequency. – Options available: 9.6GB/s, 10.4GB/s, Auto. Default setting is Auto. ...
5-3-4 Memory Configuration Description Parameter Integrated Memory Controller (iMC) When set to Enable, the system enforces Plan Of Record restrictions for DDR4 frequency and voltage programming. When set to Auto, Enforce POR the system sets it to the MRC default settings. Options available: Auto, POR, Disable.
Page 80
Description Parameter Controls if NVDIMMs are interleaved together or not. Interleave NVDIMMs Options available: Enable/Disable. Default setting is Disable. Enable/Disable Assert ADR on Reset. Assert ADR on Reset Options available: Enable/Disable. Default setting is Disable. Enable/Disable Assert ADR on S5. Assert ADR on S5 Options available: Enable/Disable.
5-3-5 IIO Configuration Description Parameter IIO Configuration Press [Enter] to configure advanced items. ® Intel VT for Directed I/O (VT-d) – Enable/Disable the Intel VT for Directed I/O (VT-d) support function by reporting the I/O device assignment to VMM through DMAR ACPI Tables.
Page 82
Description Parameter Post Interrupt – Enable/Disable VT_D posted interrupt. – Options available: Enable/Disable. Default setting is Enable. ® Intel VT for Directed I/O (VT-d) Coherency Support (Non-Isoch) (continued) – Enable/Disable Non-Isoch VT_D Engine Coherency support. – Options available: Enable/Disable. Default setting is Enable. Press [Enter] to configure advanced items.
5-3-6 Advanced Power Management Configuration Description Parameter Advanced Power Management Configuration Press [Enter] to configure advanced items. SpeedStep (Pstates) – Conventional Intel SpeedStep Technology switches both voltage and frequency in tandem between high and low levels in response to processor load. –...
Page 84
Description Parameter Press [Enter] to configure advanced items. Hardware P-States – When this item is disabled, the processor hardware chooses a P-state based on OS Request (Legacy P-States). – In Native mode, the processor hardware chooses a P-state based Hardware PM State Control on OS guidance.
5-3-7 PCH Configuration Description Parameter PCH Configuration Press [Enter] to configure advanced items. SATA Controller – Enable/Disable SATA controller. – Options available: Enable/Disable. Default setting is Enable. Configure SATA as – Configures on chip SATA type. – AHCI Mode: When set to AHCI, the SATA controller enables its AHCI functionality.
Page 86
Description Parameter Port 0/1/2/3/4/5/6/7 – Enable/Disable Port 0/1/2/3/4/5/6/7 device. – Options available: Enable/Disable. Default setting is Enable. Hot Plug (for Port 0/1/2/3/4/5/6/7) (Note 2) – Enable/Disable HDD Hot-Plug function. PCH SATA Configuration – Options available: Enable/Disable. Default setting is Disable. (continued) Spin Up Device (for Port 0/1/2/3/4/5/6/7) (Note 2)
5-3-8 Miscellaneous Configuration Description Parameter Miscellaneous Configuration Selects the active video type. Options available: Auto, Onboard Device, PCIE Device. Default setting is Active Video Auto. - 87 - BIOS Setup...
5-3-9 Server ME Configuration Parameter Description General ME Configuration Oper. Firmware Version Displays the operational firmware version. ME Firmware Status #1/#2 Displays ME Firmware status information. Current State (for ME Firmware) Displays ME Firmware current status information. Error Code (for ME Firmware) Displays ME Firmware status error code.
5-3-11 Power Policy Description Parameter Selects a Power Policy Quick Setting. Options available: Standard, Best Performance, Energy Efficient, Turbo Power Policy Quick Settings Lock. Conventional Intel SpeedStep Technology switches both voltage and frequency in tandem between high and low levels in response to processor SpeedStep (Pstates) load.
Page 92
Description Parameter Configures the state for the C-State package limit. Options available: C0/C1 state, C2 state, C6(non Retention) state, Package C State C6(Retention) state, No Limit, Auto. Default setting is Auto. The Hyper Threading Technology allows a single processor to execute two or more separate threads concurrently.
Server Management Menu Parameter Description Enable/Disable FRB-2 timer (POST timer). FRB-2 Timer Options available: Enabled/Disabled. Default setting is Disabled. Configure the FRB2 Timer timeout. FRB-2 Timer Options available: 3 minutes, 4 minutes, 5 minutes, 6 minutes. Default setting is 6 timeout minutes.
Page 94
Parameter Description Configure OS Watchdog Timer Policy. Options available: Reset, Do Nothing, Power Down, Power Cycle. Default setting is OS Wtd Timer Reset. Policy Please note that this item is configurable when OS Watchdog Timer is set to Enabled. POST wait BMC ready and reboot system. Wait BMC Ready Options available: Disabled, 2 minutes, 4 minutes, 6 minutes.
5-4-1 System Event Log Parameter Description Enabling / Disabling Options Change this item to enable or disable all features of System Event SEL Components Logging during boot. Options available: Enabled/Disabled. Default setting is Enabled. Erasing Settings Choose options for erasing SEL. Erase SEL Options available: No/Yes, On next reset/Yes, On every reset.
5-4-2 View FRU Information The FRU page is a simple display page for basic system ID information, as well as System product information. Items on this window are non-configurable. (Note) The model name will vary depends on the product you purchased BIOS Setup - 96 -...
5-4-3 BMC VLAN Configuration Description Parameter BMC VLAN Configuration Select to configure BMC VLAN ID. The valid range is from 0 to 4094. When BMC VLAN ID set to 0, BMC VLAN ID will be disabled. Select to configure BMC VLAN Priority. The valid range is from 0 to 7. BMC VLAN Priority When BMC VLAN ID is set to 0, BMC VLAN Priority will not be selected.
5-4-4 BMC Network Configuration Parameter Description BMC network configuration Lan Channel 1 Select to configure LAN channel parameters statically or dynamically (DHCP). Do nothing option will not modify any BMC network parameters Configuration Address source during BIOS phase. Options available: Unspecified, Static, DynamicBmcDhcp. Default setting is DynamicBmcDhcp.
5-4-5 IPv6 BMC Network Configuration Parameter Description IPv6 BMC Network Configuration IPv6 BMC Lan Channel 1 Enable/Disable IPv6 BMC LAN channel function. When this item is disabled, IPv6 BMC Lan Option the system will not modify any BMC network during BIOS phase. Options available: Unspecified, Enable, Disable.
Security Menu The Security menu allows you to safeguard and protect the system from unauthorized use by setting up access passwords. There are two types of passwords that you can set: • Administrator Password Entering this password will allow the user to access and change all settings in the Setup Utility. •...
5-5-1 Secure Boot The Secure Boot submenu is applicable when your device is installed the Windows 8 (or above) operating ® system. Parameter Description System Mode Displays if the system is in User mode or Setup mode. Enable/ Disable the Secure Boot function. Secure Boot Options avaiable:Enabled/Disabled.
Page 102
Parameter Description Press [Enter] to configure advanced items. Please note that this item is configurable when Secure Boot Mode is set to Custom. Factory Key Provision – Allows to provision factory default Secure Boot keys when system is in Setup Mode.
Boot Menu The Boot menu allows you to set the drive priority during system boot-up. BIOS setup will display an error message if the legacy drive(s) specified is not bootable. Parameter Description Boot Configuration Number of seconds to wait for setup activation key. 65535 (0xFFFF) Setup Prompt Timeout means indefinite waiting.
Page 104
Parameter Description FIXED BOOT ORDER Priorities Press [Enter] to configure the boot priority. By default, the server searches for boot devices in the following sequence: Hard drive. Boot Option #1 / #2 / #3 / #4 / #5 CD-COM/DVD drive. USB device.
5-6-1 UEFI NETWORK Drive BBS Priorities The UEFI network drive BBS priorities submenu allows you to specify the boot device priority from the available UEFI network drives during system boot-up. BIOS setup will display an error message if the legacy drive(s) specified is not bootable.
5-6-2 UEFI Application Boot Priorities The UEFI application boot priorities submenu allows you to specify the boot device priority from the available UEFI applications during system boot-up. BIOS setup will display an error message if the legacy drive(s) specified is not bootable. BIOS Setup - 106 -...
Save & Exit Menu The Save & Exit menu displays the various options to quit from the BIOS setup. Highlight any of the exit options then press <Enter>. Parameter Description Save Options Saves changes made and closes the BIOS setup. Save Changes and Exit Options available: Yes/No.
Page 108
Parameter Description Default Options Loads the default settings for all BIOS setup parameters. Setup Defaults are quite demanding in terms of resources consumption. If you are using low-speed memory chips or other kinds of low-performance components Restore Defaults and you choose to load these settings, the system might not function properly.
5-8-4 Intel UPI POST Codes Initialize KTIRC inuput structure default values 0xA0 Collect info such as SBSP, Boot Mode, Reset type etc 0xA1 Setup IO SADs in SBSP to access the config space 0xA2 Setup up minimum path between SBSP & other sockets 0xA3 Add the node to the tree Parse the LEP of the discovered socket...
Unsupported topology 0xDC RC Behavior: System Halt SBSP cannot find KPIRC TXEQ Parameters for this 0xDD link in GetSocketLinkEparams(). No retry. RC Behavior: System Halt 5-8-6 Intel MRC POST Codes Detect DIMM population 0xB0 Set DDR frequency 0xB1 Gather remaining SPD data 0xB2 Program registers on the memory controller level 0xB3...
5-8-8 Intel PM POST Codes Start of PPM structure initialization 0xD0 PPM CSR programming 0xD1 PPM MSR programming 0xD2 Start of PState transition init 0xD3 PPM exit 0xD4 PPM On ready to boot event 0xD5 5-8-9 Intel PM POST Codes Start of IIO early Initialization 0xE0 Pre Link training...
BIOS POST Beep code (AMI standard) 5-9-1 PEI Beep Codes # of Beeps Description Memory not Installed. Memory was installed twice (InstallPeiMemory routine in PEI Core called twice) Recovery started DXEIPL was not found DXE Core Firmware Volume was not found Recovery failed S3 Resume failed Reset PPI is not available...