Amd epyc 7002 up server system - 2u 4 nodes (131 pages)
Summary of Contents for Gigabyte H262-P61
Page 1
H262-P61 HPC Server – Ampere Altra Max - ARM Server - DP 2U 4-Nodes User Manual Rev. 1.0...
Page 2
GIGABYTE's prior written permission. Documentation Classifications In order to assist in the use of this product, GIGABYTE provides the following types of documentation: User Manual: detailed information & steps about the installation, configuration and use of this product (e.g.
Page 3
Conventions The following conventions are used in this user's guide: NOTE! Gives bits and pieces of additional information related to the current topic. CAUTION! Gives precautionary measures to avoid possible hardware or software problems. WARNING! Alerts you to any damage that might result from doing or not doing specific actions.
Page 4
Server Warnings and Cautions Before installing a server, be sure that you understand the following warnings and cautions. WARNING! To reduce the risk of electric shock or damage to the equipment: • Do not disable the power cord grounding plug. The grounding plug is an important safety feature.
Page 5
Electrostatic Discharge (ESD) CAUTION! ESD CAN DAMAGE DRIVES, BOARDS, AND OTHER PARTS. WE RECOMMEND THAT YOU PERFORM ALL PROCEDURES AT AN ESD WORKSTATION. IF ONE IS NOT AVAILABLE, PROVIDE SOME ESD PROTECTION BY WEARING AN ANTI-STATIC WRIST STRAP AT- TACHED TO CHASSIS GROUND -- ANY UNPAINTED METAL SURFACE -- ON YOUR SERVER WHEN HANDLING PARTS.
Page 6
CAUTION! Risk of explosion if battery is replaced incorrectly or with an incorrect type. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used bat- teries according to the manufacturer’s instructions.
Table of Contents Chapter 1 Hardware Installation ..................9 Installation Precautions ..................9 Product Specifications ..................10 System Block Diagram ................... 14 Chapter 2 System Appearance ..................15 Front View ...................... 15 Rear View ....................... 16 Front Panel LED and Buttons ................ 17 Rear System LAN LEDs .................
Page 8
Chapter 2 BIOS Setup ....................45 The Main Menu ....................47 Advanced Menu ..................... 50 2-2-1 Trusted Computing ....................51 2-2-2 ACPI Settings ......................52 2-2-3 APEI Configuration ....................53 2-2-4 General Watchdog Timer ..................54 2-2-5 X86 Emulation Configuration ..................55 2-2-6 PCI Subsystem Settings ..................56 2-2-7 Info Report Configuration ..................62 2-2-8...
Chapter 1 Hardware Installation Installation Precautions The motherboard/system contain numerous delicate electronic circuits and components which can become damaged as a result of electrostatic discharge (ESD). Prior to installation, carefully read the user manual and follow these procedures: • Prior to installation, do not remove or break motherboard S/N (Serial Number) sticker or warranty sticker provided by your dealer.
Product Specifications NOTE: We reserve the right to make any changes to the product specifications and product-related information without prior notice. Ampere® Altra® Max or Altra® Processor Dual processors, 7nm technology Up to 128-core per processor, TDP up to 190W ...
Page 11
Storage Per node: 2 x 2.5" SATA hot-swappable HDD/SSD bay Total: Socket Secur i t y Ser ver Oper ating P r oper t i es 8 x 2.5" SATA hot-swappable HDD/SSD bays Expansion Slots Per node: Power Suppl y 2 x Low profile half-length slots with PCIe x16 (Gen4 x16 bus) ...
Page 12
Rear I/O Per node: 2 x USB 3.2 Gen1 1 x Mini DP 2 x RJ45 Socket Secur i t y Ser ver Oper ating P r oper t i es 1 x RJ45 MLAN Power Suppl y Total: 8 x USB 3.2 Gen1 ...
Page 13
System Aspeed® AST2600 management controller Management GIGABYTE Management Console (AMI MegaRAC SP-X) web interface Dashboard Secur i t y Ser ver Oper ating P r oper t i es HTML5 KVM Sensor Monitor (Voltage, RPM, Temperature, CPU Status …etc.) ...
Chapter 2 System Appearance Front View Decription Front Panel LEDs and buttons • Please Go to Chapter 2-3 Front Panel LED and Buttons for detail description of function LEDs. System Appearance - 15 -...
Rear View Decription PCIe Card Slot #1 PCIe Card Slot #2 CMC LAN Port Mezzanine Card Slot (Option/OCP V3.0 Card) 10/100/1000 Server Management LAN Port GbE LAN Port x 2 USB 3.0 Port x 2 Mini DP Port System Appearance - 16 -...
Front Panel LED and Buttons NODE1 NODE3 NODE2 NODE4 No. Name Color Status Description Green System is operating normally. Critical condition, may indicate: System fan failure System temperature Amber Non-critical condition, may indicate: System Redundant power module failure Blink Status LED Temperature and voltage issue Chassis intrusion System is not ready, may indicate:...
Rear System LAN LEDs Name Color Status Description Yellow 1Gbps data rate 1GbE Green 100 Mbps data rate Speed LED 10 Mbps data rate Link between system and 1GbE Green network or no access Link/ Blink Data transmission or receiving is occurring Activity LED No data transmission or receiving is occurring System Appearance...
Power Supply Unit LED PSU LED State Description No AC power to all power supplies 0.5Hz Green Blinking AC present / only standby on / Cold redundant mode 2Hz Green Blinking Power supply firmware updateing mode AC cord unplugged or AC power lost; with a second power supply in parallel still with AC input power Amber Power supply critical event causing shut down:...
Hard Disk Drive LEDs HDD Present RAID SKU Rebuilding LED1 Locate HDD Fault Access (No Access) Disk LED Green ON(*1) BLINK (*2) (LED on Back Panel) Amber No RAID configuration Green ON(*1) (via PCH/HBA) Removed HDD Slot (LED on Back Panel) Amber Green BLINK (*2)
Chapter 3 System Hardware Installation Pre-installation Instructions Computer components and electronic circuit boards can be damaged electrostatic discharge. Working on computers that are still connected to a power supply can be extremely dangerous. Follow the simple guidelines below to avoid damage to your computer or injury to yourself.
Installing the Hard Disk Drive Read the following guidelines before you begin to install the Hard disk drive: • Take note of the drive tray orientation before sliding it out. • The tray will not fit back into the bay if inserted incorrectly. •...
Removing the Node Follow these instructions to remove a node: Press the release latch while simultaneously pushing down the tray handle for the node. Pull the node out of the system. To install the node, push the node back into the system. System Hardware Installation - 23 -...
Removing Chassis Cover Before you remove or install the system cover • Make sure the system is not turned on or connected to AC power. Follow these instructions to remove the system cover: Loosen and remove the six screws securing the back cover. Slide the cover to the rear of the system and remove the cover in the direction of the arrow.
Removing and Installing the Fan Duct Follow these instructions to remove/install the fan duct: Remove the two screws securing the fan ducts. Lift up to remove the fan ducts To install the fan duct, align the fan duct with the guiding groove. Push down the fan duct into chassis until its firmly seats, then install the four screws to secure the fan ducts in place.
Removing and Installing the Heatsink Read the following guidelines before you begin to install the heatsink: • Always turn off the computer and unplug the power cord from the power outlet before installing the heatsink to prevent hardware damage. • Unplug all cables from the power outlets. •...
Page 27
CPU1 Heatsink: To install the heatsink, reverse the steps above while ensuring that you tighten the captive screws in sequential order (1g2g3g4) as seen in the image below. CPU0 Heatsink CPU1 Heatsink: System Hardware Installation - 27 -...
Installing the CPU Read the following guidelines before you begin to install the CPU: • Make sure that the motherboard supports the CPU. • Always turn off the computer and unplug the power cord from the power outlet before installing the CPU to prevent hardware damage. •...
Installing Memory Read the following guidelines before you begin to install the memory: • Make sure that the motherboard supports the memory. It is recommended that memory of the same capacity, brand, speed, and chips be used. • Always turn off the computer and unplug the power cord from the power outlet before installing the memory to prevent hardware damage.
3-7-2 Installing the Memory Before installing a memory module, make sure to turn off the computer and unplug the power cord from the power outlet to prevent damage to the memory module. Be sure to install DDR4 DIMMs on this motherboard. Follow these instructions to install the Memory: Insert the DIMM memory module vertically into the DIMM slot, and push it down.
Installing the PCI Expansion Card • The PCI riser assembly does not include a riser card or any cabling as standard. To install a PCI card, a riser card must be installed. Follow these instructions to install the right PCI Expansion card: Remove the two screws securing the riser bracket to the system.
Page 33
Follow these instructions to install the left PCI Expansion card: Remove the three screws on the riser bracket to the system. Lift up the riser bracket out of system. Remove the screw securing the side bracket to the riser bracket. Remove the side bracket Align the PCI-E card to the riser guide slot and push in the direction of the arrow until the PCI-E card sits in the PCI card connector.
Installing the Mezzanine Card 3-9-1 Installing the OCP 3.0 Mezzanine Card Use of the following type of OCP 3.0 NIC is recommended: • OCP 3.0 SFF with pull tab • OCP 3.0 SFF with ejector latch Follow these instructions to install an OCP 3.0 Mezzanine card: Remove the one screw securing the OCP 3.0 card slot cover.
3-10 Replacing the Fan Assembly • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to replacing a system fan.
3-11 Replacing the Power Supply Follow these instructions to replace the power supply: Pull up the power supply handle and press the retaining clip on the right side of the power supply along the direction of the arrow. At the same time, pull out the power supply by using its handle. Insert the replacement power supply firmly into the chassis.
3-12 Replacing Power Distribution Board Cage Before you remove or install the power distribution board cage: • Make sure the system is not turned on or connected to AC power. Follow these instructions to remove the power distribution board cage: Loosen and remove the four screws securing the cage.
3-13 Cable Routing Front Switch Cable/Front LED Cable PMBus Cable System Hardware Installation - 38 -...
Page 39
Power Distribution Board to Middle BoardCable (Top) Power Distribution Board to Middle BoardCable (Bottom) System Hardware Installation - 39 -...
Page 40
Top Middle Board to HDD Back Plane Board Cable (SATA1) SATA1 Bottom Middle Board to HDD Back Plane Board Cable (SATA2) SATA2 System Hardware Installation - 40 -...
Page 41
Top Middle Board to HDD Back Plane Board Cable (SATA3) SATA3 Bottom Middle Board to HDD Back Plane Board Cable (SATA4) SATA4 System Hardware Installation - 41 -...
Chapter 4 Motherboard Components Motherboard Components CPU0 CPU1 9 10 Item Description OCP Mezzanine 3.0 Connector Proprietary PCIe Slot #2 (Gen 4/x16 slot/GENZ_2) Server Management LAN Port GbE LAN Ports USB 3.0 Port x 2 Mini DP Port NCSI Switch BMC Readiness LED M.2 Connector (PCIe x4, Supports NGFF-22110) SlimLine SAS Connector (SATA0/SATA)
Backplane Board Storage Connector 4-3-1 CBPH080 Item Description SlimLine SAS Connector (N1 SATA) SlimLine SAS Connector (N1 U.2 A) SlimLine SAS Connector (N2 U.2 A) SlimLine SAS Connector (N2 SATA) SlimLine SAS Connector (N3 U.2 A) SlimLine SAS Connector (N3 SATA) SlimLine SAS Connector (N4 U.2 A) SlimLine SAS Connector (N4 SATA) Motherboard Components...
Chapter 2 BIOS Setup BIOS (Basic Input and Output System) records hardware parameters of the system in the EFI on the motherboard. Its major functions include conducting the Power-On Self-Test (POST) during system startup, saving system parameters, loading the operating system etc. The BIOS includes a BIOS Setup program that allows the user to modify basic system configuration settings or to activate certain system features.
Page 46
Main This setup page includes all the items of the standard compatible BIOS. Advanced This setup page includes all the items of AMI BIOS special enhanced features. (ex: Auto detect fan and temperature status, automatically configure hard disk parameters.) ...
The Main Menu Once you enter the BIOS Setup program, the Main Menu (as shown below) appears on the screen. Use arrow keys to move among the items and press <Enter> to accept or enter other sub-menu. Main Menu Help The on-screen description of a highlighted setup option is displayed on the bottom line of the Main Menu.
Page 48
Parameter Description BIOS Information Access Level Displays the privileges level information. System Project Name Displays the system project name information. Project Name Displays the motherboard project name information Project Version Displays version number of the BIOS setup utility. Build Date and Time Displays the date and time when the BIOS setup utility was created.
Page 49
Parameter Description System Language Option: English. System Date Sets the date following the weekday-month-day-year format. System Time Sets the system time following the hour-minute-second format. BIOS Setup - 49 -...
Advanced Menu The Advanced Menu displays submenu options for configuring the function of various hardware components. Select a submenu item, then press <Enter> to access the related submenu screen. BIOS Setup - 50 -...
2-2-1 Trusted Computing Parameter Description Configuration Enable/Disable BIOS support for security device. OS will not show security device. TCG EFI protocol and INT1A interface will not be Security Device Support available. Options available: Enable, Disable. Default setting is Enable. BIOS Setup - 51 -...
Page 57
Parameter Description AMI PCI Driver Version Displays the AMI PCI Bus Driver version information PCI Settings Common for all Devices: Enable/Disable Single Root IO virtualization support. SR-IOV Support Options available: Disabled, Enabled. Default setting is Enabled. Change Settings of the following PCI Devices: Press [Enter] to configure advanced items.
Page 58
2-2-6-1 PCI Express GEN 1 Settings Parameter Description PCI Express Device Register Settings Enable/disable PCI Express Device Relaxed Ordering. Relaxd Ordering Options available: Enabled, Disabled. Default setting is Enabled. If enabled, allows device to use 8-bit tag field as a requester. Extended Tag Options available: Enabled, Disabled.
Page 59
Parameter Description If supported by hardware and set to "Enabled", the device is permitted to use CLKREQ# signal for power management of Link Clock Power Management clock in accordance to protocol defined in appropriate form factor specification. Options available: Enabled, Disabled. Default setting is Disabled. Defines number of Retry attempts software will take to retrain the Link Training Retry link if previous training attempt was unsuccessful.
Page 60
2-2-6-2 PCI Express GEN 2 Settings Parameter Description PCI Express GEN2 Device Register Settings I n d e v i c e f u n c t i o n s t h a t s u p p o r t c o m p l e t i o n t i m e o u t programmability, allows system software to modify the completion timeout value.
Page 61
Parameter Description If supported by hardware and set to 'Enabled', outbound AtomicOp Egress Blocking AtomicOp Requestsvia Egress Ports will be blocked. Options available: Enabled, Disabled. Default setting is Disabled. If supported by hardware and set to 'Enabled', this permits setting the number of ID-Based Ordering (IDO) bit (Attribute[2]) requests IDO Request Enable to be initiated.
2-2-7 Info Report Configuration Description Parameter Post Report Enable/disable post report support. Post Report Options available: Enabled, Disabled. Default setting is Enabled. Options available: 0,1,2,3,4,5,6,7,8,9,10, Until Press ESC. Delay Time Default setting is 1. Error Message Report Enable/disable Info error message support. Info Error Message Options available: Enabled, Disabled.
2-2-8 USB Configuration Parameter Description USB Configuration USB Module Version Displays the USB module version information. USB Controllers Displays the supported USB controllers. USB Devices: Displays the USB devices connected to the system. Enable/Disable the XHCI (USB 3.0) Hand-off support. XHCI Hand-off Options available: Enabled, Disabled.
2-2-10 IP Configuration Parameter Description IP Configuration Settings Provides the Options to Configure the IP Address Options available: Disabled, Every Boot, On Demand. Auto Configuration Default setting is Disabled. BIOS Setup - 65 -...
2-2-11 NVMe Configuration Parameter Description NVMe controller and Drive Displays the NVMe devices connected to the system information BIOS Setup - 66 -...
2-2-12 SATA Configuration Parameter Description Displays the installed HDD devices information. System will automatically SATA Configuration detect HDD type. BIOS Setup - 67 -...
2-2-14 Power Restore Configuration Parameter Description Specifies what state when power is re-applied after a power failure (G3 state). Power Restore Options available: Power Off, Power On, Last State. Default setting is Last State. BIOS Setup - 69 -...
2-2-15 Broadcom NetXtreme-E 2Px10GBASE-T OCP 3.0 Ethernet Parameter Description Press [Enter] to view firmware image information. Firmware Image Menu Press [Enter] to configure advanced items. Multi-Function Mode – Configures the NIC Hardware Mode. – Options available: SF, NPAR 1.0. Default setting is SF. Number of VFs Per PF ...
Page 71
Description Parameter Energy Efficient Ethernet – Enable/Disable Energy Efficient Ethernet operation. – Options available: Enabled, Disabled. Default setting is Disabled. Operational Link Speed – Configures the link speed setting to be used as the default link speed for the selected port. –...
Page 72
Parameter Description Setup Key Stroke – Configures key strokes to invoke the configuration menu. – Options available: Ctrl-S, Ctrl-B. Default setting is Ctrl-S. Banner Message Timeout – Selects the timeout value. (0 defaults to 4 seconds, 15 is no delay, 1-14 is timeout value in seconds) –...
Page 73
2-2-15-1 iSCSI Boot Configuration Menu Parameter Description Press [Enter] to configure advanced items. TCP/IP Parameters via DHCP – Acquires TCP/IP Parameters via DHCP. – Options available: Enabled, Disabled. Default setting is Enabled. IP Autoconfiguration – Auto-configures the IP configuration. –...
Page 74
Description Parameter Use TCP Timestamp – Enable/Disable the TCP timestamp. – Options available: Enabled, Disabled. Default setting is Disabled. Target as First HDD – Enable/Disable target appears as first hard disk drive (HDD) in the system. – Options available: Enabled, Disabled. Default setting is Disabled. iSCSI General Parameters LUN Busy Retry Count ...
Page 75
Description Parameter Boot LUN – Configures the Target boot LUN number (0-255). iSCSI Name – Configures the iSCSI name. CHAP ID iSCSI First/Second Target – Configures the Challenge-Handshake Authentication Protocol Parameters (continued) (CHAP) ID (up to 128 characters in length). CHAP Secret ...
2-2-16 MAC IPv4 Network Configuration Parameter Description Indicates whether network address is configured successfully or not. Configured Options available: Enabled, Disabled. Default setting is Disabled. Options available: Enabled, Disabled. Default setting is Enabled. Enable DHCP (Note) Local IP Address Press [Enter] to configure local IP address. (Note) Press [Enter] to configure local NetMask.
2-2-17 MAC IPv6 Network Configuration Parameter Description Press [Enter] to configure advanced items. Displays the MAC Address information. Interface ID – The 64 bit alternative interface ID for the device. The string is colon separated. e.g. ff:dd:88:66:cc:1:2:3. DAD Transmit Count ...
Chipset Setup Menu Chipset Setup menu displays submenu options for configuring the function of North Bridge. Select a submenu item, then press <Enter> to access the related submenu screen. Parameter Description CPU Configuration Press [Enter] for configuration of advanced items. RAS Configuration Press [Enter] for configuration of advanced items.
2-3-1 CPU Configuration Parameter Description CPU Configuration Number of processors/cores Displays the number of installed processor information. enabled Inter Socket Connection: Displays the Inter socket connection information. Link0/1 Controls Link speed for Inter socket connection. Inter Socket Connection Speed Options available: Default, 16GT/s, 20GT/s, 25GT/s. Default setting is Configured Default.
Page 81
Parameter Description Enable/Disable L1/L2 Prefetch for each core. L1/L2 Prefetch Options available: Enabled, Disabled. Default setting is Enabled. L1C I/D Displays the technical specifications for the installed processor Warrenty BIOS Setup - 81 -...
Server Management Menu Parameter Description BMC Self Test Status/ BMC Device ID/ BMC Device Revision/ Displays the technical specification of the BMC controller. BMC Firmware Revision/ IPMI Version/ BMC Interface(s) BMC Support Options available: Enabled, Disabled. Default setting is Enabled. System Event Log Press [Enter] to configure advanced items.
2-4-1 System Event Log Parameter Description Enabling / Disabling Options Change this item to enable or disable all features of System Event SEL Components Logging during boot. Options available: Enabled, Disabled. Default setting is Enabled. Erasing Settings Choose options for erasing SEL. Erase SEL Options available: No/Yes, On next reset/Yes, On every reset.
2-4-2 Bmc self test log Parameter Description Log area usage = 00 out of 20 logs Erase Log Options available: Yes, On every reset/ No. Default setting is No. Options available: Clear Log, Do not log any more. Default setting is Do When log is full not log any more.
2-4-3 View FRU Information The FRU page is a simple display page for basic system ID information, as well as System product information. Items on this window are non-configurable. (Note) The model name will vary depends on the product you purchased BIOS Setup - 90 -...
2-4-4 BMC Network Configuration Parameter Description BMC network configuration Lan Channel 1 Selects to configure LAN channel parameters statically or dynamically (DHCP). Do nothing option will not modify any BMC network parameters Configuration Address source during BIOS phase. Options available: Unspecified, Static, DynamicBmcDhcp. Default setting is DynamicBmcDhcp.
Security Menu The Security menu allows you to safeguard and protect the system from unauthorized use by setting up access passwords. There are two types of passwords that you can set: • Administrator Password Entering this password will allow the user to access and change all settings in the Setup Utility. •...
2-5-1 Secure Boot The Secure Boot submenu is applicable when your device is installed the Windows 8 (or above) operating ® system. Parameter Description System Mode Displays if the system is in User mode or Setup mode. Enable/ Disable the Secure Boot function. Secure Boot Options available: Enabled, Disabled.
Page 94
Parameter Description Press [Enter] to configure advanced items. Please note that this item is configurable when Secure Boot Mode is set to Custom. Factory Key Provision – Allows to provision factory default Secure Boot keys when system is in Setup Mode.
Page 95
Parameter Description OsRecovery Signatures – Displays the current status of the OsRecovery Signature Database. Key Management – Press [Enter] to configure a new OsRecovery Signature or load (continued) additional OsRecovery Signature from storage devices. – Options available: Update, Append. BIOS Setup - 95 -...
Boot Menu The Boot menu allows you to set the drive priority during system boot-up. BIOS setup will display an error message if the legacy drive(s) specified is not bootable. Parameter Description Boot Configuration Number of seconds to wait for setup activation key. 65535 (0xFFFF) Setup Prompt Timeout means indefinite waiting.
Page 97
Parameter Description FIXED BOOT ORDER Priorities Press [Enter] to configure the boot priority. By default, the server searches for boot devices in the following sequence: Hard drive. Boot Option #1 / #2 / #3 / #4 / #5 CD-COM/DVD drive. USB device.
Save & Exit Menu The Save & Exit menu displays the various options to quit from the BIOS setup. Highlight any of the exit options then press <Enter>. Parameter Description Save Options Saves changes made and closes the BIOS setup. Save Changes and Exit Options available: Yes, No.
Page 99
Parameter Description Press [Enter] to save changes as the user defaults without exit BIOS Save as User Defaults setup. Restore User Defaults Press [Enter] to restore the user defaults . Boot Override Press [Enter] to configure the device as the boot-up drive. Launch EFI Shell from Attempts to Launch EFI Shell application (Shell.efi) from one of the filesystem device...
BIOS POST Beep code (AMI standard) 2-8-1 PEI Beep Codes # of Beeps Description Memory not Installed. Memory was installed twice (InstallPeiMemory routine in PEI Core called twice) Recovery started DXEIPL was not found DXE Core Firmware Volume was not found Recovery failed S3 Resume failed Reset PPI is not available...