Page 2
The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage.
Technical Support email addresses can be found at: "Contacting Supermicro" on page 11 If you have any feedback on Supermicro product manuals, contact our writing team at: Techwriterteam@supermicro.com This manual may be periodically updated without notice. Check the Supermicro website for...
SuperServer SYS-422GA-NBRT-LCC: Preface Conventions Used in the Manual Special attention should be given to the following symbols for proper installation and to prevent damage done to the components or injury to yourself. Warning! Indicates important information given to prevent equipment/property damage or personal injury.
SuperServer SYS-422GA-NBRT-LCC: Contents Contents Contacting Supermicro Chapter 1: Introduction 1.1 Overview 1.2 System Features Front View Control Panel Rear View 1.3 System Architecture Main Components System Block Diagram Motherboard Block Diagram 1.4 Motherboard Quick Reference Motherboard Layout Quick Reference Table Chapter 2: Server Installation 2.1 Unpacking the System...
Page 6
SuperServer SYS-422GA-NBRT-LCC: Contents Chapter 3: Maintenance and Component Installation 3.1 Removing Power 3.2 Accessing the System Removing the Chassis Cover Accessing the CPU, GPU, and I/O Trays 3.3 Static-Sensitive Devices Precautions 3.4 Memory Support and Installation Memory Support The Intel® Xeon® 6 Processors...
Page 7
SuperServer SYS-422GA-NBRT-LCC: Contents Chapter 4: Motherboard Connections, Jumpers, and LEDs 4.1 Power Supply and Power Connections Power Supply Connections 4.2 Headers and Connections External BMC I²C Header Liquid Cooling Leakage Sensor Headers MCIO PCIe 5.0 x8 Connectors MCIO PCIe 5.0 x16 Connectors...
Page 8
SuperServer SYS-422GA-NBRT-LCC: Contents Direct Links for the SYS-422GA-NBRT-LCC System Direct Links for General Support and Information 7.2 Baseboard Management Controller (BMC) 7.3 Troubleshooting Procedures Before Power On No Power No Video System Boot Failure Memory Errors Losing the System's Setup Configuration If the System Becomes Unstable 7.4 CMOS Clear...
Page 9
Serial Port Console Redirection Menu Network Stack Configuration Menu PCIe/PCI/PnP Configuration Menu ACPI Settings Menu Trusted Computing Menu Supermicro KMS Server Configuration Menu Super-Guardians Configuration Menu HTTP Boot Configuration Menu System Diagnostics Configuration Menu Intel(R) Ethernet Controller Menu TLS Authenticate Configuration Menu...
Page 10
SuperServer SYS-422GA-NBRT-LCC: Contents Comply with Local and National Electrical Codes Product Disposal Fan Warning Power Cable and AC Adapter Appendix B: System Specifications Appendix C: General Data Center Environmental Specifications...
SuperServer SYS-422GA-NBRT-LCC: Introduction Chapter 1: Introduction This chapter provides a brief outline of the functions and features of the SYS-422GA-NBRT- LCC system. It is based on the X14DBG-DAP motherboard and the CSE-GP403TS-R000NP chassis. 1.1 Overview 1.2 System Features Front View Rear View 1.3 System Architecture...
SuperServer SYS-422GA-NBRT-LCC: Introduction 1.1 Overview This chapter provides a brief outline of the functions and features of the SuperServer SYS- 422GA- NBRT- LCC. The following provides an overview of the system specifications and capabilities. System Overview Motherboard X14DBG-DAP Chassis CSE-GP403TS-R000NP Dual Intel®...
Page 14
SuperServer SYS-422GA-NBRT-LCC: Introduction Notes: A Quick Reference Guide can be found on the following page of the Supermicro website: https://www.supermicro.com/en/products/system/gpu/4u/sys-422ga-nbrt-lcc The following safety model associated with the SYS-422GA-NBRT-LCC has been certified as compliant with UL or CSA: GP403LC-Q66X14.
SuperServer SYS-422GA-NBRT-LCC: Introduction 1.2 System Features The following views of the system display the main features. Refer to the System Specifications appendix of this manual for additional specifications. Front View The following features are located on the front of the SYS-422GA-NBRT-LCC server.
SuperServer SYS-422GA-NBRT-LCC: Introduction Control Panel The following switches and LEDs are located on the SYS-422GA-NBRT-LCC server control panel. Figure 1-2. SYS-422GA-NBRT-LCC Control Panel Control Panel Features Feature Description Power On/ The Power LED indicates that the power is on and the system is running. When Overheat LED blinking, this indicates that a system overheat event has been detected.
SuperServer SYS-422GA-NBRT-LCC: Introduction Rear View The following features are located on the rear of the SYS-422GA-NBRT-LCC server. Figure 1-3. SYS-422GA-NBRT-LCC Rear View System Features: Rear Feature Description Power Supplies Four redundant 6600 W Titanium level power supplies RJ45 Ports Two 10G RJ45 ports...
SuperServer SYS-422GA-NBRT-LCC: Introduction 1.3 System Architecture This section covers the locations of the system's main components and provides a system block diagram. Main Components Figure 1-4. SYS-422GA-NBRT-LCC Main Component Locations System Features: Top Feature Description DIMM Slots 24 DIMM slots Processors Dual Intel®...
Page 20
SuperServer SYS-422GA-NBRT-LCC: Introduction Figure 1-5. SYS-422GA-NBRT-LCC PCIe Tray Component Locations PCIe Tray Features: Top Feature Description One BMC/IPMI port Two 10G RJ45 ports Ten PCIe 5.0 x16 slots 1–10 Note: Slot 1 is PCIe 5.0 x16 (with x8 bandwidth), and slots 2–9 are for East-West...
SuperServer SYS-422GA-NBRT-LCC: Introduction System Block Diagram The following block diagram displays the connections and relationships between the subsystems and major components of the SYS-422GA-NBRT-LCC server. Figure 1-6. SYS-422GA-NBRT-LCC System Block Diagram...
SuperServer SYS-422GA-NBRT-LCC: Introduction Motherboard Block Diagram The following block diagram displays the connections and relationships between the subsystems and major components of the X14DBG-DAP motherboard. Figure 1-7. X14DBG-DAP Motherboard Block Diagram...
SuperServer SYS-422GA-NBRT-LCC: Introduction 1.4 Motherboard Quick Reference For details on the X14DBG-DAP motherboard layout and other quick reference information, refer to the content below. Motherboard Layout This chapter provides detailed information on the components installed on the X14DBG-DAP motherboard, as well as the features supported by the HGX B200 server.
Page 24
SuperServer SYS-422GA-NBRT-LCC: Introduction Figure 1-9. X14DBG-DAP Motherboard Layout Notes: "Maintenance and Component Installation" on page 36 for detailed information on jumpers, connectors, and LED indicators. "■" indicates the location of pin 1. Components not documented are for internal testing-purposes only.
SuperServer SYS-422GA-NBRT-LCC: Introduction Quick Reference Table Jumper Description Jumper Settings JBT1 CMOS Clear Open (normal) Description Status LEDPWR1 Power LED LED On: Onboard Power On Connector Description Onboard Battery EJBF3_1A, EJBF3_1B, Connections to Riser MCIO A/B EJBF3_2A, EJBF3_2B EJNIC1–EJNIC6 Internal Connections EJNVME1–EJNVME5...
Page 27
SuperServer SYS-422GA-NBRT-LCC: Introduction Connector Description JPGW1–JPGW10 CEM5 GPU Power Connectors P54V_JPWR1 Fan Board +54 V Connection JPWR1–JPWR7 +12 V Connections to Backplane and Riser Cards JSW_PWR1–JSW_PWR3 Main Power Connections from Midplane to Motherboard JTPM1 Trusted Platform Module/Port 80 Connector JUSB...
SuperServer SYS-422GA-NBRT-LCC: Server Installation Chapter 2: Server Installation This chapter provides advice and instructions for mounting your server in a server rack. If your server is not already fully integrated with processors, system memory, etc., refer to "Maintenance and Component Installation" on page 36 for details on installing those specific components.
SuperServer SYS-422GA-NBRT-LCC: Server Installation 2.1 Unpacking the System Inspect the box the server was shipped in and note if it was damaged in any way. If any equipment appears damaged, file a damage claim with the carrier who delivered it.
SuperServer SYS-422GA-NBRT-LCC: Server Installation 2.2 Preparing for Setup The box in which the SYS- 422GA- NBRT- LCC server was shipped should include the rackmount hardware needed to install it into the rack. Read this section in its entirety before you begin the installation.
SuperServer SYS-422GA-NBRT-LCC: Server Installation Use a regulating uninterruptible power supply (UPS) to protect the server from power surges and voltage spikes and to keep your system operating in case of a power failure. Allow any drives and power supply modules to cool before touching them.
SuperServer SYS-422GA-NBRT-LCC: Server Installation Ambient Operating Temperature If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer’s maximum rated ambient temperature (TMRA).
SuperServer SYS-422GA-NBRT-LCC: Server Installation 2.3 Installing the Rails This section provides information on installing the CSE-GP403TS-R000NP chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly from the instructions provided. You should also refer to the installation instructions that came with the rack unit you are using.
SuperServer SYS-422GA-NBRT-LCC: Server Installation 2.4 Installing the Chassis into a Rack Once rails are attached to the rack, the chassis is ready to be installed onto the rack-mounted rails. Important: Use caution when mounting or removing the system from the rack. For large systems, at least one other person must assist during installation or removal.
SuperServer SYS-422GA-NBRT-LCC: Server Installation 2.5 Connecting to a Coolant Distribution Unit (CDU) Important: Use caution when mounting or removing the system from the rack. For large systems, at least one other person must assist during installation or removal. Follow the safety recommendations printed on the rails.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Chapter 3: Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components for the SYS-422GA-NBRT-LCC server. To prevent compatibility issues, only use components that match the specifications and/or part numbers given.
Page 37
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation PCIe Cards 3.10 Power Supply Replacing the Power Supply...
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 3.1 Removing Power Before performing some setup or maintenance tasks, use the following procedure to ensure that power has been removed from the SYS-422GA-NBRT-LCC server. This step is necessary when removing or installing non hot-swap components or when replacing a non-redundant power supply.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 3.2 Accessing the System The SYS-422GA-NBRT-LCC server features a removable top cover, which allows easy access to the inside of the server. Removing the Chassis Cover Removing the chassis cover enables quick access to some components of the system.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Accessing the CPU, GPU, and I/O Trays The SYS-422GA-NBRT-LCC server features three component trays; a CPU tray and a GPU tray at the front of the server, and an I/O tray at the rear of the server.
Page 41
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Figure 3-4. Remove the I/O Tray...
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 3.3 Static-Sensitive Devices Electrostatic Discharge (ESD) can damage electronic components. To avoid damaging your motherboard, it is important to handle it very carefully. The following measures are generally sufficient to protect your equipment from ESD.
3.4 Memory Support and Installation Important: To prevent any damage, exercise extreme care when installing or removing memory modules. Note: Check the Supermicro website for recommended memory modules. Memory Support The X14DBG-DAP motherboard supports ECC DDR5 memory with speeds up to 6400 MT/s (1DPC), and MRDIMM DDR5 memory with speeds up to 8800 MT/s (1DPC) in 24 memory slots.
Page 44
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation ® ® Intel Xeon 6900-Series Processors with P-Cores DDR5 Memory Population Table (2 Processors and 24 DIMMs Installed, 1DPC) 1 Processor Memory Population Sequence (1DPC) DIMM Counts 1 Processor P1-DIMMA1 and 1 DIMM 1 Processor...
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation ® ® Intel Xeon 6900-Series Processors with P-Cores DDR5 Memory Population Table (2 Processors and 24 DIMMs Installed, 1DPC) P1-DIMMA1/P1-DIMMB1/P1-DIMMC1/P1-DIMMD1/P1-DIMME1/P1- DIMMF1/P1-DIMMG1/P1-DIMMH1/P1-DIMMI1/P1-DIMMJ1/P1- DIMMK1/P1-DIMML1 2 Processors and 24 DIMMs P2-DIMMA1/P2-DIMMB1/P2-DIMMC1/P2-DIMMD1/P2-DIMME1/P2- DIMMF1/P2-DIMMG1/P2-DIMMH1/P2-DIMMI1/P2-DIMMJ1/P2- DIMMK1/P2-DIMML1 General Guidelines for Optimizing Memory Performance Use DDR5 memory of the same type, size, and speed.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation DIMM Installation Important: To avoid causing any damage to the memory module or the DIMM socket, do not use excessive force when pressing the release tabs on the ends of the DIMM socket. Handle memory modules with care.
Page 47
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 4. Align the notches on both ends of the module against the receptive points on the ends of the slot. Figure 3-7. Aligning the Notches 5. Press both ends of the module straight down into the slot until the module snaps into place.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation DIMM Removal Important: To avoid causing any damage to the memory module or the DIMM socket, do not use excessive force when pressing the release tabs on the ends of the DIMM socket. Handle memory modules with care.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 3.5 Motherboard Battery Removal and Installation Battery Removal To remove the onboard battery, follow the steps below: 1. Power off your system and unplug your power cable. 2. Locate the onboard battery as shown below.
2.5" NVMe drives are mounted in tool-less drive carriers that simplify their removal from the server. These carriers also help promote proper airflow. Note: Enterprise-level storage modules are recommended for use in Supermicro servers. Figure 3-11. Logical Drive Numbers Drive Bay Locations Description 0–7...
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Installing Storage Drives There are eight trays for 2.5" NVMe SSDs on the SYS-422GA-NBRT-LCC server. The drives are mounted in drive carriers that simplify their removal from the server. Important: Except for short periods of time (swapping drives), do not operate the server with the drive carriers removed from the bays, regardless of how many drives are installed, for proper airflow.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Figure 3-13. Installing a Storage Drive in a Carrier 3. If needed, secure the storage drive on to the carrier with bottom screws. 4. Insert the carrier with the storage drive into the open drive bay.
Page 53
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Figure 3-14. Installing an M.2 Drive...
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Hot-Swap for NVMe Drives Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using BMC. Ejecting a Drive 1. BMC > System > Storage Monitoring > Physical View 2.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 3.7 System Cooling Refer to the following sections for information about the cooling capabilities of the SYS-422GA- NBRT-LCC server. Fans Fan speed is controlled by a system temperature setting in the BMC. If a fan fails, the remaining fans will ramp up to full speed.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Air Shrouds Air shrouds concentrate airflow to maximize fan efficiency. Installing an Air Shroud 1. Remove the CPU tray as described in "Accessing the System" on page 2. Ensure the CPU, heatsinks, and configured DIMMs are installed.
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 3.8 GPU The SYS-422GA-NBRT-LCC features an NVIDIA SXM GPU-NVHGX-B200-8180, which is oriented in the server as shown below. Figure 3-18. GPU SXM Slot Locations GPU Mapping BMC Interface GPU Slot OS (NVIDIA-SMI) Numbering Numbering...
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation 3.9 Expansion Cards Refer to the following sections for information on the expansion cards supported by the SYS- 422GA-NBRT-LCC server. PCIe Cards The SYS-422GA-NBRT-LCC server has PCIe expansion slots to support up to two FHHL expansion cards.
In the event of a power module failure, the other power modules will continue to power the system on its own. Failed power supply modules can be replaced without powering down the system. Replacement modules can be ordered directly from Supermicro. Power Supply Indicators...
Page 60
SuperServer SYS-422GA-NBRT-LCC: Maintenance and Component Installation Figure 3-20. Installing a Power Supply Module...
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs Chapter 4: Motherboard Connections, Jumpers, and LEDs This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here.
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs 4.1 Power Supply and Power Connections For information about the power supply and power connections of the SYS-422GA-NBRT-LCC server, refer to the following content. Power Supply Connections Important: To provide adequate power to your system, be sure to connect the main power supplies (JSW_PWR1/JSW_PWR2/JSW_PWR3) to the power supply.
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs 4.2 Headers and Connections For information about the headers of the SYS-422GA-NBRT-LCC server, refer to the following content. External BMC I²C Header A System Management Bus header for the BMC is located at JIPMB1 on the X14DBG-DAP motherboard.
An NVMe SMBus (I²C) header is located at JNVI2C1 on the X14DBG-DAP motherboard. It is used for PCIe SMBus clock and data connections, provides hot- plug support through a dedicated SMBus interface. This feature is only available for a Supermicro complete system with a Supermicro proprietary NVMe add-on card and a proper cable installed.
Page 65
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs Trusted Platform Module Header Pin Definitions: 10 Total Pin# Definition Pin# Definition +3.3 V SPI_CS# RESET# SPI_MISO SPI_CLK Ground SPI_MOSI No Connection +1.8 V Standby SPI_IRQ#...
JFP1 on the X14DBG-DAP motherboard contains header pins for various buttons and LED indicators that are normally located on a control panel at the front of the chassis. These connectors are designed specifically for use with Supermicro chassis. For a detailed diagram of the X14DBG-DAP motherboard, see the layout under "Motherboard...
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs Power Button BMC/BIOS Status LED Indicator Status Event Green: Solid on System power on BMC/BIOS blinking green at 4 Hz BMC/BIOS checking BIOS blinking green at 4 Hz BIOS recovery/update in progress BMC blinking red x2 (two blinks red) at 4 Hz,...
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs LAN1/LAN2 (NIC1/NIC2) LED The Network Interface Controller (NIC) LED connection for LAN Port 1 is located on pin 6 of JFP1 on the X14DBG-DAP motherboard, and LAN Port 2 is on pin 5.
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs +3.3 V Standby Power Pin Definitions: Five Total Pin# Definition I²C Data I²C Clock Ground Power Fail LED Indicators Power Failure LED Indicators are located on pins 15 and 19 of JFP1 on the X14DBG-DAP motherboard.
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs 4.4 Jumper Settings To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with a square solder pad on the printed circuit board.
SuperServer SYS-422GA-NBRT-LCC: Motherboard Connections, Jumpers, and LEDs 4.5 LED Indicators For information about the LED indicators on the SYS-422GA-NBRT-LCC server, refer to the following content. Onboard Power LED The Onboard Power LED is located at LEDPWR1 on the X14DBG-DAP motherboard. When this LED is on, the system is on.
SuperServer SYS-422GA-NBRT-LCC: Software Chapter 5: Software After the SYS-422GA-NBRT-LCC server has been installed, you can install the Operating System (OS), configure RAID settings, and install the drivers. 5.1 Microsoft Windows OS Installation Installing the OS 5.2 Driver Installation 5.3 BMC...
USB flash or media drive, or the BMC KVM console. 2. Retrieve the proper drivers. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities," select the proper driver, and copy it to a USB flash drive.
Page 75
SuperServer SYS-422GA-NBRT-LCC: Software Figure 5-2. Loading the Driver Link To load the driver, browse the USB flash drive for the proper driver files. 5. Once all devices are specified, continue with the installation. 6. After the Windows OS installation has completed, the system will automatically reboot...
SuperServer SYS-422GA-NBRT-LCC: Software 5.2 Driver Installation The Supermicro website contains drivers and utilities for your system at the following page: https://www.supermicro.com/wdl. Some of these drivers and utilities must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard.
For security, each system is assigned a unique default BMC password for the ADMIN user. The password can be found on a sticker on the motherboard and a sticker on the chassis, for Supermicro chassis. The sticker also displays the BMC MAC address. If necessary, the password can be reset using the Supermicro IPMICFG tool.
SuperServer SYS-422GA-NBRT-LCC: Optional Components 6.1 TPM Security Module This is an SPI-capable TPM 2.0 with Infineon 9672 controller. The JTPM1 header is used to connect a Trusted Platform Module (TPM). A TPM is a security device that supports encryption and authentication in hard drives. It enables the X14DBG-DAP motherboard to deny access if the TPM associated with the hard drive is not installed in the SYS-422GA-NBRT-LCC server.
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support Chapter 7: Troubleshooting and Support The following content contains information on common issues and how to resolve them. 7.1 Online Resources Direct Links for the SYS-422GA-NBRT-LCC System Direct Links for General Support and Information 7.2 Baseboard Management Controller (BMC) 7.3 Troubleshooting Procedures...
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support 7.1 Online Resources A great deal of information is available on the Supermicro website. From the top menu of the Supermicro home page at https://www.supermicro.com: Specifications for servers and other hardware are available by clicking Products.
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support 7.2 Baseboard Management Controller (BMC) The SYS-422GA-NBRT-LCC server supports the Baseboard Management Controller (BMC). BMC is used to provide remote access, monitoring, and management. There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at the following page: https://www.supermicro.com/en/solutions/management-software/bmc-resources...
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the "Technical Support Procedures" on page 89 section in this chapter. Always disconnect the AC power cord before adding, changing or installing any non hot-swap hardware components.
BIOS installed in your system. 2. Memory support: Make sure that the memory modules are supported. Refer to the product page on our website at https://www.supermicro.com. Test the modules using memtest86 or a similar utility. Note: Click on the "Tested Memory List" link on the motherboard's product page to...
Page 85
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support 3. Storage Drive support: Make sure that all storage drives work properly. Replace the failed storage drives with good ones. 4. System cooling: Check the system cooling to make sure that all system fans work properly.
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support 7.4 CMOS Clear JBT1 on the X14DBG-DAP motherboard is used to clear CMOS, which will also clear any passwords. For information on clearing CMOS, refer to CMOS Clear earlier in this manual.
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support 7.5 Motherboard Battery For information on removing, disposing of, and replacing the motherboard battery of your system, refer to "Motherboard Battery Removal and Installation" on page...
7.6 Where to Get Replacement Components If you need replacement parts for your SYS-422GA-NBRT-LCC server, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found on the Supermicro website: https://www.supermicro.com...
Before contacting Technical Support, take the following steps. Also, note that as a motherboard manufacturer, Supermicro also sells motherboards through its channels, so it is best to first check with your distributor or reseller for troubleshooting services. They should know of any possible problems with the specific system configuration that was sold to you.
Page 90
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support This warranty only covers normal consumer use and does not cover damages incurred in shipping or from failure due to the alternation, misuse, abuse or improper maintenance of products. During the warranty period, contact your distributor first for any product problems.
SuperServer SYS-422GA-NBRT-LCC: Troubleshooting and Support 7.8 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Email us at Techwriterteam@supermicro.com to provide feedback on our manuals.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.1 Introduction This chapter describes the AMIBIOS™ Setup utility for the motherboard. The BIOS is stored on a chip and can be easily upgraded using the UEFI script (flash.nsh), the BMC WebUI, or the SuperServer Automation Assistant (SAA) utility.
Page 94
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS The Main BIOS screen has two main frames. The left frame displays all the options that can be configured. “Grayed- out” options cannot be configured. The right frame displays the key legend. Above the key legend is an area reserved for a text message. When a BIOS submenu or item is selected in the left frame, it is highlighted in white.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.2 Main Setup The Main setup screen appears when the AMI BIOS Setup utility is first entered. To return to the Main setup screen, select the Main tab at the top of the screen. The Main BIOS setup screen is shown below.
Page 96
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Build Date This feature displays the date when the version of the BIOS ROM used in the system was built. CPLD Version This feature displays the version of the Complex-Programmable Logical Device (CPLD) used in the system.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.3 Advanced Setup Configurations Use the arrow keys to select the Advanced submenu and press <Enter> to access the submenu items. Important: Use caution when changing the Advanced settings. An incorrect value, an improper DRAM frequency, or a wrong BIOS timing setting may cause the system to malfunction.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS are Disabled and Enabled. Note: BIOS POST messages are always displayed regardless of the setting of this feature. Bootup NumLock State Use this feature to set the Power-on state for the <Numlock> key. The options are On and Off.
Page 99
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS The following processor information is displayed: Processor BSP Revision Processor Socket Processor ID Processor Frequency Processor Max Ratio Processor Min Ratio Microcode Revision L1 Cache RAM (Per Core) L2 Cache RAM (Per Package) L3 Cache RAM (Per Package)
Page 100
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS DCU Streamer Prefetcher If this feature is set to Enabled, the Data Cache Unit (DCU) streamer prefetcher will prefetch data streams from the cache memory to the DCU to speed up data accessing and processing to enhance CPU performance. The options are Enabled, Disabled, and Auto.
Page 101
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS APIC Physical Mode Use this feature to enable the APIC physical destination mode. The options are Disabled and Enabled. (APIC is the abbreviation for Extended Advanced Programmable Interrupt Controller.) TXT Support Select Enabled to enable Intel Trusted Execution Technology (TXT) support to enhance system integrity and data security.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Chipset Configuration Menu ►Chipset Configuration Important: Setting the wrong values in this section may cause the system to malfunction. Uncore Configuration Menu ►Uncore Configuration The following information is displayed. Number of CPU Current UPI Link Speed...
Page 103
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Note: Link L1 is an excellent feature for an idle system. L1 is used during Package C-States when its latency is hidden by other components during a wakeup. KTI Prefetch Keizer Technology Interconnect (KTI) is also known as the Intel Ultra Path Interconnect (UPI) technology.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS that a line "reads" in an A state, and all the snoops come back with a "miss." This can happen if another socket reads the line earlier and then has silently dropped it from its cache without modifying it.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Memory Map Menu ►Memory Map Intel(R) Flat Memory Mode Support Enable this feature to allow hardware- managed data movement between DDR5 and CXL memory, making total memory capacity visible to your system. The options are Disabled and Enabled.
Page 106
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS ARM Mirror Percentage (Available when "UEFI ARM Mirror" is set to Enabled) Use this feature to set the percentage of memory space to be used for UEFI ARM mirroring for memory security enhancement. The default setting is 2500.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Enhanced PPR Use this feature to set advanced memory test. Select Enabled to always execute for every boot. The options are Disabled, Enabled, and Persistent. Memory PFA Support (Available when the DCMS key is activated) Select Enabled to enable memory Predictive Failure Analysis (PFA) support. PFA can be used to avoid uncorrectable faults on the same memory page.
Page 108
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS KEY stock amount TME-MT key ID bits TME Encryption Algorithm Use this feature to set the TME encryption algorithm. The options are AES-XTS-128 and AES- XTS-256. ---------------------------------------------------------------- Trust Domain Extensions (TDX) [Outputs] ---------------------------------------------------------------- The following information is displayed.
Page 109
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS TME- MT/TDX Key Split (Available when "Trust Domain Extensions (TDX)" is set to Enabled) Use this feature to set the number of bits for TDX. The other bits will be used by TME-MT. The default setting is 1.
Page 110
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS The following features are available when your motherboard supports SGX. Note: To support SGX features, DIMM population must be symmetric across Integrated Memory Controllers (IMCs) and eight DIMMs per socket at least. For each memory controller, populating the first slots (Px-DIMMX1 or DIMMX1 depending on the motherboard design) in all channels is required.
Page 111
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS EPOCH, and the other is manually entered by the user. Each EPOCH is 64-bit. The options are SGX Owner EPOCH deactivated, Change to New Random Owner EPOCHs, and Manual User Defined Owner EPOCHs. Note: Changing the Owner EPOCH value will lose the data in enclaves.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS SGX Auto MP Registration (Available when "SW Guard Extensions (SGX)" is set to Enabled) Use this feature to enable/disable SGX Auto Multi-Package Registration Agent (MPA) running automatically at boot time. The options are Disabled and Enabled.
Page 113
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Notes: This feature is available when "NVMe Mode Switch" is set to Manual. After you’ve enabled VMD in the BIOS on a PCIe slot, this PCIe slot will be dedicated for VMD use only, and it will no longer support any PCIe device. To re- activate this slot for PCIe use, disable VMD in the BIO.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Disabled and Enabled. Intel VMD Technology When this feature is set to Enabled, VMD support will be automatically enabled when a VROC key is detected by the BIOS. The options are Disabled and Enabled. Intel VT for Directed I/O (VT-d) Menu ►Intel VT for Directed I/O (VT-d)
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Super IO Configuration Menu ►Super IO Configuration The following information is displayed. Super IO Chip Note: This submenu is available when your system supports this feature. Serial Port 1 Configuration Menu ►Serial Port 1 Configuration Serial Port 1 Select Enabled to enable serial port 1.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Change Settings (Available when "Serial Port 2/SOL" above is set to Enabled) Use this feature to specify the base I/O port address and the Interrupt Request address of serial port 2 (or SOL). Select Auto for the BIOS to automatically assign the base I/O and IRQ address to serial port 2 (or SOL).
Page 117
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Terminal Type Use this feature to select the target terminal emulation type for Console Redirection. Select VT100 to use the ASCII Character set. Select VT100+ to add color and function key support. Select ANSI to use the Extended ASCII Character Set. Select VT- UTF8 to use UTF8 encoding to map Unicode characters into one or more bytes.
Page 118
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Resolution 100x31 Select Enabled for extended- terminal resolution support. The options are Disabled and Enabled. Putty KeyPad Use this feature to select function key and keypad settings on Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Flow Control EMS Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Media Detect Count (Available when "Network Stack" is set to Enabled) Use this feature to set the wait time (in seconds) for the BIOS ROM to detect the presence of a LAN media either via the Internet connection or via a LAN port. Press the <+> or <-> key on your keyboard to change the value.
Page 121
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS MMIO High Granularity Size Use this feature to select the high memory size according to memory-address mapping for the I/O hub. The options are 1G, 4G, 16G, 32G, 64G, 256G, and 1024G. This feature is motherboard-dependent.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Note: This feature is available when your motherboard supports onboard LAN ports and when "Onboard LAN1 Option ROM" is set to Disabled. ACPI Settings Menu ►ACPI Settings NUMA Use this feature to enable Non-Uniform Memory Access (NUMA) support to minimize memory access latencies.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Trusted Computing Menu ►Trusted Computing When the TPM 2.0 (either onboard or external) is detected by your system, the following information is displayed. TPM 2.0 Device Found Firmware Version: Vendor: Note: This submenu is available when the TPM 2.0 (either onboard or external) is detected by the BIOS.
Page 124
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Pending Operation (Available when "Security Device Support" is set to Enabled) Use this feature to schedule a TPM-related operation to be performed by the security TPM (either onboard or external) at the next system boot to enhance system data integrity. The options are None and TPM Clear.
Supermicro KMS TCP Port number Use this feature to set the TCP port number used in the Supermicro KMS server. The valid range is 100–9999. The default setting is 5696. Do not change the default setting unless a different TCP port number has been specified and used in the Supermicro KMS server.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS ►Client Private Key Use the three features above to enroll factory defaults or load the KMS Transport Layer Security (TLS) certificates, which are generated by the KMS server, from the file stored in the USB flash drive as shown below.
Page 127
Notes: Be sure that the KMS server is ready before configuring this feature. Use the professional KMS server solutions (e.g., Thales Server) or the Supermicro PyKMIP Software Package to establish the KMS server. KMS Server Retry Count (Available when "TPM Security Policy" and "USB Security Policy"...
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Notes: Be sure to connect a USB flash drive with the Authentication-Key (filename: TPMAuth.bin) to your system before the system reboot. Be sure to save the Authentication-Key (filename: TPMAuth.bin) to the USB flash drive and keep a backup. Load the Authentication-Key (filename: TPMAuth.bin) after the TPM (either onboard or external) is detected by your system.
Page 129
HTTPS Boot Checks Hostname Important: Disabling "HTTPS Boot Checks Hostname" is a violation of RFC 6125 and may expose you to Man-in-the-Middle Attacks. Supermicro is not responsible for any and all security risks incurred by you disabling this feature. Enable this feature for HTTPS boot to check the hostname of the TLS certificates to see if it matches the host name provided by the remote server.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS System Diagnostics Configuration Menu ►System Diagnostics Configuration Launch System Diagnostics Set this feature to Launch Once to launch system diagnostics on next system boot. The options are Disabled and Launch Once. Note: Pressing <F7> during system bootup can also launch system diagnostics.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS The following information is displayed. UEFI Driver Adapter PBA Device Name Chip Type PCI Device ID PCI Address Link Status MAC Address Virtual MAC Address TLS Authenticate Configuration Menu ►TLS Authenticate Configuration Use this submenu to configure Transport Layer Security (TLS) settings.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Use this feature to delete the certificate if a certificate has been enrolled in the system. ►Client Certification Configuration Vlan Configuration ►►Enter Configuration Menu Create New VLAN VLAN ID Highlight this feature and enter a value between 0 and 4094 for the VLAN ID.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.4 Event Logs Use this menu to configure Event Logs settings. Note: After making any changes in this section, please be sure to reboot the system for the changes to take effect. Figure 8-3. Event Log Page ►Change SMBIOS Event Log Settings...
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Erasing Settings Erase Event Log (Available when "SMBIOS Event Log" is set to Enabled) Select No to keep the event log without erasing it upon next system bootup. Select (Yes, Next reset) to erase the event log upon next system reboot. The options are No, (Yes, Next reset), and (Yes, Every reset).
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.5 BMC Use this menu to configure Baseboard Management Console (BMC) settings. Figure 8-4. BMC Setting Page BMC Firmware Revision This feature indicates the BMC firmware revision used in this system. BMC STATUS This feature indicates the status of the BMC firmware installed in this system.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.6 Security Use this menu to configure the following security settings for the system. Figure 8-5. Security Setting Page Disable Block Sid and Freeze Lock (Available when your storage devices support TCG) Select Enabled to allow SID authentication to be performed in TCG storage devices. The options are Disabled and Enabled.
Page 137
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS User Password (Available when "Administrator Password" has been set) This feature indicates if a user password has been installed. Use this feature to set the user password which is required to enter the BIOS Setup utility. The length of the password can be between three and 20 characters long.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.7 Boot Use this menu to configure Boot settings. Figure 8-6. Boot Setting Page FIXED BOOT ORDER Priorities Use this feature to prioritize the order of a bootable device from which the system will boot. Press <Enter> on each item sequentially to select the device.
Page 139
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Path for boot option Use this feature to enter the path for the new boot option in the format fsx:\path\filename.efi. Boot option File Path Use this feature to specify the file path for the new boot option.
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS 8.8 Save & Exit Select Save & Exit from the BIOS Setup screen to configure the settings below. Figure 8-7. Save & Exit Page Save Options Discard Changes and Exit Use this feature to exit from the BIOS Setup utility without making any permanent changes to the system configuration and reboot the computer.
Page 141
SuperServer SYS-422GA-NBRT-LCC: UEFI BIOS Discard Changes Select this feature and press <Enter> to discard all changes made and return to the BIOS Setup utility. Default Options Restore Optimized Defaults Select this feature and press <Enter> to load manufacturer optimized default settings, which are intended for maximum system performance but not for maximum stability.
Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this section in its entirety before installing or configuring components in the Supermicro SYS-422GA-NBRT-LCC server. These warnings may also be found on our website at the following page: https://www.supermicro.com/about/policies/safety_information.cfm...
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems 경고! 이 제품은 전원의 단락(과전류)방지에 대해서 전적으로 건물의 관련 설비에 의존합니다. 보호장 치의 정격이 반드시 250V(볼트), 20A(암페어)를 초과하지 않도록 해야 합니다. Waarschuwing Dit product is afhankelijk van de kortsluitbeveiliging (overspanning) van uw electrische installatie.
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems ¡Advertencia! El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema.
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems Waarschuwing Alleen geautoriseerd personeel en gekwalificeerd onderhoudspersoneel mag deze apparatuur installeren, vervangen of onderhouden. Rack Stability Hazard Warning! Stability hazard. The rack may tip over causing serious personal injury. Before extending the rack to the installation position, read the installation instructions.
Page 151
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems ¡Advertencia! Peligro de inestabilidad. El rack podría volcarse y causar lesiones personales graves. Antes de extender el rack a la posición de instalación, lea las instrucciones de instalación. No coloque ninguna carga sobre el equipo montado sobre rieles deslizantes en la posición de instalación.
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems Waarschuwing Gevaar voor instabiliteit. Het rek kan kantelen en ernstig persoonlijk letsel veroorzaken. Lees de installatie-instructies voordat u het rek uitschuift naar de installatiepositie. Plaats geen last op de op de glijrail gemonteerde apparatuur in de installatiepositie. Laat de op de glijrail gemonteerde apparatuur niet in de installatiepositie staan.
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle Verbindungen entfernt werden. ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones.
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스 작업 시 주의하십시오. Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is. Voorzichtigheid is geboden tijdens het onderhoud.
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems הארצי החשמל חוקי תיאום !אזהרה והארציים המקומיים החשמל לחוקי תואמת להיות חייבת הציוד התקנת اﻟﻤﺘﻌﻠﻘﺔ واﻟﯩﻄﯩﻴﺔ اﻟﻤﺤﻠﻴﺔ ﻟﻠﻘﯩﺎوﻳﻪ ﻳﻤﺘﺜﻞ أن ﻳﺠﺐ اﻟﻜﻬﺮﺑﺎﺋﻴﺔ اﻟﻤﻌﺪات ﺗﺮﻛﻴﺐ ﺑﺎﻟﻜﻬﺮﺑﺎء 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다.
Page 160
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems Warnung Die Entsorgung dieses Produkts sollte gemäß allen Bestimmungen und Gesetzen des Landes erfolgen. ¡Advertencia! Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales. Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement.
Page 164
준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시 오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법 은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다.
Page 165
SuperServer SYS-422GA-NBRT-LCC: Standardized Warning Statements for AC Systems Stroomkabel en AC-Adapter Waarschuwing! Bij het aansluiten van het Product uitsluitend gebruik maken van de geleverde Kabels of een andere geschikte aan te schaffen Aansluitmethode, deze moet altijd voldoen aan de lokale voorschriften en veiligheidsnormen, inclusief de juiste kabeldikte en stekker. Het gebruik van niet geschikte Kabels en/of Adapters kan een storing of brand veroorzaken.
SuperServer SYS-422GA-NBRT-LCC: System Specifications Appendix B: System Specifications Processors Dual Intel® Xeon® 6900-series processors with P-cores (Socket BR LGA 7529), with six UPIs (24 GT/s max. per UPI link) and a thermal design power (TDP) of up to 500 W.
Page 167
SuperServer SYS-422GA-NBRT-LCC: System Specifications System Cooling Five 6-cm internal fans Direct-to-chip cold plate Power Supply Four 6600 W redundant Titanium Level (96%) power supplies: AC Input 5900 W: 200–207.9 Vac / 50–60 Hz 6000 W: 208–219.9 Vac / 50–60 Hz 6300 W: 220–229.9 Vac / 50–60 Hz...
Page 169
SuperServer SYS-422GA-NBRT-LCC: General Data Center Environmental Specifications Appendix C: General Data Center Environmental Specifications Particulate Contamination Specifications Air filtration: Data centers must be kept clean to Class 8 of ISO 14644-1 (ISO 2015). The air entering the data center should be filtered with a MERV 11 filter or better.
Need help?
Do you have a question about the SuperServer SYS-422GA-NBRT-LCC and is the answer not in the manual?
Questions and answers