Table of Contents

Advertisement

SuperServer
®
SYS-821GE-TNHR
USER'S MANUAL
Revision 1.0

Advertisement

Table of Contents
loading

Summary of Contents for Supermicro SuperServer SYS-821GE-TNHR

  • Page 1 SuperServer ® SYS-821GE-TNHR USER’S MANUAL Revision 1.0...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...
  • Page 4: Table Of Contents

    Contents Contents Chapter 1 Introduction 1.1 Overview ..........................9 1.2 System Features ........................10 Front View .........................10 Drive Carrier Indicators ....................11 Control Panel .........................12 Rear View ..........................14 Power Supply Indicator ....................16 Fan Module Indicator .....................16 Top View, Motherboard Tray and Switch Module .............17 Top View, GPU Tray ......................19 1.3 System Block Diagram .......................20 1.4 Motherboard Layout ......................21...
  • Page 5 Contents Processor Overview ......................35 Installation Overview ......................36 Installation Procedure Overview ..................36 Create the Processor Carrier Assembly ................37 Assemble the Processor Heatsink Module ..............41 Remove the Socket Cover ....................43 Install the PHM ........................44 Removing the PHM ......................47 Removing the Carrier Assembly from the Heatsink ............49 Removing the Processor from the Carrier Assembly ............50 3.4 Memory ..........................51 Memory Support ........................51...
  • Page 6 Contents 4.4 Jumpers ..........................72 4.5 LED Indicators ........................73 Chapter 5 Software 5.1 Microsoft Windows OS Installation ..................74 5.2 Driver Installation ........................76 5.3 SuperDoctor 5 ........................77 ® 5.4 BMC ............................78 BMC ADMIN User Password ....................78 Chapter 6 Optional Components 6.1 Power Supply Modules ......................79 6.2 NIC Kit ..........................79 Chapter 7 Troubleshooting and Support 7.1 Information Resources ......................80...
  • Page 7 Contents 7.10 Reporting an Issue ......................93 Technical Support Procedures ..................93 Returning Merchandise for Service ...................93 Vendor Support Filing System ..................94 7.11 Feedback ...........................94 7.12 Contacting Supermicro ......................95 Appendix A Standardized Warning Statements for AC Systems Appendix B System Specifications...
  • Page 8 San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.
  • Page 9: Chapter 1 Introduction

    8U; 17.2” x 14” x 33.2” (depth) (43.7 x 356 x 843 cm) A Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SYS-821GE-TNHR have been certified as compliant with UL and CSA: GP801-Q30X13, GP801-GPU, GP801-30.
  • Page 10: System Features

    Chapter 1: Introduction 1.2 System Features The following views of the system display the main features. Refer to Appendix B for additional specifications. Front View Tray Release Handles Tray Release Handles GPU Tray Fans Motherboard Tray 11 12 13 14 15 16 17 18 19 20 21 22 23 Service/Asset Tag...
  • Page 11: Drive Carrier Indicators

    Chapter 1: Introduction Drive Carrier Indicators Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare.
  • Page 12: Control Panel

    Chapter 1: Introduction Control Panel Power Button UID Button/LED/ BMC Button Power LED HDD LED NIC LED 1 NIC LED 2 Information LED Power Fail LED Figure 1-2. Control Panel Control Panel Features Features Description The main power switch applies or removes primary power from the power supply to the Power Button server but maintains standby power.
  • Page 13 Chapter 1: Introduction Information LED Color, Status Description Blue, solid Unit ID has been activated by switch Blue, blinking at 1Hz Unit ID has been activated using the BMC Blue, blinking at 2Hz, and BMC Heartbeat BMC is resetting LED on the motherboard is green Blue, blinking at 4Hz BMC is setting factory defaults Blue, blinking at 10Hz...
  • Page 14: Rear View

    Chapter 1: Introduction Rear View Fans Power Supply/Fans Expansion Tray Power Supply/Fans Input/Output Panel Figure 1-3. System: Rear View System Features: Rear Feature Description Fans Five exhaust fans, showing logical numbering Eight combination power supply modules with system cooling fans, showing logical Power Supply/Fans numbering PCIe Slots...
  • Page 15 Chapter 1: Introduction Expansion Slot Locations Slot Description PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs...
  • Page 16: Power Supply Indicator

    Chapter 1: Introduction Power Supply Indicator Power Supply Indicator LED Color and State Power Supply Condition Solid Green Indicates that the power supply is on and working Blinking Green Indicates the system is off Solid Amber Indicates failure or needs attention No AC power to module Fan Module Indicator Fan Module Indicator...
  • Page 17: Top View, Motherboard Tray And Switch Module

    Chapter 1: Introduction Top View, Motherboard Tray and Switch Module Switch Module PCIe Switches M.2 Slots (Under Switch module) Processors/ Heatsinks DIMM Slots Figure 1-5. Motherboard Tray: Top View Motherboard Tray Features Feature Description Switch Module Platform for switches and I/O PCIe Switches Four switches to facilitate direct communication between GPUs M.2 Slots...
  • Page 18 Storage Backplane AOM-GP801 - SW/ADP BPN-PDB-GP802 MB-X13DEG AOM-SXM5-IO AOM-GP801-SW/ADP BPN-PDB-GP802 Better Faster Greener™ © 2022 Supermicro Figure 1-6. Motherboard Tray: Components Motherboard Tray Features Feature Description Two add-on modules to facilitate the switch module OR AOM-GP801-SW/ADP NIC adaptor board with PLX switch for Delta-Next GPU system...
  • Page 19: Top View, Gpu Tray

    Chapter 1: Introduction Top View, GPU Tray Figure 1-7. Nvidia HGX H100 8-GPU baseboard: Top View...
  • Page 20: System Block Diagram

    Chapter 1: Introduction 1.3 System Block Diagram The block diagram below shows the connections and relationships between the subsystems and major components of the overall system. 2x M.2 NVMe Figure 1-8. System Block Diagram...
  • Page 21: Motherboard Layout

    Chapter 1: Introduction 1.4 Motherboard Layout Below is a layout of the X13DEG-OAD motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard Manual.
  • Page 22: Quick Reference

    Chapter 1: Introduction Quick Reference Jumper Description Default Setting JBT1 CMOS Clear Open (Normal) Pins 1/3 BMC I²C/SDA for VRM (Default); BMC and PCH I²C/SDA to VRM or JVRM1 Pins 3/5 PCH I²C/SDA for VRM, BMC and PCH I²C/SCL to VRM JVRM2 Pins 2/4: BMC I²C/SCL for VRM (Default);...
  • Page 23 Chapter 1: Introduction Connector Description P2-PCIE3A (JMCIO8A) PCIe 5.0 x8 MCIO connector connected to CPU2 P2-PCIE2A (JMCIO7A) PCIe 5.0 x8 MCIO connector connected to CPU2 P2-PCIE2A (JMCIO7A) PCIe 5.0 x8 MCIO connector connected to CPU2 P2-PCIE1B (JMCIO6B) PCIe 5.0 x8 MCIO connector connected to CPU2 P2-PCIE1A (JMCIO6A) PCIe 5.0 x8 MCIO connector connected to CPU2 P1-PCIE4A (JMCIO4A)
  • Page 24: Motherboard Block Diagram

    Chapter 1: Introduction Motherboard Block Diagram X13DEG-OAD CPU2-A1 CPU2-B1 CPU2-C1 CPU2-D1 CPU1-D1 CPU1-C1 CPU1-B1 CPU1-A1 VR14 VR14 8 PHASE 8 PHASE CPU1 CPU2 DDR5 DDR5 CPU1-H1 CPU1-G1 CPU1-F1 CPU1-E1 CPU2-E1 CPU2-F1 CPU2-G1 CPU2-H1 PECI:31 PECI:30 DMI3 PCI-E X16 G5 MCIO PCI-E X16 G5 MCIO PCI-E X16 G5...
  • Page 25: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory, etc., refer to Chapter 3 for details on installing those specific components.
  • Page 26: Rack Precautions

    Chapter 2: Server Installation Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them. • In single rack installations, stabilizers should be attached to the rack. In multiple rack in- stallations, the racks should be coupled together.
  • Page 27: Mechanical Loading

    Chapter 2: Server Installation Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading. Circuit Overloading Consideration should be given to the connection of the equipment to the power supply circuitry and the effect that any possible overloading of circuits might have on overcurrent protection and power supply wiring.
  • Page 28: Installing The Rails

    Chapter 2: Server Installation 2.4 Installing the Rails There are a variety of rack units on the market, which may require a slightly different assembly procedure. Also refer to the installation instructions that came with the rack. This rail set fits a rack between 28" and 33.5" deep. Do not use a two post "telco" type rack. 1.
  • Page 29 Chapter 2: Server Installation Figure 2-2. Installing the Left Rail Figure 2-3. Outer Rails Installed on the Rack...
  • Page 30: Installing The Server

    Chapter 2: Server Installation 2.5 Installing the Server Caution: The assembled system is quite heavy. Use a lift and multiple people to move it. 1. Using a lift and as many people as necessary, lift the system and slide it onto the installed rails.
  • Page 31: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.
  • Page 32: Accessing The System

    Chapter 3: Maintenance and Component Installation 3.2 Accessing the System The system is comprised of several trays. Each tray can be removed from the chassis using release levers. Before removing the trays, power down, as described in Section 3.1. To replace the trays, be sure the primary handles start in the pulled down position. Once the tray is fully inserted, lift and close the handles to lock the tray in place.
  • Page 33 Chapter 3: Maintenance and Component Installation Primary Release Handles Small Release Handle Figure 3-2. Chassis Front, Removing the Motherboard Tray Removing the Motherboard Tray 1. Pull down the release handles on each side of the tray, and pull the tray part way out. 2.
  • Page 34 Chapter 3: Maintenance and Component Installation Release Handles Figure 3-3. Chassis Rear, Removing the PCIe Expansion Tray Removing the PCIe Expansion Tray • Pull down the release handles on each side of the tray, and pull the tray out. Note: When replacing trays, insert the front motherboard tray before the PCIe tray.
  • Page 35: Processor And Heatsink

    Chapter 3: Maintenance and Component Installation 3.3 Processor and Heatsink Processor Overview The motherboard supports three versions of the 4th Gen Intel Xeon Scalable processors. They differ in the number of cores, and each requires a different CPU carrier. The XCC version supports up to 60 cores, the MCC version supports up to 32 cores, and the Max Series (HBM) version supports up to 56 cores.
  • Page 36: Installation Overview

    (gold contacts). Improper installation or socket misalignment can cause serious damage to the processor or socket, which may require manufacturer repairs. • Refer to the Supermicro website for updates on processor support. Installation Procedure Overview After preparing the system, and following ESD precautions, there are four steps to installing the processor and heatsink onto the motherboard.
  • Page 37: Create The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Create the Processor Carrier Assembly Assembling the Process Carrier Assembly 1. Hold the processor with the gold pins (LGA lands) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below.
  • Page 38 Chapter 3: Maintenance and Component Installation 2. Turn the processor over (with the gold pins up). Locate the CPU keys on the processor and the four latches on the carrier. Latch CPU Key Latch CPU Key Latch Latch Latch CPU Key Latch CPU Key Latch...
  • Page 39 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the processor carrier and press it down (E1A and E1B only). Lever Lever Carrier E1A Carrier E1B 4. Using pin 1 as a guide, carefully align the CPU keys on the processor (A & B) with those on the carrier (a &...
  • Page 40 Chapter 3: Maintenance and Component Installation 5. Once aligned, carefully insert the CPU into the carrier, making sure that the CPU is secured by latches 1, 2, 3, and 4. Processor Carrier Assembly Processor Carrier Assembly (Top View) (Component Side)
  • Page 41: Assemble The Processor Heatsink Module

    Chapter 3: Maintenance and Component Installation Assemble the Processor Heatsink Module Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed. If this is a re-installation, apply the proper amount of thermal grease to the underside of the heatsink.
  • Page 42 Chapter 3: Maintenance and Component Installation 4. Align "a" on the processor carrier assembly with the triangular cutout "A" on the heatsink along with "b", "c", "d" on the processor assembly with "B", "C", "D" on the heatsink. 5. Once properly aligned, place the heatsink on the processor carrier assembly with all corners matched up, making sure that the four clips are properly securing the heatsink.
  • Page 43: Remove The Socket Cover

    Chapter 3: Maintenance and Component Installation Remove the Socket Cover Remove the plastic protective cover from the socket by gently squeezing the grip tabs and pulling the cover off. CPU Socket with Plastic Protective Cover...
  • Page 44: Install The Phm

    Chapter 3: Maintenance and Component Installation Install the PHM To install the PHM into the CPU socket, follow these steps. 1. Locate four threaded fasteners (a, b, c, d) and Pin 1 on the CPU socket. (a, b, c, d: Threaded Fasteners) CPU Socket Pin1 2.
  • Page 45 Chapter 3: Maintenance and Component Installation 3. Check the rotating wires (1, 2, 3, 4) to make sure that they are in the unlatched position. Unlatched State Top View Side View Rotating Wire 1 PEEK Nut 4. Align PEEK nut "A" (next to the trianglular pin 1 on the heatsink) with threaded fastener "a"...
  • Page 46 Chapter 3: Maintenance and Component Installation 6. Press all four rotating wires outward and make sure that the heatsink is securely latched into the CPU socket. Latched State 7. With a t30-bit screwdriver, tighten all PEEK nuts in the sequence of "A", "B", "C", and "D"...
  • Page 47: Removing The Phm

    Chapter 3: Maintenance and Component Installation Removing the PHM To remove the processor heatsink module (PHM) from the motherboard, follow these steps. 1. Shut down the system and unplug the AC power cord from all power supplies. 2. Use a T30-bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence of A, B, C, and D.
  • Page 48 Chapter 3: Maintenance and Component Installation 4. Gently lift the PHM upward to remove it from the CPU socket.
  • Page 49: Removing The Carrier Assembly From The Heatsink

    Chapter 3: Maintenance and Component Installation Removing the Carrier Assembly from the Heatsink To remove the processor carrier assembly from the PHM, follow these steps: 1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown below.
  • Page 50: Removing The Processor From The Carrier Assembly

    Chapter 3: Maintenance and Component Installation Removing the Processor from the Carrier Assembly To remove the processor from the processor carrier, follow these steps. 1. Unlock the lever from its locked position and push it upwards to disengage the processor from the processor carrier as shown below right. Lever 2.
  • Page 51: Memory

    Chapter 3: Maintenance and Component Installation 3.4 Memory Memory Support This motherboard supports up to 8TB 3DS RDIMM/RDIMM DDR5 (288-pin) ECC memory with speeds up to 4800MT/s (1DPC) / 4400MT/s (2DPC) in 32 DIMM slots. LRDIMM/LRDIMM-3DS is not supported. For validated memory, use our Product Resources page.
  • Page 52 Chapter 3: Maintenance and Component Installation Use the DIMM slots listed below for memory modules. This memory population table is based on guidelines provided by Intel to support Supermicro motherboards. Memory Population for the X13, XCC and MCC CPUs, 32 DIMM Slots...
  • Page 53: Memory Population Guidelines

    Balance memory. Using unbalanced memory topology, such as populating two DIMMs in Notes: one channel while populating one DIMM in another channel, reduces performance. It is • Max Se not recommended for Supermicro systems. memory Mode a • In dual-CPU configurations, memory must be installed in the slots associated with the exclusiv installed CPUs.
  • Page 54: Installing Memory

    Chapter 3: Maintenance and Component Installation Installing Memory Electrostatic Discharge (ESD) can damage electronic com ponents including memory modules. To avoid damaging DIMM modules, it is important to handle them carefully. The following measures are generally sufficient. • Use a grounded wrist strap designed to prevent static discharge. •...
  • Page 55: Motherboard Battery

    Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.
  • Page 56: Storage Drives

    The drives are mounted in tool-less drive carriers that simplify their removal from the chassis. These carriers also help promote proper airflow. Drive carrier status indicators are described Section 1.2. Note: Enterprise level storage drives are recommended for use in Supermicro servers. For compatible storage drives, see the system web page.
  • Page 57 Chapter 3: Maintenance and Component Installation To install drives, first remove the drive carrier from the system. Removing a Hot-Swap Drive Carrier 1. Press the release button on the drive carrier, which will extend the drive carrier handle. 2. Use the drive carrier handle to pull the drive out of the chassis. Release Button Figure 3-7.
  • Page 58: Drives

    Chapter 3: Maintenance and Component Installation Installing a Drive 1. Remove the dummy drive, which comes pre-installed in the drive carrier. Pull out the two locking clasps on the left outside of the carrier and lift out the dummy drive. 2.
  • Page 59: Hot-Swap For Nvme Drives

    Chapter 3: Maintenance and Component Installation Hot-Swap for NVMe Drives Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using the BMC Dashboard. Ejecting a Drive 1.
  • Page 60: Checking The Temperature Of An Nvme Drive

    Chapter 3: Maintenance and Component Installation Checking the Temperature of an NVMe Drive There are two ways to check using the BMC Dashboard. Checking a Drive • BMC Dashboard > Server Health > NVMe SSD – Shows the temperatures of all NVMe drives.
  • Page 61: System Cooling

    Chapter 3: Maintenance and Component Installation 3.7 System Cooling Multiple 8-cm fans provide the cooling for the system. Fans may be replaced while the system continues to operate. Cooling is aided by louvers in the chassis that help prevent expelled hot air from returning into the chassis.
  • Page 62: Motherboard Air Shroud

    Chapter 3: Maintenance and Component Installation Motherboard Air Shroud The air shroud system concentrates airflow to maximize fan efficiency. It is installed on the motherboard tray around the CPU heatsinks, and above the DIMMs. Figure 3-11. Installing the Motherboard Air Shrouds...
  • Page 63: Gpu Air Blockers

    Chapter 3: Maintenance and Component Installation GPU Air Blockers Two metal GPU air blockers fit along the sides of the GPU tray to concentrate the airflow. Figure 3-12. Installing the GPU Air Blockers...
  • Page 64: Power Supply

    Standard configuration supports 3 + 3 redundancy. Up to three modules can be offline for service, although that is not recommended. New units can be ordered directly from Supermicro or authorized distributors. Power Supply LEDs On the rear of the power supply module, an LED displays the status.
  • Page 65 Chapter 3: Maintenance and Component Installation Replacing the Power Supply The logical power supply module numbering is shown in Chapter 1. Unplug the AC cord from the module to be replaced. 2. Pull the release handle on the back of the power supply as illustrated. 3.
  • Page 66: Pcie Expansion Cards

    Chapter 3: Maintenance and Component Installation 3.9 PCIe Expansion Cards The system can accommodate 12 PCIe cards. Figure 3-14. Expansion Cards Expansion Slot Locations Slot Description PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs PCIe 5.0 x16 (LP) from PLX switch to GPUs...
  • Page 67: Installing Expansion Cards (1-8)

    Chapter 3: Maintenance and Component Installation Installing Expansion Cards (1–8) Power down the system and pull out the PCIe expansion tray as described in Section 3.2. 2. In the front of the tray, remove the blank PCI shield. 3. Slide the expansion card into the PCIe slot on the PCIe expansion tray floor while aligning the bracket with the chassis.
  • Page 68: Installing Riser Expansion Cards (9-12)

    Chapter 3: Maintenance and Component Installation Installing Riser Expansion Cards (9–12) Expansion cards can be added for slots 9–12 by means of riser cards mounted on riser card brackets as shown below. Power down the system and remove the PCIe tray as described in Section 3.2.
  • Page 69 Chapter 3: Maintenance and Component Installation Riser Card Brackets Riser Card PCI Shield Slots Figure 3-17. Riser Card Brackets and Shields 3. Remove the blank PCI shield that covers the bracket slot. 4. Slide the expansion card(s) into the slot(s) on the riser card while aligning the shield(s) with the bracket.
  • Page 70: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.
  • Page 71: Headers And Connectors

    The JTPM1 header is used to connect a TPM Module for Trust Platform Module/Port 80 support. The TPM module, which is optional and available from Supermicro, is a security device that supports encryption and authentication in storage drives. It allows the motherboard to deny access if the TPM associated with the storage drive is not installed in the system.
  • Page 72 Chapter 4: Motherboard Connections PCIe 3.0 M.2 Slots Two M.2 slots are located at M.2-P1 and M.2-P2. They support PCIe 3.0 x2 M.2 NVMe SSDs in the 2280 and 22110 form factors. Two mounting holes are provided on the motherboard. Use mounting hole MH15 or MH16 for M.2-P2 slot support, and MH17 or MH18 for M.2-P1 slot support.
  • Page 73: Jumpers

    Chapter 4: Motherboard Connections 4.4 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.
  • Page 74: Led Indicators

    Chapter 4: Motherboard Connections 4.5 LED Indicators BMC LAN LEDs A dedicated BMC LAN connection is provided on the I/O riser connector (JSLOT1) by the mezzanine board. The Link LED indicates the speed of the connection. The other LED indicates activity. LAN 1/LAN 2 BMC Link LED Color...
  • Page 75: Chapter 5 Software

    If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals. Installing the OS 1. Create a method to access the MS Windows installation ISO file. That can be a USB flash or media drive.
  • Page 76 Chapter 5: Software 3. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the drive you want to use is not listed, click on “Load driver” link at the bottom left corner. Figure 5-2.
  • Page 77: Driver Installation

    The Supermicro website contains drivers and utilities for your system at https://www. supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to to a USB flash or media drive.
  • Page 78: Superdoctor ® 5

    5.3 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).
  • Page 79: Bmc

    There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.
  • Page 80: Chapter 6 Optional Components

    Chapter 6: Optional Components Chapter 6 Optional Components This chapter describes optional system components and installation procedures. 6.1 Power Supply Modules The default configuration includes six power supply modules. Two more can be added. 6.2 NIC Kit The default configuration includes one expansion card kit (NIC Kit), composed of one AOM- GP801-SW, one AOM-GP801-PCIE, and supporting cables.
  • Page 81: Chapter 7 Troubleshooting And Support

    Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by clicking the Products option. •...
  • Page 82: Bmc Interface

    Security Center for recent security notices Supermicro Phone and Addresses 7.2 BMC Interface The system supports a Baseboard Management Controller (BMC) interface. It provides remote access, monitoring and management. There are several BIOS settings related to the BMC.
  • Page 83: Troubleshooting Procedures

    Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures JAIOM1 AIOM PCIE 5.0X16 Use the following procedures to troubleshoot your system. If you have followed all of the AIOM-A JMCIO-RA1 JMCIO-RA2 AIOM-B procedures below and still need assistance, refer to the Technical Support Procedures MH14 Returning Merchandise for Service...
  • Page 84: System Boot Failure

    Memory: Make sure that the memory modules are supported. Refer to the product page our website at www.supermicro.com. Test the modules using memtest86 or a similar utility. • Storage drives: Make sure that all drives work properly. Replace if necessary.
  • Page 85 Chapter 7: Troubleshooting and Support • Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements. •...
  • Page 86: Bios Error Beep (Post) Codes

    When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20). For information on AMI updates, please refer to http://www.ami.com/products/.
  • Page 87: Crash Dump Using The Bmc Dashboard

    In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using the BMC Dashboard. The BMC manual is available at https://www.supermicro.com/ manuals/other/BMC_Users_Guide_X13.pdf. Check Error Log 1.
  • Page 88: Uefi Bios Recovery

    Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
  • Page 89 Note 1: If you cannot locate the "Super.ROM" file in your drive, visit our website at www. supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
  • Page 90 Chapter 7: Troubleshooting and Support Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below. 4. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update"...
  • Page 91 Chapter 7: Troubleshooting and Support 7. Press <Del> continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press <F4>...
  • Page 92 Chapter 7: Troubleshooting and Support Note: Do not interrupt this process until the BIOS flashing is complete. 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.
  • Page 93: Cmos Clear

    Chapter 7: Troubleshooting and Support 7.7 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.
  • Page 94: Where To Get Replacement Components

    7.9 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.
  • Page 95: Vendor Support Filing System

    For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.11 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Please email us at techwriterteam@supermicro.com to provide feedback on our manuals.
  • Page 96: Contacting Supermicro

    San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.
  • Page 97: Appendix A Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 98 Appendix A: Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 99 Appendix A: Warning Statements . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 100 Appendix A: Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 101 Appendix A: Warning Statements Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 102 Appendix A: Warning Statements Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components. 電源切断の警告 システムコンポーネントの取り付けまたは取り外しのために、...
  • Page 103 Appendix A: Warning Statements ‫אזהרה מפני ניתוק חשמלי‬ ‫!אזהרה‬ ‫יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק‬ ‫.לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים‬ ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت...
  • Page 104 Appendix A: Warning Statements Equipment Installation Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment. 機器の設置 トレーニングを受け認定された人だけがこの装置の設置、 交換、 またはサービスを許可されていま す。 警告 只有经过培训且具有资格的人员才能进行此设备的安装、更换和维修。 警告 只有經過受訓且具資格人員才可安裝、更換與維修此設備。 Warnung Das Installieren, Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem, qualifiziertem Personal gestattet werden.
  • Page 105 Appendix A: Warning Statements Restricted Area Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. (This warning does not apply to workstations). アクセス制限区域...
  • Page 106 Appendix A: Warning Statements ‫אזור עם גישה מוגבלת‬ !‫אזהרה‬ ‫יש להתקין את היחידה באזורים שיש בהם הגבלת גישה. הגישה ניתנת בעזרת‬ (.‫'כלי אבטחה בלבד (מפתח, מנעול וכד‬ . ‫تخصيص هذه انىحذة نترك ب ُ ها ف مناطق محظورة تم‬ ‫، م َ كن انىصىل إن منطقت محظورة فقط من خالل استخذاو أداة خاصت‬ ‫أو...
  • Page 107 Appendix A: Warning Statements Warnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr. Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp. Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers. Attention Danger d'explosion si la pile n'est pas remplacée correctement. Ne la remplacer que par une pile de type semblable ou équivalent, recommandée par le fabricant.
  • Page 108 Appendix A: Warning Statements Redundant Power Supplies Warning! This unit might have more than one power supply connection. All connec- tions must be removed to de-energize the unit. 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります。 ユニッ トの電源を切るためには、 すべての接続を取り外さなければなりません。 警告 此部件连接的电源可能不止一个,必须将所有电源断开才能停止给该部件供电。 警告 此裝置連接的電源可能不只一個,必須切斷所有電源才能停止對該裝置的供電。 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle Verbindungen entfernt werden.
  • Page 109 Appendix A: Warning Statements ‫אם קיים יותר מספק אחד‬ !‫אזהרה‬ ‫ליחדה יש יותר מחיבור אחד של ספק. יש להסיר את כל החיבורים על מנת לרוקן‬ .‫את היחידה‬ . ‫قد يكون لهذا الجهاز عدة اتصاالت بوحدات امداد الطاقة‬ ‫يجب إ ز الة كافة االتصاالت لعسل الوحدة عن الكهرباء‬ 경고! 이...
  • Page 110 Appendix A: Warning Statements Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf. Vorsicht bei der Wartung. ¡Advertencia! Cuando el sistema está en funcionamiento, el voltaje del plano trasero es peligroso. Tenga cuidado cuando lo revise. Attention Lorsque le système est en fonctionnement, des tensions électriques circulent sur le fond de panier.
  • Page 111 Appendix A: Warning Statements Comply with Local and National Electrical Codes Warning! Installation of the equipment must comply with local and national electrical codes. 地方および国の電気規格に準拠 機器の取り付けはその地方および国の電気規格に準拠する必要があります。 警告 设备安装必须符合本地与本国电气法规。 警告 設備安裝必須符合本地與本國電氣法規。 Warnung Die Installation der Geräte muss den Sicherheitsstandards entsprechen. ¡Advertencia! La instalacion del equipo debe cumplir con las normas de electricidad locales y nacionales.
  • Page 112 Appendix A: Warning Statements Product Disposal Warning! Ultimate disposal of this product should be handled according to all national laws and regulations. 製品の廃棄 この製品を廃棄処分する場合、 国の関係する全ての法律 ・ 条例に従い処理する必要があります。 警告 本产品的废弃处理应根据所有国家的法律和规章进行。 警告 本產品的廢棄處理應根據所有國家的法律和規章進行。 Warnung Die Entsorgung dieses Produkts sollte gemäß allen Bestimmungen und Gesetzen des Landes erfolgen.
  • Page 113 Appendix A: Warning Statements Hot Swap Fan Warning Warning! Hazardous moving parts. Keep away from moving fan blades. The fans might still be turning when you remove the fan assembly from the chassis. Keep fingers, screwdrivers, and other objects away from the openings in the fan assembly's housing. ファン...
  • Page 114 Electrical Appliance and Material Safety Law prohibits the use of UL or CSA -certified cables (that have UL/CSA shown on the cord) for any other electrical devices than products designated by Supermicro only. 電源コードとACアダプター...
  • Page 115 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind. ¡Advertencia! Cuando instale el producto, utilice la conexión provista o designada o procure cables, Cables...
  • Page 116 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro. 전원 케이블 및 AC 어댑터...
  • Page 117: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors Dual 4th Gen Intel Xeon Scalable processors in Socket E (LGA-4677) with four UPIs (16GT/s max.) and a thermal design power (TDP) of up to 350W; Supports SP XCC, SP MCC, and Max Series (HBM) SKUs. Chipset Intel PCH C741 BIOS...
  • Page 118 Appendix B: System Specifications Regulatory Compliance FCC, ICES, CE, VCCI, RCM, UKCA, NRTL, CB Applied Directives, Standards EMC/EMI: 2014/30/EU (EMC Directive) Electromagnetic Compatibility Regulations 2016 FCC Part 15 ICES-003 VCCI-CISPR 32 AS/NZS CISPR 32 BS/EN55032 BS/EN55035 CISPR 32 CISPR 35 BS/EN 61000-3-2 BS/EN 61000-3-3 BS/EN 61000-4-2...

Table of Contents