Supermicro SuperServer 420GH-TNGR User Manual
  1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Server
  5. SuperServer 420GH-TNGR
  6. User manual

Supermicro SuperServer 420GH-TNGR User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
SuperServer
®
420GH-TNGR
USER'S MANUAL
Revision 1.0a

Advertisement

Table of Contents
loading

Related Manuals for Supermicro SuperServer 420GH-TNGR

Summary of Contents for Supermicro SuperServer 420GH-TNGR

  • Page 1 SuperServer ® 420GH-TNGR USER’S MANUAL Revision 1.0a...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...

  • Page 4: Table Of Contents

    SuperServer 420GH-TNGR User's Manual Contents Chapter 1 Introduction 1.1 Overview ..........................9 1.2 System Features ........................10 Front View .........................10 Drive Carrier Indicators ....................12 Rear View ..........................13 1.3 System Architecture ......................14 Main Component Locations ....................14 Motherboard ........................14 Carrier Board ........................15 System Block Diagram ......................16 1.4 PCIe Mapping: Carrier Board and Motherboard ..............17...
  • Page 5 Preface Chapter 3 Maintenance and Component Installation 3.1 Removing Power .......................28 3.2 Accessing the System .......................29 CPU Tray ...........................30 3.3 Processor and Heatsink Installation ...................31 The Processor Carrier Assembly ..................32 The Processor Heatsink Module (PHM) ................34 Preparing the CPU Socket for Installation ................35 Installing the PHM into the CPU Socket ................36 Removing the PHM from the CPU Socket ...............38 Removing the Processor Carrier Assembly from the PHM ..........39...
  • Page 6 SuperServer 420GH-TNGR User's Manual Overheating (CPU Only) ....................67 3.10 Power Supply ........................68 3.11 Cable Routing Diagram ......................69 Chapter 4 Motherboard Connections 4.1 Headers and Connectors ....................70 4.2 Input/Output Ports ......................73 Front I/O Ports .......................73 4.3 Jumpers ..........................74 4.4 LED Indicators ........................76 Chapter 5 Software 5.1 OS Installation ........................77...
  • Page 7 7.8 Where to Get Replacement Components ................105 7.9 Reporting an Issue ......................105 Technical Support Procedures ..................105 Returning Merchandise for Service .................105 Vendor Support Filing System ..................106 7.10 Feedback .........................106 7.11 Contacting Supermicro .....................107 Appendix A Standardized Warning Statements for AC Systems Appendix B System Specifications...
  • Page 8 SuperServer 420GH-TNGR User's Manual Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 9: Chapter 1 Introduction

    Chapter 1: Introduction Chapter 1 Introduction 1.1 Overview This chapter provides a brief outline of the functions and features of the SuperServer 420GH-TNGR. It is based on the X12DPG-U6 motherboard and the CSE-428G2 chassis. The following provides an overview of the specifications and capabilities. System Overview Chassis CSE-428G2...

  • Page 10: System Features

    Chapter 1: Introduction 1.2 System Features The following views of the system display the main features. Refer to Appendix B for additional specifications. Front View Figure 1-1. Front View Front View Item Feature Description Service Tag System service information tag. The main power switch is used to apply or remove power from the power supply to the server.
  • Page 11 Chapter 1: Introduction Expansion Slot Locations Item Description PCIe 4.0 x16 FHHL PCIe 4.0 x16 AIOM (SFF OCP 3.0 superset) PCIe 4.0 x16 AIOM (SFF OCP 3.0 superset) Figure 1-2. LED Panel View LED Panel Item Feature Description The unit identification (UID) LED turns on when activated via UID LED management software.

  • Page 12: Drive Carrier Indicators

    Chapter 1: Introduction Drive Carrier Indicators Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare.

  • Page 13: Rear View

    Chapter 1: Introduction Rear View System Fan Modules Power Supplies Figure 1-3. System: Rear View System Features: Rear Feature Description Five heavy-duty, hot-swappable fan modules. With one failed fan at 35˚C ambient System Fans temperature, the other fans still run at full speed. Four 3000W (+54V: 2500W, +12V: 2000W) redundant power supplies, Titanium Power Supplies Level, 3+1 redundancy...

  • Page 14: System Architecture

    Chapter 1: Introduction 1.3 System Architecture This section covers the locations of the system electrical components and block diagrams of the motherboard and the overall system. Main Component Locations Motherboard X12DPG-U6 AOM-AIOM-2x8-P AOM-AIOM-2x8-P BPN-NVMe4-HS119N-S4R RSC-H2-68G4 Figure 1-4. Motherboard...

  • Page 15: Carrier Board

    Chapter 1: Introduction Carrier Board Six QSFP-DD 400GbE Ports Eight AI Processor Gaudi Cards Figure 1-5. Carrier Board...

  • Page 16: System Block Diagram

    Chapter 1: Introduction System Block Diagram This is a general block diagram and may not exactly represent the features on your motherboard. See the System Specifications appendix for the actual specifications of your motherboard. CPU Module Gaudi AI Processor Module Figure 1-6.

  • Page 17: Pcie Mapping: Carrier Board And Motherboard

    Chapter 1: Introduction 1.4 PCIe Mapping: Carrier Board and Motherboard Refer to the images and tables below for the PCIe mapping on carrier board and motherboard of the 420GH-TNGR. PCIe Mapping on Carrier Board Figure 1-7. Carrier Board Mapping Carrier Board Mapping Table Linux OS Numbering Physical location PCI BUS ID...

  • Page 18: Pcie Mapping On Motherboard

    Chapter 1: Introduction PCIe Mapping on Motherboard Figure 1-8. PCIe Mapping PCIe Mapping Table Item PCI Bus ID Component 01:00.0 NVME1 02:00.0 NVME2 4b:00.0 65:00.0 AIOM1 e3:00.0 NVME0 e4:00.0 NVME1 e5:00.0 NVME2 e6:00.0 NVME3 98:00.0 AIOM2...

  • Page 19: Motherboard Layout

    Chapter 1: Introduction 1.5 Motherboard Layout Below is a layout of the X12DPG-U6 motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard...

  • Page 20: Quick Reference Table

    Chapter 1: Introduction Quick Reference Table Jumper Description Default Setting JBT1 Clear CMOS Short pads to clear CMOS Pins 1-2 (UID function) JUID1 Unit Identifier (UID) Switch Pins 3-4 (BMC reset function) Description Status PWR_LED Onboard power LED Green on: Power on Connector Description Onboard battery...

  • Page 21: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.

  • Page 22: Rack Precautions

    Chapter 2: Server Installation • This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.). • This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units. Warning! Power cord shall be connected to a socket-outlet with earthing connection.

  • Page 23: Rack Mounting Considerations

    Chapter 2: Server Installation Rack Mounting Considerations Ambient Operating Temperature If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer’s maximum rated ambient temperature (TMRA).

  • Page 24: Installing The Rails

    Chapter 2: Server Installation 2.4 Installing the Rails There are a variety of rack units on the market, which may require a slightly different assembly procedure. This rail set fits a rack between 28" and 33.5" deep. Do not use a two post "telco" type rack.
  • Page 25 Chapter 2: Server Installation 3. In each rail set, the two sections are screwed together to keep them immobile during shipping. Release these screws just enough to allow the rail sections to slide apart. Note the arrow on the rail, which indicates the end that attaches to the front of the rack. 4.

  • Page 26: Installing The Server

    Chapter 2: Server Installation 2.5 Installing the Server Once rails are attached to the chassis and the rack, you can install the server. Installing the Chassis into a Rack Caution: The assembled system may weigh over 100 lbs. Use a lift and multiple people to move it.
  • Page 27 Chapter 2: Server Installation 3. After pushing the enclosure all the way into the rack, use the thumbscrew on each side of the server to lock it into place. Thumbscrew Figure 2-5. Locking the Server to the Rack Warning: Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing.

  • Page 28: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.

  • Page 29: Accessing The System

    Chapter 3: Maintenance and Component Installation 3.2 Accessing the System The system is comprised of two trays, a CPU tray and a carrier board tray. Each tray can be removed from the chassis using releasing levers or handles. Before removing the trays, power down the system, as described in Section 3.1.

  • Page 30: Cpu Tray

    Chapter 3: Maintenance and Component Installation CPU Tray Removing and Installing the CPU Tray 1. Loosen the captive screw on the CPU chassis, pull both levers to pull the CPU tray out. Screw Lever Figure 3-2. Removing the CPU Tray 2.

  • Page 31: Processor And Heatsink Installation

    Thermal grease is pre-applied on new heatsinks. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor and memory support. • All graphics in this manual are for illustration only. Your components may look different.

  • Page 32: The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation The Processor Carrier Assembly The processor carrier assembly is comprised of the processor and the processor carrier. To create the processor carrier assembly, please follow the steps below: Note: Before installation, be sure to review the Static-Sensitive Devices section earlier in this chapter.
  • Page 33 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the carrier and press it down as shown below. Lever 4. Using pin 1 as a guide, carefully align the CPU keys on the processor (A & B) with those on the carrier (a &...

  • Page 34: The Processor Heatsink Module (Phm)

    Chapter 3: Maintenance and Component Installation The Processor Heatsink Module (PHM) After creating the processor carrier assembly, follow the instructions below to mount the heatsink onto the carrier assembly to form the processor heatsink module (PHM). Note: If this is a new heatsink, the thermal grease has been pre-applied. Otherwise, apply the proper amount of thermal grease to the underside of the heatsink.

  • Page 35: Preparing The Cpu Socket For Installation

    Chapter 3: Maintenance and Component Installation Preparing the CPU Socket for Installation The CPU socket comes with a plastic protective cover, which needs to be removed before installing the Processor Heatsink Module (PHM). Do this by gently squeezing the grip tabs then pulling the cover off.

  • Page 36: Installing The Phm Into The Cpu Socket

    Chapter 3: Maintenance and Component Installation Installing the PHM into the CPU Socket After assembling the Processor Heatsink Module (PHM), you are ready to install it into the CPU socket. 1. Locate four threaded fasteners (a, b, c, d) on the CPU socket. CPU Socket Threaded Fastener (a, b, c, d: Threaded Fasteners)
  • Page 37 Chapter 3: Maintenance and Component Installation 4. Align peek nut "A" (next to the triangular pin 1 on the heatsink) with threaded fastener "a" on the CPU socket. Then align peek nuts "B", "C", "D" on the heatsink with threaded fasteners "b", "c", "d"...

  • Page 38: Removing The Phm From The Cpu Socket

    Chapter 3: Maintenance and Component Installation Removing the PHM from the CPU Socket Before removing the PHM from the motherboard, first shut down the system and unplug the AC power cord from all power supplies. 1. Use a t30-bit screwdriver to loosen the four peek nuts on the heatsink in the sequence of A, B, C, and D.

  • Page 39: Removing The Processor Carrier Assembly From The Phm

    Chapter 3: Maintenance and Component Installation Removing the Processor Carrier Assembly from the PHM To remove the processor carrier assembly from the PHM, please follow the steps below: 1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown below.

  • Page 40: Removing The Processor From The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Removing the Processor from the Processor Carrier Assembly Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below. 1.

  • Page 41: Memory Support And Installation

    Chapter 3: Maintenance and Component Installation 3.4 Memory Support and Installation Note: Check the Supermicro website for recommended memory modules. Important: Exercise extreme care when installing or removing DIMM modules to pre- vent any possible damage. Memory Support The X12DPG-U6 supports up to 8TB of 3DS LRDIMM/LRDIMM/3DS RDIMM/RDIMM DDR4 (288-pin) ECC memory with speeds of 3200/2933/2666MHz in 32 memory slots and up to 8TB of Intel Optane PMem 200 Series with speeds of up to 3200MHz.

  • Page 42: Memory Population Table For The 3Rd Gen Intel® Xeon® Scalable Processors

    2 CPUs & 28 DIMMs CPU2: P2-DIMMA1/P2-DIMME1/P2-DIMMC1/P2-DIMMG1/P2-DIMMB1/P2-DIMMF1/P2-DIMMD1/P2-DIMMH1/ P2-DIMMA2/P2-DIMME2/P2-DIMMC2/P2-DIMMG2 CPU1: P1-DIMMA1/P1-DIMME1/P1-DIMMC1/P1-DIMMG1/P1-DIMMB1/P1-DIMMF1/P1-DIMMD1/P1-DIMMH1/ 2 CPUs & 32 DIMMs P1-DIMMA2/P1-DIMME2/P1-DIMMC2/P1-DIMMG2/P1-DIMMB2/P1-DIMMF2/P1-DIMMD2/P1-DIMMH2 (Note) CPU2: P2-DIMMA1/P2-DIMME1/P2-DIMMC1/P2-DIMMG1/P2-DIMMB1/P2-DIMMF1/P2-DIMMD1/P2-DIMMH1/ P2-DIMMA2/P2-DIMME2/P2-DIMMC2/P2-DIMMG2/P2-DIMMB2/P2-DIMMF2/P2-DIMMD2/P2-DIMMH2 Note: This memory configuration is recommended by Supermicro for optimal memory perfor- mance. Please use this configuration to maximize your memory performance.

  • Page 43: Pmem 200 Series Population Table For X12Dpg-U6 Motherboard (With 32 Slots)

    Chapter 3: Maintenance and Component Installation PMem 200 Series Population Table for X12DPG-U6 Motherboard (with 32 Slots) Note: The Intel Optane Persistent Memory (PMem) 200 Series are supported by the 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx/4314) processors. PMem 200 Series Population Table for X12DPG-U6 32-DIMM Motherboard (within 1 CPU socket) DDR4+ AD Inter- Mode...
  • Page 44 Chapter 3: Maintenance and Component Installation Validation Matrix (DDR4 DIMMS with PMem 200 Series) DIMM Capacity (GB) Ranks Per DIMM DIMM Type & Data Width DRAM Density (Stack) 16Gb 1Rx8 1Rx4 16GB 32GB RDIMM (up to 3200) 1Rx8 16GB 32GB 1Rx4 32GB 64GB...

  • Page 45: Dimm Installation

    Chapter 3: Maintenance and Component Installation DIMM Installation 1. Insert the desired number of DIMMs into the memory slots based on the recommended DIMM population tables in the previous section. Locate DIMM memory slots on the motherboard as shown on the right. JPL6 JVRM2 JPL5...

  • Page 46: Dimm Removal

    Chapter 3: Maintenance and Component Installation 3. Align the key of the DIMM module with the receptive point on the memory slot. 4. Align the notches on both ends of the module against the receptive points on the ends of the slot. Notches 5.

  • Page 47: Motherboard Battery

    Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.

  • Page 48: Carrier Board Tray

    Chapter 3: Maintenance and Component Installation 3.6 Carrier Board Tray Releasing and Installing the Carrier Board Tray The carrier board tray contains the Gaudi accelerator base board (carrier board). Note the handles must be in the unlocked and extended position to install the carrier board tray. Caution: The carrier board tray may weigh up to 45 lbs.
  • Page 49 Chapter 3: Maintenance and Component Installation 3. Pull the tray outward until the safety lock is engaged, and then simultaneously depress the buttons on both sides to pull the tray out. Simultaneously depress the buttons on both sides while pulling the tray out Figure 3-5.

  • Page 50: Replacing Gaudi Oam Modules

    Replacing Gaudi OAM Modules Individual Gaudi OAM modules and carrier board are recommended to be serviced by Supermicro due to the optimized density of the system. However, when there's a need, follow the steps below. Replacing a Gaudi OAM Module 1.
  • Page 51 Chapter 3: Maintenance and Component Installation 2. Remove the air shroud by removing two screws on each side. Air shroud Screws Figure 3-7. Removing the Air Shroud...
  • Page 52 Figure 3-8. Removing Screws of Gaudi OAM Modules Diagonally Important: DO NOT remove the heatsink from the Gaudi OAM module. Supermicro does not recommend carrier board replacement to be done by customers. However, if the customer is familiar with the product and needs to perform a replacement themselves, SMC can provide...
  • Page 53 Chapter 3: Maintenance and Component Installation 4. Once all screws are loose, grasp the handle of the carrier board module and lift it up and out. Be careful not to scratch the carrier board baseboard or your hands on the chassis metal edges.

  • Page 54: Storage Drives

    (Both procedures may be done without removing power from the system.) These carriers also help promote proper airflow. Note: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro website at http://www.
  • Page 55 Chapter 3: Maintenance and Component Installation Figure 3-10. Logical Drive Numbers...

  • Page 56: Removing/Installing Drives

    Chapter 3: Maintenance and Component Installation Removing/Installing Drives Removing Drive Carriers from the Chassis 1. Slide the handle lever on the drive carrier up to unlock the carrier handle. This releases and extends the drive carrier handle. Handle Lever Figure 3-11. Unlocking Handle 2.
  • Page 57 Chapter 3: Maintenance and Component Installation Installing a 2.5" Hard Drive 1. Place the hard drive carrier on a flat surface. 2. Orient the drive with the connector facing the bottom rear of the carrier. The drive can be inserted from above the carrier and into the clips until a "click" is heard. 3.

  • Page 58: Hot-Swap For Hard Drives

    Chapter 3: Maintenance and Component Installation Hot-Swap for Hard Drives Supermicro servers support hard surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using the BMC. Ejecting a Drive 1.

  • Page 59: Checking The Temperature Of An Nvme Drive

    Chapter 3: Maintenance and Component Installation Replacing the Drive 1. Insert the replacement drive. 2. BMC > System > Storage Monitoring > Physical View 3. Select Device, Group and slot and click Insert. The drive Status LED indicator flashes red, then turns off. The Activity LED turns blue. Checking the Temperature of an NVMe Drive There are two ways to check using the BMC.

  • Page 60: Installing M.2 Solid State Drives

    Chapter 3: Maintenance and Component Installation Installing M.2 Solid State Drives The X12DPG-U6 can accommodate two M.2 solid state drives (SSDs). Each M.2 socket supports NVMe PCIe 3.0 x2 (32 Gb/s) or SATA SSD cards in a 2280 or 22110 form factor. The 22110 form factor is recommended because the appropriate standoff comes pre-installed on the motherboard.

  • Page 61: Expansion Cards

    The system has one PCIe 4.0 x16 FHHL slot and two PCIe 4.0 x16 AIOM slots on the CPU node. Note: Expansion cards are recommended to be serviced by Supermicro due to the optimized density of the 4U form factor.
  • Page 62 Chapter 3: Maintenance and Component Installation The thumbscrew on the back Dummy shield Figure 3-16. Removing Shield and Screw...
  • Page 63 Chapter 3: Maintenance and Component Installation Installing an Expansion Card in the Motherboard Tray Power down the system remove the CPU tray. Remove the PCIe dummy shield. 3. Insert the expansion card(s) into the riser card slot(s) while aligning the rear PCI shield. 4.
  • Page 64 Chapter 3: Maintenance and Component Installation Installing a Single-Width AIOM Power down the system remove the CPU tray. 2. Loosen the thumbscrew on the AIOM shield and remove it from the chassis. 3. Push the AIOM card into the chassis until the release lever retracts. Thumbscrew Figure 3-17.

  • Page 65: System Cooling

    Chapter 3: Maintenance and Component Installation 3.9 System Cooling Heavy-duty fan modules provide cooling for the chassis. Five fan modules are located in the rear of the chassis, and they all meet the requirements of heat dissipation by both passive carrier board and mother board.

  • Page 66: Replacing Power Fan Modules

    Chapter 3: Maintenance and Component Installation Replacing Power Fan Modules Both system fan modules and power supply fans simultaneously cool down the system. Changing a System Fan 1. Determine which fan is failing. It is recommended that BMC should be checked in advance.

  • Page 67: Overheating (Cpu Only)

    Chapter 3: Maintenance and Component Installation Figure 3-19. Removing a Fan Module Overheating (CPU Only) When processors overheat, follow these steps: 1. Use the Information LEDs to determine the nature of the overheating condition. 2. Confirm that the chassis covers are installed properly. 3.

  • Page 68: Power Supply

    The chassis features four 3+1 3000W (+54V:2500W, +12V:2000W), redundant power supplies. The power modules can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors. These power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 200-240v.

  • Page 69: Cable Routing Diagram

    Chapter 3: Maintenance and Component Installation 3.11 Cable Routing Diagram Refer to the diagram below for a representation of how the main cables are routed throughout the system. When disconnecting cables to add or replace components, refer to this diagram when adding or replacing components so you can reroute them in the same manner.

  • Page 70: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.
  • Page 71 The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the hard drive is not installed in the system.
  • Page 72 There is one S-SATA port located at SATA5 on this motherboard. The SATA5 port can be used with Supermicro SuperDOM which is an orange SATA DOM connector with power pins built in, and do not require external power cables. SATA5 port is also compatible with regular SATA HDDs or SATA DOMs that need external power cables.

  • Page 73: Input/Output Ports

    Chapter 4: Motherboard Connections 4.2 Input/Output Ports Front I/O Ports VGA Connection The onboard VGA port is located on the I/O back panel. This VGA connection provides an analog interface support between the computer and the video display. Refer to the layout below for the location of VGA connection.

  • Page 74: Jumpers

    Chapter 4: Motherboard Connections 4.3 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with a square solder pad on the printed circuit board. See the diagram below for an example of jumping pins 1 and 2.
  • Page 75 BMC settings. Both functions are available when it connects to the system UID/BMC reset switch via the midplane to the carrier board. You may refer to the Supermicro system user's manual or the BMC user's guide posted on our website at http://www.supermicro.com...

  • Page 76: Led Indicators

    Chapter 4: Motherboard Connections 4.4 LED Indicators Onboard Power LED The Onboard Power LED is located at PWR_LED on the motherboard. When this LED is on, the system power is on. Be sure to turn off the system power and unplug the power cord before removing or installing components.

  • Page 77: Chapter 5 Software

    USB/SATA DVD drive, or a USB flash drive, or the BMC KVM console. 2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.

  • Page 78: Driver Installation

    The Supermicro website contains drivers and utilities for your system at https://www. supermicro.com/wdl. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash drive or a DVD.

  • Page 79: Habana Gaudi Software Installation

    Chapter 5: Software 5.3 Habana Gaudi Software Installation Habana Gaudi software was designed to provide users with ease of use and optimize AI processors. Gaudi cards support only Ubuntu and CentOS. The supported versions include:　 Ubuntu version 18.04 (kernels 4.15 and above), version 20.04 (kernels 5.4.0 and above), and Centos version 7.8 (kernels 4.9.184 and above).

  • Page 80: Superdoctor ® 5

    5.4 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

  • Page 81: Bmc

    There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: https://www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.

  • Page 82: Bmc Password Label Locations

    Chapter 5: Software BMC Password Label Locations To locate the BMC password stickers on the motherboard and carrier board, refer to the layouts below. Motherboard JPL6 JVRM2 JPL5 JPL4 CTRL X12DPG-U6 BMC CODE REV:1.01 BIOS LICENSE BAR CODE DESIGNED IN USA JUID1 PWR_ CPU1...

  • Page 83: Carrier Board

    Chapter 5: Software Carrier Board JQ6_LED JQ3_LED JQ1_LED JUIDB1 JQ5_LED JQ4_LED JQ2_LED R459 JSRST1 LAN1 JUART1 BMC_HB_LED1 JQC3 JQC2 JQC1 MBD-HGI-MEZZ JUS1 REV:1.01 JUS2 BAR CODE DESIGNED IN USA MAC CODE JMP6 JMP8 JMP7 JMP5 JMP3 JMP2 JMP1 JMP4 PWR1 PWR2 Figure 5-6.

  • Page 84: Accessing Gpu Bmc Ip Address

    Chapter 5: Software 5.6 Accessing GPU BMC IP Address There's one LAN port on the GPU node. To access the GPU BMC, you must find out the IP address of BMC on the GPU node. Follow these steps. 1. After you turn on the system, the CPU BMC IP address is displayed in the bottom-right corner of the startup screen.

  • Page 85: Chapter 6 Optional Components

    Chapter 6: Optional Components Chapter 6 Optional Components This chapter describes optional system components and installation procedures. 6.1 Optional Parts List Optional Parts List Description Part Number Quantity Power Supply Modules PWS-3K03G-2R Inlet Thermal Sensor MCP-280-00033-0N NVMe Drive Try MCP-220-00167-0B NVMe Cable CBL-SAST-1231-85 AOC-S3008L-L8I...

  • Page 86: Intel Virtual Raid On Cpu (Vroc)

    Chapter 6: Optional Components 6.2 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs ® directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex. •...

  • Page 87: Additional Information

    Chapter 6: Optional Components Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.

  • Page 88: Enabling Nvme Raid

    Chapter 6: Optional Components Enabling NVMe RAID RAID for NVMe SSDs must be enabled through the UEFI BIOS. 1. Install the patch as described in the Restrictions and Requirements section on a previous page. 2. Reboot the server. 3. Press [DEL] key to enter BIOS. 4.
  • Page 89 Chapter 6: Optional Components Figure 6-2. BIOS VMD Setting Examples...
  • Page 90 Chapter 6: Optional Components 13. Select Strip Size (Default 64KB). 14. Select Create Volume. 15. If another RAID is needed, start again at step 6. 16. Press [F4] to save and reboot. Figure 6-3. Created Volume without Figure 6-4. Created Volume with enabling RAID spanned over VMD enabling RAID spanned over VMD Controller...

  • Page 91: Status Indications

    Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blink Fault Solid on Rebuilding 1 Hz Blink IBPI SFF 8489 Defined Status LED States Hot Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other...

  • Page 92: Chapter 7 Troubleshooting And Support

    Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by clicking the menu icon, then selecting the Products option.

  • Page 93: Bmc Interface

    Security Center for recent security notices Supermicro Phone and Addresses 7.2 BMC Interface The system supports a Baseboard Management Controller (BMC) interface. It provides remote access, monitoring and management. There are several BIOS settings related to the BMC.

  • Page 94: Troubleshooting Procedures

    Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures Returning Merchandise for Service section(s) in this chapter. Power down the system before changing any non hot-swap hardware components.

  • Page 95: No Video

    • Memory: Make sure that the memory modules are supported. Refer to the product page on our website at www.supermicro.com. Test the modules using memtest86 or a similar utility. • Storage drives: Make sure that all drives work properly. Replace if necessary.
  • Page 96 Chapter 7: Troubleshooting and Support • Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements. •...

  • Page 97: Bios Error Beep (Post) Codes

    When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20). For information on AMI updates, please refer to http://www.ami.com/products/.

  • Page 98: Crash Dump Using The Bmc Dashboard

    In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using the BMC Dashboard. The BMC manual is available at www.supermicro.com/manuals/ other/BMC_Users_Guide_X12_H12.pdf. Check Error Log 1.

  • Page 99: Uefi Bios Recovery

    Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
  • Page 100 USB device or a writable CD/DVD. Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
  • Page 101 Chapter 7: Troubleshooting and Support Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below. 4. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update"...
  • Page 102 Chapter 7: Troubleshooting and Support 7. Press <Del> continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press <F4>...
  • Page 103 Chapter 7: Troubleshooting and Support Note: Do not interrupt this process until the BIOS flashing is complete. 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.

  • Page 104: Cmos Clear

    Chapter 7: Troubleshooting and Support 7.7 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.

  • Page 105: Where To Get Replacement Components

    7.8 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.

  • Page 106: Vendor Support Filing System

    For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.10 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. To provide feedback on our manuals, please email us at techwriterteam@...

  • Page 107: Contacting Supermicro

    Chapter 7: Troubleshooting and Support 7.11 Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 108: Appendix A Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 109 Appendix A Standardized Warning Statements for AC Systems Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 110 Appendix A Standardized Warning Statements for AC Systems . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 111 Appendix A Standardized Warning Statements for AC Systems Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 112 Appendix A Standardized Warning Statements for AC Systems Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 113 Appendix A Standardized Warning Statements for AC Systems Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components. 電源切断の警告...
  • Page 114 Appendix A Standardized Warning Statements for AC Systems ‫אזהרה מפני ניתוק חשמלי‬ ‫!אזהרה‬ ‫יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק‬ ‫.לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים‬ ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت...
  • Page 115 Appendix A Standardized Warning Statements for AC Systems Attention Il est vivement recommandé de confier l'installation, le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés. !‫אזהרה‬ .‫צוות מוסמך בלבד רשאי להתקין, להחליף את הציוד או לתת שירות עבור הציוד‬ ‫واملدربيه...
  • Page 116 Appendix A Standardized Warning Statements for AC Systems Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
  • Page 117 Appendix A Standardized Warning Statements for AC Systems Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
  • Page 118 Appendix A Standardized Warning Statements for AC Systems ‫هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل‬ ‫اسحبذال البطارية‬ ‫فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة‬ ‫جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة‬ 경고! 배터리가...
  • Page 119 Appendix A Standardized Warning Statements for AC Systems ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
  • Page 120 Appendix A Standardized Warning Statements for AC Systems Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时，背板上有很危险的电压或能量，进行维修时务必小心。 警告 當系統正在進行時，背板上有危險的電壓或能量，進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
  • Page 121 Appendix A Standardized Warning Statements for AC Systems ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스...
  • Page 122 Appendix A Standardized Warning Statements for AC Systems ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬ 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다. Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften.
  • Page 123 Appendix A Standardized Warning Statements for AC Systems Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 124 Appendix A Standardized Warning Statements for AC Systems Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
  • Page 125 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
  • Page 126 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro.
  • Page 127 사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...

  • Page 128: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors Dual 3rd Gen Intel® Xeon® Scalable processorss in a Dual Socket Socket LGA-3647 (Socket P) socket; UPI up to 11.2 GT/s; support up to 270W TDP Note: Refer to the motherboard specifications pages on our website for updates to supported processors. Chipset Intel®...
  • Page 129 Appendix B: System Specifications Applied Directives, Standards EMC/EMI: 2014/30/EU (EMC Directive) FCC Part 15 ICES-003 VCCI 32-1 AS/NZS CISPR 32 EN55032 EN55035 CISPR 24 EN 61000-3-2 EN 61000-3-3 EN 61000-4-2 EN 61000-4-3 EN 61000-4-4 EN 61000-4-5 EN 61000-4-6 EN 61000-4-8 EN 61000-4-11 Green Environment: 2011/65/EU (RoHS Directive)

Table of Contents