Supermicro SuperServer SYS-820GH-TNR2 User Manual
  1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Server
  5. SuperServer SYS-820GH-TNR2
  6. User manual

Supermicro SuperServer SYS-820GH-TNR2 User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

SuperServer
®
SYS-820GH-TNR2
USER'S MANUAL
Revision 1.0

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SuperServer SYS-820GH-TNR2 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Supermicro SuperServer SYS-820GH-TNR2

Summary of Contents for Supermicro SuperServer SYS-820GH-TNR2

  • Page 1 SuperServer ® SYS-820GH-TNR2 USER’S MANUAL Revision 1.0...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...

  • Page 4: Table Of Contents

    SuperServer SYS-820GH-TNR2 User's Manual Contents Chapter 1 Introduction 1.1 Overview ..........................8 1.2 System Features ........................9 Front View ...........................9 Drive Carrier Indicators ....................11 Front I/O Ports and LED Indicators of AI Processor ............12 Rear View ..........................13 1.3 System Architecture ......................14 Main Component Locations ....................14 Motherboard ........................14...
  • Page 5 Preface 2.5 Installing the Server ......................28 Chapter 3 Maintenance and Component Installation 3.1 Removing Power .......................30 3.2 Accessing the System .......................31 CPU Tray ...........................32 AI Processor Tray ......................34 3.3 Processor and Heatsink Installation ...................36 The 3rd Gen Intel Xeon Scalable Processor ..............37 1.
  • Page 6 SuperServer SYS-820GH-TNR2 User's Manual DIMM Removal .........................59 3.5 Motherboard Battery ......................60 3.6 Storage Drives ........................61 Drive Carrier Indicators ....................61 Removing/Installing Drives ....................63 Installing M.2 Solid State Drives ..................65 3.7 Expansion Cards .......................67 Installing PCIe Expansions Cards ................67 3.8 System Cooling ........................69 System Fan Failure ......................69...
  • Page 7 7.7 Where to Get Replacement Components ................103 7.8 Reporting an Issue ......................103 Technical Support Procedures ..................103 Returning Merchandise for Service .................103 Vendor Support Filing System ..................104 7.9 Feedback ..........................104 7.10 Contacting Supermicro ....................105 Appendix A Standardized Warning Statements for AC Systems Appendix B System Specifications...

  • Page 8: Chapter 1 Introduction

    8U Rackmount 17.6 x 14 x 31.5 in (447 x 356 x 800 mm) (WxHxD) A Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SYS-820GH-TNR2 have been certified as compliant with UL or CSA: GP802F-H30X12, GP802-30...

  • Page 9: System Features

    Chapter 1: Introduction 1.2 System Features The following views of the system display the main features. Refer to Appendix B for additional specifications. Front View Figure 1-1. Front View System Features: Front Item Feature Description Six 400Gb/s QSFP-DD with ports on AI Processor tray for RDMA for QSFP-DD Ports scale-out.
  • Page 10 Chapter 1: Introduction Expansion Slot Locations Item Description PCIe 4.0 x16 FHFL PCIe 4.0 x8 FHFL PCIe 4.0 x8 FHFL PCIe 4.0 x16 FHFL Figure 1-2. LED Panel View LED Panel Item Feature Description Power Fail LED Indicates a power supply module has failed. Information LED Alerts operator to several states, as noted in the table below.

  • Page 11: Drive Carrier Indicators

    Chapter 1: Introduction Information LED Status Description An overheat condition has occurred. Continuously on and red (This may be caused by cable congestion.) Blinking red (1Hz) Fan failure, check for an inoperative fan. Blinking red (0.25Hz) Power failure, check for a non-operational power supply. UID has been activated locally to locate the server in a rack Solid blue environment.

  • Page 12: Front I/O Ports And Led Indicators Of Ai Processor

    Chapter 1: Introduction Front I/O Ports and LED Indicators of AI Processor Figure 1-3. Front I/O on AI Processor Tray Front I/O Ports and LED Indicators on AI Processor Tray Symbol Name Status Color Behavior Description Ports reserved for factory IOIOI maintenance Default...

  • Page 13: Rear View

    Chapter 1: Introduction Rear View System Fan Modules Power Supplies Power Supply Power Supply Figure 1-4. System: Rear View System Features: Rear Feature Description Twelve heavy-duty, hot-swappable fan modules. System fans run at full speed System Fans when a failed fan is detected or the ambient temperature reaches 35˚C or higher. Six 3000W (+54V: 2100W, +12V: 1100W) redundant power supplies, Titanium Power Supplies Level, 4+2 redundancy...

  • Page 14: System Architecture

    Chapter 1: Introduction 1.3 System Architecture This section covers the locations of the main system components and block diagrams of the motherboard and the overall system. Main Component Locations Motherboard AOM-GD2-IO X12DPG-OA6-GD2 RSC-H2-68G4 RSC-H2-68G4 Figure 1-5. Motherboard...

  • Page 15: Carrier Board

    Chapter 1: Introduction Carrier Board Eight AI Processor Gaudi 2 Cards ® Six QSFP-DD 400GbE Ports Figure 1-6. Carrier Board...

  • Page 16: System Block Diagram

    Chapter 1: Introduction System Block Diagram This is a general block diagram and may not exactly represent the features on your motherboard. See the System Specifications appendix for the actual specifications of your motherboard. CPU Node AIP Node 2x RSC HDD Backplane IO Board RSC-H2-68G4...

  • Page 17: Pcie Mapping: Carrier Board And Motherboard

    Chapter 1: Introduction 1.4 PCIe Mapping: Carrier Board and Motherboard Refer to the images and tables below for the PCIe mapping on the carrier board and motherboard of the SYS-820GH-TNR2. PCIe Mapping on Carrier Board OAM#0 OAM#3 OAM#4 OAM#7 OAM#1 OAM#2 OAM#5 OAM#6...

  • Page 18: Pci Bus Ids

    Chapter 1: Introduction PCI Bus IDs Figure 1-9. PCIe BUS IDs Slot 1-4 PCI Bus IDs Item PCI BUS ID BMC Number (Gen4 x16) 4B:00.0 (Gen4 x16) 98:00.0 (Gen4 x8) 77:00.0 (Gen4 x8) 90:00.0...

  • Page 19: Nvme Pcie Bus Ids

    Chapter 1: Introduction NVMe PCIe Bus IDs Figure 1-10. NVMe PCI BUS IDs Slot 1-4 NVMe PCI Bus IDs Item NVMe PCI BUS ID BMC Number 75:00.0 76:00.0 8e:00.0 8f:00.0...

  • Page 20: Pci Bus Ids

    Chapter 1: Introduction M.2 PCI Bus IDs Figure 1-11. M.2 PCI BUS IDs Slot 1-4 M.2 PCI Bus IDs Item M.2 PCI BUS ID BMC Number 04:00.0 05:00.0...

  • Page 21: Motherboard Layout

    Chapter 1: Introduction 1.5 Motherboard Layout Below is a layout of the X12DPG-OA6-GD2 motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard...

  • Page 22: Quick Reference Table

    BMC Heartbeat LED Solid Green: (during BMC Rest or during a Cold Reboot) Connector Description AIOM Supermicro Advanced I/O Module (AIOM) slot Onboard CMOS battery FAN1~10 CPU/System Fan headers J36 (USB3/4) Front-accessible USB 3.0 header with support for two USB 3.0 ports...

  • Page 23: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.

  • Page 24: Rack Precautions

    Chapter 2: Server Installation • This product should be installed only in a Restricted Access Location (dedicated equipment rooms, service closets, etc.). • This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units. Warning! Power cord shall be connected to a socket-outlet with earthing connection.

  • Page 25: Rack Mounting Considerations

    Chapter 2: Server Installation Rack Mounting Considerations Ambient Operating Temperature If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the room's ambient temperature. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer’s maximum rated ambient temperature (TMRA).

  • Page 26: Installing The Rails

    Chapter 2: Server Installation 2.4 Installing the Rails There are a variety of rack units on the market, which may require a slightly different assembly procedure. This rail set fits a rack between 28" and 33.5" deep. Do not use a two post "telco" type rack.
  • Page 27 Chapter 2: Server Installation 3. Slide the rails sections apart to match the depth of the rack. Position the rails with the template and secure the front of each to the front of the rack with two flathead screws, then secure the back of each rail to the rear of the rack with two flathead screws (see Figure 2-2).

  • Page 28: Installing The Server

    Chapter 2: Server Installation 2.5 Installing the Server Once rails are attached to the chassis and the rack, you can install the server. Installing the Chassis into a Rack Caution: The assembled system may weigh over 100 lbs. Use a lift and multiple people to move it.
  • Page 29 Chapter 2: Server Installation 2. After pushing the enclosure all the way into the rack, use the thumbscrew on each side of the server to lock it into place. Figure 2-4. Using the Screws to Secure the Server Note: The figure is for illustrative purposes only. Some chassis components such as the carrier board tray may be removed from the chassis enclosure before installing the system to the rack.

  • Page 30: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.

  • Page 31: Accessing The System

    Chapter 3: Maintenance and Component Installation 3.2 Accessing the System The system is comprised of two trays, a CPU tray and an AI processor tray. Each tray can be removed from the chassis using releasing levers or handles. Before removing the trays, power down the system, as described in Section 3.1.

  • Page 32: Cpu Tray

    Chapter 3: Maintenance and Component Installation CPU Tray Removing and Installing the CPU Tray 1. Loosen the captive screw on the CPU chassis, pull both levers to pull the CPU tray out. Lever Lever Lever Figure 3-2. Pulling out the CPU Tray...
  • Page 33 Chapter 3: Maintenance and Component Installation Figure 3-3. Removing the CPU Tray 2. To re-install it back, slide the tray into the chassis. 3. Push the levers back until they snap into place. 4. Secure each lever with a screw. SCALE...

  • Page 34: Ai Processor Tray

    Chapter 3: Maintenance and Component Installation AI Processor Tray Removing and Installing the AI Processor Tray 1. Loosen the captive screw on the AI processor chassis, then pull both levers to release latches to pull the AI processor tray out. Lever Lever Lever...
  • Page 35 Chapter 3: Maintenance and Component Installation Latch Figure 3-5. Removing the AI Processor Tray 2. To re-install it back, slide the tray into the chassis. 3. Push the levers back until they snap into place. 4. Secure each lever with a screw.

  • Page 36: Processor And Heatsink Installation

    Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor and memory support. • All graphics in this manual are for illustrations only. Your components may look different.

  • Page 37: The 3Rd Gen Intel Xeon Scalable Processor

    Chapter 3: Maintenance and Component Installation The 3rd Gen Intel Xeon Scalable Processor Processor Top View 1. The 3rd Gen Intel Xeon Scalable Processor = Cutout = Pin 1 = CPU Key = Cutout = Pin 1 = CPU Key Processor Top View...

  • Page 38: The Processor Carrier

    Chapter 3: Maintenance and Component Installation 2. The Processor Carrier = Cutout = Pin 1 = CPU Key Carrier Bottom View...

  • Page 39: Heatsink

    Chapter 3: Maintenance and Component Installation 3. Heatsink Notes: • All pictures shown are for illustration purpose only. Actual product may vary due to product enhancement. • Exercise extreme care when handling the heatsink. Pay attention to the edges of heatsink fins which can be sharp! To avoid damaging the heatsink, please do not apply excessive force on the fins when handling the heatsink.

  • Page 40: Overview Of The Cpu Socket

    Chapter 3: Maintenance and Component Installation Overview of the CPU Socket The CPU socket is protected by a plastic protective cover. Plastic Protective Cover CPU Socket...

  • Page 41: Overview Of The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Overview of the Processor Carrier Assembly The processor carrier assembly contains a 3rd Gen Intel Xeon Scalable processor and a processor carrier. Carefully follow the instructions given in the installation section to place a processor into the carrier to create a processor carrier.

  • Page 42: Overview Of The Processor Heatsink Module

    Chapter 3: Maintenance and Component Installation Overview of the Processor Heatsink Module The Processor Heatsink Module (PHM) contains a heatsink, a processor carrier, and a 3rd Gen Intel Xeon Scalable processor. 1. Heatsink 2. Processor Carrier 3. The 3rd Gen Intel Xeon Scalable Processor 4.

  • Page 43: Creating The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Creating the Processor Carrier Assembly The processor carrier assembly contains a 3rd Gen Intel Xeon Scalable processor and a processor carrier. To create the processor carrier assembly, please follow the steps below: Note: Before installation, be sure to follow the instructions given on Page 1 and Page 2 of this chapter to properly prepare yourself for installation.
  • Page 44 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the CPU socket and press the lever down as shown below. Lever 4. Using Pin 1 as a guide, carefully align the CPU keys (A and B) on the processor against the CPU keys on the carrier (a and b) as shown in the drawing below.

  • Page 45: Creating The Processor Heatsink Module (Phm)

    Chapter 3: Maintenance and Component Installation Creating the Processor Heatsink Module (PHM) After creating the processor carrier assembly, please follow the instructions below to mount the processor carrier into the heatsink to form the processor heatsink module (PHM). Note: If this is a new heatsink, the thermal grease has been pre-applied on the un- derside.

  • Page 46: Preparing The Cpu Socket For Installation

    Chapter 3: Maintenance and Component Installation Preparing the CPU Socket for Installation This motherboard comes with a plastic protective cover installed on the CPU socket. Remove it from the socket to install the Processor Heatsink Module (PHM). Gently pull up one corner of the plastic protective cover to remove it.

  • Page 47: Preparing To Install The Processor Heatsink Module (Phm) Into The Cpu Socket

    Chapter 3: Maintenance and Component Installation Preparing to Install the Processor Heatsink Module (PHM) into the CPU Socket After assembling the Processor Heatsink Module (PHM), you are ready to install it into the CPU socket. To ensure the proper installation, please follow the procedures below: 1.

  • Page 48: Installing The Processor Heatsink Module (Phm)

    Chapter 3: Maintenance and Component Installation Installing the Processor Heatsink Module (PHM) 1. Align peek nut "A", which is next to the triangle (Pin 1) on the heatsink, against threaded fastener "a" on the CPU socket. Then align peek nuts "B", "C", and "D" on the heatsink against threaded fasteners "b", "c", and "d"...
  • Page 49 Chapter 3: Maintenance and Component Installation 4. With a T30-bit screwdriver, tighten all peek nuts in the sequence of "A", "B", "C", and "D" with even pressure. To avoid damaging the processor or socket, do not use a force greater than 12 lbf-in when tightening the screws. 5.

  • Page 50: Connecting Cpu Fan Connectors

    Chapter 3: Maintenance and Component Installation AIOM AIOM-A AIOM-B JSLIM-RA1 JSLIM-RA2 MH14 JTPM1 Connecting CPU Fan Connectors LEDM1 JM2_2 JM2_1 When you connect CPU fans, make sure you connect the cables to the proper fan JPW2 JPW4 JPW1 JPW3 PWR3 PWR4 connector: Use the FAN 1 connector for the fan of CPU 1 and the FAN 7 connector for P12V...

  • Page 51: Removing The Processor Heatsink Module From The Cpu Socket

    Chapter 3: Maintenance and Component Installation Removing the Processor Heatsink Module from the CPU Socket Before removing the processor heatsink module (PHM) from the motherboard, unplug the AC power cord from all power supplies after shutting down the system. Then follow the steps below: 1.
  • Page 52 Chapter 3: Maintenance and Component Installation Removing the Processor Carrier Assembly from the Processor Heatsink Module (PHM) To remove the processor carrier assembly from the PHM, please follow the steps below: 1. Detach four plastic clips (marked a, b, c, and d) on the processor carrier assembly from the four corners of heatsink (marked A, B, C, and D) in the drawings below.

  • Page 53: Removing The Processor From The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Removing the Processor from the Processor Carrier Assembly Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below. 1.

  • Page 54: Memory Support And Installation

    Chapter 3: Maintenance and Component Installation 3.4 Memory Support and Installation Note: Check the Supermicro website for recommended memory modules. Important: Exercise extreme care when installing or removing DIMM modules to pre- vent any possible damage. Memory Support The X12DPG-OA6-GD2 supports up to 8TB of 3DS LRDIMM/LRDIMM/3DS RDIMM/RDIMM DDR4 (288-pin) ECC memory with speeds of 3200/2933/2666 MT/s in 32 memory slots or up to 8TB of Intel Optane PMem 200 Series with speeds of up to 3200 MT/s.

  • Page 55: Memory Population Table For 3Rd Gen Intel Xeon Scalable Processors

    2 CPUs & 28 DIMMs CPU2: P2-DIMMA1/P2-DIMME1/P2-DIMMC1/P2-DIMMG1/P2-DIMMB1/P2-DIMMF1/P2-DIMMD1/P2-DIMMH1/ P2-DIMMA2/P2-DIMME2/P2-DIMMC2/P2-DIMMG2 CPU1: P1-DIMMA1/P1-DIMME1/P1-DIMMC1/P1-DIMMG1/P1-DIMMB1/P1-DIMMF1/P1-DIMMD1/P1-DIMMH1/ 2 CPUs & 32 DIMMs P1-DIMMA2/P1-DIMME2/P1-DIMMC2/P1-DIMMG2/P1-DIMMB2/P1-DIMMF2/P1-DIMMD2/P1-DIMMH2 (Note) CPU2: P2-DIMMA1/P2-DIMME1/P2-DIMMC1/P2-DIMMG1/P2-DIMMB1/P2-DIMMF1/P2-DIMMD1/P2-DIMMH1/ P2-DIMMA2/P2-DIMME2/P2-DIMMC2/P2-DIMMG2/P2-DIMMB2/P2-DIMMF2/P2-DIMMD2/P2-DIMMH2 Note: This memory configuration is recommended by Supermicro for optimal memory performance. Please use this configuration to maximize your memory performance.

  • Page 56: Intel Optane Pmem 200 Series Memory Population Table

    Chapter 3: Maintenance and Component Installation Intel Optane PMem 200 Series Memory Population Table Note: The Intel Optane™ Persistent Memory (PMem) 200 Series supports ® 3rd Gen Intel Xeon Scalable (83xx/63xx/53xx/4314 Series) Processors. PMem 200 Series Population Table for X12DP 32-DIMM Motherboards (within 1 CPU socket) DDR4+ AD Inter- Mode...
  • Page 57 Chapter 3: Maintenance and Component Installation Validation Matrix (DDR4 DIMMS with PMem 200 Series) DIMM Capacity (GB) Ranks Per DIMM DIMM Type & Data Width DRAM Density (Stack) 16Gb 1Rx8 1Rx4 16GB 32GB RDIMM (up to 3200) 1Rx8 16GB 32GB 1Rx4 32GB 64GB...

  • Page 58: Dimm Installation

    Chapter 3: Maintenance and Component Installation DIMM Installation 1. Insert the desired number of DIMMs into the memory slots based on the recommended DIMM population tables in the previous section. Locate DIMM memory slots on the motherboard as shown on the right. 2.

  • Page 59: Dimm Removal

    Chapter 3: Maintenance and Component Installation 5. Push both ends of the module straight down into the slot until the module snaps into place. 6. Press the release tabs to the lock positions to secure the DIMM module into the slot. Push both ends straight down into the memory slot.

  • Page 60: Motherboard Battery

    Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.

  • Page 61: Storage Drives

    (Both procedures may be done without removing power from the system.) These carriers also help promote proper airflow. Note: Enterprise level storage drives are recommended for use in Supermicro chassis and servers. For information on recommended storage drives, visit the Supermicro website at http://www.supermicro.com/products/nfo/storage.cfm...
  • Page 62 Chapter 3: Maintenance and Component Installation 9~16 17~24 Figure 3-8. Logical Drive Numbers Logical Drive Numbers Bay # Description Four 2.5" NVMe drive bays 9-16 Up to eight 2.5" SATA drive bays Up to sixteen 2.5" SAS/SATA drive bays 9-24 (An additional RAID card is required.)

  • Page 63: Removing/Installing Drives

    Chapter 3: Maintenance and Component Installation Removing/Installing Drives Removing Drive Carriers from the Chassis 1. Slide the handle lever on the drive carrier up to unlock the carrier handle. This releases and extends the drive carrier handle. Handle Lever Figure 3-9. Unlocking Handle 2.
  • Page 64 Chapter 3: Maintenance and Component Installation Installing a 2.5" Drive 1. Place the drive carrier on a flat surface. 2. Orient the drive with the connector facing the bottom rear of the carrier. The drive can be inserted from above the carrier and into the clips until a "click" is heard. 3.

  • Page 65: Installing M.2 Solid State Drives

    Chapter 3: Maintenance and Component Installation Installing M.2 Solid State Drives The X12DPG-OA6-GD2 motherboard has two hybrid M.2 slots located at JM2_1 and JM2_2. M.2 was formerly known as Next Generation Form Factor (NGFF) and serves to replace mini PCIe. M.2 allows for a variety of card sizes, increased functionality, and spatial efficiency. The M.2 socket on the motherboard supports PCIe 3.0 x4 (32 Gb/s) SSD cards in the 2280 and 22110 form factors.
  • Page 66 Chapter 3: Maintenance and Component Installation Installing an M.2 2280 Device 1. Power down the system and remove the CPU tray as described in Sections 3.1 and 3.2. 2. Remove any components blocking the M.2 sockets. 3. To loosen the M.2 plastic standoff on the motherboard, lift up its top square latch, and use gentle force to pull it out of the hole.

  • Page 67: Expansion Cards

    3.7 Expansion Cards The system has two PCIe 4.0 x16 FHFL slots and two PCIe 4.0 x8 FHFL slots. Note: Expansion cards are recommended to be serviced by Supermicro due to the optimized density of the 8U form factor. Installing PCIe Expansions Cards 1.
  • Page 68 Chapter 3: Maintenance and Component Installation 3. Insert an expansion card into the riser slot to create an assembly. Figure 3-14 Installing the Rise Card 4. Insert the assembly into the motherboard and install a screw to secure the expansion card to the chassis.

  • Page 69: System Cooling

    Chapter 3: Maintenance and Component Installation 3.8 System Cooling Twelve heavy-duty fan modules provide cooling for the chassis. The fan modules are located in the rear of the chassis. The chassis comes with pre-installed internal fan modules. Each fan is hot-swappabe, and can be replaced without any connections being removed. System Fan Failure Fan speed is controlled by thermal sensors and ambient temperature through BMC.

  • Page 70: Replacing Power Fan Modules

    Chapter 3: Maintenance and Component Installation Replacing Power Fan Modules Both system fan modules and power supply fans run to simultaneously cool down the system. Changing a System Fan 1. Determine which fan has failed. It is recommended that BMC should be checked in advance.

  • Page 71: Power Supply

    The chassis features six 4+2 3000W (+54V:2100W, +12V:1100W), redundant power supplies. The power modules can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors. These power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 200-240v.

  • Page 72: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.
  • Page 73 The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the hard drive is not installed in the system.

  • Page 74: Input/Output Ports

    Chapter 4: Motherboard Connections 4.2 Input/Output Ports Front I/O Ports VGA Connection The onboard VGA port is located on the I/O back panel. This VGA connection provides an analog interface support between the computer and the video display. Universal Serial Bus (USB) Ports and Header There is one internal USB 3.2 Gen 1 header (JUSB3) on the motherboard.

  • Page 75: Front Control Panel

    Chapter 4: Motherboard Connections 4.3 Front Control Panel JF1 contains header pins for various buttons and indicators that are normally located on a control panel at the front of the chassis. See the figure below for the descriptions of the front control panel buttons and LED indicators.
  • Page 76 Chapter 4: Motherboard Connections Power Fail LED The Power Fail LED connection is located on pins 5 and 6 of JF1. Refer to the table below for pin definitions. Power Fail LED Pin Definitions (JF1) Pin# Definition 3.3V PWR Fail for LED6 (Solid red on: PWR failure) Information LED (OH/Fan Fail/PWR Fail/UID LED) The Information LED (OH/Fan Fail/PWR Fail/UID LED) connection is located on pins 7 and 8 of JF1.
  • Page 77 Chapter 4: Motherboard Connections NIC1/NIC2 (LAN1/LAN2) The NIC (Network Interface Controller) LED connection for LAN port 1 is located on pins 11 and 12 of JF1, and pins 9 and 10 on LAN port 2. Refer to the tables below for pin definitions LAN1/LAN2 LED LAN1/LAN2 LED Pin Definitions...

  • Page 78: Jumpers

    Chapter 4: Motherboard Connections 4.4 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with a square solder pad on the printed circuit board. See the diagram below for an example of jumping pins 1 and 2.
  • Page 79 BMC settings. Both functions are available when it connects to the system UID/BMC reset switch via the midplane to the carrier board. You may refer to the Supermicro system user's manual or the BMC user's guide posted on our website at http://www.supermicro.com...

  • Page 80: Chapter 5 Software

    Chapter 5: Software Chapter 5 Software After the hardware has been installed, you can install the Operating System (OS), configure RAID settings and install the drivers. 5.1 Habana Gaudi 2 Software Installation ® Habana Gaudi 2 software was designed to provide users with ease of use and in optimizing ®...

  • Page 81: Scale-Out

    Chapter 5: Software 5.2 Scale-Out The networking capacity of Habana Gaudi 2 allows for scaling out in the eight-card Gaudi ® server. For one OAM card, 24x 100 GbE PAM4 SerDes Links can be split into twenty-one 100GbE OAM-to-OAM connections and three 100GbE ports for scale-out. In total, there are 2.4 TbE connections connected to six QSFP-DD ports.

  • Page 82: Qsfp-Dd Serdes Lane Port Numbers For Scale-Out

    Chapter 5: Software QSFP-DD SerDes Lane Port Numbers for Scale-Out Habana Gaudi 2 provides six QSFP-DD ports (24x 100GbE) for multi-node scale-out. Refer ® to the picture below for the QSFP-DD SerDes lane port numbers for scale-out. For details, please refer to the Habana official website: https://habana.ai/products/gaudi2/ OAM#7 OAM#6...

  • Page 83: Bmc

    There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: https://www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.

  • Page 84: Bmc Password Label Locations

    Chapter 5: Software BMC Password Label Locations To locate the BMC password sticker on the motherboard, refer to the layout below. Motherboard AIOM AIOM-A AIOM-B JSLIM-RA1 JSLIM-RA2 MH14 JTPM1 LEDM1 JM2_2 JM2_1 JPW2 JPW4 JPW1 JPW3 PWR3 PWR4 P12V JPW_STBY1 JPWR7 JPWR8 JPWR10 JPWR1...

  • Page 85: Chapter 6 Optional Components

    Chapter 6: Optional Components Chapter 6 Optional Components This chapter describes optional system components and installation procedures. 6.1 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs ® directly attached to Intel Xeon Scalable processors.

  • Page 86: Additional Information

    To see the latest support information: https://www.intel.com/content/www/us/en/support/ articles/000030310/memory-and-storage/ssd-software.html Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.

  • Page 87: Enabling Nvme Raid

    Chapter 6: Optional Components Enabling NVMe RAID RAID for NVMe SSDs must be enabled through the UEFI BIOS. 1. Install the patch as described in the Restrictions and Requirements section on a previous page. 2. Reboot the server. 3. Press [DEL] key to enter BIOS. 4.
  • Page 88 Chapter 6: Optional Components Figure 6-2. BIOS VMD Setting Examples...
  • Page 89 Chapter 6: Optional Components 13. Select Strip Size (Default 64KB). 14. Select Create Volume. 15. If another RAID is needed, start again at step 6. 16. Press [F4] to save and reboot. Figure 6-3. Created Volume without Figure 6-4. Created Volume with enabling RAID spanned over VMD enabling RAID spanned over VMD Controller...

  • Page 90: Status Indications

    Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blinking Fault Solid on Rebuilding 1 Hz blinking IBPI SFF 8489 Defined Status LED States Hot Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other...

  • Page 91: Chapter 7 Troubleshooting And Support

    Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by clicking the menu icon, then selecting the Products option.

  • Page 92: Bmc Interface

    Security Center for recent security notices Supermicro Phone and Addresses 7.2 BMC Interface The system supports a Baseboard Management Controller (BMC) interface, which provides remote access, monitoring and management. There are several BIOS settings related to the BMC.

  • Page 93: Troubleshooting Procedures

    Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures Returning Merchandise for Service section(s) in this chapter. Power down the system before changing any non hot-swap hardware components.

  • Page 94: Memory Errors

    • Memory: Make sure that the memory modules are supported. Refer to the product page on our website at www.supermicro.com. Test the modules using memtest86 or a similar utility. • Storage drives: Make sure that all drives work properly. Replace if necessary.
  • Page 95 Chapter 7: Troubleshooting and Support • Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements. •...

  • Page 96: Crash Dump Using The Bmc Dashboard

    In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using the BMC Dashboard. The BMC manual is available at www.supermicro.com/manuals/ other/BMC_Users_Guide_X12_H12.pdf. Check Error Log 1.

  • Page 97: Uefi Bios Recovery

    Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
  • Page 98 USB device or a writable CD/DVD. Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
  • Page 99 Chapter 7: Troubleshooting and Support Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below. 4. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update"...
  • Page 100 Chapter 7: Troubleshooting and Support 7. Press <Del> continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press <F4>...
  • Page 101 Chapter 7: Troubleshooting and Support Note: Do not interrupt this process until the BIOS flashing is complete. 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.

  • Page 102: Cmos Clear

    Chapter 7: Troubleshooting and Support 7.6 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.

  • Page 103: Where To Get Replacement Components

    7.7 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.

  • Page 104: Vendor Support Filing System

    For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.9 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. To provide feedback on our manuals, please email us at techwriterteam@...

  • Page 105: Contacting Supermicro

    San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 106: Appendix A Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 107 Appendix AStandardized Warning Statements for AC Systems Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 108 Appendix AStandardized Warning Statements for AC Systems . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 109 Appendix AStandardized Warning Statements for AC Systems Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 110 Appendix AStandardized Warning Statements for AC Systems Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 111 Appendix AStandardized Warning Statements for AC Systems Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components. 電源切断の警告...
  • Page 112 Appendix AStandardized Warning Statements for AC Systems ‫אזהרה מפני ניתוק חשמלי‬ ‫!אזהרה‬ ‫יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק‬ ‫.לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים‬ ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت...
  • Page 113 Appendix AStandardized Warning Statements for AC Systems Attention Il est vivement recommandé de confier l'installation, le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés. !‫אזהרה‬ .‫צוות מוסמך בלבד רשאי להתקין, להחליף את הציוד או לתת שירות עבור הציוד‬ ‫واملدربيه...
  • Page 114 Appendix AStandardized Warning Statements for AC Systems Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
  • Page 115 Appendix AStandardized Warning Statements for AC Systems Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
  • Page 116 Appendix AStandardized Warning Statements for AC Systems ‫هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل‬ ‫اسحبذال البطارية‬ ‫فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة‬ ‫جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة‬ 경고! 배터리가...
  • Page 117 Appendix AStandardized Warning Statements for AC Systems ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
  • Page 118 Appendix AStandardized Warning Statements for AC Systems Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时，背板上有很危险的电压或能量，进行维修时务必小心。 警告 當系統正在進行時，背板上有危險的電壓或能量，進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
  • Page 119 Appendix AStandardized Warning Statements for AC Systems ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스...
  • Page 120 Appendix AStandardized Warning Statements for AC Systems ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬ 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다. Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften.
  • Page 121 Appendix AStandardized Warning Statements for AC Systems Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 122 Appendix AStandardized Warning Statements for AC Systems Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
  • Page 123 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
  • Page 124 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro.
  • Page 125 사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...

  • Page 126: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors Dual 3rd Gen Intel Xeon Scalable processors, Socket P+ (LGA-4189), up to 270W TDP ® ® Note: Refer to the motherboard specifications pages on our website for updates to supported processors. Chipset Intel C620A...
  • Page 127 Appendix B: System Specifications Applied Directives, Standards EMC/EMI: 2014/30/EU (EMC Directive) CLASS A Electromagnetic Compatibility Regulations 2016 FCC Part 15 Subpart B ICES-003 VCCI-CISPR 32 AS/NZS CISPR 32 BS/EN55032 BS/EN55035 CISPR 32 CISPR 35 EN 61000-3-2 EN 61000-3-3 EN 61000-4-2 EN 61000-4-3 EN 61000-4-4 EN 61000-4-5...

Table of Contents