1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Server
  5. SuperServer SYS-421GU-TNXR
  6. User manual

Supermicro SuperServer SYS-421GU-TNXR User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
SuperServer
®
SYS-421GU-TNXR
USER'S MANUAL
Revision 1.0a

Advertisement

Table of Contents
loading

Related Manuals for Supermicro SuperServer SYS-421GU-TNXR

Summary of Contents for Supermicro SuperServer SYS-421GU-TNXR

  • Page 1 SuperServer ® SYS-421GU-TNXR USER’S MANUAL Revision 1.0a...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...

  • Page 4: Table Of Contents

    Contents Contents Chapter 1 Introduction 1.1 Overview ..........................9 1.2 System Features ........................10 Front View .........................10 BMC Password .........................10 Drive Carrier Indicators ....................10 Control Panel .........................11 Rear View ..........................12 Power Supply Indicator ....................13 LAN Speed Indicator .....................13 Top View, Components .....................14 1.3 Motherboard Layout ......................15 Quick Reference .......................16 Motherboard Block Diagram .....................18...
  • Page 5 Contents 2.5 Installing the Chassis into a Rack ..................26 Removing the Chassis from the Rack ................27 Chapter 3 Maintenance and Component Installation 3.1 Removing Power .......................28 3.2 Accessing the System ......................29 Top Cover, Front .......................29 Accessing the GPUs ......................30 Top Cover, Rear ........................31 Mid-Chassis Access .......................31 Rear Chassis Access .....................32 3.3 Processor and Heatsink .....................33...
  • Page 6 Contents Hot-Swap for NVMe Drives ....................54 Checking the Temperature of an NVMe Drive ..............55 3.7 GPUs ..........................55 3.8 System Cooling ........................59 Fans ..........................59 Air Shroud .........................61 3.9 Power Supply ........................63 Power Supply LEDs ......................63 3.10 Expansion Slots and Riser Cards ..................64 3.11 Cable Routing Diagrams ....................67 Chapter 4 Motherboard Connections 4.1 Input/Output Ports ......................70...
  • Page 7 7.9 Where to Get Replacement Components ................107 7.10 Reporting an Issue ......................107 Technical Support Procedures ..................107 Returning Merchandise for Service .................107 Vendor Support Filing System ..................108 7.11 Feedback .........................108 7.12 Contacting Supermicro ....................109 Appendix A Standardized Warning Statements for AC Systems Appendix B System Specifications...
  • Page 8 San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 9: Chapter 1 Introduction

    4U rackmount; (WxHxD) 17.3” x 7.0” x 30.5” (438 x 176 x 774 mm) A link to the Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SYS-421GU-TNXR have been certified as...

  • Page 10: System Features

    Chapter 1: Introduction 1.2 System Features Front View Service/Asset Tag Storage Drives with BMC Password Control Panel Figure 1-1. Front View BMC Password The system has a unique password for ADMIN user access to the BMC. This password can be found on a sticker on the the slide-out asset tag. See Chapter 5 for more details.

  • Page 11: Control Panel

    Chapter 1: Introduction Control Panel Power Button UID Button/LED BMC Reset Power LED Drive Activity LED NIC LED NIC LED Information LED Power Fail LED Figure 1-2. Control Panel Control Panel Features Features Description The main power switch applies or removes primary power from the power supply to the Power Button server but maintains standby power.

  • Page 12: Rear View

    Chapter 1: Introduction Information LED Color, Status Description Red, blinking at 10Hz CPLD recovery mode error Blue, solid Unit ID has been activated by switch Blue, blinking at 1Hz Unit ID has been activated using the BMC Blue, blinking at 2Hz, and BMC Heartbeat BMC is resetting LED on the motherboard is green Blue, blinking at 4Hz...

  • Page 13: Power Supply Indicator

    Indicates that the power supply has a warning condition and continues to operate. Indicates that the power supply is plugged in, and is in an abnormal state. The Solid Amber system might need service. Please contact Supermicro technical support. No AC power to modules LAN Speed Indicator One LED indicates the network speed.

  • Page 14: Top View, Components

    Chapter 1: Introduction Top View, Components PCIe Cards Processor DIMM Slots Fans GPUs Figure 1-4. Top View, Internal...

  • Page 15: Motherboard Layout

    Chapter 1: Introduction 1.3 Motherboard Layout Below is a layout of the X13DGU motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard Manual.

  • Page 16: Quick Reference

    Chapter 1: Introduction Quick Reference Jumper Description Default Setting JBT1 CMOS Clear Open: Normal CPLD (Complex Programmable Logic JPFR1/JPFR2/JPFR3 Open: Disabled Device) JTAG Enable Jumper JPTG1 On-board 10G LAN device Enable Pins 1/2: Enable 10G LAN Pins 1/2: UID LED (Default), Pins 3/4: BMC JRU1 UID LED/BMC Reset Jumper Reset...
  • Page 17 Chapter 1: Introduction Connector Description SlimSAS LP (MCIO) connector with support of six Intel PCH SATA 3.0 SATA 0-3 (JS1) connections (RAID 0, RAID 1, RAID 5, and RAID 10 supported) SlimSAS LP (MCIO) connector with support of six Intel PCH SATA 3.0 SATA 4-7 (JS2) connections (RAID 0, RAID 1, RAID 5, and RAID 10 supported) SW_PWR1...

  • Page 18: Motherboard Block Diagram

    Chapter 1: Introduction Motherboard Block Diagram MBD-X13DGU Rev. 1.02 CPU1-D1/D2 CPU1-C1/C2 CPU1-B1/B2 CPU1-A1/A2 CPU2-A1/A2 CPU2-B1/B2 CPU2-C1/C2 CPU2-D1/D2 CPU2 CPU1 4th Gen Scalable CPU1-H1/H2 CPU1-G1/G2 CPU1-F1/F2 CPU1-E1/E2 CPU2-E1/E2 CPU2-F1/F2 CPU2-G1/G2 CPU2-H1/H2 4th Gen Scalable MCIO x8 MCIO x8 VERT VERT MCIO x8 VERT MCIO x8 Intel...

  • Page 19: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.

  • Page 20: Rack Precautions

    Chapter 2: Server Installation • This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units. Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.

  • Page 21: Airflow

    Chapter 2: Server Installation Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised. Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.

  • Page 22: Installing The Rails

    Chapter 2: Server Installation 2.4 Installing the Rails There are a variety of rack units on the market, which may require a slightly different assembly procedure. This rail set fits a rack between 26.8" and 36.4" deep. The following is a basic guideline for installing the system into a rack with the rack mounting hardware provided.

  • Page 23: Releasing The Inner Rail

    Chapter 2: Server Installation Releasing the Inner Rail Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing. To mount the rail onto the chassis, first release the inner rail from the outer rails. 1.

  • Page 24: Installing The Inner Rails On The Chassis

    Chapter 2: Server Installation Installing the Inner Rails on the Chassis Installing the Inner Rails 1. Identify the left and right inner rails. They are labeled. 2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.

  • Page 25: Installing The Outer Rails Onto The Rack

    Chapter 2: Server Installation Installing the Outer Rails onto the Rack Each end of the assembled outer rail includes a bracket with hooks and square, spring-loaded pegs to fit into the square holes in your rack. Installing the Outer Rail 1.

  • Page 26: Installing The Chassis Into A Rack

    Chapter 2: Server Installation 2.5 Installing the Chassis into a Rack Once rails are attached to the chassis and the rack, you can install the server. Warning: Mounting the system into the rack requires at least two people to support the chassis during installation.

  • Page 27: Removing The Chassis From The Rack

    Chapter 2: Server Installation Removing the Chassis from the Rack Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack.

  • Page 28: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.

  • Page 29: Accessing The System

    Chapter 3: Maintenance and Component Installation 3.2 Accessing the System Caution: Except for short periods of time, do not operate the server without the cover in place. The system cover must be in place to allow for proper airflow and to prevent overheating. Top Cover, Front Release Buttons Figure 3-1.

  • Page 30: Accessing The Gpus

    Chapter 3: Maintenance and Component Installation Accessing the GPUs To access the area of the GPUs, first remove the top front cover. Then remove the storage drive housing. Release Handles Figure 3-2. Removing the Storage Drive Housing 1. Remove the top, front cover. 2.

  • Page 31: Top Cover, Rear

    Chapter 3: Maintenance and Component Installation Top Cover, Rear The rear cover has two parts--one accesses the mid-chassis. Mid-Chassis Access Open the mid-chassis cover to access the system fans. Release Buttons Figure 3-3. Opening the Mid-Chassis Cover • Slide both release latches and lift the cover.

  • Page 32: Rear Chassis Access

    Chapter 3: Maintenance and Component Installation Rear Chassis Access To access the motherboard and PCIe riser cards, remove the rear cover. Release Buttons Figure 3-4. Removing the Rear Cover 1. Remove the screws—five on the top rear and two on each side. 2.

  • Page 33: Processor And Heatsink

    Chapter 3: Maintenance and Component Installation 3.3 Processor and Heatsink Processor Overview The motherboard supports three versions of the 4th Gen Intel Scalable processors. Each version differs in the number of cores and comes with a different CPU carrier. The XCC version supports up to 60 cores, the MCC version supports up to 32 cores, and the Max Series (HBM) version supports up to 56 cores.

  • Page 34: Installation Overview

    Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor support. Installation Procedure Overview After preparing the system and following ESD precautions, there are four steps to installing the processor and heatsink onto the motherboard.

  • Page 35: Create The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Create the Processor Carrier Assembly Process Carrier Assembly 1. Hold the processor with the gold pins (LGA lands) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below.
  • Page 36 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the processor socket and press it down as shown below. Lever Carrier E1A only 4. Using pin 1 as a guide, carefully align the CPU keys on the processor (A & B) with those on the carrier (a &...

  • Page 37: Create The Processor Heatsink Module

    Chapter 3: Maintenance and Component Installation Create the Processor Heatsink Module If this is a re-installation, apply the proper amount of thermal grease to the underside of the heatsink. Processor Heatsink Module 1. Turn the heatsink over with the thermal grease facing up. Pay attention to the two triangle cutouts (A, B) located at the diagonal corners of the heatsink as shown in the drawing below.

  • Page 38: Remove The Socket Cover

    Chapter 3: Maintenance and Component Installation Remove the Socket Cover Remove the plastic protective cover on the socket by gently squeezing the grip tabs and pulling the cover off. CPU Socket with Plastic Protective Cover...

  • Page 39: Install The Phm

    Chapter 3: Maintenance and Component Installation Install the PHM After assembling the Processor Heatsink Module (PHM), you are ready to install it into the CPU socket. 1. Locate four threaded fasteners (a, b, c, d) on the CPU socket. (a, b, c, d: Threaded Fasteners) CPU Socket Pin1 2.
  • Page 40 Chapter 3: Maintenance and Component Installation 4. Align PEEK nut "A" (next to the trianglular pin 1 on the heatsink) with threaded fastener "a" on the CPU socket. Then align PEEK nuts "B", "C", "D" on the heatsink with threaded fasteners "b", "c", "d" on the CPU socket, making sure that all PEEK nuts and threaded fasteners are properly aligned.

  • Page 41: Removing The Phm From The Motherboard

    Chapter 3: Maintenance and Component Installation Removing the PHM from the Motherboard Shut down the system and unplug the AC power cord from all power supplies. 1. Use a T30-bit screwdriver to loosen the four PEEK nuts on the heatsink in the sequence of A, B, C, and D.

  • Page 42: Removing The Carrier Assembly From The Heatsink

    Chapter 3: Maintenance and Component Installation Removing the Carrier Assembly from the Heatsink To remove the processor carrier assembly from the PHM, please follow the steps below: 1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown below.

  • Page 43: Removing The Processor From The Carrier Assembly

    Chapter 3: Maintenance and Component Installation Removing the Processor from the Carrier Assembly Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below. 1.

  • Page 44: Memory

    Chapter 3: Maintenance and Component Installation 3.4 Memory Memory Support This motherboard supports up to 8 TB 3DS RDIMM/RDIMM DDR5 (288-pin) ECC memory with speeds up to 4800 MT/s (1DPC) / 4400 MT/s (2DPC) in 32 DIMM slots. LRDIMM/ LRDIMM-3DS is not supported. For validated memory, use our Product Resources page.

  • Page 45: Xcc And Mcc Cpus

    Chapter 3: Maintenance and Component Installation XCC and MCC CPUs Use the DIMM slots listed below for memory modules. This memory population table is based on guidelines provided by Intel to support Supermicro motherboards. Memory Population for XCC and MCC CPUs, 32 DIMM Slots CPUs/DIMMs Slots CPU1: A1;...

  • Page 46: Max Series (Hbm) Cpus

    Chapter 3: Maintenance and Component Installation Max Series (HBM) CPUs Memory Population for Max CPUs 32 DIMM Slots CPUs/DIMMs Slots CPU1: A1; CPU2: A1 or 2 CPUs & 2 DIMMs CPU1: E1; CPU2: E1 CPU1: A1, G1; CPU2: A1, G1 or 2 CPUs &...

  • Page 47: Memory Population Guidelines

    • Balance memory. Using unbalanced memory topology, such as populating two DIMMs in one channel while populating one DIMM in another channel, reduces performance. It is not recommended for Supermicro systems. Guidelines Regarding Mixing DIMMs • Mixing memory modules of different types, speeds, ranks and vendors is very likely to cause performance issues, and therefore not recommended.

  • Page 48: Installing Memory

    Chapter 3: Maintenance and Component Installation Installing Memory ESD Precautions Electrostatic Discharge (ESD) can damage electronic com ponents including memory modules. To avoid damaging DIMM modules, it is important to handle them carefully. The following measures are generally sufficient. • Use a grounded wrist strap designed to prevent static discharge.

  • Page 49: Motherboard Battery

    Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.

  • Page 50: Storage Drives

    The system supports six hot-swap 2.5" drives, NVMe or SATA. The drives are mounted in tool-less drive carriers that simplify their removal from the chassis. These carriers also help promote proper airflow. Note: Enterprise level drives are recommended for use in Supermicro servers. For compatible drives, see the system page.

  • Page 51: Removing/Installing Drives

    Chapter 3: Maintenance and Component Installation Removing/Installing Drives Figure 3-8. Removing a Drive Carrier Removing Drive Carriers from the Chassis 1. On the front of the drive carrier, push the release button. This releases and extends the drive carrier handle. If the release button does not release it, the handle may be locked—...
  • Page 52 Chapter 3: Maintenance and Component Installation Installing a Drive 1. Orient the drive with the connector facing the bottom rear of the carrier. The drive can be inserted from above the carrier and into the clips until a "click" is heard. 2.

  • Page 53: Installing M.2 Solid State Drives

    Chapter 3: Maintenance and Component Installation Installing M.2 Solid State Drives The motherboard supports two M.2 SSDs in slots, JM2_HC1 and JM2_HC2. They are PCIe 3.0 x2, NVMe or SATA M-Key with the 2280 form factor, and supported by CPU2. Installing M.2 Drives 1.

  • Page 54: Hot-Swap For Nvme Drives

    Chapter 3: Maintenance and Component Installation Hot-Swap for NVMe Drives Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using the BMC. Ejecting a Drive 1.

  • Page 55: Checking The Temperature Of An Nvme Drive

    Prior to submitting an RMA for GPUs, Nvidia requires that their Field Diagnostic tool is first run to isolate hardware failures and obtain a log file for review. Check with Supermicro Technical Services for more details. In addition, more details can be found in Nvidia reference document Baseboard Field Diagnostics Software Guide DU-09163-001.
  • Page 56 Chapter 3: Maintenance and Component Installation Bail Latch Handle Radsok/Surlock 54V Connector (Shown with protective cover) Latch Clips T10 Screw T10 Screw "T" Handle Figure 3-12. Replacing GPU Baseboard Module...
  • Page 57 Baseboard Field Diagnostics Software Guide DU-09163-001. Use these tools to determine the failed GPU and locate using the Cable Mapping Guide Figure and GPU Mapping Table. Be sure to identify the failed GPU correctly and if any questions reach out to Supermicro Technical Service team to help.
  • Page 58 Chapter 3: Maintenance and Component Installation Figure 3-13. Installing GPU Heatsinks...

  • Page 59: System Cooling

    Chapter 3: Maintenance and Component Installation 3.8 System Cooling Fans The system is cooled by two sets of fans. Each power supply module includes a 9-cm fan. In addition, there are five mid-chassis 8-cm high-performance fans. Fan speed is controlled by the BMC depending on the system temperature.
  • Page 60 3. Pinch the release tabs on the fan and lift it up and out. 4. Replace the failed fan with an identical fan, available from Supermicro. Push the new fan into the housing, making sure the air flow direction is the same.

  • Page 61: Air Shroud

    Chapter 3: Maintenance and Component Installation Air Shroud The air shroud concentrates airflow to maximize cooling efficiency. Installing the Standard Air Shrouds • Position the air shroud and drop them into place directly behind the fans. Figure 3-15. Installing the CPU Air Shrouds...
  • Page 62 Chapter 3: Maintenance and Component Installation Figure 3-16. Installing the GPU Air Shrouds...

  • Page 63: Power Supply

    It should be replaced as soon as convenient. The power supply modules are hot-swap, meaning they can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors. These power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 100-120v or 180-240v.

  • Page 64: Expansion Slots And Riser Cards

    Chapter 3: Maintenance and Component Installation 3.10 Expansion Slots and Riser Cards This system offers options for riser cards that provide custom PCIe capabilities. PCIe Slots Position* Riser Part Number Slots Description Right side, RSC-G-66G5 right-facing Right side, RSC-GR-66G5 left-facing PCIe 5.0 x16 Left side, RSC-G-66G5...
  • Page 65 Chapter 3: Maintenance and Component Installation Installing the Center Expansion Cards 1. Power down the system and remove the top rear cover as described in Section 3.1 3.2. 2. Grap the bracket for the two slots and riser card in which you want to install the card(s), and pull the assembly up and out.
  • Page 66 Chapter 3: Maintenance and Component Installation Locking Lever Figure 3-21. Expansion Bracket Release Tab 3. Open the locking lever at the side of the slot shield and remove the shield. 4. Insert the expansion card(s) into the riser card slot(s) while aligning the rear shield. 5.

  • Page 67: Cable Routing Diagrams

    Chapter 3: Maintenance and Component Installation 3.11 Cable Routing Diagrams The below diagrams indicate the cable routing for the storage, PCIe, IO, and power cables. When disconnecting cables to add or replace components, refer to the diagrams so you can reroute them in the same manner.
  • Page 68 Chapter 3: Maintenance and Component Installation HGX H100 4-GPU UBB cable rou�ng – signal cable  4 MCIO x8 (RA to STR), FFC, Fold,50.5-56.5cm CBL-MCIO-1257RM5FBX1 CBL-MCIO-1268RM5FBX2  4 MCIO x8 (RA to STR), FFC, Fold, 62-68cm JMC101 JMC103 JMC105 JMC107 JMC104 JMC106 JMC108 JMCI031...
  • Page 69 Chapter 3: Maintenance and Component Installation 6x HDD BPN cable routing - power cable CN123 JPWR1  1pcs 12V power cable【BPN side: Micro-Hi 2x4 - MB side: Micro-Hi 2x4】【82 cm】 CBL-PWEX-1141B-50 Figure 3-26. Storage Backplane Power Cable 8x PLX RSC cable routing - signal + power ...

  • Page 70: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.

  • Page 71: Headers And Connectors

    Chapter 4: Motherboard Connections 4.2 Headers and Connectors Power Connectors Two main power connectors are connected to busbars from the power distribution board in the system. Four 4-pin power connectors (JRSC_PWR1–JRSC_PWR4) are used for riser cards. Another two 4-pin power connectors (JAIOM_PWR1 and JAIOM_PWR2) provide additional power for Advanced I/O modules.
  • Page 72 The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro. A TPM/Port 80 connector is a security device that supports encryption and authentication in storage drives. It allows the motherboard to deny access if the TPM associated with the storage drive is not installed in the system.
  • Page 73 Chapter 4: Motherboard Connections M.2 SSD Slots Two PCIe 3.0, SATA3 hybrid M.2 slots are located at JM2_HC1 and JM2_HC2. These slots support PCIe 3.0 x4 M.2 NVMe and SATA3 SSDs in the 2280 form factor. Mounting holes are MH11 for JM2_HC1 slot support and MH10 for JM2_HC2 slot support. MCIO NVMe Connectors MCIO NVMe connectors, located at JMCIO 5/16/17/19/20/21/22/29/30/25/26/27/28/33/34 /35/36, provide eight PCIe 5.0 x8 connections on the motherboard.

  • Page 74: Control Panel

    Chapter 4: Motherboard Connections Control Panel JFP1 contains header pins for the front control panel connections. All JFP1 wires have been bundled into a single cable to simplify this connection. Make sure the red wire plugs into pin 1 as marked on the motherboard. The other end connects to the control panel PCB board. Power Button Reset/UID Button UID LED_N...
  • Page 75 Chapter 4: Motherboard Connections Standby Power LED The LED indicator for standby power is pin 8 of JFP1. If this LED is on, standby power is on. RoT (Root of Trust) Power LED The Power LED for RoT (Root of Trust) connection is l pin 9 of JFP1. If this LED is on, power for the RoT chip is on.

  • Page 76: Jumpers

    Chapter 4: Motherboard Connections 4.3 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.

  • Page 77: Led Indicators

    Chapter 4: Motherboard Connections CPLD JTAG Enable Jumper Use jumpers JPFR1, JPFR2, and JPFR3 to enable CPLD (Complex Programmable Logic Device) JTAG support. Connect a cable to JPFR1 to support CPLD JTAG. See the table below for jumper settings. CPLD JTAG Enable Jumper Jumper Settings Jumper Setting Definition...
  • Page 78 Chapter 4: Motherboard Connections Onboard Power LED The Onboard Power LED is located at LEDPWR on the motherboard. When this LED is on, the system power is on. It is off when the power cable is not connected BMC Heartbeat LED When the BMC heartbeat LED is blinking green, the BMC is functioning normally.

  • Page 79: Chapter 5 Software

    1. Create a method to access the MS Windows installation ISO file. That can be a USB flash or media drive. 2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
  • Page 80 Chapter 5: Software 4. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the drive you want to use is not listed, click on “Load driver” link at the bottom left corner. Figure 5-2.

  • Page 81: Driver Installation

    The Supermicro website contains drivers and utilities for your system at https://www. supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to to a USB flash or media drive.

  • Page 82: Superdoctor ® 5

    5.3 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

  • Page 83: Bmc

    There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.

  • Page 84: Chapter 6 Optional Components

    The JRK1 header is used to connect a Trusted Platform Module (TPM). A TPM is a security device that supports encryption and authentication in storage drives. It enables the motherboard to deny access if the TPM associated with the drive is not installed in the system. Details and installation procedures are at: http://www.supermicro.com/manuals/other/TPM.pdf. • AOM-TPM-9672V...

  • Page 85: Intel Virtual Raid On Cpu (Vroc)

    Chapter 6: Optional Components 6.2 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex.

  • Page 86: Additional Information

    Chapter 6: Optional Components Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.

  • Page 87: Configuring Intel Vmd

    Chapter 6: Optional Components Configuring Intel VMD VMD must be enabled on PCIe ports which have NVMe drives attached to them in order for those drives to be added to a VROC RAID configuration. The default BIOS setting for the NVMe Mode Switch is Auto which automatically enables VMD on all installed NVMe drives.
  • Page 88 Chapter 6: Optional Components This table identifies the NVMe Port Resources in this server. Enable VMD on the NVMe drive’s corresponding hardware stack according to the VMD BIOS Settings table. Intel VMD BIOS Settings, SYS-421GU-TNXR CPU1 CPU2 Slots VMD Config for IOU0: Socket 1 IOU0 port A NVMe 0 Socket 1 IOU0 port C...
  • Page 89 Chapter 6: Optional Components 4. Select “Intel VMD for Volume Management Device on” on Socket 0 (CPU1) or Socket 2 (CPU2) to enable VMD for devices under the respective CPU. Figure 6-3. Intel VMD for Volume Management Device on Socket 0 and Socket 1 5.
  • Page 90 Chapter 6: Optional Components Figure 6-5. BIOS, Enabling VMD on Socket 1 (Example) 6. Enable the NVMe port resource according to table above for the NVMe drives that will be used in a RAID configuration. Figure 6-6. BIOS, Enabling Socket 1 (Example)
  • Page 91 Chapter 6: Optional Components 7. Choose whether to make the NVMe drives in this IOU Hot Plug Capable by selecting Enabled or Disabled. 8. Repeat steps 4 through 7 for each IOU # on each CPU to enable VMD on the desired NVMe ports.

  • Page 92: Creating Nvme Raid Configurations

    Chapter 6: Optional Components Creating NVMe RAID Configurations 1. Open Advanced > Intel(R) Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume. Figure 6-8. Created Volume without Figure 6-9. Created Volume with enabling RAID spanned over VMD enabling RAID spanned over VMD controller controller...

  • Page 93: Status Indications

    Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blinking Fault Solid on Rebuilding 1 Hz blinking IBPI SFF 8489 Defined Status LED States Hot-Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other...

  • Page 94: Chapter 7 Troubleshooting And Support

    Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by clicking the Products option. •...

  • Page 95: Bmc Interface

    Security Center for recent security notices Supermicro Phone and Addresses 7.2 BMC Interface The system supports a Baseboard Management Controller (BMC) interface. It provides remote access, monitoring and management. There are several BIOS settings related to the BMC.

  • Page 96: Troubleshooting Procedures

    Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures Returning Merchandise for Service sections in this chapter. Power down the system before changing any non hot-swap hardware components.

  • Page 97: No Video

    • Memory: Make sure that the memory modules are supported. Refer to the product page on our website at www.supermicro.com. Test the modules using memtest86 or a similar utility. • Storage drives: Make sure that all drives work properly. Replace if necessary.
  • Page 98 Also check the Control panel Overheat LED. • Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements. •...

  • Page 99: Bios Error Post Codes

    When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20). For information on AMI updates, please refer to http://www.ami.com/products/.

  • Page 100: Crash Dump Using The Bmc Dashboard

    In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using the BMC Dashboard. The BMC manual is available at https://www.supermicro.com/ manuals/other/BMC_IPMI_X13_H13.pdf. Check Error Log 1.

  • Page 101: Uefi Bios Recovery

    Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
  • Page 102 Note 1: If you cannot locate the "Super.ROM" file in your drive, visit our website at www. supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM" for the BIOS recovery use.
  • Page 103 Chapter 7: Troubleshooting and Support Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below. 4. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update"...
  • Page 104 Chapter 7: Troubleshooting and Support 7. Press <Del> continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press <F4>...
  • Page 105 Chapter 7: Troubleshooting and Support Note: Do not interrupt this process until the BIOS flashing is complete. 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.

  • Page 106: Cmos Clear

    Chapter 7: Troubleshooting and Support 7.7 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.

  • Page 107: Where To Get Replacement Components

    7.9 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.

  • Page 108: Vendor Support Filing System

    For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.11 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. To provide feedback on our manuals, please email us at techwriterteam@...

  • Page 109: Contacting Supermicro

    San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 110: Appendix A Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 111 Appendix A: Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 112 Appendix A: Warning Statements . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 113 Appendix A: Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 114 Appendix A: Warning Statements Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 115 Appendix A: Warning Statements Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components. 電源切断の警告 システムコンポーネントの取り付けまたは取り外しのために、...
  • Page 116 Appendix A: Warning Statements ‫אזהרה מפני ניתוק חשמלי‬ ‫!אזהרה‬ ‫יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק‬ ‫.לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים‬ ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت...
  • Page 117 Appendix A: Warning Statements ¡Advertencia! Solamente el personal calificado debe instalar, reemplazar o utilizar este equipo. Attention Il est vivement recommandé de confier l'installation, le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés. !‫אזהרה‬ .‫צוות מוסמך בלבד רשאי להתקין, להחליף את הציוד או לתת שירות עבור הציוד‬ ‫واملدربيه...
  • Page 118 Appendix A: Warning Statements Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
  • Page 119 Appendix A: Warning Statements Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
  • Page 120 Appendix A: Warning Statements ‫هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل‬ ‫اسحبذال البطارية‬ ‫فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة‬ ‫جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة‬ 경고! 배터리가 올바르게 교체되지 않으면 폭발의 위험이 있습니다. 기존 배터리와 동일하거나 제 조사에서...
  • Page 121 Appendix A: Warning Statements ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
  • Page 122 Appendix A: Warning Statements Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时，背板上有很危险的电压或能量，进行维修时务必小心。 警告 當系統正在進行時，背板上有危險的電壓或能量，進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
  • Page 123 Appendix A: Warning Statements ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스 작업 시 주의하십시오. Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is.
  • Page 124 Appendix A: Warning Statements ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬ 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다. Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften.
  • Page 125 Appendix A: Warning Statements Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 126 Appendix A: Warning Statements Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
  • Page 127 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
  • Page 128 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro.
  • Page 129 사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...

  • Page 130: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors Dual 4th Gen Intel Xeon Scalable processors in socket E (LGA-4677) with four UPIs (16 GT/s max.) and a thermal design power (TDP) of up to 350 W; Supports SP XCC, SP MCC, and Max Series (HBM) SKUs. Chipset Intel PCH C741 BIOS...
  • Page 131 Appendix B: System Specifications Operating Environment Operating Temperature: 10º to 35º C (50º to 95º F) Non-operating Temperature: -40º to 60º C (-40º to 140º F) Operating Relative Humidity: 8% to 90% (non-condensing) Non-operating Relative Humidity: 5% to 95% (non-condensing) Regulatory Compliance FCC, ICES, CE, UKCA, VCCI, RCM, NRTL, CB Applied Directives, Standards...
  • Page 132 Appendix B: System Specifications General Data Center Environmental Specifications Particulate contamination specifications Air filtration: Data centers must be kept clean to Class 8 of ISO 14644-1 (ISO 2015). The air entering the data center should be filtered with a MERV 11 filter or better. The air within the data center should be continuously filtered with a MERV 8 filter or better.

Table of Contents