Supermicro SuperServer SYS-221BT-DNTR User Manual
  1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Server
  5. SuperServer SYS-221BT-DNTR
  6. User manual

Supermicro SuperServer SYS-221BT-DNTR User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
SuperServer
®
SYS-221BT-DNTR
SYS-221BT-DNC8R
USER'S MANUAL
Revision 1.0a

Advertisement

Table of Contents
loading

Related Manuals for Supermicro SuperServer SYS-221BT-DNTR

Summary of Contents for Supermicro SuperServer SYS-221BT-DNTR

  • Page 1 SuperServer ® SYS-221BT-DNTR SYS-221BT-DNC8R USER’S MANUAL Revision 1.0a...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...

  • Page 4: Table Of Contents

    Preface Contents Chapter 1 Introduction 1.1 Overview ..........................9 1.2 System Features ........................11 Front View .........................11 Control Panel .........................12 Rear View ..........................13 1.3 System Architecture ......................14 Main Components ......................14 System Block Diagram ......................15 1.4 Motherboard Layout ......................17 Quick Reference Table ......................18 Chapter 2 Server Installation 2.1 Overview ..........................20 2.2 Unpacking the System .......................20...
  • Page 5 Preface Removing the Chassis Cover ...................29 3.3 Processor and Heatsink Installation ...................30 Installation Overview ......................31 Removal Overview ......................31 Create the Processor Carrier Assembly ................32 Creating the PHM ......................36 Preparing the CPU Socket for Installation ................38 Installing the PHM into the CPU Socket ................39 Removing the PHM from the CPU Socket ...............40 Removing the Processor Carrier Assembly from the PHM ..........41 Removing the Processor from the Processor Carrier Assembly ........42...
  • Page 6 Preface 3.12 Backplane ..........................66 3.13 Storage Adapter ........................66 3.14 Cable Routing Diagrams ....................67 NVMe and SATA .......................67 NVMe and SAS via 3816 AOC ..................68 Chapter 4 Motherboard Connections 4.1 Power Connections ......................69 4.2 Headers and Connectors ....................70 4.3 Input/Output Ports ......................72 4.4 Jumpers ..........................74 How Jumpers Work ......................74 4.5 LED Indicators ........................77...
  • Page 7 Preface Chapter 7 Troubleshooting and Support 7.1 Information Resources .......................92 Website ..........................92 Direct Links for the SYS-221BT-D Series System ............92 Direct Links for General Support and Information ............93 7.2 Baseboard Management Controller (BMC) ................93 7.3 Troubleshooting Procedures .....................94 General Technique ......................94 No Power ..........................94 No Video ...........................95 System Boot Failure ......................95...
  • Page 8 San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.

  • Page 9: Chapter 1 Introduction

    2U rackmount; (WxHxD) 17.6 x 3.5 x 28.8 in. (449 x 88 x 730 mm) Notes: A Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SYS-221BT-D Series have been certified as...
  • Page 10 Chapter 1: Introduction System Models Models Storage Capabilities (per node) SYS-221BT-DNTR Twelve hybrid NVMe/SATA drives via backplane and NVMe and SATA cables Twelve hybrid NVMe/SAS drives via backplane and NVMe cables, riser card and 3816 SYS-221BT-DNC8R add-on card Note: Of the twelve hybrid drives, two support PCIe 5.0 NVMe and ten support PCIe 4.0 NVMe...

  • Page 11: System Features

    Chapter 1: Introduction 1.2 System Features The CSE-217BD2-R2K22P is a 2U chassis that supports 24 front hot-swappable drives and two rear hot-pluggable nodes. Front View Control Panels for Node A Control Panels for Node B Service Tag Thumbscrew Thumbscrew Figure 1-1. Front View System Features: Front Feature Description...

  • Page 12: Control Panel

    Chapter 1: Introduction Control Panel Node Label Power Button NIC LED Information LED UID LED Figure 1-2. Control Panel (One Per Node) Control Panel Features (One Per Node) Feature Description Node Label Label with the name of the node connected to the control panel. The main power switch applies or removes primary power from the power supply to the Power Button server but maintains standby power.

  • Page 13: Rear View

    Chapter 1: Introduction Rear View The illustration below shows the features included on the rear of the chassis. Power supply modules display status lights. Release Tab Power Supply Node Handle Node A Node B Dual Function Switch BMC LAN USB Ports VGA Port Figure 1-3.

  • Page 14: System Architecture

    Chapter 1: Introduction 1.3 System Architecture This section covers the printed circuit board (PCB) locations and the system block diagrams. Main Components Storage Backplane Storage Adapter M.2 Card Carrier Motherboard AIOM R i s e r C a r d f o r SYS-221BT-DNC8R Figure 1-4.

  • Page 15: System Block Diagram

    Chapter 1: Introduction System Block Diagram The block diagram below shows the connections and relationships between the subsystems and major components of the overall system. SYS-221BT-DNTR Block Diagram DIMMA1 DIMMA1 DIMMB1 DIMMB1 DIMMC1 DIMMC1 DIMMD1 DIMMD1 12.8G/14.4G/16GT/s DIMME1 DIMME1 IMC0 4CH IMC0 4CH CPU#1 CPU#2...
  • Page 16 Chapter 1: Introduction SYS-221BT-DNC8R Block Diagram DIMMA1 DIMMA1 DIMMB1 DIMMB1 DIMMC1 DIMMC1 DIMMD1 DIMMD1 12.8G/14.4G/16GT/s DIMME1 DIMME1 IMC0 4CH IMC0 4CH CPU#1 CPU#2 DIMMF1 DIMMF1 DIMMG1 DIMMG1 DDR5 DDR5 DIMMH1 DIMMH1 PECI:30 PECI:31 SOCKET ID:1 SOCKET ID:0 IMC1 4CH IMC1 4CH DMI3 DMI3 PCIe X8...

  • Page 17: Motherboard Layout

    Chapter 1: Introduction 1.4 Motherboard Layout Below is a layout of the X13DET-B motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard Manual.

  • Page 18: Quick Reference Table

    BMC_LAN (IPMI_LAN1) Dedicated BMC LAN port on the I/O backplane COM1 (JCOM1) Serial/COM port header Supermicro Advanced input/output Module (AIOM) PCIe 5.0 x16 slot supported JAIOM by CPU1 NC-SI (Network Controller Sideband Interface) connector (See Note 1 on the JNCSI1 next page.)
  • Page 19 Network Interface Card Configuration User's Guide posted on our website under the link: http://www.supermicro.com/support/manuals/. Note 2: The SXB5 slot supports the SCC-P2HM2G4-B1 and the SCC-A2NM2241G3-B1. The SCC-P2HM2G4-B1 supports two NVMe M.2 devices (up to Gen 4) in the 22110 form factor, and the SCC-A2NM2241G3-B1 supports two NVMe M.2 devices (up to...

  • Page 20: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.

  • Page 21: Rack Precautions

    Chapter 2: Server Installation • This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units. Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.

  • Page 22: Airflow

    Chapter 2: Server Installation Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised. Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.
  • Page 23 Chapter 2: Server Installation To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety: • This unit should be mounted at the bottom of the rack if it is the only unit in the rack. •...

  • Page 24: Rack Mounting Instructions

    Chapter 2: Server Installation 2.4 Rack Mounting Instructions This section provides information on installing the chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly from the instructions provided.

  • Page 25: Installing The Rails On A Rack

    Chapter 2: Server Installation Installing the Rails on a Rack 1. Loosen the adjusting screw to allow the rear section to slide in the front section. 2. Push the small hooks on the front section of the rail into the holes on the front post of the rack and then down, until the spring-loaded pegs snap into the rack holes.

  • Page 26: Chassis Installation

    Chapter 2: Server Installation Chassis Installation Slide the chassis into the rack so that the bottom of the chassis slides onto the bottom lip of the rails. Figure 2-3. Sliding the Chassis into the Rack Stability hazard. The rack stabilizing mechanism must be in place, or the rack must be bolted to the floor before you slide the unit out for servicing.

  • Page 27: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.

  • Page 28: Accessing The System

    Chapter 3: Maintenance and Component Installation 3.2 Accessing the System Removing a Computing Node Drawer Release Latch Lock Tab Node Handle Figure 3-1. Removing a Node Tray Removing a Node 1. Use the operating system to power down the node. 2.

  • Page 29: Removing The Chassis Cover

    Chapter 3: Maintenance and Component Installation Removing the Chassis Cover You can access some chassis components, such as fans, by removing the cover. Remove two screws Figure 3-2. Removing the Chassis Cover Removing the Chassis Cover The chassis top cover can be lifted off after removing two screws. Caution: Except for short periods of time, do not operate the server without the cover in place.

  • Page 30: Processor And Heatsink Installation

    Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor and memory support. • All graphics in this manual are for illustrations only. Your components may look different.

  • Page 31: Installation Overview

    Chapter 3: Maintenance and Component Installation Installation Overview After preparing the system and following ESD precautions, there are four steps to installing the processor and heatsink onto the motherboard. 1. Attach the processor to a plastic carrier to create the processor carrier assembly. 2.

  • Page 32: Create The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Create the Processor Carrier Assembly Process Carrier Assembly 1. Hold the processor with the gold pins (LGA lands) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below.
  • Page 33 Chapter 3: Maintenance and Component Installation 2. Turn the processor over (with the gold pins up). Locate the CPU keys on the processor and the four latches on the carrier as shown below. SP XCC Latch CPU Key Latch CPU Key Latch Latch CPU Key...
  • Page 34 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the CPU socket and press it down as shown below. Lever Lever Carrier E1B Carrier E1A 4. Using Pin 1 as a guide, carefully align the CPU keys (A and B) on the processor against the CPU keys on the carrier (a and b) as shown in the drawing below.
  • Page 35 Chapter 3: Maintenance and Component Installation 6. After the processor is placed inside the carrier, examine the four sides of the processor, making sure that the processor is properly seated on the carrier. SP XCC (Top View) (Component View) CPU Carrier Assembly (Top View) (Component View) CPU Carrier Assembly...

  • Page 36: Creating The Phm

    Chapter 3: Maintenance and Component Installation Creating the PHM After creating the processor carrier assembly, please follow the instructions below to mount the processor carrier into the heatsink to form the PHM. Note: If this is a new heatsink, the thermal grease has been pre-applied on the un- derside.
  • Page 37 Chapter 3: Maintenance and Component Installation CPU Carrier Assembly (for 2U Heatsink) (CPU Component Side and Heatsink Bottom Side) SP XCC Pin 1 Pin 1 SP MCC Pin 1 Processor Heatsink Module (PHM)

  • Page 38: Preparing The Cpu Socket For Installation

    Chapter 3: Maintenance and Component Installation Preparing the CPU Socket for Installation This motherboard comes with a plastic protective cover installed on the CPU socket. Remove it from the socket by following the instructions below: 1. Press the tabs inward. 2.

  • Page 39: Installing The Phm Into The Cpu Socket

    Chapter 3: Maintenance and Component Installation Installing the PHM into the CPU Socket 1. Locate four threaded fasteners (a, b, c, d) on the CPU socket. 2. Align PEEK nut A, which is next to the triangle (Pin 1) on the heatsink, against threaded fastener a on the CPU socket.

  • Page 40: Removing The Phm From The Cpu Socket

    Chapter 3: Maintenance and Component Installation Removing the PHM from the CPU Socket Before removing the PHM from the motherboard, be sure to shut down the system and unplug the power cables from the power supply. Then follow the steps below: 1.

  • Page 41: Removing The Processor Carrier Assembly From The Phm

    Chapter 3: Maintenance and Component Installation Removing the Processor Carrier Assembly from the PHM To remove the processor carrier assembly from the PHM, please follow the steps below: 1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown in the drawings below.

  • Page 42: Removing The Processor From The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Removing the Processor from the Processor Carrier Assembly Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below. 1.

  • Page 43: Motherboard Installation

    Chapter 3: Maintenance and Component Installation 3.4 Motherboard Installation All motherboards have standard mounting holes to fit different types of chassis. Make sure that the locations of all the mounting holes for both the motherboard and the chassis match. Although a chassis may have both plastic and metal mounting fasteners, metal ones are highly recommended because they ground the motherboard to the chassis.

  • Page 44: Installing The Motherboard

    Chapter 3: Maintenance and Component Installation Installing the Motherboard 1. Install the I/O shield into the back of the chassis, if applicable. 2. Locate the mounting holes on the motherboard. See the previous page for the location. 3. Locate the matching mounting holes on the chassis. Align the mounting holes on the motherboard against the mounting holes on the chassis.

  • Page 45: Memory Support And Installation

    Chapter 3: Maintenance and Component Installation 3.5 Memory Support and Installation Note: Check the Supermicro website for recommended memory modules. Important: Exercise extreme care when installing or removing memory modules to prevent any possible damage. Memory Support This motherboard supports up to 4TB RDIMM DDR5 (288-pin) ECC memory with speeds up to 4800MT/s in 16 DIMM slots (Note below).

  • Page 46: Memory Population Table For The 4Th Gen Intel Xeon Scalable Processors

    CPU1: P1-DIMMA1/P1-DIMMB1/P1-DIMMD1/P1-DIMMF1/P1-DIMMG1/P1-DIMMH1 CPU2: P2-DIMMA1/P2-DIMMB1/P2-DIMMD1/P2-DIMMF1/P2-DIMMG1/P2-DIMMH1 CPU1: P1-DIMMA1/P1-DIMMB1/P1-DIMMC1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1/P1-DIMMG1/P1-DIMMH1 2 CPUs & 16 DIMMs CPU2: P2-DIMMA1/P2-DIMMB1/P2-DIMMC1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1/P2-DIMMG1/P2-DIMMH1 Note: This memory configuration is recommended by Supermicro for optimal memory performance. Please use this configuration to maximize your memory performance. CPU1 Pin 1 Pin 1 CPU2 Note: The drawing above shows DIMM module population for each CPU installed on the motherboard.
  • Page 47 Chapter 3: Maintenance and Component Installation Compatible and Incompatible Type in a Channel and a System DIMM Type RDIMM RDIMM 3DS 9x4 RDIMM RDIMM Compatible Incompatible Incompatible RDIMM 3DS Incompatible Compatible Incompatible 9x4 RDIMM Incompatible Incompatible Compatible...

  • Page 48: Dimm Installation

    Chapter 3: Maintenance and Component Installation DIMM Installation JUIDB1 UID_LED1 JPFR3 JVGA1 JPME1 USB0/1 IPMI_LAN (3.0) SLOT1 1. Insert the desired number of DIMMs into the memory slots based on BIOS the recommended DIMM population tables in the previous section. SATA 8~11 JTPM1 P1 AIOM PCIe 5.0 X16...

  • Page 49: Motherboard Battery

    Chapter 3: Maintenance and Component Installation 3.6 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing the node from the system.

  • Page 50: Storage Drives

    Attention state---do not remove NVMe Amber Blinking at 1 Hz device (not supported in VMD mode) Note: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, see the Supermicro website, http://www. supermicro.com/products/nfo/files/storage/SBB-HDDCompList.pdf.

  • Page 51: Drive Configuration

    Chapter 3: Maintenance and Component Installation Drive Configuration The CSE-217BD2 chassis contains two separate computing node drawers, each with its own motherboard. Each node controls a set of 12 drives. If a node drawer is pulled out of the chassis, the drives associated with that node will power down. Node Drawer Locations Node A controls Node B controls...

  • Page 52: Installing Drives

    Chapter 3: Maintenance and Component Installation Installing Drives Removing Drive Carriers from the Chassis 1. Press the release button on the drive carrier. This extends the drive carrier handle. 2. Use the handle to pull the carrier out of the chassis (Figure 3-5). 3.
  • Page 53 Chapter 3: Maintenance and Component Installation Figure 3-6. Removing a Dummy Drive from the Drive Carrier Installing a Drive 1. Install a new drive into the carrier with the printed circuit board side facing down so that the mounting holes in the drive align with those in the carrier. 2.

  • Page 54: Hot-Swap For Nvme Drives

    Chapter 3: Maintenance and Component Installation Hot-Swap for NVMe Drives Supermicro servers support NVMe surprise hot-swap. For even better data security, NVMe orderly hot-swap is recommended. NVMe drives can be ejected and replaced remotely using BMC. Note: If you are using VROC, see the Hot-Swap Drives section in Chapter 6 instead.

  • Page 55: Checking The Temperature Of An Nvme Drive

    Chapter 3: Maintenance and Component Installation Checking the Temperature of an NVMe Drive There are two ways to check using BMC. Checking a Drive • BMC > Server Health > NVMe SSD – Shows the temperatures of all NVMe drives. •...

  • Page 56: System Cooling

    Chapter 3: Maintenance and Component Installation 3.8 System Cooling Fans Fan speed is controlled by a system temperature setting in the BMC. If a fan fails, the remaining fans will ramp up to full speed. The system can continue to run with a failed fan. Replace any failed fan at your earliest convenience with the same type and model.
  • Page 57 Chapter 3: Maintenance and Component Installation Figure 3-10. Replacing a System Fan in the Fan Housing 6. Place the replacement fan into the vacant space in the housing while making sure the arrows on the top of the fan (indicating air direction) point in the same direction as the arrows on the other fans.

  • Page 58: Installing Air Shroud

    Chapter 3: Maintenance and Component Installation Installing Air Shroud The system requires air shrouds for each node to maximize airflow efficiency. Installing Air Shroud The motherboard, any expansion cards, and all components must be installed in the node tray. Place the air shroud as pictured and secure them with screws. Figure 3-11.

  • Page 59: Power Supply

    3.9 Power Supply The chassis features redundant power supplies. The power modules can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors. These power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 100-120v or 180-240v.

  • Page 60: Aiom Card

    Chapter 3: Maintenance and Component Installation 3.10 AIOM Card The Supermicro Advanced Input/Output module (AIOM) card provides options for network connection. It is inserted into an AIOM slot on the motherboard tray. The AIOM card can be installed or removed without powering down the system.

  • Page 61: Expansion Cards

    Chapter 3: Maintenance and Component Installation 3.11 Expansion Cards The CSE-217BD2 chassis supports expansion cards. Riser cards are used to mount the expansion cards. Each node can accommodate three low-profile PCIe cards. Left Expansion Slot Right Expansion Slot Figure 3-15. Expansion Card Slots Expansion Slot Locations Expansion Description (all PCIe 5.0)
  • Page 62 Chapter 3: Maintenance and Component Installation Populating Right Expansion Slot (SYS-221BT-DNC8R) 1. If necessary, power down the node, remove it from the chassis, remove the expansion card screw and set aside. 2. Remove the PCI slot shields. Expansion PCI Slot Card Screw Shields Figure 3-16.
  • Page 63 Chapter 3: Maintenance and Component Installation 3. If the riser card (p/n RSC-P2R-88G5) is not installed, attach the riser card to the riser card bracket. 4. Insert one or two expansion cards into the riser slot to create an assembly. Riser Card Bracket Expansion Cards...
  • Page 64 Chapter 3: Maintenance and Component Installation Populating Left Expansion Slot (All Models) Power down the node and remove it from the chassis. 2. Remove the expansion card screw and set aside. Remove the PCI slot shield. Expansion PCI Slot Card Screw Shields Figure 3-18.
  • Page 65 Chapter 3: Maintenance and Component Installation 4. Insert an expansion card into the riser slot of the M.2 carrier-and-riser card to create an assembly (not shown). 5. Install the M.2 SSD, if necessary (not shown). M.2 SSD Riser Slot PCI Slot Shield Figure 3-20.

  • Page 66: Backplane

    Chapter 3: Maintenance and Component Installation 3.12 Backplane The backplane (BPN-NVME5-217BHQ-S6) supports 12 SAS/SATA/NVMe drives. Four connectors are located on the back side of the backplane, two connected to each node. A cable linking the NearStack HD connector on the adapter to a high speed connector (P1 NS1, P1 NS2, or P1 NS3) on the motherboard's PCB provides PCIe 5.0 support.

  • Page 67: Cable Routing Diagrams

    Chapter 3: Maintenance and Component Installation 3.14 Cable Routing Diagrams Refer to the storage cable diagrams in the next few pages. When disconnecting cables to add or replace components, refer to the diagrams so you can reroute them in the same manner. NVMe and SATA NVMe PCIe 5.0 Cable CBL-NSH5-1326...

  • Page 68: Nvme And Sas Via 3816 Aoc

    Chapter 3: Maintenance and Component Installation NVMe and SAS via 3816 AOC NVMe PCIe 5.0 Cable CBL-NSH5-1326 NVMe PCIe 5.0 Cable CBL-NSH5-1326 NVMe PCIe 5.0 Cable CBL-NSH5-1331 Hardware RAID Cable CBL-SAST-1234F-100 Hardware RAID Cable CBL-SAST-1233F-100 Online Cable Matrix 3816 AOC Figure 3-22.

  • Page 69: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.

  • Page 70: Headers And Connectors

    The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in hard drives. It allows the motherboard to deny access if the TPM associated with the hard drive is not installed in the system.
  • Page 71 Network Interface Card Configuration User's Guide posted on the web page under the link: http://www.supermicro.com/support/manuals/. P1 NS1/P2 NS2/P2 NS3 Connectors Three PCIe 5.0 x8 connectors are located at P1 NS1, P2 NS2, and P2 NS3 headers. P1 NS1 PCIe 5.0 x8 connector (NS1) is supported by CPU1, while P2 NS2 5.0 x8 (NS2) and...

  • Page 72: Input/Output Ports

    Chapter 4: Motherboard Connections 4.3 Input/Output Ports VGA Connector A VGA connection is located at JVGA1 on the rear I/O panel. This VGA connector provides analog interface between the computer and the video displays. COM Port A COM (communication) port that supports serial link interface is located on the rear side of the motherboard.
  • Page 73 The UID/BME Reset switch (JUIDB1) works in conjunction with UID_LED1/LEDBMC LED indicator to achieve dual purposes for unit identification and BMC reset. Refer to the BMC User's Guide posted on our website at http://www.supermicro.com for more information. UID/BMC Reaset Switch (JUIDB1) Features &...

  • Page 74: Jumpers

    Chapter 4: Motherboard Connections 4.4 Jumpers How Jumpers Work To modify the operation of the motherboard, jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with a square solder pad on the printed circuit board. Refer to the diagram below for an example of jumping pins 1 and 2.
  • Page 75 Chapter 4: Motherboard Connections Watch Dog JWD1 controls the Watch Dog function. Watch Dog is a monitor that can reboot the system when a software application hangs. Jumping pins 1-2 will cause Watch Dog to reset the system if an application hangs. Jumping pins 2-3 will generate a non-maskable interrupt signal for the application that hangs.
  • Page 76 Chapter 4: Motherboard Connections BIOS Recovery Jumper (JBR1) Jumper JBR1 is used to recover system BIOS when it is corrupted. For system stability, we do not recommend that BIOS recovery be performed unless you've encountered a serious BIOS issue. See the table below for jumper settings. BIOS Recovery Jumper Jumper Settings Jumper Setting...

  • Page 77: Led Indicators

    Chapter 4: Motherboard Connections 4.5 LED Indicators BMC LAN LEDs A dedicated BMC LAN connection, located on the rear I/O panel, provides Ethernet network connection via the BMC (Baseboard Management Control). The LED on the right indicates activity, and the LED on the left indicates the speed of the connection. Refer to the table below for more information.

  • Page 78: Chapter 5 Software

    USB/SATA DVD drive, or a USB flash drive, or the BMC KVM console. 2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
  • Page 79 Chapter 5: Software 4. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on “Load driver” link at the bottom left corner. Figure 5-2.

  • Page 80: Driver Installation

    The Supermicro website contains drivers and utilities for your system at https://www. supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash drive or a DVD.

  • Page 81: Superdoctor ® 5

    5.3 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

  • Page 82: Bmc

    There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.

  • Page 83: Chapter 6 Optional Components

    It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system. Details and installation procedures are at: http://www.supermicro.com/manuals/other/TPM.pdf. • AOM-TPM-9670V •...

  • Page 84: Intel Virtual Raid On Cpu (Vroc)

    Chapter 6: Optional Components 6.3 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs directly ® attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex.

  • Page 85: Additional Information

    Chapter 6: Optional Components Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.

  • Page 86: Configuring Intel Vmd

    Chapter 6: Optional Components Configuring Intel VMD VMD must be enabled on PCIe ports which have NVMe drives attached to them in order for those drives to be added to a VROC RAID configuration. The default BIOS setting for the NVMe Mode Switch is Auto which automatically enables VMD on all installed NVMe drives.
  • Page 87 Chapter 6: Optional Components Note: Consult the X13DET-B Motherboard Manual for more detailed information on setting up Intel VMD. Caution: VMD must only be enabled on NVMe port resources. If VMD is enabled on other PCIe ports, the functionality of those ports will be impacted. See the table below. 4.
  • Page 88 Chapter 6: Optional Components Figure 6-5. BIOS, Enabling VMD on Socket 1 (Example) 6. Enable the NVMe port resource according to table above for the NVMe drives that will be used in a RAID configuration. Figure 6-6. BIOS, Enabling Socket 1 (Example)
  • Page 89 Chapter 6: Optional Components 7. Choose whether to make the NVMe drives in this IOU Hot Plug Capable by selecting Enabled or Disabled. 8. Repeat steps 4 through 7 for each IOU # on each CPU to enable VMD on the desired NVMe ports.

  • Page 90: Creating Nvme Raid Configurations

    Chapter 6: Optional Components Creating NVMe RAID Configurations 1. Open Advanced > Intel(R) Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume. Figure 6-8. Created Volume without Figure 6-9. Created Volume with enabling enabling RAID spanned over VMD RAID spanned over VMD controller controller 2.

  • Page 91: Status Indications

    Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blink Fault Solid ON Rebuilding 1 Hz Blink IBPI SFF 8489 Defined Status LED States Hot-Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other...

  • Page 92: Chapter 7 Troubleshooting And Support

    Chapter 7: Troubleshooting and Support Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by the Products option. •...

  • Page 93: Direct Links For General Support And Information

    Security Center for recent security notices Supermicro Phone and Addresses 7.2 Baseboard Management Controller (BMC) The system supports the Baseboard Management Controller (BMC). BMC is used to provide remote access, monitoring and management. There are several BIOS settings that are related to BMC.

  • Page 94: Troubleshooting Procedures

    Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures Returning Merchandise for Service section(s) in this chapter. Power down the system before changing any non hot-swap hardware components.

  • Page 95: No Video

    • Memory: Make sure that the memory modules are supported. Refer to the product page on our website at www.supermicro.com. Test the modules using memtest86 or a similar utility. • Storage drives: Make sure that all drives work properly. Replace if necessary.
  • Page 96 Also check the Control panel Overheat LED. • Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements. •...

  • Page 97: Crash Dump Using Bmc

    In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using BMC. The BMC manual is available at https://www.supermicro.com/en/solutions/ management-software/bmc-resources. Check BMC Error Log 1.

  • Page 98: Uefi Bios Recovery

    Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
  • Page 99 USB flash or media drive or a writable CD. Note 1: If you cannot locate the "Super.ROM" file in your drive disk, visit our website at www.supermicro.com to download the BIOS package. Extract the BIOS binary image into a USB flash device and rename it "Super.ROM"...
  • Page 100 Chapter 7: Troubleshooting and Support Note: At this point, you may decide if you want to start the BIOS recovery. If you decide to proceed with BIOS recovery, follow the procedures below. 4. When the screen as shown above displays, use the arrow keys to select the item "Proceed with flash update"...
  • Page 101 Chapter 7: Troubleshooting and Support 7. Press <Del> continuously during system boot to enter the BIOS Setup utility. From the top of the tool bar, select Boot to enter the submenu. From the submenu list, select Boot Option #1 as shown below. Then, set Boot Option #1 to [UEFI AP:UEFI: Built-in EFI Shell]. Press <F4>...
  • Page 102 Chapter 7: Troubleshooting and Support Note: Do not interrupt this process until the BIOS flashing is complete. 9. The screen above indicates that the BIOS update process is complete. When you see the screen above, unplug the AC power cable from the power supply, clear CMOS, and plug the AC power cable in the power supply again to power on the system.

  • Page 103: Cmos Clear

    Chapter 7: Troubleshooting and Support 7.6 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.

  • Page 104: Where To Get Replacement Components

    7.7 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.

  • Page 105: Vendor Support Filing System

    For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.9 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Please email us at techwriterteam@supermicro.com to provide feedback on our manuals.

  • Page 106: Appendix A Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 107 Appendix A: Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 108 Appendix A: Warning Statements . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 109 Appendix A: Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 110 Appendix A: Warning Statements Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 111 Appendix A: Warning Statements 電源切断の警告 システムコンポーネントの取り付けまたは取り外しのために、 シャーシー内部にアクセスするには、 システムの電源はすべてのソースから切断され、 電源コードは電源モジュールから取り外す必要が あります。 警告 在你打开机箱并安装或移除内部器件前,必须将系统完全断电,并移除电源线。 警告 在您打開機殼安裝或移除內部元件前，必須將系統完全斷電，並移除電源線。 Warnung Das System muss von allen Quellen der Energie und vom Netzanschlusskabel getrennt sein, das von den Spg.Versorgungsteilmodulen entfernt wird, bevor es auf den Chassisinnenraum zurückgreift, um Systemsbestandteile anzubringen oder zu entfernen. ¡Advertencia! El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para...
  • Page 112 Appendix A: Warning Statements ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت قبم‬ ‫انىصىل إىن امنناطق انداخهيت نههيكم نتثبيج أو إ ز انت مكىناث الجهاز‬ 경고! 시스템에 부품들을 장착하거나 제거하기 위해서는 섀시 내부에 접근하기 전에 반드시 전원 공급장치로부터...
  • Page 113 Appendix A: Warning Statements Attention Il est vivement recommandé de confier l'installation, le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés. !‫אזהרה‬ .‫צוות מוסמך בלבד רשאי להתקין, להחליף את הציוד או לתת שירות עבור הציוד‬ ‫واملدربيه...
  • Page 114 Appendix A: Warning Statements Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
  • Page 115 Appendix A: Warning Statements Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
  • Page 116 Appendix A: Warning Statements ‫هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل‬ ‫اسحبذال البطارية‬ ‫فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة‬ ‫جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة‬ 경고! 배터리가 올바르게 교체되지 않으면 폭발의 위험이 있습니다. 기존 배터리와 동일하거나 제 조사에서...
  • Page 117 Appendix A: Warning Statements ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
  • Page 118 Appendix A: Warning Statements Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时，背板上有很危险的电压或能量，进行维修时务必小心。 警告 當系統正在進行時，背板上有危險的電壓或能量，進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
  • Page 119 Appendix A: Warning Statements ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스 작업 시 주의하십시오. Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is.
  • Page 120 Appendix A: Warning Statements ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬ 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다. Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften.
  • Page 121 Appendix A: Warning Statements Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 122 Appendix A: Warning Statements Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
  • Page 123 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
  • Page 124 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro.
  • Page 125 사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...

  • Page 126: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors (per node) Dual Intel Xeon Scalable Family 4th Gen Series Processors (in Socket P+) with a thermal design power (TDP) of up to 270W and 3 UPIs (UltraPath Interconnect) of up to 11.2 GT/s per node. Note: Refer to the motherboard specifications pages on our website for updates to supported processors.
  • Page 127 Appendix B: System Specifications Power Supply Model: PWS-2K22A-1R, 2200 W redundant module, 80Plus Titanium level AC Input Voltages: 100-240 VAC Rated Input Current: 1800W: 200-220Vac 1980W: 220-230Vac 2090W: 230-240Vac 2090W: 180-220Vac (for UL/cUL only) 2200W: 220-240Vac (for UL/cUL only) 2090W: 230-240Vdc (for CCC only)> Rated Input Frequency: 50-60 Hz Rated Output Power: +12 V Max: 100A / Min: 0A (100-127Vac)
  • Page 128 Appendix B: System Specifications Applied Directives, Standards EMC/EMI: 2014/30/EU (EMC Directive) Electromagnetic Compatibility Regulations 2016 FCC Part 15 Subpart B ICES-003 VCCI-CISPR 32 AS/NZS CISPR 32 EN/BS 55032 EN/BS 55035 EN/BS 61000-3-2 EN/BS 61000-3-3 EN/BS 61000-4-2 EN/BS 61000-4-3 EN/BS 61000-4-4 EN/BS 61000-4-5 EN/BS 61000-4-6 EN/BS 61000-4-8...

This manual is also suitable for:

Superserver sys-221bt-dnc8r

Table of Contents