Supermicro Storage SuperServer SSG-641E-E1CR36H User Manual
Supermicro Storage SuperServer SSG-641E-E1CR36H User Manual

Supermicro Storage SuperServer SSG-641E-E1CR36H User Manual

Table of Contents

Advertisement

Quick Links

Storage SuperServer®
SSG-641E-E1CR36H
SSG-641E-E1CR36L
USER'S MANUAL
Revision 1.0

Advertisement

Table of Contents
loading

Summary of Contents for Supermicro Storage SuperServer SSG-641E-E1CR36H

  • Page 1 Storage SuperServer® SSG-641E-E1CR36H SSG-641E-E1CR36L USER’S MANUAL Revision 1.0...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...
  • Page 4: Table Of Contents

    Preface Contents Contacting Supermicro ......................8 Chapter 1 Introduction 1.1 Overview ..........................9 Models ..........................9 1.2 System Features ........................10 Front View .........................10 Drive Carrier Indicators ....................10 Control Panel .........................12 Rear View ..........................13 Power Supply Indicator ....................14 1.3 System Architecture ......................15 1.4 Motherboard Layout ......................17 Quick Reference Table ......................18...
  • Page 5 Preface Removing the Chassis from the Rack ................29 Chapter 3 Maintenance and Component Installation 3.1 Removing Power ........................30 3.2 Accessing the System ......................31 3.3 Processor and Heatsink Installation ...................32 The 4th Generation Intel Xeon Scalable Processor ............32 Installation Overview ......................33 Removal Overview ......................33 Create the Processor Carrier Assembly ................34 Creating the PHM ......................38...
  • Page 6 Preface 4.3 Input/Output Ports ......................67 4.4 Jumpers ..........................70 4.5 LED Indicators ........................72 Chapter 5 Software 5.1 Microsoft Windows OS Installation ..................74 5.2 Driver Installation ........................76 5.3 SuperDoctor 5 ........................77 ® 5.4 BMC ............................78 BMC ADMIN User Password ....................78 Chapter 6 Optional Components 6.1 Additional Storage Drives ....................79 6.2 Storage Control Card and Cable(s) ...................79 6.3 TPM Security Module ......................80...
  • Page 7 Preface No Video ...........................97 System Boot Failure ......................97 Memory Errors ........................97 Losing the System Setup Configuration ................97 When the System Becomes Unstable ................97 7.4 Crash Dump Using BMC .....................99 7.5 CMOS Clear ........................100 7.6 BMC Reset ........................100 7.7 Where to Get Replacement Components ................101 7.8 Reporting an Issue ......................101 Technical Support Procedures ..................101 Returning Merchandise for Service .................101...
  • Page 8: Contacting Supermicro

    San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.
  • Page 9: Chapter 1 Introduction

    4U; (WxHxD) 17.2 x 7 x 27.5 in. (437 x 178 x 699 mm) A Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SSG-641E-E1CR36H/L have been certified as compliant with UL or CSA: 847-R16X13, 847-16.
  • Page 10: System Features

    Chapter 1: Introduction 1.2 System Features The following views of the system display the main features. Front View Service/Asset Tag with BMC Password Control Panel Figure 1-1. Front View System Features: Front Feature Description Control Panel One control Panel (see Control Panel for details) Logical Storage Drive Numbers...
  • Page 11 Chapter 1: Introduction Drive Carrier LED Indicators Color Blinking Pattern Behavior for Device Blue Solid On Idle SAS/NVMe drive installed Activity Blue Blinking I/O activity Idle SATA drive installed Solid On Failure of drive with RSTe support Blinking at 1 Hz Rebuild drive with RSTe support Blinking with two blinks Hot spare for drive with RSTe support...
  • Page 12: Control Panel

    Chapter 1: Introduction Control Panel Power Button Reset Button Power LED Drive LED NIC (LAN1) LED NIC (LAN2) LED Information LED Power Fail LED Figure 1-2. Control Panel Control Panel Features Feature Description The main power switch applies or removes primary power from the power supply to the server Power button but maintains standby power.
  • Page 13: Rear View

    Chapter 1: Introduction Rear View Power Supplies 2.5" Drive Bays Serial USB 3.0 Port Port UID Switch Ports Port Figure 1-3. System: Rear View System Features: Rear Feature Description Power Supplies Two redundant power supply modules, PWS1 on the bottom, PWS2 on the top Serial Port One COM port Dedicated LAN port for BMC;...
  • Page 14: Power Supply Indicator

    Chapter 1: Introduction Expansion Card Chassis Slots Item Description PCIe 5.0 x8 low-profile slot (occupied by 3908 or 3808 SAS controller) PCIe 5.0 x16 low-profile slot (occupied by AOM for external SAS) PCIe 5.0 x16 low-profile slot PCIe 5.0 x16 low-profile slot PCIe 5.0 x16 low-profile slot PCIe 5.0 x8 low-profile slot Note: PCIe slot 1/2 is occupied by the JBOD Expansion/Storage Controller.
  • Page 15: System Architecture

    Chapter 1: Introduction 1.3 System Architecture This section shows the locations of the system electronic components. Power Supply Modules Dual Processors DIMM Slots System Fans Backplane Asset Tag Figure 1-4. Main Component Locations...
  • Page 16 Chapter 1: Introduction System Features: Top Feature Description Power Supply Dual redundant modules DIMM Slots 16 DIMM memory slots Processors 4th Gen Intel Xeon Scalable with heatsinks System Fans Seven 8-cm fans with optimal fan speed control, FAN-0166L4 Motherboard X13DEI-T Storage Backplane BPN-SAS3-846EL1-N8-1...
  • Page 17: Motherboard Layout

    Chapter 1: Introduction 1.4 Motherboard Layout Below is a layout of the X13DEI-T motherboard with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard Manual.
  • Page 18: Quick Reference Table

    Chapter 1: Introduction Quick Reference Table Jumper Description Default Setting JBT1 CMOS Clear Open (Normal) JPL1 LAN1, LAN2 Enable/Disable Pins 1-2 (Enabled) Description Status LED4, LED7 M.2 LEDs (for M.2-C1, M.2-C2) Blinking Green: Device Working LED6 Unit Identifier (UID) LED Solid Blue: Unit Identified Blinking Green: BMC Normal (Active), LEDBMC...
  • Page 19 Chapter 1: Introduction Connector Description JSTBY1 5V Standby Power Header JTPM1 Trusted Platform Module/Port 80 Header JUIDB1 Unit Identifier (UID) Switch / BMC Reset Button JNVME1 MCIO x8 Connector that supports two PCIe 5.0 x4 NVMe devices on CPU1. The two NVMe devices are P1_NVME0 and P1_NVME1.
  • Page 20: Motherboard Block Diagram

    Chapter 1: Introduction Motherboard Block Diagram X13DEI/X13DEI-T CPU1-D1 CPU1-C1 CPU1-B1 CPU1-A1 CPU2-A1 CPU2-B1 CPU2-C1 CPU2-D1 350W VR14 VR14 550A Iccmax 8 PHASE 8 PHASE 185A IccTDC 350W 350W 922W Pmax CPU1 CPU2 DDR5 DDR5 CPU1-H1 CPU1-G1 CPU1-F1 CPU1-E1 PECI:30 PECI:31 CPU2-E1 CPU2-F1 CPU2-G1...
  • Page 21: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.
  • Page 22: Rack Precautions

    Chapter 2: Server Installation • This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units. Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.
  • Page 23: Airflow

    Chapter 2: Server Installation Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised. Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.
  • Page 24: Installing The Rails

    Chapter 2: Server Installation 2.4 Installing the Rails There are a variety of rack units on the market, which may require a slightly different assembly procedure. This rail set fits a rack between 26.8" and 36.4" deep. The following is a basic guideline for installing the system into a rack with the rack mounting hardware provided.
  • Page 25: Releasing The Inner Rail

    Chapter 2: Server Installation Releasing the Inner Rail Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing. To mount the rail onto the chassis, first release the inner rail from the outer rails. 1.
  • Page 26: Installing The Inner Rails On The Chassis

    Chapter 2: Server Installation Installing the Inner Rails on the Chassis Installing the Inner Rails 1. Identify the left and right inner rails. They are labeled. 2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
  • Page 27: Installing The Outer Rails Onto The Rack

    Chapter 2: Server Installation Installing the Outer Rails onto the Rack Each end of the assembled outer rail includes a bracket with hooks and square, spring-loaded pegs to fit into the square holes in your rack. Installing the Outer Rail 1.
  • Page 28: Installing The Chassis Into A Rack

    Chapter 2: Server Installation 2.5 Installing the Chassis into a Rack Once rails are attached to the chassis and the rack, you can install the server. Warning: Mounting the system into the rack requires at least two people to support the chassis during installation.
  • Page 29: Removing The Chassis From The Rack

    Chapter 2: Server Installation Removing the Chassis from the Rack Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack.
  • Page 30: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.
  • Page 31: Accessing The System

    Chapter 3: Maintenance and Component Installation 3.2 Accessing the System The chassis features a removable top cover for access to the internal components. Removing the Chassis Cover 1. Remove power from the system as described in Section 3.1. 2. Remove the screws securing the cover to the chassis. 3.
  • Page 32: Processor And Heatsink Installation

    Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor support. • All graphics in this manual are for illustration purposes only. Your components may look different.
  • Page 33: Installation Overview

    Chapter 3: Maintenance and Component Installation Installation Overview After preparing the system and following ESD precautions, there are four steps to installing the processor and heatsink onto the motherboard. 1. Attach the processor to a plastic carrier to create the processor carrier assembly. 2.
  • Page 34: Create The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Create the Processor Carrier Assembly Process Carrier Assembly 1. Hold the processor with the gold pins (LGA lands) facing down. Locate the gold triangle at the corner of the processor and the corresponding hollowed triangle on the processor carrier as shown below.
  • Page 35 Chapter 3: Maintenance and Component Installation 2. Turn the processor over (with the gold pins up). Locate the CPU keys on the processor and the four latches on the carrier as shown below. SP XCC Latch CPU Key Latch CPU Key Latch Latch SP MCC...
  • Page 36 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the CPU socket and press it down as shown below. Lever Lever Carrier E1B Carrier E1A 4. Using Pin 1 as a guide, carefully align the CPU keys (A and B) on the processor against the CPU keys on the carrier (a and b) as shown in the drawing below.
  • Page 37 Chapter 3: Maintenance and Component Installation 6. After the processor is placed inside the carrier, examine the four sides of the processor, making sure that the processor is properly seated on the carrier. SP XCC (Top View) (Component View) CPU Carrier Assembly SP MCC (Component View) (Top View)
  • Page 38: Creating The Phm

    Chapter 3: Maintenance and Component Installation Creating the PHM After creating the processor carrier assembly, please follow the instructions below to mount the processor carrier into the heatsink to form the PHM. Note: If this is a new heatsink, the thermal grease has been pre-applied on the un- derside.
  • Page 39 Chapter 3: Maintenance and Component Installation CPU Carrier Assembly (for 2U Heatsink) (CPU Component Side and Heatsink Bottom Side) SP XCC SP MCC Pin 1 Pin 1 Processor Heatsink Module (PHM)
  • Page 40: Preparing The Cpu Socket For Installation

    Chapter 3: Maintenance and Component Installation Preparing the CPU Socket for Installation This motherboard comes with a plastic protective cover installed on the CPU socket. Remove it from the socket by following the instructions below: 1. Press the tabs inward. 2.
  • Page 41: Installing The Phm Into The Cpu Socket

    Chapter 3: Maintenance and Component Installation Installing the PHM into the CPU Socket 1. Locate four threaded fasteners (a, b, c, d) on the CPU socket. 2. Align PEEK nut A, which is next to the triangle (Pin 1) on the heatsink, against threaded fastener a on the CPU socket.
  • Page 42: Removing The Phm From The Cpu Socket

    Chapter 3: Maintenance and Component Installation Removing the PHM from the CPU Socket Before removing the PHM from the motherboard, be sure to shut down the system and unplug the power cables from the power supply. Then follow the steps below: 1.
  • Page 43: Removing The Processor Carrier Assembly From The Phm

    Chapter 3: Maintenance and Component Installation Removing the Processor Carrier Assembly from the PHM To remove the processor carrier assembly from the PHM, please follow the steps below: 1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown in the drawings below.
  • Page 44: Removing The Processor From The Processor Carrier Assembly

    Chapter 3: Maintenance and Component Installation Removing the Processor from the Processor Carrier Assembly Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below. 1.
  • Page 45: Memory

    Chapter 3: Maintenance and Component Installation 3.4 Memory This motherboard supports up to 4 TB memory capacity with 16 DIMMs of 256GB 3DS RDIMM/RDIMM DDR5 ECC memory. Note: Memory speed and capacity support depends on the processors used in the system. DIMM Population Guidelines for Optimal Performance For optimal memory performance, follow the instructions listed in the tables below when populating memory modules.
  • Page 46: Memory Population Tables

    2 CPUs & 12 DIMMs CPU1: P1-DIMMB1/P1-DIMMC1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1/P1-DIMMH1 CPU2: P2-DIMMB1/P2-DIMMC1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1/P2-DIMMH1 CPU1: P1-DIMMA1/P1-DIMMB1/P1-DIMMD1/P1-DIMMF1/P1-DIMMG1/P1-DIMMH1 CPU2: P2-DIMMA1/P2-DIMMB1/P2-DIMMD1/P2-DIMMF1/P2-DIMMG1/P2-DIMMH1 CPU1: P1-DIMMA1/P1-DIMMB1/P1-DIMMC1/P1-DIMMD1/P1-DIMME1/P1-DIMMF1/P1-DIMMG1/P1-DIMMH1 2 CPUs & 16 DIMMs CPU2: P2-DIMMA1/P2-DIMMB1/P2-DIMMC1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1/P2-DIMMG1/P2-DIMMH1 Note: This memory configuration is recommended by Supermicro for optimal memory performance. Please use this configuration to maximize your memory performance.
  • Page 47 Chapter 3: Maintenance and Component Installation COM1 JUIDB1 LED6 (UID-LED) USB5/6 (3.0) FAN5 LAN2 LAN1 USB3/4 (3.0) CTRL LEDBMC BMC_LAN CPU2 FAN6 JPCIE6 JPCIE1 JPCIE2 JPCIE3 JPCIE4 JPCIE5 M.2-C1 (NVME ONLY) BIOS LICENSE MAC CODE X13DEI(-T) IPMI CODE BAR CODE REV:1.01 DESIGNED IN USA SAN MAC...
  • Page 48: Dimm Installation

    Chapter 3: Maintenance and Component Installation DIMM Installation 1. Insert the desired number of DIMM modules based on the recommended DIMM population table at the beginning of this section (3.4 Memory). 2. Align the DIMM module key with the receptive point on the single-latch DIMM slot. Receptive Point Notch Release Tab...
  • Page 49: Motherboard Battery

    Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.
  • Page 50: Storage Drives

    The storage drives are mounted in drive carriers to simplify their installation and removal from the chassis. (Either can be performed without removing power from the system.) Note: Enterprise level storage disk drives are recommended for use in Supermicro chassis and servers. For information on recommended drives, visit the Supermicro website product pages at www.supermicro.com/products.
  • Page 51 Chapter 3: Maintenance and Component Installation Removing a Hot-Swap Drive Carrier from the Chassis 1. Press the release button on the drive carrier, which will extend the drive carrier handle. 2. Use the drive carrier handle to pull the drive out of the chassis. Figure 3-5.
  • Page 52: System Cooling

    Chapter 3: Maintenance and Component Installation 3.7 System Cooling Seven 8-cm heavy duty fans provide the cooling for the system. Fan speed is controlled by system temperature using the BMC. If a fan fails, the remaining fans will ramp up to full speed and the system will continue to operate.
  • Page 53: Installing The Air Shrouds

    Chapter 3: Maintenance and Component Installation Installing the Air Shrouds Air shrouds concentrate airflow to maximize fan efficiency. They do not require screws to install. Installing the Standard Air Shrouds • Position the air shrouds as illustrated in the figure below, sliding the front over the edge of the fan tray.
  • Page 54: Power Supply

    • Solid Amber: When illuminated, indicates that the power supply is plugged in, and is in an abnormal state. The system might need service. Please contact Supermicro technical support. Changing the Power Supply Module: 1. Unplug the AC cord from the module to be replaced.
  • Page 55 Chapter 3: Maintenance and Component Installation Release Tab Figure 3-8. Replacing the Power Supply...
  • Page 56: Pci Expansion Cards

    Chapter 3: Maintenance and Component Installation 3.9 PCI Expansion Cards The system accepts up to six PCIe expansion cards. Figure 3-9. Expansion Slots Expansion Card Chassis Slots Item Description PCIe 5.0 x8 low-profile slot (occupied by 3908 or 3808 SAS controller) PCIe 5.0 x16 low-profile slot (occupied by AOM for external SAS) PCIe 5.0 x16 low-profile slot PCIe 5.0 x16 low-profile slot...
  • Page 57: Cable Routing Diagram

    Chapter 3: Maintenance and Component Installation 3.10 Cable Routing Diagram Use this section to route or reroute cables. Proper routing is important to maintain airflow through the system. Cable part numbers and descriptions are available at the Online Cable Matrix. Default SATA Cable SAS Cable Backplane Power Cable...
  • Page 58: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.
  • Page 59: Headers And Connectors

    The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in storage drives. It allows the motherboard to deny access if the TPM associated with the storage drive is not installed in the system.
  • Page 60 Chapter 4: Motherboard Connections VROC RAID Key Header A VROC RAID Key header is located at JRK1 on the motherboard. For NVMe RAID support, install a VROC RAID Key on JRK1 as shown in the illustration below. VROC Key Intel VROC Key Pin Definitions Pin# Definition...
  • Page 61 The NVMe SMBus (I C) header (JNVI2C1) provides hot-plug support via a dedicated SMBus interface. This feature is only available for a Supermicro complete system with an SMCI- proprietary NVMe add-on card and a proper cable installed. NVMe SMBus Header...
  • Page 62 The X13DEI-T has two SATA 3.0 ports (I-SATA0~1). These SATA ports are supported by the Intel® C741 chipset. I-SATA0/1 can be used with Supermicro SuperDOMs which are orange SATA DOM connectors with power pins built in, and do not require external power cables.
  • Page 63: Front Control Panel

    These connectors are designed specifically for use with Supermicro chassis. See the table below for the descriptions of the front control panel buttons and LED indicators.
  • Page 64 Chapter 4: Motherboard Connections Power On & BMC/BIOS Status LED Button The Power On and BMC/BIOS Status LED button is located on pins 1 and 2 of JF1. Momentarily contacting both pins will power on/off the system or display BMC/BIOS status. Power Button &...
  • Page 65 Chapter 4: Motherboard Connections Information LED (OH/Fan Fail/PWR Fail/UID LED) The Information LED (OH/Fan Fail/PWR Fail/UID LED) connection is located on pins 7 and 8 of JF1. The LED on pin 7 is active when the UID button (JUIDB1) on the rear I/O panel is pressed.
  • Page 66 Chapter 4: Motherboard Connections Front Panel Power LED The Front Panel Power LED connection is located on pins 15 and 16 of JF1. FP Power LED Pin Definitions (JF1) Pins Definition 3.3 V FP PWR LED NMI Button The non-maskable interrupt (NMI) button header is located on pins 19 and 20 of JF1. NMI Button Pin Definitions (JF1) Pins...
  • Page 67: Input/Output Ports

    Chapter 4: Motherboard Connections 4.3 Input/Output Ports See the figure below for the locations and descriptions of the I/O ports on the rear of the motherboard. Figure 4-2. Rear I/O Ports Rear I/O Ports Description Description COM Port 1 10GbE LAN1 Dedicated IPMI LAN 10GbE LAN2 USB3/4 (3.0)
  • Page 68 Chapter 4: Motherboard Connections LAN Ports (LAN1/LAN2 & BMC LAN) Two Ethernet LAN ports (LAN1/LAN2) and an IPMI dedicated LAN (BMC_LAN) are located on the rear I/O panel. The LAN1/LAN2 ports support a 10GbE LAN connection (via the Broadcom 5720 LAN controller). The dedicated IPMI LAN, located above the USB2/3 ports on the rear I/O panel, provides LAN support for the BMC (Baseboard Management Controller).
  • Page 69 BMC Heartbeat LED (LEDBMC) and front/rear UID LEDs. Please note that UID can also be triggered via BMC on the motherboard. For more details, refer to the BMC User's Guide posted on our website at http://www.supermicro.com for more information on BMC.
  • Page 70: Jumpers

    Chapter 4: Motherboard Connections 4.4 Jumpers Explanation of Jumpers Connector Pins To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 Jumper is identified with a square solder pad on the printed circuit board.
  • Page 71 Chapter 4: Motherboard Connections LAN Port Enable/Disable Jumper JPL1 allows the user to enable the onboard LAN1 and LAN2 ports. The default setting is pins 1-2 to enable the connection. LAN Enable/Disable Jumper Settings Jumper Setting Definition Pins 1-2 Enabled Pins 2-3 Disabled...
  • Page 72: Led Indicators

    Chapter 4: Motherboard Connections 4.5 LED Indicators Unit ID LED The rear UID LED indicator is located at LED6. This UID indicator provides easy identification of a system that may need service. UID LED LED Indicator LED Color Definition Blue: On System Identified LAN LEDs Two LAN ports (LAN1 and LAN2) are located on the rear I/O panel of the motherboard.
  • Page 73 Chapter 4: Motherboard Connections M.2 LED Indicators Two M.2 LED indicators are located at LED4 and LED7 on the motherboard. When LED4 is blinking, M.2-C1 is functioning normally. When LED7 is blinking, M.2-C2 is functioning properly. M.2 LED State LED Color Definition Green: Blinking M.2 device working...
  • Page 74: Chapter 5 Software

    1. Create a method to access the Microsoft Windows installation ISO file. That can be a USB flash or media drive. 2. Retrieve the proper RST/RSTe driver. Go to the Supermicro web page for your motherboard and click on "Download the Latest Drivers and Utilities", select the proper driver, and copy it to a USB flash drive.
  • Page 75 Chapter 5: Software 4. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on “Load driver” link at the bottom left corner. Figure 5-2.
  • Page 76: Driver Installation

    The Supermicro website contains drivers and utilities for your system at https://www. supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash or media drive.
  • Page 77: Superdoctor ® 5

    5.3 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).
  • Page 78: Bmc

    There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.
  • Page 79: Chapter 6 Optional Components

    The system supports two hot-swap 2.5" SATA drives, accessible from the chassis rear. 6.2 Storage Control Card and Cable(s) Supermicro offers storage controller cards for various data protection and drive RAID levels. Please refer to the product page for the latest cards and add-on options.
  • Page 80: Tpm Security Module

    It enables the motherboard to deny access if the TPM associated with the hard drive is not installed in the system. Details and installation procedures are at: http://www.supermicro.com/manuals/other/TPM.pdf. • AOM-TPM-9670V •...
  • Page 81: Intel Virtual Raid On Cpu (Vroc)

    Chapter 6: Optional Components 6.4 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs ® directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex. •...
  • Page 82: Additional Information

    Chapter 6: Optional Components Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.
  • Page 83: Configuring Intel Vmd

    Chapter 6: Optional Components Configuring Intel VMD VMD must be enabled on PCIe ports which have NVMe drives attached to them in order for those drives to be added to a VROC RAID configuration. The default BIOS setting for the NVMe Mode Switch is Auto which automatically enables VMD on all installed NVMe drives.
  • Page 84 Chapter 6: Optional Components 4. This system supports eight NVMe devices. There are two M.2 NVMe and four NVMe SSDs connected to CPU1. There are two NVMe SSDs connected to CPU2. We are going to enable VMD on all eight NVMe devices. Caution: VMD must only be enabled on NVMe port resources shown below.
  • Page 85 Chapter 6: Optional Components Intel VMD BIOS Settings for X13 SuperStorage Systems Model CPU1 NVMe Ports NVMe Slot CPU2 NVMe Ports NVMe Slot M.2-C1 P2_NVME4 VMD Config for IOU 2 VMD Config for IOU 2 M.2-C2 P2_NVME5 P1_NVME0 SSG-621E-ACR12H/L VMD Config for IOU 3 P1_NVME1 P1_NVME2 VMD Config for IOU 4...
  • Page 86 Chapter 6: Optional Components 5. Select Intel VMD for Volume Management Device on CPU1. Figure 6-4. Intel VMD for Volume Management Device on CPU 1...
  • Page 87 Chapter 6: Optional Components 6. Under VMD Config for IOU 2, select the Enable/Disable VMD option. Change from Disable to Enable. 7. Select the M.2-C1 VMD option. Change from Disable to Enable. X13DEI/X13DEI-T 8. Select the M.2-C2 VMD option. Change from Disable to Enable. 9.
  • Page 88 Chapter 6: Optional Components 10. Under VMD Config for IOU 3, select the Enable/Disable VMD option. Change from Disable to Enable. 11. Select the P1_NVME0 VMD option. Change from Disable to Enable. X13DEI/X13DEI-T 12. Select the P1_NVME1 VMD option. Change from Disable to Enable. 13.
  • Page 89 Chapter 6: Optional Components 14. Under VMD Config for IOU 4, select the Enable/Disable VMD option. Change from Disable to Enable. 15. Select the P1_NVME2 VMD option. Change from Disable to Enable. X13DEI/X13DEI-T 16. Select the P1_NVME3 VMD option. Change from Disable to Enable. 17.
  • Page 90 Chapter 6: Optional Components 18. Press [ESC] to return to the previous page. 19. Select Intel VMD for Volume Management Device on CPU2. Figure 6-11. Intel VMD for Volume Management Device on CPU 2...
  • Page 91 Chapter 6: Optional Components 20. Under VMD Config for IOU 2, select the Enable/Disable VMD option. Change from Disable to Enable. X13DEI/X13DEI-T 21. Select the P2_NVME4 VMD option. Change from Disable to Enable. 22. Select the P2_NVME5 VMD option. Change from Disable to Enable. 23.
  • Page 92: Creating Nvme Raid Configurations

    Chapter 6: Optional Components Creating NVMe RAID Configurations 1. Open Advanced > Intel(R) Virtual RAID on CPU > All Intel VMD Controllers > Create RAID Volume. Figure 6-14. Created Volume without Figure 6-15. Created Volume with enabling RAID spanned over VMD enabling RAID spanned over VMD controller controller...
  • Page 93: Status Indications

    Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blinking Fault Solid on Rebuilding 1 Hz blinking IBPI SFF 8489 Defined Status LED States Hot Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other...
  • Page 94: Chapter 7 Troubleshooting And Support

    Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website, www.supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by clicking the Products option. •...
  • Page 95: Baseboard Management Controller (Bmc)

    Security Center for recent security notices Supermicro Phone and Addresses 7.2 Baseboard Management Controller (BMC) The system supports the Baseboard Management Controller (BMC). BMC is used to provide remote access, monitoring and management. There are several BIOS settings that are related to BMC.
  • Page 96: Troubleshooting Procedures

    Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures Returning Merchandise for Service section(s) in this chapter. Power down the system before changing any non hot-swap hardware components.
  • Page 97: No Video

    • Memory: Make sure that the memory modules are supported. Refer to the product page on our website at www.supermicro.com. Test the modules using memtest86 or a similar utility. • Storage drives: Make sure that all drives work properly. Replace if necessary.
  • Page 98 Also check the Control panel Overheat LED. • Adequate power supply: Make sure that the power supply provides adequate power to the system. Make sure that all power connectors are connected. Refer to the Supermicro website for the minimum power requirements. •...
  • Page 99: Crash Dump Using Bmc

    Chapter 7: Troubleshooting and Support 7.4 Crash Dump Using BMC In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using BMC.
  • Page 100: Cmos Clear

    Chapter 7: Troubleshooting and Support 7.5 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.
  • Page 101: Where To Get Replacement Components

    7.7 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.
  • Page 102: Vendor Support Filing System

    For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.9 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. To provide feedback on our manuals, please email us at techwriterteam@...
  • Page 103: Appendix A Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 104 Appendix A: Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 105 Appendix A: Warning Statements . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 106 Appendix A: Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 107 Appendix A: Warning Statements Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 108 Appendix A: Warning Statements Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components (except for hot-swap components). 電源切断の警告...
  • Page 109 Appendix A: Warning Statements ‫אזהרה מפני ניתוק חשמלי‬ ‫!אזהרה‬ ‫יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק‬ ‫.לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים‬ ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت...
  • Page 110 Appendix A: Warning Statements Attention Seul le personnel autorisé et le personnel de maintenance qualifié doivent être autorisés à installer, remplacer ou entretenir cet équipement.. !‫אזהרה‬ ‫.יש לאפשר רק צוות מורשה ואנשי שירות מוסמכים להתקין, להחליף או לטפל בציוד זה‬ ‫.ينبغي...
  • Page 111 Appendix A: Warning Statements Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
  • Page 112 Appendix A: Warning Statements Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
  • Page 113 Appendix A: Warning Statements ‫هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل‬ ‫اسحبذال البطارية‬ ‫فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة‬ ‫جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة‬ 경고! 배터리가 올바르게 교체되지 않으면 폭발의 위험이 있습니다. 기존 배터리와 동일하거나 제 조사에서...
  • Page 114 Appendix A: Warning Statements ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
  • Page 115 Appendix A: Warning Statements Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时,背板上有很危险的电压或能量,进行维修时务必小心。 警告 當系統正在進行時,背板上有危險的電壓或能量,進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
  • Page 116 Appendix A: Warning Statements ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스 작업 시 주의하십시오. Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is.
  • Page 117 Appendix A: Warning Statements ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬ 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다. Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften.
  • Page 118 Appendix A: Warning Statements Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 119 Appendix A: Warning Statements Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
  • Page 120 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
  • Page 121 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro.
  • Page 122 사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...
  • Page 123: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors Dual Socket-E (LGA4677) 4th Gen Intel® Xeon® Scalable processors with up to 60 cores Chipset Intel® C741 BIOS AMI BIOS ACPI 3.0 or later, PCI firmware 4.0 support, BIOS rescue hot-key, SPI dual/quad speed support, RTC (Real Time Clock) wakeup, and SMBIOS 3.0 or later Memory Supports up to 4 TB memory capacity with 16 DIMMs of 256 GB 3DS RDIMM DDR5 ECC memory for up to 4800 MT/s...
  • Page 124 Appendix B: System Specifications Operating Environment Operating Temperature: 10°C to 35°C (50°F to 95°F) Non-operating Temperature: -40°C to 60°C (-40°F to 140°F) Operating Relative Humidity: 8% to 90% (Non-Condensing) Non-operating Relative Humidity: 5% to 95% (Non-Condensing) Regulatory Compliance FCC, ICES, CE, UKCA, VCCI, RCM, NRTL, CB Applied Directives, Standards EMC/EMI: 2014/30/EU (EMC Directive) Electromagnetic Compatibility Regulations 2016...

This manual is also suitable for:

Storage superserver ssg-641e-e1cr36l

Table of Contents