Download Print this page
Supermicro Storage SuperServer SSG-221E-NE324R User Manual

Supermicro Storage SuperServer SSG-221E-NE324R User Manual

Advertisement

Quick Links

Storage SuperServer
®
SSG-221E-NE324R
USER'S MANUAL
Revision 1.0

Advertisement

loading
Need help?

Need help?

Do you have a question about the Storage SuperServer SSG-221E-NE324R and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Summary of Contents for Supermicro Storage SuperServer SSG-221E-NE324R

  • Page 1 Storage SuperServer ® SSG-221E-NE324R USER’S MANUAL Revision 1.0...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro website for possible updates to the manual revision level. Secure Data Deletion A secure data deletion tool designed to fully erase all data from storage devices can be found on our website: https://www.supermicro.com/about/policies/disclaimer.cfm?url=/wdl/utility/...
  • Page 4 Preface Contents Chapter 1 Introduction 1.1 Overview ..........................9 1.2 System Features ........................10 Front View .........................10 Drive Carrier Indicators ....................11 Control Panel .........................12 Rear View ..........................13 Power Supply Indicator ....................14 1.3 System Architecture ......................15 1.4 Motherboard Layout ......................17 Quick Reference Table ......................18 Motherboard Block Diagram .....................19 Chapter 2 Server Installation 2.1 Overview ..........................20...
  • Page 5 Preface Chapter 3 Maintenance and Component Installation 3.1 Removing Power ........................30 3.2 Accessing the System ......................31 Removing the Top Cover ....................31 Front Chassis Cover ......................31 Rear Cover ........................32 Removing the Rear Cover .....................32 3.3 Processor and Heatsink Installation ...................33 The 5th/4th Gen. Intel Xeon Scalable Processor .............33 Overview of the CPU Socket ....................37 Overview of the Processor Carrier Assembly ..............38 Overview of the Processor Heatsink Module (PHM) with SP XCC and Carrier E1A ..39...
  • Page 6 Preface 3.8 System Cooling ........................72 Installing the Air Shrouds ....................73 3.9 Power Supply ........................74 3.10 PCI Expansion Cards .......................75 3.11 Cable Routing Diagram .....................77 Chapter 4 Motherboard Connections 4.1 Power Connections ......................78 4.2 Headers and Connectors ....................79 4.3 Rear I/O Connectors ......................82 4.4 Connectors/Ports on the AOM-DSF-IO ................83 4.5 Front Control Panel ......................86 Front Control Panel LEDs ....................87...
  • Page 7 Preface Chapter 7 Troubleshooting and Support 7.1 Information Resources ......................107 Website ...........................107 Direct Links for the SSG-221E-NE324R System ............107 Direct Links for General Support and Information .............107 7.2 Baseboard Management Controller (BMC) ...............108 7.3 Troubleshooting Procedures ...................109 No Power ........................109 No Video .........................110 System Boot Failure .......................110 Memory Errors ........................110...
  • Page 8 San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) Sales-USA@supermicro.com (Sales Inquiries) Government_Sales-USA@supermicro.com (Gov. Sales Inquiries) support@supermicro.com (Technical Support) RMA@supermicro.com (RMA Support) Webmaster@supermicro.com (Webmaster) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.
  • Page 9 2U; (WxHxD) 17.2" x 3.5" x 30.8" in. (438 x 90 x 790 mm) A Quick Reference Guide can be found on the product page of the Supermicro website. The following safety models associated with the SSG-221E-NE324R have been certified as...
  • Page 10 Chapter 1: Introduction 1.2 System Features The following views of the system display the main features. Front View Control Panel Pull-out Tag Front Cover 9 10 13 14 15 17 18 21 22 Figure 1-1. Front View System Features: Front Feature Description Control Panel...
  • Page 11 Chapter 1: Introduction Drive Carrier Indicators Each drive carrier has two LED indicators: an activity indicator and a status indicator. For RAID configurations using a controller, the meaning of the status indicator is described in the table below. For OS RAID or non-RAID configurations, some LED indications are not supported, such as hot spare.
  • Page 12 Chapter 1: Introduction Control Panel Power Button UID Button/LED Power LED Drive Activity LED NIC (LAN2) LED NIC (LAN1) LED Information LED Power Fail LED Figure 1-2. Control Panel Control Panel Features Feature Description The main power switch applies or removes primary power from the power supplies to the Power Button server but maintains standby power.
  • Page 13 Chapter 1: Introduction Rear View Drive Bays VGA Port Power Supply IPMI Port USB Ports Power Supply (PSU2) (PSU1) Figure 1-3. Rear View System Features: Rear Feature Description Power Supplies Two redundant 2000 W power supply modules (PSU1 on the right, PSU2 left) IPMI LAN Port One rear RJ45 dedicated 1 GbE IPMI port USB Ports...
  • Page 14 Chapter 1: Introduction Power Supply Indicator Power Supply Indicator LED Color and State Power Supply Condition No AC power to modules AC cord unplugged and in redundant mode OR power supply critical events Amber, solid causing a shutdown, failure, OCP, OVP, fan fail, OTP, UVP Power supply warning events where the power supply continues to operate: high Amber, blinking temperature, over voltage, under voltage, etc...
  • Page 15 Chapter 1: Introduction 1.3 System Architecture This section shows the locations of the system's main components. Power Supplies M.2 Drives Motherboard DIMM Slots Processors System Fans Storage Backplane Figure 1-4. Main Component Locations...
  • Page 16 Chapter 1: Introduction System Features: Top Feature Description Power Supplies Dual redundant modules, PWS-2K08A-1R M.2 Drives Two M.2 NVMe/SATA drives Motherboard X13DSF-A DIMM Slots 32 DDR5 DIMM slots Dual 5th/4th Gen Intel® Xeon® Scalable processors (up to 350 W) with heatsinks, SNK- Processors P0088P System Fans...
  • Page 17 Chapter 1: Introduction 1.4 Motherboard Layout Below is a layout of the X13DSF-A motherboard with the jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4 or the Motherboard...
  • Page 18 MT1_1, MT2_1: M.2-H1 Mounting Holes; MT1_2, MT2_2 MT1_2, MT2_2: M.2-H2 Mounting Holes P1-AIOM (J139), Supermicro Advanced Input/Output Module (AIOM) PCIe 5.0 x16 Connectors for rear I/O P2-AIOM (J7) support (OCP 3.0 SFF compliant) P1_NVME0/1 – Six PCIe 5.0 x8 MCIO Connectors supported by CPU1 P1_NVME10/11 P2_NVME0/1 –...
  • Page 19 Chapter 1: Introduction X13DSF-A Motherboard Block Diagram REAR RJ45 JLAN1 Dedicated LAN Dedicated LAN RTL8211F U126 eMMC REAR USB CONN eMMC PE[13] JCOM1 COM CONN USB3.0/2.0 USB2.0 JUSB3 REAR USB3[0,1] [8,9] USB2[4,5] JVGA1 VGA CONN eSPI REAR AST2600A3 JTPM1 JUSB2 USB Header USB3[2,3] BMC Boot Flash...
  • Page 20 Chapter 2: Server Installation Chapter 2 Server Installation 2.1 Overview This chapter provides advice and instructions for mounting your system in a server rack. If your system is not already fully integrated with processors, system memory etc., refer to Chapter 3 for details on installing those specific components.
  • Page 21 Chapter 2: Server Installation • This product is not suitable for use with visual display workplace devices according to §2 of the German Ordinance for Work with Visual Display Units. Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are extended to the floor so that the full weight of the rack rests on them.
  • Page 22 Chapter 2: Server Installation Airflow Equipment should be mounted into a rack so that the amount of airflow required for safe operation is not compromised. Mechanical Loading Equipment should be mounted into a rack so that a hazardous condition does not arise due to uneven mechanical loading.
  • Page 23 Chapter 2: Server Installation 2.4 Installing the System into a Rack This section provides information on installing the SSG-221E-NE324R into a rack unit with the quick-release rails provided. There are a variety of rack units on the market, which may mean the assembly procedure will differ slightly.
  • Page 24 Chapter 2: Server Installation Releasing the Inner Rail It is necessary to release the inner rail from the middle and outer rails before installing the inner rail on the chassis. Releasing the Inner Rail from the Middle and Outer Rails 1.
  • Page 25 Chapter 2: Server Installation Installing the Inner Rails on the Server Installing the Inner Rails 1. Confirm that the left and right inner rails have been correctly identified. 2. Place the inner rail firmly against the side of the chassis, aligning the pins on the side of the chassis with the slotted thru holes in the inner rail.
  • Page 26 Chapter 2: Server Installation Installing the Outer Rails on the Rack Installing the Outer Rails 1. Confirm that the left and right outer rails have been correctly identified. 2. Release the small locking lever on the inside of the middle rail and push the middle rail back into the outer rail.
  • Page 27 Chapter 2: Server Installation Installing the Server into the Rack After the rails are installed on the chassis and on the rack, the server can be installed in the rack. It is heavy and requires two to three people to lift. Installing the System into a Rack 1.
  • Page 28 Chapter 2: Server Installation Removing the Server from the Rack Caution: The chassis is heavy and requires two to three people to lift it out. Removing the Server 1. Remove the right and left front screws that are on either side of the front of the chassis. 2.
  • Page 29 Chapter 2: Server Installation Removing the Outer Rails from the Rack In the uncommon event that it is necessary to remove the outer rails from the rack, follow these instructions. The chassis must be out of the rack. Releasing the Outer Rails 1.
  • Page 30 Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.
  • Page 31 Chapter 3: Maintenance and Component Installation 3.2 Accessing the System The SSG-221E-NE324R features a removable top cover for access to the internal components. When performing service on components inside the system, remove the system from the rack and place it on a work bench or desk. Do not service with the system extended from the rack. Removing the Top Cover Front Chassis Cover The front-chassis cover can be removed to access the drive bays while the server continues...
  • Page 32 Chapter 3: Maintenance and Component Installation Rear Cover Removing the Rear Cover Remove the thumb screw from the rear of the chassis, push the two release buttons located on top of the chassis to release the cover, then slide the cover to the rear and off. Unlock the Thumb Screw Push Push...
  • Page 33 Thermal grease is pre-applied on a new heatsink. No additional thermal grease is needed. • Refer to the Supermicro website for updates on processor and memory support. • All graphics in this manual are for illustrations only. Your components may look different.
  • Page 34 Chapter 3: Maintenance and Component Installation 1. The 5th/4th Gen. Intel Xeon Scalable Processor Processor Top View SP XCC SP MCC CPU Key CPU Key Pin 1 Pin 1 = Cutout = Pin 1 = CPU Key = Cutout = Pin 1 = CPU Key...
  • Page 35 Chapter 3: Maintenance and Component Installation 2. The Processor Carrier Carrier E1B Carrier E1A Pin 1 Pin 1 Carrier Top View Carrier Bottom View = Cutout = Pin 1 = CPU Key = Cutout = Pin 1 = CPU Key...
  • Page 36 Chapter 3: Maintenance and Component Installation 3. Heatsink 1U Heatsink 2U Heatsink Note: Exercise extreme care when handling the heatsink. Pay attention to the edges of heatsink fins, which can be sharp! To avoid damaging the heatsink, please do not apply excessive force on the fins.
  • Page 37 Chapter 3: Maintenance and Component Installation Overview of the CPU Socket The CPU socket is protected by a plastic protective cover. Plastic Protective Cover CPU Socket...
  • Page 38 Chapter 3: Maintenance and Component Installation Overview of the Processor Carrier Assembly The processor carrier assembly contains a 5th/4th Gen. Intel Xeon Scalable processor and a processor carrier. Carefully follow the instructions given in the installation section to place a processor into the carrier to create a processor carrier assembly. The processor carrier assembly includes a processor and a carrier as shown below.
  • Page 39 Chapter 3: Maintenance and Component Installation Overview of the Processor Heatsink Module (PHM) with SP XCC and Carrier E1A The Processor Heatsink Module (PHM) contains a heatsink, a processor carrier, and a 5th/4th Gen. Intel Xeon Scalable processor. 1. Heatsink 1U Heatsink 2U Heatsink (Bottom View)
  • Page 40 Chapter 3: Maintenance and Component Installation Overview of the Processor Heatsink Module (PHM) with SP MCC and Carrier E1B The Processor Heatsink Module (PHM) contains a heatsink, a processor carrier, and a 5th/4th Gen. Intel Xeon Scalable processor. 1. Heatsink 1U Heatsink 2U Heatsink (Bottom View)
  • Page 41 Chapter 3: Maintenance and Component Installation Creating the Processor Carrier Assembly The processor carrier assembly contains a 5th/4th Gen. Intel Xeon Scalable processor and a processor carrier. To create the processor carrier assembly, please follow the steps below: Note: Before installation, be sure to follow the instructions given on pages 1 and 2 of this chapter to properly prepare for installation.
  • Page 42 Chapter 3: Maintenance and Component Installation 2. First, turn over the processor carrier and locate Pin 1 on the CPU and Pin 1 on the carrier. Then, turn the processor over with component side (including the gold contacts) facing up and locate CPU keys on the processor. Finally, locate the CPU keys and four latches on the carrier as shown below.
  • Page 43 Chapter 3: Maintenance and Component Installation 3. Locate the lever on the CPU socket and press it down as shown below. Lever Lever Carrier E1A Carrier E1B 4. Using Pin 1 as a guide, carefully align the CPU keys (marked A and B) on the processor against the CPU keys on the carrier (marked a and b) as shown below.
  • Page 44 Chapter 3: Maintenance and Component Installation 6. After the processor is placed inside the carrier, examine the four sides of the processor, making sure that the processor is properly seated on the carrier. Processor Carrier Assembly Processor Carrier Assembly (Top View) (Component Side) SP XCC SP MCC...
  • Page 45 Chapter 3: Maintenance and Component Installation Creating the PHM After creating the processor carrier assembly, please follow the instructions below to mount the processor carrier into the heatsink to form the PHM. Note: If this is a new heatsink, the thermal grease has been pre-applied on the underside. Otherwise, apply the proper amount of thermal grease.
  • Page 46 Chapter 3: Maintenance and Component Installation Creating the PHM (1U Heatsink) Processor Carrier Assembly Processor Carrier Assembly (Component Side) (Component Side) (SP XCC, Carrier E1A) (SP MCC, Carrier E1B) Pin 1 Pin 1 Heatsink (Bottom Side) Heatsink (Bottom Side) PHM (Top View) PHM (1U Heatsink)
  • Page 47 Chapter 3: Maintenance and Component Installation Creating the PHM (2U Heatsink) Processor Carrier Assembly Processor Carrier Assembly (Component Side) (Component Side) (SP XCC, Carrier E1A) (SP MCC, Carrier E1B) Pin 1 Pin 1 Heatsink (Bottom Side) Heatsink (Bottom Side) PHM (Top View) PHM (2U Heatsink)
  • Page 48 Chapter 3: Maintenance and Component Installation Preparing the CPU Socket for Installation This motherboard comes with a plastic protective cover installed on the CPU socket. Remove it from the socket by following the instructions below. 1. Press the tabs inward. 2.
  • Page 49 Chapter 3: Maintenance and Component Installation Preparing to Install the PHM into the CPU Socket After assembling the Processor Heatsink Module (PHM), you are ready to install it into the CPU socket. To ensure the proper installation, please follow the procedures below. 1.
  • Page 50 Chapter 3: Maintenance and Component Installation 2. Locate four peek nuts (marked A, B, C, D) and four rotating wires (marked 1, 2, 3, 4) on the heatsink as shown below. 1U Heatsink (Top Side) A, B, C, D: Peek Nut Rotating Wire 1, 2, 3, 4: Rotating Wire a, b, c, d: Threaded Fastener...
  • Page 51 Chapter 3: Maintenance and Component Installation 3. Check the rotating wires (marked 1, 2, 3, 4) to make sure that they are at unlatched positions as shown below before installing the PHM into the CPU socket. Unlatched State Top View Side View Rotating Wire 1 Peek Nut...
  • Page 52 Chapter 3: Maintenance and Component Installation Installing the PHM into the CPU Socket 1. Align peek nut (marked A) on the heatsink against threaded fastener (marked a) on the CPU socket. Then align peek nuts (marked B, C, D) on the heatsink against threaded fasteners (marked b, c, d) on the CPU socket, making sure that all peek nuts on the heatsink are properly aligned with the correspondent threaded fasteners on the CPU socket.
  • Page 53 Chapter 3: Maintenance and Component Installation 3. Press all four rotating wires outwards and make sure that the heatsink is securely latched onto the CPU socket. Latched State 1U Heatsink Latched State 2U Heatsink...
  • Page 54 Chapter 3: Maintenance and Component Installation 4. With a T30 bit torque driver set to a force of 8.0 in-lbf (0.904 N-m), tighten all peek nuts in the sequence of A, B, C, and D with even pressure. To avoid damaging the processor or socket, do not use excessive force when tightening the peek nuts.
  • Page 55 Chapter 3: Maintenance and Component Installation Removing the PHM from the CPU Socket Before removing the PHM from the motherboard, be sure to shut down the system and unplug the power cables from the power supply. Then follow the steps below. 1.
  • Page 56 Chapter 3: Maintenance and Component Installation 2. Once the peek nuts are loosened from the CPU socket, press the rotating wires inwards to unlatch the PHM from the socket as shown below. Unlatched State 1U Heatsink Unlatched State 2U Heatsink...
  • Page 57 Chapter 3: Maintenance and Component Installation 3. Gently pull the PHM upwards to remove it from the CPU socket. 1U Heatsink 2U Heatsink...
  • Page 58 Chapter 3: Maintenance and Component Installation Removing the Processor Carrier Assembly from the PHM To remove the processor carrier assembly from the PHM, please follow the steps below. 1. Detach the four plastic clips (marked a, b, c, d) on the processor carrier assembly from the four corners of the heatsink (marked A, B, C, D) as shown below.
  • Page 59 Chapter 3: Maintenance and Component Installation 2. When all plastic clips are detached from the heatsink, remove the processor carrier assembly from the heatsink. SP XCC SP MCC 1U Heatsink (Bottom View) SP XCC SP MCC 2U Heatsink (Bottom View)
  • Page 60 Chapter 3: Maintenance and Component Installation Removing the Processor from the Processor Carrier Assembly Once you have removed the processor carrier assembly from the PHM, you are ready to remove the processor from the processor carrier by following the steps below. 1.
  • Page 61 Chapter 3: Maintenance and Component Installation 3.4 Memory Support and Installation Note: Check the Supermicro website for recommended memory modules. Important: Exercise extreme care when installing or removing memory modules to prevent any possible damage. Memory Support This motherboard supports up to 8 TB memory capacity with 32 DIMMs of 256 GB 3DS RDIMM/RDIMM DDR5 ECC memory.
  • Page 62 Chapter 3: Maintenance and Component Installation DDR5 Memory Support for the 4th Gen. Intel Xeon Scalable Processors DDR5 Memory Support for the 4th Gen. Intel Xeon Scalable Processors Speed (MT/s); Voltage (V); DIMM Per Channel (DPC) Ranks Per DIMM DIMM Capacity (GB) Type &...
  • Page 63 2 CPUs & 24 DIMMs DIMME1/P1-DIMME2/P1-DIMMF1/P1-DIMMF2/P1-DIMMG1/P1-DIMMG2/P1-DIMMH1/P1-DIMMH2 CPU2: P2-DIMMA1/P2-DIMMB1/P2-DIMMC1/P2-DIMMD1/P2-DIMME1/P2-DIMMF1/P2-DIMMG1/P2-DIMMH1 CPU1: P1-DIMMA1/P1-DIMMA2/P1-DIMMB1/P1-DIMMB2/P1-DIMMC1/P1-DIMMC2/P1-DIMMD1/P1-DIMMD2/P1- DIMME1/P1-DIMME2/P1-DIMMF1/P1-DIMMF2/P1-DIMMG1/P1-DIMMG2/P1-DIMMH1/P1-DIMMH2 2 CPUs & 32 DIMMs CPU2: P2-DIMMA1/P2-DIMMA2/P2-DIMMB1/P2-DIMMB2/P2-DIMMC1/P2-DIMMC2/P2-DIMMD1/P2-DIMMD2/P2- DIMME1/P2-DIMME2/P2-DIMMF1/P2-DIMMF2/P2-DIMMG1/P2-DIMMG2/P2-DIMMH1/P2-DIMMH2 Note: This memory configuration is recommended by Supermicro for optimal memory performance. Please use this configuration to maximize your memory performance.
  • Page 64 Chapter 3: Maintenance and Component Installation DIMM Installation Note: The DDR5 DIMM module is NOT hot-swappable and P1-AIOM PCIe 5.0x16 (J139) P2-AIOM PCIe 5.0 x16 (J7) SATA 0~3 (JS1) JTPM1 M.2-H1 JSB1 M.2-H2 be sure to disconnect power for a minimum of 20 seconds JPW3 JNCSI1 JIPMB1...
  • Page 65 Chapter 3: Maintenance and Component Installation DIMM Removal Press both release tabs on the ends of the memory module to unlock it. Once the memory module has been loosened, remove it from the memory slot. Warning! Please do not use excessive force when pressing the release tabs on the ends of the DIMM socket to avoid causing any damage to the memory module or the DIMM socket.
  • Page 66 Chapter 3: Maintenance and Component Installation 3.5 Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery Begin by removing power from the system.
  • Page 67 E3.S (2T) CXL 3.5" NVMe drives in front. They can be removed without powering down the system. Note: Enterprise level storage drives are recommended for use in Supermicro chassis and servers. For information on recommended drives, visit the Supermicro website product pages at www.supermicro.com/products.
  • Page 68 Chapter 3: Maintenance and Component Installation Drive Carriers The drives are mounted in drive carriers to simplify their installation and removal from the chassis. These carriers also help promote proper airflow through the drive bays. Each drive carrier has two LED indicators. Removing Drive Carriers from the Chassis 1.
  • Page 69 Chapter 3: Maintenance and Component Installation Installing a Storage Drive 1. The SSG-221E-NE324R uses drive carriers to mount the storage drives. 2. These drive carriers feature four small stubs that will secure the drive. These stubs and the corresponding holes on the drives are shown below. 3.
  • Page 70 Caution: Except for short periods of time, such as swapping drives, do not operate the server with the drive bays empty. Note: Enterprise level storage drives are recommended for use in Supermicro chassis and servers. For information on recommended drives, visit the Supermicro website at http://www.
  • Page 71 Chapter 3: Maintenance and Component Installation 3.7 Installing an OCP NIC Card What is an OCP NIC card? An OCP NIC, also known as an Open Compute Project Network Interface Card, is a type of network interface card designed according to the specifications and standards set forth by the Open Compute Project (OCP).
  • Page 72 Chapter 3: Maintenance and Component Installation 3.8 System Cooling Eight 8-cm heavy-duty fans provide cooling for the system. They can be replaced without powering down the system. Replacing a System Fan 1. If necessary, open the chassis while the power is running to determine which fan requires changing.
  • Page 73 Chapter 3: Maintenance and Component Installation Installing the Air Shrouds Air shrouds concentrate airflow to maximize fan efficiency. They do not require screws to install. Installing the Standard Air Shrouds • Position the air shrouds as illustrated in the figure below, sliding the front over the edge of the fan tray.
  • Page 74 3.9 Power Supply The chassis features redundant 2000 W power supplies. The power modules can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors. These power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 100-120 V or 180-240 V.
  • Page 75 Chapter 3: Maintenance and Component Installation 3.10 PCI Expansion Cards The system accepts up to four PCIe 5.0 expansion cards and two PCIe 5.0 AIOM cards. Figure 3-11. Expansion Slots Expansion Slot Locations Slot Description PCIe FHHL Gen5 x8 (slot 1) x16 (slot 2). x8 mode when slots 1 and 2 are used. PCIe FHHL Gen5 x8 (slot 3) x16 (slot 4).
  • Page 76 Chapter 3: Maintenance and Component Installation Installing an Expansion Cards 1. Power down the system and remove rear cover as described in Section 3.1. 2. In the rear of the chassis, remove one of the two PCIe brackets from the rear of the chassis.
  • Page 77 Chapter 3: Maintenance and Component Installation 3.11 Cable Routing Diagram Use this section to route or reroute cables. Proper routing is important to maintain airflow through the system. Cable part numbers and descriptions are available at the Online Cable Matrix. MCIO Cable CBL-MCIO-1422LO5Y P1_NVME0/1 to SSD 0-1...
  • Page 78 Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the jumpers, connections and LEDs on the motherboard and provides pinout definitions. Some connections might not be used in this system. A motherboard layout indicating component locations may be found in Chapter 1.
  • Page 79 The JTPM1 header is used to connect a Trusted Platform Module (TPM)/Port 80, which is available from Supermicro (optional). A TPM/Port 80 connector is a security device that supports encryption and authentication in drives. It allows the motherboard to deny access if the TPM, which is associated with the drive, is not installed in the system.
  • Page 80 Note: For detailed instructions on how to configure Network Interface Card (NIC) settings, please refer to the Network Interface Card Configuration User's Guide posted on the web page under the link: http://www.supermicro.com/support/manuals/. Chassis Intrusion A Chassis Intrusion header is located at JL1 on the motherboard. Attach the appropriate cable from the chassis to inform you when the chassis is opened.
  • Page 81 RAID Key on JRK1 for NVMe RAID support as shown in the illustration below. Note: For detailed instructions on how to configure VROC RAID settings, please refer to the VROC RAID Configuration User's Guide posted on the web page under the link: https://www. supermicro.com/support/manuals/. VROC Key Intel VROC Key Pin Definitions...
  • Page 82 CPU2). The two AIOM connectors provide input/output connections on the rear side of your system. Rear I/O Module Connector A Supermicro proprietary rear I/O module connector is located at JSB1 on the motherboard. This connector provides support for rear I/O module connection.
  • Page 83 Chapter 4: Motherboard Connections 4.4 Connectors/Ports on the AOM-DSF-IO Figure 4-1. AOM-DSF-IO Ports AOM-DSF-IO Ports Description BMC_LAN Port USB 0 (3.0) USB 1 (3.0) VGA Port I/O Connector COM Port Header BMC LAN Port A dedicated BMC LAN port (BMC_LAN) is located on the AOM-DSF-IO. The dedicated BMC LAN port provides LAN support for the Baseboard Management Controller (BMC).
  • Page 84 UID can also be triggered via BMC on the motherboard. For more details on the UID LEDs and BMC LEDs, refer to the tables below. Also, refer to the BMC User's Guide posted on our website at https://www.supermicro.com for more information on BMC. UID/BMC Reset Switch (JUIDB1)
  • Page 85 Chapter 4: Motherboard Connections VGA Connections There is one VGA connection in your system. The rear VGA connection is located at VGA on the AOM-DSF-IO. The VGA connection provides analog interface support between the computer and the video displays.
  • Page 86 JFP1, contains header pins for various buttons and LED indications with I²C support for front access. This front control panel header is designed specifically for use with Supermicro chassis. Refer to the figure below for the pin-out descriptions for JFP1. JFP1...
  • Page 87 Chapter 4: Motherboard Connections Front Control Panel LEDs Front Control Panel (JFP1) LED Indicators Event Power Drive Information Power Fail Power On Solid On Drive Activity Blinking NIC Activity Blinking Overheat Solid On Fan Fail Blinking at 1 Hz Power Fail Blinking at 1/4 Hz Solid On Local UID On...
  • Page 88 Chapter 4: Motherboard Connections Power On and BMC/BIOS Status LED Button The Power On and BMC/BIOS Status LED button is located on Pin 1 of the front control panel header located at JFP1. Momentarily contacting Pin 1 of JFP1 will power on/off the system or display BMC/BIOS status.
  • Page 89 Chapter 4: Motherboard Connections Fail LED (Information LED for OH/FF/PF) The Fail LED (Information LED for OH/Fan Fail/PWR Fail) connection is located on Pin 4 of JFP1. The LED provides warnings of overheating, power failure, or fan failure. Refer to the table below for more information.
  • Page 90 Chapter 4: Motherboard Connections Standby Power LED The LED indicator for standby power is located on Pin 8 of JFP1. If this LED is on, standby power is on. RoT (Root of Trust) Power LED The Power LED for Root of Trust (RoT) connection is located on Pin 9 of JFP1. If this LED is on, power for the RoT chip is on.
  • Page 91 Chapter 4: Motherboard Connections 4.6 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. Note: On a two-pin jumper, "Closed"...
  • Page 92 Chapter 4: Motherboard Connections 4.7 LED Indicators BMC Heartbeat LED A BMC Heartbeat LED is located at LEDBMC on the motherboard. When LEDBMC is blinking green, the BMC is functioning normally. BMC Heartbeat LED Indicator LED Color Definition Green: Blinking BMC Normal Onboard Power LED The Onboard Power LED is located at LEDPWR on the motherboard.
  • Page 93 If you will be using RAID, you must configure RAID settings before installing the Windows OS and the RAID driver. Refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals. Installing the OS 1. Create a method to access the MS Windows installation ISO file. That might be a USB flash or media drive, perhaps using an external USB/SATA flash or media drive, or the BMC KVM console.
  • Page 94 Chapter 5: Software 3. During Windows Setup, continue to the dialog where you select the drives on which to install Windows. If the disk you want to use is not listed, click on “Load driver” link at the bottom left corner. Figure 5-2.
  • Page 95 The Supermicro website contains drivers and utilities for your system at https://www. supermicro.com/wdl/driver. Some of these must be installed, such as the chipset driver. After accessing the website, go into the CDR_Images (in the parent directory of the above link) and locate the ISO file for your motherboard. Download this file to a USB flash or media drive.
  • Page 96 There are several BIOS settings that are related to BMC. For general documentation and information on BMC, visit our website at: www.supermicro.com/en/solutions/management-software/bmc-resources BMC ADMIN User Password For security, each system is assigned a unique default BMC password for the ADMIN user.
  • Page 97 Power cords CBL-PWCD-0300-IS CBL-PWCD-0579 AOM-TPM-9671V-S-O TPM security modules AOM-TPM-9670V-S-O 6.1 Storage Control Card and Cable(s) Supermicro offers storage controller cards for various data protection and drive RAID levels. Please refer to the product page for the latest cards and add-on options.
  • Page 98 The JTPM1 header is used to connect a Trusted Platform Module (TPM). A TPM is a security device that supports encryption and authentication in drives. It enables the motherboard to deny access if the TPM associated with the drive is not installed in the system. Details and installation procedures are at: http://www.supermicro.com/manuals/other/TPM.pdf. • AOM-TPM-9671V-S-O •...
  • Page 99 Chapter 6: Optional Components 6.3 Intel Virtual RAID on CPU (VROC) Intel Virtual RAID on CPU (Intel VROC) is an enterprise RAID solution for NVMe SSDs ® directly attached to Intel Xeon Scalable processors. Intel Volume Management Device (VMD) is an integrated controller inside the CPU PCIe root complex. •...
  • Page 100 Chapter 6: Optional Components Additional Information Additional information is available on the product page for the Supermicro add-on card and the linked manuals. www.supermicro.com/products/accessories/addon/AOC-VROCxxxMOD.cfm Hardware Key The Intel VROC hardware key is a license key that detects the Intel VROC SKU and activates the function accordingly.
  • Page 101 Chapter 6: Optional Components Configuring NVMe RAID Manually RAID for NVMe SSDs is enabled by default when Intel VROC Raid Key is populated. It may be managed manually through the UEFI BIOS. 1. Reboot the server and press [DEL] key to access the BIOS options. 2.
  • Page 102 Chapter 6: Optional Components Figure 6-3. BIOS, Manual Mode (Example—your server may look different.) 3. Select the desired PStack# to Enable or Disable the corresponding Intel VMD controller Figure 6-4. BIOS, Enabling VMD for Pstack0...
  • Page 103 Chapter 6: Optional Components 4. Select the desired PCIe slot to Enable or Disable Intel VMD functionality according to the current hardware configuration being used. Hot Plug Capability can also be Enabled or Disabled. Figure 6-5. BIOS, Enabling VMD Functionality per Slot 5.
  • Page 104 Chapter 6: Optional Components Figure 6-7. BIOS, Enabling CPU2 Example 6. Press [F4] to save the configuration and reboot the system and press [DEL] to enter BIOS. Note: Disabling the VMD controller without first deleting the associated existing RAID volume can lead to unexpected behavior. This action is strongly not recommended. Note: The effects of physically changing or swapping a CPU on the VMD controller enablement has not yet been thoroughly tested or documented.
  • Page 105 Chapter 6: Optional Components 10. If cross-controller RAID is required, select Enable RAID spanned over VMD Controller. Figure 6-8. Created Volume without Figure 6-9. Created Volume with enabling RAID spanned over VMD enabling RAID spanned over VMD controller controller 11. Select specific disks for RAID with an [X]. •...
  • Page 106 Chapter 6: Optional Components Status Indications An LED indicator on the drive carrier shows the RAID status of the drive. Drive Carrier Status LED Indicator Status State (red) Normal function Locating 4 Hz blinking Fault Solid on Rebuilding 1 Hz blinking IBPI SFF 8489 Defined Status LED States Hot Swap Drives Intel VMD enables hot-plug and hot-unplug for NVMe SSDs, whether from Intel or other...
  • Page 107 Chapter 7 Troubleshooting and Support 7.1 Information Resources Website A great deal of information is available on the Supermicro website; www.supermicro.com. Figure 7-1. Supermicro Website • Specifications for servers and other hardware are available by clicking the Products option. •...
  • Page 108 Security Center for recent security notices Supermicro Phone and Addresses 7.2 Baseboard Management Controller (BMC) The system supports the Baseboard Management Controller (BMC). BMC is used to provide remote access, monitoring and management. There are several BIOS settings that are related to BMC.
  • Page 109 Chapter 7: Troubleshooting and Support 7.3 Troubleshooting Procedures Use the following procedures to troubleshoot your system. If you have followed all of the procedures below and still need assistance, refer to the Technical Support Procedures Returning Merchandise for Service sections in this chapter. Power down the system before changing any non hot-swap hardware components.
  • Page 110 Chapter 7: Troubleshooting and Support No Video 1. If the power is on but you have no video, remove all the add-on cards and cables. 2. As you try to power up the system, note any beep codes. System Boot Failure If the system does not display Power-On-Self-Test (POST) or does not respond after the power is turned on, check the following: Turn on the system with only one DIMM module installed.
  • Page 111 Chapter 7: Troubleshooting and Support Note: Refer to the product page on our website at http://www.supermicro.com for memory and CPU support and updates. 3. Storage drive support: Make sure that all storage drives work properly. Replace the bad drives with good ones.
  • Page 112 Chapter 7: Troubleshooting and Support 7.4 Crash Dump Using BMC In the event of a processor internal error (IERR) that crashes your system, you may want to provide information to support staff. You can download a crash dump of status information using BMC.
  • Page 113 Chapter 7: Troubleshooting and Support 7.5 CMOS Clear JBT1 is used to clear CMOS, which will also clear any passwords. Instead of pins, this jumper consists of contact pads to prevent accidentally clearing the contents of CMOS. To Clear CMOS 1.
  • Page 114 7.7 Where to Get Replacement Components If you need replacement parts for your system, to ensure the highest level of professional service and technical support, purchase exclusively from our Supermicro Authorized Distributors/System Integrators/Resellers. A list can be found at: http://www.supermicro.com.
  • Page 115 For issues related to Red Hat Enterprise Linux, since it is a subscription based OS, contact your account representative. 7.9 Feedback Supermicro values your feedback as we strive to improve our customer experience in all facets of our business. Please email us at techwriterteam@supermicro.com to provide feedback on our manuals.
  • Page 116 Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 117 Appendix A: Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 118 Appendix A: Warning Statements . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...
  • Page 119 Appendix A: Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 120 Appendix A: Warning Statements Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 121 Appendix A: Warning Statements Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components (except for hot-swap components). 電源切断の警告...
  • Page 122 Appendix A: Warning Statements ‫אזהרה מפני ניתוק חשמלי‬ ‫!אזהרה‬ ‫יש לנתק את המערכת מכל מקורות החשמל ויש להסיר את כבל החשמלי מהספק‬ ‫.לפני גישה לחלק הפנימי של המארז לצורך התקנת או הסרת רכיבים‬ ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت...
  • Page 123 Appendix A: Warning Statements Attention Seul le personnel autorisé et le personnel de maintenance qualifié doivent être autorisés à installer, remplacer ou entretenir cet équipement.. !‫אזהרה‬ ‫.יש לאפשר רק צוות מורשה ואנשי שירות מוסמכים להתקין, להחליף או לטפל בציוד זה‬ ‫.ينبغي...
  • Page 124 Appendix A: Warning Statements Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial, cerradura con llave u otro medio de seguridad.
  • Page 125 Appendix A: Warning Statements Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
  • Page 126 Appendix A: Warning Statements ‫هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل‬ ‫اسحبذال البطارية‬ ‫فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة‬ ‫جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة‬ 경고! 배터리가 올바르게 교체되지 않으면 폭발의 위험이 있습니다. 기존 배터리와 동일하거나 제 조사에서...
  • Page 127 Appendix A: Warning Statements ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
  • Page 128 Appendix A: Warning Statements Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时,背板上有很危险的电压或能量,进行维修时务必小心。 警告 當系統正在進行時,背板上有危險的電壓或能量,進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
  • Page 129 Appendix A: Warning Statements ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스 작업 시 주의하십시오. Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is.
  • Page 130 Appendix A: Warning Statements ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬ 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다. Waarschuwing Bij installatie van de apparatuur moet worden voldaan aan de lokale en nationale elektriciteitsvoorschriften.
  • Page 131 Appendix A: Warning Statements Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 132 Appendix A: Warning Statements Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
  • Page 133 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
  • Page 134 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro.
  • Page 135 사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...
  • Page 136 Appendix B: System Specifications Appendix B System Specifications Processors Dual 5th/4th Gen Intel Xeon scalable with 4 UPI (16 GT/s max) and a total of 160 Gen5 PCIe lanes in a Socket E (LGA-4677) Chipset Intel® C741 BIOS AMI 32 MB SPI Flash EEPROM Memory 32 DIMM slots, 1 DPC ECC DDR5 RDIMM/LRDIMM for up to 5600 MT/s Storage Drives...
  • Page 137 Appendix B: System Specifications Operating Environment Operating Temperature: 10º to 35º C (50º to 95º F) Non-operating Temperature: -40º to 60º C (-40º to 140º F) Operating Relative Humidity: 8% to 90% (non-condensing) Non-operating Relative Humidity: 5% to 95% (non-condensing) Regulatory Compliance FCC, ICES, CE, UKCA, VCCI, RCM, NRTL, CB Applied Directives, Standards...