Inspur NF5468A5 Manual
  1. Manuals
  2. Brands
  3. Inspur Manuals
  4. Server
  5. NF5468A5
  6. Manual

Inspur NF5468A5 Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Inspur Server NF5468A5
White Paper
Document Version: V1.1
Release Date: October 10, 2022

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the NF5468A5 and is the answer not in the manual?

Questions and answers

Related Manuals for Inspur NF5468A5

Summary of Contents for Inspur NF5468A5

  • Page 1 Inspur Server NF5468A5 White Paper Document Version: V1.1 Release Date: October 10, 2022...
  • Page 2 All other trademarks or registered trademarks mentioned herein are the property of their respective holders. Security Statement Inspur is intensely focused on server product safety and has placed a high priority on this. For a better understanding of our server products, carefully read through the following security risk statements.
  • Page 3 Please contact Inspur Customer Service for any safety problems found or necessary support on security vulnerabilities when using our products. Inspur will remain committed to the safety of our products and solutions to achieve better customer satisfaction. Disclaimer The purchased products, services and features shall be bound by the contract made between Inspur and the customer.
  • Page 4 Preface Abstract This white paper describes the NF5468A5 server's appearance, features, performance parameters, and software and hardware compatibility, providing in-depth information of NF5468A5. Intended Audience This white paper is intended for: Inspur pre-sales engineers  Pre-sales engineers of channel partners ...
  • Page 5 Version Date Description of Changes • Updated name of Table 7-11 from GPU and Graphics Card Specifications to GPU V1.1 2022/10/10 Specifications • Added a note under Figure 5-4...

  • Page 6: Table Of Contents

    Table of Contents Product Overview ..................1 Features ..................... 2 Scalability and Performance ................2 Availability and Serviceability ................. 2 Manageability and Security ................3 Energy Efficiency ..................... 3 System Parts Breakdown ................5 System Logical Diagram ................6 Hardware Description ................. 7 Front Panel ......................
  • Page 7 Manual Handling Weight Limits ............50 Maintenance and Warranty ................51 System Management ................52 Intelligent Management System ISBMC ............52 Inspur Physical Infrastructure Manager (ISPIM) ..........54 Inspur Server Intelligent Boot (ISIB) ............... 56 10 Certifications .................... 58 11 Appendix A ....................59 11.1 Operating Temperature and Specification Limits ..........

  • Page 8: Product Overview

    Product Overview The Inspur NF5468A5 is a heterogeneous computing platform built on AMD EPYC Rome and Milan CPUs with up to 8 PCIe 4.0 AI accelerator cards. Thanks to its superior PCIe device compatibility, it can host accelerator cards from NVIDIA and other manufacturers to meet diversified needs in AI training, AI inference, and video encoding &...

  • Page 9: Features

    Based on humanization design, the server allows tool-less maintenance. The  modular structural parts enable quick removal/installation, greatly reducing O&M time. Inspur's unique intelligent control technology combined with the cutting-edge  air-cooling technology creates an optimum operating environment to ensure stable running of the server.

  • Page 10: Manageability And Security

    For information about warranty policies, refer to Chapter 9 Inspur Limited Warranty Inspur Server NF5468A5 User Manual For other product resources (such as product marketing materials, user manuals, drivers, firmware, and product certifications), visit https://en.inspur.com.
  • Page 11 Supports intelligent fan speed control to conserve energy. ...

  • Page 12: System Parts Breakdown

    System Parts Breakdown Figure 3-1 NF5468A5 Parts Breakdown (Demonstrated with 24 × 2.5-inch Drive Configuration) Item Feature Item Feature Lower 2U Air Vent Bezel Air Duct Super-Capacitor Internal M.2 SSD Module Fan Modules PSUs GPUs PCIe Add-in Cards GPU Board...

  • Page 13: System Logical Diagram

    System Logical Diagram Figure 4-1 NF5468A5 System Logical Diagram Supports 2 AMD Rome or Milan CPUs.  Supports 32 DIMMs.  The 2 processors are interconnected through 3 xGMI links.  Supports three 8 × 2.5-inch drive backplanes or one 12 × 3.5-inch drive ...

  • Page 14: Hardware Description

    Hardware Description Front Panel 5.1.1 Appearance 24 × 2.5-inch Drive Configuration  Figure 5-1 Front View Item Feature Item Feature Service Tag (including SN Drive Bay × 24 label and drive numbers)

  • Page 15: Leds & Buttons

    12 × 3.5-inch Drive Configuration  Figure 5-2 Front View Item Feature Item Feature Service Tag (including SN Drive Bay × 12 label and drive numbers) 5.1.2 LEDs & Buttons 1. LED and Button Location Figure 5-3 Front Panel LEDs and Buttons...
  • Page 16 Item Feature Item Feature Power Button and LED UID Button and LED System Reset Button System Health LED 2. LED and Button Description Table 5-1 Front Panel LED and Button Description Icon LED & Button Description Power LED: Off = No power ...

  • Page 17: Ports

    5.1.3 Ports 1. Port Location Figure 5-4 Front Panel Ports (Demonstrated with 24 × 2.5-inch Drive Configuration) Item Feature Item Feature VGA Port USB 3.0 Port USB 3.0 Port System Serial Port The ports are identical for the 24 × 2.5-inch drive configuration and 12 × 3.5-inch drive configuration.

  • Page 18: Rear Panel

    Rear Panel 5.2.1 Appearance Figure 5-5 Rear View Item Feature Item Feature PSU × 4 USB 3.0 Port × 2 BMC Management Network OCP 3.0 Card Hot-Plug Button Port and LED OCP 3.0 Card VGA Port BMC Serial Communication UID Button and LED Port GPU Slots Add-in Card Slots...

  • Page 19: Leds And Buttons

    5.2.2 LEDs and Buttons Figure 5-6 Rear Panel LEDs and Buttons Item Feature Item Feature Data Transmit Rate LED of PSU LED × 4 BMC Management Network Port Connection Status LED of OCP 3.0 Card Hot-Plug Button BMC Management Network and LED Port UID Button and LED...
  • Page 20 Icon Description Button:  ‐ Enables the hot-swap function of the OCP 3.0 Card OCP 3.0 Card LED:  Hot_Plug Hot-Plug Button ‐ Solid blue = OCP card is powered on and LED ‐ Flashing blue = OCP card power being removed or connected ‐...

  • Page 21: Ports

    5.2.3 Ports 1. Port Location Figure 5-7 Rear Panel Ports Item Feature Item Feature PSU Socket × 4 USB 3.0 Port × 2 BMC Management Network Port VGA Port BMC Serial Communication Port 2. Port Description Table 5-4 Rear Panel Port Description Port Type Quantity...

  • Page 22: Processors

    3 xGMI links at up to 18 GT/s.  Up to 256 MB of L3 cache (64 cores).  TDP up to 280 W.  For specific system processor options, consult Inspur sales representative or  refer to 7.2 Hardware Compatibility.

  • Page 23: Memory

    Figure 5-8 Processor Location Memory 5.4.1 DDR4 DIMM 1. Identification To determine the DIMM characteristics, refer to the label attached to the DIMM and the following figure and table. Figure 5-9 Memory Identification...
  • Page 24 Item Description Example 32 GB  Capacity 64 GB  128 GB  1R = Single rank  2R = Dual rank  2S2R = Two ranks of two high  Rank(s) stacked 3DS DRAM 4DR = Four ranks of dual die ...
  • Page 25 2. Memory Subsystem Architecture The NF5468A5 supports 32 DIMM slots and 8 channels per CPU with 2 DIMM slots per channel. Within a channel, populate the DIMM slot with its silk screen ending with D0 first and second the DIMM slot with its silk screen ending with D1. For instance, within CPU0 Channel A, populate CPU0_CAD0 first and second CPU0_CAD1.
  • Page 26 Maximum operating speed of a memory configuration Mixing DDR4 DIMM types (RDIMM, LRDIMM) or mixing DDR4 DIMM  specifications (capacity, bit width, rank, height, etc.) is not supported. For specific system memory options, consult your local Inspur sales  representative or refer to 7.2 Hardware Compatibility.
  • Page 27 CPU type. c: DIMM Per Channel (DPC) is the number of DIMMs per memory channel.  The above information is for reference only, please consult your local Inspur sales representative for details. 4. Population Rules General population rules for DDR4 DIMMs: Install DIMMs only when the corresponding processor is installed.
  • Page 28 5. DIMM Slot Layout Up to 32 DDR4 DIMMs can be installed in the server. Balance the total memory capacity between the installed processors for optimal memory performance. DIMM configuration must be compliant with the DIMM population rules. At least one DDR4 DIMM must be installed in the DIMM slot(s) corresponding to each CPU.

  • Page 29: Storage

    Storage 5.5.1 Drives The NF5468A5 supports not only front drives, but also 2 internal M.2 SSDs, with the capacity of up to 960 GB per M.2. Table 5-8 Drives Form Configuration Slot Drive Management Fact ntity Mode NVMe SAS/SATA NVMe...

  • Page 30: Drive Numbering

    Form Configuration Slot Drive Management Fact ntity Mode NVMe SAS/SATA NVMe SAS/SATA card (standard, RAID controller cards of the same manufacturer and series are recommended) Directly connected to 0 - 3 CPU1 1 × 8i RAID controller 0 - 7 card (standard) 2 ×...
  • Page 31 Figure 5-11 Drive Numbering Physical Drive No. Identified by the Drive No. Identified by the Standard Drive No. ISBMC 8i + 16i RAID Controller Card...

  • Page 32: Drive Leds

    Physical Drive No. Identified by the Drive No. Identified by the Standard Drive No. ISBMC 8i + 16i RAID Controller Card 12 × 3.5-inch Drive Pass-Through Configuration (12 × SAS/SATA Drive)  Figure 5-12 Drive Numbering Physical Drive No. Identified by the Drive No.

  • Page 33: Raid Controller Card

    The OCP 3.0 card allows for network expansion capabilities. The FLEX I/O card slot supports the OCP 3.0 card, which can be selected as  required. For specific OCP 3.0 card options, consult your local Inspur sales representative  or refer to 7.2 Hardware Compatibility.

  • Page 34: Pcie Slots

    For specific PCIe card options, consult your local Inspur sales representative or  refer to 7.2 Hardware Compatibility. 5.7.2 PCIe Slots 1. PCIe Slot Layout Figure 5-14 PCIe Slots - Standard Configuration GPU slots: Slot0, Slot1, Slot2, Slot3, Slot4, Slot5, Slot6, and Slot7.
  • Page 35 Connect Root PCIe PCIe Correspondi Port Slot Standa Slot ng CPU Bandwid Bandwidth (B/D/ Size Slot CPU1 PCIe 4.0 80:1:1 FHFL Slot A0:3: CPU1 PCIe 4.0 FHFL x16 if  no OCP card is installe This  PCIe CPU0 PCIe 4.0 20:1:1 FHHL slot is...

  • Page 36: Psus

    PSUs Supports up to 4 PSUs.  Supports AC PSUs.  The PSUs are hot-swappable.  Supports 4 PSUs in 2+2 redundancy.  PSUs in a server must have the same Part No. (P/N code).  Figure 5-15 PSU Layout Fan Modules Supports twelve 6056 fan modules.

  • Page 37: Boards

    Figure 5-16 Fan Module Layout 5.10 Boards 5.10.1 Motherboard Figure 5-17 NF5468A5 Motherboard...

  • Page 38: Drive Backplane

    Item Feature Item Feature Slimline Connector × 2 CPU1 VR Heatsink Memory VR Heatsink Memory VR Heatsink Slimline Connector × 8 Front Control Panel Connector Intrusion Switch Connector Smart NIC Power Connector Chassis Temperature Detector RAID Controller Card Power Connector Connector TPM Connector Backplane I...
  • Page 39 Figure 5-18 8 × 2.5-inch Drive (8 × SAS/SATA/NVMe Drive) Pass-Through Backplane Item Feature Item Feature BMC I C Connector CPLD JTAG Connector Slimline x8 Connector 1 Slimline x8 Connector 2 Slimline x4 Connector 1 VPP Connector CPLD Slimline x8 Connector 3 Slimline x8 Connector 4 Power Connector Slimline x4 Connector 2...
  • Page 40 2. Internal Drive Backplane 2 × M.2 Drive (2 × SATA/NVMe Drive) Pass-Through Backplane  Figure 5-20 Front View of 2 × M.2 Drive (2 × SATA/NVMe Drive) Pass-Through Backplane Figure 5-21 Rear View of 2 × M.2 Drive (2 × SATA/NVMe Drive) Pass-Through Backplane Table 5-10 Connectors on Internal Drive Backplane Item...

  • Page 41: Gpu Board

    5.10.3 GPU Board Figure 5-22 GPU Board Layout Item Feature Item Feature GPU Card Power Connector 1 GPU Card Power Connector 2 Radsok Connector GPU Card Power Connector 3 GPU Card Power Connector 4 Slimline Connectors PCIe Slots...

  • Page 42: Product Specifications

    Product Specifications Technical Specifications Table 6-1 Technical Specifications Item Description Form Factor 4U rack server 2 AMD Rome or Milan processors  Up to 64 cores  Max base frequency at 3.1 GHz  Up to 256 MB of L3 cache ...
  • Page 43 Item Description • The M.2 SSD has low endurance and cannot be used as a data storage device. It may be worn out within a short period of time in scenarios where frequent data erase and write occur. • For data storage, use enterprise-class SSDs or HDDs with higher DWPD. •...

  • Page 44: Environmental Specifications

    Item Description ‐ 1 × BMC management network port OS installation on the USB mobile storage media is not recommended. 12 × 6056 Fan Provides a dedicated Ethernet management port, which supports System remote control, SMTP, KVM, management via SNMP, and virtual Management media Power...
  • Page 45 Parameter Description Silver coupon: 200 Å/month (compliant with the  gaseous corrosivity level of G1 defined in ANSI/ISA-71.04-2013) Comply with the data centre cleaning standard  ISO 14644-1 Class 8 The server room must be free of explosive, Particulate  conductive, magnetic, and corrosive dust Contaminants It is recommended to hire a professional organization to monitor...

  • Page 46: Physical Specifications

    (10,000 ft), both varying with server configuration. Any fan failure or operations above 30°C (86°F) may lead to system performance degradation. Expanded operating temperature: As for certain approved configurations, the supported operating temperature can be expanded to 5°C to 10°C (41°F to 50°F) and 35°C to 45°C (95°F to 113°F) at sea level.
  • Page 47 Item Description Outer packaging (L × W × H): 1200 × 800 × 480 mm (47.24  × 31.50 × 18.90 in.) Chassis: Maximum weight of the 12 × 3.5-inch front drive  configuration: 54 kg (119.05 lbs) Weight Maximum weight of the 24 × 2.5-inch front drive ...

  • Page 48: Operating System And Hardware Compatibility

    ‐ For requirements on the performance of specific application software, contact Inspur sales representatives to confirm the detailed hardware and software configurations during the pre-sales phase. ‐ For requirements on hardware performance consistency, define specific configuration requirements (for example, specific drive models, RAID controller cards, or firmware versions) during the pre-sales phase.

  • Page 49: Hardware Compatibility

    Hardware Compatibility 7.2.1 CPU Specifications Supports up to 2 AMD EPYC processors.  Supports up to 64 cores.  Max base frequency at 3.1 GHz.  3 xGMI links at up to 18 GT/s.  Up to 256 MB of L3 cache. ...

  • Page 50: Dimm Specifications

    7.2.2 DIMM Specifications The NF5468A5 supports up to 32 DDR4 RDIMMs/LRDIMMs (3200 or 2933 MT/s). Each processor supports 8 memory channels with 2 DIMM slots per channel. The following memory protection technology is supported: Error-Correcting Code (ECC)  Table 7-3 Memory Specifications...

  • Page 51: Sas/Raid Controller Card Specifications

    U.2 NVMe SSD 7.68 TB U.2 NVMe SSD 8 TB 7.2.4 SAS/RAID Controller Card Specifications Table 7-7 SAS/RAID Controller Card Specifications Type Manufacturer Model 9400-8i 9400-16i Controller Inspur SAS3008 Card Inspur PM8222_SmartHBA Inspur PM8222 SAS3108_2GB SAS3008 Inspur PM8204-2GB PM8204-4GB RAID...

  • Page 52: Hca Card Specifications

    Speed Network Type Model (Gb/s) Port Qty. 25G_MCX562A-ACAB 25G_MCX631432AN Table 7-9 PCIe NIC Specifications Speed Network Type Model (Gb/s) Port Qty. I350-T4V2 I350AM4 EX710DA2 82599ES X710DA4FH X550T2 PCIe NIC X550 MCX512A-ACAT MCX631102AN MCX4121A-ACAT MCX516A-GCAT MCX516A-CCAT 7.2.6 HCA Card Specifications Table 7-10 HCA Card Specifications Type Model MCX653105A-ECAT...

  • Page 53: Psu Specifications

    GPU Card NVIDIA-A10 7.2.8 PSU Specifications The NF5468A5 supports up to four hot-swap Intel® CRPS 80 PLUS Platinum PSUs in 2+2 redundancy, with standard electrical and structural design, allowing customers to choose based on the actual configuration. The PSUs will lock automatically after being inserted into the power bay, enabling tool-less maintenance.

  • Page 54: Regulatory Information

    8.1.2 Personal Safety Only personnel certified or authorized by Inspur are allowed to perform the  installation procedures. Stop any operation that could cause personal injury or equipment damage.
  • Page 55 Figure 8-1 Protective Clothing Before touching the equipment, put on ESD clothes and ESD gloves or an ESD  wrist strap, and remove any conductive objects such as wrist watches or metal jewelry, as shown in Figure 8-2, in order to avoid electric shock or burns. Figure 8-2 Removing Conductive Objects How to put on an ESD strap (Figure 8-3).

  • Page 56: Equipment Safety

    Figure 8-3 Wearing an ESD Wrist Strap Use tools correctly to avoid personal injury.  When moving or lifting equipment above shoulder height, use lifting devices  and other tools as necessary to avoid personal injury or equipment damage due to equipment slippage. The power sources of the server carry a high voltage.

  • Page 57: Transportation Precautions

    To ensure equipment safety, always ground the equipment before powering it  8.1.4 Transportation Precautions Contact the manufacturer for precautions before transportation as improper transportation may damage the equipment. The precautions include but not limited to: Use a trusted logistics company to move all equipment. The transportation ...

  • Page 58: Maintenance And Warranty

    Maintenance and Warranty For information about warranty policies, refer to Chapter 9 Inspur Limited Warranty Inspur Server NF5468A5 User Manual...

  • Page 59: System Management

    System Management Intelligent Management System ISBMC The NF5468A5 is integrated with Inspur’s new-generation BMC intelligent management system (ISBMC). ISBMC is a self-developed remote server management system by Inspur. Compatible with the server management standard IPMI 2.0, ISBMC features reliable and intelligent hardware monitoring and management.
  • Page 60 OS installation, file sharing, and other O&M tasks Supports the visual management interface developed by Web GUI Inspur, displaying abundant information of the server and components, and offers easy-to-use Web GUIs Supports automatic crash screenshot with the last screen...

  • Page 61: Inspur Physical Infrastructure Manager (Ispim)

    Inspur Physical Infrastructure Manager (ISPIM) The NF5468A5 server is compatible with the latest version of Inspur Physical Infrastructure Manager (ISPIM). ISPIM is a new-generation infrastructure O&M management platform for industry data centers. Based on cutting-edge O&M concepts, ISPIM provides users with leading and efficient overall management solutions for data centers to ensure the advancement of their infrastructure management.
  • Page 62 Table 9-2 ISPIM Specifications Feature Description Supports centralized management of network-wide devices, including servers (the full range of Inspur server family, including general-purpose rack servers, AI servers, blade Centralized servers, all-in-one servers and other high-end server Device products, and third-party servers), storage devices (Inspur...

  • Page 63: Inspur Server Intelligent Boot (Isib)

    Inspur Server Intelligent Boot (ISIB) The NF5468A5 server is compatible with the latest version of Inspur Server Intelligent Boot (ISIB), a self-developed automatic O&M management system throughout the server lifecycle. Based on the SSH and PXE technologies, it is...
  • Page 64 Table 9-3 ISIB Specifications Item Description Provides multi-dimensional reports of assets, repositories,  operations and jobs Home Displays jobs 24 hours dynamically  Displays column bars of jobs in the last 30 days  Supports automatic device discovery, OS information Asset collection, and out-of-band/in-band power supply management...

  • Page 65: Certifications

    Certifications Table 10-1 Certifications Country/Region Certification Logo Mandatory/Voluntary China China Environmental Voluntary Labelling International Mutual Voluntary Recognition Mandatory Mandatory Voluntary Mandatory Russia Mandatory South Korea Mandatory...

  • Page 66: Operating Temperature And Specification Limits

    11.2 Model Table 11-2 Model Certified Model Description NF5468A5 Global 11.3 RAS Features The NF5468A5 supports a variety of RAS (Reliability, Availability, and Serviceability) features. By configuring these features, the NF5468A5 can provide greater reliability, availability, and serviceability.

  • Page 67: Sensor List

    11.4 Sensor List Table 11-3 Sensor List Sensor Description Sensor Location Inlet_Temp Air inlet temperature Right mounting ear Outlet_Temp Air outlet temperature BMC card CPUn n indicates the CPU CPUn_Temp CPUn core temperature number with a value of 0 - 1 CPUn n indicates the CPU CPUn_VR_Temp...
  • Page 68 Sensor Description Sensor Location 5 V voltage supplied by SYS_5V Motherboard motherboard to BMC 3.3 V voltage supplied by SYS_3V3 Motherboard motherboard to BMC Motherboard n indicates the CPU CPUn_PVDDCR CPUn core voltage number with a value of 0 - 1 Motherboard n indicates the CPU CPUn_PVDDCR_SOC...
  • Page 69 Sensor Description Sensor Location CPU_Power Total CPU power GPU_Power Total GPU power MEM_Power Total memory power Memory Disk_Power Total drive power Drives PSUn n indicates the PSU PSUn_Power Power consumption of PSUn number with a value of 0 - 3 CPUn n indicates the CPU CPUn_Status...

  • Page 70: Appendix B - Abbreviations

    Appendix B - Abbreviations 12.1 A - E Alternating Current Artificial Intelligence BIOS Basic Input Output System Baseboard Management Controller Column Access Strobe Conformite Europeenne CPLD Complex Programmable Logic Device Central Processing Unit DB15 D-subminiature 15-pin Direct Current DDR4 Double Data Rate 4 DIMM Dual In-line Memory Module DRAM...

  • Page 71: F - J

    Full Height Full Length Gigabit Ethernet Graphics Processing Unit Graphical User Interface Hard Disk Drive Hardware Debug Tool HTTPS Hypertext Transfer Protocol Secure IOPS Input/Output Operations per Second Internet Protocol IPMI Intelligent Platform Management Interface ISBMC Inspur Baseboard Management Controller...

  • Page 72: K - O

    JTAG Joint Test Action Group 12.3 K - O Keyboard, Video and Mouse Lucent Connector LRDIMM Load-Reduced Dual In-line Memory Module Light Emitting Diode NC-SI Network Controller Sideband Interface Network Interface Card NVMe Non-Volatile Memory Express Open Compute Project O&M Operations and Maintenance Operating System 12.4...

  • Page 73: U - Z

    Preboot Execution Environment RAID Redundant Array of Independent Disks Reliability, Availability and Serviceability RDIMM Registered Dual In-line Memory Module RJ45 Registered Jack 45 RoHS Restriction of Hazardous Substances Serial Attached Small Computer System Interface SATA Serial Advanced Technology Attachment SMTP Simple Mail Transfer Protocol Serial Number SNMP...
  • Page 74 Universal Serial Bus Video Graphics Array Virtual Pin Port Voltage Regulator Voltage Regulator-Down xGMI External Global Memory Interconnect...

Table of Contents