Technical White Paper About This Document About This Document Purpose This document describes the FusionServer XH321L V5 liquid-cooled server node in terms of features, structure, specifications, and component hardware and software compatibility. Intended Audience This document is intended for pre-sales engineers.
Page 4
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper About This Document Change History Issue Date Description 2023-11-30 ● Added 11 Waste Product Recycling. 2023-02-28 ● Updated 5.7.1 Mainboard ● Added A.5 Sensor List. 2022-11-11 Updated Security. 2022-08-12 ● Optimized 6.3 Physical Specifications...
Technical White Paper 1 Product Introduction Product Introduction The FusionServer XH321L V5 (XH321L V5) is a liquid-cooled server node designed for X6000 servers. An X6000 can house up to four XH321L V5 server nodes in a 2U chassis. The XH321L V5 delivers supreme performance and high storage density in limited space through innovative design.
Page 9
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 1 Product Introduction Table 1-1 Configuration description Configuration Application description Liquid cooling of ● Liquid cold plates for processors are provided. processors ● It fits into our company's full liquid cooling cabinets or customer's liquid-cooled cabinets.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 2 Features Features Performance and Scalability ® ® ● Powered by two Intel Xeon Scalable Skylake or Cascade Lake processors, the server provides up to 28 cores, 3.8 GHz frequency, a 38.5 MB L3 cache, and two 10.4 GT/s UPI links between the processors, which deliver supreme...
Page 11
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 2 Features ® ® ● With Intel integrated I/O, the Intel Xeon Scalable processors integrate the PCIe 3.0 controller to shortens I/O latency and improve overall system performance. ● It supports six SATA/SAS HDDs and NVMe SSDs. The SSDs deliver higher I/O performance than HDDs.
Page 12
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 2 Features NO TE The service port with NC-SI enabled supports the following configuration: ● Configuring the LOM port (NIC Mezz) of the server as the service port with NC-SI enabled.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 4 Logical Structure Logical Structure Figure 4-1 XH321L V5 logical structure ® ® ● The server supports two Intel Xeon Scalable processors. ● The server supports up to 16 memory modules.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Water inlet Slide-out label plate (with an SN label) 5.1.2 Indicators and Buttons Indicator and Button Positions Figure 5-2 Indicators and buttons on the front panel LOM port indicator...
Page 19
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Sign Indicator and Description Button Power button/ Power indicator: indicator ● Off: The device is not powered on. ● Steady green: The device is powered on. ● Blinking yellow: The iBMC is starting. The power button is locked and cannot be pressed.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Sign Indicator and Description Button Data ● Off: No data is being transmitted. transmission ● Blinking yellow: Data is being transmitted. status indicator of management network port Connection ●...
Page 21
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Figure 5-4 Ports on the multi-port cable VGA port Two USB ports Serial port One USB port Universal connector port Port Description Table 5-2 Ports on the front panel...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Tool Type Quantity Description Management RJ45 Used for server management. network port NOTE ● The management network port is a GE port that supports 100 Mbit/s and 1000 Mbit/s auto- negotiation.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description 5.3.1 DDR4 Memory 5.3.1.1 Memory Identifier You can determine the memory module properties based on the label attached to the memory module. Figure 5-8 Memory identifier Callout Description...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description 5.3.1.3 Memory Compatibility Observe the following rules when configuring DDR4 DIMMs: NO TICE ● A server must use the same model of DDR4 DIMMs, and all the DIMMs operate at the same speed, which is the smallest value of: ●...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description NO TE A quad-rank LRDIMM generates the same electrical load as a single-rank RDIMM on a memory bus. Table 5-4 DDR4 memory specifications Parameter Specifications Maximum capacity per DDR4 DIMM (GB)
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description ▪ The channels can have different online spare configurations. ▪ Each populated channel must have a spare rank. – Memory mirroring mode ▪ Comply with the general installation guidelines.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Figure 5-10 DDR4 memory installation guidelines 5.3.1.6 Memory Protection Technologies The following memory protection technologies are supported: ● ● Full mirroring ● Address range mirroring ● SDDC ●...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description 5.4.1 Drive Configuration Table 5-5 Drive configuration Specifies the hard drive Maximum Drives Drive Management type. Mode Built-in M.2 SSD ● Slots 2 support only M. 2 SSD M.2 FRU SSD...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description 5.4.3 Drive Indicators M.2 FRU Indicators Figure 5-13 M.2 FRU indicators Table 5-6 M.2 FRU indicator description Indicator Description M.2 FRU fault indicator ● Off: The M.2 FRU is running properly.
Page 33
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Table 5-7 LOM description Chip Port Type Numb Rate Supported Rates Not Type Model er of Negotiatio Rates Supported Ports n Mode X722 10GE Auto- 10000M 10/100/100 optical...
Page 34
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Indicator Positions Figure 5-15 LOM indicators Connection status Data transmission rate indicator/Data transmission indicator for a 10GE optical status indicator for a 10GE port optical port Data transmission status...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description 5.6 I/O Expansion 5.6.1 PCIe Cards PCIe cards provide ease of expandability and connection. ● The electrical ports provided by PCIe NICs cannot be connected to power over Ethernet (PoE) devices (such as a switch with PoE enabled).
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description PCIe PCIe Connec Port B/D/F Slot Slot Standa Width Size Width ● The B/D/F (Bus/Device/Function Number) values are the default values when the server is fully configured with PCIe devices. The values may vary if the server is not fully configured with PCIe devices or if a PCIe card with a PCI bridge is configured.
Page 37
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 5 Hardware Description Left guide sleeve (J168) Slimline connector (J20009/corresponding to CPU2) Power connector (J14) Power connector (J16) Signal connector (J18) Signal connector (J2) Signal connector (J19) Right guide sleeve (J169)
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 6 Product Specifications Product Specifications 6.1 Technical Specifications 6.2 Environmental Specifications 6.3 Physical Specifications 6.1 Technical Specifications Table 6-1 Technical Specifications Component Specifications Form factor 2U4 liquid-cooled server node Chipset ®...
Page 39
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 6 Product Specifications Component Specifications DIMM Supports 16 memory modules of the following types: ● Up to 16 DDR4 memory modules ● Max. 2933 MT/s memory speed ● RDIMM and LRDIMM support ●...
Page 40
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 6 Product Specifications Component Specifications Network Supports LOM. ● Supports two 10GE optical ports and two GE electrical ports via the NIC chip integrated on the mainboard. ● The LOM ports support NC-SI, WOL, and PXE.
Page 41
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 6 Product Specifications Component Specifications Video card An SM750 video chip with 32 MB display memory is integrated on the mainboard. The maximum display resolution is 1920 x 1200 at 60 Hz with 16 M colors.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 6 Product Specifications 6.2 Environmental Specifications Table 6-2 Environmental specifications Category Specifications Temperature ● Operating temperature: 5°C to 35°C (41°F to 95°F) (ASHRAE Class A1/A2 compliant) ● Non-operating temperature (with water inside): 5°C to 35°C (41°F to 95°F)
Page 43
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 6 Product Specifications Category Specifications Particle contaminant ● The equipment room environment meets the requirements of ISO 14664-1 Class 8. ● There is no explosive, conductive, magnetic, or corrosive dust in the equipment room.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 6 Product Specifications 6.3 Physical Specifications Table 6-3 Physical specifications Item Description Dimensions (H x W x 40.5 mm x 177.9 mm x 545.5 mm (1.59 in. x 7.00 in. x 21.48 in.)
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 7 Software and Hardware Compatibility Software and Hardware Compatibility Use the Compatibility List to obtain information about the operating systems and hardware supported. NO TICE ● If incompatible components are used, the device may be abnormal. This fault is beyond the scope of technical support and warranty.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 8 Safety Instructions Safety Instructions 8.1 Security 8.2 Maintenance and Warranty 8.1 Security General Statement ● Comply with local laws and regulations when installing devices. These Safety Instructions are only a supplement.
Page 47
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 8 Safety Instructions ● Do not carry the weight that is over the maximum load per person allowed by local laws or regulations. Before moving or installing equipment, check the maximum equipment weight and arrange required personnel.
Page 48
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 8 Safety Instructions Figure 8-3 Wearing an ESD wrist strap ● Exercise caution when using tools. ● If the installation position of the device is higher than the shoulders of the installation personnel, use a vehicle such as a lift to facilitate installation.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 8 Safety Instructions equipment being transported is always kept upright. Take necessary precautions to prevent collisions, corrosion, package damage, damp conditions and pollution. ● Transport the equipment in its original packaging.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 9 System Management System Management The server uses the next-generation Intelligent Baseboard Management Controller (iBMC) to implement remote server management. The iBMC complies with IPMI 2.0 and provides highly reliable hardware monitoring and management.
Page 51
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper 9 System Management Specifications Description System watchdog Supports BIOS POST, OS watchdog, and automatic system reset after fault timeout. Users can enable or disable these features individually. Setting of boot device Supports out-of-band configuration for the boot device.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Appendix A.1 Node Label Figure A-1 Position of the XH321L V5 label Table A-1 XH321L V5 Label description Description Serial number of the server node. For details, see A.2 Product A.2 Product SN...
Page 55
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix ● SN example 1 Figure A-2 SN example 1 ● SN example 2 Figure A-3 SN example 2 Table A-2 SN example description Description ESN ID (two characters), which can only be 21.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix A.3 Operating Temperature Limitations NO TE For configurations not listed in the table, the operating temperature range is 5°C (41°F) to 30°C (86°F). For special configuration and temperature requirements, contact technical support.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Drive Drive Quantity (Q) CPU Power (P) Maximum Backplane Temperature P < 140 W 35°C (95°F) 0 < Q ≤ 8 165 W < P ≤ 205 W 32°C (89.6°F) P ≤...
Page 58
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Drive Drive CPU Power Maximum Maximum Backplane Quantity (Q) Temperature Temperature (Onboard (PCIe Optical Optical Module) Module) P ≤ 140 W 35°C (95°F) 35°C (95°F) X6000 V5 C00 16 < Q ≤ 24 140 W <...
Page 59
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Drive Drive CPU Power Maximum Maximum Backplane Quantity (Q) Temperature Temperature (Onboard (PCIe Optical Optical Module) Module) P ≤ 140 W 35°C (95°F) 30°C/86°F (35°C/95°F for 10GE optical modules) 8 <...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Drive Drive Quantity (Q) CPU Power (P) Maximum Backplane Temperature P ≤ 165 W 35°C (95°F) X6000 V5 C10 8 < Q ≤ 12 165 W < P ≤ 205 W 12 x 3.5"...
Page 62
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Module Feature Description Single Device Data Corrects single-chip multi-bit errors to Correction (SDDC) improve memory reliability. Device Tagging Degrades and rectifies memory faults to improve memory availability. Data Scrambling...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Module Feature Description OOB access to MCA The out-of-band system can access registers MCA registers through the PECI. When a fatal error occurs in the system, the out-of-band system can collect onsite...
Page 64
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component CPU2 VDDQ Temp CPU VDDQ temperature Mainboard CPU1 VRD Temp CPU VRD temperature Mainboard CPU2 VRD Temp CPU VRD temperature Mainboard CPU1 MEM Temp CPU DIMM temperature...
Page 65
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component RAID Temp Temperature of the RAID RAID controller card controller card Disks Temp Maximum drive Drive temperature Power Board power FAN1 F Speed Fan speed Fan module 1 1 indicates the fan module number.
Page 66
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component PS2 VIN PSU 2 input voltage PSU 2 2 indicates the PSU number. CPU Usage CPU usage Memory Usage Memory usage CPU1 Status CPU status detection...
Page 67
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component SysFWProgress Software processes and system startup errors Power Button Power button pressed Right mounting ear status SysRestart System restart causes Boot Error Boot error Watchdog2 Watchdog...
Page 68
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component FAN2 R Presence Fan presence Fan module 2 2 indicates the fan module number. FAN3 F Presence Fan presence Fan module 3 3 indicates the fan module number.
Page 69
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component FAN4 R Status Fan fault status Fan module 4 4 indicates the fan module number. UID Button UID button status Indicator board on the front panel...
Page 70
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component DIMM020 DIMM status DIMM 020 indicates the DIMM slot number. DIMM030 DIMM status DIMM 030 indicates the DIMM slot number. DIMM031 DIMM status DIMM 031 indicates the DIMM slot number.
Page 71
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component DIMM150 DIMM status DIMM 150 indicates the DIMM slot number. PCIE Status Incorrect PCIe status PCIe device PwrOn TimeOut Power-on timeout Mainboard PwrCap Status Power capping status...
Page 72
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper A Appendix Sensor Description Component SSD Disk1 Temp SSD temperature SSD 1 1 indicates the drive slot number. SSD Disk2 Temp SSD temperature SSD 2 2 indicates the drive slot number.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper B Glossary Glossary B.1 A-E ejector lever A part on the panel of a device used to facilitate installation or removal of the device. Ethernet A baseband local area network (LAN) architecture developed by Xerox Corporation by partnering with Intel and DEC.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper B Glossary B.3 K-O A hardware device that provides public keyboard, video and mouse (KVM). B.4 P-T panel An external component (including but not limited to ejector levers, indicators, and ports) on the front or rear of the server.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper B Glossary B.5 U-Z A unit defined in International Electrotechnical Commission (IEC) 60297-1 to measure the height of a cabinet or chassis. 1 U = 44.45 mm UltraPath A point-to-point processor interconnect developed by Interconnect (UPI) Intel.
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper C Acronyms and Abbreviations Acronyms and Abbreviations C.1 A-E alternating current Advanced Encryption Standard New Instruction Set Address Resolution Protocol Advanced Vector Extensions backup battery unit BIOS Basic Input/Output System calendar day...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper C Acronyms and Abbreviations direct current DCPMM DC persistent memory module DDR3 Double Data Rate 3 DDR4 Double Data Rate 4 DDDC double device data correction DEMT Dynamic Energy Management Technology...
Page 78
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper C Acronyms and Abbreviations Gigabit Ethernet GPIO General Purpose Input/Output graphics processing unit high availability hard disk drive high-performance computing HTTP Hypertext Transfer Protocol HTTPS Hypertext Transfer Protocol Secure iBMC intelligent baseboard management controller...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper C Acronyms and Abbreviations C.3 K-O keyboard, video, and mouse Lucent connector LRDIMM load-reduced dual in-line memory module light emitting diode LAN on motherboard media access control module management controller next business day...
Page 80
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper C Acronyms and Abbreviations Preboot Execution Environment Quick Path Interconnect RAID redundant array of independent disks reliability, availability and serviceability RDIMM registered dual in-line memory module REACH Registration Evaluation and Authorization of Chemicals...
FusionServer XH321L V5 Liquid-Cooled Server Node Technical White Paper C Acronyms and Abbreviations TACH tachometer signal Turbo Boost Technology Trusted Computing Group trusted cryptography module total cost of ownership thermal design power TELNET Telecommunication Network Protocol Trusted Execution Technology TransFlash module...
Need help?
Do you have a question about the FusionServer XH321L and is the answer not in the manual?
Questions and answers