Download Print this page

xFusion Digital Technologies FusionServer CH121L V5 Product White Paper

Liquid-cooled compute node

Advertisement

Quick Links

FusionServer CH121L V5 Liquid-Cooled Compute Node
Technical White Paper
Issue
04
Date
2022-08-12
xFusion Digital Technologies Co., Ltd.

Advertisement

loading
Need help?

Need help?

Do you have a question about the FusionServer CH121L V5 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Summary of Contents for xFusion Digital Technologies FusionServer CH121L V5

  • Page 1 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper Issue Date 2022-08-12 xFusion Digital Technologies Co., Ltd.
  • Page 2 Notice In this document, "xFusion" is used to refer to "xFusion Digital Technologies Co., Ltd." for concise description and easy understanding, which does not mean that "xFusion" may have any other meaning. Any "xFusion" mentioned or described hereof may not be understood as any meaning other than "xFusion Digital Technologies Co., Ltd.", and xFusion Digital Technology Co., Ltd.
  • Page 3 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper Contents Contents About This Document ........................v 1 Product Introduction ........................7 2 Features ............................9 3 Physical Structure ........................11 4 Logical Structure ......................... 13 5 Hardware Description ........................ 14 5.1 Front Panel ..................................
  • Page 4 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper Contents 5.7.1 Mainboard ................................31 6 Product Specifications ........................ 32 6.1 Technical Specifications ............................. 32 6.2 Environmental Specifications ............................. 34 6.3 Physical Specifications ............................... 36 7 Software and Hardware Compatibility .................. 37 8 Safety Instructions ........................
  • Page 5 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper About This Document About This Document Purpose This document describes the appearance, features, specifications, and configurations of the new-generation CH121L V5 compute node of the E9000 blade server. Intended Audience This document is intended for pre-sales engineers.
  • Page 6 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper About This Document Change History Issue Date Change Description 2022-08-12 ⚫ Optimized 6.3 Physical Specifications . ⚫ Added A.1 Node Label. 2022-06-25 ⚫ Added a figure that shows how to measure dimensions.
  • Page 7 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 1 Product Introduction Product Introduction ® The CH121L V5 is a half-width compute node supporting liquid cooling. Powered by Intel ® Xeon Scalable processors, the CH121L V5 delivers powerful computing capability, large memory capacity, and outstanding flexibility and expandability.
  • Page 8 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 1 Product Introduction Table 1-1 Configuration description Configuration Application description Liquid cooling of ⚫ Liquid cold plates for processors are provided. processors ⚫ It fits into our company's full liquid cooling cabinets or customer's liquid-cooled cabinets.
  • Page 9 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 2 Features Features Performance and Scalability ® ® ⚫ Powered by two Intel Xeon Scalable Skylake or Cascade Lake processors, the server provides up to 28 cores, 3.8 GHz frequency, a 38.5 MB L3 cache, and two 10.4 GT/s UPI links between the processors, which deliver supreme processing performance.
  • Page 10 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 2 Features Availability and Serviceability ⚫ Memory mirroring and memory module backup prevent system shutdown caused by uncorrectable memory errors. ⚫ Data is protected using hot-swappable drives and RAID properties. ⚫...
  • Page 11 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 3 Physical Structure Physical Structure The CH121L V5 is available with liquid cooling of processors only or with liquid cooling of processors and memory modules. Figure 3-1 CH121L V5 (processor liquid cooling configurations) physical structure...
  • Page 12 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 3 Physical Structure BIOS battery Memory Figure 3-2 CH121L V5 (processor memory liquid cooling configurations) physical structure Air duct Shielding box Liquid cold plate Memory heat sink Water outlet Water inlet...
  • Page 13 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 4 Logical Structure Logical Structure Figure 4-1 CH121L V5 logical structure ® ® ⚫ The server supports two Intel Xeon Scalable processors. ⚫ The server supports up to 24 memory modules.
  • Page 14 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Hardware Description 5.1 Front Panel 5.2 Processor 5.3 Memory 5.4 Storage 5.5 Network 5.6 I/O Expansion 5.7 Boards 5.1 Front Panel 5.1.1 Appearance Figure 5-1 Front view Slide-out label plate (with an SN...
  • Page 15 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description 2.5" drives 5.1.2 Indicators and Buttons Indicator and Button Positions Figure 5-2 Indicators and buttons on the front panel Power button/indicator UID button/indicator Health status indicator Indicator and Button Descriptions...
  • Page 16 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Sign Indicator and Description Button this button for 6 seconds will forcibly power off the device. ⚫ When the power indicator is steady yellow, you can press this button to power on the device.
  • Page 17 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description 5.1.3 Ports Port Positions Figure 5-3 Ports on the front panel USB 3.0 ports Water inlet Water outlet Port Description Port Type Quantity Description USB port USB 3.0 Used to connect to a USB device.
  • Page 18 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Figure 5-4 Installation positions 5.2 Processor ⚫ The server supports two processors. ⚫ The same model of processors must be used in a server. ⚫ Contact your local sales representative or use the...
  • Page 19 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Figure 5-5 Positions of processors Figure 5-6 Positions of processors 2022-08-12...
  • Page 20 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description 5.3 Memory 5.3.1 DDR4 Memory 5.3.1.1 Memory Identifier You can determine the memory module properties based on the label attached to the memory module. Figure 5-7 Memory identifier...
  • Page 21 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Callout Description Definition ⚫ Column Access Strobe (CAS) P: 15 latency ⚫ T: 17 DIMM type ⚫ R: RDIMM ⚫ L: LRDIMM 5.3.1.2 Memory Subsystem Architecture The CH121L V5 provides 24 memory slots. Each processor integrates six memory channels.
  • Page 22 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Memory Channel Memory Slot 2E (primary) DIMM140(2E1) DIMM141(2E2) 2F (primary) DIMM150(2F1) DIMM151(2F2) 5.3.1.3 Memory Compatibility Observe the following rules when configuring DDR4 DIMMs: ⚫ A server must use the same model of DDR4 DIMMs, and all the DIMMs operate at the same speed, which is the smallest value of: ⚫...
  • Page 23 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Each memory channel supports a maximum of 8 ranks. The number of DIMMs supported by each channel varies depending on the number of ranks supported by each channel: Number of DIMMs supported by each channel ≤...
  • Page 24 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Parameter DIMM value listed in this table is based on the assumption that DIMMs are fully configured. ⚫ c: DPC (DIMM per channel) indicates the number of DIMMs per channel.
  • Page 25 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Figure 5-8 Memory slots Figure 5-9 DDR4 memory installation guidelines 5.3.1.6 Memory Protection Technologies The following memory protection technologies are supported: ⚫ ⚫ Full mirroring ⚫ Address range mirroring ⚫...
  • Page 26 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description ⚫ Memory thermal throttling ⚫ Memory address parity protection ⚫ Memory demand/patrol scrubbing ⚫ Device tagging ⚫ Data scrambling ⚫ Adaptive double device data correction (ADDDC) ⚫ ADDDC+1 5.4 Storage...
  • Page 27 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description 5.4.3 Drive Indicators SAS/SATA Drive Indicators Figure 5-11 SAS/SATA drive indicators Table 5-5 Description of SAS/SATA drive indicators Activity Indicator Fault Indicator Description (Green) (Yellow) The drive is not in position.
  • Page 28 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Table 5-6 M.2 FRU indicator description Indicator Description M.2 FRU fault indicator ⚫ Off: The M.2 FRU is running properly. ⚫ Blinking yellow: The M.2 FRU is being located, or RAID is being rebuilt.
  • Page 29 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description Figure 5-13 Connections between the LOM and I/O modules ⚫ In addition to the LOM, the compute node connects to the Fabric ports of the switch modules through the network ports on mezzanine cards.
  • Page 30 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description 5.6 I/O Expansion 5.6.1 PCIe Cards PCIe cards provide ease of expandability and connection. ⚫ Contact your local sales representative or use the Compatibility Checker to determine the components to be used.
  • Page 31 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 5 Hardware Description 5.7 Boards 5.7.1 Mainboard Figure 5-14 CH121L V5 mainboard TPM connector RAID controller card connectors Mezzanine card 2 connector Mezzanine card 1 connector Jumper (J76) RTC battery Positioning sleeve...
  • Page 32 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 6 Product Specifications Product Specifications 6.1 Technical Specifications 6.2 Environmental Specifications 6.3 Physical Specifications 6.1 Technical Specifications Table 6-1 Technical Specifications Component Specifications Form factor Half-width liquid-cooled compute node ® Chipset...
  • Page 33 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 6 Product Specifications Component Specifications ⚫ RDIMM and LRDIMM support ⚫ The DDR4 memory modules of different types (RDIMM and LRDIMM) cannot be used together. NOTE The preceding information is for reference only. Use the...
  • Page 34 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 6 Product Specifications Component Specifications − Two USB 3.0 ports ⚫ Built-in port: − One USB 3.0 port NOTE The maximum dimensions (H x W x D) of the built-in USB device are 33.9 mm x 14.5 mm x 7.12 mm (1.33 in.
  • Page 35 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 6 Product Specifications Category Specifications ⚫ Storage humidity (within one year): 20% to 75% ⚫ Maximum change rate: 20%/h ≤3050m Operating altitude ⚫ When the server configuration complies with ASHRAE Classes A1 and A2 and the altitude is above 900 m (2952.76 ft), the highest operating temperature decreases by...
  • Page 36 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 6 Product Specifications 6.3 Physical Specifications Table 6-3 Physical specifications Item Description Dimensions (H x W x D) 60.46 mm x 210 mm x 537.2 mm (2.38 in. x 8.27 in. x 21.15 in.)
  • Page 37 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 7 Software and Hardware Compatibility Software and Hardware Compatibility Use the Compatibility Checker to obtain information about the operating systems and hardware supported. ⚫ If incompatible components are used, the device may be abnormal. This fault is beyond the scope of technical support and warranty.
  • Page 38 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 8 Safety Instructions Safety Instructions 8.1 Security 8.2 Maintenance and Warranty 8.1 Security General Statement ⚫ Comply with local laws and regulations when installing devices. These Safety Instructions are only a supplement.
  • Page 39 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 8 Safety Instructions Figure 8-1 Safety work wear ⚫ Before touching a device, wear ESD clothing and gloves (or wrist strap), and remove any conductive objects (such as watches and jewelry). Figure 8-2 shows conductive objects that must be removed before you touch a device.
  • Page 40 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 8 Safety Instructions Figure 8-3 Wearing an ESD wrist strap ⚫ Exercise caution when using tools. ⚫ If the installation position of the device is higher than the shoulders of the installation personnel, use a vehicle such as a lift to facilitate installation.
  • Page 41 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 8 Safety Instructions transported is always kept upright. Take necessary precautions to prevent collisions, corrosion, package damage, damp conditions and pollution. ⚫ Transport the equipment in its original packaging. ⚫ If the original packaging is unavailable, package heavy, bulky parts (such as chassis and blades) and fragile parts (such as PCIe GPUs and SSDs) separately.
  • Page 42 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 9 System Management System Management The server uses the next-generation Intelligent Baseboard Management Controller (iBMC) to implement remote server management. The iBMC complies with IPMI 2.0 and provides highly reliable hardware monitoring and management.
  • Page 43 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 9 System Management Specifications Description Setting of boot device Supports out-of-band configuration for the boot device. Alarm management Supports alarm management and reports alarms using the SNMP trap, SMTP, and syslog service to ensure 24/7 operating.
  • Page 44 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 10 Certifications Certifications Country/Region Certification Standards Europe WEEE 2012/19/EU Europe REACH EC NO. 1907/2006 Europe Safety: EN 62368-1:2014+A11:2017 EMC: EN 55032:2015+A11:2020 CISPR 32:2015+A1:2019 EN IEC 61000-3-2:2019+A1:2021 EN 61000-3-3:2013+A1:2019 EN 55035:2017+A11:2020 CISPR 35:2016...
  • Page 45 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper 10 Certifications Country/Region Certification Standards CISPR 35:2016 EN 55024:2010+A1:2015 CISPR 24:2010+A1:2015 ETSI EN 300 386 V1.6.1:2012 ETSI EN 300 386 V2.1.1:2016 RoHS: BS EN IEC 63000:2018 ErP: Commission Regulation(EU) 424/2019 FCC PART 15...
  • Page 46 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper A Appendix Appendix A.1 Node Label Figure A-1 Position of the CH121L V5 label Table A-1 CH121L V5 Label description Description Serial number of the server node. For details, see A.2 Product SN.
  • Page 47 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper A Appendix Figure A-2 Example SN Table A-2 SN description Description ESN ID (two characters), which can only be 21. Material ID (eight characters), that is, the processing code. Vendor code (two characters), that is, the code of the processing place.
  • Page 48 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper A Appendix Module Feature Description Corrected Machine Check Corrects error-triggered interrupts. Interrupt (CMCI) Memory Failed DIMM Isolation Identifies faulty DIMMs to facilitate isolation and replacement of the faulty DIMMs. Memory Thermal Throttling...
  • Page 49 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper A Appendix Module Feature Description Architected Error Records With the features such as eMCA, the BIOS collects error information recorded in hardware registers in compliance with UEFI specifications, notifies the OS through the APEI interface of the ACPI, and locates the error unit, improving system availability.
  • Page 50 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper B Glossary Glossary B.1 A-E ejector lever A part on the panel of a device used to facilitate installation or removal of the device. Ethernet A baseband local area network (LAN) architecture developed by Xerox Corporation by partnering with Intel and DEC.
  • Page 51 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper B Glossary B.3 K-O A hardware device that provides public keyboard, video and mouse (KVM). B.4 P-T panel An external component (including but not limited to ejector levers, indicators, and ports) on the front or rear of the server.
  • Page 52 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper B Glossary B.5 U-Z A unit defined in International Electrotechnical Commission (IEC) 60297-1 to measure the height of a cabinet or chassis. 1 U = 44.45 mm UltraPath A point-to-point processor interconnect developed by Intel.
  • Page 53 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper C Acronyms and Abbreviations Acronyms and Abbreviations C.1 A-E alternating current Advanced Encryption Standard New Instruction Set Address Resolution Protocol Advanced Vector Extensions backup battery unit BIOS Basic Input/Output System calendar day...
  • Page 54 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper C Acronyms and Abbreviations DDR3 Double Data Rate 3 DDR4 Double Data Rate 4 DDDC double device data correction DEMT Dynamic Energy Management Technology DIMM dual in-line memory module DRAM dynamic random-access memory...
  • Page 55 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper C Acronyms and Abbreviations high availability hard disk drive high-performance computing HTTP Hypertext Transfer Protocol HTTPS Hypertext Transfer Protocol Secure iBMC intelligent baseboard management controller Industry Canada ICMP Internet Control Message Protocol...
  • Page 56 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper C Acronyms and Abbreviations LAN on motherboard media access control module management controller next business day NC-SI Network Controller Sideband Interface C.4 P-T PCIe Peripheral Component Interconnect Express power distribution unit...
  • Page 57 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper C Acronyms and Abbreviations REACH Registration Evaluation and Authorization of Chemicals RJ45 registered jack 45 RoHS Restriction of the Use of Certain Hazardous Substances in Electrical and Electronic Equipment Serial Attached Small Computer System Interface...
  • Page 58 FusionServer CH121L V5 Liquid-Cooled Compute Node Technical White Paper C Acronyms and Abbreviations TFTP Trivial File Transfer Protocol TCP offload engine trusted platform module C.5 U-Z UDIMM unbuffered dual in-line memory module UEFI Unified Extensible Firmware Interface unit identification light Underwriter Laboratories Inc.