4u rackmount intel xeon scalable series gpu server, supporting 10 x pcie x16 double-deck cards plus 1 x pcie x16 and 1 x pcie x8 singledeck cards (102 pages)
No part of this manual may be reproduced, copied, translated, or transmitted in any form or by any means without the prior written permission of Advantech Co., Ltd. The information provided in this manual is intended to be accurate and reliable.
Whether your new Advantech equipment is destined for the labo- ratory or the factory floor, you can be assured that your product will provide the reliability and ease of operation for which the name Advantech has come to be known.
You must become familiar with the safety information in this guide before you install, operate, or service Advantech products. Machine Room Environment Make sure that the area in which you install the system is properly ventilated ...
Page 5
Advantech, your authorized Advantech partner, or their agents. Equipment Modifications Do not make mechanical modifications to the system. Advantech is not respon- sible for the regulatory compliance of Advantech equipment that has been mod- ified.
It should be free of marks and scratches and in perfect working order upon receipt. When unpacking the SKY-7232D3E, check it for signs of shipping damage. (For example, damaged box, scratches, dents, etc.) If it is dam- aged or it fails to meet the specifications, notify our service department or local sales representative immediately.
Introduction The SKY-7232D3E is a 2U HCI server with dual socket Intel 3rd Gen. Xeon Scalable Processors. The value proposition of SKY-7232D3E includes following. Extreme computing performance with dual socket Intel 3rd Gen Xeon SP tech- nology, up to 32 cores per socket Maximum and flexible PCIe Configuration with up to 5x PCIe slots ...
Linux (CentOS, Red Hat, Ubuntu), Windows server Humidity Operational 5% to 85% (non-condensing) Environment Operational 0 °C (32° F) to 40° C (104° F) Temperature Storage -40 °C (-40° F) to 70 °C (158° F) Temperature Certification CE/FCC/CB/UL SKY-7232D3E User Manual...
Connectors on the SKY-7232D3E are linked to external devices such as hard disk drives. In addition, SKY-7232D3E has a jumper that are used to clean CMOS for BIOS. The tables below list the functions of each jumper and connector. Later sec- tions in this chapter give instructions for setting jumpers.
1.4.1 Buttons and LED definition Front Control Panel Label Icon Indicator, button or connector Power Button UID Button Reset Button USB3.0 HDD Activity LED System Alarm LED LAN1, LAN2 Activity LED Rack Handle (Left) Rack Handle (Right) SKY-7232D3E User Manual...
Page 16
On-Board LED State Color Description Green System power on 3V3 LED Power off System power on, in sleep mode or in soft-off Green mode 5VSB LED No AC power input BMC LED Green BMC controller is working normally SKY-7232D3E User Manual...
Page 17
Power supply warning events where the power 1Hz Blink AMBER supply continues to operate high temp, high power, high current, slow FAN. Power supply critical event causing a shutdown; AMBER failure, OCP, OVP, FAN fail. SKY-7232D3E User Manual...
PCI-E 4.0 x8 connector CN45 PCI-E 4.0 x8 connector CN59 System FAN connector CN51 Front Panel LED & Button Header CN63 TPM Module Connector CN80 Front HDD Backplate SMBUS Signal Connector (reserved) CN30 SPI Socket for BIOS1 (Primary) SKY-7232D3E User Manual...
Page 19
M.2 2080 connector 1 for PCIe 4.0 CN79 HDD Backplate SMBUS Signal Connector CN39 M.2 2080 connector 2 for PCIe 4.0 CN11-CN14 DDR4 DIMM connector CN15-CN22 DDR4 DIMM connector CPU0 Socket CPU1 Socket CN68 ATX 2x4 Power Connector CN73 CPU FAN connector SKY-7232D3E User Manual...
Page 20
Power Button CN38 FPGA Programming Header BMC Programming Header D5-D12 Port 80 Debug LED BMC Heat beat LED Activity LED for SPI Socket for BIOS1 (Primary) Clear CMOS Button Activity LED for SPI Socket for BIOS2 (Secondary) SKY-7232D3E User Manual...
Block Diagram System Memory SKY-7232D3E has sixteen 288-pin memory slots for DDR4 2666/2933/3200 MHz memory modules with maximum capacity of 1024 GB (Maximum 64 GB for each DIMM). SKY-7232D3E supports registered DIMMs memory module. Memory Installation Memory performance is affected by different DIMM configurations. To reach optimal...
Components and electronic circuit boards can be damaged by discharges of static electricity. Working on a system that is connected to a power supply can be extremely dangerous. Follow the guidelines below to avoid damage to SKY-7232D3E or injury to yourself.
CPUs, memory modules and add on cards. 2.2.1 Removing the Chassis Cover and CPU Duct Follow these instructions to remove SKY-7232D3E chassis cover. Unscrew the screw at both side, and push away the top cover. Remove CPU air duct. 2.2.2 Installing the CPU and Heatsink Follow the steps below to install CPUs and CPU heatsinks.
Page 28
Install CPU on CPU carrier and align the pin 1 mark. Install the CPU clip assembly on the heatsink as a processor + heatsink module. Use a T30 Torx screwdriver for tighten the screws in the order of 1,2 -> 3,4 with a torque of 12lbf. SKY-7232D3E User Manual...
Align the memory module with the slot. When inserted properly, the memory slot locking levers lock automatically onto the indentations at the ends of the mod- ule. Follow the recommended memory population table to install the other mem- ory modules. SKY-7232D3E User Manual...
Press the locking lever latch and pull the locking lever open and Slide the HDD tray out. The drive tray is tool-less design. Place a hard drive into the HDD tray, and then insert the HDD tray into the chassis and press the locking lever to secure the tray. SKY-7232D3E User Manual...
Rack Mounting After installing the necessary components, the SKY-7232D3E can be mounted in a rack using the supplied rack mounting kit. Rack mounting kit Sliding Rails x 2 Screws Kit x 1 Attach the inner rail to the chassis base while aligning the T pins on the side of the system with the slots on the inner rail..
Page 32
Lift the latch as shown. Secure the inner rail with one screw (M4 x 4). SKY-7232D3E User Manual...
Page 33
While you are pushing chassis back to the cabinet, you need to release the slide from locking position by pressing the trigger down. Warning! Requires at least 2 people to install the SKY-7232D3E chassis for safety purposes. SKY-7232D3E User Manual...
Page 34
Fiabilité de la mise - Fiable mise à la terre de l'équipement monté en rack doit être maintenue. Une attention particulière devrait être accordée à fournir connexions autres que les connexions directes sur le circuit de branche (par exemple l'utilisation de multiprises). SKY-7232D3E User Manual...
SKY-7232D3E BIOS is based on AMI’s APTIO BIOS and compliant to the UEFI, SMBIOS and ACPI specifications. The BIOS performs probing, initialization and configuration of the SKY-7232D3E and initializes the OS boot process at the end of POST (Power-On-Self-Test). Regular BIOS output as well as the setup menu are displayed via console port and please note that the SKY-7232D3E does not have any on-board POST Code LEDs.
Page 37
Auxiliary text providing information about the selected setup item is displayed in the top right corner. Figure 3.2 BIOS Setup Screen Organization SKY-7232D3E User Manual...
Current AMI BIOS core version in Core Version Display only UEFI Spec revision that the BIOS Compliancy Display only complies to Advantech BIOS Version info BIOS Information EX: mmmm Vx.yz Project Version Display only mmmm: model name X: major version Yz: minor version Build Date &...
3.2.2 Platform Setup Menu Select the Platform tab from the SKY-7232D3E setup screen to enter the Platform Setup screen. Users can select any of the items in the left frame of the screen, such as the Trusted Computing Configuration, to go to the sub menu for that item. Users can display a Platform BIOS Setup option by highlighting it using the <Arrow>...
Page 40
Defines number of data bits in a charac- Data Bits ter. Defines number of stop bits in a charac- Stop Bits ter. None/Even/Odd/Mark/ Parity Defines the parity scheme used. Space Flow Control None/Hardware RTS/CTS Defines the flow control scheme. SKY-7232D3E User Manual...
Page 41
This defines how long console redirec- tion will be active: “BootLoader” means that legacy con- Redirection after POST Always Enable/BootLoader sole redirection is disabled before boot- ing into a Legacy OS. “Always Enable” means Legacy console Redirection is enabled permanently. SKY-7232D3E User Manual...
Page 42
Device Reset 10sec/20sec/ Time Out for a device to Reset time-out 30sec/40sec hardware Device power-up Auto Maximum time the device will take before it delay delay Manual properly reports itself to the Host Controller. Device power-up delay SKY-7232D3E User Manual...
Is displayed when TPM support is Display Only disabled Current Status TPM State Display Only Shows TPM Enablement Status information TPM Active State Display Only Shows TPM Activation Status TPM Owner Display Only Shows Current TPM Owner SKY-7232D3E User Manual...
Page 44
Enable or Disable Endorsement Hierarchy Disable Hierarchy Select the TCG2 Spec Version Support TCG_1_2: the Compatible mode TPM2.0 UEFI TCG_2 for Win8/Win10 Spec Version TCG_1_2 TCG_2: Support new TCG2 pro- tocol and event format for Win10 or later SKY-7232D3E User Manual...
Page 45
4.4 When system with TPM1.2 module installed, and the BIOS will auto detect it and the related setting will be shown in the BIOS setup menu as below. Figure 3.9 Platform Setup: Trusted Computing with TPM1.2 SKY-7232D3E User Manual...
Page 46
Virtualization Technology for Directed I/O (VT-d). Thus, BIOS handle virtual functions exposed by PCIe devices in case SR-IOV is supported, otherwise PCIe devices will be assigned to virtual machines in pass-through mode. This applies for all PCIe devices. Figure 3.10 Platform Setup: Virtualization SKY-7232D3E User Manual...
This sub menu allows you to change the settings used for related CPU utilization set- ting. The default configuration for CPU was optimized setting for getting better perfor- mance for networking, so it is not recommend to change it. Figure 3.11 Platform Setup: Platform Management SKY-7232D3E User Manual...
Page 48
(no OS guidance) OS Controls EPB Power BIOS Controls Selects whether BIOS or Operat- Performance ing System chooses energy per- Tuning PECI Controls formance bias tuning. Enable Enable or disable the WHEA sup- WHEA Support Disable port SKY-7232D3E User Manual...
However, those terms are kept consistent with previous products to allow users to navigate more eas- ily. The sub menus are described on the following pages. Figure 3.12 Hardware Configuration Menu SKY-7232D3E User Manual...
Page 50
Table 3.9: Processor Configuration Menu Group Setup item Access/Options Description CPU signature Microcode Patch CPU Frequency Processor Cores Socket0 CPU Displays information on the pro- Display only Intel VT-x Tech- information cessor installed nology L1 code Cache L2 Cache L3 Cache SKY-7232D3E User Manual...
Page 51
Hardware Setup: North Bridge Configuration This menu allows the configuration of the memory controller and related features of the SoC. Pls refer BIOS DIMM naming compared with M/B DIMM slots printing. Figure 3.14 North Bridge Configuration Menu SKY-7232D3E User Manual...
Page 52
Select Rank Interleaving setting leaving in IMC 4-way Interleave 8-way Interleave Enable Disable Select to enable/disable Patrol Patrol Scrub Enable at End of Scrub Support POST Data Scrambling Enable Select to auto to enable the for DDR4/5 Disable Scrambler SKY-7232D3E User Manual...
Page 53
This sub-menu contains settings for the PCIe subsystem. Some menu items are referred to as “PCI” settings. Although the SKY-7232D3E does not implement a PCI bus, these settings still apply to the platform as PCIe is using the same configuration mechanism as PCI.
Page 54
PORT 0DLink Choose Link Speed for this PCIe Gen 2 (5 GT/s) Speed port Gen 3 (8 GT/s) Gen 4 (16 GT/s) Enable/Disable Intel Volume Man- Enabled Port 0D VMD agement Device Technology on Disable specific root port SKY-7232D3E User Manual...
Page 55
Select PCIe port bifurcation Port 2) x8x8 Auto ® Enable/Disable Intel Volume PCIe Port 2 VMD Enabled Management Device Technology Support Disable in this IOU. VMD Hot Plug Enabled Enable/Disable Hot Plug for PCIe Capable Disable Root Ports SKY-7232D3E User Manual...
Page 56
PORT 3A Link Change PCI Express Devices Gen 2 (5 GT/s) Speed Settings. Gen 3 (8 GT/s) Gen 4 (16 GT/s) ® Enable/Disable Intel Volume Enabled PORT 3A VMD Management Device Technology Disable on specific root port SKY-7232D3E User Manual...
Page 57
PORT 0B Link Choose Link Speed for this PCIe Gen 2 (5 GT/s) Speed port Gen 3 (8 GT/s) Gen 4 (16 GT/s) Enable/Disable Intel Volume Man- Enabled Port 0B VMD agement Device Technology on Disable specific root port SKY-7232D3E User Manual...
Page 58
Gen 1 (2.5 GT/s) PORT 1C Link Change PCI Express Devices Gen 2 (5 GT/s) Speed Settings. Gen 3 (8 GT/s) Gen 4 (16 GT/s) Enable/Disable Intel® Volume Enabled PORT 1C VMD Management Device Technology Disable on specific root port SKY-7232D3E User Manual...
Page 59
PORT 2D Link Change PCI Express Devices Gen 2 (5 GT/s) Speed Settings. Gen 3 (8 GT/s) Gen 4 (16 GT/s) ® Enable/Disable Intel Volume Enabled PORT 2D VMD Management Device Technology Disable on specific root port SKY-7232D3E User Manual...
Page 60
PORT 3D Link Change PCI Express Devices Gen 2 (5 GT/s) Speed Settings. Gen 3 (8 GT/s) Gen 4 (16 GT/s) ® Enable/Disable Intel Volume Enabled PORT 3D VMD Management Device Technology Disable on specific root port SKY-7232D3E User Manual...
Auto 11.2 GB/s None Link Frequency 10.4 GB/s Allows for Selecting the UPI link fre- Select 9.6 GB/s quency Use Per Link Set- ting Enabled Link0p Enable Enable/disable Link0 Disabled Enabled Link1p Enable Enable/disable Link1 Disabled SKY-7232D3E User Manual...
Page 62
Table 3.13: Hardware Setup: South Bridge Configuration Menu Items Group Setup item Access/Options Description SATA Configura- Select sub-menu. tion ACPI Settings Select sub-menu. Runtime Error Select sub-menu. Logging PCH state after Power on/Power Select S0/S5 for ACPI state after a G3 Off/Last State SKY-7232D3E User Manual...
Page 63
SATA Mode (1) AHCI Mode. (2) RAID Mode. RAID Enabled SATA Controller To enable the SATA controller Disabled AHCI sSATA Mode (1) AHCI Mode. (2) RAID Mode. RAID Enabled sSATA Controller To enable the sSATA controller Disabled SKY-7232D3E User Manual...
Page 64
Hot Plug #Port 3 Designates this port as Hot Pluggable Disabled Enabled sSATA Hot Plug #Port 4 Designates this port as Hot Pluggable Disabled Enabled sSATA Hot Plug #Port 5 Designates this port as Hot Pluggable Disabled SKY-7232D3E User Manual...
Page 65
Enable ACPI Auto Enabled Enable or disable BIOS ACPI auto Configuration Disabled configuration Enable the system ability to hiber- None Enabled nate (OS/S4 sleep state), this Enable Hibernation Disabled option may be not effective with some O.S SKY-7232D3E User Manual...
This sub-menu contains settings for the Runtime error logging configuration. Figure 3.20 Hardware Setup: Runtime Error Logging Configuration Table 3.16: Hardware Setup: Runtime Error logging Menu Items Group Setup item Access/Options Description Enabled System error enabling and log- None System Errors Disabled ging setup option Auto SKY-7232D3E User Manual...
Page 69
Boot Watchdog Timer is disabled. Select to configure LAN channel Unspecified parameters statically or dynami- BMC network Configuration Static cally (by BIOS or BMC). Unspeci- configuration Address DynamicBmc- fied option will not modify any Dhcp BMC network parameters during BIOS phase SKY-7232D3E User Manual...
Page 70
Users can configure the system boot priority settings via the boot page. The default setting of boot priority of boot option #1 is “UEFI: Built-in EFI Shell”; Users can define the boot priorities based on the application. Figure 3.24 Boot Configuration SKY-7232D3E User Manual...
Page 71
CSM Parameters CSM Support Enable the CSM support 3.2.5.1 Compatibility Support Module (CSM) Configuration This submenu allows users to configure the support for legacy BIOS mechanisms and option ROMs. Figure 3.25 Post & Boot Setup: CSM Configuration Menu SKY-7232D3E User Manual...
Setup. If set the “Password Check” is [Always], then this is a power on password and must be entered to boot or enter Setup. In Setup the User will have Administra- tor rights. SKY-7232D3E User Manual...
3.2.7 Save & Exit Menu The SKY-7232D3E BIOS allows users to store BIOS configuration results as “User Defaults.” Users can select “Save as User Defaults” to record all changes which had been made in previous pages as the default setting for further use.
Need help?
Do you have a question about the SKY-7232D3E and is the answer not in the manual?
Questions and answers