Highest core count in a space-saving form factor (95 pages)
Summary of Contents for Penguin Computing Relion 2940
Page 1
Relion 2940 Efficient and Versatile Intel-based HPC Server Designed for Next-gen Datacenters Technical Guide Rev. 1.0 PENGUIN COMPUTING www.penguincomputing.com | 1-888-PENGUIN (736-4846) | twitter:@PenguinHPC...
Page 2
Penguin Computing's prior written permission. Documentation Classifications In order to assist in the use of this product, Penguin Computing provides the following types of docu- mentations: For detailed product information, carefully read the User's Manual.
Page 3
Please note WHEN ORDERING SPARE PARTS, you should check the most up-to-date in- formationavailable on your regional web or channel. For whatever reason, if a part number change is made,it will not be noted in the printed Service Guide. For Penguin Computing- AUTHORIZED SERVICEPROVIDERS, your Penguin Computing office may have a DIF- FERENT part number code to thosegiven in the FRU list of this printed Service Guide.
Relion 2940 Chassis Manual Table of Contents Box Contents Safety, Care and Regulatory Information Chapter 1 Hardware Installation Installation Precautions Product Specifications (Per Node) System Block Diagram Chapter 2 System Hardware Installation S y s t e m C o m p o n e n t s...
Page 5
Relion 2940 Chassis Manual T h e M a i n M e n u 4 2 5 - 2 A d v a n c e d M e n u 5 - 2 - Serial Port Console Redirection...
Page 6
Relion 2940 Chassis Manual 5-4-1 System Event Log 5-4-2 View FRU Information 5-4-3 BMC network configuration 5 Security Menu 5-5-1 Secure Boot menu 5-5-1-1 Key Management Boot Menu Save & Exit Menu BIOS POST Codes BIOS POST Beep code PEI Beep Codes...
Relion 2940 Chassis Manual Box Contents Relion 2940 System • The box contents above are for reference only and the actual items shall depend on the product package you obtain. The box contents are subject to change without notice. • The motherboard image is for reference only.
Relion 2940 Chassis Manual Safety, Care and Regulatory Information Important safety information Read and follow all instructions marked on the product and in the documentation before you operateyour sys- tem. Retain all safety and operating instructions for future use. •...
Relion 2940 Chassis Manual Federal Communications Commission (FCC) Statement Warning This is a class A product. In a domestic environment this product may cause radiointerfer- enceIn which case the user may be required to take adequate measures. This equipment has been tested and found to comply with the limits for a Class A digital device,pursuant to Part 15 of the FCC Rules.
Page 10
Relion 2940 Chassis Manual WEEE Symbol Statement The symbol shown below is on the product or on its packaging, which indicates that this product must not be disposed of with other waste. Instead, the device should be taken to the waste collection centers for activation of the treatment, collection, recycling and disposal procedure.
Relion 2940 Chassis Manual Chapter 1 Hardware Installation Installation Precautions The motherboard/system contain numerous delicate electronic circuits and components which can become damaged as a result of electrostatic discharge (ESD). Prior to installation, carefully read the service guide and follow these procedures: •...
Relion 2940 Chassis Manual Product Specifications (Per Node) Support for Intel Xeon E5-2600 V3 series processors in the LGA2011 package ® ® L3 cache varies with CPU Supports Dual QuickPath Interconnect up to 9.6GT/s Enhanced Intel SpeedStep Technology (EIST) Support Intel Virtualization Technology (VT)
Page 13
Power Supply AC input 100-127V: DC Output 1000W AC input 200-240V: DC Output 1600W * Penguin Computing reserves the right to make any changes to the product specifications and product- related information without prior notice. - 13 - Hardware Installation...
Relion 2940 Chassis Manual Chapter 2 System Hardware Installation Pre-installation Instructions Perform the steps below before you open the server or before you remove or replaceany component. • Back up all important system and data files before performing any hardwareconfiguration.
Relion 2940 Chassis Manual System Components Item Decription Power module Power supply board cage PCI Express card Fan duct Memory module System cooling fan Hard drive Hardware Installation - 16 -...
Relion 2940 Chassis Manual Replacing Power Supply Board Cage Cover Before you remove or install the power supply board cage cover • Make sure the system is not turned on or connected to AC power. Follow these instructions to remove the power supply board cage cover: Loosen and remove the screw securing the cover.
Relion 2940 Chassis Manual Replacing the Motherboard Tray Follow these instructions to replace the motherboard tray: Disconnect the power, SATA, front panel, and mainboard cable connectors. Press the retaining clip on the left side of the tray along the direction of the arrow.
Relion 2940 Chassis Manual Removing and Installing the Fan Duct Follow these instructions to remove/install the fan duct: Lift up to remove the fan duct To install the fan duct, align the fan duct with the guiding groove. Push down the fan duct into...
Relion 2940 Chassis Manual Installing the CPU Read the following guidelines before you begin to install the CPU: • Make sure that the motherboard supports the CPU. • Always turn off the computer and unplug the power cord from the power outlet before installing the CPU to prevent hardware damage.
Relion 2940 Chassis Manual Installing the Heat Sink Follow these instructions to install the heat sinks: Apply thermal compound evenly on the top of the CPU. Remove the protective cover from the underside of the heat sink. Place the heat sink(s) on top of the CPU and tighten the four positioning screws.
Relion 2940 Chassis Manual Installing the Memory Read the following guidelines before you begin to install the memory: • Make sure that the motherboard supports the memory. It is recommended that memory of the same capacity, brand, speed, and chips be used.
Relion 2940 Chassis Manual Installing a Memory Before installing a memory module, make sure to turn off the computer and unplug the power cord from the power outlet to prevent damage to the memory module. Be sure to install DDR3 DIMMs on this motherboard.
Relion 2940 Chassis Manual Installing the PCI Expansion Card • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to installing a PCI card.
Relion 2940 Chassis Manual Installing Add-on Card (Optional) • Voltages can be present within the server whenever an AC power source is connected. This voltage is present even when the main power switch is in the off position. Ensure that the system is powered-down and all power sources have been disconnected from the server prior to installing a PCI card.
Relion 2940 Chassis Manual Installing the Hard Disk Drive Read the following guidelines before you begin to install the Hard disk drive: • Take note of the drive tray orientation before sliding it out. • The tray will not fit back into the bay if inserted incorrectly.
Relion 2940 Chassis Manual Replacing the Power Supply CAUTION! • In order to reduce the risk of injury from electric shock, disconnect AC power from the power supply before removing it from the system. Follow these instructions to replace the power supply: Disconnect the three power cables.
Relion 2940 Chassis Manual Chapter 3 System Appearance Front View Decription ID button and LED Power button and LED VGA port USB 3.0 ports HDD bays NOTE! For detail LED description, please see the following section: Front Panel LED and Buttons and Rear System Button and LEDs.
Relion 2940 Chassis Manual Rear View 9 10 11 9 10 11 11 10 11 10 Decription VGA port Serial port Power Button/LED ID button/LED Reset Button NMI button System status LED LAN2 Active/Link LED (top)/ LAN1 Active/Link LED (buttom)
Relion 2940 Chassis Manual Front Panel LED and Buttons Critical Name Color Status Description Event System has power applied to it or ACPI Power button Amber and LED S0 state System is in ACPI S5 state (Power off) Blink System has power applied to it or ACPI...
Relion 2940 Chassis Manual Rear System Button and LEDs Critical Description Name Color Status Event Power button Green Solid On System is powered on and LED • System is not powered on or in ACPI S5 state (power off) •...
Page 34
Relion 2940 Chassis Manual LAN1 Active/ Link between system and network Green Solid On Link LED or no access Blink Data transmission or receiving is occurring No data transmission or receiving is occurring Yellow 1 Gbps data rate 1GbE/ Managemt...
Relion 2940 Chassis Manual Hard Disk Drive LEDs Mode Description Multi-Color LED LED Active LED Active Green Amber Non-RAID Hard disk drive is not present Hard disk drive is present but not active Hard disk drive is present and active...
Relion 2940 Chassis Manual Cable Routing Suggest Cable Suggest Cable Front panel I2C Bus cable Front USB cable Front VGA cable Front panel cable HDD back plane board power cable SATA cable SGPIO cable System fan power cable Mainborad power cable...
Relion 2940 Chassis Manual Chapter 4 Motherboard Components MH70-HD0 Motherboard Components 39 38 Code Description Item VGA_1 Rear VGA port F_VGA1 Front VGA header COM1 Rear serial port COM2 Front serial port header SW_PWR1 Power button/LED SW_ID ID switch button...
Relion 2940 Chassis Manual Chapter 5 BIOS Setup BIOS (Basic Input and Output System) records hardware parameters of the system in the EFI on the motherboard. Its major functions include conducting the Power-On Self-Test (POST) during system startup, saving system parameters and loading operating system, etc. BIOS includes a BIOS Setup program that allows the user to modify basic system configuration settings or to activate certain system features.
Relion 2940 Chassis Manual Main This setup page includes all the items in standard compatible BIOS. Advanced This setup page includes all the items of AMI BIOS special enhanced features. (ex: Auto detect fan and temperature status, automatically configure hard disk parameters.) ...
Relion 2940 Chassis Manual The Main Menu Once you enter the BIOS Setup program, the Main Menu (as shown below) appears on the screen. Use arrow keys to move among the items and press <Enter> to accept or enter other sub-menu.
Page 43
Relion 2940 Chassis Manual BIOS Information Porject Name Display the project name information. Porject Version Display version number of the BIOS setup utility. BIOS Build Date and Time Displays the date and time when the BIOS setup utility was created.
Page 44
Relion 2940 Chassis Manual Onboard LAN Information LAN1/LAN2 MAC Address Display LAN1/LAN2 MAC address information. System Date Set the date following the weekday-month-day- year format. System Time Set the system time following the hour-minute- second format. BIOS Setup - 44 -...
Relion 2940 Chassis Manual Advanced Menu The Advanced menu display submenu options for configuring the function of various hardware components. Select a submenu item, then press Enter to access the related submenu screen. - 45 - BIOS Setup...
Relion 2940 Chassis Manual COM1/COM2/Serial Over LAN Console Redirection Settings Console Redirection (Note) Select whether to enable console redirection for specified device. Console redirection enables users to manage the system from a remote location. Options available: Enabled/Disabled. Default setting is Disabled.
Page 49
Relion 2940 Chassis Manual Legacy OS Redirection Resolution (Note) On Legacy OS, the number of Rows and Columns supported redirection. Options available: 80x24/80X25. Default setting is 80x24. Putty KeyPad (Note) Select function FunctionKey and KeyPad on Putty. Options available: VT100/LINUX/XTERMR6/SCO/ESCN/VT400. Default setting is VT100.
Relion 2940 Chassis Manual 5-2-2 PCI Subsystem Settings PCI Express Slot #1/#2 I/O ROM When enabled, This setting will initialize the device expansion ROM for the related PCI-E slot. Options available: Enabled/Disabled. Default setting is Enabled. Onboard LAN#1/#2 Controller Enable/Disable onboard LAN devices.
Page 51
Relion 2940 Chassis Manual SR-IOV Support If system has SR-IOV capable PCIe Devices, this option enables or disables Single Root IO Virtualization Support. Options available: Enabled/Disabled. Default setting is Disabled. PCI Express Settings Press [Enter] for configuration of advanced items.
Relion 2940 Chassis Manual 5-2-2-1 PCI Express Settings PCI Express Device Register Settings Relaxed Ordering Enable/DIsable PCI Express Device Relaxed Ordering feature. Options available: Enabled/Disabled. Default setting is Extended Tag Disabled. Wnen this feature is enabled, the system will allow device to use 8-bit Tag field as a requester.
Page 53
Relion 2940 Chassis Manual Link Training Timeout (us) Define the number of Microseconds software will wait before polling 'Link Training' bit in Link Status register. Press <+> / <-> keys to increase or decrease the desired values. Value rang is from 10 to 10000 us.
Relion 2940 Chassis Manual 5-2-4 CSM Configuration Compatibility Support Module Configuration CSM Support Enable/Disable Compatibility Support Module (CSM) support. Options available: Enabled/Disabled. Default setting is Enabled. CSM16 Module Version Display CSM Module version information. Gate20 Active Upon Request: GA20 can be disabled using BIOS services.
Page 56
Relion 2940 Chassis Manual Option ROM execution Network Controls the execution UEFI and Legacy PXE OpROM. Options available: Do not launch/UEFI/Legacy. Default setting is Legacy. Storage Controls the execution UEFI and Legacy Storage OpROM. Options available: Do not launch/UEFI/Legacy. Default setting is Legacy.
Relion 2940 Chassis Manual 5-2-6 Trusted Computing Configuration Security Device Support Select Enabled to activate TPM support feature. Options available: Enabled/Disabled. Default setting is Disabled. Current Status Information Display current TPM status information. BIOS Setup - 58 -...
Relion 2940 Chassis Manual 5-2-8 Chipset Configuration Restore on AC Power Loss (Note) Defines the power state to resume to after a system shutdown that is due to an interruption in AC power. When set to Last State, the system will return to the active power state prior to shutdown. When set to Stay Off, the system remains off after power shutdown.
Page 62
Relion 2940 Chassis Manual AMI SIO Driver Version Display the AMI SIO driver version information. Super IO Chip Logical Device(s) Configuration [*Active*] Serial Port 1/2 Press [Enter] for confuguration of advanced items. Serial Port 1 Configuration Use This Device When enabled allows you to configure the serial port 1 settings. When set to Disabled, displays no configuration for the serial port.
Page 63
Relion 2940 Chassis Manual Possible: Configure Serial Port 1 base I/O addressand IRQ. Option available: Use Automatic Settings IO=3F8h; IRQ=4; DMA;/ IO=3F8h; IRQ=3,4,5,7,9,10,11,12; DMA;/ IO=2F8h; IRQ=3,4,5,7,9,10,11,12; DMA;/ IO=3E8h; IRQ=3,4,5,7,9,10,11,12; DMA;/ IO=2E8h; IRQ=3,4,5,7,9,10,11,12; DMA;. Default setting is Use Automatic Settings. Serial Port 2 Configuration Use This Device When enabled allows you to configure the serial port 2 settings.
Relion 2940 Chassis Manual 5-2-10 iSCSI Configuration iSCSI Initiator Name Add an Attempts Press [Enter] for configuration of advanced items. Delete Attempts Press [Enter] for configuration of advanced items. Change Attempt Order Press [Enter] for configuration of advanced items. BIOS Setup...
Relion 2940 Chassis Manual Intel RC Setup Menu Intel RC Setup menu displays submenu options for configuring the function of North Bridge and South Bridge. Select a submenu item, then press Enter to access the related submenu screen. RC Revision Display Intel RC version information.
Page 70
Relion 2940 Chassis Manual CPU Socket 0/1 Configuration Press [Enter] for configuration of advanced items. Cores Enabled (for CPU socket 0/1) Number of Cores to enable. 0 means all cores. 14 Cores is available. Press the numeric keys to adjust desired values.
Relion 2940 Chassis Manual 5-3-2-1 CPU P State Control EIST (P-State) Conventional Intel SpeedStep Technology switches both voltage and frequency in tandem between high and low levels in response to processor load. Options available: Enabled/Disabled. Default setting is Enabled. Turbo Mode When this item is enabled, tje processor will automatically ramp up the clock speed of 1-2 of its processing cores to improve its performance.
Relion 2940 Chassis Manual 5-3-2-2 CPU C State Control Package C State Limit Configure state for the C-State package limit. Options available: C0/C1 state/C2 state/C6(non Retention) state/C6(Retention) state. Default setting is C6(non Retention) state. CPU C3/C6 Report Allows you to determine whether to let the CPU enter C3/C6 mode in system halt state. When enabled, the CPU core frequency and voltage will be reduced during system halt state to decrease power consumption.
Relion 2940 Chassis Manual 5-3-2-3 CPU T State Control ACPI T-States Enable/Disable CPU throttling by OS. Thorttling reduces power comsumption. Options available: Enabled/Disabled. Default setting is Enabled. BIOS Setup - 74 -...
Page 77
Relion 2940 Chassis Manual QPI General Configuration Press [Enter] for configuration of advanced items. QPI Status Press [Enter] to view QPI status. Link Speed Mode Options available: Slow/Fast. Default setting is Fast. Link Frequency Select Options available: 6.4GB/s/8.0GB/s/9.6GB/s/Auto/Auto Limited. Default setting is Auto.
Relion 2940 Chassis Manual 5-3-5 Memory Configuration Integrated Memory Controller (iMC) Enforce POR Enable to enforce POR restrictions for DDR4 frequency and voltage programming. Options available: Enforce POR/Disabled/Enforce Stretch Goals. Default setting is Enforce POR. Memory Frequency Configure memory frequency.
Relion 2940 Chassis Manual 5-3-5-2 Memory Thermal Set Throttling Configure Thermal Throttling Mode. Select OLTT or CLTT mode. Options available: Disabled/OLTT/CLTT. Default setting is CLTT. DIMM Temp Stat Display DIMM Temp Stat. MEMHOT Throttling Mode Options available: Disabled/Output-only/Input-only. Default setting is Input-only.
Page 82
Relion 2940 Chassis Manual 5-3-5-3 Memory Map Socket Interleave Below 4GB Splits the 0-4GB address space between two sockets, so that both sockets get a chunk of local memory below 4GB. Options available: Disabled/Enabled. Default setting is Disabled. Channel Interleaving Options available: Auto/1-way Interleave/2-way Interleave/3-way Interleave/4-way Interleave.
Relion 2940 Chassis Manual 5-3-5-4 Memory RAS Configuration RAS Mode Enable/Disable RAS modes. Enabling Sparing and Mirroring is not supported. When this item is set to enabled, Sparing will be selected. Options available: Disable/Mirror/Lockstep Mode. Default setting is Disabled. Lockstep x4 DIMMs Options available: Auto/Disabled/Enabled.
Relion 2940 Chassis Manual 5-3-6 IIO Configuration IIO Configuration EV DFX Features Set this option to allow DFX Lock Bits to remain clear. Options available: Enabled/Disabled. Default setting is Disabled. IOAT Configuration Press [Enter] for configuration of advanced items. Intel VT for Directed I/O (VT-d) Press [Enter] for configuration of advanced items.
Relion 2940 Chassis Manual 5-3-7 PCH Configuration PCH Configuration PCH Devices Press [Enter] for configuration of advanced items. PCH SATA Configuration Press [Enter] for configuration of advanced items. USB Configuration Press [Enter] for configuration of advanced items. - 87 -...
Page 90
Relion 2940 Chassis Manual When SATA Type is set to IDE PCH SATA Configuration SATA Controller(s) Enable/Disable sSATA controller. Options available: Enabled/Disabled. Default setting is Enabled. Configure sSATA as Coonfigure on chip SATA type. IDE Mode: When set to IDE, the SATA controller disables its RAID and AHCI functions and runs in the IDE emulation mode.
Page 91
Relion 2940 Chassis Manual Support Aggressive Link Power Mana (Note) Enable PCH to aggressively enter link power state. Options available: Enabled/Disabled. Default setting is Enabled. Alternate Device ID on RAID Enable /Disable Alternate Device ID on RAID mode. Options available: Enabled/Disabled. Default setting is Disabled.
Relion 2940 Chassis Manual 5-3-7-2-1 SATA Mode Options When SATA Type is set to IDE/AHCI Mode SATA LED locate When this option is enabled, LED/SGPIO hardware is attached. Options available: Enabled/Disabled. Default setting is Enabled. BIOS Setup - 92 -...
Page 93
Relion 2940 Chassis Manual When SATA Type is set to RAID Mode SATA LED locate When this option is enabled, LED/SGPIO hardware is attached. Options available: Enabled/Disabled. Default setting is Enabled. Intel Rapid Recovery Technology Enable/Disable Intel Rapid Recovery Technology support function.
Relion 2940 Chassis Manual 5-3-7-3 USB Configuration USB Precondition Precondition work on USB host conteoller and root ports for faster enumeration. Options available: Enabled/Disabled. Default setting is Disabled. xHCI Mode Enable/Disable xHCI (USB 3.0) support function. Options available: Smart Auto/Enabled/Disabled. Default setting is Smart Auto.
Relion 2940 Chassis Manual 5-3-9 Server ME Configuration Greneral ME Configuration Operational Firmware Version Display Operational Firmware Version information. Recovery Firmware Version Display Recovery Firmware Version information. ME Firmware Features Display ME Firmware features information. ME Firmware Status #1/#2 Display ME Firmware status information.
Relion 2940 Chassis Manual 5-4-1 System Event Log Enabling/Disabling Options SEL Components Change this to enable or disable all features of System Event Logging during boot. Options available: Enabled/Disabled. Default setting is Enabled. Erasing Settings Erasing SEL Choose options for erasing SEL.
Relion 2940 Chassis Manual 5-4-2 View FRU Information The FRU page is a simple display page for basic system ID information, as well as System product information. Items on this window are non-configurable. BIOS Setup - 104 -...
Relion 2940 Chassis Manual Security Menu The Security menu allows you to safeguard and protect the system from unauthorized use by setting up access passwords. There are two types of passwords that you can set: • Administrator Password Entering this password will allow the user to access and change all settings in the Setup Utility.
Relion 2940 Chassis Manual 5-5-1 Secure Boot menu The Secure Boot Menu is applicable when your device is installed the Windows 8 operatin system. ® Secure Mode Display the System secure mode state. Secure Boot Display the status of Secure Boot.
Relion 2940 Chassis Manual 5-5-1-1 Key Management Default Key Provisioning Force the system to Setup Mode. This will clear all Secure Boot Variables such as Platform Key (PK), Key-exchange Key (KEK), Authorized Signature Database (db), and Forbidden Signaures Database (dbx).
Page 109
Relion 2940 Chassis Manual Append Var to KEK Press [Enter] to load additional KEK from a storage devices for an additional db and dbx management. Authorized Signature Database (DB) Display the status of Authorized Signature Database. Delete DB Press [Enter] to delete the db from your system.
Relion 2940 Chassis Manual Boot Menu The Boot menu allows you to set the drive priority during system boot-up. BIOS setup will display an error message if the legacy drive(s) specified is not bootable. Boot Configuration Setup Prompt Timeout Number of seconds to wait for setup activation key. 65535(0xFFFF) means indefinite waiting."...
Page 111
Relion 2940 Chassis Manual Hard Drive BBS Priorities Press Enter to configure the boot priority. - 111 - BIOS Setup...
Relion 2940 Chassis Manual Save & Exit Menu The Exit menu displays the various options to quit from the BIOS setup. Highlight any of the exit options then press Enter. Save Changes and Exit Saves changes made and close the BIOS setup.
Page 113
Relion 2940 Chassis Manual Boot Override Press Enter to configure the device as the boot-up drive. UEFI: Built-in in EFI Shell Press <Enter> on this item to Launch EFI Shell from filesystem device. - 113 - BIOS Setup...
Relion 2940 Chassis Manual 2-10 BIOS POST Beep code 2-10-1 PEI Beep Codes # of Beeps Description Memory not Installed. Memory was installed twice (InstallPeiMemory routine in PEI Core called twice) Recovery started DXEIPL was not found DXE Core Firmware Volume was not found...
Relion 2940 Chassis Manual 5-10 BIOS Recovery Instruction The system has an embedded recovery technique. In the event that the BIOS becomes corrupt the boot block can be used to restore the BIOS to a working state. To restore your BIOS, please follow the instructions listed...
Need help?
Do you have a question about the Relion 2940 and is the answer not in the manual?
Questions and answers