Supermicro SUPERSERVER 2028GR-TRT User Manual
  1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Server
  5. SuperServer 2028GR-TRT
  6. User manual

Supermicro SUPERSERVER 2028GR-TRT User Manual

Hide thumbs Also See for SUPERSERVER 2028GR-TRT:
Table of Contents

Advertisement

Quick Links

Download this manual
S
S
UPER
ERVER
®
2028GR-TR
2028GR-TRT
2028GR-TRH
2028GR-TRHT
USER'S MANUAL
Revision 1.0a

Advertisement

Table of Contents
loading

Related Manuals for Supermicro SUPERSERVER 2028GR-TRT

Summary of Contents for Supermicro SUPERSERVER 2028GR-TRT

  • Page 1 UPER ERVER ® 2028GR-TR 2028GR-TRT 2028GR-TRH 2028GR-TRHT USER’S MANUAL Revision 1.0a...
  • Page 2 This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.
  • Page 3 If you have any questions, please contact our support team at: support@supermicro.com This manual may be periodically updated without notice. Please check the Supermicro Web site for possible updates to the manual revision level. Warnings Special attention should be given to the following symbols used in this manual.

  • Page 4: Table Of Contents

    System Power ....................1-3 SATA Subsystem ..................... 1-3 Front Control Panel ..................1-3 Cooling System ....................1-3 GPU Subsystem ....................1-3 Contacting Supermicro ..................1-5 Chapter 2 Server Installation Overview ......................2-1 Unpacking the System ..................2-1 Preparing for Setup ..................2-1 Choosing a Setup Location ................
  • Page 5 Preface Checking the Serverboard Setup ..............2-9 Checking the Chassis Setup ................. 2-10 Chapter 3 System Interface ..............3-1 Overview ......................3-1 Control Panel Buttons ..................3-2 Control Panel LEDs ..................3-2 Overheating ..................... 3-3 Drive Carrier LEDs ..................3-4 Power Supply LEDs ..................3-4 Chapter 4 Standardized Warning Statements for AC Systems ....
  • Page 6 UPER ERVER 2028GR-TR/TRT/TRH/TRHT Manual Installing Memory .................... 5-8 Memory Support ....................5-8 Processor/DIMM Population Configurations ..........5-8 Serverboard Details ..................5-10 Connector Definitions ................... 5-13 I/O Connections .................... 5-17 Jumper Settings .................... 5-20 Onboard Indicators ..................5-22 5-10 SATA Ports ....................5-23 5-11 Installing Software ..................

  • Page 7: Chapter 1 Introduction

    Operating systems certified for use with the system are listied on the web site. Note: For your system to work properly, please follow the links below to download all necessary drivers/utilities and the user’s manual for your server. • Supermicro product manuals: http://www.supermicro.com/support/manuals/ • Product drivers and utilities: ftp://ftp.supermicro.com...

  • Page 8: Serverboard Features

    IPMI (Intelligent Platform Management Interface) is a hardware-level interface specification that provides remote access, monitoring and administration for Supermicro server platforms. IPMI allows server administrators to view a server’s hardware status remotely, receive an alarm automatically if a failure occurs, and...

  • Page 9: Server Chassis Features

    GPU Subsystem The 2028GR-TR/TRT/TRH/TRHT server represents one of Supermicro's massively parallel processing multiple GPU/Xeon Phi servers, with support for up to six GPUs/ Xeon Phis. NVIDIA Kepler GPUs place this system at the forefront of today's GPU computing solutions.
  • Page 10 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual #1-8 #2-8 VCCP1 12v #1-7 VCCP0 12v #2-7 #1-6 VR12.5 VR12.5 #2-6 #1-5 5 PHASE 5 PHASE #2-5 145W 145W #1-4 #2-4 #1-3 #2-3 #1-2 #2-2 #1-1 Processor 2 Processor 1 #2-1 9.6G DDR4 DDR4 9.6G DMI2 DMI2 PVCCIO...

  • Page 11: Contacting Supermicro

    Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Web Site: www.supermicro.com Europe Address: Super Micro Computer B.V. Het Sterrenbeeld 28, 5215 ML...
  • Page 12 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Notes...

  • Page 13: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation Overview This chapter provides a quick setup checklist to get your system up and running. This quick setup assumes that your system has come to you with the processors and memory preinstalled. If your system is not already fully integrated with a serverboard, processors, system memory etc., please turn to the chapter or section noted in each step for details on installing specific components.

  • Page 14: Warnings And Precautions

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Warnings and Precautions Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them. • In single rack installation, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.

  • Page 15: Rack Mounting Considerations

    Chapter 2: Server Installation • Use a regulating uninterruptible power supply (UPS) to protect the server from power surges, voltage spikes and to keep your system operating in case of a power failure. • Allow the hot plug SATA drives and power supply modules to cool before touching them.

  • Page 16: Installing The System Into A Rack

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Installing the System into a Rack This section provides information on installing the chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly from the instructions provided. You should also refer to the installation instructions that came with the rack unit you are using.

  • Page 17: Releasing The Inner Rail

    Chapter 2: Server Installation Releasing the Inner Rail Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing. To mount the rail onto the chassis, first release the inner rail from the outer rails. Releasing Inner Rail from the Outer Rails 1.

  • Page 18: Installing The Inner Rails On The Chassis

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Installing the Inner Rails on the Chassis Installing the Inner Rails 1. Identify the left and right inner rails. They are labeled. 2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.

  • Page 19: Installing The Outer Rails Onto The Rack

    Chapter 2: Server Installation Installing the Outer Rails onto the Rack Installing the Outer Rails 1. Press upward on the locking tab at the rear end of the middle rail. 2. Push the middle rail back into the outer rail. 3.

  • Page 20: Sliding The Chassis Onto The Rack Rails

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Sliding the Chassis onto the Rack Rails Warning: Mounting the system into the rack requires at least two people to support the chassis during installation. Please follow safety recommendations printed on the rails. Installing the Chassis into a Rack 1.

  • Page 21: Checking The Serverboard Setup

    Chapter 2: Server Installation Checking the Serverboard Setup After you install the server in the rack, you should open the unit to make sure the serverboard is properly installed and all the connections have been made. Removing the Chassis Cover 1.

  • Page 22: Checking The Chassis Setup

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Checking the Chassis Setup Checking the Drives Next, you should check to make sure the hard drives have been properly installed and all connections have been made. You can add or remove hard drives from the drive carriers without having to remove the top chassis cover.

  • Page 23: Chapter 3 System Interface

    Chapter 3: System Interface Chapter 3 System Interface Overview The chassis includes: • A control panel on the front that houses power buttons and status monitoring lights • Status lights on externally accessible hard drives • Status lights for the power supply visible from the back of the chassis These elements are described in this chapter with possible responses.

  • Page 24: Control Panel Buttons

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Control Panel Buttons The control panel includes two push-buttons. Power: The main power switch is used to apply or remove power from the power supply to the server system. Turning off system power with this button removes the main power but keeps standby power supplied to the system.

  • Page 25: Overheating

    Some backplanes allow the overheat temperature to be set at 45, 50, or 55 by changing a jumper setting. For more information, consult the backplane user manual at www.supermicro.com. (Click Support, then the Manuals link.) Responses If the server overheats: 1.

  • Page 26: Drive Carrier Leds

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual 3. Check the routing of the cables and make sure all fans are present and oper- ating normally. 4. Verify that the heatsinks are installed properly. Drive Carrier LEDs The chassis includes externally accessible SAS/SATA drives. Each drive carrier displays two status LEDs on the front of the carrier.

  • Page 27: Chapter 4 Standardized Warning Statements For Ac Systems

    Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our web site at http://www.supermicro.com/ about/policies/safety_information.cfm. Warning Definition Warning! This warning symbol means danger.
  • Page 28 UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut.
  • Page 29 Chapter 4: Warning Statements for AC Systems ‫جسذٌة‬ ‫اصابة‬ ً‫تتسبب ف‬ ‫حالة ٌوكي أى‬ ً‫اًك ف‬ ‫خطز‬ ًٌ‫ٌع‬ ‫هذا الزهز‬ !‫تحذٌز‬ ‫الذوائز‬ ‫بالوخاطز الٌاجوة عي‬ ‫ي على علن‬ ، ‫ك‬ ‫هعذات‬ ‫تعول على أي‬ ‫قبل أى‬ ‫الكهزبائٍة‬ ‫حىادث‬ ‫أي‬ ‫وقىع‬ ‫وٌع‬...

  • Page 30: Installation Instructions

    UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Installation Instructions Warning! Read the installation instructions before connecting the system to the power source. 設置手順書 システムを電源に接続する前に、 設置手順書をお読み下さい。 警告 将此系统连接电源前,请先阅读安装说明。 警告 將系統與電源連接前，請先閱讀安裝說明。 Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación.

  • Page 31: Circuit Breaker

    Chapter 4: Warning Statements for AC Systems Circuit Breaker Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A. サーキッ ト ・ ブレーカー この製品は、 短絡 （過電流） 保護装置がある建物での設置を前提としています。 保護装置の定格が250 V、...

  • Page 32: Power Disconnection Warning

    UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual 경고! 이 제품은 전원의 단락(과전류)방지에 대해서 전적으로 건물의 관련 설비에 의존합니다. 보호장치의 정격이 반드시 250V(볼트), 20A(암페어)를 초과하지 않도록 해야 합니다. Waarschuwing Dit product is afhankelijk van de kortsluitbeveiliging (overspanning) van uw electrische installatie. Controleer of het beveiligde aparaat niet groter gedimensioneerd is dan 220V, 20A.
  • Page 33 Chapter 4: Warning Statements for AC Systems ¡Advertencia! El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema. Attention Le système doit être débranché...

  • Page 34: Equipment Installation

    UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Equipment Installation Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment. 機器の設置 トレーニングを受け認定された人だけがこの装置の設置、 交換、 またはサービスを許可 されています。 警告 只有经过培训且具有资格的人员才能进行此设备的安装、更换和维修。 警告 只有經過受訓且具資格人員才可安裝、更換與維修此設備。 Warnung Das Installieren, Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem, qualifiziertem Personal gestattet werden.

  • Page 35: Restricted Area

    Chapter 4: Warning Statements for AC Systems Waarschuwing Deze apparatuur mag alleen worden geïnstalleerd, vervangen of hersteld door geschoold en gekwalificeerd personeel. Restricted Area Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security.

  • Page 36: Battery Handling

    UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual ‫אזור עם גישה מוגבלת‬ !‫אזהרה‬ ‫יש להתקין את היחידה באזורים שיש בהם הגבלת גישה. הגישה ניתנת בעזרת‬ .)'‫כלי אבטחה בלבד (מפתח, מנעול וכד‬ ‫محظورة‬ ‫مناطق‬ ٍ‫نتركُبها ف‬ ‫هذه انىحذة‬ ‫تخصيص‬ ‫تم‬ ،‫أداة خاصت‬ ‫من خالل استخذاو‬ ‫فقط‬...
  • Page 37 Chapter 4: Warning Statements for AC Systems Warnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr. Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp. Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers. Attention Danger d'explosion si la pile n'est pas remplacée correctement. Ne la remplacer que par une pile de type semblable ou équivalent, recommandée par le fabricant.

  • Page 38: Redundant Power Supplies

    UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Redundant Power Supplies Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit. 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります。 ユニッ トの電源を切るためには、 すべての接続を取り外さなければなりません。 警告 此部件连接的电源可能不止一个，必须将所有电源断开才能停止给该部件供电。 警告 此裝置連接的電源可能不只一個，必須切斷所有電源才能停止對該裝置的供電。 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle Verbindungen entfernt werden.

  • Page 39: Backplane Voltage

    Chapter 4: Warning Statements for AC Systems ‫امداد الطاقة‬ ‫بوحدات‬ ‫عدة اتصاالت‬ ‫جهاز‬ ‫ال‬ ‫يكون لهذا‬ ‫قد‬ ‫الكهرباء‬ ‫عن‬ ‫وحدة‬ ‫ال‬ ‫لعسل‬ ‫كافة االتصاالت‬ ‫يجب إزالة‬ 경고! 이 장치에는 한 개 이상의 전원 공급 단자가 연결되어 있을 수 있습니다. 이 장치에 전원을...

  • Page 40: Comply With Local And National Electrical Codes

    UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual ‫מתח בפנל האחורי‬ !‫הרה‬ ‫אז‬ ‫קיימת סכנת מתח בפנל האחורי בזמן תפעול המערכת. יש להיזהר במהלך‬ .‫העבודה‬ ‫اللىحة‬ ‫أوالطاقة المىجىدة على‬ ‫التيار الكهزبائي‬ ‫مه‬ ‫خطز‬ ‫هناك‬ ‫هذا الجهاس‬ ‫خدمة‬ ‫كه حذرا عند‬ ‫يعمل‬ ‫النظام‬ ‫عندما يكىن‬ 경고! 시스템이...

  • Page 41: Product Disposal

    Chapter 4: Warning Statements for AC Systems Attention L'équipement doit être installé conformément aux normes électriques nationales et locales. ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ ‫הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫התקנת‬ ‫المتعلقة‬ ‫المحلية والىطىية‬ ‫قىاويه‬ ‫يجب أن يمتثل لل‬ ‫الكهربائية‬...

  • Page 42: Hot Swap Fan Warning

    UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual ¡Advertencia! Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales. Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent.
  • Page 43 Chapter 4: Warning Statements for AC Systems 警告 當您從機架移除風扇裝置，風扇可能仍在轉動。小心不要將手指、螺絲起子和其他 物品太靠近風扇。 Warnung Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt. ¡Advertencia! Los ventiladores podran dar vuelta cuando usted quite ell montaje del ventilador del chasis.

  • Page 44: Power Cable And Ac Adapter

    Electrical Appliance and Material Safety Law prohibits the use of UL or CSA -certified cables (that have UL/CSA shown on the code) for any other electrical devices than products designated by Supermicro only. 電源コードとACアダプター 製品を設置する場合、 提供または指定された接続ケーブル、 電源コードとACアダプター...
  • Page 45 Appareils électroménagers et de loi sur la sécurité Matériel interdit l'utilisation de UL ou CSA câbles certifiés qui ont UL ou CSA indiqué sur le code pour tous les autres appareils électriques que les produits désignés par Supermicro seulement.
  • Page 46 UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Notes 4-20...

  • Page 47: Chapter 5 Advanced Serverboard Setup

    Chapter 5: Advanced Serverboard Setup Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to connect cables and describes all jumpers and connections. A layout and quick reference chart are included in this chapter for your reference. Always close the chassis when you have finished working on the system to maintain optimal cooling.

  • Page 48: Connecting Cables

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Connecting Cables Assuming the X10DRG-H/HT serverboard is installed, the next step is to connect the cables to the board. These include the data (ribbon) cables for the peripherals and control panel and the power cables. Connecting Data Cables The ribbon cables used to transfer data from the peripheral devices have been carefully routed to prevent them from blocking the flow of cooling air that moves through the system from front to back.

  • Page 49: I/O Ports

    Chapter 5: Advanced Serverboard Setup I/O Ports Figure 5-1. I/O Ports IO Ports USB Port 0 LAN Port 2 USB Port 1 VGA Port IPMI Dedicated LAN UID Switch LAN Port 1 For X10DRG-H the LAN ports are 1Gb; for X10DRG-HT the LAN ports are 10Gb.

  • Page 50: Installing The Processor And Heatsink

    • Install the processor into the CPU socket before installing the heatsink. • Refer to the Supermicro web site for updates on CPU support. Installing an LGA 2011 Processor Installing a CPU 1. There are two levers on the LGA 2011 socket.
  • Page 51 Chapter 5: Advanced Serverboard Setup 3. W ith the sec ond lever f ully Open the load plate. retracted, gently push down on the "Open 1st" lever to loosen the load plate. Lift the load plate with your fingers to open it completely. 4.
  • Page 52 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Gently close the load plate. 7. With the "Close 1st" lever fully retracted, gently close the load plate. Push down and lock the lever labeled "Close 1st". 8. Make sure the locking mechanism on the "Close 1st" lever catches the lip of the load plate.

  • Page 53: Installing A Cpu Heatsink

    Chapter 5: Advanced Serverboard Setup Installing a CPU Heatsink 1. Remove power from the system and unplug the AC power cord from the power supply. 2. Do not apply any thermal grease to the heatsink or the CPU die; the required amount has already been applied.

  • Page 54: Installing Memory

    Memory speed support is dependent on the CPUs. For best memory performance, please install memory modules of the same type and same speed. For the latest CPU/memory updates, refer to the Supermicro website. Processor/DIMM Population Configurations For memory to work properly, follow the tables below for memory installation.
  • Page 55 Chapter 5: Advanced Serverboard Setup Processors and their Corresponding Memory Modules CPU# Corresponding DIMM Modules CPU 1 DIMMA1 DIMMB1 DIMMC1 DIMMD1 DIMMA2 DIMMB2 DIMMC2 DIMMD2 CPU2 DIMME1 DIMMF1 DIMMG1 DIMMH1 DIMME2 DIMM F2 DIMMG2 DIMMH2 Processor and Memory Module Population for Optimal Performance Number of CPU and Memory Population Configuration Table CPUs+DIMMs...

  • Page 56: Serverboard Details

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Serverboard Details LAN2 LAN1 USB4/5 (3.0) JWD1 IPMI_LAN BIOS CTRL JOH1 JBT1 CPU1 CLOSE 1st OPEN 1st X10DRG-H Rev. 1.01 BIOS MAC CODE JITP1 LICENSE BAR CODE CPU2 CLOSE 1st FANG OPEN 1st FANF FAN3 FANB FANA FAN4 Figure 5-3.
  • Page 57 Chapter 5: Advanced Serverboard Setup X10DRG-H(T) Jumpers Jumper Description Default Setting JBT1 Clear CMOS See section 5-8 JPB1 BMC Enable Pins 1-2 (Enabled) JPG1 VGA Enable Pins 1-2 (Enabled) JPL1 GLAN1/GLAN2 Enable (X10DRG-H) Pins 1-2 (Enabled) 10_GLAN1/10G_LAN2 Enable (X10DRG-HT) JPME2 Manufacture (ME) Mode Select Pins 1-2 (Normal) JWD1...
  • Page 58 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual UID Switch (BP) USB 4/5 (3.0) Backpanel USB 3.0 Port 4/Port 5 (FP) 2/3 (3.0) Front Accessible USB 3.0 headers 0/1, 2/3 (FP) USB 0/1 (2.0) Front-Accessible USB 2.0 header for two USB connections USB 0/1 Backpanel VGA port X10DRG-H(T) LED Indicators Description...

  • Page 59: Connector Definitions

    Chapter 5: Advanced Serverboard Setup Connector Definitions Power Connectors The X10DRG-H/HT serverboard has one proprietary main power (JPW1) and six 8-pin 12V power connectors (JPW2, JPW3/JPW4/JPW5/JPW6/JPW7). The 8-pin power connector located at JPW2 is used to supply power to the serverboard, and the other five 8-pin power connectors located at JPW3-JPW7 are used for HDD backplane and GPU add-on cards.
  • Page 60 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Ground x (Key) x (Key) Power On LED 3.3V HDD LED FP UID/3.3V Stby NIC1 LED (Link) NIC1 LED (Activity) NIC2 LED (Link) NIC2 LED (Activity) OH/Fan Fail/PWR Fail/UID LED Blue LED (UID Cathode) PWR Fail LED 3.3V Ground Reset (Button)
  • Page 61 Chapter 5: Advanced Serverboard Setup NIC2 (LAN2) LED NIC2 LED Pin Definitions The LED connections for LAN2 are on pins (JF1) 9 and 10 of JF1. Attach an LED cable to Pin# Definition display network activity. See the table on Activity LED the right for pin definitions.
  • Page 62 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Fan Headers The serverboard has twelve fan headers. Fan Header Pin Definitions Fans 1~4 are for CPU/system use and Pin# Definition Fans A~H for GPU use.. All are 4-pin fan Ground headers, which are backward compatible with traditional 3-pin fans.

  • Page 63: I/O Connections

    Chapter 5: Advanced Serverboard Setup Standby Power Header Standby PWR Pin Definitions The +5V Standby Power header is located Pin# Definition at JSTBY1 on the motherboard. See the table on the right for pin definitions. (You +5V Standby must also have a card with a Standby Ground Power connector and a cable to use this No Connection...
  • Page 64 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Universal Serial Bus (USB) Front Panel USB 0/1, 2/3 Pin Definition Two USB 3.0 ports (USB 4/5) are located Pin# Definition Pin# Definitions on the I/O rear I/O shield. In addition, two internal USB headers, provide four USB_PN2 USB_PN3 USB 3.0 connections (USB 0/1, USB 2/3)
  • Page 65 Blue: On Unit Identified Note: the UID can also be triggered via IPMI. Refer to the IPMI User's Guide on the Supermicro website. Rear UID LED UID LED Status The rear UID LED is located at LE4 on the backplane.

  • Page 66: Jumper Settings

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Jumper Settings Explanation of Jumpers To modify the operation of the serverboard, jumpers can be used Connector to choose between optional settings. Pins Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with Jumper a square solder pad on the printed circuit board.
  • Page 67 Chapter 5: Advanced Serverboard Setup VGA Enable/Disable VGA Enable/Disable Jumper Settings JPG1 allows you to enable or disable the Jumper Setting VGA port. The default position is on pins Definition 1 and 2 to enable VGA. See the table on Pins 1-2 Enabled the right for jumper settings.

  • Page 68: Onboard Indicators

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Onboard Indicators LAN 1/2 Link LED Activity LED LAN1/2 Port LEDs The Ethernet ports have two LEDs. On each port, one LED indicates activity GLAN Activity Indicator (Left) LED Settings and teh other indicates the speed of the Color Status Definition...

  • Page 69: 5-10 Sata Ports

    Chapter 5: Advanced Serverboard Setup 5-10 SATA Ports SATA Port Pin Definitions SATA Ports Pin # Definition There are ten SATA 3.0 (I-SATA 0-5 & Ground S-SATA0-3) on the motherboard. I-SATA SATA_TXP ports are supported by the Intel PCH SATA_TXN C612, and S-SATA ports are supported by Ground the Intel SCU chip.

  • Page 70: 5-11 Installing Software

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual 5-11 Installing Software The Supermicro ftp site contains drivers and utilities for your system at ftp://ftp. supermicro.com. Some of these must be installed, such as the chipset driver. After accessing the ftp site, go into the CDR_Images directory and locate the ISO file for your serverboard.

  • Page 71: Superdoctor ® 5

    Chapter 5: Advanced Serverboard Setup SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface in Windows and Linux operating systems. The program monitors system health information such as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

  • Page 72: 5-12 Onboard Battery

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT User's Manual 5-12 Onboard Battery Care must be taken to assure that the chassis cover is in place when the system is operating to ensure proper cooling. Out of warranty damage to the system can occur if this practice is not strictly followed. Figure 5-8.

  • Page 73: Chapter 6 Advanced Chassis Setup

    Chapter 6: Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform mainte- nance on the SC218GHTS-R2K03BP chassis. The only tool required is a Phillips screwdriver. Your system may require the installation of processors, memory, drives or expan- sion cards.

  • Page 74: Static-Sensitive Devices

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Static-Sensitive Devices Electrostatic Discharge (ESD) can damage electronic com ponents. To prevent dam- age to any printed circuit boards (PCBs), it is important to handle them very carefully. The following measures are generally sufficient to protect your equipment from ESD damage.

  • Page 75: Installing Drives

    Chapter 6: Advanced Chassis Setup Installing Drives Drive bays are accessible from the front of the chassis without removing the chas- sis cover or powering down the system. The hard disk drives are mounted in drive carriers to simplify their installation and removal from the chassis. These carriers also help promote proper airflow for the drive bays.
  • Page 76 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Dummy Drive Hard Drive Carrier Figure 6-3. Removing a Dummy Drive from the Drive Carrier Installing a Hard Drive into a Drive Carrier 1. Remove the four screws securing the dummy drive to the hard drive carrier. 2.
  • Page 77 Caution: Except for short periods of time (swapping hard drives), do not operate the server with the hard drive carriers removed. Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro Web site...

  • Page 78: Installing Graphics (Gpu) Cards

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Installing Graphics (GPU) Cards The chassis supports up to six GPU cards, which are mounted in brackets to fit into the PCI-Express slots at the front of the chassis. NVIDIA Kepler K10/K20/K40 GPUs are supported. The GPU cards may be preinstalled, the procedure below is provided if a GPU card must be replaced.
  • Page 79 Chapter 6: Advanced Chassis Setup Airflow Side Screws Left Side GPU Bracket and Cards Side Screws Right Side GPU Bracket and Cards Figure 6-6. Installing the Left and Right GPU Brackets into the Chassis Important Note for Kepler GPUs: Note the airflow arrows on top of the GPU card. The card with the arrow pointing toward the Tesla logo, right to left airflow, should go on the left side of the chassis, and the card with the arrow pointing away from the Tesla logo, left to right airflow, should go on the right side of the chassis (when...

  • Page 80: Expansion Card Setup

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Expansion Card Setup The system supports the following PCI-Express expansion cards and an expansion card bracket: Cards up to 10.5" in length are supported. • Four PCIe 3.0 x16 (2028GR-TR/TRT), or six PCIe 3.0 x16 (2028GR-TRH/ TRHT) •...
  • Page 81 Chapter 6: Advanced Chassis Setup Figure 6-9. Installing Expansion Cards into the Expansion Card Bracket Figure 6-10. Installing the Expansion Card Bracket into the Chassis...
  • Page 82 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Figure 6-11. Installing a Low-Profile Expansion Card Installing a Low-Profile Expansion Card 1. Disconnect the chassis from any power source. 2. Remove the screws securing the PCI slot cover and slide the cover sideways to remove it. 3.

  • Page 83: System Cooling

    Chapter 6: Advanced Chassis Setup System Cooling Five 8-cm fans provide the cooling for the system. It is very important that the chas- sis top cover is properly installed and making a good seal in order for the cooling air to circulate properly through the chassis and cool the components. System Fan Failure Fan speed is controlled by system temperature by means of an IPMI setting.
  • Page 84 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Replacing a System Fan 1. Remove the chassis cover. If necessary to determine which fan has failed, keep the power on. Then power-down the system and disconnect the chassis power cord. 2. Remove the screws securing the fan housing to the floor of the chassis. See the illustrations below to determine the location of the screws for the fan that is being removed.
  • Page 85 Chapter 6: Advanced Chassis Setup 3. Lift the fan housing up and out of the chassis. 4. Disconnect the fan cable. 5. Examine the drawings below, then disassemble the fan housing by removing the front and rear fan guards (A). 6.

  • Page 86: Installing The Air Shroud

    SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Installing the Air Shroud Air shrouds concentrate airflow to maximize fan efficiency. The serverboard air shroud does not require screws for installation. Each GPU card has its own air shroud. Installing the Serverboard Air Shroud 1.

  • Page 87: Power Supply

    The failed power module can be replaced without powering-down the system. Replace with the same model. Replacement modules can be ordered directly from Supermicro. An amber light on the power supply is illuminated when the power is switched off.
  • Page 88 SUPERSERVER 2028GR-TR/TRT/TRH/TRHT Series User's Manual Notes 6-16...

  • Page 89: Chapter 7 Bios

    When an option is selected in the left frame, it is highlighted in white. Often a text message will accompany it. Note: the AMI BIOS has default text messages built in. Supermicro retains the option to include, omit, or change any of these text messages.

  • Page 90: How To Start The Setup Utility

    Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you have to update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.
  • Page 91 Note: The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00. Supermicro X10DRG BIOS Version: This item displays the version of the BIOS ROM used in the system. Build Date: This item displays the date when the version of the BIOS ROM used in the system was built.

  • Page 92: Advanced Setup Configurations

    SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Advanced Setup Configurations Use the arrow keys to select Advanced setup and press <Enter> to access the submenu items: Caution: Take Caution when changing the Advanced settings. An incorrect value, a very high DRAM frequency or an incorrect BIOS timing setting may cause the system to malfunction.
  • Page 93 Chapter 7: AMI BIOS Wait For 'F1' If Error Select Enabled to force the system to wait until the 'F1' key is pressed if an error occurs. The options are Disabled and Enabled. INT19 (Interrupt 19) Trap Response Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Immediate, the ROM BIOS of the host adaptors will "capture"...
  • Page 94 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual CPU Configuration  This submenu displays the following CPU information as detected by the BIOS. It also allows the user to configure CPU settings. • Processor Socket • Processor ID • Processor Frequency • Processor Max Ratio •...
  • Page 95 Chapter 7: AMI BIOS codes to overwhelm the processor to damage the system during an attack. This feature is used in conjunction with the items: "Clear MCA," "VMX," "Enable SMX," and "Lock Chipset" for Virtualization media support. The options are Enable and Disable.
  • Page 96 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual AES-NI Select Enable to use the Intel Advanced Encryption Standard (AES) New Instruc- tions (NI) to ensure data security. The options are Enable and Disable. Intel Virtualization Technology Select Enable to use Intel Virtualization Technology support for Direct I/O VT-d sup- port by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables.
  • Page 97 Chapter 7: AMI BIOS No PCIe Port Active ECO This item provides a workaround solution when there is no PCIe port active. The options are Reset the SQ FLOP by CSR Option and PCU Squelch Exit Ignore Option. Socket 0 PCIED00F0 Port 0/DMI This submenu allows the user to configure the settings for the following PCI-E prots: 0, 1A, 1B, 2A, 2B, 2C, 2D, 3A, 3B, 3C, and 3D.
  • Page 98 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Corr Err Over (Correctable Error Overwrite) This item configures the option to overwrite correctable errors for ECC memory. The options are Disable and Enable. L0s Support This item configures the option to enable support for the L0s PCI-E link state (non supported in this motherboard).
  • Page 99 Chapter 7: AMI BIOS QPI (Quick Path Interconnect) Configuration QPI General Configuration QPI Status The following information will display: • Number of CPU • Number of IIO • Current QPI Link Speed • Current QPI Link Frequency • QPI Global MMIO Low Base/Limit •...
  • Page 100 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Memory Configuration Enforce POR Select Enable to enforce POR restrictions on memory frequency and voltage programming. The options are Enabled and Disabled. Memory Frequency Use this feature to set the maximum memory frequency for onboard memory modules.
  • Page 101 Chapter 7: AMI BIOS RAS Mode When Disable is selected, RAS is not supported. When Mirror is selected, the motherboard maintains two identical copies of all data in memory for data backup. When Lockstep is selected, the motherboard uses two areas of memory to run the same set of operations in parallel to boost performance.
  • Page 102 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Legacy USB Support Select Enabled to support onboard legacy USB devices. Select Auto to disable legacy support if there are no legacy USB devices present. Select Disable to have all USB devices available for EFI applications only. The options are Enabled, Disabled, and Auto.
  • Page 103 Chapter 7: AMI BIOS SATA Configuration  When this submenu is selected, AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the fol- lowing items: SATA Controller This item enables or disables the onboard SATA controller supported by the Intel PCH chip.
  • Page 104 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual *If the item above "Configure SATA as" is set to IDE, the following items will display: Serial ATA Port 0 ~ Port 5 This item indicates that a SATA port specified by the user is installed (present) or not.
  • Page 105 Chapter 7: AMI BIOS Port 0 ~ Port 5 Spin Up Device On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRE- SET initialization to the device. The options are Enabled and Disabled. Port 0 ~ Port 5 SATA Device Type Use this item to specify if the SATA port specified by the user should be con- nected to a Solid State drive or a Hard Disk Drive.
  • Page 106 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual sSATA Port 0 ~ Port 3 Spin Up Device On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRE- SET initialization to the device. The options are Enabled and Disabled. Port 0 ~ Port 3 sSATA Device Type Use this item to specify if the sSATA port specified by the user should be con- nected to a Solid State drive or a Hard Disk Drive.
  • Page 107 Chapter 7: AMI BIOS • Model number of drive and capacity • Software Preserve Support sSATA Port 0 ~ Port 3 Select Enabled to enable an sSATA port specified by the user. The options are Disabled and Enabled. sSATA Port 0 ~ Port 3 Spin Up Device On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRE- SET initialization to the device.
  • Page 108 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual PCIe/PCI/PnP Configuration PCI Devices Common Settings PCI Latency Timer Select Enabled to set the latency timer for PCI. The options are 32 PCI Bus Clocks, 64 PCI Bus Clocks, 96 PCI Bus Clocks, 128 PCI Bus Clocks, 160 PCI Bus Clocks, 192 PCI Bus Clocks, 224 PCI Bus Clocks, and 248 PCI Bus Clocks.
  • Page 109 Chapter 7: AMI BIOS ASPM Support Use this item to set the Active State Power Management (ASPM) level for a PCI-E device. Select Auto for the system BIOS to automatically set the ASPM level based on the system configuration. Select Disabled to disable ASPM support. The options are Disabled and Auto.
  • Page 110 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual VGA Priority Use this item to select the graphics device to be used as the primary video display for system boot. The options are Onboard and Offboard. Onboard LAN Option ROM Type Select Legacy to boot the computer using a Legacy device installed on the moth- erboard.
  • Page 111 Chapter 7: AMI BIOS Serial Port 2 Attribute Select SOL to use COM Port 2 as a Serial_Over_LAN (SOL) port for console redi- rection. The options are COM and SOL. Serial Port Console Redirection  COM 1 COM 1 Console Redirection Select Enabled to enable COM Port 1 Console Redirection, which will allow a client machine to be connected to a host machine at a remote site for networking.
  • Page 112 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark, and Space. Stop Bits A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication.
  • Page 113 Chapter 7: AMI BIOS SOL/COM2 Console Redirection SOL/COM2 Console Redirection Select Enabled to use the SOL/COM2 port for Console Redirection. The options are Enabled and Disabled. *If the item above set to Enabled, the following items will become available for user's configuration: SOL/COM2 Console Redirection Settings Use this feature to specify how the host computer will exchange data with the client...
  • Page 114 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Flow Control Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty.
  • Page 115 Chapter 7: AMI BIOS Serial Port for Out-of-Band Management / Windows Emergency Management Services (EMS) The submenu allows the user to configure Console Redirection settings to support Out-of-Band Serial Port management. Console Redirection Select Enabled to use a COM port selected by the user for EMS Console Redi- rection.
  • Page 116 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual The setting for each of the following features is displayed: Data Bits, Parity, Stop Bits Trusted Computing (Available when a TPM device is installed and detected by the BIOS) Configuration Security Device Support If this feature and the TPM jumper on the motherboard are both set to Enabled, onboard security devices will be enabled for TPM (Trusted Platform Module) sup- port to enhance data integrity and network security.
  • Page 117 Chapter 7: AMI BIOS pendency on other timestamp calculation devices, such as an x86 RDTSC Instruc- tion embedded in the CPU. The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer. The options are Enabled and Disabled. NUMA (Available when the OS supports this feature) Select Enabled to enable Non-Uniform Memory Access support to enhance system performance.

  • Page 118: Event Logs

    SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Event Logs Use this feature to configure Event Log settings. Change SMBIOS Event Log Settings  This feature allows the user to configure SMBIOS Event settings. Enabling/Disabling Options SMBIOS Event Log Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot.
  • Page 119 Chapter 7: AMI BIOS Memory Correctable Error Threshold Use this item to enter the threshold value for correctable memory errors. The default setting is 10. Erasing Settings Erase Event Log Select Enabled to erase all error events in the SMBIOS (System Management BIOS) log before an event logging is initialized at bootup.

  • Page 120: Ipmi

    SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual IPMI Use this feature to configure Intelligent Platform Management Interface (IPMI) settings. IPMI Firmware Revision This item indicates the IPMI firmware revision used in your system. Status of BMC This item indicates the status of the onboard BMC (Baseboard Management Con- troller).
  • Page 121 Chapter 7: AMI BIOS When SEL is Full This feature allows the user to determine what the AMI BIOS should do when the system event log is full. Select Erase Immediately to erase all events in the log when the system event log is full. The options are Do Nothing and Erase Immediately. Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.

  • Page 122: Security Settings

    SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Security Settings This menu allows the user to configure the following security settings for the system. Administrator Password Use this feature to set the administrator password which is required before the user entering the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long.

  • Page 123: Boot Settings

    Chapter 7: AMI BIOS Boot Settings Use this feature to configure Boot Settings: Boot Configuration Boot Mode Select Use this item to select the type of device to be used for system boot. The options are Legacy, UEFI, and Dual. Fixed Boot Order Priorities This option prioritizes the order of bootable devices from which the system will boot.
  • Page 124 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual • Dual Boot Order #9 • Dual Boot Order #10 • Dual Boot Order #11 • Dual Boot Order #12 • Dual Boot Order #13 • Dual Boot Order #14 • Dual Boot Order #15  Add New Boot Option Use this item to select a new boot device to add to the boot priority list.
  • Page 125 Chapter 7: AMI BIOS • Boot Order #2  Network Drive BBS Priorities • Boot Order #1  UEFI Application Boot Priorities • UEFI Boot Order #1 7-37...

  • Page 126: Save & Exit

    SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Save & Exit Select the Save & Exit tab from the BIOS setup screen to configure the settings below. Discard Changes and Exit Select this option to quit the BIOS setup without making any permanent changes to the system configuration, and reboot the computer.
  • Page 127 Chapter 7: AMI BIOS Restore Optimized Defaults To set this feature, select Restore Optimized Defaults from the Exit menu and press <Enter>. These are manufacture default settings designed for maximum system performance but not for maximum stability. Save as User Defaults To set this feature, select Save as User Defaults from the Exit menu and press <En- ter>.
  • Page 128 SuperServer 2028GR-TR/TRT/TRH/TRHT User’s Manual Notes 7-40...

  • Page 129: Appendix A Bios Error Beep Codes

    Appendix A: BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the POST (Power-On Self-Test) routines, which are performed at each system boot, errors may occur. Non-fatal errors are those which, in most cases, allow the system to continue to boot.
  • Page 130 UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Notes...

  • Page 131: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Processors Two Intel E5-2600 v3/v4 series processors in LGA 2011 sockets Note: Please refer to our web site for a complete listing of supported processors. Chipset Intel PCH C612 BIOS 128Mb SPI Flash EEPROM with AMI® BIOS Memory Capacity Sixteen DIMM sockets supporting up to 2 TB of 288-pin Registered (RDIMM)/ Load Reduced (LRDIMM) DDR4 ECC 2400/2133/1866/1600 MHz...
  • Page 132 UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Serverboard X10DRG-H/HT (proprietary ATX form factor) Dimensions: 19.8" (L) x 9.2" (W) (503 mm x 234 mm) Chassis SC218GHTS-R2K03BP (2U rackmount) Dimensions: (WxHxD) 17.2 x 3.5 x 30.5 in. (437 x 89 x 775 mm) System Cooling Five sets of 8-cm fans (fan speed controlled by IPMI) System Input Requirements...
  • Page 133 See www.dtsc.ca.gov/hazardouswaste/perchlorate” (continued from front) The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency com- munication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage.
  • Page 134 UPER ERVER 2028GR-TR/TRT/TRH/TRHT User's Manual Notes...

This manual is also suitable for:

Superserver 2028gr-trSuperserver 2028gr-trhSuperserver 2028gr-trht

Table of Contents