Supermicro SuperServer 1028GR-TR User Manual
  1. Manuals
  2. Brands
  3. Supermicro Manuals
  4. Server
  5. SuperServer 1028GR-TR
  6. User manual

Supermicro SuperServer 1028GR-TR User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
S
S
UPER
ERVER
®
1028GR-TR
1028GR-TRT
2
1
USER'S MANUAL
Revision 1.0b

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SuperServer 1028GR-TR and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Supermicro SuperServer 1028GR-TR

Summary of Contents for Supermicro SuperServer 1028GR-TR

  • Page 1 UPER ERVER ® 1028GR-TR 1028GR-TRT USER’S MANUAL Revision 1.0b...
  • Page 2 This product, including software and documentation, is the property of Supermicro and/or its licensors, and is supplied only under a license. Any use or reproduction of this product is not allowed, except as expressly permitted by the terms of said license.
  • Page 3 About this Manual This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the SuperServer 1028GR-TR(T). Installation and maintenance should be performed by experienced technicians only. Please refer to the server specifications page on our Web site for updates on supported memory, processors and operating systems (http://www.supermicro.

  • Page 4: Table Of Contents

    SuperServer 1028GR-TR(T) User Manual Contents Chapter 1 Introduction Overview ......................1-1 Serverboard Features ..................1-2 Processors ...................... 1-2 Memory ......................1-2 Serial ATA ....................... 1-2 PCI Expansion Slots ..................1-2 Input/Output Ports ................... 1-2 IPMI ......................... 1-2 Server Chassis Features ................1-3 System Power ....................
  • Page 5 Contents Chapter 3 System Interface Overview ......................3-1 Control Panel Buttons ..................3-2 Control Panel LEDs ..................3-2 Overheating ..................... 3-3 Overheat Temperature Setting ..............3-3 Responses ....................3-3 Drive Carrier LEDs ..................3-4 Power Supply LEDs ..................3-4 Chapter 4 Standardized Warning Statements for AC Systems About Standardized Warning Statements ............
  • Page 6 SuperServer 1028GR-TR(T) User Manual Installing Memory .................... 5-8 Memory Support ....................5-8 Processor/DIMM Population Configurations ..........5-8 Serverboard Details ..................5-10 Connector Definitions ................... 5-13 I/O Connections .................... 5-17 Jumper Settings .................... 5-20 Onboard Indicators ..................5-22 5-10 SATA Ports ....................5-23 5-11 Installing Software ..................

  • Page 7: Chapter 1 Introduction

    Chapter 1 Introduction Overview The SuperServer 1028GR-TR(T) series is a high-end GPU server comprised of two main subsystems: an SC118GH-R1K66B 1U server chassis and the X10DRG-H/HT dual processor serverboard. The 1028GR-TR offers 1Gb LAN connections and the 1028GR-TRT offers 10Gb. Refer to our web site for information on operating systems that have been certified for use with the system (www.supermicro.com).

  • Page 8: Serverboard Features

    IPMI (Intelligent Platform Management Interface) is a hardware-level interface specification that provides remote access, monitoring and administration for Supermicro server platforms. IPMI allows server administrators to view a server’s hardware status remotely, receive an alarm automatically if a failure occurs, and...

  • Page 9: Server Chassis Features

    All chassis and power supply fans operate continuously. GPU Subsystem The 1028GR-TR(T) server represents one of Supermicro's massively parallel processing multiple-GPU/Xeon Phi servers, with support for up to three GPU/Xeon Phi cards. It supports all NVIDIA K10, K20, K40, K80 GPUs and Intel Xeon Phi cards, placing this system at the forefront of today's GPU computing solutions.
  • Page 10 SUPERSERVER 1028GR-TR/TRT User's Manual #1-8 #2-8 VCCP1 12v #1-7 VCCP0 12v #2-7 #1-6 VR12.5 VR12.5 #2-6 #1-5 5 PHASE 5 PHASE #2-5 145W 145W #1-4 #2-4 #1-3 #2-3 #1-2 #2-2 #1-1 Processor 2 Processor 1 #2-1 9.6G DDR4 DDR4 9.6G...

  • Page 11: Contacting Supermicro

    Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Web Site: www.supermicro.com Europe Address: Super Micro Computer B.V. Het Sterrenbeeld 28, 5215 ML...
  • Page 12 SUPERSERVER 1028GR-TR/TRT User's Manual Notes...

  • Page 13: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation Overview This chapter provides a quick setup checklist to get your system up and running. This quick setup assumes that your system has come to you with the processors and memory preinstalled. If your system is not already fully integrated with a serverboard, processors, system memory etc., please turn to the chapter or section noted in each step for details on installing specific components.

  • Page 14: Warnings And Precautions

    SUPERSERVER 1028GR-TRT/TR User's Manual Warnings and Precautions Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them. • In single rack installation, stabilizers should be attached to the rack. In multiple rack installations, the racks should be coupled together.

  • Page 15: Rack Mounting Considerations

    Chapter 2: Server Installation Rack Mounting Considerations Ambient Operating Temperature If installed in a closed or multi-unit rack assembly, the ambient operating temperature of the rack environment may be greater than the ambient temperature of the room. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer’s maximum rated ambient temperature (Tmra).

  • Page 16: Installing The System Into A Rack

    SUPERSERVER 1028GR-TRT/TR User's Manual Installing the System into a Rack This section provides information on installing the chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure differs slightly. You should also refer to the installation instructions that came with the rack unit you are using.

  • Page 17: Installing The Optional Inner Rail Extensions

    Chapter 2: Server Installation Installing the Optional Inner Rail Extensions Attaching the optional inner rail extensions allows you to pull the server farther out of the rack. Do not put downward force on the chassis when it is fully extended. Installing the Inner Rail Extensions 1.

  • Page 18: Assembling The Outer Rails

    SUPERSERVER 1028GR-TRT/TR User's Manual Assembling the Outer Rails Each outer rail comes in two sections that must be assembled before mounting onto the rack. Assembling the Outer Rails 1. Identify the left and right outer rails by examining the ends, which bend outward. Match the left front outer rail with the left rear outer rail and the same for the right rails.

  • Page 19: Installing The Outer Rails Onto The Rack

    Chapter 2: Server Installation Installing the Outer Rails onto the Rack Each end of the assembled outer rail includes a bracket with square pegs to fit into your rack holes. If you have an older rack with round holes, these brackets must be removed, and you must use screws to secure the rail to the rack.

  • Page 20: Installing And Removing The Chassis From A Rack

    SUPERSERVER 1028GR-TRT/TR User's Manual Installing and Removing the Chassis From a Rack Installation into a Rack 1. Slide the inner rail extensions into the front of the outer rails. 2. Push the chassis backward into the rack until it clicks into the locked postion. Removing the Chassis From a Rack Press the outer rail latch to release the chassis.

  • Page 21: Installing The Server Into A Telco Rack

    Chapter 2: Server Installation Installing the Server into a Telco Rack Optional brackets are needed to install the server to a telco (open type) rack. To install the server into a Telco type rack, use the two L-shaped brackets on either side of the chassis (four total).
  • Page 22 SUPERSERVER 1028GR-TRT/TR User's Manual Notes 2-10...

  • Page 23: Chapter 3 System Interface

    Chapter 3: System Interface Chapter 3 System Interface Overview The chassis includes: • A control panel on the front that houses power buttons and status monitoring lights • Status lights on externally accessible hard drives • Status lights for the power supply visible from the back of the chassis These elements are described in this chapter with possible responses.

  • Page 24: Control Panel Buttons

    SUPERSERVER 1028GR-TR/TRT User's Manual Control Panel Buttons The chassis includes two push-buttons. UID: The reset button is used to reboot the system. Power: The main power switch is used to apply or remove power from the power supply to the server system. Turning off system power with this button removes the main power but keeps standby power supplied to the system.

  • Page 25: Overheating

    Some backplanes allow the overheat temperature to be set at 45, 50, or 55 by changing a jumper setting. For more information, consult the backplane user manual at www.supermicro.com. (Click Support, then the Manuals link.) Responses If the server overheats: 1.

  • Page 26: Drive Carrier Leds

    SUPERSERVER 1028GR-TR/TRT User's Manual Drive Carrier LEDs The chassis includes externally accessible SAS/SATA drives. Each drive carrier displays two status LEDs on the front of the carrier. • Green: When illuminated, this LED indicates drive activity. It blinks on and off when that particular drive is being accessed This function is controlled by the backplane.

  • Page 27: Chapter 4 Standardized Warning Statements For Ac Systems

    The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components.
  • Page 28 UPER ERVER 2028GR-TR/TRT User's Manual Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut.
  • Page 29 Chapter 4: Warning Statements for AC Systems . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬ ٍ...

  • Page 30: Installation Instructions

    UPER ERVER 2028GR-TR/TRT User's Manual Installation Instructions Warning! Read the installation instructions before connecting the system to the power source. 設置手順書 システムを電源に接続する前に、 設置手順書をお読み下さい。 警告 将此系统连接电源前,请先阅读安装说明。 警告 將系統與電源連接前，請先閱讀安裝說明。 Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación.

  • Page 31: Circuit Breaker

    Chapter 4: Warning Statements for AC Systems Circuit Breaker Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A. サーキッ ト ・ ブレーカー この製品は、 短絡 （過電流） 保護装置がある建物での設置を前提としています。 保護装置の定格が250 V、...

  • Page 32: Power Disconnection Warning

    UPER ERVER 2028GR-TR/TRT User's Manual ‫هذا املنتج يعتمد عىل معداث الحاميت مه الدوائ ر القصرية التي تم تثبيتها يف‬ ‫املبنى‬ 20A, 250V : ‫تأكد من أن تقييم الجهاز الوقايئ ليس أكرث من‬ 경고! 이 제품은 전원의 단락(과전류)방지에 대해서 전적으로 건물의 관련 설비에 의존합니다.
  • Page 33 Chapter 4: Warning Statements for AC Systems ¡Advertencia! El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema. Attention Le système doit être débranché...

  • Page 34: Equipment Installation

    UPER ERVER 2028GR-TR/TRT User's Manual Equipment Installation Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment. 機器の設置 トレーニングを受け認定された人だけがこの装置の設置、 交換、 またはサービスを許可 されています。 警告 只有经过培训且具有资格的人员才能进行此设备的安装、更换和维修。 警告 只有經過受訓且具資格人員才可安裝、更換與維修此設備。 Warnung Das Installieren, Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem, qualifiziertem Personal gestattet werden.

  • Page 35: Restricted Area

    Chapter 4: Warning Statements for AC Systems Waarschuwing Deze apparatuur mag alleen worden geïnstalleerd, vervangen of hersteld door geschoold en gekwalificeerd personeel. Restricted Area Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security.

  • Page 36: Battery Handling

    UPER ERVER 2028GR-TR/TRT User's Manual ‫אזור עם גישה מוגבלת‬ !‫אזהרה‬ ‫יש להתקין את היחידה באזורים שיש בהם הגבלת גישה. הגישה ניתנת בעזרת‬ (.‫'כלי אבטחה בלבד (מפתח, מנעול וכד‬ . ‫تخصيص هذه انىحذة نترك ب ُها ف مناطق محظورة تم‬ ‫، م َ كن انىصىل إن منطقت محظورة فقط من خالل استخذاو أداة خاصت‬ ‫أو...
  • Page 37 Chapter 4: Warning Statements for AC Systems Warnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr. Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp. Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers. Attention Danger d'explosion si la pile n'est pas remplacée correctement. Ne la remplacer que par une pile de type semblable ou équivalent, recommandée par le fabricant.

  • Page 38: Redundant Power Supplies (If Applicable To Your System)

    UPER ERVER 2028GR-TR/TRT User's Manual Redundant Power Supplies Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit. 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります。 ユニッ トの電源を切るためには、 すべての接続を取り外さなければなりません。 警告 此部件连接的电源可能不止一个，必须将所有电源断开才能停止给该部件供电。 警告 此裝置連接的電源可能不只一個，必須切斷所有電源才能停止對該裝置的供電。 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle Verbindungen entfernt werden.

  • Page 39: Backplane Voltage (If Applicable To Your System)

    Chapter 4: Warning Statements for AC Systems . ‫قد يكون لهذا الجهاز عدة اتصاالت بوحدات امداد الطاقة‬ ‫يجب إ ز الة كافة االتصاالت لعسل الوحدة عن الكهرباء‬ 경고! 이 장치에는 한 개 이상의 전원 공급 단자가 연결되어 있을 수 있습니다. 이 장치에 전원을...

  • Page 40: Comply With Local And National Electrical Codes

    UPER ERVER 2028GR-TR/TRT User's Manual ‫מתח בפנל האחורי‬ !‫אזהרה‬ ‫קיימת סכנת מתח בפנל האחורי בזמן תפעול המערכת. יש להיזהר במהלך‬ .‫העבודה‬ ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이...

  • Page 41: Product Disposal

    Chapter 4: Warning Statements for AC Systems Attention L'équipement doit être installé conformément aux normes électriques nationales et locales. ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬...

  • Page 42: Hot Swap Fan Warning (If Applicable To Your System)

    UPER ERVER 2028GR-TR/TRT User's Manual Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 43 Chapter 4: Warning Statements for AC Systems Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt. ¡Advertencia! Riesgo de piezas móviles.

  • Page 44: Power Cable And Ac Adapter

    Electrical Appliance and Material Safety Law prohibits the use of UL or CSA -certified cables (that have UL/CSA shown on the code) for any other electrical devices than products designated by Supermicro only.. 電源コードとACアダプター 製品を設置する場合、 提供または指定および購入された接続ケーブル、 電源コードとAC アダプターを...
  • Page 45 ‫ -בכבלים המוסמכים ב‬UL ‫-או ב‬CSA (‫( כאשר מופיע עליהם קוד של‬UL/CSA ‫עבור‬ ‫ כל מוצר חשמלי אחר, אלא רק במוצר אשר הותאם ע"י‬Supermicro ‫.בלבד‬ ‫عند تركيب املنتج، قم باستخدام التوصيالت املتوفرة أو املحددة أو قم ب رش اء الكابالت الكهربائية ومحوالت التيار‬...
  • Page 46 Het gebruik van niet geschikte Kabels en/of Adapters kan een storing of brand veroorzaken. Wetgeving voor Elektrische apparatuur en Materiaalveiligheid verbied het gebruik van UL of CSA -gecertificeerde Kabels (met UL/CSA in de code) voor elke andere toepassing dan de door Supermicro hiervoor beoogde Producten. 4-20...

  • Page 47: Chapter 5 Advanced Serverboard Setup

    Chapter 5: Advanced Serverboard Setup Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to connect cables and describes all jumpers and connections. A layout and quick reference chart are included in this chapter for your reference. Always close the chassis when you have finished working on the system to maintain optimal cooling.

  • Page 48: Connecting Cables

    SUPERSERVER 1028GR-TR/TRT User's Manual Connecting Cables Assuming the X10DRG-H(T) serverboard is installed, the next step is to connect the cables to the board. These include the data (ribbon) cables for the peripherals and control panel and the power cables. Connecting Data Cables...

  • Page 49: I/O Ports

    Chapter 5: Advanced Serverboard Setup I/O Ports Figure 5-1. I/O Ports IO Ports USB Port 0 LAN Port 2 USB Port 1 VGA Port IPMI Dedicated LAN UID Switch LAN Port 1 For X10DRG-H the LAN ports are 1Gb; for X10DRG-HT the LAN ports are 10Gb.

  • Page 50: Installing The Processor And Heatsink

    • Install the processor into the CPU socket before installing the heatsink. • Refer to the Supermicro web site for updates on CPU support. Installing an LGA 2011 Processor Installing a CPU 1. There are two levers on the LGA 2011 socket.
  • Page 51 Chapter 5: Advanced Serverboard Setup 3. W ith the sec ond lever f ully Open the load plate. retracted, gently push down on the "Open 1st" lever to loosen the load plate. Lift the load plate with your fingers to open it completely. 4.
  • Page 52 SUPERSERVER 1028GR-TR/TRT User's Manual Gently close the load plate. 7. With the "Close 1st" lever fully retracted, gently close the load plate. Push down and lock the lever labeled "Close 1st". 8. Make sure the locking mechanism on the "Close 1st" lever catches the lip of the load plate.

  • Page 53: Installing A Cpu Heatsink

    Chapter 5: Advanced Serverboard Setup Installing a CPU Heatsink 1. Remove power from the system and unplug the AC power cord from the power supply. 2. Do not apply any thermal grease to the heatsink or the CPU die; the required amount has already been applied.

  • Page 54: Installing Memory

    Memory speed support is dependent on the CPUs. For best memory performance, please install memory modules of the same type and same speed. For the latest CPU/memory updates, refer to the Supermicro website. Processor/DIMM Population Configurations For memory to work properly, follow the tables below for memory installation.
  • Page 55 Chapter 5: Advanced Serverboard Setup Processors and their Corresponding Memory Modules CPU# Corresponding DIMM Modules CPU 1 DIMMA1 DIMMB1 DIMMC1 DIMMD1 DIMMA2 DIMMB2 DIMMC2 DIMMD2 CPU2 DIMME1 DIMMF1 DIMMG1 DIMMH1 DIMME2 DIMM F2 DIMMG2 DIMMH2 Processor and Memory Module Population for Optimal Performance Number of CPU and Memory Population Configuration Table CPUs+DIMMs...

  • Page 56: Serverboard Details

    SUPERSERVER 1028GR-TR/TRT User's Manual Serverboard Details LAN2 LAN1 USB4/5 (3.0) JWD1 IPMI_LAN BIOS CTRL JOH1 JBT1 CPU1 CLOSE 1st OPEN 1st X10DRG-H Rev. 1.01 BIOS MAC CODE JITP1 LICENSE BAR CODE CPU2 CLOSE 1st FANG OPEN 1st FANF FAN3 FANB...
  • Page 57 Chapter 5: Advanced Serverboard Setup X10DRG-H(T) Jumpers Jumper Description Default Setting JBT1 Clear CMOS See Chapter 2 JPB1 BMC Enable Pins 1-2 (Enabled) JPG1 VGA Enable Pins 1-2 (Enabled) JPL1 GLAN1/GLAN2 Enable (X10DRG-H) Pins 1-2 (Enabled) 10_GLAN1/10G_LAN2 Enable (X10DRG-HT) JPME2 Manufacture (ME) Mode Select Pins 1-2 (Normal) JWD1...
  • Page 58 SUPERSERVER 1028GR-TR/TRT User's Manual UID Switch (BP) USB 4/5 (3.0) Backpanel USB 3.0 Port 4/Port 5 (FP) 2/3 (3.0) Front Accessible USB 3.0 headers 0/1, 2/3 (FP) USB 0/1 (2.0) Front-Accessible USB 2.0 header for two USB connections USB 0/1...

  • Page 59: Connector Definitions

    Chapter 5: Advanced Serverboard Setup Connector Definitions Power Connectors The X10DRG-H(T) serverboard has one proprietary main power (JPW1) and six 8-pin 12V power connectors (JPW2, JPW3/JPW4/JPW5/JPW6/JPW7). The 8-pin power connector located at JPW2 is used to supply power to the serverboard, and the other five 8-pin power connectors located at JPW3-JPW7 are used for the HDD backplane or GPUs.
  • Page 60 SUPERSERVER 1028GR-TR/TRT User's Manual Ground x (Key) x (Key) Power On LED 3.3V HDD LED FP UID/3.3V Stby NIC1 LED (Link) NIC1 LED (Activity) NIC2 LED (Link) NIC2 LED (Activity) OH/Fan Fail/PWR Fail/UID LED Blue LED (UID Cathode) PWR Fail LED 3.3V...
  • Page 61 Chapter 5: Advanced Serverboard Setup NIC2 (LAN2) LED NIC2 LED Pin Definitions The LED connections for LAN2 are on pins (JF1) 9 and 10 of JF1. Attach an LED cable to Pin# Definition display network activity. See the table on Activity LED the right for pin definitions.
  • Page 62 SUPERSERVER 1028GR-TR/TRT User's Manual Fan Headers The serverboard has twelve fan headers. Fan Header Pin Definitions Fans 1~4 are for CPU/system use and Pin# Definition Fans A~H for GPU use.. All are 4-pin fan Ground headers, which are backward compatible with traditional 3-pin fans.

  • Page 63: I/O Connections

    Chapter 5: Advanced Serverboard Setup Standby Power Header Standby PWR Pin Definitions The +5V Standby Power header is located Pin# Definition at JSTBY1 on the motherboard. See the table on the right for pin definitions. (You +5V Standby must also have a card with a Standby Ground Power connector and a cable to use this No Connection...
  • Page 64 SUPERSERVER 1028GR-TR/TRT User's Manual Universal Serial Bus (USB) Front Panel USB 0/1, 2/3 Pin Definition Two USB 3.0 ports (USB 4/5) are located Pin# Definition Pin# Definitions on the I/O rear I/O shield. In addition, two internal USB headers, provide four...
  • Page 65 Blue: On Unit Identified Note: the UID can also be triggered via IPMI. Refer to the IPMI User's Guide on the Supermicro website. Rear UID LED UID LED Status The rear UID LED is located at LE4 on the backplane.

  • Page 66: Jumper Settings

    SUPERSERVER 1028GR-TR/TRT User's Manual Jumper Settings Explanation of Jumpers To modify the operation of the serverboard, jumpers can be used Connector to choose between optional settings. Pins Jumpers create shorts between two pins to change the function of the connector. Pin 1 is identified with...
  • Page 67 Chapter 5: Advanced Serverboard Setup VGA Enable/Disable VGA Enable/Disable Jumper Settings JPG1 allows you to enable or disable the Jumper Setting VGA port. The default position is on pins Definition 1 and 2 to enable VGA. See the table on Pins 1-2 Enabled the right for jumper settings.

  • Page 68: Onboard Indicators

    SUPERSERVER 1028GR-TR/TRT User's Manual Onboard Indicators LAN 1/2 Link LED Activity LED LAN1/2 Port LEDs The Ethernet ports have two LEDs. On each port, one LED indicates activity GLAN Activity Indicator (Left) LED Settings and teh other indicates the speed of the...

  • Page 69: 5-10 Sata Ports

    Chapter 5: Advanced Serverboard Setup 5-10 SATA Ports SATA Port Pin Definitions SATA Ports Pin # Definition There are ten SATA 3.0 (I-SATA 0-5 & Ground S-SATA0-3) on the motherboard. I-SATA SATA_TXP ports are supported by the Intel PCH SATA_TXN C612, and S-SATA ports are supported by Ground the Intel SCU chip.

  • Page 70: 5-11 Installing Software

    SUPERSERVER 1028GR-TR/TRT User's Manual 5-11 Installing Software The Supermicro ftp site contains drivers and utilities for your system at ftp://ftp. supermicro.com. Some of these must be installed, such as the chipset driver. After accessing the ftp site, go into the CDR_Images directory and locate the ISO file for your serverboard.

  • Page 71: Superdoctor ® 5

    Chapter 5: Advanced Serverboard Setup SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface in Windows and Linux operating systems. The program monitors system health information such as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).

  • Page 72: 5-12 Onboard Battery

    SUPERSERVER 1028GR-TR/TRT User's Manual 5-12 Onboard Battery Care must be taken to assure that the chassis cover is in place when the system is operating to ensure proper cooling. Out of warranty damage to the system can occur if this practice is not strictly followed.

  • Page 73: Chapter 6 Advanced Chassis Setup

    Chapter 6: Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform maintenance on the SC118GHTS-R1K66BP chassis. The only tool required is a Phillips screwdriver. Your system may require the installation of processors, memory, drives or expansion cards.

  • Page 74: Static-Sensitive Devices

    SUPERSERVER 1028GR-TR/TRT Series User's Manual Static-Sensitive Devices Electrostatic Discharge (ESD) can damage electronic com ponents. To prevent damage to any printed circuit boards (PCBs), it is important to handle them very carefully. The following measures are generally sufficient to protect your equipment from ESD damage.

  • Page 75: Installing Drives

    2. Use the handle to pull the drive carrier out of the chassis. Figure 6-2. Removing a Drive Carrier Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro Web site...
  • Page 76 SUPERSERVER 1028GR-TR/TRT Series User's Manual Installing a Drive 1. Remove the dummy drive, which comes pre-installed in the drive carrier, by removing the screws securing the dummy drive to the carrier. These screws are not used to mount the actual hard drive.

  • Page 77: Installing Graphics (Gpu) Cards

    Chapter 6: Advanced Chassis Setup Installing Graphics (GPU) Cards The system supports three graphics processor unit (GPU) cards, which are mounted in brackets to fit into the PCIe slots at the front of the chassis. The GPU cards may be preinstalled. Use the procedure below if a GPU card must be replaced.
  • Page 78 SUPERSERVER 1028GR-TR/TRT Series User's Manual 3. Secure each card to the bracket using the screws that are included for this purpose. Keplers: Remove the bracket on the end of the GPU, add a washer (included in kit) between the plate and the PCB for each screw, then attach the GPU to the bracket.

  • Page 79: Installing Expansion Cards

    Chapter 6: Advanced Chassis Setup Installing Expansion Cards The system accepts one low profile expansion card, mounted on a riser bracket. Installing an Expansion Card 1. Locate the riser card bracket in your chassis accessory bag, and the riser card, which may be purchased separately.

  • Page 80: System Cooling

    SUPERSERVER 1028GR-TR/TRT Series User's Manual System Cooling Ten 4-cm counter-rotating fans provide the cooling for the system. Each fan unit is actually made up of two fans joined back-to-back, which rotate in opposite directions. This counter-rotating action generates exceptional airflow and works to dampen vibration levels.
  • Page 81 Chapter 6: Advanced Chassis Setup Replacing a System Fan 1. If you do not use the BIOS to determine which fan has failed, open the top cover of the chassis while the system is running to locate the position of the failed fan. Never run the server for an extended period of time with the top cover open.

  • Page 82: Installing The Air Shroud

    SUPERSERVER 1028GR-TR/TRT Series User's Manual Installing the Air Shroud Air shrouds concentrate airflow to maximize fan efficiency. The SC118GH chassis has an air shroud for each GPU and one for the serverboard. The serverboard air shroud does not require screws to install.

  • Page 83: Power Supply

    The PWR Fail LED will illuminate and remain on until the failed unit has been replaced. Replace with the same model. Replacement units can be ordered directly from Supermicro. Figure 6-10. Removing the Power Supply Replacing the Power Supply 1.
  • Page 84 SUPERSERVER 1028GR-TR/TRT Series User's Manual Notes 6-12...

  • Page 85: Chapter 7 Ami Bios

    When an option is selected in the left frame, it is highlighted in white. Often a text message will accompany it. Note: the AMI BIOS has default text messages built in. Supermicro retains the option to include, omit, or change any of these text messages.

  • Page 86: How To Start The Setup Utility

    Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update. If you have to update the BIOS, do not shut down or reset the system while the BIOS is updating to avoid possible boot failure.
  • Page 87 Note: The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00. Supermicro X10DRG BIOS Version: This item displays the version of the BIOS ROM used in the system. Build Date: This item displays the date when the version of the BIOS ROM used in the system was built.

  • Page 88: Advanced Setup Configurations

    SuperServer 1028GR-TR/TRT User’s Manual Advanced Setup Configurations Use the arrow keys to select Advanced setup and press <Enter> to access the submenu items: Caution: Take Caution when changing the Advanced settings. An incorrect value, a very high DRAM frequency or an incorrect BIOS timing setting may cause the system to malfunction.
  • Page 89 Chapter 7: AMI BIOS Wait For 'F1' If Error Select Enabled to force the system to wait until the 'F1' key is pressed if an error occurs. The options are Disabled and Enabled. INT19 (Interrupt 19) Trap Response Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Immediate, the ROM BIOS of the host adaptors will "capture"...
  • Page 90 SuperServer 1028GR-TR/TRT User’s Manual CPU Configuration  This submenu displays the following CPU information as detected by the BIOS. It also allows the user to configure CPU settings. • Processor Socket • Processor ID • Processor Frequency • Processor Max Ratio •...
  • Page 91 Chapter 7: AMI BIOS codes to overwhelm the processor to damage the system during an attack. This feature is used in conjunction with the items: "Clear MCA," "VMX," "Enable SMX," and "Lock Chipset" for Virtualization media support. The options are Enable and Disable.
  • Page 92 SuperServer 1028GR-TR/TRT User’s Manual AES-NI Select Enable to use the Intel Advanced Encryption Standard (AES) New Instruc- tions (NI) to ensure data security. The options are Enable and Disable. Intel Virtualization Technology Select Enable to use Intel Virtualization Technology support for Direct I/O VT-d sup- port by reporting the I/O device assignments to the VMM (Virtual Machine Monitor) through the DMAR ACPI tables.
  • Page 93 Chapter 7: AMI BIOS No PCIe Port Active ECO This item provides a workaround solution when there is no PCIe port active. The options are Reset the SQ FLOP by CSR Option and PCU Squelch Exit Ignore Option. Socket 0 PCIED00F0 Port 0/DMI This submenu allows the user to configure the settings for the following PCI-E prots: 0, 1A, 1B, 2A, 2B, 2C, 2D, 3A, 3B, 3C, and 3D.
  • Page 94 SuperServer 1028GR-TR/TRT User’s Manual Corr Err Over (Correctable Error Overwrite) This item configures the option to overwrite correctable errors for ECC memory. The options are Disable and Enable. L0s Support This item configures the option to enable support for the L0s PCI-E link state (non supported in this motherboard).
  • Page 95 Chapter 7: AMI BIOS QPI (Quick Path Interconnect) Configuration QPI General Configuration QPI Status The following information will display: • Number of CPU • Number of IIO • Current QPI Link Speed • Current QPI Link Frequency • QPI Global MMIO Low Base/Limit •...
  • Page 96 SuperServer 1028GR-TR/TRT User’s Manual Memory Configuration Enforce POR Select Enable to enforce POR restrictions on memory frequency and voltage programming. The options are Enabled and Disabled. Memory Frequency Use this feature to set the maximum memory frequency for onboard memory modules.
  • Page 97 Chapter 7: AMI BIOS RAS Mode When Disable is selected, RAS is not supported. When Mirror is selected, the motherboard maintains two identical copies of all data in memory for data backup. When Lockstep is selected, the motherboard uses two areas of memory to run the same set of operations in parallel to boost performance.
  • Page 98 SuperServer 1028GR-TR/TRT User’s Manual Legacy USB Support Select Enabled to support onboard legacy USB devices. Select Auto to disable legacy support if there are no legacy USB devices present. Select Disable to have all USB devices available for EFI applications only. The options are Enabled, Disabled, and Auto.
  • Page 99 Chapter 7: AMI BIOS SATA Configuration  When this submenu is selected, AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the fol- lowing items: SATA Controller This item enables or disables the onboard SATA controller supported by the Intel PCH chip.
  • Page 100 SuperServer 1028GR-TR/TRT User’s Manual *If the item above "Configure SATA as" is set to IDE, the following items will display: Serial ATA Port 0 ~ Port 5 This item indicates that a SATA port specified by the user is installed (present) or not.
  • Page 101 Chapter 7: AMI BIOS Port 0 ~ Port 5 Spin Up Device On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRE- SET initialization to the device. The options are Enabled and Disabled. Port 0 ~ Port 5 SATA Device Type Use this item to specify if the SATA port specified by the user should be con- nected to a Solid State drive or a Hard Disk Drive.
  • Page 102 SuperServer 1028GR-TR/TRT User’s Manual sSATA Port 0 ~ Port 3 Spin Up Device On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRE- SET initialization to the device. The options are Enabled and Disabled.
  • Page 103 Chapter 7: AMI BIOS • Model number of drive and capacity • Software Preserve Support sSATA Port 0 ~ Port 3 Select Enabled to enable an sSATA port specified by the user. The options are Disabled and Enabled. sSATA Port 0 ~ Port 3 Spin Up Device On an edge detect from 0 to 1, set this item to allow the PCH to start a COMRE- SET initialization to the device.
  • Page 104 SuperServer 1028GR-TR/TRT User’s Manual PCIe/PCI/PnP Configuration PCI Devices Common Settings PCI Latency Timer Select Enabled to set the latency timer for PCI. The options are 32 PCI Bus Clocks, 64 PCI Bus Clocks, 96 PCI Bus Clocks, 128 PCI Bus Clocks, 160 PCI Bus Clocks, 192 PCI Bus Clocks, 224 PCI Bus Clocks, and 248 PCI Bus Clocks.
  • Page 105 Chapter 7: AMI BIOS ASPM Support Use this item to set the Active State Power Management (ASPM) level for a PCI-E device. Select Auto for the system BIOS to automatically set the ASPM level based on the system configuration. Select Disabled to disable ASPM support. The options are Disabled and Auto.
  • Page 106 SuperServer 1028GR-TR/TRT User’s Manual VGA Priority Use this item to select the graphics device to be used as the primary video display for system boot. The options are Onboard and Offboard. Onboard LAN Option ROM Type Select Legacy to boot the computer using a Legacy device installed on the moth- erboard.
  • Page 107 Chapter 7: AMI BIOS Serial Port 2 Attribute Select SOL to use COM Port 2 as a Serial_Over_LAN (SOL) port for console redi- rection. The options are COM and SOL. Serial Port Console Redirection  COM 1 COM 1 Console Redirection Select Enabled to enable COM Port 1 Console Redirection, which will allow a client machine to be connected to a host machine at a remote site for networking.
  • Page 108 SuperServer 1028GR-TR/TRT User’s Manual the data bits. Select Space to add a Space as a parity bit to be sent with your data bits. The options are None, Even, Odd, Mark, and Space. Stop Bits A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication.
  • Page 109 Chapter 7: AMI BIOS SOL/COM2 Console Redirection SOL/COM2 Console Redirection Select Enabled to use the SOL/COM2 port for Console Redirection. The options are Enabled and Disabled. *If the item above set to Enabled, the following items will become available for user's configuration: SOL/COM2 Console Redirection Settings Use this feature to specify how the host computer will exchange data with the client...
  • Page 110 SuperServer 1028GR-TR/TRT User’s Manual Flow Control Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop sending data when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty.
  • Page 111 Chapter 7: AMI BIOS Serial Port for Out-of-Band Management / Windows Emergency Management Services (EMS) The submenu allows the user to configure Console Redirection settings to support Out-of-Band Serial Port management. Console Redirection Select Enabled to use a COM port selected by the user for EMS Console Redi- rection.
  • Page 112 SuperServer 1028GR-TR/TRT User’s Manual The setting for each of the following features is displayed: Data Bits, Parity, Stop Bits Trusted Computing (Available when a TPM device is installed and detected by the BIOS) Configuration Security Device Support If this feature and the TPM jumper on the motherboard are both set to Enabled, onboard security devices will be enabled for TPM (Trusted Platform Module) sup- port to enhance data integrity and network security.
  • Page 113 Chapter 7: AMI BIOS pendency on other timestamp calculation devices, such as an x86 RDTSC Instruc- tion embedded in the CPU. The High Performance Event Timer is used to replace the 8254 Programmable Interval Timer. The options are Enabled and Disabled. NUMA (Available when the OS supports this feature) Select Enabled to enable Non-Uniform Memory Access support to enhance system performance.

  • Page 114: Event Logs

    SuperServer 1028GR-TR/TRT User’s Manual Event Logs Use this feature to configure Event Log settings. Change SMBIOS Event Log Settings  This feature allows the user to configure SMBIOS Event settings. Enabling/Disabling Options SMBIOS Event Log Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot.
  • Page 115 Chapter 7: AMI BIOS Memory Correctable Error Threshold Use this item to enter the threshold value for correctable memory errors. The default setting is 10. Erasing Settings Erase Event Log Select Enabled to erase all error events in the SMBIOS (System Management BIOS) log before an event logging is initialized at bootup.

  • Page 116: Ipmi

    SuperServer 1028GR-TR/TRT User’s Manual IPMI Use this feature to configure Intelligent Platform Management Interface (IPMI) settings. IPMI Firmware Revision This item indicates the IPMI firmware revision used in your system. Status of BMC This item indicates the status of the onboard BMC (Baseboard Management Con- troller).
  • Page 117 Chapter 7: AMI BIOS When SEL is Full This feature allows the user to determine what the AMI BIOS should do when the system event log is full. Select Erase Immediately to erase all events in the log when the system event log is full. The options are Do Nothing and Erase Immediately. Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.

  • Page 118: Security Settings

    SuperServer 1028GR-TR/TRT User’s Manual Security Settings This menu allows the user to configure the following security settings for the system. Administrator Password Use this feature to set the administrator password which is required before the user entering the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long.

  • Page 119: Boot Settings

    Chapter 7: AMI BIOS Boot Settings Use this feature to configure Boot Settings: Boot Configuration Boot Mode Select Use this item to select the type of device to be used for system boot. The options are Legacy, UEFI, and Dual. Fixed Boot Order Priorities This option prioritizes the order of bootable devices from which the system will boot.
  • Page 120 SuperServer 1028GR-TR/TRT User’s Manual • Dual Boot Order #9 • Dual Boot Order #10 • Dual Boot Order #11 • Dual Boot Order #12 • Dual Boot Order #13 • Dual Boot Order #14 • Dual Boot Order #15  Add New Boot Option Use this item to select a new boot device to add to the boot priority list.
  • Page 121 Chapter 7: AMI BIOS • Boot Order #2  Network Drive BBS Priorities • Boot Order #1  UEFI Application Boot Priorities • UEFI Boot Order #1 7-37...

  • Page 122: Save & Exit

    SuperServer 1028GR-TR/TRT User’s Manual Save & Exit Select the Save & Exit tab from the BIOS setup screen to configure the settings below. Discard Changes and Exit Select this option to quit the BIOS setup without making any permanent changes to the system configuration, and reboot the computer.
  • Page 123 Chapter 7: AMI BIOS Restore Optimized Defaults To set this feature, select Restore Optimized Defaults from the Exit menu and press <Enter>. These are manufacture default settings designed for maximum system performance but not for maximum stability. Save as User Defaults To set this feature, select Save as User Defaults from the Exit menu and press <En- ter>.
  • Page 124 SuperServer 1028GR-TR/TRT User’s Manual Notes 7-40...

  • Page 125: Appendix A Bios Error Beep Codes

    Appendix A: BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the Power-On Self-Test (POST) routines, which are performed at each system boot, errors may occur. Non-fatal errors are those which, in most cases, allow the system to continue to boot.
  • Page 126 SUPERSERVER 1028GR-TR/TRT User's Manual Notes...

  • Page 127: Appendix B System Specifications

    Dual Intel E5-2600 v3/v4 Series Processors (Socket R3) LGA 2011. Each processor supports dual full-width Intel QuickPath Interconnect (QPI) links of up to 9.6 GT/s one direction per QPI. For a complete listing of supported processors, refer to the Supermicro web site. Chipset Intel PCH C612...
  • Page 128 SUPERSERVER 1028GR-TR/TRT User's Manual Expansion Slots The serverboard has four PCI-Express 3.0 x16 slots to support three double-width GPU cards. An additional slot supports one low profile PCI-Express 3.0 x8 (in x16 slot) card. Riser cards are used. Serverboard X10DRG-H/HT (proprietary form factor) Dimensions: 19.8"...
  • Page 129 See www.dtsc.ca.gov/hazardouswaste/perchlorate” (continued from front) The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency com- munication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage.
  • Page 130 SUPERSERVER 1028GR-TR/TRT User's Manual Notes...

This manual is also suitable for:

Superserver 1028gr-trt

Table of Contents