Table of Contents

Advertisement

Quick Links

S
UPER
®
SUPERSERVER
6028TR-DTR
6028TR-D72R
USER'S MANUAL
Revision 1.0

Advertisement

Table of Contents
loading

Summary of Contents for Supero SUPERSERVER 6028TR-DTR

  • Page 1 UPER ® SUPERSERVER 6028TR-DTR 6028TR-D72R USER'S MANUAL Revision 1.0...
  • Page 2 The information in this User’s Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates.
  • Page 3 It provides information for the installation and use of the SuperServer 6028TR-DTR/D72R. Installation and maintainance should be performed by experienced technicians only. The SuperServer 6028TR-DTR/D72R is a high-end server based on the SC827HD-R1K28BP 2U rackmount chassis and the dual processor X10DRT-H serverboard.
  • Page 4 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Refer to Chapter 6 for detailed information on the SC827HD-R1K28BP server chassis. You should follow the procedures given in this chapter when installing, removing or reconfiguring SATA or peripheral drives and when replacing system power supply units and cooling fans.
  • Page 5 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Notes...
  • Page 6: Table Of Contents

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Table of Contents Chapter 1 Introduction Overview ......................1-1 Serverboard Features ..................1-2 Processors ...................... 1-2 Memory ......................1-2 SAS ......................... 1-2 SATA ......................1-2 PCI Expansion Slots ..................1-2 Onboard Controllers/Ports ................1-3 Graphics Controller ..................1-3 Other Features ....................
  • Page 7 Table of Contents Removing the Protective Film ................. 2-4 Rack Mounting Instructions ................2-5 Separating the Sections of the Rack Rails ............. 2-5 Installing the Inner Rail Extensions ..............2-6 Outer Rack Rails ..................... 2-7 Chapter 3 System Interface Overview ......................3-1 Control Panel Buttons ..................
  • Page 8 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Removing the Heatsink ................... 5-8 Installing Memory .................... 5-9 Memory Support ....................5-9 Adding PCI Expansion Cards ................5-11 Serverboard Details ..................5-12 X10DRT-H Quick Reference ................. 5-12 Connector Definitions ..................5-14 Jumper Settings .................... 5-17 Explanation of Jumpers ................5-17 5-10 Onboard Indicators ..................
  • Page 9 Table of Contents Chapter 7 BIOS Introduction ...................... 7-1 Starting BIOS Setup Utility ................7-1 How To Change the Configuration Data ............7-2 Starting the Setup Utility ................. 7-2 Main Setup ...................... 7-2 Advanced Setup Configurations..............7-4 Event Logs ....................7-30 IPMI .......................
  • Page 10 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Notes...
  • Page 11: Chapter 1 Introduction

    Chapter 1 Introduction Overview The SuperServer 6028TR-DTR/D72R is a high-end server comprised of two main subsystems: the SC827HD-R1K28BP 2U server chassis and the X10DRT-H dual processor serverboard in four hot-swap nodes. Please refer to our web site for information on operating systems that have been certified for use with the system (www.supermicro.com).
  • Page 12: Serverboard Features

    RAID function of the SATA drives. PCI Expansion Slots The SuperServer 6028TR-DTR/D72R has for each node one PCI Express 3.0 x16 slot (Slot 1), one PCI Express 3.0 x8 slot for a rear I/O riser card (SXB1) and one...
  • Page 13: Onboard Controllers/Ports

    Chapter 1: Introduction Onboard Controllers/Ports The rear I/O ports include one COM port, a VGA (monitor) port, two USB 3.0 ports (additional internal USB headers are included on the serverboard), an IPMI dedicated LAN port and two Ethernet ports. Note: For IPMI Configuration Instructions, please refer to the Embedded BMC Configuration User's Guide available at http://www.supermicro.com/support/ manuals/.
  • Page 14: Front Control Panel

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Front Control Panel SC827HD-R1K28BP chassis features two independant control panels associated with each serverboard (node) in the chassis. Each control panel has LEDs to indicate power on, network activity, power fail, fan fail, system overheat conditions and the UID LED.
  • Page 15 Chapter 1: Introduction Figure 1-1. Intel C612 Chipset: System Block Diagram Note: This is a general block diagram and may not exactly repre- sent the features on your motherboard. See the previous pages for the actual specifications of your motherboard. This block diagram is intended for your reference only.
  • Page 16: Contacting Supermicro

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V.
  • Page 17: Twin: System Notes

    Chapter 1: Introduction 2U Twin: System Notes As a 2U Twin configuration, the SuperServer 6028TR-DTR/D72R is a unique server system. With two system boards incorporated into a single chassis acting as two separate nodes, there are several points you should keep in mind.
  • Page 18 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Notes...
  • Page 19: Chapter 2 Server Installation

    Chapter 2: Server Installation Chapter 2 Server Installation Overview This chapter provides a quick setup checklist to get your system up and running. Following these steps in the order given should enable you to have it operational within a minimum amount of time. This setup assumes that your system has come to you with the processors and memory preinstalled.
  • Page 20: Warnings And Precautions

    SUPERSERVER 6028TR-DTR/D72R User's Manual • This product is not suitable for use with visual display work place devices ac- cording to §2 of the the German Ordinance for Work with Visual Display Units. Warnings and Precautions Rack Precautions • Ensure that the leveling jacks on the bottom of the rack are fully extended to the floor with the full weight of the rack resting on them.
  • Page 21: Rack Mounting Considerations

    Chapter 2: Server Installation Rack Mounting Considerations Ambient Operating Temperature If installed in a closed or multi-unit rack assembly, the ambient operating tempera- ture of the rack environment may be greater than the ambient temperature of the room. Therefore, consideration should be given to installing the equipment in an environment compatible with the manufacturer’s maximum rated ambient tempera- ture (Tmra).
  • Page 22: Removing The Protective Film

    SUPERSERVER 6028TR-DTR/D72R User's Manual Removing the Protective Film Before operating the server for the first time, it is important to remove the protec- tive film covering the top of the chassis, in order to allow for proper ventilation and cooling.
  • Page 23: Rack Mounting Instructions

    Chapter 2: Server Installation Rack Mounting Instructions This section provides information on installing the SC827 chassis into a rack unit with the quick-release rails provided. There are a variety of rack units on the market, which may mean the assembly procedure will differ slightly. You should also refer to the installation instructions that came with the rack unit you are using.
  • Page 24: Installing The Inner Rail Extensions

    SUPERSERVER 6028TR-DTR/D72R User's Manual Installing the Inner Rail Extensions The SC827 chassis includes a set of inner rails in two sections: inner rails and inner rail extensions. The inner rails are pre-attached to the chassis, and do not interfere with normal use of the chassis if you decide not to use a server rack. The inner rail extension is attached to the inner rail to mount the chassis in the rack.
  • Page 25: Outer Rack Rails

    Chapter 2: Server Installation SCREW screw the handles t outer rails for secur purpose if necessar Figure 2-4: Assembling the Outer Rails Outer Rack Rails Outer rails attach to the rack and hold the chassis in place. The outer rails for the SC827 chassis extend between 30 inches and 33 inches.
  • Page 26 SUPERSERVER 6028TR-DTR/D72R User's Manual SCREW Figure 2-5: Installing Into the Rack Installing the Chassis into a Rack 1. Extend the outer rails as illustrated above. 2. Align the inner rails of the chassis with the outer rails on the rack.
  • Page 27: Chapter 3 System Interface

    Chapter 3: System Interface Chapter 3 System Interface Overview There are LEDs on the control panels and on the hard drive carriers to keep you constantly informed of the overall status of the system as well as the activity and health of specific components.
  • Page 28: Control Panel Leds

    SUPERSERVER 6028TR-DTR/D72R User's Manual Control Panel LEDs In addition to the LEDs built into the power and UID buttons, each of the control panels located on the front of the SC827HD-R1K28BP chassis has two LEDs that provide you with critical information related their own node. This section explains what each LED indicates when illuminated and any corrective action you may need to take.
  • Page 29: About Standardized Warning Statements

    Chapter 4: Warning Statements for AC Systems Chapter 4 Standardized Warning Statements for AC Systems About Standardized Warning Statements The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance.
  • Page 30 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut.
  • Page 31 Warning Statements for AC Systems ‫جسذٌة‬ ‫اصابة‬ ً‫تتسبب ف‬ ‫حالة ٌوكي أى‬ ً‫اًك ف‬ ‫خطز‬ ًٌ‫ٌع‬ ‫هذا الزهز‬ !‫تحذٌز‬ ‫الذوائز‬ ‫بالوخاطز الٌاجوة عي‬ ‫ي على علن‬ ، ‫ك‬ ‫هعذات‬ ‫تعول على أي‬ ‫قبل أى‬ ‫الكهزبائٍة‬ ‫حىادث‬ ‫أي‬ ‫وقىع‬ ‫وٌع‬ ‫ل‬ ‫الىقائٍة‬...
  • Page 32: Installation Instructions

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Installation Instructions Warning! Read the installation instructions before connecting the system to the power source. 設置手順書 システムを電源に接続する前に、 設置手順書をお読み下さい。 警告 将此系统连接电源前,请先阅读安装说明。 警告 將系統與電源連接前,請先閱讀安裝說明。 Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación.
  • Page 33: Circuit Breaker

    Chapter 4: Warning Statements for AC Systems Circuit Breaker Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A. サーキッ ト ・ ブレーカー この製品は、 短絡 (過電流) 保護装置がある建物での設置を前提としています。 保護装置の定格が250 V、...
  • Page 34: Power Disconnection Warning

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL ‫في‬ ‫التي تم تثبيتها‬ ‫مه الدوائرالقصيرة‬ ‫الحمايت‬ ‫معداث‬ ‫يعتمد على‬ ‫هذا المنتج‬ ‫المبنى‬ ‫أكثر من‬ ‫ليس‬ ‫وقائي‬ ‫ال‬ ‫الجهاز‬ ‫تقييم‬ ‫أن‬ ‫تأكد من‬ 20A, 250V 경고! 이 제품은 전원의 단락(과전류)방지에 대해서 전적으로 건물의 관련 설비에 의존합니다. 보호장치의 정격이 반드시 250V(볼트), 20A(암페어)를 초과하지...
  • Page 35 Chapter 4: Warning Statements for AC Systems Warnung Das System muss von allen Quellen der Energie und vom Netzanschlusskabel getrennt sein, das von den Spg.Versorgungsteilmodulen entfernt wird, bevor es auf den Chassisinnenraum zurückgreift, um Systemsbestandteile anzubringen oder zu entfernen. ¡Advertencia! El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema.
  • Page 36: Equipment Installation

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Equipment Installation Warning! Only trained and qualified personnel should be allowed to install, replace, or service this equipment. 機器の設置 トレーニングを受け認定された人だけがこの装置の設置、 交換、 またはサービスを許可 されています。 警告 只有经过培训且具有资格的人员才能进行此设备的安装、更换和维修。 警告 只有經過受訓且具資格人員才可安裝、更換與維修此設備。 Warnung Das Installieren, Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem, qualifiziertem Personal gestattet werden.
  • Page 37: Restricted Area

    Chapter 4: Warning Statements for AC Systems Waarschuwing Deze apparatuur mag alleen worden geïnstalleerd, vervangen of hersteld door geschoold en gekwalificeerd personeel. Restricted Area Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security.
  • Page 38: Battery Handling

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL ‫אזור עם גישה מוגבלת‬ !‫אזהרה‬ ‫יש להתקין את היחידה באזורים שיש בהם הגבלת גישה. הגישה ניתנת בעזרת‬ .)'‫כלי אבטחה בלבד (מפתח, מנעול וכד‬ ‫محظورة‬ ‫مناطق‬ ٍ‫نتركُبها ف‬ ‫هذه انىحذة‬ ‫تخصيص‬ ‫تم‬ ،‫أداة خاصت‬ ‫من خالل استخذاو‬...
  • Page 39 Chapter 4: Warning Statements for AC Systems Warnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr. Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp. Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers. Attention Danger d'explosion si la pile n'est pas remplacée correctement. Ne la remplacer que par une pile de type semblable ou équivalent, recommandée par le fabricant.
  • Page 40: Redundant Power Supplies

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Redundant Power Supplies Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit. 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります。 ユニッ トの電源を切るためには、 すべての接続を取り外さなければなりません。 警告 此部件连接的电源可能不止一个,必须将所有电源断开才能停止给该部件供电。 警告 此裝置連接的電源可能不只一個,必須切斷所有電源才能停止對該裝置的供電。 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle Verbindungen entfernt werden.
  • Page 41: Backplane Voltage

    Chapter 4: Warning Statements for AC Systems ‫امداد الطاقة‬ ‫بوحدات‬ ‫عدة اتصاالت‬ ‫جهاز‬ ‫ال‬ ‫يكون لهذا‬ ‫قد‬ ‫الكهرباء‬ ‫عن‬ ‫وحدة‬ ‫ال‬ ‫لعسل‬ ‫كافة االتصاالت‬ ‫يجب إزالة‬ 경고! 이 장치에는 한 개 이상의 전원 공급 단자가 연결되어 있을 수 있습니다. 이 장치에 전원을...
  • Page 42: Comply With Local And National Electrical Codes

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Attention Lorsque le système est en fonctionnement, des tensions électriques circulent sur le fond de panier. Prendre des précautions lors de la maintenance. ‫מתח בפנל האחורי‬ !‫הרה‬ ‫אז‬ ‫קיימת סכנת מתח בפנל האחורי בזמן תפעול המערכת. יש להיזהר במהלך‬...
  • Page 43: Product Disposal

    Chapter 4: Warning Statements for AC Systems ¡Advertencia! La instalacion del equipo debe cumplir con las normas de electricidad locales y nacionales.Attention L'équipement doit être installé conformément aux normes électriques nationales et locales. ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ ‫הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫התקנת‬...
  • Page 44: Hot Swap Fan Warning

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Warnung Die Entsorgung dieses Produkts sollte gemäß allen Bestimmungen und Gesetzen des Landes erfolgen. ¡Advertencia! Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales. Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement.
  • Page 45 Chapter 4: Warning Statements for AC Systems 当您从机架移除风扇装置,风扇可能仍在转动。小心不要将手指、螺丝起子和其他 物品太靠近风扇 警告 當您從機架移除風扇裝置,風扇可能仍在轉動。小心不要將手指、螺絲起子和其他 物品太靠近風扇。 Warnung Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt. ¡Advertencia! Los ventiladores podran dar vuelta cuando usted quite ell montaje del ventilador del chasis.
  • Page 46: Power Cable And Ac Adapter

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Waarschuwing Het is mogelijk dat de ventilator nog draait tijdens het verwijderen van het ventilatorsamenstel uit het chassis. Houd uw vingers, schroevendraaiers en eventuele andere voorwerpen uit de buurt van de openingen in de ventilatorbehuizing. Power Cable and AC Adapter...
  • Page 47 Chapter 4: Warning Statements for AC Systems ¡Advertencia! Al instalar el producto, utilice los cables de conexión previstos o designados, los cables y adaptadores de CA. La utilización de otros cables y adaptadores podría ocasionar un mal funcionamiento o un incendio. Aparatos Eléctricos y la Ley de Seguridad del Material prohíbe el uso de UL o CSA cables certificados que tienen UL o CSA se muestra en el código de otros dispositivos eléctricos que los productos designados por Supermicro solamente.
  • Page 48 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Waarschuwing Bij het installeren van het product, gebruik de meegeleverde of aangewezen kabels, stroomkabels en adapters. Het gebruik van andere kabels en adapters kan leiden tot een storing of een brand. Elektrisch apparaat en veiligheidsinformatiebladen wet...
  • Page 49: Chapter 5 Advanced Serverboard Setup

    Chapter 5: Advanced Serverboard Setup Chapter 5 Advanced Serverboard Setup This chapter covers the steps required to install the X10DRT-H serverboard into the chassis, connect the data and power cables and install add-on cards. All serverboard jumpers and connections are also described. A layout and quick reference chart are included in this chapter for your reference.
  • Page 50: Connecting Cables

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Connecting Cables Now that the processors are installed, the next step is to connect the cables to the serverboard. Connecting Data Cables The cables used to transfer data from the peripheral devices have been carefully routed in preconfigured systems to prevent them from blocking the flow of cooling air that moves through the system from front to back.
  • Page 51: Rear I/O Ports

    Chapter 5: Advanced Serverboard Setup Rear I/O Ports See Figure 5-1 below for the and locations of the various rear I/O ports and the UID switch. Figure 5-1. Rear I/O Ports Rear I/O Ports Dedicated IPMI LAN Back Panel USB 3.0 Port 1 Back Panel USB 3.0 Port 0 Gigabit LAN 1 Gigabit LAN 2...
  • Page 52: Processor And Heatsink Installation

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Processor and Heatsink Installation Notes: • Always remove the power cord before adding, removing or changing a CPU. • When receiving a serverboard without a processor pre-installed, make sure that the plastic CPU socket cap is in place and none of the socket pins are bent;...
  • Page 53 Chapter 5: Advanced Serverboard Setup 3. With the second lever fully Open the load plate. retracted, gently push down on the "Open 1st" lever to loosen the load plate. Lift the load plate with your fingers to open it completely. IMPORTANT! 4.
  • Page 54 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Gently close the load plate. 7. With the "Close 1st" lever fully retracted, gently close the load plate. Push down and lock the lever labeled "Close 1st". 8. Make sure the locking mechanism on the "Close 1st" lever catches the lip of the load plate.
  • Page 55: Installing A Passive Cpu Heatsink

    Chapter 5: Advanced Serverboard Setup Installing a Passive CPU Heatsink 1. Do not apply any thermal grease to the heatsink or the CPU die - the required amount has already been applied. 2. Place the heatsink on top of the CPU so that the four mounting holes are aligned with those on the serverboard and the heatsink bracket underneath.
  • Page 56: Removing The Heatsink

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Removing the Heatsink Caution: We do not recommend that the CPU or the heatsink be removed. However, if you do need to uninstall the heatsink, please follow the instructions below to prevent damage to the CPU or the CPU socket.
  • Page 57: Installing Memory

    Chapter 5: Advanced Serverboard Setup Installing Memory Installing Memory 1. Insert each memory module vertically into its slot, paying attention to the notch along the bottom of the module to prevent inserting the module incorrectly (see Figure 5-4). 2. Install starting with slot P1-DIMMA1. 3.
  • Page 58 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Processor & Memory Module Population Configuration For the memory to work properly, follow the tables below when populating the DIMM slots. Processors and their Corresponding Memory Modules CPU# Corresponding DIMM Modules CPU 1 DIMMA1 DIMMB1 DIMMC1...
  • Page 59: Adding Pci Expansion Cards

    Chapter 5: Advanced Serverboard Setup Adding PCI Expansion Cards The 6028TR-DTR/D72R includes one preinstalled riser card per node, designed specifically for use in a 2U rackmount chassis. This riser card (RSC-R2UT-3E8R) supports three standard size PCI Express x8 cards for each node. Installing an Expansion Card 1.
  • Page 60: Serverboard Details

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Serverboard Details Figure 5-5. X10DRT-H Serverboard Layout (not drawn to scale) COM1 JCOM1 JVGA JUIDB1 JIB1 LAN2 LAN1 QSFP LEDBMC JUSBRJ45 JSTBY1 JPB1:BMC 1-2:ENABLE 2-3:DISABLE JBT1: CMOS CLEAR JSD2 CPU1 CLOSE 1st OPEN 1st CPU2 CLOSE 1st...
  • Page 61 Chapter 5: Advanced Serverboard Setup Jumper Description Default Setting JVRM1/JVRM2 C Bus for VRM Pins 1-2 (BMC: Normal) JBT1 Clear CMOS See Section 5-9 JPB1 BMC Enable/Disable Pins 1-2 (Enabled) JPG1 VGA Enable/Disable Pins 1-2 (Enabled) JPL1 LAN Enable/Disable Pins 1-2 (Enabled) JI2C1/JI2C2 SMB to PCI Slots Pins 1-2 (Enabled)
  • Page 62: Connector Definitions

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Connector Definitions Main Power Main power to the serverboard is supplied through the system backplane (BPN- SAS-217HQ), which receives power directly from the power supply. One hard drive midplane in each node (BPN-ADP-S2208L-H6iR) plugs into the backplane and the...
  • Page 63 Chapter 5: Advanced Serverboard Setup VGA Port A VGA (video) port is provided on the I/O backplane. This connector is used to provide video and CRT display. Unit Identifier Switch A Unit Identifier (UID) switch (SW1) and an LED indicator are located to the right of the VGA port.
  • Page 64 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Fan Headers This serverboard has one system Fan Header fan header (Fan 3). This 4-pin fans Pin Definitions header is backward compatible with Pin# Definition traditional 3-pin fans. However, fan Ground speed control is available for 4-pin fans +12V only.
  • Page 65: Jumper Settings

    Chapter 5: Advanced Serverboard Setup Jumper Settings Connector Pins Explanation of Jumpers To modify the operation of the serverboard, Jumper jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function Setting of the connector.
  • Page 66 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Watch Dog Enable/Disable Watch Dog (JWD1) is a system monitor Watch Dog that can reboot the system when a Jumper Settings software application hangs. Close pins Jumper Setting Definition 1-2 to reset the system if an application...
  • Page 67 Chapter 5: Advanced Serverboard Setup C Bus for VRM C Bus for VRM Jumper Settings Jumpers JVRM1 and JVRM2 allow the Jumper Setting Definition BMC or the PCH to access CPU and Pins 1-2 Enabled memory VRM controllers. See the table Pins 2-3 Disabled on the right for jumper settings.
  • Page 68: 5-10 Onboard Indicators

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL 5-10 Onboard Indicators LAN Port LEDs The LAN ports are located on the rear I/O LAN Port LED (Connection Speed Indicator) panel. On each Gb LAN port, one LED LED Color Definition blinks to indicate activity while the other...
  • Page 69: 5-11 Pci-Express And Sata Connections

    Chapter 5: Advanced Serverboard Setup Power LED The Power LED on the serverboard Power LED Settings functions as an indicator that power Color Status Definition is connected and the ser verboard Green Solid Power On/Server- is running. This LED will display a boad Running steady green light indicating that the Power Off/...
  • Page 70: 5-12 Installing Software

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL 5-12 Installing Software The Supermicro ftp site contains drivers and utilities for your system at ftp://ftp. supermicro.com. Some of these must be installed, such as the chipset driver. After accessing the ftp site, go into the CDR_Images directory and locate the ISO file for your serverboard.
  • Page 71: Superdoctor® 5

    Chapter 5: Advanced Serverboard Setup SuperDoctor® 5 The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface in Windows and Linux operating systems. The program monitors system health information such as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).
  • Page 72: 5-13 Onboard Battery

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL 5-13 Onboard Battery Please handle used batteries carefully. Do not damage the battery in any way; a damaged battery may release hazardous materials into the environment. Do not discard a used battery in the garbage or a public landfill. Please comply with the regulations set up by your local hazardous waste management agency to dispose of your used battery properly.
  • Page 73: Chapter 6 Advanced Chassis Setup

    Chapter 6: Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform maintenance on the SC827HD-R1K28BP chassis. For component installation, follow the steps in the order given to eliminate the most common problems encountered. If some steps are unnecessary, skip ahead to the step that follows.
  • Page 74: Control Panel

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Figure 6-1. Chassis Front and Rear Views Node A Control Panel Node B Control Panel SAS/SATA Drives Dedicated IPMI LAN Port Dedicated IPMI LAN Port LAN Ports PCI-Express x8 Cards Power Supply LAN Ports PCI-Express x8 Cards...
  • Page 75: Chassis Cover

    Chapter 6: Advanced Chassis Setup Chassis Cover Before operating the SC827HD chassis for the first time, it is important to remove the protective film covering the top of the chassis, in order to allow for proper ventilation and cooling. Removing the Chassis Cover and Protective Film 1.
  • Page 76: Installing The Air Shrouds

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Installing the Air Shrouds Air Shrouds Air shrouds concentrate airflow to maximize fan efficiency. The SC827HD chassis requires air shrouds for each serverboard node. Air shrouds vary depending upon the serverboard used. See the illustrations below.
  • Page 77: Checking The Airflow

    Chapter 6: Advanced Chassis Setup Checking the Airflow Checking Airflow 1. Make sure there are no objects to obstruct airflow in and out of the server. In addition, if you are using a front bezel, make sure the bezel's filter is replaced periodically.
  • Page 78 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Changing a System Fan 1. If necessary, open the chassis while the power is running to determine which fan has failed. (Never run the server for an extended period of time with the chassis cover open.) 2.
  • Page 79 Chapter 6: Advanced Chassis Setup Figure 6-5. Replacing a System Fan in the Fan Housing...
  • Page 80: Removing And Installing The Backplane

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Removing and Installing the Backplane The SC827HD chassis backplane is located behind the hard drives and in front of the front system fans. If it is necessary to remove the backplane, follow the instructions below. Removing the Backplane Removing the Backplane from the Chassis 1.
  • Page 81 Chapter 6: Advanced Chassis Setup 7. Loosen the three screws in the spring bar, located on the floor of the chassis, indicated by the arrows below (Figure 6-7). Figure 6-7. Loosening the Spring Bar Screws in the Floor of the Chassis 8.
  • Page 82: Installing The Backplane

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Installing the Backplane Installing the Backplane into the Chassis (Figure 6-9) 1. Ensure that all of the hard drive trays have been removed from the bays in the front of the chassis and that the spring bar has been loosened as directed in the previous section.
  • Page 83: Installing The Serverboard

    Chapter 6: Advanced Chassis Setup Installing the Serverboard I/O Shield The I/O shield holds the serverboard ports in place. The I/O shield does not require installation. Node Installation/Removal As with any server system, power must be removed from the serverboard when upgrading or installing memory or processors.
  • Page 84 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Figure 6-10. Removing a Node 6-12...
  • Page 85 Chapter 6: Advanced Chassis Setup Installing the Serverboard (Figure 6-11) 1. Review the documentation that came with your serverboard. Become familiar with component placement, requirements, precautions, and cable connections. 2. Pull the serverboard node drawer out of the back of the chassis. 3.
  • Page 86 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Figure 6-11. Installing the Serverboard in the Serverboard Node Drawer 6-14...
  • Page 87: Adapter Card Replacement

    Chapter 6: Advanced Chassis Setup Adapter Card Replacement Each serverboard drawer comes equipped with an adapter card which plugs into the backplane. In the event that the adapter card needs to be replaced, installation requires only a Phillips head screwdriver. Figure 6-12.
  • Page 88: Expansion Card/Expansion Slot Setup

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Expansion Card/Expansion Slot Setup The 6028TR-DTR/D72R includes one preinstalled riser card per node, designed specifically for use in a 2U rackmount chassis. This riser card (RSC-R2UT-3E8R) supports three standard size PCI Express x8 cards for each node.
  • Page 89: 6-10 Installing And Removing Hard Drives

    Chapter 6: Advanced Chassis Setup 6-10 Installing and Removing Hard Drives The SC827HD chassis contains two individual serverboards in separate node drawers. Each serverboard node controls a set of six hard drives. Note that if a serverboard node drawer is pulled out of the chassis, the hard drives associated with that node will power down as well.
  • Page 90 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Removing Hard Drive Carriers From the Chassis (Figure 6-14) 1. Press the release button on the drive carrier. This extends the drive bay handle. 2. Use the handle to pull the drive out of the chassis.
  • Page 91 Chapter 6: Advanced Chassis Setup The hard drives are mounted in drive carriers to simplify their installation and removal from the chassis. These carriers also help promote proper airflow for the drive bays. Caution! Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers.
  • Page 92: 6-11 Power Supply

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL 6-11 Power Supply The SuperServer 6028TR-DTR/D72R has two 1280 watt hot-plug power supply modules to provide redundant power for the system. If either of the two power supply modules fail, the other module will take the full load and allow the system to continue operation without interruption.
  • Page 93 Chapter 6: Advanced Chassis Setup Figure 6-16. Removing the Power Supply Release Tab 6-21...
  • Page 94 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Notes 6-22...
  • Page 95: Chapter 7 Bios

    Chapter 7: BIOS Chapter 7 BIOS Introduction This chapter describes the AMI BIOS Setup utility for the X10DRT-H. It also provides the instructions on how to navigate the AMI BIOS Setup utility screens. The AMI ROM BIOS is stored in a Flash EEPROM and can be easily updated. Starting BIOS Setup Utility To enter the AMI BIOS Setup utility screens, press the <Del>...
  • Page 96: How To Change The Configuration Data

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL How To Change the Configuration Data The configuration data that determines the system parameters may be changed by entering the AMI BIOS Setup utility. This Setup utility can be accessed by pressing <F2> at the appropriate time during system boot.
  • Page 97 Chapter 7: BIOS System Date This item displays the system date in Day MM/DD/YY format (e.g. Wed 10/12/2011). System Time This item displays the system time in HH:MM:SS format (e.g. 15:32:52). Supermicro X10DRT-H BIOS Version This item displays the version of the BIOS ROM used in this system. Build Date This item displays the date that the BIOS Setup utility was built.
  • Page 98: Advanced Setup Configurations

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Advanced Setup Configurations Use the arrow keys to select Advanced Setup and press <Enter> to access the following submenu items. Boot Features Quiet Boot This feature selects the bootup screen display between POST messages and the OEM logo. Select Disabled to display the POST messages. Select Enabled to display the OEM logo instead of the normal POST messages.
  • Page 99 Chapter 7: BIOS Interrupt 19 Capture Interrupt 19 is the software interrupt that handles the boot disk function. When this item is set to Enabled, the ROM BIOS of the host adaptors will "capture" Interrupt 19 at bootup and allow the drives that are attached to these host adaptors to function as bootable disks.
  • Page 100 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL CPU Configuration This submenu displays the information of the CPU as detected by the BIOS. It also allows the user to configuration CPU settings. Socket 1 CPU Information/Socket 2 CPU Information This submenu displays the following information regarding the CPU installed in Socket 1 and (or) Socket 2 as detected by the BIOS.
  • Page 101 Chapter 7: BIOS Execute-Disable Bit Capability (Available if supported by the OS & the CPU) Select Enabled to enable the Execute-Disable Bit which will allow the processor to designate areas in the system memory where an application code can execute and where it cannot, thus preventing a worm or a virus from flooding illegal codes to overwhelm the processor or damage the system during an attack.
  • Page 102 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Intel® Virtualization Technology (Available when supported by the CPU) Select Enabled to support Intel Virtualization Technology, which will allow one platform to run multiple operating systems and applications in independent parti- tions, creating multiple "virtual" systems in one physical computer. The options are Enabled and Disabled.
  • Page 103 Chapter 7: BIOS  CPU C State Control Package C-State limit This feature allows the user to set the limit on the C-State package register. The options are C0/C1 State, C2 State, C6 (Non Retention) State, and C6 (Rententioin) State. CPU C3 Report Select Enabled to allow the BIOS to report the CPU C3 State (ACPI C2) to the operating system.
  • Page 104 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL IIO1 Configuration IOU2 (II0 PCIe Port 1) This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user. The options are x4x4, X8, and Auto. IOU0 (II0 PCIe Port 2) This item configures the PCI-E port Bifuraction setting for a PCI-E port specified by the user.
  • Page 105 Chapter 7: BIOS IOU1 (II02 PCIE Port 3) Use this item to configure the PCI-E port Bifuraction setting for a PCI-E port speci- fied by the user. The options are x4x4x4x4, x4x4x8, x8x4x4, x8x8, x16, and Auto. IOAT (Intel® IO Acceleration) Configuration Enable IOAT Select Enable to enable Intel I/OAT (I/O Acceleration Technology) support, which significantly reduces CPU overhead by leveraging CPU architectural improve-...
  • Page 106 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL QPI (Quick Path Interconnect) Configuration QPI Status The following information will display: • Number of CPU • Number of IIO • Current QPI Link Speed • Current QPI Link Frequency • QPI Global MMIO Low Base/Limit •...
  • Page 107 Chapter 7: BIOS Memory Configuration Enforce POR Select Enable to enforce POR restrictions on DDR4 frequency and voltage programming. The options are Enabled and Disabled. Memory Frequency Use this feature to set the maximum memory frequency for onboard memory modules. The options are Auto, 1333, 1400, 1600, 1800, 1867, 2000, 2133, 2200, 2400, 2600, 2667, and Reserved (Do not select Reserved).
  • Page 108 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Memory RAS (Reliability Availability Serviceability) Configuration Use this submenu to configure the following Memory RAS settings. RAS Mode When Disable is selected, RAS is not supported. When Mirror is selected, the motherboard maintains two identical copies of all data in memory for data backup.
  • Page 109 Chapter 7: BIOS South Bridge Configuration  The following South Bridge information will display: USB Configuration  • USB Module Version • USB Devices Legacy USB Support Select Enabled to support onboard legacy USB devices. Select Auto to disable legacy support if there are no legacy USB devices present. Select Disable to have all USB devices available for EFI applications only.
  • Page 110 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL EHCI2 Select Enabled to enable EHCI (Enhanced Host Controller Interface) support on USB 2.0 connector #2 (-at least one USB 2.0 connector should be enabled for EHCI support.) The options are Disabled and Enabled. XHCI Pre-Boot Drive Select Enabled to enable XHCI (Extensible Host Controller Interface) support on a pre-boot drive specified by the user.
  • Page 111 Chapter 7: BIOS Port 0 ~ Port 5 Spin Up Device On an edge detect from 0 to 1, set this item to allow the PCH to initialize the device. The options are Enabled and Disabled. Port 0 ~ Port 5 SATA Device Type Use this item to specify if the SATA port specified by the user should be con- nected to a Solid State drive or a Hard Disk Drive.
  • Page 112 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Serial ATA Port 0~ Port 5 This item displays the information detected on the installed SATA drives on the particular SATA port. • Model number of drive and capacity • Software Preserve Support Port 0~ Port 5 Select Enabled to enable a SATA port specified by the user.
  • Page 113 Chapter 7: BIOS Support Aggressive Link Power Management When this item is set to Enabled, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link to a low power state when the I/O is inactive for an extended period of time, and the power state will return to normal when the I/O becomes active.
  • Page 114 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL *If the item above "Configure sSATA as" is set to RAID, the following items will display: Support Aggressive Link Power Management When this item is set to Enabled, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link to a low power state when the I/O is inactive for an extended period of time, and the power state will return to normal when the I/O becomes active.
  • Page 115 Chapter 7: BIOS Server ME (Management Engine) Configuration This feature displays the following system ME configuration settings. • General ME Configuration • Operational Firmware Version • Recovery Firmware Version • ME Firmware Features • ME Firmware Status #1 • ME Firmware Status #2 •...
  • Page 116 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Maximum Payload Select Auto for the system BIOS to automatically set the maximum payload value for a PCI-E device to enhance system performance. The options are Auto, 128 Bytes, and 256 Bytes. Maximum Read Request Select Auto for the system BIOS to automatically set the maximum size for a read request for a PCI-E device to enhance system performance.
  • Page 117 Chapter 7: BIOS Onboard LAN1 Option ROM Onboard LAN2 Option ROM Onboard Video Option ROM Use this option to select the type of device installed in LAN Port1, LAN Port2, LAN Port3, LAN Port4, or the onboard video device used for system boot. The default setting for LAN1 Option ROM is PXE, Disabled for LAN2 Option ROM, and Legacy for Onboard Video Option ROM.
  • Page 118 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Serial Port 2 Attribute Select SOL to use COM Port 2 as a Serial_Over_LAN (SOL) port for console redi- rection. The options are COM and SOL. Serial Port Console Redirection  COM 1 COM 1 Console Redirection Select Enabled to enable COM Port 1 Console Redirection, which will allow a client machine to be connected to a host machine at a remote site for networking.
  • Page 119 Chapter 7: BIOS is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits. Select Space to add a Space as a parity bit to be sent with your data bits.
  • Page 120 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL legacy Console Redirection remains enabled upon OS bootup. The options are Always Enable and Bootloader. SOL/COM1 Console Redirection Select Enabled to use the SOL port for Console Redirection. The options are Enabled and Disabled. *If the item above set to Enabled, the following items will become available for user's configuration: SOL/COM1 Console Redirection Settings...
  • Page 121 Chapter 7: BIOS Stop Bits A stop bit indicates the end of a serial data packet. Select 1 Stop Bit for standard serial data communication. Select 2 Stop Bits if slower devices are used. The options are 1 and 2. Flow Control Use this feature to set the flow control for Console Redirection to prevent data loss caused by buffer overflow.
  • Page 122 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Legacy Console Redirection Settings Legacy Console Redirection Settings Use the feature to select the COM port to display redirection of Legacy OS and Legacy OPROM messages. The choices are COM1 and SOL/COM2. Serial Port for Out-of-Band Management/Windows Emergency...
  • Page 123 Chapter 7: BIOS Flow Control Use this item to set the flow control for Console Redirection to prevent data loss caused by buffer overflow. Send a "Stop" signal to stop data-sending when the receiving buffer is full. Send a "Start" signal to start data-sending when the receiving buffer is empty.
  • Page 124: Event Logs

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Event Logs Use this feature to configure Event Log settings. Change SMBIOS Event Log Settings  This feature allows the user to configure SMBIOS Event settings. Enabling/Disabling Options SMBIOS Event Log Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot.
  • Page 125 Chapter 7: BIOS PCI-Ex (PCI-Express) Error Enable Select Yes for the BIOS to correct errors occurred in the PCI-E slots. The options are Yes and No. Erasing Settings Erase Event Log Select Enabled to erase all error events in the SMBIOS (System Management BIOS) log before an event logging is initialized at bootup.
  • Page 126: Ipmi

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL IPMI Use this feature to configure Intelligent Platform Management Interface (IPMI) settings. IPMI Firmware Revision This item indicates the IPMI firmware revision used in your system. IPMI Status This item indicates the status of the IPMI firmware installed in your system.
  • Page 127 Chapter 7: BIOS When SEL is Full This feature allows the user to determine what the BIOS should do when the sys- tem event log is full. Select Erase Immediately to erase all events in the log when the system event log is full. The options are Do Nothing and Erase Immediately. Note: After making changes on a setting, be sure to reboot the system for the changes to take effect.
  • Page 128: Security Settings

    SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL When you have completed the system configuration changes, select this option to save the changes and reboot the computer so that the new system configuration settings can take effect. Select Save Changes and Exit, and press <Enter>. When...
  • Page 129: Boot Settings

    Chapter 7: BIOS Boot Settings Use this feature to configure Boot Settings: Boot Configuration Setup Prompt Timeout Use this item to indicate how many seconds the system shall wait for the BIOS setup activation key to respond before the system starts to boot. The default setting is 1. Boot Mode Select Use this item to select the type of device to be used for system boot.
  • Page 130 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL • Dual Boot Order #4 • Dual Boot Order #5 • Dual Boot Order #6 • Dual Boot Order #7 • Dual Boot Order #8 • Dual Boot Order #9 • Dual Boot Order #10 •...
  • Page 131: Save & Exit

    Chapter 7: BIOS Delete Boot Option Select the target boot device to delete.  Network Drive BBS Priorities • Legacy Boot Order #1 - [IBA GE Slot 0100 ...]  USB Key Drive BBS Priorities • Legacy Boot Order #1 - [Generic USB SD Re...] ...
  • Page 132 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Save Changes and Reset When you have completed the system configuration changes, select this option to leave the BIOS setup utility and reboot the computer for the new system configura- tion parameters can take effect. Select Save Changes and Exit from the Exit menu and press <Enter>.
  • Page 133: Appendix A Bios Error Beep Codes

    Appendix A: BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur. Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process.
  • Page 134 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Notes...
  • Page 135: Appendix B System Specifications

    Appendix B: System Specifications Appendix B System Specifications Note: Unless noted specifications apply to a complete system (all serverboards). Processors Two E5-2600 series processors per node in Socket R LGA 2011 type sockets Note: please refer to our website for details on supported processors. Chipset One C612 chipset per node BIOS...
  • Page 136 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL Chassis SC827HD-R1K28BP (2U rackmount) Dimensions: (WxHxD) 17.25 x 3.47 x 28.5 in. (438 x 88 x 724 mm) Weight Gross (Bare Bone): 85 lbs. (38.6 kg.) System Cooling The system has four (4) 8-cm PWM system cooling fans...
  • Page 137 Appendix B: System Specifications Notes...
  • Page 138 SUPERSERVER 6028TR-DTR/D72R USER'S MANUAL (continued from front) The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in significant injury or loss of life or catastrophic property damage.

This manual is also suitable for:

Superserver 6028tr-d72r

Table of Contents