Table of Contents

Advertisement

Quick Links

S
UPER
®
FatTwin
F617R3-FT
USER'S MANUAL
Revision 1.0a

Advertisement

Table of Contents
loading

Summary of Contents for Supero FatTwin F617R3-FT

  • Page 1 UPER ® FatTwin F617R3-FT USER'S MANUAL Revision 1.0a...
  • Page 2 The information in this User’s Manual has been carefully reviewed and is believed to be accurate. The vendor assumes no responsibility for any inaccuracies that may be contained in this document, makes no commitment to update or to keep current the information in this manual, or to notify any person or organization of the updates.
  • Page 3 SCF418IL-R1K62BP chassis. Chapter 2: Server Installation This chapter describes the steps necessary to install the FatTwin F617R3-FT into a rack and check out the server confi guration prior to powering up the system. If your server was ordered without processor and memory components, this chapter will refer you to the appropriate sections of the manual for their installation.
  • Page 4 FatTwin F617R3-FT USER'S MANUAL Chapter 6: Advanced Chassis Setup Refer to Chapter 6 for detailed information on the SCF418IL-R1K62BP server chassis. You should follow the procedures given in this chapter when installing, removing or reconfi guring SATA or peripheral drives and when replacing system power supply units and cooling fans.
  • Page 5 FatTwin F617R3-FT USER'S MANUAL Notes...
  • Page 6: Table Of Contents

    FatTwin F617R3-FT USER'S MANUAL Table of Contents Chapter 1 Introduction Overview ......................1-1 Serverboard Features ..................1-2 Processors ...................... 1-2 Memory ......................1-2 Serial ATA ....................... 1-2 PCI Expansion Slots ..................1-2 Onboard Controllers/Ports ................1-3 Graphics Controller ..................1-3 Nuvoton WPCM450R Controller ..............
  • Page 7 Table of Contents Rack Precautions .................... 2-2 Server Precautions ..................2-2 Rack Mounting Considerations ............... 2-3 Ambient Operating Temperature ..............2-3 Reduced Airfl ow ..................2-3 Mechanical Loading ................... 2-3 Circuit Overloading ..................2-3 Reliable Ground ..................2-4 Rack Mounting Instructions ................2-4 Identifying the Sections of the Rack Rails ............
  • Page 8 FatTwin F617R3-FT USER'S MANUAL Chapter 5 Advanced Motherboard Setup Handling the Motherboard ................5-1 Precautions ..................... 5-1 Unpacking ....................... 5-1 Connecting Cables ..................5-2 Connecting Data Cables ................. 5-2 I/O Ports ......................5-2 Processor and Heatsink Installation..............5-3 Installing a Passive CPU Heatsink ..............5-7 Removing the Heatsink ...................
  • Page 9 Table of Contents Permanent and Optional Standoffs ..............6-9 6-10 Installing Expansion Cards ................6-11 F418IL PCIE Slot Confi gurations ..............6-11 Installing Front Low-profi le Expansion Cards ..........6-11 Assembling the PCIE Slot Bracket Assembly .......... 6-12 6-11 Installing Air Shrouds ..................6-14 Air Shrouds ....................
  • Page 10 FatTwin F617R3-FT USER'S MANUAL Notes...
  • Page 11: Chapter 1 Introduction

    Chapter 1 Introduction Overview The FatTwin F617R3-FT is a high-end server comprised of two main subsystems: the SCF418IL-R1K62BP 4U server chassis and the X9DRFF dual processor serverboard in eight hot-swap nodes. Please refer to our web site for information on operating systems that have been certifi ed for use with the system (www.
  • Page 12: Serverboard Features

    SATA subsystem, (up to two SATA 3 (6 Gb/s) and four SATA 2 (3 Gb/s)) which is either RAID 0 and 1 (AHCI SATA2) or RAID 0 and 1 (AHCI SATA3) supported. The FatTwin F617R3-FT server however only has two fi xed 3.5" HDD in each node, so the SATA drives are not hot-swappable units.
  • Page 13: Onboard Controllers/Ports

    Chapter 1: Introduction Onboard Controllers/Ports One Fast UART 16550 serial port, one 9-pin RS-232 port are located on the serverboard. The color-coded I/O ports include a VGA (monitor) port, two USB 2.0 ports, an IPMI dedicated LAN port and two Gigabit Ethernet ports. Note: For IPMI Confi...
  • Page 14: Other Features Supported By The Wpcm Bmc Controller

    FatTwin F617R3-FT USER'S MANUAL Other Features Supported by the WPCM BMC Controller The WPCM450R supports the following features: • IPMI 2.0 • Serial over LAN • KVM over LAN • LAN Alerting-SNMP Trap • Event Log • X-Bus parallel interface for I/O expansion •...
  • Page 15: Server Chassis Features

    Chapter 1: Introduction Server Chassis Features The following is a general outline of the main features of the F418IL server chassis. The F418IL chassis is available in a variety of confi gurations. For more information, visit our Web site at www.supermicro.com. System Power Each F418IL chassis model includes a high-effi...
  • Page 16: Air Shrouds

    FatTwin F617R3-FT USER'S MANUAL Air Shrouds The F418IL chassis requires mylar air shrouds for each node to direct the airfl ow where cooling is needed. The air shroud will differ for different motherboards. If using a motherboard which is not the default in the chassis, refer to the optional parts in the Appendix of this manual, or the Supermicro Web site at www.supermicro.com...
  • Page 17 Chapter 1: Introduction Figure 1-1. Intel C602J Chipset: System Block Diagram Note: This is a general block diagram and may not exactly repre- sent the features on your motherboard. See the previous pages for the actual specifi cations of your motherboard. This block diagram is intended for your reference only.
  • Page 18: Contacting Supermicro

    FatTwin F617R3-FT USER'S MANUAL Contacting Supermicro Headquarters Address: Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Web Site: www.supermicro.com Europe Address: Super Micro Computer B.V.
  • Page 19: Fattwin: System Notes

    SATA Drives As a system, the FatTwin F617R3-FT supports the use of two (2) SATA HDD's in fi xed-mounted motherboard trays per node for a total of sixteen (16) HDD drives in the system. These drives are not hot-swappable. Consequently, RAID setup is limited to a two-drive scheme (RAID cannot be spread across all drives).
  • Page 20 FatTwin F617R3-FT USER'S MANUAL Notes 1-10...
  • Page 21: Chapter 2 Server Installation

    Unpacking the System You should inspect the box the FatTwin F617R3-FT was shipped in and note if it was damaged in any way. If the server itself shows damage you should fi le a damage claim with the carrier who delivered it.
  • Page 22: Warnings And Precautions

    FatTwin F617R3-FT USER'S MANUAL Warnings and Precautions Choosing a Setup Location • Leave enough clearance in front of the rack to enable you to open the front door completely (~25 inches) and approximately 30 inches of clearance in the back of the rack to allow for suffi...
  • Page 23: Rack Mounting Considerations

    Chapter 2: Server Installation Rack Mounting Considerations Warning! To prevent bodily injury when mounting or servicing this unit in a rack, you must take special precautions to ensure that the system remains stable. The following guidelines are provided to ensure your safety: •...
  • Page 24: Reliable Ground

    FatTwin F617R3-FT USER'S MANUAL Reliable Ground A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).
  • Page 25: Locking Tabs

    Chapter 2: Server Installation Locking Tabs Each inner rail has a locking tab. This tab locks the chassis into place when installed and pushed fully into the rack. These tabs also lock the chassis in place when fully extended from the rack. This prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing.
  • Page 26: Installing The Rails On A Rack

    FatTwin F617R3-FT USER'S MANUAL Installing the Rails on a Rack Installing the Rails 1. Adjust the length of both rails as described on the previous page. 2. Align the front section of the outer rail with the slots on the front post of the rack.
  • Page 27: Chassis Installation

    Chapter 2: Server Installation Chassis Installation Installing the Chassis into a Rack 1. Confi rm that the rails are correctly installed on the rack. 2. Align the bottom of the chassis with the bottom of the rails. 3. Insert the chassis into the rails, keeping the pressure even on both sides, pushing the chassis into the rack until it clicks into the locked position.
  • Page 28: Checking The Serverboard Setup

    FatTwin F617R3-FT USER'S MANUAL Checking the Serverboard Setup After you install the FatTwin F617R3-FT in the rack, you will need to open the unit to make sure the serverboard is properly installed and all the connections have been made. Accessing the inside of the System Before operating the server for the fi...
  • Page 29: Checking The Drive Bay Setup

    Chapter 2: Server Installation Checking the Drive Bay Setup Next, you should check to make sure the peripheral drives and the SATA drives have been properly installed and all connections have been made. Checking the Drives 1. For the F617R3-FT server, all hard drives are fi xed on the motherboard tray and can only be retrieved by removing the top cover.
  • Page 30 FatTwin F617R3-FT USER'S MANUAL Notes 2-10...
  • Page 31: Chapter 3 System Interface

    Chapter 3: System Interface Chapter 3 System Interface Overview There are several LEDs on the control panel and on the drive carriers to keep you constantly informed of the overall status of the system. F418IL chassis with front I/O (right image below) have a power button LED and a UID indicator, with additional LED indicators directly on the motherboard.
  • Page 32: Control Panel Buttons

    FatTwin F617R3-FT USER'S MANUAL Control Panel Buttons • Power: The main power button on each of the four control panels is used to apply or remove power from the power supply to each of the four systems in the chassis. Turning off system power with this button removes the main power, but keeps standby power supplied to the system.
  • Page 33: Chapter 4 Standardized Warning Statements For Ac Systems

    Chapter 4: Warning Statements for AC Systems Chapter 4 Standardized Warning Statements for AC Systems About Standardized Warning Statements The following statements are industry standard warnings, provided to warn the user of situations which have the potential for bodily injury. Should you have questions or experience difficulty, contact Supermicro's Technical Support department for assistance.
  • Page 34 FatTwin F617R3-FT USER'S MANUAL Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befi nden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut.
  • Page 35 Warning Statements for AC Systems ‫ﺟﺴﺪﻳﺔ‬ ‫ﺍﺻﺎﺑﺔ‬ ‫ﺗﺘﺴﺒﺐ ﻓﻲ‬ ‫ﺣﺎﻟﺔ ﻳﻤﻜﻦ ﺃﻥ‬ ‫ﺍﻧﻚ ﻓﻲ‬ ‫ﺧﻄﺮ‬ ‫ﻳﻌﻨﻲ‬ ‫ﻫﺬﺍ ﺍﻟﺮﻣﺰ‬ !‫ﺗﺤﺬﻳﺮ‬ ‫ﺍﻟﺪﻭﺍﺋﺮ‬ ‫ﺑﺎﻟﻤﺨﺎﻁﺮ ﺍﻟﻨﺎﺟﻤﺔ ﻋﻦ‬ ‫ﻦ ﻋﻠﻰ ﻋﻠﻢ‬ ، ‫ﻛ‬ ‫ﻣﻌﺪﺍﺕ‬ ‫ﺗﻌﻤﻞ ﻋﻠﻰ ﺃﻱ‬ ‫ﻗﺒﻞ ﺃﻥ‬ ‫ﺍﻟﻜﻬﺮﺑﺎﺋﻴﺔ‬ ‫ﺣﻮﺍﺩﺙ‬ ‫ﺃﻱ‬ ‫ﻭﻗﻮﻉ‬ ‫ﻤﻨﻊ‬ ‫ﻟ‬ ‫ﺍﻟﻮﻗﺎﺋﻴﺔ‬...
  • Page 36: Installation Instructions

    FatTwin F617R3-FT USER'S MANUAL Installation Instructions Warning! Read the installation instructions before connecting the system to the power source. 設置手順書 システムを電源に接続する前に、 設置手順書をお読み下さい。 警告 将此系统连接电源前,请先阅读安装说明。 警告 將系統與電源連接前,請先閱讀安裝說明。 Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación.
  • Page 37: Circuit Breaker

    Chapter 4: Warning Statements for AC Systems Circuit Breaker Warning! This product relies on the building's installation for short-circuit (overcurrent) protection. Ensure that the protective device is rated not greater than: 250 V, 20 A. サーキッ ト ・ ブレーカー この製品は、 短絡 (過電流) 保護装置がある建物での設置を前提としています。 保護装置の定格が250 V、...
  • Page 38: Power Disconnection Warning

    FatTwin F617R3-FT USER'S MANUAL ‫ﻓﻲ‬ ‫ﺍﻟﺘﻲ ﺗﻢ ﺗﺜﺒﻴﺘﻬﺎ‬ ‫ﻣﻦ ﺍﻟﺪﻭﺍﺋﺮﺍﻟﻘﺼﻴﺮﺓ‬ ‫ﺍﻟﺤﻤﺎﻳﺔ‬ ‫ﻣﻌﺪﺍﺕ‬ ‫ﻳﻌﺘﻤﺪ ﻋﻠﻰ‬ ‫ﻫﺬﺍ ﺍﻟﻤﻨﺘﺞ‬ ‫ﺍﻟﻤﺒﻨﻰ‬ ‫ﺃﻛﺜﺮ ﻣﻦ‬ ‫ﻟﻴﺲ‬ ‫ﻮﻗﺎﺋﻲ‬ ‫ﺍﻟ‬ ‫ﺍﻟﺠﻬﺎﺯ‬ ‫ﺗﻘﻴﻴﻢ‬ ‫ﺃﻥ‬ ‫ﺗﺄﻛﺪ ﻣﻦ‬ 20A, 250V 경고! 이 제품은 전원의 단락(과전류)방지에 대해서 전적으로 건물의 관련 설비에 의존합니다. 보호장치의 정격이 반드시 250V(볼트), 20A(암페어)를 초과하지...
  • Page 39 Chapter 4: Warning Statements for AC Systems Warnung Das System muss von allen Quellen der Energie und vom Netzanschlusskabel getrennt sein, das von den Spg.Versorgungsteilmodulen entfernt wird, bevor es auf den Chassisinnenraum zurückgreift, um Systemsbestandteile anzubringen oder zu entfernen. ¡Advertencia! El sistema debe ser disconnected de todas las fuentes de energía y del cable eléctrico quitado de los módulos de fuente de alimentación antes de tener acceso el interior del chasis para instalar o para quitar componentes de sistema.
  • Page 40: Equipment Installation

    FatTwin F617R3-FT USER'S MANUAL Equipment Installation Warning! Only trained and qualifi ed personnel should be allowed to install, replace, or service this equipment. 機器の設置 トレーニングを受け認定された人だけがこの装置の設置、 交換、 またはサービスを許可 されています。 警告 只有经过培训且具有资格的人员才能进行此设备的安装、更换和维修。 警告 只有經過受訓且具資格人員才可安裝、更換與維修此設備。 Warnung Das Installieren, Ersetzen oder Bedienen dieser Ausrüstung sollte nur geschultem, qualifi...
  • Page 41: Restricted Area

    Chapter 4: Warning Statements for AC Systems Waarschuwing Deze apparatuur mag alleen worden geïnstalleerd, vervangen of hersteld door geschoold en gekwalifi ceerd personeel. Restricted Area Warning! This unit is intended for installation in restricted access areas. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security.
  • Page 42: Battery Handling

    FatTwin F617R3-FT USER'S MANUAL ‫אזור עם גישה מוגבלת‬ !‫אזהרה‬ ‫יש להתקין את היחידה באזורים שיש בהם הגבלת גישה. הגישה ניתנת בעזרת‬ .('‫כלי אבטחה בלבד )מפתח, מנעול וכד‬ ‫ﻣﺤﻈﻮﺭﺓ‬ ‫ﻣﻨﺎﻁﻖ‬ ‫ﻟﺘﺮﻛﻴﺒﻬﺎ ﻓﻲ‬ ‫ﻫﺬﻩ ﺍﻟﻮﺣﺪﺓ‬ ‫ﺗﺨﺼﻴﺺ‬ ‫ﺗﻢ‬ ،‫ﺃﺩﺍﺓ ﺧﺎﺻﺔ‬ ‫ﻣﻦ ﺧﻼﻝ ﺍﺳﺘﺨﺪﺍﻡ‬...
  • Page 43 Chapter 4: Warning Statements for AC Systems Warnung Bei Einsetzen einer falschen Batterie besteht Explosionsgefahr. Ersetzen Sie die Batterie nur durch den gleichen oder vom Hersteller empfohlenen Batterietyp. Entsorgen Sie die benutzten Batterien nach den Anweisungen des Herstellers. Attention Danger d'explosion si la pile n'est pas remplacée correctement. Ne la remplacer que par une pile de type semblable ou équivalent, recommandée par le fabricant.
  • Page 44: Redundant Power Supplies

    FatTwin F617R3-FT USER'S MANUAL Redundant Power Supplies Warning! This unit might have more than one power supply connection. All connections must be removed to de-energize the unit. 冗長電源装置 このユニッ トは複数の電源装置が接続されている場合があります。 ユニッ トの電源を切るためには、 すべての接続を取り外さなければなりません。 警告 此部件连接的电源可能不止一个,必须将所有电源断开才能停止给该部件供电。 警告 此裝置連接的電源可能不只一個,必須切斷所有電源才能停止對該裝置的供電。 Warnung Dieses Gerät kann mehr als eine Stromzufuhr haben. Um sicherzustellen, dass der Einheit kein trom zugeführt wird, müssen alle Verbindungen entfernt werden.
  • Page 45: Backplane Voltage

    Chapter 4: Warning Statements for AC Systems ‫ﺍﻣﺪﺍﺩ ﺍﻟﻄﺎﻗﺔ‬ ‫ﺑﻮﺣﺪﺍﺕ‬ ‫ﻋﺪﺓ ﺍﺗﺼﺎﻻﺕ‬ ‫ﺠﻬﺎﺯ‬ ‫ﺍﻟ‬ ‫ﻳﻜﻮﻥ ﻟﻬﺬﺍ‬ ‫ﻗﺪ‬ ‫ﺍﻟﻜﻬﺮﺑﺎء‬ ‫ﻋﻦ‬ ‫ﻮﺣﺪﺓ‬ ‫ﺍﻟ‬ ‫ﻟﻌﺰﻝ‬ ‫ﻛﺎﻓﺔ ﺍﻻﺗﺼﺎﻻﺕ‬ ‫ﻳﺠﺐ ﺇﺯﺍﻟﺔ‬ 경고! 이 장치에는 한 개 이상의 전원 공급 단자가 연결되어 있을 수 있습니다. 이 장치에 전원을...
  • Page 46: Comply With Local And National Electrical Codes

    FatTwin F617R3-FT USER'S MANUAL Attention Lorsque le système est en fonctionnement, des tensions électriques circulent sur le fond de panier. Prendre des précautions lors de la maintenance. ‫מתח בפנל האחורי‬ !‫הרה‬ ‫אז‬ ‫קיימת סכנת מתח בפנל האחורי בזמן תפעול המערכת. יש להיזהר במהלך‬...
  • Page 47: Product Disposal

    Chapter 4: Warning Statements for AC Systems ¡Advertencia! La instalacion del equipo debe cumplir con las normas de electricidad locales y nacionales.Attention L'équipement doit être installé conformément aux normes électriques nationales et locales. ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ ‫הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫התקנת‬...
  • Page 48: Hot Swap Fan Warning

    FatTwin F617R3-FT USER'S MANUAL Warnung Die Entsorgung dieses Produkts sollte gemäß allen Bestimmungen und Gesetzen des Landes erfolgen. ¡Advertencia! Al deshacerse por completo de este producto debe seguir todas las leyes y reglamentos nacionales. Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement.
  • Page 49 Chapter 4: Warning Statements for AC Systems 当您从机架移除风扇装置,风扇可能仍在转动。小心不要将手指、螺丝起子和其他 物品太靠近风扇 警告 當您從機架移除風扇裝置,風扇可能仍在轉動。小心不要將手指、螺絲起子和其他 物品太靠近風扇。 Warnung Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt. ¡Advertencia! Los ventiladores podran dar vuelta cuando usted quite ell montaje del ventilador del chasis.
  • Page 50: Power Cable And Ac Adapter

    FatTwin F617R3-FT USER'S MANUAL Waarschuwing Het is mogelijk dat de ventilator nog draait tijdens het verwijderen van het ventilatorsamenstel uit het chassis. Houd uw vingers, schroevendraaiers en eventuele andere voorwerpen uit de buurt van de openingen in de ventilatorbehuizing. Power Cable and AC Adapter...
  • Page 51 Chapter 4: Warning Statements for AC Systems ¡Advertencia! Al instalar el producto, utilice los cables de conexión previstos o designados, los cables y adaptadores de CA. La utilización de otros cables y adaptadores podría ocasionar un mal funcionamiento o un incendio. Aparatos Eléctricos y la Ley de Seguridad del Material prohíbe el uso de UL o CSA cables certifi...
  • Page 52 FatTwin F617R3-FT USER'S MANUAL Waarschuwing Bij het installeren van het product, gebruik de meegeleverde of aangewezen kabels, stroomkabels en adapters. Het gebruik van andere kabels en adapters kan leiden tot een storing of een brand. Elektrisch apparaat en veiligheidsinformatiebladen wet verbiedt het gebruik van UL of CSA gecertifi...
  • Page 53: Chapter 5 Advanced Motherboard Setup

    Chapter 5: Advanced Motherboard Setup Chapter 5 Advanced Motherboard Setup This chapter covers the steps required to install the X9DRFF motherboard into the chassis, connect the data and power cables and install add-on cards. All motherboard jumpers and connections are also described. A layout and quick reference chart are included in this chapter for your reference.
  • Page 54: Connecting Cables

    (make sure the red wires connect to the pin 1 locations). If you are confi guring the system, keep the airfl ow in mind when routing the cables. The following cables need to be connected for the FatTwin F617R3-FT system: •...
  • Page 55: Processor And Heatsink Installation

    Chapter 5: Advanced Motherboard Setup Processor and Heatsink Installation Caution! When handling the processor package, avoid placing direct pressure on the label area. Note: Always connect the power cord last, and always remove it before adding, removing or changing any hardware components. Make sure that you install the processor into the CPU socket before you install the CPU heatsink.
  • Page 56 FatTwin F617R3-FT USER'S MANUAL 2. Press the second load lever labeled 'Close 1st' to release the load plate that covers the CPU socket from its locking position. Press down on Load the Pull lever away Lever labeled 'Close 1st' from the socket 3.
  • Page 57 Chapter 5: Advanced Motherboard Setup 5. Use your thumb and index fi nger to hold the CPU on its edges. Align the CPU keys, which are semi-circle cutouts, against the socket keys. Socket Keys CPU Keys 6. Once they are aligned, carefully lower the CPU straight down into the socket. (Do not drop the CPU on the socket.
  • Page 58 FatTwin F617R3-FT USER'S MANUAL 7. With the CPU inside the socket, inspect the four corners of the CPU to make sure that the CPU is properly installed. 8. Close the load plate with the CPU inside the socket. Lock the lever labeled 'Close 1st' fi...
  • Page 59: Installing A Passive Cpu Heatsink

    Chapter 5: Advanced Motherboard Setup Installing a Passive CPU Heatsink 1. Do not apply any thermal grease to the heatsink or the CPU die -- the required amount has already been applied. 2. Place the heatsink on top of the CPU so that the four mounting holes are aligned with those on the Motherboard's and the Heatsink Bracket underneath.
  • Page 60: Removing The Heatsink

    FatTwin F617R3-FT USER'S MANUAL Removing the Heatsink Caution: We do not recommend that the CPU or the heatsink be removed. However, if you do need to uninstall the heatsink, please follow the instructions below to avoid damaging the CPU or the CPU socket.
  • Page 61: Installing Memory

    Chapter 5: Advanced Motherboard Setup Installing Memory Warning: Exercise extreme care when installing or removing DIMM modules to prevent any possible damage. Installing Memory 1. Insert the desired number of DIMMs into the memory slots, starting with P1- DIMM #1A. (For best performance, please use the memory modules of the same type and speed in the same bank.) 2.
  • Page 62: Removing Memory Modules

    FatTwin F617R3-FT USER'S MANUAL Removing Memory Modules Press both notches on the ends of the DIMM module to unlock it. Once the DIMM module is loosened, remove it from the memory slot. Memory Support The X9DRFF motherboard supports up to 256 GB of 240-pin Registered (RDIMM)/ Load Reduced (LRDIMM) ECC or up to 64 GB of Unbuffered (UDIMM) ECC/Non- ECC DDR3-1600/1333/1066/800 MHz 4- channel memory in eight (8) DIMM slots.
  • Page 63 Chapter 5: Advanced Motherboard Setup Installing UDIMM (ECC/Non-ECC) Memory Intel E5-2600 Series Processor UDIMM Memory Support Ranks Per Memory Capacity Speed (MT/s) and Voltage Validated DIMM & Per DIMM by Slot per Channel (SPC) and Data Width DIMM Per Channel (DPC) (See the Note below) 1.35V 1.5V...
  • Page 64: Adding Pci Expansion Cards

    FatTwin F617R3-FT USER'S MANUAL Intel E5-2600 Series Processor LRDIMM Memory Support Ranks Per Memory Capacity Speed (MT/s) and Voltage Validated DIMM & Per DIMM by Slot per Channel (SPC) and Data Width DIMM Per Channel (DPC) 1.35V 1.5V (See the...
  • Page 65: Motherboard Details

    Chapter 5: Advanced Motherboard Setup Motherboard Details Figure 5-4. X9DRFF Motherboard Layout (not drawn to scale) VGA1 JFLED2 LAN2 LAN1 IPMI_LAN CTRL CTRL CTRL BUZZER Intel BATTERY X9DRFF Rev. 1.10 CPU1 CLOSE 1st I-SATA0 I-SATA1 I-SATA2 I-SATA3 USB2 OPEN 1st I-SATA4 I-SATA5 JSD1...
  • Page 66 FatTwin F617R3-FT USER'S MANUAL Notes: 1. For the latest CPU/Memory updates, please refer to our website at http:// www.supermicro.com/products/motherboard/ for details. 2. Use only the correct type of onboard CMOS battery as specifi ed by the manufacturer. Do not install the onboard battery upside down to avoid possible explosion.
  • Page 67 Chapter 5: Advanced Motherboard Setup Connector Description COM1 Serial (COM) Port FAN1/FAN2 CPU/System (4-Pin) Fan Headers JIPMB1 4-pin External BMC I2C Header (for an IPMI Card) JP3/JP4 4-pin Power Connectors 8-pin Power Connector JSD1 SATA Device Power Connector JSTBYI Standby Power Connector JTPM1 TPM (Trusted Platform Module)/Port 80 LAN1/LAN2...
  • Page 68: Connector Defi Nitions

    FatTwin F617R3-FT USER'S MANUAL Connector Defi nitions An 8-pin power connector (JP5) and 12V 8-pin PWR two 4-pin power connectors (JP3/JP4) Pin Defi nitions are located on the motherboard. These Pins Defi nition power connectors meet the SSI EPS 12V...
  • Page 69 Chapter 5: Advanced Motherboard Setup Universal Serial Bus (USB) Backplane USB 0/1 & FP USB 2 Two Universal Serial Bus ports (USB1, Pin Defi nitions USB2) are located at (JUSB1, JUSB2) Pin# Defi nition the I/O back panel. (USB Cables are not included).
  • Page 70 FatTwin F617R3-FT USER'S MANUAL TPM Header/Port 80 TPM/Port 80 Header (JTPM1) Pin Defi nitions A Trusted Platform Module/Port 80 Pin# Defi nition Pin# Defi nition header is located at JTPM1 to provide LCLK TPM support and Port 80 connection. LFRAME# <(KEY)>...
  • Page 71: Jumper Settings

    Chapter 5: Advanced Motherboard Setup Jumper Settings Connector Pins Explanation of Jumpers To modify the operation of the motherboard, Jumper jumpers can be used to choose between optional settings. Jumpers create shorts between two pins to change the function Setting of the connector.
  • Page 72 FatTwin F617R3-FT USER'S MANUAL GLAN Enable/Disable GLAN Enable Jumper Settings JPL1 enables or disables the LAN Port1/ Jumper Setting Defi nition LAN Port2 on the motherboard. See the Enabled (default) table on the right for jumper settings. Disabled The default setting is Enabled.
  • Page 73: 5-10 Onboard Indicators

    Chapter 5: Advanced Motherboard Setup BMC-Failure LED Enable BMC Support Enable Jumper Settings Use the jumper JFLED2 to enable BMC- Jumper Setting Defi nition Failure LED indicator to indicate a BMC Open Enabled failure. See the table on the right for Closed Disabled (Default) jumper settings.
  • Page 74 FatTwin F617R3-FT USER'S MANUAL Onboard Power LED Onboard PWR LED Indicator (LED5) LED Settings An Onboard Power LED is located at LED Color Status LED5 on the motherboard. When this System Off (PWR LED is on, the system is on. Be sure...
  • Page 75: 5-11 Serial Ata Connections

    Chapter 5: Advanced Motherboard Setup 5-11 Serial ATA Connections SATA Ports SATA Pin Defi nitions There are six Serial_ATA ports on the Pin# Defi nition motherboard. I-SATA ports 0/1 support Ground SATA 3.0. I-SATA ports 2-5 supports TX_P SATA 2.0 connections. See the table on the right for pin defi...
  • Page 76: 5-11 Installing Drivers

    FatTwin F617R3-FT USER'S MANUAL 5-11 Installing Drivers The Supermicro ftp site contains drivers and utilities for your system at ftp://ftp. supermicro.com. Some of these must be installed, such as the chipset driver. After accessing the ftp site, go into the CDR_Images directory and locate the ISO fi...
  • Page 77 SuperDoctor III, as the SuperDoctor III settings override the BIOS settings. To set the BIOS temperature threshold settings again, you would fi rst need to uninstall SuperDoctor III. Figure 5-7. Supero Doctor III Interface Display Screen (Health Information) 5-25...
  • Page 78: Superdoctor Iii

    FatTwin F617R3-FT USER'S MANUAL Figure 5-8. Supero Doctor III Interface Display Screen (Remote Control) Note: The SuperDoctor III program and User’s Manual can be downloaded from the Supermicro web site at http://www.supermicro.com/products/accessories/software/ SuperDoctorIII.cfm.For Linux, we recommend that you use the SuperoDoctor II application instead.
  • Page 79: 5-13 Serverboard Battery

    Chapter 5: Advanced Motherboard Setup 5-13 Serverboard Battery Caution: There is a danger of explosion if the onboard battery is installed upside down, which will reverse its polarites (see Figure 5-9). This battery must be replaced only with the same or an equivalent type recommended by the manufacturer (CR2032).
  • Page 80 FatTwin F617R3-FT USER'S MANUAL Notes 5-28...
  • Page 81: Chapter 6 Advanced Chassis Setup

    Chapter 6: Advanced Chassis Setup Chapter 6 Advanced Chassis Setup This chapter covers the steps required to install components and perform maintenance on the SCF418IL-R1K62BP chassis. For component installation, follow the steps in the order given to eliminate the most common problems encountered. If some steps are unnecessary, skip ahead to the step that follows.
  • Page 82: Control Panel

    FatTwin F617R3-FT USER'S MANUAL Figure 6-1. Front Chassis Views VGA Port IPMI LAN Port Control Panel USB Ports SAS/SATA Drives (16) Ethernet Ports Rear Fan Power Supply Control Panel The control panel for each node is located on the front of the chassis. The LEDs inform you of system status.
  • Page 83: Removing The Power Cord

    Chapter 6: Advanced Chassis Setup Removing the Power Cord Before performing any setup or maintenance on the chassis, use the following procedure to ensure that power has been removed disconnected from the system. Removing the Power Cord 1. Use the operating system to power down the system, following the on-screen prompts.
  • Page 84: Removing Nodes From The Chassis

    FatTwin F617R3-FT USER'S MANUAL Removing Nodes from the Chassis Each of the eight individual nodes may be removed from the chassis. Note that when a node is removed from the chassis, the hard drives located in the node will shut-down.
  • Page 85: Node Confi Guration

    Chapter 6: Advanced Chassis Setup Node Confi guration SCF418IL-R1K62BP Node Layout The specifi cations for the SCF418IL-R1K62BP nodes are shown in the table below and the layout is shown in Figure 6-4. SCF418IL-R1K62BP Node Layout Specifi cations Front of Node Rear of Node One low-profi...
  • Page 86: Nodes And Associated Hard Drives

    FatTwin F617R3-FT USER'S MANUAL Nodes and Associated Hard Drives The F418IL chassis contains eight individual motherboards in separate 1U nodes. Each node controls the hard drives contained within that node. Note that if a node is pulled out of the chassis, the hard drives associated with that node will power down as well.
  • Page 87: Installing And Removing 3.5" Fixed Hard Drives

    Chapter 6: Advanced Chassis Setup Installing and Removing 3.5" Fixed Hard Drives Removing 3.5" Fixed Hard Drives from the Node 1. Power down the system and remove the power cords from the rear of the power supplies as described in Section 6-3. Remove the node from the chassis as described in Section 6-5 and remove the cover from the node as described in Section 6-6.
  • Page 88 FatTwin F617R3-FT USER'S MANUAL 6. Install a replacement drive into the hard drive tray and secure it to the tray with the screws previously set aside. 7. Secure the hard drive tray to the fl oor of the node with the screw previously set aside.
  • Page 89: Installing The Motherboard

    Chapter 6: Advanced Chassis Setup Installing the Motherboard Compatible Motherboards For the most up-to-date information on compatible motherboards and other parts, visit the Supermicro Web site at www.supermicro.com. Permanent and Optional Standoffs Standoffs prevent short circuits by creating space between the motherboard and the fl...
  • Page 90 FatTwin F617R3-FT USER'S MANUAL 8. Connect the cables between the motherboard, backplane, chassis, front panel, and power supply, as needed. The fans may be temporarily removed to allow access to the backplane ports. 9. Replace the expansion card bracket and secure the bracket with a screw.
  • Page 91: 6-10 Installing Expansion Cards

    Chapter 6: Advanced Chassis Setup 6-10 Installing Expansion Cards F418IL PCIE Slot Confi gurations Some F418IL chassis models support one or more expansion cards in each node, Refer to the tables below to determine the PCIE slot confi guration for your particular chassis.
  • Page 92: Assembling The Pcie Slot Bracket Assembly

    FatTwin F617R3-FT USER'S MANUAL Assembling the PCIE Slot Bracket Assembly Each node supports one expansion card. This expansion card must be plugged into a riser card, which in turn plugs into the motherboard. Assembling the PCIE Slot Bracket Assembly 1. Power down the system and remove the power cords from the rear of the power supplies as described in Section 6-3.
  • Page 93 Chapter 6: Advanced Chassis Setup 5. Secure the riser card to the PCIE slot bracket using the two screws included in the accessory box. Figure 6-13: Installing the Riser Card and Bracket Bracket Mounting Screws 6. Insert the riser card into the appropriate slot on the motherboard. 7.
  • Page 94: 6-11 Installing Air Shrouds

    FatTwin F617R3-FT USER'S MANUAL 6-11 Installing Air Shrouds Air Shrouds Air shrouds concentrate airfl ow to maximize fan effi ciency. The F418IL and F418ILL chassis require an air shroud in each node. Installing an Air Shroud 1. Power down the system and remove the power cords from the rear of the power supplies as described in Section 6-3.
  • Page 95: 6-12 Removing And Installing System Fans

    Chapter 6: Advanced Chassis Setup 6-12 Removing and Installing System Fans Removing and Installing External System Fans Removing a Rear Exhaust Fan 1. Determine which node contains the failed fan and power down the node with the operating system. 2. Remove the power cord from the rear of the node as described on page 6-2. 3.
  • Page 96: 6-13 Replacing The Power Supplies

    FatTwin F617R3-FT USER'S MANUAL 6-13 Replacing the Power Supplies The F418IL chassis includes redundant 1620 Watt power supplies. These power supplies are auto-switching capable. This enables the power supplies to automatically sense and operate at a 100v to 240v input voltage. An amber light will be illuminated on the power supply when the power is off.
  • Page 97: Chapter 7 Bios

    Chapter 7: BIOS Chapter 7 BIOS Introduction This chapter describes the AMI BIOS Setup Utility for the X9DRFF serverboard. The 16 MB AMI BIOS® is stored in a Flash EEPROM and can be easily updated. This chapter describes the basic navigation of the AMI BIOS Setup Utility setup screens. Starting BIOS Setup Utility To enter the AMI BIOS Setup utility screens, press the <Del>...
  • Page 98: Starting The Setup Utility

    FatTwin F617R3-FT FatTwin Starting the Setup Utility Normally, the only visible Power-On Self-Test (POST) routine is the memory test. As the memory is being tested, press the <Delete> key to enter the main menu of the AMI BIOS Setup utility. From the main menu, you can access the other setup screens.
  • Page 99 Chapter 7: BIOS The AMI BIOS main menu displays the following information: System Date This item displays the system date in Day MM/DD/YY format (e.g. Wed 10/12/2012). System Time This item displays the system time in HH:MM:SS format (e.g. 15:32:52). Supermicro X9DRFF (-7) Version This item displays the SMC version of the BIOS ROM used in this system.
  • Page 100: Advanced Setup Confi Gurations

    FatTwin F617R3-FT FatTwin This displays the amount of memory that is available in the system. Advanced Setup Confi gurations Use the arrow keys to select Advanced Setup and press <Enter> to access the following submenu items.  Boot Feature Quiet Boot This feature allows the user to select bootup screen display between POST messages and the OEM logo.
  • Page 101 Chapter 7: BIOS Use this feature to set the Power-on state for the Num Lock key. The options are Off and On. Wait For 'F1' If Error Select Enabled to force the system to wait until the 'F1' key is pressed if an error occurs.
  • Page 102 FatTwin F617R3-FT FatTwin system power to be turned on after a power loss. Select Last State to allow the system to resume its last state before a power loss. The options are Power On, Stay Off, and Last State.  CPU Confi guration This submenu displays the information of the CPU as detected by the BIOS.
  • Page 103 Chapter 7: BIOS Select Enable to enable Clock Spectrum support, which will allow the BIOS to monitor and attempt to reduce the level of Electromagnetic Interference caused by the components whenever needed. The options are Disabled and Enabled. RTID (Record Types IDs) This feature displays the total number of Record Type IDs for local and remote pools.
  • Page 104 FatTwin F617R3-FT FatTwin If this feature is set to Disabled, The CPU prefetches the cache line for 64 bytes. If this feature is set to Enabled the CPU fetches both cache lines for 128 bytes as comprised. The options are Disabled and Enabled.
  • Page 105 Chapter 7: BIOS Turbo Mode (Available when Power Technology is set to Custom and EIST is enabled) This feature allows processor cores to run faster than marked frequency in specifi c conditions. The options are Disabled and Enabled. C1E Support (Available when Power Technology is set to Custom) Select Enabled to enable Enhanced C1 Power State to boost system performance.
  • Page 106 FatTwin F617R3-FT FatTwin Factory Long Duration Maintained This item displays the period of time (in seconds) set by the manufacturer during which long duration power is maintained. Long Duration Maintained This item displays the period of time (in seconds) during which long duration power is maintained.
  • Page 107 Chapter 7: BIOS When set to Enabled, this feature uses Intel's DCA (Direct Cache Access) Technology to improve data transfer effi ciency. The default setting is Enabled. MMCFG BASE This feature determines the lowest base address that can be assigned to PCI devices.
  • Page 108 FatTwin F617R3-FT FatTwin Isoc Select Enabled to enable Isochronous support to meet QoS (Quality of Service) requirements. This feature is especially important for virtualization technology. The options are Enabled and Disabled. QPI (Quick Path Interconnect) Link Speed Mode Use this feature to select data transfer speed for QPI Link connections. The options are Fast and Slow.
  • Page 109 Chapter 7: BIOS When Independent is selected, all DIMMs are available to the operating system. When Mirroring is selected, the motherboard maintains two identical copies of all data in memory for data backup. When Lockstep is selected, the motherboard uses two areas of memory to run the same set of operations in parallel.
  • Page 110 FatTwin F617R3-FT FatTwin source). Memory is updated as well. Select Enabled to use Demand Scrubbing for ECC memory correction. The options are Enabled and Disabled. Data Scrambling Select Enabled to enable data scrambling to ensure data security and integrity. The options are Disabled and Enabled.
  • Page 111 Chapter 7: BIOS available for EFI (Extensive Firmware Interface) applications only. The settings are Disabled, Enabled and Auto. Port 60/64 Emulation Select Enabled to enable I/O port 60h/64h emulation support for the legacy USB keyboard so that it can be fully supported by the operating systems that does not recognize a USB device.
  • Page 112 FatTwin F617R3-FT FatTwin When Enabled, the SATA AHCI controller manages the power usage of the SATA link. The controller will put the link in a low power mode during extended periods of I/O inactivity, and will return the link to an active state when I/O activity resumes.
  • Page 113 Chapter 7: BIOS SERR# Generation Select Enabled to allow a PCI device to generate an SERR number for a PCI Bus Signal Error Event. The options are Enabled and Disabled. Maximum Payload Select Auto to allow the system BIOS to automatically set the maximum payload value for a PCI-E device to enhance system performance.
  • Page 114 FatTwin F617R3-FT FatTwin Load Onboard SAS OPROM Select Enabled to enable the onboard SAS Option ROM. This is to boot the computer using a SAS device. The options are Disabled and Enabled. VGA Priority This feature allows the user to select the graphics adapter to be used as the primary boot device.
  • Page 115 Chapter 7: BIOS 12; IO=2F8h; IRQ=3, 4, 5, 6, 7, 10, 11, 12; IO=3E8h; IRQ=3, 4, 5, 6, 7, 10, 11, 12; IO=2E8h; IRQ=3, 4, 5, 6, 7, 10, 11, 12; Device Mode Use this feature to select the desired mode for a serial port specifi ed. The options are Normal and High Speed.
  • Page 116 FatTwin F617R3-FT FatTwin  Console Redirection Settings This feature allows the user to specify how the host computer will exchange data with the client computer, which is the remote computer used by the user. Terminal Type This feature allows the user to select the target terminal emulation type for Console Redirection.
  • Page 117 Chapter 7: BIOS VT-UTF8 Combo Key Support Select Enabled to enable VT-UTF8 Combination Key support for ANSI/VT100 terminals. The options are Enabled and Disabled. Recorder Mode Select Enabled to capture the data displayed on a terminal and send it as text messages to a remote server.
  • Page 118 FatTwin F617R3-FT FatTwin The feature selects a serial port used by the Microsoft Windows Emergency Management Services (EMS) to communicate with a remote server. The options are COM1 and SOL. Terminal Type This feature allows the user to select the target terminal emulation type for Console Redirection.
  • Page 119 Chapter 7: BIOS This feature enables the Non-Uniform Memory Access ACPI support. The options are Enabled and Disabled. High Precision Event Timer Select Enabled to activate the High Precision Event Timer (HPET) that produces periodic interrupts at a much higher frequency than a Real-time Clock (RTC) does in synchronizing multimedia streams, providing smooth playback, reducing the dependency on other timestamp calculation devices, such as an x86 RDTSC Instruction embedded in the CPU.
  • Page 120 FatTwin F617R3-FT FatTwin This item displays the status of TPM Support to indicate if TPM is currently active or deactivated. TPM Owner Status This item displays the status of TPM Ownership.  Intel TXT (LT-SX) Confi guration Intel TXT (LT-SX) Hardware Support This feature indicates if the following hardware components support the Intel Trusted Execution Technology.
  • Page 121: Event Logs

    Chapter 7: BIOS TPM Support Trusted Platform support TPM State Trusted Platform state  ME Subsystem This feature displays the following ME Subsystem Confi guration settings. • ME BIOS Interface Version • ME Version Event Logs Use this feature to confi gure Event Log settings. ...
  • Page 122 FatTwin F617R3-FT FatTwin Enabling/Disabling Options SMBIOS Event Log Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot. The options are Enabled and Disabled. Runtime Error Logging Support Select Enabled to support Runtime Error Logging. The options are Enabled and Disabled.
  • Page 123: Ipmi

    Chapter 7: BIOS MECI (Multiple Event Count Increment) Enter the increment value for the multiple event counter. Enter a number between 1 to 255. The default setting is 1. METW (Multiple Event Count Time Window) This item allows the user to decide how long (in minutes) should the multiple event counter wait before generating a new event log.
  • Page 124 FatTwin F617R3-FT FatTwin IPMI Firmware Revision This item indicates the IPMI fi rmware revision used in your system. IPMI Status This item indicates the status of the IPMI fi rmware installed in your system.  System Event Log Enabling/Disabling Options SEL Components Select Enabled for all system event logging at bootup.
  • Page 125 Chapter 7: BIOS Confi guration Address Source This feature allows the user to select the source of the IP address for this computer. If Static is selected, you will need to know the IP address of this computer and enter it to the system manually in the fi...
  • Page 126: Boot

    FatTwin F617R3-FT FatTwin This item displays the Gateway IP address for this computer. This should be in decimal and in dotted quad form (i.e., 192.168.10.253). Boot This submenu allows the user to confi gure the following boot settings for the system.
  • Page 127: Security

    Chapter 7: BIOS Network Devices, USB Device BBS Priorities, Hard Disk Drives The above options appear when detected by the BIOS. Use these options to set the order of the legacy network, USB, and Hard Disk Drive devices detected. Security This menu allows the user to confi...
  • Page 128: Save & Exit

    FatTwin F617R3-FT FatTwin Save & Exit This submenu allows the user to confi gure the Save and Exit settings for the system. Discard Changes and Exit Select this option to quit the BIOS Setup without making any permanent changes to the system confi guration, and reboot the computer. Select Discard Changes and Exit, and press <Enter>.
  • Page 129 Chapter 7: BIOS Save as User Defaults Select this feature and press <Enter> to save the current settings as the user's defaults. When the dialog box appears, asking you if you want to save values as user's defaults, click Yes to save the current values as user's default settings, or click No to keep the defaults previously saved as the user's defaults.
  • Page 130 FatTwin F617R3-FT FatTwin Notes 7-34...
  • Page 131: Appendix A Bios Error Beep Codes

    Appendix A: BIOS Error Beep Codes Appendix A BIOS Error Beep Codes During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur. Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process.
  • Page 132 FatTwin F617R3-FT USER'S MANUAL Notes...
  • Page 133: Appendix B System Specifi Cations

    Note: Check the Supermicro website (www.supermicro.com) for the latest memory support information. SATA Drive Bays Each node of the FatTwin F617R3-FT contains two (2) fi xed SATA drives per node. PCI Expansion The FatTwin F617R3-FT has 1x PCI-E 3.0 x16 low-profi le available per node.
  • Page 134 Non-operating Temperature: -40°C to 70°C (-40°F to 158°F) Operating Relative Humidity: 8% to 90% (non-condensing) Non-operating Relative Humidity: 5 to 95% (non-condensing) The table below specifi es the preferred ambient temperature versus processor support for the FatTwin F617R3-FT system. Ambient Temperature versus Porcessor Support 35°C 30°C 25°C...
  • Page 135 Appendix B: System Specifi cations Regulatory Compliance Electromagnetic Emissions: FCC Class A, EN 55022 Class A, EN 61000-3-2/-3- 3, CISPR 22 Class A Electromagnetic Immunity: EN 55024/CISPR 24, (EN 61000-4-2, EN 61000-4-3, EN 61000-4-4, EN 61000-4-5, EN 61000-4-6, EN 61000-4-8, EN 61000-4-11) Safety: CSA/EN/IEC/UL 60950-1 Compliant, UL or CSA Listed (USA and Canada), CE Marking (Europe) California Best Management Practices Regulations for Perchlorate Materials:...
  • Page 136 FatTwin F617R3-FT USER'S MANUAL Notes (continued from front) The products sold by Supermicro are not intended for and will not be used in life support systems, medical equipment, nuclear facilities or systems, aircraft, aircraft devices, aircraft/emergency communication devices or other critical systems whose failure to perform be reasonably expected to result in signifi...

Table of Contents