Supermicro SuperServer 6029P-TR User Manual

Supermicro SuperServer 6029P-TR User Manual

Hide thumbs Also See for SuperServer 6029P-TR:
Table of Contents

Advertisement

SuperServer
®
6029P-TR(T)
USER'S MANUAL
Revision 1.0

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SuperServer 6029P-TR and is the answer not in the manual?

Questions and answers

Summary of Contents for Supermicro SuperServer 6029P-TR

  • Page 1 SuperServer ® 6029P-TR(T) USER’S MANUAL Revision 1.0...
  • Page 2 State of California, USA. The State of California, County of Santa Clara shall be the exclusive venue for the resolution of any such disputes. Supermicro's total liability for all claims will not exceed the price paid for the hardware product.
  • Page 3: About This Manual

    About this Manual This manual is written for professional system integrators and PC technicians. It provides information for the installation and use of the SuperServer 6029P-TR(T). Installation and maintenance should be performed by experienced technicians only. Please refer to the 6029P-TR(T) server specifications page on our website for updates on supported memory, processors and operating systems (http://www.supermicro.com).
  • Page 4: Table Of Contents

    SuperServer 6029P-TR(T) User's Manual Contents Chapter 1 Introduction 1.1 Overview ..........................8 1.2 Unpacking the System ......................8 1.3 System Features ........................9 1.4 Chassis Features .......................10 Control Panel ........................10 Front Features ........................11 Rear Features ........................11 1.5 Motherboard Layout ......................12 System Block Diagram ......................15 Chapter 2 Rack Installation 2.1 Preparing for Setup ......................16...
  • Page 5 Preface Chapter 3 Maintenance and Component Installation 3.1 Removing Power ........................25 3.2 Accessing the System ......................26 3.3 Motherboard Components ....................27 Processor and Heatsink Installation ..................27 The Xeon Scalable Processor ..................27 Overview of the Processor Socket Assembly ..............28 Heatsinks ........................29 Overview of the Processor Heatsink Module (PHM) .............30 Assembling the Processor Package ................31 Assembling the Processor Heatsink Module (PHM) .............33 Preparing the CPU Socket for Installation..............34...
  • Page 6 SuperServer 6029P-TR(T) User's Manual Chapter 4 Motherboard Connections 4.1 Power Connections ......................53 4.2 Headers and Connectors ....................54 Control Panel ........................57 Data Cables ........................59 4.3 Input/Output Ports and Interface Buttons ................60 4.4 Jumpers ..........................61 Explanation of Jumpers ....................61 4.5 LED Indicators ........................63 Chapter 5 Software 5.1 OS Installation ........................65...
  • Page 7: Contacting Supermicro

    Super Micro Computer, Inc. 980 Rock Ave. San Jose, CA 95131 U.S.A. Tel: +1 (408) 503-8000 Fax: +1 (408) 503-8008 Email: marketing@supermicro.com (General Information) support@supermicro.com (Technical Support) Website: www.supermicro.com Europe Address: Super Micro Computer B.V. Het Sterrenbeeld 28, 5215 ML...
  • Page 8: Chapter 1 Introduction

    Introduction 1.1 Overview The SuperServer 6029P-TR(T) is an all-purpose server system in the SC825TS-R1K03LPB chassis, using an X11DPi-N(T) motherboard for memory, CPU, storage, or network intensive applications. It will serve well in data centers, government labs, or business enterprises, for cloud and virtualization, simulation, automation, hosting and storage.
  • Page 9: System Features

    Chapter 1: Introduction 1.3 System Features The following table provides an overview of the main features of the 6029P-TR(T) server. Refer to Appendix C for additional specifications. System Features Motherboard X11DPi-N(T) Chassis SC825TS-R1K03LPB Supports dual Intel 81xx/61xx/51xx/41xx/31xx series (Socket P0) processors which offer Intel UltraPath Interconnect (UPI) of up to 10.4 GT/s Memory Supports up to 2 TB of Load Reduced DIMM (LRDIMM), 3D LRDIMM, Non-Volatile DIMM (NV-DIMM) DDR4...
  • Page 10: Chassis Features

    SuperServer 6029P-TR(T) User's Manual 1.4 Chassis Features Control Panel The chassis front features a control panel to monitor node function and control power. Figure 1-1. Control Panel Control Panel Features Item Features Description The main power switch applies or removes primary power from the power supply Power button to the server but maintains standby power.
  • Page 11: Front Features

    Chapter 1: Introduction Front Features The front of the chassis includes eight hot-swap drive bays and the chassis control panel. Figure 1-2. Chassis Front View Front Chassis Features Item Feature Description Control Panel Described in previous section Drives Eight 3.5" hot-swap storage drive bays I/O panel Two USB ports and one COM port DVD drive bay...
  • Page 12: Motherboard Layout

    SuperServer 6029P-TR(T) User's Manual 1.5 Motherboard Layout Below is a layout of the X11DPi-N(T) with jumper, connector and LED locations shown. See the table on the following page for descriptions. For detailed descriptions, pinout information and jumper settings, refer to Chapter 4.
  • Page 13 Gigabit LAN/10G LAN Ethernet Ports on the IO back panel (10G LAN ports on LAN1/LAN2 X11DPi-NTX11DPi-N(T) only) S-SATA0-3 S-SATA 3.0 iPass header supported by the Intel SCU S-SATA Ports with built-in power pins and with support of Supermicro SuperDOM (Disk On Module) S-SATA4/S-SATA5 devices SLOT1/SLOT3 PCI-Express 3.0 X8 Slots supported by CPU1 SLOT2 PCI-Express 3.0 X16 Slot supported by CPU1...
  • Page 14: Led Description

    SuperServer 6029P-TR(T) User's Manual Connector Description USB0/1 Back panel USB 2.0 Ports USB2/3 Front Accessible USB 2.0 Header USB4/5 Back panel USB 3.0 Ports USB6 Type A USB 3.0 Header USB7/8 Front Accessible USB 3.0 Header VGA Port Description State: Status...
  • Page 15: System Block Diagram

    Chapter 1: Introduction System Block Diagram VCCP0 12v VCCP1 12v VR13 VR13 5+1 PHASE 5+1 PHASE VCCP0 VCCP1 SNB CORE SNB CORE DDR4 DDR4 SLOT 2 PCI-E X16 G3 (LANE REVERSE) PCI-E X8 G3 PCI-E X16 G3 SLOT 1 PCI-E X8 G3 PCI-E X16 G3 SLOT 4 PCI-E X16 G3...
  • Page 16: Chapter 2 Rack Installation

    6029P-TR(T) User's Manual Chapter 2 Rack Installation This chapter provides advice and instructions for mounting your system in a rack. 2.1 Preparing for Setup The box in which the system was shipped should include the hardware needed to install it into the rack.
  • Page 17: Server Precautions

    Chapter 2 Rack Installation Server Precautions • Review the electrical and general safety precautions in the appendix, "Standardized Safety Warnings" in this manual. • Determine the placement of each component in the rack before you install the rails. • Install the heaviest server components at the bottom of the rack first and then work your way up.
  • Page 18: Reliable Ground

    6029P-TR(T) User's Manual Reliable Ground A reliable ground must be maintained at all times. To ensure this, the rack itself should be grounded. Particular attention should be given to power supply connections other than the direct connections to the branch circuit (i.e. the use of power strips, etc.).
  • Page 19: Installing The Rails

    Chapter 2 Rack Installation 2.2 Installing the Rails This section provides information on installing the chassis into a rack unit with the rails provided. There are a variety of rack units on the market, which may mean that the assembly procedure will differ slightly from the instructions provided.
  • Page 20: Releasing The Inner Rail

    6029P-TR(T) User's Manual Releasing the Inner Rail Each inner rail has a locking latch. This latch prevents the server from coming completely out of the rack when when the chassis is pulled out for servicing. To mount the rail onto the chassis, first release the inner rail from the outer rails.
  • Page 21: Installing The Inner Rails

    Chapter 2 Rack Installation Installing the Inner Rails Begin the rack mounting procedure by installing the inner rails to the chassis. 1. Identify the left and right inner rails. They are labeled. 2. Place the inner rail firmly against the side of the chassis, aligning the hooks on the side of the chassis with the holes in the inner rail.
  • Page 22: Installing The Outer Rails Onto The Rack

    6029P-TR(T) User's Manual Installing the Outer Rails onto the Rack 1. Press upward on the locking tab at the rear end of the middle rail. 2. Push the middle rail back into the outer rail. 3. Hang the hooks on the front of the outer rail onto the square holes on the front of the rack.
  • Page 23: Installing The Chassis Into A Rack

    Chapter 2 Rack Installation 2.3 Installing the Chassis into a Rack Once rails are attached to the chassis and the rack, you can install the server. 1. Pull the middle rail out of the front of the outer rail and make sure that the ball bearing shuttle is locked at the front of the middle rail.
  • Page 24: Removing The Chassis From The Rack

    6029P-TR(T) User's Manual Removing the Chassis from the Rack Caution! It is dangerous for a single person to off-load the heavy chassis from the rack without assistance. Be sure to have sufficient assistance supporting the chassis when removing it from the rack.
  • Page 25: Chapter 3 Maintenance And Component Installation

    Chapter 3: Maintenance and Component Installation Chapter 3 Maintenance and Component Installation This chapter provides instructions on installing and replacing main system components. To prevent compatibility issues, only use components that match the specifications and/or part numbers given. Installation or replacement of most components require that power first be removed from the system.
  • Page 26: Accessing The System

    SuperServer 6029P-TR(T) User's Manual 3.2 Accessing the System A portion of the chassis top is removable to allow access to components. Removing the Top Cover 1. Remove the screw on each side of the chassis. 2. Depress the release buttons and slide the cover back and off.
  • Page 27: Motherboard Components

    When receiving a motherboard without a processor pre-installed, make sure that the plastic CPU socket cap is in place and none of the socket pins are bent; otherwise, contact your retailer immediately. • Refer to the Supermicro website for updates on CPU support. The Xeon Scalable Processor SKX Processor SKX-F Processor Figure 3-2.
  • Page 28: Overview Of The Processor Socket Assembly

    SuperServer 6029P-TR(T) User's Manual Overview of the Processor Socket Assembly The processor socket assembly contains 1) the Intel SKX(-F) processor, 2) the narrow processor clip, 3) the dust cover, and 4) the CPU socket. 1. SKX (-F) Processor (The SKX Processor) 2.
  • Page 29: Heatsinks

    Chapter 3: Maintenance and Component Installation Heatsinks The 6029P-TR(T) server uses a slightly different heatsink design for each CPU. The SNK- P0068PSC model is used for CPU1, the CPU closer to the mid-chassis fans. Figure 3-3. Heatsink SNK-P0068PS for CPU2 Figure 3-4.
  • Page 30: Overview Of The Processor Heatsink Module (Phm)

    SuperServer 6029P-TR(T) User's Manual Overview of the Processor Heatsink Module (PHM) The Processor Heatsink Module (PHM) contains 1) a heatsink, 2) a narrow processor clip, and 3) the SKX(-F) processor. 1. Heatsink 2. Narrow processor clip 3. SKX(-F) Processor (Bottom View for a non-F Model and CPU2...
  • Page 31: Assembling The Processor Package

    Chapter 3: Maintenance and Component Installation Assembling the Processor Package Attach the processor to the narrow processor clip to create the processor package. Caution: Be careful handling the CPU. Do not touch the underside. Wear ESD gloves. 1. On the top corner of the CPU, locate pin 1 (A), marked by a triangle. Also, locate notch B and notch C (and notch D for -F models) on the CPU as shown below.
  • Page 32 SuperServer 6029P-TR(T) User's Manual CPU (Upside Down) Align Notch D of the CPU w/CPU LGA Lands up and Notch D of the Processor Clip Align Notch C of the CPU Pin 1 and Notch C of the Processor Clip Align Notch B of the CPU...
  • Page 33: Assembling The Processor Heatsink Module (Phm)

    Chapter 3: Maintenance and Component Installation Assembling the Processor Heatsink Module (PHM) After creating the processor package assembly, mount it onto the heatsink to create the processor heatsink module (PHM). 1. Locate "1" on the heatsink label and the corner next to it. With your index finger pressing against the screw at this corner, turn the heatsink upside down with the thermal grease side facing up.
  • Page 34: Preparing The Cpu Socket For Installation

    SuperServer 6029P-TR(T) User's Manual Preparing the CPU Socket for Installation This motherboard comes with the CPU socket assembled in the factory. It includes a dust cover, a socket bracket, the CPU socket (P0), and a back plate. CPU Socket with Dust Cover On Removing the Dust Cover from the CPU Socket Remove the dust cover from the CPU socket, exposing the socket pins as shown below.
  • Page 35: Installing The Processor Heatsink Module (Phm)

    Chapter 3: Maintenance and Component Installation Installing the Processor Heatsink Module (PHM) 1. Locate the triangle (pin 1) on the CPU socket, and locate the triangle (pin 1) at the corner of the PHM that is closest to "1." (If you have difficulty locating pin 1, turn the PHM upside down.
  • Page 36: Connecting An Hfi Carrier Card

    SuperServer 6029P-TR(T) User's Manual Connecting an HFI Carrier Card A host fabric interface (HFI) carrier card can be connected the JHFI sideband header and to an SKX-F processor. Two HFI headers are located on the X11DPi-N(T) motherboard. JHFI1 is used for CPU 1, and JHFI2 is for CPU2. (For more information on the JHFI1/JHFI2 headers, see Chapter 4.) Note: The 6029P-TR(T) server supports only one -F model processor, and...
  • Page 37: Removing The Processor Heatsink Module From The Motherboard

    Chapter 3: Maintenance and Component Installation Removing the Processor Heatsink Module from the Motherboard Before removing the processor heatsink module (PHM), power down as described in Section 3.1. 1. Using a T30 Torx-bit screwdriver, loosen and remove the screws on the PHM from the socket, starting with the screw marked #4, in the sequence of 4, 3, 2, 1.
  • Page 38: Memory

    DIMMs in one channel while populating one DIMM in another channel on the same motherboard will result in reduced memory performance. Check the Supermicro website for possible updates to memory support. DIMM Module Population Configuration For optimal memory performance, follow the specifications below when populating memory.
  • Page 39 Chapter 3: Maintenance and Component Installation General Population Requirements DIMM Mixing Rules - All DIMMs must be DDR4. - X4 and X8 DIMMs can be mixed in the same channel. - Mixing of LRDIMMs and RDIMMs is not allowed in the same channel, across different channels, and across different sockets.
  • Page 40 SuperServer 6029P-TR(T) User's Manual (DDR4 Only) Memory Populations with Possible Mixes LRDIMMs DIMM0/DIMM1 Possible Mixes DIMM0/DIMM1 Within DDR0 x4, None, x4, x4 Quad Rank, None IMC DIMM Quad Rank, Quad Rank DDR1 Population None or same as DDR0 Note: Requirements...
  • Page 41 Chapter 3: Maintenance and Component Installation (DDR4 Only) 2SPC Memory Configuration with x4 DIMMs Total # of DDR Channel Number Adaptive DIMMs Virtual Lock Ranks Step DIMM 1 x4 DIMM Must be installed on iMC0 DDR Y, only Bank VLS Population Channel 0 >1...
  • Page 42: Install Procedure

    SuperServer 6029P-TR(T) User's Manual Install Procedure The DIMM slots must be populated in the following order: P1-DIMMA1, P1-DIMMA2, then P1-DIMMB1, DIMMB2. The blue slots must be populated first. Caution: Exercise caution when installing or removing memory modules to prevent damage to the DIMMs or slots.
  • Page 43 Chapter 3: Maintenance and Component Installation PCIe M.2 Slot The motherboard has one M.2 slot. M.2 was formerly Next Generation Form Factor (NGFF) and serves to replace mini-PCIe. M.2 allows for a variety of card sizes, increased functionality, and spatial efficiency. The M.2 socket on the motherboard supports PCIe 3.0 X4 (32 Gb/s) SSD cards in the 2280 and 22110 form factors.
  • Page 44: Motherboard Battery

    SuperServer 6029P-TR(T) User's Manual Motherboard Battery The motherboard uses non-volatile memory to retain system information when system power is removed. This memory is powered by a lithium battery residing on the motherboard. Replacing the Battery 1. Remove power from the system as described in section 3.1 and remove the node from the chassis.
  • Page 45: Chassis Components

    The SC825 chassis supports eight 3.5" SATA3 storage drives (HDDs or SSDs) in drive carriers to simplify their removal from the chassis. These carriers also help promote proper airflow. Note: Enterprise level hard disk drives are recommended for use in Supermicro chassis and servers. For information on recommended HDDs, visit the Supermicro website at http://www.
  • Page 46: Installing Drives

    SuperServer 6029P-TR(T) User's Manual Installing Drives Removing Drive Carriers from the Chassis 1. Press the release button on the drive carrier. This extends the drive carrier handle. 2. Use the handle to pull the carrier out of the chassis. 3. Remove the dummy drive from the carrier.
  • Page 47 Chapter 3: Maintenance and Component Installation Figure 3-8. Removing the Dummy Drive Installing a Hard Drive 1. Place the hard drive carrier on a flat surface. 2. Insert the hard drive into the carrier with the printed circuit board side facing downward and so that the mounting holes in the drive align with those in the drive carrier.
  • Page 48: Dvd Drive Installation (Optional)

    SuperServer 6029P-TR(T) User's Manual DVD Drive Installation (Optional) The system accomodates an optional slim DVD drive. Side mounting brackets are typically required. Installing a DVD Drive 1. Power down the system as described in Section 3.1 and remove the chassis cover.
  • Page 49: Installing Expansion Cards

    Chapter 3: Maintenance and Component Installation Installing Expansion Cards The system can accommodate six low-profile PCIe cards. The chassis has seven: the slot nearest the chassis center is not supported by this motherboard. Installing an Expansion Card 1. Power down the system and remove the cover. 2.
  • Page 50: System Fans

    SuperServer 6029P-TR(T) User's Manual System Fans Three hot-swap fans provide cooling. They can be replaced without powering down the system. Fan speed is controlled by a system temperature setting in IPMI. If a fan fails, the remaining fans will ramp up to full speed. The system can continue to run with a failed fan. Replace any failed fan at your earliest convenience with the same type and model.
  • Page 51: Installing The Air Shrouds

    Chapter 3: Maintenance and Component Installation Installing the Air Shrouds Air shrouds concentrate airflow to maximize fan efficiency. It covers the processors and heatsinks. Installing an Air Shroud The air shroud fits behind the two fans closest to the power supply. Align the pins and press the air shroud into the chassis along the edges.
  • Page 52: Power Supply

    Power Supply The chassis features redundant power supplies. The power modules can be changed without powering down the system. New units can be ordered directly from Supermicro or authorized distributors. These power supplies are auto-switching capable. This feature enables them to automatically sense the input voltage and operate at a 100-120v or 180-240v.
  • Page 53: Chapter 4 Motherboard Connections

    Chapter 4: Motherboard Connections Chapter 4 Motherboard Connections This section describes the connections on the motherboard and provides pinout definitions. Note that depending on how the system is configured, not all connections are required. The LEDs on the motherboard are also described here. A motherboard layout indicating component locations may be found in Chapter 1.
  • Page 54: Headers And Connectors

    SATA is supported on the X11DPi-N(T) motherboard by three iPass connectors and two SATA powered ports. The powered ports, S-SATA4/S-SATA5, are yellow connectors with power pins built in. They can be used with Supermicro SuperDOMs and do not require external power cables.
  • Page 55 Chapter 4: Motherboard Connections Host Fabric Interface (HFI) Carrier Card Sideband Headers (for the SKX-F CPU Only) Two Host Fabric Interface carrier card headers are located at JHFI1/JHFI2 on the motherboard. A JHFI Sideband header is used when a SKX-F processor is installed on the motherboard. Use a Host Fabric Interface (HFI) sideband cable to connect the carrier card to the JHFI header, and use an Internal-Faceplate-to-Processor cable (IFPA54B) to connect the carrier card to the SKX-F processor to enhance system performance.
  • Page 56: Chassis Intrusion

    SuperServer 6029P-TR(T) User's Manual Power SMB (I C) Header The Power System Management Bus (I C) connector (JPI C1) monitors the power supply, fan, and system temperatures. Power SMB Header Pin Definitions Pin# Definition Clock Data PMBUS_Alert Ground +3.3V 4-pin BMC External I C Header A System Management Bus header for IPMI 2.0 is located at JIPMB1.
  • Page 57: Control Panel

    Chapter 4: Motherboard Connections Control Panel JF1 contains header pins for various control panel connections. See the figure below for the pin locations and definitions of the control panel buttons and LED indicators. All JF1 wires have been bundled into a single cable to simplify this connection. Make sure the red wire plugs into pin 1 as marked on the motherboard.
  • Page 58 SuperServer 6029P-TR(T) User's Manual Power Fail LED The Power Fail LED connection is located on pins 5 and 6 of JF1. Power Fail LED Pin Definitions (JF1) Pin# Definition 3.3V PWR Supply Fail Overheat (OH)/Fan Fail Connect an LED cable to pins 7 and 8 of JF1 to use the Overheat/Fan Fail LED connections.
  • Page 59: Data Cables

    Chapter 4: Motherboard Connections HDD LED/UID Switch The HDD LED/UID Switch connection is located on pins 13 and 14 of JF1. Attach a cable to Pin 14 to show hard drive activity status. Attach a cable to Pin 13 to use UID switch. Refer to the table below for pin definitions.
  • Page 60: Input/Output Ports And Interface Buttons

    SuperServer 6029P-TR(T) User's Manual 4.3 Input/Output Ports and Interface Buttons The rear I/O panel offers these ports and control switches. Figure 4-2. Back Panel I/O Ports Back Panel I/O Ports Description No. Description COM1 USB 1 USB 4 GLAN1 (6029P-TR), 10G_LAN1 (6029P-TRT)
  • Page 61: Jumpers

    Chapter 4: Motherboard Connections 4.4 Jumpers Explanation of Jumpers To modify the operation of the motherboard, jumpers are used to choose between optional settings. Jumpers create shorts between two pins to change the function associated with it. Pin 1 is identified with a square solder pad on the printed circuit board. See the motherboard layout page for jumper locations.
  • Page 62 SuperServer 6029P-TR(T) User's Manual LAN Port Enable/Disable Change the setting of jumper JPL1 to enable or disable LAN ports 1 and 2. Please note that LAN1/LAN2 ports support GbE LAN connections on the X11DPi-N, and 10GbE LAN connections on the X11DPi-NT. The default setting is Enabled.
  • Page 63: Led Indicators

    Chapter 4: Motherboard Connections Watch Dog JWD1 controls the Watch Dog function. Watch Dog is a monitor that can reboot the system when a software application hangs. Jumping pins 1-2 will cause Watch Dog to reset the system if an application hangs. Jumping pins 2-3 will generate a non-maskable interrupt signal for the application that hangs.
  • Page 64 SuperServer 6029P-TR(T) User's Manual IPMI LAN LED The yellow LED indicates activity, while the green/amber LED indicates the speed of the connection. IPMI LAN LED IPMI LAN Link LED (left) LED Color Definition Link LED Activity LED Amber: Solid 1 Gb/s...
  • Page 65: Chapter 5 Software

    You must first configure RAID settings (if using RAID) before you install the Windows OS and the software drivers. To configure RAID settings, please refer to the RAID Configuration User Guides posted on our website at www.supermicro.com/support/manuals. Installing the Windows OS for a RAID System 1.
  • Page 66: Driver Installation

    SuperServer 6029P-TR(T) User's Manual 5.2 Driver Installation The Supermicro FTP site contains drivers and utilities for your system at ftp://ftp.supermicro. com. Some of these must be installed, such as the chipset driver. After accessing the FTP site, go into the CDR_Images directory and locate the ISO file for your motherboard.
  • Page 67: Superdoctor ® 5

    5.3 SuperDoctor ® The Supermicro SuperDoctor 5 is a program that functions in a command-line or web-based interface for Windows and Linux operating systems. The program monitors such system health information as CPU temperature, system voltages, system power consumption, fan speed, and provides alerts via email or Simple Network Management Protocol (SNMP).
  • Page 68: Chapter 6 Bios

    SuperStorage Server 6029P-TR(T) User's Manual Chapter 6 BIOS 6.1 Introduction This chapter describes the AMI BIOS setup utility for the X11DPi-N(T) and provides the instructions on navigating the setup screens. The BIOS is stored in a Flash EEPROM and can be updated. Note: Due to periodic changes to the BIOS, some settings may have been added or deleted since this manual was published.
  • Page 69 HH:MM:SS format. Note: The time is in the 24-hour format. For example, 5:30 P.M. appears as 17:30:00. The date's default value is 01/01/2016 after RTC reset. Supermicro X11DPi-N/X11DPi-NT (Motherboard model) BIOS Version Build Date (of the BIOS)
  • Page 70: Advanced Setup Configurations

    SuperStorage Server 6029P-TR(T) User's Manual 6.3 Advanced Setup Configurations Use the arrow keys to select the Advanced tab and press <Enter> to access the submenu items. Caution: Take caution when changing the Advanced settings. An incorrect value, a very high DRAM frequency, or an incorrect DRAM timing setting may make the system unstable.
  • Page 71: Power Configuration

    Chapter 6: BIOS Option ROM Messages Use this feature to set the display mode for the Option ROM. Select Keep Current to use the current AddOn ROM display setting. Select Force BIOS to use the Option ROM display mode set by the system BIOS. The options are Force BIOS and Keep Current. Bootup NumLock State Use this feature to set the Power-on state for the Numlock key.
  • Page 72: Cpu Configuration

    SuperStorage Server 6029P-TR(T) User's Manual CPU Configuration  Warning: Setting the wrong values in the following sections may cause the system to malfunc- tion. Processor Configuration  The following CPU information will be displayed: • Processor BSP Revision • Processor Socket •...
  • Page 73 Chapter 6: BIOS PPIN Control Select Unlock/Enable to use the Protected-Processor Inventory Number (PPIN) in the system. The options are Unlock/Enable and Unlock/Disable. Hardware Prefetcher (Available when supported by the CPU) If this feature is set to Enable, the hardware prefetcher will prefetch streams of data and instructions from the main memory to the Level 2 (L2) cache to improve CPU performance.
  • Page 74: Advanced Power Management Configuration

    SuperStorage Server 6029P-TR(T) User's Manual Advanced Power Management Configuration  CPU P State Control  SpeedStep (PStates) EIST (Enhanced Intel SpeedStep Technology) allows the system to automatically adjust processor voltage and core frequency in an effort to reduce power consumption and heat dissipation.
  • Page 75: Chipset Configuration

    Chapter 6: BIOS Enhanced Halt State (C1E) Select Enable to enable "Enhanced Halt State" support, which will significantly reduce the CPU's power consumption by minimizing CPU's clock cycles and reduce voltage during a "Halt State." The options are Disable and Enable. Package C State Control ...
  • Page 76: Memory Configuration

    SuperStorage Server 6029P-TR(T) User's Manual Link L0p Enable Select Enable to enable Link L0p. The options are Disable, Enable, and Auto. Link L1 Enable Select Enable to enable Link L1 (Level 1 link). The options are Disable, Enable, and Auto. IO Directory Cache Select Enable for the IODC (I/O Directory Cache) to generate snoops instead of generating memory lockups for remote IIO (InvIToM) and/or WCiLF (Cores).
  • Page 77: Memory Topology

    Chapter 6: BIOS Memory Topology  This item displays the information of onboard memory modules as detected by the BIOS. • P1 DIMMA1 • P1 DIMMB1 • P2 DIMMA1 • P2 DIMMB1 Memory RAS (Reliability_Availability_Serviceability) Configuration  Use this submenu to configure the following Memory RAS settings. Static Virtual Lockstep Mode Select Enable to support Static Virtual Lockstep mode to enhance memory performance.
  • Page 78: Iio Configuration

    SuperStorage Server 6029P-TR(T) User's Manual roughly 64 GB of memory behind the IO hub will be scrubbed every day. The options are Enable and Disable. Patrol Scrub Interval Use this item to specify the number of hours (between 0 to 24) required for the system to complete a full patrol scrubbing.
  • Page 79: Ioat Configuration

    Chapter 6: BIOS • PCI-E Port Link Max • PCI-E Port Link Speed PCI-E Port Max (Maximum) Payload Size (Available for CPU 1 Configuration only) Select Auto for the system BIOS to automatically set the maximum payload value for a PCI-E device specified by to user to enhance system performance.
  • Page 80 SuperStorage Server 6029P-TR(T) User's Manual PassThrough DMA Select Enable for the Non-Iscoh VT-d engine to pass through DMA (Direct Memory Access) to enhance system performance. The options are Enable and Disable. Select Enable to enable ATS (Address Translation Services) support for the Non-Iscoh VT-d engine to enhance system performance.
  • Page 81: South Bridge

    Chapter 6: BIOS South Bridge The following South Bridge information will display: • USB Module Version • USB Devices Legacy USB Support Select Enabled to support onboard legacy USB devices. Select Auto to disable legacy support if there are no legacy USB devices present. Select Disable to have all USB devices available for EFI applications only.
  • Page 82: Sata Configuration

    SuperStorage Server 6029P-TR(T) User's Manual SATA Configuration  When this submenu is selected, the AMI BIOS automatically detects the presence of the SATA devices that are supported by the Intel PCH chip and displays the following items: SATA Controller This item enables or disables the onboard SATA controller supported by the Intel PCH chip. The options are Enable and Disable.
  • Page 83 Chapter 6: BIOS SATA Device Type Use this item to specify if the device installed on the SATA port selected by the user should be connected to a Solid State drive or a Hard Disk Drive. The options are Hard Disk Drive and Solid State Drive.
  • Page 84 SuperStorage Server 6029P-TR(T) User's Manual Spin Up Device On an edge detect from 0 to 1, set this item to allow the sSATA device installed on the sSATA port specified by the user to start a COMRESET initialization. The options are Enable and Disable.
  • Page 85: Network Stack Configuration

    Chapter 6: BIOS MMCFG Base This feature determines the lowest MMCFG (Memory-Mapped Configuration) base assigned to PCI devices. The options are 1G, 1.5G, 1.75G. 2G, 2.25G, and 3G. VGA Priority Use this item to select the graphics device to be used as the primary video display for system boot.
  • Page 86: Super Io Configuration

    SuperStorage Server 6029P-TR(T) User's Manual Ipv4 PXE Support Select Enabled to enable Ipv4 PXE boot support. If this feature is disabled, it will not create the Ipv4 PXE boot option. The options are Disabled and Enabled. Ipv4 HTTP Support Select Enabled to enable Ipv4 HTTP boot support. If this feature is disabled, it will not create the Ipv4 HTTP boot option.
  • Page 87: Serial Port Console Redirection

    Chapter 6: BIOS The options for Serial Port 1 are Auto, (IO=3F8h; IRQ=4), (IO=3F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), (IO=2F8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12); (IO=3E8h; IRQ=3, 4, 5, 6, 7, 9, 10, 11, 12), and (IO=2E8h;...
  • Page 88 SuperStorage Server 6029P-TR(T) User's Manual Bits Per second Use this feature to set the transmission speed for a serial port used in Console Redirection. Make sure that the same speed is used in the host computer and the client computer. A lower transmission speed may be required for long and busy lines.
  • Page 89 Chapter 6: BIOS Putty KeyPad This feature selects Function Keys and KeyPad settings for Putty, which is a terminal emulator designed for the Windows OS. The options are VT100, LINUX, XTERMR6, SCO, ESCN, and VT400. Redirection After BIOS Post Use this feature to enable or disable legacy Console Redirection after BIOS POST. When the option-Bootloader is selected, legacy Console Redirection is disabled before booting the OS.
  • Page 90 SuperStorage Server 6029P-TR(T) User's Manual Odd if the parity bit is set to 0, and the number of 1's in data bits is odd. Select None if you do not want to send a parity bit with your data bits in transmission. Select Mark to add a mark as a parity bit to be sent along with the data bits.
  • Page 91 Chapter 6: BIOS Legacy Console Redirection Settings  Legacy Console Redirection Settings Use the feature to select the COM port to display redirection of Legacy OS and Legacy OPROM messages. The default setting is COM1. Serial Port for Out-of-Band Management/Windows Emergency Management Services (EMS) The submenu allows the user to configure Console Redirection settings to support Out-of- Band Serial Port management.
  • Page 92: Acpi Settings

    SuperStorage Server 6029P-TR(T) User's Manual ACPI Settings  Use this feature to configure Advanced Configuration and Power Interface (ACPI) power management settings for your system. NUMA Support (Available when the OS supports this feature) Select Enabled to enable Non-Uniform Memory Access support to enhance system perfor- mance.
  • Page 93 Chapter 6: BIOS • Active PCR Banks • Available PCR Banks Pending Operation Use this feature to schedule a TPM-related operation to be performed by a security (TPM) device at the next system boot to enhance system data integrity. Your system will reboot to carry out a pending TPM operation.
  • Page 94 "IIO Configuration" in the "Chipset/North Bridge" submenu). Note 2: For more information on TPM, please refer to the TPM manual at http://www. supermicro.com/manuals/other. Intel Virtual RAID on CPU When this submenu is selected and the RAID devices are detected, the BIOS screen displays the following items: Intel VROC with VMD Technology 5.0.0.1205...
  • Page 95: Event Logs

    Chapter 6: BIOS 6.4 Event Logs Use this tab page to configure Event Log settings. Change SMBIOS Event Log Settings Enabling/Disabling Options SMBIOS Event Log Select Enabled to enable SMBIOS (System Management BIOS) Event Logging during system boot. The options are Enabled and Disabled. Erasing Settings Erase Event Log Select Enabled to erase all error events in the SMBIOS (System Management BIOS) log...
  • Page 96: View System Event Log

    SuperStorage Server 6029P-TR(T) User's Manual SMBIOS Event Log Standard Settings Log System Boot Event Select Enabled to log system boot events. The options are Enabled and Disabled. MECI (Multiple Event Count Increment) Enter the increment value for the multiple event counter. Enter a number between 1 to 255. The default setting is 1.
  • Page 97: Ipmi

    Chapter 6: BIOS 6.5 IPMI Use this tab page to configure Intelligent Platform Management Interface (IPMI) settings. The following items will be displayed: • IPMI Firmware Revision • Status of BMC System Event Log Enabling/Disabling Options SEL Components Select Enabled for all system event logging at bootup. The options are Enabled and Disabled. Erasing Settings Erase SEL Select Yes, On next reset to erase all system event logs upon next system reboot.
  • Page 98: Bmc Network Configuration

    SuperStorage Server 6029P-TR(T) User's Manual When SEL is Full This feature allows the user to determine what the BIOS should do when the system event log is full. Select Erase Immediately to erase all events in the log when the system event log is full.
  • Page 99: Security

    Chapter 6: BIOS IPMI LAN Selection Use this feature to select the type of the IPMI LAN. The options are Dedicated, Shared, and Failover. VLAN Select Enabled to enable IPMI VLAN function support. The options are Enabled and Disabled. Configuration Address Source Use this item to select the IP address source for this computer.
  • Page 100: Key Management

    SuperStorage Server 6029P-TR(T) User's Manual User Password Use this feature to set the user password which is required to enter the BIOS setup utility. The length of the password should be from 3 characters to 20 characters long. Password Check Select Setup for the system to check for a password at Setup.
  • Page 101 Chapter 6: BIOS Save All Secure Boot Variables  This feature allows the user to set and save the secure boot key variables specified by the user. Secure Boot Variables Secure Boot Variable/Size/Key#/Key Sources Platform Key (PK)  This feature allows the user to enter and configure a set of values to be used as a platform firmware key for the system.
  • Page 102: Boot

    SuperStorage Server 6029P-TR(T) User's Manual 6.7 Boot Use this tab page to configure Boot Settings. Boot Mode Select Use this feature to select the type of devices that the system is going to boot from. The options are Legacy, UEFI (Unified Extensible Firmware Interface), and Dual. Fixed Boot Order Priorities This feature prioritizes the order of a bootable device from which the system will boot.
  • Page 103: Delete Boot Option

    Chapter 6: BIOS Add New Boot Option This feature allows the user to add a new boot option to the boot priority features for your system. Add Boot Option Use this item to specify the name for the new boot option. Path for Boot Option Use this feature to enter the path for the new boot option in the format fsx:\path\filename.efi.
  • Page 104 SuperStorage Server 6029P-TR(T) User's Manual Delete Drive Option Select the target boot driver to delete from the boot priority list.  Hard Disk Drive BBS Priorities • Boot Option #1 - #5  Network Drive BBS Priorities • Boot Option #1 ...
  • Page 105: Save & Exit

    Chapter 6: BIOS 6.8 Save & Exit Use this tab page to configure Save & Exit settings. Save Options Discard Changes and Exit Select this option to quit the BIOS setup without making any permanent changes to the system configuration and reboot the computer. Select Discard Changes and Exit from the Exit menu and press <Enter>.
  • Page 106 SuperStorage Server 6029P-TR(T) User's Manual Default Options Restore Optimized Defaults To set this feature, select Restore Defaults from the Exit menu and press <Enter> to load manufacturer default settings which are intended for maximum system performance but not for maximum stability. Save As User Defaults To set this feature, select Save as User Defaults from the Exit menu and press <Enter>.
  • Page 107: Appendix A Bios Error Codes

    Appendix A: BIOS Error Codes Appendix A BIOS Error Codes A-1 BIOS Error Beep (POST) Codes During the POST (Power-On Self-Test) routines, which are performed each time the system is powered on, errors may occur. Non-fatal errors are those which, in most cases, allow the system to continue the boot-up process.
  • Page 108 When BIOS performs the Power On Self Test, it writes checkpoint codes to I/O port 0080h. If the computer cannot complete the boot process, a diagnostic card can be attached to the computer to read I/O port 0080h (Supermicro p/n AOC-LPC80-20). For information on AMI updates, please refer to http://www.ami.com/products/.
  • Page 109: Appendix B Standardized Warning Statements For Ac Systems

    Supermicro's Technical Support department for assistance. Only certified technicians should attempt to install or configure components. Read this appendix in its entirety before installing or configuring components in the Supermicro chassis. These warnings may also be found on our website at http://www.supermicro.com/about/...
  • Page 110 Appendix B: Standardized Warning Statements Warnung WICHTIGE SICHERHEITSHINWEISE Dieses Warnsymbol bedeutet Gefahr. Sie befinden sich in einer Situation, die zu Verletzungen führen kann. Machen Sie sich vor der Arbeit mit Geräten mit den Gefahren elektrischer Schaltungen und den üblichen Verfahren zur Vorbeugung vor Unfällen vertraut. Suchen Sie mit der am Ende jeder Warnung angegebenen Anweisungsnummer nach der jeweiligen Übersetzung in den übersetzten Sicherheitshinweisen, die zusammen mit diesem Gerät ausgeliefert wurden.
  • Page 111: Installation Instructions

    SuperServer 6029P-TR(T) User's Manual . ٌ ‫ا ك ً ف حالة و ٌ يك أى تتسبب ف اصابة جسذ ة ٌ هذا الزهز ع ٌ خطز !تحذ ز‬ ‫قبل أى تعول عىل أي هعذات،يك عىل علن بالوخاطز ال ا ٌجوة عي الذوائز‬...
  • Page 112: Circuit Breaker

    Appendix B: Standardized Warning Statements Warnung Vor dem Anschließen des Systems an die Stromquelle die Installationsanweisungen lesen. ¡Advertencia! Lea las instrucciones de instalación antes de conectar el sistema a la red de alimentación. Attention Avant de brancher le système sur la source d'alimentation, consulter les directives d'installation. .‫יש...
  • Page 113 SuperServer 6029P-TR(T) User's Manual Warnung Dieses Produkt ist darauf angewiesen, dass im Gebäude ein Kurzschluss- bzw. Überstromschutz installiert ist. Stellen Sie sicher, dass der Nennwert der Schutzvorrichtung nicht mehr als: 250 V, 20 A beträgt. ¡Advertencia! Este equipo utiliza el sistema de protección contra cortocircuitos (o sobrecorrientes) del edificio.
  • Page 114: Power Disconnection Warning

    Appendix B: Standardized Warning Statements Power Disconnection Warning Warning! The system must be disconnected from all sources of power and the power cord removed from the power supply module(s) before accessing the chassis interior to install or remove system components. 電源切断の警告...
  • Page 115: Equipment Installation

    SuperServer 6029P-TR(T) User's Manual ‫يجب فصم اننظاو من جميع مصادر انطاقت وإ ز انت سهك انكهرباء من وحدة امداد‬ ‫انطاقت قبم‬ ‫انىصىل إىن امنناطق انداخهيت نههيكم نتثبيج أو إ ز انت مكىناث الجهاز‬ 경고! 시스템에 부품들을 장착하거나 제거하기 위해서는 섀시 내부에 접근하기 전에 반드시 전원...
  • Page 116: Restricted Area

    Appendix B: Standardized Warning Statements Attention Il est vivement recommandé de confier l'installation, le remplacement et la maintenance de ces équipements à des personnels qualifiés et expérimentés. !‫אזהרה‬ .‫צוות מוסמך בלבד רשאי להתקין, להחליף את הציוד או לתת שירות עבור הציוד‬ ‫واملدربيه...
  • Page 117 SuperServer 6029P-TR(T) User's Manual Warnung Diese Einheit ist zur Installation in Bereichen mit beschränktem Zutritt vorgesehen. Der Zutritt zu derartigen Bereichen ist nur mit einem Spezialwerkzeug, Schloss und Schlüssel oder einer sonstigen Sicherheitsvorkehrung möglich. ¡Advertencia! Esta unidad ha sido diseñada para instalación en áreas de acceso restringido. Sólo puede obtenerse acceso a una de estas áreas mediante la utilización de una herramienta especial,...
  • Page 118: Battery Handling

    Appendix B: Standardized Warning Statements Battery Handling Warning! There is the danger of explosion if the battery is replaced incorrectly. Replace the battery only with the same or equivalent type recommended by the manufacturer. Dispose of used batteries according to the manufacturer's instructions 電池の取り扱い...
  • Page 119: Redundant Power Supplies

    SuperServer 6029P-TR(T) User's Manual ‫هناك خطر من انفجار يف حالة اسحبذال البطارية بطريقة غري صحيحة فعليل‬ ‫اسحبذال البطارية‬ ‫فقط بنفس النىع أو ما يعادلها مام أوصث به الرشمة املصنعة‬ ‫جخلص من البطاريات املسحعملة وفقا لحعليامت الرشمة الصانعة‬ 경고! 배터리가 올바르게 교체되지 않으면 폭발의 위험이 있습니다. 기존 배터리와 동일하거나 제...
  • Page 120 Appendix B: Standardized Warning Statements ¡Advertencia! Puede que esta unidad tenga más de una conexión para fuentes de alimentación. Para cortar por completo el suministro de energía, deben desconectarse todas las conexiones. Attention Cette unité peut avoir plus d'une connexion d'alimentation. Pour supprimer toute tension et tout courant électrique de l'unité, toutes les connexions d'alimentation doivent être débranchées.
  • Page 121: Backplane Voltage

    SuperServer 6029P-TR(T) User's Manual Backplane Voltage Warning! Hazardous voltage or energy is present on the backplane when the system is operating. Use caution when servicing. バックプレーンの電圧 システムの稼働中は危険な電圧または電力が、 バックプレーン上にかかっています。 修理する際には注意く ださい。 警告 当系统正在进行时,背板上有很危险的电压或能量,进行维修时务必小心。 警告 當系統正在進行時,背板上有危險的電壓或能量,進行維修時務必小心。 Warnung Wenn das System in Betrieb ist, treten auf der Rückwandplatine gefährliche Spannungen oder Energien auf.
  • Page 122: Comply With Local And National Electrical Codes

    Appendix B: Standardized Warning Statements ‫هناك خطز مه التيار الكهزبايئ أوالطاقة املىجىدة عىل اللىحة‬ ‫عندما يكىن النظام يعمل كه حذ ر ا عند خدمة هذا الجهاس‬ 경고! 시스템이 동작 중일 때 후면판 (Backplane)에는 위험한 전압이나 에너지가 발생 합니다. 서비스 작업 시 주의하십시오. Waarschuwing Een gevaarlijke spanning of energie is aanwezig op de backplane wanneer het systeem in gebruik is.
  • Page 123: Product Disposal

    SuperServer 6029P-TR(T) User's Manual ‫תיאום חוקי החשמל הארצי‬ !‫אזהרה‬ .‫התקנת הציוד חייבת להיות תואמת לחוקי החשמל המקומיים והארציים‬ ‫تركيب املعدات الكهربائية يجب أن ميتثل للقىاويه املحلية والىطىية املتعلقة‬ ‫بالكهرباء‬ 경고! 현 지역 및 국가의 전기 규정에 따라 장비를 설치해야 합니다.
  • Page 124 Appendix B: Standardized Warning Statements Attention La mise au rebut ou le recyclage de ce produit sont généralement soumis à des lois et/ou directives de respect de l'environnement. Renseignez-vous auprès de l'organisme compétent. ‫סילוק המוצר‬ !‫אזהרה‬ .‫סילוק סופי של מוצר זה חייב להיות בהתאם להנחיות וחוקי המדינה‬ ‫التخلص...
  • Page 125 SuperServer 6029P-TR(T) User's Manual Warnung Gefährlich Bewegende Teile. Von den bewegenden Lüfterblätter fern halten. Die Lüfter drehen sich u. U. noch, wenn die Lüfterbaugruppe aus dem Chassis genommen wird. Halten Sie Finger, Schraubendreher und andere Gegenstände von den Öffnungen des Lüftergehäuses entfernt.
  • Page 126 Verbindungskabeln, Stromkabeln und/oder Adapater, die Ihre örtlichen Sicherheitsstandards einhalten. Der Gebrauch von anderen Kabeln und Adapter können Fehlfunktionen oder Feuer verursachen. Die Richtlinien untersagen das Nutzen von UL oder CAS zertifizierten Kabeln (mit UL/CSA gekennzeichnet), an Geräten oder Produkten die nicht mit Supermicro gekennzeichnet sind.
  • Page 127 ‫.قيرح وأ لطع يف ببستي دق ىرخأ تالوحمو تالباك يأ مادختسا .ميلسلا سباقلاو لصوملا مجح‬ ‫ لبق نم ةدمتعملا تالباكلا مادختسا تادعملاو ةيئابرهكلا ةزهجألل ةمالسلا نوناق رظحي‬UL ‫ وأ‬CSA ‫( ةمالع لمحت يتلاو‬UL/CSA) ‫ لبق نم ةددحملاو ةينعملا تاجتنملا ريغ ىرخأ تادعم يأ عم‬Supermicro.
  • Page 128 사항을 준수하여 제공되거나 지정된 연결 혹은 구매 케이블, 전원 케이블 및 AC 어댑터를 사용하십시오. 다른 케이블이나 어댑터를 사용하면 오작동이나 화재가 발생할 수 있습니다. 전기 용품 안전법은 UL 또는 CSA 인증 케이블 (코드에 UL / CSA가 표시된 케이블)을 Supermicro 가 지정한 제품 이외의 전기 장치에 사용하는 것을 금지합니다. Stroomkabel en AC-Adapter...
  • Page 129: Appendix C System Specifications

    SATA Eight SATA 3.0 ports supported by Intel PCH (I-SATA 0-3, I-SATA 4-7) Four S-SATA 3.0 ports supported by Intel SCU Two SATA 3.0 ports with power-pins built-in, with support for Supermicro SuperDOM (S-SATA4/S-ISATA5) Chassis SC825TS-R1K03LPB; 2U, slide mounting rails Dimensions: (WxHxD) 16.8 x 3.5 x 25.5 in.
  • Page 130: Operating Environment

    SuperStorage Server 6029P-TR(T) User's Manual Power Supply Dual 800/1000 W modules, 80Plus Titanium level Model: PWS-1K03A-1R AC Input: 100-240 V, 50-60 Hz Rated AC Input Current: 800 W Output @ 100-127 V: 9-12 A; 1000 W Output @ 200-240 V: 6-7.2 A Rated DC Output Power: +12 V, for 800 W - 67 A, for 1000 W - 83 A +5 V standby - 4 A...
  • Page 131: Appendix D Uefi Bios Recovery Instructions

    Warning: Do not upgrade the BIOS unless your system has a BIOS-related issue. Flashing the wrong BIOS can cause irreparable damage to the system. In no event shall Supermicro be liable for direct, indirect, special, incidental, or consequential damages arising from a BIOS update.
  • Page 132 SuperServer 6029P-TR(T) User's Manual Note: If you cannot locate the "Super.ROM" file in your driver disk, visit our website at www. supermicro.com to download the BIOS image to a USB flash device and rename it "Super ROM". 2. Insert the USB device that contains the new BIOS image ("Super.ROM") into your USB drive and power on the system 3.
  • Page 133 Appendix D: UEFI BIOS Recovery 6. After the process has completed, press any key to reboot the system. 7. Using a different system, extract the BIOS package into a bootable USB flash drive. 8. When the DOS prompt appears, enter AMI.BAT BIOSname.###.
  • Page 134 SuperServer 6029P-TR(T) User's Manual Note: Do not interrupt this process until BIOS flashing has completed. 9. After receiving the message that the BIOS update is complete, unplug the AC power cable from the power supply to clear CMOS, then plug the AC power cable in the power supply again to power on the system.

This manual is also suitable for:

Superserver 6029p-trt

Table of Contents