1. Manuals
  2. Brands
  3. Silicon Graphics Manuals
  4. Desktop
  5. SGI Altix 3700 Bx2
  6. User manual

Silicon Graphics SGI Altix 3700 Bx2 User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
®
®
SGI
Altix
3700 Bx2 User's Guide
Document Number 007-4377-002

Advertisement

Table of Contents
loading

Related Manuals for Silicon Graphics SGI Altix 3700 Bx2

Summary of Contents for Silicon Graphics SGI Altix 3700 Bx2

  • Page 1 ® ® Altix 3700 Bx2 User’s Guide Document Number 007-4377-002...
  • Page 2 COPYRIGHT © 2004 Silicon Graphics, Inc. All rights reserved; provided portions may be copyright in third parties, as indicated elsewhere herein. No permission is granted to copy, distribute, or create derivative works from the contents of this electronic documentation in any manner, in whole or in part, without the prior written permission of Silicon Graphics, Inc.
  • Page 3 Record of Revision Version Description September 2004, first release November 2004 Updated IO9 information and L1 bezel color 007-4377-002...

  • Page 5: Table Of Contents

    Contents Contents Figures . . xiii Tables . xvii About This Guide. . xix Audience . xix Important Information . xix Chapter Descriptions . . xx Related Publications . . xxi Conventions xxiii Product Support . xxiii Reader Comments . xxiv Operation Procedures Precautions .
  • Page 6 Contents Installing Optional Components . . 13 Adding or Removing PCI Cards . . 13 Adding or Removing Disk Drives . . 14 System Control . . 15 Levels of System Control . . 17 System Controller Interaction . . 18 L1 Controller .
  • Page 7 Contents System Overview . . 45 System Models . . 47 System Architecture . . 49 System Features . 51 Modularity and Scalability . . 51 Distributed Shared Memory (DSM) . 51 Distributed Shared I/O . . 52 ccNUMA Architecture .
  • Page 8 Contents IX-brick . . 75 Product Overview . . 76 External Components . . 79 Front Panel Components . . 79 Rear Panel Components . . 81 PCI and PCI-X Card Configuration Guidelines . . 83 Important Installation Considerations . .
  • Page 9 Contents Distributed Power Supplies . .109 Technical Specifications . .111 SGI TP900 Storage Module . .113 Overview . .113 External Components . .114 Front Panel Components. .114 Disk Drive Carrier Module . .115 Dummy Carrier Module .115 Rear Panel Components . .116 Power Supply Module .
  • Page 10 Contents Preparing the System for Maintenance or Upgrade Returning the System to Operation . Installing or Removing Internal Parts . Adding or Replacing a PCI or PCI-X Card . Installing or Replacing a Disk Drive in the IX-brick Installing a System Disk Drive . Removing a System Disk Drive .
  • Page 11 Contents Chinese Class A Regulatory Notice .181 Korean Class A Regulatory Notice . .181 Shielded Cables . .182 Electrostatic Discharge . .182 Laser Compliance Statements . .183 Lithium Battery Statements . .184 Index .185 007-4377-002...

  • Page 13: Figures

    PDU and PDS Circuit Breaker Switches . Figure 1-4 L1 Controller Display Location Example . 11 Figure 1-5 SGI Altix 3700 Bx2 Server System Control Network (Example) . . 16 Figure 2-1 Console Controller Network Diagram Example . 19 Figure 2-2 L1 Front Panel .
  • Page 14 Figures Block Diagram of PX-brick . . 89 Figure 7-2 Front Panel and Display on the PX-brick . . 91 Figure 7-3 Rear Panel of the PX-brick . . 93 Figure 7-4 Numbering of PCI and PCI-X Card Slots . .
  • Page 15 Figures Releasing the Carrier Handle . .151 Figure 12-14 Carrier Camming Lever .152 Figure 12-15 Unlocking the Drive Carrier Module .154 Figure 12-16 Opening the Module Handle . .155 Figure 12-17 Inserting the Disk Drive Module in a D-brick2 . .156 Figure 12-18 Locking the Drive Carrier Module...

  • Page 17: Tables

    Tables Tables L1 Controller Functions . 20 Table 2-1 Location Guidelines for Connecting USB/Ethernet Adapters. . 24 Table 2-2 Tall Rack Technical Specifications . 63 Table 4-1 Configurable Items of CR-brick . . 73 Table 5-1 CR-brick Technical Specifications . 74 Table 5-2 Physical Specifications of the IX-brick .
  • Page 18 Tables Altix 3700 Bx2 Physical Specifications Table A-2 Environmental Specifications . Table A-3 Power Specifications Table A-4 Ethernet Pinouts. Table A-5 Serial Port Pinout Table A-6 xviii 007-4377-002...

  • Page 19: About This Guide

    Audience This guide is written for owners, system administrators, and users of SGI Altix 3700 Bx2 series computer systems. It is written with the assumption that the reader has a general knowledge of computers and computer systems.

  • Page 20: Chapter Descriptions

    About This Guide Chapter Descriptions The following topics are covered in this guide: • Chapter 1, “Operation Procedures,” provides instructions for powering on and powering off your system. • Chapter 2, “System Control,” describes the function of the L1 and L2 controllers and provides instructions for operating the controllers.

  • Page 21: Related Publications

    Related Publications Related Publications The following SGI documents are relevant to the Altix 3700 Bx2 series system: • SGI Total Performance 900 Storage System User’s Guide (P/N 007-4428-xxx) This fully illustrated guide explains how to operate and maintain the SGI Total Performance 900 (TP900) SCSI storage system.
  • Page 22 About This Guide You can obtain SGI documentation, release notes, or man pages in the following ways: • See the SGI Technical Publications Library at http://docs.sgi.com. Various formats are available. This library contains the most recent and most comprehensive set of online books, release notes, man pages, and other information.

  • Page 23: Conventions

    Conventions Conventions The following conventions are used throughout this document: Convention Meaning This fixed-space font denotes literal items such as commands, files, Command routines, path names, signals, messages, and programming language structures. variable The italic typeface denotes variable entries and words or concepts being defined.

  • Page 24: Reader Comments

    About This Guide Reader Comments If you have comments about the technical accuracy, content, or organization of this document, contact SGI. Be sure to include the title and document number of the manual with your comments. (Online, the document number is located in the front matter of the manual.

  • Page 25: Operation Procedures

    Chapter 1 Operation Procedures This chapter explains how to operate your new system in the following sections: • “Precautions” on page 1 • “Connecting a System Console” on page 3 • “Powering the System On and Off” on page 3 •...

  • Page 26: Safety Precautions

    1: Operation Procedures Safety Precautions Warning: Before operating or servicing any part of this product, read the “Safety Information” on page 177. Danger: Keep fingers and conductive tools away from high-voltage areas. Failure to follow these precautions will result in serious injury or death. The high-voltage areas of the system are indicated with high-voltage warning labels.

  • Page 27: Connecting A System Console

    Connecting a System Console Connecting a System Console The system console enables you to perform the following activities: • Monitor your system by reading the system’s status and error message information generated and displayed by the SGI system’s L1 controller. •...

  • Page 28: Powering On The System

    1: Operation Procedures Powering On the System This section describes how to prepare to power on your system, and how to power on your system by using either of the following: • L1 controller • System console Preparing to Power On To prepare to power on your system, follow these steps: Check to ensure that the cabling between the power distribution unit (PDU) and the wall power-plug receptacle is secure.

  • Page 29: Figure 1-2 D-Brick2 Psu/Cooling Module Power Switch

    Powering the System On and Off 3. If you plan to power on a D-brick2, or an entire server that includes a D-brick2, make sure that the power switch on the rear of each PSU/cooling module (two per D-brick2) is in the (on) position.

  • Page 30: Figure 1-4 Pdu And Pds Circuit Breaker Switches

    1: Operation Procedures 4. Make sure that the PDU and PDS circuit breaker switches shown in Figure 1-4 are turned on to give power to the server system when the system is powered on. Circuit breaker switch Figure 1-4 PDU and PDS Circuit Breaker Switches Note: Verify that the LEDs turn on and light green and that your controllers display that the system is powered on for each segment of the procedure, which indicates that the power-on procedure is proceeding properly.

  • Page 31: Powering On At The System Console

    Powering the System On and Off Powering On at the System Console The power-on procedure at a system console varies with your server setup, as follows: • If you have a system console, you can toggle between L1 and console mode. This enables you to power on your server with L1 commands and view the activity by changing to the console mode.

  • Page 32: Powering Off The System

    1: Operation Procedures 2. If you want to power on the bricks connected to the CR-brick, enter the following command: oo3c01-L1> * power up (* indicates all) 3. From the L1 prompt, display the brick configuration information by entering the following command: 001c05-L1>...

  • Page 33: Powering Off At The System Console

    Powering the System On and Off Powering Off at the System Console The power-off procedure at a system console varies with your server setup, as follows: • If you have a system console connected to a server with an ethernet or other hardware interface, you can toggle between L1 and console mode, power off your server with L1 controller commands, and monitor the power-off activity by changing to the console mode.

  • Page 34: Using Embedded Support Partner (Esp)

    1: Operation Procedures 3. From the L1 prompt, display the brick configuration information by entering the following command: 001c05-L1> config In L1 mode, you can obtain system configuration information within a specific set of inter connectivity limits. A CR-brick only has information about its attached I/O brick and, any other CR-bricks attached to it.

  • Page 35: Monitoring Your Server

    Monitoring Your Server Monitoring Your Server You can monitor your Altix 3700 Bx2 server from the following sources: • On the L1 controller’s display at the front of each brick (except the TP900 and D-brick2), as shown in Figure 1-5, you can monitor brick items. For example, you can see if the fans on a particular brick are operating properly.
  • Page 36 1: Operation Procedures • You can connect an optional SGIconsole via an Ethernet port adapter or simple serial interface. You will need to connect either a local or remote workstation to monitor the servers via Ethernet. These console connections enable you to view the status and error messages generated by the L1 controllers in your Altix 3700 Bx2 rack.

  • Page 37: Installing Optional Components

    Installing Optional Components Installing Optional Components Besides adding a system console, you can add or replace the following hardware items on your Altix 3700 Bx2 series server: • Peripheral component interface (PCI) cards into your IX-brick or PX-brick. • Disk drives to your IX-brick, TP900 disk storage module, or D-brick2 storage module.

  • Page 38: Adding Or Removing Disk Drives

    1: Operation Procedures Adding or Removing Disk Drives The IX-brick supports the system boot functions and contains one or two low-profile disk drives. See “Installing or Replacing a Disk Drive in the IX-brick” on page 144 for detailed instructions on installing or removing disk drives. The TP900 is a SCSI-based disk storage module that provides JBOD (just a bunch of disks) mass storage and that has up to 8 disk drives in each storage module.

  • Page 39: System Control

    “L2 Emulator Operation” on page 33 • “Upgrading L1 Firmware” on page 43 The control system for the SGI Altix 3700 Bx2 series servers manages power control and sequencing, provides environmental control and monitoring, initiates system resets, stores identification and configuration information, and provides console/diagnostic and scan interface.

  • Page 40: Figure 2-1 Sgi Altix 3700 Bx2 Server System Control Network (Example)

    Local Area Network (LAN) SGIconsole Type A USB to Enet adapter CR-brick Local Area Network (LAN) CR-brick NUMAlink cable (USB signals used) Xtown2 (RS-422 signals used) CR-brick CR-brick IX-brick Figure 2-1 SGI Altix 3700 Bx2 Server System Control Network (Example) 007-4377-002...

  • Page 41: Levels Of System Control

    Levels of System Control Levels of System Control The system control network configuration of your server will depend on the size of the system and control options selected. The Altix 3700 Bx2 server has optional levels of control, as follows: •...

  • Page 42: System Controller Interaction

    2: System Control System Controller Interaction In all Altix 3700 Bx2 servers all the L1 controllers communicate with each other in the following ways: • All CR and NUMAlink-4 R-bricks communicate with each other through the NUMAlink connections using low voltage differential signaling (LVDS). •...

  • Page 43: Figure 2-2 Console Controller Network Diagram Example

    System Controller Interaction Ethernet bus Ethernet USB to Enet Type A adapter USB connector R-brick R-brick Console NUMAlink 4 channels IX-brick PX-brick NUMAlink 4 channels R-brick R-brick Ethernet NUMAlink 4 (lvds signals used) Xtown2 (RS-422 signals used) Figure 2-2 Console Controller Network Diagram Example 007-4377-002...

  • Page 44: L1 Controller

    2: System Control L1 Controller All bricks except TP900 storage modules and D-brick2 storage modules have L1 controllers. The following subsections describe the basic features of all L1 controllers: • “L1 Controller Functions” on page 20 • “L1 Front Panel Display” on page 22 Note: For additional information on L1 controller commands, see the SGI L1 and L2 Controller Software User’s Guide (007-3938-xxx).
  • Page 45 L1 Controller L1 Controller Functions (continued) Table 2-1 Function CR-brick R-brick IX-brick PX-brick Reports the population of the PCI cards and the power levels of the PCI slots. Powers on the PCI slots and their associated LEDs. 007-4377-002...

  • Page 46: L1 Front Panel Display

    2: System Control L1 Front Panel Display Figure 2-3 shows the L1 controller front panel on the CR-brick. Failure LED Service-required L1 controller display Power button with LED Reset Figure 2-3 L1 Front Panel The front panel display contains the following items: •...

  • Page 47: Optional Ethernet Switch

    Optional Ethernet Switch • Service required LED. • Failure LED. • Reset switch and non-maskable interrupt (NMI) switch. Note: The reset and NMI switch functions are available on the CR-brick only. Optional Ethernet Switch se of an Ethernet switch is the preferred method of connecting remote support hardware to multiple systems.

  • Page 48: Console Hardware Requirements

    2: System Control Console Hardware Requirements The console type and how these console types are connected to the Altix 3700 Bx2 servers is determined by what console option is chosen. If you have an Altix 3700 Bx2 server with a dumb terminal, you can connect the terminal via a serial cable to the (DB-9) console port connector on the rear of the CR-brick.

  • Page 49: Operating The L1

    Operating the L1 By default the L2 emulator uses DHCP to obtain an IP address. To set a state IP, access the L1 via the serial port and use the following commands: 001c05-L1> L2 ip <ip address> <netmask> <broadcast> 001c05-L2> reboot_L1 These console connections enable you to view the status and error messages generated by the L1 controllers on your system.

  • Page 50: L1 Mode

    2: System Control The L1 operates in one of these two modes, which are discussed in the sections that follow: L1 Mode The L1 prompt is visible and all input is directed to the L1 command processor. The enhanced L1 control system is compatible with the L1 controller in the IX-bricks. The Altix 3700 Bx2 server L1 system control can perform the following: •...

  • Page 51: Viewing System Configuration (From A Brick's Perspective)

    Operating the L1 Viewing System Configuration (from a Brick’s Perspective) An L1 has limited knowledge of the system topology, depending on the system’s configuration. In configurations without an R-brick, each CR-brick has information about other CR-bricks within the system and its attached I/O brick (if any). An I/O brick only has information about its attached CR-brick.

  • Page 52: Command Targeting

    2: System Control Command Targeting All commands entered affect only the local brick. You can target a command to all bricks (including the local brick) by prefixing the command with an asterisk (*). 001c05-L1> * version 001c05: L1 0.7.37 (Image A), Built 11/24/2004 14:59:42 [2MB image] 004i01: L1 0.7.37 (Image A), Built 11/24/2004 14:59:42 [2MB image] 002c01:...

  • Page 53: Powering On, Powering Off, And Resetting The Brick

    Operating the L1 Powering On, Powering Off, and Resetting the Brick Use a serial terminal cable connected to the console port on any one of the CR bricks. From this perspective all functioning bricks with an L1 can be seen in the output of the L1 config command.

  • Page 54: Console Mode From L1

    2: System Control Console Mode from L1 In console mode, output from the system is visible and all input is directed to the system. To enter console mode, press Ctrl+D at the L1 prompt: 001c05-L1> Ctrl+D entering console mode 001c05 console, <CTRL-T> to escape to L1 <system output appears here>...
  • Page 55 Operating the L1 • Subchannel 0A specifies Node 0, CPU A. • Subchannel 0C specifies Node 0 CPU B. • Subchannel 1A specifies Node 1, CPU A. • Subchannel 1C specifies Node 1, CPU B. • Subchannel 2A specifies Node 2, CPU A. •...

  • Page 56: Viewing Information, Warnings, And Error Messages

    2: System Control 001c05-L1> entering console mode 001c05 console, <CTRL-T> to escape to L1 no response from 001c05 junk bus console UART:UART_TIMEOUT When this time-out condition occurs, either the brick is hung or the subchannel is incorrect. A brick is identified by its rack, type, and slot (001c05). The structure of the brick location is as follows: rrrbss.p where:...

  • Page 57: L2 Emulator Operation

    L2 Emulator Operation L2 Emulator Operation As mentioned in “System Controller Interaction” on page 18 level one system controllers in an Altix 3700 Bx2 system can operate in “L2 emulator mode”. This is to say that they essentially perform the same functions as the L2 system controller on the Altix 3000. A USB Ethernet adapter can be plugged into the type A connector on the CR-brick.
  • Page 58 2: System Control Verifying that the system serial number is set on the L2: L1> l2 serial To set the L2 emulator system serial number: L1> l2 serial set <serial number> Verifying that msys is enabled (this allows multiple L2s in a system to exist peacefully with other L2s from another system on the same subnet) L1>...

  • Page 59: Viewing System Configuration

    L2 Emulator Operation Viewing System Configuration You can use the L2 emulator’s config command to view the current system configuration from a brick level: L2> config L2 127.0.0.1: - 001 (LOCAL) L1 127.0.0.1:0:0 - 001c18 L1 127.0.0.1:1:0 - 001r16 L1 127.0.0.1:2:0 - 001r14 L1 127.0.0.1:3:0 - 001c11...

  • Page 60: Setting Command Targeting

    2: System Control is the brick type. is the slot location of the brick. is the partition of the brick (not present if the system is not partitioned). R-bricks are not associated with a partition. In the example shown above, 001c05 is a CR-brick in rack 001 and slot position 05. Setting Command Targeting If a command is not understood by the L2 emulator system controller, in general it is passed to the L1 system controllers.
  • Page 61 L2 Emulator Operation Default Destination When the L2 emulator starts, the default destination is set to all racks and all slots. You can determine the default destination by using the destination command: L2> destination all racks, all slots L2> The following command sets the destinations to rack 2 and 3, all slots: L2>...

  • Page 62: Viewing Information, Warnings, And Error Messages

    2: System Control Command Interpretation Some L2 commands are the same as the L1 commands. In many cases, this is intentional because the L2 emulator provides sequencing that is necessary for a command to function correctly. When L1 and L2 commands are similar, you can assure that an L1 command is entered for the bricks in the current destination by preceding the command <L1 command>...

  • Page 63: Console Mode From The L2 Emulator

    L2 Emulator Operation To power on or power off a specific brick, specify a current destination: L2> r 2 s 5 power up L2> To power on or power off all bricks in a partition, enter the following: L2> partition <partition number> <power up or power down> To reset the system, enter the following: L2>...

  • Page 64: Console Selection

    2: System Control To permanently engage the L2 mode, press Ctrl+T and then enter the l2 command: Ctrl+T escaping to L2 system controller L2> l2 L2 command processor engaged, <CTRL_D> for console mode. L2> Console Selection When in console mode, the L2 emulator communicates with the CR-brick set with the select command to be the system console or global master.
  • Page 65 L2 Emulator Operation • Node 0 console subchannel. • Node 1 console subchannel. The output console input: 002c05 console0 shows that the L2 emulator will send console input to brick 001c05 and the console subchannel will be used. To change the brick that will be the system console, use the select <rack>.<slot> command, where <rack>...

  • Page 66: L1 Mode From L2 Emulation

    2: System Control L1 Mode from L2 Emulation In L1 mode, the prompt from a single L1 is visible, and all input is directed to that L1 command processor. To enter L1 mode, enter the rack and a slot followed by l1: L2>...

  • Page 67: Upgrading L1 Firmware

    Upgrading L1 Firmware Upgrading L1 Firmware The L1 firmware is currently distributed as part of the snxsc_firmware package. To determine which version of the package is installed on your system console, enter the following command: $> rpm -q snxsc_firmware If the package is installed, the full package name (including the revision) is returned: snxsc_firmware-1.18.3-1 The L1 firmware binary and the utilities used to update it are stored in /usr/cpu/firmware/sysco.
  • Page 68 2: System Control You can update individual bricks by replacing all with a rack and slot number: $> /usr/cpu/firmware/sysco/flashsc --12 10.1.1.1 /usr/cpu/firmware/sysco/l1.bin 1.19 This updates only the brick in rack 1, slot 19 007-4377-002...

  • Page 69: System Overview

    Chapter 3 System Overview This chapter provides an overview of the physical and architectural aspects of your SGI Altix 3700 Bx2 series system. The major components of the Altix 3700 Bx2 series systems are described and illustrated. The Altix 3700 Bx2 series is a family of multiprocessor distributed shared memory (DSM) computer systems that initially scale from 8 to 256 Intel 64-bit processors as a cache-coherent single system image (SSI).

  • Page 70: Figure 3-1 Sgi Altix 3700 Bx2 Series Systems

    3: System Overview SGI Altix 3700 Bx2 Series Systems Figure 3-1 007-4377-002...

  • Page 71: System Models

    System Models System Models The CR-brick contains the processors (8 processors per CR-brick) and two internal high-speed routers. The routers connect to other system bricks via NUMAlink cables and expand the compute or memory capacity of the Altix 3700 Bx2. The 40U rack in this server houses all bricks, drives, and other components;...

  • Page 72: Figure 3-2 Sgi Altix 3700 Bx2 Server System (Example Configuration)

    3: System Overview CR-brick CR-brick Power bay CR-brick CR-brick R-brick R-brick Power bay CR-brick CR-brick CR-brick Power bay CR-brick IX-brick Figure 3-2 SGI Altix 3700 Bx2 Server System (Example Configuration) 007-4377-002...

  • Page 73: System Architecture

    System Architecture System Architecture The Altix 3700 Bx2 computer system is based on a distributed shared memory (DSM) architecture. The system uses a global-address-space, cache-coherent multiprocessor that scales to 64 Intel Itanium 2 processors in a single rack. Because it is modular, the DSM combines the advantages of low entry cost with the ability to scale processors, memory, and I/O independently to a maximum of 256 processors on a single-system image (SSI) at initial release.

  • Page 74: Figure 3-3 Functional Block Diagram Of Cr-Brick

    3: System Overview Brick Front System On On/Off Switch L1 Display Service ReqÕd Reset Switch System Fault NMI Switch Node 0 Node 1 Top Side Router Power Rtr C Rtr A 0 Rtr A 1 Rtr A 2 Rtr A 3 XIO 0 On/Off XIO 1...

  • Page 75: System Features

    System Features System Features The main features of the Altix 3700 Bx2 series server systems are introduced in the following sections: • “Modularity and Scalability” on page 51 • “Distributed Shared Memory (DSM)” on page 51 • “Distributed Shared I/O” on page 52 •...

  • Page 76: Distributed Shared I/O

    3: System Overview Distributed Shared I/O Like DSM, I/O devices are distributed among the compute nodes (each compute node has two I/O ports) and are accessible by all compute nodes through the NUMAlink interconnect fabric. ccNUMA Architecture As the name implies, the cache-coherent non-uniform memory access (ccNUMA) architecture has two parts, cache coherency and nonuniform memory access, which are discussed in the sections that follow.

  • Page 77: Non-Uniform Memory Access (Numa)

    System Features Non-uniform Memory Access (NUMA) In DSM systems, memory is physically located at various distances from the processors. As a result, memory access times (latencies) are different or “non-uniform.” For example, it takes less time for a processor to reference its local memory than to reference remote memory.
  • Page 78 3: System Overview • Power-on and boot: – Automatic testing occurs after you power on the system. (These power-on self-tests or POSTs are also referred to as power-on diagnostics or PODs). – Processors and memory are automatically de-allocated when a self-test failure occurs.

  • Page 79: System Components

    System Components System Components The Altix 3700 Bx2 series system features the following major components: • 40U rack. This is a custom rack used for both the compute and I/O rack in the Altix 3700 Bx2 system. The power bays are mounted vertically on one side of the rack. •...

  • Page 80: Figure 3-4 Altix 3700 Bx2 System Components Example

    3: System Overview 1 to 3 power bays per compute rack 1 power bay per I/O rack TP900 CHANNEL 2 CHANNEL 1 1 or 2 I/O channels OUTPUT 1 to 8 disk drives GOOD FAULT 0 to 4 per system (high bandwidth config) 0 to 24 per system (high capacity config) D-brick2 1 or 2 I/O channels...

  • Page 81: Bay (Unit) Numbering

    System Components Bay (Unit) Numbering Bays in the racks are numbered using standard units. A standard unit (SU) or unit (U) is equal to 1.75 inches (4.445 cm). Because bricks occupy multiple standard units, brick locations within a rack are identified by the bottom unit (U) in which the brick resides. For example, in a tall 40U rack, the CR-brick positioned in U05, U06, and U07 is identified as C05.

  • Page 82: Optional System Components

    3: System Overview Optional System Components The Altix 3700 Bx2 series system has the following external storage options: • Host bus adapter interfaces (HBA) – 2Gbit Fibre Channel, 200MB/s peak bandwidth – Ultra320 SCSI, 320 MB/s peak bandwidth – Gigabit Ethernet copper and optical –...

  • Page 83: Rack Information

    Chapter 4 Rack Information This chapter describes the physical characteristics of the tall (40 U) racks in the following sections: • “Overview” on page 59 • “Tall Rack (40U)” on page 60 • “Technical Specifications” on page 63 Overview At the time this document was published only the tall (40U) rack shown in Figure 4-1 was approved for use with the Altix 3700 Bx2 systems.

  • Page 84: Tall Rack (40U)

    4: Rack Information Tall Rack (40U) The tall rack (shown in Figure 4-1 on page 61) has the following features and components: • Front and rear door. Both front and rear doors lock to prevent unauthorized access to the system. You lock the front door from the rear of the rack by depressing and turning the actuator handle (see “Locking the Front Door”...

  • Page 85: Figure 4-1 Tall (40U) Rack

    Tall Rack (40U) Figure 4-1 Tall (40U) Rack 007-4377-002...

  • Page 86: Locking The Front Door

    4: Rack Information Locking the Front Door To lock the front door of the tall rack, follow these steps: Close the front door. 2. In the rear of the rack, press in the door lock actuator and rotate the lever to point downward (see Figure 4-2).

  • Page 87: Technical Specifications

    Technical Specifications Technical Specifications Table 4-1 lists the technical specifications of the tall rack. Table 4-1 Tall Rack Technical Specifications Characteristic Specification Height 74.25 in. (1885.95 mm) Width 30.875 in. (784.23 mm) Depth 53 in. (1346.2 mm) Weight (empty) 425 lb (192.78 kg) 007-4377-002...

  • Page 89: Cr-Brick

    Overview The CR-brick is a 4U-high enclosure that contains the compute and memory functionality for the SGI Altix 3700 Bx2 system. Figure 5-1 on page 66 shows a front and side view of the CR-brick. The CR-brick is divided into separate nodes that are connected internally by high-speed NUMAlink channels.

  • Page 90: Figure 5-1 Front And Side View Of Cr-Brick

    5: CR-brick Figure 5-1 Front and Side View of CR-brick 007-4377-002...
  • Page 91 Overview The CR-brick has the following features: • Up to eight 64-bit RISC processors (two processors per node) • Large secondary caches (on each processor) • Up to 48 memory DIMM slots (12 slots per node) • Up to eight internal NUMAlink channels (two per node) •...

  • Page 92: Figure 5-2 Cr-Brick Block Diagram

    5: CR-brick Brick Front System On On/Off Switch L1 Display Service ReqÕd Reset Switch System Fault NMI Switch Node 0 Node 1 Top Side Router Power Rtr C Rtr A 0 Rtr A 1 Rtr A 2 Rtr A 3 XIO 0 On/Off XIO 1...

  • Page 93: External Components

    External Components External Components This section describes the external components located on the front and rear panels of the CR-brick. Front Panel Components The CR-brick contains the following front panel items (see Figure 5-3 on page 70): • Three hot-pluggable fans. •...

  • Page 94: Figure 5-3 Front View Of Cr-Brick

    5: CR-brick Power button with LED Service-required Reset Failure LED L1 controller display Figure 5-3 Front View of CR-brick 007-4377-002...

  • Page 95: Rear Panel Components

    External Components Rear Panel Components The CR-brick has the following rear panel items (see Figure 5-4): • Power switch. Move the power switch to the position to power on the L1 controller within the CR-brick, and to the position to power off the L1 controller.

  • Page 96: Internal Components

    5: CR-brick LED illuminates green when the link between the CR-brick and the other brick is established. Port F Port G Port H Port A upper upper upper upper Node 1 XIO Console Power connector connector Not used Power switch L1 USB Power connector...

  • Page 97: Processors

    Pinouts Processors Eight 64-bit Intel Itanium 2 processors with secondary cache are mounted on half panel printed circuit boards (referred to as node boards). To reduce memory latency, each processor can access three levels of on-chip cache memory. L3 cache sizes and types vary with processor speed.

  • Page 98: Important Notes

    5: CR-brick Important Notes The CR-brick has the following restrictions: • All processors within the CR-brick must be the same frequency; however, CR-bricks within a partition or system can have different processor speeds. • All processor revisions must be the same within a processor node. •...

  • Page 99: Ix-Brick

    Chapter 6 IX-brick The IX-brick is an I/O expansion subsystem that connects I/O devices to your system by using either the PCI or PCI-X protocol. The PCI-X protocol enables I/O devices to operate at clock speeds of up to 133 MHz, or 1 Gbit/s. This protocol also enables I/O devices to operate more efficiently, thereby providing a higher sustained bandwidth at any clock frequency.

  • Page 100: Product Overview

    6: IX-brick Product Overview The 4U-high IX-brick, shown in Figure 6-1, provides 12 PCI-X slots that support up to 12 PCI or PCI-X cards. The 12 slots are configured as six 2-slot buses. Note: You can install PCI cards in 11 of the 12 PCI slots. One PCI-X slot (the leftmost slot) is reserved for a base I/O PCI card.

  • Page 101: Figure 6-2 Ix-Brick Block Diagram

    Product Overview Three PIC (PCI interface chip) ASICs are key components of the IX-brick architecture. These ASICs support two 1200- or 800-MB/s Xtown2 XIO ports and six PCI-X buses (see Figure 6-2). Each bus has two card slots in which you can install PCI cards. (Slot 1 of bus 1, however, seats the base I/O card only.) For best base I/O performance, leave the PCI slot (bus 1 slot 2) next to the base I/O card empty, or install only a 66 MHz PCI card.
  • Page 102 6: IX-brick Also important to the IX-brick architecture is the base I/O PCI card. This card contains logic that controls the DVD-ROM and internal system disk drives, and it provides the following connectors (see Figure 6-4): • Internal system disk connector that connects to up to two internal disk drives. •...

  • Page 103: External Components

    External Components External Components This section describes the external components that are located on the front and rear panels of the IX-brick. Front Panel Components The IX-brick has the following front panel components (see Figure 6-3): • Two system disk drives. These customer-removable, sled-mounted disk drives are used to house your operating system and other application software.

  • Page 104: Figure 6-3 Front Panel Of Ix-Brick

    6: IX-brick Warning: To prevent personal injury, or damage to the IX-brick, the hot-swappable fans can be installed only by a trained SGI system support engineer (SSE). System disk drives DVD-ROM Service required LED Drive bay cover Display On/Off switch with LED Failure LED Front Panel of IX-brick...

  • Page 105: Rear Panel Components

    External Components Rear Panel Components The IX-brick has the following rear panel components (see Figure 6-4): • Power switch. Moving the power switch to the position powers on the L1 controller of the IX-brick, and moving it to the position powers off the L1 controller.

  • Page 106: Figure 6-4 Rear Panel Of Ix-Brick

    6: IX-brick The leftmost PCI-X slot (bus 1, slot 1) seats a base I/O card that has the following connectors: • External SCSI connector. This 68-pin VHDCI external SCSI port enables you to connect your system to an external SCSI device. For an updated list of supported SCSI devices, see the SGI Supportfolio at http://support.sgi.com.

  • Page 107: Pci And Pci-X Card Configuration Guidelines

    PCI and PCI-X Card Configuration Guidelines PCI and PCI-X Card Configuration Guidelines The PCI-X slots are numbered bus 1 through bus 6. Each bus has two slots, labeled 1 and 2, as shown in Figure 6-5. Separate buses enable the IX-brick to run cards of different frequencies at the same time.

  • Page 108: Important Installation Considerations

    6: IX-brick Important Installation Considerations To maximize the operating efficiency of the PCI cards, consider the following configuration guidelines before you install the cards. • You can place one or two PCI cards on one bus, or one or two PCI-X cards on one bus.

  • Page 109: Pci Card Carrier

    Technical Specifications PCI Card Carrier Each PCI card is mounted on a carrier so that you can slide the cards into and out of the brick. This carrier supports most PCI cards; it can be adjusted to accommodate cards of different sizes.
  • Page 110 6: IX-brick Table 6-2 shows the port specifications of the IX-brick. Table 6-2 Port Specifications of the IX-brick Port Quantity Connector Type Power entry 21-pin Foxcon Proprietary 100-pin dual row The following external connectors are located on the base I/O card: SCSI connector One external 68-pin VHDCI external...

  • Page 111: Px-Brick

    Chapter 7 PX-brick The PX-brick is an optional PCI-X based I/O expansion subsystem that connects I/O devices to your system. The PX-brick supports both PCI and PCI-X protocol. PCI-X protocol enables I/O devices to operate at clock speeds of up to 133 MHz, or 1 Gbit/s. This new protocol also enables I/O devices to operate more efficiently, thereby providing a higher sustained bandwidth at any clock frequency.

  • Page 112: Product Overview

    7: PX-brick Product Overview The 4U-high PX-brick shown in Figure 7-1 provides 12 card slots to support up to 12 PCI or PCI-X cards. The 12 slots are configured as six 2-slot buses. The PX-brick offers the following: • The PX-brick supports both PCI cards and PCI-X cards. •...

  • Page 113: Figure 7-2 Block Diagram Of Px-Brick

    Product Overview Bus 6 slot 2 Bus 6 slot 1 Port F ASIC Bus 5 slot 2 Port D (XIO) Bus 5 slot 1 Crosstown2 XIO port Bus 4 slot 2 Port D (XIO) Port A Bus 4 slot 1 (XIO) Port F ASIC...

  • Page 114: External Components

    7: PX-brick External Components This section describes the external components located on the front and rear panels of the PX-brick. Front Panel Components The following are the front panel components of the PX-brick (see Figure 7-3): • L1 controller and display. The L1 controller generates PX-brick status and error messages that appear on the liquid crystal display (LCD).

  • Page 115: Figure 7-3 Front Panel And Display On The Px-Brick

    External Components Service required LED Display On/Off switch with LED Failure LED Front Panel and Display on the PX-brick Figure 7-3 007-4377-002...

  • Page 116: Rear Panel Components

    7: PX-brick Rear Panel Components The PX-brick has the following rear panel components (see Figure 7-4): • Power switch. Moving the power switch to the position powers on the L1 controller of the PX-brick, and moving it to the position powers off the L1 controller.

  • Page 117: Figure 7-4 Rear Panel Of The Px-Brick

    External Components Figure 7-4 shows the location of the rear panel components of the PX-brick. One LED lights yellow, the other lights green Connectors XIO 10 XIO 11 Power switch 48VDC 48/12VDC LEDs 12VDC PWR Connector PCI-X slot LEDs Figure 7-4 Rear Panel of the PX-brick 007-4377-002...

  • Page 118: Pci And Pci-X Card Configuration Guidelines

    7: PX-brick PCI and PCI-X Card Configuration Guidelines The PCI and PCI-X card slots on the motherboard are numbered bus 1 through bus 6. Each bus has two slots, labeled 1 and 2, as shown in Figure 7-5. Separate buses enable the PX-brick to run cards of different frequencies at the same time.

  • Page 119: Important Installation Considerations

    PCI and PCI-X Card Configuration Guidelines Important Installation Considerations To maximize the operating efficiency of the PCI cards, consider the following configuration guidelines before you install the cards. • You can place one or two PCI cards on one bus, or one or two PCI-X cards on one bus.

  • Page 120: Pci Card Carrier

    7: PX-brick PCI Card Carrier Each PCI card is mounted on a carrier so that you can slide the cards into and out of the brick. This carrier supports most PCI cards; it can be adjusted to accommodate cards of different sizes.

  • Page 121: R-Brick

    Chapter 8 R-brick This chapter describes the function and physical components of the optional R-brick in the following sections: • “Overview” on page 97 • “External Components” on page 100 • “Technical Specifications” on page 103 Overview The R-brick (router brick) is an eight-port optional router that functions as a high-speed switch to route network packets from one CR-brick to another throughout the NUMAlink interconnect fabric.

  • Page 122: Figure 8-1 Front View Of The R-Brick

    8: R-brick L1 controller display Failure LED Service-required LED Power button with LED Front View of the R-Brick Figure 8-1 The R-brick has the following features: • Eight NUMAlink channels • One USB port for system controller support • One L1 controller and LCD display •...

  • Page 123: Figure 8-2 R-Brick Block Diagram

    Overview Port 7 Port 8 Port 6 Port 1 Router ASIC Port 5 Port 2 Port 4 Port 3 LVDS LVDS LVDS LVDS System LVDS LVDS control board LVDS LVDS L2 host (Type A USB connector) L1 console (DB9 connector) R-brick Block Diagram Figure 8-2 007-4377-002...

  • Page 124: External Components

    8: R-brick External Components This section describes the external components that are located on the front and rear panels of the R-brick. Front Panel Components The R-brick contains the following front panel items (as shown in Figure 8-1 on page 98): •...

  • Page 125: Rear Panel Components

    External Components Rear Panel Components The R-brick has the following rear panel items (see Figure 8-3): • Power switch. Move the power switch to the I position to power on the L1 controller within the R-brick, and to the 0 position to power off the L1 controller. Powering on the L1 controller Illuminates the 12-VDC LED green.

  • Page 126: Figure 8-3 Rear View Of R-Brick

    8: R-brick Power switch Console Port H Port A 48VDC ELEC CONSOLE 12VDC RATING 48VDC 1.1A 12VDC 1.2A DC IN L1 USB L1 USB Port E Port D Power connector Rear View of R-brick Figure 8-3 007-4377-002...

  • Page 127: Technical Specifications

    Technical Specifications Technical Specifications Table 8-1 lists the technical specifications of the R-brick. Table 8-1 R-brick Technical Specifications Characteristic Specification Height 3.3 in. (83.82 mm) Width 17.38 in. (441.45 mm) Depth 27.5 in. (698.50 mm) Weight 20 lb (9.1 kg) Input power 48 VDC (~ 60 W) Table 8-2 lists the specifications of the R-brick ports.

  • Page 129: Power Bay

    Chapter 9 Power Bay This chapter describes the function and physical components of the power bay in the following sections: • “Overview” on page 105 • “External Components” on page 107 • “Distributed Power Supplies” on page 109 • “Technical Specifications” on page 111 Overview The power bay is a 3U-high enclosure that holds a maximum of six hot-swappable distributed power supply modules (DPSs).

  • Page 130: Figure 9-1 Front And Rear Views Of Power Bay

    9: Power Bay Front view Rear view Figure 9-1 Front and Rear Views of Power Bay The power bay has the following features: • 3U-high enclosure • Six AC input connectors • Eight DC output connectors • Fault reset button 007-4377-002...

  • Page 131: External Components

    External Components External Components This section describes the external components located on the front and rear panels of the power bay. Front Panel Components The front of the power bay seats the distributed power supplies (see Figure 9-2). When the power bay contains three power supplies, the supplies reside in locations 4, 5, and 6. Power supply 1 Power supply 2 Power supply 3...

  • Page 132: Rear Panel Components

    9: Power Bay Rear Panel Components The power bay module has eight DC output connectors (see Figure 9-3). A power cord connects one output connector to a C-brick, R-brick, IX-brick, or PX-brick. This connection provides 12-VDC standby power, 48-VDC power, and monitoring signals. Note: The L1 controller of a connecting module can monitor the status and enable the output ports of the power bay.

  • Page 133: Figure 9-4 Front And Rear Views Of The Dps

    Distributed Power Supplies Distributed Power Supplies The distributed power supplies (DPSs) are air-cooled devices; each DPS has two fans that move air from the front of the rack to the rear of the rack. Figure 9-4 shows front and rear views of a DPS.
  • Page 134 9: Power Bay The input and output power connectors shown in the rear view picture of the power supply interconnect with the power bay through a motherboard located inside the power bay. Table 9-1 lists conditions of the power supplies and the corresponding states of the LEDs. Table 9-1 Power Supply LED States LED States...
  • Page 135 Technical Specifications Technical Specifications Table 9-2 lists the technical specifications of the power bay. Table 9-2 Power Bay Technical Specifications Characteristic Specification Height 5.12 in. (130.04 mm) Width 17.5 in. (444.5 mm) Depth 23.87 in. (606.3 mm) Weight 64.5 lb (29.26 kg) (with five power supplies) Input voltage 220 VAC...
  • Page 137 The SGI TP900 storage module is a rackmountable, 2U-high, 8-drive storage system that provides JBOD (“just a bunch of disks”) storage for the SGI Altix 3700 Bx2 system. The drive backplane of the TP900 connects the 8 drives on one SCSI bus. As an option, the storage system can also be configured on two SCSI buses (2 strings of 4 drives).

  • Page 138: Figure 10-1 Front View Of Tp900 Storage Module

    10: SGI TP900 Storage Module External Components This section describes the external components located on the front and rear panels of the TP900 storage module. Front Panel Components The front of the SGI TP900 chassis consists of 8 drive bays that contain either disk drive carrier modules or dummy carrier modules, which are discussed in the subsections that follow.

  • Page 139: Figure 10-2 Drive Carrier Led Indicators

    External Components The front of the chassis also contains three status LEDs that are described in Table 10-1. Status LEDs Table 10-1 Status System status Green signifies that power is applied to the enclosure. Amber signifies that the ESI processor has failed. Power status Green signifies that the power supplies are functioning normally.

  • Page 140: Figure 10-3 Rear View Of Tp900 Storage Module

    10: SGI TP900 Storage Module Rear Panel Components The rear of the TP900 storage module contains 6 bays that house power supply, cooling, and SCSI I/O modules. See Figure 10-3. The rear of the TP900 storage module is 3 bays wide by 2 bays high.
  • Page 141 External Components Power Supply Module The SGI TP900 storage system requires one 350-W power supply module, which is mounted in the rear of the system (location 2/3). Power supply voltage operating ranges are nominally 115 V or 230 V and are selected automatically. Optionally, a second power supply module (location 2/1) can be added to the TP900 system to provide n+1 redundant power.

  • Page 142: Figure 10-4 Scsi Terminator Plug

    10: SGI TP900 Storage Module Cooling Module The cooling module consists of fans that pull warm air from a plenum behind the drive backplane and exhaust the warm air at the rear of the enclosure. The cooling modules connect to the backplane for power and status signal connections. The TP900 system requires one cooling module, which is mounted in the rear of the system.
  • Page 143 Technical Specifications Technical Specifications Table 10-2 lists the technical specifications of the TP900 storage module. Table 10-2 TP900 Storage Module Technical Specifications Characteristic Specification Height 3.37 in. (85.7 mm) Width 17.6 in. (447 mm) Depth 21.46 in. (545 mm) Weight: Maximum configuration 48.5 lb (22 kg) Empty enclosure...
  • Page 145 Chapter 11 D-brick2 Storage Module This chapter describes the functional and physical components of the D-brick2 non-RAID mass storage option brick. It also explains how to power the D-brick2 on and off, and how to replace disk drive modules in the D-brick2. For troubleshooting and additional detailed information on the D-brick2, see SGI Total Performance 9100 (2Gb TP9100) Storage System User’s Guide (P/N 007-4522-00x), which is available online at http://docs.sgi.com.

  • Page 146: Figure 11-1 D-Brick2 Front And Rear Views

    11: D-brick2 Storage Module D-brick2 Overview The optional D-brick2 module is a high performance, large-scale non-RAID storage system for your SGI rackmounted system. Each enclosure contains a minimum of 2 and maximum of 16 disk drives, and the component modules that handle I/O, power and cooling, and operations.
  • Page 147 D-brick2 External Components Functional Description The modular design of the D-brick2 expands easily to meet your mass storage needs. This storage system provides compact, high-capacity JBOD ("just a bunch of disks") storage for supported SGI systems. Each D-brick2 is connected to one or more Fibre Channel boards (host bus adapters, or HBAs) in the SGI host system, either separately or in a combination (loop).

  • Page 148: Figure 11-2 D-Brick2 Drive Carrier Module And "Dummy" Module

    11: D-brick2 Storage Module Drive Carrier Modules and “Dummy” Modules The disk drive carrier module consists of a hard disk drive mounted in a die-cast aluminum carrier (see Figure 11-2). The carrier protects the disk drive from radio frequency interference, electromagnetic induction, and physical damage. It also provides a means for thermal conduction.

  • Page 149: Figure 11-3 Anti-Tamper Locking On The D-Brick2 Disk Drive

    D-brick2 External Components A key (Torx screwdriver) to lock or unlock the disk drives is provided with each D-brick2. A red indicator is visible in the center rectangular aperture in the handle if the anti-tamper lock is locked, and a black indicator is visible when the lock is unlocked (see Figure 11-3).

  • Page 150: Figure 11-4 D-Brick2 Operators Panel And Power Supply/Cooling Modules

    11: D-brick2 Storage Module Fan fail LED AC input fail LED DC output fail LED PSU good LED Power-on LED Invalid address ID LED Enclosure ID switch Alarm mute switch PSU/cooling/temperature fault LED System/ESI fault LED Hub mode LED 2 Gb/s link speed LED AC power input Configuration switches Power on/off...

  • Page 151: Figure 11-5 D-Brick2 Loop Resiliency Circuit (Lrc) Module

    D-brick2 External Components Loop Resiliency Circuit (LRC) Modules The D-brick2 uses a Fibre Channel arbitrated loop (FC-AL) to interface with the host computer system. The FC-AL backplane incorporates two independent loops formed by port bypass circuits within the LRC I/O modules. Figure 11-5 shows an LRC module. Processors housed on the LRC modules provide enclosure management and interface to devices on the backplane, a PSU/cooling module, and an ops panel to monitor internal functions.
  • Page 152 11: D-brick2 Storage Module Powering the D-brick2 On or Off This section explains how to power the D-brick2 on and off. Powering On the D-brick2 Before powering on the D-brick2, confirm that the following is true: • Drives are seated in the correct bays and blank plates are fitted in any empty bays. •...
  • Page 153 Powering the D-brick2 On or Off Powering Off the D-brick2 Before powering off the D-brick2, confirm that the following has occurred: • All system users have been notified and are logged off. • Disk data has been backed up as appropriate. To power off a D-brick2 enclosure, follow these steps: Move the power switch on the rear of each PSU/cooling module to the “off”...
  • Page 154 11: D-brick2 Storage Module D-brick2 Technical and Environmental Specifications The rackmounted D-brick2 disk enclosure is 13.4 cm (5.3 in.) high, 50 cm (19.7 in.) deep, and 44.6 cm (17.5 in.) wide. Component weights, power requirements, and environmental information for the D-brick2 are provided in the following tables. Note: You should always follow system-level technical, operational, and environmental specifications, regardless of the tolerances of individual system bricks.
  • Page 155 D-brick2 Technical and Environmental Specifications Table 11-2 shows the power requirements and specifications of the D-brick2.] Table 11-2 D-brick2 Enclosure Power Specifications Specification Value Voltage range for rack 200-240 VAC Voltage range selection Automatic Frequency 50-60 Hz Power factor >0.98 Maximum power consumption 700 VA Typical power consumption...
  • Page 156 11: D-brick2 Storage Module Table 11-3 provides temperature and humidity requirements for D-brick2 modules.] Table 11-3 D-brick2 Ambient Temperature and Humidity Requirements Factor Temperature Relative Humidity Maximum Wet Bulb 5 °C to 40 °C 23 °C Operating temperature 20% to 80% noncondensing (41 °F to 104 °F) (73 °F) 0 °C to 50 °C...
  • Page 157 Chapter 12 Maintenance and Upgrade Procedures This chapter provides information about installing or removing components from your SGI system, as follows: • “Maintenance Precautions and Procedures” on page 133 • “Adding or Replacing a PCI or PCI-X Card” on page 136 •...
  • Page 158 12: Maintenance and Upgrade Procedures Preparing the System for Maintenance or Upgrade To prepare the system for maintenance, follow these steps: If you are logged on to the system, log out. At your system console, switch to the L1 mode by entering the following command: $>...
  • Page 159 Maintenance Precautions and Procedures Installing or Removing Internal Parts Caution: The components inside the system are extremely sensitive to static electricity. Always wear a wrist strap when you work with parts inside your system. To use the wrist strap, follow these steps: Unroll the first two folds of the band.
  • Page 160 12: Maintenance and Upgrade Procedures Adding or Replacing a PCI or PCI-X Card Warning: Before installing, operating, or servicing any part of this product, read the “Safety Information” on page 177. This section provides instructions for adding or replacing a PCI or PCI-X card in the IX-brick or PX-brick.

  • Page 161: Figure 12-1 Removing A Card Carrier

    Adding or Replacing a PCI or PCI-X Card To add or replace a PCI card, follow these steps: Shut down the operating system. (See your software guide if you need instructions to do this.) 2. Power off the I/O brick by following the power-off instructions in the “Powering Off the System”...

  • Page 162: Figure 12-2 Extracting The Carrier Metal Filler Plate

    12: Maintenance and Upgrade Procedures 4. If you are replacing a card, gently remove the existing card from the carrier. If you are adding a card, extract the carrier metal filler plate by pushing down on it, as shown in Figure 12-2. This filler plate covers the area where your card connectors will protrude out to the rear panel of the I/O brick.

  • Page 163: Figure 12-3 Adjusting The Carrier Guide Bar

    Adding or Replacing a PCI or PCI-X Card Note: If you are adding or replacing a half-height PCI card, skip step 5 and proceed to step 6. 5. If the full-height card that you want to install does not fit in the carrier, follow these steps: Loosen the three screws on the guide bar with a Phillips screwdriver (if your carrier uses T8 Torx screws, you will need a Torx screw driver).

  • Page 164: Figure 12-4 Mounting Card In Carrier

    12: Maintenance and Upgrade Procedures Mount the card in the carrier, as shown in Figure 12-4, so that the following occurs: – The card connectors protrude through the bulkhead where the metal filler plate was located. – The edge connectors fit between the bottom guides of the carrier. –...

  • Page 165: Figure 12-5 Mounting Half-Height Pci Card Into Carrier

    Adding or Replacing a PCI or PCI-X Card 6. To install a half-height PCI card in a carrier, follow these steps: Remove the two screws from the carrier guide bar, as shown in Figure 12-5. Note: Take care not to lose the threaded inserts in the carrier guide bar. b.

  • Page 166: Figure 12-7 Installing The Bracket To Secure A Half-Height Pci Card

    12: Maintenance and Upgrade Procedures Place the PCI card bracket so that the screw holes of the bracket align with the empty screw holes of the carrier guide bar, as shown in Figure 12-7. Secure the bracket to the carrier guide bar with two T8 Torx screws. g.

  • Page 167: Figure 12-8 Installing A Card In A Slot

    Adding or Replacing a PCI or PCI-X Card 7. Insert the carrier-mounted PCI card into the vacant slot, using the slot guide, as shown in Figure 12-8. Figure 12-8 Installing a Card in a Slot 8. Push horizontally on the carrier seating bar, as shown in Figure 12-9, to seat the card securely in the slot.

  • Page 168: Figure 12-10 Location Of Scsi Disk Drive Bays

    12: Maintenance and Upgrade Procedures 10. Boot your operating system software. (See your software operation guide if you need instructions to boot your operating system.) 11. Run the hinv hardware inventory command to verify the installation. This command lists hardware that the operating system discovered during the boot operation.
  • Page 169 Installing or Replacing a Disk Drive in the IX-brick To install a disk drive, see Figure 12-11 and follow these steps: Remove the drive bay cover to access the two disk drive bays (see panel 1 in Figure 12-11). Note: If you are installing only one disk drive, install it in the rightmost bay. 2.

  • Page 170: Figure 12-11 Installing A Disk Drive

    12: Maintenance and Upgrade Procedures Locking handle Figure 12-11 Installing a Disk Drive 007-4377-002...
  • Page 171 Installing or Replacing a Disk Drive in the IX-brick Removing a System Disk Drive Before you remove a disk drive, you must power off the IX-brick according to the instructions in the “Powering Off the System” on page 8. To remove a disk drive, follow these steps (see Figure 12-12): Remove the drive bay cover to access the two disk drive bays, as shown in panel 1 of Figure 12-12.

  • Page 172: Figure 12-12 Removing A Disk Drive

    12: Maintenance and Upgrade Procedures Locking handle Figure 12-12 Removing a Disk Drive 007-4377-002...
  • Page 173 Replacing a TP900 Drive Carrier Module Replacing a TP900 Drive Carrier Module Caution: Follow electrostatic discharge (ESD) precautions while replacing the drive carriers. Avoid contact with the backplane components and module connectors. To remove and replace a drive carrier module from the SGI TP900 enclosure, follow these steps: Caution: Do not remove a drive carrier unless a replacement or a dummy carrier can be immediately added.

  • Page 174: Figure 12-13 Unlocking The Anti-Tamper Lock

    12: Maintenance and Upgrade Procedures Torx screwdriver Figure 12-13 Unlocking the Anti-Tamper Lock 2. Release the carrier handle by pressing the latch in the handle towards the right. 3. Gently withdraw the drive carrier module approximately 1 inch (25 mm), and then wait 30 seconds for the drive to spin down.

  • Page 175: Figure 12-14 Releasing The Carrier Handle

    Replacing a TP900 Drive Carrier Module 5. Release the handle of the replacement carrier by pressing the latch in the handle towards the right, as shown in Figure 12-14. Insert the carrier into the enclosure. Figure 12-14 Releasing the Carrier Handle Important: Ensure that the carrier is oriented so that the drive is uppermost and the handle opens from the left.

  • Page 176: Figure 12-15 Carrier Camming Lever

    12: Maintenance and Upgrade Procedures 6. Gently slide the carrier all the way into the enclosure until it is stopped by the camming lever on the right of the carrier, as shown in Figure 12-15. TP900 Storage Module Figure 12-15 Carrier Camming Lever 7.
  • Page 177 Installing or Replacing a D-brick2 Drive Carrier Module Installing or Replacing a D-brick2 Drive Carrier Module This section explains how to install or replace a drive carrier in the D-brick2 storage module, as follows: • “Installing a Drive Carrier Module” on page 153 •...

  • Page 178: Figure 12-16 Unlocking The Drive Carrier Module

    12: Maintenance and Upgrade Procedures 3. Place the drive carrier module on an antistatic work surface and ensure that the anti-tamper lock is disengaged (unlocked). The indicator window is red when the drive is locked. A disk drive module cannot be installed if its anti-tamper lock is activated (locked) outside the enclosure.

  • Page 179: Figure 12-17 Opening The Module Handle

    Installing or Replacing a D-brick2 Drive Carrier Module 4. Open the handle of the replacement carrier by pressing the latch handle towards the right (see Figure 12-17). Figure 12-17 Opening the Module Handle 5. Remove the dummy drive carrier module from the target drive bay. 007-4377-002...

  • Page 180: Figure 12-18 Inserting The Disk Drive Module In A D-Brick2

    12: Maintenance and Upgrade Procedures 6. Orient the new drive carrier module so that the hinge of the handle is on the right. Then slide the drive carrier module into the chassis until it is stopped by the camming lever on the right of the module (see Figure 12-18). s g i s g i s g i s g i...

  • Page 181: Figure 12-19 Locking The Drive Carrier Module

    Installing or Replacing a D-brick2 Drive Carrier Module 9. When you finish installing the drive carrier module(s), lock the drive carrier module(s) in the chassis by inserting the Torx screwdriver in the drive module and turning it 90 degrees clockwise. The indicator in the drive carrier module turns red when the drive is locked.

  • Page 182: Figure 12-20 Unlocking The Disk Drive Module

    12: Maintenance and Upgrade Procedures Replacing a Drive Carrier Module This section explains how to replace a defective drive carrier module. Caution: Follow electrostatic discharge (ESD) precautions while replacing the drive carriers. Avoid contact with the backplane components and module connectors. Note: Replace disk drive modules one at a time.

  • Page 183: Figure 12-21 Removing The Drive Carrier Module

    Installing or Replacing a D-brick2 Drive Carrier Module 4. Open the handle by pressing the latch on the module handle towards the right. Then gently slide the module out of the enclosure approximately 1 inch (25 mm), and wait 30 seconds for the drive to stop spinning. See Figure 12-21. Caution: Damage can occur to a drive if it is removed while still spinning.
  • Page 185 Chapter 13 Troubleshooting and Diagnostics This chapter provides the following sections to help you troubleshoot your system: • “Troubleshooting Chart” on page 162 • “L1 Controller Error Messages” on page 164 • “SGI Electronic Support” on page 166 007-4377-002...
  • Page 186 13: Troubleshooting and Diagnostics Troubleshooting Chart Table 13-1 lists recommended actions for problems that can occur. To solve problems that are not listed in this table, use the SGI Electronic Support system or contact your SGI system support engineer (SSE). For more information about the SGI Electronic Support system, see the “SGI Electronic Support”...
  • Page 187 Troubleshooting Chart Troubleshooting Chart (continued) Table 13-1 Problem Description Recommended Action The System Status LED of the TP900 is Contact your SSE. amber. The Power Status LED of the TP900 is Contact your SSE to replace the power supply amber. module.
  • Page 188 13: Troubleshooting and Diagnostics L1 Controller Error Messages Table 13-2 lists error messages that the L1 controller generates and displays on the L1 display. This display is located on the front of the CR-bricks, R-bricks, IX-brick, and PX-bricks. Note: In Table 13-2, a voltage warning occurs when a supplied level of voltage is below or above the nominal (normal) voltage by 10 percent.
  • Page 189 L1 Controller Error Messages L1 Controller Messages (continued) Table 13-2 L1 System Controller Message Message Meaning and Action Needed Temperature messages: low alt. ATTN: <temp sensor description> advisory The ambient temperature at the brick’s air inlet temperature reached @ xxC xxF has exceeded 30°...

  • Page 190: Figure 13-1 Full Support Sequence

    13: Troubleshooting and Diagnostics SGI Electronic Support SGI Electronic Support provides system support and problem-solving services that function automatically, which helps resolve problems before they can affect system availability or develop into actual failures. SGI Electronic Support integrates several services so they work together to monitor your system, notify you if a problem exists, and search for solutions to problems.
  • Page 191 SGI Electronic Support The sequence of events can be described as follows: Embedded Support Partner (ESP) monitors your system 24 hours a day. 2. When a specified system event is detected, ESP notifies SGI via e-mail (plain text or encrypted). 3.
  • Page 192 13: Troubleshooting and Diagnostics The following three components compose the integrated SGI Electronic Support system: SGI Embedded Support Partner (ESP) is a set of tools and utilities that are embedded in the SGI Linux ProPack release. ESP can monitor a single system or group of systems for system events, software and hardware failures, availability, performance, and configuration changes, and then perform actions based on those events.
  • Page 193 Appendix A Technical Specifications and Pinouts This appendix contains technical specification information about your system, as follows: • “System-level Specifications” on page 169 • “Physical Specifications” on page 170 • “Environmental Specifications” on page 171 • “Power Specifications” on page 172 •...
  • Page 194 A: Technical Specifications and Pinouts Physical Specifications Table A-2 shows the physical specifications of the Altix 3700 Bx2 system. Table A-2 Altix 3700 Bx2 Physical Specifications Feature Specification Dimensions for a single tall rack, Height: 74.25 in. (1886 mm) including doors and side panels Width: 30.88 in.
  • Page 195 Environmental Specifications Environmental Specifications Table A-3 lists the environmental specifications of the system. Table A-3 Environmental Specifications Feature Specification +5 °C (41 °F) to +35 °C (95 °F) (up to 1500 m / 5000 ft.) Temperature tolerance +5 °C (41 °F) to +30 °C (86 °F) (1500 m to 3000 m /5000 ft. to 10,000 ft.) (operating) -40 °C (-40 °F) to +60 °C (140 °F) Temperature tolerance...
  • Page 196 A: Technical Specifications and Pinouts Power Specifications Table A-4 shows the power specifications for the system. Table A-4 Power Specifications Feature Specification Single-phase power requirements Voltage 200-240V (180-254 VAC min/max) Frequency 50-60 Hz Power 11.2 kW per rack Hold-up time 20 ms Total harmonic distortion Less than 14% at full load...
  • Page 197 I/O Port Specifications I/O Port Specifications This section contains specifications and port pinout information for the base I/O ports of your system, as follows: • “Ethernet Port” on page 174 • “Serial Ports” on page 175 007-4377-002...

  • Page 198: Figure A-1 Ethernet Port

    A: Technical Specifications and Pinouts Ethernet Port The system auto-selects the Ethernet port speed and type (duplex vs. half-duplex) when the server is booted, based on what it is connected to. Figure A-1 shows the Ethernet port. Pin 4 Pin 5 Pin 6 Pin 3 Pin 7...

  • Page 199: Figure A-2 Serial Port

    I/O Port Specifications Serial Ports The IX-brick features two standard available 9-pin serial ports via the base I/O PCI card. These ports are capable of transferring data at rates as high as 230 kbps. Other features of the ports include the following: •...
  • Page 200 A: Technical Specifications and Pinouts Table A-6 shows pinout assignments for the 9-pin male DB-9 connector. Table A-6 Serial Port Pinout Assignment Description Data carrier detect Receive data Transmit data Data terminal ready Signal ground Data set ready Request to send Clear to send Ring indicator 007-4377-002...
  • Page 201 Appendix B Safety Information and Regulatory Specifications This appendix provides safety information and regulatory specifications for your system in the following sections: • “Safety Information” on page 177 • “Regulatory Specifications” on page 179 Safety Information Read and follow these instructions carefully: Follow all warnings and instructions marked on the product and noted in the documentation included with this product.
  • Page 202 B: Safety Information and Regulatory Specifications 9. Do not attempt to service this product yourself except as noted in this guide. Opening or removing covers of node and switch internal components may expose you to dangerous voltage points or other risks. Refer all servicing to qualified service personnel.
  • Page 203 Regulatory Specifications Regulatory Specifications The following topics are covered in this section: • “CMN Number” on page 179 • “CE Notice and Manufacturer’s Declaration of Conformity” on page 179 • “Electromagnetic Emissions” on page 180 • “Shielded Cables” on page 182 •...
  • Page 204 B: Safety Information and Regulatory Specifications Electromagnetic Emissions This section provides the contents of electromagnetic emissions notices from various countries. FCC Notice (USA Only) This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: •...

  • Page 205: Figure B-1 Vcci Notice (Japan Only)

    Regulatory Specifications Industry Canada Notice (Canada Only) This Class A digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numérique német pas de perturbations radioélectriques dépassant les normes applicables aux appareils numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques établi par le Ministère des Communications du Canada.
  • Page 206 B: Safety Information and Regulatory Specifications Shielded Cables This SGI system is FCC-compliant under test conditions that include the use of shielded cables between the system and its peripherals. Your system and any peripherals you purchase from SGI have shielded cables. Shielded cables reduce the possibility of interference with radio, television, and other devices.
  • Page 207 Regulatory Specifications Laser Compliance Statements The DVD-ROM drive in this computer is a Class 1 laser product. The DVD-ROM drive’s classification label is located on the drive. Warning: Avoid exposure to the invisible laser radiation beam when the device is open.
  • Page 208 B: Safety Information and Regulatory Specifications Lithium Battery Statements Warning: If a lithium battery is a soldered part, only qualified SGI service personnel should replace this lithium battery. For other types, replace the battery only with the same type or an equivalent type recommended by the battery manufacturer, or the battery could explode.
  • Page 209 Index CMN number command targeting Altix 3700 Bx2 server L1 mode illustration L2 mode Altix 3700 Bx2 servers console monitoring locations L1 mode power off powering off L1 mode power on powering on powering off bricks apropos command xxii powering on bricks audible alarm console communications subchannels...
  • Page 210 Index antitamper lock disengaging D-brick2 components cooling module drive carrier modules dummy modules embedded support partner (ESP) features system support front view environmental specifications LRC module error messages overview ESI/ops panel module power supply module ESP (embedded support partner) powering off system support powering on Ethernet connector...
  • Page 211 Index block diagram messages 28, 32 front panel components viewing system configuration overview L1 software PCI and PCI-X card slots modes of operation PCI and PCI-X slot rules to L1 mode PCI and PCI-X slots L2 emulation mode PCI card configuration guidelines to L1 mode rear panel viewing system configuration...
  • Page 212 Index connector TP900 storage module non-uniform memory access (NUMA) power bay numbering features bricks in a rack front panel components racks front view 106, 107 overview rear panel components rear view 106, 108 technical specifications PCI and PCI-X cards power specifications installation procedure power supply LED IX-brick PCI and PCI-X slots...
  • Page 213 Index list of optional RAS features system controller R-brick system features block diagram system overview features front panel components overview port specifications rear panel components tall rack rear view features technical specifications locking front door resetting system technical specifications L1 mode CR-brick L2 mode distributed power supplies...
  • Page 214 Index warning and error messages XIO 11 and XIO 10 viewing in L1 mode IX-brick PX-brick warning messages viewing in L2 mode 32, 38 007-4377-002...

Table of Contents