Do you have a question about the SGI Altix 450 and is the answer not in the manual?
Questions and answers
Subscribe to Our Youtube Channel
Summary of Contents for Silicon Graphics SGI Altix 450
Page 1
® ® Altix 450 System User’s Guide Document Number 007-4857-002...
Page 2
Intel and Itanium are trademarks or registered trademarks of Intel Corporation or its subsidiaries in the United States and other countries. UNIX is a registered trademark in the United States and other countries, licensed exclusively through X/Open Company, Ltd.
Record of Revision Version -001 -002 007-4857-002 Description August 2006, First release March 2007, Engineering updates to cover RAID 1, DVD-R/W, 2D graphics and IA2.
Contents List of Figures . List of Tables About This Guide . Audience. Important Information . Chapter Descriptions Related Publications . Conventions . Product Support . Reader Comments . System Installation . System Installation Overview . Safety Precautions . Hazard Statements . ESD Precautions Safety Measures 007-4857-002...
Page 6
Contents Installing a Rack . Preinstallation Activities Site Plan Verification . Tools Required . Power Receptacle Verification . Unloading and Moving System Equipment . Unloading the Equipment from the Truck . Inspecting the Shipping Crate . Transporting the Shipping Crate Removing a Short Rack from the Shipping Crate .
Page 7
Operation Procedures . Precautions . ESD Precaution . Safety Precautions . System Controller Network . Console Connections Connecting to the System Controller Communicating with the System Controller Powering the System On and Off Preparing to Power On . Powering On and Off at the Console . Powering On and Off from the L1 .
Page 8
Levels of System Control System Controller Interaction L1 Controller . L1 Controller Functions . L1 Front Panel Display . Ethernet Switch . Console Hardware Requirements Operating the L1 . L1 Mode . Viewing System Configuration (from an IRU’s Perspective) .
Page 9
Altix 42U and 20U Rack Features . Technical Specifications. Maintenance and Upgrade Procedures . Maintenance Precautions and Procedures . Preparing the System for Maintenance or Upgrade Returning the System to Operation . Installing or Removing Internal Parts . Replacing IRU Components. Remove and Replace the System Control Display Panel .
Page 10
Contents Physical Specifications . Environmental Specifications Power Specifications . I/O Port Specifications . Ethernet Port. Serial Ports . External SAS/SATA Port Connector USB Type A Connector . Safety Information and Regulatory Specifications . Safety Information Regulatory Specifications CMN Number CE Notice and Manufacturer’s Declaration of Conformity . Electromagnetic Emissions .
Page 12
Blade, IRU and Rack Components Functional Block Diagram of the Individual Rack Unit (IRU) . Altix 450 IRU System Components Example SGI Altix 450 System Control Network (Example) . L1 Front Panel Ethernet Switch System Controller Block Diagram (Example) .
Page 13
Figure 6-23 Figure 6-24 Figure 6-25 Figure 6-26 Figure 6-27 Figure 6-28 Figure 7-1 Figure 7-2 Figure A-1 Figure A-2 Figure A-3 Figure A-4 Figure B-1 Figure B-2 Figure B-3 007-4857-002 Seating the Card in the Slot . Removing the Card Access Panel From the IA Blade . Replacing the IA Blade PCI Access Door Location of Disk Drive Bays .
Warning: system support engineer (SSE) should perform any replacement of parts, or service of your SGI Altix 450 system not covered in the following list of items that you can perform yourself: • Unpacking, setting up and connecting the system rack(s) and individual rack units IRU(s).
About This Guide • Using the ESI/ops panel (operating panel) on optional mass storage bricks. See the user’s guide for your optional SGI mass storage enclosure. Chapter Descriptions The following topics are covered in this guide: • Chapter 1, “System Installation” guides an installer through the steps of unpacking and positioning the system rack(s).
Related Publications The following SGI documents are relevant to the Altix 450 series system: • SGI L1 and L2 Controller Software User’s Guide (P/N 007-3938-00x) This guide describes how to use the L1 and L2 controller commands at your system console to monitor and manage your SGI system.
Page 20
About This Guide References in the documentation to these pages include the name of the command and the section number in which the command is found. For additional information about displaying man pages using the man command, see man(1). In addition, the apropos command locates man pages based on keywords. For example, to display a list of man pages that describe disks, type the following on a command line: apropos disk For information about setting up and using apropos, see apropos(1).
Conventions The following conventions are used throughout this document: Convention Command variable user input man page(x) GUI element Product Support SGI provides a comprehensive product support and maintenance program for its products, as follows: • If you are in North America, contact the Technical Assistance Center at +1 800 800 4SGI or contact your authorized service provider.
About This Guide Reader Comments If you have comments about the technical accuracy, content, or organization of this document, contact SGI. Be sure to include the title and document number of the manual with your comments. (Online, the document number is located in the front matter of the manual. In printed manuals, the document number is located at the bottom of each page.) You can contact SGI in any of the following ways: •...
Chapter 1 System Installation This chapter describes how to unpack and install your Altix 450 system. Specifically, the following topics are covered: • “System Installation Overview” on page 2 • “Safety Precautions” on page 3 • “Installing a Rack” on page 6 •...
1: System Installation System Installation Overview In this chapter, different installation instructions are provided for different types of system installations. Follow the instructions for your type of installation, as follows: Note: It is assumed that you will be connecting a system console to your system in each installation case.
• If you have ordered either a single- or dual-IRU system that you intend to install on a table top, follow the instructions in these sections: – – – – – • If you have your own rack, and have ordered system modules with the intention of rackmounting and cabling your own system, follow the instructions in these sections: –...
1: System Installation Hazard Statements During the installation of your Altix 450 system, be alert for hazard advisory statements with icons, which signify the following: • Caution indicates a potentially hazardous situation that, if not avoided, can result in minor or moderate injury.
Safety Measures Observe the following safety measures when you install the system: • Use caution when you remove the system from the shipping crate. Failure to handle the system carefully can result in personal injury or property damage. Caution: Ensure that the shipping crate is positioned close to its destination before you unpack the crate.
1: System Installation Installing a Rack This section describes how to install a rack that already has your system IRUs rackmounted and cabled together. The following information is provided: • “Preinstallation Activities” on page 6 • “Unloading and Moving System Equipment” on page 12 •...
1: System Installation Power Receptacle Verification Ensure that a qualified technician installs the correct power receptacles. Your Altix 450 system uses one or two single-phase power receptacles. For North American sites, the single-phase receptacle is a 30-amp, 200- to 240-volt receptacle that has two phase sockets and one ground socket.
Figure 1-1 007-4857-002 Pole X Pole Y Socket Y 30-amp Single-phase Power Receptacle for North American Sites Installing a Rack Power cord connector Ground pole Ground socket Socket X Receptacle...
Page 32
1: System Installation For international sites, follow these steps to ensure that a single-phase power receptacle is properly wired: 1. Set the voltmeter to a high AC voltage range. 2. Check the voltage between socket 1 and socket 2 (see Figure 1-2). The meter should read between 200 and 240 VAC.
1: System Installation Unloading and Moving System Equipment Your Altix 450 system arrives at the site in a pallet-mounted cardboard shipping crate. For a short rack system, the documentation carton and the accessories carton are packed with the system. The documentation carton contains the system manuals as well as warranty and licensing information.
If your site does not have a loading dock, arrange for a forklift to unload the system from the transportation vehicle. Ensure that two or three people are available to help unload the equipment. Move all crates slowly and carefully. Figure 1-3 shows the lift openings and dimensions of a tall rack shipping crate.
1: System Installation Figure 1-4 shows the lift openings and dimensions of a short rack shipping crate. This figure also shows where to position the pallet jack. 48.75 (1238 mm) Pallet jack position Figure 1-4 Inspecting the Shipping Crate After the system is unloaded from the truck, follow these steps before you unpack it: 1.
Transporting the Shipping Crate Use a pallet jack with forks that are 48 in. (122 cm) long or longer to transport the shipping crate to the designated location. See Figure 1-3 and Figure 1-4 for the crate dimensions and location to position the pallet jack.
1: System Installation Removing a Short Rack from the Shipping Crate Warning: to move the rack to the unpacking site. Ensure that the rack remains on a level surface and that the rack weight remains evenly distributed across the four casters. If you must lift the casters over an obstacle, such as a door threshold, use proper lifting techniques and employ a minimum of two people.
Rear mounting bracket Figure 1-5 007-4857-002 Ramp Removing a Short Rack from the Shipping Crate Installing a Rack Cardboard cover Foam cushion Front mounting bracket...
1: System Installation Unpacking and Installing the Tall Rack Warning: 1,450 lb (658 kg). Use caution when you unpack and move this rack. A pallet jack is needed to move the rack prior to unpacking. Ensure that the rack remains on a level surface and that the rack weight remains evenly distributed across the four casters.
Positioning and Leveling Racks Caution: To avoid ESD damage to the electronic components, be sure to position the racks before you remove the ESD bags that cover the rack assemblies. To position and level your system racks, follow these steps: 1.
1: System Installation Top view of short rack Top view of tall rack Figure 1-9 Unpacking and Inspecting Modules This section describes how to unpack and inspect individual IRUs. Follow these instructions if you plan to install individual modules in a rack or on a table top. Before unpacking your IRUs, inspect the packaging container for evidence of mishandling during transit.
Firmly connect the base module of the IRU to the fan module using these steps: Align the rear connectors of the fan module with the rear of the IRU base module and carefully slide it in until it fully joins together. 2.
1: System Installation Installing the IRUs in a Rack This section describes how to install the IRUs that compose an Altix 450 system in a rack. This section also describes how to remove the IRUs from a rack. You can use the instructions to rackmount one or more IRUs in a 20U (short) or 42U (tall) Altix rack.
Determining Where to Attach Rails in a Rack The base IRU, and any additional IRUs, each require five units (5U) of vertical space within the rack (one unit is equivalent to 1.75 inches [44.5 mm]). To determine where you should install the unit’s shelf rails in the rack, you must count mounting holes.
1: System Installation Rackmounting IRUs with Shelf Rails This section describes how to rackmount an IRU using shelf rails. The shelf rails, which are shipped with the module, support the module within the rack. To attach the shelf rails to the rack, follow these steps: Locate the slot location in the rack in which you will install the IRU.
Note: Even with the blades, power supplies and fan module disconnected, the IRU’s base unit is heavy. Always use two people when installing it into a rack. 7. Working from the front of the rack, set the rear edge of the IRU module on the shelf rails. Then slide the module into the rack until the module ears are snug against the front rack rails.
1: System Installation Removing a Rackmounted IRU Module To remove an IRU that is already mounted in a rack, follow these steps: 1. Power off the module. For instructions on how to power off the module, see “Powering the System On and Off” on page 38. 2.
NUMAlink Cabling the System IRUs Some configurations of an Altix 450 system will consist of either two or more IRUs. This section describes how to cable together these multiple units. If your system was shipped with all the cables pre-installed, go on to the next section. Note: If your system is made up of a single module, you can skip this section and proceed to “Cabling the System IRUs to a Power Source”...
1: System Installation Figure 1-14 To connect two Altix 450 compute modules to each other with NUMAlink cables, follow these steps: Power off both compute modules (see “Powering the System On and Off” on page 38). 2. Connect the NUMAlink cables to the NUMAlink connectors on both IRU modules. 3.
The console output should indicate that the processors and memory on both IRU modules have been discovered. If the secondary IRU module has not been discovered, use the reset L1 command to perform a reset of the system. Note: Use the network L1 command to set the network mode. (See the SGI L1 and L2 Controller Software User’s Guide (007-3938-00x) for more information on L1 commands.) Cabling the System IRUs to a Power Source This section describes how to make the following connections to a power source:...
1: System Installation Figure 1-15 Figure 1-16 shows the connecting of a dual-IRU system located on either a tabletop or desktop, to a power source. in si Power-Supply Connectors on the IRU Module 007-4857-002...
Power distribution unit (PDU) Power source Figure 1-16 007-4857-002 inside inside Connecting an Unracked IRU System to a Power Source Cabling the System IRUs to a Power Source...
1: System Installation Connecting System Modules to a Rack Power Source If your Altix 450 system is shipped from SGI in a rack, there will be at least one power distribution unit (PDU) installed in the rack. Note that each single-phase PDU can support a maximum of two Altix 450 IRUs.
Figure 1-18 shows an example of the optional three-phase PDU available in tall racks only. Figure 1-18 007-4857-002 Power distribution unit (PDU) Optional Three-Phase PDU Example Cabling the System IRUs to a Power Source...
1: System Installation Connecting the System Console This section explains how to attach and establish a connection between a system console and an Altix 450 system. The system console enables you to perform the following activities: • Start a Linux console session to set up networking and other configuration parameters. •...
Connecting the System Console Console port Reset button in s id Ethernet port L1 controller panel Figure 1-19 Location of the L1 Console Port 007-4857-002...
“Cabling the System IRUs to a Power Source” on page 31 for information. Note: You must manually power on any optional storage modules by placing the power switch(es) in the ON ( starting the operating system. ) position. Note that you should turn any optional storage module on before...
Powering On With Optional System Console and L1/L2 Controller To power on and boot your system using the system console, follow these steps: If not yet done so, connect a system console to the server system as described in “Connecting the System Console” on page 36. 2.
Page 62
1: System Installation 4. Verify that all of the L1 controllers display “L1 running.” If any L1 controllers are not running, contact your SGI system support engineer (SSE). 5. At the system console, access the L2 controller by entering the following command: $>...
Powering On Manually or With L1 Console If your system does not have a a local system console, you can manually power on and off the server by using the power button(s). To power on your system or an individual IRU manually, follow these steps: If the monitors and other peripherals are equipped with voltage select switches, verify that they are set for the appropriate AC voltage and plug them in.
1: System Installation Powering Off at the System Console To power off your system using the system console, follow these steps: Caution: If you power off the system before you halt the operating system, you can lose data. Shut down the operating system by entering the following command: # init 0 2.
Powering Off Manually To power off your system manually, follow these steps: Caution: If you power off the system before you halt the operating system, you can lose data. Shut down the operating system by entering the following command: # init 0 2.
1: System Installation L1 Front Panel Controls The L1 front panel of the Altix 450 IRU provides the following control features, as shown in Figure 1-22: • Status LEDs. The front panel has the following LEDs: • • • • Power button.
Note: If your system includes an optional storage module, see the user’s guide that comes with the product for operating instructions. Operating the L1 Controller The L1 controller operates in one of the two following modes: • L1 mode. The L1 prompt ( command processor.
Page 68
1: System Installation escaping to L1 system controller 001c01-L1> l1 L1 command processor engaged, <CTRL-D> for console mode. 001c01-L1> 007-4857-002...
Chapter 2 Operation Procedures This chapter explains how to operate your new system in the following sections: • “Precautions” on page 47 • “System Controller Network” on page 49 • “Powering the System On and Off” on page 51 • “Using Embedded Support Partner (ESP)”...
2: Operation Procedures Safety Precautions Warning: Information” on page 165. Danger: follow these precautions will result in serious injury or death. The high-voltage areas of the system are indicated with high-voltage warning labels. Caution: Power off the system only after the system software has been shut down in an orderly manner.
System Controller Network All Altix 450 enclosures contain an embedded microprocessor board and display assembly known as the system controller. This microprocessor runs an embedded version of the Linux operating system. The system controller runs off standby power and is running as long as the enclosure is connected to an active power source.
2: Operation Procedures Console Connections A console is defined as a connection to the system that provides access to the system controller network. A console can be a personal computer (Ethernet connection) or a dumb terminal (serial connection). The Altix 450 series supports multiple types of console connections: •...
Communicating with the System Controller Once a connection to the console is established, the user will be presented with either an L2 prompt (ethernet connection), known as L2 mode, or and L1 prompt (serial connection), known as L1 mode. From either of these prompts various system controller commands can be entered. 001c01-L1>...
Figure 2-1 3. If you plan to power on a server that includes optional mass storage enclosures, make sure that the power switch on the rear of each PSU/cooling module (one or two per enclosure) is in the 4. Make sure that all PDU circuit breaker switches (see the example in Figure 2-2 on page 53) are turned on to provide power to the server system when it is switched on.
Power source Figure 2-2 007-4857-002 Power distribution unit (PDU) On/off switches Single-Phase Rack PDU Circuit Breaker Switches Powering the System On and Off...
2: Operation Procedures Powering On and Off at the Console The power-on and off procedure at a console varies with your server setup, as follows: • If you have a console connected to a server with a serial interface, you can toggle between L1 and console mode.
Page 77
oo1c01-L1> * power down (* indicates all) From the L1 prompt, display the system configuration information by entering the following command: 001c01-L1> config :0 001c01 L0C :2 002r01 L1H :4 002r05 L3H 001c01-L1> In L1 mode, you can obtain only limited information about the system configuration. An IRU has information about its internal blades, and also when other IRUs are NUMAlink attached to the IRU, information about those IRUs.
2: Operation Procedures Powering-On and Off From the L2 Commands issued at the L2 prompt are typically sent to all NUMAlink connected IRU enclosures in the system. To power on a system: system-101-L2> power up To power off a system: system-101-L2>...
Monitoring Your Server You can monitor your Altix 450 server from the following sources: • On the L1 controller’s display at the front of the IRU as shown in Figure 2-3, you can monitor system operational status. For example, you can monitor error messages that warn of power or temperature values that are out of tolerance.
2: Operation Procedures 2D Graphics Video Interface If your system was ordered in January 2007 or later, it may come equipped with an optional 2D graphics board interface (supported with SLES 10 or later system software). This low-profile PCI interface card is installed in the base I/O blade in the Altix system (see Figure 2-4 on page 59). Note that this blade is commonly referred to as the IA2 blade.
DVDROM Figure 2-4 Installing Optional Components Besides adding a system console, you can add or replace the following hardware items on your Altix 450 series server: • Peripheral component interface (PCI) cards into your system I/O blades. • Disk drives in your IA/IA2 blade (base I/O). The sections that follow discuss these activities in more detail.
“Safety Information” on page 165. I/O Blade Overview System I/O is primarily accomplished through standard and optional blades in the SGI Altix 450 IRUs. The PCI, PCI-X and PCIe based I/O sub-systems, are industry standard for connecting peripherals, storage and graphics to a processor blade. These are the primary configurable I/O system interfaces for the Altix 450 series systems: •...
Adding or Removing Disk Drives The IA/IA2 blade (base I/O blade) within the IRU supports the system boot functions and contains one or two low-profile disk drives. See “Installing or Replacing a Disk Drive in the IA Blade” on page 138 for detailed instructions on installing or removing disk drives. For information on removing or replacing disk drives in optional mass storage enclosures, see the hardware document supplied with the storage option.
Page 84
Select a device: [1-1 or 0 to quit] 1 Identify firmware, BIOS, and/or FCode Download firmware (update the FLASH) Download/erase BIOS and/or FCode (update the FLASH) Scan for devices Change IOC settings (interrupt coalescing) Change SAS IO Unit settings Display attached devices Change WWID Diagnostics RAID actions...
Page 85
Main menu, select an option: RAID actions menu, select an option: 0 volumes are active, 0 physical disks are active RAID actions menu, select an option: 007-4857-002 Identify firmware, BIOS, and/or FCode Download firmware (update the FLASH) Download/erase BIOS and/or FCode (update the FLASH) Scan for devices Change IOC settings (interrupt coalescing) Change SAS IO Unit settings...
Page 86
2: Operation Procedures 1. 0 2. 0 To create a volume, select two or more of the available targets Select a target: Select a target: 2 physical disks were created Select volume type: Select volume size: Enable write caching: Zero the first and last blocks of the volume? [Yes or No, default is No] Volume was created RAID actions menu, select an option: 1 volume is active, 2 physical disks are active...
Page 88
2: Operation Procedures 1 volume is active, 2 physical disks are active Volume 0 is Bus 0 Target 0, Type IM (Integrated Mirroring) Volume State: Volume Settings: Volume draws from Hot Spare Pools: Volume Size 139898 MB, Stripe Size 0 KB, 2 Members Primary is PhysDisk 1 (Bus 0 Target 56) Secondary is PhysDisk 0 (Bus 0 Target 1) For information on the two RAID 1 disks, use the lsscsi command as shown in the following...
Chapter 3 System Overview This chapter provides an overview of the physical and architectural aspects of your SGI Altix 450 system. The major components of the Altix 450 series systems are described and illustrated. The Altix 450 series is a family of multiprocessor distributed shared memory (DSM) computer systems that initially scale from 2 to 76 Intel 64-bit processor cores as a cache-coherent single system image (SSI).
The rack system requires a minimum of one 20U-high rack with one single-phase power distribution unit (PDU) installed in the rack. Each single-phase PDU has 5 outlets (to support two IRUs). Figure 3-2 shows an example configuration of a 42U Altix 450 system “tall rack.” SGI Altix 450 System (Short Rack) 007-4857-002...
System Models Figure 3-2 SGI Altix 450 Server System (Tall Rack) You can also add additional PCI expansion blades or RAID and non-RAID disk storage to your server system. Figure 3-3 shows an individual blade, IRU and Rack. 007-4857-002...
The basic expansion building block for the NUMAlink interconnect is the processor node; each processor node consists of a Super-Hub (SHub) ASIC and one or two 64-bit processors with three levels of on-chip secondary caches. The Intel 64-bit processors are connected to the SHub ASIC via a single high-speed front side bus.
interface. The SHub ASIC memory interface enables any processor in the system to access the memory of all processors in the system. Another component of the NUMAlink 4 architecture is the router ASIC. The router ASIC is a custom designed 8-port crossbar ASIC. Using the router ASICs with a highly specialized backplane and NUMAlink 4 cables provides a high-bandwidth, extremely low-latency interconnect between all processor, I/O, and other option blades within the system.
3: System Overview System Features The main features of the Altix 450 series server systems are introduced in the following sections: • “Modularity and Scalability” on page 72 • “Distributed Shared Memory (DSM)” on page 72 • “Distributed Shared I/O” on page 73 •...
Memory latency is the amount of time required for a processor to retrieve data from memory. Memory latency is lowest when a processor accesses local memory. Distributed Shared I/O Like DSM, I/O devices are distributed among the blade nodes within the IRUs (each base I/O blade node has two NUMAlink ports) and are accessible by all compute nodes within the SSI through the NUMAlink interconnect fabric.
3: System Overview Non-uniform Memory Access (NUMA) In DSM systems, memory is physically located at various distances from the processors. As a result, memory access times (latencies) are different or “non-uniform.” For example, it takes less time for a processor blade to reference its locally installed memory than to reference remote memory.
Page 97
• Power-on and boot: – – – • Further RAS features: – – – – 007-4857-002 Automatic testing occurs after you power on the system. (These power-on self-tests or POSTs are also referred to as power-on diagnostics or PODs). Processors and memory are automatically de-allocated when a self-test failure occurs. Boot times are minimized.
3: System Overview System Components The Altix 450 series system features the following major components: • 20U rack. The “short” rack is a custom rack used with the Altix 450 system. It holds up to 4 IRUs or a combination of IRUs and option modules (such as mass storage). •...
Port Port Figure 3-5 Bay (Unit) Numbering Bays in the racks are numbered using standard units. A standard unit (SU) or unit (U) is equal to 1.75 inches (4.445 cm). Because IRUs occupy multiple standard units, IRU locations within a rack are identified by the bottom unit (U) in which the IRU resides.
3: System Overview Optional System Components Availability of optional components for the SGI 450 systems may vary based on new product introductions or end-of-life components. Some options are listed in this manual, others may be introduced after this document goes to production status. Check with your SGI sales or support representative for the most current information on available product options not discussed in this manual.
• “Upgrading L1 Firmware” on page 99 The control system for the SGI Altix 450 series servers manages power control and sequencing, provides environmental control and monitoring, initiates system resets, stores identification and configuration information, and provides console/diagnostic and scan interface.
Typically, an Ethernet connection to the system controller network is used. This Ethernet connection is usually made from the IRU housing the system disk(s). Remote workstation monitor Local Area Network (LAN) Local Area Network (LAN) Cat-5 Ethernet SGI Altix 450 System Control Network (Example) Altix 450 007-4857-002...
The system controller is designed into all IRUs. An Ethernet connection directly from the IRU to a local private or public Ethernet allows the system to be administered directly from a local or remote console. Note that there is no interconnected system controller function in the optional storage modules.
Monitors and controls warning LEDs on the IRU • Monitors the On/Off power switch • Monitors the reset switch and the nonmaskable interrupt (NMI) switch • Reports the population of the PCI cards and the power levels of the PCI slots in installed I/O blades •...
Reset switch (insert paper clip to actuate). • Non-maskable interrupt (NMI) switch (insert paper clip to actuate). Note: The reset and NMI switch functions on any IRU in a NUMAlink connected system will affect all the IRUs in the system. Ethernet Switch Use of an Ethernet switch is the preferred method of interconnecting large systems with multiple L2s and remote support hardware to multiple systems.
4: System Control Console Hardware Requirements The console type and how these console types are connected to the Altix 450 servers is determined by what console option is chosen. If you have an Altix 450 server with a dumb terminal, you can connect the terminal via a serial cable to the (DB-9) console port connector on the system control board of the IRU.
application that is always running on the system controller. When the enclosure is connected to a LAN via the L2 host connector, the system controller spawns an application that provides L2 functionality. The L1 operates in one of these two modes, which are discussed in the sections that follow: L1 Mode The L1 prompt is visible and all input is directed to the L1 command processor.
4: System Control • “Viewing Information, Warnings, and Error Messages” on page 94 Viewing System Configuration (from an IRU’s Perspective) An L1 has limited knowledge of the system topology, depending on the system’s configuration. Typically, an L1 has information only about L1s that are directly NUMAlink connected. In large configurations with more than one L1, the L1 may have knowledge of only a portion of the L1s in the system.
Commands can be targeted to other L1s by preceding the command with a rack and slot: 001c01-L1> 1.11 version The command above issues a version command to the IRU in rack 001, U position 11. Some commands can be targeted to a specific blade within an IRU. Precede the command with the blade designator: 001c01-L1>...
4: System Control L1 Console Selection If the system contains more than one IRU and a serial connection is utilized for the console, the serial cable must be connected to the IRU that is located in the lowest rack and slot position. The select command shows the current console mode settings: 001c01-L1>...
001c01-L1> entering console mode 001c01 console, <CTRL-T> to escape to L1 no response from 001c01 junk bus console UART:UART_TIMEOUT When this time-out condition occurs, either the IRU is hung or the subchannel is incorrect. An IRU is identified by its rack, type, and slot (001c01). Viewing Information, Warnings, and Error Messages All information, warnings, and error messages generated by any of the system controllers are in the following form:...
Page 112
Once this is done for all target IRUs and Dense routers, connect them to the network (using an optional Ethernet switch if necessary). The rackid on the L2 cannot be set with the L2 “rackid” command, instead it will be inherited from the local L1.
Once the L2 is running, you can telnet to the L2, or use an optional SGIconsole. After the connection to the L2 controller is established, the following prompt appears, indicating that the L2 is ready to accept commands: olympic-101-L2> Common operations are discussed in the subsections that follow. Viewing System Configuration You can use the L2’s config command to view the current system configuration from an IRU level:...
4: System Control In the example shown above, 001c01 is an IRU in rack 001 and slot position 01. Setting Command Targeting If a command is not understood by the L2 system controller, in general it is passed to the L1 system controllers.
Page 115
L2 Operation To target individual blades in an IRU use the following syntax: olympic-101-L2> 1.11 b1 power down Executing the above command will power down the blade in blade slot 1 of the IRU in rack 001 U position 11. Default Destination When the L2 starts, the default destination is set to all racks and all slots.
4: System Control L2> r 2-4,7 <L1 command> This is a one-time destination. Command Interpretation Some L2 commands are the same as the L1 commands. In many cases, this is intentional because the L2 provides sequencing that is necessary for a command to function correctly. When L1 and L2 commands are similar, you can ensure that an L1 command is entered for the IRUs current destination by preceding the command <L1 command>...
To power on or power off a specific IRU, specify a current destination: L2> r 2 s 5 power up L2> To power on or power off all IRUs in a partition, enter the following: L2> partition <partition number> <power up or power down> To reset the system, enter the following: L2>...
4: System Control Ctrl+T escaping to L2 system controller L2> l2 L2 command processor engaged, <CTRL_D> for console mode. L2> Console Selection When in console mode, the L2 communicates with the IRU set with the select command to be the system console or global master. All input from the console is directed to that IRU. You can set and view the system console with the select command.
Page 119
• Subchannel 3C specifies Blade 3, CPU C. • Subchannel console0 Blade 0 console subchannel. • Subchannel console1 Blade 1 console subchannel. The select command output: “console input: 001c01 console0” shows that the L2 will send console input to IRU 001c01 blade 0 and the console subchannel will be used. To change the IRU that will be the system console, use the select <rack>.<slot>...
4: System Control Generally, the L2 will track the correct IRU rack, slot, blade, and subchannel for system console input and no user setting should be required. If the default value was manually overridden, it can be reset by entering the following command: 001c01-L1>...
Upgrading L1 Firmware The L1 firmware is currently distributed as part of the snxsc_firmware package. To determine which version of the package is installed on your system console, enter the following command: $> rpm -q snxsc_firmware If the package is installed, the full package name (including the revision) is returned: snxsc_firmware-1.18.3-1 The L1 firmware binary and the utilities used to update it are stored in /usr/cpu/firmware/sysco.
Page 122
4: System Control You can update individual IRUs by replacing all with a rack and slot number: $> /usr/cpu/firmware/sysco/flashsc --12 10.1.1.1 /usr/cpu/firmware/sysco/l1.bin 1.16 This updates only the IRU in rack 1, slot 16. 007-4857-002...
Chapter 5 Rack Information This chapter describes the physical characteristics of the tall (42U) and short (20U) Altix racks in the following sections: • “Overview” on page 101 • “Altix 42U and 20U Rack Features” on page 102 • “Technical Specifications” on page 104 Overview At the time this document was published only the tall (42U) and short (20U) Altix racks shown in Figure 5-1 and Figure 5-2 were tested and approved for use with Altix 450 systems.
5: Rack Information Altix 42U and 20U Rack Features The Altix racks (shown in Figure 5-1 and Figure 5-2) have the following features and components: • Front and rear door. The front door is opened by grasping the wide end of the triangle-shaped door piece and pulling outward.
Chapter 6 Maintenance and Upgrade Procedures This chapter provides information about installing or removing components from your SGI system, as follows: • “Maintenance Precautions and Procedures” on page 107 • “Installing or Removing Internal Parts” on page 109 • “Adding or Replacing PCI/PCI-X Cards” on page 128 •...
To prepare the system for maintenance, follow these steps: If you are logged on to the system, log out. Follow standard procedures for gracefully halting the operating system. 2. At your system console, switch from console mode to system control mode by entering the following command: $> Ctrl+T The system will respond with the system control prompt: L2>...
Installing or Removing Internal Parts Caution: The components inside the system are extremely sensitive to static electricity. Always wear a wrist strap when you work with parts inside your system. To use the wrist strap, follow these steps: Unroll the first two folds of the band. 2.
6: Maintenance and Upgrade Procedures Replacing IRU Components While the individual rack units (IRUs) are not considered end-user replaceable, a number of their internal components can be removed and replaced. These include: • L1 controller panel • IRU power supplies •...
Replacing IRU Components in si in si Loosen screw Figure 6-1 Removing the L1 Controller Panel Replace the system control panel using the following steps: Position the controller panel assembly slightly above the retention screw. 2. Carefully slid it back into place, see Figure 6-2. 007-4857-002...
6: Maintenance and Upgrade Procedures 3. Be careful not to snag the ribbon cable while replacing the panel. 4. Use the T10 torx driver to tighten the retention screw holding the panel to the IRU. 5. Restart the IRU or system as applicable. Figure 6-2 Tighten screw Replacing the L1 Controller Panel...
Removing or Adding IRU Power Supplies Under most circumstances a single power supply in an IRU can be replaced without shutting down the IRU or the complete system. In the case of a fully configured (loaded) IRU, this may not be possible.
6: Maintenance and Upgrade Procedures 4. Install the new power supply with the retention latch at the top of the supply. 5. Slide the power supply into the chassis until the retention latch engages. 6. Reconnect the power cord to the power supply. 7.
3. A line will be added to the L1 system controller’s log file indicating the fan warning. 4. If ESP is used, a warning message will be sent to it also, (see “SGI Electronic Support” on page 149). The system controller monitors the temperature within each IRU. If the temperature increases due to the failed fan, the remaining fans will run at a higher RPM to compensate for the failed fan.
6: Maintenance and Upgrade Procedures Screw Figure 6-6 3. Slide a new blower assembly completely into the open slot, see Figure 6-7. 4. Tighten the blower assembly screw to secure the new fan. Removing a Fan From the IRU Loosen screw 007-4857-002...
Removing or Replacing a System Blade From the IRU The blades installed in your SGI Altix 450 can generally be removed from or installed in an IRU without powering down the entire system. However, the operating system should be halted and the power to the IRU should be shut down in most cases.
Memory DIMM Group Placement and Guidelines Memory is contained on cards that are referred to as DIMMs (dual inline memory modules). Each individual memory or compute/memory blade can contain four, eight, or twelve DIMMs installed in DIMM slots located on the blade's node board. These twelve DIMM slots are organized into three groups of four DIMMs each, as shown in Figure 6-10.
6: Maintenance and Upgrade Procedures Group 2 Group 0 Figure 6-10 Left bus Y DIMM 2 (DIMM location 5) Left bus Y DIMM 1 (DIMM location 4) Left bus Y DIMM 0 (DIMM location 3) Left bus X DIMM 2 (DIMM location 2) Left bus X DIMM 1 (DIMM location 1) Left bus X DIMM 0 (DIMM location 0) Memory...
Figure 6-11 Remove and Replace the DVD Drive Use the following steps to remove the DVD drive from an IA blade: Power off the IRU, use instructions in “Powering the System On and Off” on page 51. 2. Extract the IA blade you are going to install the new DVD drive in. See the information in “Replacing IRU Components”...
Page 146
6: Maintenance and Upgrade Procedures 8. Slide the new DVD drive assembly into the IA blade housing. 9. Connect the DVD power and data cable connectors to the replacement drive. 10. Screw in the DVD drive assembly retention screw. 11. Replace the DVD access panel and tighten the retention screw. 12.
PCI Express has both compatibility and differences with older PCI/PCI-X technology. Check with your SGI sales or service representative for more detail on PCI Express options available with the SGI Altix 450. PCI Express is compatible with PCI/PCI-X in the following ways: •...
6: Maintenance and Upgrade Procedures 1”. SGI Altix 450 technology uses an x16 connector (64 wires) or “by 16” in PCI Express card slots. This technology will support PCIe boards that use connectors up to x16 in size. Table 6-2 shows this concept.
Caution: To protect the PCI cards from ESD damage, SGI recommends that you use a grounding wrist strap while installing a PCI card. Installing PCI Cards in the Three-Slot Blade Use the following instructions and illustrations to install or replace a PCI/PCI-X card in the three-slot blade: Follow the instructions in “Replacing IRU Components”...
Note: If you are adding or replacing a half-height PCI card, skip ahead to step 6. 5. If the full-height card that you want to install does not fit in the carrier, follow these steps: Figure 6-17 007-4857-002 Loosen the three screws on the guide bar with a Phillips screwdriver (if your carrier uses T8 Torx screws, you will need a Torx screw driver).
6: Maintenance and Upgrade Procedures Bulkhead Figure 6-18 Mount the card in the carrier, (see Figure 6-18) and ensure the following occurs: – The card connectors protrude through the bulkhead where the metal filler plate was located. – The edge connectors fit between the bottom guides of the carrier. –...
6. To install a half-height PCI card in a carrier, follow these steps: Remove T8 Torx screws Figure 6-19 Adjustment rail Figure 6-20 007-4857-002 Remove the two screws from the carrier guide bar, as shown in Figure 6-19. Note: Take care not to lose the threaded inserts in the carrier guide bar. Loosen the third screw of the carrier guide bar.
6: Maintenance and Upgrade Procedures Figure 6-21 Place the PCI card bracket so that the screw holes of the bracket align with the empty screw holes of the carrier guide bar, as shown in Figure 6-21. Secure the bracket to the carrier guide bar with two T8 Torx screws. Tighten the screw that you loosened in step 6b.
7. Insert the carrier-mounted PCI card into the vacant slot, using the slot guide, as shown in Figure 6-22. Figure 6-22 8. Push in horizontally on the carrier seating bar, as shown in Figure 6-23, to seat the card securely in the slot. Figure 6-23 9.
6: Maintenance and Upgrade Procedures Add or Remove a PCI Card in Base IA Blades To add or replace a PCI card in the base IA blade (base I/O), follow these steps: Power off the IRU by following the power-off instructions in the “Powering the System On and Off”...
M PA Figure 6-25 8. Replace the PCI card access door by installing it into the slotted opening and sliding it forward, as shown in Figure 6-25. 9. Reinstall the top PCI card access door screw. 10. Reinstall the front PCI card access door screw. 11.
6: Maintenance and Upgrade Procedures Installing or Replacing a Disk Drive in the IA Blade The IA/IA2 blade (base I/O) in an IRU has two system disk drive bays as shown in Figure 6-26. This section describes how to install or remove the drives. DVDROM DVD drive Figure 6-26...
Removing a System Disk Drive Before you remove a disk drive, you must power off the IRU or system according to the instructions in the “Powering the System On and Off” on page 51. To remove a disk drive, follow these steps: Open the front of the rack and access the two disk drive bays, as shown in panel 1 of Figure 6-27.
6: Maintenance and Upgrade Procedures Installing a System Disk Drive Before you install a disk drive, you must power off the IRU that houses the IA blade (base I/O) where the disk(s) are installed, see the instructions in the “Powering the System On and Off” on page 51.
Chapter 7 Troubleshooting and Diagnostics This chapter provides the following sections to help you troubleshoot your system: • “Troubleshooting Chart” on page 144 • “L1 Controller Error Messages” on page 145 • “SGI Electronic Support” on page 149 007-4857-002...
7: Troubleshooting and Diagnostics Troubleshooting Chart Table 7-1 lists recommended actions for problems that can occur. To solve problems that are not listed in this table, use the SGI Electronic Support system or contact your SGI system support engineer (SSE). For more information about the SGI Electronic Support system, see the “SGI Electronic Support”...
L1 Controller Error Messages Table 7-2 lists error messages that the L1 controller generates and displays on the L1 display. This display is located on the front of the IRU. Note: In Table 7-2, a voltage warning occurs when a supplied level of voltage is below or above the nominal (normal) voltage by 10 percent.
Page 168
7: Troubleshooting and Diagnostics Table 7-2 L1 System Controller Message Temperature messages: low alt. ATTN: <temp sensor description> advisory temperature reached @ xxC xxF ATTN: <temp sensor description> critical temperature reached @ xxC xxF ATTN: <temp sensor description> fault temperature reached @ xxC xxF Temperature messages: high alt.
LED Status Indicators There are a number of LEDs on the front of the IRUs that can help you detect, identify and potentially correct functional interruptions in the system. The following subsections describe these LEDs and ways to use them to understand potential problem areas. IRU Power Supply LEDs Each power supply installed in an IRU has a single bi-color (green/amber) status LED.
7: Troubleshooting and Diagnostics Compute/Memory Blade LEDs Each compute/memory blade installed in an IRU has a total of eight LED indicators arranged in two rows of four and behind the perforated of the blade: • One green LED shows power-on complete status for the blade. •...
Figure 7-1 SGI Electronic Support SGI Electronic Support provides system support and problem-solving services that function automatically, which helps resolve problems before they can affect system availability or develop into actual failures. SGI Electronic Support integrates several services so they work together to monitor your system, notify you if a problem exists, and search for solutions to problems.
7: Troubleshooting and Diagnostics Supportfolio Online Figure 7-2 Customer's system Implement solution Page or e-mail alert SGI customer and SGI support engineer SGI Knowledgebase Full Support Sequence e-mail View the case solutions SGI global customer support center 007-4857-002...
Page 173
The sequence of events can be described as follows: Embedded Support Partner (ESP) monitors your system 24 hours a day. 2. When a specified system event is detected, ESP notifies SGI via e-mail (plain text or encrypted). 3. Applications that are running at SGI analyze the information, determine whether a support case should be opened, and open a case if necessary.
Page 174
The following three components compose the integrated SGI Electronic Support system: SGI Embedded Support Partner (ESP) is a set of tools and utilities that are embedded in the SGI Linux ProPack release. ESP can monitor a single system or group of systems for system events, software and hardware failures, availability, performance, and configuration changes, and then perform actions based on those events.
Appendix A Technical Specifications and Pinouts This appendix contains technical specification information about your system, as follows: • “System-level Specifications” on page 153 • “Physical Specifications” on page 154 • “Environmental Specifications” on page 156 • “Power Specifications” on page 157 •...
A: Technical Specifications and Pinouts Physical Specifications Table A-2 shows the physical specifications of the Altix 450 system in a 42U rack. Table A-2 Feature Dimensions for a single tall (42U) rack system, including doors and side panels Shipping dimensions Weight of full rack (maximum) Shipping weight (maximum) Access requirements...
Table A-3 Feature Dimensions for a single short (20U) rack system, including doors and side panels Shipping dimensions Weight of full rack (maximum) Shipping weight (maximum) Access requirements Front Rear Side Individual Rack Unit (IRU) enclosure specifications 007-4857-002 Altix 450 Short Rack System Physical Specifications Specification Height: 41.8 in.
A: Technical Specifications and Pinouts Environmental Specifications Table A-4 lists the environmental specifications of the 42U rack system. Table A-5 provides the environmental information for the 20U system. Table A-4 Feature Temperature tolerance (operating) Temperature tolerance (non-operating) Relative humidity Heat dissipation Altix 450 (42U rack) Cooling requirement Air flow: intake (front),...
Table A-5 Feature Heat dissipation Altix 450 Cooling requirement Air flow: intake (front), exhaust (rear) Maximum altitude Acoustical noise level Power Specifications Table A-6 shows the power specifications for the system. Table A-6 Feature Single-phase power requirements Voltage Frequency Power Hold-up time Total harmonic distortion 007-4857-002...
A: Technical Specifications and Pinouts I/O Port Specifications This section contains specifications and port pinout information for the base I/O ports of your system, as follows: • “Ethernet Port” on page 159 • “Serial Ports” on page 160 • “External SAS/SATA Port Connector” on page 162 •...
Ethernet Port The system auto-selects the Ethernet port speed and type (duplex vs. half-duplex) when the server is booted, based on what it is connected to. Figure A-1 shows the Ethernet port. Figure A-1 Table A-7 shows the cable pinout assignments for the Ethernet port operating in 10/100-Base-T mode and also operating in 1000Base-T mode.
A: Technical Specifications and Pinouts Serial Ports The IRU modules have 9-pin serial interface connectors. These ports are for console interface and are capable of transferring data at rates as high as 230 kbps. Other features of the ports include the following: •...
Table A-8 shows pinout assignments for the 9-pin male DB-9 connector. Table A-8 007-4857-002 Serial Port Pinout Assignment Description Data carrier detect Receive data Transmit data Data terminal ready Signal ground Data set ready Request to send Clear to send Ring indicator I/O Port Specifications...
A: Technical Specifications and Pinouts External SAS/SATA Port Connector Figure A-3 shows the connector pin locations for the external single-channel Serial Attached SCSI (SAS) and Serial Advanced Technology Attachment (SATA) connector. This combined technology connector is used to support optional external storage. Table A-9 lists the pin assignments for the 14-pin SAS/SATA connector.
USB Type A Connector Figure A-4 shows the USB type A connector provided on the base I/O that supports general USB applications and optional keyboard and mouse configurations. Table A-10 lists the pin assignments for the USB type A connector. Figure A-4 Table A-10 Signal...
Appendix B Safety Information and Regulatory Specifications This appendix provides safety information and regulatory specifications for your system in the following sections: • “Safety Information” on page 165 • “Regulatory Specifications” on page 167 Safety Information Read and follow these instructions carefully: Follow all warnings and instructions marked on the product and noted in the documentation included with this product.
Page 188
9. Do not attempt to service this product yourself except as noted in this guide. Opening or removing covers of blade and switch internal components may expose you to dangerous voltage points or other risks. Refer all servicing of items not listed in this guide to qualified service personnel.
Regulatory Specifications The following topics are covered in this section: • “CMN Number” on page 167 • “CE Notice and Manufacturer’s Declaration of Conformity” on page 167 • “Electromagnetic Emissions” on page 168 • “Shielded Cables” on page 170 • “Electrostatic Discharge”...
B: Safety Information and Regulatory Specifications Electromagnetic Emissions This section provides the contents of electromagnetic emissions notices from various countries. FCC Notice (USA Only) This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: •...
Industry Canada Notice (Canada Only) This Class A digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numérique német pas de perturbations radioélectriques dépassant les normes applicables aux appareils numériques de Classe A préscrites dans le Règlement sur les interferences radioélectriques établi par le Ministère des Communications du Canada.
B: Safety Information and Regulatory Specifications Shielded Cables This SGI system is FCC-compliant under test conditions that include the use of shielded cables between the system and its peripherals. Your system and any peripherals you purchase from SGI have shielded cables. Shielded cables reduce the possibility of interference with radio, television, and other devices.
Laser Compliance Statements The DVD drive in this computer is a Class 1 laser product. The DVD drive’s classification label is located on the drive. Warning: Warning: toute exposition aux rayons. Warning: Strahl aussetzen. Warning: rayos. Warning: Warning: Warning: in i strålen. Warning: Warning: 007-4857-002...
B: Safety Information and Regulatory Specifications Lithium Battery Statements Warning: should replace this lithium battery. For other types, replace the battery only with the same type or an equivalent type recommended by the battery manufacturer, or the battery could explode. Discard used batteries according to the manufacturer’s instructions. Warning: Udskiftning må...
Index Altix server illustration Altix servers monitoring locations battery statements block diagram cache coherency circuit breaker switches CMN number command targeting L1 mode L2 mode connector pin assignment SAS/SATA USB type A console L1 mode power on powering on bricks console communications subchannels 007-4857-002...
Page 196
Index fan RPM level front panel display L1 controller front panel LEDs information, warning, and error messages viewing in L2 mode 89, 94 install disk drive IRU block diagram IRU slot numbering Knowledgebase console mode operation mode L1 console selection L1 controller description error messages...
Page 197
racks PCI and PCI-X cards installation procedure PCI and PCI-X card installation PCIe slots physical specifications Altix Tall Rack Physical Specifications pinouts Ethernet connector serial connector power receptacle 8-11 power specifications powering off L2 mode powering on at system console in L1 mode L2 emulator mode preparation...
Page 198
Index unpack a tall rack unpack and move the short rack upgrading L1 firmware USB type A connector pin assignments VGA video card viewing system configuration L1 mode voltage select switches for peripherals warning messages viewing in L2 mode 89, 94 weight of the short rack 007-4857-002...
Need help?
Do you have a question about the SGI Altix 450 and is the answer not in the manual?
Questions and answers