1. Manuals
  2. Brands
  3. Cisco Manuals
  4. Switch
  5. SFS 7008
  6. Hardware manual

Cisco SFS 7008 Hardware Manual

Infiniband server switch
Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
Cisco SFS 7008 InfiniBand Server Switch
Hardware Guide (Topspin 270 Hardware Guide)
Release 2.2.0 Update 1
Part Number: OL-7725-01
Product ID: 140265

Advertisement

Table of Contents
loading

Related Manuals for Cisco SFS 7008

Summary of Contents for Cisco SFS 7008

  • Page 1 Cisco SFS 7008 InfiniBand Server Switch Hardware Guide (Topspin 270 Hardware Guide) Release 2.2.0 Update 1 Part Number: OL-7725-01 Product ID: 140265...

  • Page 2: Part Number: Ol

    Copyright © 2004 - 2005 Topspin Communications, Inc. All rights reserved. The Topspin Switched Computing System, Topspin Host Channel Adapter, Topspin Element Manager, and collateral software programs and documentation are subject to and made available only pursuant to the license agreement signed by you and Topspin, Communications, Inc.

  • Page 3: Table Of Contents

    Regulatory Notices... vii FCC Statement ... vii Safety Information ... vii Electrical Cautions ... vii General Cautions... ix Contact Information ... ix 1: Features Overview ... 11 System Architecture...11 Hot Standby ... 11 InfiniBand Connectivity ... 12 Flexibility... 12 Hi-Availability ... 12 Non-Blocking Architecture...
  • Page 4 Connect Management Devices ...26 Attach a Serial Console Cable to a PC or Terminal ... 26 Connect an Ethernet Cable to the Ethernet Management Port ... 27 Recommended Management Configuration ... 27 Power on the Chassis ... 27 Configure Basic Connectivity...28 Assigning an Address Statically ...
  • Page 5 Upgrading a Topspin 270 with Element Manager... 54 Upgrading an Individual Controller Card ...56 Upgrading a Controller Card with the CLI ... 57 Upgrading Individual Node Cards ...59 Upgrading a Node Card with Element Manager... 60 5: Monitoring the Topspin 270 System... 65 Interpreting the Front Panel LEDs...65 System-Wide Status LED ...
  • Page 6 7: Specifications and Compliance Certifications Chassis and Management Interface ... 103 Electrical Specifications ... 104 EMC/Immunity ... 104 Safety ... 104 Acoustics... 104 Product Markings... 105 8: Index ... 107...

  • Page 7: Regulatory Notices

    Regulatory Notices FCC Statement This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules. These limits are designed to provide reasonable protection against harmful interference when the equipment is operated in a commercial environment. This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications.
  • Page 8 viii CAUTION: Grounding is supplied by the ground-prong on the 3-prong power cable. Do not attach a separate ground cable. Do not use adapter plugs. Do not remove the ground prong from the cable. Ensure the ground connection on the power supply is correct and functioning before applying power to the Topspin system.

  • Page 9: General Cautions

    CAUTION: Never place your hand inside an empty card or module bay. You should never have cause to place a hand anywhere inside the Topspin chassis. Unused card and module bays should always have a Topspin cover over the bay to ensure proper safety, ventilation, and cooling. General Cautions CAUTION: No user is authorized to remove the Topspin system enclosure cover.

  • Page 11: 1: Features Overview

    On the Topspin 270, the inactive controller card remains on hot standby so that it can assume control in the event that the active controller card fails over. The hot standby feature lets the Server Switch fail over without rebooting or resetting any cards in the chassis.

  • Page 12: Infiniband Connectivity

    Example Topspin-270# show card ========================================================================= ========================================================================= admin slot type ------------------------------------------------------------------------- controllerFabric12x controllerFabric12x The oper code field of the command output identifies the controller card as the active card (normal) or the hot standby card (standby). By default, when you power on a Topspin 270, the card in slot 11 becomes active and the card in slot 12 becomes the standby.

  • Page 13: Non-Blocking Architecture

    Fabric For redundancy, InfiniBand Host Channel Adapters (HCAs) can be dual-connected to a redundant pair of Topspin 270s. In an InfiniBand fabric that includes more than one Topspin 270: if the subnet manager on the Topspin 270 that is acting as the master fails, another subnet manager will take over within seconds. All necessary state information is kept in sync.
  • Page 14 Figure 1-2: Back Chassis View...

  • Page 15: Chassis Slot Numbering

    Chassis Slot Numbering Slot numbers are printed on the chassis for easy identification. Power Supply ID 1 Fan ID 1 Slot # 9 Slot # 10 Slot # 11 Slot # 12 Slot # 13 Slot # 14 Figure 1-3: Chassis Slot Numbering in Front (Non-port Side) Power Supply ID 2 Fan ID 2...

  • Page 16: Dimensions

    Slot # 1 Slot # 2 Slot # 3 Slot # 4 Slot # 5 Slot # 6 Slot # 7 Slot # 8 Figure 1-4: Chassis Slot Numbering in Back (Service Side) Dimensions • Height: 6U unit • Width: 17.04” •...

  • Page 17: Fan Trays

    • The power supplies are 1U, 48V, 1200W • The supplies provide regulated +48V DC to all other modules in the system. • Each power supply has self contained fans for cooling. Fan Trays Refer to “Installing a Fan Module” on page 41 The fan trays are redundant, hot-swappable cooling units.

  • Page 18: Fabric Controller Modules

    Understanding the Core Slot to Mgmt Interface Module Connection Each Core slot in the chassis (refer to Management Interface module. The controller (fabric interface module inserted in the core slot) selects the Management Interface module to which it will connect. The pairing of Management Interface module to core slot is as follows: •...

  • Page 19: Line Interface Modules (Lim)

    • At least one Fabric Controller module must be installed in the Core slot for the chassis to boot. • When a module is installed in a Core slot, it acts as either the master or standby controller for the chassis, with all modules in the system being slaves to the master controller.

  • Page 20: Administrative Features

    Administrative Features Real-Time Clock The Topspin 270 maintains correct time regardless of power conditions or connectivity. Latency The Topspin 270 has port to port latency of less than 600ns. Non-Volatile Memory The memory supports up to: • three stored system images (not including recovery image) •...

  • Page 21: 2: Installing The Topspin 270 System

    Installing the Topspin 270 System This chapter describes how to install and manage the Topspin 270 system hardware. • “Prepare the Site” on page 21 • “Configure Basic Connectivity” on page 28 • “Mount the Topspin 270 Chassis in a Rack” on page 22 •...

  • Page 22: Mount The Topspin 270 Chassis In A Rack

    Topspin also has an optional shelf that is appropriate for pre-racking and shipping a unit in the rack. If you have purchased this shelf unit separately, refer to the documentation that is provided in the shelf kit package. Requirements In addition to the accessories provided with the server switch, you should have: • #2 phillips screwdriver •...
  • Page 23 Determine the direction that the switch will be installed and justified in the rack. The direction that the switch will be justified will determine which set of rack ears that need to be removed. Use a #2 phillips screwdriver to remove one set of rack ears: •...
  • Page 24 Use 2 - 3 people to lift the switch into the rack. Figure 2-3: Chassis Set onto Shelf Push the chassis into the rack until the rack ears are flush with rails. Figure 2-4: Rack Ears Flush with Rails...

  • Page 25: Install Optional Ha Components

    Use screws that fit your rack to attach both rack ears to the rack rails. Figure 2-5: Use Appropriate Screws to Attach Rack Ears to Rails Install Optional HA Components If you have purchased a High-Availability (HA) package, install the following components: •...

  • Page 26: Connect Management Devices

    Connect the cables to the InfiniBand chassis serial console port on the Management Interface card. Connect the other end of the serial cable to your terminal server or management workstation. For detailed information on how to connect the serial console cable, please see the documentation included with the serial cable kit.

  • Page 27: Connect An Ethernet Cable To The Ethernet Management Port

    The diagram below shows the recommended management port connections. To have constant access to the chassis remotely, redundantly connect the serial ports on two Management Interface cards to a terminal server. Figure 2-7: Recommended Management Configuration Power on the Chassis Use only the power cable provided with your InfiniBand system.

  • Page 28: Configure Basic Connectivity

    Inspect the power cord and determine if it provides the proper plug and is appropriately certified for use with your electrical system. Discard the cord if it is inappropriate for your national electrical system and obtain the proper cord, as required by your national electrical codes or ordinances. Grounding is supplied by the ground-prong on the 3-prong power plug.

  • Page 29: Assigning An Address Statically

    Assigning an Address Statically Refer to the static example below: When the system has completed booting, press <Enter> several times to display the CLI prompt. Login: Enter the user name and password. The default user name is super, and the default password is super.

  • Page 30: Connect Network Devices

    Login: super Password: super Topspin-270> Topspin-270> enable Topspin-270# Topspin-270# configure Topspin-270(config)# Topspin-270(config)# interface mgmt-ethernet Topspin-270(config-if-mgmt-ethernet)# option dhcp Topspin-270(config-if-mgmt-ethernet)# no shutdown Topspin-270(config-if-mgmt-ethernet)# exit Topspin-270(config)# exit Topspin-270# copy running-config startup-config If you have two Fabric Controllers installed in Core slots, you will receive a message asking if you want to save the configuration to the Standby Controller.

  • Page 31: Connecting Infiniband Devices

    Two InfiniBand systems (such as a Topspin 120 and a Topspin 270) can be connected by an InfiniBand cable inter-switch link (ISL). Manage the System You can manage the InfiniBand server-switch system using the following methods: • Command Line Interface (CLI) - a text-based interface accessible through a direct serial connection, Telnet over IP, or SSH over IP.

  • Page 32: (Optional) Launch The Chassis Manager

    You may need to use the exit command to return to global config mode. Example Topspin-270> enable Topspin-270# configure Topspin-270(config)# telnet enable Enter the ip http server command to enable HTTP services on your device. HTTPs is also supported. Example Topspin-270(config)# ip http server Launch Chassis Manager To launch Chassis Manager, perform the following steps: Launch your Web browser.
  • Page 33 Type the Management IP address of your Server Switch in the address field of your browser and press Enter. (You configured the IP address in Figure 2-10: Web Browser Window A log-in window opens. Figure 2-11 Figure 2-11: Chassis Manager Log-In Window Enter your Server Switch user name and password in the log-in window and click the OK button.

  • Page 34: (Optional) Install The Element Manager Gui

    Check that you have sufficient system resources. You will need: • • • • Insert the Topspin CD-ROM into the CD-ROM drive of a server that has network access to a Topspin management port. The GUI can be found in the following location on the CD-ROM. • •...

  • Page 35: 3: Managing Individual Components

    Managing Individual Components This chapter describes how to install the Field Replaceable Units (FRUs) in the Topspin 270 system. About the Field Replaceable Units The following Field Replaceable Units (FRUs) are a part of the Topspin 270 chassis: • “Power Supply Modules” on page 35 •...

  • Page 36: Removing A Power Supply Module

    In most cases, vital information can be recovered from the failed module. If you have the appropriate support agreement, you may want to return the unit for diagnosis. Refer to on page Locating the Power Supply Module Both power supply units are located on the front of the chassis. When facing the front of the switch with the bezel cover removed, the power modules are located in the top center bays of the Topspin 270 chassis.
  • Page 37 Pull the power cord from the chassis. Power Cord (back) Figure 3-1: Diagram of Power Supply to the Associated Power Cord Use a #1 phillips screwdriver to unscrew the fasteners that hold the power supply module in place. Figure 3-2: Loosening Captive Screws Power Supply (front)

  • Page 38: Installing A New Power Supply Module

    Use the handle to pull the power supply module from the bay. Figure 3-3: Pulling the Power Supply Module from the Bay 10. Install the blanking panel in place of the power supply module. The device should never be run without either a blanking panel or module in any bay, as overheating may occur.

  • Page 39: Fan Tray Modules

    Insert the new power supply unit into the open slot until it is fully seated. You may need to push the unit with your thumbs to get it completely into the bay. Figure 3-4: Inserting Power Supply Module Secure the captive screws with a #1 phillips screwdriver. Check the LEDs on the power supply to verify the status of the module.
  • Page 40 Use a #1 phillips screw driver to unscrew the captive screws. Figure 3-5: Loosening Captive Screws Carefully begin to pull the fan tray 1” out of the bay. Do not pull the fan tray completely from the bay. CAUTION: The fan tray does not have guards over the blades. You must wait until the fan blades have stopped moving before completely removing the fan tray from the bay, or risk injury.

  • Page 41: Installing A Fan Module

    Install a new fan module. Refer to fan module. Installing a Fan Module Remove the new fan module from the package. Ground yourself appropriately. Remove the bezel cover from the front of the switch, if you have not already done so. Refer to “Removing a Fan Module”...

  • Page 42: Fabric Controllers

    Check the LEDs on the fan module to verify the status. Refer to Fabric Controllers About the Fabric Controllers Refer to About a Failed Fabric Controller If you believe a fabric controller module has failed, contact technical support. Refer to information.
  • Page 43 Use a #1 phillips screwdriver to unscrew the captive screws from both ends of the Fabric Controller card. Figure 3-9: Loosen Captive Screws Before Removing Pull the levers on both sides of the card toward you. The card will be released. Figure 3-10: Opening Fabric Card Levers Use the levers to pull the card toward you and remove it from the bay.

  • Page 44: Installing A Fabric Controller

    Installing a Fabric Controller Remove the new Fabric Controller module from the packaging. Ground yourself appropriately. Remove the bezel cover, if you have not already done so. Refer to Remove the blanking panel, if no fabric controller was previously installed. Align the new Fabric Controller module with the bay into which you want to install it.

  • Page 45: Line Interface Management Modules (Lim)

    Upgrade the Image with the CLI To upgrade the image of the Controller card with the Command Line Interface, refer to Controller Card with the CLI” on page 57 • CLI Reference Guide Upgrade the Image with the Chassis Manager To upgrade the system image with the Chassis Manager web GUI, refer to the following document: •...
  • Page 46 Remove the InfiniBand cables from the ports. Figure 3-12: Removing a Pinch-Type Connector Figure 3-13: Removing a Pull-Type Connector To remove a cable with a pinch connector, pinch both sides of the back of the connector and pull the connector away from the port. To remove a cable with a pull connector, grasp the connector with one hand and push it toward the port, then pull the latch away from the port with your other hand and gently wiggle the connector away from the port.
  • Page 47 Use a #1 phillips screwdriver to unscrew the captive screws on both sides of the LIM card. Figure 3-14: Loosen the Captive Screws Release the LIM module by pulling both levers toward you, then toward the outside of the chassis. Figure 3-15: Releasing the LIM Module Levers Use the levers to pull the module from the bay.

  • Page 48: Installing A Lim Module

    Install a blanking panel in place of the LIM module, or refer to page 48 Installing a LIM Module Remove the new LIM module from the package. Refer to Ground yourself appropriately. Remove the blanking panel if a LIM module was not currently in place. Align the LIM module and slide it into the bay as far as possible.

  • Page 49: Management Interface Modules

    Connect the InfiniBand cables to the ports. Management Interface Modules About Management Interface Modules Refer to About a Failed Management Interface Module If you believe a Management Interface module has failed, contact technical support. Management Interface modules are hot-swappable. Refer to monitoring information.

  • Page 50: Installing A Management Interface Module

    If the Master Management Interface module was removed, the standby module becomes active. The “Master” led becomes green. Install a blanking panel in the empty bay, or refer to on page 50 Installing a Management Interface Module Remove the new Management Interface module from the package. Ground yourself appropriately.
  • Page 51 Use a #1 phillips screwdriver to loosen and remove the screws from the left and right side of the Chassis ID module. Figure 3-20: Loosen the Captive Screws Pull the Chassis ID module from the bay. Figure 3-21: Remove the Chassis ID Module Do not allow the bay to remain empty, as overheating may occur.

  • Page 52: Installing A Replacement Chassis Id Module

    Installing a Replacement Chassis ID Module Remove the new Chassis ID module from the package. Ground yourself appropriately. Remove the old Chassis ID module, if you have not already done so. Refer to ID Module” on page 50 Align the chassis ID module with the slot and push the module completely into the bay. Use the LEDs to verify the status of the module.

  • Page 53: 4: Administrative Tasks

    Administrative Tasks This chapter describes administrative tasks that may be performed on the Topspin 270 system. • “Upgrade all Cards in a Chassis” on page 53 • “Upgrading an Individual Controller Card” on page 56 • “Upgrading Individual Node Cards” on page 59 Upgrade all Cards in a Chassis These procedures assumes you are upgrading all fabric controllers and node cards in the chassis.

  • Page 54: Upgrading A Topspin 270 With Element Manager

    Select Maintenance > File Management Click the Import button. File Type = Image Select Remote FTP Server or Local File to navigate to the file. Click the Copy button and wait for the message that indicates the copy was successful. Click Ok.
  • Page 55 Click the new .img file and click the Install button. Click Yes when prompted. Repeat for all Server Switches you wish to upgrade. Figure 4-2: Watching the File Copy Progress Click Ok when the Image Install Completed Successfully message appears.

  • Page 56: Upgrading An Individual Controller Card

    Select Maintenance > Reboot to reboot the controller cards and activate the image. Click Yes at the prompt. View the new image on the cards: Figure 4-4: Upgraded Current Image Repeat for additional switches in the fabric. Upgrading a Topspin 270 with the Chassis Manager For the procedure needed to upgrade a Topspin 270 chassis using the Chassis Manager GUI, refer to the Chassis Manager User Guide.

  • Page 57: Upgrading A Controller Card With The Cli

    Upgrading a Controller Card with the CLI For the commands needed to upgrade a single Controller card using the CLI, refer to the CLI Reference Guide. Check the version of your Controller card with the show card-inventory command. In the example below, only the Controller card in slot 12 needs to be upgraded.
  • Page 58 Show the standby Controller card. Example Topspin-270# show card-inventory ================================================================================ ================================================================================ slot-id : 11 used-memory : 18092 (kbytes) free-memory : 109676 (kbytes) used-disk-space : 30891 (kbytes) free-disk-space : 71488 (kbytes) last-image-source : TopspinOS-2.2.0/build531 primary-image-source : TopspinOS-2.2.0/build531 image : TopspinOS-2.2.0/build531 cpu-descr : PPC 440GP Rev. C - Rev 4.129 (pvr 4012 0481) fpga-firmware-rev : ae ib-firmware-rev : 0004031fe8 slot-id : 12...

  • Page 59: Upgrading Individual Node Cards

    Activate the image. After downloading the image file to the chassis controller, it must be installed to become active. The install command installs the specified image file into the system. Example Topspin-270# install image:Topspin-270-TopspinOS-2.2.0-build531.img *****************operation completed successfully Specify the new boot image to be used. Example Topspin-270# configure Topspin-270(config)# boot-config primary-image-source TopspinOS-2.2.0/build531...

  • Page 60: Upgrading A Node Card With Element Manager

    Select Maintenance > File Management Click the Import button. File Type = Image Select Remote FTP Server or Local File to navigate to the file. Click the Copy button and wait for the message that indicates the copy was successful. Click Ok.
  • Page 61 Note: all node cards in the must have an oper-status of “up” for the upgrade to be effective. Select Maintenance > File Management Click the new .img file and click the Install button. Click Yes when prompted. Figure 4-6: Watching the File Copy Progress Click Ok when the Image Install Completed Successfully message appears.
  • Page 62 Activate the image on the node card(s) by enabling and disabling each node card. Do not reboot the chassis as this will not result in the image being applied to the node card(s). Figure 4-8: Disable and Enable the Node Card(s) View the new image on the node card(s) when the card comes back online: Figure 4-9: Upgraded Current Image Right-click a node card and select Properties.
  • Page 63 Upgrading Node Card(s) with the Chassis Manager For the procedure needed to upgrade node cards using the Chassis Manager GUI, refer to the Chassis Manager User Guide.

  • Page 65: 5: Monitoring The Topspin 270 System

    Monitoring the Topspin 270 System This chapter describes how to install and manage the Topspin 270 system hardware. • “Interpreting the Front Panel LEDs” on page 65 • “Interpreting the Back Panel LEDs” on page 71 • “Monitoring the System with Chassis Manager” on page 76 •...

  • Page 66: System-Wide Status Led

    Figure 5-1: Front Panel LEDs System-Wide Status LED Locating the System-Wide Status LED The system-wide status LED is located on the front of the chassis, and is visible whether the bezel cover is on or off. This LED indicates the overall health of all modules in the system. If you are facing the front of the chassis, the system-wide status LED is found on the top left corner of the switch.

  • Page 67: Power Supply Leds

    Table 5-1: Interpreting the System-Wide LED (see Color State Yellow blinking Power Supply LEDs Locating the Power Supply LEDs The Power Supply LEDs are located in the outside of each Power Supply module, if you are facing the front of the chassis with the bezel cover removed. Figure 5-2: Power Supply LEDs Figure 5-1)
  • Page 68 In addition, a Power Supply Identify LED is located on the outside of the chassis, next to the corresponding power supply. This LED allows the user to initiate a command that causes the Identify LED to blink, which assists in locating a particular Field Replaceable Unit. Figure 5-3: Power Supply Identify LED Replicas of the Power Supply LEDs are positioned on the back of the chassis.

  • Page 69: Fan Leds

    Table 5-3: Interpreting the Power Supply Identify LED Color State Yellow blinking Fan LEDs Location The Fan LEDs are located at the top of each Fan tray module. Refer to In addition, replicas of the Fan Tray LEDs are positioned on the back of the chassis. Refer to “Management Interface Module LEDs”...

  • Page 70: Fabric Controller Leds

    Fabric Controller LEDs Each Fabric Module has two sets of LED indicators. • The two LEDs (green or yellow) are the module status indicators • The single LED (green only) indicates whether of not the module is the active system master (Table Location Refer to...

  • Page 71: Interpreting The Back Panel Leds

    Interpreting the Back Panel LEDs The back of the Topspin 270 chassis has the following types of LED indicators: • “Management Interface Module LEDs” on page 71 • “Chassis ID LEDs” on page 74 • “LIM Status LEDs” on page 75 •...
  • Page 72 Location The Management Interface modules are located at the top of back the chassis. Refer to view the chassis diagram. Figure 5-6: Management Interface Module LEDs Interpreting the Management Interface LEDs System Status LEDs Table 5-7: Interpreting the Management Interface Module System Status LEDs (see 5-6) Color Green and Yellow...
  • Page 73 Table 5-8: Interpreting the Management Interface Module Status LEDs (see Color State Green Yellow solid on Yellow blinking Fan Tray Module Status LEDs Table 5-9: Interpreting the Fan Tray Status LEDs (see Color State Green over Yellow Green solid on Green Yellow solid on...

  • Page 74: Chassis Id Leds

    Table 5-10: Interpreting the Power Supply Status LEDs (see Color Green over Yellow Green Green Yellow Master Management Connection Status LED The Master Management Connection Status LED is a single LED that indicates whether that particular Management Interface module is connected to the system's active master controller. Refer to Table 5-11: Interpreting the Master Management Connection LEDs (see Color...

  • Page 75: Lim Status Leds

    Table 5-13: Interpreting the Chassis ID Status LEDs (see Color Green/Yellow Green Green Yellow Yellow LIM Status LEDs Location The LIM Status LED is located at the far left of each LIM card (if you are facing the back of the chassis).

  • Page 76: Monitoring The System With Chassis Manager

    Location The InfiniBand port LEDs are located to the right of each InfiniBand port (if you are facing the LIM card) in the back of the chassis. Figure 5-9: InfiniBand Port LEDs Interpreting the InfiniBand Port LEDs Table 5-15: Interpreting the InfiniBand Port Status LED Top (Logical) LED solid on blinking...
  • Page 77 The Device Rear View and the Device Front View appear. Figure 5-10: Chassis Manager 270 Device Rear View...
  • Page 78 Figure 5-11: Chassis Manager 270 Device Front View View the information at the top of the window to quickly check the status color and the number of modules installed. • • • • Use the visual representation of the LEDs to monitor the status of the cards, ports, power supplies, and fans.

  • Page 79: Monitor The Cards

    • In the case of the fabric controller cards, the card that is currently on standby (not the master) will be grey. The master fabric controller will be green. • A red LED indicates that an error has been detected. Monitor the Cards Launch the Chassis Manager by entering the IP address of the InfiniBand switch into your web browser.

  • Page 80: Monitor The Infiniband Ports

    normal bootFailed tooHot booting checkingBootImage wrongBootImage rebooting standby recoveryImage Click the radio button next to the card that you want to monitor. 10. Click the Properties button to view details about the card, or to reset the card. Reset a card to return it to the default state. The cards cannot be shut down because they are architected so that they are always in-service once they are inserted into the chassis.

  • Page 81: Monitor The Power Supplies

    View the Admin Status and the Oper Status of the ports. The Admin Status refers to the state that the admin has chosen the port to be. The Oper Status refers to the actual state of the port. For example, an admin may have selected a state of “Up” for a port, but the Oper Status would display “down”...

  • Page 82: Monitor The Fans

    The Power Supplies view appears. Figure 5-15: Chassis Manager Power Supplies Window Monitor the Fans Launch the Chassis Manager by entering the IP address of the InfiniBand switch into your web browser. Log into the chassis. The Device Rear View and the Device Front View appear. View the Fan status at the top of the window to quickly check the status color and the number of modules installed.

  • Page 83: Monitor The Temperature

    Monitor the Temperature Launch the Chassis Manager by entering the IP address of the InfiniBand switch into your web browser. Press the Enter key. The Device Rear View and the Device Front View appear. Click open the Chassis file in the left-navigation tree. The individual components appear beneath the Chassis menu.

  • Page 84: Monitoring The System With Element Manager

    Monitoring the System with Element Manager For information regarding installing the optionally licensed Element Manager GUI, refer to the InfiniBand User Guide. Launch the Element Manager. Select Health > Status. The Health Status window opens. Figure 5-18: Element Manager Summary Tab Interpreting the Summary Tab Use the Summary tab to view the status of the Power, Fans, and Temperature Sensors at once.

  • Page 85: Interpreting The Power Supplies Tab

    Interpreting the Power Supplies Tab Use the Health > Status > Power Supplies tab to view the operating status of the power supplies. Figure 5-19: Element Manager Power Supplies Tab Interpreting the Fans Tab Use the Health > Status > Fans tab to view the operating status of the fans. Figure 5-20: Element Manager Fans Tab Note the OperStatus field.

  • Page 86: Monitor The System With The Cli

    Figure 5-21: Element Manager Sensors Tab Note the OperStatus field. A status of “up” indicates that the sensor is functioning properly. Note the Temperature field. Each slot has an individual temperature sensor. The Alarm and Shutdown temperatures vary by slot type. Monitor the System With the CLI For a complete list of CLI commands, refer to the CLI Reference Guide.
  • Page 87 Note the Speed field. The integer in this field represents a percentage. The percentage changes based on the ambient temperature of the unit, and will increase as the temperature rises. Example Topspin-270> show fan ================================================================================ ================================================================================ oper-status speed(%) -------------------------------------------------------------------------------- ================================================================================ ================================================================================ product serial-number...

  • Page 89: 6: Hardware Diagnostic Tests

    Hardware Diagnostic Tests This chapter describes how to run diagnostic tests on the Topspin 270 system hardware. • “About Diagnostic Tests” on page 89 • “Displaying Hardware Errors” on page 99 About Diagnostic Tests Hardware diagnostic tests can be performed through the CLI or the Element Manager GUI. Refer to the Element Manager User Guide for instruction on running tests in with the Java GUI.

  • Page 90: Run Card Tests

    Run Card Tests References to “Cards” refers to fabric controllers, management I/O modules, node cards and the chassis ID module. Fans and power supplies are not included in the Card tests; they can be tested through the standard chassis test The following tests are available to locate and diagnose one or more cards in the chassis: •...
  • Page 91 Example of completed test Topspin-270(config-diag-card-11)# exit Topspin-270(config)# exit Topspin-270# show diagnostic card 11 ================================================================================ ================================================================================ test : self-test slot-id : 11 iterations : 1 action : start result : success percentage-completed : 100 result-string : Card Test, Final report : PASSED; Please reboot system Diagnostic Tests For Cards...

  • Page 92: Run Chassis Tests

    Use the more file-system:file-name command to display the log file and view the detailed results of the diag test. Example of log results Topspin-270# more syslog:hwif_log Thu Mar 4 10:57:49 2004: POST: SEEPROM: PASSED Thu Mar 4 10:57:49 2004: POST: FPGA: PASSED Thu Mar 4 10:57:49 2004: POST: SUMMIT: PASSED Thu Mar...

  • Page 93: Run A Chassis Standard Test

    • Standard • Extended • Extended Memory Run a Chassis Standard Test The chassis standard diag test runs a diagnostic test on all cards in the chassis. Enter the diag chassis test standard and start commands to initiate the test. Example Topspin-270>...

  • Page 94: Run Fan Tests

    Enter the show diag post command to show any errors on individual components. Example Topspin-270# show diag post =================================================================== =================================================================== fru-slot post-status ------------------------------------------------------------------- card(1) passed card(2) passed card(7) passed card(8) passed card(9) passed card(10) passed card(11) passed card(12) passed card(13) passed card(14) passed...
  • Page 95 Enter the diag fan <id> command. Example Topspin-270# config Topspin-270(config)# diag fan 1 Topspin-270(config-diag-fan-1)# test self-test Topspin-270(config-diag-fan-1)# start Topspin-270(config-diag-fan-1)# exit Topspin-270(config)# exit Topspin-270# show diag fan ============================================================================= ============================================================================= module-type : fan module-number : 1 test : self-test iterations : 1 action : start result : in-progress percentage-completed : 70...

  • Page 96: Run Power Supply Tests

    Use the show diag fru-error command to display any errors that appear in the result-string. Example Topspin-270# show diag fru-error ============================================================ ============================================================ fru-slot fru-error ------------------------------------------------------------ card(1) none card(2) none card(7) none card(8) none card(9) none card(10) none card(11) none card(12) none card(13) none...

  • Page 97: Run A Self-Test On A Power Supply

    Run a Self-Test on a Power Supply Show the ID of the power supply that you want to diagnose, if you do not already know the number. Example Topspin-270# show power-supply ===================================================================== ===================================================================== type admin-status --------------------------------------------------------------------- Enter the diag power-supply <id> command and specify the type of test (self-test is chosen by default).
  • Page 98 Use the show diag fru-error command to display any errors that appear in the result-string. Example Topspin-270# show diag fru-error ================================================================ ================================================================ fru-slot fru-error ---------------------------------------------------------------- card(9) none card(10) none card(11) none card(12) none card(13) none card(14) none card(15) none card(17) none fan(1) none...

  • Page 99: Displaying Hardware Errors

    Displaying Hardware Errors To display POST results, non-fatal errors that can are recovered, informational logging (such as firmware updates), and hardware errors: Use the more syslog:hwif_log command to locate the: /topspin/log/hwif_log Example of output without errors Topspin-270> enable Topspin-270# more syslog:hwif_log Thu Mar 4 10:57:49 2004: POST: SEEPROM: PASSED Thu Mar...

  • Page 100: Error Types

    To view FRU errors on your Topspin 270, enter the show diagnostic fru-error command. Example Topspin-270# show diagnostic fru-error ================================================================================ ================================================================================ fru-slot fru-error -------------------------------------------------------------------------------- card(1) _FRU_POWER_CONTROLLER_CONFIG_ERR fan(1) none fan(2) none power-supply(1) none Error Types The following types of hardware errors are logged for the Topspin 270 baseboard: Table 6-1: Topspin 270 Baseboard Errors Error Number Description The following types of hardware errors are logged for the Topspin 270 power supply:...
  • Page 101 Table 6-2: Topspin 270 Power Supply Errors Error Number Description Power Supply Fan Fail Error Power Supply I2C Communication Error...

  • Page 103: 7: Specifications And Compliance Certifications

    Specifications and Compliance Certifications This chapter details the Topspin 270 specifications and compliance certifications. Chassis and Management Interface Table 7-1: Chassis and Management General Specifications Operating Temperature Ranges Operating Temperature Non-Operating Temperature Operating Temperature Gradient Operating Altitude Non-Operating Altitude Operating Humidity: Non-Operating Humidity: Operating Humidity Gradient Operating Shock...

  • Page 104: Electrical Specifications

    Table 7-1: Chassis and Management General Specifications Operating Temperature Ranges Non-Operating Vibration, random Max. Operating Inclination Electrical Specifications Table 7-2: Electrical Specifications Category AC Input Maximum Power consumption EMC/Immunity Table 7-3: EMC/Immunity Description FCC; CFR 47 Part 15, Subpart B Class A ICES-003 Issue 2 EN 61000-3-2 (Harmonics), EN 61000-3-3 (Flicker), EN 55022: 1998, EN 55024:1998;...

  • Page 105: Product Markings

    Product Markings • UL, FCC Statement, VCCI, CE, ICES...

  • Page 107: 8: Index

    active controller card 11 admin status 81 card operational state 79 reset 80 card reset 80 chassis ID about 19 LEDs 74 chassis manager launching 32 LEDs 78 controller card identify active 11 upgrade 59 controllerFabric12x 79 core slot about 18 diag card 90 diag chassis test standard 93 diag power-supply 97...
  • Page 108 rack-locator 89 reload 92 reset card 80 reset controller card 59 safety information vii setup 32 show card 11 show diag chassis 93 show diag fru-error 96, 98 show diag post 94 show power-supply 97 slot numbers 15 speed port 81 starting Chassis Manager 32 switch configuration 32 switch fabric end-nodes...

This manual is also suitable for:

Topspin 270

Table of Contents