1. Manuals
  2. Brands
  3. Sun Oracle Manuals
  4. Switch
  5. Switch 72
  6. User manual

Sun Oracle Switch 72 User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
Sun Datacenter InfiniBand
Switch 72
User's Guide
Part No. 820-7751-12
May 2010, Revision A

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Switch 72 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Sun Oracle Switch 72

Summary of Contents for Sun Oracle Switch 72

  • Page 1 Sun Datacenter InfiniBand Switch 72 User’s Guide Part No. 820-7751-12 May 2010, Revision A...
  • Page 2 Copyright © 2009, 2010 Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means.

  • Page 5: Table Of Contents

    Contents Using This Documentation xi Installing the Switch 1 Understanding Switch Specifications 1 Physical Specifications 2 Environmental Requirements 3 Acoustic Noise Emissions 3 Electrical Specifications 3 Network Management Connector and Pins 4 USB Management Connector and Pins 5 CXP Connector and Pins 5 Routing Service Cables 7 Power Cord Requirements 7 Management Cable Requirements 8...
  • Page 6 Perform Diagnostics on the InfiniBand Fabric 43 ▼ Validate the InfiniBand Fabric and Report Errors 44 Administering the Switch 47 Troubleshooting the Switch 47 Switch Hardware Problems 48 InfiniBand Fabric Problems 51 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 7 Understanding the LEDs 54 Front Status LEDs 55 Rear Status LEDs 55 ▼ Check Chassis Status LEDs 56 ▼ Check Network Management Port Status LEDs 57 ▼ Check Link Status LEDs 57 ▼ Check Power Supply Status LEDs 58 ▼ Check Fan Status LEDs 59 Understanding Routing Through the Switch 59 CXP Connectors and Link LEDs to Switch Chip Port Routes 60...
  • Page 8 Determine Changes to the InfiniBand Fabric Topology 95 ▼ Find 1x or SDR or DDR Links in the Fabric 97 ▼ Determine Which Links Are Experiencing Significant Errors 97 viii Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 9 ▼ Clear Error Counters 98 ▼ Clear Data Counters 99 ▼ Check All Ports 99 ▼ Reset a Port 100 ▼ Set Port Speed 101 ▼ Disable a Port 102 ▼ Enable a Port 103 Controlling the Subnet Manager 104 ▼...
  • Page 10 Remove an InfiniBand Cable 134 ▼ Install an InfiniBand Cable 136 Servicing the Battery 139 ▼ Remove the Switch From the Rack 139 ▼ Replace the Battery 140 Upgrading the Firmware 145 Index 147 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 11: Using This Documentation

    Using This Documentation This user guide provides detailed procedures that describe preparation, installation, administration, and service for the Sun Datacenter InfiniBand Switch 72 from ® Oracle . This document is written for technicians, system administrators, authorized service providers, and users who have advanced experience installing, administering, and servicing InfiniBand fabric hardware.

  • Page 12: Documentation Feedback

    Submit comments about this document by clicking the Feedback[+] link at (http://docs.sun.com). Include the title and part number of your document with your feedback: Sun Datacenter InfiniBand Switch 72 User’s Guide, part number 820-7751-12. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 13: Installing The Switch

    Installing the Switch The following topics describe the installation of the switch. The topics are listed in the order of completion. “Understanding Switch Specifications” on page 1 ■ “Routing Service Cables” on page 7 ■ “Understanding InfiniBand Cabling” on page 9 ■...

  • Page 14: Network Management Connector And Pins

    24 in. (609.6 mm) Height 1.75 in. (44.5 mm) Weight 23.0 lbs (11.4 kg) Related Information “Shipping Carton Contents” on page 16 ■ “Install the Switch in the Rack” on page 18 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 15: Environmental Requirements

    Environmental Requirements Parameter Operating Ambient temperature 41˚F to 89.6˚F (5˚C to 32˚C) Relative humidity 5% to 85% noncondensing, 80˚F (27˚C) maximum wet bulb Elevation (Sun requirement) Maximum 9840 feet (3000 meters) at 104˚F (40˚C) Acoustic Noise Emissions Parameter Operating Idling Acoustic power LWAd (1B=10dB) 7.1 B 7.2 B...

  • Page 16: Network Management Connector And Pins

    Related Information “Management Cable Requirements” on page 8 ■ “Attach the Management Cables” on page 24 ■ “Access the Management Controller From the Network Management Port” on ■ page 29 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 17: Usb Management Connector And Pins

    USB Management Connector and Pins The following table lists the pinout of the USB management connector. Signal +5 VDC - Data + Data Related Information “Management Cable Requirements” on page 8 ■ “Attach the Management Cables” on page 24 ■ “Access the Management Controller From the USB Management Port”...
  • Page 18 Ground for both signal and power return VCC3.3-Tx 3.3V standby power from the power supplies VCC3.3-Rx 3.3V standby power return VCC12-Tx 12V power for cable export and future enhancements VCC12-Rx 12V power return Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 19: Routing Service Cables

    Signal Description TXportdiff Differential InfiniBand transmit signal, where: • port – 0 to 11 • diff – n or p for negative or positive RXportdiff Differential InfiniBand receive signal, where: • port – 0 to 11 • diff – n or p for negative or positive C clock C data I/O PRSNT...

  • Page 20: Management Cable Requirements

    MAC address of the management controller, so the server can provide an IP address to the management controller upon boot. If a DHCP server is not available, then the USB connection is used. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 21: Infiniband Cable Cautions

    The advantage of the NET connection over the USB connection is that administration of the switch can happen from anywhere on the network. There is no cable length constraint for the network management route because of the re-amplification, filtering, and processing that happens at each hub or switch within the Ethernet network.

  • Page 22: Infiniband Cable Cautions

    Apply connection or Carry the entire cable to and from disconnection forces at the the points of connection. connector only. Related Information “Connecting InfiniBand Cables” on page 35 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 23: Infiniband Cable Guidelines

    InfiniBand Cable Guidelines Proper InfiniBand cable installation requires the following: 1. Plan the cable routes and cable length needs, identifying problematic cable route bends, minimizing the length of continuous vertical runs to no more than 2 meters (7 feet), and specifying hardware to support cable routing. “InfiniBand Cable Path Lengths”...

  • Page 24: Infiniband Cable Path Lengths

    You can bundle the cables using many hook and loop straps. Do not bundle more than 12 cables together. A fully configured switch has 24 InfiniBand cables, so that is at least two bundles. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 25: Floor And Underfloor Delivery Of Infiniband Cables

    Place the hook and loop straps as close together as reasonably possible. For example, every 1 ft (0.3 m). If a cable breaks free from a strap, the cable can not fall far before it is retained by another strap. Related Information “Connecting InfiniBand Cables”...

  • Page 26: Understanding The Installation

    There must be a clean, dry, stable work surface. ■ Related Information “Suggested Tools” on page 15 ■ “Antistatic Precautions” on page 15 ■ “Installation Responsibilities” on page 15 ■ “Installation Sequence” on page 16 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 27: Suggested Tools

    Suggested Tools The following tools are necessary or beneficial for installing the switch: Antistatic mat ■ Antistatic wrist strap ■ No. 2 Phillips screwdriver ■ No. 1 Phillips screwdriver ■ Flashlight ■ Gloves ■ Magnifying glass ■ Related Information “Antistatic Precautions” on page 15 ■...

  • Page 28: Accessing The Management Controller

    Cable bracket and rackmount kit ■ Cable management bracket and cover ■ Two rack-mounting rail assemblies ■ Assortment of screws and captive nuts ■ Sun Datacenter InfiniBand Switch 72 Getting Started Guide ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 29 Item Descripton Switch Front mounting brackets, long Front mounting brackets, short C-shaped brackets Documentation Hardware Cable management extenders Long rails Cable management cover Cable management assembly Attachment brackets Attachment plates Power cords (not pictured) After verifying the package contents, install the switch into the rack. See “Install the Switch in the Rack”...

  • Page 30: Install The Switch In The Rack

    Place the attachment plate on the flange side of the extender, opposite the attachment bracket. c. Use two screws to sandwich the attachment bracket and plate to the extender, in the position farthest from the flange. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 31 d. Using a No. 2 Phillips screwdriver, tighten the two screws. e. Repeat from Step a for the other cable management extender. 4. Attach the cable management extenders and long rails to the rear of the rack. a. Place the long rail to the mounting location on the rear rack post. b.
  • Page 32 Ensure that the ends of the long rails slide into the C-shaped brackets at the rear of the switch chassis and that the power cords lay into the cut-outs of the long front mounting brackets. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 33 9. Mount the front of the switch chassis to the front rack posts with two captive nuts and two screws at each side. Tighten the screws securely. 10. Install the cable management bracket to the tabs of the attachment brackets at the rear of the switch, tightening the thumbscrews on each side of the cable management bracket.
  • Page 34 11. Install the cable management bracket cover. 12. Tighten the thumbscrews on each side of the cover. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 35: Powering On The Switch

    13. Attach the management cables. “Attach the Management Cables” on page Related Information “Shipping Carton Contents” on page 16 ■ “Powering On the Switch” on page 23 ■ Powering On the Switch After installing the components, enable powering up of the switch by performing these tasks.

  • Page 36: Attach The Management Cables

    1. Identify the prerequisite and subsequent installation tasks that you must perform in conjunction with this procedure. “Installation Sequence” on page 2. Connect the network management cables from the management console to the connectors labeled NET. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 37 3. Configure the DHCP server with the MAC address of the management controller. The MAC address is printed on the customer information (yellow) sheet on the outside of the switch shipping carton and on the pull-out tab on the left side front of the switch chassis, adjacent to power supply 0.
  • Page 38 “Network Management Connector and Pins” on page 4 ■ “USB Management Connector and Pins” on page 5 ■ “Management Cable Requirements” on page 8 ■ “Attach the InfiniBand Cables” on page 36 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 39: Attach The Power Cords

    ▼ Attach the Power Cords The power cords for the switch ship separately and are specific to the country of installation. The facility power receptacles for the power cords should be located such that the power cords are routed out of the way, either to the sides of the rack or under the floor.

  • Page 40: Accessing The Management Controller

    “Access the Management Controller From the USB Management Port” on page 30 ■ Related Information “Network Management Connector and Pins” on page 4 ■ “USB Management Connector and Pins” on page 5 ■ “Management Cable Requirements” on page 8 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 41: Access The Management Controller From The Network Management Port

    ▼ Access the Management Controller From the Network Management Port Note – The administrator of the switch has the username of root. 1. Identify the prerequisite and subsequent installation tasks that you must perform in conjunction with this procedure. “Installation Sequence” on page 2.

  • Page 42: Access The Management Controller From The Usb Management Port

    Even if you do not see the text, go to Step 5. Type root for the login name followed by the root password of changeme. nm2name login: root Password: password The # prompt is displayed. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 43: Verify The Switch Status

    Note – You can change the password at a later time. See “Change the Administrator Password” on page 93 for instructions on how to change the administrator password. 6. Verify the switch status. “Verify the Switch Status” on page Related Information “USB Management Connector and Pins”...
  • Page 44 Measured 12V = 12.06 V Measured 5V = 5.10 V Measured VBAT = 3.17 V Measured 1.8V = 1.78 V Measured 1.2V Standby = 1.21 V Measured 1.8V Standby = 1.80 V Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 45 Measured 2.5VA = 2.51 V Measured 2.5VB = 2.51 V Measured 1.2VA = 1.22 V Measured 1.2VB = 1.22 V Measured 1.2VC = 1.21 V Measured 1.2VD = 1.21 V Measured 1.2VB = 1.21 V Measured 1.2VE = 1.21 V Measured 1.2VF = 1.21 V Voltage test returned OK Starting PSU test:...

  • Page 46: Start The Subnet Manager

    13: # setsmpriority 13 ------------------------------------------------- OpenSM 3.2.6_20090717 Reading Cached Option File: /etc/opensm/opensm.conf Loading Cached Option:routing_engine = ftree Loading Cached Option:sminfo_polling_timeout = 1000 Loading Cached Option:polling_retry_number = 3 Command Line Arguments: Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 47: Connecting Infiniband Cables

    Priority = 13 Creating config file template ’/tmp/osm.conf’. Log File: /var/log/opensm.log ------------------------------------------------- 6. Enable the Subnet Manager: # enablesm Starting IB Subnet Manager. 7. Attach the InfiniBand cables. “Attach the InfiniBand Cables” on page Related Information Switch Reference, setsmpriority command ■...

  • Page 48: Attach The Infiniband Cables

    “Installation Sequence” on page 2. Loosen the two captive thumbscrews that secure the cover to the cable management bracket. 3. Lift the cover off. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 49 4. Remove the protective cap from the connector and visually inspect the cable connector. The shell should not be bent and should be parallel to the inner boards. If the connector is bent or damaged, use a different cable. 5. Ensure that the retraction strap is forward. 6.
  • Page 50 If the connector stops or binds with about 1/8 in. (2 mm) still to go, back out ■ and repeat Step 8. Continue to push the connector in until the hooks catch onto the top of the receptacle. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 51 9. Place the cable into the open slot on the cable management bracket. 10. Repeat Step 4 through Step 9 for all cables to be installed. 11. Replace the cover for the cable management bracket and tighten the thumbscrews. Installing the Switch...
  • Page 52 12. Route the InfiniBand cables so that they do not interfere with other cables, or with servicing the Sun Datacenter InfiniBand Switch 72 or other systems. Use hook and loop fastener straps to bundle and secure the cables. Note – Do not use cable zip ties to bundle or secure the cable, because the ties damage the wires inside the cable.

  • Page 53: Check Link Status

    ▼ Check Link Status 1. Identify the prerequisite and subsequent installation tasks that you must perform in conjunction with this procedure. “Installation Sequence” on page 2. On the management controller, determine the state of the links: # listlinkup If the link for a connector is reported as Not present, there is no cable ■...

  • Page 54: Discover The Infiniband Fabric Topology

    0 lid 24 lmc 0 [22] "S-0021283a8620b0c0"[18] # "Sun DCS 72 QDR switch 1.2(LC)" lid 22 4xQDR Note – The output for your InfiniBand fabric will differ from that in the example. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 55: Perform Diagnostics On The Infiniband Fabric

    3. Perform InfiniBand fabric diagnostics. “Perform Diagnostics on the InfiniBand Fabric” on page Related Information Switch Reference, ibnetdiscover command ■ “Validate the InfiniBand Fabric and Report Errors” on page 44 ■ ▼ Perform Diagnostics on the InfiniBand Fabric The ibdiagnet command performs a collection of tests on the InfiniBand fabric and generates several files that contain parameters and aspects of the InfiniBand fabric.

  • Page 56: Validate The Infiniband Fabric And Report Errors

    Error check on lid 25 (Sun DCS 72 QDR FC switch o4nm2-72p-2) port 9: FAILED #warn: counter SymbolErrors = 65535 (threshold 10) lid 20 port 255 Error check on lid 20 (Sun DCS 72 QDR switch 1.2(LC)) port all: FAILED Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 57 ## Summary: 6 nodes checked, 0 bad nodes found 144 ports checked, 2 ports have errors beyond threshold Note – The output for your InfiniBand fabric will differ from that in the example. Related Information Switch Reference, ibcheckerrors command ■ “Discover the InfiniBand Fabric Topology”...
  • Page 58 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 59: Administering The Switch

    Administering the Switch The following topics describe the administration of the switch. “Troubleshooting the Switch” on page 47 ■ “Administrative Command Overview” on page 66 ■ “Monitoring the Hardware” on page 67 ■ “Monitoring the InfiniBand Fabric” on page 76 ■...

  • Page 60: Switch Hardware Problems

    “Power On a Power Supply” on page 122. 6. If the previous steps do not rectify the situation, replace the switch. “Remove the Switch From the Rack” on page 139 “Installing the Switch” on page Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 61 Situation Corrective Steps The Attention LED on 1. If you are unable to access the management controller, power cycle the switch. the switch chassis is lit or “Power Off a Power Supply” on page 117 “Power On a Power Supply” on the management page 122.
  • Page 62 “InfiniBand Fabric Problems” on page 51 ■ “Understanding the LEDs” on page 54 ■ “Understanding Routing Through the Switch” on page 59 ■ “Switch GUIDs Overview” on page 65 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 63: Infiniband Fabric Problems

    InfiniBand Fabric Problems The following table lists situations that might occur with the InfiniBand fabric and corrective steps that can be taken to resolve the problem. Situation Corrective Steps Performance of the 1. Determine if there are errors or problems with the InfiniBand fabric. InfiniBand fabric See: seems diminished.
  • Page 64 2. 7. Depending upon what does or does not rectify the problem, replace that component. “Servicing the InfiniBand Cables” on page 132. See remote port’s documentation for replacement procedures. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 65 Situation Corrective Steps Some InfiniBand For a temporary solution: links are running at 1. Identify the suspect links using the ibdiagnet command. 1x or SDR. “Find 1x or SDR or DDR Links in the Fabric” on page 97. Look for text like the following: -W- link with SPD=2.5 found at direct path "1,19"...

  • Page 66: Front Status Leds

    “Switch Hardware Problems” on page 48 ■ “InfiniBand Fabric Problems” on page 51 ■ “Understanding Routing Through the Switch” on page 59 ■ “Switch GUIDs Overview” on page 65 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 67: Front Status Leds

    Front Status LEDs The power supply status LEDs and fan status LEDs are located on the front of the switch chassis. Front Status LEDs FIGURE: Figure Legend Power supply AC LED Power supply Attention LED Power supply OK LED Fan status LEDs Related Information “Check Power Supply Status LEDs”...

  • Page 68: Check Chassis Status Leds

    ▼ Check Chassis Status LEDs The chassis status LEDs are located on the left side of the rear panel. See “Rear Status LEDs” on page 1. Visually inspect the chassis status LEDs. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 69: Check Network Management Port Status Leds

    2. Compare what you see to the following table. Glyph Location Name Color State and Meaning Locator White On – No function. Off – Disabled. Flashing – The switch is identifying itself. Middle Attention Amber On – Normal fault detected. Off –...

  • Page 70: Check Power Supply Status Leds

    15 minutes. A shorter cooling time might cause damage to the power supply when the power cord is reattached. If the Attention LED lights amber upon reattaching the power cord, replace the power supply. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 71: Check Fan Status Leds

    Related Information “Display Power Supply Status” on page 68 ■ “Check Board-Level Voltages” on page 69 ■ ▼ Check Fan Status LEDs The fan status LEDs are located in the lower right corner of the fans at the front of the switch chassis.

  • Page 72: Cxp Connectors And Link Leds To Switch Chip Port Routes

    Note – When using CXP to QSFP splitter cables, the P1, P2, and P3 QSFP connectors are related to the right, center, and left link LEDs respectively. Related Information “Switch Chip Port to Switch Chip Port Routes” on page 61 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 73: Switch Chip Port To Switch Chip Port Routes

    “Switch Chip Port to CXP Connectors and Link LED Routes” on page 62 ■ “Signal Route Through the Switch” on page 64 ■ “Display Link Status” on page 75 ■ “Display Switch Chip Port Status” on page 76 ■ Switch Chip Port to Switch Chip Port Routes The following table provides a mapping of switch chip (I4) and port to another switch chip (I4) and port.

  • Page 74: Switch Chip Port To Cxp Connectors And Link Led Routes

    LEDs is provided in the following table. The connectors and LEDs are given as connectorletter-location, where: connector – The identifying number of the connector group (0–11). ■ letter – The letter identifying the upper (A) or lower (B) connector. ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 75 location – The location of the LED, left, center, or right. ■ Note – The shaded cell seen in the PDF file is used for the example described in “Signal Route Through the Switch” on page 64. The shaded cell is not seen in the HTML file.

  • Page 76: Signal Route Through The Switch

    “Switch Chip Port to CXP Connectors and Link LED Routes” on page 62 ■ “Display a Route Through the Fabric” on page 79 ■ “Perform Comprehensive Diagnostics for a Route” on page 95 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 77: Switch Guids Overview

    Switch GUIDs Overview Global unit identifiers (GUIDs) are unique 64-bit strings that identify nodes such as switches and channel adapters. For the Sun Datacenter InfiniBand switches, GUIDs are modified to identify the node’s role and location. The following table describes the GUID’s structure.

  • Page 78: Administrative Command Overview

    “Monitoring the Hardware” on page 67 ■ “Monitoring the InfiniBand Fabric” on page 76 ■ “Controlling the Hardware” on page 87 ■ “Controlling the InfiniBand Fabric” on page 93 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 79: Hardware Command Overview

    Hardware Command Overview The management controller uses a simplified Linux OS and file system. From the # prompt on the management controller, you can type hardware commands to perform some administrative and management tasks. Hardware commands are user-friendly and can perform some testing upon the switch chips, enabling greater control of the switch and its operation.

  • Page 80: Display Switch General Health

    Switch Reference, showunhealthy command ■ “Display Switch Environmental and Operational Data” on page 71 ■ ▼ Display Power Supply Status The checkpower command performs a simple pass-fail test on the power supplies. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 81: Check Board-Level Voltages

    1. On the management controller, type: # checkpower PSU 0 present status: OK PSU 1 present status: Alert 2. If you see the words Alert or Not Present in the command output, perform the following steps for the affected power supply. a.

  • Page 82: Display Internal Temperatures

    # showtemps Back temperature 22.88 Front temperature 31.75 Com-Express temperature 26.12 I4-A temperature 55 maxtemperature 55 I4-B temperature 47 maxtemperature 49 I4-C temperature 52 maxtemperature 52 I4-D temperature 48 maxtemperature 49 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 83: Display Fan Status

    I4-E temperature 52 maxtemperature 52 I4-F temperature 52 maxtemperature 54 Related Information Switch Reference, showtemps command ■ “Display Fan Status” on page 71 ■ “Display Switch Environmental and Operational Data” on page 71 ■ ▼ Display Fan Status The output of the getfanspeed command can help you determine fan speed inconsistencies, which might indicate a future failure.
  • Page 84 Fan 4 running at rpm 12433 FAN test returned OK Starting Connector test: Connector test returned OK Starting I4 test: I4-A OK I4-B OK I4-C OK I4-D OK I4-E OK I4-F OK All I4s OK Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 85: Display Switch Firmware Versions

    I4 test returned OK NM2 Environment test PASSED Related Information Switch Reference, env_test command ■ ▼ Display Switch Firmware Versions In time, newer or updated switch firmware might become available. The nm2version command displays the versions of the firmware within the switch chassis.

  • Page 86: Locate A Switch Chip Or Connector From The Guid

    For example, GUID 0x0021283a8638b0c0 is truncated to b0c0. The b0 means that the node is inside of a Sun Datacenter InfiniBand Switch 72. The c means that the node is located in I4 switch chip C. The port is 21.

  • Page 87: Display Link Status

    I4-E OK I4-F OK Related Information Switch Reference, checkboot command ■ “Reset the Switch Chip” on page 89 ■ “Display Switch Environmental and Operational Data” on page 71 ■ ▼ Display Link Status In some situations, you might need to know the status of each route through the switch.

  • Page 88: Display Switch Chip Port Status

    ■ “Identify All HCAs in the Fabric” on page 78 ■ “Display the InfiniBand Fabric Topology” on page 78 ■ “Display a Route Through the Fabric” on page 79 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 89: Identify All Switches In The Fabric

    “Display the Link Status of a Node” on page 80 ■ “Display Counters for a Node” on page 81 ■ “Display Data Counters for a Node” on page 82 ■ “Display Low-Level Detailed Information About a Node” on page 83 ■...

  • Page 90: Identify All Hcas In The Fabric

    To understand the routing that happens within your InfiniBand fabric, the ibnetdiscover command displays the node-to-node connectivity. The output of the command is dependent upon the size of your fabric. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 91: Display A Route Through The Fabric

    ● On the management controller, type: # ibnetdiscover Related Information Switch Reference, ibnetdiscover command ■ “Determine Changes to the InfiniBand Fabric Topology” on page 95 ■ “Perform Comprehensive Diagnostics for the Entire Fabric” on page 94 ■ ▼ Display a Route Through the Fabric Often you need to know the route between two nodes.

  • Page 92: Display The Link Status Of A Node

    ● On the management controller, type: # ibportstate lid port where: lid is the LID of the node. ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 93: Display Counters For A Node

    port is the port of the node. ■ For example: # ibportstate 24 8 PortInfo: # Port info: Lid 24 port 8 LinkState:.......Active PhysLinkState:....LinkUp LinkWidthSupported:....1X or 4X LinkWidthEnabled:....1X or 4X LinkWidthActive:....4X LinkSpeedSupported:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedEnabled:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedActive:....10.0 Gbps Peer PortInfo: # Port info: Lid 24 DR path slid 25;...

  • Page 94: Display Data Counters For A Node

    ■ ▼ Display Data Counters for a Node If you want to know the data counters for a node, the ibdatacounts command provides that subset of the perfquery command output. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 95: Display Low-Level Detailed Information About A Node

    ● On the management controller, type: # ibdatacounts lid port where: lid is the LID of the node. ■ port is the port of the node. ■ Note – If no port is specified for a switch node, the counters are the total for all switch ports.

  • Page 96: Display Low-Level Detailed Information About A Port

    The smpquery command can provide very detailed information about a port. ● On the management controller, type: # smpquery portinfo lid port where: lid is the LID of the node. ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 97: Related Information

    port is the port of the node. ■ For example, to see detailed information about port 8 on the switch with LID 24, type: # smpquery portinfo 24 8 # Port info: Lid 24 port 8 Mkey:......0x0000000000000000 GidPrefix:.......0x0000000000000000 Lid:......0x0000 SMLid:......0x0000 CapMask:......0x0 DiagCode:......0x0000 MkeyLeasePeriod:....0...

  • Page 98: Map Lids To Guids

    # node_desc Sun DCS 72 QDR switch 1.2(LC) 0x15 port_guid 0x0021283a8620b0b0 # node_desc Sun DCS 72 QDR switch 1.2(LC) 0x16 port_guid 0x0021283a8620b0c0 # node_desc Sun DCS 72 QDR switch 1.2(LC) Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 99: Controlling The Subnet Manager

    Note – The output in the example is just a portion of the entire file. Related Information Switch Reference, osmtest command ■ ▼ Display Subnet Manager Status If you want to quickly determine your Subnet Manager’s priority and state, the sminfo command can also provide the LID and GUID of the hosting HCA.

  • Page 100: Restart The Management Controller

    The management controller power cycles and reinitializes. Note – The reboot command severs any management console link to the management controller. You must re-access the management controller to regain administrative control. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 101: Restart The Entire Switch

    Related Information “Restart the Entire Switch” on page 89 ■ “Reset the Switch Chip” on page 89 ■ ▼ Restart the Entire Switch Should you need to restart the entire switch, you can use the managementreset command. Resetting the entire switch disrupts the InfiniBand fabric. All services are re-initialized and all links will retrain.

  • Page 102: Recover Ports After Switch Chip Reset

    In this example, ports 20, 21, and 22 of switch chip I4-A are down. 2. If the ports are still down, restart the environment daemon: # /etc/init.d/envd stop; /etc/init.d/envd start Wait one minute for the links to retrain. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 103: Set Link Speed

    3. Verify that the ports are up: # listlinkup Connector 0A Present <-> I4-A Ports 22 up 21 up 20 up Connector 1A Not present Note – If the ports do not come up, repeat this procedure a second time. Additionally, investigate if the respective cable or the InfiniBand device at the other end of the cable is at fault.

  • Page 104: Disable A Switch Chip Port

    ● On the management controller, type: # enableswitchport switch_chip port where: switch_chip is the letter of the switch chip (A–F). ■ port is the number of the port (1–36). ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 105: Change The Administrator Password

    Related Information Switch Reference, enableswitchport command ■ “Enable a Port” on page 103 ■ “Disable a Switch Chip Port” on page 92 ■ ▼ Change the Administrator Password The default password for the root user is changeme. You can use the passwd command to make the password unique and more secure.

  • Page 106: Perform Comprehensive Diagnostics For The Entire Fabric

    The ibdiagnet.log file contains the log of the testing. Related Information Switch Reference, ibdiagnet command ■ Switch Reference, ibdiagpath command ■ “Display the InfiniBand Fabric Topology” on page 78 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 107: Perform Comprehensive Diagnostics For A Route

    ▼ Perform Comprehensive Diagnostics for a Route Similar to the ibdiagnet command, the ibdiagpath command can perform some of the same tests for a particular route. ● On the management controller, type: # ibdiagpath -v -l slid,dlid where: slid is the LID of the source node. ■...
  • Page 108 Checking src 0x0021283a8620b0f0 to dest 0x0021283a8620b0f0 Aug 13 19:45:02 480588 [B7EF96C0] 0x01 -> osmtest_validate_path_data: Checking path SLID 0x19 to DLID 0x19 Aug 13 19:45:02 480989 [B7EF96C0] 0x02 -> osmtest_run: Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 109: Find 1X Or Sdr Or Ddr Links In The Fabric

    ***************** ALL TESTS PASS ***************** OSMTEST: TEST "Validate Inventory" PASS Note – Depending on the size of your InfiniBand fabric, the output from the osmtest command could be tens of thousands of lines long. Related Information Switch Reference, osmtest command ■...

  • Page 110: Clear Error Counters

    If you are troubleshooting a port, the perfquery command provides counters of errors occurring at that port. To determine if the problem has been resolved, you can reset all of the error counters to 0 with the ibclearerrors command. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 111: Clear Data Counters

    ● On the management controller, type: # ibclearerrors ## Summary: 5 nodes cleared 0 errors Related Information Switch Reference, ibclearerrors command ■ Switch Reference, perfquery command ■ “Display Counters for a Node” on page 81 ■ “Clear Data Counters” on page 99 ■...

  • Page 112: Reset A Port

    You might need to reset a port to determine its functionality. ● On the management controller, type: # ibportstate lid port reset where: lid is the LID of the node. ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 113: Set Port Speed

    port is the port of the node. ■ For example: # ibportstate 24 8 reset Initial PortInfo: # Port info: Lid 24 port 8 LinkState:.......Down PhysLinkState:....Disabled LinkWidthSupported:....1X or 4X LinkWidthEnabled:....1X or 4X LinkWidthActive:....4X LinkSpeedSupported:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedEnabled:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedActive:....2.5 Gbps After PortInfo set:...

  • Page 114: Disable A Port

    If a port is found to be problematic, you can disable it. ● On the management controller, type: # ibportstate lid port disable where: lid is the LID of the node. ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 115: Enable A Port

    port is the port of the node. ■ For example: # ibportstate 24 8 disable Initial PortInfo: # Port info: Lid 24 port 8 LinkState:.......Active PhysLinkState:....LinkUp LinkWidthSupported:....1X or 4X LinkWidthEnabled:....1X or 4X LinkWidthActive:....4X LinkSpeedSupported:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedEnabled:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedActive:....10.0 Gbps After PortInfo set:...

  • Page 116: Controlling The Subnet Manager

    ■ “Disable the Subnet Manager” on page 107 ■ “Set the Subnet Manager Priority” on page 108 ■ “Start the Subnet Manager With the opensmd Daemon” on page 109 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 117: Create The Guid.txt File

    “Stop the Subnet Manager With the opensmd Daemon” on page 109 ■ Related Information “Controlling the Hardware” on page 87 ■ “Controlling the InfiniBand Fabric” on page 93 ■ ▼ Create the guid.txt File If your InfiniBand fabric uses the Fat-Tree routing algorithm, you must provide a root node GUID file for the Subnet Manager.

  • Page 118: Create The Opensm.conf File

    3. Open the /etc/opensm/opensm.conf file in a text editor. 4. Find the following parameters and change them to as listed. ■ sweep_interval 120 routing_engine ftree ■ use_ucast_cache TRUE ■ ■ root_guid_file /etc/opensm/guid.txt Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 119: Enable The Subnet Manager

    Note – If the /etc/opensm/guid.txt file does not exist, you must create it. See “Create the guid.txt File” on page 105. 5. Save the /etc/opensm/opensm.conf file. 6. Set the permissions for the /etc/opensm/opensm.conf file: # chmod 0644 /etc/opensm/opensm.conf Related Information Switch Reference, opensm command ■...

  • Page 120: Set The Subnet Manager Priority

    Loading Cached Option:sm_priority = 13 Loading Cached Option:sminfo_polling_timeout = 1000 Loading Cached Option:polling_retry_number = 3 Command Line Arguments: Priority = 3 Creating config file template ’/tmp/osm.conf’. Log File: /var/log/opensm.log ------------------------------------------------- Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 121: Start The Subnet Manager With The Opensmd Daemon

    2. Restart the Subnet Manager: # disablesm Stopping IB Subnet Manager.. # enablesm Starting IB Subnet Manager. Related Information Switch Reference, setsmpriority command ■ “Create the opensm.conf File” on page 106 ■ ▼ Start the Subnet Manager With the opensmd Daemon The opensmd daemon enables you to start the OpenSM Subnet Manager without providing command line configuration parameters.
  • Page 122 The Subnet Manager is stopped. Related Information Switch Reference, opensmd command ■ “Disable the Subnet Manager” on page 107 ■ “Start the Subnet Manager With the opensmd Daemon” on page 109 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 123: Servicing The Switch

    Servicing the Switch Once a failed part is identified, it can be replaced. The topics listed here help you service switch chassis components. “Understanding Service Procedures” on page 111 ■ “Servicing the Power Supplies” on page 113 ■ “Servicing the Fans” on page 124 ■...

  • Page 124: Replaceable Components

    “Servicing the Battery” on page 139 ■ “Upgrading the Firmware” on page 145 ■ Replaceable Components The following illustration identifies the replaceable components of the switch. Replaceable Components FIGURE: Figure Legend Battery Power supply Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 125: Servicing The Power Supplies

    Related Information “Servicing the Power Supplies” on page 113 ■ “Servicing the Fans” on page 124 ■ “Servicing the InfiniBand Cables” on page 132 ■ “Servicing the Battery” on page 139 ■ Servicing the Power Supplies The following table provides a description of a goal you want to achieve and links to the sequential tasks required to reach that goal.

  • Page 126: Inspecting A Power Supply

    1. Identify the prerequisite and subsequent service tasks you must perform in conjunction with this procedure. “Inspecting a Power Supply” on page 114. 2. Use the following illustration to identify the various features of a power supply. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 127 Power Supply Features FIGURE: Figure Legend AC Connector Release tab Status LEDs 3. Inspect the power supply hardware. “Inspect the Power Supply Hardware” on page 116. Related Information “Identify the Fan” on page 125 ■ “Identify the InfiniBand Cable” on page 133 ■...

  • Page 128: Inspect The Power Supply Hardware

    1. Identify the prerequisite and subsequent service tasks you must perform in conjunction with this procedure. “Inspecting a Power Supply” on page 114. 2. Verify that the connectors are clean and without damage. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 129: Power Off A Power Supply

    3. The power supply is ready for installation. “Install a Power Supply” on page 120. Related Information “Inspect the Fan Connector” on page 127 ■ “Inspect the InfiniBand Cable Connectors” on page 134 ■ ▼ Power Off a Power Supply Note –...

  • Page 130: Remove A Power Supply

    1. Identify the prerequisite and subsequent service tasks you must perform in conjunction with this procedure. “Servicing the Power Supplies” on page 113. 2. Locate the power supply to be removed. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 131 3. Press and hold the release tab to the left and pull on the handle of the power supply. 4. Continue to pull the handle of the power supply to remove it from the chassis. 5. Set the power supply aside. Servicing the Switch...

  • Page 132: Install A Power Supply

    6. Orient the power supply with the status LEDs on the left and the release tab on the right. 7. Slide the power supply into the open slot, pushing at the handle. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 133 8. When the power supply seats, push firmly so that the release tab clicks to secure the power supply into the chassis. 9. Power on the power supply. “Power On a Power Supply” on page 122. Servicing the Switch...

  • Page 134: Power On A Power Supply

    1. Identify the prerequisite and subsequent service tasks you must perform in conjunction with this procedure. “Servicing the Power Supplies” on page 113. 2. Reconnect the power cord to the power supply. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 135 The AC LED lights green to indicate the power supply is connected to facility power. A moment later, the OK LED lights green to indicate the power supply is at full power. 3. Verify the power supply’s operation with the checkpower and checkvoltages commands on the management controller.

  • Page 136: Servicing The Infiniband Cables

    “Remove a Fan” on page 127 Related Information “Understanding Service Procedures” on page 111 ■ “Servicing the Power Supplies” on page 113 ■ “Servicing the InfiniBand Cables” on page 132 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 137: Inspecting An Infiniband Cable

    “Servicing the Battery” on page 139 ■ Inspecting a Fan Before installing a fan, inspect its hardware and connector to verify its suitability for installation. Step Description Links Identify the fan. “Identify the Fan” on page 125 Inspect the hardware. “Inspect the Fan Hardware”...

  • Page 138: Inspect The Fan Hardware

    4. Verify that the thumbscrew spins freely and smoothly. 5. Inspect the fan connector. “Inspect the Fan Connector” on page 127. Related Information “Inspect the Power Supply Hardware” on page 116 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 139: Inspect The Fan Connector

    “Inspect the InfiniBand Cable Hardware” on page 133 ■ ▼ Inspect the Fan Connector 1. Identify the prerequisite and subsequent service tasks you must perform in conjunction with this procedure. “Inspecting a Fan” on page 125. 2. Verify that the connector is clean and without damage. 3.
  • Page 140 If a fan has failed, its Attention LED lights. 3. Loosen the captive thumbscrew at the right side of the fan. 4. Grasp the handle and pull the fan straight out. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 141: Install A Fan

    5. Set the fan aside. 6. Consider your next steps: If you are removing the fan for replacement, install a new fan. ■ “Install a Fan” on page 130. If you are removing the fan as a subtractive action, you are finished. ■...
  • Page 142 The fan might immediately power on. 7. Tighten the captive thumbscrew to secure the fan in the switch chassis. 8. Verify that the fan Attention LED goes out. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 143: Servicing The Infiniband Cables

    9. Use the getfanspeed command on the management controller to verify the fan’s operation. For example, to check the fans: # getfanspeed Fan 0 rpm 14270 Fan 1 rpm 14270 Fan 2 rpm 14270 Fan 3 rpm 14270 Fan 4 rpm 14434 Note –...

  • Page 144: Inspecting An Infiniband Cable

    1. Identify the prerequisite and subsequent service tasks you must perform in conjunction with this procedure. “Inspecting an InfiniBand Cable” on page 132. 2. Use the following illustration to identify the various features of the InfiniBand cable. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 145: Inspect The Infiniband Cable Hardware

    InfiniBand Cable Features FIGURE: Figure Legend Retraction strap Paddle boards 3. Inspect the InfiniBand cable hardware. “Inspect the InfiniBand Cable Hardware” on page 133. Related Information “Identify the Power Supply” on page 114 ■ “Identify the Fan” on page 125 ■...

  • Page 146: Inspect The Infiniband Cable Connectors

    1. Identify the prerequisite and subsequent service tasks you must perform in conjunction with this procedure. “Servicing the InfiniBand Cables” on page 132. 2. Loosen the thumbscrews and remove the cover for the cable management bracket. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 147 3. Locate the cable to be removed. 4. Grasp the cable connector to support its weight and apply the removal force. 5. Pull on the loop of the retractor strap while simultaneously pulling on the cable connector. The cable connector comes free. Servicing the Switch...

  • Page 148: Install An Infiniband Cable

    3. Inspect the replacement InfiniBand cable. “Inspecting an InfiniBand Cable” on page 132. 4. Bring the replacement cable to the switch. 5. Feed the cable through the cable management hardware. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 149 6. Orient the cable connector to the CXP receptacle squarely and horizontally. Ensure that the upper shell just touches the underside of the top of the receptacle on the rear panel. 7. Slowly move the connector in. As you slide the connector in, the top of the shell should scrape against the underside of the top of the CXP receptacle.
  • Page 150 11. Replace the cover for the cable management bracket and tighten the thumbscrews. Related Information “Install a Power Supply” on page 120 ■ “Install a Fan” on page 130 ■ “Replace the Battery” on page 140 ■ Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 151: Servicing The Battery

    Servicing the Battery Oracle’s Sun Datacenter InfiniBand Switch 72 has a battery on the main board that supports the management controller. You can only replace the battery because the management controller is dependent upon the battery. You cannot add or subtract the battery.

  • Page 152: Replace The Battery

    2. Use a No. 1 Phillips screwdriver to remove the eight screws that secure the C-shaped brackets at the rear sides of the switch chassis. 3. Remove the eight screws that secure the long front brackets at the front sides of the switch chassis. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 153 4. Remove the 16 screws that secure the top cover to the chassis. There are five screws on each side and six screws across the top front of the cover. 5. Slide the cover forward and lift it off. 6. Lift up slightly on the clip that retains the battery and release the battery from the main board.
  • Page 154 7. Properly dispose of the old battery. 8. Unwrap the replacement battery from its antistatic packaging. 9. Install the replacement battery into the main board with the + side up. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 155 10. Orient the cover over the chassis and lower it in place. 11. Slide the cover rearward so that it engages at the rear panel. Ensure that the screw holes in the cover align with the holes in the chassis. Servicing the Switch...
  • Page 156 12. Use a No. 1 Phillips screwdriver to install the 16 screws that secure the cover to the chassis. 13. Use eight screws to attach the two long front brackets to the front sides of the chassis. Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 157: Upgrading The Firmware

    Upgrading the Firmware Periodically, a newer version of the firmware for management controller or the I4 switch chips might become available. Refer to the Sun Datacenter InfiniBand Switch 72 Product Notes, part number 820-7753, for more information. Servicing the Switch...
  • Page 158 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

  • Page 159: Index

    Index network management, 57 power supply, 58 accessing management controller, 28 link status, 75 network management, 29 port, 99 USB management, 30 port status, 76 acoustic noise power supply, 68 emissions, 3 switch chip boot status, 74 idling, 3 checkpower command, 31, 68, 122 operating, 3 checkvoltages command, 69, 122 administering the switch, 47...
  • Page 160 126 installing, 130 disableswitchport command, 92 LED, 55 disabling removing, 127 port, 102 servicing, 124 Subnet Manager, 107 features switch chip port, 92 fan, 125 discovering the InfiniBand fabric, 42 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 161 InfiniBand cable, 133 InfiniBand cable power supply, 114 attaching, 36 bundling, 12 findport command, 74 cautions, 10 firmware connector, 5 switch, 73 delivery upgrading, 145 floor and underfloor, 13 front status LEDs, 55 overhead, 13 features, 133 handling guidelines, 9, 11 getbaseguid command, 105 inspecting, 132 getfanspeed command, 31, 71...
  • Page 162 LED, 62 power supply to switch chip port, 61 checking monitoring LEDs, 58 hardware, 67 status, 68 InfiniBand fabric, 76 features, 114 inspecting, 114 connectors, 116 network management hardware, 116 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...
  • Page 163 installing, 120 service cables, 7 LEDs, 55 powering off, 117 sequence of installation tasks, 16 on, 122 servicing removing, 118 battery, 139 servicing, 113 fan, 124 powering off InfiniBand cable, 132 power supply, 117 power supply, 113 switch, 117 switch, 111 powering on setlinkspeed command, 91 power supply, 122...
  • Page 164 14 LEDs, 54 service procedures, 111 switch specifications, 1 USB management cable requirements, 8 connector, 5 validating the InfiniBand fabric, 44 verifying InfiniBand fabric, 41 switch status, 31 voltage, 3 Sun Datacenter InfiniBand Switch 72 User’s Guide • May 2010...

This manual is also suitable for:

Datacenter infiniband switch 72

Table of Contents