Page 1 Sun Datacenter InﬁniBand Switch 72 Command Reference Part No. 820-7752-12 May 2010, Revision A...
Page 2 Copyright © 2009, 2010 Oracle and/or its afﬁliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means.
Page 5: Table Of Contents
Contents Using This Documentation xv Understanding the Commands 1 Understanding Hardware Commands 1 checkboot Command 2 Syntax 2 Description 2 Example 3 checkpower Command 3 Syntax 3 Description 3 Example 3 checkvoltages Command 4 Syntax 4 Description 4 Example 4 connector Command 5 Syntax 5 Description 5...
Page 6 Command 11 Syntax 11 Description 11 Example 11 getfanspeed Command 12 Syntax 13 Description 13 Example 13 getportstatus Command 13 Syntax 13 Description 14 Example 14 i4reset Command 14 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 7 Syntax 14 Description 14 Example 15 listlinkup Command 15 Syntax 15 Description 15 Example 15 managementreset Command 16 Syntax 16 Description 16 Example 17 nm2version Command 17 Syntax 17 Description 17 Example 18 readchfru Command 18 Syntax 18 Description 19 Example 19 setlinkspeed Command 19 Syntax 19...
Page 8 Syntax 27 Description 28 Options 28 Example 28 ibchecknet Command 29 Syntax 29 Description 29 Options 30 Example 30 ibchecknode Command 31 Syntax 31 Description 31 Options 32 Example 32 viii Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 9 ibcheckport Command 32 Syntax 32 Description 33 Options 33 Example 34 ibcheckportstate Command 34 Syntax 34 Description 34 Options 35 Example 35 ibcheckportwidth Command 35 Syntax 36 Description 36 Options 36 Example 37 ibcheckstate Command 37 Syntax 37 Description 37 Options 38 Example 38 ibcheckwidth Command 39...
Page 10 Description 45 Options 45 Example 46 ibdiagnet Command 46 Syntax 46 Description 47 Options 48 Example 49 ibdiagpath Command 51 Syntax 51 Description 51 Options 52 Example 53 ibhosts Command 54 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 11 Syntax 55 Description 55 Options 55 Example 55 ibnetdiscover Command 56 Syntax 56 Description 56 Options 57 Example 58 ibnodes Command 59 Syntax 59 Description 60 Options 60 Example 60 ibportstate Command 61 Syntax 61 Description 61 Options 62 Example 62 ibroute Command 63 Syntax 63 Description 64...
Page 12 Options 71 Example 72 opensm Command 72 Syntax 72 Description 73 Options 74 Example 77 opensmd Daemon 78 Syntax 78 Description 78 Options 81 Example 82 osmtest Command 82 Syntax 82 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 13 Description 82 Options 83 Example 84 perfquery Command 85 Syntax 85 Description 86 Options 86 Example 87 saquery Command 87 Syntax 88 Description 88 Options 89 Example 90 sminfo Command 90 Syntax 91 Description 91 Options 91 Example 92 smpdump Command 92 Syntax 93 Description 93 Options 93...
Page 14 Index 97 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 15: Using This Documentation
Using This Documentation This command reference provides detailed information regarding the commands for ® administering the Sun Datacenter InfiniBand Switch 72 from Oracle . This document is written for developers, system administrators, and users who have advanced experience administering InfiniBand fabrics and hardware.
Page 16: Documentation Feedback
Submit comments about this document by clicking the Feedback[+] link at (http://docs.sun.com). Include the title and part number of your document with your feedback: Sun Datacenter InfiniBand Switch 72 Command Reference, part number 820-7752-12. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 17: Understanding The Commands
Understanding the Commands This document provides detailed information regarding the commands which are used to administer the switch. “Understanding Hardware Commands” on page 1 ■ “Understanding InfiniBand Commands” on page 23 ■ Related Information Switch User’s Guide ■ Switch Remote Administration ■...
Page 18: Checkboot Command
“Understanding InfiniBand Commands” on page 23 ■ checkboot Command Displays switch chip boot status. Syntax checkboot Description This hardware command checks the boot status of the switch chip. Output is a simplified OK. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 19: Example
Example The following example shows how to check the boot status of the switch chips with the checkboot command. # checkboot I4-A OK I4-B OK I4-C OK I4-D OK I4-E OK I4-F OK Related Information “i4reset Command” on page 14 ■...
Page 20: Checkvoltages Command
Measured VBAT = 3.08 V Measured 1.8V = 1.77 V Measured 1.2V Standby = 1.21 V Measured 1.8V Standby = 1.80 V Measured 2.5VA = 2.51 V Measured 2.5VB = 2.51 V Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 21: Connector Command
Measured 1.2VA = 1.22 V Measured 1.2VB = 1.21 V Measured 1.2VC = 1.21 V Measured 1.2VD = 1.22 V Measured 1.2VE = 1.21 V Measured 1.2VF = 1.21 V All voltages OK Related Information “checkpower Command” on page 3 ■...
Page 22: Options
Manufacturing day. 2-byte ASCII (1st = 01). Options The following table describes the options to the connector command and their purposes: Option Purpose Checks for the presence of connector number present Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 23: Example
Option Purpose Returns the data in register reg. Data values are hexadecimal. read Writes the value of data into the register reg. Data values are converted from write decimal to hexadecimal. Example The following example shows how to write a value of 14 (E in hexadecimal) to register 218 of connector 1A with the connector command.
Page 24: Example
This hardware command disables a port on the switch chip. Example The following example shows how to disable port 1 on switch chip A with the disableswitchport command. # disableswitchport A 1 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 25: Enablesm Command
Related Information “enableswitchport Command” on page 10 ■ “ibportstate Command” on page 61 ■ enablesm Command Enables the Subnet Manager within the management controller. Syntax enablesm Description This hardware command enables the OpenSM opensmd daemon on the management controller. Note – Similarly, both the enablesm and opensm commands invoke an instance of the same Subnet Manager.
Page 26: Enableswitchport Command
The following example shows how to enable port 1 on switch chip A with the enableswitchport command. # enableswitchport A 1 Related Information “disableswitchport Command” on page 8 ■ “ibportstate Command” on page 61 ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 27: Env_Test Command
env_test Command Displays environmental status. Syntax env_test Description This hardware command performs a series of hardware and environmental tests of the switch. This command is an amalgamation of the following commands: ■ checkpower checkvoltages ■ showtemps ■ ■ getfanspeed ■ connector checkboot ■...
Page 28: Getfanspeed Command
Starting I4 test: I4-A OK I4-B OK I4-C OK I4-D OK I4-E OK I4-F OK All I4s OK I4 test returned OK NM2 Environment test PASSED getfanspeed Command Displays fan speed. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 29: Syntax
Syntax getfanspeed Description This hardware command displays the speed of the fans. The command also indicates if the fan is “not present” or has “stopped”. Example The following example shows how to display fan speeds with the getfanspeed command. # getfanspeed Fan 0 rpm 17940 Fan 1 rpm 17940 Fan 2 rpm 17687...
Page 30: Description
“ibcheckportwidth Command” on page 35 ■ i4reset Command Resets the switch chip. Syntax i4reset switch_chip where switch_chip is the letter of the switch chip (A–F). Description This hardware command resets the switch chip. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 31: Example
Example The following example shows how to reset switch chip A with the i4reset command. # i4reset A Reset I4-A Related Information “checkboot Command” on page 2 ■ “ibportstate Command” on page 61 ■ listlinkup Command Displays links presence. Syntax listlinkup Description This hardware command lists the presence of links and the up-down state of the...
Page 32: Managementreset Command
The command requests a reboot, and in most situations, this should be done. The managementreset command also forces links to retrain upon management controller services startup. The -r option bypasses the query for reboot and reboots automatically. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 33: Example
Example The following example shows how to reset the management controller and InfiniBand fabric services with the managementreset command. # managementreset Stopping Environment daemon, please wait Resetting CPLD, please wait Restarting Environment daemon Reboot needed to reconnect to I4 and enable IB ports Do you want do reboot now [yes/no]:yes Broadcast message from root (pts/0) (Fri Nov 20 17:10:27 2009): The system is going down for reboot NOW!
Page 34: Example
In this example, only the output that is bold is relevant to the administration of the switch. Related Information Switch Service, display switch chip firmware version ■ readchfru Command Displays chassis FRU information. Syntax readchfru Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 35: Description
Description This hardware command displays a hexadecimal dump of the contents of the chassis FRU ID registers. Example The following example shows how to display the chassis FRU ID register with the readchfru command. # readchfru Reading from FRU ff 61 67 20 65 72 20 76 65 6c 64 69 67 20 6b 75 6c 0a ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff 11 ff ff ff ff ff ff ff ff ff ff ff ff ff ff ff...
Page 36: Description
“listlinkup Command” on page 15 ■ “ibportstate Command” on page 61 ■ setsmpriority Command Sets the Subnet Manager priority. Syntax setsmpriority priority where priority is a number from 0 (lowest) to 13 (highest). Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 37: Description
Description This hardware command sets the priority of the Subnet Manager within the management controller. You use this command when there are multiple Subnet Managers in the InfiniBand fabric. By setting a Subnet Manager to a higher priority than another Subnet Manager, it becomes the master Subnet Manager. By setting a Subnet Manager to a lower priority than another Subnet Manager, it becomes the slave Subnet Manager.
Page 38: Showtemps Command
I4-B temperature 47 maxtemperature 49 I4-C temperature 52 maxtemperature 52 I4-D temperature 48 maxtemperature 49 I4-E temperature 52 maxtemperature 52 I4-F temperature 52 maxtemperature 54 Related Information “env_test Command” on page 11 ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 39: Showunhealthy Command
showunhealthy Command Displays problematic components. Syntax showunhealthy Description This hardware command shows a list of switch components that appear to have a problem. Unlike the env_test command, the showunhealty command only displays messages for components that have failed testing. Example The following example shows how to display a list of unhealthy components in the switch with the showunhealthy command.
Page 40 -n[src_name,]dst_name|-l[src_lid,]dst_lid|-d p1,p2,p3,...[-c “ibdiagpath Command” on count][-v][-o outputdir][-t topology][-s system][-i device][-p page 51 port][-wt topology][-pm][-pc][-P PM = value][-lw 1x|4x|12x][-ls 2.5|5|10][-skip checks][-load_db file][-h][-V] ibhosts [-h][topology|-C ca_name][-P ca_port][-t timeout] “ibhosts Command” on page 54 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 41 Command Syntax Links “ibnetdiscover ibnetdiscover [-d][-e][-v][-s][-l][-g][-H][-S][-R][-C ca_name][-P ca_port][-t timeout][-V][-p][-h][topology] Command” on page 56 ibnodes [-h][topology|-C ca_name][-P ca_port][-t timeout] “ibnodes Command” on page 59 ibportstate [-d][-D][-e][-G][-h][-s smlid][-v][-C ca_name][-P “ibportstate Command” ca_port][-t timeout] lid|dr_path|guid port [op] on page 61 ibroute [-d][-a][-n][-D][-e][-G][-h][-M][-s smlid][-v][-V][-C “ibroute Command”...
Page 42: Ibaddr Command
Purpose Sets the debug level. Can be used several times to increase the debug level. Uses the directed path address. The path is a comma delimited sequence of out ports. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 43: Example
Option Purpose Shows the LID range and GID for port GUID addresses. Shows the LID range only. Shows the GID address only. Uses the specified channel adapter name. Uses the specified channel adapter port. Overrides the default timeout. Displays the version information. Provides help.
Page 44: Description
(threshold 100) lid 25 port 9 Error check on lid 25 (Sun DCS 72 QDR FC switch o4nm2-72p-2) port 9: FAILED #warn: counter XmtDiscards = 9714 (threshold 100) lid 25 port 1 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 45: Ibchecknet Command
Error check on lid 25 (Sun DCS 72 QDR FC switch o4nm2-72p-2) port 1: FAILED ## Summary: 6 nodes checked, 0 bad nodes found 142 ports checked, 3 ports have errors beyond threshold Note – The output in the example is just a portion of the full output. Related Information ibcheckerrors man page ■...
Page 46: Options
## Summary: 6 nodes checked, 0 bad nodes found 142 ports checked, 0 bad ports found 3 ports have errors beyond threshold Note – The output in the example is just a portion of the full output. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 47: Ibchecknode Command
Related Information ibchecknet man page ■ “ibcheckerrors Command” on page 27 ■ “ibchecknode Command” on page 31 ■ “ibcheckport Command” on page 32 ■ “ibnetdiscover Command” on page 56 ■ ibchecknode Command Validates InfiniBand nodes and reports errors. Syntax ibchecknode -v [-h][-N][-G][-C ca_name][-P ca_port][-t timeout] [lid|dr_path|guid] where: ca_name is the channel adapter name.
Page 48: Options
■ “ibaddr Command” on page 26 ■ “smpquery Command” on page 94 ■ ibcheckport Command Validates InfiniBand ports and reports errors. Syntax ibcheckport [-h][-v][-N][-G][-C ca_name][-P ca_port][-t timeout] lid|guid port where: Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 49: Description
ca_name is the channel adapter name. ■ ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■ lid is the local identifier. ■ guid is the global unit identifier. ■ port is the port being validated. ■...
Page 50: Example
■ port is the port being validated. ■ Description This InfiniBand command checks the specified port for the logical (Active) and physical (LinkUp) states. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 51: Options
Note – The port address is a LID, unless the -G option is used to specify a GUID address. Options The following table describes the options to the ibcheckportstate command and their purposes: Option Purpose Uses the port GUID address. Provides help.
Page 52: Syntax
Uses the port GUID address. Provides help. Uses mono mode instead of color mode. Uses the specified channel adapter name. Uses the specified channel adapter port. Overrides the default timeout. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 53: Example
Example The following example shows how to check the width of port 8 on LID 24 with the ibcheckportwidth command. # ibcheckportwidth -v 24 8 Port check lid 24 port 8: Related Information ibcheckportwidth man page ■ “getportstatus Command” on page 13 ■...
Page 54: Options
142 ports checked, 0 ports with bad state found Note – The output in the example is just a portion of the full output. Related Information ibcheckstate man page ■ “ibchecknode Command” on page 31 ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 55: Ibcheckwidth Command
“ibcheckportstate Command” on page 34 ■ “ibnetdiscover Command” on page 56 ■ ibcheckwidth Command Finds 1x (or wider) links in the InfiniBand fabric. Syntax ibcheckwidth [-h][-N][-v][topology|-C ca_name][-P ca_port][-t timeout] where: topology is the topology file. ■ ca_name is the channel adapter name. ■...
Page 56: Example
■ ibclearcounters Command Clears port counters in the InfiniBand fabric. Syntax ibclearcounters [-h][topology|-C ca_name][-P ca_port][-t timeout] where: topology is the topology file. ■ ca_name is the channel adapter name. ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 57: Description
ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■ Description This InfiniBand command is a script that clears the Performance Manager agent port counters by either discovering the InfiniBand fabric topology or using an existing topology file.
Page 58: Ibclearerrors Command
The following table describes the options to the ibclearerrors command and their purposes: Option Purpose Provides help. Uses mono mode instead of color mode. Uses the specified channel adapter name. Uses the specified channel adapter port. Overrides the default timeout. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 59: Example
Example The following example shows how to clear all error counters with the ibclearerrors command. # ibclearerrors ## Summary: 6 nodes cleared 0 errors Related Information ibclearerrors man page ■ “ibnetdiscover Command” on page 56 ■ “perfquery Command” on page 85 ■...
Page 60: Options
Note – You might see more output than what is in the example. Related Information ibdatacounters man page ■ “ibdatacounts Command” on page 45 ■ “ibnetdiscover Command” on page 56 ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 61: Ibdatacounts Command
ibdatacounts Command Displays InfiniBand fabric port data counters. Syntax ibdatacounts [-b][-G][-h][-N][-v][-C ca_name][-P ca_port][-t timeout] lid|guid port where: ca_name is the channel adapter name. ■ ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■ lid is the local identifier. ■...
Page 62: Example
[-c count][-v][-r][-o outputdir][-t topology][-s system][-i device][-p port][-wt topology][-pm][-pc][-P PM = value][-lw 1x|4x|12x][-ls 2.5|5|10][-skip checks][-load_db file][-h][-V] where: count is the number of packets. ■ outputdir is the output directory. ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 63: Description
topology is the topology file. ■ system is the local system name. ■ device is the index of the device connecting to the InfiniBand fabric. ■ port is the port of the device. ■ PM is the Performance Manager counter number. ■...
Page 64: Options
Options The following table describes the options to the ibdiagnet command and their purposes: Option Purpose Sets the minimum number of packets sent across each link. Provides verbose output. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 65: Example
Option Purpose Provides a report of fabric qualities. Specifies the topology file name. Specifies the local system name. In the case of multiple devices on the local system, this option specifies the index of the device of the port used to connect to the InfiniBand fabric. Specifies the local device port number used to connect to the InfiniBand fabric.
Page 66 Performance Counters Report Specific Link Width Check Specific Link Speed Check Partitions Check IPoIB Subnets Check Please see /tmp/ibdiagnet.log for complete log ---------------------------------------------------------------- -I- Done. Run time was 68 seconds. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 67: Ibdiagpath Command
Related Information ibdiagnet man page ■ “ibdiagpath Command” on page 51 ■ ibdiagpath Command Traces the InfiniBand fabric diagnostic path. Syntax ibdiagpath -n[src_name,]dst_name|-l[src_lid,]dst_lid|-d p1,p2,p3,...[-c count][-v][-o outputdir][-t topology][-s system][-i device][-p port][-wt topology][-pm][-pc][-P PM = value][-lw 1x|4x|12x][-ls 2.5|5|10][-h][-V] where: src_name is the source port. ■...
Page 68: Options
In the case of multiple devices on the local system, this option specifies the index of the device of the port used to connect to the InfiniBand fabric. Specifies the local device port number used to connect to the InfiniBand fabric. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 69: Example
Option Purpose Specifies the output directory. Specifies the expected link width. Specifies the expected link speed. Dumps all the fabric link Performance Manager counters into ibdiagpath.pm. Resets all the fabric link Performance Manager counters. Use the Performance Manager counter of PM set to the threshold of value. Provides help.
Page 70: Ibhosts Command
Please see /tmp/ibdiagpath.log for complete log ---------------------------------------------------------------- -I- Done. Run time was 0 seconds. Related Information ibdiagpath man page ■ “ibdiagnet Command” on page 46 ■ ibhosts Command Displays host nodes. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 71: Syntax
Syntax ibhosts [-h][topology|-C ca_name][-P ca_port][-t timeout] where: topology is the topology file. ■ ca_name is the channel adapter name. ■ ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■ Description This InfiniBand command is a script that discovers the InfiniBand fabric topology or uses the existing topology file to extract the channel adapter nodes.
Page 72: Ibnetdiscover Command
Nodes, node types, node descriptions, links, port numbers, port LIDs, and GUIDs are displayed. The output is directed to a topology file, if the file name is specified. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 73: Options
The output of the topology file follows this basic format for each node: vendid=vendor_ID_in_hex devid=device _ID_in_hex sysimgguid=GUID_in_hex and/or switchguid=GUID_in_hex(portGUID_in_hex) Switch ports_total "type-nodeGUID_in_hex" # "NodeDescription" base port 0 lid LID lmc 0 caguid=GUID_in_hex Ca ports_total "type-nodeGUID_in_hex" # "NodeDescription" [port] "type-nodeGUID_in_hex"[port](portGUID_in_hex) # "NodeDescription" lid LID widthspeed [port] "type-nodeGUID_in_hex"[port](portGUID_in_hex) # "NodeDescription"...
Page 74: Example
0 lid 25 lmc 0 [36] "S-0021283a8620b0d0"[4] # "Sun DCS 72 QDR switch 1.2(LC)" lid 23 4xQDR [35] "S-0021283a8620b0b0"[5] # "Sun DCS 72 QDR switch 1.2(LC)" lid 21 4xQDR Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 75: Ibnodes Command
[34] "S-0021283a8620b0d0"[6] # "Sun DCS 72 QDR switch 1.2(LC)" lid 23 4xQDR vendid=0x2c9 devid=0x673c sysimgguid=0x21283a8620b0e3 switchguid=0x21283a8620b0e0(21283a8620b0e0) Switch 36 "S-0021283a8620b0e0" # "Sun DCS 72 QDR switch 1.1(FC)" base port 0 lid 24 lmc 0 [22] "S-0021283a8620b0c0"[18] # "Sun DCS 72 QDR switch 1.2(LC)" lid 22 4xQDR [24] "S-0021283a8620b0c0"[16] # "Sun DCS 72 QDR switch 1.2(LC)"...
Page 76: Description
: 0x0021283a8620b0c0 ports 36 "Sun DCS 72 QDR switch 1.2(LC)" base port 0 lid 22 lmc 0 Note – The output in the example is just a portion of the full output. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 77: Ibportstate Command
Related Information ibnodes man page ■ “ibnetdiscover Command” on page 56 ■ ibportstate Command Manages the state and link speed of an InfiniBand port. Syntax ibportstate [-d][-D][-e][-G][-h][-s smlid][-v][-C ca_name][-P ca_port][-t timeout] lid|dr_path|guid port [op] where: smlid is the Subnet Manager LID. ■...
Page 78: Options
8 with the ibportstate command. # ibportstate 24 8 PortInfo: # Port info: Lid 24 port 8 LinkState:.......Active PhysLinkState:....LinkUp LinkWidthSupported:....1X or 4X LinkWidthEnabled:....1X or 4X LinkWidthActive:....4X LinkSpeedSupported:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 79: Ibroute Command
LinkSpeedEnabled:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedActive:....10.0 Gbps Peer PortInfo: # Port info: Lid 24 DR path slid 25; dlid 65535; 0,8 port 2 LinkState:.......Active PhysLinkState:....LinkUp LinkWidthSupported:....1X or 4X LinkWidthEnabled:....1X or 4X LinkWidthActive:....4X LinkSpeedSupported:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedEnabled:....2.5 Gbps or 5.0 Gbps or 10.0 Gbps LinkSpeedActive:....10.0 Gbps Related Information...
Page 80: Description
Uses smlid as the target LID for Subnet Manager or Subnet Administrator queries. Provides verbose output. Displays the version information. Uses the specified channel adapter name. Uses the specified channel adapter port. Overrides the default timeout. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 81: Example
Example The following example shows how to display the forwarding table for LID 24 with the ibroute command. # ibroute 24 Unicast lids [0x0-0x19] of switch Lid 24 guid 0x0021283a8620b0e0 (Sun DCS 72 QDR switch 1.1(FC)): Destination Port Info 0x0014 001 : (Switch portguid 0x0021283a8620b0a0: ’Sun DCS 72 QDR switch 1.2(LC)’) 0x0015 011 : (Switch portguid 0x0021283a8620b0b0: ’Sun DCS 72 QDR switch 1.2(LC)’)
Page 82: Description
Infiniband device ’is4_0’ port 0 status: default gid: fe80:0000:0000:0000:0021:283a:8620:b0f0 base lid: 0x19 sm lid: 0x19 state: 4: ACTIVE phys state: 5: LinkUp rate: 40 Gb/sec (4X QDR) Related Information ibstatus man page ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 83: Ibswitches Command
ibswitches Command Displays InfiniBand switch node in the topology. Syntax ibswitches [-h][topology|-C ca_name][-P ca_port][-t timeout] where: topology is the topology file. ■ ca_name is the channel adapter name. ■ ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■...
Page 84: Example
“ibnetdiscover Command” on page 56 ■ “ibnodes Command” on page 59 ■ ibsysstat Command Displays system status of an InfiniBand address. Syntax ibsysstat [-d][-e][-G][-h][-s smlid][-v][-V][-C ca_name][-P ca_port][-t timeout][-o oui][-S] lid|guid [op] Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 85: Description
where: smlid is the Subnet Manager LID. ■ topology is the topology file. ■ ca_name is the channel adapter name. ■ ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■ oui is the OUI number. ■...
Page 86: Example
2: model AMD Opteron(tm) Processor 848 MHZ 2189.680 cpu 3: model AMD Opteron(tm) Processor 848 MHZ 2189.680 Related Information ibsysstat man page ■ ibtracert Command Traces the InfiniBand path. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 87: Syntax
Syntax ibtracert [-d][-D][-G][-h][-m mlid][-s smlid][-v][-V][-C ca_name][-P ca_port][-t timeout][lid|dr_path|guid [startlid [endlid]]] where: mlid is the multicast LID. ■ smlid is the Subnet Manager LID. ■ ca_name is the channel adapter name. ■ ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■...
Page 88: Example
■ opensm Command Runs the InfiniBand Subnet Manager and Subnet Administrator. Syntax opensm [-F filename][-c filename][-g guid][-l lmc][-p priority][-smkey SMKey][-r][-R engine][-A][-z][-M filename][-U filename][-S filename][-a path][-u path][-X path][-m path][-o][-s interval][-t timeout][-maxsmps Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 89: Description
number][-console[off|local|socket|loopback]][-console-port port] [-i filename][-f path][-L size][-e][-P filename][-N][-Q[-Y filename]] [-y][-B][-I][-v][-V][-D flags][-dopt][-h] where: filename is the path and file for the respective option. ■ guid is the global unit identifier. ■ lmc is the LMC. ■ priority is the priority of the instance, 0 (low)–13 (high). ■...
Page 90: Options
Reassigns LIDs to all end nodes. By default, OpenSM attempts to preserve existing LID assignments while resolving multiple use of the same LID. Note - Use of the -r option might disrupt fabric traffic. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 91 Option Purpose Selects the routing algorithm to use. Multiple algorithms can be specified in the order of use upon failure. The list is comma delimited. Algorithms supported are: • minhop – Min Hop. This default algorithm routes through the minimum number of hops with an optimized path.
Page 92 0 through 15. Prevents OpenSM from exiting upon fatal initialization issues. For example, duplicate GUIDS or 12x links with poorly configured lane reversal. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 93: Example
Option Purpose Runs OpenSM in the background as a daemon. Starts OpenSM in an inactive state. Increases the log verbosity. Sets log verbosity to maximum. The same as -D 0xFF. Sets the log verbosity according to the following bit flags: •...
Page 94: Opensmd Daemon
LMC lmc_esp0 FALSE value is used for enhanced switch port 0. If TRUE, LMC value for subnet is used for ESP0. Otherwise, LMC value for ESP0s is 0. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 95 Parameter Description Default Value Maximum time a packet can live in a packet_life_time 0x12 switch. Actual time is 4.096 usec * 2^packet_life_time. A value of 0x14 disables the mechanism. Number of sequential packets dropped vl_stall_count 0x07 that cause the port to enter the VLStalled state.
Page 96 Use a single thread for handling Subnet single_thread FALSE Administrator queries. Daemon mode. daemon FALSE Deactivate the Subnet Manager. sm_inactive FALSE Babbling Port Policy. babbling_port_policy FALSE Log flags used. log_flags 0x03 Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 97: Options
Parameter Description Default Value Force flush of the log file after each log force_log_flush FALSE message. Log file to be used. log_file /var/log/opensm.log Maximum size of the log file in MB. If log_max_size overrun, log is restarted. If TRUE, accumulates the log over accum_log_file TRUE multiple OpenSM sessions.
Page 98: Example
OpenSM, you can create the inventory file with the -f c option. At a later time, you can run osmtest -f v to identify where there have been changes. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 99: Options
The osmtest command conducts the following tests: Multicast compliancy test ■ Event forwarding test ■ Service record registration test ■ RMPP stress test ■ Small Subnet Administrator queries test ■ Options The following table describes the options to the osmtest command and their purposes: Option Purpose...
Page 100: Example
Aug 13 23:00:48 920209 [B7E7B6C0] 0x02 -> osm_vendor_init: 1000 pending umads specified using default guid 0x21283a8620b0f0 Aug 13 23:00:48 930634 [B7E7B6C0] 0x02 -> osm_vendor_bind: Binding to port 0x21283a8620b0f0 Aug 13 23:00:48 957644 [B7E7B6C0] 0x02 -> osmtest_validate_sa_class_port_info: Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 101: Perfquery Command
----------------------------- SA Class Port Info: base_ver:1 class_ver:2 cap_mask:0x2602 cap_mask2:0x0 resp_time_val:0x10 ----------------------------- Aug 13 23:00:48 962010 [B7E7B6C0] 0x01 -> osmtest_validate_node_data: Checking node 0x0021283a8620b0a0, LID 0x14 Aug 13 23:00:48 962226 [B7E7B6C0] 0x01 -> osmtest_validate_node_data: Checking node 0x0021283a8620b0b0, LID 0x15 Aug 13 23:01:03 083751 [B7E7B6C0] 0x02 -> osmt_delete_service_by_name: Trying to Delete service name: osmt.srvc.719885380.7487 Aug 13 23:01:03 084267 [B7E7B6C0] 0x02 ->...
Page 102: Description
Uses the port GUID address. Provides help. Loops through all ports. Resets the counters after reading. Resets counters only. Provides verbose output. Displays the version information. Uses the specified channel adapter name. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 103: Example
Option Purpose Uses the specified channel adapter port. Overrides the default timeout. Example The following example shows how to display all port counters for LID 24, port 8 with the perfquery command. # perfquery 24 8 # Port counters: Lid 24 port 8 PortSelect:......8 CounterSelect:....0x1b01 SymbolErrors:....0...
Page 104: Syntax
InformInfoRecord [[from_lid]/[from_port]] [[to_lid]/[to_port]] LinkRecord ServiceRecord PathRecord MCMemberRecord MCMR [[lid]/[block]] LFTRecord LFTR [[mlid]/[position]/[block]] MFTRecord MFTR Description This InfiniBand command performs the selected Subnet Administrator query. Node records are queried by default. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 105: Options
Options The following table describes the options to the saquery command and their purposes: Option Purpose Provides help. Sets the debug level. Can be used several times to increase the debug level. Displays the PathRecord information. Displays the NodeRecord information. Displays the NodeDescriptions of channel adapters only.
Page 106: Example
Note – The output in the example is just a portion of the full output. Related Information saquery man page ■ sminfo Command Queries the InfiniBand SMInfo attribute. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 107: Syntax
Syntax sminfo [-d][-e] -s state -p priority -a activity [-D][-G][-h][-V][-C ca_name][-P ca_port][-t timeout] smlid|smdr_path where: state is the state for the Subnet Manager. ■ priority is the priority. ■ activity is the activity count. ■ ca_name is the channel adapter name. ■...
Page 108: Example
25 sm guid 0x21283a8620b0f0, activity count 25950 priority 13 state 3 SMINFO_MASTER Related Information sminfo man page ■ “smpdump Command” on page 92 ■ smpdump Command Dumps the InfiniBand fabric management attributes. Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 109: Syntax
Syntax smpdump [-s][-D][-h][-V][-C ca_name][-P ca_port][-t timeout] lid|dr_path attr [mod] where: ca_name is the channel adapter name. ■ ca_port is the channel adapter port. ■ timeout is the timeout in milliseconds. ■ lid is the local identifier. ■ dr_path is the directed path. ■...
Page 110: Example
■ lid is the local identifier. ■ dr_path is the directed path. ■ guid is the global unit identifier. ■ params is the parameter of the operation. ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 111: Description
Description This InfiniBand command permits a subset of the standard SMP queries, including the following: Node information ■ Node description ■ Switch information ■ Port information ■ Output is in human-readable format. Supported operations and parameters are as follows: nodeinfo addr ■...
Page 112: Example
BaseVers:......1 ClassVers:.......1 NodeType:......Switch NumPorts:......36 SystemGuid:......0x0021283a8620b0e3 Guid:......0x0021283a8620b0e0 PortGuid:......0x0021283a8620b0e0 PartCap:......8 DevId:......0xbd36 Revision:......0x000000a0 LocalPort:.......1 VendorId:......0x0002c9 Related Information smpquery man page ■ “saquery Command” on page 87 ■ “smpdump Command” on page 92 ■ Sun Datacenter InfiniBand Switch 72 Command Reference • May 2010...
Page 113 Index ibdatacounters, 43 ibdatacounts, 45 checkboot command, 2 ibdiagnet, 46 checkpower command, 3 ibdiagpath, 51 checkvoltages command, 4 ibhosts, 54 command ibnetdiscover, 56 hardware, 1 ibnodes, 59 checkboot, 2 ibportstate, 61 checkpower, 3 ibroute, 63 checkvoltages, 4 ibstatus, 65 connector, 5 ibswitches, 67 disablesm, 7 ibsysstat, 68...
Page 114 hardware opensm command, 72 commands, 1 options, 74 support ﬁles, 73 opensm parameters, 9, 78 i4reset command, 14 opensmd daemon, 78 ibaddr command, 26 osmtest command, 82 ibcheckerrors command, 27 ibchecknet command, 29 perfquery command, 85 ibchecknode command, 31 ibcheckport command, 32 ibcheckportstate command, 34 readchfru command, 18 ibcheckportwidth command, 35...

Sun Oracle Datacenter InfiniBand Switch 72 Command Reference Manual

Using this Documentation

Understanding the Commands

Quick Links

Need help?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Sun Oracle Datacenter InfiniBand Switch 72

Summary of Contents for Sun Oracle Datacenter InfiniBand Switch 72

Table of Contents