Discover The Infiniband Network Topology In A Multirack Configuration; Perform Diagnostics On The Infiniband Fabric In A Multirack Configuration - Oracle Exalogic Elastic Cloud Owner's Manual

Verify the InfiniBand Fabric in a Multirack Configuration
Performs diagnostics upon the InfiniBand fabric and reports status. See
Diagnostics on the InfiniBand Fabric in a Multirack
3. ibcheckerrors
Checks the entire InfiniBand fabric for errors. See
InfiniBand Fabric in a Multirack

14.6.1 Discover the InfiniBand Network Topology in a Multirack Configuration

To discover the InfiniBand network topology and build a topology file which is used
by the OpenSM Subnet Manager, run the following command on the command-line
interface (CLI) of the spine switch:
# ibnetdiscover
The output is displayed, as in the following example:
The topology file is used by InfiniBand commands to scan the InfiniBand fabric and
validate the connectivity as described in the topology file, and to report errors as
indicated by the port counters.
# Topology file: generated on Sat Apr 13 22:28:55 2002
#
# Max of 1 hops discovered
# Initiated from node 0021283a8389a0a0 port 0021283a8389a0a0
vendid=0x2c9
devid=0xbd36
sysimgguid=0x21283a8389a0a3
switchguid=0x21283a8389a0a0(21283a8389a0a0)
Switch
lid 15 lmc 0
[23]
vendid=0x2c9
devid=0x673c
sysimgguid=0x3ba000100e38b
caguid=0x3ba000100e388
Ca 2 "H-0003ba000100e388" # "nsn33-43 HCA-1"
[2](3ba000100e38a)
localhost" lid 15 4xQDR

14.6.2 Perform Diagnostics on the InfiniBand Fabric in a Multirack Configuration

To perform a collection of tests on the InfiniBand fabric and generate several files that
contain parameters and aspects of the InfiniBand fabric, run the following command
on the command-line interface (CLI) of the spine switch:
# ibdiagnet
In the following example, the ibdiagnet command is minimized to determine which
links are underperforming:
# ibdiagnet -lw 4x -ls 10 -skip all
Loading IBDIAGNET from: /usr/lib/ibdiagnet1.2
14-6 Oracle Exalogic Elastic Cloud Machine Owner's Guide
36 "S-0021283a8389a0a0" # "Sun DCS 36 QDR switch localhost" enhanced port 0
"H-0003ba000100e388"[2](3ba000100e38a) # "nsn33-43 HCA-1" lid 14 4xQDR
"S-0021283a8389a0a0"[23] # lid 14 lmc 0 "Sun DCS 36 QDR switch
Note:
The actual output for your InfiniBand fabric will differ from that in the
example.
Configuration.
Check for Errors in the
Configuration.
Perform