Oracle Exalogic Elastic Cloud Owner's Manual page 153

net4 Infiniband
net5 Infiniband
Open a second terminal and log in as root to the switch net5 is connected to
4.
(el01sw-ib02 for this example).
Run the showvlan command to verify that the VLAN 0 is associated with the
default partition and that the VLAN ID is created on the correct IB partition. The
following example displays the output from this command showing that the VLAN
ID is 3066 and it's associated to the correct IB partition:
[root@el01sw-ib02 ~]# showvlan
Connector/LAG VLN
------------- ---
0A-ETH-1 0
0A-ETH-1 3066 0x8206
Repeat the previous step on the switch net4 is connected to (el01sw-ib03 for this
5.
example).
From the compute node session, use the dladm command to verify that the
6.
compute node GUIDs are included in the IB partition that the VLAN 3066 is using.
See the following extract of the command output for net4 and net5:
root@el01cn16:~# dladm show-ib net4
LINK HCAGUID PORTGUID
net4 2128000... 21280001EFF369 1
root@el01cn16:~# dladm show-ib net5
LINK HCAGUID PORTGUID
net5 2128000... 21280001EFF36A 2
Make a note of the data that the command displays in the PORTGUID column for
both IB datalinks.
Run the commands iblinkinfo, ibswitches, and ibstat to determine the
7.
mapping among the IB HCA ports, IB datalinks and IB switches. See the following
section of the first command output:
root@el01cn16:~# iblinkinfo|grep cn16
. . .
14 33[ ] ==(...)==> 72
15 33[ ] ==(...)==> 71
The output of the command displays a pair of value sets:
• switch lid 14, base lid 72, port 2
• switch lid 15, base lid 71, port 1
The following is an extract of the second command:
root@el01cn16:~# ibswitches
. . .
Switch : 0x0010e00b4520c0a0 ports 36 "SUN IB QDR GW switch el01sw-ib02
Set Up Ethernet Over InfiniBand (EoIB) on Oracle Solaris
up
up
PKEY
------
0xffff
PORT STATE GWNAME
up el01sw-ib02 0a-eth-1 7FFF,8206,FFFF
el01sw-ib02 0a-eth-2
el01sw-ib02 0a-eth-3
. . .
PORT STATE GWNAME
up el01sw-ib02 0a-eth-1 7FFF,8206,FFFF
el01sw-ib02 0a-eth-2
el01sw-ib02 0a-eth-3
. . .
2[ ] "el01cn16 EL-C 192.168.10.16 HCA-1" ( )
1[ ] "el01cn16 EL-C 192.168.10.16 HCA-1" ( )
Configure Ethernet Over InfiniBand 10-13
32000 unknown ibp0
32000 unknown ibp1
GWPORT PKEYS
GWPORT PKEYS