Before You Begin; Verify The Firmware Of Infiniband Switch; Gather Port Guids Of Compute Nodes And Bridgex Ports Of Gateway Switches - Oracle Exalogic Elastic Cloud Owner's Manual

Select a list that is preferably near the upper end of the 0x0001–0x7ffe range. For
example, if you identify 0x7000 to 0x7ffe as you range, you can create up to 4096
partitions. We recommend the upper end, because Exalogic Control assigns pkeys
starting from lower end—that is, 0x0001.
In this list (L2), mark or remove the pkeys that were assigned before the rack was
3.
converted to a hybrid configuration—that is, the L1 list you created earlier.
As you create partitions, select pkeys from only the predetermined list (L2) and
4.
keep track of the pkeys that you are assigning.
Such an approach provides a reasonable guarantee that pkeys assigned in the
physical environment are different from the pkeys that Exalogic Control assigns in
the virtual half of the rack.
After the Exalogic machine is converted to a hybrid rack, for every network (either
IPoIB or EoIB) that you create in the virtual half of the hybrid rack, Exalogic Control
automatically assigns a unique pkey, starting from 0x0001. While selecting an unused
pkey for a new partition, Exalogic Control will skip any pkeys (both L1 and L2) that
are used for partitions in the physical half of the configuration. This way, every
partition on the hybrid rack—regardless of whether it is on the physical or virtual part
—will have a unique pkey.

16.3 Before You Begin

Before you can start creating unique InfiniBand partitions, you must complete the
following tasks:
Verify the switch firmware version
1.
Gather the port GUIDs of compute nodes and BridgeX ports of gateway switches
2.
Identify the InfiniBand switches in your Exalogic machine's InfiniBand fabric and
3.
note down their IP addresses
Determine which InfiniBand switch is running the master Subnet Manager (SM)
4.
Log in to the InfiniBand switch that is running the master Subnet Manager (SM)
5.

16.3.1 Verify the Firmware of InfiniBand Switch

Ensure that the InfiniBand switches in your Exalogic machine are installed with
firmware versions 2.0.4 or above. This requirement is mandatory.

16.3.2 Gather Port GUIDs of Compute Nodes and BridgeX Ports of Gateway Switches

Before creating an InfiniBand partition, you must identify the port GUIDs of Exalogic
compute nodes that will be added to the partition. In addition, you must identify the
BridgeX ports of the gateway switches that are connected to those Exalogic compute
nodes.
Identifying Port GUIDs on Compute Nodes
To identify the port GUIDs on an Exalogic compute node, run the following command
on the command line:
# ibstat
This command displays output, as in the following example:
Use InfiniBand Partitions in Exalogic Physical Environments 16-3
Before You Begin