Qlogic Fast Fabric User Manual page 170

D – Multi-Subnet Fabrics
Primarily Independent Subnets
typically with different IP subnets. Consult the QuickSilver Fabric Access Software
Users Guide for more information on configuring IPoIB.
NOTE:
"Installing and Verifying Firmware on the SilverStorm IB Chassis" on page 3-6 can
be performed as per the instructions. When creating the chassis file, list all
SilverStorm 9000 series internally-managed IB switches in all subnets. If desired,
additional files may also be created per subnet that list only the SilverStorm chassis
in each subnet.
"Installing and Configuring the Subnet Manager" on page 3-9 can be performed as
per the instructions. At least one subnet manager is required per IB subnet. Consult
the QuickSilver Fabric Manager and Fabric Viewer Users Guide for more information
on how to configure a host SM node to manage more than one IB subnet.
"Installing and Verifying Firmware on the IB Switches" on page 3-10. At this time
this operation is not supported for IB management nodes connected to more than
one IB subnet.
"Installing InfiniBand on the Remaining Servers" on page 3-12 can be performed
as per the instructions. When creating the hosts file, list all of the hosts in all
subnets except the IB management node where Fast Fabric is being run. If desired,
additional files may also be created per subnet that list the hosts in each subnet
(except the IB management node).
"Verifying InfiniBand on the Remaining Servers" on page 3-16 has the following
adjustments from the instructons.
(All): Create the allhosts file per the instructions. Next, create additional files
❥
per subnet that list all the hosts in each subnet including the IB management
node.
(All): "Verify Hosts via Ethernet ping" on page 4-4 can be performed per the
❥
instructions.
(All): "Summary of Fabric Components" on page 4-9 is not presently supported
❥
for IB management nodes connected to multiple fabrics. Instead manually run:
iba_report -d 0 -h x -p y
where x and y specify the applicable HCA and port to select the desired subnet.
Repeat for each subnet.
(Host): "Show Status of Host IB Ports" on page 4-9 may be run per the
❥
instructions.
D-2
When managing a cluster where compute nodes are not running the
QuickSilver host stack or where the IPoIB settings on the compute nodes
are incompatible with the IB Management node (e.g., when a 4K MTU is
used on the compute nodes), it is recommended not to run IPoIB on the
IB management node(s).
Q
D000006-000 Rev A