D.9 Infiniband Wiring Table For Two Or Three C7000 Enclosures With Single-Density Blades And An External Infiniband Switch - HP Cluster Platform Express v2010 Overview

From
Enclosure 1
Interconnect
Module 5/6 Port 8
D.9 InfiniBand Wiring Table for Two or Three c7000 Enclosures with
Single-Density Blades and an External InfiniBand Switch
Configurations of three enclosures require an external InfiniBand switch. The wiring for two
enclosures can be derived from the three enclosure wiring tables by omitting the wiring for
Enclosure 3. The connection to Port 8 on the external InfiniBand switch (IB-SW1) depends on
whether the configuration includes an external control node connected to the InfiniBand fabric
or not. If there is a control node connected to the InfiniBand fabric, the control node's HCA is
connected to that port. If the control node is not connected to Port 8 of the InfiniBand switch,
connect Port 8 to the InfiniBand switch installed in Interconnect Module Bay 5/6 in Enclosure 1.
From
IB 24 Port Switch
Port 1
IB 24 Port Switch
Port 2
IB 24 Port Switch
Port 3
IB 24 Port Switch
Port 4
IB 24 Port Switch
Port 5
IB 24 Port Switch
Port 6
IB 24 Port Switch
Port 7
IB 24 Port Switch
Port 8
IB 24 Port Switch
Port 9
IB 24 Port Switch
Port 10
IB 24 Port Switch
Port 11
IB 24 Port Switch
Port 12
IB 24 Port Switch
Port 13
D.9 InfiniBand Wiring Table for Two or Three c7000 Enclosures with Single-Density Blades and an External InfiniBand
Label To
Enclosure 2 Interconnect
Module 5/6 Port 8
E1-IMB5-P8
Control node InfiniBand
HCA
Label To
Enclosure 1 Interconnect
IB-SW1-P1 Module 5/6 Port 1
Enclosure 1 Interconnect
IB-SW1-P2 Module 5/6 Port 2
Enclosure 1 Interconnect
IB-SW1-P3 Module 5/6 Port 3
Enclosure 1 Interconnect
IB-SW1-P4 Module 5/6 Port 4
Enclosure 1 Interconnect
IB-SW1-P5 Module 5/6 Port 5
Enclosure 1 Interconnect
IB-SW1-P6 Module 5/6 Port 6
Enclosure 1 Interconnect
IB-SW1-P7 Module 5/6 Port 7
Enclosure 1 Interconnect
Module 5/6 Port 8
IB-SW1-P8
Control node Infiniband
HCA
Enclosure 2 Interconnect
IB-SW1-P9 Module 5/6 Port 1
Enclosure 2 Interconnect
IB-SW1-P10 Module 5/6 Port 2
Enclosure 2 Interconnect
IB-SW1-P11 Module 5/6 Port 3
Enclosure 2 Interconnect
IB-SW1-P12 Module 5/6 Port 4
Enclosure 2 Interconnect
IB-SW1-P13 Module 5/6 Port 5
Label Comments
Used if there is no rack-mount
control node connected to the
E2-IMB5-P8 InfiniBand fabric
Only used if the control node is a
Control-P1 rack-mountable server connected
to the InfiniBand switch
Label Comments
E1-IMB5-P1
E1-IMB5-P2
E1-IMB5-P3
E1-IMB5-P4
E1-IMB5-P5
E1-IMB5-P6
E1-IMB5-P7
Used if there is no rack-mount
control node connected to the
E1-IMB5-P8 InfiniBand fabric
Used only if the control node is a
Control-P1 rack-mount server connected to
the InfiniBand fabric
E2-IMB5-P1
E2-IMB5-P2
E2-IMB5-P3
E2-IMB5-P4
E2-IMB5-P5
89
Switch