Table of Contents
Advertisement
InfiniBand Switch Platform Hardware User Manual
4. Check that none of the LEDs on the spines are yellow.
5. Check that the leaf status LEDs, fan status LED, and spine status LED in the spines
are all green.
Status
1 3 5
2 4 6 8 10 12 14 16 18
Status LED
1.8
InfiniBand QSFP Cable Installation
The switch uses industry standard QSFP InfiniBand cables which are available from sev-
eral vendors. The standard QSFP cables support full 40+40Gb/s (QDR), 20+20Gb/s
(DDR) and 10+10Gb/s (SDR) bidirectional wire speed of the switch ports. All Infini-
Band QSFP connections are made to the leaf boards. Each leaf has 18 InfiniBand QSFP
connectors in two rows, which are numbered 1-18. See Section 2.1.6 for port numbering.
All cables can be inserted or removed with the unit powered on. To insert a cable, press
the connector onto the port receptacle until the connector is firmly seated. The orange
LED indicator above the port will light when the physical connection is established
(when both ends of the cable are properly connected to working devices). Allow 15 sec-
onds for link to get up. To remove, disengage the lock and slowly pull the connector
away from the port receptacle.
Mellanox Technologies
It can take up to 5 minutes to boot up the system. Turn off the system if any LEDs
remain red for more than 5 minutes.
The maximum number of connections from each leaf is 2. If the (number of leafs x the
maximum number of connections per leaf) is less than 36 then some of the leaf to spine
connection LEDs may be OFF.
Figure 32: Spine Module
Fan LED
7
9 11
13
15
17
Fan Status
Leaf connection LEDs
If maximum cable lengths are exceeded data transfer will be reduced and the bit error
rate will increase.
For a valid physical connection both ends of the cable must be connected to working
devices.
19 21 23
25
27
29
31
33
35
20
22
24
26
28
30
32
34
36
41
Advertisement
Table of Contents
