Table of Contents
Advertisement
InfiniBand FDR Switch Platform Hardware User Manual
3. Check the Status LEDs on all of the management modules and confirm that all of the
LEDs show status lights consistent with normal operation.
4. Check that none of the LEDs on the spines are yellow.
5. Check that the leaf status LEDs, fan status LED, and spine status LED in the spines
are all green.
!
1
3
5
!
UID
2
4
6
Status, Fan, Bad Port and UID LEDs
1.9
InfiniBand QSFP Cable Installation
The switch uses industry standard QSFP InfiniBand cables which are available from
Mellanox Technologies. The Mellanox proprietary QSFP cables support full 56+56Gb/s
(FDR), 40+40Gb/s (FDR10), 40+40Gb/s (QDR), 20+20Gb/s (DDR) and 10+10Gb/s
(SDR) bidirectional wire speed of the switch ports. All InfiniBand QSFP connections are
made to the leaf boards. Each leaf has 18 InfiniBand QSFP connectors in two rows,
which are numbered 1-18. See Section 2.1.6 for port numbering.
Mellanox Technologies
Any yellow or red status LEDs on any of the management modules is cause for con-
cern and must be dealt with immediately.
It can take up to 5 minutes to boot up the system. Turn off the system if any LEDs
remain red for more than 5 minutes.
The maximum number of connections from each leaf is 6 If the (number of leafs x the
maximum number of connections per leaf) is less than 36 then some of the leaf to spine
connection LEDs may be OFF.
Figure 24: Spine Module
7
9
11
13
15 17
8
10
12
14
16
18
Leaf connection LEDs
If maximum cable lengths are exceeded data transfer will be reduced and the bit error
rate will increase.
To raise link at FDR (56Gb/s) with 3rd party FDR cables, managed switch systems
must be programmed with management software MLNX-OS 3.3.4304 or higher, and
unmanaged switch systems need SwitchX firmware version 9.2.6000 or higher.
19
21 23 25
27
29 31
33
35
20 22
24
26
28
30
32
34
36
36
Advertisement
Table of Contents
