Nvidia Mellanox ConnectX-6 MCX654106A-ECAT User Manual page 26

4. After plugging in a cable, lock the connector using the latching mechanism particular to the
cable vendor. When data is being transferred the Green LED will blink. See
the Interfaces section.
5. Care should be taken as not to impede the air exhaust flow through the ventilation holes. Use
cable lengths which allow for routing horizontally around to the side of the chassis before
bending upward or downward in the rack.
6. To remove a cable, disengage the locks and slowly pull the connector away from the port
receptacle. LED indicator will turn off when the cable is unseated.
Identifying the Card in Your System
On Linux
Get the device location on the PCI bus by running lspci and locating lines with the string "Mellanox
Technologies":
ConnectX-6 Card
Configuration
Single-port Socket
Direct Card (2x PCIe
x16)
Dual-port Socket
Direct Card (2x PCIe
x16)
Single-port PCIe x8/
x16 Card
Dual-port PCIe x16
Card
On Windows
1. Open Device Manager on the server. Click Start => Run, and then enter devmgmt.msc.
2. Expand System Devices and locate your Mellanox ConnectX-6 adapter card.
3. Right click the mouse on your adapter's row and select Properties to display the adapter card
properties window.
4. Click the Details tab and select Hardware Ids (Windows 2012/R2/2016) from the Property pull-
down menu.
lspci Command Output Example
[root@mftqa-009 ~]# lspci |grep mellanox -i
a3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
e3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
[root@mftqa-009 ~]# lspci |grep mellanox -i
05:00.0 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
05:00.1 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
82:00.0 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
82:00.1 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
In the output example above, the first
two rows indicate that one card is installed in a PCI slot with PCI Bus address 05
(hexadecimal), PCI Device number 00 and PCI Function number 0 and 1. The other
card is installed in a PCI slot with PCI Bus address 82 (hexa-decimal), PCI Device numb
er 00 and PCI Function number 0 and 1.
Since the two PCIe cards are installed in two PCIe slots, each card
gets a unique PCI Bus and Device number. Each of the PCIe x16 busses sees two network
ports; in effect, the two physical ports of the ConnectX-6 Socket Direct adapter are viewe
d as four net devices by the system.
[root@mftqa-009 ~]# lspci |grep mellanox -i
3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
[root@mftqa-009 ~]# lspci |grep mellanox -i
86:00.0 Network controller: Mellanox Technologies MT28908A0 Family [ConnectX-6] 86:00.1
Network controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
LED Interface under
26