Downloading Nvidia Ofed - Nvidia MCX651105A-EDAT User Manual

Downloading NVIDIA OFED
1. Verify that the system has a NVIDIA network adapter installed by running lscpi command. The below table provides output examples per ConnectX-6
card configuration.
ConnectX-6 Card Configuration
Single-port Socket Direct Card (2x PCIe
x16)
Dual-port Socket Direct Card (2x PCIe
x16)
Single-port PCIe x16 Card
[root@mftqa-009 ~]# lspci |grep mellanox -i
a3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
e3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
[root@mftqa-009 ~]# lspci |grep mellanox -i
05:00.0 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
05:00.1 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
82:00.0 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
82:00.1 Infiniband controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
In the output example above, the first
two rows indicate that one card is installed in a PCI slot with PCI Bus address 05 (hexadecimal), PCI Device number 00 and PCI Function
number 0 and 1. The other card is installed in a PCI slot with PCI Bus address 82 (hexadecimal), PCI Device number 00 and PCI Function
number 0 and 1.
Since the two PCIe cards are installed in two PCIe slots, each card
gets a unique PCI Bus and Device number. Each of the PCIe x16 busses sees two network ports; in effect, the two physical ports of the
ConnectX-6 Socket Direct adapter are viewed as four net devices by the system.
[root@mftqa-009 ~]# lspci |grep mellanox -ia
3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
66