ConnectX-6 Card
Configuration
Single-port Socket
Direct Card (2x PCIe
x16)
Dual-port Socket
Direct Card (2x PCIe
x16)
Single-port PCIe x16
Card
Dual-port PCIe x16
Card
2.
Download the ISO image to your host.
The image's name has the format
You can download and install the latest OpenFabrics Enterprise Distribution (OFED) software
package available via the NVIDIA web site at http://www.nvidia.com > Products > Software >
Ethernet Drivers > Linux SW/Drivers > Download..
a.
Scroll down to the Download wizard, and click the Download tab.
b.
Choose your relevant package depending on your host operating system.
c.
Click the desired ISO/tgz package.
d.
To obtain the download link, accept the End User License Agreement (EULA).
3.
Use the md5sum utility to confirm the file integrity of your ISO image. Run the following
command and compare the result to the value provided on the download page.
md5sum MLNX_OFED_LINUX-<ver>-<OS label>.iso
[root@mftqa-009 ~]# lspci |grep mellanox -i
a3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family
[ConnectX-6]
e3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family
[ConnectX-6]
[root@mftqa-009 ~]# lspci |grep mellanox -i
05:00.0 Infiniband controller: Mellanox Technologies MT28908A0 Family
[ConnectX-6]
05:00.1 Infiniband controller: Mellanox Technologies MT28908A0 Family
[ConnectX-6]
82:00.0 Infiniband controller: Mellanox Technologies MT28908A0 Family
[ConnectX-6]
82:00.1 Infiniband controller: Mellanox Technologies MT28908A0 Family
[ConnectX-6]
In the output example above, the first
two rows indicate that one card is installed in a PCI slot with PCI Bus address
05 (hexadecimal), PCI Device number 00 and PCI Function number 0 and 1.
The other card is installed in a PCI slot with PCI Bus address 82 (hexadecimal
), PCI Device number 00 and PCI Function number 0 and 1.
Since the two PCIe cards are installed in two PCIe slots, each card
gets a unique PCI Bus and Device number. Each of the PCIe x16 busses sees two
network ports; in effect, the two physical ports of the ConnectX-6 Socket
Direct adapter are viewed as four net devices by the system.
[root@mftqa-009 ~]# lspci |grep mellanox -ia
3:00.0 Infiniband controller: Mellanox Technologies MT28908 Family [ConnectX-6]
[root@mftqa-009 ~]# lspci |grep mellanox -ia
86:00.0 Network controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
86:00.1 Network controller: Mellanox Technologies MT28908A0 Family [ConnectX-6]
MLNX_OFED_LINUX-<ver>-<OS label><CPU arch>.iso
.
48