Starting The Mellanox Software Tools And Determining The Current Port Configuration; Switching The Port Configuration - Nvidia DGX A100 User Manual

‣
If port 1 is Ethernet, then port 2 (InfiniBand) does not support EDR.
7.7.1. Starting the Mellanox Software Tools and
Determining the Current Port Configuration
Here is some information about how you can start the Mellanox software tools and determine
the configuration for the current port.
Start the Mellanox Software Tools services.
$ sudo mst start
To determine the current port configuration, enter the following:
$ sudo mlxconfig -e query | egrep -e Device\|LINK_TYPE
The following example shows the output for one of the port devices, showing the device path
and the default, current, and next boot configuration.
Device #2:
Device type: ConnectX6
Device: /dev/mst/mt4123_pciconf8
Configurations: Default Current Next Boot
* LINK_TYPE_P1 IB(1) IB(1) IB(1)
‣
IB(1) indicates the port is configured for InfiniBand.
‣
ETH(2) indicates the port is configured for Ethernet.
Determine the Device path bus numbers for the slot number of the port you want to configure.
Refer to the table in Open Ports
7.7.2.

Switching the Port Configuration

Make sure that you have started the Mellanox Software Tools (MST) services as described in

Starting the Mellanox Software Tools and Determining the Current Port Configuration

have identified the correct ports to change.
Issue mlxconfig for each port you want to configure.
$ sudo mlxconfig -y -d <device-path> set LINK_TYPE_P1=<config-number>
where:
‣
corresponds to the port you want to configure.
<device-path>
‣
<config-number>
Here is an example to set slot 0 to Ethernet:
$ sudo mlxconfig -y -d /dev/mst/mt4123_pciconf2 set LINK_TYPE_P1=2
Here is an example that sets slot 1 to InfiniBand:
$ sudo mlxconfig -y -d /dev/mst/mt4123_pciconf3 set LINK_TYPE_P1=1
NVIDIA DGX A100
for the mapping.
is for InfiniBand and
1
for Ethernet.
2
Network Configuration
and
DU-09821-001 _v01 | 46