Nvidia ConnectX-6 Lx User Manual
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Computer Hardware
  5. ConnectX-6 Lx
  6. User manual
Nvidia ConnectX-6 Lx User Manual

Nvidia ConnectX-6 Lx User Manual

Ethernet adapter cards for ocp spec 3.0
Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP
Spec 3.0 User Manual

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the ConnectX-6 Lx and is the answer not in the manual?

Questions and answers

Related Manuals for Nvidia ConnectX-6 Lx

Summary of Contents for Nvidia ConnectX-6 Lx

  • Page 1 NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 2: Table Of Contents

    Monitoring Monitoring Finding the MAC and Serial Number on the Adapter Card Finding the MAC and Serial Number on the Adapter Card Document Revision History Document Revision History NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 3 About This Manual This is the User Guide for Ethernet adapter cards based on the NVIDIA® ConnectX®-6 Lx integrated circuit device for Open Compute Project Spec 3.0. These adapters connectivity provide the highest performing low latency and most flexible interconnect solution for servers supporting OCP spec 3.0 adapter cards used in Enterprise Data Centers and High-...
  • Page 4 This manual is intended for the installer and user of these cards. The manual assumes basic familiarity with Ethernet network and architecture specifications. Technical Support Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods: URL: https://www.nvidia.com > Support E-mail: enterprisesupport@nvidia.com...
  • Page 5 Bit Error Rate of less than 1E-15 . Read more at LinkX Cables and Transceivers. Open Compute https://www.opencompute.org/ Project 3.0 NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 6 When discussing memory sizes, MB and MBytes are used in this document to mean size in mega Bytes. The use of Mb or Mbits (small b) indicates size in mega bits. In this document PCIe is used to mean PCI Express. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 7: Introduction

    Enterprise Data Centers and High-Performance Computing environments. Providing up to two ports of 25GbE or a single-port of 50GbE connectivity, and PCIe Gen 3.0/4.0 x8 host connectivity, ConnectX-6 Lx is a member of NVIDIA’s world-class, award- winning, ConnectX family of network adapters. Continuing NVIDIA’s consistent innovation in networking, ConnectX-6 Lx provides agility and efficiency at every scale.
  • Page 8 MT28942A0- MT28942A0- MT28942A0- MT28942A0- IC Part Number YCCF-AE YCCF-AE YCCF-AE YCCF-AE Host Management Crypto Secure Boot 4127 for Physical Function (PF) Device ID 4128 for Virtual Function (VF) NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 9 Crypto √ √ Secure Boot √ 4127 for Physical Function (PF) Device ID 4128 for Virtual Function (VF) For more detailed information see Specifications. Features and Benefits Warning NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 10 NVGRE and VXLAN. While this solves network scalability issues, it NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 11 • NVMe over Fabric offloads for the target machine ConnectX®-6 Lx SR-IOV technology provides dedicated adapter SR-IOV resources and guaranteed isolation and protection for virtual machines (VM) within the server. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 12 IPsec inline encryption/decryption acceleration to offload the OPNs) CPU and run the entire data path encryption or decryption in the NIC hardware while maintaining the line rate. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 13 OpenFabrics Enterprise Distribution (OFED) OpenFabrics Windows Distribution (WinOF-2) Connectivity Interoperable with 1/10/25/50 Gb/s Ethernet switches Passive copper cable with ESD protection Powered connectors for optical and active cable support NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 14: Interfaces

    Interfaces The below figures show the component side of the NVIDIA ConnectX-6 Lx adapter card. Each numbered interface that is referenced in the figures is described in the following table with a link to detailed information. Warning The ConnectX-6 Lx adapter card includes special circuits to protect...
  • Page 15 There are two I/O LEDs, LED0 and LED1, per port to indicate Ports LEDs speed and link status. Interface” “FRU EEPROM” FRU EEPROM capacity 4Kb “SMBus Allows BMC connectivity using MCTP over SMBus or MCTP over Interface” PCIe protocols. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 16 NVIDIA’s ASAP2 technology. Embedded hardware root-of-trust and support for RSA-based secure firmware update and secure boot, providing guaranteed integrity of the network adapter. Ethernet SFP28/QSFP28 Interfaces NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 17 There are two I/O LEDs, LED0 and LED1, per port to indicate speed and link status. LED0 is a bicolor (yellow and green) LED and LED1 is a single color (green) LED. Link Indications NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 18 ConnectX®-6 Lx OCP 3.0 adapter can be connected to a BMC using MCTP over SMBus or MCTP over PCIe protocols as if it is a standard NVIDIA OCP 3.0 adapter. For configuring the adapter for the specific manageability solution in use by the server, please contact NVIDIA Support.
  • Page 19 The adapter card incorporates a CPLD device that controls the networking port LEDs, as well as an implementation of the OCP 3.0 host scan chain. It draws its power supply from 3.3V_EDGE. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 20: Hardware Installation

    Hardware Installation Installation and initialization of ConnectX-6 Lx adapter cards for OCP Spec 3.0 require attention to the mechanical attributes, power specification, and precautions for electronic equipment. Safety Warnings Note Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Adapter Installation Safety Instructions document available on nvidia.com.
  • Page 21 Procedure Direct Link Check the system’s hardware and software Refer to System Requirements requirements. Pay attention to the airflow consideration Refer to Airflow Requirements within the host system NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 22 (particulate) contamination. The operating environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness level. Hardware Requirements Important NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 23 A system with a PCI Express x16 slot for OCP spec 3.0 is required for installing the card. Airflow Requirements ConnectX-6 Lx adapter cards are offered with two airflow patterns: from the heatsink to the network ports, and vice versa, as shown below.
  • Page 24 Pre-Installation Checklist 1. Unpack the ConnectX-6 Lx adapter card. Unpack and remove the ConnectX-6 Lx card. Check the parts for visible damage that may have occurred during shipping. Please note that the cards must be placed on an antistatic surface.
  • Page 25 The new bracket of the desired form factor. The screws supplied with the new bracket kit. The required torx tool type as specified in the instructions. Removing the Existing Bracket NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 26 Be careful not to put stress on the LEDs on the adapter card. 3. Save the two screws. Installing the New Bracket 1. Assemble the new bracket onto the card. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 27 Bracket Note that one screw is flat-head 90° screw and the other is socket-head screw. Screw on the different types of screws as shown in the below illustration. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 28 Please follow proper electrical grounding procedures. 2. Open the system case. 3. Align the card with the system rails. Pull-tab (Thumbscrew) Internal Lock Bracket Ejector-Latch Bracket Bracket NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 29 firmly connectors are in a full locked. mate. Cables and Modules Cable Installation 1. All cables can be inserted or removed with the unit powered on. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 30 4. After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When a logical connection is made, Green LED1 will light. When data is being transferred, Green LED1 will blink. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 31 1. Open Device Manager on the server. Click Start => Run, and then enter devmgmt.msc. 2. Expand System Devices and locate your NVIDIA ConnectX-6 Lx adapter card. 3. Right click the mouse on your adapter's row and select Properties to display the adapter card properties window.
  • Page 32 In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of NVIDIA Technologies; and DEV is equal to 1018 (for ConnectX-6 Lx) – this is a valid NVIDIA Technologies PCI Device ID.
  • Page 33 Please note that the following images are for illustration purposes only. 1. Verify that the system is powered off and unplugged. 2. Wait 30 seconds. 3. Unsecure the card. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 34 While holding the heatsink, gently push the card out of the server. Rotate the captive screw Open the ejector latch. counterclockwise. 4. Gently pull out the adapter card. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 35 Internal Lock Bracket Ejector-Latch Bracket Bracket Gently pull out the While holding the tab, pull Open the ejector latch. adapter card from the out the adapter card. server. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 36: Driver Installation

    Windows 11 Client (64 bit only) Windows 10 Client (64 bit only) Windows 8.1 Client (64 bit only) Note: The Operating System listed above must run with administrator privileges. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 37 Installing the incorrect .exe file is prohibited. If you do so, an error message will be displayed.For example, if you install a 64- bit .exe on a 32-bit machine, the wizard will display the following NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 38 3. [Optional] If you do not want to upgrade your firmware version (i.e., MT_SKIPFWUPGRD default value is False). MLNX_WinOF2_<revision_version>_All_Arch.exe /v" MT_SKIPFWUPGRD=1" 4. [Optional] If you do not want to install the Rshim driver, run. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 39 Please remove the following oem inf files from driver store: <oem inf list>" 5. [Optional] If you want to skip the check for unsupported devices, run. MLNX_WinOF2_<revision_version>_All_Arch.exe /v" SKIPUNSUPPORTEDDEVCHECK=1" 6. Click Next in the Welcome screen. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 40 7. Read and accept the license agreement and click Next. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 41 If the user has an OEM card. In this case, the firmware will not be displayed. If the user has a standard NVIDIA® card with an older firmware version, the firmware will be updated accordingly. However, if the user has both an OEM card and a NVIDIA®...
  • Page 42 10. Select a Complete or Custom installation, follow Step a onward. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 43 Management tools - installation tools used for management, such as mlxstat Diagnostic Tools - installation tools used for diagnostics, such as mlx5cmd 2. Click Next to install the desired tools. 11. Click Install to start the installation. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 44 12. In case firmware upgrade option was checked in Step 7, you will be notified if a firmware upgrade is required (see NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 45 The following is an example of an unattended installation session. 1. Open a CMD console-> Click Start-> Task Manager File-> Run new task-> and enter CMD. 2. Install the driver. Run: NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 46 The Rshim driver installanion will fail if a prior Rshim driver is already installed. The following fail message will be displayed in the log: "ERROR!!! Installation failed due to following errors: MlxRshim drivers installation disabled and MlxRshim drivers Installed, NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 47: Linux Driver Installation

    3. Attach the adapters back to VM with the DDA tools. Linux Driver Installation This section describes how to install and test the NVIDIA OFED for Linux package on a single server with a NVIDIA ConnectX-6 Lx adapter card installed.
  • Page 48 A server platform with ConnectX®-6 Lx (EN) (firmware: fw- Platforms ConnectX6 Lx) Required Disk Space for Installation For the latest list of device IDs, please visit the NVIDIA website at Device ID http://www.nvidia.com/page/firmware_HCA_FW_identification. Linux operating system. Operating System For the list of supported operating system distributions and kernels, please refer to the NVIDIA OFED Release Notes file.
  • Page 49 Warning If the driver detects unsupported cards on the system, it will abort the installation procedure. To avoid this, make sure to add flag during installation. --skip-unsupported-devices-check Usage NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 50 The regular installation can be performed and weak-updates mechanism will create symbolic links to the MLNX_OFED kernel modules. Warning NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 51 Dynamic Kernel Module Support (DKMS) framework. Thus, the drivers' compilation will take place on the host during MLNX_OFED installation.Therefore, using "mlnx_add_kernel_support.sh" is irrelevant on Ubuntu and Debian distributions. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 52 At this point, OFED for Linux has already installed the OpenSM Subnet Manager on your machine. For the list of installation options, run: ./mlnxofedinstall --h Installation Procedure NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 53 For unattended installation, use the --force installation option while running the MLNX_OFED installation script: /mnt/mlnxofedinstall --force Warning MLNX_OFED for Ubuntu should be installed with the following flags in chroot environment:./mlnxofedinstall --without-dkms -- NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 54 AvailableFW XX.XX.XXXXStatus: No matching image found Error message #2:The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033)To obtain firmware for this device, please contact your HW vendor. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 55 files. See the relevant chapters in this manual for details. The list of the modules that will be loaded automatically upon boot can be found in the /etc/infiniband/openib.conf file. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 56 firmware update will occur and the error message below will be printed. "The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor." NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 57 The process of updating the initramfs will add the blacklists from step 1, and will prevent the kernel from loading the modules automatically. mlnxofedinstall Return Codes NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 58 OFED ISO image Note: If an adapter’s Flash was originally programmed with an Expansion ROM image, the automatic firmware update will also burn an Expansion ROM image. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 59 Installing MLNX_OFED Using YUM This type of installation is applicable to RedHat/OL and Fedora operating systems. Setting up MLNX_OFED YUM Repository 1. Log into the installation machine as root. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 60 Userid: "Mellanox Technologies (Mellanox Technologies - Signing Key v2) <support@mellanox.com>" From : /repos/MLNX_OFED/<MLNX_OFED file>/RPM-GPG-KEY-Mellanox this ok [y/N]: 5. Check that the key was successfully imported. # rpm -q gpg-pubkey --qf '%{NAME}-%{VERSION}-%{RELEASE}\t%{SUMMARY}\n' | grep Mellanox NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 61 2. Mount the ISO image on your machine and copy its content to a shared location in your network. # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt 3. Build the packages with kernel support and create the tarball. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 62 This system is not registered to Red Hat Subscription Management. You can use subscription- manager to register. repo id repo name status mlnx_ofed MLNX_OFED Repository rpmforge RHEL 6Server - RPMforge.net - dag 4,597 NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 63 : MLNX_OFED hypervisor installer package (with KMP support) mlnx-ofed-hypervisor-user-only.noarch : MLNX_OFED hypervisor-user-only installer package (User Space packages only) mlnx-ofed-kernel-only.noarch : MLNX_OFED kernel-only installer package (with KMP support) NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 64 In this case, the group RPM packages have the supported kernel version in their package's name. Example: mlnx-ofed-all-3.17.4-301.fc21.x86_64.noarch : MLNX_OFED all installer package for kernel 3.17.4- 301.fc21.x86_64 (without KMP support) NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 65 # yum install mlnx-ofed-all Loaded plugins: langpacks, product-id, subscription-manager Resolving Dependencies --> Running transaction check ---> Package mlnx-ofed-all.noarch 0:3.1-0.1.2 will be installed --> Processing Dependency: kmod-isert = 1.0-OFED.3.1.0.1.2.1.g832a737.rhel7u1 for package: mlnx-ofed-all-3.1-0.1.2.noarch ....NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 66 1. Log into the installation machine as root. 2. Extract the MLNX_OFED package on a shared location in your network. It can be downloaded from https://www.nvidia.com/en-us/networking/ Products Software InfiniBand Drivers. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 67 2. Mount the ISO image on your machine and copy its content to a shared location in your network. # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt 3. Build the packages with kernel support and create the tarball. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 68 [trusted=yes] file:/<path to extracted MLNX_OFED package>/DEBS ./ 6. Update the apt-get cache. # sudo apt-get update Installing MLNX_OFED Using the apt-get Tool After setting up the apt-get repository for MLNX_OFED package, perform the following: NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 69 - MLNX_OFED basic installer package (with DKMS support) (exact) mlnx-ofed-basic - MLNX_OFED basic installer package (with DKMS support) mlnx-ofed-dpdk-upstream-libs - MLNX_OFED dpdk-upstream-libs installer package (with DKMS support) where: NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 70 2. Install the desired group. apt-get install '<group name>' Example: apt-get install mlnx-ofed-all Warning Installing MLNX_OFED using the “apt-get” tool does not automatically update the firmware.To update the firmware to NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 71: Vmware Driver Installation

    Depending on the application of the user's system, it may be necessary to modify the default configuration of network adapters based on the ConnectX® adapters. In case that tuning is required, please refer to the Performance Tuning Guide for NVIDIA Network Adapters.
  • Page 72 | grep nmlx nmlx5-core 4.16.8.8-1OEM.650.0.0.4240417 MEL PartnerSupported 2017-01-31 nmlx5-rdma 4.16.8.8-1OEM.650.0.0.4240417 MEL PartnerSupported 2017-01-31 Warning After the installation process, all kernel modules are loaded automatically upon boot. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 73 4. Reboot the server. Firmware Programming 1. Download the VMware bootable binary images v4.6.0 from the Firmware Tools (MFT) site. 1. ESXi 6.5 File: mft-4.6.0.48-10EM-650.0.0.4598673.x86_64.vib NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 74 2. Install the image according to the steps described in the MFT User Manual. Warning The following procedure requires custom boot image downloading, mounting and booting from a USB device. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 75: Updating Adapter Firmware

    With Host management , Single-port QSFP28, PCIe 4.0 x8, No Crypto, Thumbscrew (Pull Tab) Bracket   PCI Device Name: 0000:07:00.0 Base MAC: 0000e41d2da206d4 Versions: Current Available FW 16.20.1000 16.24.1000   Status: Update required   NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 76 Perform FW update? [y/N]: y Device #1: Up to date Device #2: Updating FW ... Done   Restart needed for updates to take effect. Log File: /var/log/mlxup/mlxup-yyyymmdd.log NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 77: Troubleshooting

    Check that the latest driver is loaded Check that both the adapter and its link are set to the same speed communicati and duplex settings established NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 78 flint -d <mst_device> q ibstat Ports Information ibv_devinfo Firmware Version To download the latest firmware version, refer to the NVIDIA Upgrade Update and Query Utility. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 79 flint –d <mst_device> –i <firmware_bin_file> b Event log viewer MST device logs: mst start Collect Log File mst status flint –d <mst_device> dc > dump_configuration.log mstdump <mst_device> dc > mstdump.log NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 80: Specifications

    Specifications Warning Please make sure to install the ConnectX-6 Lx OCP 3.0 card in a PCIe slot that is capable of supplying the power levels mentioned below for the appropriate use case Warning In Standby mode only port0 is available.
  • Page 81 Humidity Non- 10% to 90% relative humidity operational Altitude (Operational 3050m Regulat Safety CB / cTUVus / CE CE / FCC / VCCI / ICES / RCM NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 82 RoHS RoHS compliant a. ConnectX-6 Lx adapters supplement the auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA Ethernet product. b. Typical power for ATIS traffic load.
  • Page 83 RoHS RoHS compliant a. ConnectX-6 Lx adapters supplement the auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA Ethernet product. b. Typical power for ATIS traffic load.
  • Page 84 ConnectX-6 Lx Single-Port QSFP28 OCP 3.0 Bracket Mechanical Drawings and Dimensions Warning All dimensions are in millimeters. The bracket's mechanical tolerance is +/- 0.25mm. Dual-port SFP28 Thumbscrew Bracket Single-port QSFP28 Thumbscrew Bracket NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 85 NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 86: Monitoring

    ConnectX®-6 Lx IC has a thermal shutdown safety mechanism that automatically shuts down the ConnectX®-6 Lx card in case of a high-temperature event, improper thermal coupling or heatsink removal. NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 87: Finding The Mac And Serial Number On The Adapter Card

    Finding the MAC and Serial Number on the Adapter Card Each NVIDIA adapter card has a different identifier printed on the label: serial number and the card MAC for the Ethernet protocol. Warning The product revisions indicated on the labels in the following figures do not necessarily represent the latest revisions of the cards.
  • Page 88 NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 89: Document Revision History

    Updated airflow numbers in "Specifications" Oct. Updated networking ports LEDs indications 2020 Updated Specifications tables Oct. Added board labels 2020 Sep. First release 2020 © Copyright 2024, NVIDIA. PDF Generated on 08/26/2024 NVIDIA ConnectX-6 Lx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

This manual is also suitable for:

900-9x625-0053-sb0900-9x625-0083-sb0900-9x659-0015-sb1900-9x659-0045-sb0900-9x625-0073-sb1900-9x625-0063-sb0 ... Show all

Table of Contents