Nvidia ConnectX-4 User Manual
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Computer Hardware
  5. Mellanox ConnectX-4 Lx
  6. User manual
Nvidia ConnectX-4 User Manual

Nvidia ConnectX-4 User Manual

Infiniband/ethernet adapter cards
Hide thumbs Also See for ConnectX-4:
Table of Contents

Advertisement

Quick Links

Download this manual
NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards
User Manual

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the ConnectX-4 and is the answer not in the manual?

Questions and answers

Related Manuals for Nvidia ConnectX-4

Summary of Contents for Nvidia ConnectX-4

  • Page 1 NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

  • Page 2: Table Of Contents

    Hardware Installation Driver Installation Driver Installation Linux Driver Installation Linux Driver Installation Windows Driver Installation Windows Driver Installation Troubleshooting Troubleshooting Updating Adapter Firmware Updating Adapter Firmware Specifications Specifications Document Revision History Document Revision History NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 3 firmware for operating the board, and relevant documentation. Ordering Part Numbers The table below provides the ordering part numbers (OPN) for the available ConnectX-4 InfiniBand/Ethernet adapter cards. NVIDIA...
  • Page 4 Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods: URL: https://www.nvidia.com > Support E-mail: enterprisesupport@nvidia.com Customers who purchased NVIDIA Global Support Services, please see your contract for details regarding Technical Support. Customers who purchased NVIDIA products through an NVIDIA-approved reseller should first seek assistance through their reseller.
  • Page 5 LinkX InfiniBand cables and transceivers are designed to maximize the performance of High-Performance Computing networks, requiring high-bandwidth, low-latency connections between compute nodes and switch nodes. NVIDIA offers one of the industry’s broadest portfolios of QDR/FDR10 (40Gb/s), FDR (56Gb/s), LinkX EDR/HDR100 (100Gb/s), HDR (200Gb/s), and NDR (400Gb/s) cables,...

  • Page 6: Introduction

    Introduction Product Overview This is the User Guide for InfiniBand/Ethernet adapter cards based on the NVIDIA® ConnectX®-4 integrated circuit device. These adapters connectivity provide the highest performing and most flexible interconnect solution for PCI Express Gen 3.0/4.0 servers used in Enterprise Data Centers, High-Performance Computing, and Embedded environments.
  • Page 7 Uses PCIe Gen 3.0 (8GT/s) through an x8 or x16 edge connector. Gen 1.1 and Express 2.0 compatible. (PCIe) A standard InfiniBand data rate, where each lane of a 4X port runs a bit rate InfiniBa of 25.78125Gb/s with a 64b/66b encoding, resulting in an effective bandwidth NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 8 InfiniBa Architec ture ConnectX-4 delivers low latency, high bandwidth, and computing efficiency for Specific performance-driven server and storage clustering applications. ConnectX-4 is ation InfiniBand Architecture Specification v1.3 compliant.
  • Page 9 Networ solves network scalability issues, it hides the TCP packet from the hardware offloading engines, placing higher loads on the host CPU. ConnectX-4 effectively addresses this by providing advanced NVGRE and VXLAN hardware offloading engines that encapsulate and de-capsulate the overlay protocol.
  • Page 10 InfiniBand RDMA for high-performance storage access. NVMe over Fabric offloads for the target machine ConnectX-4 SR-IOV technology provides dedicated adapter resources and SR-IOV guaranteed isolation and protection for virtual machines (VM) within the server. Operating Systems/Distributions...

  • Page 11: Interfaces

    LED Interface There is one bi-color I/O LED per port to indicate link status. LED behavior is described below for Ethernet and InfiniBand port configurations. Physical and Logical Link Indications - Ethernet Protocol: NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 12 Indicates an active physical link Beacon command for 1Hz blinking Yellow locating the adapter card Error 4Hz blinking Yellow Indicates an error with the link. The error can be one of the following: NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 13 Over-current condition of Blinks until current the networking ports error is fixed Indicates a valid logical (data activity) link with no active Solid green traffic Blinking green Indicates a valid logical link with active traffic NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

  • Page 14: Hardware Installation

    Hardware Installation Installation and initialization of ConnectX-4 adapter cards require attention to the mechanical attributes, power specification, and precautions for electronic equipment. Safety Warnings Note Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Adapter Installation Safety Instructions.
  • Page 15 During periods of lightning activity, do not work on the equipment or connect or dis - connect cables. Copper Cable Connecting/Disconnecting Some copper cables are heavy and not flexible, as such, they should be carefully NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 16 This equipment should be installed, replaced, or serviced only by trained and qualified personnel. Equipment Disposal The disposal of this equipment should be in accordance to all national laws and regula - tions. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 17 IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:20 Installation Procedure Overview The installation procedure of ConnectX-4 adapter cards involves the following steps: Procedure Direct Link Check the system’s hardware and software Refer to System requirements.
  • Page 18 System Requirements Hardware Requirements Important Unless otherwise specified, NVIDIA products are designed to work in an environmentally controlled data center with low levels of gaseous and dust (particulate) contamination. The operation environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for...
  • Page 19 Airflow Requirements ConnectX-4 adapter cards are offered with two airflow patterns: from the heatsink to the network ports, and vice versa. Please refer to the Specifications chapter for airflow numbers for each specific card model.
  • Page 20 1. Unpack the adapter package and place them on an antistatic surface, and verify you have received the following items: 1. ConnectX-4 Adapter Card, with a tall bracket assembled on the card. 2. Short bracket (accessory) 2. Check the parts for visible damage that may have occurred during shipping.
  • Page 21 3. Shut down your system if active: Turn off the power to the system, and disconnect the power cord. Refer to the system documentation for instructions. Before you install the ConnectX-4 card, make sure that the system is disconnected from power.
  • Page 22 Removing the Existing Bracket 1. Using a torque driver, remove the two screws holding the bracket in place. 2. Separate the bracket from the ConnectX-4 card. Important Be careful not to put stress on the LEDs on the adapter card.
  • Page 23 1. Before installing the card, make sure that the system is off and the power cord is not connected to the server. Please follow proper electrical grounding procedures. 2. Open the system case. 3. Place the adapter in an available PCI Express slot. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 24 4. Applying even pressure at both corners of the card, insert the adapter card into the PCI Express slot until firmly seated. 5. When the adapter is properly seated, the port connectors are aligned with the slot opening, and the adapter faceplate is visible against the system chassis. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 25 2. To insert a cable, press the connector into the port receptacle until the connector is firmly seated. 1. Support the weight of the cable before connecting the cable to the adapter card. Do this by using a cable holder or tying the cable to the rack. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 26 6. To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. The LED indicator will turn off when the cable is unseated. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 27 1. Open Device Manager on the server. Click Start => Run, and then enter devmgmt.msc. 2. Expand System Devices and locate your NVIDIA ConnectX-4 adapter card. 3. Right click the mouse on your adapter's row and select Properties to display the adapter card properties window.
  • Page 28 5. In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_1003”. VEN is equal to 0x15B3 which is the Vendor ID of NVIDIA; and DEV is equal to 1018 (for ConnectX-4) which is a valid NVIDIA PCIe Device ID.
  • Page 29 The list of NVIDIA PCI Device IDs can be found at the PCI ID repository. Uninstalling the Card Safety Precautions The adapter is installed in a system that operates with voltages that can be lethal. Before uninstalling the adapter card, please observe the following precautions to avoid injury and prevent damage to system components.
  • Page 30 5. When the port connectors reach the top of the chassis window, gently pull the adapter card in parallel to the motherboard. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

  • Page 31: Driver Installation

    This section describes how to install and test the MLNX_OFED for Linux package on a single server with an ConnectX-4 adapter card installed. Prerequisites Requirements Description A server platform with one ConnectX-4 (VPI, IB, EN) (firmware: fw- Platforms ConnectX4) Required Disk Space for Installation Linux operating system.
  • Page 32 2. Download the ISO image to your host. The image’s name has the format MLNX_OFED_LINUX-<ver>-<OS label><CPU arch>.iso You can download and install the latest OpenFabrics Enterprise Distribution (OFED) software package available via the NVIDIA web site at nvidia.com/en-us/networking Products Software InfiniBand Drivers NVIDIA MLNX_OFED 1.
  • Page 33 flag during --skip-unsupported-devices-check installation. Usage ./mnt/mlnxofedinstall [OPTIONS] The installation script removes all previously installed OFED packages and re-installs from scratch. You will be prompted to acknowledge the deletion of the old packages. Warning NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 34 filesystem mounted over a ConnectX card, not regenerating the initramfs may even cause the system to fail to reboot. In such cases, the installer will recommend running the following command to update the initramfs: NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 35 /tmp directory. All Mellanox, OEM, OFED, or Distribution IB packages will be removed. Do you want to continue?[y/N]:y See log file /tmp/mlnx_ofed_iso.21642.log   Building OFED RPMs. Please wait... Removing OFED RPMs... NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 36 For the list of installation options, run: ./mlnxofedinstall --h Installation Procedure This section describes the installation procedure of MLNX_OFED on NVIDIA adapter cards. 1. Log in to the installation machine as root. 2. Mount the ISO image on your machine.
  • Page 37 --without-fw-update --forceFor example:./mlnxofedinstall --without-dkms --add-kernel- support --kernel 3.13.0-85-generic --without-fw-update -- forceNote that the path to kernel sources (--kernel- sources) should be added if the sources are not in their default location. Warning NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 38 firmware update can take effect. Refer to the table below to find the appropriate action for your specific card. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 39 files. See the relevant chapters in this manual for details. The list of the modules that will be loaded automatically upon boot can be found in the /etc/infiniband/openib.conf file. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 40 In case your machine has an unsupported network adapter device, no firmware update will occur and the error message below will be printed. "The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor."...
  • Page 41 Logs dir: /tmp/MLNX_OFED_LINUX-4.4-1.0.0.0.IBMM2150110033.logs Driver Load Upon System Boot Upon system boot, the NVIDIA drivers will be loaded automatically. To prevent the automatic load of the NVIDIA drivers upon system boot: 1. Add the following lines to the "/etc/modprobe.d/mlnx.conf" file. blacklist mlx5_core blacklist mlx5_ib 2.
  • Page 42 The firmware version of the adapter device is older than the firmware version included with the OFED ISO image Note: If an adapter’s Flash was originally programmed with an Expansion ROM image, the automatic firmware update will also burn an Expansion ROM image. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 43 In case your machine has an unsupported network adapter device, no firmware update will occur and the error message below will be printed. "The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor."...
  • Page 44 Userid: "Mellanox Technologies (Mellanox Technologies - Signing Key v2) <support@mellanox.com>" From : /repos/MLNX_OFED/<MLNX_OFED file>/RPM-GPG-KEY-Mellanox this ok [y/N]: 5. Check that the key was successfully imported. # rpm -q gpg-pubkey --qf '%{NAME}-%{VERSION}-%{RELEASE}\t%{SUMMARY}\n' | grep Mellanox NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 45 2. Mount the ISO image on your machine and copy its content to a shared location in your network. # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt 3. Build the packages with kernel support and create the tarball. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 46 Loaded plugins: product-id, security, subscription-manager This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. repo id repo name status mlnx_ofed MLNX_OFED Repository rpmforge RHEL 6Server - RPMforge.net - dag 4,597 NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 47 : MLNX_OFED hypervisor installer package (with KMP support) mlnx-ofed-hypervisor-user-only.noarch : MLNX_OFED hypervisor-user-only installer package (User Space packages only) mlnx-ofed-kernel-only.noarch : MLNX_OFED kernel-only installer package (with KMP support) mlnx-ofed-vma.noarch : MLNX_OFED vma installer package (with KMP support) NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 48 RHEL and SLES. For other operating systems, kernel module RPM packages are provided only for the operating system's default kernel. In this case, the group RPM packages have the supported kernel version in their package's name. Example: NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 49 Please note that the resulting MLNX_OFED repository will contain unsigned RPMs, therefore, you should set 'gpgcheck=0' in the repository configuration file. 2. Install the desired group. # yum install mlnx-ofed-all Loaded plugins: langpacks, product-id, subscription-manager Resolving Dependencies --> Running transaction check NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 50 2. Extract the MLNX_OFED package on a shared location in your network. It can be downloaded from https://www.nvidia.com/en-us/networking/ Products Software InfiniBand Drivers. 3. Create an apt-get repository configuration file called "/etc/apt/sources.list.d/mlnx_ofed.list" with the following content: NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 51 # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt 3. Build the packages with kernel support and create the tarball. # /mnt/mlnx_add_kernel_support.sh --make-tgz <optional --kmp> -k $(uname -r) -m /mnt/ Note: This program will create MLNX_OFED_LINUX TGZ rhel7.6 under /tmp directory. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 52 Installing MLNX_OFED Using the apt-get Tool After setting up the apt-get repository for MLNX_OFED package, perform the following: 1. View the available package groups by invoking: # apt-cache search mlnx-ofed- apt-cache search mlnx-ofed ..NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 53 (with DKMS support) (exact) mlnx-ofed-basic - MLNX_OFED basic installer package (with DKMS support) mlnx-ofed-dpdk-upstream-libs - MLNX_OFED dpdk-upstream-libs installer package (with DKMS support) where: mlnx-ofed-all MLNX_OFED all installer package mlnx-ofed-basic MLNX_OFED basic installer package NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 54 MLNX_OFED dpdk-upstream-libs installer package 2. Install the desired group. apt-get install '<group name>' Example: apt-get install mlnx-ofed-all Warning Installing MLNX_OFED using the “apt-get” tool does not automatically update the firmware.To update the firmware NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

  • Page 55: Windows Driver Installation

    Windows Driver Installation For Windows, download and install the latest WinOF-2 for Windows software package available via the NVIDIA website at: WinOF-2 webpage. Follow the installation instructions included in the download package (also available from the download page). The snapshots in the following sections are presented for illustration purposes only. The installation interface may slightly vary, depending on the operating system in use.
  • Page 56 On an x64 (64-bit) machine, the output will be “AMD64”. 2. Go to the WinOF-2 web page at: https://www.nvidia.com/en-us/networking/ > Products > Software > InfiniBand Drivers (Learn More) > Nvidia WinOF-2. 3. Download the .exe image according to the architecture of your machine (see Step The name of the .exe is in the following format: MLNX_WinOF2-...
  • Page 57 2. [Optional] Manually configure your setup to contain the logs option (replace “LogFile” with the relevant directory). MLNX_WinOF2_<revision_version>_All_Arch.exe /v"/l*vx [LogFile]" Example: MLNX_WinOF2-2_10_50000_All_x64.exe /v"/l*vx [LogFile]" 3. [Optional] If you do not want to upgrade your firmware version (i.e., MT_SKIPFWUPGRD default value is False). NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 58 Please remove the following oem inf files from driver store: <oem inf list>" 5. [Optional] If you want to skip the check for unsupported devices, run. MLNX_WinOF2_<revision_version>_All_Arch.exe /v" SKIPUNSUPPORTEDDEVCHECK=1" 6. Click Next in the Welcome screen. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 59 7. Read and accept the license agreement and click Next. 8. Select the target folder for the installation. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 60 If the user has an OEM card. In this case, the firmware will not be displayed. If the user has a standard NVIDIA® card with an older firmware version, the firmware will be updated accordingly. However, if the user has both an OEM card and a NVIDIA®...
  • Page 61 Documentation - contains the User Manual and Release Notes Management tools - installation tools used for management, such as mlxstat Diagnostic Tools - installation tools used for diagnostics, such as mlx5cmd 2. Click Next to install the desired tools. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 62 11. Click Install to start the installation. 12. In case firmware upgrade option was checked in Step 7, you will be notified if a firmware upgrade is required (see NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 63 13. Click Finish to complete the installation. Unattended Installation NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 64 4. [Optional] if you wish to control whether to install ND provider or not (i.e., MT_NDPROPERTY default value is True). MLNX_WinOF2-[Driver/Version]_<revision_version>_All_Arch.exe /vMT_NDPROPERTY=1 5. [Optional] If you do not wish to upgrade your firmware version (i.e.,MT_SKIPFWUPGRD default value is False). MLNX_WinOF2-[Driver/Version]_<revision_version>_All_Arch.exe /vMT_SKIPFWUPGRD=1 NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 65 MLNX_WinOF2_<revision_version>_All_Arch.exe /v" SKIPUNSUPPORTEDDEVCHECK=1" Firmware Upgrade If the machine has a standard NVIDIA® card with an older firmware version, the firmware will be automatically updated as part of the NVIDIA® WinOF-2 package installation. For information on how to upgrade firmware manually, please refer to MFT User Manual.
  • Page 66 Host. Therefore, to update the firmware, the following must be performed: 1. Return the network adapters to the Host. 2. Update the firmware according to the steps in the MFT User Manual. 3. Attach the adapters back to VM with the DDA tools. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

  • Page 67: Troubleshooting

    Verify that your switch and adapter port are compatible Link light is on, but with Check that the latest driver is loaded Check that both the adapter and its link are set to the same speed communicati and duplex settings established NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 68 Download and install MFT: MFT Documentation Refer to the User Manual for installation instructions. Mellanox Firmware Once installed, run: Tool (MFT) mst start mst status flint -d <mst_device> q ibstat Ports Information ibv_devinfo NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 69 Firmware Version To download the latest firmware version, refer to the NVIDIA Upgrade Update and Query Utility. cat /var/log/messages dmesg >> system.log Collect Log File journalctl (Applicable on new operating systems) cat /var/log/syslog Windows Troubleshooting From the Windows desktop choose the Start menu and run:...

  • Page 70: Updating Adapter Firmware

    fixes. To check that your card is programmed with the latest available firmware version, download the mlxup firmware update and query utility. The utility can query for available NVIDIA adapters and indicate which adapters require a firmware update. If the user confirms, mlxup upgrades the firmware using embedded images. The latest mlxup executable and documentation are available inmlxup - Update and Query Utility .
  • Page 71 Current Available 16.00.0000 16.00.1000 Status: Update required   Perform FW update? [y/N]: y Device #1: Up to date Device #2: Updating FW ... Done Restart needed updates to take effect. Log File: /var/log/mlxup/mlxup-yyyymmdd.log NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

  • Page 72: Specifications

    1.5W Active Cables 14.2W Airflo Maximum power available through QSFP28 port: 3.5W Heatsink to Port Port to Heatsink Passive Active 1.5W Passive Active 1.5W Airflow (LFM) Cables Cables Cables Cables 400LFM 450LFM 400LFM 400LFM NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 73 RoHS RoHS compliant Notes: a. The ConnectX-4 adapters supplement the IBTA auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA InfiniBand product. b. Typical power for ATIS traffic load.
  • Page 74 RoHS RoHS compliant Notes: a. The ConnectX-4 adapters supplement the IBTA auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA InfiniBand product. b. Typical power for ATIS traffic load.
  • Page 75 Passive Active 1.5W Airflow (LFM) Cables Cables Cables Cables 450LFM 400LFM 400LFM 400LFM Envir Operational 0°C to 55°C onme Temperature Non- ntal -40°C to 70°C operational Humidity Operational 10% to 85% relative humidity NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 76 RoHS RoHS compliant Notes: a. The ConnectX-4 adapters supplement the IBTA auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA InfiniBand product. b. Typical power for ATIS traffic load.
  • Page 77 RoHS RoHS compliant Notes: a. The ConnectX-4 adapters supplement the IBTA auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA InfiniBand product. NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 78 Typical power for ATIS traffic load. c. For both operational and non-operational states. Notes: a. The ConnectX-4 adapters supplement the IBTA auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA InfiniBand product.
  • Page 79 RoHS RoHS compliant Notes: a. The ConnectX-4 adapters supplement the IBTA auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA InfiniBand product. b. Typical power for ATIS traffic load.
  • Page 80 Humidity ntal Non- 10% to 90% relative humidity operational Altitude 3050m (Operational) Safety CB / cTUVus / CE Regul CE / FCC / VCCI / ICES / RCM atory RoHS RoHS compliant NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 81 Notes: a. The ConnectX-4 adapters supplement the IBTA auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another NVIDIA InfiniBand product. b. Typical power for ATIS traffic load. c. For both operational and non-operational states.
  • Page 82 Bracket Mechanical Drawing Warning All dimensions are in millimeters. The bracket mechanical tolerance is +/- 0.25mm. Dual-port Bracket Single-port Bracket NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 83 NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

  • Page 84: Document Revision History

    Added mechanical drawings Updated "Safety Warnings" Updated "Cable Installation" Apr. 2016 Updated "Airflow Specifications" Mar. 2016 Removed I2C-Compatible Interface Updated speed specifications in the following sections: 'Product Overview" Feb. 2016 "Features and Benefits" NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...
  • Page 85 Added 56GbE support to relevant sections. Dec. 2015 Added port numbers to the specification tables Dec. 2015 Updated specifications tables Nov.2015 Updated specifications tables Jun. 2015 First Release © Copyright 2024, NVIDIA. PDF Generated on 08/26/2024 NVIDIA ConnectX-4 InfiniBand/Ethernet Adapter Cards User Manual...

This manual is also suitable for:

900-9x426-0014-st0900-9x426-0054-st0900-9x4ac-0014-st0900-9x4ac-0054-st0900-9x4ac-0016-st0900-9x4ac-0056-st3

Table of Contents