Table of Contents
Advertisement
Quick Links
Advertisement
Table of Contents
Troubleshooting
Related Manuals for Nvidia MCX545B-CCUN
Summary of Contents for Nvidia MCX545B-CCUN
- Page 1 NVIDIA Mellanox ConnectX-5 Ethernet Adapter Cards for OCP Spec 2.0 User Manual 25 and 100 Gb/s Ethernet Adapter Cards; Intelligent RDMA (RoCE) enabled NICs. Supporting OCP Specification 2.0 type 1 and type 2. Exported on Dec/16/2020 07:33 PM https://docs.mellanox.com/x/V4eO...
-
Page 2: Table Of Contents
Table of Contents Introduction........................8 OCP Spec 2.0 Stacking Heights ....................9 OCP Spec 2.0 Type 1 Stacking Height - Single-port Card ..........9 OCP Spec 2.0 Type 1 Stacking Height - Dual-port Card..........10 OCP Spec 2.0 Type 2 Stacking Height - Single-port Card ..........10 OCP Spec 2.0 Type 2 Stacking Height - Dual-port Card.......... - Page 3 Software Requirements ....................24 Downloading Mellanox WinOF-2 Driver ................24 Installing Mellanox WinOF-2 Driver ................25 Attended Installation ....................25 Unattended Installation....................30 Installation Results ..................... 31 Uninstalling Mellanox WinOF-2 Driver................31 Attended Uninstallation ....................31 Unattended Uninstallation ..................31 Extracting Files Without Running Installation ..............
- Page 4 Windows Troubleshooting..................... 51 Specifications ......................52 MCX542A-ACAN Specifications .................... 52 MCX542B-AC[A/U]N Specifications ..................53 MCX545B-GCUN Specifications.................... 54 MCX545B-CCUN Specifications.................... 55 MCX545A-CCAN and MCX545A-CCUN Specifications............56 MCX546A-BCAN Specifications .................... 57 MCX546A-CDAN Specifications .................... 58 Board Mechanical Drawing and Dimensions............... 59 Finding the MAC and Serial Number on the Adapter Card ........63...
- Page 5 About This Manual This User Manual describes NVIDIA® Mellanox® ConnectX®-5 and ConnectX®-5 Ex Ethernet adapter cards for Open Compute Project (OCP), Spec 2.0. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant documentation.
- Page 6 Customers who purchased Mellanox products directly from Mellanox are invited to contact us through the following methods: • URL: http://www.mellanox.com > Support • E-mail: support@mellanox.com • Tel: +1.408.916.0055 Customers who purchased Mellanox M-1 Global Support Services, please see your contract for details regarding Technical Support. Customers who purchased Mellanox products through a Mellanox approved reseller should first seek assistance through their reseller.
- Page 7 When discussing memory sizes, MB and MBytes are used in this document to mean size in mega Bytes. The use of Mb or Mbits (small b) indicates size in mega bits. In this document PCIe is used to mean PCI Express.
-
Page 8: Introduction
Introduction This is the User Guide for Ethernet adapter cards based on the ConnectX®-5 integrated circuit device for OCP Spec 2.0. These adapters connectivity provide the highest performing low latency and most flexible interconnect solution for PCI Express Gen 3.0/4.0 servers used in Enterprise Data Centers and High-Performance Computing environments. -
Page 9: Ocp Spec 2.0 Stacking Heights
OCP Spec 2.0 Stacking Heights OCP Spec 2.0 Type 1 Stacking Height - Single-port Card This section applies to MCX545B-CCUN and MCX545B-GCUN. The single port 100Gb/s Ethernet adapter card complies with OCP Spec 2.0 Type 1 with 8mm stacking height. -
Page 10: Ocp Spec 2.0 Type 1 Stacking Height - Dual-Port Card
OCP Spec 2.0 Type 1 Stacking Height - Dual-port Card This section applies to MCX542A-ACAN and MCX542B-ACAN. The dual port 10/25Gb/s Ethernet adapter card comply with OCP Spec 2.0 Type 1 with 8mm stacking height. OCP Spec 2.0 Type 2 Stacking Height - Single-port Card ... -
Page 11: Features And Benefits
Features and Benefits This section describes hardware features and capabilities. Please refer to the relevant driver and/or firmware release notes for feature availability. Feature Description PCI Express (PCIe) Uses PCIe Gen 3.0 (8GT/s) and Gen 4.0 (16GT/s) through an x8 or x16 edge connector. -
Page 12: Operating Systems/Distributions
Feature Description RDMA and RDMA over Converged ConnectX-5, utilizing IBTA RDMA (Remote Data Memory Access) and Ethernet (RoCE) RoCE (RDMA over Converged Ethernet) technology, delivers low- latency and high-performance over Band and Ethernet networks. Leveraging data center bridging (DCB) capabilities as well as ConnectX-5 advanced congestion control hardware mechanisms, RoCE provides efficient low-latency RDMA services over Layer 2 and Layer 3 networks. -
Page 13: Connectivity
Connectivity • Interoperable with 1/10/25/40/50/100 Gb/s Ethernet switches • Passive copper cable with ESD protection • Powered connectors for optical and active cable support... -
Page 14: Interfaces
Interfaces Ethernet SFP28 and QSFP28 Interfaces The network ports of the ConnectX®-5 adapter card are compliant with the IEEE 802.3 Ethernet standards listed in Features and Benefits. Ethernet traffic is transmitted through the SFP28/QSFP28 connectors on the adapter card. The adapter card includes special circuits to protect from ESD shocks to the card/server when plugging copper cables. -
Page 15: Smbus Interface
LED and State Description 4Hz blinking Yellow Indicates an error with the link. The error can be one of the following: Error Type Description LED Behavior Blinks until the error C access to the is fixed networking ports fails Over-current Over-current condition Blinks until the error of the networking ports... -
Page 16: Hardware Installation
Hardware Installation Installation and initialization of ConnectX-5 adapter cards for OCP Spec 2.0 require attention to the mechanical attributes, power specification, and precautions for electronic equipment. Safety Warnings Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Adapter Installation Safety Instructions document available on... -
Page 17: Hardware Requirements
Hardware Requirements For proper operation and performance, please make sure to use a PCIe slot with a corresponding bus width and that can supply sufficient power to your card. Refer to the Specifications section of the manual for more power A system with a PCI Express x16 slot (two FCI B2B x8 connectors) is required for installing the card. -
Page 18: Adapter Cards Installation Instructions
Please note that if the card is removed hastily from the antistatic bag, the plastic ziplock may harm the EMI fingers on the networking connector. Carefully remove the card from the antistatic bag to avoid damaging the EMI fingers. Shut down your system if active: Turn off the power to the system, and disconnect the power cord. -
Page 19: Cables And Modules
Applying even pressure on four corners of the card (as shown in the below picture), insert the adapter card into the PCI Express slot until firmly seated. Secure the adapter with the adapter clip or screw. To uninstall the adapter card, see Uninstalling the Card. -
Page 20: Identifying The Card In Your System
All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated. Support the weight of the cable before connecting the cable to the adapter card. Do this by using a cable holder or tying the cable to the rack. -
Page 21: Adapter Cards Extraction Instructions
PCI Device (Example) In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of Mellanox Technologies; and DEV is equal to 1018 (for ConnectX-5) –... -
Page 22: Card Extraction
Card Extraction Please note that the following images are for illustration purposes only. Verify that the system is powered off and unplugged. Wait 30 seconds. To remove the card, disengage clip 1 and 2 on connector A side. To disconnect connector A, gently pull the adapter card upwards. Disengage clip 3 and clip 4 on the adapter card on Connector B side. - Page 23 6. To remove the card, gently pull the adapter card upwards.
-
Page 24: Driver Installation
Driver Installation Please use the relevant driver installation section. • Windows Driver Installation • Linux Driver Installation • VMware Driver Installation Windows Driver Installation For Windows, download and install the latest Mellanox WinOF-2 for Windows software package available via the Mellanox web site at: http://www.mellanox.com > Products > Software > Ethernet Drivers >... -
Page 25: Installing Mellanox Winof-2 Driver
Go to the Mellanox WinOF-2 web page at http://www.mellanox.com > Products > Ethernet Drivers > Windows SW/Drivers. Download the exe image according to the architecture of your machine (see Step 1). The name of the .exe is in the following format: MLNX_WinOF2-<version>_x<arch>.exe. Installing the incorrect exe file is prohibited. If you do so, an error message will be displayed. For example, if you try to install a 64-bit executable file on a 32-bit machine, the wizard will display the following (or a similar) error message: “The installation package is not supported by this processor type. - Page 26 Click Next in the Welcome screen. Read and accept the license agreement and click Next. Select the target folder for the installation.
- Page 27 The firmware upgrade screen will be displayed in the following cases: • If the user has an OEM card. In this case, the firmware will not be displayed. • If the user has a standard Mellanox card with an older firmware version, the firmware will be updated accordingly.
- Page 28 Select a Complete or Custom installation, follow Step a onward. Select the desired feature to install: • Performances tools - install the performance tools that are used to measure performance in user environment • Documentation - contains the User Manual and Release Notes • Management tools - installation tools used for management, such as mlxstat •...
- Page 29 9. Click Install to start the installation. 10. In case firmware upgrade option was checked in Step 7, you will be notified if a firmware upgrade is required (see ). 11. Click Finish to complete the installation.
-
Page 30: Unattended Installation
Unattended Installation If no reboot options are specified, the installer restarts the computer whenever necessary without displaying any prompt or warning to the user. To control the reboots, use the /norestart or /forcerestart standard command-line options. The following is an example of an unattended installation session. -
Page 31: Installation Results
Installation Results Upon installation completion, you can verify the successful addition of the network card(s) through the Device Manager. The inf files can be located at: %ProgramFiles%\Mellanox\MLNX_WinOF2\Drivers\ To see the Mellanox network adapters, display the Device Manager and pull down the “Network adapters”... -
Page 32: Extracting Files Without Running Installation
Open a CMD console. (Click Task Manager > File > Run new task, and enter CMD.) To uninstall the driver, run: MLNX_WinOF2-2_0_All_x64.exe /S /x /v"/qn" Extracting Files Without Running Installation To extract the files without running installation, perform the following steps: Open a CMD console-> Click Start-> Task Manager-> File-> Run new task-> and enter CMD. Extract the driver and the tools: MLNX_WinOF2-2_0_<revision_version>_All_x64 /a To extract only the driver file... - Page 33 Click Install to extract this folder, or click Change to install to a different folder. ...
-
Page 34: Firmware Upgrade
To complete the extraction, click Finish. Firmware Upgrade If the machine has a standard Mellanox card with an older firmware version, the firmware will be automatically updated as part of the WinOF-2 package installation. For information on how to upgrade firmware manually, please refer to the MFT User Manual at www.m ellanox.com >Products >... -
Page 35: Downloading Mellanox Ofed
Requirements Description Device ID For the latest list of device IDs, please visit the Mellanox website at http://www.mellanox.com/page/ firmware_HCA_FW_identification. Operating System Linux operating system. For the list of supported operating system distributions and kernels, please refer to the Mellanox OFED Release Notes file. - Page 36 a path to the folder that contains the FW binary files, by running . Using this --fw-image-dir option, the FW version embedded in the MLNX_OFED package will be ignored. Example: ./mlnxofedinstall --fw-image-dir /tmp/my_fw_bin_files Usage ./mnt/mlnxofedinstall [OPTIONS] Pre-existing configuration files will be saved with the extension “.conf.rpmsave”. The installation script removes all previously installed Mellanox OFED packages and re-installs from scratch.
-
Page 37: Installation Procedure
For your machine to be part of the InfiniBand/VPI fabric, a Subnet Manager must be running on one of the fabric nodes. At this point, Mellanox OFED for Linux has already installed the OpenSM Subnet Manager on your machine. For the list of installation options, run: ./mlnxofedinstall --h ... - Page 38 In case your machine has the latest firmware, no firmware update will occur and the installation script will print at the end of installation a message similar to the following: Device #1: ---------- Device Type: ConnectX-5 Ex Part Number: MCX546A-CDAN Description: ConnectX®-5 Ex network interface card for OCP, 100GbE dual-port QSFP28,...
-
Page 39: Installation Results
Installation Results Software • Most of MLNX_OFED packages are installed under the “/usr” directory except for the following packages which are installed under the “/opt” directory: • fca and ibutils • The kernel modules are installed under • /lib/modules/`uname -r`/updates on SLES and Fedora Distributions •... -
Page 40: Driver Load Upon System Boot
An example of OPENIBD_POST_START script for activating all interfaces is provided in the MLNX_OFED package under the docs/scripts/openibd-post-start-configure-interfaces/ folder. Driver Load Upon System Boot Upon system boot, the Mellanox drivers will be loaded automatically. To prevent the automatic load of the Mellanox drivers upon system boot: Add the following lines to the "/etc/modprobe.d/mlnx.conf"... -
Page 41: Setting Up Mlnx_Ofed Yum Repository
Setting up MLNX_OFED YUM Repository Log into the installation machine as root. Mount the ISO image on your machine and copy its content to a shared location in your network. # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt Download and install Mellanox Technologies GPG-KEY: The key can be downloaded via the following link: http://www.mellanox.com/downloads/ofed/ RPM-GPG-KEY-Mellanox... - Page 42 # yum search mlnx-ofed- mlnx-ofed-all.noarch : MLNX_OFED all installer package (with KMP support) mlnx-ofed-basic.noarch : MLNX_OFED basic installer package (with KMP support) mlnx-ofed-guest.noarch : MLNX_OFED guest installer package (with KMP support) mlnx-ofed-hpc.noarch : MLNX_OFED hpc installer package (with KMP support) mlnx-ofed-hypervisor.noarch : MLNX_OFED hypervisor installer package (with KMP support)
-
Page 43: Uninstalling Mlnx_Ofed Using The Yum Tool
Uninstalling MLNX_OFED Using the YUM Tool Use the script /usr/sbin/ofed_uninstall.sh to uninstall the Mellanox OFED package. The script is part of the ofed-scripts RPM. Installing MLNX_OFED Using apt-get Tool This type of installation is applicable to Debian and Ubuntu operating systems. Setting up MLNX_OFED apt-get Repository Log into the installation machine as root. -
Page 44: Uninstalling Mlnx_Ofed Using The Apt-Get Tool
2. Install the desired group. # apt-get install '<group name>' Example: # apt-get install mlnx-ofed-all Installing MLNX_OFED using the “apt-get” tool does not automatically update the firmware. To update the firmware to the version included in MLNX_OFED package, run: # apt-get install mlnx-fw-updater Or, update the firmware to the latest version available on Mellanox Technologies’... -
Page 45: Updating The Device Firmware Automatically Upon System Boot
In case that you ran the mlnxofedinstall script with the ‘--without-fw-update’ option or you are using an OEM card and now you wish to (manually) update firmware on your adapter card(s), you need to perform the steps below. The following steps are also appropriate in case that you wish to burn newer firmware that you have downloaded from Mellanox Technologies’... -
Page 46: Removing Signature From Kernel Modules
Secure Boot key database and loaded onto the system key ring by the kernel. Follow these steps below to add the Mellanox's x.509 public key to your system: Prior to adding the Mellanox's x.509 public key to your system, please make sure that (1) The 'mokutil' package is installed on your system, and (2) The system is booted in UEFI mode. -
Page 47: Performance Tuning
Update the initramfs on RHEL systems with the stripped modules. mkinitrd /boot/initramfs-$(uname -r).img $(uname -r) --force Performance Tuning Depending on the application of the user's system, it may be necessary to modify the default configuration of network adapters based on the ConnectX® adapters. In case that tuning is required, please refer to the Performance Tuning Guide for Mellanox Network Adapters at https:// community.mellanox.com/docs/DOC-2489. -
Page 48: Removing Earlier Mellanox Drivers
Verify the driver was installed successfully. esxcli software vib list | grep nmlx nmlx5-core 4.16.8.8-1OEM.650.0.0.4240417 PartnerSupported 2017-01-31 nmlx5-rdma 4.16.8.8-1OEM.650.0.0.4240417 PartnerSupported 2017-01-31 After the installation process, all kernel modules are loaded automatically upon boot. Removing Earlier Mellanox Drivers Please unload the previously installed drivers before removing them. To remove all the drivers: Log into the ESXi server with root permissions. -
Page 49: Updating Adapter Firmware
Updating Adapter Firmware Each adapter card is shipped with the latest version of qualified firmware at the time of manufacturing. However, Mellanox issues firmware updates occasionally that provide new features and bug fixes. To check that your card is programmed with the latest available firmware version, download the mlxup firmware update and query utility. -
Page 50: Troubleshooting
Troubleshooting General Troubleshooting Server unable to find the adapter • Ensure that the adapter is placed correctly • Make sure the adapter slot and the adapter are compatible Install the adapter in a different PCI Express slot • Use the drivers that came with the adapter or download the latest •... -
Page 51: Windows Troubleshooting
Mellanox Firmware Tool (MFT) Download and install MFT: http://www.mellanox.com/ content/pages.php?pg=management_tools&menu_section=34 Refer to the User Manual for installation instructions. Once installed, run: mst start mst status flint -d <mst_device> q Ports Information ibstat ibv_devinfo Firmware Version Upgrade To download the latest firmware version refer to http:// www.mellanox.com/supportdownloader Collect Log File... -
Page 52: Specifications
Specifications MCX542A-ACAN Specifications Size: 3.07 in. x 4.33 in (78.00mm x 110.05mm) Physical Connector: Dual SFP28 Ethernet (copper and optical) Ethernet: 25GBASE-CR/CR-S, 25GBASE-SR, 25GBASE-LR, 25G Ethernet Consortium, Protocol Support 10GBASE-SR, 10GBASE-LR, 10GBASE-ER, SGMII / 1000BASE-X Data Rate: 1/10/25 Gb/s Ethernet PCI Express Gen3: SERDES @ 8.0GT/s (respectively), 16 lanes (2.0 and 1.1 compatible) Voltage: 3.3V_PCI, 3.3V_AUX, 5V_AUX, 12V Power Power... -
Page 53: Mcx542B-Ac[A/U]N Specifications
MCX542B-AC[A/U]N Specifications Mellanox recommends populating MCX542B-ACAN in a standard PCIe x8 OCP connector which exposes PCIe lanes in a straight manner. In case the OCP slot exposes PCIe lanes in a reversed manner, MCX542B-ACAN supports automatic lane reversal with FW image from April 2019 release and above. ... -
Page 54: Mcx545B-Gcun Specifications
a. Typical power for ATIS traffic load. b. For both operational and non-operational states. c. Airflow is measured on ambient 55°. MCX545B-GCUN Specifications Size: 3.07 in. x 4.33 in (78.00mm x 110.05mm) Physical Connector: Single QSFP28 Ethernet (copper and optical) Ethernet: 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, Protocol 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR, Support... -
Page 55: Mcx545B-Ccun Specifications
MCX545B-CCUN Specifications Size: 3.07 in. x 4.33 in (78.00mm x 110.05mm) Physical Connector: Single QSFP28 Ethernet (copper and optical) Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 50GBASE-R2, 50GBASE-R4, Protocol 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, Support 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR Data Rate: 1/10/25/40/50/100 Gb/s PCI Express Gen3: SERDES @ 8.0GT/s (respectively), 16 lanes (2.0 and 1.1 compatible) -
Page 56: Mcx545A-Ccan And Mcx545A-Ccun Specifications
MCX545A-CCAN and MCX545A-CCUN Specifications Size: 3.07 in. x 4.33 in (78.00mm x 110.05mm) Physical Connector: Single QSFP28 Ethernet (copper and optical) Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 50GBASE-R2, 50GBASE-R4, Protocol 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, Support 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR Data Rate: 1/10/25/40/50/100 Gb/s PCI Express Gen3: SERDES @ 8.0GT/s (respectively), 16 lanes (2.0 and 1.1 compatible) Voltage: 3.3VAUX, 5VAUX, 12V... -
Page 57: Mcx546A-Bcan Specifications
MCX546A-BCAN Specifications Size: 3.07 in. x 4.33 in (78.00mm x 110.05mm) Physical Connector: Dual QSFP28 Ethernet (copper and optical) Ethernet: 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, Protocol 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, Support 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR Data Rate: 1/10/25/40 Gb/s PCI Express Gen3/4: SERDES @ 8.0GT/s / 16.0GT/s (respectively), 16 lanes (2.0 and 1.1 compatible) Voltage: 3.3VAUX, 5VAUX, 12V... -
Page 58: Mcx546A-Cdan Specifications
MCX546A-CDAN Specifications Size: 3.07 in. x 4.33 in (78.00mm x 110.05mm) Physical Connector: Dual QSFP28 Ethernet (copper and optical) Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 50GBASE-R2, 50GBASE-R4, Protocol 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, Support 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR Data Rate: 1/10/25/40/50/100 Gb/s PCI Express Gen3/4: SERDES @ 8.0GT/s/16Gt/s, 16 lanes (2.0 and 1.1 compatible) Note: PCIe 4.0 x16 bus can supply a maximum bandwidth of 256Gb/s only (=16 * 16GT/s,... -
Page 59: Board Mechanical Drawing And Dimensions
Board Mechanical Drawing and Dimensions All dimensions are in millimeters. All the mechanical tolerances are +/- 0.1mm. For the 3D Model of the card, please refer to 3D Models at http://www.mellanox.com/page/ 3d_models. MCX542A-ACAN Mechanical Drawing and Dimensions MCX542B-ACAN Mechanical Drawing and Dimensions... - Page 60 MCX545B-CCUN Mechanical Drawing and Dimensions MCX545A-CCAN and MCX545A-CCUN Mechanical Drawing and Dimensions...
- Page 61 MCX546A-CDAN and MCX546A-BCAN Mechanical Drawing and Dimensions...
-
Page 63: Finding The Mac And Serial Number On The Adapter Card
Finding the MAC and Serial Number on the Adapter Card Each Mellanox adapter card has a different identifier printed on the label: serial number and the card MAC for the Ethernet protocol. The product revisions indicated on the labels in the following figures do not necessarily represent the latest revisions of the card. -
Page 64: Document Revision History
Apr. 2020 Added MCX545A-CCUN support across the document. Feb. 2020 Added altitude criteria to "Specifications". Jan. 2020 Added MCX545B-CCUN support across the document. Oct. 2019 Updated the supported Ethernet protocols in "Specifications". Oct. 2019 Updated board labels in "Finding the MAC and Serial Number on the Adapter Card". - Page 65 NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.
- Page 66 NVIDIA, the NVIDIA logo, and Mellanox are trademarks and/or registered trademarks of Mellanox Technologies Ltd. and/or NVIDIA Corporation in the U.S. and in other countries. Other company and product names may be trademarks of the respective companies with which they are associated.