Nvidia 900-9X658-0076-MB0 User Manual
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Network Card
  5. 900-9X658-0076-MB0
  6. User manual
Nvidia 900-9X658-0076-MB0 User Manual

Nvidia 900-9X658-0076-MB0 User Manual

Connectx-6 dx ethernet adapter cards for ocp spec 3.0
Hide thumbs Also See for 900-9X658-0076-MB0:
Table of Contents

Advertisement

Quick Links

Download this manual
NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP
Spec 3.0 User Manual

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the 900-9X658-0076-MB0 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Nvidia 900-9X658-0076-MB0

Summary of Contents for Nvidia 900-9X658-0076-MB0

  • Page 1 NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 2: Table Of Contents

    Monitoring Monitoring Finding the MAC and Serial Number on the Adapter Card Finding the MAC and Serial Number on the Adapter Card Document Revision History Document Revision History NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 3 In some of the OCP 3.0 prototype samples, the insertion force that is required to install the card into a particular PCI connector may exceed the maximum insertion force that is allowed by the connector’s spec. NVIDIA is updating the OCP 3.0 cards to ensure the proper insertion process.
  • Page 4 Thumbscr ew (Pull Tab) Bracket MCX623436AC-CDAB ConnectX® 900-9X658-0086-SB0 -6 Dx EN adapter card, 100GbE, OCP3.0, With Host Manageme nt, Dual- port QSFP56, PCIe 4.0 x16, Crypto and Secure NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 5 (Pull Tab) Bracket 900-9X658-0046-SI0 MCX623435AC-CDAI ConnectX- 6 Dx EN adapter card, 100GbE, OCP3.0, With Host Manageme nt, Single- port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Internal NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 6 IPsec tra c, please refer to the NVIDIA ConnectX-6 Dx Cards Product Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.
  • Page 7 Management, Single-port QSFP56, MCX623439MC-CDAB Multi-Host or Socket Direct, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket 900-9X624-0083- MCX623432AC-ADAB ConnectX®-6 Dx EN adapter card, 25GbE, OCP3.0, With Host NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 8 Ethernet network and architecture speci cations. Technical Support Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods: NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 9 URL: https://www.nvidia.com > Support E-mail: enterprisesupport@nvidia.com Customers who purchased NVIDIA Global Support Services, please see your contract for details regarding Technical Support. Customers who purchased NVIDIA products through an NVIDIA-approved reseller should rst seek assistance through their reseller. Related Documentation...
  • Page 10 When discussing memory sizes, MB and MBytes are used in this document to mean size in MegaBytes. The use of Mb or Mbits (small b) indicates the size in Megabits. In this document, PCIe is used to mean PCI Express. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 11: Introduction

    In some of the OCP 3.0 prototype samples, the insertion force that is required to install the card into a particular PCI connector may exceed the maximum insertion force that is allowed by the connector’s spec. NVIDIA is updating the OCP 3.0 cards to ensure the proper insertion process.
  • Page 12 Small Form Factor (SFF) OCP 3.0 Dimensions 4.52 in. x 2.99 in (115.00mm x 76.00mm) Thumbscrew Retention Thumbscrew (Pull Tab) (Pull Tab) Internal Lock Bracket Mechanism Bracket Bracket NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 13 QSFP QSFP QSFP QSFP Ethe rnet 10/25/40/50/100 Gb/s Rate PCIe Gen 3.0 / 4.0 x16 Expr SERDES @ 8.0GT/s / 16.0GT/s NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 14 Part 8928 8928 8928 8928 8928 8928 8928 8928 8928 8928 8928 8928 XCCF XCCF XCCF XCCF F-CE F-CE F-CE F-CE F-CE F-CE F-CE F-CE Cryp NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 15 4.52 in. x 2.99 in (115.00mm x 76.00mm) Retention Thumbscrew (Pull Tab) Thumbscrew (Pull Tab) Internal Lock Mechanism Bracket Bracket Bracket RoHS RoHS Compliant RoHS Compliant RoHS Compliant MT28928A0- IC Part Number MT28928A0-XCCF-CE MT28928A0-XCCF-CE XCCF-CE NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 16 Gigabit Ethernet, supporting all FEC modes • IEEE 802.3ba 40 Gigabit Ethernet • IEEE 802.3by 25 Gigabit Ethernet • IEEE 802.3ae 10 Gigabit Ethernet • IEEE 802.3ap based auto-negotiation and KR startup NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 17 Converged Ethernet) technology, delivers low-latency and high-performance over Band and Ethernet networks. Leveraging data center bridging (DCB) capabilities as well as ConnectX®-6 Dx advanced congestion control hardware NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 18 • NVMe over Fabric o oads for the target machine ConnectX®-6 Dx SR-IOV technology provides dedicated adapter resources and SR-IOV guaranteed isolation and protection for virtual machines (VM) within the server. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 19 NVIDIA Multi-Host ® ® NVIDIA Mellanox Multi-Host technology enables next-generation Cloud, Web 2.0 and high-performance data centers to design and build new scale-out heterogeneous compute and storage racks NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 20: Operating Systems/Distributions

    OpenFabrics Enterprise Distribution (OFED) OpenFabrics Windows Distribution (WinOF-2) Connectivity Interoperable with 1/10/25/40/50/100/200 Gb/s Ethernet switches Passive copper cable with ESD protection Powered connectors for optical and active cable support NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 21: Interfaces

    Interfaces The below gures show the component side of the NVIDIA ConnectX-6 Dx adapter card. Each numbered interface referenced in the gure is described in the following table with a link to detailed information. Note The ConnectX-6 Dx adapter card includes special circuits to protect from ESD shocks to the card/server when plugging copper cables.
  • Page 22 ConnectX-6 Dx IC 6 Dx IC on the board. PCIe Gen 3.0/4.0 PCI Express Interface through an x16 edge connector. Ethernet Networking Interface Ethernet tra c is transmitte d through NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 23 Networking Ports LEDs Interface LED1, per port to indicate speed and link status. EEPROM FRU EEPROM capacity SMBus Interface Allows connectivit y using MCTP over SMBus or MCTP over NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 24 Purpose-built inline acceleration engines that o oad IPsec and TLS data-in-motion and XTS-AES data-at-rest cryptographic operations. Stateful rewall solution acceleration, powered by Open vSwitch connection tracking and NVIDIA's ASAP2 technology. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 25 200GbE interconnect for up to four independent hosts without any performance degradation. The gure below shows a ConnectX-6 Dx device with NVIDIA Multi-Host connected to four separate hosts, each with a PCIe x4 interface, on one side to a switch on the other side.
  • Page 26 NVIDIA OCP 3.0 Multi-host adapter drives 0100 on PRSNTB[3:0]# to the server. If Server Drivers Adapter PCIe Mode Single-Host Mode: x1 PCIe x16 Socket Direct Mode: x2 PCIe x8 Socket Direct Mode: x4 PCIe x4 Multi-Host Mode: x2 PCIe x8...
  • Page 27 Error Type Description LED Behavior C access Blinks until the to the error is xed networking ports fails Over- Over- Blinks until the current current error is xed condition NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 28: Smbus Interface

    ConnectX®-6 Dx OCP 3.0 adapter can be connected to a BMC using MCTP over SMBus or MCTP over PCIe protocols as if it is a standard NVIDIA OCP 3.0 adapter. For con guring the adapter for the server's speci c manageability solution, please contact NVIDIA Support.
  • Page 29 ConnectX®-6 Dx IC has a thermal shutdown safety mechanism that automatically shuts down the ConnectX®-6 Dx card in case of a high-temperature event, improper thermal coupling, or heatsink removal. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 30: Hardware Installation

    Over-temperature This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended: 55°C (131°F). An air ow of 200LFM at this NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 31 The disposal of this equipment should be in accordance to all national laws and regula ‐ tions. Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 32: Installation Procedure Overview

    Precaution Refer to Pre- Follow the pre-installation checklist Installation Checklist (Optional) Replace the assembled Refer to OCP 3.0 bracket with the desired OCP 3.0 form factor bracket Bracket NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 33: System Requirements

    (particulate) contamination levels. The operating environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness level. Hardware Requirements Warning NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 34 All cards in the system should be planned with the same air ow direction. Hot Aisle Cooling Cold Aisle Cooling Heatsink-to-port Air ow Direction Port-to-heatsink Air ow Direction NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 35: Software Requirements

    1. Remove any metallic objects from your hands and wrists. 2. Make sure to use only insulated tools. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 36: Pre-Installation Checklist

    Installation Instructions. If you need to replace the assembled OCP 3.0 bracket with a di erent form- factor bracket, please follow the instructions in this section. Warning NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 37 1. Using the torx tool type listed in the below table, remove the screws according to the instructions per OCP 3.0 bracket type. Ejector- Internal Lock Bracket Pull-tab (Thumbscrew) Bracket Latch Bracket 2. Gently separate the bracket from the OCP 3.0 card. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 38 Installing the New Bracket 1. Assemble the new bracket onto the card. Internal Lock Bracket Pull-tab Bracket Ejector-Latch Bracket Warning Do not force the bracket onto the adapter card. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 39 This section provides detailed instructions on installing your adapter card in a system. The below table lists the di erent ConnectX-6 Dx OCP 3.0 retention mechanisms and o ers direct links to installation instructions per bracket type. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 40 1. Before installing the card, ensure the system is o , and the power cord is not connected to the server. Please follow proper electrical grounding procedures. 2. Open the system case. 3. Align the card with the system rails. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 41 4. Push the card until connectors are in full mate. 5. Turn the captive screw clockwise until rmly locked. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 42 1. Before installing the card, ensure the system is o , and the power cord is not connected to the server. Please follow proper electrical grounding procedures. 2. Open the system case. 3. Align the card with the system rails. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 43 Please follow proper electrical grounding procedures. 2. Open the system case. 3. Align the card with the system rails while ensuring the ejector latch is open. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 44 4. Push the card until connectors are in full mate. Make sure the ejector latch is open before inserting the card. 5. To secure the card, close the ejector. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 45 To uninstall the adapter card, see Uninstalling the Card. Cables and Modules To obtain the list of supported NVIDIA cables for your adapter, please refer to the Cables Reference Table at http://www.nvidia.com/products/interconnect/cables-con gurator.php. Cable Installation 1. All cables can be inserted or removed with the unit powered on.
  • Page 46 Get the device location on the PCI bus by running lspci and locating lines with the string "Mellanox Technologies": lspci |grep -i Mellanox ConnectX-6 Dx Network controller: Mellanox Technologies MT28800 Family [ NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 47 5. In the Value display box, check the elds VEN and DEV ( elds are separated by '&'). In the display example above, notice the sub-string "PCI\VEN_15B3&DEV_1003": VEN is equal to 0x15B3 – this is the Vendor ID of NVIDIA; DEV is equal to 1018 (for ConnectX-6 Dx) – this is a valid NVIDIA PCI Device ID.
  • Page 48 Note The list of NVIDIA PCI Device IDs can be found in the PCI ID repository at http://pci-ids.ucw.cz/read/PC/15b3. Card Extraction Instructions Safety Precautions The adapter is installed in a system that operates with voltages that can be lethal. Before uninstalling the adapter card, please observe the following precautions to avoid injury and prevent damage to system components.
  • Page 49 4. While holding the tab, carefully pull out the adapter card. Cards with Internal-Lock Bracket Extraction Info Please note that the following images are for illustration purposes only. 1. Verify that the system is powered o and unplugged. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 50 Please note that the following images are for illustration purposes only. 1. Verify that the system is powered o and unplugged. 2. Wait 30 seconds. 3. Open the ejector latch. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 51 4. Gently extract the adapter card from the server. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 52: Driver Installation

    (root) privileges on the target machine. Downloading MLNX_OFED 1. Verify that the system has a NVIDIA network adapter installed. The following example shows a system with an installed NVIDIA adapter card: NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 53: Vmware Driver Installation

    Subsystem: Mellanox Technologies Device 0014 86:00.1 Network controller [0207]: Mellanox Technologies Family Subsystem: Mellanox Technologies Device 0014 For Linux driver installation, please refer to NVIDIA DOCA Installation Guide for Linux. VMware Driver Installation This section describes VMware Driver Installation. Hardware and Software Requirements...
  • Page 54 650.0 0.4240417 PartnerSupported 2017 nmlx5-rdma -1OEM. 4.16 650.0 0.4240417 PartnerSupported 2017 Note After the installation process, all kernel modules are loaded automatically upon boot. Removing Earlier NVIDIA Drivers NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 55: Firmware Programming

    4. Reboot the server. Firmware Programming 1. Download the VMware bootable binary images v4.6.0 from the Firmware Tools (MFT) site. 1. ESXi 6.5 File: mft-4.6.0.48-10EM-650.0.0.4598673.x86_64.vib 2. MD5SUM: 0804c e30913a7b4017445a0f0adbe1 NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 56: Windows Driver Installation

    Windows Driver Installation For Windows, download and install the latest WinOF-2 for Windows software package available via the NVIDIA website at: WinOF-2 webpage. Follow the installation instructions included in the download package (also available from the download page). The snapshots in the following sections are presented for illustration purposes only. The installation interface may slightly vary, depending on the operating system in use.
  • Page 57 On an x64 (64-bit) machine, the output will be “AMD64”. 2. Go to the WinOF-2 web page at: https://www.nvidia.com/en-us/networking/ > Products > Software > In niBand Drivers (Learn More) > Nvidia WinOF-2. 3. Download the .exe image according to the architecture of your machine (see Step 1).

  • Page 58: Attended Installation

    MLNX_WinOF2_<revision_version>_All_Arch.exe /v " MT_DISABLE_RSHIM_INSTALL=1" Note The Rshim driver installanion will fail if a prior Rshim driver is already installed. The following fail message will be displayed in the log: NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 59 5. [Optional] If you want to skip the check for unsupported devices, run. MLNX_WinOF2_<revision_version>_All_Arch.exe /v " SKIPUNSUPPORTEDDEVCHECK=1" 6. Click Next in the Welcome screen. 7. Read and accept the license agreement and click Next. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 60 If the user has an OEM card. In this case, the rmware will not be displayed. If the user has a standard NVIDIA® card with an older rmware version, the rmware will be updated accordingly. However, if the user has both an OEM...
  • Page 61 NVIDIA® card, only the NVIDIA® card will be updated. 10. Select a Complete or Custom installation, follow Step a onward. 1. Select the desired feature to install: Performances tools - install the performance tools that are used to measure performance in user environment NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 62 Management tools - installation tools used for management, such as mlxstat Diagnostic Tools - installation tools used for diagnostics, such as mlx5cmd 2. Click Next to install the desired tools. 11. Click Install to start the installation. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 63 12. In case rmware upgrade option was checked in Step 7, you will be noti ed if a rmware upgrade is required (see 13. Click Finish to complete the installation. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 64: Unattended Installation

    The following is an example of an unattended installation session. 1. Open a CMD console-> Click Start-> Task Manager File-> Run new task-> and enter CMD. 2. Install the driver. Run: NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 65 5. [Optional] If you do not wish to upgrade your rmware version (i.e., MT_SKIPFWUPGRD default value is False ). MLNX_WinOF2-[Driver/Version]_<revision_version>_All_Arch.exe /vMT_SKIPFWUPGRD= 6. [Optional] If you do not want to install the Rshim driver, run. MLNX_WinOF2_<revision_version>_All_Arch.exe /v " MT_DISABLE_RSHIM_INSTALL=1" Note NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 66: Firmware Upgrade

    SKIPUNSUPPORTEDDEVCHECK=1" Firmware Upgrade If the machine has a standard NVIDIA® card with an older rmware version, the rmware will be automatically updated as part of the NVIDIA® WinOF-2 package installation. For information on how to upgrade rmware manually, please refer to MFT User Manual.

  • Page 67: Updating Adapter Firmware

    To check that your card is programmed with the latest available rmware version, download the mlxup rmware update and query utility. The utility can query for available NVIDIA adapters and indicate which adapters require a rmware update. If the user con rms, mlxup upgrades the rmware using embedded images. The latest mlxup executable and documentation are available in mlxup - Update and Query Utility .
  • Page 68   Perform FW update? [y/N]: y Device #1: Up to date Device #2: Updating FW ... Done   Restart needed for updates to take effect. Log File: /var/log/mlxup/mlxup-yyyymmdd.log NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 69: Troubleshooting

    Reboot the server Try removing and re-installing all adapters Check that cables are connected Adapters stopped working after installing properly another adapter Make sure your motherboard has the latest BIOS NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 70 Active Optical Cable (AOC) or transceiver to Direct Attached Copper (DAC) connectivity. Linux Troubleshooting Environment Information cat /etc/issue uname -a cat /proc/cupinfo | grep ‘model name’ | uniq NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 71: Windows Troubleshooting

    Export option from the File menu. Assign a le name and save. Mellanox Firmware Tool (MFT) Download and install MFT: MFT Documentation Refer to the User Manual for installation instructions. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 72 < rmware_bin_ le> b Event log viewer MST device logs: mst start mst status Collect Log File int –d <mst_device> dc > dump_con guration.log mstdump <mst_device> dc > mstdump.log NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 73: Speci Cations

    Active Module Power x Number_of_Modules / 0.9 (e ciency factor). MCX623432AE-ADAB / MCX623432AN-ADAB / MCX623432AC-ADAB / MCX623432AS-ADAB Speci cations Physical Form Factor: Small Form Factor (SFF) OCP 3.0 Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm) NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 74 Cable 400LFM 100LFM Air ow Active 0.8W 400LFM 100LFM NVIDIA Cable Active 1.5W 500LFM 150LFM Cable Environme Operationa 0°C to 55°C ntal Temperatu Non- -40°C to 70°C operational NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 75 MCX623432AC-GDAB: Crypto Enabled, Secure Boot Capabilitie MCX623432AN-GDAB: Crypto Disabled, No Secure Boot MCX623432AS-GDAI: Crypto Disabled, Secure Boot Power and Voltage: 3.3VAUX, 12V Air ow Power Cable Type Active Mode Standby Mode NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 76 RoHS RoHS compliant a. Typical power for ATIS tra c load. b. The non-operational storage temperature speci cations apply to the product without its package. MCX623435MN-CDAB Speci cations NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 77 Passive Cable 100LFM 300LFM 100LFM @55 ° C Active 2.2W 700LFM 200LFM 300LFM 100LFM NVIDIA Cable @55 ° C Active 3.5W 700LFM 300LFM 300LFM 100LFM Cable @50 ° C NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 78 Protocol Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 100GBASE- Support CR2, 100GBASE-KR2, 100GBASE-SR2, 50GBASE-R2, 50GBASE-R4, 40GBASE-CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 79 3050m Safety CB / cTUVus / CE Regulator CE / FCC / VCCI / ICES / RCM RoHS RoHS compliant a. Typical power for ATIS tra c load. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 80 Voltage: 3.3VAUX, 12V Power Cable Type Active Mode Standby Mode Air o Typic Passive 5.7W Cables Power Maxi Passive 26.6W Cables Power Maximum power available through QSFP56 port: 5W NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 81 If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec tra c, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth...
  • Page 82 Cables Power Maximum Passive 26.6W Power Cables Maximum power available through QSFP56 port: 5W Air ow Cable Type Hot Aisle Cold Aisle HSK to Port Port to HSK NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 83 Form Factor: Small Form Factor (SFF) OCP 3.0 Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm) Connector: Dual DSFP Ethernet (copper and optical) Reten Thumbscrew (Pull Tab) Bracket tion NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 84 Standby Active Standby Active Mode Mode Mode Mode @45C @35C @35C Air o 350LF Passive 100LFM 150LFM 100LFM Cable @55C Active 400LF 2.5W 200LFM 200LFM 100LFM Cables @45C NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 85 : Crypto enabled, Secure Boot enabled, with Host Management MCX623435AE-CDAB: Crypto enabled, Secure Boot disabled, with Capabilitie Host Management MCX623435AN-CDAB: Crypto disabled, Secure Boot disabled, with Host Management NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 86 NVIDIA Cable Active 3.5W 300LFM 250LFM 100LFM 700LFM Cable Environme Operationa 0°C to 55°C ntal Temperatu Non- -40°C to 70°C operational Humidity Operationa 10% to 85% relative humidity NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 87 IPsec tra c, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.
  • Page 88 Humidity Non- operational 10% to 90% relative humidity Altitude (Operation 3050m Regulator Safety CB / cTUVus / CE CE / FCC / VCCI / ICES / RCM NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 89 All dimensions are in millimeters. The PCB mechanical tolerance is +/- 0.13mm. ConnectX- 6 Dx ConnectX-6 Dx SFP28/SFP56 OCP ConnectX-6 Dx Dual-Port QSFP56 Single-Port OCP 3.0 QSFP56 OCP 3.0 Bracket Mechanical Drawings and Dimensions NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 90 Note All dimensions are in millimeters. The bracket's mechanical tolerance is +/- 0.25mm. Single-port Dual-port SFP28/SFP56 Dual-port QSFP56 Thumbscrew QSFP56 Thumbscrew Bracket Bracket Thumbscre w Bracket NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 91: Monitoring

    ConnectX®-6 Dx card in case of a high-temperature event, improper thermal coupling, or heatsink removal. For the required air ow (LFM) per OPN, please refer to the Speci cations chapter. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 92: Finding The Mac And Serial Number On The Adapter Card

    Finding the MAC and Serial Number on the Adapter Card Each NVIDIA adapter card has a di erent identi er printed on the label: serial number and the card MAC for the Ethernet protocol. Note The product revisions indicated on the labels in the following gures do not necessarily represent the latest revisions of the cards.
  • Page 93 MCX623432AN-GDAB Board Label MCX623432AC-GDAB Board Label Example Example NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 94 NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 95 MCX623436AN-CDAB Board Label MCX623436AC-CDAB Board Label Example Example NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 96 MCX623435AN-VDAB Board Label MCX623435AC-VDAB Board Label Example Example NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 97 NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...

  • Page 98: Document Revision History

    Apr. 2021 MCX623436MS-CDAB. Mar. 2021 Added OPN MCX623432AS-ADAB. Feb. 2021 Added OPN MCX623439MC[/N]-CDAB. Added OPNs MCX623435AE-CDAB and Jan. 2021 MCX623435AN-CDAB Oct. 2020 Updated air ow numbers in Speci cations. NVIDIA ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual...
  • Page 99 NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.<br/><br/>No license, either expressed or implied, is granted under any NVIDIA patent right, copyright,...
  • Page 100 EXPRESSLY DISCLAIMS ALL IMPLIED WARRANTIES OF NONINFRINGEMENT, MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE. TO THE EXTENT NOT PROHIBITED BY LAW, IN NO EVENT WILL NVIDIA BE LIABLE FOR ANY DAMAGES, INCLUDING WITHOUT LIMITATION ANY DIRECT, INDIRECT, SPECIAL, INCIDENTAL, PUNITIVE, OR CONSEQUENTIAL DAMAGES, HOWEVER CAUSED AND REGARDLESS OF THE THEORY OF LIABILITY, ARISING OUT OF ANY USE OF THIS DOCUMENT, EVEN IF NVIDIA HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.

This manual is also suitable for:

Mcx623436ms-cdab

Table of Contents