Nvidia Mellanox ConnectX-6 Dx User Manual
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Computer Hardware
  5. Mellanox ConnectX-6 Dx Series
  6. User manual

Nvidia Mellanox ConnectX-6 Dx User Manual

Ethernet adapter cards for ocp spec 3.0
Hide thumbs Also See for Mellanox ConnectX-6 Dx:
Table of Contents

Advertisement

Quick Links

NVIDIA Mellanox ConnectX-6 Dx Ethernet
Adapter Cards for OCP Spec 3.0 User Manual
Exported on Oct/22/2020 06:48 PM
https://docs.mellanox.com/x/2wPjAQ

Advertisement

Table of Contents
loading

Related Manuals for Nvidia Mellanox ConnectX-6 Dx

Summary of Contents for Nvidia Mellanox ConnectX-6 Dx

  • Page 1 NVIDIA Mellanox ConnectX-6 Dx Ethernet Adapter Cards for OCP Spec 3.0 User Manual Exported on Oct/22/2020 06:48 PM https://docs.mellanox.com/x/2wPjAQ...

  • Page 2: Table Of Contents

    Table of Contents Table of Contents .......................2 Introduction........................9 Products Overview........................9 ConnectX-6 Dx 25GbE Adapter Cards for OCP 3.0 ............9 ConnectX-6 Dx 100GbE Adapter Cards for OCP 3.0 ............10 ConnectX-6 Dx 200GbE Adapter Cards for OCP 3.0 ............11 Features and Benefits......................11 Operating Systems/Distributions ..................
  • Page 3 Cables and Modules......................24 Identifying the Card in Your System ................24 Extraction Instructions..................... 25 Safety Precautions ...................... 21 Extraction Instructions....................25 Driver Installation ....................27 Windows Driver Installation....................27 Hardware and Software Requirements................27 Downloading Mellanox WinOF-2 Driver ................27 Installing Mellanox WinOF-2 Driver ................
  • Page 4 Setting up MLNX_OFED YUM Repository ..............43 Installing MLNX_OFED Using the YUM Tool .............. 44 Uninstalling MLNX_OFED Using the YUM Tool ............45 Installing MLNX_OFED Using apt-get Tool..............45 Setting up MLNX_OFED apt-get Repository .............. 45 Installing MLNX_OFED Using the apt-get Tool............45 Uninstalling MLNX_OFED Using the apt-get Tool.............
  • Page 5 Single-port QSFP56 Thumbscrew Bracket  ..............63 Finding the MAC and Serial Number on the Adapter Card ........64 Document Revision History ..................66...
  • Page 6 About This Manual This is the User Guide for NVIDIA® Mellanox® Ethernet ConnectX®-6 Dx adapter cards for Open Compute Project Spec 3.0. These adapters connectivity provide the highest performing low latency and most flexible interconnect solution for servers supporting OCP spec 3.0 adapter cards used in Enterprise Data Centers and High-Performance Computing environments.
  • Page 7 Intended Audience This manual is intended for the installer and user of these cards. The manual assumes basic familiarity with Ethernet network and architecture specifications. Technical Support Customers who purchased Mellanox products directly from Mellanox are invited to contact us through the following methods: •...
  • Page 8 Mellanox LinkX Mellanox LinkX cables and transceivers are designed to maximize the performance of Interconnect High-Performance Computing networks, requiring high-bandwidth, low-latency Solutions connections between compute nodes and switch nodes. Mellanox offers one of industry’s broadest portfolio of 40Gb/s, 56Gb/s, 100Gb/s and 200Gb/s cables, including Direct Attach Copper cables (DACs), copper splitter cables, Active Optical Cables (AOCs) and transceivers in a wide range of lengths from 0.5m to 10km.

  • Page 9: Introduction

    Introduction This is the User Guide for Mellanox Technologies Ethernet adapter cards based on the ConnectX®-6 Dx integrated circuit device for OCP Spec 3.0. These adapters connectivity provide the highest performing low latency and most flexible interconnect solution for servers supporting OCP 3.0 used in Enterprise Data Centers and High-Performance Computing environments. ...

  • Page 10: Connectx-6 Dx 100Gbe Adapter Cards For Ocp 3.0

    MCX623432AN-GDAB MCX623432AC-GDAB MCX623432AS-GDAI Network Connector Type Dual-port SFP56 Dual-port SFP56 Dual-port SFP56 Ethernet Data Rate 10/25/40/50 Gb/s PCI Express Connectors PCIe Gen 3.0 / 4.0 x16 SERDES @ 8.0GT/s / 16.0GT/s Dimensions Small Form Factor (SFF) OCP 3.0 4.52 in. x 2.99 in (115.00mm x 76.00mm) Retention Mechanism Thumbscrew (Pull Tab) Thumbscrew (Pull Tab)

  • Page 11: Connectx-6 Dx 200Gbe Adapter Cards For Ocp 3.0

    MCX623436AN- MCX623436AC- MCX623435MN- MCX623436AS- CDAB CDAB CDAB CDAI Device ID 4125 for Physical Function (PF) 4126 for Virtual Function (VF) ConnectX-6 Dx 200GbE Adapter Cards for OCP 3.0  MCX623435AN-VDAB MCX623435AC-VDAB MCX623435AS-VDAI Network Connector Type Single-port QSFP56 Single-port QSFP56 Single-port QSFP56 Ethernet Data Rate 10/25/40/50/100/200 Gb/s PCI Express Connectors PCIe Gen 3.0 / 4.0 x16...
  • Page 12 Feature Description Up to 200 Gigabit Mellanox adapters comply with the following IEEE 802.3 standards: Ethernet • 200GbE / 100GbE / 50GbE / 40GbE / 25GbE / 10GbE / 1GbE • IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet • IEEE 802.3by, Ethernet Consortium25, 50 Gigabit Ethernet, supporting all FEC modes •...

  • Page 13: Operating Systems/Distributions

    Feature Description Storage Acceleration A consolidated compute and storage network achieves significant cost-performance advantages over multi-fabric networks. Standard block and file access protocols can leverage RDMA for high-performance storage access. • NVMe over Fabric offloads for the target machine • Erasure Coding •...

  • Page 15: Interfaces

    Interfaces The below figures show the component side of the Mellanox ConnectX-6 Dx adapter card. Each numbered interface that is referenced in the figures is described in the following table with a link to detailed information.  The ConnectX-6 Dx adapter card includes special circuits to protect from ESD shocks to the card/server when plugging copper cables ...

  • Page 16: Connectx-6 Dx Ic

    Item Description “SMBus Interface” Allows BMC connectivity using MCTP over SMBus or MCTP over PCIe protocols. “Voltage Voltage supply pins that feed onboard regulators. Regulators” “CPLD Interface” Controls the networking port LEDs. ConnectX-6 Dx IC  The ConnectX®-6 Dx EN family of adapter IC devices delivers two ports of 10/25/40/50/100Gb/s or a single-port of 200Gb/s Ethernet connectivity paired with best-in-class hardware capabilities that accelerate and secure cloud and data-center workloads.

  • Page 17: Networking Ports Leds Interface

    Supported PCIe Interface Features PCIe Gen 3.0/4.0 (1.1 and 2.0 compatible) through x16 Link Rates: 2.5. 5.0, 8.0 or 16GT/s. edge connectors Auto Negotiation to: x16, x8, x4, x2 or x1. Support for MSI/MSI-X mechanisms. Networking Ports LEDs Interface There are two I/O LEDs, LED0 and LED1, per port to indicate speed and link status. LED0 is bicolor (yellow and green) LED and LED1 is a single color (green) LED.

  • Page 18: Smbus Interface

    SMBus Interface ConnectX®-6 Dx technology maintains support for manageability through a BMC. ConnectX®-6 Dx OCP 3.0 adapter can be connected to a BMC using MCTP over SMBus or MCTP over PCIe protocols as if it is a standard Mellanox OCP 3.0 adapter. For configuring the adapter for the specific manageability solution in use by the server, please contact Mellanox Support.

  • Page 19: Hardware Installation

    Hardware Installation Installation and initialization of ConnectX-6 Dx adapter cards for OCP Spec 3.0 require attention to the mechanical attributes, power specification, and precautions for electronic equipment. Safety Warnings  Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Adapter Installation Safety Instructions document available on...

  • Page 20: System Requirements

    System Requirements  Unless otherwise specified, Mellanox products are designed to work in an environmentally controlled data center with low levels of gaseous and dust (particulate) contamination. The operating environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness level.

  • Page 21: Safety Precautions

    • Software Stacks - Mellanox OpenFabric software package MLNX_OFED for Linux, WinOF-2 for Windows, and VMware. See the Driver Installation section. Safety Precautions  The adapter is being installed in a system that operates with voltages that can be lethal. Before opening the case of the system, observe the following precautions to avoid injury and prevent damage to system components.

  • Page 22: Ocp 3.0 Bracket Replacement Instructions

    OCP 3.0 Bracket Replacement Instructions Unable to render include or excerpt-include. Could not retrieve page. OCP 3.0 Adapter Card Installation Instructions This section provides detailed instructions on how to install your adapter card in a system.   Please note that the following figures are for illustration purposes only. Cards with Thumbscrew (Pull-tab) Bracket ...

  • Page 23: Cards With Internal Lock Bracket

    Cards with Internal Lock Bracket Before installing the card, make sure that the system is off and the power cord is not connected to the server. Please follow proper electrical grounding procedures. Open the system case. Align the card with the system rails. Push the card until connectors are in full mate and a clicking sound is heard.

  • Page 24: Cables And Modules

    Cables and Modules To obtain the list of supported Mellanox cables for your adapter, please refer to the Cables Reference Table at http://www.mellanox.com/products/interconnect/cables-configurator.php. Cable Installation All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated.

  • Page 25: Extraction Instructions

    On Windows Open Device Manager on the server. Click Start => Run, and then enter devmgmt.msc. Expand System Devices and locate your Mellanox ConnectX-6 Dx adapter card. Right click the mouse on your adapter's row and select Properties to display the adapter card properties window. Click the Details tab and select Hardware Ids (Windows 2012/R2/2016) from the Property pull- down menu.
  • Page 26 Remove any metallic objects from your hands and wrists. It is strongly recommended to use an ESD strap or other antistatic devices. Turn off the system and disconnect the power cord from the server. Extraction Instructions  Please note that the following images are for illustration purposes only. Verify that the system is powered off and unplugged.

  • Page 27: Driver Installation

    Driver Installation Please use the relevant driver installation section. • Windows Driver Installation • Linux Driver Installation • VMware Driver Installation Windows Driver Installation For Windows, download and install the latest Mellanox WinOF-2 for Windows software package available via the Mellanox web site at: http://www.mellanox.com > Products > Software > Ethernet Drivers >...

  • Page 28: Installing Mellanox Winof-2 Driver

     Installing the incorrect exe file is prohibited. If you do so, an error message will be displayed. For example, if you try to install a 64-bit executable file on a 32-bit machine, the wizard will display the following (or a similar) error message: “The installation package is not supported by this processor type.
  • Page 29 Click Next in the Welcome screen. Read then accept the license agreement and click Next. Select the target folder for the installation. The firmware upgrade screen will be displayed in the following cases: If the user has an OEM card. In this case, the firmware will not be displayed. If the user has a standard Mellanox card with an older firmware version, the firmware will be updated accordingly.
  • Page 30 card, only the Mellanox card will be updated. Select a Complete or Custom installation, follow Step a and on. Select the desired feature to install: Performance tools - install the performance tools that are used to measure performance in user environment Documentation - contains the User Manual and Release Notes iii.
  • Page 31 Diagnostic Tools - installation tools used for diagnostics, such as mlx5cmd Click Next to install the desired tools. Click Install to start the installation. In case that firmware upgrade option was checked in Step 7, you will be notified if a firmware upgrade is required. See TBD.

  • Page 32: Unattended Installation

    Click Finish to complete the installation. Unattended Installation  If no reboot options are specified, the installer restarts the computer whenever necessary without displaying any prompt or warning to the user. Use the /norestart or /forcerestart standard command-line options to control reboots. The following is an example of an unattended installation session.

  • Page 33: Installation Results

    Installation Results Upon installation completion, you can verify the successful addition of the network card(s) through the Device Manager. Upon installation completion, the inf files can be located at: %ProgramFiles% \Mellanox\MLNX_WinOF2\Drivers\<OS> To see the Mellanox network adapters, display the Device Manager and pull down the Network adapters menu.
  • Page 34 Click Next to create a server image. Click Change and specify the location in which the files are extracted to. Click Install to extract this folder, or click Change to install to a different folder.

  • Page 35: Uninstalling Mellanox Winof-2 Driver

    To complete the extraction, click Finish. Uninstalling Mellanox WinOF-2 Driver Attended Uninstallation To uninstall MLNX_WinOF2 on a single node:  Click Start > Control Panel > Programs and Features > MLNX_WinOF2 > Uninstall. (NOTE: This requires elevated administrator privileges) Unattended Uninstallation To uninstall MLNX_WinOF2 in unattended mode: Open a CMD console. (Click Task Manager > File > Run new task, and enter CMD.) To uninstall the driver, run: MLNX_WinOF2-1_10_All_x64.exe /S /x /v"/qn"...

  • Page 36: Online Update

    Go to the Mellanox WinOF web page at http://www.mellanox.com > Products > Ethernet Drivers > Windows SW/Drivers. Download the driver (MLNX_WinOF2_MLNX_WinOF2-1_64_mlx5_All_win2016_x64_fre_1_64_15407.exe). Extract the driver to a local directory (see Extracting Files Without Running Installation). Copy the contents of this directory to C:\WS2016TP5_Drivers.  The directory contents should appear as follows: This location should be specified for DriversPath property when injecting driver into the Nano server image: New-NanoServerImage -MediaPath \\Path\To\Media\en_us -BasePath .\Base -TargetPath .\InjectingDrivers.vhdx...

  • Page 37: Linux Driver Installation

    Linux Driver Installation This section describes how to install and test the Mellanox OFED for Linux package on a single server with a Mellanox ConnectX-6 Dx adapter card installed. Prerequisites Requirements Description Platforms A server platform with ConnectX®-6 Dx (EN) (firmware: fw-...

  • Page 38: Installing Mellanox Ofed

    Installing Mellanox OFED Installation Script The installation script,  , performs the following: mlnxofedinstall • Discovers the currently installed kernel • Uninstalls any software stacks that are part of the standard operating system distribution or another vendor's commercial stack • Installs the MLNX_OFED_LINUX binary RPMs (if they are available for the current kernel) •...

  • Page 39: Installation Procedure

    Example The following command will create a MLNX_OFED_LINUX ISO image for RedHat 6.3 under the / tmp directory. # ./MLNX_OFED_LINUX-x.x-x-rhel6.3-x86_64/mlnx_add_kernel_support.sh -m /tmp/MLNX_OFED_LINUX-x.x-x-rhel6.3- x86_64/ --make-tgz Note: This program will create MLNX_OFED_LINUX TGZ for rhel6.3 under /tmp directory. All Mellanox, OEM, OFED, or Distribution IB packages will be removed. Do you want to continue?[y/N]:y See log file /tmp/mlnx_ofed_iso.21642.log Building OFED RPMs.
  • Page 40  For unattended installation, use the --force installation option while running the MLNX_OFED installation script: /mnt/mlnxofedinstall --force  MLNX_OFED for Ubuntu should be installed with the following flags in the root environment: ./mlnxofedinstall --without-dkms --add-kernel-support --kernel <kernel version in chroot> --without-fw-update --force For example: ./mlnxofedinstall --without-dkms --add-kernel-support --kernel 3.13.0-85-generic --without-fw-update --force...

  • Page 41: Installation Results

      • ConnectX-6 Dx/ConnectX-6 Dx Ex - perform a standard reboot Otherwise, restart the driver by running:  /etc/init.d/openibd restart After installation completion, information about the Mellanox OFED installation, such as prefix, kernel version, and installation parameters can be retrieved by running the command /etc/infiniband/info. Most of the Mellanox OFED components can be configured or reconfigured after the installation, by modifying the relevant configuration files.

  • Page 42: Driver Load Upon System Boot

    OPENIBD_PRE_START OPENIBD_POST_START OPENIBD_PRE_STOP OPENIBD_POST_STOP Example: OPENIBD_POST_START=/sbin/openibd_post_start.sh  An example of OPENIBD_POST_START script for activating all interfaces is provided in the MLNX_OFED package under the docs/scripts/openibd-post-start-configure-interfaces/ folder. Driver Load Upon System Boot Upon system boot, the Mellanox drivers will be loaded automatically. To prevent the automatic load of the Mellanox drivers upon system boot: Add the following lines to the "/etc/modprobe.d/mlnx.conf"...

  • Page 43: Uninstalling Mlnx_Ofed

    Uninstalling MLNX_OFED Use the script /usr/sbin/ofed_uninstall.sh to uninstall the Mellanox OFED package. The script is part of the ofed-scripts RPM. Installing MLNX_OFED Using YUM This type of installation is applicable to RedHat/OL, Fedora, XenServer Operating Systems. Setting up MLNX_OFED YUM Repository Log into the installation machine as root.

  • Page 44: Installing Mlnx_Ofed Using The Yum Tool

    # yum repolist Loaded plugins: product-id, security, subscription-manager This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. repo id repo name status mlnx_ofed MLNX_OFED Repository rpmforge RHEL 6Server - RPMforge.net - dag 4,597 repolist: 8,351 Installing MLNX_OFED Using the YUM Tool After setting up the YUM repository for MLNX_OFED package, perform the following:...

  • Page 45: Uninstalling Mlnx_Ofed Using The Yum Tool

    # yum install mlnx-ofed-all Loaded plugins: langpacks, product-id, subscription-manager Resolving Dependencies --> Running transaction check ---> Package mlnx-ofed-all.noarch 0:3.1-0.1.2 will be installed --> Processing Dependency: kmod-isert = 1.0-OFED.3.1.0.1.2.1.g832a737.rhel7u1 package: mlnx-ofed-all-3.1-0.1.2.noarch ........qperf.x86_64 0:0.4.9-9 rds-devel.x86_64 0:2.0.7-1.12 rds-tools.x86_64 0:2.0.7-1.12 sdpnetstat.x86_64 0:1.60-26 srptools.x86_64 0:1.0.2-12 Complete!

  • Page 46: Uninstalling Mlnx_Ofed Using The Apt-Get Tool

    <pre># apt-cache search mlnx-ofed- mlnx-ofed-vma-eth - MLNX_OFED vma-eth installer package (with DKMS support) mlnx-ofed-hpc - MLNX_OFED hpc installer package (with DKMS support) mlnx-ofed-vma-vpi - MLNX_OFED vma-vpi installer package (with DKMS support) mlnx-ofed-basic - MLNX_OFED basic installer package (with DKMS support) mlnx-ofed-vma - MLNX_OFED vma installer package (with DKMS support)

  • Page 47: Updating The Device Manually

    mlxfwmanager --online -u -d 0000:09:00.0 Querying Mellanox devices firmware ... Device #1: ---------- Device Type: ConnectX-6 Dx Part Number: MCX623436AC-CDAB Description: ConnectX®-6 Dx EN adapter card, 100GbE, OCP3.0, With Host Management, Dual-port QSFP56, PCIe 4.0 x16, Crypto and Secure Boot, Thumbscrew (Pull Tab) Bracket PSID: MT_1020120019 PCI Device Name: 0000:09:00.0...

  • Page 48: Uefi Secure Boot

    separated list of PCI devices to exclude from the firmware update. Example: MLNX_EXCLUDE_DEVICES="00:05.0,00:07.0" UEFI Secure Boot All kernel modules included in MLNX_OFED for RHEL7 and SLES12 are signed with x.509 key to support loading the modules when Secure Boot is enabled. Enrolling Mellanox's x.509 Public Key on Your Systems In order to support loading MLNX_OFED drivers when an OS supporting Secure Boot boots on a UEFI- based system with Secure Boot enabled, the Mellanox x.509 public key should be added to the UEFI...

  • Page 49: Performance Tuning

    # rpm -qa | grep -E "kernel-ib|mlnx-ofa_kernel|iser|srp|knem|mlnx-rds|mlnx-nfsrdma|mlnx-nvme|mlnx-rdma-rxe" | xargs rpm -ql | grep "\.ko$" | xargs strip -g After the signature has been removed, a message as the below will no longer be presented upon module loading: "Request for unknown module key 'Mellanox Technologies signing key: 61feb074fc7292f958419386ffdd9d5ca999e403' err -11"...

  • Page 50: Installing Mellanox Native Esxi Driver For Vmware Vsphere

    Installing Mellanox NATIVE ESXi Driver for VMware vSphere  Please uninstall all previous Mellanox driver packages prior to installing the new version. See Removing Earlier Mellanox Drivers for further information. To install the driver: Log into the ESXi server with root permissions. Install the driver. ...

  • Page 51: Firmware Programming

    Firmware Programming Download the VMware bootable binary images from the Mellanox Firmware Tools (MFT) site. Install the image according to the steps described in the MFT User Manual.  The following procedure requires custom boot image downloading, mounting and booting from a USB device.

  • Page 52: Updating Adapter Firmware

    Updating Adapter Firmware Each adapter card is shipped with the latest version of qualified firmware at the time of manufacturing. However, Mellanox issues firmware updates occasionally that provide new features and bug fixes. To check that your card is programmed with the latest available firmware version, download the mlxup firmware update and query utility.

  • Page 53: Troubleshooting

    Troubleshooting General Troubleshooting Server unable to find the adapter • Ensure that the adapter is placed correctly • Make sure the adapter slot and the adapter are compatible Install the adapter in a different PCI Express slot • Use the drivers that came with the adapter or download the latest •...

  • Page 54: Windows Troubleshooting

    Mellanox Firmware Tool (MFT) Download and install MFT: http://www.mellanox.com/ content/pages.php?pg=management_tools&menu_section=34 Refer to the User Manual for installation instructions. Once installed, run: mst start mst status flint -d <mst_device> q Ports Information ibstat ibv_devinfo Firmware Version Upgrade To download the latest firmware version refer to http:// www.mellanox.com/supportdownloader Collect Log File...

  • Page 55: Specifications

    Specifications  Install the ConnectX-6 Dx OCP 3.0 card in a PCIe slot that is capable of supplying the power levels mentioned below for the appropriate use case  In Standby mode only port0 is available. MCX623432A[E/N/C]-ADAB Specifications Form Factor: Small Form Factor (SFF) OCP 3.0 Physical Size: 4.52 in.

  • Page 56: Mcx623432A[N/C]-Gdab/Mcx623432As-Gdai Specifications

    Active Standby Active Standby Mode @55C  Mode @45C  Mode Mode Passive 400LFM 100LFM Cable Active 0.8W 400LFM 100LFM Cable Active 1.5W 500LFM 150LFM Cable Safety CB / cTUVus / CE Regulatory CE / FCC / VCCI / ICES / RCM RoHS RoHS compliant a. ConnectX-6 Dx adapters supplement the auto-negotiation specification to get better bit error rates and longer cable reaches.

  • Page 57: Mcx623435Mn-Cdab Specifications

    Voltage: 3.3VAUX, 12V Power and Environment Power Cable Active Mode Standby Mode Type Passive 16.9W 4.54W Typical Power Cables Maximum Passive 21.4W 8.75W Power Cables 2W Active 25.94W Cables Maximum power available through SFP56 port: 2W Temperature Operationa 0°C to 55°C Non- -40°C to 70°C operationa...
  • Page 58 Connector: Single QSFP56 Ethernet (copper and optical) Retention Mechanism: Thumbscrew (Pull Tab) Bracket Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 50GBASE-R2, 50GBASE-R4, 40GBASE- Protoco CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, Support 1000BASE-CX, 1000BASE-KX, 10GBASE-SR Data Rate: Ethernet 1/10/25/40/50/100 Gb/s PCI Express Gen 4.0: SERDES @ 16.0GT/s, 16 lanes (2.0 and 1.1 compatible) Voltage: 3.3VAUX, 12V...

  • Page 59: Mcx623436A[N/C]-Cdab/Mcx623436As-Cdai Specifications

    MCX623436A[N/C]-CDAB/MCX623436AS- CDAI Specifications Form Factor: Small Form Factor (SFF) OCP 3.0 Physi Size: 4.52 in. x 2.99 in (115.00mm x 76.00mm) Connector: Dual QSFP56 Ethernet (copper and optical) Retention MCX623436A[N/C]-CDAB: Thumbscrew (Pull Tab) Bracket Mechanism: MCX623436AS-CDAI: Internal Lock Bracket Ethernet: 100GBASE-CR4, 100GBASE-KR4, 100GBASE-SR4, 50GBASE-R2, 50GBASE-R4, 40GBASE- Proto CR4, 40GBASE-KR4, 40GBASE-SR4, 40GBASE-LR4, 40GBASE-ER4, 40GBASE-R2, 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII,...
  • Page 60 Safety CB / cTUVus / CE Regul atory CE / FCC / VCCI / ICES / RCM RoHS RoHS compliant a. ConnectX-6 Dx adapters supplement the auto-negotiation specification to get better bit error rates and longer cable reaches. This supplemental feature only initiates when connected to another Mellanox Ethernet product. ...

  • Page 61: Board Mechanical Drawing And Dimensions

    Altitude 3050m (Operational) Environmen Cable Hot Aisle Cold Aisle @35C Type Heatsink to Port Port to Heatsink Airflow Active Mode @ Standby Active Standby 55C  Mode @45C  Mode Mode Passive 500LFM 100LFM 300LFM 100LFM Cable Active 800LFM @45C 600LFM @45C 300LFM 100LFM 4.55W Cable Safety...
  • Page 62 ConnectX-6 Dx Dual-Port QSFP56 OCP 3.0 Mechanical Drawing and Dimensions  ConnectX-6 Dx Single-Port QSFP56 OCP 3.0 Mechanical Drawing and Dimensions ...

  • Page 63: Bracket Mechanical Drawings And Dimensions

    Bracket Mechanical Drawings and Dimensions   All dimensions are in millimeters. The bracket's mechanical tolerance is +/- 0.25mm. Dual-port SFP28/SFP56 Thumbscrew Bracket  Dual-port QSFP56 Thumbscrew Bracket  Single-port QSFP56 Thumbscrew Bracket ...
  • Page 64 Finding the MAC and Serial Number on the Adapter Card Each Mellanox adapter card has a different identifier printed on the label: serial number and the card MAC for the Ethernet protocol.  The product revisions indicated on the labels in the following figures do not necessarily represent the latest revisions of the cards.
  • Page 65 MCX623436AN-CDAB Board Label Example MCX623436AC-CDAB Board Label Example MCX623435AN-VDAB Board Label Example MCX623435AC-VDAB Board Label Example...
  • Page 66 Document Revision History Date Revision Description of Changes Oct. 2020 • Updated airflow numbers in "Specifications". • Updated networking ports LEDs indications.   Sep. 2020  Added OCP 3.0 bracket replacement instructions. Jul. 2020 Updated airflow numbers in "Specifications". Jul. 2020 Updated all power and airflow numbers in "Specifications".
  • Page 67 NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.
  • Page 68 NVIDIA, the NVIDIA logo, and Mellanox are trademarks and/or registered trademarks of Mellanox Technologies Ltd. and/or NVIDIA Corporation in the U.S. and in other countries. Other company and product names may be trademarks of the respective companies with which they are associated.

This manual is also suitable for:

C-adabE-adabN-adabN-gdabC-gdabS-gdai ... Show all

Table of Contents