Nvidia MCX621102AC-ADAT User Manual
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Adapter
  5. Mellanox MCX621102ACADAT
  6. User manual
Nvidia MCX621102AC-ADAT User Manual

Nvidia MCX621102AC-ADAT User Manual

Connectx-6 dx ethernet adapter cards
Hide thumbs Also See for MCX621102AC-ADAT:
Table of Contents

Advertisement

Quick Links

 
 
 
 
 
 
 
NVIDIA ConnectX-6 Dx Ethernet Adapter
Cards User Manual
 
 
Exported on Sep/16/2022 01:57 PM

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the MCX621102AC-ADAT and is the answer not in the manual?

Questions and answers

Related Manuals for Nvidia MCX621102AC-ADAT

Summary of Contents for Nvidia MCX621102AC-ADAT

  • Page 1               NVIDIA ConnectX-6 Dx Ethernet Adapter Cards User Manual     Exported on Sep/16/2022 01:57 PM...

  • Page 2: Table Of Contents

    Table of Contents Introduction..................9 Product Overview ..................9 Features and Benefits ................13 Operating Systems/Distributions ..............15 Connectivity ..................16 Interfaces ..................17 ConnectX-6 Dx IC Interface............... 18 Encryption ..................18 PCI Express Interface................18 Networking Ports LEDs Interface ..............19 Scheme 1: One Bi-Color LED ..............
  • Page 3 General Troubleshooting ................59 Linux Troubleshooting ................60 Windows Troubleshooting................. 60 Specifications..................62 MCX621102AC-ADAT / MCX621102AN-ADAT / MCX621102AN-ADAT Specifications ..62 MCX623102AC-ADAT / MCX623102AN-ADAT / MCX623102AS-ADAT Specifications..63 MCX621202AS-ADAT / MCX621202AC-ADAT Specifications ........64 MCX623102AC-GDAT / MCX623102AE-GDAT / MCX623102AN-GDAT / MCX623102AS-GDAT Specifications..................
  • Page 4 Board Mechanical Drawing and Dimensions ............ 72 Bracket Mechanical Drawing ..............73 Finding the MAC on the Adapter Card .............75 Document Revision History ..............76  ...
  • Page 5 About This Manual This User Manual describes NVIDIA® ConnectX®-6 Dx Ethernet adapter cards. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant documentation. Ordering Part Numbers The table below provides the ordering part numbers (OPN) for the available ConnectX-6 Dx Ethernet adapter cards.
  • Page 6 200GbE, Single-port QSFP56, PCIe 4.0 x16, No Crypto, Tall Bracket Legacy (EOL) Ordering Part Numbers Marketing Description MCX621102AC-ADAT ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x8, Crypto and Secure Boot, Tall Bracket MCX623102AC-ADAT ConnectX-6 Dx EN adapter card, 25GbE, Dual-port SFP28, PCIe 4.0 x16, Crypto and Secure Boot, Tall Bracket...
  • Page 7 This manual is intended for the installer and user of these cards. The manual assumes basic familiarity with Ethernet network and architecture specifications. Technical Support Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods: •...
  • Page 8 See NVIDIA MLNX_OFED for Linux User Manual and Linux Documentation. Release Notes NVIDIA firmware update and query utility used to update the firmware. NVIDIA Firmware See NVIDIA Firmware Utility (mlxup) Documentation. Update NVIDIA Firmware Tools...

  • Page 9: Introduction

    As the world's most advanced cloud SmartNIC, ConnectX-6 Dx provides up to two ports of 25, 50 or 100Gb/s or a single-port of 200Gb/s Ethernet connectivity, powered by 50Gb/s PAM4 SerDes technology and PCIe Gen 4.0 host connectivity. ConnectX-6 Dx continues among NVIDIA's innovation path in scalable cloud fabrics, delivering unparalleled performance and efficiency at every scale.
  • Page 10  These cards are optimized for Workstation Environments and include an onboard cooling fan that meets the acoustic requirements for workstations. Form Data No. of PCIe Secure Bracket Factor/ Transmiss Ports and Interface Boot Type Dimensions ion Rate Type ✔ ✔...
  • Page 11 Form Data No. of PCIe Secure Bracket Factor/ Transmiss Ports and Interface Boot Type Dimensions ion Rate Type ✔ MCX623105 5.59in. x 100/50/25/ Single-port PCIe Gen 4.0 Tall AN-CDAT 2.71in 10/1 GbE QSFP56 SERDES @ Bracket (142.00mm x 16.0GT/s x16 68.90mm) ✔...
  • Page 12 Form Data No. of PCIe Brac Factor/ Trans Ports Interfac Dimensi & missio Type   n Rate Type port ✔ ✔ ✔ ✔ ✔ ✔ Tall MCX623 5.59in. x 100/50/ Dual- PCIe Gen 106PC- 2.71in 25/10/1 port Bracke CDAT (142.00m QSFP56 SERDES @ 16.0GT/s...

  • Page 13: Features And Benefits

    PCIe Gen 4.0 SERDES@ 8.0GT/s / 16.0GT/s through x8/x16 Edge Connector Up to 200GbE NVIDIA adapters comply with the following IEEE 802.3 standards: 200GbE / 100GbE / 50GbE / 40GbE / 25GbE / 10GbE / 1GbE – IEEE 802.3bj, 802.3bm 100 Gigabit Ethernet –...
  • Page 14 Band and Ethernet networks. Leveraging data center bridging (DCB) capabilities, as well as ConnectX-6 Dx, advanced congestion control hardware mechanisms, Ethernet RoCE provides efficient low-latency RDMA services over Layer 2 and Layer 3 networks. (RoCE) NVIDIA NVIDIA PeerDirect® communication provides high-efficiency RDMA access by eliminating PeerDirect®...

  • Page 15: Operating Systems/Distributions

    NVIDIA offers a full IEEE 1588v2 PTP software solution, as well as time-sensitive related Applications features called “5T”. NVIDIA PTP and 5T software solutions are designed to meet the most demanding PTP profiles. ConnectX-6 Dx incorporates an integrated Hardware Clock (PHC) that...

  • Page 16: Connectivity

    Connectivity • Interoperable with 1/10/25/40/50/100/200 Gb/s Ethernet switches • Passive copper cable with ESD protection • Powered connectors for optical and active cable support...

  • Page 17: Interfaces

    Interfaces The below figures show the component side of the ConnectX-6 Dx adapter card. Each numbered interface that is referenced in the figures is described in the following table with a link to detailed information.  The below figures are for illustration purposes only and might not reflect the current revision of the adapter card.

  • Page 18: Connectx-6 Dx Ic Interface

    AES data-at-rest cryptographic operations. • Stateful firewall solution acceleration, powered by Open vSwitch connection tracking and NVIDIA’s ASAP2 technology. • Embedded hardware root-of-trust and support for RSA-based secure firmware update and secure boot, providing guaranteed integrity of the network adapter.

  • Page 19: Networking Ports Leds Interface

    Networking Ports LEDs Interface For the networking ports LEDs description, follow the below table depending on the OPN you have purchased.   LEDs Scheme MCX621102A[C/N/E]-ADAT, MCX621202A(C/S)-ADAT Scheme 1: One Bi-Color LED MCX623102A[C/N]-ADAT, MCX623102A[C/N]- Scheme 2: One Bi-Color LED and one Single Color GDAT, MCX623102A[S/E/N/C]-GDAT MCX623105A[N/E]-CDAT, MCX623106A[C/N/S/E]- CDAT, MCX623106P[C/N/E]-CDAT,...

  • Page 20: Scheme 2: One Bi-Color Led And One Single Color Led

    BMC using MCTP over SMBus or MCTP over PCIe protocols as if it is a standard NVIDIA PCIe stand-up adapter. For configuring the adapter for the specific manageability solution in use by the server, please contact NVIDIA Support.

  • Page 21: Heatsink

    Heatsink The heatsink is attached to the ConnectX-6 Dx IC in order to dissipate the heat. It is attached either by using four spring-loaded push pins that insert into four mounting holes, or by screws. ConnectX-6 Dx IC has a thermal shutdown safety mechanism that automatically shuts down the ConnectX-6 Dx card in cases of high-temperature event, improper thermal coupling or heatsink removal.

  • Page 22: Hardware Installation

    Hardware Installation Installation and initialization of ConnectX-6 Dx adapter cards require attention to the mechanical attributes, power specification, and precautions for electronic equipment. Safety Warnings  Safety warnings are provided here in the English language. For safety warnings in other languages, refer to the Adapter Installation Safety Instructions.

  • Page 23: System Requirements

    Software Requirements • Operating Systems/Distributions section under the Introduction section. • Software Stacks - NVIDIA OpenFabric software package MLNX_OFED for Linux, WinOF-2 for Windows, and VMware. See the Driver Installation section. Safety Precautions The adapter is being installed in a system that operates with voltages that can be lethal. Before opening the case of the system, observe the following precautions to avoid injury and prevent damage to system components.

  • Page 24: Unpacking The Package

    • Verify that the system is powered off and is unplugged. • It is strongly recommended to use an ESD strap or other antistatic devices. Unpacking the Package Check against the package contents list that all the parts have been sent. Check the parts for visible damage that may have occurred during shipping.

  • Page 25: Bracket Replacement Instructions

    (Optional) Check the mounting bracket on the card. If required for your system, replace the full-height mounting bracket that is shipped mounted on the card with the supplied low-profile bracket. Refer to Bracket Replacement Instructions. Bracket Replacement Instructions The ConnectX-6 Dx card is usually shipped with an assembled high-profile bracket. If this form factor is suitable for your requirements, you can skip the remainder of this section and move to Installation Instructions.
  • Page 26 Step 1: Locate an available PCI Express slot and insert the adapter card to the chassis. Step 2: Applying even pressure at both corners of the card, insert the adapter card in a PCI Express slot until firmly seated.  Do not use excessive force when seating the card, as this may damage the chassis. Secure the adapter card to the chassis.

  • Page 27: Cables And Modules

     To uninstall the adapter card, see Uninstalling the Card. Cables and Modules To obtain the list of supported Mellanox cables for your adapter, please refer to the Cables Reference Table at Networking Configuration Tools. Cable Installation All cables can be inserted or removed with the unit powered on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated.

  • Page 28: Identifying The Card In Your System

    After plugging in a cable, lock the connector using the latching mechanism particular to the cable vendor. When data is being transferred the Green LED will blink. See LED Interface under the Interfaces section.  Care should be taken as not to impede the air exhaust flow through the ventilation holes. Use cable lengths that allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack.

  • Page 29: Uninstalling The Card

    In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of NVIDIA; and DEV is equal to 1018 (for ConnectX-6 Dx) – this is a valid NVIDIA PCI Device ID.
  • Page 30 Verify that the system is powered off and unplugged. Wait 30 seconds. To remove the card, disengage the retention mechanisms on the bracket (clips or screws). Holding the adapter card from its center, gently pull the ConnectX-6 and Auxiliary Connections cards out of the PCI Express slot.

  • Page 31: Driver Installation

    NVIDIA web site at https://www.nvidia.com/en-us/networking/ products/software/ > InfiniBand Drivers > Learn More > NVIDIA MLNX_OFED  Scroll down to the Download wizard, and click the Download tab. Choose your relevant package depending on your host operating system.

  • Page 32: Installing Mlnx_Ofed

    Use the Hash utility to confirm the file integrity of your ISO image. Run the following command and compare the result to the value provided on the download page. SHA256 MLNX_OFED_LINUX-<ver>-<OS label>.iso Installing MLNX_OFED Installation Script The installation script,  , performs the following: mlnxofedinstall •...
  • Page 33 /tmp directory. # ./MLNX_OFED_LINUX-x.x-x-rhel6.3-x86_64/mlnx_add_kernel_support.sh -m /tmp/MLNX_OFED_LINUX-x.x-x-rhel6.3- x86_64/ --make-tgz Note: This program will create MLNX_OFED_LINUX TGZ for rhel6.3 under /tmp directory. All NVIDIA, OEM, OFED, or Distribution IB packages will be removed. Do you want to continue?[y/N]:y See log file /tmp/mlnx_ofed_iso.21642.log  ...
  • Page 34 Logs dir: /tmp/MLNX_OFED_LINUX-x.x-x.logs This program will install the MLNX_OFED_LINUX package on your machine. Note that all other NVIDIA, OEM, OFED, RDMA or Distribution IB packages will be removed. Those packages are removed due to conflicts with MLNX_OFED_LINUX, do not reinstall them.
  • Page 35 Status: No matching image found Error message 2: The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor. If the installation script has performed a firmware update on your network adapter, complete the step relevant to your adapter card type to load the firmware:...
  • Page 36 In case that your machine has an unsupported network adapter device, no firmware update will occur and the error message below will be printed. The firmware for this device is not distributed inside NVIDIA driver: 0000:01:00.0 (PSID: IBM2150110033) To obtain firmware for this device, please contact your HW vendor.

  • Page 37: Installing Mlnx_Ofed Using Yum

    To prevent automatic load of the NVIDIA drivers upon system boot: Add the following lines to the "/etc/modprobe.d/mlnx.conf" file.  blacklist mlx4_core blacklist mlx4_en blacklist mlx5_core blacklist mlx5_ib Set “ONBOOT=no” in the "/etc/infiniband/openib.conf" file. If the modules exist in the initramfs file, they can automatically be loaded by the kernel.
  • Page 38 # mount -o ro,loop MLNX_OFED_LINUX-<ver>-<OS label>-<CPU arch>.iso /mnt Download and install GPG-KEY: The key can be downloaded via the following link: http://www.mellanox.com/downloads/ ofed/RPM-GPG-KEY-Mellanox # wget http://www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox --2014-04-20 13:52:30-- http://www.mellanox.com/downloads/ofed/RPM-GPG-KEY-Mellanox Resolving www.mellanox.com... 72.3.194.0 Connecting to www.mellanox.com|72.3.194.0|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 1354 (1.3K) [text/plain] Saving to: ?RPM-GPG-KEY-Mellanox?  ...
  • Page 39 mlnx-ofed-vma-vpi.noarch : MLNX_OFED vma-vpi installer package (with KMP support) Where: mlnx-ofed-all Installs all available packages in MLNX_OFED. mlnx-ofed-basic Installs basic packages required running Mellanox cards. mlnx-ofed-guest Installs packages required by guest OS. mlnx-ofed-hpc Installs packages required HPC. mlnx-ofed-hypervisor Installs packages required by hypervisor OS. mlnx-ofed-vma Installs packages required by VMA.

  • Page 40: Installing Mlnx_Ofed Using Apt-Get Tool

    Extract the MLNX_OFED package on a shared location in your network. You can download it from https://www.nvidia.com/en-us/networking/products/software/ > InfiniBand Drivers > Learn More > NVIDIA MLNX_OFED  Create an apt-get repository configuration file called "/etc/apt/sources.list.d/mlnx_ofed.list" with the following content: # deb file:/<path to extracted MLNX_OFED package>/DEBS ./ Download and install GPG-KEY.

  • Page 41: Updating Firmware After Installation

    The firmware can be updated either manually or automatically (upon system boot), as described in the sections below. Updating the Device Online To update the device online on the machine from the NVIDIA site, use the following command line: mlxfwmanager --online -u -d <device> Example: mlxfwmanager --online -u -d 0000:09:00.0...

  • Page 42: Uefi Secure Boot

    Support > Firmware Download). Get the device’s PSID. mlxfwmanager_pci | grep PSID PSID: MT_1210110019 Download the firmware BIN file from the NVIDIA website or the OEM website. Burn the firmware. mlxfwmanager_pci -i <fw_file.bin> Reboot your machine after the firmware burning is completed.
  • Page 43 Enrolling Mellanox's x.509 Public Key on Your Systems In order to support loading MLNX_OFED drivers when an OS supporting Secure Boot boots on a UEFI- based system with Secure Boot enabled, the Mellanox x.509 public key should be added to the UEFI Secure Boot key database and loaded onto the system key ring by the kernel.

  • Page 44: Performance Tuning

    NVIDIA website at: https://www.nvidia.com/en-us/networking/products/software/ > InfiniBand Drivers > Learn More > NVIDIA WinOF-2. Follow the installation instructions included in the download package (also available from the download page).  The snapshots in the following sections are presented for illustration purposes only. The installation interface may slightly vary, depending on the operating system in use.

  • Page 45: Downloading Winof-2 Driver

    %PROCESSOR_ARCHITECTURE%  On an x64 (64-bit) machine, the output will be “AMD64”. Go to the WinOF-2 web page at: https://www.nvidia.com/en-us/networking/products/software/ InfiniBand Drivers → NVIDIA WinOF-2 Download the .exe image according to the architecture of your machine (see Step 1).  The name of the .exe is in the following format: MLNX_WinOF2-<version>_<arch>.exe.
  • Page 46 Double click the .exe and follow the GUI instructions to install MLNX_WinOF2. [Optional] Manually configure your setup to contain the logs option (replace “LogFile” with the relevant directory): MLNX_WinOF2_<revision_version>_All_Arch.exe /v"/l*vx [LogFile]" [Optional] If you do not want to upgrade your firmware version. (Note: MT_SKIPFWUPGRD default value is False.) MLNX_WinOF2_<revision_version>_All_Arch.exe /v"...
  • Page 47 If the user has a standard adapter card with an older firmware version, the firmware will be updated accordingly. However, if the user has both an OEM card and an NVIDIA adapter card, only the NVIDIA card will be updated.
  • Page 48 Select a Complete or Custom installation, follow Step a onward. Select the desired feature to install: • Performances tools - install the performance tools that are used to measure performance in user environment • Documentation - contains the User Manual and Release Notes • Management tools - installation tools used for management, such as mlxstat...
  • Page 49 • Diagnostic Tools - installation tools used for diagnostics, such as mlx5cmd Click Next to install the desired tools.  9.  Click Install to start the installation.
  • Page 50          10. In case firmware upgrade option was checked in Step 7, you will be notified if a firmware upgrade is required (see  ).           11.  Click Finish to complete the installation.
  • Page 51         Unattended Installation  If no reboot options are specified, the installer restarts the computer whenever necessary without displaying any prompt or warning to the user. To control the reboots, use the /norestart or /forcerestart standard command-line options. The following is an example of an unattended installation session.

  • Page 52: Uninstalling Winof-2 Driver

    MLNX_WinOF2_<revision_version>_All_Arch.exe /v"MT_RIVERMAX=1 /l*vx C:\Users\<user>\log.txt " Installation Results Upon installation completion, you can verify the successful addition of the network card(s) through the Device Manager. The inf files can be located at: %ProgramFiles%\Mellanox\MLNX_WinOF2\Drivers\ To see the network adapters, display the Device Manager and pull down the “Network adapters” menu. ...

  • Page 53: Extracting Files Without Running Installation

    Open a CMD console. (Click Task Manager > File > Run new task, and enter CMD.) To uninstall the driver, run: MLNX_WinOF2-<version>_All_x64.exe /S /x /v"/qn" Extracting Files Without Running Installation To extract the files without running installation, perform the following steps: Open a CMD console-> Click Start-> Task Manager-> File-> Run new task-> and enter CMD. Extract the driver and the tools: MLNX_WinOF2-<revision_version>_All_x64 /a To extract only the driver file:...
  • Page 54         Click Install to extract this folder, or click Change to install to a different folder. ...

  • Page 55: Firmware Upgrade

    Manual. VMware Driver Installation This section describes VMware Driver Installation. Hardware and Software Requirements Requirement Description Platforms A server platform with an adapter card based on NVIDIA devices: • ConnectX®-6 Dx (EN) (firmware: fw-ConnectX6Dx) Operating System ESXi 8.x Installer Privileges The installation requires administrator privileges on the target machine.

  • Page 56: Installing Native Esxi Driver For Vmware Vsphere

    PartnerSupported 2017-01-31  After the installation process, all kernel modules are loaded automatically upon boot. Removing Earlier NVIDIA Drivers  Please unload the previously installed drivers before removing them. To remove all the drivers: Log into the ESXi server with root permissions.

  • Page 57: Firmware Programming

    Firmware Programming Download the VMware bootable binary images v4.6.0 from the Firmware Tools (MFT) site. ESXi 6.5 File: mft-4.6.0.48-10EM-650.0.0.4598673.x86_64.vib MD5SUM: 0804cffe30913a7b4017445a0f0adbe1 Install the image according to the steps described in the MFT User Manual.  The following procedure requires custom boot image downloading, mounting and booting from a USB device.

  • Page 58: Updating Adapter Firmware

    To check that your card is programmed with the latest available firmware version, download the mlxup firmware update and query utility. The utility can query for available NVIDIA adapters and indicate which adapters require a firmware update. If the user confirms, mlxup upgrades the firmware using embedded images.

  • Page 59: Troubleshooting

    Troubleshooting General Troubleshooting • Ensure that the adapter is placed correctly Server unable to find the adapter • Make sure the adapter slot and the adapter are compatible Install the adapter in a different PCI Express slot • Use the drivers that came with the adapter or download the latest •...

  • Page 60: Linux Troubleshooting

    <interface> ethtool -i <interface_of_Mellanox_port_num> ibdev2netdev lspci | grep -i Mellanox Card Detection Download and install MFT: http://www.nvidia.com/content/ NVIDIA Firmware Tool (MFT) pages.php?pg=management_tools&menu_section=34 Refer to the User Manual for installation instructions. Once installed, run: mst start mst status flint -d <mst_device> q...
  • Page 61 • Event log viewer Collect Log File • MST device logs: • mst start • mst status • flint –d <mst_device> dc > dump_configuration.log • mstdump <mst_device> dc > mstdump.log...

  • Page 62: Specifications

    Specifications MCX621102AC-ADAT / MCX621102AN-ADAT / MCX621102AN-ADAT Specifications Physical Size: 4.89in. x 2.71in (124.22mm x 68.90mm) Connector: Dual SFP28 Ethernet (copper and optical) Data Rate: Ethernet 1/10/25 Gb/s Protocol Support Ethernet: 25GBASE-R, 20GBASE-KR2, 10GBASE-LR,10GBASE-ER, 10GBASE-CX4, 10GBASE-CR, 10GBASE-KR, SGMII, 1000BASE-CX, 1000BASE-KX, 10GBASE-SR PCI Express Gen 3.0/4.0: SERDES @ 16.0GT/s, 8 lanes (2.0 and 1.1 compatible)

  • Page 63: Mcx623102Ac-Adat / Mcx623102An-Adat / Mcx623102As-Adat Specifications

    (efficiency factor) b. Typical power for ATIS traffic load. c. For both operational and non-operational states. d. Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels. MCX623102AC-ADAT / MCX623102AN-ADAT / MCX623102AS-ADAT Specifications Physical Size: 5.59in.

  • Page 64: Mcx621202As-Adat / Mcx621202Ac-Adat Specifications

    Typical power for ATIS traffic load. c. For both operational and non-operational states. d. Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels. MCX621202AS-ADAT / MCX621202AC-ADAT Specifications  These cards are optimized for Workstation Environments and include an onboard cooling fan that meets the acoustic requirement for workstations.

  • Page 65: Mcx623102Ac-Gdat / Mcx623102Ae-Gdat / Mcx623102An-Gdat / Mcx623102As-Gdat Specifications

    Cable Type Maximum Allowed Fan External Airflow Inlet Temperature Conditions Maximum Allowed Passive Copper Module 50° Inlet Temperature NVIDIA SFP28 0.8W 40° Module No External Airflow 10G Base SFP-10G-T-NC 40° 2.5W Cable Passive Copper Module 55° NVIDIA SFP28 0.8W 50°...

  • Page 66: Mcx623105An-Cdat / Mcx623105Ae-Cdat / Mcx623105Ac-Cdat Specifications

    (efficiency factor) b. Typical power for ATIS traffic load. c. For both operational and non-operational states. d. Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels. MCX623105AN-CDAT / MCX623105AE-CDAT / MCX623105AC-CDAT Specifications Physical Size: 5.59in.

  • Page 67: Mcx623106As-Cdat / Mcx623106An-Cdat / Mcx623106Ac-Cdat / Mcx623106Ae-Cdat Specifications

    Typical power for ATIS traffic load. c. For both operational and non-operational states. d. Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels. MCX623106AS-CDAT / MCX623106AN-CDAT / MCX623106AC-CDAT / MCX623106AE-CDAT Specifications Physical Size: 5.59in.
  • Page 68 (efficiency factor) b. Typical power for ATIS traffic load. c. For both operational and non-operational states. d. Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels.

  • Page 69: Mcx623106Pn-Cdat / Mcx623106Pc-Cdat Specifications

    Altitude (Operational) 3050m Hot Aisle - Heatsink to Port Airflow Passive Cable Requirements @ 600LFM (d)(e) NVIDIA Active 2.5W 700LFM Cable Active 3.5W Cable 1000LFM Safety CB / cTUVus / CE Regulatory CE / FCC / VCCI / ICES / RCM...

  • Page 70: Mcx623106Tc-Cdat / Mcx623106Tn-Cdat / Mcx623106Gn-Cdat / Mcx623106Gc-Cdat Specifications

    Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels. MCX623106TC-CDAT / MCX623106TN-CDAT / MCX623106GN-CDAT / MCX623106GC-CDAT Specifications Physical Size: 5.59in. x 2.71in (142.00mm x 68.90mm) Connector: Dual QSFP56 Ethernet (copper and optical)

  • Page 71: Mcx623105Ac-Vdat / Mcx623105An-Vdat / Mcx623105As-Vdat / Mcx623105Ae-Vdat Specifications

    Typical power for ATIS traffic load. c. For both operational and non-operational states. d. Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels. MCX623105AC-VDAT / MCX623105AN-VDAT /  MCX623105AS-VDAT / MCX623105AE-VDAT Specifications Physical Size: 5.59in.

  • Page 72: Board Mechanical Drawing And Dimensions

    Typical power for ATIS traffic load. c. For both operational and non-operational states. d. Airflow is measured in wind tunnel. e. Contact NVIDIA for airflow numbers with other active modules' power levels. Board Mechanical Drawing and Dimensions  3D model of the cards are available through the customer portal following login.

  • Page 73: Bracket Mechanical Drawing

    Dual-Port SFP28/SFP56 x16 Adapter Cards Single-Port QSFP56 x16 Adapter Cards Mechanical Mechanical Drawing  Drawing  Mechanical Tolerance: Mechanical Tolerance: Width: +/- 0.13mm Width: +/- 0.13mm Height:  +0/-0.13mm Height:  +0/-0.13mm Dual-Port QSFP56 x16 Adapter Cards Mechanical Drawing  Mechanical Tolerance: Width: +/- 0.13mm Height:  +0/-0.13mm Bracket Mechanical Drawing ...
  • Page 74 Card Configuration Short Bracket Tall Bracket Single-Port QSFP56 Cards Dual-Port QSFP56 Cards...

  • Page 75: Finding The Mac On The Adapter Card

    Finding the MAC on the Adapter Card Each NVIDIA adapter card has a different identifier printed on the label: serial number and the card MAC for the Ethernet protocol.  The product revisions indicated on the labels in the following figures do not necessarily represent the latest revisions of the cards.

  • Page 76: Document Revision History

    Document Revision History Date Revision Description of Changes Aug. 2022 Updated the "Legacy (EOL) Ordering Part Numbers" table. Jun. 2022 Updated board and bracket mechanical drawings and mechanical tolerances.  Mar. 2022  Added the following OPNs to relevant sections:  • MCX621202AS-ADAT •...
  • Page 77 Date Revision Description of Changes Jun. 2020 Updated airflow numbers. Added the following OPNs to all relevant sections: • MCX621102AE-ADAT  • MCX623102AS-GDAT • MCX623102AC-GDAT • MCX623106AE-CDAT  • MCX623106PC-CDAT • MCX623106PN-CDAT • MCX623106PE-CDAT • MCX623105AE-VDAT May. 2020 Updated power numbers. Feb. 2020 Added the following OPNs to all relevant sections: •...
  • Page 78 NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.
  • Page 79 Copyright © 2022 NVIDIA Corporation & affiliates. All Rights Reserved.

This manual is also suitable for:

Mcx621102an-adatMcx623102ac-adatMcx623102an-adatMcx623102as-adatMcx621202as-adatMcx621202ac-adat ... Show all

Table of Contents