Nvidia BlueField-2 InfiniBand User Manual
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Network Hardware
  5. BlueField-2 InfiniBand
  6. User manual
Nvidia BlueField-2 InfiniBand User Manual

Nvidia BlueField-2 InfiniBand User Manual

Ethernet dpu
Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the BlueField-2 InfiniBand and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Nvidia BlueField-2 InfiniBand

Summary of Contents for Nvidia BlueField-2 InfiniBand

  • Page 1 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 2: Table Of Contents

    Finding the GUID/MAC on the DPU Finding the GUID/MAC on the DPU Supported Servers and Power Cords Supported Servers and Power Cords Pin Description Pin Description 30-pin NC-SI Connector 30-pin NC-SI Connector Document Revision History Document Revision History NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 3 Figure 14. Image2021 8 11 8 56 28 Figure 15. Image2021 8 11 8 44 35 Figure 16. Image2021 8 11 8 56 28 Figure 17. Image2021 8 11 8 44 35 Figure 18. Image2021 8 11 8 56 28 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 4 Figure 27. Image2022 6 6 10 13 24 Figure 28. Image2020 12 8 10 59 25 Figure 29. HHHL MBF2M355A VExOT Tall Bracket Figure 30. HHHL MBF2M355A VExOT Short Bracket Figure 31. Group4 Bracket Figure 32. IB Group3 Bracket NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 5 Table 2. Table 3. Table 4. Table 5. Table 6. Table 7. Table 8. Table 9. Table 10. Table 11. Table 12. Table 13. Table 14. Table 15. Table 16. Table 17. Table 18. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 6 Table 19. Table 20. Table 21. Table 22. Table 23. Table 24. Table 25. Table 26. Table 27. Table 28. Table 29. Table 30. Table 31. Table 32. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 7 About This Manual This user manual describes NVIDIA® BlueField®-2 InfiniBand/Ethernet Programmable DPU (data processing unit). It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and a step-by- step plan of how to bring up the BlueField-2 DPUs.
  • Page 8 Documents section for details on accessing the document.  Legacy (EOL) Ordering Part Numbers Series/ External boar NVIDIA PCIe Secure 1GbE Integrated Core Crypto Speed Support Boot Speed Ports Power Memo 900- 16GB Seri 0066 2.75 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 9 900- 16GB Seri 0056 2.75 SQ0  900- 16GB Seri 0086 2.75 -ST1  900- 16GB Seri 0076 2.75 -ST2  NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 10 900- 16GB 64GB Seri 0086 2.0G 900- 16GB 64GB Seri 0066 2.0G 900- 16GB 64GB Seri 0056 2.0G NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 11 -ST6  If your target application for this crypto-enabled card will utilize 100Gb/s or higher ban of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA BlueField-2 document to learn about a potential bandwidth limitation. See Related Documents sectio...
  • Page 12 This manual is intended for the installer and user of these cards. The manual assumes basic familiarity with InfiniBand/Ethernet network and architecture specifications. Technical Support Customers who purchased NVIDIA products directly from NVIDIA are invited to contact us through the following methods: E-mail: Enterprisesupport@nvidia.com Enterprise Support page: https://www.nvidia.com/en-us/support/enterprise Related Documentation InfiniBa...
  • Page 13 Softwar leveraging industry-standard APIs. With DOCA, developers can deliver breakthrough networking, security, and storage performance by harnessing Docum the power of NVIDIA's DPUs. NVIDIA DOCA SDK software is available at entatio https://docs.nvidia.com/doca/sdk. BlueFiel BMC software enables control and management of the baseboard d BMC management controller’s (BMC) hardware components.
  • Page 14 Gigabytes. The use of Gb or Gbits (small b) indicates the size in Gigabits. In this document, PCIe is used to mean PCI Express. Revision History A list of the changes made to this document is provided in Document Revision History NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 15: Introduction

    BlueField-2 empowers agile and high-performance solutions for cloud networking, storage, cybersecurity, data analytics, HPC, and artificial intelligence (AI), from edge to core data centers and clouds, all while reducing the total cost of ownership. The NVIDIA DOCA software development kit (SDK) enables developers to create applications and services for the BlueField-2 DPU rapidly.
  • Page 16 BlueField-2 DPU is shipped with Ubuntu – a Linux commercial operating system Oper – which includes the NVIDIA OFED stack (MLNX_OFED) and is capable of running ating all customer-based Linux applications seamlessly. BlueField-2 DPU also supports Syste CentOS and has an out-of-band 1GbE management interface.
  • Page 17 1x USB 2.0 Type-A to Mini USB Type B MBF2H516A-EENOT cable MBF2M516A-EECOT MBF20-DKIT MBF2M516A-EEEOT 1x USB 2.0 Type-A to 30pin Flat Socket MBF2M516A-EENOT 4-pin USB to female USB Type-A cable All the rest of the MBF25-DKIT DPUs 30-pin shrouded connector cable NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 18 (HPC), artificial intelligence Specification (AI), and hyperscale cloud data center applications. v1.4 BlueField-3 DPU is InfiniBand Architecture Specification v1.3 compliant. compliant InfiniBand Network Protocols and Rates: Protocol Standard Rate (Gb/s) Comments Port Ports NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 19 IEEE 802.3bj 100 Gigabit Ethernet IEEE 802.3bm IEEE 802.3by 50/25 Gigabit Ethernet Ethernet Consortium25 IEEE 802.3ba 40 Gigabit Ethernet IEEE 802.3ae 10 Gigabit Ethernet 2.5/5 Gigabit Ethernet IEEE 802.3cb (For 2.5: support only 2.5 x1000BASE- NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 20 Arm boot, OS, and disk space. DDR4 SDRAM - 16GB/32GB @3200MT/s single-channel DDR4 SDRAM memory. Solder down on board. 64bit + 8bit ECC. The NVIDIA BlueField-2 DPU integrates eight 64-bit Armv8 A72 cores interconnected by a coherent mesh network, one DRAM controller, and BlueField-2...
  • Page 21 Non-volatile Memory Express (NVMe) over Fabrics is a protocol for communicating block storage IO requests over RDMA to transfer data between a host computer and a target solid-state storage device or system over a network. NVIDIA BlueField-2 DPU may operate as a co- NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 22 Acceleration Burst Buffer Offloads for Background Checkpointing GPUDirect RDMA is a technology that provides a direct P2P (Peer-to- Peer) data path between the GPU Memory directly to/from the NVIDIA HCA devices. This provides a significant decrease in GPU-GPU GPU Direct communication latency and completely offloads the CPU, removing it...
  • Page 23 Having a trusted onboard BMC that is fully isolated for the host server ensures the highest security for the DPU boards. NVIDIA offers a full IEEE 1588v2 PTP software solution, as well as time- sensitive related features called “5T”. NVIDIA PTP and 5T software solutions, are designed to meet the most demanding PTP profiles.

  • Page 24: Bluefield Dpu Administrator Quick Start Guide

    NVIDIA DOCA Developer Quick Start Guide. Note Not sure which guide to follow? For more details on the different BlueField user types, please refer to the NVIDIA BlueField and DOCA User Types document. Verifying DPU Connection and Setting Up Host...
  • Page 25 For Ubuntu/Debian: f in $( dpkg --list | grep doca | awk echo $f ; apt '{print $2}' remove --purge $f -y ; done $ sudo apt-get autoremove For CentOS/RHEL/Rocky: NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 26 DPU. Connecting to BlueField and Verifying Version To connect to your DPU: 1. SSH to the DPU using the OOB IP or the RShim IP (192.168.100.2) using the default credentials ( ubuntu ubuntu NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 27 1. Installing a new BFB on the DPU is performed using the utility that is bfb-install included in the RShim tool. # bfb-install --bfb <BFB-image>.bfb --rshim rshim0 Expected output example: Pushing bfb Collecting BlueField booting status. Press Ctrl+C to stop… NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 28 3. Verify that the BFB has been installed and the firmware has been upgraded successfully by accessing the DPU again: 1. SSH to the BlueField DPU from the host using OOB IP or RShim IP: ssh <ip> 2. Check the versions of the DPU image and firmware: NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 29   -INSTALLED VERSIONS- ATF: v2.2(release):4.0.3-3-g886241c UEFI: 4.0.3-1-g2162ecf FW: 24.37.1300   Version check complete. No issues found. Additional Reading To learn more about BlueField please see: BlueField hardware troubleshooting BlueField software installation BlueField software troubleshooting NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 30: Supported Interfaces

    One bi-color LED per port for the link and physical status Interface DDR4 SDRAM 8 units of SDRAM for a total of 16GB @ 3200MT/s single DDR4 On-Board channel, 64bit + 8bit ECC, solder-down memory NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 31 1GbE BASE-T OOB management interface Interface RTC Battery Battery holder for RTC eMMC x8 NAND flash Interface FHHL DPU Layout and Interface Information Interfaces of MBF2H516A-EEEOT, MBF2H516A-EENOT, MBF2M516A-EECOT, MBF2M516A-EEEOT and MBF2M516A-EENOT Component Side Print Side NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 32 NOTE: This connector is present on FHHL P-Series DPUs only. It is Connector not present on FHHL E-Series DPUs. 10 RTC Battery Battery holder for RTC eMMC x8 NAND flash Interface Interfaces of MBF2H516C-EECOT, MBF2H516C-EESOT, MBF2M516C-EECOT and MBF2M516C-EESOT NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 33 The NC-SI connector type differs per the product HW version: Management In the Engineering samples, a 30-pin NC-SI connector is populated, Interface whereas in HW versions B200 and up, a 20-pin NC-SI connector is populated. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 34 Interfaces Detailed Description DPU IC NVIDIA® BlueField®-2 DPU is a family of advanced DPU IC solutions that integrate a coherent mesh of 64-bit Arm v8 A72 cores, an NVIDIA® ConnectX®-6 Dx network adapter front-end, and a PCI Express switch into a single chip. The powerful DPU IC architecture includes an Armv8 multicore processor array and enables customers to develop sophisticated applications and highly differentiated feature sets.
  • Page 35 Networking Ports LEDs Interface There is one bicolor (Yellow and Green) I/O LED per port to indicate speed and link status. State Bi-Color LED (Yellow/Green) Beacon command for 1Hz blinking Yellow locating the adapter card NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 36 PCIe Gen 4.0, and 3.0, 2.0 and 1.1 compatible 2.5, 5.0, or 8.0, or 16.0 GT/s link rate x16 lanes Auto-negotiates to x16, x8, x4, x2, or x1 Support for MSI/MSI-X mechanisms DDR4 SDRAM On-Board Memory NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 37 The USB to UART cable is not used for NC-SI management purposes. DPU OPN Maximum Trace Length on the Board MBF2M516C-EECOT MBF2M516C-EESOT 5 inch in 30-pin connector MBF2H516C-EECOT 10 inch in 20-pin connector MBF2H516C-EESOT MBF2M345A-HECOT 3.3inch MBF2M345A-HESOT MBF2H516A-EEEOT MBF2H516A-EENOT MBF2M516A-EECOT 6inch MBF2M516A-EEEOT MBF2M516A-EENOT NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 38 Warnings: Once a cable is plugged into the UART interface, its other side must be plugged into a USB connector. Leaving the USB side unconnected might lead to unexpected behavior of the DPU card. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 39 The cable is not included in the MBF2M345A- connector shipped DPU card box and should be ordered separately HESOT as part of the accessories kit (P/N: MBF25-DKIT). MBF2M516C- EECOT MBF2M516C- EESOT MBF2H516C- NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 40 The BMC node enables remote power cycling, board environment monitoring, BlueField-2 chip temperature monitoring, board power, and consumption monitoring, and individual interface resets. The BMC also supports the ability to push a boot stream to BlueField-2. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 41 There are 2 OOB management LEDs, one green and one amber/yellow. The following table describes LED behavior for DPUs with or with onboard BMC. LED Indications Link Activity Green Amber/Yellow DPUs with BMC DPUs without BMC NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 42 External PCIe Power Supply Connector Warning Applies to FHHL P-Series DPUs only, OPNs MBF2H516A-CEEOT and MBF2H516A-CENOT. Important FHHL P-Series DPUs require supplementary power from a 6-pin ATX power supply connector in addition to a minimum of 75W power NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 43 NAND flash and is used for Arm boot, operating system storage and disk space. Memory size is either 64GB or 128GB, where 128GB is effectively 40GB with high durability. MMCX RA PPS IN/OUT Interface Warning Applies to the following OPNs: MBF2H516C-EECOT, MBF2H516C- EESOT, MBF2M516C-EECOT, MBF2M516C-EESOT. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 44 The DPU PTP solution allows you to run any PTP stack on your host. With respect to testing and measurements, selected NVIDIA DPUs allow you to use the PPS-out signal from the onboard MMCX RA connectors; the DPU also allows measuring PTP in scale, with the PPS-In signal.

  • Page 45: Hardware Installation

    This equipment should not be operated in an area with an ambient temperature exceed ing the maximum recommended: 55°C (131°F). An airflow of 200LFM at this maximum ambient temperature is required for HCA cards NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 46 CLASS 1 LASER PRODUCT and reference to the most recent laser standards: IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:20 Installation Procedure Overview NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 47 (particulate) contamination. The operating environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8 for cleanliness level. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 48 75W through the supplementary 6-pin ATX power supply connector (Relevant for OPNs: MBF2H516A-EEEOT MBF2H516A-EENOT, MBF2H516C-EECOT and MBF2H516C-EESOT). Airflow Requirements DPU is offered with one airflow pattern: from the heatsink to the network ports. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 49 It is strongly recommended to use an ESD strap or other antistatic devices. Unpacking Check against the package contents list that all the parts have been sent. Check the parts for visible damage that may have occurred during shipping. Please note that the cards NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 50 Before you install the DPU, make sure that the system is disconnected from power. Installation Instructions This section provides detailed instructions on installing your DPU in a system. Warning Please note that the following figures are for illustration purposes only. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 51 3. Applying even pressure at both corners of the card, insert the DPU into the PCI Express slot until firmly seated. Important Do not use excessive force when seating the card, as this may damage the system or the DPU. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 52 6-pin power connector from the power supply to the power connector on the top edge of the DPU. Note that the connector and socket on the graphics card have a unique shape and connect one way only. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 53 3. Insert the connector into the DPU card. Be careful to insert the connector straight into the cage. Do not apply any torque, up or down, to the connector cage in the DPU card. 4. Make sure that the connector locks in place. Warning NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 54 A UART console interface is located on the DPU. Connect the supplied USB 2.0 Type-A to a 30pin Flat Socket cable from this interface to a motherboard/desired server for UART console capabilities. For more information on the NC-SI interface, please refer to UART Interface Connectivity. Important NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 55 3. Carefully connect the 30 pin connector on the board to the mating cable. 4. Connect the USB cable to the desired interface master, which can be a motherboard or any desired server. Do not leave the USB side unattended. Uninstalling the DPU NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 56 4. Holding the DPU from its center, gently pull the DPU out of the PCI Express slot. 5. When the port connectors reach the top of the chassis window, gently pull the DPU in parallel to the motherboard. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 57: General Troubleshooting

    Forgot password needed to Refer to the latest version of BlueField DPU SW Manual install/upgrade the and follow instructions under "Upgrading NVIDIA BlueField-2 DPU image BlueField DPU Software" section. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 58 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 59: Specifications

    (14.0625Gb/s per lane), QDR (10Gb/s per lane), DDR (5Gb/s per lane), 1X/2X/4X SDR (2.5Gb/s per lane) Single-channel with 8 DDR4 8 bit + ECC (64bit + 8bit ECC) 16GB @ Onboard 3200MT/s Memory 64GB eMMC memory NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 60 If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.
  • Page 61 Voltage: 12V DPU Power Maximum power available through QSFP56 port: 2.5W (per port) Supply, Consumption Power and airflow specifications are provided in NVIDIA BlueField-2 and Airflow DPUs Power and Airflow Specifications document, which is available at NVOnline following login. Environmental Operational 0°C to 55°C...
  • Page 62 If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.
  • Page 63 Voltage: 12V DPU Power Maximum power available through QSFP56 port: 2.5W (per port) Supply, Consumption Power and airflow specifications are provided in NVIDIA BlueField-2 and Airflow DPUs Power and Airflow Specifications document, which is available at NVOnline following login. Operational 0°C to 55°C...
  • Page 64 If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.
  • Page 65 If your target application for this crypto-enabled card will utilize 100Gb/s or higher bandwidth, where a substantial part of the bandwidth will be allocated for IPsec traffic, please refer to the NVIDIA BlueField-2 DPUs Release Notes document to learn about a potential bandwidth limitation. See Related Documents section for details on accessing the document.
  • Page 66 NVIDIA InfiniBand product. The non-operational storage temperature specifications apply to the product without its package. MBF2H516C-EECOT/ MBF2H516C-EESOT Specifications Important To power up these FHHL P-Series DPUs with x16 PCIe Gen 4 lanes, you need to connect a PCIe external power cable to the onboard 6- pin ATX connector.
  • Page 67 Voltage: 12V DPU Power Maximum power available through QSFP56 port: 2.5W (per port) Supply,Consum ption and Power and airflow specifications are provided in NVIDIA BlueField-2 Airflow DPUs Power and Airflow Specifications document, which is available at NVOnline following login. Operationa 0°C to 55°C...
  • Page 68 All dimensions are in millimeters. The PCB mechanical tolerance is +/- 0.13mm. The diagrams may differ for different cards and are only provided here for illustration purposes. HHHL DPUs FHHL DPUs Bracket Mechanical Drawing Note All dimensions are in millimeters. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 69 Group # Bracket Tall bracket: Short bracket: MBF2M345A- HECOT MBF2M345A- HESOT MBF2H516A- EEEOT MBF2H516A- EENOT MBF2M516A- EECOT MBF2M516A- EEEOT MBF2M516A- EENOT MBF2H516C- EECOT MBF2H516C- EESOT MBF2M516C- EECOT MBF2M516C- EESOT NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 70: Monitoring

    Refer to the below table for heatsink details per card configuration. For the required airflow (LFM) per OPN, please refer to the NVIDIA BlueField-2 DPUs Power and Airflow Specifications document, available at NVOnline following login. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 71: Finding The Guid/Mac On The Dpu

    Finding the GUID/MAC on the DPU Each NVIDIA adapter card has a different identifier printed on the label: serial number and the card MAC for the Ethernet protocol and the card GUID for the InfiniBand protocol. VPI cards have both a GUID and a MAC (derived from the GUID).
  • Page 72 The gap between the MAC addresses is a set by constant numbers in HEX.The OOB, ECPF, and MPF MAC addresses depend on the BASE MAC address. DPU Board Label (Example) NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 73 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 74: Supported Servers And Power Cords

    A620-G40 Inspur NF5280M5 Inspur SA5212M5 Inspur NF5280R6 Inspur SA5280R6 Lenovo SR630 V2 Lenovo SR655 (AMD) Lenovo SR635 (AMD) Super Micro AS-2114GT-DRN Super Micro AS-2114GT-DNR Super Micro SYS-120U-TNR Super Micro SYS-220U-TNR R4900 G3 R4900 G5 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 75 5288H V5/V6 Supported Power Cords Vendor Part Number Description Name 72-102163- Cisco-UCSC M6/7 1U Power Cable for NVIDIA BlueField-2 CISCO 72-102164- Cisco-UCSC M6/7 2U Power Cable for NVIDIA BlueField-2 755742-001 HP GPU Power Cable for hp dl380 gen9 805123-001...

  • Page 76: Pin Description

    3.3V 3.3V - Not Connected TRST# JTAG - Not Connected 3.3V 3.3V - Not Connected 3.3V_AUX PERST# PCIe Reset WAKW#/RSVD RSVD REFCLK+ Host Reference Clock REFCLK- Host Reference Clock PETP0 PETN0 PERP0 PERN0 RSVD NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 77 Pin # Signal Name Description RSVD PETP1 PETN1 PERP1 PERN1 PETP2 PETN2 PERP2 PERN2 PETP3 PETN3 PERP3 PERN3 RSVD RSVD RSVD RSVD PETP4 PETN4 PERP4 PERN4 PETP5 PETN5 PERP5 PERN5 PETP6 PETN6 PERP6 PERN6 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 78 Pin # Signal Name Description Pin # Signal Name Description PETP7 PETN7 PERP7 PERN7 RSVD RSVD PETP8 PETN8 PERP8 PERN8 PETP9 PETN9 PERP9 PERN9 PETP10 PETN10 PERP10 PERN10 PETP11 PETN11 PERP11 PERN11 PETP12 PETN12 PERP12 PERN12 PETP13 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 79 4-pin Vertical USB Connector The below table provides the 4-pin vertical USB connector on the DPU. For further details, please refer to USB Interface. Pin # Signal +5V_USB USB DP USB DN External Power Supply Connector NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 80 Please follow the link to the table coinciding with the OPN you have purchased. Link to NC-SI connector mapping MBF2M345A-HECOT Table A - NC-SI Connector Pins MBF2M345A-HESOT MBF2M516A-EECOT Table B - NC-SI Connector Pins NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 81 PACK_ID[2:0] signals allow for 8 unique card IDs. The system configurator sets the unique value per card via the connecting harness. Description / Pin Name Comments 50MHz REF CLK for NC- NCSI_REF_CLK Input SI BUS Ground NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 82 Transmit Data In 0 Ground NCSI_TX_D1 Input Transmit Data In 0 Ground NCSI_TX_EN Input Transmit Enable Ground Reserved SOFT_RST#, connected to BlueField-2 device pin HOST_GPIO[7] Input/Ou ARM_I2C1_SDA Open-drain signal tput Input/Ou ARM_NSRST# Open-drain signal tput NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 83 This table applies to all HW versions of the following OPNs: MBF2M516A-EECOT, MBF2M516A-EEEOT, MBF2M516A-EENOT, MBF2H516A-EECOT, MBF2H516A-EEEOT, MBF2H516A-EENOT, MBF2H516C-EECOT, MBF2H516C-EESOT, MBF2M516C-EECOT and MBF2M516C-EESOT. PACK_ID[2:0] signals allow for 8 unique card IDs. The system configurator sets the unique value per card via the connecting harness. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 84 Carrier Sense / Receive NCSI_CRS_DV Output Data Valid Ground NCSI_TX_D0 Input Transmit Data In 0 Ground NCSI_TX_D1 Input Transmit Data In 0 Ground NCSI_TX_EN Input Transmit Enable Ground Reserved Reserved Input/Ou BMC_I2C2_SDA Open-drain signal tput NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 85: 30-Pin Nc-Si Connector

    BMC_TX5 Output data output Not Connected UART transmit serial BMC_RX5 Input data input 30-pin NC-SI Connector Warning The below table applies to the engineering samples of the following OPNs: MBF2H516C-EECOT, MBF2H516C-EESOT, MBF2M516C-EECOT and MBF2M516C-EESOT. NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 86 Carrier Sense / Receive NCSI_CRS_DV Output Data Valid Ground NCSI_TX_D0 Input Transmit Data In 0 Ground NCSI_TX_D1 Input Transmit Data In 0 Ground NCSI_TX_EN Input Transmit Enable Ground Reserved Reserved Input/Ou BMC_I2C2_SDA Open-drain signal tput NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 87 See description above Input pin NIC_GPIO[46] table Ground NIC_BMC_CTRL0, connected to BMC device pin Y3 (Open Drain) Not Connected UART transmit serial BMC_TX5 Output data output Not Connected UART transmit serial BMC_RX5 Input data input NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

  • Page 88: Document Revision History

    May. Updated Specifications - added non-operational storage temperature 2023 specifications Apr. Added device ID and PSID information in NVIDIA BlueField-2 InfiniBand/Ethernet 2023 DPU User Guide Added BlueField DPU Administrator Quick Start Guide Feb. Updated NC-SI connector pins in Pin Description 2023 Jan.
  • Page 89 2021 Sep. Updated System Requirements section. 2021 In Supported Interfaces sections: Updated mechanical drawing and USB section description Jun. Added note that port cages of some cards operate in SFP28/QSFP28 2021 mode by default NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...
  • Page 90 Removed the UART interface from "Supported Interfaces" 2020 Updated "Package Contents" Updated the NCSI interface pinouts Dec. Added "Supported Servers and Power Cords" chapter 2020 Oct. First release 2020 © Copyright 2023, NVIDIA. PDF Generated on 06/07/2024 NVIDIA BlueField-2 InfiniBand/Ethernet DPU User Guide...

This manual is also suitable for:

900-9d2 50-0048-st1900-9d2 50-0048-st1a900-9d2 50-0038-st1900-9d2 19-0066-st3900-9d2 19-0066-st3a900-9d2 19-0056 -sq0 ... Show all

Table of Contents