Mellanox Technologies MNPH29C-XSR User Manual
Mellanox Technologies MNPH29C-XSR User Manual

Mellanox Technologies MNPH29C-XSR User Manual

Connectx-2 en dual port sfp+ ethernet adapter card
Table of Contents

Advertisement

®
ConnectX
-2 EN Dual Port SFP+ Ethernet
Adapter Card User Manual
P/N:
MNPH29C-XSR, MNPH29C-XTR, MNPH29D-XSR, MNPH29D-XTR
Rev 1.6
www.mellanox.com

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the MNPH29C-XSR and is the answer not in the manual?

Questions and answers

Summary of Contents for Mellanox Technologies MNPH29C-XSR

  • Page 1 ® ConnectX -2 EN Dual Port SFP+ Ethernet Adapter Card User Manual P/N: MNPH29C-XSR, MNPH29C-XTR, MNPH29D-XSR, MNPH29D-XTR Rev 1.6 www.mellanox.com...
  • Page 2 Mellanox®, BridgeX®, ConnectX®, InfiniBlast®, InfiniBridge®, InfiniHost®, InfiniRISC®, InfiniScale®, InfiniPCI®, PhyX® and Virtual Protocol Interconnect® are registered trademarks of Mellanox Technologies, Ltd. CORE-Direct and FabricIT are trademarks of Mellanox Technologies, Ltd. All other marks and names mentioned herein may be trademarks of their respective companies. ConnectX-2 Ethernet Card User Manual...
  • Page 3: Table Of Contents

    B.3 PCI Express Connector Pinout B.4 SFP+ Connector Pinout Appendix C Replacing a Tall Bracket With a Short Bracket C.1 Remove the Existing Bracket from the Adapter Card C.2 Installing the New Bracket Appendix D Avertissements de sécurité d’installation (Warnings in French) Mellanox Technologies...
  • Page 4 Rev 1.6 Appendix E Sicherheitshinweise (Warnings in German) Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) Mellanox Technologies...
  • Page 5: List Of Figures

    Figure 13: Schematic of the ConnectX-2 Small Form Factor MNPH29D Adapter Card Figure 14: Schematic of the ConnectX-2 Card MNPH29C Adapter Card Figure 15: Compatible Connector Plug and Pinout Figure 16: Rear View of Module With Pin Placement Figure 17: Remove the Bracket Figure 18: Putting on the Bracket Mellanox Technologies...
  • Page 6: List Of Tables

    Table 8: VPD Layout for MNPH29C-X[ST]R Table 9: Hardware and Software Requirements Table 10: Specifications for MNPH29D-X[ST]R Table 11: Specifications for MNPH29C-X[ST]R Table 12: Adapter Cards Certification Status Table 13: I2C-Compatible Connector Pinout Table 14: SFP+ Connector Pinout Mellanox Technologies...
  • Page 7: Revision History

    Removed Gen 1 cards Formatted EMC table Changed EN 60950-1: 2001 to EN 60950-1: 2006 Changed RDMA over Ethernet Added RDMA over Ethernet New template April 2010 New power numbers Feb. 2010 Added Section on PXE boot Feb. 2010 Initial Release Mellanox Technologies...
  • Page 8: About This Manual

    Rev 1.6 About this Manual ® This User Manual describes Mellanox Technologies ConnectX -2 Dual Port 10Gigabit Ethernet PCI Express x8 adapter cards. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant documentation.
  • Page 9: Firmware And Software Updates

    The Mellanox support downloader contains software, firmware and knowledge database informa- tion for Mellanox products. Access the data base from the Mellanox Support Web page, http://www.mellanox.com=>Support or use the following link to go directly to the Mellanox Support Download Assistant page, http://www.mellanox.com/supportdownloader/. Mellanox Technologies...
  • Page 10: Chapter 1 Overview

    Overview Overview ® This document is a User Manual for Mellanox Technologies cards based on the ConnectX ENintegrated circuit device. The cards described in this manual have the following main features: • IEEE Std 802.3 compliant • 10 Gb/s Ethernet •...
  • Page 11: Adapter Cards Covered In This Manual

    PCIe Gen2 10 +10 Gb/s Short MT25408B0-FCCR-TE 5.0 GT/s Ethernet 2 ports MNPH29C-XTR PCIe Gen2 10 +10 Gb/s Tall MT25408B0-FCCR-TE 5.0 GT/s Ethernet 2 ports MNPH29C-XSR PCIe Gen2 10 +10 Gb/s Short MT25408B0-FCCR-TE 5.0 GT/s Ethernet 2 ports Mellanox Technologies...
  • Page 12 Rev 1.6 Overview Figure 1: SFP+ NIC Component Side and Bracket Views MNPH29D MNPH29C Mellanox Technologies...
  • Page 13: Mellanox Part Numbering Legend

    ConnectX-2 Ethernet Card User Manual Rev 1.6 Mellanox Part Numbering Legend Table 4 describes the Mellanox Technologies adapter cards part numbering legend. Table 4 - Mellanox Cards Part Numbering Key Adapter Card Field Decoder MHTS#I-XBR Mellanox Technologies Adapter Type H = InfiniBand Host Channel Adapter, N = Ethernet Network Interface Card...
  • Page 14: Finding The Mac And Serial Number On The Adapter Cards

    This equipment should not be operated in an area with an ambient temperature exceed- ing the maximum recommended: 55°C (131°F). To guarantee proper air flow, allow at least 8cm (3 inches) of clearance around the ven- tilation openings. Mellanox Technologies...
  • Page 15 6. Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula- tions. 7. Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes. Mellanox Technologies...
  • Page 16: Chapter 2 Adapter Card Interfaces

    2.1.2 PCI Express Interface The ConnectX-2 adapter cards support PCI Express 2.0 (1.1 compatible) through an x8 edge con- nector. The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations. Mellanox Technologies...
  • Page 17: Table 5: Leds

    Constant on indicates no Data Transfer Port 2 Physical Link - Green Constant on indicates a good physical link Blinking indicates a problem with the Physical Port 2 link Data Activity - Yellow Blinking indicates Data Transfer Constant on indicates no Data Transfer Mellanox Technologies...
  • Page 18: Power

    There is a jumper on each adapter card that indicates to the device whether an on-board Flash device is to be used. Table 6 provides information on this jumper. See the schematic in Appendix A,“Specifications,” on page 34 for the jumper location. Mellanox Technologies...
  • Page 19: Vpd Layout

    Each board incorporates an EEPROM that is accessible through the I2C. The EEPROM is used for storing the Vital Product Data (VPD). The EEPROM capacity is 4Kb. VPD Layout The PCI VPD (Vital Product Data) layout, for each of the described Mellanox Technologies Con- ® nectX -2 adapter cards complies with the format defined in the PCI 2.3 Specification, Appendix I.
  • Page 20: Table 8: Vpd Layout For Mnph29C-X[St]R

    0x4F Length [15:8] MSB 0x00 VPD Keyword Add in Card Part Number Length 0x15 %STR_SPC VPD Keyword Engineering Change Level of the card (rev) Length Revision %STR PCB revision VPD Keyword Serial Number Length 0x18 SerialNumber %STR_SPC “00..00XXXX..XX” Mellanox Technologies...
  • Page 21 Length [15:8] MSB 0x00 VPD Keyword EFI Driver version Length Data STR_SPC VPD Keyword Asset Tag Length 0x20 Data STR_SPC “N/A” VPD Keyword Remaining read/write area Length 0x6A Data STR_ZERO Reserved (0x00) Small Resource Type END Tag (0x11) 0x78 Mellanox Technologies...
  • Page 22: Chapter 3 Driver Software And Firmware

    Adapter Card To use RoCE you will need the following versions of firmware and software: • OFED 1.5.1 or later • firmware version 2.7.700 or later 3.2.2 Installation For installation instructions visit: www.mellanox.com => Support => Ethernet SW/Driver Mellanox Technologies...
  • Page 23: Updating Card Firmware

    Please contact Mellanox system support if you cannot find the firmware binary for your adapter card. To check the latest firmware: 1. Go to Mellanox web site to check current firmware version. Go to: http://www.mellanox.com/supportdownloader 2. Enter your card PSID and compare the firmware versions. Mellanox Technologies...
  • Page 24: Connectx En Pxe

    To enable one must place the PXE ROM image to the flash. This software is based on the open source Etherboot/gPXE project (see www.etherboot.org). For more details go to http://www.mellanox.com Products => Ethernet SW/Drivers > ConnectX EN PXE. Mellanox Technologies...
  • Page 25: Chapter 4 Ethernet Adapter Card Installation

    Please consult the host machine documentation for instructions on how to install a PCI Express card. When more than one PCI slot is available make sure to use the PCI slot with the proper configuration. Mellanox Technologies...
  • Page 26: Set Up

    If you cannot find any PCI device, click Action --> Scan for hardware changes. If no PCI devices are detected, check that the network adapter card(s) is correctly installed in the PCI slot or try installing the adapter card into a different PCI slot. Mellanox Technologies...
  • Page 27 3. Select a PCI Device / InfiniBand Controller entry. 4. Right-click. 5. Select “Properties to display the PCI Device Properties” window. 6. Click the Details tab and select Device Instance Id (Windows 2003) or Hardware Ids (Windows 2008/R2) from the Property pull-down menu. Mellanox Technologies...
  • Page 28 7. In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_6368”: VEN is equal to 0x15B3 – this is the Vendor ID of Mellanox Technologies; and DEV is equal to 0x6368 – this is a valid Mellanox Technologies PCI Device ID.
  • Page 29 Technologies”: > lspci | grep Mellanox 2:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0) Make sure that either the MLNX_OFED driver or the MLNX_EN driver is loaded and configured. Check the link status First check the network interface name by running the command.
  • Page 30 If you don’t see the mlx4_en driver, run: ’ modprobe mlx4_en’ Another option is to use the command below to see which modules are active. Edit ”/etc/infiniband/openib.conf” which modules needs to loaded from a service. For example: # Load MLX4_EN module MLX4_EN_LOAD=yes Mellanox Technologies...
  • Page 31: Cables And Modules

    SFP+ transceiver modules are available for both SR and LR protocols. www.mellanox.com => Products => Cables for certified and approved cable recommenda- tions. 4.4.1 Optical modules for SFP+ SFP+ transceiver modules can be used to connect fiber optic cables to the cards greatly increasing the cable reach. Mellanox Technologies...
  • Page 32: Cable Installation

    When a logical connection is made the YELLOW LED will come on. When data is being transferred the yellow led will blink. When installing cables make sure that the latches engage. Mellanox Technologies...
  • Page 33 Both LED indicators will turn off when the cable is unseated. Cables, especially long copper cables, can weigh a substantial amount. Make sure that the weight of the cable is supported on its own and is not hanging from the adapter card. Mellanox Technologies...
  • Page 34: Appendix A Specifications

    EN 60950-1:2006 EMI: CLASS 1 LASER PRODUCT IEC 60 825-1:1993 + A1:1997 + A2:2001 EN 60825-1:1994+A1:1996+ A2:2001” RoHS: RoHS R6 a. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. Mellanox Technologies...
  • Page 35: Mnph29C-X[St]R Specifications

    Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. A.3 Board Mechanical Drawing and Dimensions All of the cards covered in this User Manual have the same mechanical drawing and share the same dimensions as depicted in Figure 13 or Figure 14. Mellanox Technologies...
  • Page 36 Rev 1.6 All dimensions are in millimeters. All the mechanical tolerances are +/-0.1mm Figure 13: Schematic of the ConnectX-2 Small Form Factor MNPH29D Adapter Card 142.25 12.75 15.00 45.96 3.65 1.90 45.01 Mellanox Technologies...
  • Page 37: Emc Certification Statements

    57.15 96.30 A.4 EMC Certification Statements Table 12 lists the approved certification status per in different regions of the world. Table 12 - Adapter Cards Certification Status Adapter Card P/N VCCI ICES cTUVus C-TICK MNPH29C-XTR MNPH29C-XSR MNPH29D-XTR MNPH29D-XSR Mellanox Technologies...
  • Page 38 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsible for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. §15.105(a) Statement NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
  • Page 39 (commercial broadcasting and Distributors or users pay attention to this point . This device is communication equipment ) usually aimed to be used in other area except at home . Remark Class A device: operated in a commercial area. Mellanox Technologies...
  • Page 40: Appendix B Interface Connectors Pinout

    Signal Name SPSDA 5 1 2 3 4 SPSCL B.2 PCI Express x8Connector Pinout These cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 2.0 specification. Mellanox Technologies...
  • Page 41: Pci Express Connector Pinout

    ConnectX-2 Ethernet Card User Manual Rev 1.6 B.3 PCI Express Connector Pinout B.4 SFP+ Connector Pinout Figure 16: Rear View of Module With Pin Placement 13.70 8.50 SFP+ Cage Mellanox Technologies...
  • Page 42: Table 14: Sfp+ Connector Pinout

    LOS is open collector output. Should be pulled up with 4.7kΩ – 10kΩ on host board to a voltage between 2.0V and 3.6V. Logic 0 indicates normal operation; logic 1 indicates loss of signal. Mellanox Technologies...
  • Page 43: Appendix C Replacing A Tall Bracket With A Short Bracket

    Do not force the bracket onto the card. You may have to gently push the LEDs using a small screwdriver to align the LEDs with the holes in the bracket. 5. Screw on the bracket using the screws and washers saved from the procedure above step 1. Mellanox Technologies...
  • Page 44 Rev 1.6 Figure 18: Putting on the Bracket 6. Make sure that the LEDs are aligned onto the bracket holes. 7. Use a torque driver to apply up to 2 lbs-in torque on the screws. Mellanox Technologies...
  • Page 45: Appendix D Avertissements De Sécurité D'installation (Warnings In French)

    L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. 7. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies...
  • Page 46 6. Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. 7. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies...
  • Page 47 La instalación, el reemplazo y el mantenimiento de este equipo estarán a cargo únicamente de personal capacitado y competente. 6. Eliminación de equipos La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales. Mellanox Technologies...
  • Page 48 Rev 1.6 Códigos eléctricos locales y nacionales Este equipo se debe instalar conforme a los códigos eléctricos locales y nacio- nales. Mellanox Technologies...

This manual is also suitable for:

Mnph29c-xtrMnph29d-xsrMnph29d-xtr

Table of Contents