Subscribe to Our Youtube Channel
Related Manuals for Mellanox Technologies ConnectX MHRH19-XTC
Summary of Contents for Mellanox Technologies ConnectX MHRH19-XTC
- Page 1 ® ConnectX IB HCA Adapter Card with QSFP Connectors User Manual P/N: MHRH19-XTC, MHRH19-XSC, MHRH29-XSC, MHRH29-XTC, MHQH19-XTC, MHQH19-XSC, MHQH29-XSC, MHQH29-XTC Rev 1.5 www.mellanox.com...
- Page 2 Mellanox®, BridgeX®, ConnectX®, InfiniBlast®, InfiniBridge®, InfiniHost®, InfiniRISC®, InfiniScale®, InfiniPCI®, PhyX® and Virtual Protocol Interconnect® are registered trademarks of Mellanox Technologies, Ltd. CORE-Direct and FabricIT are trademarks of Mellanox Technologies, Ltd. All other marks and names mentioned herein may be trademarks of their respective companies. Mellanox Technologies...
-
Page 3: Table Of Contents
B.2 PCI Express x8 Connector Pinout B.3 PCI Express Connector Pinout B.4 QSFP Connector Pinout Appendix C Replacing a Tall Bracket With a Short Bracket C.1 Replacing a Bracket C.2 Remove the Existing Bracket from the Adapter Card Mellanox Technologies... - Page 4 Rev 1.5 C.3 Installing the New Bracket Appendix D Avertissements de sécurité d’installation (Warnings in French) Appendix E Sicherheitshinweise (Warnings in German) Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) Mellanox Technologies...
-
Page 5: List Of Figures
Figure 10: Schematic of the Dual Port Adapter Card MH[RQ]H29B-X[ST]R Figure 11: Compatible Connector Plug and Pinout Figure 12: Connector and Cage Views Figure 13: Remove the Bracket Figure 14: Gasket Installation Figure 15: Placing the Bracket on the Card Mellanox Technologies... -
Page 6: List Of Tables
Specifications for MHRH19-X[ST]C Table 11: Specifications for MHQH19-X[ST]C Table 12: Specifications for MHRH29-XSC/-XTC Table 13: Specifications for MHQH29-XSC/-XTC Table 14: HCA Cards Certification Status Table 15: I2C-Compatible Connector Pinout Table 16: Connector Pin Name and Number to Signal Name Correspondence Mellanox Technologies... -
Page 7: Revision History
Fixed links to website 2008 Added single port cards August 1.05 Added French Translation of Safety Warnings Removed Watermark 2008 April 2008 0.20 Added MHRH Changed Link from OFED to Mellanox ODFED Removed Confidential March 2008 0.10 Initial Release Mellanox Technologies... -
Page 8: About This Manual
Rev 1.5 About this Manual This User Manual describes Mellanox Technologies MH[RQ]H[12]9-X[ST]C ConnectX IB PCI Express x8 HCA Adapter cards. HCAIt provides details as to the interfaces of the board, specifica- tions, required software and firmware for operating the board, and relevant documentation. -
Page 9: Firmware And Software Updates
The Mellanox support downloader contains software, firmware and knowledge database informa- tion for Mellanox products. Access the data base from the Mellanox Support Web page, http://www.mellanox.com=>Support or use the following link to go directly to the Mellanox Support Download Assistant page, http://www.mellanox.com/supportdownloader/. Mellanox Technologies... -
Page 10: Chapter 1 Overview
Rev 1.5 Overview Overview This document is a User Manual for Mellanox Technologies host channel adapter (HCA) cards ® based on MT25408 , ConnectX IBthe ConnectXintegrated circuit device. The cards described in this manual have the following main features: • QSFP ports for connecting InfiniBand traffic at 10Gb/s (SDR), 20Gb/s (DDR), 40Gb/s (QDR) •... -
Page 11: Adapter Cards Covered In This Manual
Number (OPN) Memory Brack Speed Size MHRH19-XTC 20Gb/s No Mem Tall (DDR) Single port MHRH19-XSC 20Gb/s No Mem Short (DDR) Single port MHQH19-XTC 40Gb/s No Mem Tall (QDR) Single port MHQH19-XSC 40Gb/s No Mem Short (QDR) Single port Mellanox Technologies... - Page 12 Number (OPN) Memory Brack Speed Size MHRH29-XTC 20Gb/s No Mem Tall (DDR) Figure 1: MH[RQ]H29-XTC Card Dual port MHRH29-XSC Short MHQH29-XTC 40Gb/s No Mem Tall (QDR) Dual port MHQH29-XSC Short Short Bracket Tall Bracket These cards are RoHS-R5 Compliant. Mellanox Technologies...
-
Page 13: Mellanox Part Numbering Legend
Rev 1.5 Mellanox Part Numbering Legend Table 4 describes the Mellanox Technologies adapter cards part numbering legend. Table 4 - Mellanox Cards Part Numbering Key Adapter Card Field Decoder MHTS#I-XBR Mellanox Technologies Adapter Type H = InfiniBand Host Channel Adapter, N = Ethernet Network Interface Card... -
Page 14: Finding The And Serial Number On The Adapter Cards
4. Copper Cable Connecting/Disconnecting Some copper cables are heavy and not flexible, as such they should be carefully attached to or detached from the connectors. Refer to the cable manufacturer for spe- cial warnings and instructions. Mellanox Technologies... - Page 15 6. Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula- tions. 7. Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes. Mellanox Technologies...
-
Page 16: Chapter 2 Adapter Card Interfaces
PCI Express Interface The ConnectX-adapter cards support PCI Express 2.0 (1.1 compatible) through an x8 edge con- nector. The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations. Mellanox Technologies... -
Page 17: Table 5: Leds
2.1.4 I C Compatible Interface A three-pin header on the HCA Adapter card is provided as the I C compatible interface. See Appendix A,“Specifications,” on page 34 for the location on the board. Figure 5: I C Connector Mellanox Technologies... -
Page 18: Power
Each board incorporates an EEPROM that is accessible through the I2C. The EEPROM is used for storing the Vital Product Data (VPD). The EEPROM capacity is 512 bytes. VPD Layout The PCI VPD (Vital Product Data) layout, for each of the described Mellanox Technologies Con- ® nectX -HCA Adapter adapter cards complies with the format defined in the PCI 2.3 Specifica-... -
Page 19: Table 7: Vpd Layout For Mhrh[12]9-X[St]C
Tag (0x11) Length [7:0] LSB 0x9A Length [15:8] MSB 0x00 VPD Keyword EFI Driver version Length Data STR_SPC VPD Keyword Asset Tag Length 0x20 Data STR_SPC “N/A” VPD Keyword Remaining read/write area Length 0x6b Data STR_ZERO Reserved (0x00) Mellanox Technologies... - Page 20 Rev 1.5 Adapter Card Interfaces Table 7 - VPD Layout for MHRH[12]9-X[ST]C Offset Item Value Format Description (Decimal) Small Resource Type END Tag 0x78 (0x11) Mellanox Technologies...
-
Page 21: Table 8: Vpd Layout For Mhqh[12]9-X[St]C
Tag (0x11) Length [7:0] LSB 0x9A Length [15:8] MSB 0x00 VPD Keyword EFI Driver version Length Data STR_SPC VPD Keyword Asset Tag Length 0x20 Data STR_SPC “N/A” VPD Keyword Remaining read/write area Length 0x6b Data STR_ZERO Reserved (0x00) Mellanox Technologies... - Page 22 Rev 1.5 Adapter Card Interfaces Table 8 - VPD Layout for MHQH[12]9-X[ST]C Offset Item Value Format Description (Decimal) Small Resource Type END Tag 0x78 (0x11) Mellanox Technologies...
-
Page 23: Chapter 3 Driver Software And Firmware
3.3.1 Hardware and Software Requirements Software: Operating Systems: • RHEL5.4 2.6.18-164.el5 x86_64 or later • Mellanox OFED with GPUDirect support • NVIDIA Development Driver for Linux version 195.36.15 or later Hardware: • Mellanox ConnectX-2 HCA card • NVIDIA Tesla series Mellanox Technologies... -
Page 24: Updating Hca Adapter Card Firmware
Each card is shipped with the latest version of qualified firmware at the time of manufacturing. Firmware is updated occasionally, and the most recent firmware can be obtained from: http://www.mellanox.com =>Support > Download Center. Check that the firmware on your card is Mellanox Technologies... - Page 25 To check the latest firmware: 1. Go to Mellanox web site to check current firmware version. Go to: http://www.mellanox.com/supportdownloader 2. Enter your card PSID and compare the firmware versions. Figure 7: Support Download Assistant Mellanox Technologies...
-
Page 26: Chapter 4 Hca Infiniband Card Installation
PCI slot with less lanes than the card requires then the adapter card will not provide the optimum data transfer. Set Up This section is valid for InfiniBand, Ethernet and VPI cards. Disregard sections that are not relevant to your card. Mellanox Technologies... - Page 27 If you cannot find any PCI device, click Action --> Scan for hardware changes. If no PCI devices are detected, check that the network adapter card(s) is correctly installed in the PCI slot or try installing the adapter card into a different PCI slot. Mellanox Technologies...
- Page 28 3. Select a PCI Device / InfiniBand Controller entry. 4. Right-click. 5. Select “Properties to display the PCI Device Properties” window. 6. Click the Details tab and select Device Instance Id (Windows 2003) or Hardware Ids (Windows 2008/R2) from the Property pull-down menu. Mellanox Technologies...
- Page 29 7. In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_6368”: VEN is equal to 0x15B3 – this is the Vendor ID of Mellanox Technologies; and DEV is equal to 0x6368 – this is a valid Mellanox Technologies PCI Device ID.
- Page 30 Technologies”: > lspci | grep Mellanox 2:00.0 InfiniBand: Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] (rev b0) Make sure that either the MLNX_OFED driver or the MLNX_EN driver is loaded and configured. Check the link status First check the network interface name by running the command.
- Page 31 If you don’t see the mlx4_en driver, run: ’ modprobe mlx4_en’ Another option is to use the command below to see which modules are active. Edit ”/etc/infiniband/openib.conf” which modules needs to loaded from a service. For example: # Load MLX4_EN module MLX4_EN_LOAD=yes Mellanox Technologies...
-
Page 32: Cables And Modules
When a logical connection is made the YELLOW LED will come on. When data is being transferred the yellow led will blink. Mellanox Technologies... - Page 33 1. Pull on the latch release mechanism thereby unlatching the connector and pull the connector out of the cage. 2. Do not apply torque to the connector when removing it from the adapter card. 3. Remove any cable supports that were used to support the cable’s weight. Mellanox Technologies...
-
Page 34: Appendix A Specifications
RoHS-R5 a. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. b. The auto-negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architec- ture Specification, Release 1.2. Mellanox Technologies... -
Page 35: Mhqh19-X[St]C Specifications
RoHS-R5 a. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. b. The auto-negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architec- ture Specification, Release 1.2. A.3 MHRH29-X[ST]C Specifications... - Page 36 RoHS-R5 a. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. b. The auto-negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architec- ture Specification, Release 1.2. Mellanox Technologies...
-
Page 37: Mhqh29-X[St]C Specifications
RoHS-R5 a. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. b. The auto-negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architec- ture Specification, Release 1.2. A.5 Board Mechanical Drawing and Dimensions All of the cards covered in this User Manual have the same mechanical drawing and share the same dimensions as depicted in Figure 10. -
Page 38: Emc Certification Statements
HCAcard in different regions of the world. Table 14 - HCA Cards Certification Status VCCI KCC/BCC EN Class ICES Class HCA Card P/N FCC Class (USA) (Japan) (Korea) C-Tick (Europe) (Canada) MHRH19-XSC MHRH19-XTC MHQH19-XSC MHQH19-XTC Mellanox Technologies... - Page 39 Rev 1.5 Table 14 - HCA Cards Certification Status VCCI KCC/BCC EN Class ICES Class HCA Card P/N FCC Class (USA) (Japan) (Korea) C-Tick (Europe) (Canada) MHRH29-XSC MHRH29-XTC MHQH29-XSC MHQH29-XTC Mellanox Technologies...
- Page 40 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsible for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. §15.105(a) Statement NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
- Page 41 (commercial broadcasting and Distributors or users pay attention to this point . This device is communication equipment ) usually aimed to be used in other area except at home . Remark Class A device: operated in a commercial area. Mellanox Technologies...
-
Page 42: Appendix B Interface Connectors Pinout
Signal Name SPSDA 5 1 2 3 4 SPSCL B.2 PCI Express x8 Connector Pinout These cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 2.0 specification. Mellanox Technologies... -
Page 43: Pci Express Connector Pinout
View into Front of Cage 8.50 Table 16 - Connector Pin Name and Number to Signal Name Correspondence Connector Pin Number Connector Pin Name Port A Signal Name TXN_2 Tx2n TXP_2 Tx2p TXN_4 Tx4n TXP_4 Tx4p ModSelL_Port0 ModSelL ResetL_Port0 ResetL VccRx Mellanox Technologies... - Page 44 Connector Pin Name Port A Signal Name RXP_3 Rx3p RXN_3 Rx3n RXP_1 Rx1p RXN_1 Rx1n RXN_2 Rx2n RXP_2 Rx2p RXN_4 Rx4n RXP_4 Rx4p ModPrsl_Port0 Mod PrsL IntL IntL VccTx Vcc1 LPMode_Port0 LPMode TXP_3 Tx3p TXN_3 Tx3n TXP_1 Tx1p TXN_1 Tx1n Mellanox Technologies...
-
Page 45: Appendix C Replacing A Tall Bracket With A Short Bracket
2. Place the gasket for each port onto the new bracket. Make sure to correctly align the gasket with the hole in the bracket. 3. If the old gaskets are still on the card, remove them before installing the new bracket. Make sure that only one gasket per port is used. Mellanox Technologies... - Page 46 Figure 15: Placing the Bracket on the Card Gaskets in place on the bracket. 6. Make sure that the LEDs are aligned onto the bracket holes. 7. Use a torque driver to apply up to 2 lbs-in torque on the screws. Mellanox Technologies...
- Page 47 L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. 7. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies...
- Page 48 6. Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. 7. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies...
- Page 49 La instalación, el reemplazo y el mantenimiento de este equipo estarán a cargo únicamente de personal capacitado y competente. 6. Eliminación de equipos La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales. Mellanox Technologies...
- Page 50 Rev 1.5 Códigos eléctricos locales y nacionales Este equipo se debe instalar conforme a los códigos eléctricos locales y nacio- nales. Mellanox Technologies...
Need help?
Do you have a question about the ConnectX MHRH19-XTC and is the answer not in the manual?
Questions and answers