Mellanox Technologies ConnectX-2 Series User Manual

Mellanox Technologies ConnectX-2 Series User Manual

Lx vpi single port qsfp infiniband and ethernet adapter card
Table of Contents

Advertisement

®
ConnectX
-2 LX VPI Single Port QSFP
InfiniBand and Ethernet Adapter Card User
Manual
P/N: MHQA19-XSR, MHQA19-XTR, MHQA19-XNR
Rev 1.0
www.mellanox.com

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the ConnectX-2 Series and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Summary of Contents for Mellanox Technologies ConnectX-2 Series

  • Page 1 ® ConnectX -2 LX VPI Single Port QSFP InfiniBand and Ethernet Adapter Card User Manual P/N: MHQA19-XSR, MHQA19-XTR, MHQA19-XNR Rev 1.0 www.mellanox.com...
  • Page 2 © Copyright 2010. Mellanox Technologies. All rights reserved. Mellanox, BridgeX, ConnectX, Virtual Protocol Interconnect, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. CORE-Direct, FabricIT, and PhyX are trademarks of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners.
  • Page 3: Table Of Contents

    Appendix C Replacing a Tall Bracket With a Short Bracket C.1 Remove the Existing Bracket from the Adapter Card C.2 Installing the New Bracket Appendix D Avertissements de sécurité d’installation (Warnings in French) Appendix E Sicherheitshinweise (Warnings in German) Mellanox Technologies...
  • Page 4 Rev 1.0 Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) Mellanox Technologies...
  • Page 5: List Of Figures

    Hardware Devices Figure 8: PCI Device Figure 9: MHQA-19 Mechanical Drawing Figure 10: Compatible Connector Plug and Pinout Figure 11: Connector and Cage Views Figure 12: Remove the Bracket Figure 13: Gasket Installation Figure 14: Putting on the Bracket Mellanox Technologies...
  • Page 6: List Of Tables

    Jumper Configuration Table 7: MHQA19X[STN]R Table 8: Hardware and Software Requirements Table 9: Specifications for MHQA19-X[ST]C Table 10: Adapter Cards Certification Status Table 11: I2C-Compatible Connector Pinout Table 12: Connector Pin Name and Number to Signal Name Correspondence Mellanox Technologies...
  • Page 7: Revision History

    ConnectX-2 Card User Manual Rev 1.0 Revision History This document was printed on 11/17/10 . Table 1 - Revision History Table Date Comments/Changes Nov. 2010 Initial draft Mellanox Technologies...
  • Page 8: About This Manual

    Rev 1.0 About this Manual ® This User Manual describes Mellanox Technologies ConnectX -2 Single Port InfiniBand and Ethernet PCI Express x8 adapter cards. It provides details as to the interfaces of the board, specifi- cations, required software and firmware for operating the board, and relevant documentation.
  • Page 9: Firmware And Software Updates

    The Mellanox support downloader contains software, firmware and knowledge database informa- tion for Mellanox products. Access the data base from the Mellanox Support Web page, http://www.mellanox.com=>Support or use the following link to go directly to the Mellanox Support Download Assistant page, http://www.mellanox.com/supportdownloader/. Mellanox Technologies...
  • Page 10: Chapter 1 Overview

    Rev 1.0 Overview Overview This document is a User Manual for Mellanox Technologies cards based on the integrated circuit device. The cards described in this manual have the following main features: • Virtual Protocol Interconnect IBTA v1.2.1 compliant • Compliant with QSFP MSA spec Rev. 1.0 •...
  • Page 11: Adapter Cards Covered In This Manual

    Tall MT25414B0-FCCR-QI 5.0 GT/s 1 port MHQA19-XSR PCIe Gen2 40 Gb/s QDR Short MT25414B0-FCCR-QI 5.0 GT/s 1 port MHQA19-XNR PCIe Gen2 40 Gb/s QDR No bracket MT25414B0-FCCR-QI 5.0 GT/s 1 port Figure 1: Single Port Card Component Side Mellanox Technologies...
  • Page 12: Mellanox Part Numbering Legend

    Rev 1.0 Overview Mellanox Part Numbering Legend Table 4 describes the Mellanox Technologies adapter cards part numbering legend. Table 4 - Mellanox Cards Part Numbering Key Adapter Card Field Decoder MHTS#I-XBR Mellanox Technologies Adapter Type H = InfiniBand Host Channel Adapter, N = Ethernet Network Interface Card...
  • Page 13: Finding The And Serial Number On The Adapter Cards

    To guarantee proper air flow, allow at least 8cm (3 inches) of clearance around the ven- tilation openings. 3. During Lightning - Electrical Hazard During periods of lightning activity, do not work on the equipment or connect or dis- connect cables. Mellanox Technologies...
  • Page 14 6. Equipment Disposal Disposal of this equipment should be in accordance to all national laws and regula- tions. 7. Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes. Mellanox Technologies...
  • Page 15: Chapter 2 Adapter Card Interfaces

    This utility will prompt for the PCI device to be modified (if there is only one it will be selected automatically). At the next stage the user will be prompted for the desired mode for each port. Mellanox Technologies...
  • Page 16: Table 5: Leds

    Constant on indicates a good physical link Blinking indicates a problem with the Physical link Data Activity - Yellow Blinking indicates Data Transfer Constant on indicates no Data Transfer The short bracket has the same port and LED footprint as the tall bracket. Mellanox Technologies...
  • Page 17: Power

    There is a jumper on each adapter card that indicates to the device whether an on-board Flash device is to be used. Table 6 provides information on this jumper. See the schematic in Figure 9 on page 32 for the jumper location. Mellanox Technologies...
  • Page 18: Vpd Layout

    EEPROM is used for storing the Vital Product Data (VPD). The EEPROM capacity is 4Kb. VPD Layout The PCI VPD (Vital Product Data) layout, for each of the described Mellanox Technologies VPI adapter cards complies with the format defined in the PCI 2.3 Specification, Appendix I. All adapter cards have the same PCI VPD layout.
  • Page 19 Length [15:8] MSB 0x00 VPD Keyword EFI Driver version Length Data STR_SPC VPD Keyword Asset Tag Length 0x20 Data STR_SPC “N/A” VPD Keyword Remaining read/write area Length 0x68 Data STR_ZERO Reserved (0x00) Small Resource Type END Tag (0x11) 0x78 Mellanox Technologies...
  • Page 20: Chapter 3 Driver Software And Firmware

    Please contact Mellanox or your assigned Field Application Engineer if you cannot find the firm- ware binary for your adapter card. To check the latest firmware: 1. Go to Mellanox web site to check current firmware version. Go to: http://www.mellanox.com/supportdownloader 2. Enter your card PSID and compare the firmware versions. Mellanox Technologies...
  • Page 21 ConnectX-2 Card User Manual Rev 1.0 Figure 6: Support Download Assistant Mellanox Technologies...
  • Page 22: Chapter 4 Vpi Adapter Card Installation

    PCI slot with less lanes than the card requires then the adapter card will not provide the optimum data transfer. Set Up The basic steps to embed Mellanox cards in your computer are: 1. Identify the card in your system. 2. Verify the computer is recognizing the new adapter. Mellanox Technologies...
  • Page 23 PCI devices are detected, check that the network adapter card(s) is correctly installed in the PCI slot or try installing the adapter card into a different PCI slot. Figure 7: Hardware Devices 3. Select a PCI Device / InfiniBand Controller entry. Mellanox Technologies...
  • Page 24 Hardware Ids (Windows 2008/R2) from the Property pull-down menu. Figure 8: PCI Device 7. In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_6368”: VEN is equal to Mellanox Technologies...
  • Page 25 ConnectX-2 Card User Manual Rev 1.0 0x15B3 – this is the Vendor ID of Mellanox Technologies; and DEV is equal to 0x6368 – this is a valid Mellanox Technologies PCI Device ID. The list of Mellanox Technologies PCI Device IDs can be found in the PCI ID reposi- tory at http://pci-ids.ucw.cz/read/PC/15b3.
  • Page 26 Host# lsmod | grep mlx4_en mlx4_en 109708 mlx4_core 136804 2 mlx4_en,mlx4_ib If you don’t see the mlx4_en driver, run: ’ modprobe mlx4_en’ Ethernet Driver Usage and Configuration To assign an IP address to the interface run: #> ifconfig eth<n> <ip> Mellanox Technologies...
  • Page 27 • To set interrupt coalescing settings when adaptive moderation is disabled, use: #> ethtool -c eth<x> [rx-usecs N] [rx-frames N] usec settings correspond to the time to wait after the *last* packet is sent/received before triggering an interrupt. To query pause frame settings run: #> ethtool -a eth<x> Mellanox Technologies...
  • Page 28 'sysctl' interface. order restore these parameters their default values, download "mlnx_en_reverse_settings.conf" file from the MLNX_EN for Linux Web page http://www.mellanox.com => Home > Products > Adapter Ethernet SW. and run: > /sbin/sysctl -p mlnx_en_reverse_settings.conf Mellanox Technologies...
  • Page 29: Cables And Modules

    Care should be taken not to impede the air exhaust flow through the ventilation holes. Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack. Mellanox Technologies...
  • Page 30 1. Pull on the latch release mechanism thereby unlatching the connector and pull the connector out of the cage. 2. Do not apply torque to the connector when removing it from the adapter card. 3. Remove any cable supports that were used to support the cable’s weight. Mellanox Technologies...
  • Page 31: Appendix A Specifications

    ETSI EN 300 019-2-2 IEC 60068-2- 64, 29, 32 RoHS: RoHS-R6 a. The auto-negotiation protocol is proprietary of Mellanox Technologies and compliant with the InfiniBand Architec- ture Specification, Release 1.2. A.2 Board Mechanical Drawing and Dimensions All dimensions are in millimeters.
  • Page 32: Emc Certification Statements

    This device complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This device may not cause harmful interference, and 2. This device must accept any interference received, including interference that may cause undesired operation. Mellanox Technologies...
  • Page 33 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsible for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. §15.105(a) Statement NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
  • Page 34 (Translation - "This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio interference may occur, in which case the user may be required to take corrective actions.") Mellanox Technologies...
  • Page 35: Appendix B Interface Connectors Pinout

    Signal Name SPSDA 5 1 2 3 4 SPSCL B.2 PCI Express x8Connector Pinout The adapter cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 2.0 specification. Mellanox Technologies...
  • Page 36: Pci Express Connector Pinout

    View into Front of Cage 8.50 Table 12 - Connector Pin Name and Number to Signal Name Correspondence Connector Pin Number Connector Pin Name Port A Signal Name TXN_2 Tx2n TXP_2 Tx2p TXN_4 Tx4n TXP_4 Tx4p ModSelL_Port0 ModSelL ResetL_Port0 ResetL VccRx Mellanox Technologies...
  • Page 37 Connector Pin Name Port A Signal Name RXP_3 Rx3p RXN_3 Rx3n RXP_1 Rx1p RXN_1 Rx1n RXN_2 Rx2n RXP_2 Rx2p RXN_4 Rx4n RXP_4 Rx4p ModPrsl_Port0 Mod PrsL IntL IntL VccTx Vcc1 LPMode_Port0 LPMode TXP_3 Tx3p TXN_3 Tx3n TXP_1 Tx1p TXN_1 Tx1n Mellanox Technologies...
  • Page 38: Appendix C Replacing A Tall Bracket With A Short Bracket

    2. Place the gasket onto the new bracket. Make sure to correctly align the gasket with the hole in the bracket. 3. If the old gasketis still on the card, remove it before installing the new bracket. Make sure that only one gasket per port is used. Mellanox Technologies...
  • Page 39 Do not force the bracket onto the card. You may have to gently push the LEDs using a small screwdriver to align the LEDs with the holes in the bracket. 5. Screw on the bracket using the screws and washers saved from the procedure above step 1. Figure 14: Putting on the Bracket Mellanox Technologies...
  • Page 40 Rev 1.0 6. Make sure that the LEDs are aligned onto the bracket holes. 7. Use a torque driver to apply up to 2 lbs-in torque on the screws. Mellanox Technologies...
  • Page 41: Appendix D Avertissements De Sécurité D'installation (Warnings In French)

    L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. 7. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies...
  • Page 42: Appendix E Sicherheitshinweise (Warnings In German)

    6. Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. 7. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies...
  • Page 43 La instalación, el reemplazo y el mantenimiento de este equipo estarán a cargo únicamente de personal capacitado y competente. 6. Eliminación de equipos La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales. Mellanox Technologies...
  • Page 44 Rev 1.0 Códigos eléctricos locales y nacionales Este equipo se debe instalar conforme a los códigos eléctricos locales y nacio- nales. Mellanox Technologies...

This manual is also suitable for:

Mhqa19-xtrMhqa19-xsrMhqa19-xnr

Table of Contents