Related Manuals for Dell Mellanox ConnectX-3
Summary of Contents for Dell Mellanox ConnectX-3
- Page 1 Dell and the Dell logo are trademarks of Dell Inc. ® ConnectX -3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual 0J05YT, 0K6V3V Rev 1.0 www.mellanox.com Great user manuals database on UserManuals.info...
- Page 2 NOTE: THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE PRO- VIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUS- TOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT.
-
Page 3: Table Of Contents
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Table of Contents Table of Contents ..............3 List of Tables . -
Page 4: List Of Tables
Rev 1.0 List of Tables Table 1: Revision History Table ........... .6 Table 2: Documents List . -
Page 5: List Of Figures
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 List of Figures Figure 1: 0J05YT Label ............10 Figure 2: Board Label . -
Page 6: Revision History
Rev 1.0 Revision History This document was first printed on February 14, 2012 Table 1 - Revision History Table Date Comments/Changes February Initial Release 2012 Mellanox Technologies Great user manuals database on UserManuals.info... -
Page 7: About This Manual
Rev 1.0 About this Manual This User Manual describes ConnectX®-3 Dual QSFP Port mezzanine card for the Dell Blade Servers. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the cards, installation instructions, and relevant documentation. - Page 8 Rev 1.0 Mellanox Technologies Great user manuals database on UserManuals.info...
-
Page 9: Chapter 1 Overview
1 Overview This document is a User Manual for the Mellanox Technologies ConnectX®-3 40Gb/s and 56Gb/ s InfiniBand dual-port mezzanine cards for the Dell Blade Servers. The cards described in this manual have the following main features: • InfiniBand Architecture Specifications v1.2.1 compliant •... -
Page 10: Figure 1: 0J05Yt Label
Rev 1.0 Overview Figure 1: 0J05YT Label Figure 2: Board Label Figure 3: 0K6V3V Label Figure 4: Board Label Mellanox Technologies Great user manuals database on UserManuals.info... -
Page 11: Chapter 2 Card Interfaces
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Card Interfaces I/O Interfaces Each mezzanine card includes the following interfaces: • PCI Express (PCIe) • I C-compatible connector (for debug) Figure 5: 0J05YT/0K6V3V Card 2.1.1 InfiniBand Interface The ConnectX®-3 mezzanine cards are compliant with the InfiniBand Architecture Specification,... -
Page 12: Pci Express Interface
Rev 1.0 Card Interfaces 2.1.2 PCI Express Interface The ConnectX®-3 mezzanine cards support PCI Express 3.0 (1.1 and 2.0 compatible) . The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations. -
Page 13: Eeprom
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 A jumper inserted into the drill on each adapter card indicates to the device whether an on-board Flash device is to be used or not. Table 4 provides information on this jumper. - Page 14 Rev 1.0 Card Interfaces Table 5 - 0J05YT VPD Layout Offset Item Value Format Description (Decimal) SerialNumber OO0J05YTMMM %STR_SPC “00..00XXXX..XX” MMYMDSSSS VPD Keyword Misc Information Length 0x15 Data VPI QDR SFF STR_SPC mezz VPD Keyword Length Data 0,105 %CS0 Large Resource Type VPD-W 0x91 Tag (0x11) Length [7:0] LSB...
-
Page 15: Table 6: 0K6V3V Vpd Layout
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Table 5 - 0J05YT VPD Layout Offset Item Value Format Description (Decimal) 2050 Length 0xfd 2051 Data STR_ZERO Reserved (0x00) 2304 VPD Keyword Remaining read/write area... - Page 16 Rev 1.0 Card Interfaces Table 6 - 0K6V3V VPD Layout Offset Item Value Format Description (Decimal) Revision %STR PCB revision VPD Keyword Serial Number Length 0x14 SerialNumber OO0K6V3VMMM %STR_SPC “00..00XXXX..XX” MMYMDSSSS VPD Keyword Misc Information Length 0x11 Data VPI FDR SFF STR_SPC mezz VPD Keyword...
- Page 17 ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Table 6 - 0K6V3V VPD Layout Offset Item Value Format Description (Decimal) 1794 Length 0xfd 1795 Data STR_ZERO Reserved (0x00) 2048 VPD Keyword Remaining read/write area...
-
Page 18: Chapter 3 Card Installation
Installation of this mezzanine card should only be done by a properly qualified technician or engi- neer. Installation or service not authorized by Dell or performed by unqualified personnel may void guarantees and warranties. Read and follow all safety precautions specified in this document and in the PowerEdge documentation. -
Page 19: Figure 7: Grounding Clip
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Use the documentation supplied with the Dell Blade Servers to remove and replace the blade from the chassis. The card shown below has grounding clips that must come in contact with the chassis after the card is installed. -
Page 20: Figure 9: Protective Cover In Place
Rev 1.0 Card Installation DIMMS can be hot. Allow sufficient time for the blade components to cool before starting this procedure. Remove the blade from the chassis. Remove the cover from the blade. Open the retaining clip. The card can be placed in either of the two available slots. Expose the socket to be used for the new card. -
Page 21: Figure 10: Remove The Cover
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Figure 10: Remove the Cover Hold the mezzanine card by the edges only. Line up the mezzanine card so that the pins of the mezzanine card are over the sockets in the blade server. -
Page 22: Figure 12: Single Card In Slot C
Rev 1.0 Card Installation Figure 12: Single Card in Slot C Figure 13: Two Cards Installed Replace the blade server cover. Replace the blade server into the chassis Mellanox Technologies Great user manuals database on UserManuals.info... -
Page 23: Safety Warnings
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Safety Warnings 1. Installation Instructions Read all installation instructions before connecting the equipment to the power source. 2. Over Temperature This equipment should not be operated in an area with an ambient temperature exceeding the maximum recommended: °C (°F). -
Page 24: Chapter 4 Driver Software And Firmware
Rev 1.0 Driver Software and Firmware Driver Software and Firmware Driver Software 4.1.1 Linux For Linux, download and install the latest OpenFabrics Enterprise Distribution (OFED) software package available via the Mellanox web site at: http://www.mellanox.com => Products => Soft- ware/Drivers => Infiniband & VPI Software/Drivers => Mellanox OFED => Download. Follow the installation instructions included in the download package (also available from the download page). -
Page 25: Windows
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Rate: 56 Base lid: 8 LMC: 0 SM lid: 12 Capability mask: 0x02514868 Port GUID: 0x0002c903002fefe2 Link layer: InfiniBand Check the OFED version To get the version of the running Mellanox OFED/BXOFED, run the following command: # ofed_info |head -1 MLNX_OFED_LINUX-1.5.2-2.0.0 (OFED-1.5.2-20101219-1546):... -
Page 26: Flexboot
Rev 1.0 Driver Software and Firmware Figure 14: Device Manager (example) If the cards are connected to a managed switch, there is no need to run openSM. Only Note: one OpenSM should run per subnet.In InfiniBand interfaces, OpenSM is installed as a disabled Windows service. - Page 27 ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 number. Please contact Mellanox System Support if you cannot find the firmware binary for your mezzanine card. The following steps describe how to retrieve the PSID (firmware identification) and programmed firmware version of your mezzanine card.
-
Page 28: Figure 15: Support Download Assistant
Rev 1.0 Driver Software and Firmware Figure 15: Support Download Assistant If a newer firmware version exists for your mezzanine card, update the firmware as follows: a. Download the firmware image zip file from the Download Center (see Step 2a above) b. -
Page 29: Appendix A Specifications
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Appendix A: Specifications A.1 Board Mechanical Drawing and Dimensions The ConnectX®-3 mezzanine card mechanical drawing is depicted in Figure 16. All dimensions are in millimeters. All the mechanical tolerances are +/- 0.1mm Figure 16: Mechanical Drawing of 0J05YT/0K6V3V Mezzanine Card 23.92... -
Page 30: Table 8: Connectx-3 0J05Yt/0K6V3V Specifications Table
Rev 1.0 Specifications Table 8 - ConnectX-3 0J05YT/0K6V3V Specifications Table Size: 3.11in. x3.46 in. (78.91mm X 88mm) Physical InfiniBand: IBTA v1.2.1 QDR (10Gb/s per lane) or FDR (14.0625Gb/s per lane) port Protocol Support Data Rate: Up to 56Gb/s FDR– InfiniBand PCI Express Gen3: 3.0 SERDES @ 8.0 GT/s (1.1 and 2.0 compatible) Voltage: 12V, 3.3V, 3.3VAUX 0J05YT Typ Power: 5.75W... -
Page 31: Appendixb Avertissements De Sécurité D'installation (French)
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Appendix B: Avertissements de sécurité d’installation (French) 1. Instructions d’installation Lisez toutes les instructions d’installation avant de brancher le matériel à la source d’alimentation électrique. 2. Température excessive Ce matériel ne doit pas fonctionner dans une zone avec une température ambi-... -
Page 32: Appendixc Installation - Sicherheitshinweise (German)
Rev 1.0 Appendix C: Installation - Sicherheitshinweise (German) 1. Installationsanleitungen Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromvers- orgung anschließen. 2. Übertemperatur Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der maximal empfohlenen Temperatur von 55°C (131°F) betrieben werden. -
Page 33: Appendixd Advertencias De Seguridad Para La Instalación (Warnings In Spanish)
ConnectX®-3 Dual Port 40Gb/s and 56Gb/s Mezzanine Card for Dell User Manual Rev 1.0 Appendix D: Advertencias de seguridad para la instalación (Warnings in Spanish) 1. Instrucciones de instalación Antes de conectar el equipo a la fuente de alimentación, leer todas las instrucciones de instalación.