Subscribe to Our Youtube Channel
Related Manuals for Mellanox Technologies MCX312B-XCCS
Summary of Contents for Mellanox Technologies MCX312B-XCCS
- Page 1 ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual P/N: MCX312B-XCCT, MCX312B-XCCS, MCX311A-XCCT, MCX312C-XCCT Rev 1.5 www.mellanox.com...
- Page 2 ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT (S) AND/OR THE SYSTEM USING IT . THEREFORE , MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY .
-
Page 3: Table Of Contents
4.1.2 Installing the Driver ..........22 Mellanox Technologies... - Page 4 Appendix E Sicherheitshinweise (Warnings in German) ..... . . 63 Appendix F Advertencias de seguridad para la instalación (Warnings in Spanish) . 65 Mellanox Technologies...
-
Page 5: List Of Tables
SFP+ Connector Pinout ..........54 Mellanox Technologies... -
Page 6: List Of Figures
Figure 17: Board Label (Example) ..........57 Mellanox Technologies... -
Page 7: Revision History
Revision History This document was printed on August 28, 2017. Table 1 - Revision History Table Date Comments/Changes August 2017 • Added MCX312B-XCCS to relevant sections. • Updated Product Overview on page • Updated MCX312B-XCC[S/T] Specifications on page August 2016 •... -
Page 8: About This Manual
Rev 1.5 About this Manual This User Manual describes Mellanox Technologies ConnectX®-3 Pro Gigabit Ethernet Single and Dual SFP+ port PCI Express x8 adapter cards. It provides details as to the interfaces of the board, specifications, required software and firmware for operating the board, and relevant docu- mentation. -
Page 9: Technical Support
The Mellanox support downloader contains software, firmware and knowledge database infor- mation for Mellanox products. Access the database from the Mellanox Support web page, http://www.mellanox.com => Support or use the following link to go directly to the Mellanox Support Download Assistant page, http://www.mellanox.com/supportdownloader/. Mellanox Technologies... -
Page 10: Chapter 1 Introduction
Rev 1.5 Introduction This is the User Guide for Mellanox Technologies Ethernet adapter cards based on the Con- nectX®-3 Pro EN integrated circuit device. These adapters connectivity provide the highest per- forming and most flexible interconnect solution for PCI Express Gen3 servers used in Enterprise Data Centers, High-Performance Computing, and Embedded environments. -
Page 11: Features And Benefits
I/O virtualization with ConnectX-3 Pro gives data center managers better server utilization while reducing cost, power, and cable complexity. A consolidated compute and storage network achieves significant cost-perfor- Storage Acceleration mance advantages over multi-fabric networks. Standard block and file access protocols can leverage RDMA for high-performance storage access. Mellanox Technologies... -
Page 12: Operating Systems/Distributions
• VMware ESXi 4.x and 5.x Connectivity • Interoperable with 10GbE switches • Passive copper cable with ESD protection • Powered connectors for optical and active cable support • QSFP+ to SFP+ connectivity through QSA module • Passive copper cable with ESD protection Mellanox Technologies... -
Page 13: Chapter 2 Interfaces
The device can be either a master initiating the PCI Express bus operations or a slave responding to PCI bus operations. The following lists PCIe interface features: • PCIe Base 3.0 compliant, 1.1 and 2.0 compatible Mellanox Technologies... -
Page 14: I2C-Compatible Interface
C-compatible Interface A three-pin header on the adapter cards is provided as the I C-compatible interface. LED Interface There are two I/O LEDs per port. For LED specifications please refer to Section 7.4, “Adapter Led Operations,” on page Mellanox Technologies... -
Page 15: Chapter 3 Hardware Installation
Note: Due to risk of damaging the EMI gasket, it is not recommended to replace the bracket more than three times. To replace the bracket you will need the following parts: Mellanox Technologies... -
Page 16: Removing The Existing Bracket
2. Save the two screws and the two fiber washers. 3.4.2 Installing the New Bracket 1. Place the bracket onto the card until the screw holes line up. Please make sure to insert the bracket until the end of the EMI fingers. See Figure Mellanox Technologies... -
Page 17: Figure 4: Emi Fingers
LEDs with the holes in the bracket. 2. Screw on the bracket using the screws and washers saved from the bracket removal procedure above. Figure 5: Placing the Bracket on the Card MCX312B-XCCT Mellanox Technologies... -
Page 18: Card Installation Instructions
1. Open the module’s locking mechanism – see Figure 6 and Figure 7. 2. Make sure that the male connectors on the module will align with the female connectors inside of the cage. Also check that there is no dirt or foreign matter in the module or in the cage. Mellanox Technologies... -
Page 19: Cable Installation
6. To remove a cable, disengage the locks and slowly pull the connector away from the port receptacle. Both LED indicators will turn off when the cable is unseated. Mellanox Technologies... -
Page 20: Identify The Card In Your System
1. In the Value display box, check the fields VEN and DEV (fields are separated by ‘&’). In the display example above, notice the sub-string “PCI\VEN_15B3&DEV_1003”: VEN is equal to 0x15B3 – this is the Vendor ID of Mellanox Technologies; and DEV is equal to 1003 – this is a valid Mellanox Technologies PCI Device ID. -
Page 21: On Linux
Rev 1.5 3.7.2 On Linux Get the device location on the PCI bus by running lspci and locating lines with the string “Mella- nox Technologies”: > lspci |grep -i Mellanox 27:00.0 Network controller: Mellanox Technologies MT27520 Family [ConnectX-3 Pro] Mellanox Technologies... -
Page 22: Chapter 4 Driver Installation
(done by the mlnx_en install script) 4.1.2 Installing the Driver Download Driver Package Step 1. Please download the current driver package from http://www.mellanox.com => Products => Software => Ethernet Driver => Linux Driver => Download. Install Driver Step 2. Mellanox Technologies... -
Page 23: Loading The Driver
#> modprobe -r mlx4_en Load the new driver version Step 2. Run: #> modprobe mlx4_en The result is a new net-device appearing in 'ifconfig -a' output. 4.1.4 Unloading the Driver To unload the Ethernet driver run: #> modprobe mlx4_en Mellanox Technologies... -
Page 24: Uninstalling The Driver
Enter the following command: > echo %PROCESSOR_ARCHITECTURE% On an x64 (64-bit) machine, the output will be “AMD64”. Go to the MLNX_WinOF for Windows Web page at Step 2. http://www.mellanox.com => Products => Software => InfiniBand/VPI Drivers => Windows SW/Drivers. Mellanox Technologies... -
Page 25: Extracting Files Without Running Installation
To extract the files without running installation, perform the following steps. Open a CMD console (Click Start-->Run and enter CMD). Step 1. Enter the following command: Step 2. MLNX_VPI_WinOF-<version>_All_<OS>_<arch>.exe /a Click Next to create a server image. Step 3. Mellanox Technologies... - Page 26 ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 Click Change and specify the location in which the files are extracted to. Step 4. Click Install to extract this folder, or click Change to install to a different folder. Step 5. Mellanox Technologies...
-
Page 27: Installing Mlnx_Winof
To configure your setup to contain the logs option, please run the following command after opening a CMD console: MLNX_VPI_WinOF-4_40_0_All_win8_x64.exe /v"/l*vx [LogFile]" If you do not want to upgrade your firmware version, run the following command: MLNX_VPI_WinOF-4_40_0_All_win8_x64.exe /v" MT_SKIPFWUPGRD=1" For further help, please run: MLNX_VPI_WinOF-4_40_0_All_win8_x64.exe /v" /h" Mellanox Technologies... - Page 28 ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 Click Next in the Welcome screen. Read then accept the license agreement and click Next. Step 2. Mellanox Technologies...
- Page 29 If the user has a standard Mellanox card, and the firmware version is older than the one specified in WinOF Installation Guide 4.40, the firmware will be updated accordingly. However, if the user has both OEM card and Mellanox card, only Mellanox card will be updated. Mellanox Technologies...
- Page 30 Configure your system for maximum performance by checking the maximum performance Step 5. box. This step requires rebooting your machine at the end of the installation. Select a Complete or Custom installation, follow Step a on page 31. Step 6. Mellanox Technologies...
- Page 31 Band environment. • SDK - contains the libraries and DLLs for developing InfiniBand application over IBAL. • Documentation: contains the User Manual and Installation Guide. • ND FLTR DLLs: contains the files for standalone installation of the mlx4nd provider. Mellanox Technologies...
- Page 32 ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 Click Install to start the installation. Click Finish to complete the installation. Step 7. Mellanox Technologies...
-
Page 33: 4.2.3.2 Unattended Installation
Windows 2012 driver do not completely uninstall the previous version. • In Windows 2012 (MLNX_WinOF Rev. 4.2 and above), the network configuration is saved upon driver upgrade. • In Windows 2008 R2 the existing configuration files are not saved upon driver upgrade. Mellanox Technologies... -
Page 34: Installation Results
To run OpenSM as a service, assuming the package was installed in the default path, use: sc create OpenSM1 binPath= "c:\Program Files\Mellanox\MLNX_VPI\IB\Tools\ opensm.exe --service" start=auto" To start the service, run: sc start opensm Mellanox Technologies... -
Page 35: Uninstalling Mlnx_Winof
1. Click Start => Control Panel => Programs and Features => MLNX_VPI => Uninstall. (NOTE: This requires elevated administrator privileges.) 2. Double click the .exe and follow the instructions of the install wizard. 3. Click Start => All Programs => Mellanox Technologies => MLNX_WinOF => Uninstall MLNX_WinOF. 4.2.7.2 Unattended Uninstall ... - Page 36 ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 Right-click a Mellanox Local Area Connection and left-click Properties. Step 2. Select Internet Protocol Version 4 (TCP/IPv4) from the scroll list and click Properties. Step 3. Mellanox Technologies...
-
Page 37: Port Type Management On Windows
After installing Mellanox WinOF VPI for Windows on your machine, you can change a port's pro- tocol configuration. The following steps describe how to configure the port type: Step 1: Display the Device Manager and expand “System Devices”. Mellanox Technologies... - Page 38 Select the Port Protocol tab from the Properties sheet. Note: The “Port Protocol” tab is displayed only if the NIC is a VPI (IB and ETH). If the NIC is either only IB or ETH, the tab will not be shown. Mellanox Technologies...
-
Page 39: Performance Tuning
Reboot ESXi server (The driver will be loaded automatically). » To verify that the driver is loaded, run: #> vmkload_mod -l | grep mlx4_en » To query network uplinks installed on your machine, run: #> esxcli network nic list Mellanox Technologies... -
Page 40: Installing And Running The Offline_Bundle Driver On Esxi-5.X
“Adding the Device as an uplink to an Existing Vswitch using the CLI,” on page 10 the VMware User Manual. See Table 2, “Documents List,” on page 8. 4.4.3 Removing the VIB/offline_bundle Driver » To remove the VIB/offline_bundle driver package from the ESXi server machine, run: #> esxcli software vib remove –n net-mlx4-en Mellanox Technologies... -
Page 41: Flexboot
FlexBoot supports remote Boot over Ethernet. This technology is based on the Preboot Execution Environment (PXE) standard specification, and FlexBoot software is based on the open source iPXE project (see www.ipxe.org). For more information go to http://www.mellanox.com => Products => Software => Ethernet Drivers => Download. Mellanox Technologies... -
Page 42: Chapter 5 Updating Adapter Card Firmware
Enter your card PSID to display the latest firmware file. The file name of the binary is composed by combin- ing the firmware name, the firmware release version, and the card part number. Note: Please contact Mellanox System Support if you cannot find the firmware binary for your adapter card. Mellanox Technologies... -
Page 43: Figure 9: Support Download Assistant
> flint -d /dev/mst/mt4099_pci_cr0 -i <binary image> burn a. Reboot the computer. b. Enter: mst start. c. Verify that the card firmware was updated successfully. > flint -d /dev/mst/mt4103_pci_cr0 q Image type: ConnectX-3 Pro FW Version: 2.9.4100 Device ID: 4103 Mellanox Technologies... -
Page 44: Chapter 6 Troubleshooting
• Verify that your switch and adapter port are compatible • Check that the latest driver is loaded Link light is on, but • Check that both the adapter and its link are set to the same speed with no and duplex settings communication established Mellanox Technologies... -
Page 45: Linux
Mellanox Firmware Tool (MFT) Once installed, run: mst start mst status flint –d <mst_device> q ibstat Ports Information lbv_devinfo To download the latest firmware version refer to Firmware Version http://www.mellanox.com/supportdownloader Upgrade /var/log/messages Collect Log File dmesg > system.logF Mellanox Technologies... -
Page 46: Windows
–d <mst_device> –i <firmware_bin_file> b • Event log viewer • MST device logs: • mst start Collect log file • mst status • C:\Users\Administrator> flint –d <mst_device> dc > dump_configura- tion.log • C:\Users\Administrator> mstdump <mst_device> dc > mstdump.log Mellanox Technologies... -
Page 47: Chapter 7 Specifications
Please refer to www.mellanox.com => Products => Cables and Transceivers Cable Support a. For both operational and non-operational states b. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. Mellanox Technologies... -
Page 48: Mcx312C-Xcct Specifications
Please refer to www.mellanox.com => Products => Cables and Transceivers Cable Support a. For both operational and non-operational states b. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. Mellanox Technologies... -
Page 49: Mcx311A-Xcct Specifications
Please refer to www.mellanox.com => Products => Cables and Transceivers Cable Support a. For both operational and non-operational states b. Air flow is measured ~1” from the heat sink between the heat sink and the cooling air inlet. Mellanox Technologies... -
Page 50: Adapter Led Operations
The short bracket has the same port and LED footprints as the tall bracket. Board Mechanical Drawing and Dimensions All dimensions are in millimeters. All the mechanical tolerances are +/- 0.1mm. Figure 10: Mechanical Drawing of the Dual-port MCX312B-XCCT Adapter Card 142.24 40.84 53.59 49.1 Mellanox Technologies... -
Page 51: Figure 11: Mechanical Drawing Of The Dual-Port Mcx312C-Xcct Adapter Card
ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 Figure 11: Mechanical Drawing of the Dual-port MCX312C-XCCT Adapter Card 142.24 59.1 64.4 68.9 Figure 12: Mechanical Drawing of the Single-port MCX311A-XCCT Adapter Card 142.24 40.84 49.1 53.59 Mellanox Technologies... -
Page 52: Bracket Mechanical Drawing
ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 Bracket Mechanical Drawing Figure 13: Dual-port Bracket Regulatory Statements For regulatory statements for all ConnectX®-3 Pro cards please refer to: http://www.mellanox.com/related-docs/user_manuals/Regulatory_and_Compliance_Guide.pdf Mellanox Technologies... -
Page 53: Appendix A Interface Connectors Pinout
ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 Appendix A: Interface Connectors Pinout SFP+ Connector Pinout Figure 14: Rear View of Module With Pin Placement Mellanox Technologies... -
Page 54: Table 11: Sfp+ Connector Pinout
LOS is open collector output. Should be pulled up with 4.7kΩ – 10kΩ on host board to a voltage between 2.0V and 3.6V. Logic 0 indicates normal operation; logic 1 indicates loss of signal. Mellanox Technologies... -
Page 55: Pci Express X8 Connector Pinout
ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 PCI Express x8 Connector Pinout The adapter cards use a standard PCI Express x8 edge connector and the PCI Express x8 standard pinout according to the PCI Express 3.0 specification. Figure 15: PCIe Connector Pinout Mellanox Technologies... -
Page 56: Figure 16: Compatible Connector Plug And Pinout
ConnectX®-3 Pro Ethernet Single and Dual SFP+ Port Adapter Card User Manual Rev 1.5 C-compatible Connector Pinout Figure 16: Compatible Connector Plug and Pinout Connector Pin Number Signal Name SPSDA SPSCL Mellanox Technologies... -
Page 57: Appendix B Finding The Mac And Serial Number On The Adapter Card
Please see the below example. Note: The shown versions and/or parameter values in the example below may not reflect the lat- est or actual values for this product, and are included here for illustration purposes only. Mellanox Technologies... - Page 58 -d /dev/mst/mt4103_pci_cr0 -qq q -W- Running quick query - Skipping full image integrity checks. Image type: ConnectX FW Version: 2.30.5000 Device ID: 4103 Description: Node Port1 Port2 Sys image GUIDs: 0002c90300e8eef0 0002c90300e8eef1 0002c90300e8eef2 0002c90300e8eef3 MACs: 0002c9e8eef0 0002c9e8eef1 VSD: PSID: MT_1200111023 Mellanox Technologies...
-
Page 59: Appendix C Safety Warnings
This equipment should be installed in compliance with local and national electrical codes. 8. Hazardous Radiation Exposure Caution – Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure. Mellanox Technologies... - Page 60 ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7 CLASS 1 LASER PRODUCT and reference to the most recent laser standards: IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:20. Mellanox Technologies...
-
Page 61: Appendix D Avertissements De Sécurité D'installation (Warnings In French)
L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. 7. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies... - Page 62 PRODUIT LASER DE CLASSE 1 » et références aux normes laser les plus récentes CEI 60 825-1:1993 + A1:1997 + A2:2001 et NE 60825- 1:1994+A1:1996+ A2:2001 Mellanox Technologies...
-
Page 63: Appendix E Sicherheitshinweise (Warnings In German)
Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. 7. Regionale und nationale elektrische Bestimmungen t Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bes- timmungen installiert werden. This equipment should be installed in compliance with local and national elec- trical codes. Mellanox Technologies... - Page 64 Achtung – Nutzung von Steuerungen oder Einstellungen oder Ausführung von Prozeduren, die hier nicht spezifiziert sind, kann zu gefährlichem Strahlenkon- takt führen.. Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards : ICE 60 825-1:1993 + A1:1997 + A2:2001 und EN 60825-1:1994+A1:1996+ A2:2001 Mellanox Technologies...
-
Page 65: Appendix F Advertencias De Seguridad Para La Instalación (Warnings In Spanish)
Este equipo se debe instalar conforme a los códigos eléctricos locales y nacionales. 8. Exposición a niveles de radiación peligrosos Precaución: el uso de controles o ajustes o la realización de procedimientos distintos de los que aquí se especifican podrían causar exposición a niveles de radiación peligrosos. Mellanox Technologies... - Page 66 ConnectX®-3 Pro Ethernet Single and Dual QSFP+ Port Adapter Card User Manual Rev 1.7 PRODUCTO LÁSER DE CLASE 1 y referencia a las normas de láser más recientes: IEC 60825-1:2007/03 y EN 60825-1:2007 Mellanox Technologies...
Need help?
Do you have a question about the MCX312B-XCCS and is the answer not in the manual?
Questions and answers