Related Manuals for Mellanox Technologies INFINISCALE III M2401G
Summary of Contents for Mellanox Technologies INFINISCALE III M2401G
- Page 1 Third party information brought to you courtesy of Dell. InfiniScale® III M2401G 20Gb/s InfiniBand Blade Switch I/O Module for PowerEdge M-Series User Manual PN: M2401G Rev 1.8 Mellanox Technologies...
- Page 2 InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Intercon- nect is a trademark of Mellanox Technologies, Ltd. Dell and the Dell logo are trademarks of Dell Inc. All other marks and names mentioned herein may be trademarks of their respective companies.
-
Page 3: Table Of Contents
2.2 Mechanical Installation 2.2.1 Removing an Old Switch From the Chassis 2.2.2 Removing a Blank Cover Plate From the Chassis 2.2.3 Installing the Mellanox M2401G Switch Into the Dell Chassis 2.3 Power Connections and Initial Power On 2.4 InfiniBand Cable Installation Chapter 3 Cluster Management and Firmware 3.1 Network Management and Clustering Software... -
Page 4: About This Manual
• Mellanox Technologies Web pages: • Dell Support Web pages: Conventions Throughout this manual, the name M2401G and the term switch are used to describe the M2401G 20Gb/s InfiniBand blade switch I/O module, unless explicitly indicated otherwise. Rev 1.8 InfiniBand architecture specification descriptions The Mellanox OFED stack provides a tool set to manage InfiniBand fabric clusters. -
Page 5: Revision History
Minor fixes to Rev 1.5 Minor fixes to Rev 1.4 Added Instructions for Reprogramming Over the InfiniBand Network Added Dell logo and Dell 3rd party info statement Replaced Mellanox address Fixed Links to new web site Added Certs and Link to FW... -
Page 6: Chapter 1 Overview
All that is required for normal operation is to follow the usual precau- tions for installation and connection from the switch to the HCAs or other switches. Once connected, the Subnet Management software automatically configures and begins utilizing the switch. -
Page 7: Infiniband Connectors
Each of the InfiniBand ports has two LEDs located next to the connector. The green LED, when lit, indicates that a valid physical connection to the other system (switch or HCA port) exists. The yel- low LED when lit, indicates that the Subnet Manager is running and a valid data link exists. The yellow LED illuminates when the InfiniBand network is discovered over the physical link. - Page 8 ON or BLINKING AMBER ON or BLINKING AMBER Mellanox Technologies Switch Status Boot in Progress Switch not ready The CMC is identifying the newly installed switch Switch is on and operating Normally Fault in System Self-diagnosed Fault in System CMC-detected...
-
Page 9: Chapter 2 Installation And Basic Operation
The switch platform does not require any programming or configuration to operate as a basic Infini- Band switch and includes all of the necessary functionality to operate with external standard Infini- Band Subnet Management software. -
Page 10: Installation Safety Warnings
Installation Safety Warnings Installation Instructions Read all installation instructions before connecting the equipment to the power source. Over-temperature This equipment should not be operated in an area with an ambient temperature exceed- ing the maximum recommended: °C (°F). Moreover, to guarantee proper air flow, allow at least 8cm (3 inches) of clearance around the ventilation openings. -
Page 11: Mechanical Installation
Mechanical Installation These switches are hot pluggable. It is not necessary to power down the Dell Chassis to install a new switch or to replace an old switch with a new one. Figure 4: Rear View of the Dell PowerEdge M1000e Chassis... -
Page 12: Removing A Blank Cover Plate From The Chassis
C2. Modules may be installed in Fabric B and C independently (you do not need to install modules in Fabric B before installing modules in Fabric C slots). Refer to the Dell PowerEdge M1000e Hardware Owners Manual for more information. -
Page 13: Infiniband Cable Installation
M2401G 20Gb/s InfiniBand Blade Switch I/O Module User Manual InfiniBand Cable Installation All cables can be inserted or removed with the unit power on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated. The green LED indicator below each port will light when the physical connection is established (that is, when the unit is powered on and a cable is plugged into the port with a functioning port plugged into the other end of the connector). -
Page 14: Chapter 3 Cluster Management And Firmware
Updating Firmware The switch is delivered with the latest Firmware available at the time of production. New firmware versions will be posted on the Mellanox firmware download page. Firmware can be updated in- band using the Mellanox Firmware Tools (MFT). - Page 15 M2401G 20Gb/s InfiniBand Blade Switch I/O Module User Manual Reports regarding cluster links will use direct routes. Loading IBDM from: /usr/local/lib/ibdm1.2 -I- Using port 1 as the local port. -I- Discovering ... 3 nodes (2 Switches & 1 CA-s) discovered.
- Page 16 II. Using the ibnetdiscover tool: Run: [root@mymach]# ibnetdiscover | grep 00000006660abcd0 | grep -w Switch Switch 24 "S-00000006660abcd0" base port 0 lid 17 lmc 0 Note: The resulting LID is given as a decimal number. 4. Run mlxburn with the LID retrieved in step #3 above to perform the In-Band burning operation.
-
Page 17: Chapter 4 Troubleshooting
2. Remove and reinstall the switch. The status LED for the switch is blinking amber: 1. remove the switch from the chassis and re-insert it (verify that the switch is all the way in the chassis and the lever is firmly closed). -
Page 18: Appendix A Specifications
Appendix A: Specifications Table 4 - M2401G Specification Data Physical H x W x D: 1.16 x 10.04 inches 272.50 x 29.45 x 255.20 mm Weight: 1.5 Kg fully configured Mounting: Vertically mounted rack SerDes Speeds 10, 20 Gb/s per port Connectors: microGiGaCN 8 external CX4 connectors... -
Page 19: Appendix B Mechanical Drawing
M2401G 20Gb/s InfiniBand Blade Switch I/O Module User Manual Appendix B: Mechanical Drawing Figure 4 Mechanical Drawing of the Switch Mellanox Technologies Rev 1.8... -
Page 20: Appendix C Emc Certification Statements
Appendix C: EMC Certification Statements C.1: FCC Statements (USA) Class A Statements: § 15.21 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsible for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. - Page 21 M2401G 20Gb/s InfiniBand Blade Switch I/O Module User Manual C.1.3 VCCI Statements (Japan) Class A Statement: (Translation - "This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio interference may occur, in which case the user may be required to take corrective actions.")
-
Page 22: Appendix D Infiniband Connector Pinout
Appendix D: InfiniBand Connector Pinout Table 5 - Connector Pin to Signal Name Correspondence Connector Pin Connector Pin Name Number IBtxIp(0) IBtxIn(0) IBtxIp(1) IBtxIn(1) IBtxIp(2) IBtxIn(2) IBtxIp(3) IBtxIn(3) IBtxOn(3) IBtxOp(3) IBtxOn(2) Rev 1.8 Figure 5: InfiniBand Connector Pinout Conn 1X IBtxOp(3) IBtxIp(3) IBtxOn(3) - Page 23 IBtxOp(2) IBtxOn(1) IBtxOp(1) IBtxOn(0) IBtxOp(0) G1-G6, G9, H1-H2 Signal Ground Sense-3.3V Px in the signal name signifies Port # x. This switch has 8 external ports. Signal Name IB_Px_T3_P IB_Px_T2_N IB_Px_T2_P IB_Px_T1_N IB_Px_T1_P Figure 6: Pinout Connector View Mellanox Technologies...
-
Page 24: Appendix E Avertissements De Sécurité D'installation
Appendix E: Avertissements de sécurité d’installation Instructions d’installation Lisez toutes les instructions d’installation avant de brancher le matériel à la source d’alimentation électrique. Température excessive Ce matériel ne doit pas fonctionner dans une zone avec une température ambiante dépassant le maximum recommandé de 45°C (113°F). En outre, pour garantir un bon écoulement de l’air, laissez au moins 8 cm (3 pouces) d’espace libre autour des ouver- tures de ventilation. - Page 25 M2401G 20Gb/s InfiniBand Blade Switch I/O Module User Manual Elimination du matériel L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux.
-
Page 26: Appendix F Installation - Sicherheitshinweise
Appendix F: Installation - Sicherheitshinweise Installationsanleitungen Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromversorgung anschließen. Übertemperatur Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der maximal empfohlenen Temperatur von 45°C (113°F) betrieben werden. Außerdem sollten mindestens 8 cm (3 in.) Freiraum um die Belüftungsöffnungen sein, um einen einwandfreien Luftstrom zu gewährleisten. - Page 27 M2401G 20Gb/s InfiniBand Blade Switch I/O Module User Manual Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden.