Related Manuals for Mellanox Technologies InfiniScale III
Summary of Contents for Mellanox Technologies InfiniScale III
- Page 1 Third party information brought to you courtesy of Dell. InfiniScale® III 16+8 Port 20Gb/s InfiniBand Switch for Dell PowerEdge M1000e-series Blade Enclosures User Manual PN: M2401G Rev 1.7 Mellanox Technologies...
- Page 2 InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Intercon- nect is a trademark of Mellanox Technologies, Ltd. Dell and the Dell logo are trademarks of Dell Inc. All other marks and names mentioned herein may be trademarks of their respective companies.
-
Page 3: Table Of Contents
2.2 Mechanical Installation 2.2.1 Removing an Old Switch From the Chassis 2.2.2 Removing a Blank Cover Plate From the Chassis 2.2.3 Installing the Mellanox M2401G Switch Into the Dell Chassis 2.3 Power Connections and Initial Power On 2.4 InfiniBand Cable Installation Chapter 3 Cluster Management and Firmware 3.1 Network Management and Clustering Software... -
Page 4: About This Manual
• Dell Support Web pages: http://support.dell.com Conventions Throughout this manual, the name M2401G and the term switch are used to describe the 16+8 port 20Gb/s InfiniBand switch for the Dell M1000e, unless explicitly indicated otherwise. Rev 1.7 Mellanox Technologies... -
Page 5: Revision History
Rev 1.5 Minor fixes to Rev 1.4 Added Instructions for Reprogramming Over the InfiniBand Network Nov. 2008 Rev 1.4 Added Dell logo and Dell 3rd party info statement Replaced Mellanox address Fixed Links to new web site Aug. 2008 Rev 1.3 Added Certs and Link to FW Aug. -
Page 6: Chapter 1 Overview
1 Overview The Mellanox M2401G 20Gb/s InfiniBand Switch Blade for Dell PowerEdge M1000e-series Blade Enclosures provides a high bandwidth, low latency, low power fabric for Enterprise Data Center and High-Performance Computing environments. Based on the third generation InfiniScale® III InfiniBand switch device, the platform delivers an ideal balance between cost and performance. -
Page 7: Infiniband Connectors
M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual InfiniBand Connectors InfiniBand connectivity has 8 microGiGa connectors through the front panel. The remaining 16 interfaces are through the AirMax Midplane Connector out the back of the switch. Figure 1 shows the front 8 ports. Each of the InfiniBand ports has two LEDs located next to the connector. - Page 8 Table 3 - IOM states and LED configurations: Switch Status Indication Green Status Boot in Progress Switch not ready BLINKING BLUE The CMC is identifying the newly installed switch Blinking Blue ON BLUE Switch is on and operating Normally ON or BLINKING Fault in System AMBER Self-diagnosed...
-
Page 9: Chapter 2 Installation And Basic Operation
M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual 2 Installation and Basic Operation Installation and initialization of the switch platform are straightforward processes, requiring atten- tion to the normal mechanical, power, and thermal precautions for rack-mounted equipment. The switch platform does not require any programming or configuration to operate as a basic Infini- Band switch and includes all of the necessary functionality to operate with external standard Infini- Band Subnet Management software. -
Page 10: Installation Safety Warnings
Installation Safety Warnings Installation Instructions Read all installation instructions before connecting the equipment to the power source. Over-temperature This equipment should not be operated in an area with an ambient temperature exceed- ing the maximum recommended: °C (°F). Moreover, to guarantee proper air flow, allow at least 8cm (3 inches) of clearance around the ventilation openings. -
Page 11: Mechanical Installation
Mechanical Installation These switches are hot pluggable. It is not necessary to power down the Dell Chassis to install a new switch or to replace an old switch with a new one. Figure 4: Rear View of the Dell PowerEdge M1000e Chassis... -
Page 12: Removing A Blank Cover Plate From The Chassis
C2. Modules may be installed in Fabric B and C independently (you do not need to install modules in Fabric B before installing modules in Fabric C slots). Refer to the Dell PowerEdge M1000e Hardware Owners Manual for more information. -
Page 13: Infiniband Cable Installation
M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual InfiniBand Cable Installation All cables can be inserted or removed with the unit power on. To insert a cable, press the connector into the port receptacle until the connector is firmly seated. The green LED indicator below each port will light when the physical connection is established (that is, when the unit is powered on and a cable is plugged into the port with a functioning port plugged into the other end of the connector). -
Page 14: Chapter 3 Cluster Management And Firmware
>Support >Dell 3.2.1 Instructions for Reprogramming Over the InfiniBand Network To update an MT47396 InfiniScale III switch devices having a specific GUID (for example, 0x00000006660abcd0) or LID, the following are the recommended steps to update the device firm- ware. - Page 15 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Reports regarding cluster links will use direct routes. Loading IBDM from: /usr/local/lib/ibdm1.2 -I- Using port 1 as the local port. -I- Discovering ... 3 nodes (2 Switches & 1 CA-s) discovered. -I--------------------------------------------------- -I- Bad Guids/LIDs Info -I--------------------------------------------------- -I- skip option set.
- Page 16 Note: The resulting LID is given as a decimal number. 4. Run mlxburn with the LID retrieved in step #3 above to perform the In-Band burning operation. Burn the InfiniScale III switch: [root@mymach]> mlxburn -dev /dev/mst/SW_MT47396_lid-0x0011 -fw ./IS3FW.BIN -I- Reading PSID from board -I- Using auto detected configuration file ./MT34000LE-A00.INI (PSID =...
-
Page 17: Chapter 4 Troubleshooting
M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual 4 Troubleshooting As soon as a switch is plugged in make sure that the power LED comes on. The power LED for the switch does not come on: 1. Check that the chassis has power. 2. -
Page 18: Appendix A Specifications
Appendix A: Specifications Table 4 - M2401G Specification Data Physical Power and Environmental H x W x D: 1.16 x 10.04 inches Maximum Power: 272.50 x 29.45 x 255.20 mm Dissipated Power: 33.5W Weight: 1.5 Kg fully configured Power through Mounting: Vertically mounted rack connector:... -
Page 19: Appendix B Mechanical Drawing
M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Appendix B: Mechanical Drawing Figure 4 Mechanical Drawing of the Switch Mellanox Technologies Rev 1.7... -
Page 20: Appendix C Emc Certification Statements
Appendix C: EMC Certification Statements C.1: FCC Statements (USA) Class A Statements: § 15.21 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsible for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. - Page 21 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual C.1.3 VCCI Statements (Japan) Class A Statement: (Translation - "This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio interference may occur, in which case the user may be required to take corrective actions.") C.1.4 MIC Certification (Korea)
-
Page 22: Appendix D Infiniband Connector Pinout
Appendix D: InfiniBand Connector Pinout Figure 5: InfiniBand Connector Pinout Conn 1X IBtxOp(3) IBtxIp(3) IBtxOn(3) IBtxIn(3) IBtxOp(2) IBtxIp(2) IBtxOn(2) IBtxIn(2) IBtxOp(1) IBtxIp(1) IBtxOn(1) IBtxIn(1) IBtxOp(0) IBtxIp(0) IBtxOn(0) IBtxIn(0) Table 5 - Connector Pin to Signal Name Correspondence Connector Pin Connector Pin Name Signal Name Number IBtxIp(0) - Page 23 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Table 5 - Connector Pin to Signal Name Correspondence Connector Pin Connector Pin Name Signal Name Number IBtxOp(2) IB_Px_T3_P IBtxOn(1) IB_Px_T2_N IBtxOp(1) IB_Px_T2_P IBtxOn(0) IB_Px_T1_N IBtxOp(0) IB_Px_T1_P G1-G6, G9, H1-H2 Signal Ground Sense-3.3V Px in the signal name signifies Port # x.
-
Page 24: Appendix E Avertissements De Sécurité D'installation
Appendix E: Avertissements de sécurité d’installation Instructions d’installation Lisez toutes les instructions d’installation avant de brancher le matériel à la source d’alimentation électrique. Température excessive Ce matériel ne doit pas fonctionner dans une zone avec une température ambiante dépassant le maximum recommandé de 45°C (113°F). En outre, pour garantir un bon écoulement de l’air, laissez au moins 8 cm (3 pouces) d’espace libre autour des ouver- tures de ventilation. - Page 25 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Elimination du matériel L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies Rev 1.7...
-
Page 26: Appendix F Installation - Sicherheitshinweise
Appendix F: Installation - Sicherheitshinweise Installationsanleitungen Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromversorgung anschließen. Übertemperatur Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der maximal empfohlenen Temperatur von 45°C (113°F) betrieben werden. Außerdem sollten mindestens 8 cm (3 in.) Freiraum um die Belüftungsöffnungen sein, um einen einwandfreien Luftstrom zu gewährleisten. - Page 27 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies Rev 1.7...