Mellanox Technologies PowerEdge M420 User Manual
Mellanox Technologies PowerEdge M420 User Manual

Mellanox Technologies PowerEdge M420 User Manual

Infiniscale iv 16+16 port 40gb/s infiniband switch for dell poweredge m1000e-series blade enclosures user manual

Advertisement

Quick Links

Third party information brought
to you courtesy of Dell.
InfiniScale® IV 16+16 Port 40Gb/s
InfiniBand Switch for Dell PowerEdge
M1000e-series Blade Enclosures User Manual
PN: M3601Q
Rev 1.1
Mellanox Technologies

Advertisement

Table of Contents
loading

Summary of Contents for Mellanox Technologies PowerEdge M420

  • Page 1 Third party information brought to you courtesy of Dell. InfiniScale® IV 16+16 Port 40Gb/s InfiniBand Switch for Dell PowerEdge M1000e-series Blade Enclosures User Manual PN: M3601Q Rev 1.1 Mellanox Technologies...
  • Page 2 InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Interconnect is a trade- mark of Mellanox Technologies, Ltd. Dell and the Dell logo are trademarks of Dell Inc. All other marks and names mentioned herein may be trademarks of their respective companies.
  • Page 3: Table Of Contents

    2.2 Mechanical Installation 2.2.1 Removing an Old Switch From the Chassis 2.2.2 Removing an I/O Module Blank From the Chassis 2.2.3 Installing the Mellanox M3601Q Switch Into the Dell Chassis 2.3 Power Connections and Initial Power On 2.4 InfiniBand Cable Installation Chapter 3 Cluster Management and Firmware 3.1 Network Management and Clustering Software...
  • Page 4: About This Manual

    • Dell Support Web pages: http://support.dell.com Conventions Throughout this manual, the name M3601Q and the terms switch, I/O module, and IOM are used to describe the 16+16 port 40Gb/s InfiniBand switch for the Dell M1000e, unless explicitly indicated otherwise. Mellanox Technologies Rev 1.1...
  • Page 5: Revision History

    M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Revision History Table 2 - Revision History Table Date Revision Description March 2009 Added Dell Logo November 2008 Initial Release Mellanox Technologies Rev 1.1...
  • Page 6: Chapter 1 Overview

    M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual 1 Overview The Mellanox M3601Q 40Gb/s InfiniBand Switch Blade for Dell PowerEdge M1000e-series Blade Enclosures provides a high bandwidth, low latency fabric for Enterprise Data Centers, High-Perfor- mance Computing and Embedded environments. Based on the fourth generation InfiniScale® IV InfiniBand switch device, this I/O module (IOM) delivers up to 40Gb/s full bisectional bandwidth per port.
  • Page 7: Infiniband Connectors

    Figure 1: Switch Front Panel and Locking Mechanism Locking Mechanism Switch Status Lights InfiniBand Connectors InfiniBand connectivity has 16 QSFP connectors through the front panel. The remaining 16 inter- faces are through the AirMax Midplane Connector out the back of the switch. Figure 1 shows the front 16 ports.
  • Page 8: Switch Status Lights

    M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Figure 2: Physical and Logical Link Indication LEDs LED Name Connection Status Physical Link - Green Off – No Physical Link ON – Physical Link Data Activity - Yellow Blinking – indicates Data Transfer Constant on –...
  • Page 9: Chapter 2 Installation And Basic Operation

    2 Installation and Basic Operation Installation and initialization of the I/O module are straightforward processes, requiring attention to the normal mechanical, power, and thermal precautions for rack-mounted equipment. The I/O mod- ule does not require any programming or configuration to operate as a basic InfiniBand switch and includes all of the necessary functionality to operate with external standard InfiniBand Subnet Management software.
  • Page 10 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Copper InfiniBand Cable Connecting/Disconnecting Copper InfiniBand cables are heavy and not flexible, as such they should be carefully attached to or detached from the connectors. Refer to the cable manufacturer for special warnings and instructions.
  • Page 11: Mechanical Installation

    Mechanical Installation These switches are hot pluggable. It is not necessary to power down the Dell Chassis to install a new switch or to replace an old switch with a new one. Figure 4: Rear View of the Dell PowerEdge M1000e Chassis...
  • Page 12: Removing An I/O Module Blank From The Chassis

    You must install a module in slots B1/C1 before installing a module in slots B2/C2. Refer to the Dell PowerEdge M1000e Hardware Owners Manual for more information. 1. Follow the instructions in Section 2.2.1 or Section 2.2.2 to remove an old switch or an I/O Mod- ule Blank.
  • Page 13 To remove, disengage the locks and slowly pull the connector away from the port receptacle. Both LED indicators will turn off when the cable is unseated. Care should be taken not to impede the air exhaust flow through the chassis. Note: Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack.
  • Page 14: Chapter 3 Cluster Management And Firmware

    > Downloads > Firmware Tools. The latest firmware can be found at: http://www.mellanox.com > Support > Dell. 3.2.1 Instructions for Reprogramming Over the InfiniBand Network To update an MT48436 InfiniScale IV switch device having a specific GUID (for example, 0x00000006660abcd0) or LID, the following are the recommended steps to update the device firmware.
  • Page 15 -I- Using port 1 as the local port. -I- Discovering ... 3 nodes (2 Switches & 1 CA-s) discovered. -I--------------------------------------------------- -I- Bad Guids/LIDs Info -I--------------------------------------------------- -I- skip option set. no report will be issued -I--------------------------------------------------- -I- Links With Logical State = INIT -I--------------------------------------------------- -I- skip option set.
  • Page 16 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual II. Using the ibnetdiscover tool: Run: [root@mymach]# ibnetdiscover | grep 00000006660abcd0 | grep -w Switch Switch 24 "S-00000006660abcd0" "MT48436 Infiniscale-III Mellanox Technologies" base port 0 lid 17 lmc 0 Note: The resulting LID is given as a decimal number. 4.
  • Page 17: Chapter 4 Troubleshooting

    4 Troubleshooting As soon as a switch is plugged in make sure that the power LED comes on. The power LED for the switch does not come on: 1. Check that the chassis has power. 2. Remove and reinstall the switch. The status LED for the switch is blinking amber: 1.
  • Page 18: Appendix A Specification

    M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Appendix A: Specifications Table 4 - M3601Q Specification Data Physical Power and Environmental H x W x D: 10.73 x 2.322 x 10.04 inches Maximum Power: 152 W 272.54 x58.98 x 255.02 mm Dissipated Power: 120W Weight:...
  • Page 19: Appendix B Emc Certification Statements

    Appendix B: EMC Certification Statements B.1: FCC Statements (USA) Class A Statements: § 15.21 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsi- ble for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. §15.105(a) Statement NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device,...
  • Page 20 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual (Translation - "This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio interference may occur, in which case the user may be required to take corrective actions.") B.1.4 MIC Certification (Korea) Korea's "Regulation for Certification of Information and Communication Equipment,"...
  • Page 21: Appendix C Qsfp Interface

    Appendix C: QSFP Interface Rx1n Rx2n Table 5 - InfiniBand QSFP Connector Pinout Rx1p Rx2p Connector Connector Signal Description Pin Number Pin Name Rx4n Rx3n Ground Rx3p Rx4p Tx2n Transmitter Inverted Data Input Tx2p Transmitter Non-Inverted Data Input ModPrsL Ground IntL Tx4n Transmitter Inverted Data Input...
  • Page 22 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Figure 5: Pinout Looking Into the Rear of the Connector and the Front of the Cage 18.35 View into Rear of Connector 8.50 18.35 View into Front of Cage 8.50 Mellanox Technologies Rev 1.1...
  • Page 23: Appendix D Avertissements De Sécurité D'installation

    Appendix D: Avertissements de sécurité d’installation Instructions d’installation Lisez toutes les instructions d’installation avant de brancher le matériel à la source d’alimentation électrique. Température excessive Ce matériel ne doit pas fonctionner dans une zone avec une température ambiante dépassant le maximum recommandé de 40°C (104°F). En outre, pour garantir un bon écoulement de l’air, laissez au moins 8 cm (3 pouces) d’espace libre autour des ouver- tures de ventilation.
  • Page 24 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Elimination du matériel L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies Rev 1.1...
  • Page 25: Appendix E Installation - Sicherheitshinweise

    Appendix E: Installation - Sicherheitshinweise Installationsanleitungen Lesen Sie alle Installationsanleitungen, bevor Sie das Gerät an die Stromversorgung anschließen. Übertemperatur Dieses Gerät sollte nicht in einem Bereich mit einer Umgebungstemperatur über der maximal empfohlenen Temperatur von 40°C (104°F) betrieben werden. Außerdem sollten mindestens 8 cm (3 in.) Freiraum um die Belüftungsöffnungen sein, um einen einwandfreien Luftstrom zu gewährleisten.
  • Page 26 M3601Q 16+16 Port 40Gb/s InfiniBand Switch User Manual Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies Rev 1.1...

This manual is also suitable for:

Poweredge m520Poweredge m620Infiniscale iv m3601q

Table of Contents