Mellanox Technologies MTS3600Q-1BNC User Manual
Mellanox Technologies MTS3600Q-1BNC User Manual

Mellanox Technologies MTS3600Q-1BNC User Manual

Infiniscale iv 36-port qsfp infiniband switch
Hide thumbs Also See for MTS3600Q-1BNC:

Advertisement

Quick Links

®
InfiniScale
IV 36-Port QSFP
InfiniBand Switch User Manual
P/N: MTS3600Q-1BNC, MTS3600Q-2BNC,
MTS3600Q-1UNC, MTS3600Q-2UNC, MTS3600R-1BNC,
MTS3600R-2BNC, MTS3600R-1UNC, MTS3600R-2UNC
Rev 2.0.0
Mellanox Technologies

Advertisement

Table of Contents
loading

Summary of Contents for Mellanox Technologies MTS3600Q-1BNC

  • Page 1 ® InfiniScale IV 36-Port QSFP InfiniBand Switch User Manual P/N: MTS3600Q-1BNC, MTS3600Q-2BNC, MTS3600Q-1UNC, MTS3600Q-2UNC, MTS3600R-1BNC, MTS3600R-2BNC, MTS3600R-1UNC, MTS3600R-2UNC Rev 2.0.0 Mellanox Technologies...
  • Page 2 All rights reserved. Preliminary information. Subject to change without notice. Mellanox Technologies ConnectX, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Interconnect is a trade- mark of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners.
  • Page 3: Table Of Contents

    Appendix B Switch Hardware Components Appendix C QSFP Interface Appendix D Replacement Parts Ordering Numbers Appendix E de sécurité d’installation (French) Appendix F Installation - Sicherheitshinweise (German) Appendix G Special Regulations Regarding Finland, Sweden, Denmark, and Norway Mellanox Technologies Rev 2.0.0...
  • Page 4: Revision History

    Rev 1.2 Added Reprogramming the MT3600 Through The I2C Port section. Added power cord OPNs to table 11 in Appendix D. September 2008 Rev 1.1 Fixed link to Software package page. September 2008 Rev 1.0 Initial release Rev 2.0.0 Mellanox Technologies...
  • Page 5: About This Manual

    Switch Firmware and Firm- ware Update Tools http://www.mellanox.com > Downloads > Firmware Tools. ® Note that the Switch System described in this manual is based on Mellanox Technologies’ InfiniScale IV switch device. Mellanox OFED Stack for Linux User’s Manual http://www.mellanox.com >...
  • Page 6: Switch Products Covered In This User's Manual

    Switch Products Covered in this User’s Manual Table 3 - Switch Products Covered by this User Manual Product Number Description MTS3600Q-1BNC 36-port Managed QSFP 40Gb/s InfiniBand switch with one power supply MTS3600R-1BNC 36-port Managed QSFP 20Gb/s InfiniBand switch with one power supply...
  • Page 7: Chapter 1 Overview

    The serial number and product version information are found on the label seen in the figure below. Figure 1: Generic Product label Also on this label is the GUID identifier for the switch. There is also a label with the MAC for the manage- ment module? Figure 2: Management Module Label Mellanox Technologies Rev 2.0.0...
  • Page 8: Chapter 2 Installation And Basic Operation

    Note: Do not run the switch for more than 2 minutes should the FAN LED show yellow. If the PSU LEDs are not green, this indicates a problem with the power supplies. Do not run the switch if the PSU LEDs are not green. Rev 2.0.0 Mellanox Technologies...
  • Page 9 Power Supply Unit can be added to increase security, hot- swap ability and to add redundancy. Figure 5: MTS3600 QSFP Front Panel Place for secondary Primary Power Fan Unit Power Supply Unit Supply Unit Mellanox Technologies Rev 2.0.0...
  • Page 10: I2C Connector

    Internal management refers to a switch that has an internal PPC management board. Switches without this management board can be managed using an external management system. The following interfaces allow access to the internal management module. These interfaces have no function in externally managed sys- tems. Rev 2.0.0 Mellanox Technologies...
  • Page 11: Interfaces

    Please first read the warnings sub-section carefully before carrying on with installation procedures. 2.2.1 Installation Safety Warnings For Safety Warnings in French see Section E,“de sécurité d’installation (French),” on page 34, and for Ger- man see Section F,“Installation - Sicherheitshinweise (German),” on page 36. Mellanox Technologies Rev 2.0.0...
  • Page 12 In general you should fill the rack with equipment starting from the bottom to the top. Equipment Installation This equipment should be installed, replaced, or serviced only by trained and qualified personnel. Rev 2.0.0 Mellanox Technologies...
  • Page 13: Mechanical Installation

    Cable routing in particular should not impede the air exhaust from the chassis. 2.2.2.1 Installing the Switch in the Rack Tools needed: Phillips Screwdriver ESD Strap ESD mat Mellanox Technologies Rev 2.0.0...
  • Page 14 IB connectors can be even with the vertical rack support. The other side of the switch will be further inside of the rack. Things to consider before choosing where to mount the rails and rail slides. Rev 2.0.0 Mellanox Technologies...
  • Page 15 Tighten the screws to 3Nm or 26.5 pound inches. Figure 9: Screwing the Rail Slide onto the switch This side of the switch will be next to the verti- cal rack support. Mellanox Technologies Rev 2.0.0...
  • Page 16: Power Connections And Initial Power On

    The switch platform ships with one or two Power Supply Units. For switches with only one unit installed, a second PSU may be installed at a later time. Each supply has a separate AC receptacle. The input voltage is Rev 2.0.0 Mellanox Technologies...
  • Page 17: Extracting And Inserting The Power Supply Unit

    With both power supplies installed in the redundant configuration, either PSU may be extracted without bringing down the system. Note: Make sure that the PSU that you are NOT replacing is showing all green, for both the PSU and status indicators. Mellanox Technologies Rev 2.0.0...
  • Page 18: Infiniband Cable Installation

    When a logical connection is made the yellow light will come on. When data is being transferred the yellow light will blink. Rev 2.0.0 Mellanox Technologies...
  • Page 19: Extracting And Inserting The Fan Unit

    Pull the fan unit out by pulling on the thumbscrews. As the fan unseats, the fan status indicator will turn off. To insert a FAN Unit: Make sure the mating connector of the new unit is free of any dirt and/or obstacles. Mellanox Technologies Rev 2.0.0...
  • Page 20: Replacing The Battery In The Management Module

    Kit Parts” for a picture of the rail slides. Note: Support the weight of the switch when you remove the screws so that the switch does not fall. Slide the switch from the rack. Remove the rails from the rack. Rev 2.0.0 Mellanox Technologies...
  • Page 21: Disposal

    According to the WEEE Directive 2002/96/EC, all waste electrical and elec- tronic equipment (EEE) should be collected separately and not disposed of with regular household waste. Dispose of this product and all of its parts in a responsible and environmentally friendly way. Mellanox Technologies Rev 2.0.0...
  • Page 22: Chapter 3 Management And Tools Overview

    The Subnet management features include: upgrading Drivers upgrading software monitoring of: • AC power to the PSUs • DC power out from the PSUs • board temperature • spine fan module unit • leaf fan module unit Rev 2.0.0 Mellanox Technologies...
  • Page 23: Initializing The Switch For The First Time

    Be sure to read and follow all of the instructions regarding the updating of the firmware on your switch sys- tem. Firmware for the HCA cards connected to this switch system can be downloaded from the same site. Mellanox Technologies Rev 2.0.0...
  • Page 24: Switch Management Tools

    FabricIT EFM. Make sure to register your FabricIT license to enable all of the available commands and functions. See the FabricIT EFM User Manual for instructions and commands available to manage the switches, and fabric. Rev 2.0.0 Mellanox Technologies...
  • Page 25: Chapter 5 Troubleshooting

    Caution: Do not run the switch if the System Status LED for the Fans is Yellow! The link LED for the InfiniBand connector does not come on: Check that both ends of the cable are connected. Check that the locks on the ends are secured. Mellanox Technologies Rev 2.0.0...
  • Page 26 Make sure that the latest FW version is installed on both the HCA and the switch. If media adapters are used, check that the all connections are good, tight, and secure. The activity LED does not come on: Check that the Subnet Manager has been started. Rev 2.0.0 Mellanox Technologies...
  • Page 27: Appendix A Specification

    Scalability and Performance Features Switching Performance: Simultaneous wire-speed any port to any port Hot-Swappable: Fan Module and Power Supplies Addressing: 48K Unicast Addresses Max. per Subnet 1+1 Redundant: Power Supplies 16K Multicast Addresses per Subnet Switching Capacity: 2.88Tb/s Mellanox Technologies Rev 2.0.0...
  • Page 28 Scalability and Performance Features Switching Performance: Simultaneous wire-speed any port to any port Hot-Swappable: Fan Module and Power Supplies Addressing: 48K Unicast Addresses Max. per Subnet 1+1 Redundant: Power Supplies 16K Multicast Addresses per Subnet Switching Capacity: 1.44Tb/s Rev 2.0.0 Mellanox Technologies...
  • Page 29 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsi- ble for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. §15.105(a) Statement NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
  • Page 30 0.0.1 (Translation - "This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio interfer- ence may occur, in which case the user may be required to take corrective actions.") Rev 2.0.0 Mellanox Technologies...
  • Page 31: Appendix B Switch Hardware Components

    InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual Appendix B: Switch Hardware Components Place for Optional Secondary Power Primary Power Supply Unit Supply Unit Fan Unit Mellanox Technologies Rev 2.0.0...
  • Page 32: Appendix C Qsfp Interface

    +3.3 V Power supply transmitter Vcc 1 +3.3 V Power Supply LPMode Low Power Mode Ground Tx3p Transmitter Non-Inverted Data Input Tx3n Transmitter Inverted Data Input Ground Tx1p Transmitter Non-Inverted Data Input Tx1n Transmitter Inverted Data Input Ground Rev 2.0.0 Mellanox Technologies...
  • Page 33: Appendix D Replacement Parts Ordering Numbers

    ACC000208 Power cord Type D for India ACC000209 Power cord Type I for China ACC000210 Power cord Type J for Switzerland ACC000211 Power cord Type B for Japan, ACC000212 Power cord Type I for Australia ACC000213 Mellanox Technologies Rev 2.0.0...
  • Page 34: Appendix E De Sécurité D'installation (French)

    Lorsque ce produit est monté ou entretenu sur baie, il faut prendre des précautions spéciales pour s’assurer que le système reste stable. En général, il faut remplir la baie avec du matériel de bas en haut. Rev 2.0.0 Mellanox Technologies...
  • Page 35 L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. 10. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies Rev 2.0.0...
  • Page 36: Appendix F Installation - Sicherheitshinweise (German)

    Wenn dieses Produkt in einem Rack montiert oder gewartet wird, sind besondere Vor- sichtsmaßnahmen zu ergreifen, um die Stabilität des Systems zu gewährleisten. Im Allgemeinen sollten Sie das Gestell von unten nach oben mit Geräten füllen. Rev 2.0.0 Mellanox Technologies...
  • Page 37 Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. 10. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies Rev 2.0.0...
  • Page 38: Appendix G Special Regulations Regarding Finland, Sweden, Denmark, And Norway

    Do not connect this unit to any outlet that is not fully grounded! Finland - “Laite on liitettävä suojamaadoituskoskettimilla varustettuun pistorasiaan” Norway - “Apparatet må tilkoples jordet stikkontakt” Unit is intended for connection to IT power systems for Norway only. Sweden - “Apparaten skall anslutas till jordat uttag.” Rev 2.0.0 Mellanox Technologies...

Table of Contents