Mellanox Technologies MTS3600Q-1UNC User Manual
  1. Manuals
  2. Brands
  3. Mellanox Technologies Manuals
  4. Switch
  5. InfiniScale MTS3600Q-1UNC
  6. User manual
Mellanox Technologies MTS3600Q-1UNC User Manual

Mellanox Technologies MTS3600Q-1UNC User Manual

Infiniscale iv 36-port qsfp infiniband switch
Hide thumbs Also See for MTS3600Q-1UNC:
Table of Contents

Advertisement

Quick Links

Download this manual
®
InfiniScale
IV 36-Port QSFP
InfiniBand Switch User Manual
P/N: MTS3600Q-1UNC, MTS3600Q-2UNC,
MTS3600R-1UNC, MTS3600R-2UNC
Rev 1.5
Mellanox Technologies

Advertisement

Table of Contents
loading

Related Manuals for Mellanox Technologies MTS3600Q-1UNC

Summary of Contents for Mellanox Technologies MTS3600Q-1UNC

  • Page 1 ® InfiniScale IV 36-Port QSFP InfiniBand Switch User Manual P/N: MTS3600Q-1UNC, MTS3600Q-2UNC, MTS3600R-1UNC, MTS3600R-2UNC Rev 1.5 Mellanox Technologies...
  • Page 2 Subject to change without notice. Mellanox Technologies ConnectX, InfiniBlast, InfiniBridge, InfiniHost, InfiniRISC, InfiniScale, and InfiniPCI are registered trademarks of Mellanox Technologies, Ltd. Virtual Protocol Interconnect is a trade- mark of Mellanox Technologies, Ltd. All other trademarks are property of their respective owners.

  • Page 3: Table Of Contents

    Appendix B Switch Hardware Components Appendix C QSFP Interface Appendix D Replacement Parts Ordering Numbers Appendix E Avertissements de sécurité d’installation (French) Appendix F Installation - Sicherheitshinweise (German) Appendix G Special Regulations Regarding Finland, Sweden, Denmark, and Norway Mellanox Technologies Rev 1.5...

  • Page 4: Revision History

    Rev 1.2 Added Reprogramming the MT3600 Through The I2C Port section. Added power cord OPNs to table 11 in Appendix D. September 2008 Rev 1.1 Fixed link to Software package page. September 2008 Rev 1.0 Initial release Mellanox Technologies Rev 1.5...

  • Page 5: About This Manual

    Switch Products Covered in this User’s Manual Table 3 - Switch Products Covered by this User Manual Product Number Description MTS3600Q-1UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with one power supply MTS3600Q-2UNC 36-port Unmanaged QSFP 40Gb/s InfiniBand switch with two power supplies...

  • Page 6: Chapter 1 Overview

    1.1 Serial Number and Product Version Information The serial number and product version information are found on the label seen in the figure below. Figure 1: Generic Product label Also on this label is the GUID identifier for the switch. Mellanox Technologies Rev 1.5...

  • Page 7: Chapter 2 Installation And Basic Operation

    Input AC voltage Indicators is good PSU Status Indicators 2.1.1.1 System Status Indicators The System Status Indicators are located just to the left of the primary power supply unit, and labeled “Sys.”. The following status conditions are possible: Rev 1.5 Mellanox Technologies...
  • Page 8 The PSU status indicators are located just to the left of the primary power supply unit, and labeled “PSU1” and “PSU2”. The following status conditions are possible: Table 5 - PSU Status LED Configurations LED Configuration Status OK – This power supply unit is delivering the correct DC supply. Mellanox Technologies Rev 1.5...

  • Page 9: I2C Connector

    The Ethernet connection provides access for remote management. The MTS3600 can be connected to an Ethernet switch or the Ethernet port of a computer. 2.1.3.3 USB interface There are two USB ports for connecting a keyboard and mouse for local management operation. Rev 1.5 Mellanox Technologies...

  • Page 10: Switch Platform Installation And Operation

    Do not operate the product if the blank cover is not securely fastened or if it is removed. During Lightning - Electrical Hazard During periods of lightning activity, do not work on the equipment or connect or disconnect cables. Mellanox Technologies Rev 1.5...

  • Page 11: Mechanical Installation

    PSU for redundancy), hot-swap fan tray, and I/O ports for an optional CPU advanced man- agement board and an I2C I/O port. The hot-swap fan module provides front to back air flow. The switch platform contains auto-sensing 90 - 264 VAC connections for all possible PSUs. Rev 1.5 Mellanox Technologies...
  • Page 12 ESD strap is touching your skin and that the other end is connected to a verified ground. Choose which way you want the switch to slide out of the rack. Either the side with the power supply units can slide out or the side with the IB connectors can slide out. Mellanox Technologies Rev 1.5...
  • Page 13 The caged nuts are separated by a single space Take the 2 rail slides and screw them to the switch. Use two of the flat head screws for each rail slide. Use these holes Rev 1.5 Mellanox Technologies...

  • Page 14: Power Connections And Initial Power On

    If the fan status indicator is not green then unplug the power connection and check that the fan module is inserted properly and that the mating connector of the fan unit is free of any dirt and/or obstacles. Mellanox Technologies Rev 1.5...

  • Page 15: Extracting And Inserting The Power Supply Unit

    With both power supplies installed in the redundant configuration, either PSU may be extracted without bringing down the system. Note: Make sure that the PSU that you are NOT replacing is showing all green, for both the PSU and status indicators. Rev 1.5 Mellanox Technologies...

  • Page 16: Infiniband Cable Installation

    When data is being transferred the yellow light will blink. Cables in the bottom row should be inserted up side down in relation to the how the cables are inserted in tehtop row. Mellanox Technologies Rev 1.5...

  • Page 17: Extracting And Inserting The Fan Unit

    Note: The green fan status indicator should light and the yellow fan status should remain off. If not, extract the fan unit and re-insert it. After two unsuccessful attempts to install the fan unit, power off the switch before attempting any system debug. Rev 1.5 Mellanox Technologies...

  • Page 18: Replacing The Battery In The Management Module

    InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual 2.2.7 Replacing the Battery in the Management Module TBD Need procedure. Mellanox Technologies Rev 1.5...

  • Page 19: Chapter 3 Management And Tools Overview

    /dev/mst/ directory. These devices can be used for access by other MFT tools. [root@mymach]> mst ib add -I- Running ibdiagnet to discover the fabric ... Loading IBDIAGNET from: /usr/local/lib/ibdiagnet1.2 -W- Topology file is not specified. Reports regarding cluster links will use direct routes. Loading IBDM from: /usr/local/lib/ibdm1.2 Rev 1.5 Mellanox Technologies...
  • Page 20 -I- Added 3 in-band devices [root@mymach]> To list the discovered mst inband devices run “mst status”. [root@mymach]> mst status MST modules: ------------ MST PCI module loaded MST PCI configuration module loaded Inband devices: ------------------- /dev/mst/CA_MT25418_sw005_HCA-1_lid-0x0001 /dev/mst/SW_MT47396_lid-0x0011 /dev/mst/SW_MT48438_lid-0x0003 [root@mymach]> Mellanox Technologies Rev 1.5...

  • Page 21: Reprogramming The Mts3600 Through The I2C Port

    Run: [root@mymach]# ibnetdiscover | grep 00000006660abcd0 | grep -w Switch Switch 24 "S-00000006660abcd0" "MT47396 Infiniscale-III Mellanox Technologies" base port 0 lid 17 lmc 0 Note: The resulting LID is given as a decimal number. Run mlxburn with the LID retrieved in step #3 above to perform the In-Band burning operation.

  • Page 22: Managed Switch System

    Congestion & notification manager QoS manager Adaptive routing manager Cluster diagnostics manager Management modules with a CPU will have the capability to allow remote monitoring and remote manage- ment of the chassis from any host connected to the fabric. Mellanox Technologies Rev 1.5...

  • Page 23: Accessing The Management Cpu

    For local access out of band management of the switch system: Connect a keyboard to the one of the USB ports, a video device to the video connector, and a mouse to the second USB connector of the switch (cables not supplied). Rev 1.5 Mellanox Technologies...

  • Page 24: Downloading Firmware

    The embedded OS and tools on the CPU in the management module is a subset of the Mellanox OFED stack. http://www.mellanox.com > Downloads > InfiniBand SW/Drivers, Select “Mellanox OpenFabrics Enterprise Distribution for Linux (MLNX_OFED) ” Select the Linux User’s Manual Mellanox Technologies Rev 1.5...

  • Page 25: Chapter 4 Troubleshooting

    Make sure that the latest FW version is installed on both the HCA and the switch. If media adapters are used, check that the all connections are good, tight, and secure. The activity LED does not come on: Check that the Subnet Manager has been started. Rev 1.5 Mellanox Technologies...

  • Page 26: Management Module

    InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual 4.1 Management Module How do I know if the battery is dead: Replace the battery Mellanox Technologies Rev 1.5...

  • Page 27: Appendix A Specification

    Scalability and Performance Features Switching Performance: Simultaneous wire-speed any port to any port Hot-Swappable: Fan Module and Power Supplies Addressing: 48K Unicast Addresses Max. per Subnet 1+1 Redundant: Power Supplies 16K Multicast Addresses per Subnet Switching Capacity: 2.88Tb/s Mellanox Technologies Rev 1.5...
  • Page 28 Scalability and Performance Features Switching Performance: Simultaneous wire-speed any port to any port Hot-Swappable: Fan Module and Power Supplies Addressing: 48K Unicast Addresses Max. per Subnet 1+1 Redundant: Power Supplies 16K Multicast Addresses per Subnet Switching Capacity: 1.44Tb/s Rev 1.5 Mellanox Technologies...
  • Page 29 Statement Warning! Changes or modifications to this equipment not expressly approved by the party responsi- ble for compliance (Mellanox Technologies) could void the user's authority to operate the equipment. §15.105(a) Statement NOTE: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
  • Page 30 0.1.5 (Translation - "This is a Class A product based on the standard of the Voluntary Control Council for Interference by Information Technology Equipment (VCCI). If this equipment is used in a domestic environment, radio interfer- ence may occur, in which case the user may be required to take corrective actions.") Rev 1.5 Mellanox Technologies...

  • Page 31: Appendix B Switch Hardware Components

    InfiniScale® IV 36-Port QSFP InfiniBand Switch User Manual Appendix A: Switch Hardware Components Place for Optional Secondary Power Primary Power Supply Unit Supply Unit Fan Unit Mellanox Technologies Rev 1.5...
  • Page 32 +3.3 V Power supply transmitter Vcc 1 +3.3 V Power Supply LPMode Low Power Mode Ground Tx3p Transmitter Non-Inverted Data Input Tx3n Transmitter Inverted Data Input Ground Tx1p Transmitter Non-Inverted Data Input Tx1n Transmitter Inverted Data Input Ground Rev 1.5 Mellanox Technologies...

  • Page 33: Appendix D Replacement Parts Ordering Numbers

    ACC000208 Power cord Type D for India ACC000209 Power cord Type I for China ACC000210 Power cord Type J for Switzerland ACC000211 Power cord Type B for Japan, ACC000212 Power cord Type I for Australia ACC000213 Mellanox Technologies Rev 1.5...

  • Page 34: Appendix E Avertissements De Sécurité D'installation (French)

    Lorsque ce produit est monté ou entretenu sur baie, il faut prendre des précautions spéciales pour s’assurer que le système reste stable. En général, il faut remplir la baie avec du matériel de bas en haut. Rev 1.5 Mellanox Technologies...
  • Page 35 L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. 10. Codes électriques locaux et nationaux Ce matériel doit être installé dans le respect des codes électriques locaux et nationaux. Mellanox Technologies Rev 1.5...

  • Page 36: Appendix F Installation - Sicherheitshinweise (German)

    Wenn dieses Produkt in einem Rack montiert oder gewartet wird, sind besondere Vor- sichtsmaßnahmen zu ergreifen, um die Stabilität des Systems zu gewährleisten. Im Allgemeinen sollten Sie das Gestell von unten nach oben mit Geräten füllen. Rev 1.5 Mellanox Technologies...
  • Page 37 Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. 10. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Mellanox Technologies Rev 1.5...

  • Page 38: Appendix G Special Regulations Regarding Finland, Sweden, Denmark, And Norway

    Do not connect this unit to any outlet that is not fully grounded! Finland - “Laite on liitettävä suojamaadoituskoskettimilla varustettuun pistorasiaan” Norway - “Apparatet må tilkoples jordet stikkontakt” Unit is intended for connection to IT power systems for Norway only. Sweden - “Apparaten skall anslutas till jordat uttag.” Rev 1.5 Mellanox Technologies...

This manual is also suitable for:

Mts3600r-1uncMts3600q-2uncMts3600r-2unc

Table of Contents