Subscribe to Our Youtube Channel
Related Manuals for Mellanox Technologies SwitchX
Summary of Contents for Mellanox Technologies SwitchX
- Page 1 SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual P/N:MSX10XX Rev 1.3 www.mellanox.com...
- Page 2 © Copyright 2012. Mellanox Technologies. All Rights Reserved. Mellanox®, Mellanox logo, BridgeX®, ConnectX®, CORE-Direct®, InfiniBridge®, InfiniHost®, InfiniScale®, PhyX®, SwitchX®, Virtual Protocol Interconnect® and Voltaire® are registered trademarks of Mellanox Technologies, Ltd. Connect-IB™, FabricIT™, MLNX-OS™, ScalableHPC™, Unbreakable-Link™, UFM™ and Unified Fabric Manager™ are trademarks of Mellanox Technologies, Ltd.
-
Page 3: Table Of Contents
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Table of Contents List of Figures ..............5 List of Tables . - Page 4 Installation - Sicherheitshinweise (German) ......64 Appendix H Advertencias de seguridad para la instalación (Spanish) ....68 Mellanox Technologies...
-
Page 5: List Of Figures
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 List of Figures Figure 1: Connector Side View of the Switch ........11 Figure 2: Pull Out Tab . - Page 6 Figure 39: QSFP Connector Male and Female Views ........57 Mellanox Technologies...
-
Page 7: List Of Tables
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 List of Tables Table 1: Revision History Table Table 2: Reference Documents and Web Sites Table 3: System Status LED Configurations Table 4: Fan Status LED Configurations Table 5:... -
Page 8: Revision History
Added Appendix for Thermal Threshold Definitions Removed reference to spring clip in Appendix “Transferring the Power Cord” Changed Specifications table formatting 4 column to 2 column Fixed port LED assignment Added Cable Splitting section July 2011 Initial Release Mellanox Technologies... -
Page 9: About This Manual
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 About this Manual This manual describes the installation and basic use of the Mellanox switch which is based on the SwitchX switch device. Intended Audience This manual is intended for users and system administrators responsible for designing and test- ing switch platforms. -
Page 10: Abreviations
Depth of the Unit S = standard depth, B = short depth R= Connector side to Power side airflow Air Flow direction F= Power Side side to Connector side airflow Chip Generation R – SwitchX S – SwitchX-2 Mellanox Technologies... -
Page 11: Chapter 1 Overview
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Overview The SX10xx Ethernet system switch family provides the highest-performing fabric solution in a 1U form factor by delivering up to 2.88Tb/s of non-blocking throughput to High-Performance Computing (HPC), high frequency trading and Enterprise Data Centers (EDC), with ultra-low- latency. -
Page 12: Features
The Serial number and the MAC for the switch are found on the pull out tab below the USB con- nector. The MAC for the Management PC is also on this tab. This MAC is for the mgmt0 man- agement interface (the top Ethernet port). The second interface mgmt1 has the next consecutive MAC. Mellanox Technologies... -
Page 13: Figure 2: Pull Out Tab
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 2: Pull Out Tab SX1035 CONSOLE S /N : M T 1 1 1 7 X 0 0 0 1 4 P /N : M S X 1 0 3 5 B - 1 B F R... -
Page 14: Chapter 2 40 Gb/S Ethernet
QSFP cables and connectors for 40Gb/s speed, or 10Gb/s speed when connecting through QSA Mellanox adaptors. Specific ports can support breakout cables. See “Splitting the Data Stream Using Breakout (Fanout) Cables” on page 36 for mor information. Mellanox Technologies... -
Page 15: Basic Operation And Installation
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Basic Operation and Installation Switch Platform Hardware Overview Figure 3 shows the power side panel and connector side panel views of the switch. The figure shows port configurations for the switch systems, the hot-swap power supply location, the hot- swap fan module, 2 –... - Page 16 For more information See “Troubleshooting” on page 46. If the PS LEDs are not green, this indicates a problem with the power supplies. The switch is operational only if at least one of the PS LEDs is green. Mellanox Technologies...
-
Page 17: Figure 5: Power, Fan, And System Leds
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 5: Power, Fan, and System LEDs Table 3 - System Status LED Configurations LED Configuration STATUS/ System Health LED Solid Green OK – The system is up and running. -
Page 18: Figure 7: Fan Status Led Power Side
TheSX10XX switch is available with one factory installed Power Supply Unit. A second Power Supply Unit can be added to support hot-swap ability and to add redundancy. See Section F, “Replacement Parts Ordering Numbers,” on page 59 for ordering part numbers. Mellanox Technologies... -
Page 19: Figure 8: Power Side Panel
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 8: Power Side Panel PS unit 1 status LED Fan status LED Fan Unit Primary Power Supply Unit The primary power supply unit (PS1) is located on the right side of the power side panel, with PS2 on the left side. -
Page 20: Reset Button
On the connector side panel under the system LEDs is a reset button. This reset button requires a tool to be pressed. DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button. Sharp objects can cause damage, use a flat object to push the reset button. Mellanox Technologies... -
Page 21: Figure 11: Reset Button
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 11: Reset Button Press the reset button to reset the main and management CPUs and to delete the existing password. This button resets both the CPU of the switch device and the CPU of the management module. It thereby resets all of the ports by bringing them down and powering them up when the button is pushed. -
Page 22: Air Flow
Connector side inlet to power side outlet Power side inlet to connector side outlet QSFP Cable Power Budget Classification All SwitchX QSFP switches are designed for active cables with a max power per module of 2W. Typical power per port is 1.3W. Mellanox Technologies... -
Page 23: Interfaces
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Interfaces 3.4.1 Port Connector Interfaces The connector side of the switch has 36 QSFP ports. These are placed in two rows, 18 ports to a row. The ports are labelled as shown in Figure 13. The bottom row ports are flipped from the top row. -
Page 24: Switch Platform Installation And Operation
PC or remotely. This interface is for support personnel and advanced users only. Switch Platform Installation and Operation Installation and initialization of the switch platform are straightforward processes, requiring attention to the normal mechanical, power, and thermal precautions for rack-mounted equipment. Mellanox Technologies... -
Page 25: Installation Safety Warnings
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 3.5.1 Installation Safety Warnings For Safety Warnings in French see Section G,“Avertissements de sécurité d’installation (French),” on page 60, for German see Section H,“Installation - Sicherheitshinweise (German),” on page 64, and for Spanish see Section I,“Advertencias de seguridad para la instalación (Span- ish),”... - Page 26 For European connection, select a power supply cord that is internationally harmonized and marked “<HAR>”, 3 - conductor, minimum 0,75 mm2 wire, rated at 300 V, with a PVC insulated jacket. The cord must have a molded on plug cap rated 250 V, 10 A. Mellanox Technologies...
-
Page 27: Mechanical Installation
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 13. Do Not Use the Switch as a Shelf or Work Space Caution: Slide/rail mounted equipment is not to be used as a shelf or a work space. 14. WEEE Directive... -
Page 28: Package Contents And Installation
Parts included in the rail kit: • 2 rails • 16 recessed flat head screws You will have extras! • 2 rail slides • 10 caged nuts • 2 switch slides • 10 pan head screws M6 Mellanox Technologies... -
Page 29: Figure 16: Rack Rail Kit Parts
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 16: Rack Rail Kit Parts Switch slide x2 Rail x2 Rail slide x2 1. Place the ESD mat on the floor where you will be working and put on the ESD strap. Make sure the ESD strap is touching your skin and that the other end is connected to a verified ground. -
Page 30: Figure 17: Placement Of Switch In Rack
See Figure 18,“Mounting Options”. • Will the connector side be recessed past other equipment in the rack and will this be prob- lematic? • The installation kit allows for a 2” recess of the switch past the vertical support. Mellanox Technologies... -
Page 31: Figure 18: Mounting Options
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 18: Mounting Options 3. Decide which mounting option you want to use. To use the rail kit to transfer the power cord from the connector side to the power side go now to “Transferring the Power Cord”... -
Page 32: Figure 20: Inserting The Caged Nuts
Figure 21: Slide the Rail into the Rail Slide This side of the rail kit goes on the side of the rack you will slide the switch into. This is the same side of the switch that will be next to the vertical support. Mellanox Technologies... -
Page 33: Grounding The Switch
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 9. Slide the switch into the rails. 10. Tighten the bolts to 9.2 Nm or 81.5 pound inches. 11. Put the switch into place and screw the bolts into the nuts. Tighten the bolts to 9.2 Nm or 81.5 pound inches. -
Page 34: Figure 23: Two Power Inlets - Electric Caution Notifications
Einhieten spannungs- ensure a powered down state “Alimentation Stabilise’e”. frei zu machen sind die inside of the switch platform. Pour isoler completement le Netzstecker aller Netzteile module en cause, Il faut zu entfernen de’brancher toutes les alimen- tations stabilise’es. Mellanox Technologies... -
Page 35: Extracting And Inserting The Power Supply Unit
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Extracting and Inserting the Power Supply Unit With both power supplies installed in the redundant configuration, either PS unit may be extracted without bringing down the system. Make sure that the PS unit that you are NOT replacing is showing all green, for both the PS unit and status indicators. -
Page 36: Supported Approved Cables
40 Gb/s port into 4 lanes (4 SFP+ connectors 10Gb/s each). These 4 lanes then go, one lane to each of the 4 SFP+ connectors. Some ports can be split into 2 10 Gb/s ports, using lanes 1 and 2 Mellanox Technologies... -
Page 37: Figure 27: Breakout Or Fanout Cable
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 only. When a QSFP port is split into 2 10Gb/s ports then only SFP+ connectors #1 and #2 are used. Connectors #3 and #4 are left unconnected. Using Figure 28 and Table 10, with breakout cables you can achieve 64 ports of 10Gb/s. -
Page 38: Table 10: Port Splitting Options
— — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — — Mellanox Technologies... -
Page 39: Cable Installation
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 29: 3 Examples of Port Mapping Assignment 64 X10 GbE DO NOT USE 12 x 40GbE ports blocked 00 10GbE ports THESE PORTS 12 x 40GbE ports split to 4 10GbE ports =... -
Page 40: Extracting And Inserting The Fan Unit
“Air Flow” on page 22 for an explanation of the model numbers and labels. Make sure that the fans have the air flow that matches the model number. An air flow opposite to the switch design will cause the switch to operate at a higher (less than optimal) temperature. Mellanox Technologies... -
Page 41: Switch Shut Down Procedure
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 31: Air Flow Labels These air flow labels must be the same To extract a Fan Unit 1. Using two fingers, push both latch releases towards each other simultaneously while pulling the fan module out of the switch. -
Page 42: Disassembly Of The Switch From The Rack
On the connector side panel under the system LEDs is a reset button. This reset button requires a tool to be pressed. DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button. Sharp objects can cause damage, use a flat object to push the reset button. Mellanox Technologies... -
Page 43: Figure 33: Reset Button
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 33: Reset Button Press the reset button to reset the main and management CPUs and to delete the existing password. This button resets both the CPU of the switch device and the CPU of the management module. It thereby resets all of the ports by bringing them down and powering them up when the button is pushed. -
Page 44: Management And Tools Overview
Chassis Management Using the MLNX-OS™ Software The SX10XX switches come standard with a management software module for chassis manage- ment called Mellanox Operating System (MLNX-OS). MLNX-OS is installed on all SwitchX based managed switch systems. MLNX-OS includes a CLI and chassis management software . -
Page 45: Starting A Remote Connection To The Switch
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 4.2.1 Starting a Remote Connection to the Switch There are two ways to access the management CPU: • Via the Ethernet connector for remote access: • SSH • Telnet •... -
Page 46: Chapter 5 Troubleshooting
4. If media adapters are used, check that the all connections are good, tight, and secure. The activity LED does not come on: When running IB check that the Subnet Manager has been started. The switch is off: 1. Unplug the switch. 2. Wait 5 minutes. Mellanox Technologies... - Page 47 SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 3. Plug in the switch. 4. If the switch does not come on, check the power supplies. 5. If the switch comes on, Use the MLNX-OS management CLI to determine the cause of the Shutdown.
- Page 48 15b3 bd34 0c06 Net: ppc_4xx_eth0, ppc_4xx_eth1 Hit Ctrl+B to stop autoboot: Mellanox MLNX-OS Boot Menu: 1. EFM_PPC_M460EX EFM_1.1.1000 2010-06-24 16:32:03 ppc 2. EFM_PPC_M460EX EFM_1.1.1200 2010-06-25 18 :00:03 ppc 3. U-Boot prompt Choice: 5. Select the image to boot. Mellanox Technologies...
-
Page 49: Appendix A Specification
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Appendix A: Specification Table 11 - SX103[56]Specification Data Physical Size: SX103[56]B 1.716” (1U) H x 16.85” W x SX1056S 1.716” (1U) H x 16.85” W (short) 16.8” D (Standard i.e. - Page 50 Rev 1.3 Shock and Humidity: Shock and Vibration: ETSI EN 300 019-2-2: 1999-09 Operating 5% - 95% non-condensing Vibration/ Humidity Mellanox Technologies...
-
Page 51: Approved Cables
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Protocol Support Ethernet: Management: Speed protocol \ Auto-Negotiation of (40Gb/s, Managed using MLNX-OS QoS / Management 10Gb/s, 1Gb/s) Data Rate: Data Rate 40Gb/s Regulatory Compliance EMC Safety: US/Canada: cTUVus... -
Page 52: China Ccc Warning Statement
Rev 1.3 China CCC Warning Statement Mellanox Technologies... - Page 53 When the SwitchX® device crosses this temperature, the firmware will automatically shut down the device. 3. Emergency – 130C In case the firmware fails to shut down the SwitchX® device upon crossing the Critical thresh- old, the SwitchX® device will auto-shutdown upon crossing the Emergency (130C) threshold. Mellanox Technologies...
-
Page 54: Appendix B Transferring The Power Cord
4. Push the cord end through the hole in the switch slide. Leave ~ 7” of cord hanging out from the hole. Figure 36: Put the Cord Through the Switch Slide Before Screwing it to the Switch 5. Screw the switch slides to the switch. Mellanox Technologies... -
Page 55: Figure 37: Screw The Switch Slide To The Switch
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 37: Screw the Switch Slide to the Switch Figure 38: Transfer Power Cord Finished 6. Return to step 2 on page 22 and continue the installation. Mellanox Technologies... -
Page 56: Appendix Cqsfp Interface
Receiver Inverted Data Output 3 Rx4p Receiver Non-Inverted Data Out- put 3 Ground ModPrsL Module Present IntL Interrupt Vcc Tx +3.3 V Power supply transmitter Vcc 1 +3.3 V Power Supply LPMode Low Power Mode Ground Tx3p Transmitter Non-Inverted Data Mellanox Technologies... -
Page 57: Figure 39: Qsfp Connector Male And Female Views
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Figure 39: QSFP Connector Male and Female Views 18.35 View into Rear of Connector 8.50 18.35 View into Front of Cage 8.50 Mellanox Technologies... -
Page 58: Appendix Drj-45 Console And Ethernet Interfaces
RJ45_RTS# RXD+ RJ45_DTR# TXD+ RJ-45_RTS# 1 RJ45_TXD RXD- TXD- RJ-45_DTR# 2 RJ45_RXD RXD+ RJ-45_TXD Pin 8 Looking into the Socket Bl/W RXD- RJ-45_RXD Br/W TXD+ Pin 1 TXD- RJ45_SDA RXD+ RXD- RJ45_SCL Pin 8 Looking into the Socket Mellanox Technologies... -
Page 59: Appendix E Replacement Parts Ordering Numbers
SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Appendix F: Replacement Parts Ordering Numbers Table 14 - Replacement Parts Ordering Numbers Part Description I2C DB9 or RJ-45 to USB Adapter MTUSB-1 Fan module with power supply side to connector side air flow... -
Page 60: Appendix F Avertissements De Sécurité D'installation (French)
6. Orages – dangers électriques Pendant un orage, il ne faut pas utiliser le matériel et il ne faut pas brancher ou débrancher les câbles. Mellanox Technologies... - Page 61 SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 7. Branchement/débranchement des câbles en cuivre Les câbles InfiniBand en cuivre sont lourds et ne sont pas flexibles, il faut donc faire très attention en les branchant et en les débranchant des connecteurs. Consultez le fab- ricant des câbles pour connaître les mises en garde et les instructions spéciales.
- Page 62 PRODUIT LASER DE CLASSE 1 » et références aux normes laser les plus récentes CEI 60 825-1:1993 + A1:1997 + A2:2001 et NE 60825-1:1994+A1:1996+ A2:2001 Mellanox Technologies...
- Page 63 SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 19. S’assurer que les enceintes sont appropriées Des enceintes électriques, mécaniques et incendie adaptées doivent être fournies par le fabricant du produit final ou par l’utilisateur final. 20. Cordons électriques CA homologués UL Pour les prises électriques en Amérique du Nord, choisissez un cordon électrique...
-
Page 64: Appendix G Installation - Sicherheitshinweise (German)
Anschlüsse angebracht bzw. davon getrennt werden. Lesen Sie die speziellen Warnun- gen und Anleitungen des Kabelherstellers. 7. Gafahr des elektrischen Schocks. Gafahr des elektrischen Schocks. Entferrnen des Netzsteckers elnes Netzteils spannungs- frei. Um alle Einhieten spannungsfrei zu machen sind die Netzstecker aller Netzteile zu entfernen Mellanox Technologies... - Page 65 SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 Risk of electric shock and energy hazard. The PSUs are all independent. Disconnect all power supplies to ensure a powered down state inside of the switch plat- form. 8. Rack-Montage und Wartung Wenn dieses Produkt in einem Rack montiert oder gewartet wird, sind besondere Vor- sichtsmaßnahmen zu ergreifen, um die Stabilität des Systems zu gewährleisten.
- Page 66 19. Zweipolige bzw. Neutralleiter-Sicherung im Netzteil Achtung: Zweipolige bzw. Neutralleiter-Sicherung im Netzteil. Netzstecker ziehen, um sicher- zustellen, daß keine Spannung am Gerät anliegt. Entfernen Sie alle Netzkabel vor dem Öffnen der Abdeckung dieses Produkts oder dem Berühren der Innenteile. Mellanox Technologies...
- Page 67 SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 20. Bodily Injury Due to Weight <40 lbs 70 - 121 lbs >121 lbs 40 - 70 lbs <18 kgs 32 - 55 kgs >55 kgs 18 - 32 kgs Use enough people to safely lift this product.
-
Page 68: Appendix H Advertencias De Seguridad Para La Instalación (Spanish)
6. Dos fusibles, uno en el polo y otro en el neutro Dos fusibles, uno en el polo y otro en el neutro. Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno. Mellanox Technologies... - Page 69 SwitchX 36-Port QSFP 40Gb/s Ethernet System Hardware User Manual Rev 1.3 7. Cuando hay rayos: peligro de descarga eléctrica No utilizar el equipo ni conectar o desconectar cables durante períodos de actividad de rayos. 8. Conexión y desconexión del cable Copper Dado que los cables de cobre son pesados y no son flexibles, su conexión a los conec-...
- Page 70 (EEE) se deben recolectar por separado y no se deben eliminar junto con residuos domésticos. Al deshacerse de este producto y de todas sus partes, hágalo de una manera respon- sable y respetuosa con el medio ambiente. Mellanox Technologies...
Need help?
Do you have a question about the SwitchX and is the answer not in the manual?
Questions and answers