Page 2
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY.
Page 4
Appendix F Installation - Sicherheitshinweise (German) ....68 Appendix G Advertencias de seguridad para la instalación (Spanish) ..71 Mellanox Technologies Arrow.com.
Mellanox MLNX-OS® SwitchX®-2 This document contains information regarding configuring and manag- Software User Manual SwitchX®-2 ing Mellanox Technologies' Switch Platforms. MLNX-OS® Software Command Ref- Command Reference Guide for MLNX-OS® listing all of the commands erence Guide available through MLNX-OS®...
Abbreviations FDR — Fourteen Data Rate – Used to indicate a 4X port running at 56Gb/s Mellanox Part Numbering Legend Place Field Decoder Mellanox Technologies System Type SwitchX® switch Family Data Transfer Protocol 6 = InfiniBand Size of box 0 = 1U 1 = 1.5U...
On managed switches only, the MAC for the Management PC is also on this tab. This MAC is for the mgmt0 management interface (the top Ethernet port). The second interface mgmt1 has the next consecutive MAC. Externally managed switches do not have a MAC on the tab. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Both FDR and FDR10 support Forward Error Correction (FEC), as described in IEEE 802.3ap chapter 74. FDR and FDR10 are only guaranteed to work with approved Mellanox Cables. FDR10 is only guaranteed to work with approved Mellanox ConnectX®-3 adapters. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
RS232 cable DB9 to RJ-45 included in the box to connect to host PC for ini- Managed tial configuration of the switch. After initial configuration, the switch can be managed through the Ethernet port using a remote connection. Gateway functionality is not supported in the externally managed SwitchX® switches. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
System Status Indicators The System Status Indicators are located to the left of the connectors on the connector side panel, and on the power side at the far right. Both of these LEDs give identical information. Mellanox Technologies Arrow.com. Arrow.com.
PS unit is installed in the switch, the PS2 LED will be off • the FAN LED should light up green. If the FAN LED shows red, troubleshoot the fan module. See “Troubleshooting” on page 51. Mellanox Technologies Arrow.com. Arrow.com.
Major Error – Possible damage can result to the switch. Turn off immediately. e.g. bad firmware, can’t boot, overheated. If the system is booting up, it can take up to 5 minutes for the status led to change to green. Off – The system has no power. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Error – One or more fans is not operating properly. The system should be powered down and troubleshoot the fan module. Off – The fan unit is not receiving any power. Check that the fan unit is properly and completely inserted. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
The primary power supply unit (PS1) is located on the right side of the power side panel, with PS2 on the left side. Each PS unit has a single 2 color LED on the right side of the PS unit, that indicates the internal status of the unit. Mellanox Technologies Arrow.com. Arrow.com.
Figure 13: Bad Port LED This is a one color LED The Bad Port indicator is located on the left side of the connector side panel of the unit. Table 7 shows the fan status LED assignment. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
LED Configuration LED Description Physical link is down / Default. Solid Green Physical link is up with no traffic. Flashing Green Physical link is up with traffic. Flashing Orange Physical errors. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
9.On the PS unit and fan modules the air flow direction can be seen on the power side panel. All components need to have the same air flow. A mismatch in the air flow will affect the heat dissipation. All PS units must have the same air flow as the fan module. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
These air flow labels must be the same. Any mismatch of these labels will affect the switch temperature. Table 10 shows the icons that indicate airflow using arrows and colors. All components need the same colored airflow icons. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Port Connector Interfaces The connector side of the switch has 18 QSFP ports. These are placed in one row. The ports are labelled from 1 to 18. Figure 17: Port Numbering 9 10 Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
A harness is included in the package to connect to a DB9 connection on a host PC. Connecting to a local host PC and following the instructions in the Installation Guide, “Configuring the Switch for the First Time”, must be done before any remote Mellanox Technologies Arrow.com. Arrow.com.
Page 24
This connector can be used to install firmware upgrades, should Debug and Troubleshooting only. the firmware image be damaged and cannot be upgraded through a host PC or remotely. This interface is for support personnel and advanced users only. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Sharp objects can cause damage, use a flat object to push the reset button. Figure 21: Reset Button Press the reset button to reset the main and management CPUs and to delete the existing password. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Page 26
You will then be able to enter without a pass- word and make a new password for the user “admin”. In the externally managed switches the reset button resets the CPU of the switch device. Mellanox Technologies Arrow.com. Arrow.com.
5. Redundant Power Supply Connection - Electrical Hazard This product includes a blank cover over the space for the redundant power supply. Do not operate the product if the blank cover is not securely fastened or if it is removed. Mellanox Technologies Arrow.com. Arrow.com.
Page 28
Caution – Use of controls or adjustment or performance of procedures other than those specified herein may result in hazardous radiation exposure. CLASS 1 LASER PRODUCT and reference to the most recent laser standards: IEC 60 825-1:1993 + A1:1997 + A2:2001 and EN 60825-1:1994+A1:1996+ A2:2001 Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
The installation kit is shipped separately. Check the parts for visible damage that may have occurred during shipping. The switch comes packed with the following items: Mellanox Technologies Arrow.com. Arrow.com.
Test the ground using an Ohm meter. Some national and/or local codes may require IT components to be bonded and exter- nally grounded (not including the power cord ground). You must follow all national and local codes when installing this equipment. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Pour isoler completement le Netzstecker aller Netzteile module en cause, Il faut zu entfernen de’brancher toutes les alimen- tations stabilise’es. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Rev 1.1 Installation Battery Replacement Mellanox Technologies does not support battery replacement. Customer removal of the switch cover will void the warrantee. Only Remove the cover to comply with WEEE directives or to dis- assemble for environmentally approved disposal. Customer removal of the switch cover will void the warrantee.
3. Login (from a serial terminal program) as admin and use admin as password. This starts the Mellanox configuration wizard. 4. Go through the Mellanox configuration wizard. Table 12 shows an example of a wizard ses- sion. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Otherwise hit <enter> to save changes and exit. Choice: <Enter> Configuration changes saved. To return to the wizard from the CLI, enter the “configuration jump-start” command from con- figuration mode. Launching CLI... <switch name> Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Otherwise hit <enter> to save changes and exit. Choice: Configuration changes saved. To return to the wizard from the CLI, enter the "configuration jump-start" command from configure mode. Launching CLI... <switch name> [standalone: master] > Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
5. Before attempting a remote (for example, SSH) connection to the switch, check the mgmt0 interface configuration. Specifically, verify the existence of an IP address. To check the cur- rent mgmt0 configuration, enter the following commands: Mellanox Technologies Arrow.com. Arrow.com.
This page will need a support login and password. Rerunning the Wizard If you want to rerun the wizard run the following commands: sx-43 [standalone: master] > enable sx-43 [standalone: master]# configure terminal sx-43 [standalone: master] (config) # configuration jump-start Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Figure 26: Power Supply Unit Extraction Push Here Latch release If you are not immediately installing a new PSU you must install a blank so that the air flow for cooling the switch is not compromised. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
45° Celsius. This unit is intended for installation in a Restricted Access Location. A restricted access area can be accessed only through the use of a special tool, lock and key, or other means of security. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
These two latches must be pushed towards each other at the same time while the module is pulled out. To insert a FAN Unit: 1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Page 42
The green fan status indicator should light. If not, extract the fan unit and reinsert it. After two unsuccessful attempts to install the fan unit, power off the switch before attempting any system debug. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Figure 31: SX6018 Port Splitting Options This port can be split into 4 10Gb/s SFP+ This port can be split into 2 10Gb/s SFP+ The maximum 10 Gb/s Ethernet ports configurable with this switch is 56. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Care should be taken not to impede the air flow through the ventilation holes next to the connec- tor ports. Cable lengths should be used which allow for routing horizontally around to the side of the chassis before bending upward or downward in the rack. Mellanox Technologies Arrow.com. Arrow.com.
To shut down the switch run the command: Reload halt [noconfirm] The switch cannot be restarted remotely! To restart the switch you must physically go to the switch and unplug and plug in the power cord. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
You will then be able to enter without a pass- word and make a new password for the user “admin”. In the externally managed switches the reset button resets the CPU of the switch device. Mellanox Technologies Arrow.com. Arrow.com.
• Upgrading software • Monitoring of: • AC power to the PSUs • DC power out from the PSUs • Board temperature • Fan module status • Chassis failures Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
All firmware updates should be done in-band. Go to the Mellanox Website and confirm that the firmware is the latest. If not, reburn the latest firmware from the download site. New firmware Mellanox Technologies Arrow.com. Arrow.com.
Page 50
The externally managed switches are Plug and Play and all firmware updates should be done in-band. This interface is for Debug and Troubleshooting only. This interface is for FAEs and advanced users only. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
When running IB check that the Subnet Manager has been started. The switch is off: Issue 7. Unplug the switch. Wait 5 minutes. Plug in the switch. If the switch does not come on, check the power supplies. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
TYP: 1.5W Non-operating -40° to 70° Celsius Shock and Humidity: Shock and Vibration: ETSI EN 300 019-2-2: 1999-09 Operating 5% - 95% non-condensing Vibration/ Humidity Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Page 55
Simultaneous wire-speed any port Capacity: 2.02Tb/s Performance / Capacity to any port Reliability, Availability and Serviceability Features Hot-Swappable: Fan Module Hot swapability / Redundancy 1+1 Redundant: Power Supplies Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
EMC Certifications The list of approved certifications per switch in different regions of the world is located on the Mellanox Website at: http://www.mellanox.com/related-docs/user_manuals/Regulatory_and_Compliance_Guide.pdf EMC statements are also in the Regulatory and Compliance Guide. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Page 59
3. Emergency – 130C In case the firmware fails to shut down the SwitchX® device upon crossing the Critical thresh- old, the SwitchX® device will auto-shutdown upon crossing the Emergency (130C) threshold. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
SwitchX®-2 18-Port QSFP FDR InfiniBand System Hardware User Manual Rev 1.0 Figure 32: QSFP Connector Male and Female Views 18.35 View into Rear of Connector 8.50 18.35 View into Front of Cage 8.50 Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
MSX60-FR 300W Power Supply w/ Power Supply Side to Connector side air flow MSX60-PF 300W Power Supply w/ Connector side to Power Supply side air flow MSX60-PR Power cord Type C13-C14 ACC000500 Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Les câbles InfiniBand en cuivre sont lourds et ne sont pas flexibles, il faut donc faire très attention en les branchant et en les débranchant des connecteurs. Consultez le fab- ricant des câbles pour connaître les mises en garde et les instructions spéciales. Mellanox Technologies Arrow.com. Arrow.com.
Page 65
Ce matériel ne doit être installé, remplacé ou entretenu que par du personnel formé et qualifié. 14. Elimination du matériel L’élimination de ce matériel doit s’effectuer dans le respect de toutes les législations et réglementations nationales en vigueur. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Page 66
à 3 conducteurs, d’un diamètre de fil minimum de 0,75 mm2, d’une tension nominale de 300 V, avec une gaine isolée en PVC. Le cordon doit avoir une fiche moulée d’une tension nominale de 250 V et d’une intensité nominale de 10 A. Mellanox Technologies Arrow.com. Arrow.com.
Page 67
Conformément à la Directive WEEE 2002/96/EC, les déchets d'équipements élec- triques et électroniques (EEE) doivent être triés et ne peuvent être éliminés avec les déchets ménagers. Veuillez disposer de ce produit et de tous ses composants de manière responsable et respectueuse de l’environnement. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Um alle Einhieten spannungsfrei zu machen sind die Netzstecker aller Netz- teile zu entfernen Risk of electric shock and energy hazard. The PSUs are all independent. Disconnect all power supplies to ensure a powered down state inside of the switch platform. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Page 69
Für die europäischen Zusammenhang, wählen Sie ein Netzkabel, das international harmonisiert und der Aufschrift "<HAR>", 3 - Leiter, mindestens 0,75 mm2 Draht, bewertet mit 300 V, mit einem PVC-Mantel isoliert. Das Kabel muss eine angespritztem Stecker bewertet bei 250 V, 10 A. " Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
6. Dos fusibles, uno en el polo y otro en el neutro Dos fusibles, uno en el polo y otro en el neutro. Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno. Mellanox Technologies Arrow.com. Arrow.com.
Page 72
La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales. 13. Códigos eléctricos locales y nacionales Este equipo se debe instalar conforme a los códigos eléctricos locales y nacio- nales. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com. Arrow.com.
Page 73
(EEE) se deben recolectar por separado y no se deben eliminar junto con residuos domésticos. Al deshacerse de este producto y de todas sus partes, hágalo de una manera respon- sable y respetuosa con el medio ambiente. Mellanox Technologies Arrow.com. Arrow.com. Arrow.com.
Need help?
Do you have a question about the SwitchX-2 MSX6018F-1SFS and is the answer not in the manual?
Questions and answers