Subscribe to Our Youtube Channel
Related Manuals for Mellanox Technologies SwitchX MT51336-EN-EVB
Summary of Contents for Mellanox Technologies SwitchX MT51336-EN-EVB
- Page 1 SwitchX® Evaluation Board Hardware User Manual PN: MT51336-EN-EVB, MT51336-VPI-EVB Rev 1.5 www.mellanox.com...
- Page 2 KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY.
-
Page 3: Table Of Contents
5.9 Disposal ..........49 Mellanox Technologies... - Page 4 Chapter 7 Troubleshooting ......... 54 Mellanox Technologies...
- Page 5 Figure 35: EVB Board Connections View 1 ........45 Mellanox Technologies...
- Page 6 Figure 41: Connector Pinout ..........61 Mellanox Technologies...
- Page 7 Table 12: RJ-45 Pinout ........... .63 Mellanox Technologies...
-
Page 8: Revision History
Fixed Figure 35 and Table 7 Added Power up sequence to Section 5.5 Added Appendix B Thermal Definitions Decision to include I2C power side interface Changes recommended by the field application engineers Added Internal I2C section Initial Release Mellanox Technologies... -
Page 9: Chapter 1 Overview
• FDR10 supports 20% more bandwidth over regular QDR using the same cables/connec- tors • All ports can be set to gateway ports connecting to 40GigE (over QSFP) or 1/10GigE (over QSA) • 4.032 Tb/s aggregate data switching capacity with ultra low latency Mellanox Technologies... -
Page 10: Management Cpu
• The blue one goes from the blue labeled connector on the EVBduaghter board to the blue label on the server side card included in the kit. Mellanox Technologies... -
Page 11: Pcie Extender Kit
Serial Number and Product Version Information The Serial number and GUID for the switch and the MAC for the Management PC are found on the pull out tab below the USB interface connection. Mellanox Technologies... -
Page 12: Figure 2: Pull Out Tab
Rev 1.5 Overview Figure 2: Pull Out Tab S/N: MT1117X00014 P/N: MT51336-EN-EVB Rev:A1 MAC: 0002C927051C Made in IL Mellanox Technologies... -
Page 13: Chapter 2 40 Gb/S Ethernet
10GigE/1GigE. Ports 1 and 2 and 35 and 36 are not connected to the chip. All ports are capable of virtual switching (VEPA+). All usable virtual switching ports are grouped together. The port protocol can only be obtained from the management interface. Mellanox Technologies... -
Page 14: Chapter 3 Fdr
FDR10 supports 20% more bandwidth over regular QDR using the same QSFP cables/connec- tors. Both FDR and FDR10 support Forward Error Correction (FEC), as described in IEEE 802.3ap chapter 74. FDR10 is only guaranteed to work with approved Mellanox ConnectX-3 adapters. Mellanox Technologies... -
Page 15: Chapter 4 Basic Operation And Installation
• 1 – power supply unit • 1 – I2C connector • various switch, port, fan and power status LEDs All connectivity except for power cords is via the connector side panel. All connectors can sup- port active cables. Mellanox Technologies... -
Page 16: Status Leds
If the STATUS LED shows red after three minutes, unplug the switch and call your Mellanox representative for assistance. If the switch shuts down due to over temperature, unplug the switch, wait 5 minutes and replug in the switch. For more information See “Troubleshooting” on page 54. Mellanox Technologies... -
Page 17: Figure 5: Power, Fan, And System Leds
Red — Major fault 4.1.1.3 Port Connector LED Assignment Above the ports are two LEDs one for the upper port and one for the lower port . The fol- lowing table shows the port status according to the LED indication. Mellanox Technologies... -
Page 18: Figure 7: Power Side Panel
The power supply unit (PSU) is located on the right side of the power side panel. The PSU has a single 2 color LED on the right side of the PSU, that indicates the internal status of the unit. Mellanox Technologies... -
Page 19: Figure 8: Psu Status Leds
Figure 9: Fan Status LED Connector Side This is a two color LED Green — OK Red — Major fault Off — No power to the system The LED indicator on the Fan Module is on the right side of the module. Mellanox Technologies... -
Page 20: Figure 10: Fan Status Led Power Side
For more information See “Troubleshooting” on page 54. 4.1.1.6 Bad Port LED The Bad Port indicator is located on the left side of the connector side panel of the unit. The following Bad Port conditions are possible: Mellanox Technologies... -
Page 21: Reset Button
4.1.1.7 UID LED Switch Identifier The UID LED is a debug feature that will become available to customers in the near future. For details please contact Mellanox Technologies support. 4.1.2 Reset Button On the connector side panel under the system LEDs is a reset button. -
Page 22: Qsfp Cable Power Budget Classification
One Trace and compliance pair 33, 35 One Trace and compliance pair 2, 4 One Trace and compliance pair 34, 36 Compliance Ports 3,4 Compliance Ports 33, 34 4.4.1.2 Top and Bottom Orientation Figure 13: Top and Bottom Ports Mellanox Technologies... -
Page 23: Management And Firmware Updating Interfaces
For the Socket pinout see “RJ-45 CONSOLE and Ethernet interfaces” on page 63. This connector will not work if the management module is removed. That is if you are using the PCIE/1GbE Extender. Mellanox Technologies... - Page 24 There is an I2C connector 3-pin type at connector number 19 on Figure 35 on page 45. Use the DB9 to 3-pin dongle (in the MTUSB-1 accessory kit) to connect to this primary 3-pin I2C con- nector on the board to have direct access to the chip. Connector number 20 on Figure 35 on Mellanox Technologies...
-
Page 25: Switch Platform Installation And Operation
4. Redundant Power Supply Connection - Electrical Hazard This product includes a blank cover over the space for the redundant power supply. Do not operate the product if the blank cover is not securely fastened or if it is removed. Mellanox Technologies... - Page 26 This equipment should be installed in compliance with local and national electrical codes. 11. Battery Replacement There is a risk of explosion should the battery be replaced with a battery of an incorrect type. Dispose of used batteries according to the instructions. Mellanox Technologies...
-
Page 27: Mechanical Installation
The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take pre- cautions to guarantee proper ventilation in order to maintain good airflow at ambient temperature. Cable routing in particular should not impede the air exhaust from the chassis. Mellanox Technologies... -
Page 28: Package Contents And Installation
If anything is damaged or missing, contact your customer representative immediately. 4.6.1 Installing the Switch in the Rack Tools and Customer Supplied Parts • Phillips Screwdrivers #1 and #2 • grounding screw • ESD strap • grounding wire sufficient to reach a valid ground. • ESD mat Mellanox Technologies... -
Page 29: Figure 15: Rack Rail Kit Parts
The distance between the rack and the door can be as little as 4 cm on one side of the rack and as much as 18 cm on the other side of the rack. Keep in mind that there can be as many as 36 cables connected to the switch. Mellanox Technologies... -
Page 30: Figure 16: Mounting Options
Support 3. Decide which mounting option you want to use. 4. Screw the switch slides onto the switch. Use 5 flat head screws for short switches and 7 screws for standard depth switches, to connect each switch slide. Mellanox Technologies... -
Page 31: Figure 17: Screwing On The Rail
7. Slide the rail into the rail slide. 8. Using two of the bolts for each corner install the rails and rail slides in the rack. Do not tighten the bolts yet. Mellanox Technologies... -
Page 32: Grounding The Switch
If so, connect a ground wire to one of the casing screws and connect the other end to a valid ground. If you choose to not use the ground screw, make sure that the rack is properly Mellanox Technologies... -
Page 33: Power Connections And Initial Power On
Power supply unit has directional air flow similar to the fan module. The Fan module airflow must coincide with the airflow of the PSU. If the PSU airflow direction is dif- ferent from the fan module airflow direction the system will shut down. Figure 20: Power Supply Unit Extraction Mellanox Latch Release Mellanox Technologies... -
Page 34: Cable Installation
After plugging in a cable, lock the connector using the latch- Mellanox Technologies... -
Page 35: Extracting And Inserting The Fan Unit
To extract a Fan Unit: 1. Using two fingers, push both latch releases towards each other simultaneously while pulling the fan module out of the switch. As the fan unseats, the fan status indicator will turn off. Mellanox Technologies... -
Page 36: Figure 24: Fan Module Latches
The green fan status indicator should light. If not, extract the fan unit and reinsert it. After two unsuccessful attempts to install the fan unit, power off the switch before attempting any system debug. Mellanox Technologies... -
Page 37: Chapter 5 Installing The Pcie/1Gbe Server Side Board
Ethernet connection. The interfaces are: Interface For PCIE clocking and reset of the PCI Express QSFP for connection to the server side board QSFP for connection to the server side board Interface For Ethernet RJ45 for remote Ethernet connection Mellanox Technologies... -
Page 38: Figure 25: Server Side Card
CX4 connector connection PCIE SERVER TX PCIE SERVER RX The PCB server board has 3 interfaces: Interface For PCIE clocking and reset QSFP for connection to the server side board QSFP for connection to the server side board Mellanox Technologies... -
Page 39: Removing The Top Cover
ESD strap is touching your skin and that the other end is connected to a verified ground. 2. Remove the 6 screws from the power side of the top. 3. Slide the top towards the power side. With the cover off you will need a clip on fan cooling the chip heat sink. Mellanox Technologies... -
Page 40: Figure 27: Screw Locations
Rev 1.5 Installing the PCIE/1GbE Server Side board Figure 27: Screw Locations Figure 28: Slide the Top Mellanox Technologies... -
Page 41: Removing The Management Cpu
SwitchX Switch EVB Hardware User Manual Rev 1.5 Removing the Management CPU Figure 29: Management Board Installed Figure 30: Unscrew the Management Board Mellanox Technologies... -
Page 42: Installing The Pcie/1Gbe Extender
ESD strap is touching your skin and that the other end is connected to a verified ground. 2. Put the connectors for the extender daughter board through the holes in the frame. Figure 32: Holes for the Extender Board Interfaces Set the connectors through these holes. Mellanox Technologies... -
Page 43: Figure 33: Install The Extender Board
Select only one of these two options. Either use the RJ45 Ethernet connection option or the PCIE option. DO NOT TRY AND USE BOTH OPTIONS AT THE SAME TIME! When running the SwitchX® EVB without the top cover use portable fans to keep the heat sinks cool. Mellanox Technologies... -
Page 44: Installing The Server Side Board
4. Connect the CX4 cable from the daughter board to the server board. 5. Tie down the cables using the cable ties in the EVB. 6. First power up the EVB and then power up the server. Mellanox Technologies... -
Page 45: Board Connectors Numbering And Locations
SwitchX Switch EVB Hardware User Manual Rev 1.5 Board Connectors Numbering and Locations Figure 35: EVB Board Connections View 1 Mellanox Technologies... -
Page 46: Table 7: Port Connector Numbering
SX HW Port 27 TX lane B Negative Mini SMP Data SX HW Port 27 TX lane C Positive Mini SMP Data SX HW Port 27 TX lane C Negative Mini SMP Data SX HW Port 27 TX lane D Positive Mellanox Technologies... - Page 47 Connects to Port 36, Ref to compliance port 34 Mini SMP Reference Connects to Port 36, Ref to compliance port 34 Mini SMP Reference Connects to Port 36, Ref to compliance port 34 Mini SMP Reference Connects to Port 36, Ref to compliance port 34 Mellanox Technologies...
-
Page 48: Switch Shut Down Procedure
To restart the switch you must physically go to the switch and unplug and replug in all of the power cords to the chassis. Disassembly of the Switch from the Rack To disassemble the switch from the rack: Mellanox Technologies... -
Page 49: Disposal
15 seconds the switch is reset and the password is deleted. The LEDs will flicker for a fraction of a second to indicate reset is occurring. You will then be able to enter without a password and make a new password for the user admin. Mellanox Technologies... -
Page 50: Configuring The Switch For The First Time
2. Configure a serial terminal program (for example, HyperTerminal, minicom, or Tera Term) on your host PC with the settings described in Table 8 Table 8 - Serial Terminal Program Configuration Parameter Setting Baud Rate 9600 Data bits Stop bits Mellanox Technologies... - Page 51 RX bytes: 1343502058 TX bytes: 313920869 RX packets: 17589211 TX packets: 992717 RX mcast packets: 0 TX discards: RX discards: TX errors: RX errors: TX overruns: RX overruns: TX carrier: RX frame: TX collisions: 0 TX queue len: 1000 Mellanox Technologies...
-
Page 52: Chapter 6 Connecting To The Switch Platform
Mellanox Firmware Tools (MFT) and documentation are available for download via http://www.mellanox.com mellanox.com > Products > Adapter IB/VPI SW > Firmware Tools. The MFT kit includes: • mlxburn • flint • spark • debug utilities See “Related Documentation” on page 7. Mellanox Technologies... -
Page 53: Updating Firmware
SwitchX® Switch systems. Click in the Table for the firmware image that you need. Be sure to read and follow all of the instructions regarding the updating of the firmware on your switch system. Firmware for the HCA cards connected to this switch system can be downloaded from the same site. Mellanox Technologies... -
Page 54: Chapter 7 Troubleshooting
The activity LED does not come on: Check that the Subnet Manager has been started. The switch is off: Unplug the switch. Wait 5 minutes. Plug in the switch. If the switch does not come on, check the power supplies. Mellanox Technologies... - Page 55 The switch is not working and unresponsive: Reset the switch. If resetting the switch does not work: Unplug the switch. Wait 5 minutes. Plug in the switch. If the switch does not come on, check the power supplies. Mellanox Technologies...
-
Page 56: Table 9: Specifications For Mt51336
182W – 5W/port Passive cables: 100W – 2.8W/port Typ@Typ: 40GigE Active Cables: 186W – 5.2 W/port Passive cables: 104W – 2.9 W/port Max@Max: 40GigE Active Cables: 224W – 6.2 W/port Passive cables: 119W – 3.3W/port Temperature: 0°C to 45°C Mellanox Technologies... - Page 57 At this temperature the firmware will automatically shut down the switch. Emergency –130 In case the firmware failed to shut down the SwitchX® when reaching the Critical threshold, a hardware mechanism will automatically shut down the switch at 130OC. Mellanox Technologies...
-
Page 58: Table 10: Replacement Parts Ordering Numbers
300W Power Supply w/ Connector side to Power Supply side air flow MSX60-PR Power cord Type C13-C14 ACC000500 Installation Kit for short switches in racks 40-60 cm deep MSX60-BKIT Installation Kit for short or standard switches in racks 60-80 cm deep MSX60-SKIT Mellanox Technologies... -
Page 59: Figure 38: Transfer Power Cord
3. Put the power cord in the switch slide channel. 4. Push the cord end through the hole in the switch slide. Leave ~ 7” of cord hanging out from the hole. 5. Screw the switch slides to the switch. Mellanox Technologies... -
Page 60: Figure 39: Install The Switch Slide
Rev 1.5 Figure 39: Install the Switch Slide Figure 40: Transfer Power Cord Finished 6. Return to step 4 on page 36 and continue the installation. Mellanox Technologies... -
Page 61: Figure 41: Connector Pinout
GBE1_MDI1+/ RX0+ GBE0_MDI1+/ RX0+ factory I2C1_CLK PCIe1_Rx2_p restore I2C0_CLK PCIe1_Tx2_p GP_LV I2C1_DAT GBE1_MDI0-/ PCIe1_Rx2_n TX0- 3.3V I2C0_DAT GBE0_MDI0-/ PCIe1_Tx2_n TX0- GP_HV PWR_OK GBE1_MDI0+/ TX0+ 3.3V USB_0_OC# GBE0_MDI0+/ TX0+ PCIe1_Rx1_p 3.3V PCIe1_Tx1_p Sys_Err INT1# 2.5VA_GBE PCIe1_Rx1_n USB0- 2.5VA_GBE PCIe1_Tx1_n Mellanox Technologies... - Page 62 GBE0_MDI3- 82 CPU_Present# PCIe1_Tx0_n GBE1_MDI3+ 83 RS232_TX GBE0_MDI3+ 84 CPU_TCK PCIE_CLK_REF1+ 115 PCIe0_Rx0_p RS232_DTR 56 PCIE_CLK_REF0+ 116 PCIe0_Tx0_p CPU_TMS GBE1_MDI2- 87 PCIE_CLK_REF1- 117 PCIe0_Rx0_n RS232_DSR 58 GBE0_MDI3- 88 PCIE_CLK_REF0- 118 PCIe0_Tx0_n SYS_HALT# 59 GBE1_MDI2+ 89 RS232_RTS GBE0_MDI3+ 90 Mellanox Technologies...
-
Page 63: Table 12: Rj-45 Pinout
G N D G N D G N D R X D - G N D G N D RJ45_SC L G N D G N D G N D P in 8 Looking into the S ocket Mellanox Technologies... - Page 64 6. Orages – dangers électriques Pendant un orage, il ne faut pas utiliser le matériel et il ne faut pas brancher ou débrancher les câbles. Mellanox Technologies...
- Page 65 12. Ajouter une information de connexion à la masse Connect a Valid Ground to this Device Avant de brancher l’appareil à la conduite d’alimentation, les vis de protection à la terre du terminal de l’appareil doivent être appliquées à l’installation de protection à la Terre du bâtiment. Mellanox Technologies...
- Page 66 PRODUIT LASER DE CLASSE 1 » et références aux normes laser les plus récentes CEI 60 825-1:1993 + A1:1997 + A2:2001 et NE 60825-1:1994+A1:1996+ A2:2001 Mellanox Technologies...
- Page 67 Conformément à la Directive WEEE 2002/96/EC, les déchets d'équipements élec- triques et électroniques (EEE) doivent être triés et ne peuvent être éliminés avec les déchets ménagers. Veuillez disposer de ce produit et de tous ses composants de manière responsable et respectueuse de l’environnement. Mellanox Technologies...
- Page 68 Anschlüsse angebracht bzw. davon getrennt werden. Lesen Sie die speziellen Warnun- gen und Anleitungen des Kabelherstellers. 7. Gafahr des elektrischen Schocks. Gafahr des elektrischen Schocks. Entferrnen des Netzsteckers elnes Netzteils span- nungsfrei. Um alle Einhieten spannungsfrei zu machen sind die Netzstecker aller Netz- teile zu entfernen Mellanox Technologies...
- Page 69 Achtung – Nutzung von Steuerungen oder Einstellungen oder Ausführung von Proze- duren, die hier nicht spezifiziert sind, kann zu gefährlichem Strahlenkontakt führen.. Klasse 1 Laserprodukt und Referenzen zu den aktuellsten Lasterstandards : ICE 60 825-1:1993 + A1:1997 + A2:2001 und EN 60825-1:1994+A1:1996+ A2:2001 Mellanox Technologies...
- Page 70 19. Zweipolige bzw. Neutralleiter-Sicherung im Netzteil Achtung: Zweipolige bzw. Neutralleiter-Sicherung im Netzteil. Netzstecker ziehen, um sicher- zustellen, daß keine Spannung am Gerät anliegt. Entfernen Sie alle Netzkabel vor dem Öffnen der Abdeckung dieses Produkts oder dem Berühren der Innenteile. Mellanox Technologies...
- Page 71 20. Bodily Injury Due to Weight Use enough people to safely lift this product. <40 lbs 70 - 121 lbs >121 lbs 40 - 70 lbs <18 kgs 32 - 55 kgs >55 kgs 18 - 32 kgs Mellanox Technologies...
- Page 72 6. Dos fusibles, uno en el polo y otro en el neutro Dos fusibles, uno en el polo y otro en el neutro. Quitar los cables de corriente antes de abrir la tapa de este producto o tocar cualquier componente interno. Mellanox Technologies...
- Page 73 12. Eliminación de equipos La eliminación definitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales. 13. Códigos eléctricos locales y nacionales Este equipo se debe instalar conforme a los códigos eléctricos locales y nacio- nales. Mellanox Technologies...
- Page 74 (EEE) se deben recolectar por separado y no se deben eliminar junto con residuos domésticos. Al deshacerse de este producto y de todas sus partes, hágalo de una manera respon- sable y respetuosa con el medio ambiente. Mellanox Technologies...
Need help?
Do you have a question about the SwitchX MT51336-EN-EVB and is the answer not in the manual?
Questions and answers