Related Manuals for Mellanox Technologies BridgeX BX5020 GT Series
Summary of Contents for Mellanox Technologies BridgeX BX5020 GT Series
- Page 1 ® BridgeX GT Series BX5020 Gateway IB to Ethernet User Manual P/N: MBX5020-1SFR Rev 1.4 www.mellanox.com...
- Page 2 THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT.
-
Page 3: Table Of Contents
2.4.9 Extracting and Inserting the Fan Unit Chapter 3 Management and Software 3.1 FabricIT Chapter 4 Troubleshooting Appendix A Specifications Appendix B EMC Certifications EMC Certifications Appendix C Interface Connector Pinouts SFP+ Interface RS232 to RJ45 Connector Interface Mellanox Technologies... - Page 4 Appendix D Replacement Parts Ordering Numbers Appendix E Avertissements de sécurité d’installation (French) Appendix F Installation - Sicherheitshinweise (German) Appendix G Advertencias de seguridad para la instalación (Spanish) Appendix H SFP+ Modules Product Features Applications Dimensions Pin Descriptions Power Dissipation Mellanox Technologies...
-
Page 5: List Of Tables
PSU Status LED Configurations Table 9: Port Connector LED Assignment Table 10: Air Flow Direction Table 11: Gateway and Installation Kit Options Table 12: BX5020-1S Specification Data Table 13: SFP+ Pinout Table 14: Replacement Parts Ordering Numbers Table 15: SFP+ Pinout Mellanox Technologies... -
Page 6: List Of Figures
Figure 26: RJ45 Connector Pinout Figure 27: I2C Pinouts Figure 28: QSFP Connector Pinout Figure 29: Pinout Looking Into the Rear of the Connector and the Front of the Cage Figure 30: Rear View of Module With Pin Placement Mellanox Technologies... -
Page 7: Revision History
Table 1 - Revision History Table Date Revision Description August 2011 Updated Power numbers Added Power as heat in BTUs/hr June 2011 Removed references to FC June 2011 Minor fixes Feb. 2011 New power numbers New I2C section Sept. 2010 Initial release Mellanox Technologies... -
Page 8: About This Manual
InfiniBand (IB) is used. Downlink refers to the Local Area Network (LAN) switch facing ports, where Ethernet (EN) are used. Caution: This symbol indicates the possibility of physical injury to the user or installer. Mellanox Technologies... -
Page 9: Gateway Products Covered In This User Manual
SFP+ downlink ports with CPU, RoHS6 Mellanox Part Numbering Legend Table 4 - Part Numbering Legend Place Field Decoder Mellanox Technologies System Type = BridgeX based Bridge System Gateway protocols 1 = Ethernet Uplinks 5 = InfiniBand Uplinks 9 = VPI (Ethernet and InfiniBand) Uplinks... -
Page 10: Chapter 1 Overview
Figure 1: MBX 5020 Gateway Mellanox MBX5020 MGT CONSOLE < D < A < B < C STATUS PSU 1 PSU 2 Port groups Product version information tab location Mellanox Technologies... -
Page 11: Features
• Jumbo Frames up to 9K support * This feature will be available to customers in the near future. Connectors and Cabling • SFP+ connectors for downlink 10GigE ports • Optical transceiver modules for SR and LR for Ethernet • Optical modules for FC Mellanox Technologies... -
Page 12: Serial Number And Product Version Information
QSFP uplink port and four SFP+ down link ports. Each gateway group can be inde- pendently configured. Within each gateway group, the QSFP uplink ports can be either 10Gbps, 20Gbps, or 40Gbps InfiniBand and the SFP+ downlink ports can be either 1Gbps or 10Gbps Ethernet. Mellanox Technologies... -
Page 13: Table 5: Bx5020 Gateway Port Grouping, Protocols And Speeds
Figure 4: Example of a Setup Showing a Port Group Ethernet Downlink MBX5020 MGT CONSOLE < A < B < C STATUS <D PSU 1 PSU 2 Gateway Uplink MTS3600 InfiniBand Switch QSFP Cable Mellanox Technologies... -
Page 14: Chapter 2 Installation And Basic Operation
When configured for Ethernet, only 3 of the 4 downlink ports per gateway group are used and all downlink ports within the gateway group must have the same speed, that is, 1Gbps or 10Gbps. See Table 5 for the port numbers of the active Ethernet ports. Mellanox Technologies... -
Page 15: Uplink Ports
Open the module’s locking mechanism– see Figure 7 and Figure 8. Make sure that the male connectors on the module will align with the female connectors inside of the cage. Also check that there is no dirt or foreign matter in the module or in the cage. Mellanox Technologies... -
Page 16: Status Leds
Status indicators are located on the right side of power side panel and on the left side of the con- nector (IB/ETH) side panel. Both of these system status indicators are three color LEDs, display- ing the same status on both sides of the gateway. The following status conditions are possible. Mellanox Technologies... -
Page 17: Table 6: System Status Led Configurations
Error –One or more fans is not operating properly. The system should be powered down and troubleshoot the fan module. Off – The fan unit is not receiving any power. Check that the fan unit is properly and completely inserted. Mellanox Technologies... -
Page 18: Table 8: Psu Status Led Configurations
“PSU1” and “PSU2”. Table 8 Shows the explanation of the PSU Status LED colors. Table 8 - PSU Status LED Configurations LED Configuration Fan LED Green OK – The Power supply is delivering the correct voltage. 12VDC Error – The PSU is not operational. Replace the PSU. Mellanox Technologies... -
Page 19: Port Connector Leds
DO NOT use a sharp pointed object such as needle or push pin for pressing the Reset button. Sharp objects can cause damage, use a flat object such as a paper clip. Mellanox Technologies... -
Page 20: Air Flow
9. On the PSUs and fan modules the air flow direction can be seen on the power side panel. Table 10 - Air Flow Direction Picture OPN Designation Description connector (IB/ETH) side inlet to power side outlet Mellanox Technologies... -
Page 21: Management Interfaces
The gateway has two Ethernet connectors. This Ethernet connection provides access for remote management. The BX series gateways can be connected to a network through the RJ45 connectors. There are two GigE connectors. Their MAC addresses can be found on the product version label Mellanox Technologies... -
Page 22: Package Contents
If the Gateway is powered off for any reason without using the proper shut down pro- cedure the Flash memory may be corrupted. If the Flash memory is corrupted the Gateway may fail to boot. Mellanox Technologies... -
Page 23: Installation Safety Warnings
5. During Lightning - Electrical Hazard During periods of lightning activity, do not work on the equipment or connect or dis- connect cables. Mellanox Technologies... - Page 24 Overcurrent Protection: A readily accessible Listed branch circuit overcurrent protec- tive device rated 20 A must be incorporated in the building wiring. 12. Equipment Installation This equipment should be installed, replaced, or serviced only by trained and qualified personnel. Mellanox Technologies...
- Page 25 According to the WEEE Directive 2002/96/EC, all waste electrical and electronic equipment (EEE) should be collected separately and not disposed of with regular household waste. Dispose of this product and all of its parts in a responsible and environmentally friendly way. Mellanox Technologies...
-
Page 26: Mechanical Installation
• ESD Strap • Grounding wire sufficient to reach a valid ground • ESD mat Parts included in the rail kit: • 2 rails • 18 recessed flat head screws • 2 rail slides • 8 caged nuts Mellanox Technologies... -
Page 27: Figure 14: Installation Kit Parts
If you need room to bring the power cord from the other side of the rack, recess the gateway and run the power cord through the bracket.The installation kit can be reversed so that the bracket can be installed on either side of the gate- way the power side or the connector (IB/ETH) side. Mellanox Technologies... -
Page 28: Figure 15: Making Room For The Power Cord
5 screws Clip 4 caged nuts into the holes in the rack you will be using to connect the rail slides. Check that both sides of the gateway, left and right, are the same level in the rack. Mellanox Technologies... -
Page 29: Figure 18: Clipping In The Caged Nuts
Ground the gateway. See Section 2.4.3 for grounding instructions. Plug in the power cord. You can start connecting all of the cables to the gateway. There is no On-Off switch on the gateway. The gateway will come on when one plug is plugged in. Mellanox Technologies... -
Page 30: Grounding The Gateway
2.4.4 Disassembling the Gateway from the Rack To disassemble the gateway from the rack: Put on an ESD strap and connect to a valid ground. Shut down the gateway using the procedure in Section 2.4.6. Mellanox Technologies... -
Page 31: Power Connections And Initial Power On
Caution: When turning off the gateway, use the proper shut down procedure (see Sec- tion 2.4.6) and make sure ALL LEDS are off to ensure a powered down status. Mellanox Technologies... -
Page 32: Shut Down Procedure
Make sure that the PSU that you are NOT replacing is showing all green, for both the PSU and status indicators. If your system does not have a redundant power supply, you must bring down the system before you replace the PSU. Mellanox Technologies... -
Page 33: Cable Installation
All cables can be inserted or removed with the unit powered on. To insert a cable, press the con- nector into the port receptacle until the connector is firmly seated. The indicator, above each port, will light green when the physical connection is established (that is, when the unit is powered on Mellanox Technologies... -
Page 34: Figure 23: Top And Bottom Ports
Cables for cable recommendations regarding Mellanox approved cables and recommended maxi- mum cable lengths. Cables in the bottom row should be inserted up side down in relation to the how the cables are inserted in the top row. Figure 23: Top and Bottom Ports Mellanox Technologies... -
Page 35: Extracting And Inserting The Fan Unit
PSU1 Mellanox Fan Unit Using two hands, push both latch releases in simultaneously while pulling the fan module out of the gateway. As the fan unseats, the fan status indicator will turn off. Pull the fan unit out. Mellanox Technologies... - Page 36 The green fan status indicator should light. If not, extract the fan unit and reinsert it. After two unsuccessful attempts to install the fan unit, power off the gateway before attempting any system debug. Mellanox Technologies...
-
Page 37: Chapter 3 Management And Software
FabricIT is a software based management system that can be run with either a command line inter- face or with a GUI interface. The GUI interface can be run through the Web. See the FabricIT BXM User Manual for instructions and commands available to manage the gate- ways, and fabric. Mellanox Technologies... -
Page 38: Chapter 4 Troubleshooting
Make sure that the latest FW version is installed on both the HCA/ NIC cards and the gate- way. If media adapters are used, check that the all connections are good, tight, and secure. The activity LED does not come on: t the Subnet Manager has been started. Check tha Mellanox Technologies... - Page 39 FLASH: 16 MB NAND: 1024 MiB PCI: Bus Dev VenId DevId Class Int PCIE0: link is not up. PCIE1: successfully set as root-complex 01 00 15b3 bd34 0c06 00 Net: ppc_4xx_eth0, ppc_4xx_eth1 Hit Ctrl+B to stop autoboot: 0 Mellanox FabricIT Mellanox Technologies...
- Page 40 Rev 1.4 Troubleshooting Boot Menu: 1. EFM_PPC_M460EX EFM_1.1.1000 2010-06-24 16:32:03 ppc 2. EFM_PPC_M460EX EFM_1.1.1200 2010-06-25 18 :00:03 ppc 3. U-Boot prompt Choice: Select the image to boot. Mellanox Technologies...
-
Page 41: Appendix A Specifications
IEEE 802.3ad Link Aggregation with LACP Environmental: EU: IEC 60068-2-64: Random IEEE 802.3x Flow Control (Per Priority Vibration Flow Control) EU: IEC 60068-2-29: Shocks, Virtual lanes support Type I / II Jumbo Frames support EU: IEC 60068-2-32: Fall Test Mellanox Technologies... - Page 42 Scalability and Performance Features Switching Perfor- Hot-Swappable: Fan Module and Power Sup- mance: Simultaneous wire-speed any port to any 1+1 Redundant: plies port Power Supplies Addressing: 48K Unicast Addresses Max. per Subnet Bridging Capacity 16K Multicast Addresses per Subnet 320Gb/s Mellanox Technologies...
-
Page 43: Appendix B Emc Certifications
Rev 1.4 Appendix B: EMC Certifications EMC Certifications The list of approved certifications per gateway in different regions of the world is located on the Mellanox Website at: www.mellanox.com/related-docs/user_manuals/Regulatory_and_Compliance_Guide.pdf EMC Statements are also in the Regulatory and Compliance Guide. Mellanox Technologies... -
Page 44: Appendix C Interface Connector Pinouts
No connection required VeeR Receiver Ground (Common with Transmitter Ground) VeeR Receiver Ground (Common with Transmitter Ground) Receiver Inverted DATA out. AC Coupled Receiver Non-inverted DATA out. AC Coupled VeeR Receiver Ground (Common with Transmitter Ground) VccR Receiver Power Supply Mellanox Technologies... - Page 45 MOD_ABS pulls line low to indicate module is plugged in. e. LOS is open collector output. Should be pulled up with 4.7kΩ – 10kΩ on host board to a voltage between 2.0V and 3.6V. Logic 0 indicates normal operation; logic 1 indicates loss of signal. Mellanox Technologies...
-
Page 46: Rs232 To Rj45 Connector Interface
Rev 1.4 RS232 to RJ45 Connector Interface Figure 26: RJ45 Connector Pinout CONSOLE TXD+ Pin 1 TXD- RJ45_RTS# RXD+ RJ45_DTR# RJ45_TXD RXD- RJ45_RXD Pin 8 Looking into the Socket Mellanox Technologies... -
Page 47: I2C Rj45 Connector Interface Pinout
Rev 1.4 I2C RJ45 Connector Interface Pinout Figure 27: I2C Pinouts TXD+ Pin 1 TXD- RJ45_SDA RXD+ RXD- RJ45_SCL Pin 8 Looking into the Socket Mellanox Technologies... -
Page 48: Qsfp Connector Pinout
Rev 1.4 QSFP Connector Pinout Figure 28: QSFP Connector Pinout Rx1n Rx2n Rx1p Rx2p Rx4n Rx3n Rx3p Rx4p ModPrsL IntL VccTx Vcc Rx Vcc1 ResetL LPMode ModSelL Tx3p Tx4p Tx3n Tx4n Tx1p Tx2p Tx1n Tx2n Mellanox Technologies... -
Page 49: Figure 29: Pinout Looking Into The Rear Of The Connector And The Front Of The Cage
Rev 1.4 Figure 29: Pinout Looking Into the Rear of the Connector and the Front of the Cage 18.35 View into Rear of Connector 8.50 18.35 View into Front of Cage 8.50 Mellanox Technologies... -
Page 50: Appendix D Replacement Parts Ordering Numbers
Power cord Type G for UK ACC000208 Power cord Type D for India ACC000209 Power cord Type I for China ACC000210 Power cord Type J for Switzerland ACC000211 Power cord Type B for Japan, ACC000212 Power cord Type I for Australia ACC000213 Mellanox Technologies... - Page 51 Rev 1.4 Mellanox Technologies...
-
Page 52: Appendix E Avertissements De Sécurité D'installation (French)
7. Montage et entretien sur baie Lorsque ce produit est monté ou entretenu sur baie, il faut prendre des précautions spé- ciales pour s’assurer que le système reste stable. En général, il faut remplir la baie avec du matériel de bas en haut. Mellanox Technologies... - Page 53 14. Codes d’installation INSTALLATION CODES L’appareil doit être installé selon l’ancienne version des codes électriques nationaux du pays. Pour l’Amérique du Nord, l’équipement doit être installé conformément aux spécifications du Code Electrique National Américain et du Code Electrique Canadien. Mellanox Technologies...
- Page 54 à 3 conducteurs, d’un diamètre de fil minimum de 0,75 mm2, d’une tension nominale de 300 V, avec une gaine isolée en PVC. Le cordon doit avoir une fiche moulée d’une tension nominale de 250 V et d’une intensité nominale de 10 A. Mellanox Technologies...
-
Page 55: Appendix F Installation - Sicherheitshinweise (German)
Rack-Montage und Wartung Wenn dieses Produkt in einem Rack montiert oder gewartet wird, sind besondere Vor- sichtsmaßnahmen zu ergreifen, um die Stabilität des Systems zu gewährleisten. Im Allgemeinen sollten Sie das Gestell von unten nach oben mit Geräten füllen. Mellanox Technologies... - Page 56 Für die europäischen Zusammenhang, wählen Sie ein Netzkabel, das international harmonisiert und der Aufschrift "<HAR>", 3 - Leiter, mindestens 0,75 mm2 Draht, bewertet mit 300 V, mit einem PVC-Mantel isoliert. Das Kabel muss eine angespritztem Stecker bewertet bei 250 V, 10 A. " Mellanox Technologies...
- Page 57 Kabel für den Anschluss an das Gerät RS232-und Ethernet-Schnittstellen müssen UL zertifiziert Typ DP-1 oder DP-2. (Hinweis-, wenn nicht mit Wohnsitz in LPS-Schal- tung) Überstromschutz: Eine leicht zugängliche Auflistung Abzweigleitung Überstrom- Schutzeinrichtung 20 A bewertet werden müssen in dem Gebäude Verkabelung. Mellanox Technologies...
-
Page 58: Appendix G Advertencias De Seguridad Para La Instalación (Spanish)
Dado que los cables de cobre InfiniBand son pesados y no son flexibles, su con- exión a los conectores y su desconexión se deben efectuar con mucho cuidado. Para ver advertencias o instrucciones especiales, consultar al fabricante del cable. Mellanox Technologies... - Page 59 300 voltios nominal, con cobertura protectora aislante de PVC. El cable debe tener un enchufe moldeado con capuchón de 250 voltios nominal, 10 A. ADVERTENCIA: Alta corriente de fuga. Es esencial efectuar la conexión a tierra antes de conectar la alimentación. Mellanox Technologies...
- Page 60 Precaución: el uso de controles o ajustes o la realización de procedimientos distintos de los que aquí se especifican podrían causar exposición a niveles de radiación peligrosos. PRODUCTO LÁSER DE CLASE 1 y referencia a las normas de láser más recientes: IEC 60825-1:2007/03 y EN 60825-1:2007 Mellanox Technologies...
- Page 61 (EEE) se deben recolectar por separado y no se deben eliminar junto con residuos domésticos. Al deshacerse de este producto y de todas sus partes, hágalo de una manera responsable y respetuosa con el medio ambiente. Mellanox Technologies...
-
Page 62: Appendix H Sfp+ Modules
• Uncooled 850nm VCSEL laser • Receiver limiting electrical interface • Duplex LC connector • Built-in digital diagnostic functions • RoHS-6 compliant (lead-free) Applications • 10GBASE-SR/SW 10G Ethernet Dimensions 56.50 Mellanox Technologies 13.60 14.80 13.70 MTSFPP-SR Module 1.55 0.50 13.90 8.50 11.85... -
Page 63: Pin Descriptions
2-wire Serial Interface Clock Line MOD_ABS Module Absent. Grounded within the module No connection required RX_LOS Loss of Signal indication. Logic 0 indicates normal operation. No connection required VeeR Receiver Ground (Common with Transmitter Ground) VeeR Receiver Ground (Common with Transmitter Ground) Mellanox Technologies... -
Page 64: Power Dissipation
LOS is open collector output. Should be pulled up with 4.7kΩ – 10kΩ on host board to a voltage between 2.0V and 3.6V. Logic 0 indicates normal operation; logic 1 indicates loss of signal. Power Dissipation Max power dissipation 1.00 W Mellanox Technologies...