Mellanox SX67X0 1U Switch Systems Hardware User Manual Rev. 1.0 www.mellanox.com...
Page 2
KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCTO(S) AND/OR THE SYSTEM USING IT. THEREFORE, MELLANOX TECHNOLOGIES CANNOT AND DOES NOT GUARANTEE OR WARRANT THAT THE PRODUCTS WILL OPERATE WITH THE HIGHEST QUALITY.
This icon indicates information that is helpful to the user. This icon indicates a situation that can potentially cause damage to hardware or soft- ware. BEWARE! This icon indicates a situation that can potentially cause personal injury or damage to hardware or software. Mellanox Technologies...
Introduction to Mellanox SX67X0 Systems Overview The SX67X0 systems provide the highest performing fabric solution in a 1U form factor by delivering up to 4Tb/s of non-blocking bandwidth with 200ns port-to-port latency. These systems are the industry's most cost-effective building blocks for embedded systems and storage with a need for low port density systems.
Introduction to Mellanox SX67X0 Systems Figure 2: SX6710/SX6720 Rear Side View Figure 3: SX6730 Rear Side View Speed and Switching Table 3 describes maximum throughput and interface speed per system model. Table 3 - Speed and Switching Capabilities 10GbE* SFP+...
Supplies (AC), x86 dual core, standard depth, rear to front airflow, Rail Kit, RoHS6 SX6730 MSX6730-FS2F2 SwitchX®-2 based FDR InfiniBand Switch NEBS certified, 36 QSFP ports, non- blocking switching capacity of 4Tbps, 2 Power Supplies (DC), Standard depth, Man- aged, rear to front airflow, Rail Kit must be purchased separately, RoHS6 Mellanox Technologies...
For Safety Warnings in Croatian see Section E.9, “Sigurnosna upozorenja za instaliranje (Croa- tian),” on page 77. For Safety Warnings in Italian see Section E.10, “Avvertenze di sicurezza per l’installazione (italiano),” on page 82. For Safety Warnings in Turkish see Section E.11, “Montaj Güvenlik Uyarıları (Türkçe),” on page 86. Mellanox Technologies...
Red latches are placed on the power inlet side. Power side inlet to connector side outlet. Blue latches are placed on the power inlet side. Figure 4: Air Flow Direction Marking - Power Side Inlet to Connector Side Outlet Mellanox Technologies...
For connection of the SX6730, a DC cable is required. Such a cable is not included in the basic package and should be ordered separately. If anything is damaged or missing, contact your sales representative at support@mella- nox.com. Mellanox Technologies...
Battery Backup Unit (BBU) Installation for SX6720 If the BBU is deformed, leaking, corroded or visually damaged, replace it immediately Do not use a BBU that was not provided by Mellanox Technologies • A BBU that has not been used for two years or longer past ts printed manufacturing date is unusable.
• 10x M6 Standard cage nuts¹ ² and 10x M6 Standard pan-head Phillips screws¹ (D) • 2x Phillips100 DEG F.H TYPE-I ST.ST 6-32 X 1/4 screw with around patch (E). ¹ Other threads are available by special order: M5, 10-32, 12-24 ² G-type cage-nut is available by special order. Mellanox Technologies...
Secure the chassis in the inner rails screwing the 2 flat head Phillips screws in the designated points. Figure 11: Mounting the Outer Rails into the Rack Figure 12: Attaching the Inner Rails to the Chassis Mellanox Technologies...
Step 3. Press on the locking spring (appears in red in Figure 16) on both sides simultaneously, and con- tinue pulling the unit towards you until it is fully removed. Mellanox Technologies...
A 40GbE port can be split to 4 (or less) 10GbE ports by using a Mellanox breakout cable. When using a port to split a data stream into four 10 Gb/s data streams and one of the other ports on the switch will be disabled and unmapped from the switch. Mellanox Technologies...
When using this feature you should log into the MLNX-OS® CLI and configure the individual ports to be ‘split-2’ or ‘split-4’. Not all ports can be split. For further information, refer to the MLNX-OS User Man- ual. Figure 18: Breakout or Fanout Cable 2.5.1.1 Splitting Options Mellanox Technologies...
Step 4. with normal operation (initially flashing and then moving to a steady color) as shown in Figure 19 below. For more information, refer to “LEDs” on page 30. Figure 19: System Status LEDs 5 Minutes After Power On Mellanox Technologies...
Mellanox Switch Mellanox configuration wizard Do you want to use the wizard for initial configuration? yes Step 1: Hostname? [my-switch] Step 2: Use DHCP on mgmt0 interface? [yes] no <localhost># In such case the serial connection should be used. Mellanox Technologies...
‘zeroconf’ configuration or not. If you enter ‘no’ (no Zeroconf), you must enter a static IP, and the session will continue. Step 3: Enable IPv6? [yes] The management interface will be able to use IPv6 addresses. Mellanox Technologies...
Page 27
To change an answer, enter the step number to return to or hit Note: <enter> to save changes and exit. To re-run the configuration wizard, run the command “configura- Choice: <Enter> tion jump-start” in Config mode. Configuration changes saved. Mellanox Technologies...
To change an answer, enter the step number to return to. Otherwise hit <enter> to save changes and exit. Choice: Configuration changes saved. To return to the wizard from the CLI, enter the “configuration jump-start” command from configure mode. Launching CLI... > Mellanox Technologies...
Set up an Ethernet connection between the system and a local network machine using a stan- Step 1. dard RJ45 connector. Start a remote secured shell (SSH) using the command: “ssh -l <username> <IP_address>”, Step 2. # ssh -l <username> <ip address> Mellanox Technologies...
Grasping the handle with your hand, push the latch release with your thumb while pulling the Step 2. handle outward. As the power supply unit unseats, the power supply unit status LEDs will turn off. Remove the power supply unit. Step 3. Mellanox Technologies...
Make sure that the fans have the air flow that matches the model number. An air flow opposite to the system design will cause the system to operate at a higher (less than optimal) temperature. For power supply unit air flow direction, refer to Section 2.2 on page 8 Mellanox Technologies...
The green Fan Status LED should light. If not, extract the fan unit and reinsert it. After system two unsuccessful attempts to install the fan unit, power off the before attempt- ing any system debug. Mellanox Technologies...
This interface is not found in externally managed systems. The port labeled “Console” is an RS232 serial port on the back side of the chassis that is used for initial configuration and debugging. Upon first installation of the system, you need to Mellanox Technologies...
DO NOT use a sharp pointed object such as a needle or a push pin for pressing the Reset button. Use a flat object to push the reset button. To reset the system and the CPU of its management board, perform the following: Mellanox Technologies...
Shows the health of the power supply units Green Bad Port LED lights up when a symbol error is detected on one Green of the ports. *Unit Identifier LED Lights up on command through the CLI *This function is currently disabled. Mellanox Technologies...
Mellanox representa- tive for assistance. 3.2.1.2 Fan Status LED All fans must be operating while the power supply is plugged in. Mellanox Technologies...
The fan unit should be replaced. System boot Risk of Electric Shock! With the fan module removed, power pins are accessible within the module cavity. DO NOT insert tools or body parts into the fan module cavity. Mellanox Technologies...
Table 15 - Power Supply Unit Status Front LED Assignments LED Behavior Description Action Required Solid Green Both of the power supplies are running nor- mally. Solid Red One or both of the power supplies are not The faulty FRUs should be replaced. operational. System boot Mellanox Technologies...
Error, one or more ports have received symbol Check symbol error counters on the sys- errors. tem UI to identify the ports. Possible causes are: Replace the cable on these ports. • Bad cable • Bad connection • Bad connector Mellanox Technologies...
Inventory Pull-out Tab The system’s inventory parameters (such as serial number, part number, GUID and MAC address) can be extracted from the Inventory pull-out tab on the lower right side of the front panel. Figure 28: Pull-out Tab Mellanox Technologies...
Fabric Inspector includes a complete set of InfiniBand tools for fabric wide diagnostics to check node-node and node-switch connectivity and to verify routes within the fabric. Advanced filtering allows creating filtering rules on a system wide basis, between nodes or port connections based on traffic patterns and user assigned system names (GUIDs). Mellanox Technologies...
SwitchX®-2 based managed systems. MLNX-OS® includes a CLI, WebUI, SNMP, system management software and IB management software (OpenSM). The Ethernet ports for remote management connect to Ethernet systems. These sys- tems must be configured to 100Mb/1 Gb auto-negotiation. Mellanox Technologies...
This state is indicative of a problem with the PSU. • Check/replace the power cable. • Replace the PSU if needed. The activity LED does not Make sure that there is an SM running in the fabric. light up (InfiniBand): Mellanox Technologies...
Page 45
Press enter to boot the selected image or 'p' to enter a password to unlock the next set of features. Highlighted entry is 0: " • Select previous image to boot by pressing an arrow key and choosing the appropriate image. Mellanox Technologies...
Specifications Specifications SX67X0 Series Table 20 - SX67X0 Specifications Feature Value Mechanical Size: Short - 1.716” (H) H x 16.85” (W) x16.8” (D), 43.6mm (H) x 428mm (W) x 428.9 mm (D) Standard - 1.716” (H) H x 16.85” (W) x24.75” (D), 43.6mm (H) x 428mm (W) x 722.3 mm (D) Mounting: 19”...
Power cord Type C13-C14 MTEF-FANF-A Fan module w/rear to front airflow fan for SX67X0/SX1710 switch systems MTEF-FANF-B Fan module w/rear to front airflow fan with Orange cap for SX67X0 switch systems MTEF-FANR-A Fan module w/front to rear airflow fan for SX67X0/SX1710 switch systems...
When the SwitchX®/SwitchX-2 device crosses this temperature, the firmware will automatically shut down the device. 3.Emergency – 130°C In case the firmware fails to shut down the SwitchX®/SwitchX-2 device upon crossing the Criti- cal threshold, the SwitchX® device will auto-shutdown upon crossing the Emergency (130°C) threshold. Mellanox Technologies...
Vcc Tx +3.3 V Power supply transmitter Vcc 1 +3.3 V Power Supply LPMode Low Power Mode Ground Tx3p Transmitter Non-Inverted Data Input Tx3n Transmitter Inverted Data Input Ground Tx1p Transmitter Non-Inverted Data Input Tx1n Transmitter Inverted Data Input Mellanox Technologies...
Not connected RJ45 to DB9 Harness Pinout In order to connect a host PC to the Console RJ45 port of the system, a RS232 harness cable (DB9 to RJ45) is supplied. Figure 30: RJ45 to DB9 Harness Pinout Mellanox Technologies...
(EEE) should be collected separately and not disposed of with regular household waste. Dispose of this product and all of its parts in a responsible and environmentally friendly way. Follow the instructions found at http://www.mellanox.com/page/dismantling_procedures for proper disassembly and disposal of the switch, according to the WEEE directive. Mellanox Technologies...
5. Over-temperature This equipment should not be operated in an area with an ambient temperature exceed- ing the maximum recommended: 45°C (113°F). Moreover, to guarantee proper , allow at least 8cm (3 inches) of clearance around the ventilation openings. Mellanox Technologies...
Page 54
When this product is mounted or serviced in a rack, special precautions must be taken to ensure that the system remains stable. In general you should fill the rack with equip- ment starting from the bottom to the top. Mellanox Technologies...
Page 55
For European connection, select a power supply cord that is internationally harmonized and marked “<HAR>”, 3 - conductor, minimum 1.0 mm wire, rated at 300 V, with a PVC insulated jacket. The cord must have a molded plug rated at 250 V, 10 A. Mellanox Technologies...
Page 56
Caution: Slide/rail mounted equipment is not to be used as a shelf or a work space. The rails are not intended for sliding the unit away from the rack. It is for permanent instal- lation at final resting place only, not used for service and maintenance Mellanox Technologies...
This unit is intended for connection to a TN power system and an IT power system of Norway only. 安裝安全性警告 (Chinese) 1. 安裝指示 本設備附有備援電源供應器或在適當位置配有空白蓋板。 2. 因重量導致的人身受傷 為了安全起見,請安排足夠的人員以合力抬起本產品。 <40 lbs 70 - 121 lbs >121 lbs 40 - 70 lbs <18 kgs 32 - 55 kgs >55 kgs 18 - 32 kgs 3. 重設備 本設備極重,應使用機械式起重機來搬移,以避免人員受傷。 Mellanox Technologies...
8 cm (3") autour des orifices de ventilation. 6. Châssis empilé sur d'autres équipements Le châssis ne doit pas être empilé sur d'autres équipements. S'il tombe, il peut endom- mager l'équipement ou entraîner des blessures. Mellanox Technologies...
Page 64
En règle générale, le rack doit être rempli en commençant par le bas. 13. Installation de l'équipement Cet équipement ne doit être installé, remplacé et maintenu que par un personnel formé et qualifié. Mellanox Technologies...
Page 65
300 V, avec une gaine isolante en PVC. Le cordon doit avoir une prise moulée 250 V 10 A. 19. Courant de fuite élevé Avertissement : courant de fuite élevé, une connexion à la terre est indispensable avant de brancher l'alimentation. Mellanox Technologies...
Page 66
électroniques (EEE) doivent être collectés séparément et ne pas être mis au rebut avec les déchets ménagers habituels. Ce produit et toutes ses pièces doivent être mis au rebut d'une manière responsable, respectant l'environnement. 25. Restrictions concernant l'alimentation pour la Norvège Mellanox Technologies...
8 cm (3 in.) Freiraum um die Belüftungsöffnungen sein, um einen einwandfreien Luftstrom zu gewährleisten. 6. Stapeln des Chassis Das Chassis sollte nicht auf andere Geräte gestapelt werden. Wenn das Chassis herun- terfällt, kann es zu Verletzungen und Beschädigungen an Geräten führen. Mellanox Technologies...
Page 68
Allgemeinen sollten Sie das Gestell von unten nach oben mit Geräten füllen. 11. Geräteinstallation Diese Gerät sollte nur von geschultem und qualifiziertem Personal installiert, ausge- tauscht oder gewartet werden. 12. Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestim- mungen erfolgen. Mellanox Technologies...
Page 69
19. Installationscodes Dieses Gerät muss installiert sein, entsprechend auf die neueste Version des Landes National Electrical Code. Für Nordamerika, müssen in Übereinstimmung mit den gel- tenden Vorschriften in der US-amerikanischen National Electrical Code und dem Canadian Electrical Code. Mellanox Technologies...
2. Lesión corporal a causa de peso .Recurra a suficientes personas para levantar este producto sin <40 lbs 70 - 121 lbs >121 lbs 40 - 70 lbs <18 kgs 32 - 55 kgs >55 kgs 18 - 32 kgs Mellanox Technologies...
Page 71
9. Tomas de alimentación múltiples Riesgo de descarga eléctrica y peligro de corriente. Todas las fuentes de alimentación son independientes. Desconecte todas las fuentes de alimentación, para asegurar que no haya corriente alguna dentro de la plataforma de conmutación. Mellanox Technologies...
Page 72
Este dispositivo se debe instalar conforme a la versión más reciente de los códigos eléctricos nacionales del país en cuestión. En América del Norte, el equipo se debe instalar de acuerdo con las disposiciones vigentes del Código Eléctrico Nacional de los EE.UU. y del Código Eléctrico de Canadá. Mellanox Technologies...
Page 73
Este dispositivo se debe instalar conforme a la versión más reciente de los códigos eléctricos nacionales del país en cuestión. En América del Norte, el equipo se debe instalar de acuerdo con las disposiciones vigentes del Código Eléctrico Nacional de los EE.UU. y del Código Eléctrico de Canadá. Mellanox Technologies...
2. Травмы при переносе тяжелых предметов Для поднятия этого изделия следует задействовать достаточное количество людей. <40 lbs 70 - 121 lbs >121 lbs 40 - 70 lbs <18 kgs 32 - 55 kgs >55 kgs 18 - 32 kgs Mellanox Technologies...
Page 75
нейтральном проводах. Открывать кожух этого изделия или касаться внутренних деталей можно только после отсоединения всех шнуров питания. Несколько источников питания Опасность поражения электрическим током и опасные энергетические воздействия. Блоки питания независимы друг от друга. Чтобы обесточить все компоненты внутри платформы коммутации, следует отсоединить все блоки питания. Mellanox Technologies...
Page 76
правилами установки электрооборудования. 16. Правила установки электрооборудования Это устройство устанавливается в соответствии с последним изданием национальных правил установки электрооборудования. В Северной Америке оборудование устанавливается в соответствии с действующими требованиями Национальных правил эксплуатации и обслуживания электрических установок США и Канады. Mellanox Technologies...
Page 77
телекоммуникационном центре или специальном помещении для компьютеров). 21. Правила установки электрооборудования Это устройство устанавливается в соответствии с последним изданием национальных правил установки электрооборудования. В Северной Америке оборудование устанавливается в соответствии с действующими требованиями Национальных правил эксплуатации и обслуживания электрических установок США и Канады. Mellanox Technologies...
Apelaţi la un număr suficient de persoane pentru a ridica în siguranţă acest produs. <40 lbs 70 - 121 lbs >121 lbs 40 - 70 lbs <18 kgs 32 - 55 kgs >55 kgs 18 - 32 kgs Mellanox Technologies...
Page 79
9. Multiple mufe electrice Risc de şoc electric şi pericol electric. Toate aparatele cu alimentare de la reţea sunt independente. Deconectaţi toate sursele de alimentare cu energie pentru a asigura decuplarea în inte- riorul platformei de comutare. Mellanox Technologies...
Page 80
Acest dispozitiv trebuie să fie instalat în conformitate cu ultima versiune a codurilor electrice naţionale ale ţării în cauză. Pentru America de Nord, echipamentul trebuie să fie instalat conform cerințelor aplicabile din Codul electric naţional al SUA şi Codul electric canadian. Mellanox Technologies...
Page 81
Acest dispozitiv trebuie să fie instalat în conformitate cu ultima versiune a codurilor electrice naţionale ale ţării în cauză. Pentru America de Nord, echipamentul trebuie să fie instalat conform cerințelor aplicabile din Codul electric naţional al SUA şi Codul electric canadian. Mellanox Technologies...
2. Tjelesne ozljede uslijed težine Kako biste sigurno podignuli ovaj proizvod, koristite dovoljan broj ljudi. <40 lbs 70 - 121 lbs >121 lbs 40 - 70 lbs <18 kgs 32 - 55 kgs >55 kgs 18 - 32 kgs Mellanox Technologies...
Page 83
9. Višestruki ulazi za napajanje Rizik od strujnog udara i opasnost od električne energije. PSU jedinice su neovisne. Odspojite sva napajanja kako biste osigurali stanje bez napajanja unutar platforme preklopnika. Mellanox Technologies...
Page 84
Ova oprema trebala bi se instalirati u skladu s lokalnim i nacionalnim električnim kodovima. 16. Instalacijski kodovi Ovaj se uređaj mora instalirati sukladno najnovijoj verziji nacionalnih električnih kodova države. U Sjevernoj Americi oprema se mora instalirati sukladno važećim zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code. Mellanox Technologies...
Page 85
21. Instalacijski kodovi Ovaj se uređaj mora instalirati sukladno najnovijoj verziji nacionalnih električnih kodova države. U Sjevernoj Americi oprema se mora instalirati sukladno važećim zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code. Mellanox Technologies...
Page 86
Sukladno WEEE direktivi 2002/96/EZ, sav električni i elektronički otpad (EEE) trebao bi se prikupljati zasebno i ne bi se trebao odlagati kao običan kućanski otpad. Odlaganje ovog proizvoda i svih njegovih dijelova vršite na odgovoran i ekološki način. Mellanox Technologies...
Questa apparecchiatura non va utilizzata in un’area con una temperatura ambiente superiore a quella massima consigliata: 45 °C (113 °F). Inoltre, per assicurare un flusso d’aria adeguato, lasciare almeno 8 cm (3 pollici) di spazio attorno alle aperture di ventilazione. Mellanox Technologies...
Page 88
Quando questo prodotto viene montato o sottoposto a manutenzione su un rack, è necessario adottare delle precauzioni speciali per assicurarsi che il sistema resti stabile. In generale, il rack va riempito con apparecchiature, procedendo dal basso verso l’alto. Mellanox Technologies...
Page 89
PVC. Il cavo deve disporre di una spina stampata di potenza nominale pari a 250 V, 10 A. 19. Corrente di dispersione elevata Avvertenza: corrente di dispersione elevata; il collegamento a terra è essenziale prima di collegare l’alimentazione. Mellanox Technologies...
Page 90
Secondo la direttiva RAEE 2002/96/EC, tutti i rifiuti da apparecchiature elettriche ed elettroniche (RAEE) vanno raccolti separatamente e non smaltiti nei normali rifiuti domestici. Smaltire questo prodotto e tutte le sue parti in modo responsabile e rispettoso dell’ambiente Mellanox Technologies...
8 cm (3 inç) açıklık bırakılmalıdır. 5. Aşırı ısınma Bu ekipman, önerilen maksimum ortam sıcaklığını aşan alanlarda çalıştırılmamalıdır: 45 °C (113 °F). Ayrıca, düzgün hava akışı sağlamak için havalandırma deliklerinin etrafında en az 8 cm (3 inç) açıklık bırakılmalıdır. Mellanox Technologies...
Page 92
önce bütün güç kablolarını çıkartın. 9. Çoklu Güç Girişleri Elektrik çarpması riski ve enerji tehlikesi. Bütün PSU'lar (Güç Kaynağı Üniteleri) ayrıdır. Anahtar platformundaki gücü kapatmak için tüm güç kaynaklarının bağlantılarını kesin. Mellanox Technologies...
Page 93
Bu ekipmanın montajında yerel ve ulusal elektrik kodlarına uyulması gerekir. 16. Montaj Kodları Bu cihazın, ülke ulusal elektrik kodlarının son sürümüne göre monte edilmesi gerekir. Kuzey Amerika için, ekipmanın ABD Ulusal Elektrik Kodu ve Kanada Elektrik Kodu'nun uygulama koşullarına göre monte edilmesi gerekir. Mellanox Technologies...
Page 94
özel görevli bilgisayar odası gibi). 21. Montaj Kodlarıi Bu cihazın, ülke ulusal elektrik kodlarının son sürümüne göre monte edilmesi gerekir. Kuzey Amerika için, ekipmanın ABD Ulusal Elektrik Kodu ve Kanada Elektrik Kodu'nun uygulama koşullarına göre monte edilmesi gerekir. Mellanox Technologies...
Page 95
(EEE) ayrı olarak toplanmalı ve evsel atıklarla birlikte çöpe atılmamalıdır. Bu ürün ve tüm parçaları çevreye dost ve sorumlu bir şekilde imha edilmelidir. 25. Norveç Güç Kısıtlamaları Bu ünite, bir TN güç sistemine ve sadece Norveç'in IT güç sistemine bağlanmak içindir. Mellanox Technologies...