Page 1 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 2: Table Of Contents
Table of contents Table of contents Introduction Introduction Installation Installation QM9700/QM9790 Tool-Less Rail Kit QM9700/QM9790 Tool-Less Rail Kit QM9701 Tool-Less Rail Kit QM9701 Tool-Less Rail Kit Cable Installation Cable Installation Initial Power On Initial Power On System Bring-Up of Managed Systems System Bring-Up of Managed Systems FRU Replacements FRU Replacements...
Page 3 Relevant for Models: QM9700, QM9790 and QM9701 This manual describes the installation and basic use of the NVIDIA 1U NDR In niBand switch systems based on the NVIDIA Quantum™-2 switch ASIC. This manual is intended for IT managers and system administrators.
Page 4 System Model NVIDIA SKU QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 5 System Model NVIDIA SKU 920-9B210-00RN-0M2 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 6 System Model NVIDIA SKU QM9701 920-9B210-00RN-0M6 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 7 System Model NVIDIA SKU QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 8 System Model NVIDIA SKU QM9790 920-9B210-00FN-0D0 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 9 System Model NVIDIA SKU QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 10 System Model NVIDIA SKU 920-9B210-00RN-0D0 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 11 System Model NVIDIA SKU Related Documentation Document Description In niBand Architecture The In niBand Trade Association (IBTA) In niBand® Speci cation Speci cation at https://www.in nibandta.org. Volume 1 Release 1.5 MLNX-OS® User Manual This document contains information regarding the con guration and management of the MLNX-OS® software.
Page 12 Document Description https://www.nvidia.com/en-us/networking/ethernet/switch- software/. Visit https://academy.nvidia.com/en/in niband-customized- Hands-on workshops training/. For any tailor-made service, contact: nbu-services- On-site/remote services sales@nvidia.com. Revision History A list of the changes made to this document are provided in Document Revision History. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 13: Introduction
Today’s complex research demands ultra-fast processing of high-resolution simulations, extreme-size datasets, and complex, highly parallelized algorithms that need to exchange information in real time. The QM9700 NDR In niBand switches extend NVIDIA In-Network Computing technologies and introduce the third generation of NVIDIA SHARP technology, SHARPv3.
Page 14: Speed And Switching Capabilities
monitor, manage, preventatively troubleshoot, and maintain the modern data center fabric, to realize higher utilization and reduce overall opex. Front View QM9700 QM9701 QM9790 Rear View QM9700 and QM9790 QM9701 For additional air ow options, see Air ow. Speed and Switching Capabilities The table below describes maximum throughput and interface speed per system model.
Page 15: Management Interfaces, Psus And Fans
Certi cations The list of certi cations (such as EMC, Safety and others) per system for di erent regions of the world is located on the NVIDIA page at https://www.nvidia.com/en- us/networking/environmental-and-regulatory-compliance/. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 16: Installation
Installation System Installation and Initialization Installation and initialization of the system require attention to the normal mechanical, power, and thermal precautions for rack-mounted equipment. Note The rack mounting holes conform to the EIA-310 standard for 19-inch racks. Take precautions to guarantee proper ventilation in order to maintain good air ow at ambient temperature.
Page 17 170557766215 7-api-v2.png Note Unless otherwise speci ed, NVIDIA products are designed to work in an environmentally controlled data center with low levels of gaseous and dust (particulate) contamination. The operation environment should meet severity level G1 as per ISA 71.04 for gaseous contamination and ISO 14644-1 class 8...
Page 18: Safety Warnings
Procedure 19" System Mounting Mount the system into a rack enclosure Options Power on the system Initial Power On System Bring-Up of Perform system bring-up Managed Systems Install FRU Replacements, if needed FRU Replacements Safety Warnings Prior to the installation, please review the Safety Warnings. Note that some warnings may not apply to all models.
Page 19 Heavy Equipment This equipment is heavy and should be moved using a mechanical lift to avoid injuries. Risk of Electric Shock! With the fan module removed power pins are accessible within the module cavity. Do not insert tools or body parts into the fan module cavity. For AC powered switch systems: Disconnecting one power supply only disconnects one module.
Page 20 Redundant Power Supply Connection (OPTIONAL)—Electrical Hazard This product includes a redundant power or a blank in its place. In case of a blank power supply, do not operate the product with the blank cover removed or not securely fastened. Double Pole/Neutral Fusing This system has double pole/neutral fusing.
Page 21 Local and National Electrical Codes This equipment should be installed in compliance with local and national electrical codes. Installation Codes This device must be installed according to the latest version of the country national electrical codes. For North America, equipment must be installed in accordance to the applicable requirements in the US National Electrical Code and the Canadian Electrical Code.
Page 22 Overcurrent Protection A readily accessible Listed branch circuit overcurrent protective device rated 20 A must be incorporated in the building wiring. Acoustic Level Warning The acoustic level listed in Speci cations section represents product noise measured in accordance with ISO 7779 under nominal conditions. The actual noise level can vary depending on the installation conditions, including but not limited to the number of racks in the installation, the overall installation size, rack and other equipment material and noise levels, fan faults, room temperature, room con guration, and employee location in...
Page 23: Nordic Countries Notices
Taiwan RoHS Declaration - Gateway Systems Taiwan BSMI Class A Statement - Warning to the User! ，。 Nordic Countries Notices In Finland: "Laite on liitettävä suojakoskettimilla varustettuun pistorasiaan" QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 24 In Norway: "Apparatet må tilkoples jordet stikkontakt" In Sweden: "Apparaten skall anslutas till jordat uttag" (Simpli ed Chinese) 。，。，，。，。。高高。，，。 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 25 。，。。，，。。，。。。，。，。，。。、。。。 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 26 ，。，，。，。，。。 [ 16 AWG] ，、、， 125 V [ 13 A] 、，，。 <HAR> ，、、面， 300 V 250 V, 10 A ，。，...
Page 27 音 ISO 7779 音音。音，、、音、风、、 OSHA 。，，音，音。。。，。 WEEE WEEE 2002/96/EC (EEE) ，，，。。。 China CCC Warning Statement QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 28 Taiwan RoHS Declaration - Switch Systems QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 29 Taiwan RoHS Declaration - Gateway Systems Taiwan BSMI Class A Statement - Warning to the User! ，。 Caution: Risk of Explosion A risk of explosion exists, if the battery is replaced with an incorrect type. Dispose of used batteries according to the instructions. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 30 。。。。。。 (Chinese) 。，。，，。风，。风。高高。，，风。。，。 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 31 。，。，。。。，。，。。，须预。顶。、。。。 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 32 ，。，，。，。，。。 [16AWG] ，，额 125 V [ 13 A] 、，，。 <HAR> -3 ，、面 300 V 250 V, ，额，。，额 10 A 。...
Page 33 ISO 7779 音音。音，、、音、风、、 OSHA 。，，音，音。。。，。 WEEE WEEE 2002/96/EC (EEE) ，，，。。。 China CCC Warning Statement QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 34 Taiwan RoHS Declaration - Switch Systems QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 35 Taiwan RoHS Declaration - Gateway Systems Taiwan BSMI Class A Statement - Warning to the User! ，。 Caution: Risk of Explosion A risk of explosion exists, if the battery is replaced with an incorrect type. Dispose of used batteries according to the instructions. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 36: Avertissements De Sécurité Pour L'installation (French)
。。。。。。 Avertissements de sécurité pour l'installation (French) Instructions d'installation Veuillez lire la totalité des instructions d'installation avant de relier l'équipement au secteur. Blessures à cause du poids Prévoyez assez de personnel pour soulever ce produit en toute sécurité. Équipement lourd Cet équipement est lourd et doit être déplacé...
Page 37 Le châssis ne doit pas être empilé sur d'autres équipements. S'il tombe, il peut endommager l'équipement ou entraîner des blessures. Connexion de l'alimentation redondante : danger d'électrocution Ce produit est équipé d'une alimentation redondante ou d'un cache si elle est absente. Dans ce dernier cas, ne pas faire fonctionner le produit si le cache est retiré...
Page 38 Cet équipement ne doit être installé, remplacé et maintenu que par un personnel formé et quali é. Mise au rebut de l'équipement La mise au rebut de cet équipement doit se faire conformément à toutes les lois et réglementations nationales. Codes électriques locaux et nationaux Cet équipement doit être installé...
Page 39 Codes d'installation Cet appareil doit être installé conformément à la version la plus récente des codes électrique nationaux. En Amérique du Nord, l'équipement doit être installé en respectant les exigences de l'US National Electrical Code et du Code canadien de l'électricité.
Page 40: Installation Sicherheitshinweise (German)
Selon la Directive 2002/96/CE (DEEE), tous les déchets d'équipements électriques et électroniques (EEE) doivent être collectés séparément et ne pas être mis au rebut avec les déchets ménagers habituels. Ce produit et toutes ses pièces doivent être mis au rebut d'une manière responsable, respectant l'environnement. Restrictions concernant l'alimentation pour la Norvège Cet appareil est prévu pour être relié...
Page 41 Stapeln des Chassis Das Chassis sollte nicht auf andere Geräte gestapelt werden. Wenn das Chassis herunterfällt, kann es zu Verletzungen und Beschädigungen an Geräten führen. Zweipolig/Neutrale Sicherung Achtung: Zweipolige bzw. Neutralleiter-Sicherung im Netzteil. Netzstecker ziehen, um sicherzustellen, daß keine Spannung am Gerät anliegt. Entfernen Sie alle Netzkabel vor dem Ö...
Page 42 Geräteentsorgung Die Entsorgung dieses Geräts sollte unter Beachtung aller nationalen Gesetze Bestimmungen erfolgen. Regionale und nationale elektrische Bestimmungen Dieses Gerät sollte unter Beachtung der regionalen und nationalen elektrischen Bestimmungen installiert werden. Installationscodes Dieses Gerät muss entsprechend der aktuellsten Version des National Electrical Code installiert weden.
Page 43 Installationscodes Dieses Gerät muss installiert sein, entsprechend auf die neueste Version des Landes National Electrical Code. Für Nordamerika, müssen in Übereinstimmung mit den geltenden Vorschriften in der US-amerikanischen National Electrical Code und dem Canadian Electrical Code. Verbindung der Geräte untereinander Kabel für den Anschluss an das Gerät RS232-und Ethernet-Schnittstellen müssen UL zerti ziert Typ DP-1 oder DP-2.
Page 44: Advertencias De Seguridad De Instalación (Spanish)
ensorgt werden. Dieses Produkt und alle seine Teile in verantwortungsvoller und umweltfreundlicher Art und Weise entsorgen. Advertencias de seguridad de instalación (Spanish) Instrucciones de instalación Antes de conectar el equipo a la fuente de alimentación, leer todas las instrucciones de instalación. Lesión corporal a causa de peso Recurra a su cientes personas para levantar este producto sin.
Page 45 Los chasis no se deben apilar sobre otros equipos. La caída del chasis podría causar lesiones corporales, así como daños al equipo. Conexión redundante de fuente de alimentación: peligro de descarga Este producto incluye una fuente de alimentación redundante o, en su lugar, una vacía. Si se dispone de una fuente de alimentación vacía, no utilizar el producto si su tapa está...
Page 46 La instalación, el reemplazo y el mantenimiento de este equipo estarán a cargo únicamente de personal capacitado y competente. Eliminación del equipo La eliminación de nitiva de este equipo se debe efectuar conforme a todas las leyes y reglamentaciones nacionales. Códigos eléctricos locales y nacionales Este equipo se debe instalar conforme a los códigos eléctricos locales y nacionales.
Page 47 ADVERTENCIA: Alta corriente de fuga. Es esencial efectuar la conexión a tierra antes de conectar la alimentación. Códigos de instalación Este dispositivo se debe instalar conforme a la versión más reciente de los códigos eléctricos nacionales del país en cuestión. En América del Norte, el equipo se debe instalar de acuerdo con las disposiciones vigentes del Código Eléctrico Nacional de los EE.UU.
Page 48: Предупреждения По Технике Безопасности При Установке (Russian)
Conforme a la Directiva 2002/96/CE sobre RAEE, todos los residuos de equipos eléctricos y electrónicos (EEE) se deben recolectar por separado y no se deben eliminar junto con residuos domésticos. Al deshacerse de este producto y de todas sus partes, hágalo de una manera responsable y respetuosa con el medio ambiente.
Page 49 надлежащей вентиляции следует обеспечить зазор вокруг вентиляционных отверстий не менее 8 см (3 дюйма). Установка шасси поверх другого оборудования Не устанавливать шасси поверх другого оборудования. Падение шасси может привести к травмам и повреждению оборудования. Опасность поражения электрическим током резервного источника питания В...
Page 50 При установке или обслуживании этого изделия в стойке следует обеспечить устойчивость системы. Как правило, стойка заполняется оборудованием снизу вверх. Установка оборудования Устанавливать, заменять и/или обслуживать это оборудование должен только подготовленный и квалифицированный персонал. Утилизация оборудования Это оборудование утилизируется в соответствии с национальными законами и постановлениями.
Page 51 Канадской ассоциацией стандартизации (CSA), 3-жильного, [16 AWG], длиной от 1,5 м [6 футов] до 4,5 м, с литой вилкой, рассчитанной на 125 В [13 А]. Подключение к электропитанию в Европе выполняется с помощью гармонизированного шнура питания с маркировкой <HAR>, 3-жильного, с сечением жилы...
Page 52: Avertismente Privind Siguranţa La Instalare (Romanian)
из которых изготовлены стойки и другое оборудование, уровни шума стоек, неисправности вентиляторов, температуру в помещении, конфигурацию помещения и расположение сотрудников относительно оборудования. Владелец дата-центра должен обеспечить эффективную защиту здоровья органов слуха в соответствии со стандартом OSHA и оградить сотрудников от чрезмерного и длительного воздействия шума.
Page 53 Echipament greu Acest echipament este greu şi trebuie să e mutat folosind un dispozitiv mecanic de ridicare pentru a evita producerea de leziuni. Risc de şoc electric Odată ce modulul ventilator este îndepărtat, pinii electrici sunt accesibili în cavitatea modulului. NU introduceţi instrumente sau părţi din corp în cavitatea modulului ventilator.
Page 54 În timpul descărcărilor electrice - pericol electric În timpul perioadelor cu descărcări electrice luminoase, nu lucraţi cu echipamentul sau nu conectaţi sau deconectaţi cablurile. Conectarea/deconectarea cablului din cupru Cablurile din cupru sunt grele şi in exibile, de aceea trebuie să e ataşate sau detaşate de conectori cu grijă.
Page 55 Avertisment: Înlocuiţi numai cu o baterie recunoscută UL, certi cată pentru curent de încărcare anormal maxim de minimum 4 mA Există risc de explozie în cazul în care bateria este înlocuită cu o baterie necorespunzătoare. Eliminaţi bateriile folosite în conformitate cu instrucţiunile. Cordon de alimentare electrică...
Page 56: Sigurnosna Upozorenja Za Instaliranje (Croatian)
Nivelul acustic menționat în secțiunea Speci cații reprezintă zgomotul produsului, măsurat în conformitate cu standardul ISO 7779, în condiții nominale. Nivelul real de zgomot poate varia în funcție de condițiile de instalare, inclusiv, dar fără limitare, numărul de stive din con gurație, dimensiunea generală...
Page 57 Kako biste sigurno podignuli ovaj proizvod, koristite dovoljan broj ljudi. Teška oprema Ova oprema je vrlo teška i treba se premještati pomoću mehaničkog dizala kako bi se izbjegle ozljede. Rizik od strujnog udara! Rizik od strujnog udara! S uklonjenim modulom ventilatora, perima napajanja se može pristupiti u otvoru modula.
Page 58 Ovaj sustav raspolaže dvopolnim/neutralnim osiguračima. Uklonite sve kabele napajanja prije otvaranja poklopca proizvoda ili dodirivanja unutarnjih dijelova. Višestruki ulazi za napajanje Rizik od strujnog udara i opasnost od električne energije. PSU jedinice su neovisne. Odspojite sva napajanja kako biste osigurali stanje bez napajanja unutar platforme preklopnika.
Page 59 Ovaj se uređaj mora instalirati sukladno najnovijoj verziji nacionalnih električnih kodova države. U Sjevernoj Americi oprema se mora instalirati sukladno važećim zahtjevima navedenim u US National Electrical Code i Canadian Electrical Code. Zamjena baterije Upozorenje: Bateriju zamijenite samo baterijom iz serije UL koja je certi cirana za maksimalnu nepravilnu struju punjenja ne manju od 4 mA Postoji rizik od eksplozije ako se baterija zamijeni neodgovarajućom vrstom.
Page 60: Avvertenze Di Sicurezza Per L'installazione (Italian)
Upozorenje na akustičnu razinu Akustična razina navedena u odjeljku Speci kacije predstavlja buku proizvoda izmjerenu u skladu s ISO 7779 pod nominalnim uvjetima. Stvarna razina buke može varirati ovisno o uvjetima instalacije, uključujući, ali ne ograničavajući se na broj stalaka u instalaciji, ukupnu veličinu instalacije, materijal stalka i druge opreme i razine buke, kvar ventilatora, sobnu temperaturu, raspored prostorija i položaj zaposlenika u odnosu na opremu.
Page 61 Apparecchiatura pesante Questa apparecchiatura è molto pesante e va spostata mediante un sollevatore meccanico, per evitare lesioni. Rischio di scosse elettriche! Con il modulo ventola rimosso, i pin di alimentazione sono accessibili all’interno della cavità del modulo. NON inserire strumenti o parti del corpo nella cavità del modulo della ventola.
Page 62 Prese di alimentazione multiple Rischio e pericolo di scosse elettriche. Gli alimentatori sono tutti indipendenti. Scollegare tutti gli alimentatori per assicurarsi che il commutatore non sia sotto tensione Durante i temporali, pericolo di scosse elettriche Durante i temporali, non e ettuare interventi sull’apparecchiatura e non collegare o scollegare i cavi.
Page 63 Codici di installazione Questo dispositivo va installato in conformità con l’ultima versione dei codici elettrici nazionali del Paese. Per il Nord America, l’apparecchiatura va installata in conformità con i requisiti applicabili del “codice elettrico nazionale USA” e del “codice elettrico canadese”.
Page 64: Montaj Güvenlik Uyarıları (Turkish)
un circuito la cui potenza non è limitata). Protezione contro le sovracorrenti: la cablatura dell’edi cio deve integrare un dispositivo di protezione contro le sovracorrenti di potenza nominale pari a 20. Avviso sul livello acustico Il livello acustico indicato nella sezione Speci che rappresenta il rumore del prodotto misurato in conformità...
Page 65 Montaj Talimatları Ekipmanı güç kaynağına bağlamadan önce tüm montaj talimatlarını okuyun. Ağırlık Nedeniyle Fiziksel Yaralanma Bu ürünü güvenli bir şekilde kaldırabilmek için yeterli sayıda insandan yardım alın. Ağır Ekipman Bu ekipman çok ağırdır ve yaralanmaları önlemek için ekipmanın mekanik asansör kullanılarak taşınması...
Page 66 kapatılmamışken ürünü çalıştırmayın. Çift Kutuplu/Nötr Kesmeli Sigorta Bu sistemde çift kutuplu/nötr kesmeli sigorta kullanılmaktadır. Ürünün kapağını açmadan veya herhangi bir iç parçaya dokunmadan önce bütün güç kablolarını çıkartın. Çoklu Güç Girişleri Elektrik çarpması riski ve enerji tehlikesi. Bütün PSU'lar (Güç Kaynağı Üniteleri) ayrıdır. Anahtar platformundaki gücü...
Page 67 Bu cihazın, ülke ulusal elektrik kodlarının son sürümüne göre monte edilmesi gerekir. Kuzey Amerika için, ekipmanın ABD Ulusal Elektrik Kodu ve Kanada Elektrik Kodu'nun uygulama koşullarına göre monte edilmesi gerekir. Pilin Değiştirilmesi Uyarı: Yalnızca, maksimum düzgüsüz şarj akımı 4mA'dan az olmayan, UL Onaylı pillerle değiştirin.
Page 68: Japan Vcci Statement
Teknik Özellikler bölümünde listelenen akustik seviye, nominal koşullarda ISO 7779 uyarınca ölçülen ürün gürültüsünü temsil eder. Gerçek gürültü seviyesi; kurulumdaki raf sayısı, toplam kurulum boyutu, raf ve diğer ekipman malzemesi ve gürültü düzeyleri, fan arızaları, oda sıcaklığı, oda yapılandırması ve ekipmanla ilgili olarak çalışan konumu dahil ancak bunlarla sınırlı...
Page 69 ‫תקן ישראלי‬ ‫יש להתקין את המוצר תוך הקפדה על תקנות החשמל הנהוגות בישראל, ולעשות שימוש ביחידת חלוקת‬ 32 (‫כוח העומדת בתקן ישראל )ת”י‬ ‫חבלת גוף כתוצאה מנשיאת משקל יתר‬ .‫נדרשת נוכחותם של מספר מתקינים כדי להרים את המוצר בבטחה‬ ‫ציוד כבד‬ .‫המוצר...
Page 70 .‫המערכת מכילה ספק כוח נוסף לגיבוי, או, בחלק מהמקרים, חלל ריק המאפשר הרכבת ספק כזה. אין לעשות‬ ‫שימוש במערכת כשהמכסה החוסם את החלל הריק אינו סגור כהלכה‬ ‫מספר שקעים חשמליים‬ .‫סכנת התחשמלות ואזהרת אנרגיה‬ .‫כל אחד מספקי הכוח פועל באופן עצמאי. יש לנתק את כל ספקי הכוח, כדי להבטיח ניתוק מוחלט של המערכת‬ ‫מזרם...
Page 71 3 - ‫, מוליך‬CSA ‫על מנת לחבר את המוצר לחשמל בצפון אמריקה, יש לבחור כבל חשמלי ובעל הסמכת‬ ,[16 AWG] .13A ,125V ‫שבקצהו תקע מובנה‬ .‫אורכו המינימלי 5.1 מטר )6 אינץ'( ואורכו המקסימלי 5.4 מטר‬ ‫לחיבור אירופאי, בחר כבל חשמלי בעל התאמה בינלאומית וסימון‬ 2^‫<",מוליך...
Page 72 .IT ‫, ולמערכת אספקת חשמל מסוג‬TN ‫בנורבגיה בלבד, יחידה זו מיועדת לחיבור למערכת אספקת חשמל מסוג‬ Air Flow NVIDIA systems are o ered with two air ow patterns: Power (rear) side inlet to connector side outlet - marked with blue dots that are placed on the power inlet side.
Page 73: Package Contents
Warning All servers and systems in the same rack should be planned with the same air ow direction. All FRU components need to have the same air ow direction. A mismatch in the air ow will a ect the heat dissipation. The table below provides an air ow color legend and respective OPN designation.
Page 74: Mounting Options
32 - OSFP thermal caps Note If anything is damaged or missing, contact your sales representative at Networking-support@nvidia.com. Mounting Options By default, the SN9700 and SN9790 systems are shipped with the rail kit described in QM9700/QM9790 Tool-Less Rail Kit. For a designated MGX mount railkit for the SN9701 system, see QM9701 Tool-Less Rail Kit.
Page 75 Prior to the installation procedure, inspect all rail-kit components and make sure none of them is missing or damaged. If anything is missing or damaged, contact your NVIDIA representative at Networking- support@nvidia.com. The following parts are included in the tool-less rail kit (see gure below):...
Page 76 Prerequisites: Before mounting the system to the rack, select the way you wish to place the system. Pay attention to the air ow within the rack cooling, connector and cabling options. While planning how to place the system, review the two installation options shown in the table below, and consider the following points: Make sure the system air ow is compatible with your installation selection.
Page 77 Note The following steps include illustrations that show front side (ports) installation, yet all instructions apply to all installation options. 1. Attach the left and right system rails (A) to the switch. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 78 Attaching the System Rails (A) to the Switch 2. Secure the assembly by gently pushing the system chassis’ pins through the slider key holes, until locking occurs Securing the System in the Switch Rails (A) Chassis' Pins in the Rails' Slots Locking them in a Fixed Position QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 79 3. Mount both of the rack rails (B) into the rack by angularly inserting the brakes located at the rails edges into the designated slots in the rack unit, as shown in the following gure: Inserting the Rack Rails (B) 4.
Page 80 The Breaks are Caught and Locked in the Rack's Slots Aligning the Rack Rails (B) Angular Position Rack Rails Fully Inserted and Locked in the Rack Assembly 5. Pull the rack rails' telescopic extensions all the way to the rack's opposite side, and insert the latches at the rails' free edges to the rack's slots.
Page 81 Inserting the Spring Latches to the Rack's Slots To mount the system into the rack: Warning QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 82 At least two people are required to safely mount the system in the rack. While your installation partner is supporting the system’s weight, perform the following steps: 6. Slide the rails installed on the system into the channels in the rack rails. Push them forward until the locking mechanism is activated on both sides, and a click is heard.
Page 83 Pulling the System Out 4. Press the spring latches on both sides of the rack, and continue to pull the system out until the rack rails are clear of the system's rails. Pressing the Spring Latches on Both Sides QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 84: Qm9701 Tool-Less Rail Kit
5. Remove the rails from the system. Release the metal latches and pull out the rails, so the system's pins will be removed out of the oval slots. Removing the Rails from the System 6. Remove the rails from the rack by pressing the lock button, and pull the rails outside of the rack assembly.
Page 85: Installation Instructions
Kit Part Number Description Installation kit for standard\short depth 2U switches (19" DGX ACC-KIT001265 mountable) The following instructions have been prepared and provided with permission from King Slide. Package Contents Installation Instructions QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 86 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 87 Troubleshooting QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 88 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 89: Cable Installation
Cable Installation Power Cable and Cable Retainer In some switch models, the product's package includes cable retainers. It is highly recommended to use them in order to secure the power cables in place. When installing retainers for the PSUs of the QM97x0 switch systems, please adhere to the following instructions: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 90 1. Verify the integrity of the retainer assembly, as demonstrated in the below table:- The snaps' push-pins must have visible edges with no broken or torn parts. - The shoulders' pins should be in-tact and must not be bent inwards. Proper Condition Improper Condition 2.
Page 91 Correct Insertion Incorrect Insertion 3. Push the retainer until the shoulders' pins (in blue circles below) are open and aligned with the PSU front panel, as shown in the following table: Fully Mated Retainer QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 92: Port Cables
4. Make sure that the retainer is fully locked in place by gently attempting to pull it outwards. 5. Open the plastic loop and route the AC cord through it. Locate the loop over the AC cord, as shown in the following table, and fasten it tightly. Proper Loop Placement Improper Loop Placement Note...
Page 93 For a list of Supported Cables and Transceivers, please see the interconnect product speci cations page. For full cabling guidelines, please see NVIDIA Cable Management Guidelines and FAQs Application Note . For more information about port LEDs, refer to Port LEDs.
Page 94 In the QM9700 and QM9790 systems, a single OSFP cage contains 2 NDR ports, and a single NDR port (quad-lane) is divided into 2 dual-lane ports. This maximizes exibility by enabling end users to use a combination of dual-lane and quad-lane interfaces according to the speci c requirements of their network.
Page 95 QM9700, please refer to the "In niBand Switching" chapter in the latest MLNX-OS® User Manual . For QM9790, please refer to latest NVIDIA Firmware Tools (MFT) Documentation.
Page 96 2. ASIC/Cage/Port/Split: Logical Port Numbering Schematic Two pro les can be selected for the QM97x0 NDR switch systems. The rst one de nes the system as a pure 64-port NDR (32 cages) switch. The other pro le permits any or all NDR ports to be split into two 2X (NDR200) ports.
Page 97: Initial Power On
Note Note: The IB tools will report 129 logical ports. Port 129 is an internal port used for the SHARP Aggregation Node when SHARP is enabled. Initial Power On Each system’s input voltage is speci ed in the Speci cations chapter. The power cords should be standard 3-wire AC power cords including a safety ground and rated for 15A or higher.
Page 98 It may take up to ve minutes to turn on the system. If the System Status LED shows amber after ve minutes, unplug the system and call your NVIDIA representative for assistance. 4. Check the frontal System Status LEDs and con rm that all of the LEDs show status lights consistent with normal operation (initially ashing, and then moving to a steady color) as shown below.
Page 99: System Bring-Up Of Managed Systems
1. Run the following command from a host: # flint -d <device> q 2. Compare the results of this command with the latest version for your system posted on https://network.nvidia.com/products/adapter-software/ rmware-tools/. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 100 3. If the current version is not the latest version, follow the directions in the MFT User Manual to burn the new rmware. Con guring Network Attributes The procedures described in this chapter assume that you have already installed and powered-on the system according to the instructions in this document.
Page 101 Manual Host Con guration To perform initial con guration of the system: 1. Connect a host PC to the Console RJ45 port of the system, using the supplied harness cable (DB9 to RJ45). Note Make sure to connect to the Console RJ45 port, and not to the (Ethernet) MGT port.
Page 102 Parameter Setting Flow Control None 3. The boot menu is prompted. This terminal is not active input or output booting. while Boot Menu ------------------------------------------------------------- ------ : <image # > : <image # > ------------------------------------------------------------- ------ Use the ^ and v keys to select which entry is highlighted.
Page 103 The boot menu features a countdown timer. It is recommended to allow the timer to run out by not selecting any of the options. 4. Login as admin and use admin as password. If the machine is still initializing, you might not be able to access the CLI until initialization completes.
Page 104 Wizard Session Display (Example) Comments con guration or not. If you enter “yes” (yes Zeroconf), the session will continue as shown in the "IP zeroconf con guration" table. If you enter “no” (no Zeroconf), then you need to enter a static IP, and the session will continue as shown in the "Static IP con guration"...
Page 105 Wizard Session Display (Example) Comments hardening on your machine. If enabled, new passwords will be checked upon con gured restrictions. If you wish to enable it, type “yes” and press <Enter>. If you wish to disable it, enter “no”. To avoid illegal access to the machine, please type a password and then press <Enter>.
Page 106 Wizard Session Display (Example) Comments password characters are not printed. You have entered the following information: The wizard displays a Hostname: <switch name> summary of your choices Use DHCP on mgmt0 interface: yes and then asks you to Enable IPv6: yes Enable IPv6 autoconﬁg (SLAAC) on mgmt0 interface: yes con rm the choices or to Enable DHCPv6 on mgmt0 interface: no...
Page 107 Wizard Session Display (Example) Comments will continue as shown in the IP zeroconf con guration" table. If you enter “no” (no Zeroconf), then you need to enter a static IP, and the session will continue as shown in the "Static IP con guration"...
Page 108 Wizard Session Display (Example) Comments Perform this step to con gure the box IPv6 masklen. If you wish to accept the default value, Step 11: HA Chassis Management IPv6 masklen? (Example: [33]) type “yes” and press <Enter>. Otherwise, enter the desired box IPv6 masklen.
Page 109 Wizard Session Display (Example) Step 8: Domain name? Step 9: Enable IPv6? [yes] yes Step 10: Enable IPv6 autoconﬁg (SLAAC) on mgmt0 interface? [no] no Step 11: Update time? [yyyy/mm/dd hh:mm:ss] Step 12: Enable password hardening? [yes] yes Step 13: Admin password (Enter to leave unchanged)? You have entered the following information: Hostname: switch-112126 Use DHCP on mgmt0 interface: no...
Page 110 Wizard Session Display (Example) Step 10: Admin password (Enter to leave unchanged)? You have entered the following information: Hostname: switch-112126 Use DHCP on mgmt0 interface: no Use zeroconf on mgmt0 interface: yes Default gateway: 192.168.10.1 Primary DNS server: Domain name: Enable IPv6: yes Enable IPv6 autoconﬁg (SLAAC) on mgmt0 interface: yes Update time: yyyy/mm/dd hh:mm:ss...
Page 111 Wizard Session Display (Example) Step 8: HA Chassis Management IP netmask: [255.255.255.0] Step 9: HA Chassis IPv6 address: [fdfd:fdfd:7:145::1000:4814] Step 10: HA Chassis Management IPv6 masklen: [33] You have entered the following information: 1. Hostname: sw-mantaray-201-mgmt1 2. Use DHCP on mgmt0 interface: yes 3.
Page 112 Admin up : yes Link up : yes DHCP running : yes IP address 10.12 67.34 Netmask 255.255 IPv6 enabled : yes Autoconf enabled: no Autoconf route : yes Autoconf privacy: no DHCPv6 running : no IPv6 addresses IPv6 address: fe80::268a:7ff:fe53:3d8e/ ...
Page 113: Rerunning The Wizard
overruns carrier collisions queue len 1000 Con guring the Switch with ZTP Zero-touch Provisioning (ZTP) automates initial con guration of switch systems at boot time. It helps minimize manual operation and reduce customer initial deployment cost. For more information, please refer to the “Zero-touch Provisioning” section in the "Getting Started"...
Page 114: Remote Connection
3. Log into the switch (default username is admin, password admin). 4. Read and accept the EULA when prompted. 5. Once the following prompt appears, the system is ready to use. NVIDIA MLNX-OS Switch Management Password: Last login: <time> from <ip-address>...
Page 115: Fru Replacements
FRU Replacements Power Supply NVIDIA systems are equipped with two replaceable power supply units work in a redundant con guration. Either unit may be extracted without bringing down the system. Warning Make sure that the power supply unit that you are NOT replacing is showing all green, for both the power supply unit and the rear System Status LEDs.
Page 116 temperature will be a ected. For power supply unit air ow direction, refer to Air Flow. To extract a power supply unit: 1. Remove the power cord from the power supply unit. 2. Grasping the handle with your hand, push the latch release with your thumb while pulling the handle outward.
Page 117 1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles. Warning Do not attempt to insert a power supply unit with a power cord connected to it. 2. Insert the power supply unit by sliding it into the opening, until a slight resistance is felt.
Page 118 system to operate at a higher (less than optimal) temperature. For power supply unit air ow direction, refer to Air Flow. To extract a fan unit: Note When replacing a faulty fan unit in an operational switch system, do not leave the slot unpopulated for more than 60 seconds. 1.
Page 119 1. Make sure the mating connector of the new unit is free of any dirt and/or obstacles. 2. Insert the fan unit by sliding it into the opening until slight resistance is felt. Continue pressing the fan unit until it seats completely. Warning Do not attempt to insert the fan unit rotated in a 90°/180°/270°...
Page 120: Software Management
Managed systems come with an embedded management CPU card that runs MLNX-OS® management software. The MLNX-OS systems management package and related documentation can be downloaded at https://docs.nvidia.com/networking/software/switch-software/index.html#mlnx-os- in niband. In niBand Subnet Manager The In niBand Subnet Manager (SM) is a centralized entity running in the system. The SM applies network tra c related con gurations such as QoS, routing, partitioning to the fabric devices.
Page 121: Upgrading Software (On Managed Systems)
Software and rmware updates are available from the NVIDIA Support website. Check that your current revision is the same one that is on the NVIDIA website. If not upgrade your software. Copy the update to a known location on a remote server within the user’s LAN.
Page 122: Updating Firmware In-Band (Typical)
Firmware updates should normally be conducted in-band. The use of the MTUSB-1 device is intended for cases of debug or rmware corruption and should be conducted by NVIDIA FAEs or Support engineers, or by trained users at the customer's site.
Page 123 # flint -d <device> q# 3. Compare the results of this command with the latest version for your system posted on https://network.nvidia.com/support/ rmware/ rmware-downloads/ (select the Quantum™ System page). 4. If the current version is not the latest version, follow the directions in the MFT User manual to burn the new rmware inband.
Page 124: Interfaces
Interfaces The systems support the following interfaces: Data interfaces - In niBand 10/100/1000Mb Ethernet management interface (RJ45)* USB port (USB Type A)* RS232 Console port (RJ45)** I²C interface* Reset button Status and Port LEDs *This interface is not found in managed systems. **This interface is not found in externally managed systems.
Page 125 MQM97xx Air Cooled - Non-planarized NDR Compute Port* NDR SM - Single Switch side Mode NDR SM - Single UFM 3.5 side Mode  (1 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 126  NDR Multi Mode UFM 3.5 side Speed In niBand speed is auto-adjusted by the In niBand protocol. NVIDIA systems support QDR/FDR/EDR/HDR/NDR In niBand. FDR is an In niBand data rate, where each lane of a 4X port runs a bit rate of 14.0625Gb/s with 64b/66b encoding, resulting in an e ective bandwidth of...
Page 127: Rs232 (Console)
56.25Gb/s. EDR is an In niBand data rate, where each lane of a 4X port runs a bit rate of 25Gb/s with 64b/66b encoding, resulting in an e ective bandwidth of 100Gb/s. HDR is an In niBand data rate, where each lane of a 4X port runs a bit rate of 50Gb/s with 64b/66b encoding, resulting in an e ective bandwidth of 200Gb/s.
Page 128 The RJ45 Ethernet “MGT” port is labeled images/download/thumbnails/3306298639/image2019-3-5_16-52-4- version-1-modi cationdate-1730276155487-api-v2.png . The Management RJ45 Ethernet ports provide access for remote management. The management ports are con gured with auto-negotiation capabilities by default (100MbE to 1GbE). The management ports’ network attributes (such as IP Address) need to be pre- con gured via the RS232 serial console port or by DHCP before use.
Page 129: Reset Button
Only FAEs are authorized to connect through it. Warning Only original NVIDIA cables supplied with the switch package can be used to connect a switch system to the server. Connecting any cable other than the NVIDIA supplied console cable may cause an I²C hang.
Page 130: Led Noti Cations
Warning Do not use a sharp pointed object such as a needle or a push pin for pressing the reset button. Use a at object to push the reset button. To reset the system, push the reset button for less than 15 seconds. When using an Onyx (MLNX-OS) based system, keeping the reset button pressed for more than 15 seconds will reset the system and the “admin”...
Page 131 Symbol Name Power Supply Units LEDs Fan Status LED QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 132: System Status Led
Symbol Name Unit Identi er LED System Status LED System Status LED - Front Side QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 133: Fan Status Led
Solid Major error has occurred. For minutes after starting the system, unplug the Ambe example, corrupted rmware, system and call your NVIDIA representative for system is overheated, etc. assistance. Fan Status LED Fan Status LED - Front and Rear Sides...
Page 134: Power Supply Status Leds
Front Panel Description Rear Panel Both of these LEDs in the red rectangles show the fans’ status. Fan Status Front LED Assignments Description Action Required Behavior Solid Green All fans are up and running. Solid Error, one or more fans are not operating The faulty FRUs should be Amber properly.
Page 135 Note This section applies to the QM9700 and QM979 systems only. The QM9701 system is powered by a busbar. The systems include two power supply inlets (for redundancy). Each system can operate with only one power supply connected. Each power supply unit has a single 2 color LED that indicates the status of the unit.
Page 136 Action Required Behavior Solid All PS units are connected and running normally. N/A Green Flashing Call your NVIDIA AC present / Only 12VSB on (PSU o ) or PSU in Green representative for Smart-on state. assistance. AC cord unplugged or AC power lost while the Plug in the AC cord of the second power supply still has AC input power.
Page 137 (config) # led MGMT uid on switch To verify the LED status, run: (config) # show leds switch Module LED Status ----------------------------------------------------------------- --------- MGMT UID Blues To deactivate the UID LED on a switch system, run: (config) # led MGMT uid off switch Port LEDs QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 138 Each time you press on the Lane Select Button, the Port LEDs display will switch to a di erent state, as follows: Lane Select Button States State LED Status Ports LED Indication 0 (Default) LED is o 4x || 2xA LED is on 4x || 2xB The port LEDs behavior indicates the ports’...
Page 139: Inventory Pull-Out Tab
LED Behavior Description Action Required Wait for the Logical link to raise. Check that the Solid Amber Link is up. SM is up. Flashing A problem with the Check that the SM is up. Amber link. In In niBand system mode, the LED indicator, corresponding to each data port, will light orange when the physical connection is established (that is, when the unit is powered on and a cable is plugged into the port with the other end of the connector plugged into a functioning port).
Page 140 Note The images provided here are for illustration purposes only. The may not re ect the latest version of the product nor all available models. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 141: Troubleshooting
Troubleshooting Cause Problem Indicator Symptoms Solutio LEDs System Status LED is blinking for more than 5 minutes Cause: MLNX- softwa re did boot properl y and only rmwa re is runnin Solutio Conne ct to system via the consol e port, check softwa status.
Page 142 Cause Problem Indicator Symptoms Solutio t an FAE if MLNX- softwa re did load properl System Status LED is amber Cause: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 143 Cause Problem Indicator Symptoms Solutio Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 144 Cause Problem Indicator Symptoms Solutio Fan Status LED is amber Cause: Possibl e fan issue Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 145 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 146 Cause Problem Indicator Symptoms Solutio Front PSU Status LED is amber Cause: Possibl e PSU issue Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 147 Cause Problem Indicator Symptoms Solutio Make sure that there is an The activity LED does not light up (In niBand) runnin g in fabric. QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 148 Cause Problem Indicator Symptoms Solutio System boot failure The last software upgrade failed on x86 based systems Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 149 Cause Problem Indicator Symptoms Solutio ’s QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 150 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 151 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 152 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 153 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 154 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 155 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 156 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 157 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 158 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 159 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 160 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 161 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 162 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 163 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 164 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 165 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 166 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 167 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 168 Cause Problem Indicator Symptoms Solutio " QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 169 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 170 Cause Problem Indicator Symptoms Solutio QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 171: Speci Cations
Speci cations QM9700 and QM9790 Technical Speci cations Feature Mechanical .2” 7” " Size: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 172 Feature ” Mounting: Weight: Speed: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 173 Feature Connector cage: Environmental Temperature: 0° °C 0° °C QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 174 Feature 0° °C Humidity: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 175 Feature Altitude: Noise level: Regulatory Safety: EMC: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 176 Feature RoHS: Power Input Voltage: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 177 Feature Global Power Consumption: QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 178 Feature QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 179 Feature QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 180 Feature ® ™ CPU (in QM9700 only): Main Devices Switch: ™- Throughput Switching: QM9701 Speci cations Feature Value Mechanical 17.2" (H) x 1.7" (W) x 33.62" (D) Size: 438mm (H) x 43.6mm (W) x 854mm (D) Mounting: 19” rack mount, DGX mountable Weight: 16.88 kg Speed:...
Page 181 Typical power with passive cables (ATIS): TBD Consumption: Max power with active cables: 1,660W CPU (in QM9700 only): Intel® Core™ i3 Co ee Lake TMain Devices Switch: NVIDIA Quantum™-2 IC Throughput Switching: 25.6Tbps QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 182: Appendixes
Appendixes The document contains the following appendixes: Accessory and Replacement Parts Thermal Threshold De nitions Interface Speci cations Disassembly and Disposal Accessory and Replacement Parts Ordering Part Numbers for Replacement Parts Part Number Legacy Part Number 930-9BRKT-00JM- MTEF-KIT-I-TL " QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 183 Part Number Legacy Part Number ACC-KIT001265 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 184 Part Number Legacy Part Number 930-9BFAN-00IW- MTEF-FANF-L QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 185 Part Number Legacy Part Number 930-9BFAN-00JA- MTEF-FANR-L 930-9NPSU-00JN- MTEF-PSR-AC-K QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 186 Part Number Legacy Part Number QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 187 Part Number Legacy Part Number 930-9NPSU-00J6- MTEF-PSF-AC-K QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 188 Part Number Legacy Part Number HAR000631 – QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 189 Part Number Legacy Part Number ACC001897 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 190 Part Number Legacy Part Number ACC001899 ACC001850 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 191: Thermal Threshold De Nitions
Part Number Legacy Part Number Thermal Threshold De nitions Three thermal threshold de nitions are measured by the Quantum™ ASICs, and impact the overall switch system operation state as follows: Warning – 105°C: On managed systems only: When the ASIC device crosses the 100°C threshold, a Warning Threshold message will be issued by the management software, indicating to system administration that the ASIC has crossed the Warning threshold.
Page 192: Interface Speci Cations
Interface Speci cations OSFP Pin Description Net Name PinNum TX2P TX2N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 193 Net Name PinNum TX4P TX4N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 194 Net Name PinNum TX6P TX6N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 195 Net Name PinNum TX8P TX8N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 196 Net Name PinNum VCC1 VCC1 LPWn_PRSn QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 197 Net Name PinNum RX7N RX7P QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 198 Net Name PinNum RX5N RX5P QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 199 Net Name PinNum RX3N RX3P QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 200 Net Name PinNum RX1N RX1P QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 201 Net Name PinNum RX2P RX2N RX4P QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 202 Net Name PinNum RX4N RX6P QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 203 Net Name PinNum RX6N RX8P QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 204 Net Name PinNum RX8N INT_RSTn QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 205 Net Name PinNum VCC2 VCC2 TX7N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 206 Net Name PinNum TX7P TX5N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 207 Net Name PinNum TX5P TX3N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 208 Net Name PinNum TX3P TX1N QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 209: Rj45 To Db9 Harness Pinout
Net Name PinNum TX1P RJ45 to DB9 Harness Pinout In order to connect a host PC to the Console RJ45 port of the system, a RS232 harness cable (DB9 to RJ45) is supplied. RJ45 to DB9 Harness Pinout QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 210: Disassembly And Disposal
Warning RJ-45 Console and I²C interfaces are integrated in the same connector. Due to that, connecting any cable other than the NVIDIA supplied console cable may cause an I²C hang. Using uncerti ed cables may damage the I²C interface. Refer to the Replacement Parts Ordering Numbers appendix for harness details.
Page 211 4. Unscrew the center bolts from the side of the system with the bracket. Warning Support the weight of the system when you remove the screws so that the system does not fall. 5. Slide the system from the rack. 6.
Page 212: Document Revision History
Document Revision History Descri Date Revision ption Added March 2025 QM97 November 2024 QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 213 Descri Date Revision ption QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 214 Descri Date Revision ption QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 215 Descri Date Revision ption October 2024 Upload ed a correct logical mappi diagra m in Cable QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 216 Descri Date Revision ption Installa tion page, under section Switch Pro le: Non- Splitta (Suitab le for L2/Spi Switch es). Fixed broken cross- referen Update Cable April 2023 Installa tion section July 2022 Update OPNs section QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 217 Descri Date Revision ption QM97XX 1U NDR 400Gbps InﬁniBand Switch Systems User Manual...
Page 218 Customer should obtain the latest relevant information before placing orders and should verify that such information is current and complete. NVIDIA products are sold subject to the NVIDIA standard terms and conditions of sale supplied at the time of order acknowledgement, unless otherwise agreed in an individual sales agreement signed by authorized representatives of NVIDIA and customer (“Terms of Sale”).
Page 219 NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.

This manual is also suitable for:

Infiniband qm9700 Infiniband qm9790 Infiniband qm9701

Nvidia InfiniBand QM97 Series User Manual

Quick Links

Need help?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Nvidia InfiniBand QM97 Series

Summary of Contents for Nvidia InfiniBand QM97 Series

This manual is also suitable for:

Table of Contents