Download
Share
Print this page
Nvidia MLNX-GW Getting Started
  1. Manuals
  2. Brands
  3. Nvidia Manuals
  4. Computer Hardware
  5. MLNX-GW
  6. Getting started
Nvidia MLNX-GW Getting Started

Nvidia MLNX-GW Getting Started

Hide thumbs

Advertisement

Quick Links

Download this manual
Getting Started With MLNX-GW

Advertisement

loading
Need help?

Need help?

Do you have a question about the MLNX-GW and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Nvidia MLNX-GW

Summary of Contents for Nvidia MLNX-GW

  • Page 1 Getting Started With MLNX-GW...
  • Page 2 Con guring the Gateway for the First Time Con guring the Gateway for the First Time General Networkwide Deployment Guidelines General Networkwide Deployment Guidelines Con guring High Availability Con guring High Availability Con guring Partition Keys Con guring Partition Keys Getting Started With MLNX-GW...
  • Page 3 The following sections describe instructions for con guration and initialization of the Skyway appliance. Con guring the Gateway for the First Time General Networkwide Deployment Guidelines Getting Started With MLNX-GW...

  • Page 4: Gateway Initialization

    4. The “Station IP address” is the address of the IPMI controller. DHCP may need to be con gured in order to provide a lease for the MAC address. The NVIDIA Skyway appliance has 2 LAN ports on the back panel of the appliance that can be used for IPMI (in the gure below IPMI LAN2 is used).
  • Page 5 "Lan channel 1" refers to IPMI LAN 1 and "Lan channel 2" refers to IPMI LAN 2. 5. Use the following IPMI command to remote access serial console (user and password should be “admin” by default). Getting Started With MLNX-GW...
  • Page 6 Once operating system boots, iKVM over HTML5 no longer shows any output. However, iKVM over HTML5 can be used for BIOS con gurations at the very beginning of the system boot sequence right before the operating system boots. Getting Started With MLNX-GW...
  • Page 7 3. Log in as admin and use admin as password, using IPMI. ipmitool -I lanplus -H <IP Address> -U admin -P admin sol activate 4. Connect the management Ethernet cable to LAN3 (second port from the left) on the back panel of the appliance. Getting Started With MLNX-GW...
  • Page 8 Typing “yes” will have the DHCP server assign the IP address Typing “no” (no DHCP) will o er the use of the “zeroconf” con guration or not. For the use of Zeroconf, Getting Started With MLNX-GW...
  • Page 9 Note that password Step 8: Confirm admin password? <new_password> characters are not printed. Step 9: Monitor password (Must be typed)? To avoid illegal access to the <new_password> machine, please type a password and then press <Enter>. Getting Started With MLNX-GW...
  • Page 10 (e.g., SSH) to the gateway. Speci cally, verify the existence of an IP address. gateway # show interfaces mgmt0   Interface mgmt0 status: Comment Admin up : yes Link up : yes DHCP running : yes IP address 10.7 148.61 Netmask 255.255 IPv6 enabled : yes Autoconf enabled: no Getting Started With MLNX-GW...

  • Page 11: Rerunning The Wizard

    : ethernet Interface source: physical 1500 HW address :c9: :a1:b2   bytes 11700449 packets 55753 mcast packets discards errors overruns frame   bytes 5139846 packets 28452 discards errors overruns carrier collisions queue len 1000 Rerunning the Wizard Getting Started With MLNX-GW...
  • Page 12 3. Log in to the gateway (default username and password are both "admin"). 4. Read and accept the EULA, when prompted. 5. Once the following prompt appears, the system is ready to use. NVIDIA Gateway   Password: Last login: <time> from <ip-address> Getting Started With MLNX-GW...
  • Page 13 If rmware was upgraded, rmware boot bar will appear and the CLI will be blocked until rmware upgrade is complete. Note The CLI will be blocked until In niBand virtual interfaces are created. The following message will appear : " Creating VFs". images/download/attachments/2219580760/image2021-3-7_17-47- 31-version-1-modi cationdate-1635445417477-api-v2.png Getting Started With MLNX-GW...
  • Page 14 In niBand datacenter and vice versa. The following section describes networkwide guidelines and provides a speci c example when using a NVIDIA Ethernet switch running NVIDIA Onyx™ operating system. Note Ensure the Subnet Manager is running in the In niBand cluster with IPoIB enabled.
  • Page 15 Make sure MTU on the Ethernet router connected to Skyway is at least 2 bytes smaller than the In niBand IPoIB MTU con guration (e.g. set In niBand MTU to 4092 and Ethernet MTU to 4090). In niBand Guidelines Getting Started With MLNX-GW...
  • Page 16 # Virtualization support #  : Ignore Virtualization - No virtualization support #  : Disable Virtualization - Disable virtualization on all # Virtualization supporting ports #  : Enable Virtualization - Enable (virtualization on all # Virtualization supporting ports virt_enabled  Getting Started With MLNX-GW...
  • Page 17 1. On the relevant In niBand nodes, con gure an IP address on each In niBand port designated for the Skyway deployment (e.g., ib0). In addition, con gure a default route with the Skyway IP as next hop (in this example, 1.1.1.3). # ifconfig ib0 Getting Started With MLNX-GW...
  • Page 18 Note The NVIDIA Skyway IP which is con gured as next hop should match the virtual IP of the In niBand port channel of the NVIDIA Skyway appliance. 2. Access and con gure an IP address on the gateway's Ethernet and In niBand ports and con gure a virtual IP address on the In niBand port.
  • Page 19 Skyway and a single Ethernet router with LAG. It is possible to also connect to two Ethernet routers in an MLAG con guration. For more information, see the following community post for MLAG con guration on NVIDIA Onyx-based switches: https://enterprise-support.nvidia.com/s/article/how-to- con gure-mlag-on-mellanox-switches.
  • Page 20 This section explains how to con gure a high availability (HA) cluster with multiple appliances. Before Con guring HA Note For all appliances in the HA cluster, the MLNX-GW version must the same. For all appliances in the HA cluster, the Ethernet management interfaces must be in the same L2 subnet.
  • Page 21 Make sure that all Ethernet interfaces that are connected to Skyway appliances in the same HA cluster are connected through an Ethernet MLAG or LAG con guration. Below is an example of MLAG and MAGP con guration on Ethernet switches connected to Skyway appliances. Getting Started With MLNX-GW...
  • Page 22 2.252 primary eth_router (config) # mlag-port-channel switchport interface access vlan eth_router (config) # protocol magp eth_router (config) # vlan magp interface eth_router (config vlan magp ) # ip virtual- interface router address 2.254 Getting Started With MLNX-GW...
  • Page 23 (config) # port-channel switchport access interface vlan eth_router (config) # vlan ip address interface eth_router (config) # ip route   Note Additional commands might be required to ensure the MTU restrictions described in "Networkwide Deployment Guidlines" page. Getting Started With MLNX-GW...
  • Page 24 HA domain id change: YES 'YES' Skyway B: gateway (config) # gw ha   Warning! Configuration is about to be saved and the system will be reloaded. Type to confirm the HA domain id change: YES 'YES' Note Getting Started With MLNX-GW...
  • Page 25 Name : skyway- GW Operational state: active System guid : b8ce:f603: :7e8a 0068 Priority :   Name : skyway- <--- (local node) GW Operational state: active System guid : b8ce:f603: :6efa 0075 Priority : High Availability LAG/MLAG Setup Getting Started With MLNX-GW...
  • Page 26 In this above use case, every Skyway-facing port on the side of the L2 Ethernet switches should be con gured as a router port. In addition, a private network should be established (in the example above, 3.3.0.0/16) between the router ports mentioned above and the Skyways Ethernet port channel. Getting Started With MLNX-GW...
  • Page 27 3. Con gure PKEY on the In niBand host. #### pkey_full = pkey_id (hex) + (hex) 8000 echo > "0x<pkey_full>" /sys/ /net/ib<interface_number>/create_child class ifconfig ib<interface_number>.< pkey_full> up ifconfig ib<interface_number>.< pkey_full> <Ib host pkey port ip> netmask <netmask> Getting Started With MLNX-GW...
  • Page 28 (config) # ib port-channel pkey 0x<pkey_id> interface ip address <Gw pkey port ip> <netmask> gateway (config) # ib port-channel pkey 0x<pkey_id> interface virtual ip address <Gw pkey port virtual ip> <netmask> gateway (config) # configuration write Example: Getting Started With MLNX-GW...
  • Page 29 <pkey subnet>/<netmask> via <eth router port ip> Example: ip route add  via <eth router port ip> 111.222 62.0 6. Add routes on the Ethernet router. ip route <pkey subnet>/<netmask> <gw eth pc ip> Example: ip route   / <gw eth pc> 111.222 62.0 Getting Started With MLNX-GW...
  • Page 30 NVIDIA accepts no liability related to any default, damage, costs, or problem which may be based on or attributable to: (i) the use of the NVIDIA product in any manner that is contrary to this document or (ii) customer product designs.
  • Page 31 Sale for the product. Trademarks NVIDIA and the NVIDIA logo are trademarks and/or registered trademarks of NVIDIA Corporation in the U.S. and other countries. Other company and product names may be trademarks of the respective companies with which they are associated.