Mellanox Technologies sRB-20210G User Manual
  1. Manuals
  2. Brands
  3. Mellanox Technologies Manuals
  4. Gateway
  5. sRB-20210G
  6. User manual
Mellanox Technologies sRB-20210G User Manual

Mellanox Technologies sRB-20210G User Manual

10 gbe gateway module
Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
10 GbE Gateway
(sRB-20210G
Module)
User Manual
Version 2.0
www.mellanox.com
Mellanox Technologies

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the sRB-20210G and is the answer not in the manual?

Questions and answers

Related Manuals for Mellanox Technologies sRB-20210G

Summary of Contents for Mellanox Technologies sRB-20210G

  • Page 1 10 GbE Gateway (sRB-20210G Module) User Manual Version 2.0 www.mellanox.com Mellanox Technologies...
  • Page 2 THIS HARDWARE, SOFTWARE OR TEST SUITE PRODUCT (“PRODUCT(S)”) AND ITS RELATED DOCUMENTATION ARE PROVIDED BY MELLANOX TECHNOLOGIES “AS-IS” WITH ALL FAULTS OF ANY KIND AND SOLELY FOR THE PURPOSE OF AIDING THE CUSTOMER IN TESTING APPLICATIONS THAT USE THE PRODUCTS IN DESIGNATED SOLUTIONS. THE CUSTOMER'S MANUFACTURING TEST ENVIRONMENT HAS NOT MET THE STANDARDS SET BY MELLANOX TECHNOLOGIES TO FULLY QUALIFY THE PRODUCT(S) AND/OR THE SYSTEM USING IT.

  • Page 3: Table Of Contents

    Managing the Unit over Fast Ethernet (Out-of-Band) or InfiniBand (Inband) ..16 2.2.2 Handling Different Subnets ..................18 Configuring an sRB-20210G Module (10 GbE to InfiniBand Bridge) ........20 Setting Time and Date ......................21 Default Settings ........................21 Users and Passwords ......................22 Verifying the Configuration ....................
  • Page 4 5.1.1 Overview ......................... 44 5.1.2 Setting the I/O IP via the GUI ................. 44 5.1.3 Configuring the sRB-20210G IP via the Switch CLI ..........45 Resetting the sRB-20120G ....................46 5.2.1 Resetting the I/O via the GUI .................. 46 5.2.2 Resetting the I/O via the CLI...................
  • Page 5 6.6.1 Configuring a Cluster via the GUI ................63 6.6.2 Configuring a Cluster via the CLI ................65 6.6.3 Cluster Mode (sRB-20210G High Availability) ............65 6.6.4 Setting sRB-20210G Algorithms ................66 6.6.5 Loop Prevention ...................... 68 Setting the Event Policy Filters ..................... 70 Port MTU Configuration (Jumbo Frames) ................
  • Page 6 12.3 I/O System Overview Parameter Description ..............114 12.4 Viewing an I/O via the CLI ....................114 12.5 Connecting to an I/O Device via the CLI ................115 12.6 Viewing I/O Port Properties ....................115 12.7 Viewing I/O Network (Partitioning) Information ..............117 Mellanox Technologies...
  • Page 7 13.3 Mechanisms Used to Create and Enforce Partitions ............119 13.4 Quick Settings ........................120 13.4.1 Switch Settings (GUI) ................... 120 13.4.2 sRB-20210G Settings (GUI) ................. 120 13.5 Setting Partitioning via the GridVision Fabric Manager GUI ..........121 13.5.1 Creating a Network ....................122 13.5.2 Viewing Network Information ................
  • Page 8 Security Options ....................184 14.6.9 SNMP Options ...................... 186 14.6.10 Traffic Flow Manager (TFM) ................. 192 14.7 Safe Mode CLI Commands ....................200 14.8 Software Upgrade Procedure in Safe Mode ............... 202 14.9 CLI Safe Mode ........................203 Mellanox Technologies...
  • Page 9 Version 2.0 (sRB-20210G Module) User Manual About this Manual This manual describes how to operate the sRB-20210G module, also referred to as Mellanox’s 10 GbE gateway. The manual describes the tasks commonly required to configure and use the device. Information regarding the sRB-20210G hardware installation can be found in the Mellanox ISR 2004/2012 Grid Director Installation Manual.

  • Page 10: Chapter 1. Introduction

    IMPORTANT: The sRB-20210G module is used as a bridge in the system. It does not run on several subnets. However, it can be used to interface several subnets using partitions. For more information, refer to ‎...

  • Page 11: Led Indicators

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Figure 1-2 shows a Mellanox sRB-20210G with optical XFP modules installed. ‎ 1 -2. sRB-20210G – With Pluggable Optic XFP Modules Figure 1.2.2 LED Indicators Three LEDs are located on the face of the module, indicating link status of the combined interfaces in the integrated Management port (mgmt) and overall system status.

  • Page 12: Features

    Functional Description 1.4.1 High Performance InfiniBand-to-GbE Connectivity The sRB-20210G core capabilities rely on the Mellanox in-house developed silicon used for forwarding traffic between InfiniBand and Ethernet infrastructures. This custom silicon enables the Mellanox sRB-20210G to achieve wire-speed protocol processing with minimal latency, while transparently providing upper-layer traffic classification capabilities.

  • Page 13: Comprehensive Management

    1.4.3 sRB-20210G Architecture  All data traffic is handled by the sRB-20210G hardware (Silicon) to achieve the highest possible throughput, with the lowest possible latency.  Management traffic is handled in software by the CPU. Software...

  • Page 14: Srb-20210G Application Diagram

    CLI commands are used for managing the packet handling rules in the sRB-20210G. The user can define rules or use the default rules. If no new rule was added or if there was no change to the default rules, the packets are handled by a default method. For ‎...

  • Page 15: Infiniband

    Mellanox GridVision management software. 1.5.6 Physical  Mellanox Grid Director ISR 2012 and ISR 2004 Line Board compatible  Supports any combination of sLB-2024 and sRB-20210G Line Boards  Power and cooling through ISR 2012 or ISR 2004 chassis. 1.5.7 Environmental ...

  • Page 16: Chapter 2. Initial Configuration

    Configuring the sRB-20210G Gateway in the ISR 2XXX NOTES: Do not physically connect any of the sRB-20210G GbE ports to the same physical network as the switch’s Ethernet management port. In order to prevent broadcast packet loops, the switch’s Ethernet management port must be physically-separated from the GbE network and InfiniBand fabric.
  • Page 17 172.28.255.255 DHCP client disabled default-gw Ip is: 172.28.0.1 Link-speed auto-negotiation. To set the sRB-20210G IP address and Default Gateway (Switch side): Use the following table to enter the appropriate commands: Commands Procedure From the Switch prompt: guest a. Enter the guest mode. The default password Step 1 for the guest user is voltaire.

  • Page 18: Handling Different Subnets

    Example: switch(config-chassis)io connect 4 1 You will now get the sRB-20210G admin prompt. If the switch and the host are in the same subnet, the sRB-20210G is now ready for operation. 2.2.2 Handling Different Subnets This section explains how to set the sRB-2021G when the switch and the host are in different subnets.
  • Page 19 10G-Card(config-route)# default-gw set 1 172.25.0.1 Expected Result: sRB-20210G-6044(config-route)# static-route show entry destination netmask gateway interface |-----|----------|---------|---------|-------- 0.0.0.0 0.0.0.0 172.25.0.1 if0 Exits to the Switch chassis mode. Step 8 The sRB-20210G is now ready; traffic is set to be transferred. Mellanox Technologies...

  • Page 20: Configuring An Srb-20210G Module (10 Gbe To Infiniband Bridge)

    Step 7 interface interface Step 8 Enter the configuration mode. Note: Before going to the following step, you must first hand out this PKey to the SRB-20210G from the Switch. Refer to the GridVision User Documentation for further information. Mellanox Technologies...

  • Page 21: Setting Time And Date

    To configure the PKey, refer to Partitioning, in Chapter 13. Setting Time and Date The time of the sRB-20210G is synchronized with the switch. Setup is performed through the switch. Refer to the Switch User Documentation for details on how to set up the time and date.

  • Page 22: Users And Passwords

    Enter directly the privileged mode. The default password for the admin user is 123456. Note: When connecting to the sRB-20210G via the switch using the io connect command, you are already in admin mode and do not need a password.

  • Page 23: Verifying The Configuration

    Enter directly the privileged mode. The default password for the admin user is 123456. Note: When connecting to the sRB-20210G via the switch using the io connect command, you are already in admin mode and do not need a password.
  • Page 24 Use this command to display the system clock. Step 5 You can now start working with the basic functions by accessing the sRB-20210G via the Switch VFM or via the CLI. Advanced sRB-20210G features are detailed further in this manual.

  • Page 25: Chapter 3. Mellanox Device Manager (Vdm)

    The Mellanox Device Manager (VDM) is an embedded application with a web-based GUI that provides InfiniBand management functionality for the Mellanox sRB-20210G. It enables users to view a graphical representation of the Mellanox sRB-20210G, its LED indicators and ports, and to monitor and configure device parameters.

  • Page 26: Logging-In To The Device Manager

    Admin user type. This user can perform all configuration and provisioning operations. Default password: 123456  Guest user type. This user can only view device configuration and status information. Default password: Voltaire Password The password for the specific type of user. Mellanox Technologies...

  • Page 27: The Switch Device Manager Main Window

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual NOTE: You can change the SNMP settings by clearing the Use Default SNMP Community Strings check box (see Figure 3-3). ‎ 3 -3. Login Dialog Box – Setting SNMP Community Strings Figure The default Get and Set community string is private.
  • Page 28 3 -4. Front of the Chassis The figure below shows the rear of the chassis in the GridVision Integrated Device Manager Main Window. The ISR 2004 was used for the example below. ‎ Figure 3 -5. Rear of the Chassis containing an sRB-20210G Mellanox Technologies...

  • Page 29: The Main Menu

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual In this example, a sRB-20210G unit is installed in slot 2. The left panel (Subnet Tree) lists the sRB-20210G under sLB/sRBD, and the right panel shows the sRB-20210G information. 3.4.1 The Main Menu The main menu provides access to the Device Manager of the Switch only.

  • Page 30: Srb-20210G Gateway Graphical Representation

    3.4.3 sRB-20210G Gateway Graphical Representation The following GUI graphical representation of the sRB-20210G provides a view of the sRB-20210G front panel with two 10 GbE ports and 22 InfiniBand ports. Figure 3-7 shows the graphical representation of the sRB-20210G in the Device Manager.

  • Page 31: Right-Click Menus

    (see Sections 3.4.4.1 – 3.4.4.4). 3.4.4.1 Right-Clicking an sRB-20210G (Blue Area) When right-clicking the blue area of the sRB-20210G at the rear of the chassis (see Figure 4-2) or on the sRB-20210G graphical representation itself (see Figure 3-7), the following menu is displayed: ‎...
  • Page 32 3.4.4.3 Right-Clicking 10 GbE Ports (Gray Area) The two 10 GbE Ports are confined into a gray area onto the sRB-20210G board. Right-clicking this area allows you to choose from the following options: ‎...

  • Page 33: Left-Click Option

    ‎ information, as shown in Figure 3 -7. From the rear of the switch only – Clicking a port on the sRB-20210G Click a port on the sRB-20210G at the at the rear switch shows the Information Area for the specific port (right rear switch panel of the main window), as shown in Section 4.3.

  • Page 34: Trap Table

    You can rearrange columns positions within the Trap Log table, by dragging and dropping a selected column in the new desired position as well as resizing the column width. 3.6.3 Viewing and Hiding Events You can hide the Events Log from view by selecting View/View Events from the main menu. Mellanox Technologies...

  • Page 35: Acknowledging Events

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual 3.6.4 Acknowledging Events Clearing/acknowledging an event means that you have taken the steps to correct the problem and now wish to remove the event from the Trap Table. Acknowledging an event is essentially clearing it. The state of the node is refreshed accordingly.
  • Page 36 Additional information, if applicable, regarding the location of the port. Port GUID Global unique identification number (GUID) of the port. IB Port Displays the InfiniBand port number. Displays the port LID. Event Provides detailed information on the specific event. Details Mellanox Technologies...

  • Page 37: Chapter 4. Device Information

    CLI. Getting Started with the sRB-20210G Device Manager The sRB-20210G is installed into the Switch. It is accessed and managed through the Grid Director Management GUI and CLI connections. This means that you must first get into the switch GUI and CLI and only then can you access the sRB-20210G Device.
  • Page 38 4 -2. sRB-20210G Device Manager - 10 GbE Line Information Window NOTES: The status bar at the top of the window shows that this module is an sRB-20210G line (listed under sLB/sRBD) installed in slot #3 of an ISR 2004 chassis.

  • Page 39: Device Information Via The Cli

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Port Description Shows the current Maximum Transmission Unit (MTU) settings of each port (1500 or 9198) Trunk Group Shows the aggregated ports in full (P1-2) or no Lag (separate) mode (P1), (P2).

  • Page 40: Srb-20210G Port Information

    In the VDM Main Window, click Rear. The rear of the Switch is displayed, showing the sRB-20210G installed in the chassis, as shown in Figure 3-5. Click a port on the sRB-20210G. The port Information area (right panel) shows the specific Step 2 port information.

  • Page 41: Viewing The System Time And Date (Cli Only)

    In the example above, the status bar of the Information Area shows the information of the 10 GbE gateway’s port 1. Viewing the System Time and Date (CLI only) To view sRB-20210G system time, run the following command from the sRB-20210G CLI admin or privileged mode: 10G> clock show...

  • Page 42: Viewing Srb-20210G Temperature (Switch Cli Only)

    Checking the Device Software Version 4.7.1 Device Version via the GUI To view the version information via the GUI: On the sRB-20210G (zoom view) graphical representation, right click on the 10G gray area and select About, as shown in the figure below. Mellanox Technologies...

  • Page 43: Device Version Via The Cli

     The software version of the 10 GbE Gateway  The software version of the switch. You can also view the sRB-20210G hardware version information in the field under the sRB-20210G graphical representation (Zoom view). ‎ Figure 4 -6. Hardware Version 4.7.2...

  • Page 44: Chapter 5. Device Configuration

    The I/O Panel window is used to configure the I/O IP on the switch side. It shows the type of I/O installed in the switch drawer slots. The slot number is the number on the Grid Director rear panel in which the sRB-20210G is installed within the switch. It also shows the sRB-20210G IP and mask.

  • Page 45: Configuring The Srb-20210G Ip Via The Switch Cli

    5.1.3 Configuring the sRB-20210G IP via the Switch CLI The sRB-20210G IP address is configured via the CLI of the Switch by using the following ISRxxxx(config-chassis)#io ip-address set [slot-number] command: [position-number] [ip-address] [netmask] To configure the I/O via the Switch CLI, perform the following steps: Run a ISRxxxx(config-chassis)#io show command to see if the address is configured.

  • Page 46: Resetting The Srb-20120G

    Version 2.0 Device Configuration NOTE: The IP address of the sRB-20210G must be on the same subnet as the sMB card with which the CLI session is established. Resetting the sRB-20120G 5.2.1 Resetting the I/O via the GUI To reset the I/O: Right-click the sRB-20210G graphical representation either from the switch or zoom view.

  • Page 47: User Settings (Setting Passwords)

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual User Settings (Setting Passwords) You can change your user password periodically or as necessary. 5.3.1 User Settings via the GUI The GridVision Device Manager allows you to configure three types of user authorization: ...

  • Page 48: User Settings Via The Cli

    Enter directly the privileged mode. The default password for the admin user is 123456. Note: When connecting to the sRB-20210G via the switch using the io connect command, you are already in admin mode and do not need a password.

  • Page 49: Chapter 6. Advanced Configuration

    To update sRB-20210G software, perform the following steps: Step 1 Make sure that the FTP server is active, and located in the same subnet as the sRB-20210G management port subnet. Copy the new version files from the installation CD to the FTP root directory.
  • Page 50 Enter directly the privileged mode. The default password for the admin user is 123456. Note: When connecting to the sRB-20210G via the switch using the io connect command, you are already in admin mode and do not need a password.

  • Page 51: Updating The Vdm (Gui) - Gateway Version Automatic Upgrade

    To configure remote management settings: Step 1 On the sRB-20210G zoom view, right-click the 10G gray area and select Remote Management Settings from the menu. The Remote Management Settings dialog box opens, as displayed in Figure 6-2: Mellanox Technologies...
  • Page 52 6 -3. Remote Management Settings - General View (or edit) the information in the following fields: Step 5 Device Name: Name of the device. Note that you can also edit this field. SNMP Version: Software version of the SNMP. Note: this field is read-only. Mellanox Technologies...

  • Page 53: Setting Remote Management Via The Cli

    Click OK to save updates to this tab and exit the dialog box. 6.2.2 Setting Remote Management via the CLI To define SNMP Communities, enter the following commands: From the sRB-20210G CLI (config-snmp) menu, run the following commands as required. Step Set the SNMP community get string using the following command: Optional...
  • Page 54 Updating the Switch community strings will update all the community strings in the device. Example: 10G(config-snmp)# snmp community trap trap Expected Result: 10G(config-snmp)# snmp show snmp functionality enable snmp get enable snmp set enable get community public set community private trap community trap location description Mellanox Technologies...
  • Page 55 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Define the SNMP contacts string using the following command: Optional Syntax: snmp contacts set [contacts] Note that the contact is a string set by the user. Example: 10G(config-snmp)# snmp contacts set Voltaire...

  • Page 56: Remote Configuration Settings (Ftp/Scp)

    Remote Configuration Settings (FTP/SCP) The FTP configured for use with the sRB-20210G is used for the following:  Upgrading software versions  Uploading log files to the remote server  Uploadingdownloading the repository file. Mellanox Technologies...

  • Page 57: Setting Remote Configuration Via The Gui

    Setting Remote Configuration via the GUI To Configure Remote Configuration via the GUI: On the sRB-20210G zoom view, right-click the 10G gray area and select Remote Configuration from the menu. The Remote Configuration dialog box opens, as displayed in Figure 6-4.

  • Page 58: Backing Up The Configuration Via The Gui And The Cli

    If the file name is not indicated, it remote: is created using a default name. [remote-path] Any characteristic after the last slash in the path will be used as a user-defined file name. Click Load from 10G(config-remote Downloads the configuration from the Optional Mellanox Technologies...

  • Page 59: Setting Link Aggregation (Lag)

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Backing up the configuration Remote to download )#copy remote: remote server using previously defined the backup running-config server name, user name, and password. configuration from the copy remote: The remote path must contain the remote server.

  • Page 60: Setting Link Aggregation Via The Gui

    Setting Link Aggregation via the GUI To set Link Aggregation via the GUI: Step 1 On the sRB-20210G zoom view, right-click the 10G gray area and select Link Aggregation Configuration from the menu. The Link Aggregation Configuration dialog box is displayed, as shown below.

  • Page 61: Setting Link Aggregation Via The Cli

    [full,separate] Example: 10G(config-if)# lag-mode set full NOTE: When setting to link aggregation, make sure that sRB-20210G ports on the Ethernet Switch are aggregated as well. To view 10 GbE Link Aggregation Mode settings via the CLI: Syntax: lag-mode show...

  • Page 62: Configuring I/O Interfaces

    |-----|-------|-------------|-------------|----------------|----|------ smb-mng 172.28.1.36 255.255.0.0 172.28.255.255 0x7fff No port 192.168.2.2 255.255.255.0 192.168.2.255 0x7fff Note that the Trunk (LAG mode) was changed to P1, P2. (This command is available from both, the 10G admin or config menus). Mellanox Technologies...

  • Page 63: Cluster Configuration

    Multiple algorithms are available for distributing traffic between multiple sRB-20210G Gateways in Cluster Mode. The traffic can be balanced between the sRB-20210G Gateways according to the load balancing algorithm (options: active-active, master-standby). In active-active mode, the load balancing is performed according to the Hash Algorithm (options: XOR IB Eth, IB, Eth).
  • Page 64 (derives from its hardware address). It is used by one of the optional loop prevention methods. Auto join cluster After being automatically detected a sRB-20210G can be set to automatically join the cluster. This means that it is now able to transfer packets.

  • Page 65: Configuring A Cluster Via The Cli

    (config-cluster)# cluster priority set [priority [0-255]] The sRB-20210G with the highest priority value will be set as master as long there is no other master in the fabric. Each one of the other sRB-20210G Gateways is set with a descending priority value in the event of the master failing.

  • Page 66: Setting Srb-20210G Algorithms

    12.11.11.11 0x75 0x62880 0x62880 net75 sRB-20210G 75.75.75.75 6.6.4 Setting sRB-20210G Algorithms To set the 10 GbE algorithms: At the 10 GbE>configcluster prompt, enter the following commands: Step 1 Command Description cluster Sets the cluster hash table algorithm. In active-active...
  • Page 67 Default: active-active  active-active means that all sRB-20210G Gateways in the cluster transfer packets  master-standby means that only the Master sRB-20210G in the Cluster transfers packets; the others are in Standby mode Example: 10G(config-cluster)# cluster load-balance-algorithm set active-active Expected results:...

  • Page 68: Loop Prevention

    If the configuration includes more subnets (two separate Ethernet networks connected to one InfiniBand network and vice-versa), the 10 GbE gateways blocks the traffic between the two remote networks. In such a case, Automatic mode can be used when each two 10GbE are connected to a different Ethernet network. Mellanox Technologies...
  • Page 69 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual 6.6.4.3 Automatic Mode Automatic is the most permissive mode: traffic is blocked between all 10 GbE gateways that are members of the same cluster. Each gateway discards all received packets sent by another gateway that belongs to the same cluster, but passes-on all packets sent by other gateways.

  • Page 70: Setting The Event Policy Filters

    A certain event should be recorded in the log  A trap should be sent for a certain event  No action should be taken  The event’s severity would be considered as Normal, Minor, Warning, or Critical. Mellanox Technologies...
  • Page 71 Version 2.0 (sRB-20210G Module) User Manual To set the event policy filters: On the unit’s sRB-20210G graphic image, right-click the management module area; a pop-up Step 1 menu appears. From the pop-up menu, select Policy Table; the Policy Table dialog box appears.

  • Page 72: Port Mtu Configuration (Jumbo Frames)

    The sRB-20210G intermediates between these networks using different MTU sizes and by implementing the Path MTU discovery (PMTU) mechanism. Upon receiving an IP packet that is too large to transfer to the other side, the sRB-20210G issues an ICMP error toward the sender, notifying regarding the maximum packet size that can be delivered to the destination IP.

  • Page 73: Setting The Mtu Via The Gui

    You can set the MTU of each Ethernet and InfiniBand port individually, via the Port Configuration dialog box. To set the MTU for individual ports: On the unit’s sRB-20210G graphic image, right-click the Ethernet port or management module Step 1 area; a pop-up menu appears.

  • Page 74: Setting The Mtu Via The Cli

    MTU value (in bytes) in the following format: port ethernet set mtu [1, 2] [1500, 9198] . For example: sRB-20210G-7074(config-port)# port ethernet set mtu 2 9198 4. Type port ib set mtu and then the IB port number followed by the required MTU...

  • Page 75: Mib Support

    IMPORTANT: You cannot connect to the sRB-20210G through the SSH protocol. However, you can use SSH with the Grid Director and use the following command to connect to the sRB-20210G: switch(config-chassis)# io connect Mellanox Technologies...

  • Page 76: Enabling/Disabling Non-Secure Protocols

    All security features are available and accessible through the Switch. In order to secure the sRB-20210G, you must disable the sRB-20210G security features (telnet/ftp). As a result, the sRB-20210G will only be accessible through the Switch and will benefit from the Switch security features, such as RADIUS and sRB-20210G Filtering.
  • Page 77 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual 6.10.2.2 Disabling FTP Access (‘FTPD’) Mellanox allows you to disable the FTP non-secure protocol on the remote server using the following commands to provide enhanced security access to your system. To set ftpd via the CLI: From the 10G CLI, go to configsecurity mode and disable the ftpd status, as follows:...

  • Page 78: Chapter 7. Setting-Up Networks

    Link Aggregation Mode of the port [Full (P1-2) or Separate LAG (P1, P2). 7.1.1 Network Table Right-click Menu Right-clicking the Networks table allows you insert and remove networks, as well as set the network default gateway, change the broadcast, and refresh the table. Mellanox Technologies...

  • Page 79: Defining (Adding) A New Network

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual ‎ 7 -2. Networks Table – Right-click Menu Figure 7.1.2 Defining (Adding) a New Network To define a new Network: Right-click inside the Networks Table and select New Network from the menu.

  • Page 80: Viewing Network Information

    Right-click a specific network inside the Networks Table and select Remove Network from Step the menu. The network is removed. Note that you cannot remove the If0 (default) or smb-mng (management) network. Note: smb-mng is the management interface. If0 is the default interface. Neither can be removed. Mellanox Technologies...

  • Page 81: Updating The Default Gateway

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual To remove all networks from the Network Table: Right-click inside the Networks Table and select Remove All Networks from the menu. All Step user-defined networks are removed. 7.1.5 Updating the Default Gateway To update a Default Gateway: Right-click inside the Networks Table and select Default Gateway from the menu.

  • Page 82: Refresh Table

    10G(config-if)# interface show if0 entry alias ip mask broadcast vlan pkey(hex) trunk |-----|------------|----------------|----------------|----------------|----|---- 192.168.2.93 255.255.255.0 192.168.2.255 0x7fff P1-2 7.2.2 Adding Networks To add a Network (or Interface) via the CLI: At the 10G(config-if)# prompt, type the following command: Step Mellanox Technologies...

  • Page 83: Removing Networks

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual interface add interface add [alias] [tag - [1-4094]] [P1,P2,P1-2][pKey 0x0001-0x7fff] [Ip] [Mask] Example: 10G(config-if)# interface add V5 108 P1-2 0x108 172.55.55.5 255.255.255.0 This example adds an IP interface with a logical name (here called V5), on VLAN 108, trunk P1-2 (full LAG configuration), to destination InfiniBand Partition 0x108.
  • Page 84 From the 10G(config-route)# menu, run the following command: Step 10G(config-route)# default-gw set [row [1..65]][Gateway][Iface] Examples: The following example shows how to configure the default gateway of the sRB-20210G. 10G(config-route)# default-gw set 2 smb-mng 192.168.60.254 NOTE: smb-mng is the sRB-20210G managing interface though which the Switch accesses the sRB-20210G.

  • Page 85: Chapter 8. Traffic Flow Management

    Flow Management table. Overview When a packet (TCP/IP, UDP, ICMP, or other) arrives at the sRB-20210G, its header is compared with the TFM Table. If there is a match between the header and a TFM rule, the packet is treated according to the rule. If no rule matches the packet, the packet is dropped. The TFM Table displays the TFM rules defined in the gateway;...
  • Page 86 Services. Click this icon to display the Services Table, which displays the list of services defined in the gateway. 8.2.1.2 Right-click Menu Right-clicking the Traffic Rules Table allows you insert, update, and remove rules, as well as refreshing the Traffic Rules Table. Mellanox Technologies...
  • Page 87 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual ‎ 8 -2. TFM Table – Right-click Menu Figure 8.2.1.3 Inserting a New Rule To add a new rule to the TFM table: Click the Insert icon in the TFM Table or select Insert Rule from the right-click menu.
  • Page 88 To update a Rule: Inside the TFM Table, right-click the rule you wish to update and select Update from the Step 1 menu. The Update Rule dialog box is displayed. ‎ Figure 8 -4 - Update Rule Dialog Box Mellanox Technologies...
  • Page 89 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Step 2 Change the configuration as required. Click OK to update the rule. Step 3 8.2.1.5 Creating a New Service When adding a TFM rule, the service matching the rule must first be defined. The service refers to the protocol of the packet.
  • Page 90 8.2.1.6 Viewing the List of Services To view the list of the services defined in the sRB-20210G: Click Services on the TFM table. The Services window is displayed, showing the list of Step 1 services defined in the sRB-20210G and their details, as shown below.
  • Page 91 8.2.1.8 Setting TFM via the CLI When a TCP/IP packet arrives at the sRB-20210G, its header is compared with and checked against the TFM Table. If there is a match between the header and the rule in the TFM Table the packet is treated according to the rule defined in the TFM Table.
  • Page 92 You can add the following protocols: ICMP, IGMP, TCP services. 10G(config-tfm)# rules show Displays the existing TFM rules. 10G(config-tfm)# rules add 6 Defines a new rule using the supplied 192.168.3.1 parameters. 255.255.255.0 In this example, assume that an ICMP Mellanox Technologies...
  • Page 93 Enter directly the privileged mode. The default password for the admin user is 123456. Note: When connecting to the sRB-20210G via the switch using the io connect command, you are already in admin mode and do not need a password.
  • Page 94 Enter directly the privileged mode. The default password for the admin user is 123456. Note: When connecting to the sRB-20210G via the switch using the io connect command, you are already in admin mode and do not need a password.
  • Page 95 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Command name Description service show Shows the list of services available in the sRB-20210G. 10G-ipr-20(config-tfm)# service show --- Total number of entries 7--- entry name protocol Sport Dport type |------|-----------------------------|---------|-- -------|---------|---------...
  • Page 96 The following is a description of the CLI command for adding a TFM rule. The syntax for adding a TFM rule is: 10G(config-tfm)#rules add [row > 0][Source | any][Source-ip-mask | any][Dest | any][Dest-ip-mask | any][Interface][Service | any][tunneling,discard] [log [no,1-15]] Mellanox Technologies...
  • Page 97 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual where: Index number of the rule. Rules are applied according to priority: if several rules apply to arriving packets, the rules with the lowest index number will be applied. You can add up to 1,204 rules.

  • Page 98: Chapter 9. Static Route Configuration

    9.2.1 Setting Routing via the GUI To view the Static Route Table in the VDM: Step Under the Device, expand the sRB-20210G and click Static Route. The right side of the window shows the Static Route table. ‎ Figure 9 -1. Static Route Table...
  • Page 99 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Table 9-1. Static Route Table Parameters Parameter Description The row number matching this rule. Destination destination subnet Netmask destination subnet Netmask Gateway IP or IB gateway through which the traffic is transferred...

  • Page 100: Routing Configuration Via The Cli

    9.2.2 Routing Configuration via the CLI The sRB-20210G forwards traffic back and forth between IP and InfiniBand. The gateway is defined when packets must be transferred outside the boundaries of the IP or InfiniBand subnets, using the Static Routing commands.
  • Page 101 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Prompt Command name Description 10G(config)# route Switches to Route mode 10G(config-route)# static-route set Defines the static routing rules of [row][Destination] interfaces in a table. [netmask] row is the row number in the table chosen [Gateway][Iface] for the new rule.

  • Page 102: Chapter 10. Logs And Statistics

    Chapter 10. Logs and Statistics If you experience a problem with the sRB-20210G, you may be asked to provide the Export Log files for debugging purposes. You can also use the Port Counters Statistics feature to collect specific statistics on each one of the 10 GbE ports.
  • Page 103 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Step 2 Select the counters on which you would like to run the statistics by checking the box next to the desired port. Set the Polling Interval to define the time interval in seconds between which the system polls Step 3 the counters.

  • Page 104: Viewing Port Status And Statistics Via The Cli

    Shows the status of all Ethernet ports. 10G(config-port)# port ethernet set Updates the MTU of an Ethernet port. 10G(config-port)# port ib show Shows the status of InfiniBand port. 10G(config-port)# port ib set mtu Updates the MTU of an InfiniBand port. Mellanox Technologies...
  • Page 105 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Example of Port Statistics: 10G(config-port)# port statistics show Type: port1 port2 |-------------|-----------------|--------- total tx: 1581362 vlan tx: 799622 frag tx: ip-option tx: 946 unicast tx: 120499 arp/rarp tx: 1188 icmp/igmp tx: 948...
  • Page 106 Active (link is up) Shows the present Maximum Transmission Unit (MTU) settings of each port (1500/2048 for IB; 1500/9198 for ETH) speed Port speed in Mbits/sec Prompt Command name Description 10G(port)# port ib show Shows the status of IB port (enable/disable) Mellanox Technologies...

  • Page 107: Statistics Logs

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Example: 10G(config-port)# port ib show port status speed(Gbps) |------|--------------|--------------|-------------- active 2048 The following details the parameters for the port ib show command: Parameter Description port Port number Shows the present Maximum Transmission Unit (MTU)

  • Page 108: Viewing Traps/Events

    Command name Description 255.255.255.0 packet on the interface arrives at 192.168.3.200 the sRB-20210G with source IP of 255.255.255.0 if0 icmp 192.168.3.1 and destination IP of tunneling 3 192.168.3.200. The rule will be treated according to the icmp service pre-defined by the user. If there are no other TFM rules with a higher priority (i.e., a lower index number),...
  • Page 109 ? policy event set issue-alarm policy event set issue-alarm [event id (1001-100 8)] [log, trap, log+trap, none] sRB-20210G-6050(config-policy)# policy event set issue-alarm 1002 log sRB-20210G-6050(config-policy)# sRB-20210G-6050(config-policy)# policy event show 1002 Event Id = 1002 Event Name...

  • Page 110: Viewing Events

    The Trap Table only displays the events that occur when the Fabric Manager session is current. Events are time-stamped with the date/time of the 10GbE Gateway clock, which could differ from the PC time. Events originating in the PC are time-stamped with the PC clock time. Mellanox Technologies...

  • Page 111: Chapter 11. Multicast Settings

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Chapter 11. Multicast Settings This chapter provides instructions on how to configure a multicast group to either send a packet onto the InfiniBand side or drop it. 11.1 Overview This section introduces the feature that supports multicast. This feature allows configuring the fabric behavior in case the multicast packet arrives from the Ethernet side but a multicast group for this packed does not exist on the InfiniBand side.

  • Page 112: Mc-Table Session

    11.4 MC-Table Session Displays all multicast groups opened by the user and handled by this specific sRB-20210G. Assume that there are two sRB-20210Gs and three open multicast groups in the cluster, as follows: 225.5.5.5; 225.6.6.6; 225.7.7.7, the mc-table for each of the sRB-20210G will report...

  • Page 113: Chapter 12. Mellanox Fabric Manager (Vfm)

    Click the desired I/O module under the selected switch. The system overview for the chosen I/O module is displayed. Figure 12-1 shows the detailed system overview of an sRB-20210G. The fields in this window are detailed in Table 12-1. ‎...

  • Page 114: I/O System Overview Parameter Description

    I/O Port Information is available via the Port View, the Port Properties, and the Properties panel. You can also edit the sRB-20210G properties by right-clicking the sRB-20210G in the internal structure frame (upper right panel) and selecting properties. In the window that opens, you can see some properties that can be changed if you select the "manual name and IP".

  • Page 115: Connecting To An I/O Device Via The Cli

    ISR2004-38fa(config-chassis)# io show slot #2, position #1, I/O Type 10 GbE Gateway, IP:172.30.106.60 Mask:255.255.0.0 GetCommunity:public SetCommunity:private This shows that a sRB-20210G (10 GbE Gateway) is installed in slot 2 of the Switch. 12.5 Connecting to an I/O Device via the CLI...
  • Page 116 1, 2 Shows the link’s data rate Speed 10GbE: 10000000, 1G: 1000000 Media The communication media type Copper Fiber-optic The port’s trunk type Trunk Unique ID Port GUID (GUID/MAC) If selected, the GbE port’s data rate Auto-sense is auto-sensed Mellanox Technologies...

  • Page 117: Viewing I/O Network (Partitioning) Information

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Field Description Possible Values Full duplex If selected, the GbE port works in full-duplex mode 12.7 Viewing I/O Network (Partitioning) Information You can view the I/O Network (Partitioning) Information per gateway.

  • Page 118: Chapter 13. Partitioning

    InfiniBand fabric into predefined virtual networks to allow inter-communication between the members of the specific network. A network can be expanded to an Ethernet VLAN (Virtual LAN) via a sRB-20210G enabling the two networks to communicate internally as one single network. It is currently recommended to perform this via the GridVision Fabric Manager GUI.

  • Page 119: Mechanisms Used To Create And Enforce Partitions

    In the above block diagram (Figure 13-1), Partition A (PKey A) is shared between InfiniBand Hosts 1, 2, and 3 and is connected to VLAN Y (Ethernet Hosts) via the sRB-20210G. Partition B (PKey B) is shared between InfiniBand Hosts 4, 5, and 1. Note that InfiniBand Host 1 belongs to both Partition A and Partition B, meaning that it can communicate between all hosts in Partition A and B.

  • Page 120: Quick Settings

    2. Verify that the sRB-20210G has an IP address. If there is an IP address, proceed to the following step. 3. If there is no IP address (the IP is 0.0.0.0), switch to the VDM to set the sRB-20210G configuration then reopen the sRB-20210G VFM (see note at the end of this section).

  • Page 121: Setting Partitioning Via The Gridvision Fabric Manager Gui

    7. Expand the menu under the sRB-20210G. Right-click the port to which you want to attach the network, and select Partitioning. 8. Select the network to which you want to attach your sRB-20210G port and add the network to the list.

  • Page 122: Creating A Network

    Figure 1 3-2. Creating a Network The Create Network dialog box is displayed. ‎ Figure 1 3-3. Create Network Dialog Box Step 3 In the Create Network Window Name field, enter the name of the network (user-defined). Note Mellanox Technologies...
  • Page 123 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual that if you want to configure a sRB-20210G, this name will be used as the default name of its interface. NOTE: If, from the Switch CLI, you run a configchassisinterfaceinterface show command, you will see this name as the newly created sRB-20210G interface.

  • Page 124: Viewing Network Information

    ‎ 1 3-5. Creating a Network using the Port Info – Partitioning Tab Figure Once your network is defined, you can connect sRB-20210G ports to the VLAN if you wish to attach an InfiniBand partition to an Ethernet VLAN. 13.5.2...

  • Page 125: Assigning Server Ports To A Network

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual 13.5.3 Assigning Server Ports to a Network To assign or add a Server/Host port to a network or partition: Select the host you wish to attach to a network or partition (either from the Subnet Tree or Step 1 from the Site Topology Map View).

  • Page 126: Assigning Network Membership

    Mapping an InfiniBand Partition to an Ethernet VLAN via the 10 GbE Gateway Mapping an InfiniBand partition to an Ethernet VLAN is performed via the 10 GbE Gateway whose ports are assigned to the VLAN. The 10 GbE Gateway can provide up to 16 interfaces. Mellanox Technologies...
  • Page 127 To connect 10 GbE Gateway Ports to the VLAN: Under the Site TopologyMap View select a switch. Step 1 Under the Internal Structure (dynamic right panel), select the desired sRB-20210G and Step 2 expand it. Scroll all the way down to 10 GbE Gateway and expand it.

  • Page 128: Multiple Selection For Partitioning Configuration

    Under Available Networks, select the network from the list (in the above example: Bob) and Step 6 click Add to associate the sRB-20210G port with the network. The network (Bob) is added to the lower section (Networks accessed by selected port/s).

  • Page 129: Setting Partitioning Via The Cli

    IMPORTANT: When adding a sRB-20210G to a Partition through the CLI, make sure you add both sRB-20210G port GUIDs (you can view the sRB-20210G GUIDs by running a netdiscover command from the Utilities Menu.

  • Page 130: Deleting A Network

    Description: Shows the details of the specific network. network show [network (str)] Syntax: Example: Switch(config-sm-partition)# network show 2323 network name: 2323 pkey value: 0x43 description: ip address: 2.2.3.0 subnet mask: 255.255.255.0 vlan tag: gateway: 0.0.0.0 dhcp: Mellanox Technologies...

  • Page 131: Viewing The Network Error Log File

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual gvdhcp: membership: full trust level: QoS priort: status: 13.6.5 Viewing the Network Error Log File Command: network-file error-log show Description: Shows the network error file ((PartitionError.txt)). network-file error-log show Syntax: Example: Switch(config-sm-partition)# network-file error-log show In line 26: The port guid 0x0 doesn't have the "management"...
  • Page 132 |0x8f10001011301 |management |full |HCABob |0x8f10001011301 |br1 |full |HCABob |0x8f10001011301 |br3 |full |HCABob |0x8f10001011301 |br4 |full |HCABob |0x8f10001011301 |br2 |full |HCABob |0x8f10001011301 |Bob |full |HCABob |0x8f10001011301 |br5 |full |HCAJohn |0x8f10001011302 |management |full |HCAJohn |0x8f10001011302 |br1 |full |HCAJohn |0x8f10001011302 |br3 |full Mellanox Technologies...
  • Page 133 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual |HCAJohn |0x8f10001011302 |br4 |full |HCAJohn |0x8f10001011302 |br2 |full |HCAJohn |0x8f10001011302 |Bob |full |NewHCA |0x8f10001011456 |management |full |NewHCA |0x8f10001011456 |br1 |partial 13.6.6.2 Setting GUID Membership To set GUID membership (full or part), run the following command: The membership of the GUID in the example below is set to “part”.
  • Page 134 |System name |Port #|Port Guid |network name|membership| --------------------------------------------------------------- |0x0 |management |full |HCAJohn |0x8f10001011302 |management |full |HCAJohn |0x8f10001011302 |br1 |full |HCAJohn |0x8f10001011302 |br3 |full |HCAJohn |0x8f10001011302 |br4 |full |HCAJohn |0x8f10001011302 |br2 |full |HCAJohn |0x8f10001011302 |Bob |full |HCANew |0x8f10001011456 |management |full Mellanox Technologies...
  • Page 135 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual |HCANew |0x8f10001011456 |br1 |partial 13.6.6.4 Viewing a GUID, Related Network, and Membership To view the GUID and related network as well as network membership, run the following command: Command: interface guid show...
  • Page 136 Networks Network Fields Description @Network Name Unique network name defined by the user (without spaces). PKey Value Pkey number in hexadecimal format. Description Description of the network. IP address Network subnet IP address. Subnet Mask Network subnet mask. Mellanox Technologies...
  • Page 137 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual VLAN Tag Integer defined by the user on the Ethernet side. Enables a VLAN to be part of the InfiniBand network. Gateway IP of the gateway. DHCP For future use. DHCP mode can be enabled for the sMB Ethernet interface. This mode is operational only when the Ethernet is the selected management interface.
  • Page 138 You can view the list of partition errors by entering the path of the file in your browser, for example: http://172.25.7.11/PartitionError.txt List of errors reported in the PartitionError.txt file: In line 17: Failed to translate system name "" to guid. In line 20: Failed to translate system name "" to guid. Mellanox Technologies...

  • Page 139: Chapter 14. Command Line Interface (Cli) Management

    14.2 Mellanox CLI Model The Mellanox sRB-20210G CLI model consists of a hierarchical structure of the menus and sub-menus, as shown in the diagram below. For further detail, refer to the sRB-20210G CLI Reference, in Chapter 14. Mellanox Technologies...

  • Page 140: Cli Operating Conventions

    Safe Mode Login: admin Password: 123456 ‎ Figure 1 4-1. Mellanox sRB-20210G CLI Model Safe Mode is provided for troubleshooting purposes. For more information on Safe Mode functionality, refer to Section 14.9. 14.3 CLI Operating Conventions 14.3.1 Keyboard Usage in CLI Operation...

  • Page 141: Cli Command Structure

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Function Up Arrow or Ctrl-P Recalls commands in the history buffer, beginning with the most recent command. Repeat the key sequence to successively recall older commands. Down Arrow or Return to more recent commands in the history buffer after recalling Ctrl-N commands with the Up Arrow or Ctrl-P.

  • Page 142: Case-Sensitivity

    <command> ? Displays the help for the specific command. Ends the CLI. NOTE: When the sRB-20210G CLI syntax defines parameters in brackets [], you must include at least one of the parameters in the command. 14.3.3 Case-Sensitivity CLI commands must be entered using the same case as shown in this manual. User-defined strings, such as names or descriptions, may appear in any case, including mixed case.

  • Page 143: Exec Mode Commands

    (?) at the system prompt allows the user to obtain a list of commands available for each command mode. When the user starts a session on the sRB-20210G, the initial mode is User mode, often called Exec or Admin mode. Only a limited subset of the commands is available in Exec (Admin) mode.
  • Page 144 IP address (virtual), the LID (local ID), and the destination QP. The LID and the destination QP are the physical layer. This connection between the virtual and physical layer is much like the standard correlation between the IP address and the MAC address. Mellanox Technologies...
  • Page 145 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual This table enables you to see the traffic transferred to a specific machine. arp-table show Syntax: Example: 10G-Card> arp-table show Arp Ethernet entries: ================================================================= ========== IP address MAC_ADDR VLAN PORT Device 192.168.0.95...
  • Page 146 0x75 net75 sRB-20210G  Mode: enable (always) – Means that the sRB-20210G gateway (router) automatically connects to the cluster. Mode options are: auto or disabled.  Loopback protection algorithm: Default is full – Loop back protection prevents gateways from transferring packets in an infinite loop. This mechanism prevents loops between gateways.
  • Page 147 Version 2.0 (sRB-20210G Module) User Manual Parameter Description Join cluster After being automatically detected a sRB-20210G can be set to automatically (Auto automatically join the cluster. This means that it is now able to join cluster) transfer packets. Options: Yes/No...
  • Page 148 ETH Port2 mac-address : 00:08:f1:06:03:c1 Remote show Description: Shows the name of the Remote server and the user name used by the sRB-20210G to log in to the server. The password is not displayed for security reasons. remote show Syntax: Example: 10G>...
  • Page 149 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual ping Description: Sends echo message to a network host. ping <ip-address> Syntax: rules show Description: Displays the rules of the Traffic Flow Management defined in the gateway. rules show Syntax: Example: 10G>...

  • Page 150: Privileged Mode Commands

    IPR FirmWare Version: 0xE. IPR CPLD Version: 0x5. 14.5 Privileged Mode Commands The privileged command set includes many of the commands contained in Exec Mode, as well as various configuration commands which include commands that provide access to the Mellanox Technologies...
  • Page 151 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual remaining modes. Privileged Mode also includes high-level testing commands that are not debug available to the user, such as the mode (for internal use only). If the system administrator has set a password, you are prompted to enter it before being allowed access to Privileged Mode.
  • Page 152 Syntax: Example: 10G-Card# arp-table show Arp Ethernet entries: ================================================================= ========== IP address MAC_ADDR VLAN PORT Device 192.168.0.95 00:1B:56:18:80:5F Arp Infiniband entries: ================================================================= ========== IP address GUID PKEY Device 192.168.0.92 00:08:F1:04:03:96:0E:45 0xFFFF 0x404 172.28.0.1 00:08:F1:04:00:40:32:01 0xFFFF Mellanox Technologies...
  • Page 153 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual clock show Description: Displays the system clock. clock show Syntax: Example: sRB-20210G-61f0# clock show Thu Apr 2 14:48:17 UTC 2009 cluster show Description: Shows the cluster configuration. cluster show Syntax: Example: sRB-20210G-61f0>...
  • Page 154 Ends the CLI. Syntax: exit Description: Exits to previous menu. exit Syntax: mc-table show Description: Displays the multicast entries of this computer. Syntax: mc-table show Example: sRB-20210G-6060# mc-table show IP address MLID PKEY STATE 225.7.7.7 0xC00D 0xFFFF Join 225.5.5.5 0xC00A 0xFFFF Join...
  • Page 155 Syntax: remote show Description: Shows the name of the Remote server and the user name used by the sRB-20210G to log on to the server. The password is not displayed for security reasons. remote show Syntax: Example: sRB-20210G-61f0> remote show...
  • Page 156 [update-file-dir] Syntax: Where: update-file-dir is the directory of the image that is on the remote server. Example: sRB-20210G-61f0# update software /10 GbE Gateway-install/version-1.3 ***************************************************************** Ftp server ip : 172.25.0.16 Ftp download dir : /10 GbE Gateway-install/version-1.3 Package file : 10 GbE Gateway-upgrade.pkg...

  • Page 157: Statistics Mode

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Do you want to continue the install procedure ? [y/n] y Getting Software image from remote server..uptime Description: Displays the current time, how long the system has been running, how many users are currently logged on, and the system load averages..
  • Page 158 1 192.168.2.0 255.255..255.0 any any tunneling active 1 Note that in this example, the log number is 1 (n=1) Expected result: sRB-20210G-61f0(statistic)# log show counter tx total pack tx total byte rx total pack rx total byte |------|-------------|-------------|-------------|-------------- 2733553 268066596...

  • Page 159: Configuration (Config) Commands

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual tx-reset Description: Resets the tx counters of the specific log. tx-reset [counter] Syntax: Example: sRB-20210G-61f0(statistic)# log show counter tx total pack tx total byte rx total pack rx total byte |-------|--------------|--------------|--------------|-----------...
  • Page 160 Syntax: policy Description: Changes to Policy mode. policy Syntax: port ‎ Description: Changes to Port Configuration mode. Refer to Section 1 4.6.5 for a list of commands available in this menu. port Syntax: Mellanox Technologies...
  • Page 161 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual remote ‎ Description: Changes to Remote Configuration mode. Refer to Section 1 4.6.6 for a list of commands available in this menu. remote Syntax: route ‎ Description: Changes to Route Configuration mode. Refer to Section 1 4.6.7 for a...

  • Page 162: Cluster Options

    Syntax: 14.6.1 Cluster Options A cluster may include several gateways. The sRB-20210G supports both High availability (load balancing in active-active fashion) and failover. Note that the active-active feature is currently available in limited functionality. The following are the commands available in the Cluster Mode.
  • Page 163 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual cluster priority set cluster priority set [priority [0-255]] cluster id set cluster id set [ID [0-255]] cluster show cluster show cluster mode set cluster mode set [disable, enable] cluster box-id set cluster box-id set [box ID 0x0 –...
  • Page 164 Description: Sets the load balancing algorithm [active-active, master-standby] The traffic can be balanced between the sRB-20210G according to the load balancing algorithm. Options: active-active, master-standby Default: active-active active-active – means that all sRB-20210G in the cluster transfer packets master-standby –...
  • Page 165 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual active-active Expected results: sRB-20210G-61f0(config-cluster)# cluster show cluster configuration ----------------------- mode : enable loop prevention : full priority : 100 join cluster automatically : yes load balancing algorithm : active-active hash table algorithm...
  • Page 166 : 224.0.0.77 cluster id cluster priority set Description: Changes the gateway active-active priority. cluster priority set [priority [0-255]] Syntax: Example: sRB-20210G-61f0(config-cluster)# cluster priority set 1 Expected results: sRB-20210G-61f0(config-cluster)# cluster show cluster configuration ----------------------- mode : enable Loop prevention : full...
  • Page 167 192.168.2.2 cluster id set Description: Changes the gateway cluster id (For Loop Prevention Manual mode). cluster id set [priority [1-255]] Syntax: Example: sRB-20210G-61f0(config-cluster)# cluster id set 1 Expected results: sRB-20210G-61f0(config-cluster)# cluster show cluster configuration ----------------------- mode : enable Loop prevention...

  • Page 168: Diagnostics

    Displays the system memory and CPU utilization. system-utilization show Description: Displays the system memory and CPU utilization. system-utilization show Syntax: Example: sRB-20210G-61f0(config-diagnostics)# system-utilization show Total memory 235916 kbytes. Free memory 58056 kbytes. Memory utilization : 24.61%. CPU idle 99%.
  • Page 169 InfiniBand Partition 0x8057. The IP address of the interface is 172.55.55.5 and the subnet mask is 255.255.255.0. Note that the default pkey is 65535. The pkey value should be given in hexadecimal format. The user must first hand out this pkey to the sRB-20210G from the Switch.
  • Page 170 P1-42 interface vlan set Description: Updates the VLAN of an interface. Syntax: interface vlan set [alias] [tag - no,[0-4094]] Example: sRB-20210G-61f0(config-if)# interface vlan set Net 101 Expected result: sRB-20210G-61f0(config-if)# interface show all entry alias mask broadcast vlan pkey(hex) trunk |-----|------------|----------------|----------------|----------------|----|---------|----...

  • Page 171: Ntp Options

    LAG mode is: full LAG 14.6.4 NTP Options The NTP menu allows you to configure NTP (Network Time Protocol). The NTP menu allows sRB-20210G clock synchronization with a managing Switch. The following commands are available under the NTP menu. 10G-Card(config-ntp)# ? <command> ? Displays the command's usage string.
  • Page 172 13) Pacific/Gambier 14) Pacific/Nauru 15) Pacific/Niue 16) Pacific/Honolulu 17) Pacific/Norfolk 18) Pacific/Marquesas 19) Pacific/Palau 20) Pacific/Efate 21) Pacific/Kwajalein 22) Pacific/Saipan 23) Pacific/Samoa 24) Pacific/Chatham 25) Pacific/Yap 26) Pacific/Tongatapu 27) Pacific/Kosrae 28) Pacific/Port_Moresby 29) Pacific/Ponape 30) Pacific/Pitcairn 31) Pacific/Wallis Mellanox Technologies...

  • Page 173: Port Options

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual 32) Pacific/Wake 33) Pacific/Galapagos 34) Pacific/Kiritimati 35) Pacific/Enderbury 36) Pacific/Pago_Pago 37) Pacific/Funafuti 38) Pacific/Fiji 39) Pacific/Midway 40) Pacific/Rarotonga 41) Pacific/Tahiti 42) Pacific/Easter 43) Pacific/Noumea 44) Pacific/Guam 45) Pacific/Auckland 46) Pacific/Majuro 47) Pacific/Truk...
  • Page 174 Description: Set the Ethernet port’s MTU Syntax: port ethernet set mtu [1..2] [disable,enable] [1500,9216] Example: sRB-20210G-61f0(config-port)# port ethernet set 1 disable mtu 1 1500 sRB-20210G-61f0(config-port)# port ethernet set 1 mtu 2 enable 9198 Expected results: sRB-20210G-61f0(config-port)# port ethernet show port...
  • Page 175 1500 1000000 enable port ib set mtu Description: port ib set mtu Syntax: port ib set mtu [1500,2048] Example: sRB-20210G-61f0(config-port)# port ib set mtu 2048 Expected results: sRB-20210G-61f0(config-port)# port ib show port status speed(Gbps) |------|--------------|--------------|-------------- active 2048 port ib show...
  • Page 176 Version 2.0 Command Line Interface (CLI) Management port statistics reset [port [1..2]] Syntax: Example: sRB-20210G-61f0(config-port)# port statistics reset 1 port statistics show Description: provides detailed statistics for each port. port statistics show Syntax: The following table describes the port types listed by the command:...

  • Page 177: Remote Options

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Example: sRB-20210G-61f0(config-port)# port statistics show Type: port1 port2 |-------------|-----------|---------- total tx: 4294967295 4294967295 vlan tx: 4294967295 4294967295 frag tx: 4294967295 4294967295 ip-option tx: 4294967295 4294967295 unicast tx: 4294967295 4294967295 arp/rarp tx: 4294967295 4294967295...
  • Page 178 [file-name]. flash show flash show. Password password protocol set protocol set [FTP | SCP] remote show remote show server server [ip-address] username username [username] The following details the commands available under the Remote menu. Mellanox Technologies...
  • Page 179 This example shows how you restoring from the local disk a repository by the name JonhnDoe by copying it to a backup file and then using it for restoring the configuration. sRB-20210G-61f0(config-remote)# copy flash: JohnDoe running-config New Configuration will take place after Reboot...
  • Page 180 Example 2: JohnDoe In this case, we are running this command with the backup file name ( sRB-20210G-61f0(config-remote)# copy running-config flash: JohnDoe Successed to create the file: JohnDoe. Example 3: If you have already two repository backups, you will get the following message if you want to create another one.
  • Page 181 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Gateway_12_11_2008-01-21_IP_172.30.106.18.new. exportLog Description: Uploads relevant logs and information to the remote server, using the previously defined server name, user name, and password. exportLOGs [remote path] Syntax: Example: sRB-20210G-61f0(config-remote)# exportLOGs /pub/ flash delete Description: Deletes the specific file from flash.
  • Page 182 P12345586 <- will be displayed as ***** protocol set Description: Sets the protocol to access the remote server. protocol set [FTP | SCP] Syntax: Example: sRB-20210G-61f0(config-remote)# protocol set SCP remote show Description: Shows the protocol used to access the remote server. remote show Syntax: Example:...

  • Page 183: Route Options

    Sets the default gateway IP address for the defined interface. default-gw set [row [1..10]][Gateway][Iface] Syntax: Examples: The following example shows how to configure the default gateway of the sRB-20210G. sRB-20210G-61f0(config-route)# default-gw set 2 smb-mng 172.30.0.1 NOTE: smb-mng is the sRB-20210G managing interface though which the Switch accesses the sRB-20210G.

  • Page 184: Security Options

    Description: Sets the static route. static-route set [row [1..10]] [Destination][netmask] Syntax: [Gateway][Iface] where Iface is the interface name. Example: sRB-20210G-61f0(config-route)# static-route set 3 192.73.0.0 255.255.0.0 172.30.0.1 smb-mng static-route show Description: Shows all static routes. static-route show Syntax: Example:...
  • Page 185 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual console show Shows console enable/disable option. Ends the CLI. exit Exits to previous menu. ftpd set Changes ftpd option. ftpd show Shows ftpd option. telnetd set Enables/disables the telnetd option. telnetd show Shows the telnetd option status.

  • Page 186: Snmp Options

    Description: Provides the option to disable Telnet for security purposes. telnetd set [disable, enable] Syntax: Example: sRB-20210G-61f0(config-security)# telnetd set enable Change will be effective only after next reboot telnetd set Description: Show the telnetd status telnetd show Syntax:...
  • Page 187 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual snmp show Shows the SNMP properties. snmp trap-port show Shows the SNMP agent trap port. snmp udp-port show Shows the SNMP agent udp port. Usage: snmp cluster-monitor set snmp cluster-monitor set [string]...
  • Page 188 125.25.7.11 snmp community get Description: Sets the SNMP get community string. snmp community get [string] Syntax: Example: sRB-20210G-61f0(config-snmp)# snmp community get A123 Expected results: sRB-20210G-61f0(config-snmp)# snmp community show get community A123 set community private trap community trap Mellanox Technologies...
  • Page 189 (sRB-20210G Module) User Manual snmp community set Description: Sets the SNMP set community string. snmp community set [string] Syntax: Example: sRB-20210G-61f0(config-snmp)# snmp community set A42B Expected results: sRB-20210G-61f0(config-snmp)# snmp community show get community A123 set community A42B trap community trap snmp community trap Description: Sets the SNMP trap community.
  • Page 190 Command Line Interface (CLI) Management snmp description set Description: Sets the SNMP description. snmp location set [description] Syntax: Example: sRB-20210G-61f0(config-snmp)# snmp description set H1 snmp description show Description: Displays version information on the SNMP agent in the Switch. snmp description show Syntax: Example:...
  • Page 191 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual snmp set Description: Enables/disables the SNMP set commands. snmp set [enable, disable] Syntax: Example: sRB-20210G-61f0(config-snmp)# snmp set enable snmp show Description: Shows the SNMP configuration information. snmp show Syntax: Example: sRB-20210G-61f0(config-snmp)# snmp show...

  • Page 192: Traffic Flow Manager (Tfm)

    Version 2.0 Command Line Interface (CLI) Management 14.6.10 Traffic Flow Manager (TFM) The commands available under the TFM mode are listed below: sRB-20210G-61f0(config-tfm)# ? <command> ? Displays the command's usage string. Displays the list of available commands. Ends the CLI.
  • Page 193 Note that Source-ip-mask and Dest-ip-mask must be bitwise masks. Example: rules add 6 192.168.3.1 255.255.255.0 192.168.3.200 255.255.255.0 if0 any tunneling 3 In the above example, assume that a packet arrives at the sRB-20210G with source IP of 192.168.3.1 192.168.3.200 and destination IP of .
  • Page 194 1 rules update destination Description: Updates the TFM destination rules. rules update destination [row Syntax: [1..1000]][Dest-ip,any][Dest-ip-mask,any] Example: sRB-20210G-61f0(config-tfm)# rules update destination 2 any any Expected results: sRB-20210G-61f0(config-tfm)# rules show entry Source Source-mask Dest Dest-mask Interface Service Routing Status Log...
  • Page 195 2 rules update source Description: Updates the TFM source rules. rules update source [row [1..1000]] Syntax: [Source-ip,any][Source-ip-mask,any] Example: sRB-20210G-61f0(config-tfm)# rules update source 2 any any Expected results: sRB-20210G-61f0(config-tfm)# rules show entry Source Source-mask Dest Dest-mask Interface Service Routing Status Log...
  • Page 196 ICMP services. The name is the user-defined ICMP service name. service add ICMP [type|any][name] Syntax: Example: sRB-20210G-61f0(config-service)# service add ICMP any V1 Expected results: sRB-20210G-61f0(config-service)# service show entry name protocol Sport Dport...
  • Page 197 Otherwise, the service will apply to TCP packets arriving and outgoing on all ports. The name parameter is the user-defined service name. service add TCP [Sport|any][Dport|any][name] Syntax: Example: sRB-20210G-61f0(config-service)# service add TCP 80 30 aviTcp Expected results: sRB-20210G-61f0(config-service)# service show entry name protocol Sport Dport...
  • Page 198 Note that you can only change the Sport or Dport of the row of a UDP or TCP protocol. (The rules matching the updated service will be updated accordingly). service update Dport [row][Dport] Syntax: Example: sRB-20210G-61f0(config-service)# service update Dport 4 10 Expected results: sRB-20210G-61f0(config-service)# service show entry name protocol Sport Dport...
  • Page 199 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Example: sRB-20210G-61f0(config-service)# service update Dport 4 8 Expected result: sRB-20210G-61f0(config-service)# service show entry name protocol Sport Dport type |------|---------------------------|---------|---------|--------- |------- icmp8 ICMP icmp0 ICMP TCP1 service update name Description: Modifies the service name.

  • Page 200: Safe Mode Cli Commands

    Description: Displays the usage string of the specified command. ? <command> Syntax: ip-address Description: Sets the IP addresses of the gateway (sRB-20210G) Ethernet or InfiniBand interface ip-address <ib/eth> <ip> <mask> Syntax: show ip Description: Displays the gateway Ethernet and InfiniBand IP addresses and subnet mask.
  • Page 201 Syntax: import Description: Imports the configuration via FTP. import <filename> <server-ip> [ <username> <password>] Syntax: telnet Description: Opens a Telnet session. telnet Syntax: reboot Description: Reboots the sRB-20210G; this command is required after performing various operations. reboot Syntax: Mellanox Technologies...

  • Page 202: Software Upgrade Procedure In Safe Mode

    Software Upgrade Procedure in Safe Mode This procedure restores the image file, using the software located in the specified directory of the designated FTP server. Set the sRB-20210G IP address using the ip-address <eth/ib> <ip> <mask> command, Step 1 as shown in the example below.

  • Page 203: Cli Safe Mode

    10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual Ftp server ip : <ip> 14.9 CLI Safe Mode Safe Mode provides a minimal set of CLI commands that allows the user to reinstall a valid image into the gateway in the event that the system software image is corrupt. This set of commands is used as a last recourse.
  • Page 204 Properties retrieved from a specific LID Local Area Network LID Mask Control Management Information Base Maximum Transmission Unit Pkey Partition Key RARP Reverse Address Resolution Protocol RDMA Remote Direct Memory Access Receive Sport Source Port Small Form Factor Pluggable Subnet Manager Mellanox Technologies...
  • Page 205 10 GbE Gateway Version 2.0 (sRB-20210G Module) User Manual SNMP Simple Network Management Protocol sRBD Router Blade Drawer sRB-20210G Mellanox InfiniBand-to-10 GbE Gateway, 10G, 10 GbE, router. Transmission Control Protocol Traffic Flow Management Transmit User Datagram Protocol Mellanox Device Manager...

Table of Contents