Summary of Contents for Chelsio Communications Terminator 5
Page 2
IMPLIED WARRANTIES MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE USE OF THE SOFTWARE AND ANY ASSOCIATED MATERIALS (COLLECTIVELY THE “SOFTWARE”) IS SUBJECT TO THE SOFTWARE LICENSE TERMS OF CHELSIO COMMUNICATIONS, INC. Chelsio (India) Private Limited Chelsio Communications (Headquarters) Subramanya Arcade, Floor 3, Tower B 209 North Fair Oaks Avenue, No.
Page 3
Document History Version Revision Date 1.3.6 11/19/2015 1.3.7 12/11/2015 1.3.8 01/28/2016 1.3.9 03/04/2016 1.4.0 04/21/2016 1.4.1 05/13/2016 1.4.2 06/27/2016 1.4.3 07/25/2016 1.4.4 07/29/2016 1.4.5 08/16/2016 1.4.6 08/26/2016 1.4.7 10/14/2016 Chelsio T5 Unified Wire for Windows...
Network and Storage related requirements. The Terminator 5 (T5) is Chelsio’s next generation of highly integrated, hyper-virtualized 40/10GbE controllers. The T5 is built around a programmable protocol-processing engine, with full offload of a complete Unified Wire solution comprising NIC, TOE, iWARP RDMA, iSCSI, FCoE and NAT support.
Chapter I. Chelsio Unified Wire 1.2. Hardware Requirements The Chelsio T5 Unified Wire supports all x64 architectures supporting PCIE (x4, x8) slots. AMD CPUs, 64-bit (x86_64/amd64) Intel CPUs, 64-bit (x86_64) The Chelsio Unified Wire supports 3.3v PCI bus only. Running an adapter on a Note PCI x4 slot is not recommended as performance will be significantly reduced by the limitations of PCI.
Chapter I. Chelsio Unified Wire 2. Hardware Installation Shutdown/power off your system. ii. Power off all remaining peripherals attached to your system. iii. Unpack the Chelsio adapter and place it on an anti-static surface. iv. Remove the system case cover according to the system manufacturer’s instructions. v.
Chapter I. Chelsio Unified Wire 3. Software/Driver Installation Chelsio Unified Wire can be installed using the Installer or the zip package. Refer the relevant section below depending on the method of installation selected. 3.1. Prerequisites Please ensure that the following requirements are met, before proceeding with the installation: Unified Wire Installer Download and install the latest Microsoft Visual C++ Redistributable Packages for Visual Studio (x86 and x64).
Chapter I. Chelsio Unified Wire 3.2. Unified Wire Installer Chelsio Unified Wire Installer provides two methods of installation: GUI or CLI mode. GUI mode provides an interactive GUI installer with customizable options. Whereas, CLI mode enables unattended installation of Chelsio drivers and software thereby relieving the user from monitoring the installation process and providing input via dialog boxes.
Page 13
Chapter I. Chelsio Unified Wire iii. Select the radio button I accept the terms of the license agreement and click Next. Figure 2 - Chelsio EULA window iv. Now, either select Complete for complete package installation or else select Custom radio button to customize the installation.
Page 14
Chapter I. Chelsio Unified Wire Figure 4 - Customizing the installation v. Click Install to start the installation. Figure 5 - Start installation Chelsio T5 Unified Wire for Windows...
Page 15
Chapter I. Chelsio Unified Wire vi. Selected driver components will now be installed. Figure 6 - Installation in progress vii. After successful installation of driver(s), the Unified Wire Manager installer will be invoked. Click Next for the Chelsio End User License Agreement Window. Figure 7 - UM installer welcome window Chelsio T5 Unified Wire for Windows...
Page 16
Chapter I. Chelsio Unified Wire viii. Select the radio button I accept the terms of the license agreement and click Next. Figure 8 - Chelsio EULA window ix. The next window will display the prerequisites for various UM components. Ensure that they are met before proceeding.
Page 17
Chapter I. Chelsio Unified Wire x. Now, either select Complete for complete package installation or else select Custom radio button to customize the installation. The Custom option provides the option to change the installation path and which UM components to install. Click Next. If Management Station is selected, please make sure that all related prerequisites Note are met before proceeding (See Prerequisites) or else the component will be skipped...
Page 18
Chapter I. Chelsio Unified Wire Figure 11 - Changing UM installation path Figure 12 - Selecting UM components to install Chelsio T5 Unified Wire for Windows...
Page 19
Chapter I. Chelsio Unified Wire xi. Click Install to start the installation. Unified Wire Manager will now be installed with the selected options. Figure 13 - Starting UM installation xii. Click Finish to exit from the UM Installer. Figure 14 - Finishing UM installation Chelsio T5 Unified Wire for Windows...
Page 20
Chapter I. Chelsio Unified Wire xiii. Click Finish to exit from the Unified Wire Installer. Figure 15 - Finishing Unified Wire installation CLI mode (Silent Installation) To install drivers/software using this feature, open command prompt and execute the following command: C:\Users\Administrator>ChelsioUwire-x.x.x.xx.exe –in <driver(s)>...
Chapter I. Chelsio Unified Wire To know more about other parameters and options, execute the following command: C:\Users\Administrator>ChelsioUwire-x.x.x.xx.exe -help The above command will create a help file, ChelsioUwire-x.x.x.xx_help.txt, in the present working directory which contains the complete list of command line syntax required for performing all the necessary CLI operations.
Chapter I. Chelsio Unified Wire 3.4. Zip Package Chelsio Unified Wire zip package provides two methods of installation: Manual and using Offline Windows Image. In Manual method, the driver components will have to be individually installed using the Device Manager. Using the second method, you can add Chelsio driver components to an offline OS image.
Page 23
Chapter I. Chelsio Unified Wire v. Click Next and driver installation will progress. Click Finish once the installation is complete. NDIS Miniport driver Open Device Manager (Control Panel -> System & Security-> System -> Device Manager), click on Network Adapters, right click on the Chelsio network adapter and select Update Driver Software.
Page 24
Chapter I. Chelsio Unified Wire iii. Determine the index number of image file. C:\Windows\system32>dism /get-wiminfo /wimfile:<path>\NanoServer.wim iv. Mount the image file: C:\Windows\system32>dism /mount-wim /wimfile:<path>\NanoServer.wim /index:<index_number> /mountdir:<mount_directory> v. Copy the Microsoft OEM driver set package from NanoServer\Packages folder in the ISO to your hard drive and add it to the image file: C:\Windows\system32>dism /image:<path>\<mount_directory>...
Page 25
Chapter I. Chelsio Unified Wire viii. Finally, add the image file to WDS server and install Nano Server (with Chelsio drivers) using PXE boot. ix. The Nano Server machine will reboot. In case of non-WHQLed drivers, run the following command to enable test signing and Note reboot the machine again: [nanomachine-ip]: PS D:\>...
Chapter I. Chelsio Unified Wire 4. Configuring Chelsio Network Interfaces In order to test Chelsio adapters’ features, it is required to use at least two machines, each with Chelsio’s network adapters. These machines can be connected directly (back-to- back) or with a switch. 4.1.
Page 27
Chapter I. Chelsio Unified Wire Zip Package: PS D:\ChelsioUwire-x.x.x.xx\Adapter Configuration> .\chelsio_adapter_config.ps1 Figure 17 - Adapter configuration utility (zip package) iv. Enter the index of the 40G adapter for which the configuration needs to be updated. Hit [Enter]. Figure 18 - Selecting adapter v.
Page 28
Chapter I. Chelsio Unified Wire Nano Server Machine (Nano Server Installer & Zip Package) Connect to Nano Server Machine. ii. In case of Nano Server Installer, the configuration script and cxgbnano.exe utility will be copied to <system_drive>\Windows\System32 during installation. If you are using the zip package, copy cxgbnano.exe from ChelsioUwire-x.x.x.xx folder to <system_drive>\Windows\System32 and change your working directory to ChelsioUwire- x.x.x.xx\Adapter Configuration.
Chapter I. Chelsio Unified Wire v. Select Port settings (option 3) as the configuration type. Hit [Enter]. Figure 24 - Port settings vi. Select the operation mode and then enter y to confirm. Figure 25 - Operation mode vii. Determine the Instance ID of the adapter using the Get-PnpDevice command: Figure 26 - Adapter instance IDs viii.
Page 30
Chapter I. Chelsio Unified Wire iv. From the Internet Protocol (TCP/IP) Properties window, assign an IP Address (e.g. 192.169.1.10) and subnet mask (e.g. 255.255.255.0). v. Click on Ok and close on the other window. vi. Check to see if you can ping to some other address on this subnet. Chelsio T5 Unified Wire for Windows...
Chapter I. Chelsio Unified Wire 5. Mass Deployment (Installer) Using Unified Wire Installer’s Mass Deployment feature, you can flash or erase Option ROM on multiple systems (nodes) simultaneously. The Installer utilizes Unified Wire Manager’s Agent and Client components to implement this feature. The Client component has to be installed on the host machine and the Agent component on the remote nodes.
Page 32
Chapter I. Chelsio Unified Wire StartOfNonCluster <IPAddress1>:<user1>:<Password1> <IPAddress2>:<user2>:<Password2> <IPAddress3>:<user3>:<Password3> <IPAddressN>:<userN>:<PasswordN> EndOfNonCluster iii. Open the configuration file and provide the following values: a. Enter absolute path of the shared location where installer is copied to, for the ExecutablePath parameter. b. Provide user credentials for the User and Password parameters of the machine where Installer was copied to.
Chapter I. Chelsio Unified Wire 5.2. Flashing Option ROM Unified Wire Installer will flash Option ROM onto the first Chelsio adapter Important present in remote node (adapter with index 0. See Configuring using UM CLI to determine adapter index). Hence, ensure that you either use a non-Chelsio adapter for corporate/private network or ensure that the Chelsio adapter used is not installed as first on remote nodes.
Page 34
Chapter I. Chelsio Unified Wire Deploying UM components and Flashing Option ROM together Run the following command to invoke the UM installer. PS C:\Users\Administrator> .\ChelsioUwire-x.x.x.xx.exe -action flashoptionrom -config <config_file.txt> ii. Click the Next button for the Chelsio End User License Agreement Window. Figure 28 - UM Installer welcome window Chelsio T5 Unified Wire for Windows...
Page 35
Chapter I. Chelsio Unified Wire iii. Select the radio button I accept the terms of the license agreement and click Next. Figure 29 - Chelsio EULA window iv. The next window will display the pre-requisites for various UM components. Ensure that they are met before proceeding.
Page 36
Chapter I. Chelsio Unified Wire v. Now, select Custom radio button to customize the installation. Click Next. Figure 31 - UM prerequisites window vi. The next window will display the location where UM will be installed by default. You can change the location by using the Change button or click Next to continue with the default path.
Page 37
Chapter I. Chelsio Unified Wire vii. Next, ensure that only Client is selected under features to be installed. Click Next. Figure 33 - Selecting UM components viii. Click Finish to complete Client installation. Figure 34 - Finishing UM installation Chelsio T5 Unified Wire for Windows...
Page 38
Chapter I. Chelsio Unified Wire ix. Now, installation of UM Agent component on remote nodes will commence. Figure 35 - Starting Agent installation x. Click Agree on the PsExec License Agreement window that appears. This window will appear only during first installation. Figure 36 - PsEXec license agreement Chelsio T5 Unified Wire for Windows...
Page 39
Chapter I. Chelsio Unified Wire xi. UM Agents will now be installed on remote nodes. A default group OptionROM will be created and all the nodes on which UM Agent was successfully installed, will be added to it as members. Figure 37 - Agent installation on remote nodes Please ensure that the OptionROM group created here is not deleted.
Page 40
Chapter I. Chelsio Unified Wire Deploying UM components and Flashing Option ROM separately Deploying UM Components Run the following command to invoke the Unified Wire Installer. PS C:\Users\Administrator> .\ChelsioUwire-x.x.x.xx.exe -action deployagent –config <config_file.txt> ii. Follow steps (ii)-(xi) in the Deploying UM components and Flashing Option ROM together section.
Chapter I. Chelsio Unified Wire iii. Follow steps xii and xiii in the Deploying UM components and Flashing Option ROM together section. Flashing option ROM on remote nodes with inbox NDIS drivers will fail. Hence, please Note ensure that all nodes are updated to the latest version using the Unified Wire Installer. 5.3.
Note location where UM Client is installed. Typically, this will be C:\Program Files (x86)\Chelsio Communications\UnifiedWireManager\client. To avoid this and run the command from any path, you will need to reboot the host. The following examples assume that the host machine was rebooted before running commands.
Page 43
Chapter I. Chelsio Unified Wire Add member to group To add a member to a group, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe –m addmember grpname=<group_name> details=”<IP_address>;<user_id>;<password>;*;*,*,<adapter_index>,*,*,*,*,*>” E.g. PS C:\Users\Administrator> chelsio_uwcli.exe –m addmember grpname=OptionROM details=”10.193.185.107;administrator;cdrom888;*;*,*,0,*,*,*,*,*>” Figure 46 - Adding member to group View group and member details To view details of all the groups and members created, run the following command: PS C:\Users\Administrator>...
Page 44
Chapter I. Chelsio Unified Wire Delete member from a group To delete a member from a group, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe –m deletemember grpname=<group_name> index=<member_index> E.g. PS C:\Users\Administrator> chelsio_uwcli.exe –m deletemember grpname=OptionROM index=1 Figure 48 - Deleting member from group Delete Group To delete a group, run the following command: PS C:\Users\Administrator>...
Page 45
Chapter I. Chelsio Unified Wire Flashing Option ROM To flash Option ROM using UM, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe chelsio flashrom adapter=BULKADAPTER path=<path_to_optionrom_image_file> –B <group_name> E.g. PS C:\Users\Administrator> chelsio_uwcli.exe chelsio flashrom adapter=BULKADAPTER path=C:\Users\Administrator\Desktop\cuwlbt4.bin –B OptionROM Figure 50 - Flashing option ROM using UM CLI Flashing option ROM on remote nodes with inbox NDIS drivers will fail.
Page 46
Chapter I. Chelsio Unified Wire Figure 51 - Viewing status Erasing Option ROM To erase Option ROM using UM, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe chelsio eraserom adapter=BULKADAPTER force=1 –B <group_name> In addition to flashing and erasing Option ROM, you can perform additional bulk operations on remote nodes like setting MTU and VLAN ID, changing adapter and port parameters, etc.
Page 47
Chapter I. Chelsio Unified Wire Help To view Unified Wire Manager’s CLI help, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe –m Chelsio T5 Unified Wire for Windows...
Chapter I. Chelsio Unified Wire 6. cxgbtool/cxgbnano help The cxgbtool (cxgbnano for Nano Server) command queries or sets various aspects of Chelsio network interface cards. It complements standard tools used to configure network settings and provides functionality not available through such tools. Some of the commands provided can be used to query running statistics to aid in debugging.
Page 50
Chapter I. Chelsio Unified Wire filter Description: Displays list of configured hardware filters Syntax: cxgbtool [nicInterface] filter Example: loadfw Description: Loads firmware image. Syntax: cxgbtool [vbdInterface] loadfw [firmwareImage] The Firmware input file used must be a binary and not a header file. Note Example: loadcfg...
Page 51
Chapter I. Chelsio Unified Wire loadphy Description: Loads phy firmware. Syntax: cxgbtool [vbdInterface] loadphy [phyFile] Example: loadboot Description: Flashes the Option ROM image. Syntax: cxgbtool [vbdInterface] loadboot [bootImageFile] [pf {0|1|2|…|7}|offset {val}|clear] Parameters: pf{val}: Flash Option ROM image to the offset defined by the PFs EXPROM_OFST in the serial configuration.
Page 52
Chapter I. Chelsio Unified Wire Example: Loading boot configuration file: Clearing the flash area: mdio Description: Reads/writes MDIO register. Syntax: cxgbtool [vbdInterface] mdio [physicalAddress][manageableDevicesAddress][registerAddress] [(writeValue)] Example Read MDIO register Write MDIO register currently not supported. Note Chelsio T5 Unified Wire for Windows...
Page 53
Chapter I. Chelsio Unified Wire meminfo Description: Displays memory info. Syntax: cxgbtool [vbdInterface] meminfo Example: mtus Description: Prints hardware MTU table. Syntax: cxgtool [vbdInterface] mtus Chelsio T5 Unified Wire for Windows...
Page 54
Chapter I. Chelsio Unified Wire Example: qsets Description: Reads # of qsets Syntax: cxgbtool [nicInterface] qsets Example: qstats Description: Displays statistics for each Tx & Rx queue. Syntax: cxgbtool [nicInterface] qstats [queueType [(clr)]] Queue Type parameters: txeth: Tx tunnel queue statistics. rxeth: Rx tunnel queue statistics.
Page 55
Chapter I. Chelsio Unified Wire Example of rxeth qstats: Description: Reads/writes register. Syntax: Register Read: cxgbtool [vbdInterface] reg [readAddress] Register Write: cxgbtool [vbdInterface] reg [[writeAddress] = {val}] Example: Register read: Register write: regdump Description: Displays registers of a hardware module. Not specifying any parameter will display registers for all the modules.
Page 56
Chapter I. Chelsio Unified Wire Display registers for specific module: cxgbtool [vbdInterface] regdump [registerModule] Table 1 – T5 register module parameters Module Parameter Description Scatter-Gather DMA Engine common register set. PCI Express Interface common register set. This module implements the PCI-Express SR-IOV physical logical, data link, and transaction layers.
Page 57
Chapter I. Chelsio Unified Wire System Management Bus common register set. This module implements an SMBus Master/Slave for system management. I2C-Bus Master common register set. This module implements an I2C- Bus Master for PHY management and I/O expansion. MI common register set. This module implements an MDIO Master for PHY management.
Page 58
Chapter I. Chelsio Unified Wire Displaying specific (mps) module registers: Description: Reads hardware TCP Control Block, which contains details regarding all offloaded connections. Syntax: cxgbtool [nicInterface] tcb [tid] Example: Chelsio T5 Unified Wire for Windows...
Page 61
Chapter I. Chelsio Unified Wire dumpctx Description: Displays adapter context. Syntax: cxgbtool [nicInterface] dumpctx Example: version Description: Displays the adapter Part Number, Serial Number, Device ID, Firmware Version, TP, NDIS Driver version, and VBD version. Syntax: cxgbtool [vbdInterface] version Example: Chelsio T5 Unified Wire for Windows...
Page 62
Chapter I. Chelsio Unified Wire fwtoc Description: Converts firmware binary file to source file header. Syntax: cxgbtool [vbdInterface] fwtoc [firmwareFile] filename= [CFileName].bin Example: inst Description: Installs driver package specified in the setup information file (.inf). Syntax: cxgbtool [vbdInterface] inst [infFilePath] force Example: unins Description: Uninstalls driver package specified in the setup information file (.inf).
Page 63
Chapter I. Chelsio Unified Wire update Description: Updates driver package. Syntax: cxgbtool update [infFile] Example: rescan Description: Scans for hardware changes in the device manager. Syntax: cxgbtool [vbdInterface] rescan all Example: trace Description: Enables driver debug prints. Syntax: trace [nicInterface|vbdInterface] trace [nic|vbd] [(flags)][(level)] Example: seeprom Use this option with caution.
Page 64
Chapter I. Chelsio Unified Wire The seepromFile should be in binary format (.bin). Note Example: Read SEEPROM data: Write SEEPROM data: Verify SEEPROM data: serialinit Use this option with caution. Incorrect usage may render the adapter useless. Important Description: Reads/Writes serialinit data. Syntax: Read serialinit data to a bin file: cxgbtool [vbdInterface] serialinit read Display serialinit data in console: cxgbtool [vbdInterface] serialinit dump...
Page 65
Chapter I. Chelsio Unified Wire Example: Read serialinit data Write serialinit data Verify serialinit data Use this option with caution. Incorrect usage may render the adapter useless. Important Description: Reads/writes VPD data. Syntax: Read VPD data: cxgbtool [vpdInterface] vpd read Write VPD data to serial EEPROM on chip: cxgbtool [vpdInterface] vpd write [vpdFile] The vpdFile should be in binary format (.bin).
Page 66
Chapter I. Chelsio Unified Wire Write VPD Data: vpdparams Description: Displays the adapters Serial Number, Device ID, EC, Core Clock, Part Number, and Network Address (MAC). Syntax: cxgbtool [vbdInterface] vpdparams Example: Description: Traces the Ingress and Egress path of a packet through the Chelsio adapter. Syntax: cxgbtool [vbdInterface] wtp Example: Chelsio T5 Unified Wire for Windows...
Page 67
Chapter I. Chelsio Unified Wire stats Description: Prints MAC statistics for a given port or TP MIB statistics. Syntax: cxgbtool [vbdInterface] stats [mac{portInstance}|mib] Example: Chelsio T5 Unified Wire for Windows...
Page 68
Chapter I. Chelsio Unified Wire cpl_stats Description: Displays CPL Request and Response Statistics for all channels. Syntax: cxgbtool [vbdInterface] cpl_stats Example: debugfs Description: When used in conjunction with other options, debugfs displays useful information regarding Chelsio adapters. Syntax: cxgbtool [vbdInterface] debugfs [option] debugfs options: ...
Page 71
Chapter I. Chelsio Unified Wire Example: ddp_stats Description: Displays DDP(Direct Data Placement) statistics. Syntax: cxgbtool [vbdInterface] debugfs ddp_stats Example: edc0 Description: Redirects EDC0 memory details to a file. Syntax: cxgbtool [vbdInterface] debugfs edc0 [fileName] It is recommended that the fileName be provided without any extension. Note Example: ...
Page 72
Chapter I. Chelsio Unified Wire Example: flash Description: Redirects Flash memory details to a file. Syntax: cxgbtool [vbdInterface] debugfs flash [fileName] It is recommended that the fileName should be provided without any extension. Note Example: ibq_tp Description: Displays CIM TP inbound queue. Syntax: cxgbtool [vbdInterface] debugfs ibq_tp[{0|1}] Example: Chelsio T5 Unified Wire for Windows...
Page 74
Chapter I. Chelsio Unified Wire ibq_ncsi Description: Displays CIM NCSI inbound queue. Syntax: cxgbtool [vbdInterface] debugfs ibq_ncsi Example: Description: Redirects MC memory details to a file. Syntax: cxgbtool [vbdInterface] debugfs mc[{0|1}] [dumpFileName] Example: It is recommended that the dumpFileName should be provided without any extension. Note ...
Page 80
Chapter I. Chelsio Unified Wire tid_info Description: Displays TID info. Syntax: cxgbtool [nicInterface] debugfs tid_info Example: tx_rate Description: Displays TX rate for NIC and offload traffic. Syntax: cxgbtool [vbdInterface] debugfs tx_rate Example: ulprx_la Description: Dumps ULP RX LA. Syntax: cxgbtool [vbdInterface] debugfs ulprx_la Example: Chelsio T5 Unified Wire for Windows...
Page 81
Chapter I. Chelsio Unified Wire cudbg Description: Collects and processes Chelsio adapter debug logs. Syntax: cxgbtool [vbdInterface] debugfs cudbg [operation] [entity] [outfile][(optionalParams)] Examples: o Collecting debug log for all entities o Collecting debug log skipping specific debug entities o Collecting debug log avoiding entities that can affect running traffic o Displaying debug log on the screen.
Page 82
Chapter I. Chelsio Unified Wire o Displaying debug log on the screen skipping specific entities Chelsio T5 Unified Wire for Windows...
Page 83
Chapter I. Chelsio Unified Wire o Displaying summary of debug log present in a compressed dump file on screen Chelsio T5 Unified Wire for Windows...
Page 84
Chapter I. Chelsio Unified Wire o Extracting the compressed debug log in a human readable format to the specified path Chelsio T5 Unified Wire for Windows...
Page 85
Chapter I. Chelsio Unified Wire o Extracting the compressed debug log in a human readable format to the specified path skipping specific entities Chelsio T5 Unified Wire for Windows...
Page 86
Chapter I. Chelsio Unified Wire o Displaying debug log on the screen without storing them in any file. devlog Description: Prints firmware device log information. Syntax: cxgbtool [vbdInterface] devlog Example: Chelsio T5 Unified Wire for Windows...
Page 87
Chapter I. Chelsio Unified Wire Description: Prints RSS info. Syntax: cxgbtool [vbdInterface] rss Example: rss_config Description: Prints RSS Configuration. Syntax: cxgbtool [vbdInterface] rss_config Example: Chelsio T5 Unified Wire for Windows...
Page 88
Chapter I. Chelsio Unified Wire rss_key Description: Prints RSS Key. Syntax: cxgbtool [vbdInterface] rss_key Example: rss_pf_config Description: Prints RSS PF Configuration Syntax: cxgbtool [vbdInterface] rss_pf_config Example: rss_vf_config Description: Prints RSS VF Configuration. Syntax: cxgbtool [vbdInterface] rss_vf_config Example: Chelsio T5 Unified Wire for Windows...
Page 89
Chapter I. Chelsio Unified Wire coalesce Description: Changes the coalescing settings for tunnel Rx queues of the specified Ethernet device. nicInterface cxgbtool [ ] coalesce [ {val}] [ {val}] [(persistent)] Syntax: rx-usecs-irq rx-frames-irq Parameters rx-usecs-irq: Rx Coalescing Timer. Number of microseconds after which interrupt will be sent. rx-frames-irq: Rx Coalescing Threshold Packets.
Page 90
Chapter I. Chelsio Unified Wire rdma_stats Description: Prints RDMA statistics if NDK/ND is enabled Syntax: cxgbtool [nicInterface] rdma_stats Example: stags Description: Prints STAG contents if NDK/ND is enabled. Syntax: cxgbtool [nicInterface] stags Example: Chelsio T5 Unified Wire for Windows...
Page 91
Chapter I. Chelsio Unified Wire chim_sock Description: Prints chimney statistics. Syntax: cxgbtool [nicInterface] chim [tcb {tid}|sock] tcb: Prints Hardware TCB information for given tid of an offloaded connection. sock: Prints driver per socket statistics. Currently not supported. Note Description: Displays l2t table contents. Syntax: cxgbtool [nicInterface] l2t Example: hw_sched...
Page 92
Chapter I. Chelsio Unified Wire mbox_log Description: Prints firmware mailbox command/reply log information. Syntax: cxgbtool [vbdInterface] mbox_log Example: Chelsio T5 Unified Wire for Windows...
Chapter I. Chelsio Unified Wire 7. Firmware Update The driver will auto-load the T5 firmware if an update is required. The firmware version can be verified using cxgbtool: C:\Users\Administrator>cxgbtool nic0 version In case of installer, the firmware binaries will be copied to <system_drive>\ChelsioUwire \Firmware\ folder during installation.
Chapter I. Chelsio Unified Wire 8. Software/Driver Uninstallation Similar to installation, Chelsio Unified Wire can be uninstalled using the Installer or zip package. Refer the relevant section depending on the method of installation used to install drivers. 8.1. Installer Chelsio Unified Wire Installer can be uninstalled using two methods: GUI or CLI mode. GUI mode requires user interaction and uninstallation occurs with options specified by the user.
Page 95
Chapter I. Chelsio Unified Wire iii. Click on the Finish button to exit from the installer. Figure 54 - Finishing uninstallation This method of uninstallation is possible only if the drivers were installed using Note Unified Wire Installer. Uninstalling Unified Wire package using the above method will not uninstall Unified Wire Manager.
Chapter I. Chelsio Unified Wire 8.2. Zip Package If the driver components were installed using the zip package, they will have to be uninstalled manually. The following section lists the various components and their respective methods of uninstallation. The driver components need to be uninstalled strictly in the order described Important here.
Chapter I. Chelsio Unified Wire 9. Software/Driver Update For any distribution specific problems, please check README and Release Notes included in the release for possible workaround. Please visit Chelsio Download Center, http://service.chelsio.com/, for regular updates on various software/drivers. You can also subscribe to our newsletter for the latest software updates. Chelsio T5 Unified Wire for Windows...
Chapter II. NDIS Function 1. Introduction Chelsio’s T5 series of Unified Wire adapters provide extensive support for NIC operation, including all stateless offload mechanisms for both IPv4 and IPv6 (IP, TCP and UDP checksum offload, LSO - Large Send Offload aka TSO - TCP Segmentation Offload, Network Direct and assist mechanisms for accelerating LRO - Large Receive Offload).
Chapter II. NDIS Function 2. Software/Driver Configuration and Fine-tuning 2.1. Advanced Configuration The Chelsio network driver provides advanced configuration options under the Device Properties. In the Network Connections window, select the Chelsio adapter’s Local Area Connection interface (right-click -> properties). Click the Configure button. VBD Driver Parameters To see all tunable VBD driver parameters, open the Device Manager, click on the System Devices, double click on the Chelsio T5 40G/10G Bus Enumerator, and then click the...
Page 101
Chapter II. NDIS Function Default: 0 Flow Control Description: Enable or disable the receipt or transmission of PAUSE frames. If Rx is enabled, all incoming PAUSE frames will be honored. If Tx is enabled, the HW will send PAUSE frames when its MAC Rx FIFO usage is beyond a high-watermark.
Page 102
Chapter II. NDIS Function Default: Rx & Tx Enabled Jumbo Packet (Maximum Transmission Unit) Description: Specify the Maximum Transmission Unit (MTU) value. Value: o 4088 Bytes o 9014 Bytes o Disabled Default: Disabled Large Send Offload V2 (IPv4) ...
Page 103
Chapter II. NDIS Function NDIS QoS Description: Enable or disable NDIS Quality of Service for DCB interface. Value: Disabled | Enabled Default: Disabled NetworkDirect Functionality Description: Enable or disable Network Direct Functionality. Value: Disabled | Enabled ...
Page 104
Chapter II. NDIS Function Receive Side Scaling (RSS) Description: Control the RSS functions. If on, the Microsoft RSS function is enabled. If off, the Chelsio RSS function is enabled. Value: Disabled | Enabled Default: Enabled Recv Segment Coalescing (IPv4) ...
Page 105
Chapter II. NDIS Function Rx Offload Queue Size Description: Set different Offload Rx Queue sizes. Driver ships with reasonable defaults. Value: 256-2048 Default: 512 This feature is not fully tested and available for experimental usage only. Note SR-IOV ...
Page 106
Chapter II. NDIS Function UDP Checksum Offload (IPv4) Description: Enable or disable computation of UDP checksum by the adapter for IPv4 packets. Value: o Disabled o Rx & Tx Enabled o Rx Enabled o Tx Enabled Default: Rx & Tx Enabled UDP Checksum Offload (IPv6) ...
Chapter II. NDIS Function Value: Disabled | Enabled Default: Enabled VMQ VLAN ID Filtering Description: Enable or disable the ability to filter network packets by using the VLAN identifier in the media access control (MAC) header. Value: Disabled | Enabled ...
Page 108
Chapter II. NDIS Function adapter. Virtual RSS or vRSS solves this bottleneck by distributing the network traffic across multiple virtual processors. This feature is enabled by default. Chelsio T5 Unified Wire for Windows...
Chapter III. iWARP (ND) 1. Introduction ND or Network Direct is Microsoft's new Remote Direct memory Access (RDMA) interface for high speed, low-latency networks such as those running on 40/10 Gigabit Ethernet or InfiniBand, with an architecture that directly bypasses OS and TCP/IP overhead. ND achieves better performance for massively parallel programs that can utilize very low-latency, high-bandwidth, and enables efficient CPU utilization.
Chapter III. iWARP (ND) 2. Software/Driver Configuration and Fine-tuning 2.1. Registering iWARP(ND) driver Chelsio Unified Wire Installer registers Chelsio iWARP provider automatically during installation. In case of zip package, run the following command to register: C:\Users\Administrator>chinstallsp.exe -i The iWARP provider should show up using: C:\Users\Administrator>chinstallsp.exe -l You should see a similar output: 0000001019 - Chelsio Network Direct provider...
RDMA as a transport medium for SMB, unprecedented levels of performance and efficiency can be achieved. With fully offloaded RDMA support, Terminator 5 based adapters deliver large performance and efficiency gains to Windows users in a seamless, plug and play fashion.
Chapter IV. SMB Direct 4. Software/Driver Configuration and Fine-tuning 4.1. Enabling SMB Direct Server 2016/2012 R2 SMB Direct is installed and enabled by default on Windows Server 2016 and 2012 R2 versions. RDMA functionality on Chelsio adapters will be enabled after installing the driver from the package.
Chapter IV. SMB Direct 4.3. RDMA/NVGRE concurrent (Mode 2) In this mode, you can run RDMA traffic using a virtual switch. This feature is enabled by default in the driver, but must be enabled on the Hyper-V Virtual Ethernet adapter. Follow the steps mentioned below to enable the feature: If you haven’t done already, run the Chelsio Unified Wire Installer which will install NDIS function driver.
Chapter IV. SMB Direct Figure 59 - Verifying RDMA on virtual switch 4.4. Troubleshooting If RDMA is not working in your system, please check for the following: Operating system version should be Windows Server 2016, 2012 R2 or 10 AU Client. ...
Chapter V. NDIS SR-IOV 1. Introduction The ever increasing network infrastructure of IT enterprises has led to a phenomenal increase in maintenance and operational costs. IT managers are forced to acquire more physical servers and other data center resources to satisfy storage and network demands. To solve the Network and I/O overhead, users are opting for server virtualization which consolidates I/O workloads onto lesser physical servers thus resulting in efficient, dynamic and economic data center environments.
Chapter V. NDIS SR-IOV 2. Software/Driver Configuration and Fine-tuning Please ensure that Unified Wire is installed on the host before proceeding. Refer Software/Driver Installation section of the Chelsio Unified Wire chapter for step-by-step instructions. 2.1. Enabling SR-IOV The adapter's configuration should be updated to make use of the SR-IOV Important feature.
Page 120
Chapter V. NDIS SR-IOV Figure 61 - Adapter configuration utility (Installer) Zip Package: PS D:\ChelsioUwire-x.x.x.xx\Adapter Configuration> .\chelsio_adapter_config.ps1 Figure 62 - Adapter configuration utility (Zip Package) iv. Enter the index of the adapter for which the configuration needs to be updated. Hit [Enter]. Figure 63 - Selecting adapter v.
Page 121
Chapter V. NDIS SR-IOV Nano Server (Nano Server Installer & Zip Package) Connect to Nano Server Machine. ii. Check if the machine is SR-IOV capable using the following command: [nanomachine-ip]: PS C:\> Get-VMHost | fl *iov* The IovSupport field should display “True” as shown in the image below: Figure 65 - Checking SR-IOV capability iii.
Chapter V. NDIS SR-IOV Figure 66 - Adapter configuration utility viii. Enter the index of the Chelsio adapter for which the configuration needs to be updated. Hit [Enter]. Figure 67 - Selecting adapter ix. Select SRIOV (option 2) as the configuration type and enter y to confirm. Hit [Enter]. Figure 68 - Setting the configuration type x.
Chapter VI. Data Center Bridging (DCB) 1. Introduction Data Center Bridging (DCB) refers to a set of bridge specification standards, aimed to create a converged Ethernet network infrastructure shared by all storage, data networking and traffic management services. An improvement to the existing specification, DCB uses priority-based flow control to provide hardware-based bandwidth allocation and enhances transport reliability.
Chapter VI. Data Center Bridging (DCB) 2. Software/Driver Configuration and Fine-tuning 2.1. Installing DCB To install DCB on the host machine, open PowerShell with administrative privileges and run the following command: PS C:\Users\Administrator> Install-WindowsFeature -Name "Data-Center- Bridging" -IncludeAllSubFeature -IncludeManagementTools Although not mandatory, it is recommended to reboot the machine after installation. 2.2.
Chapter VI. Data Center Bridging (DCB) Using PowerShell Open PowerShell with administrative privileges and run the following command: PS C:\Users\Administrator> Get-NetAdapterRdma | where {$_.InterfaceDescription -like "Chelsio*"} | Enable-NetAdapterQos' Verifying QoS To verify if QoS is enabled, use the PowerShell command Get-NetAdapterQos and observe the results.
Page 127
Chapter VI. Data Center Bridging (DCB) iii. Set DCBx version to auto: Force10(conf-lldp)#dcbx version auto iv. Specify the intervals between hello packets: Force10(conf-lldp)#hello 5 v. Create a DCB map. For example, here we are configuring 2 groups/classes: Group 0 has BW of 80% with pfc enabled. ...
Page 128
Chapter VI. Data Center Bridging (DCB) Verifying To verify remote and operational QoS configurational parameters, run the Get-NetAdapterQos command on the host machine. You should see a similar output: PS C:\Users\Administrator> Get-NetAdapterQos Name : Chelsio_p1 Enabled : True Capabilities Hardware Current -------- -------...
Chapter VII. Unified Wire Manager (UM) 1. Introduction Chelsio's Unified Wire Manager is a powerful management software tool, allowing you to view and configure different aspects of the system, including Chelsio hardware installed in the system. The software includes a command line interface (CLI) tool and a web management interface (Web GUI) to help you manage all Chelsio network adapter cards on the network across multiple operating systems.
Chapter VII. Unified Wire Manager (UM) 1.2. Reference Architecture Chelsio’s Web GUI is a web-based management interface that lets you remotely manage several Chelsio CNAs from anywhere, at any time on the network using a web browser. The Web GUI provides a great amount of flexibility, efficiency and accessibility to system administrators in managing the Network and SAN.
Chapter VII. Unified Wire Manager (UM) CLI Client The CLI Client (chelsio_uwcli) is an executable binary which allows you to manage and configure agents using the command-line interface. It is not a command shell with a prompt; it accepts all command parameters as arguments when launching it, making it script-friendly.
Chapter VII. Unified Wire Manager (UM) 2. Hardware and Software 2.1. Supported Adapters Following are the currently shipping Chelsio adapters that are compatible with Chelsio Unified Wire Manager: T580-CR T580-LP-CR T580-SO-CR T540-CR T520-CR T520-LL-CR T520-SO-CR 2.2. Platform/Component Matrix The table below lists the Windows versions and the supported UM components. Table 3 - Supported UM components Version/Distribution Supported UM Components...
Chapter VII. Unified Wire Manager (UM) 3. Installation (Zip Package) This section describes the procedure to install UM. This is applicable only for zip package since the Unified Wire installer will install UM by default. If an older version of the software exists, the installer will upgrade it to the version provided in the package.
Page 135
Chapter VII. Unified Wire Manager (UM) iii. Select the radio button I accept the terms of the license agreement and click Next. Figure 71 - Chelsio EULA window iv. The next window will display the pre-requisites for various UM components. Ensure that they are met before proceeding.
Page 136
Chapter VII. Unified Wire Manager (UM) v. Now, either select Complete for complete package installation or else select Custom radio button to customize the installation. Click Next. Figure 73 - Select setup (installation) type a. If you selected Custom, the next window will display the location where UM will be installed by default.
Page 137
Chapter VII. Unified Wire Manager (UM) b. Next, you can choose the UM components you wish to install. Deselect the components you don’t wish to install and click Next. Figure 75 - Selecting UM components to install If Management Station is selected, please make sure that all related prerequisites Note are met before proceeding (See Pre-requisites) or else the component will be skipped during installation.
Page 138
Chapter VII. Unified Wire Manager (UM) vii. Select Finish to exit the UM Installer. Figure 77 - Finishing UM installation Chelsio T5 Unified Wire for Windows...
Chapter VII. Unified Wire Manager (UM) 4. Configuration 4.1. Configuring Management Station Follow the steps mentioned below to configure Apache Server and SSL certificate. Apache HTTP Server Assuming that Apache HTTP Server 2.2 is installed at the default location, append the following lines in C:\Program Files (x86)\Apache Software Foundation\Apache2.2\Conf\httpd.conf ScriptAlias /python/ "C:/Program Files (x86)/Apache Software...
Page 140
Chapter VII. Unified Wire Manager (UM) cd "C:\Program Files (x86)\Apache Software Foundation\Apache2.2\conf" ..\bin\openssl req -config openssl.cnf -new -out blarg.csr -keyout blarg.pem ..\bin\openssl rsa -in blarg.pem -out blarg.key ..\bin\openssl x509 -in blarg.csr -out blarg.crt -req -signkey blarg.key - days 365 ii. Browse to the following location: C:\Program Files (x86)\Apache Software Foundation\Apache2.2\conf\extra\ iii.
Chapter VII. Unified Wire Manager (UM) 5. Verifying UM components status The following section explains how to verify status of various UM components. 5.1. Verifying Management Agent On the system running Management Agent, launch Services from the Control Panel. You can also type services.msc in the Run command.
Chapter VII. Unified Wire Manager (UM) 5.2. Verifying Management Client Execute the following query command to determine if Management Client is installed: C:\Users Administrator>chelsio_uwcli.exe -V The above query should confirm that Management Client is installed by displaying a similar result: Unified Manager client CLI version : 2.x.yy 5.3.
Chapter VII. Unified Wire Manager (UM) 6. Management Agent 6.1. Communication The agent uses a TCP connection over IP to communicate with the client. After the connection is established, SSL (Secure Sockets Layer) encryption is enabled using the Open SSL libraries. The agent listens on a TCP port for new incoming connections from clients.
Chapter VII. Unified Wire Manager (UM) 7. CLI client 7.1. CLI Help system A detailed help and usage documentation is built into the CLI, and is accessible through its help system. The help can be invoked by the usual argument of /? or --help. Viewing help Open command prompt by typing cmd in the Run command.
Chapter VII. Unified Wire Manager (UM) 8. Web GUI client 8.1. Management Station In order to access the Web Management Interface, start the Apache HTTP server, if it’s not running already. Also, Cookies and Javascript must be enabled in the browser. Running Management Station Launch Services from the Control Panel.
Chapter VII. Unified Wire Manager (UM) 8.2. Accessing Web Management Interface To access the Web GUI, type in the URL https://<management station IP address> in a web browser. ii. The security certificate used by the web server is a generic one. It may cause the following types of prompts in different browsers.
Page 147
Chapter VII. Unified Wire Manager (UM) Figure 85 - Security Certificate prompt in Apple Safari Figure 86 - Security Certificate prompt in Google Chrome iii. The web interface requires password authorization to be accessed. Enter the administrator/root credentials that were set up on the management station system and click on the Login button.
Chapter VII. Unified Wire Manager (UM) 8.3. Layout and Navigation The Web Management Interface consists of the following: Title bar displaying the username on the left, Unified Wire Manager logo and name in the centre; and a Logout button on the right. ...
Chapter VII. Unified Wire Manager (UM) 8.4. Home page The home page is displayed by default on launching the Web GUI. It displays Bookmarks and History, Service Discovery and Bulk Driver Installation modules. Options to go back to home page, add/remove system, refresh and configure email alerts are also available. Home This option will display the home page.
Page 150
Chapter VII. Unified Wire Manager (UM) Connecting to a system Select the system from the Bookmark list and click Connect. Once successfully connected, the system will appear on the left pane with different related modules on the right to view and manage. ...
Page 151
Chapter VII. Unified Wire Manager (UM) Bulk Driver Installation This module allows you to install drivers for multiple systems simultaneously. Drivers available for installation for a particular system may differ depending on the network adapter (T5, T4 or T3) and operating system selected. ...
Page 152
Chapter VII. Unified Wire Manager (UM) Add System Use this option to connect to new Agents using their IP or Hostname. The TCP port for connection is by default 35001. You will have to provide correct user credentials for the agent in order to connect successfully.
Page 153
Chapter VII. Unified Wire Manager (UM) Refresh This option can be used to reload the Web GUI or UM Agent. To reload the Web GUI, navigate to the Home page (by clicking on the “Home” button and click Refresh. You can use this option to refresh Home page panes (Bookmarks and History, Service Discovery and Bulk Driver Installation).
Page 154
Chapter VII. Unified Wire Manager (UM) Bulk Configuration The Bulk Configuration page allows you to execute common configuration changes to multiple agents and their network adapters simultaneously. You can conveniently perform bulk operations like installing option ROM, setting MTU and VLAN ID, changing adapter and port parameters on various devices, without having to access multiple modules and thus saving considerable amount of administration time.
Page 155
Chapter VII. Unified Wire Manager (UM) Figure 95 - Creating a group Figure 96 - Managing a group Boot Configuration Using this module, you can install option ROM or erase option ROM on Chelsio network devices. The Set Default Boot Settings button will reset the adapter to factory boot settings. Figure 97 - Boot Configuration module Chelsio T5 Unified Wire for Windows...
Page 156
Chapter VII. Unified Wire Manager (UM) Network Configuration In the Network Configuration module, you can set Maximum Transfer Unit (MTU),Virtual LAN (VLAN) ID and change the IP address type for the members (network interfaces) of the Network group. MTU can be set between 1500-9000 bytes. VLAN id can be set for an adapter within the range 0-4094 (enter 0 to disable it).
Chapter VII. Unified Wire Manager (UM) Port Configuration In the Port Configuration module, you can set various port settings like enabling Tx checksum and TCP segmentation offload, setting Link speed and link duplex mode, etc. The settings depend on the device driver installed. Figure 100 - Port Configuration module Chelsio T5 Unified Wire for Windows...
Page 158
Chapter VII. Unified Wire Manager (UM) Bypass Configuration Use the Bypass Configuration module to configure Chelsio’s bypass adapters like B420-SR and B404-BT. Figure 101 - Bypass Configuration module Chelsio T5 Unified Wire for Windows...
Chapter VII. Unified Wire Manager (UM) 8.5. System page The system page is displayed, when the system hostname / IP address is selected in the tree menu on the left. On adding a system, this item is automatically selected, and this page is displayed.
Page 160
Chapter VII. Unified Wire Manager (UM) Driver Details A list of Chelsio device drivers with related information like driver description, version, current load status and installation date is shown in this module. To load or unload a particular driver, select the appropriate option (Yes to load, No to unload) in the corresponding cell of the Loaded column and click Load/Unload Driver button.
Page 161
Chapter VII. Unified Wire Manager (UM) System Diagnostics Using this module, you can run various diagnostic tests on Chelsio adapters to troubleshoot adapter related issues. Select the adapter(s) from the list for which you want to run the test, select the operation (type of test;...
Page 162
Chapter VII. Unified Wire Manager (UM) Unified Wire Manager Component Versions A list of the Unified Wire Manager agent components installed on the managed system is shown in this module. The versions of the components are useful in case of reporting an issue to support. Figure 106 - Unified Wire Manager Component Versions module VM Configurations The VM Configurations module allows you to view UUID and Power and Health state of Virtual...
Chapter VII. Unified Wire Manager (UM) Managed system application logs The management agent logs its activities and any errors that occur, in /var/log/chelsio in Linux and FreeBSD and in the Event log, in Windows. This log can be obtained in this module. Only 20 entries can be obtained and viewed at a time.
Page 164
Chapter VII. Unified Wire Manager (UM) Chelsio card page When a Chelsio card is selected in the tree menu on the left, this page is displayed. It provides details of the card and associated settings. It also displays any card specific statistics that the hardware provides.
Page 165
Chapter VII. Unified Wire Manager (UM) TCP Offload settings (Linux & FreeBSD) The TCP offload settings applicable to the card are shown here. These settings are only available when using the TOE capable drivers (t3_tom and toecore for T3 cards; t4_tom and toecore for T4 cards).
Page 166
Chapter VII. Unified Wire Manager (UM) Device Driver settings (Windows) The device driver settings applicable to the card are shown here. For Chelsio T5 and T4 adapters, only the MaxVMQueues field will be displayed. On changing the settings, the changed settings may not reflect immediately on refreshing the data.
Chapter VII. Unified Wire Manager (UM) Port summary The port details such as the Ethernet adapter name and link details are shown in this module. Figure 114 - Port Summary of T4 CNA Port settings Port settings such as MTU, Link speed and others can be set in this module. The settings depend on the device driver installed.
Page 168
Chapter VII. Unified Wire Manager (UM) Port statistics Ethernet statistics and additional hardware statistics for the port are displayed in this module. Figure 116 - Port Statistics of T4 CNA on Windows Agent Networking Management page The system networking configurations are shown on this page. IP addresses, MTU, VLAN Ids, DNS and default gateway settings can be viewed and modified here.
Page 169
Chapter VII. Unified Wire Manager (UM) stack. Maximum Transfer Unit (MTU) can be set between 1500-9000 bytes. VLAN id can also be set for an adapter within the range 0-4094 (enter 0 to disable it). You can use the View/Set IP addresses option to add, modify or delete IP aliases. Figure 117 - System network configuration module Figure 118 - Managing IP aliases System network statistics...
Page 170
Chapter VII. Unified Wire Manager (UM) Figure 119 - System network statistics module Figure 120 - Network Throughput Vs Time instant Graph Chelsio T5 Unified Wire for Windows...
Page 171
Chapter VII. Unified Wire Manager (UM) Figure 121 - Network Throughput Vs Time instant Table Default Gateway and DNS configuration The DNS servers list can be set here. The default gateway for remote networks and the Internet can also be set here. On Linux and FreeBSD, only one default gateway is allowed. On Windows, you may set multiple default gateways.
Page 172
Chapter VII. Unified Wire Manager (UM) team may be created with a DHCP or Static IP address. Please check with the driver documentation for the supported modes for creating a team / bond, with offload enabled Chelsio cards. All modes may not be available with all configurations / combinations. Also, the team members can only be 2 ports of a single offload-enabled card, and not across Chelsio cards.
Page 174
Chapter VII. Unified Wire Manager (UM) 8.6.3.1. Hypervisor Virtual Network Manager This module allows you to view and manage virtual networks. The left pane displays a list of different virtual networks created. Clicking on a virtual network name will display related properties on the right.
Page 175
Chapter VII. Unified Wire Manager (UM) Private Network: A Private Network is similar to Internal Network in that physical adapter is not required for setup and access to external networks is not provided. However, unlike Internal Network, guest operating systems can only communicate with guest operating systems in the same private network and not with the host.
Page 176
Chapter VII. Unified Wire Manager (UM) iWARP iWARP Settings On Linux Agents, iWARP parameter settings for Chelsio's RDMA capable NICs can be set using this module. These settings can be set only when iWARP driver (iw_cxgb4 for T4 and T5; iw_cxgb3 for T3) is loaded.
Page 177
Chapter VII. Unified Wire Manager (UM) Figure 132 - iWARP settings for T4 CNA for FreeBSD Agent Chelsio T5 Unified Wire for Windows...
Chapter VII. Unified Wire Manager (UM) Figure 133 - iWARP settings for T4 CNA for Linux Agent 8.7. Storage Storage Summary The Storage module lists the status of configuration modules under Storage section, running on the agent. Figure 134 - Storage Summary Module Chelsio T5 Unified Wire for Windows...
Page 179
Chapter VII. Unified Wire Manager (UM) FCoE Initiator (Linux, Windows, XenServer) All supported Chelsio FCoE initiators available on the operating system can be managed from this page. FCoE support is extended on Linux, Windows and XenServer platforms. Please refer Platform/Driver Matrix section on the list of operating systems that are supported.
Page 180
Chapter VII. Unified Wire Manager (UM) FCoE Attributes Information such as Interrupt modes (MSI/MSI-X/INTx), SCSI mode and the card state are provided in this module. Figure 137 - FCoE Attributes module 8.7.1.2. FCoE Port This is an actual N_Port which communicates with the fabric and performs FIP and FCoE device discovery.
Page 181
Chapter VII. Unified Wire Manager (UM) Figure 139 - FCoE Port Attributes module for Linux Agent FCoE NPIV management NPIV is a fibre channel facility allowing multiple N_Port IDs to share a single physical N_Port. This module allows the user to manage virtual ports on the corresponding FCoE Port. To create a virtual port, select the option Create and the GUI allows two ways of creating a virtual port.
Page 182
Chapter VII. Unified Wire Manager (UM) Figure 140 - FCoE NPIV management module 8.7.1.3. FCoE Remote Port Remote ports are the SCSI targets that are discovered by their respective N_port/virtual ports. The GUI conveys the same via a tree structure so that the end user knows the initiator-target mapping.
Page 183
Chapter VII. Unified Wire Manager (UM) FCoE Remote Port Lun Details This module provides the LUN information such as size of the LUN, SCSI address, and LUN address. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format. Figure 142 - FCoE Remote Port Lun Details module 8.7.1.4.
Page 184
Chapter VII. Unified Wire Manager (UM) FCoE Virtual Port Attributes The module provides details about link status and port identifiers such as WWPN, WWNN, FC ID and Virtual NPort MAC Address. The module also contains fabric information such as fabric name, VLAN on which the FCoE service is currently running and the number of SCSI targets that are being discovered by this virtual port.
Page 185
Chapter VII. Unified Wire Manager (UM) FCoE Remote Port Lun Details This module provides LUN information for remote port associate with virtual port. Details such as size of the LUN, SCSI address, and LUN address are provided. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format.
Page 186
Chapter VII. Unified Wire Manager (UM) Figure 147 - Open iSCSI initiator Figure 148 - Microsoft iSCSI initiator Chelsio T5 Unified Wire for Windows...
Page 187
Chapter VII. Unified Wire Manager (UM) Figure 149 - Chelsio iSCSI initiator Discover targets iSCSI targets can be discovered by providing the IP address and TCP port (usually 3260) of the target. The discovery operation fetches the targets found at that Portal (combination of IP address and TCP port).
Page 188
Chapter VII. Unified Wire Manager (UM) Figure 150 - Discover targets module Targets The iSCSI targets that have been discovered, or are currently connected, are listed here. You may login, logout and delete the target from the initiator's configuration. If a target is connected, the sessions and connections to the target, and the disks provided by the target will be listed.
Page 189
Chapter VII. Unified Wire Manager (UM) FO iSCSI Initiator (Linux) Full Offload iSCSI Hardware Information PCI, firmware and other adapter related details are provided in this module. Select the Chelsio adapter for which you want to view properties from the Select a T4 Card drop-down list and the module will expand to display related properties.
Page 190
Chapter VII. Unified Wire Manager (UM) The Port Up and Port Down buttons will enable and disable the selected port respectively. The Clear IP button deletes values set for the IP Type, IP, Subnet Mask and Gateway properties and resets them. Figure 153 - FO iSCSI Manage Ports module Chelsio T5 Unified Wire for Windows...
Page 191
Chapter VII. Unified Wire Manager (UM) FO iSCSI Initiator Properties In the FO iSCSI Initiator Properties module, you can configure FO iSCSI Initiator by setting different properties like enabling/disabling CHAP authentication, setting Header and Data digest, etc. Figure 154 - FO iSCSI Initiator Properties FO iSCSI Manage Instances The FO iSCSI Initiator service maintains multiple instances of a target depending on the discovery method.
Page 192
Chapter VII. Unified Wire Manager (UM) Figure 155 - FO iSCSI Manage Instances module FO iSCSI Discover Details iSCSI Targets can be discovered using this module. Select a Chelsio adapter and initiator instance using which you want to discover targets. Next, provide the source (initiator) and destination (target) IP.
Page 193
Chapter VII. Unified Wire Manager (UM) FO iSCSI Session Details The FO iSCSI Session Details module can be used to log onto targets and view details of established iSCSI sessions. You can also logout from a target Use the Login section to connect to a target. Adapter, (initiator) instance, Target Name, Source (Initiator) IP, Destination (Target) IP and Destination Port are mandatory.
Page 194
Chapter VII. Unified Wire Manager (UM) After successful login, details of the established iSCSI session will be displayed under the Established sessions section. Select the adapter and session id. Details of the selected session will be displayed. To end the session, click Logout. Figure 158 - FO iSCSI Session Details module: Established Sessions Chelsio T5 Unified Wire for Windows...
Page 195
Chapter VII. Unified Wire Manager (UM) iSCSI Target page (Linux) This page allows to create new Targets and manage them (add/delete portals, add/delete LUNs, add/delete ACLs). It also provides information on Session details. Viewing and modifying Target properties is also available. The modules available on this page are as below: Target Stack Globals This module displays various global properties of a currently connected iSCSI target.
Page 196
Chapter VII. Unified Wire Manager (UM) Target properties Properties such as Target name and Alias, Max Data Receive Length, Authentication mode related to a specific iSCSI target can be viewed and modified here. iSCSI targets can be started/stopped or deleted. Figure 160 - Target properties module Chelsio T5 Unified Wire for Windows...
Page 197
Chapter VII. Unified Wire Manager (UM) Session details Details including Session ID, Initiator IQN and Connections List of all discovered and currently connected iSCSI targets are listed here. Figure 161 - Session Details module New Target Creation New iSCSI target can be created here by specifying the Target IQN and Target Alias name. Figure 162 - New Target Creation module Chelsio T5 Unified Wire for Windows...
Page 198
Chapter VII. Unified Wire Manager (UM) LUNs Various Logical Units created in an iSCSI Target can be managed here. The modules available on this page are as below: View/Edit iSCSI Target LUNs This module displays various Logical Units created in an iSCSI Target. Selected LUNs can be deleted.
Page 199
Chapter VII. Unified Wire Manager (UM) Add LUN New LUNs can be added here by providing various parameters like Target Name, Target Device and RAM Disk Size etc. RW (Read-Write) and RO (Read Only) are the two kinds of permissions that can be set.
Page 200
Chapter VII. Unified Wire Manager (UM) Portal Groups Portal details for currently connected iSCSI Targets can be viewed and added here. The modules available on this page are as below: View/Edit iSCSI Target Portals Portal List on the left displays details of the portal group on which an iSCSI target is listening and the related info is displayed on the right under Portal Details.
Page 201
Chapter VII. Unified Wire Manager (UM) Add Portal New Portals can be added here by choosing the specific target and Portal IP address. The Port number should be 3260. Figure 166 - Adding a new Portal ACLs ACLs configured for currently connected iSCSI Targets can be managed here. The modules available on this page are as below: View/Edit iSCSI Target ACLs This module displays details for all the ACLs configured for an iSCSI Target.
Chapter VII. Unified Wire Manager (UM) Add ACL New ACLs can be configured by specifying Target name, initiator IQN name, IP address and permission type. Figure 168 - Adding new ACL 8.8. Hardware Features The Hardware module lists the status of configuration modules under Hardware Features section, running on the agent.
Page 203
Chapter VII. Unified Wire Manager (UM) Filtering (Linux) Using this page, one can control the traffic from a specific IP. The module available on this page is as below: T3 Filtering configuration T3 Filtering options can be set only when offload driver (t3_tom) is not loaded. This module lists the various parameters which can be set while determining filtering options for a system IP.
Page 204
Chapter VII. Unified Wire Manager (UM) T4 Filtering configuration T4 Filtering options can be set only when offload driver (t4_tom) is not loaded. A list of pre-defined filter selection combinations is displayed. The combination fragmentation, mpshittype, protocol, vlan, port, fcoe is active by default. To select a different combination, highlight it in the Combinations list by clicking and click “Set Active Combination”.
Page 205
Chapter VII. Unified Wire Manager (UM) Traffic Management (Linux) Using this page, one can add/delete/modify offload policies only in the presence of offload driver (t3_tom for T3 adapters; t4_tom for T4 adapters). Traffic Management configuration The Chelsio Card section on the left displays all the cards available in the server and their corresponding policies on the right.
Page 206
Chapter VII. Unified Wire Manager (UM) Boot T4 Save Config File (Linux) This module displays the current T4 configuration tuning option selected. You can also change the tuning option by selecting the config file for each option located in /ChelsioUwire- x.x.x.xx/src/network/firmware.
Page 207
Chapter VII. Unified Wire Manager (UM) T3 iSCSI / T3 PXE Boot Option Rom Management (Linux) The Chelsio T3 card may be used for PXE or iSCSI boot. This module allows managing the boot capability. The Option ROM (PXE/iSCSI) may be installed to the card, or erased from the card. iSCSI boot Option ROM settings can be configured for the card here.
Page 208
Chapter VII. Unified Wire Manager (UM) T5/T4 Boot Option ROM management This module allows managing the PXE and FCoE boot capability for Chelsio T5 and T4 cards. The Option ROM (PXE and FCoE) may be installed to or erased from the card. The version of Option ROM flashed can be viewed here.
Page 209
Chapter VII. Unified Wire Manager (UM) T5/T4 Boot Configuration This module can be used to view and configure PXE and FCoE Option ROM settings for Chelsio T5 and T4 cards. PXE physical functions and order of ports for PXE boot can be selected here. The same module can be used to configure FCoE Option ROM.
Page 210
Chapter VII. Unified Wire Manager (UM) Figure 177 - FCoE Boot configuration for T4 CNAs Figure 178 - iSCSI Boot configuration for T4 CNAs Bypass (Linux) You can use the Bypass page to configure various settings for Chelsio’s bypass adapters like setting bypass operation mode, creating rules (filters), starting/stopping BA server, etc.
Page 211
Chapter VII. Unified Wire Manager (UM) The Watchdog timer is used to ensure that if there is a software failure, the switch will enter the default state. The Watchdog timeout value should be provided in milliseconds. Figure 179 - Bypass Configuration module Redirect Configuration In the Redirect Configuration module, you can set rules (filters), based on which the bypass adapter will redirect packets.
Page 212
Chapter VII. Unified Wire Manager (UM) In the Rules Configuration tab, you can add, delete and configure rules. Use the Add a Filter row button to add a new rule by specifying the rule id in the INDEX field and providing the required parameters.
Chapter VII. Unified Wire Manager (UM) T4 Egress Class Schedulers (Linux) Schedulers can be set only when T5/T4 network driver (cxgb4) is loaded. Egress Queue Map Using this module, you can bind (map) NIC (non-offloaded) Tx queues to Tx Scheduler classes. Figure 182 - Egress Queue Map module Egress Packet Scheduler Using this module you can configure different scheduler hierarchy levels (i.e.Class Rate Limiting,...
Page 215
Chapter VII. Unified Wire Manager (UM) This section describes the procedure to uninstall UM. For both installer and zip package, the application will have to be uninstalled manually. For Installer, open Programs and Features in the Control Panel. Double click on UnifiedWireManager.
Page 216
Chapter VII. Unified Wire Manager (UM) Figure 185 - Modifying UM components b. If you select Remove, you can uninstall the application completely. Click Next and then Yes to confirm. Figure 186 - Uninstalling UM iii. Click the Finish button to exit from the installer. Chelsio T5 Unified Wire for Windows...
Page 217
Chapter VII. Unified Wire Manager (UM) Figure 187 - Finishing uninstallation Chelsio T5 Unified Wire for Windows...
Chapter VIII. UM for Win PE 1. Introduction Chelsio UM for Win PE is a light-weight management tool developed for Windows PE (Windows Preinstallation Environment) platform and provides features to view and configure different aspects of the system, including Chelsio adapter installed. The tool provides command-line options to view system related information like list of drivers installed, Chelsio adapters present, etc.
Chapter VIII. UM for Win PE 1.2. Software Requirements Windows Requirement Currently Chelsio UM for Win PE is available for the following Windows version(s): Server 2012 R2 Windows Server 2012 R2 Other versions have not been tested and are not guaranteed to work. 1.3.
Page 221
Chapter VIII. UM for Win PE Figure 188 – ‘chelsio’ service commands syntax and usage Run the following command to view syntax and usage for a sub-command: X:\windows\system32>chelsio_uwlite.exe chelsio <sub-command> /? E.g. To view syntax and usage of EraseSettings sub-command under chelsio service: X:\windows\system32>chelsio_uwlite.exe chelsio erasesettings /? Chelsio T5 Unified Wire for Windows...
Page 222
Chapter VIII. UM for Win PE Figure 189 - 'EraseSettings' sub-command syntax and usage Flashing Option ROM Run the following command to list all Chelsio CNAs present in the system. The list displays a unique index for each CNA found. X:\windows\system32>chelsio_uwlite.exe chelsio listadapters Figure 190 - Listing Chelsio Adapters ii.
Page 223
Chapter VIII. UM for Win PE Figure 191 - Flashing option ROM Erasing Option ROM Run the following command to list all Chelsio CNAs present on the system. The list displays a unique index for each CNA found. X:\windows\system32>chelsio_uwlite.exe chelsio listadapters Figure 192 - Listing Chelsio Adapters ii.
IF YOU DO NOT AGREE TO THE TERMS OF THIS AGREEMENT, CLICK THE "DO NOT ACCEPT" BUTTON TO TERMINATE THE INSTALLATION PROCESS. 1. License. Chelsio Communications, Inc. ("Chelsio") hereby grants you, the Licensee, and you hereby accept, a limited, non-exclusive, non-transferable license to install and use the Software with one or more Chelsio network adapters on a single server computer for use in communicating with one or more other computers over a network.
Page 226
Chapter IX. Appendix HEREBY DISCLAIMS ALL OTHER WARRANTIES, INCLUDING, BUT NOT LIMITED TO, NON-INFRINGEMENT OF THIRD PARTY RIGHTS, MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. Some states do not allow the exclusion of implied warranties or limitations on how long an implied warranty may last, so the above limitations may not apply to you.
Page 227
Chelsio and any attempt to do so without such consent shall be void and shall constitute a material breach of this Agreement. Should you have any questions concerning this Agreement, you may contact Chelsio by writing to: Chelsio Communications, Inc. 209 North Fair Oaks Avenue, Sunnyvale, CA 94085 U.S.A...
Need help?
Do you have a question about the Terminator 5 and is the answer not in the manual?
Questions and answers