Chapter I. Chelsio Unified Wire 1. Introduction Thank you for choosing Chelsio T5/T4 Unified Wire adapters. These high speed, single chip, single firmware cards provide enterprises and data centers with high performance solutions for various Network and Storage related requirements.
PCI. 1.3. Software Requirements Chelsio T5/T4 Unified Wire has been developed to run on Windows based platforms. To know more about the complete list of versions supported by each driver/software, please refer to their respective sections. 1.4.
6. For maximum performance, it is highly recommended to install the adapter into a PCIE x8 slot. 7. Holding the Chelsio adapter by the edges, align the edge connector with the PCI connector on the motherboard. Apply even pressure on both edges until the card is firmly seated. It may be necessary to remove the SFP (transceiver) modules prior to inserting the adapter.
1. Open the Device Manager (Control Panel -> System & Security-> System -> Device Manager), click on the Network Adapters, right click on the Chelsio Network Adapter and select Update Driver Software. In case of Virtual Functions in VM, select Other Devices, right click on Chelsio Ndis Note Function.
Page 12
3.1.3. Generic Function 1. Open the Device Manager (Control Panel -> System & Security-> System -> Device Manager), click on the Network Adapters, right click on the Chelsio T5/T4 40G/10G Generic Function and select Update Driver Software. 2. Select Browse my computer for driver software.
Some of the commands provided can be used to query running statistics to aid in debugging. Definitions [nicInterface] is the name of the network device to work on, given in the format "nic[0,1,..n]" [vbdInterface] is the name of the Chelsio Bus Enumerator instance to work on, given in the format "vbd[0,1,...n]" Syntax...
Page 20
Transport Protocol Engine common register set. This module implements the main packet processing pipeline. ulp_rx Ingress Upper Layer Protocol common register set. This module implements the upper layer protocol processing in the ingress direction Chelsio T5/T4 Unified Wire for Windows...
Page 21
It interfaces to the external serial flash device. PIO Local Bus controller common register set. This module implements the PIO Local Bus controller. It is physically distributed across T4/T5. Lookup Engine Common register set. The Lookup Engine implements the connection, filter and ACL databases.
Page 22
Example: Displaying all available module registers: C:\Users\Administrator>cxgbtool vbd0 regdump [0x1e000] SGE_PF_KDOORBELL 31:15 QID 14:14 Priority 13:13 Type 12:0 PIDX [0x1e004] SGE_PF_GTS 31:16 IngressQID 15:13 TimerReg 12:12 SEIntArm 11:0 CIDXInc Chelsio T5/T4 Unified Wire for Windows...
Page 25
NIC DeviceID 5401 (T520-CR) NIC FW Version 1.14.4.0 NIC TP Version 0.1.4.8 Ndis Driver Version 5.5.11.0 VBD Version 5.5.11.0 fwtoc Description: Converts Firmware binary file to source file header. Syntax: cxgbtool [vbdInterface] fwtoc [firmwareFile] filename= [CFileName].bin Chelsio T5/T4 Unified Wire for Windows...
Page 27
Read SEEPROM data to a bin file: cxgbtool [vbdInterface] seeprom read Display SEEPROM data in console: cxgbtool [vbdInterface] seeprom dump Write SEEPROM data: cxgbtool [vbdInterface] seeprom write [seepromFile] Verify SEEPROM data: cxgbtool [vbdInterface] seeprom verify [seepromFile] Chelsio T5/T4 Unified Wire for Windows...
Page 28
Read serialinit data to a bin file: cxgbtool [vbdInterface] serialinit read Display serialinit data in console: cxgbtool [vbdInterface] serialinit dump Write serialinit data: cxgbtool [vbdInterface] serialinit write [initdataFile] Verify serialinit data: cxgbtool [vbdInterface] serialinit verify [initdataFile] Chelsio T5/T4 Unified Wire for Windows...
Page 29
Description: Reads/writes VPD data. Syntax: Read VPD data: cxgbtool [vpdInterface] vpd Write VPD data to serial EEPROM on chip: cxgbtool [vpdInterface] vpd [vpdFile] Example: Read VPD Data: C:\Users\Administrator>cxgbtool vbd0 vpd Write VPD Data: C:\Users\Administrator>cxgbtool vbd0 vpd vpd.bin Chelsio T5/T4 Unified Wire for Windows...
Page 30
Description: Displays the adapters Serial Number, Device ID, EC, Core Clock, Part Number, and Network Address (MAC) Syntax: cxgbtool [vbdInterface] vpdparams Example: C:\Users\Administrator>cxgbtool vbd0 vpdparams Serial Number : RE14130227 : T520-CR : 0000000000000000 Core Clock : 250000 : 11011605002 Network Addr : 000743047D60 Chelsio T5/T4 Unified Wire for Windows...
Page 31
Chapter I. Chelsio Unified Wire Description: Traces the Ingress and Egress path of a packet through the Chelsio adapter. Syntax: cxgbtool [vbdInterface] wtp Example: C:\Users\Administrator>cxgbtool vbd0 wtp 0x00000000 HIGH 0x00aa0000 0x0003f000 HIGH 0x00660022 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x0000eeee 0x00000000...
Page 32
Syntax: cxgbtool [vbdInterface] stats [mac{portInstance}|mib] Example: C:\Users\Administrator>cxgbtool vbd0 stats mac0 0x00000000 HIGH 0x00000066 0x0003f000 HIGH 0x00aa00ee 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x00000000 0x0070000b HIGH 0x0000eeee 0x00000013 HIGH 0x0000eeee 0x00000013 HIGH 0x001199cc 0x00000016 HIGH 0x00020491 0x0000000b Chelsio T5/T4 Unified Wire for Windows...
Page 34
Description: Displays results of CIM MA logic analyzer trace. Syntax: cxgbtool [vbdInterface] debugfs cim_ma_la Example: C:\Users\Administrator>cxgbtool vbd0 debugfs cim_ma_la 0000000000000000000000000000000000 0000000000000000000000000000000000 Cnt ID Tag UE Data RDY VLD 0 0000000000000000 0 0000000000000000 0 0000000000000000 0 0000000000000000 0 0000000000000000 0 0000000000000000 Chelsio T5/T4 Unified Wire for Windows...
Page 35
Retransmit min: 960 us Retransmit max: 9765440 us Persist timer min: 960 us Persist timer max: 9765440 us Keepalive idle timer: 7031116800 us Keepalive interval: 73240800 us Initial SRTT: 137437100448 us FINWAIT2 timer: 9765440 us Chelsio T5/T4 Unified Wire for Windows...
Page 36
C:\Users\Administrator>cxgbtool vbd0 debugfs edc0 edc0 cxgbtool: This may take a while. Please be patient cxgbtool: Reading MEM_EDC0 (0) memory of size 3145728 bytes cxgbtool: Writing memory block to file edc... cxgbtool: Done writing memory block to file edc0 Chelsio T5/T4 Unified Wire for Windows...
Page 47
Enable IPF Mask Mask IPv6 IPv4 Queue Map Chn Prt Map Size Size Four Two Four Two Four yes yes yes yes yes yes rss_vf_config Description: Prints RSS VF Configuration. Syntax: cxgbtool [vbdInterface] rss_vf_config Chelsio T5/T4 Unified Wire for Windows...
Page 48
Rx Coalescing Threshold Packets. Number of packets after which interrupt will be sent. Example: Setting Rx Coalescing Timer: C:\Users\Administrator>cxgbtool nic0 coalesce rx-usecs-irq 5 Setting Rx Coalescing Threshold Packets C:\Users\Administrator>cxgbtool nic0 coalesce rx-frames-irq 20 Description: Prints endpoints (eps) if NDK/ND is enabled. Syntax: cxgbtool [nicInterface] eps Chelsio T5/T4 Unified Wire for Windows...
Page 49
1048 in_use 0 rq id 2169 in_use 256 state 1 onchip 0 ep tid 78 state 7 0.0.0.0:4304->0.0.0.0:5445 rdma_stats Description: Prints RDMA statistics if NDK/ND is enabled Syntax: cxgbtool [vbdInterface] rdma_stats Chelsio T5/T4 Unified Wire for Windows...
Page 50
0x083ae260: (inactive): stag idx 0x0900 key 0x00 state INV type NSMR pdid perms none rem_inv_dis 0 addr_type ZBTO bind_enable 0 pg_size 4096 qpid 0x0 pbl_off 0x0000 pbl_addr 0x0b414780 len 0 va 0000000000000000 bind_cnt 0 Stag(2):0xf00 0x83ae320 0000000000000000 0000000000000000 0000000000000000 Chelsio T5/T4 Unified Wire for Windows...
Page 52
Flow IPG(us) class 29640261 disabled disabled class 29640261 disabled disabled class 29640261 disabled disabled class 29640261 disabled disabled class 29640261 disabled disabled class 29640261 disabled disabled class 29640261 disabled disabled class 29640261 disabled disabled Chelsio T5/T4 Unified Wire for Windows...
Chapter I. Chelsio Unified Wire 5. Firmware Update The driver will auto-load the T5 and T4 firmwares if an update is required. The firmware version can be verified using cxgbtool: C:\Users\Administrator>cxgbtool nic0 version The Firmware binaries are present in ChelsioUwire-x.x.x.xx/firmware/ directory.
3. Repeat the above step for the other Chelsio Network Adapters. 6.1.2. Virtual Bus Driver 1. Open the Device Manager (Control Panel -> System & Security-> System -> Device Manager), click on the System Devices, right click on the Chelsio T5/T4 40G/10G Bus Enumerator and select Uninstall. Note In case of Virtual Functions in VM, use Chelsio T5/T4 40G/10G Bus Enumerator [Virtual Function].
Page 55
Chapter I. Chelsio Unified Wire 3. Repeat the above step for the other Generic Functions. Uninstalling drivers using any other order is not supported. Important Chelsio T5/T4 Unified Wire for Windows...
For any distribution specific problems, please check README and Release Notes included in the release for possible workaround. Please visit Chelsio support web site http://service.chelsio.com/ for regular updates on various software/drivers. You can also subscribe to our newsletter for the latest software updates. Chelsio T5/T4 Unified Wire for Windows...
Chapter II. NDIS Function 1. Introduction Chelsio’s T5/T4 series of Unified Wire Adapters provide extensive support for NIC operation, including all stateless offload mechanisms for both IPv4 and IPv6 (IP, TCP and UDP checksum offload, LSO - Large Send Offload aka TSO - TCP Segmentation Offload, Network Direct and assist mechanisms for accelerating LRO - Large Receive Offload).
2.1. Assigning IP address to the Chelsio Network Adapter 1. Double click on the Network Connections icon and choose the Chelsio card entry and double click it. 2. Click on the Properties button from the Local Area Connection X Status.
Page 60
VXLAN and NVGRE. Value: 0-256 Default: 0 This parameter is available only for T5 adapters. Note Flow Control Description: Enable or disable the receipt or transmission of PAUSE frames. If Rx is enabled, all incoming PAUSE frames will be honored.
Page 61
Maximum Number of RSS Queues Description: Change the number of RSS Queues. Value: 1-8 Default: 4 NetworkDirect Functionality Description: Enable or disable Network Direct Functionality. Value: Disabled | Enabled Default: Enabled Chelsio T5/T4 Unified Wire for Windows...
Page 62
Value: Disabled | Enabled o Default: Enabled Receive Side Scaling (RSS) Description: Control the RSS functions. If on, the Microsoft RSS function is enabled. If off, the Chelsio RSS function is enabled. Value: Disabled | Enabled Default: Enabled Recv Segment Coalescing (IPv4) ...
Page 63
Default: Rx & Tx Enabled TCP Checksum Offload (IPv6): Description: Enable or disable computation of TCP checksum by the adapter for IPv6 packets. Value: o Disabled o Rx & Tx Enabled o Rx Enabled Chelsio T5/T4 Unified Wire for Windows...
Page 64
Description: Enable or disable computation of UDP checksum by the adapter for IPv6 packets. Value: o Disabled o Rx & Tx Enabled o Rx Enabled o Tx Enabled Default: Rx & Tx Enabled Chelsio T5/T4 Unified Wire for Windows...
Page 65
Vxlan UDP Port Number o Description: Specify the current VXLAN UDP destination port number that is currently operational in the NIC. o Value: 1-65535 o Default: 4789 This parameter is available only for T5 adapters. Note Chelsio T5/T4 Unified Wire for Windows...
Chelsio’s T5 based adapters offer extensive support for this feature leading to a higher throughput performance. This feature is enabled by default. Chelsio T5/T4 Unified Wire for Windows...
Windows users in a seamless, plug and play fashion. 1.1. Hardware Requirements 1.1.1. Supported Adapters The following are the currently shipping Chelsio adapters that are compatible with Chelsio SMB Direct driver: T520-BT T502-BT T580-CR...
Chapter III. SMBDirect 2. Software/Driver Configuration and Fine-tuning 2.1. Enabling SMB Direct SMB Direct is installed and enabled by default. RDMA functionality on Chelsio adapters will be enabled after installing the driver from the package. Get-NetAdapterRdma You can use the PowerShell command to get a list of RDMA capable interfaces in your system.
Page 70
Chapter III. SMBDirect The IovSupport field should display “True” as shown in the image below: ii. If you haven’t done already, install the Chelsio Unified Wire driver package. iii. Verify if the driver is installed and loaded using the Get-NetAdapter command. The InterfaceDescription field should list Chelsio adapter as shown in the image below: iv.
Verify network interface configurations on both sides. Please ensure that the interfaces are reachable using ping command. In the Event Viewer (on the client side), please ensure that the traffic running is not over TCP. Chelsio T5/T4 Unified Wire for Windows...
Page 72
Verify that SMB driver is loaded and working. Open PowerShell window and execute the following command : C:\Users\Administrator>driverquery.exe | findstr /I smb Verify that Chelsio driver is loaded and working. Open PowerShell window and execute the following command : C:\Users\Administrator>driverquery.exe | findstr /I chel ...
Other benefits of Virtualization include improved disaster recovery, server portability, cloud computing, Virtual Desktop Infrastructure (VDI), etc. Chelsio’s T5 and T4 Unified Wire family of Adapters deliver increased bandwidth, lower latency and lower power with virtualization features to maximize cloud scaling and utilization. The adapters also provide full support for PCI-SIG SR-IOV to improve I/O performance on a virtualized system.
2. Software/Driver Configuration and Fine-tuning Please ensure that Unified Wire is installed on the host before proceeding. Refer Software/Driver Installation section of the Chelsio Unified Wire chapter for step-by-step instructions. Check if the machine is SR-IOV capable using the following command: PS C:\Users\Administrator>...
Enter 2 as the configuration type and y to confirm. Hit [Enter]. iv. Reboot system for changes to take effect. 2.2. vSwitch Configuration Create a vSwitch with SR-IOV enabled using Chelsio adapter. ii. Assign a virtual network adapter with SR-IOV enabled to the VM. iii. Bring up the VM. 2.3.
Chelsio hardware installed in the system. The software includes a command line interface (CLI) tool and a web management interface (Web GUI) to help you manage all Chelsio network adapter cards on the network across multiple operating systems.
The Management Agent is a binary executable, which runs as a service on the system that has at least one Chelsio card installed. It is installed along with libraries that can manage various components of the system and enabled during system startup.
The authentication credentials, as well as all data exchanged between the CLI client or the Web GUI and the agent, are encrypted using SSL. This ensures that the data cannot be accessed when it is being transmitted over the network. Chelsio T5/T4 Unified Wire for Windows...
Chapter V. Unified Wire Manager (UM) 2. Hardware and Software 2.1. Supported Adapters Following are the currently shipping Chelsio Adapters that are compatible with Chelsio Unified Wire Manager: T5 Adapters T502-BT T520-CR T580-CR T580-LP-CR T580-SO-CR ...
Chapter V. Unified Wire Manager (UM) 2.3. Platform/Driver Matrix The table below lists the Chelsio T5/T4 driver(s) and their supported versions: Chelsio driver Version 5.5.11.0 Chelsio T5/T4 Unified Wire for Windows...
2. Ensure that the path to python binary (typically "C:\Python26"), is added to PATH system variable. 3. Install Apache HTTP Server 2.2 with SSL. (Download from here) 4. If the Apache Server is running, it should be stopped before starting the installation process. Chelsio T5/T4 Unified Wire for Windows...
Installer will upgrade it to the current version. 1. Run the UnifiedWireManager-x.x.xx-x64 installer application. 2. Click the Next button for the Chelsio End User License Agreement Window. Figure 3.2 (a) – UM installer welcome window Chelsio T5/T4 Unified Wire for Windows...
Page 85
Chapter V. Unified Wire Manager (UM) 3. Select the radio button I accept the terms of the license agreement and click Next. Figure 3.2 (b) – Chelsio EULA window Chelsio T5/T4 Unified Wire for Windows...
Page 86
Chapter V. Unified Wire Manager (UM) 4. The next window will display the pre-requisites for various UM components. Ensure that they are met before proceeding. Click Next. Figure 3.2 (c) – UM prerequisites window Chelsio T5/T4 Unified Wire for Windows...
Page 87
Chapter V. Unified Wire Manager (UM) 5. Now, either select Complete for complete package installation or else select Custom radio button to customize the installation. Click Next. Figure 3.2 (d) – Select setup (installation) type Chelsio T5/T4 Unified Wire for Windows...
Page 88
If you selected Custom, the next window will display the location where UM will be installed by default. You can change the location by using the Change button or click Next to continue with the default path. Figure 3.2 (e) – Changing UM installation path Chelsio T5/T4 Unified Wire for Windows...
Page 89
Figure 3.2 (f) – Selecting UM components to install If Management Station is selected, please make sure that all related Note prerequisites are met before proceeding (See Pre-requisites) or else the component will be skipped during installation. Chelsio T5/T4 Unified Wire for Windows...
Page 90
Chapter V. Unified Wire Manager (UM) 6. Click Install to start the installation. Unified Wire Manager will now be installed with the selected options. Figure 3.2 (g) – Starting UM installation Chelsio T5/T4 Unified Wire for Windows...
Page 91
Chapter V. Unified Wire Manager (UM) 7. Select Finish to exit the UM Installer. Figure 3.2 (h) – Finishing UM installation Chelsio T5/T4 Unified Wire for Windows...
Uncomment "LoadModule ssl_module modules/mod_ssl.so" Add the following lines: RewriteEngine On RewriteCond %{HTTPS} !=on RewriteRule ^/?(.*) https://%{SERVER_NAME}/$1 [R,L] 4.1.2. SSL Certificate 1. Execute the following lines in command prompt and provide info to generate OpenSSL certificate and keys: Chelsio T5/T4 Unified Wire for Windows...
Page 93
Uncomment the following line SSLSessionCache "dbm:C:/Program Files (x86)/Apache Software Foundation/Apache2.2/logs/ssl_scache" Comment the following line SSLSessionCache "shmcb:C:/Program Files (x86)/Apache Software Foundation/Apache2.2/logs/ssl_scache(512000)" Use the Windows Event Log (Event Viewer) for troubleshooting any installation Note related issues. Chelsio T5/T4 Unified Wire for Windows...
Verifying Management Agent 1. On the system running Management Agent, launch Services from the Control Panel. You can also type services.msc in the Run command. This will open the Services window. Figure 5.1(a) – Windows Services Chelsio T5/T4 Unified Wire for Windows...
2. Search for Unified Wire Management Station in the list of services. You should get the options to stop,start and restart the service in the Actions menu on the left side. Figure 5.3 – Verifying Management Station service status Chelsio T5/T4 Unified Wire for Windows...
Page 96
Chapter V. Unified Wire Manager (UM) While accessing the Web Management Interface, if an error “Management Note Station is not running” is displayed at the log-in page, follow the above steps to restart Management Station and try again. Chelsio T5/T4 Unified Wire for Windows...
If there is a firewall appliance / software protecting the network that the system is on, and you wish to connect to the system from a different network, using the client, the firewall appliance also needs to be configured appropriately. Chelsio T5/T4 Unified Wire for Windows...
Also, two different Web GUI or CLI clients cannot connect to a management agent at the same time. There is no mechanism to allow this scenario. Chelsio T5/T4 Unified Wire for Windows...
2. Search for “Apachex.x” in the list of services and click Start in the Action menu on the left. Figure 8.1.1 (a) – Starting Apache HTTP server 3. Search for “Unified Wire Management Station” and click Start in the Action menu on the left. Figure 8.1.1(b) – Starting Management Station service Chelsio T5/T4 Unified Wire for Windows...
You will need to select the correct option to continue. Security Certificate prompt in Internet Explorer Figure 8.2 (a) - Security Certificate prompt in Mozilla Firefox Figure 8.2 (b) - Chelsio T5/T4 Unified Wire for Windows...
Page 101
Login button. Figure 8.2 (e) - Web GUI Login page Not performing any operation/action for 5 minutes will result in session timeout. Note You will have to re-login and connect to the Agents again. Chelsio T5/T4 Unified Wire for Windows...
Navigation Pane. The panels can be expanded and collapsed by clicking on the panel heading. The Bottom bar has the About link on the right and copyright details on the left. Figure 8.3 – Web Management Interface Chelsio T5/T4 Unified Wire for Windows...
The passwords are encrypted, but it is still advisable to store passwords only if the system you are running the GUI client on, is secure. Figure 8.4.1 (a) - Bookmarks and history module Chelsio T5/T4 Unified Wire for Windows...
Page 104
Select the system from the Bookmark list and click Delete system to remove it. Once removed, the system will no longer appear in the Bookmarks and History Note module. If you wish to manage that system again, you will have to use the “Add system” option. Chelsio T5/T4 Unified Wire for Windows...
Page 105
Installing Driver 1. In the Choose the card fields, select T3 or T4/T5 depending on the chip revision of the network card. 2. Select the operating system for which drivers are to be installed in the Choose the OS Type field.
Page 106
Chapter V. Unified Wire Manager (UM) 3. Select a system or systems from the list and choose the driver to be installed in the Driver Installation section. 4. Download the appropriate driver from Chelsio’s Download Center, service.chelsio.com. 5. Locate the driver package.
Page 107
If you deselect the ‘Remember Password’ option, you will be asked to enter the password every time you try to connect to the system. Figure 8.4.2 (a) - Adding a UM Agent Chelsio T5/T4 Unified Wire for Windows...
Page 108
This feature is available only on the Web Management Interface. Using this option, you can receive email alerts regarding the link status of a Chelsio Network Interface Card. This feature sends email notifications regarding the port and the card, on which the link up/down event has occurred.
Page 109
Various configurable parameters have been categorized into several modules like Boot Configuration module to install and erase option ROM, Network Configuration module to set MTU and VLAN ID, Card Configuration module to change driver parameters, etc. Chelsio T5/T4 Unified Wire for Windows...
Page 110
MTU size of a network interface (in the Network Configuration module), create a group with group type Network. To install or erase option ROM on a Chelsio T4 adapter (in the Boot Configuration module), create a group with group type t4adapter.
Page 111
Figure 8.4.6 (b) – Managing a group Boot Configuration Using this module, you can install option ROM or erase option ROM on Chelsio network devices. The Set Default Boot Settings button will reset the adapter to factory boot settings. Figure 8.4.6 (c) – Boot Configuration module...
Page 112
MTU can be set between 1500-9000 bytes. VLAN id can be set for an adapter within the range 0-4094 (enter 0 to disable it). The IP type can be static or DHCP. Figure 8.4.6 (d) – Network Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 113
The Card Configuration module allows you to set various adapter settings including TCP Offload. Offload settings are only available when using the TOE capable drivers (t3_tom and toecore for T3 cards; t4_tom and toecore for T4 cards). Figure 8.4.6 (e) – Card Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 114
In the Port Configuration module, you can set various port settings like enabling Tx checksum and TCP segmentation offload, setting Link speed and link duplex mode, etc. The settings depend on the device driver installed. Figure 8.4.6 (f) - Port Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 115
Chapter V. Unified Wire Manager (UM) Bypass Configuration Use the Bypass Configuration module to configure Chelsio’s bypass adapters like B420-SR and B404-BT. Figure 8.4.6 (g) - Bypass Configuration module Chelsio T5/T4 Unified Wire for Windows...
The system page contains generic system and support modules which are discussed below: 8.5.1. System summary This module lists the system Hostname, Operating System, platform and also gives the count of the Chelsio cards found. Figure 8.5.1 (a) - System Summary module Chelsio T5/T4 Unified Wire for Windows...
Page 117
Chapter V. Unified Wire Manager (UM) 8.5.2. Drivers Installation Using this module, one can install various Chelsio drivers for different operating systems. Figure 8.5.2 (a) - Drivers Installation module connected to Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 118
Chapter V. Unified Wire Manager (UM) 8.5.3. Driver Details A list of Chelsio device drivers with related information like driver description, version, current load status and installation date is shown in this module. To load or unload a particular driver, select the appropriate option (Yes to load, No to unload) in the corresponding cell of the Loaded column and click Load/Unload Driver button.
Page 119
Chapter V. Unified Wire Manager (UM) 8.5.4. System Diagnostics Using this module, you can run various diagnostic tests on Chelsio adapters to troubleshoot adapter related issues. Select the adapter(s) from the list for which you want to run the test, select the operation (type of test;...
Page 120
A list of the Unified Wire Manager agent components installed on the managed system is shown in this module. The versions of the components are useful in case of reporting an issue to support. Figure 8.5.5 - Unified Wire Manager Component Versions module Chelsio T5/T4 Unified Wire for Windows...
Page 121
The properties box will display the domain state of the machines selected. Now, click on any of the system power actions provided at the bottom. Figure 8.5.6 - VM Configurations module Chelsio T5/T4 Unified Wire for Windows...
Page 122
Chapter V. Unified Wire Manager (UM) 8.5.7. Managed system application logs The management agent logs its activities and any errors that occur, in /var/log/chelsio in Linux and FreeBSD and in the Event log, in Windows. This log can be obtained in this module. Only 20 entries can be obtained and viewed at a time.
8.6.1. Network summary The Network Summary module provides the total number of Chelsio adapters present, including the number of T5, T4 and T3 adapters. It also provides the total number of Network interfaces including corporate and Chelsio interfaces and VLANs.
Page 124
Chapter V. Unified Wire Manager (UM) 8.6.2. Chelsio card page When a Chelsio card is selected in the tree menu on the left, this page is displayed. It provides details of the card and associated settings. It also displays any card specific statistics that the hardware provides.
Page 125
Highlight the system item in the tree menu on the left, and click "Refresh", to refresh data from the system, in case the updated settings are not being shown. Figure 8.6.2 (b) - TCP Offload Settings module for a FreeBSD Agent Chelsio T5/T4 Unified Wire for Windows...
Page 126
Chapter V. Unified Wire Manager (UM) Device Driver settings (Windows) The device driver settings applicable to the card are shown here. For Chelsio T5 and T4 adapters, only the MaxVMQueues field will be displayed. On changing the settings, the changed settings may not reflect immediately on refreshing the data.
Page 127
Chelsio card's port The port page is displayed on selecting a port of a Chelsio card listed in the tree menu on the left. It provides details of the port and port settings. It also displays any port specific statistics that the hardware provides.
Page 128
Port settings Port settings such as MTU, Link speed and others can be set in this module. The settings depend on the device driver installed. Figure 8.6.2.1 (b) - Port Settings of T4 CNA Chelsio T5/T4 Unified Wire for Windows...
Page 129
Chapter V. Unified Wire Manager (UM) Port statistics Ethernet statistics and additional hardware statistics for the port are displayed in this module. Figure 8.6.2.1 (c) - Port Statistics of T4 CNA on Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 130
0-4094 (enter 0 to disable it). You can use the View/Set IP addresses option to add, modify or delete IP aliases. Figure 8.6.3 (a) - System network configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 131
Chapter V. Unified Wire Manager (UM) Figure 8.6.3 (b) – Managing IP aliases Chelsio T5/T4 Unified Wire for Windows...
Page 132
Table view in the Advanced NIC characteristics. The polling time field sets the average time (in seconds) based on which the table/graph updates the report. Figure 8.6.3 (c) - System network statistics module Chelsio T5/T4 Unified Wire for Windows...
Page 133
Chapter V. Unified Wire Manager (UM) Figure 8.6.3 (d) - Network Throughput Vs Time instant Graph Figure 8.6.3 (e) - Network Throughput Vs Time instant Table Chelsio T5/T4 Unified Wire for Windows...
Page 134
Windows, you may set multiple default gateways. Use the option to set multiple default gateways with caution, since it may cause the system to stop communicating with external networks. Figure 8.6.3 (f) - Default gateway and DNS configuration module for a Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 135
All modes may not be available with all configurations / combinations. Also, the team members can only be 2 ports of a single offload-enabled card, and not across Chelsio cards. Do not mix third party cards and offload-enabled Chelsio cards in a single team.
Page 136
Use the GetConnections utility to view currently active TCP/UDP connections. Offload status for each connection is also displayed if protocol offload hardware is available. This is useful for troubleshooting any connectivity issues for clients to various services. Figure 8.6.3 (h) - Ping Utility Chelsio T5/T4 Unified Wire for Windows...
Page 138
To do so, click on the virtual machine and click “Detach”. Similarly, detach all the virtual machines and then use the “Delete Switch” to delete the virtual network. Figure 8.6.3.1 (a) – Virtual Network Manager module Chelsio T5/T4 Unified Wire for Windows...
Page 139
Once created, you can manage the virtual networks in the Virtual Network Manager module. Figure 8.6.3.1 (b) – Creating external virtual network Figure 8.6.3.1 (c) – Creating internal virtual network Chelsio T5/T4 Unified Wire for Windows...
Page 140
To attach a virtual network to a virtual machine, select the virtual network from the Virtual Network list and the virtual machine from the VM list. Finally click Attach. Figure 8.6.3.1 (e) – Attaching Virtual Network to VM Chelsio T5/T4 Unified Wire for Windows...
Page 141
These settings can be set only when iWARP driver (iw_cxgb4 for T4 and T5; iw_cxgb3 for T3) is loaded. If you set any parameter for a T5 adapter, it applies for all the T5 adapters present. Same applies for T4 and T3 adapters.
Page 142
Chapter V. Unified Wire Manager (UM) Figure 8.6.4 (a) – iWARP settings for T4 CNA for FreeBSD Agent Chelsio T5/T4 Unified Wire for Windows...
Page 143
Chapter V. Unified Wire Manager (UM) Figure 8.6.4 (b) – iWARP settings for T4 CNA for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Figure 7.7 – Storage Summary Module 8.7.1. FCoE Initiator (Linux, Windows, XenServer) All supported Chelsio FCoE initiators available on the operating system can be managed from this page. FCoE support is extended on Linux, Windows and XenServer platforms. Please refer to Platform/Driver matrix section on the list of operating systems that are supported.
Page 145
Figure 8.7.1.1 (a) – FCoE Card Summary module FCoE Attributes Information such as Interrupt modes (MSI/MSI-X/INTx), SCSI mode and the card state are provided in this module. Figure 8.7.1.1 (b) – FCoE Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 146
NPIV management support. It contains the following sections: FCoE Port Summary The SCSI adapter name and the underlying ENODE MAC address of the physical port can be found here. Figure 8.7.1.2 (a) – FCoE Port Summary module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 147
(10G/1G) being used. Note that only class 3 service is supported by the initiator for now and the frame size is fixed to 2128 bytes as per spec. Figure 8.7.1.2 (b) – FCoE Port Atrributes module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 148
To delete a virtual port, select the option Delete and select the virtual port WWPN which you want to delete and click on delete. Figure 8.7.1.2 (c) – FCoE NPIV management module Chelsio T5/T4 Unified Wire for Windows...
Page 149
This module provides details about the discovered target such as target’s FC ID, WWPN and WWNN so that the user can identify the discovered target accordingly. Figure 8.7.1.3 (a) – FCoE Remort Port Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 150
This module provides the LUN information such as size of the LUN, SCSI address, and LUN address. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format. Figure 8.7.1.3 (b) – FCoE Remote Port Lun Details module Chelsio T5/T4 Unified Wire for Windows...
Page 151
FCoE Virtual Port Summary The SCSI adapter name and the underlying ENODE MAC address of the physical port can be found here. Figure 8.7.1.4 (a) – FCoE Virtual Port Summary module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 152
(10G/1G) being used. Note that only class 3 service is supported by the initiator for now and the frame size is fixed to 2128 bytes as per spec. Figure 8.7.1.4 (b) – FCoE Virtual Port Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 153
LUN, SCSI address, and LUN address are provided. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format. Figure 8.7.1.4 (d) - FCoE Remote Port Lun Details module Chelsio T5/T4 Unified Wire for Windows...
Page 154
(Chelsio node cannot be disabled in Windows), and its properties can be viewed and edited in this module. In the Chelsio Linux stack, new initiator nodes can be created too. Disabling the initiator causes it to log out of any iSCSI targets that it is connected to, thus removing any disks provided by the iSCSI targets that were connected.
Page 155
Chapter V. Unified Wire Manager (UM) Figure 8.7.2 (b) - Microsoft iSCSI initiator Chelsio T5/T4 Unified Wire for Windows...
Page 157
(the IP address and TCP Port specified when discovering the target). If there are any pre-existing iSCSI sessions established to the target, deletion of Note the target Portal from the discovered targets list will fail. Figure 8.7.2 (d) - Discover targets module Chelsio T5/T4 Unified Wire for Windows...
Page 158
If a target is connected, the sessions and connections to the target, and the disks provided by the target will be listed. Figure 8.7.2 (e) - Targets module after logging in Chelsio T5/T4 Unified Wire for Windows...
Page 159
8.7.3. FO iSCSI Initiator (Linux) Full Offload iSCSI Hardware Information PCI, firmware and other adapter related details are provided in this module. Select the Chelsio adapter for which you want to view properties from the Select a T4 Card drop-down list and the module will expand to display related properties.
Page 160
Here you can configure various port settings like VLAN id, Maximum Transmission Unit (MTU) and IP. Select a Chelsio adapter from Select a T4 Card drop-down list and then select the port for which you want set any of the aforementioned properties. MTU can be set between 1500- 9000 bytes.
Page 161
In the FO iSCSI Initiator Properties module, you can configure FO iSCSI Initiator by setting different properties like enabling/disabling CHAP authentication, setting Header and Data digest, etc. Figure 8.7.3 (c) - FO iSCSI Initiator Properties Chelsio T5/T4 Unified Wire for Windows...
Page 162
In this module, you can set upto 8 instances. Configurable parameters include initiator node name (IQN), alias (friendly) name, Initiator (CHAP) Username and password. Figure 8.7.3 (d) - FO iSCSI Manage Instances module Chelsio T5/T4 Unified Wire for Windows...
Page 163
Chapter V. Unified Wire Manager (UM) FO iSCSI Discover Details iSCSI Targets can be discovered using this module. Select a Chelsio adapter and initiator instance using which you want to discover targets. Next, provide the source (initiator) and destination (target) IP. Finally, click Discover. After successful discovery, all the discovered targets will appear in the Discovered Targets section.
Page 164
CHAP for a secure iSCSI connection. One-way (target authenticates the initiator) and Mutual (target and initiator authenticate each other) authentication methods are supported. Figure 8.7.3 (f) - FO iSCSI Session Details module: Login Chelsio T5/T4 Unified Wire for Windows...
Page 165
Established sessions section. Select the Adapter and session id. Details of the selected session will be displayed. To end the session, click Logout. Figure 8.7.3 (g) - FO iSCSI Session Details module: Established Sessions Chelsio T5/T4 Unified Wire for Windows...
Page 166
Target properties is also available. The modules available on this page are as below: Target Stack Globals This module displays various global properties of a currently connected iSCSI target. Authentication priority between CHAP and ACL can be set here. Figure 8.7.4 (a) - Target Stack Globals module Chelsio T5/T4 Unified Wire for Windows...
Page 167
Properties such as Target name and Alias, Max Data Receive Length, Authentication mode related to a specific iSCSI target can be viewed and modified here. iSCSI targets can be started/stopped or deleted. Figure 8.7.4 (b) - Target properties module Chelsio T5/T4 Unified Wire for Windows...
Page 168
Chapter V. Unified Wire Manager (UM) Session details Details including Session ID, Initiator IQN and Connections List of all discovered and currently connected iSCSI targets are listed here. Figure 8.7.4 (c) – Session Details module Chelsio T5/T4 Unified Wire for Windows...
Page 169
Chapter V. Unified Wire Manager (UM) New Target Creation New iSCSI target can be created here by specifying the Target IQN and Target Alias name. Figure 8.7.4 (d) - New Target Creation module Chelsio T5/T4 Unified Wire for Windows...
Page 170
View/Edit iSCSI Target LUNs This module displays various Logical Units created in an iSCSI Target. Selected LUNs can be deleted. Figure 8.7.5 (a) - View/Edit iSCSI Target LUNs module Chelsio T5/T4 Unified Wire for Windows...
Page 171
Device and RAM Disk Size etc. RW (Read-Write) and RO (Read Only) are the two kinds of permissions that can be set. If Ram Disk is selected, then a minimum of 16 MB should be provided. Figure 8.7.5 (b) - Adding a new LUN Chelsio T5/T4 Unified Wire for Windows...
Page 172
Portal List on the left displays details of the portal group on which an iSCSI target is listening and the related info is displayed on the right under Portal Details. Selected portals can be deleted. Figure 8.7.6 (a) - View/Edit iSCSI Target Portals module Chelsio T5/T4 Unified Wire for Windows...
Page 173
Chapter V. Unified Wire Manager (UM) Add Portal New Portals can be added here by choosing the specific target and Portal IP address. The Port number should be 3260. Figure 8.7.6 (b) – Adding a new Portal Chelsio T5/T4 Unified Wire for Windows...
Page 174
View/Edit iSCSI Target ACLs This module displays details for all the ACLs configured for an iSCSI Target. Selected ACLs can be deleted. Figure 8.7.7 (a) - Target ACL operations module Chelsio T5/T4 Unified Wire for Windows...
Page 175
Chapter V. Unified Wire Manager (UM) Add ACL New ACLs can be configured by specifying Target name, initiator IQN name, IP address and permission type. Figure 8.7.7 (b) - Adding new ACL Chelsio T5/T4 Unified Wire for Windows...
Chapter V. Unified Wire Manager (UM) 8.8. Hardware Features The Hardware module lists the status of configuration modules under Hardware Features section, running on the agent. Figure 8.8 – Hardware module Chelsio T5/T4 Unified Wire for Windows...
Page 177
Note time to reflect. Highlight the system item in the tree menu on the left, and click "Refresh system", to refresh data from the system, in case the updated settings are not being shown. Chelsio T5/T4 Unified Wire for Windows...
Page 178
The FILTERID and T4 CARD fields are mandatory. After providing appropriate values for the parameters click “Save Changes”. For a detailed explanation regarding different fields, please refer cxgbtool Note manual by running man cxgbtool command on Management Agent CLI. Figure 8.8.1(b) - T4 Filtering Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 179
(t3_tom for T3 adapters; t4_tom for T4 adapters). 8.8.3. Traffic Management configuration The Chelsio Card section on the left displays all the cards available in the server and their corresponding policies on the right. Policies can be added and deleted. Policy Details displays the primitives (maximum 8) and actions which can be modified.
Page 180
/ChelsioUwire- x.x.x.xx/src/network/firmware. For instance, to select Low latency Networking, locate the file, t4- config.txt, in /ChelsioUwire-x.x.x.xx/src/network/firmware/low_latency_config directory. Figure 8.8.4 - T4 Save Config File module Chelsio T5/T4 Unified Wire for Windows...
Page 181
8.8.5. T3 iSCSI / T3 PXE Boot Option Rom Management (Linux) The Chelsio T3 card may be used for PXE or iSCSI boot. This module allows managing the boot capability. The Option ROM (PXE/iSCSI) may be installed to the card, or erased from the card.
Page 182
8.8.6. T5/T4 Boot Option ROM management This module allows managing the PXE and FCoE boot capability for Chelsio T5 and T4 cards. The Option ROM (PXE and FCoE) may be installed to or erased from the card. The version of Option ROM flashed can be viewed here.
Page 183
FCoE targets. Enable the Option ROM only if you are planning to boot the system via PXE or install the operating system on FCoE LUN. Figure 8.8.7 (a) - PXE Boot configuration for T4 CNAs Chelsio T5/T4 Unified Wire for Windows...
Page 184
Chapter V. Unified Wire Manager (UM) Figure 8.8.7 (b) - FCoE Boot configuration for T4 CNAs Figure 8.8.7 (c) - iSCSI Boot configuration for T4 CNAs Chelsio T5/T4 Unified Wire for Windows...
Page 185
Chapter V. Unified Wire Manager (UM) 8.8.8. Bypass (Linux) You can use the Bypass page to configure various settings for Chelsio’s bypass adapters like setting bypass operation mode, creating rules (filters), starting/stopping BA server, etc. There are two modules available: Bypass Configuration and Redirect Configuration.
Page 186
To edit an existing rule, select the corresponding checkbox, change the desired paremeters and click Save Changes. To delete a rule, select the corresponding checkbox and click Delete a Filter. Finally, click Save Changes. You can delete multiple rules using this method. Chelsio T5/T4 Unified Wire for Windows...
Page 189
Chapter V. Unified Wire Manager (UM) 8.8.9. T4 Egress Class Schedulers (Linux) Schedulers can be set only when T5/T4 network driver (cxgb4) is loaded. Egress Queue Map Using this module, you can bind (map) NIC (non-offloaded) Tx queues to Tx Scheduler classes.
Chapter V. Unified Wire Manager (UM) 9. Uninstalling Unified Wire Manager To uninstall Unified Wire Manager, use Programs and Features in the Control Panel. Chelsio T5/T4 Unified Wire for Windows...
Only local systems can be managed currently using this tool. Note 1.1. Hardware Requirements 1.1.1. Supported Adapters The following are the currently shipping Chelsio Adapters that are compatible with Chelsio UM for Win PE: T502-BT T520-CR T580-CR T580-LP-CR T580-SO-CR...
Chapter VI. UM for Win PE 1.2. Software Requirements 1.2.1. Windows Requirement Currently Chelsio UM for Win PE is available for the following version(s): Windows Server 2012 R2 1.3. Examples 1.3.1. Viewing help Run the following command to view the list of commands available under a service.
Page 194
Chapter VI. UM for Win PE Run the following command to view syntax and usage for a sub-command: X:\windows\system32>chelsio_uwlite.exe chelsio <sub-command> /? E.g. To view syntax and usage of EraseSettings sub-command under chelsio service: X:\windows\system32>chelsio_uwlite.exe chelsio erasesettings /? Chelsio T5/T4 Unified Wire for Windows...
Page 195
Chapter VI. UM for Win PE 1.3.2. Flashing Option ROM Run the following command to list all Chelsio CNAs present in the system. The list displays a unique index for each CNA found. X:\windows\system32>chelsio_uwlite.exe chelsio listadapters Now, run the following command to flash option ROM onto the adapter: X:\windows\system32>chelsio_uwlite.exe chelsio flashrom adapter=<idx>...
Page 196
Option ROM image file, cuwlbt4.bin 1.3.3. Erasing Option ROM Run the following command to list all Chelsio CNAs present on the system. The list displays a unique index for each CNA found. X:\windows\system32>chelsio_uwlite.exe chelsio listadapters Now, run the following command to erase option ROM from the adapter: X:\windows\system32>chelsio_uwlite.exe chelsio eraserom adapter=0 force=1...
Chapter VII. Appendix Chelsio End-User License Agreement (EULA) Installation and use of the software implies acceptance of the terms in the Chelsio End-User License Agreement (EULA). IMPORTANT: PLEASE READ THIS SOFTWARE LICENSE CAREFULLY BEFORE DOWNLOADING OR OTHERWISE USING SOFTWARE ASSOCIATED...
Page 199
Agreement by returning the Software. 8. Limitation of Liability. IN NO EVENT SHALL CHELSIO HAVE ANY LIABILITY TO YOU OR...
Page 200
Agreement. Should you have any questions concerning this Agreement, you may contact Chelsio by writing to: Chelsio Communications, Inc. 370 San Aleso Ave.
Need help?
Do you have a question about the T5 and is the answer not in the manual?
Questions and answers