ASIC. The T4 adapters can fully offload TCP, UDP, iSCSI, iWARP and FCoE over a single Unified Wire. The adapters also fully support SR-IOV, EVB/VNTag, DCB, Traffic Management and Filtering.
Chapter I. Chelsio Unified Wire 1.3. Software Requirements Chelsio T5/T4 Unified Wire has been developed to run on Windows based platforms. To know more about the complete list of versions supported by each driver/software, please refer to their respective sections.
Ethernet interface. However, for T5 40G and T420-BT adapters, the association of physical Ethernet ports and their corresponding network device names is opposite. For this adapter, the port nearest to the motherboard will appear as the first network interface. Chelsio T5/T4 Unified Wire for Windows...
3.1.1. Virtual Bus Driver 1. Open the Device Manager (Control Panel -> System & Security-> System -> Device Manager), click on the System Devices, right click on the Chelsio T5/T4 40G/10G Enumerator and select Update Driver Software. 2. Select Browse my computer for driver software.
Page 11
3.1.3. Generic Function 1. Open the Device Manager (Control Panel -> System & Security-> System -> Device Manager), click on the Network Adapters, right click on the Chelsio T5/T4 40G/10G Generic Function and select Update Driver Software. 2. Select Browse my computer for driver software.
Page 14
C:\Users\Administrator>cxgbtool vbd0 loadfw t5fw-1.11.18.0.bin loadcfg Description: Loads firmware configuration file or clears configuration flash region. The configuration file used must be in text format and not a header file. Note Syntax: cxgbtool [vbdInterface] loadcfg [[firmwareConfigurationFile]|clear] Chelsio T5/T4 Unified Wire for Windows...
Page 15
{val}: Flash Option ROM image to the offset specified by the user. clear: The flash area reserved for Option ROM image will be cleared. Example: Flashing Option ROM image to the offset defined by the PFs EXPROM_OFST: C:\Users\Administrator>cxgbtool vbd0 loadboot cuwlbt4.bin pf 0 Chelsio T5/T4 Unified Wire for Windows...
Page 17
Loopback 0 using 0 pages out of 144 allocated Loopback 1 using 0 pages out of 144 allocated Loopback 2 using 0 pages out of 144 allocated Loopback 3 using 0 pages out of 144 allocated Chelsio T5/T4 Unified Wire for Windows...
Page 20
Multi-port support common register set. This module implements the multi-port support for T4, and switches egress packets to the ingress path when their Ethernet DA (Destination Address) matches an address in the exact match Ethernet Address database, or if the outer-VLAN...
Page 21
Chapter I. Chelsio Unified Wire indicates that the packet is destined to another virtual machine connected to the T4, or if another virtual machine is subscribing to an L2 multicast group that is the MAC destination address of the packet.
Page 26
NIC TP Version 0.1.4.7 Ndis Driver Version 5.3.12.0 VBD Version 5.3.12.0 fwtoc Description: Converts Firmware binary file to source file header. Syntax: cxgbtool [vbdInterface] fwtoc [firmwareFile] filename= [CFileName].bin Example: C:\Users\Administrator>cxgbtool vbd0 fwtoc .\Chelsio-Uboot-1.0.0.68\t4fw- 1.12.14.0.bin filename=t4fw-1.12.14.0.bin Chelsio T5/T4 Unified Wire for Windows...
Page 27
Syntax: cxgbtool [vbdInterface] uninst [infFile] Example: C:\Users\Administrator>cxgbtool vbd0 uninst .\chnetx64.inf Removing device instance CHT<4|5>BUS\CHNET\5&39B01C76&1&0000 rescan Description: Scans for hardware changes in the device manager. Syntax: cxgbtool [vbdInterface] rescan all Example: C:\Users\Administrator>cxgbtool vbd0 rescan all Chelsio T5/T4 Unified Wire for Windows...
Page 28
Description: Displays the adapters Serial Number, Device ID, EC, Core Clock, Part Number, and Network Address (MAC) Syntax: cxgbtool [vbdInterface] vpdparams Example: C:\Users\Administrator>cxgbtool vbd0 vpdparams Serial Number : RE14130227 : T520-CR : 0000000000000000 Core Clock : 250000 : 11011605002 Network Addr : 000743047D60 Chelsio T5/T4 Unified Wire for Windows...
Page 29
0x01534745 HIGH 0x45475301 0xfeacb8ba HIGH 0xbab8acfe ifaces = nic0 nic1 *************************EGGRESS (TX) PATH ********************************* MOD : core---->PCIE---->SGE<-| #Ring Doorbell MOD |<-core<----PCIE<----SGE<-| #Request Work Request SOP | EOP | MOD |->core---->PCIE---->SGE------>CIM/uP->| #Work Request to uP Chelsio T5/T4 Unified Wire for Windows...
Page 30
0x00000000 HIGH 0x00000066 0x0003f000 HIGH 0x00aa00ee 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x00000000 0x0070000b HIGH 0x0000eeee 0x00000013 HIGH 0x0000eeee 0x00000013 HIGH 0x001199cc 0x00000016 HIGH 0x00020491 0x0000000b HIGH 0x00cc0022 0x00c0000a HIGH 0x00000000 0x0000000a Chelsio T5/T4 Unified Wire for Windows...
Page 32
CPL requests: CPL responses: debugfs Description: When used in conjunction with other options, debugfs displays useful information regarding Chelsio adapters. Syntax: cxgbtool [vbdInterface] debugfs [option] debugfs options: cctrl Description: Displays congestion control table. Chelsio T5/T4 Unified Wire for Windows...
Page 33
Description: Displays results of CIM MA logic analyzer trace. Syntax: cxgbtool [vbdInterface] debugfs cim_ma_la Example: C:\Users\Administrator>cxgbtool vbd0 debugfs cim_ma_la 0000000000000000000000000000000000 0000000000000000000000000000000000 Cnt ID Tag UE Data RDY VLD 0 0000000000000000 0 0000000000000000 0 0000000000000000 Chelsio T5/T4 Unified Wire for Windows...
Page 34
TCP timestamp tick: 1048.576 us DACK tick: 8.192 us DACK timer: 488 us Retransmit min: 960 us Retransmit max: 9765440 us Persist timer min: 960 us Persist timer max: 9765440 us Keepalive idle timer: 7031116800 us Chelsio T5/T4 Unified Wire for Windows...
Page 35
Done writing memory block to file edc0 edc1 Description: Redirects EDC1 memory details to a file. Syntax: cxgbtool [vbdInterface] debugfs edc1 [fileName] It is recommended that the fileName provided is edc1 without any extension. Note Chelsio T5/T4 Unified Wire for Windows...
Page 47
Syntax: cxgbtool [vbdInterface] rss_pf_config Example: C:\Users\Administrator>cxgbtool vbd0 rss_pf_config PF Map Index Size = 0 Hash Tuple Enable Default Enable IPF Mask Mask IPv6 IPv4 Queue Map Chn Prt Map Size Size Four Two Four Two Four Chelsio T5/T4 Unified Wire for Windows...
Page 48
Rx Coalescing Timer. Number of microseconds after which interrupt will be sent. rx-frames-irq: Rx Coalescing Threshold Packets. Number of packets after which interrupt will be sent. Example: Setting Rx Coalescing Timer: C:\Users\Administrator>cxgbtool nic0 coalesce rx-usecs-irq 5 Chelsio T5/T4 Unified Wire for Windows...
Page 49
1048 in_use 0 rq id 2169 in_use 256 state 1 onchip 0 ep tid 78 state 7 0.0.0.0:4304->0.0.0.0:5445 rdma_stats Description: Prints RDMA statistics if NDK/ND is enabled Syntax: cxgbtool [vbdInterface] rdma_stats Chelsio T5/T4 Unified Wire for Windows...
Page 50
0x083ae260: (inactive): stag idx 0x0900 key 0x00 state INV type NSMR pdid perms none rem_inv_dis 0 addr_type ZBTO bind_enable 0 pg_size 4096 qpid 0x0 pbl_off 0x0000 pbl_addr 0x0b414780 len 0 va 0000000000000000 bind_cnt 0 Stag(2):0xf00 0x83ae320 0000000000000000 0000000000000000 0000000000000000 Chelsio T5/T4 Unified Wire for Windows...
Chapter I. Chelsio Unified Wire 5. Firmware Update The driver will auto-load the T5 and T4 firmwares if an update is required. The firmware version can be verified using cxgbtool: C:\Users\Administrator> cxgbtool nic0 version The Firmware binaries are present in ChelsioUwire-x.x.x.xx/firmware/ directory.
For any distribution specific problems, please check README and Release Notes included in the release for possible workaround. Please visit Chelsio support web site http://service.chelsio.com/ for regular updates on various software/drivers. You can also subscribe to our newsletter for the latest software updates. Chelsio T5/T4 Unified Wire for Windows...
Chapter II. NDIS Function 1. Introduction Chelsio‟s T5/T4 series of Unified Wire Adapters provide extensive support for NIC operation, including all stateless offload mechanisms for both IPv4 and IPv6 (IP, TCP and UDP checksum offload, LSO - Large Send Offload aka TSO - TCP Segmentation Offload, Network Direct and assist mechanisms for accelerating LRO - Large Receive Offload).
Chapter II. NDIS Function 1.2. Software Requirements 1.2.1. Windows Requirement Currently Chelsio T5/T4 NDIS Function driver is available for the following version: Windows Server 2012 R2 NDIS driver supports NIC, NDK and NVGRE Offload functionalities. Note Chelsio T5/T4 Unified Wire for Windows...
To see all tunable VBD driver parameters, open the Device Manager (Control Panel -> System & Security-> System -> Device Manager), click on the System Devices, double click on the Chelsio T5/T4 40G/10G Bus Enumerator, and then click the Advanced tab. Nic Instances: ...
Page 58
Description: Specifies a new MAC address for the port. If Not Present, the default MAC from EEPROM is used. If specified, the new MAC overwrites the default MAC. This specified MAC is persistent across machine reboot. Chelsio T5/T4 Unified Wire for Windows...
Page 59
Value: Disabled | Enabled Default: Enabled Recv Segment Coalescing (IPv6) Description: Enables or Disables the Receive Segment Coalescing feature for IPv6 traffic. This is a receiver packets aggregating feature which helps reduce the receive Chelsio T5/T4 Unified Wire for Windows...
Page 60
Description: This parameter enables or disables computation of TCP checksum by the adapter for IPv4 packets. Value: o Disabled o Rx & Tx Enabled o Rx Enabled o Tx Enabled Default: Rx & Tx Enabled Chelsio T5/T4 Unified Wire for Windows...
Page 61
Description: This parameter enables or disables computation of UDP checksum by the adapter for IPv4 packets. Value: o Disabled o Rx & Tx Enabled o Rx Enabled o Tx Enabled Default: Rx & Tx Enabled Chelsio T5/T4 Unified Wire for Windows...
Value: Disabled | Enabled Default: Enabled 2.3. NVGRE Offload Chelsio‟s T5 based adapters are uniquely capable of offloading the processing of NVGRE encapsulated frames such that all stateless offloads (checksums, LSO, VMQ and filtering) are Chelsio T5/T4 Unified Wire for Windows...
Navigate to Application and Service Logs-> Microsoft->Windows->SMBClient ->Operational 2.6. Troubleshooting If RDMA is not working in your system, please check for the following: Operating system version should be Windows Server 2012 or 2012 R2. Chelsio T5/T4 Unified Wire for Windows...
Page 64
Verify that Chelsio driver is loaded and working. Open PowerShell window and execute the following command : C:\Users\Administrator> driverquery.exe | findstr /I chel Confirm that traffic is running over Chelsio adapter. Look for potential errors in Event Log. Chelsio T5/T4 Unified Wire for Windows...
Single tool with CLI and Web interface that works across Storage, Networking and Hardware. Manage all Chelsio adapters installed on the system. Tool for FAE to debug issues on the Customer front. Freedom to choose various modes of management i.e. CLI or Web GUI. Chelsio T5/T4 Unified Wire for Windows...
The Management Client can be used to connect to agents and manage them. Once connected you can view and configure Chelsio CNAs and related networking, storage and hardware properties. You can use either the CLI or Web GUI client to manage agents based on your Chelsio T5/T4 Unified Wire for Windows...
The authentication credentials, as well as all data exchanged between the CLI client or the Web GUI and the agent, are encrypted using SSL. This ensures that the data cannot be accessed when it is being transmitted over the network. Chelsio T5/T4 Unified Wire for Windows...
T440-LP-CR T420-CX T420-SO-CR 2.2. Platform/Component Matrix The table below lists the Windows versions and the supported UM components. Version/Distribution Supported UM Components Management Agent, Management Client, Management Windows Server 2012 R2 Station Chelsio T5/T4 Unified Wire for Windows...
Chapter III. Unified Wire Manager (UM) 2.3. Platform/Driver Matrix The table below lists the Chelsio T5/T4 driver(s) and their supported versions: Chelsio driver Version 5.3.21.0 Chelsio T5/T4 Unified Wire for Windows...
2. Ensure that the path to python binary (typically "C:\Python26"), is added to PATH system variable. 3. Install Apache HTTP Server 2.2 with SSL. (Download from http://www.apache.org/dist/httpd/binaries/win32/httpd-2.2.25-win32-x86-no_ssl.msi) 4. If the Apache Server is running, it should be stopped before starting the installation process. Chelsio T5/T4 Unified Wire for Windows...
Installer will upgrade it to the current version. 1. Run the UnifiedWireManager-x.x.xx-x64 installer application. 2. Click the Next button for the Chelsio End User License Agreement Window. Figure 3.2 (a) – UM installer welcome window Chelsio T5/T4 Unified Wire for Windows...
Page 73
Chapter III. Unified Wire Manager (UM) 3. Select the radio button I accept the terms of the license agreement and click Next. Figure 3.2 (b) – Chelsio EULA window Chelsio T5/T4 Unified Wire for Windows...
Page 74
Chapter III. Unified Wire Manager (UM) 4. The next window will display the pre-requisites for various UM components. Ensure that they are met before proceeding. Click Next. Figure 3.2 (c) – UM prerequisites window Chelsio T5/T4 Unified Wire for Windows...
Page 75
Chapter III. Unified Wire Manager (UM) 5. Now, either select Complete for complete package installation or else select Custom radio button to customize the installation. Click Next. Figure 3.2 (d) – Select setup (installation) type Chelsio T5/T4 Unified Wire for Windows...
Page 76
If you selected Custom, the next window will display the location where UM will be installed by default. You can change the location by using the Change button or click Next to continue with the default path. Figure 3.2 (e) – Changing UM installation path Chelsio T5/T4 Unified Wire for Windows...
Page 77
Figure 3.2 (f) – Selecting UM components to install If Management Station is selected, please make sure that all related Note prerequisites are met before proceeding (See Pre-requisites) or else the component will be skipped during installation. Chelsio T5/T4 Unified Wire for Windows...
Page 78
Chapter III. Unified Wire Manager (UM) 6. Click Install to start the installation. Unified Wire Manager will now be installed with the selected options. Figure 3.2 (g) – Starting UM installation Chelsio T5/T4 Unified Wire for Windows...
Page 79
Chapter III. Unified Wire Manager (UM) 7. Select Finish to exit the UM Installer. Figure 3.2 (h) – Finishing UM installation Chelsio T5/T4 Unified Wire for Windows...
Uncomment "LoadModule ssl_module modules/mod_ssl.so" Add the following lines: RewriteEngine On RewriteCond %{HTTPS} !=on RewriteRule ^/?(.*) https://%{SERVER_NAME}/$1 [R,L] 4.1.2. SSL Certificate 1. Execute the following lines in command prompt and provide info to generate OpenSSL certificate and keys: Chelsio T5/T4 Unified Wire for Windows...
Page 81
Uncomment the following line SSLSessionCache "dbm:C:/Program Files (x86)/Apache Software Foundation/Apache2.2/logs/ssl_scache" Comment the following line SSLSessionCache "shmcb:C:/Program Files (x86)/Apache Software Foundation/Apache2.2/logs/ssl_scache(512000)" Use the Windows Event Log (Event Viewer) for troubleshooting any installation Note related issues. Chelsio T5/T4 Unified Wire for Windows...
Verifying Management Agent 1. On the system running Management Agent, launch Services from the Control Panel. You can also type services.msc in the Run command. This will open the Services window. Figure 5.1(a) – Windows Services Chelsio T5/T4 Unified Wire for Windows...
2. Search for Unified Wire Management Station in the list of services. You should get the options to stop,start and restart the service in the Actions menu on the left side. Figure 5.3 – Verifying Management Station service status Chelsio T5/T4 Unified Wire for Windows...
Page 84
Chapter III. Unified Wire Manager (UM) While accessing the Web Management Interface, if an error “Management Note Station is not running” is displayed at the log-in page, follow the above steps to restart Management Station and try again. Chelsio T5/T4 Unified Wire for Windows...
If there is a firewall appliance / software protecting the network that the system is on, and you wish to connect to the system from a different network, using the client, the firewall appliance also needs to be configured appropriately. Chelsio T5/T4 Unified Wire for Windows...
Also, two different Web GUI or CLI clients cannot connect to a management agent at the same time. There is no mechanism to allow this scenario. Chelsio T5/T4 Unified Wire for Windows...
2. Search for “Apachex.x” in the list of services and click Start in the Action menu on the left. Figure 8.1.1 (a) – Starting Apache HTTP server 3. Search for “Unified Wire Management Station” and click Start in the Action menu on the left. Figure 8.1.1(b) – Starting Management Station service Chelsio T5/T4 Unified Wire for Windows...
You will need to select the correct option to continue. Security Certificate prompt in Internet Explorer Figure 8.2 (a) - Security Certificate prompt in Mozilla Firefox Figure 8.2 (b) - Chelsio T5/T4 Unified Wire for Windows...
Page 89
Login button. Figure 8.2 (e) - Web GUI Login page Not performing any operation/action for 5 minutes will result in session timeout. Note You will have to re-login and connect to the Agents again. Chelsio T5/T4 Unified Wire for Windows...
Navigation Pane. The panels can be expanded and collapsed by clicking on the panel heading. The Bottom bar has the About link on the right and copyright details on the left. Figure 8.3 – Web Management Interface Chelsio T5/T4 Unified Wire for Windows...
The passwords are encrypted, but it is still advisable to store passwords only if the system you are running the GUI client on, is secure. Figure 8.4.1 (a) - Bookmarks and history module Chelsio T5/T4 Unified Wire for Windows...
Page 92
Select the system from the Bookmark list and click Delete system to remove it. Once removed, the system will no longer appear in the Bookmarks and History Note module. If you wish to manage that system again, you will have to use the “Add system” option. Chelsio T5/T4 Unified Wire for Windows...
Page 93
Installing Driver 1. In the Choose the card fields, select T3 or T4/T5 depending on the chip revision of the network card. 2. Select the operating system for which drivers are to be installed in the Choose the OS Type field.
Page 94
Use this option to connect to new Agents using their IP or Hostname. The TCP port for connection is by default 35001. You will have to provide correct user credentials for the agent in order to connect successfully. Chelsio T5/T4 Unified Wire for Windows...
Page 95
If you deselect the „Remember Password‟ option, you will be asked to enter the password every time you try to connect to the system. Figure 8.4.2 (a) - Adding a UM Agent Chelsio T5/T4 Unified Wire for Windows...
Page 96
Recipients field separated a comma. Enter Mail server details and ensure that the “Enable email Alerts” field is enabled. Select the Agent(s), for which you want to receive alerts and Click on Save. Chelsio T5/T4 Unified Wire for Windows...
Page 97
Various configurable parameters have been categorized into several modules like Boot Configuration module to install and erase option ROM, Network Configuration module to set MTU and VLAN ID, Card Configuration module to change driver parameters, etc. Chelsio T5/T4 Unified Wire for Windows...
Page 98
MTU size of a network interface (in the Network Configuration module), create a group with group type Network. To install or erase option ROM on a Chelsio T4 adapter (in the Boot Configuration module), create a group with group type t4adapter.
Page 99
Using this module, you can install option ROM or erase option ROM on Chelsio network devices. The Set Default Boot Settings button will reset the adapter to factory boot settings. Figure 8.4.6 (c) – Boot Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 100
MTU can be set between 1500-9000 bytes. VLAN id can be set for an adapter within the range 0-4094 (enter 0 to disable it). The IP type can be static or DHCP. Figure 8.4.6 (d) – Network Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 101
The Card Configuration module allows you to set various adapter settings including TCP Offload. Offload settings are only available when using the TOE capable drivers (t3_tom and toecore for T3 cards; t4_tom and toecore for T4 cards). Figure 8.4.6 (e) – Card Configuration module...
Page 102
In the Port Configuration module, you can set various port settings like enabling Tx checksum and TCP segmentation offload, setting Link speed and link duplex mode, etc. The settings depend on the device driver installed. Figure 8.4.6 (f) - Port Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 103
Chapter III. Unified Wire Manager (UM) Bypass Configuration Use the Bypass Configuration module to configure Chelsio‟s bypass adapters like B420-SR and B404-BT. Figure 8.4.6 (g) - Bypass Configuration module Chelsio T5/T4 Unified Wire for Windows...
The system page contains generic system and support modules which are discussed below: 8.5.1. System summary This module lists the system Hostname, Operating System, platform and also gives the count of the Chelsio cards found. Figure 8.5.1 (a) - System Summary module Chelsio T5/T4 Unified Wire for Windows...
Page 105
Chapter III. Unified Wire Manager (UM) 8.5.2. Drivers Installation Using this module, one can install various Chelsio drivers for different operating systems. Figure 8.5.2 (a) - Drivers Installation module connected to Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 106
(Yes to load, No to unload) in the corresponding cell of the Loaded column and click Load/Unload Driver button. Click Refresh if changes are not reflected immediately. To reject the load/unload option selected, click Discard Changes. Figure 8.5.3 - Driver Details module Chelsio T5/T4 Unified Wire for Windows...
Page 107
(type of test; you can run more than one test at a time) and click Run Test. After the tests are completed, the results will be displayed in a tabular format. Figure 8.5.4 - System Diagnostics module for a T4 CNA Chelsio T5/T4 Unified Wire for Windows...
Page 108
A list of the Unified Wire Manager agent components installed on the managed system is shown in this module. The versions of the components are useful in case of reporting an issue to support. Figure 8.5.5 - Unified Wire Manager Component Versions module Chelsio T5/T4 Unified Wire for Windows...
Page 109
The properties box will display the domain state of the machines selected. Now, click on any of the system power actions provided at the bottom. Figure 8.5.6 - VM Configurations module Chelsio T5/T4 Unified Wire for Windows...
Page 110
Use the Get Logs button to retrieve, and Hide Logs button to clear the log entries. The Delete Logs button will remove the logs permanently from the agent. Figure 8.5.7 - Managed System Application Logs module for Windows Agent Chelsio T5/T4 Unified Wire for Windows...
8.6.1. Network summary The Network Summary module provides the total number of Chelsio adapters present, including the number of T5, T4 and T3 adapters. It also provides the total number of Network interfaces including corporate and Chelsio interfaces and VLANs.
Page 112
This module provides PCI, firmware and other details of the card. The card's serial number and factory MAC address are also provided for inventory purposes. Figure 8.6.2 (a) - Card Summary module for a Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 113
TOE capable drivers (t3_tom and toecore for T3 cards; t4_tom and toecore for T4 cards). On changing the settings, the changed settings may not reflect immediately on refreshing the data. Highlight the system item in the tree menu on the left, and click "Refresh", to refresh data from the system, in case the updated settings are not being...
Page 114
Chapter III. Unified Wire Manager (UM) Device Driver settings (Windows) The device driver settings applicable to the card are shown here. For Chelsio T5 and T4 adapters, only the MaxVMQueues field will be displayed. On changing the settings, the changed settings may not reflect immediately on refreshing the data.
Page 115
The modules available on this page are as below: Port summary The port details such as the Ethernet adapter name and link details are shown in this module. Figure 8.6.2.1 (a) - Port Summary of T4 CNA Chelsio T5/T4 Unified Wire for Windows...
Page 116
Port settings Port settings such as MTU, Link speed and others can be set in this module. The settings depend on the device driver installed. Figure 8.6.2.1 (b) - Port Settings of T4 CNA Chelsio T5/T4 Unified Wire for Windows...
Page 117
Chapter III. Unified Wire Manager (UM) Port statistics Ethernet statistics and additional hardware statistics for the port are displayed in this module. Figure 8.6.2.1 (c) - Port Statistics of T4 CNA on Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 118
0-4094 (enter 0 to disable it). You can use the View/Set IP addresses option to add, modify or delete IP aliases. Figure 8.6.3 (a) - System network configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 119
Chapter III. Unified Wire Manager (UM) Figure 8.6.3 (b) – Managing IP aliases Chelsio T5/T4 Unified Wire for Windows...
Page 120
Table view in the Advanced NIC characteristics. The polling time field sets the average time (in seconds) based on which the table/graph updates the report. Figure 8.6.3 (c) - System network statistics module Chelsio T5/T4 Unified Wire for Windows...
Page 121
Chapter III. Unified Wire Manager (UM) Figure 8.6.3 (d) - Network Throughput Vs Time instant Graph Figure 8.6.3 (e) - Network Throughput Vs Time instant Table Chelsio T5/T4 Unified Wire for Windows...
Page 122
Windows, you may set multiple default gateways. Use the option to set multiple default gateways with caution, since it may cause the system to stop communicating with external networks. Figure 8.6.3 (f) - Default gateway and DNS configuration module for a Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 123
2 ports of a single offload-enabled card, and not across Chelsio cards. Do not mix third party cards and offload-enabled Chelsio cards in a single team. Figure 8.6.3 (g) - Create a network team/bond device module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 124
Use the GetConnections utility to view currently active TCP/UDP connections. Offload status for each connection is also displayed if protocol offload hardware is available. This is useful for troubleshooting any connectivity issues for clients to various services. Figure 8.6.3 (h) - Ping Utility Chelsio T5/T4 Unified Wire for Windows...
Page 126
To do so, click on the virtual machine and click “Detach”. Similarly, detach all the virtual machines and then use the “Delete Switch” to delete the virtual network. Figure 8.6.3.1 (a) – Virtual Network Manager module Chelsio T5/T4 Unified Wire for Windows...
Page 127
Once created, you can manage the virtual networks in the Virtual Network Manager module. Figure 8.6.3.1 (b) – Creating external virtual network Figure 8.6.3.1 (c) – Creating internal virtual network Chelsio T5/T4 Unified Wire for Windows...
Page 128
To attach a virtual network to a virtual machine, select the virtual network from the Virtual Network list and the virtual machine from the VM list. Finally click Attach. Figure 8.6.3.1 (e) – Attaching Virtual Network to VM Chelsio T5/T4 Unified Wire for Windows...
Page 129
On Linux Agents, iWARP parameter settings for Chelsio's RDMA capable NICs can be set using this module. These settings can be set only when iWARP driver (iw_cxgb4 for T4 and T5; iw_cxgb3 for T3) is loaded. If you set any parameter for a T5 adapter, it applies for all the T5 adapters present.
Page 130
Chapter III. Unified Wire Manager (UM) Figure 8.6.4 (a) – iWARP settings for T4 CNA for FreeBSD Agent Chelsio T5/T4 Unified Wire for Windows...
Page 131
Chapter III. Unified Wire Manager (UM) Figure 8.6.4 (b) – iWARP settings for T4 CNA for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
This module provides details about the driver installed; such as driver name and its version. The module also gives information about the number of FCoE enabled cards that are present on the machine. Figure 8.7.1 (a) – FCoE Initiator Summary module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 133
Figure 8.7.1.1 (a) – FCoE Card Summary module FCoE Attributes Information such as Interrupt modes (MSI/MSI-X/INTx), SCSI mode and the card state are provided in this module. Figure 8.7.1.1 (b) – FCoE Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 134
NPIV management support. It contains the following sections: FCoE Port Summary The SCSI adapter name and the underlying ENODE MAC address of the physical port can be found here. Figure 8.7.1.2 (a) – FCoE Port Summary module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 135
(10G/1G) being used. Note that only class 3 service is supported by the initiator for now and the frame size is fixed to 2128 bytes as per spec. Figure 8.7.1.2 (b) – FCoE Port Atrributes module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 136
To delete a virtual port, select the option Delete and select the virtual port WWPN which you want to delete and click on delete. Figure 8.7.1.2 (c) – FCoE NPIV management module Chelsio T5/T4 Unified Wire for Windows...
Page 137
This module provides details about the discovered target such as target‟s FC ID, WWPN and WWNN so that the user can identify the discovered target accordingly. Figure 8.7.1.3 (a) – FCoE Remort Port Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 138
This module provides the LUN information such as size of the LUN, SCSI address, and LUN address. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format. Figure 8.7.1.3 (b) – FCoE Remote Port Lun Details module Chelsio T5/T4 Unified Wire for Windows...
Page 139
FCoE Virtual Port Summary The SCSI adapter name and the underlying ENODE MAC address of the physical port can be found here. Figure 8.7.1.4 (a) – FCoE Virtual Port Summary module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 140
(10G/1G) being used. Note that only class 3 service is supported by the initiator for now and the frame size is fixed to 2128 bytes as per spec. Figure 8.7.1.4 (b) – FCoE Virtual Port Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 141
LUN, SCSI address, and LUN address are provided. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format. Figure 8.7.1.4 (d) - FCoE Remote Port Lun Details module Chelsio T5/T4 Unified Wire for Windows...
Page 142
8.7.2. iSCSI initiator (Linux, Windows) All supported iSCSI initiators can be managed from this page. The supported initiators on Windows are Microsoft and Chelsio iSCSI initiator (T4 adapters). On Linux, Open iSCSI initiator is supported. The modules available on this page are: Initiator nodes This module lists the initiator nodes / virtual adapters configured in the initiator stack.
Page 143
Chapter III. Unified Wire Manager (UM) Figure 8.7.2 (b) - Microsoft iSCSI initiator Chelsio T5/T4 Unified Wire for Windows...
Page 145
(the IP address and TCP Port specified when discovering the target). If there are any pre-existing iSCSI sessions established to the target, deletion of Note the target Portal from the discovered targets list will fail. Figure 8.7.2 (d) - Discover targets module Chelsio T5/T4 Unified Wire for Windows...
Page 146
If a target is connected, the sessions and connections to the target, and the disks provided by the target will be listed. Figure 8.7.2 (e) - Targets module after logging in Chelsio T5/T4 Unified Wire for Windows...
Page 147
PCI, firmware and other adapter related details are provided in this module. Select the Chelsio adapter for which you want to view properties from the Select a T4 Card drop-down list and the module will expand to display related properties. You can also view details like link id, status, enode mac, etc of all the ports of the selected adapter.
Page 148
Here you can configure various port settings like VLAN id, Maximum Transmission Unit (MTU) and IP. Select a Chelsio adapter from Select a T4 Card drop-down list and then select the port for which you want set any of the aforementioned properties. MTU can be set between 1500- 9000 bytes.
Page 149
In the FO iSCSI Initiator Properties module, you can configure FO iSCSI Initiator by setting different properties like enabling/disabling CHAP authentication, setting Header and Data digest, etc. Figure 8.7.3 (c) - FO iSCSI Initiator Properties Chelsio T5/T4 Unified Wire for Windows...
Page 150
In this module, you can set upto 8 instances. Configurable parameters include initiator node name (IQN), alias (friendly) name, Initiator (CHAP) Username and password. Figure 8.7.3 (d) - FO iSCSI Manage Instances module Chelsio T5/T4 Unified Wire for Windows...
Page 151
(target) IP. Finally, click Discover. After successful discovery, all the discovered targets will appear in the Discovered Targets section. To view more details, click on the Target name. Figure 8.7.3 (e) - FO iSCSI Discover Details module Chelsio T5/T4 Unified Wire for Windows...
Page 152
CHAP for a secure iSCSI connection. One-way (target authenticates the initiator) and Mutual (target and initiator authenticate each other) authentication methods are supported. Figure 8.7.3 (f) - FO iSCSI Session Details module: Login Chelsio T5/T4 Unified Wire for Windows...
Page 153
Established sessions section. Select the Adapter and session id. Details of the selected session will be displayed. To end the session, click Logout. Figure 8.7.3 (g) - FO iSCSI Session Details module: Established Sessions Chelsio T5/T4 Unified Wire for Windows...
Page 154
Target properties is also available. The modules available on this page are as below: Target Stack Globals This module displays various global properties of a currently connected iSCSI target. Authentication priority between CHAP and ACL can be set here. Figure 8.7.4 (a) - Target Stack Globals module Chelsio T5/T4 Unified Wire for Windows...
Page 155
Properties such as Target name and Alias, Max Data Receive Length, Authentication mode related to a specific iSCSI target can be viewed and modified here. iSCSI targets can be started/stopped or deleted. Figure 8.7.4 (b) - Target properties module Chelsio T5/T4 Unified Wire for Windows...
Page 156
Chapter III. Unified Wire Manager (UM) Session details Details including Session ID, Initiator IQN and Connections List of all discovered and currently connected iSCSI targets are listed here. Figure 8.7.4 (c) – Session Details module Chelsio T5/T4 Unified Wire for Windows...
Page 157
Chapter III. Unified Wire Manager (UM) New Target Creation New iSCSI target can be created here by specifying the Target IQN and Target Alias name. Figure 8.7.4 (d) - New Target Creation module Chelsio T5/T4 Unified Wire for Windows...
Page 158
View/Edit iSCSI Target LUNs This module displays various Logical Units created in an iSCSI Target. Selected LUNs can be deleted. Figure 8.7.5 (a) - View/Edit iSCSI Target LUNs module Chelsio T5/T4 Unified Wire for Windows...
Page 159
Device and RAM Disk Size etc. RW (Read-Write) and RO (Read Only) are the two kinds of permissions that can be set. If Ram Disk is selected, then a minimum of 16 MB should be provided. Figure 8.7.5 (b) - Adding a new LUN Chelsio T5/T4 Unified Wire for Windows...
Page 160
Portal List on the left displays details of the portal group on which an iSCSI target is listening and the related info is displayed on the right under Portal Details. Selected portals can be deleted. Figure 8.7.6 (a) - View/Edit iSCSI Target Portals module Chelsio T5/T4 Unified Wire for Windows...
Page 161
Chapter III. Unified Wire Manager (UM) Add Portal New Portals can be added here by choosing the specific target and Portal IP address. The Port number should be 3260. Figure 8.7.6 (b) – Adding a new Portal Chelsio T5/T4 Unified Wire for Windows...
Page 162
View/Edit iSCSI Target ACLs This module displays details for all the ACLs configured for an iSCSI Target. Selected ACLs can be deleted. Figure 8.7.7 (a) - Target ACL operations module Chelsio T5/T4 Unified Wire for Windows...
Page 163
Chapter III. Unified Wire Manager (UM) Add ACL New ACLs can be configured by specifying Target name, initiator IQN name, IP address and permission type. Figure 8.7.7 (b) - Adding new ACL Chelsio T5/T4 Unified Wire for Windows...
Chapter III. Unified Wire Manager (UM) 8.8. Hardware Features The Hardware module lists the status of configuration modules under Hardware Features section, running on the agent. Figure 8.8 – Hardware module Chelsio T5/T4 Unified Wire for Windows...
Page 165
Note time to reflect. Highlight the system item in the tree menu on the left, and click "Refresh system", to refresh data from the system, in case the updated settings are not being shown. Chelsio T5/T4 Unified Wire for Windows...
Page 166
Chapter III. Unified Wire Manager (UM) T4 Filtering configuration T4 Filtering options can be set only when offload driver (t4_tom) is not loaded. A list of pre-defined filter selection combinations is displayed. The combination fragmentation, mpshittype, protocol, vlan, port, fcoe is active by default. To select a different combination, highlight it in the Combinations list by clicking and click “Set Active Combination”.
Page 167
8.8.2. Traffic Management (Linux) Using this page, one can add/delete/modify offload policies only in the presence of offload driver (t3_tom for T3 adapters; t4_tom for T4 adapters). 8.8.3. Traffic Management configuration The Chelsio Card section on the left displays all the cards available in the server and their corresponding policies on the right.
Page 168
8.8.4. Boot T4 Save Config File (Linux) This module displays the current T4 configuration tuning option selected. You can also change the tuning option by selecting the config file for each option located in /ChelsioUwire- x.x.x.xx/src/network/firmware. For instance, to select Low latency Networking, locate the file, t4- config.txt, in /ChelsioUwire-x.x.x.xx/src/network/firmware/low_latency_config directory.
Page 169
Option ROM only if you are planning to boot the system via iSCSI. Refer the iSCSI boot documentation for more details about its configuration. Figure 8.8.5 (a) - Option ROM management module for a T3 card Chelsio T5/T4 Unified Wire for Windows...
Page 170
8.8.6. T5/T4 Boot Option ROM management This module allows managing the PXE and FCoE boot capability for Chelsio T5 and T4 cards. The Option ROM (PXE and FCoE) may be installed to or erased from the card. The version of Option ROM flashed can be viewed here.
Page 171
FCoE targets. Enable the Option ROM only if you are planning to boot the system via PXE or install the operating system on FCoE LUN. Figure 8.8.7 (a) - PXE Boot configuration for T4 CNAs Chelsio T5/T4 Unified Wire for Windows...
Page 172
Chapter III. Unified Wire Manager (UM) Figure 8.8.7 (b) - FCoE Boot configuration for T4 CNAs Figure 8.8.7 (c) - iSCSI Boot configuration for T4 CNAs Chelsio T5/T4 Unified Wire for Windows...
Page 173
The Watchdog timer is used to ensure that if there is a software failure, the switch will enter the default state. The Watchdog timeout value should be provided in milliseconds. Figure 8.8.8 (a) - Bypass Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 174
To edit an existing rule, select the corresponding checkbox, change the desired paremeters and click Save Changes. To delete a rule, select the corresponding checkbox and click Delete a Filter. Finally, click Save Changes. You can delete multiple rules using this method. Chelsio T5/T4 Unified Wire for Windows...
Page 177
Chapter III. Unified Wire Manager (UM) 8.8.9. T4 Egress Class Schedulers (Linux) Schedulers can be set only when T5/T4 network driver (cxgb4) is loaded. Egress Queue Map Using this module, you can bind (map) NIC (non-offloaded) Tx queues to Tx Scheduler classes.
Chapter III. Unified Wire Manager (UM) 9. Uninstalling Unified Wire Manager To uninstall Unified Wire Manager, use Programs and Features in the Control Panel. Chelsio T5/T4 Unified Wire for Windows...
The following are the currently shipping Chelsio Adapters that are compatible with Chelsio UM for Win PE: T502-BT T520-CR T580-CR T580-LP-CR T580-SO-CR T520-LL-CR T520-SO-CR T540-CR T522-CR T420-CR T440-CR T422-CR T420-LL-CR T440-LP-CR T420-CX T420-SO-CR T420-BT T404-BT Chelsio T5/T4 Unified Wire for Windows...
Examples 1.3.1. Viewing help Run the following command to view the list of commands available under a service. X:\windows\system32> chelsio_uwlite.exe <service-name> E.g. To view commands available under the chelsio service: X:\windows\system32> chelsio_uwlite.exe Chelsio Chelsio T5/T4 Unified Wire for Windows...
Page 182
Run the following command to view syntax and usage for a sub-command: X:\windows\system32> chelsio_uwlite.exe chelsio <sub-command> /? E.g. To view syntax and usage of EraseSettings sub-command under chelsio service: X:\windows\system32> chelsio_uwlite.exe chelsio erasesettings /? Chelsio T5/T4 Unified Wire for Windows...
Page 183
Now, run the following command to flash option ROM onto the adapter: X:\windows\system32> chelsio_uwlite.exe chelsio flashrom adapter=<idx> path=<option_rom_image> Here, is the CNA index found in step i (0 in this case) and option_rom_image is the path to Option ROM image file, cuwlbt4.bin Chelsio T5/T4 Unified Wire for Windows...
Page 184
X:\windows\system32> chelsio_uwlite.exe chelsio listadapters Now, run the following command to erase option ROM from the adapter: X:\windows\system32> chelsio_uwlite.exe chelsio eraserom adapter=0 force=1 Here, is the CNA index found in step i (0 in this case) Chelsio T5/T4 Unified Wire for Windows...
Software furnished will be free from defects in material or workmanship under normal use and service a period of thirty (30) days from the date of delivery to you. CHELSIO DOES CANNOT Chelsio T5/T4 Unified Wire for Windows...
Page 187
Government is subject the restrictions of this Agreement in accordance with 48 C.F.R. 12.212 of the Federal Acquisition Regulations and successors and 49 C.F.R. 227.7202-1 of the DoD FAR Supplement and its successors. Chelsio T5/T4 Unified Wire for Windows...
Page 188
Agreement. Should you have any questions concerning this Agreement, you may contact Chelsio by writing to: Chelsio Communications, Inc. 370 San Aleso Ave. Sunnyvale, CA 94085 Chelsio T5/T4 Unified Wire for Windows...
Need help?
Do you have a question about the T4 and is the answer not in the manual?
Questions and answers