Page 2 For all support related questions please send email to support@chelsio.com Copyright © 2015. Chelsio Communications. All Rights Reserved. Chelsio ® is a registered trademark of Chelsio Communications. All other marks and names mentioned herein may be trademarks of their respective companies. Chelsio T5/T4 Unified Wire for Windows...
Page 3: Version History
1.1.4 09/23/2013 1.1.5 09/30/2013 1.1.6 12/02/2013 1.1.7 12/05/2013 1.1.8 12/16/0213 1.1.9 01/13/2014 1.2.0 01/23/2014 1.2.1 02/05/2014 1.2.2 02/11/2014 1.2.3 02/28/2014 1.2.4 04/22/2014 1.2.5 05/27/2014 1.2.6 07/21/2014 1.2.7 09/01/2014 1.2.8 11/06/2014 1.2.9 11/25/2014 1.3.0 03/25/2015 Chelsio T5/T4 Unified Wire for Windows...
Page 4 Software/Driver Uninstallation Software/Driver Update NDIS FUNCTION Introduction 1.1. Hardware Requirements 1.2. Software Requirements Software/Driver Configuration and Fine-tuning 2.1. Assigning IP address to the Chelsio Network Adapter 2.2. Advanced Configuration 2.3. NVGRE Offload 2.4. Enabling SMB Direct 2.5. Verifying RDMA 2.6.
Page 5 8.5. System page 8.6. Network page 8.7. Storage 8.8. Hardware Features Uninstalling Unified Wire Manager UM FOR WIN PE Introduction 1.1. Hardware Requirements 1.2. Software Requirements 1.3. Examples APPENDIX Chelsio End-User License Agreement (EULA) Chelsio T5/T4 Unified Wire for Windows...
Page 6: I. Chelsio Unified Wire
Chapter I. Chelsio Unified Wire I. Chelsio Unified Wire Chelsio T5/T4 Unified Wire for Windows...
Page 7: Introduction
Chapter I. Chelsio Unified Wire 1. Introduction Thank you for choosing Chelsio T5/T4 Unified Wire adapters. These high speed, single chip, single firmware cards provide enterprises and data centers with high performance solutions for various Network and Storage related requirements.
Page 8: Hardware Requirements
Chapter I. Chelsio Unified Wire 1.2. Hardware Requirements The Chelsio T5/T4 Unified Wire supports all x64 architectures supporting PCIE (x4, x8) slots. AMD CPUs, 64-bit (x86_64/amd64) Intel CPUs, 64-bit (x86_64) The Chelsio Unified Wire supports 3.3v PCI bus only. Running an adapter on a...
Page 9: Hardware Installation
6. For maximum performance, it is highly recommended to install the adapter into a PCIE x8 slot. 7. Holding the Chelsio adapter by the edges, align the edge connector with the PCI connector on the motherboard. Apply even pressure on both edges until the card is firmly seated. It may be necessary to remove the SFP (transceiver) modules prior to inserting the adapter.
Page 10: Software/Driver Installation
Chapter I. Chelsio Unified Wire 3. Software/Driver Installation Chelsio Unified Wire Installer provides two methods of installation: GUI and CLI mode. GUI mode provides an interactive GUI installer with customizable options. Whereas, CLI mode enables unattended installation of Chelsio drivers and software thereby relieving the user from monitoring the installation process and providing input via dialog boxes.
Page 11: Installing Unified Wire
Installing Unified Wire 3.2.1. GUI mode (Installer) 1. Run the ChelsioUwire-x.x.x.xx.exe installer application. 2. Click the Next button for the Chelsio End User License Agreement Window. Figure 3.2 (a) – Unified Wire Installer welcome window Chelsio T5/T4 Unified Wire for Windows...
Page 12 Chapter I. Chelsio Unified Wire 3. Select the radio button I accept the terms of the license agreement and click Next. Figure 3.2 (b) – Chelsio EULA window Chelsio T5/T4 Unified Wire for Windows...
Page 13 Chapter I. Chelsio Unified Wire 4. Now, either select Complete for complete package installation or else select Custom radio button to customize the installation. Figure 3.2 (c) – Select setup (installation) type Chelsio T5/T4 Unified Wire for Windows...
Page 14 Chapter I. Chelsio Unified Wire If you select Custom, you can choose whether to install Network driver or not. Figure 3.2 (d) – Customizing the installation Chelsio T5/T4 Unified Wire for Windows...
Page 15 Chapter I. Chelsio Unified Wire 5. Click Install to start the installation. Figure 3.2 (e) – Start Installation Chelsio T5/T4 Unified Wire for Windows...
Page 16 Chapter I. Chelsio Unified Wire 6. Selected drivers will now be installed. Figure 3.2 (f) – Installation in progress Chelsio T5/T4 Unified Wire for Windows...
Page 17 Chapter I. Chelsio Unified Wire 7. After successful installation of driver(s), the Unified Wire Manager installer will be invoked. Click the Next button for the Chelsio End User License Agreement Window. Figure 3.2 (g) – UM installer welcome window Chelsio T5/T4 Unified Wire for Windows...
Page 18 Chapter I. Chelsio Unified Wire 8. Select the radio button I accept the terms of the license agreement and click Next. Figure 3.2 (h) – Chelsio EULA window Chelsio T5/T4 Unified Wire for Windows...
Page 19 9. The next window will display the pre-requisites for various UM components. Ensure that they are met before proceeding. Click Next. Figure 3.2 (i) – UM prerequisites window If prerequisites mentioned are not met, installation of UM will fail. Driver Note installation will however continue. Chelsio T5/T4 Unified Wire for Windows...
Page 20 Chapter I. Chelsio Unified Wire 10. Now, either select Complete for complete package installation or else select Custom radio button to customize the installation. Click Next. Figure 3.2 (j) – Select setup (installation) type Chelsio T5/T4 Unified Wire for Windows...
Page 21 If you selected Custom, the next window will display the location where UM will be installed by default. You can change the location by using the Change button or click Next to continue with the default path. Figure 3.2 (k) – Changing UM installation path Chelsio T5/T4 Unified Wire for Windows...
Page 22 Figure 3.2 (l) – Selecting UM components to install If Management Station is selected, please make sure that all related Note prerequisites are met before proceeding (See Pre-requisites) or else the component will be skipped during installation. Chelsio T5/T4 Unified Wire for Windows...
Page 23 Chapter I. Chelsio Unified Wire 11. Click Install to start the installation. Unified Wire Manager will now be installed with the selected options. Figure 3.2 (m) – Starting UM installation Chelsio T5/T4 Unified Wire for Windows...
Page 24 Chapter I. Chelsio Unified Wire 12. Select Finish to exit the UM Installer. Figure 3.2 (n) – Finishing UM installation Chelsio T5/T4 Unified Wire for Windows...
Page 25 To install drivers using this feature, open command prompt and execute the following command: C:\Users\Administrator>ChelsioUwire-x.x.x.xx.exe –in <driver(s)> E.g.: C:\Users\Administrator>ChelsioUwire-x.x.x.xx.exe –in all The above command will install all the drivers/software. To know more about other parameters and options, execute the following command: C:\Users\Administrator>ChelsioUwire-x.x.x.xx.exe -help Chelsio T5/T4 Unified Wire for Windows...
Page 26 CLI operations. A log file, ChelsioUwire-x.x.x.xx.log, is created in the same directory which Note keeps a record of all the commands executed and their results. Chelsio T5/T4 Unified Wire for Windows...
Page 27: Mass Deployment
Administrator)and run the following command: PS C:\Users\Administrator> .\ChelsioUwire-x.x.x.xx.exe -sampleconfig The above command will generate a sample configuration file, RemoteMachineconfig.txt. It contains the following directives: StartShareMachineInfo ExecutablePath:\\<Machine-IP>\<Shared directory>\ChelsioUwire-x.x.x.xx.exe User:<user> Password:<password> EndShareMachineInfo StartOfCluster <user>:<Password> <IPAddress1> <IPAddress2> <IPAddress3> <IPAddressN> EndOfCluster Chelsio T5/T4 Unified Wire for Windows...
Page 28 10.193.184.78:admin:pass_456 4. Save the file to a desired location. For successful deployment of UM components and flashing/erasing option ROM, Note please ensure that the host machine and remote nodes are in the same domain. Chelsio T5/T4 Unified Wire for Windows...
Page 29: Flashing Option Rom
Deploying components and Flashing Option ROM together.  Deploying components and Flashing Option ROM separately. Both methods mentioned above will flash option ROM only onto the first Chelsio Note adapter present in the remote node. If you plan to flash more adapters in the same node or add new nodes to the cluster, they will have to be added as members to a group and flashed using UM’s CLI component.
Page 30 Chapter I. Chelsio Unified Wire 2. Click the Next button for the Chelsio End User License Agreement Window. Figure 4.2.1 (a) – UM Installer welcome window Chelsio T5/T4 Unified Wire for Windows...
Page 31 Chapter I. Chelsio Unified Wire 3. Select the radio button I accept the terms of the license agreement and click Next. Figure 4.2.1 (b) – Chelsio EULA Window Chelsio T5/T4 Unified Wire for Windows...
Page 32 Chapter I. Chelsio Unified Wire 4. The next window will display the pre-requisites for various UM components. Ensure that they are met before proceeding. Click Next. Figure 4.2.1 (c) – UM prerequisites window Chelsio T5/T4 Unified Wire for Windows...
Page 33 Chapter I. Chelsio Unified Wire 5. Now, select Custom radio button to customize the installation. Click Next. Figure 4.2.1 (d) – Select setup (installation) type Chelsio T5/T4 Unified Wire for Windows...
Page 34 The next window will display the location where UM will be installed by default. You can change the location by using the Change button or click Next to continue with the default path. Figure 4.2.1 (e) – Changing UM installation path Chelsio T5/T4 Unified Wire for Windows...
Page 35 Chapter I. Chelsio Unified Wire Next, ensure that only Client is selected under features to be installed. Click Next. Figure 4.2.1 (f) – Selecting UM components to install Chelsio T5/T4 Unified Wire for Windows...
Page 36 Chapter I. Chelsio Unified Wire 6. Click Finish to complete Client installation. Figure 4.2.1 (g) – Finishing UM installation Chelsio T5/T4 Unified Wire for Windows...
Page 37 7. Now, installation of UM Agent component on remote nodes will commence. Figure 4.2.1 (h) – Starting Agent installation 8. Click Agree on the PsExec License Agreement Window that appears. This window will appear only during first installation. Figure 4.2.1 (i) – PsEXec License Agreement Chelsio T5/T4 Unified Wire for Windows...
Page 38 Option ROM to fail on remote nodes. UM components will have to be deployed again to fix this issue. 10. Option ROM will now be flashed onto adapters on remote nodes present in the OptionROM group. Figure 4.2.1 (k) – Flashing option ROM Chelsio T5/T4 Unified Wire for Windows...
Page 39 3. After completion, a log file MassDeploy.log containing the summary of the process will be created. Click OK on the dialog box that appears to exit the installer and view the log. Figure 4.2.2 (a) – Finishing UM components deployment Chelsio T5/T4 Unified Wire for Windows...
Page 40: Erasing Option Rom
Installer. 4.3. Erasing Option ROM Unified Wire Installer will erase option ROM only from the first Chelsio adapter Note present in the remote node. If you plan to erase from more adapters in the same node or add new nodes to the cluster, they will have to be added as members to a group and erased using UM’s CLI component.
Page 41 Figure 4.3 (a) – Starting option ROM erasing 3. Option ROM will now be erased from adapters on nodes present in the OptionROM group. Figure 4.3 (b) – Erasing option ROM on remote nodes Chelsio T5/T4 Unified Wire for Windows...
Page 42: Configuring Using Um Cli
Note location where UM Client is installed. Typically, this will be C:\Program Files (x86)\Chelsio Communications\UnifiedWireManager\client. To avoid this and run the command from any path, you will need to reboot the host. The following examples assume that the host machine was rebooted before running commands.
Page 43 PS C:\Users\Administrator> chelsio_uwcli.exe –m addmember grpname=OptionROM details=”10.193.185.107;administrator;cdrom888;*;*,*,0,*,*,*,*,*>” Figure 4.4.1 (b) – Adding member to group View group and member details To view details of all the groups and members created, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe –m list Chelsio T5/T4 Unified Wire for Windows...
Page 44 To delete a member from a group, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe –m deletemember grpname=<group_name> index=<member_index> E.g. PS C:\Users\Administrator> chelsio_uwcli.exe –m deletemember grpname=OptionROM index=1 Figure 4.4.1 (d) – Deleting member from group Chelsio T5/T4 Unified Wire for Windows...
Page 45 To flash Option ROM using UM, run the following command: PS C:\Users\Administrator> chelsio_uwcli.exe chelsio flashrom adapter=BULKADAPTER path=<path_to_optionrom_image_file> –B <group_name> E.g. PS C:\Users\Administrator> chelsio_uwcli.exe chelsio flashrom adapter=BULKADAPTER path=C:\Users\Administrator\Desktop\cuwlbt4.bin –B OptionROM Figure 4.4.2 (a) – Flashing option ROM using UM CLI Chelsio T5/T4 Unified Wire for Windows...
Page 46 You can list the adapters on local host and verify if Option ROM was successfully flashed using the following command: PS C:\Users\Administrator> chelsio_uwcli.exe chelsio listadapters –B <group_name> E.g. PS C:\Users\Administrator> chelsio_uwcli.exe chelsio listadapters –B OptionROM Figure 4.4.2 (b) – Viewing status Chelsio T5/T4 Unified Wire for Windows...
Page 47 PS C:\Users\Administrator>chelsio_uwcli.exe -B Figure 4.4.2 (c) – Erasing option ROM using UM CLI 4.4.2. Help To view Unified Wire Manager’s CLI help, run the following command: PS C:\Users\Administrator>chelsio_uwcli.exe –m Chelsio T5/T4 Unified Wire for Windows...
Page 48: Cxgbtool Help
Some of the commands provided can be used to query running statistics to aid in debugging. Definitions [adapterInterface] is the name of the network device to work on, given in the format "nic[0,1,..n]" [vbdInterface] is the name of the Chelsio Bus Enumerator instance to work on, given in the format "vbd[0,1,...n]" Syntax...
Page 49 00000000 00000000 00000000 00000000 00000070 00000000 00000000 00000000 00000000 In show_t4_ctxt: p->mem_id = 0 StatusPgNS: StatusPgRO: FetchNS: FetchRO: Valid: PCIeDataChannel: DCAEgrQEn: DCACPUID: FCThreshOverride: WRLength: WRLengthKnown: ReschedulePending: 0 OnChipQueue: FetchSizeMode FetchBurstMin: FetchBurstMax: FLMcongMode: MaxuPFLCredits: FLMcontextID: uPTokenEn: UserModeIO: uPFLCredits: Chelsio T5/T4 Unified Wire for Windows...
Page 50 C:\Users\Administrator>cxgbtool vbd0 loadfw t5fw-1.11.18.0.bin loadcfg Description: Loads firmware configuration file or clears configuration flash region. The configuration file used must be in text format and not a header file. Note Syntax: cxgbtool [vbdInterface] loadcfg [[firmwareConfigurationFile]|clear] Chelsio T5/T4 Unified Wire for Windows...
Page 51 {val}: Flash Option ROM image to the offset specified by the user. clear: The flash area reserved for Option ROM image will be cleared. Example: Flashing Option ROM image to the offset defined by the PFs EXPROM_OFST: C:\Users\Administrator>cxgbtool vbd0 loadboot cuwlbt4.bin pf 0 Chelsio T5/T4 Unified Wire for Windows...
Page 52 BootROM length: 1664, value2add:0 mdio Description: Reads/writes MDIO register. Syntax: cxgbtool [vbdInterface] mdio [physicalAddress][manageableDevicesAddress][registerAddress] [(writeValue)] Example Read MDIO register C:\Users\Administrator>cxgbtool vbd0 mdio 0 0 0 Write MDIO register C:\Users\Administrator>cxgbtool vbd0 mdio 0 0 0 0 Chelsio T5/T4 Unified Wire for Windows...
Page 53 Loopback 0 using 0 pages out of 144 allocated Loopback 1 using 0 pages out of 144 allocated Loopback 2 using 0 pages out of 144 allocated Loopback 3 using 0 pages out of 144 allocated Chelsio T5/T4 Unified Wire for Windows...
Page 54 Chimney Tx queue statistics. rxtoe: Chimney Rx queue statistics. txrdma: RDMA tx queue statistics. rxrdma: RDMA Rx queue statistics. txctrl: Chimney control queue statistics. txfwd: Chimney forwarding queue statistics. rxnvgre: Rx NVGRE statistics. clr: Clear Queue statistics. Chelsio T5/T4 Unified Wire for Windows...
Page 55 Description: Reads/writes register. Syntax: Register Read: cxgbtool [vbdInterface] reg [readAddress] Register Write: cxgbtool [vbdInterface] reg [[writeAddress] = {val}] Example: Register read: C:\Users\Administrator>cxgbtool vbd0 reg 0x19428 00000008 [8] Register write: C:\Users\Administrator>cxgbtool vbd0 reg 0x19428 = 0x3 Chelsio T5/T4 Unified Wire for Windows...
Page 56 Multi-port support common register set. This module implements the multi-port support for T4, and switches egress packets to the ingress path when their Ethernet DA (Destination Address) matches an address in the exact match Ethernet Address database, or if the outer-VLAN Chelsio T5/T4 Unified Wire for Windows...
Page 57 It interfaces to the external serial flash device. PIO Local Bus controller common register set. This module implements the PIO Local Bus controller. It is physically distributed across T4/T5. Lookup Engine Common register set. The Lookup Engine implements the connection, filter and ACL databases.
Page 58 13:13 Type 12:0 PIDX [0x1e004] SGE_PF_GTS 31:16 IngressQID 15:13 TimerReg 12:12 SEIntArm 11:0 CIDXInc Displaying specific (mps) module registers: C:\Users\Administrator>cxgbtool vbd0 regdump mps [ 0x9000] MPS_CMN_CTL 4:4 LpbkCrdtCtrl 3:3 Detect8023 2:2 VFDirectAccess 1:0 NumPorts Chelsio T5/T4 Unified Wire for Windows...
Page 59 23:16 S_RXMAPCHANNEL2 0x55 15:8 S_RXMAPCHANNEL1 0x55 7:0 S_RXMAPCHANNEL0 0x55 0x21] TP_RX_SCHED_SGE 15:12 S_RXSGEMOD1 11:8 S_RXSGEMOD0 3:3 S_RXSGECHANNEL3 2:2 S_RXSGECHANNEL2 1:1 S_RXSGECHANNEL1 0:0 S_RXSGECHANNEL0 0x22] TP_TX_SCHED_MAP 0x7777 30583 15:12 S_TXMAPCHANNEL3 11:8 S_TXMAPCHANNEL2 7:4 S_TXMAPCHANNEL1 3:0 S_TXMAPCHANNEL0 Chelsio T5/T4 Unified Wire for Windows...
Page 60 SGE_DEBUG_DATA_HIGH13 SGE_DEBUG_DATA_HIGH14 0x45475301 1162302209 SGE_DEBUG_DATA_HIGH15 0xbab8acfe 3132665086 SGE_DEBUG_DATA_LOW00 SGE_DEBUG_DATA_LOW01 0x3f000 258048 SGE_DEBUG_DATA_LOW02 SGE_DEBUG_DATA_LOW03 SGE_DEBUG_DATA_LOW04 SGE_DEBUG_DATA_LOW05 0x70000b 7340043 SGE_DEBUG_DATA_LOW06 0x19 SGE_DEBUG_DATA_LOW07 SGE_DEBUG_DATA_LOW08 0x17 SGE_DEBUG_DATA_LOW09 SGE_DEBUG_DATA_LOW10 SGE_DEBUG_DATA_LOW11 SGE_DEBUG_DATA_LOW12 0x390 SGE_DEBUG_DATA_LOW13 SGE_DEBUG_DATA_LOW14 0x1534745 22234949 SGE_DEBUG_DATA_LOW15 0xfeacb8ba 4272732346 Chelsio T5/T4 Unified Wire for Windows...
Page 61 Pkt Filter CurOfldCaps 0xd7fe00 Tx Pend FwdTx Pend CtrlTx RefCount 1 ToeTx Pend RdmaTx RefCount 1 Rx Pend ToeRx Pend ToeRxData Pend Ndk Connect Ndk Accept Ndk ConnectFail 0 Ndk ConnectErr Ndk Active Ndk CQErr Chelsio T5/T4 Unified Wire for Windows...
Page 62 NIC TP Version 0.1.4.7 Ndis Driver Version 5.3.12.0 VBD Version 5.3.12.0 fwtoc Description: Converts Firmware binary file to source file header. Syntax: cxgbtool [vbdInterface] fwtoc [firmwareFile] filename= [CFileName].bin Example: C:\Users\Administrator>cxgbtool vbd0 fwtoc .\Chelsio-Uboot-1.0.0.68\t4fw- 1.12.14.0.bin filename=t4fw-1.12.14.0.bin Chelsio T5/T4 Unified Wire for Windows...
Page 63 Syntax: cxgbtool [vbdInterface] uninst [infFile] Example: C:\Users\Administrator>cxgbtool vbd0 uninst .\chnetx64.inf Removing device instance CHT<4|5>BUS\CHNET\5&39B01C76&1&0000 rescan Description: Scans for hardware changes in the device manager. Syntax: cxgbtool [vbdInterface] rescan all Example: C:\Users\Administrator>cxgbtool vbd0 rescan all Chelsio T5/T4 Unified Wire for Windows...
Page 64 Description: Displays the adapters Serial Number, Device ID, EC, Core Clock, Part Number, and Network Address (MAC) Syntax: cxgbtool [vbdInterface] vpdparams Example: C:\Users\Administrator>cxgbtool vbd0 vpdparams Serial Number : RE14130227 : T520-CR : 0000000000000000 Core Clock : 250000 : 11011605002 Network Addr : 000743047D60 Chelsio T5/T4 Unified Wire for Windows...
Page 65 Chapter I. Chelsio Unified Wire Description: Traces the Ingress and Egress path of a packet through the Chelsio adapter. Syntax: cxgbtool [vbdInterface] wtp Example: C:\Users\Administrator>cxgbtool vbd0 wtp 0x00000000 HIGH 0x00aa0000 0x0003f000 HIGH 0x00660022 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x0000eeee 0x00000000...
Page 66 0x00000000 HIGH 0x00000066 0x0003f000 HIGH 0x00aa00ee 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x0000eeee 0x00000000 HIGH 0x00000000 0x0070000b HIGH 0x0000eeee 0x00000013 HIGH 0x0000eeee 0x00000013 HIGH 0x001199cc 0x00000016 HIGH 0x00020491 0x0000000b HIGH 0x00cc0022 0x00c0000a HIGH 0x00000000 0x0000000a Chelsio T5/T4 Unified Wire for Windows...
Page 67 4553 rx_frames rx_bcast_frames rx_mcast_frames rx_ucast_frames rx_too_long rx_jabber rx_fcs_err rx_len_err rx_symbol_err rx_runt rx_frames_64 rx_frames_65_127 rx_frames_128_255 rx_frames_256_511 rx_frames_512_1023 Chelsio T5/T4 Unified Wire for Windows...
Page 68 CPL requests: CPL responses: debugfs Description: When used in conjunction with other options, debugfs displays useful information regarding Chelsio adapters. Syntax: cxgbtool [vbdInterface] debugfs [option] debugfs options:  cctrl Description: Displays congestion control table. Chelsio T5/T4 Unified Wire for Windows...
Page 69 Description: Displays results of CIM MA logic analyzer trace. Syntax: cxgbtool [vbdInterface] debugfs cim_ma_la Example: C:\Users\Administrator>cxgbtool vbd0 debugfs cim_ma_la 0000000000000000000000000000000000 0000000000000000000000000000000000 Cnt ID Tag UE Data RDY VLD 0 0000000000000000 0 0000000000000000 0 0000000000000000 Chelsio T5/T4 Unified Wire for Windows...
Page 70 TCP timestamp tick: 1048.576 us DACK tick: 8.192 us DACK timer: 488 us Retransmit min: 960 us Retransmit max: 9765440 us Persist timer min: 960 us Persist timer max: 9765440 us Keepalive idle timer: 7031116800 us Chelsio T5/T4 Unified Wire for Windows...
Page 71 Done writing memory block to file edc0  edc1 Description: Redirects EDC1 memory details to a file. Syntax: cxgbtool [vbdInterface] debugfs edc1 [fileName] It is recommended that the fileName provided is edc1 without any extension. Note Chelsio T5/T4 Unified Wire for Windows...
Page 72 Description: Displays CIM TP inbound queue. Syntax: cxgbtool [vbdInterface] debugfs ibq_tp[{0|1}] Example: C:\Users\Administrator>cxgbtool vbd0 debugfs ibq_tp0 000000: 078003ff ffc04102 2e8003ff 00000000 0x0010: 2effc041 00000000 00000000 00000000 0x0020: 078103ff ffc04202 2e8103ff 00000000 0x0030: 2effc042 00000000 00000000 00000000 Chelsio T5/T4 Unified Wire for Windows...
Page 73 Description: Displays CIM NCSI inbound queue. Syntax: cxgbtool [vbdInterface] debugfs ibq_ncsi Example: C:\Users\Administrator>cxgbtool vbd0 debugfs ibq_ncsi 000000: 00000000 00000000 00000000 00000000 0x0010: 00000000 00000000 00000000 00000000 0x0020: 00000000 00000000 00000000 00000000 0x0030: 00000000 00000000 00000000 00000000 Chelsio T5/T4 Unified Wire for Windows...
Page 74 3 01:00:5e:00:00:01 ffffffffffff 4 33:33:00:01:00:03 ffffffffffff 5 33:33:00:00:00:0c ffffffffffff 6 33:33:ff:00:00:11 ffffffffffff 7 33:33:ff:b8:3f:b8 ffffffffffff 8 01:00:5e:7f:ff:fa ffffffffffff 9 01:00:5e:00:00:fc ffffffffffff  mps_trc_wr trace Description: Sets MPS trace filter. Syntax: cxgbtool [vbdInterface] debugfs mps_trc_wr trace[0|1|2|3] [tx[portInstance]|rx[portInstance]] Chelsio T5/T4 Unified Wire for Windows...
Page 75 0000000000000000000000000000000000000000000000000000000000000000000000000000 000000000000000000000000000000000000000000000000000000000000000000000@0  mbox Description: Displays the last command in each mailbox. Syntax: cxgbtool [vbdInterface] debugfs mbox[{0|1|2|…|7}] Example: C:\Users\Administrator>cxgbtool vbd0 debugfs mbox0 mailbox[0] owned by driver 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 Chelsio T5/T4 Unified Wire for Windows...
Page 76 Description: Displays SGE outbound queue. Syntax: cxgbtool [vbdInterface] debugfs obq_sge Example: C:\Users\Administrator>cxgbtool vbd0 debugfs obq_sge 000000: 00000020 00000801 00000000 00000000 0x0010: 00000020 00001301 00010000 67400052 0x0020: 00001020 00001301 0000037f e0800606 0x0030: 00000020 00000801 01fd206d 00907803 Chelsio T5/T4 Unified Wire for Windows...
Page 77 Description: Displays CIM SGE outbound queue. Syntax: cxgbtool [vbdInterface] debugfs obq_sge_rx_q[{0|1}] Example: C:\Users\Administrator>cxgbtool vbd0 debugfs obq_sge_rx_q0 000000: 00000000 00000000 00000000 00000000 0x0010: 00000000 00000000 00000000 00000000 0x0020: 00000000 00000000 00000000 00000000 0x0030: 00000000 00000000 00000000 00000000 Chelsio T5/T4 Unified Wire for Windows...
Page 78 Bypass + mem: Rx cycles Rx bytes Read: Write bypass: 20820 Write mem: Flush: tcp_stats Description: Displays IPv4/IPv6 TCP statistics. Syntax: cxgbtool [vbdInterface] debugfs tcp_stats Example: C:\Users\Administrator>cxgbtool vbd0 debugfs tcp_stats IPv6 OutRsts: InSegs: OutSegs: RetransSegs: Chelsio T5/T4 Unified Wire for Windows...
Page 79 RstIn: 0 DataIn: 0 DataInVld: 0 PadIn: 0 RxBufEmpty: 1 RxDdp: 0 RxFbCongestion: 0 TxFbCongestion: 0 TxPktSumSrdy: 1 RcfUlpType: 0 Eread: 0 Ebypass: 1 Esave: 0 Static0: 1 Cread: 0 Cbypass: 1 Csave: 0 Chelsio T5/T4 Unified Wire for Windows...
Page 80 HW TID usage: 0 IP users, 0 IPv6 users tx_rate Description: Displays TX rate for NIC and offload traffic. Syntax: cxgbtool [vbdInterface] debugfs tx_rate Example: C:\Users\Administrator>cxgbtool vbd0 debugfs tx_rate channel 0 channel 1 channel 2 channel 3 NIC B/s: Offload B/s: Chelsio T5/T4 Unified Wire for Windows...
Page 81 CORE pcie: npf 7 (pfbitmap 0x7f) nvf 64 (pf 0..3 0x10 0x10 0x10 0x10) 403154 INFO CORE flr_timer_start: flowc_id 96 00000000205FFF80 00000000205FCF40 506767 INFO DUMMY cf_parse: file memtype 0x1 memaddr 0x5e0000 mapped @ 00000000205E0000: Chelsio T5/T4 Unified Wire for Windows...
Page 82 Description: Prints RSS info. Syntax: cxgbtool [vbdInterface] rss Example: C:\Users\Administrator>cxgbtool vbd0 rss 1023 1023 rss_config Description: Prints RSS Configuration. Syntax: cxgbtool [vbdInterface] rss_config Example: C:\Users\Administrator>cxgbtool vbd0 rss_config TP_RSS_CONFIG: 0x300003c Tnl4TupEnIpv6: Tnl2TupEnIpv6: Tnl4TupEnIpv4: Tnl2TupEnIpv4: TnlTcpSel: Chelsio T5/T4 Unified Wire for Windows...
Page 83 Syntax: cxgbtool [vbdInterface] rss_pf_config Example: C:\Users\Administrator>cxgbtool vbd0 rss_pf_config PF Map Index Size = 0 Hash Tuple Enable Default Enable IPF Mask Mask IPv6 IPv4 Queue Map Chn Prt Map Size Size Four Two Four Two Four Chelsio T5/T4 Unified Wire for Windows...
Page 84 Rx Coalescing Timer. Number of microseconds after which interrupt will be sent. rx-frames-irq: Rx Coalescing Threshold Packets. Number of packets after which interrupt will be sent. Example: Setting Rx Coalescing Timer: C:\Users\Administrator>cxgbtool nic0 coalesce rx-usecs-irq 5 Chelsio T5/T4 Unified Wire for Windows...
Page 85 1048 in_use 0 rq id 2169 in_use 256 state 1 onchip 0 ep tid 78 state 7 0.0.0.0:4304->0.0.0.0:5445 rdma_stats Description: Prints RDMA statistics if NDK/ND is enabled Syntax: cxgbtool [vbdInterface] rdma_stats Chelsio T5/T4 Unified Wire for Windows...
Page 86 0x083ae260: (inactive): stag idx 0x0900 key 0x00 state INV type NSMR pdid perms none rem_inv_dis 0 addr_type ZBTO bind_enable 0 pg_size 4096 qpid 0x0 pbl_off 0x0000 pbl_addr 0x0b414780 len 0 va 0000000000000000 bind_cnt 0 Stag(2):0xf00 0x83ae320 0000000000000000 0000000000000000 0000000000000000 Chelsio T5/T4 Unified Wire for Windows...
Page 87 C:\Users\Administrator>cxgbtool nic0 chim sock 102.1.1.56:5001 ======> 102.1.1.62:49169 ============================================= ChRcvBytes : 1460 ChRcvCredits : 1460 ChRcvMaxSeq ChRcvWndAdjusted : 324776 Cached flag : 0x2 :Nagle Const flag : 0x6 :SACK:WS RcvIndicationSize : 128 RcvNxt : 1871353069 Chelsio T5/T4 Unified Wire for Windows...
Page 88: Firmware Update
Chapter I. Chelsio Unified Wire 6. Firmware Update The driver will auto-load the T5 and T4 firmwares if an update is required. The firmware version can be verified using cxgbtool: C:\Users\Administrator> cxgbtool nic0 version The Firmware binaries are copied to <system_drive>\ChelsioT4\Firmware\ directory during Unified Wire installation.
Page 89: Software/Driver Uninstallation
Chapter I. Chelsio Unified Wire 7. Software/Driver Uninstallation Similar to installation, Chelsio Unified Wire can be uninstalled using two methods: GUI and CLI mode. GUI mode requires user interaction and uninstallation occurs with options specified by the user. Whereas, CLI mode does not require any user input.
Page 90 Note Unified Wire Manager. You will have to manually uninstall it using “Programs and Features” in the Control Panel. 7.1.2. CLI Mode To uninstall all the drivers, execute the following command: C:\Users\Administrator>ChelsioUwire-x.x.x.xx.exe –un all Chelsio T5/T4 Unified Wire for Windows...
Page 91: Software/Driver Update
For any distribution specific problems, please check README and Release Notes included in the release for possible workaround. Please visit Chelsio support web site http://service.chelsio.com/ for regular updates on various software/drivers. You can also subscribe to our newsletter for the latest software updates. Chelsio T5/T4 Unified Wire for Windows...
Page 92: Ii. Ndis Function
Chapter II. NDIS Function II. NDIS Function Chelsio T5/T4 Unified Wire for Windows...
Page 93: Introduction
Chapter II. NDIS Function 1. Introduction Chelsio’s T5/T4 series of Unified Wire Adapters provide extensive support for NIC operation, including all stateless offload mechanisms for both IPv4 and IPv6 (IP, TCP and UDP checksum offload, LSO - Large Send Offload aka TSO - TCP Segmentation Offload, Network Direct and assist mechanisms for accelerating LRO - Large Receive Offload).
Page 94: Software Requirements
Chapter II. NDIS Function 1.2. Software Requirements 1.2.1. Windows Requirement Currently Chelsio T5/T4 NDIS Function driver is available for the following version: Windows Server 2012 R2* Windows Server 2012 Windows 2008 R2* Windows 8.1 (64-bit) Windows 8 (64-bit) Windows 7 (64-bit)* * Driver on these versions is WHQL certified.
Page 95: Advanced Configuration
2.1. Assigning IP address to the Chelsio Network Adapter 1. Double click on the Network Connections icon and choose the Chelsio card entry and double click it. 2. Click on the Properties button from the Local Area Connection X Status.
Page 96 Description: Specifies a new MAC address for the port. If Not Present, the default MAC from EEPROM is used. If specified, the new MAC overwrites the default MAC. This specified MAC is persistent across machine reboot. Chelsio T5/T4 Unified Wire for Windows...
Page 97 Receive Side Scaling (RSS):  Description: This parameter controls the RSS functions. If on, the Microsoft RSS function is enabled. If off, the Chelsio RSS function is enabled.  Value: Disabled | Enabled  Default: Enabled Recv Segment Coalescing (IPv4): ...
Page 98 Description: This parameter enables or disables computation of TCP checksum by the adapter for IPv4 packets.  Value: o Disabled o Rx & Tx Enabled o Rx Enabled o Tx Enabled  Default: Rx & Tx Enabled Chelsio T5/T4 Unified Wire for Windows...
Page 99 Description: This parameter enables or disables computation of UDP checksum by the adapter for IPv4 packets.  Value: o Disabled o Rx & Tx Enabled o Rx Enabled o Tx Enabled  Default: Rx & Tx Enabled Chelsio T5/T4 Unified Wire for Windows...
Page 100: Nvgre Offload
Value: Disabled | Enabled  Default: Enabled 2.3. NVGRE Offload Chelsio’s T5 based adapters are uniquely capable of offloading the processing of NVGRE encapsulated frames such that all stateless offloads (checksums, LSO, VMQ and filtering) are Chelsio T5/T4 Unified Wire for Windows...
Page 101: Troubleshooting
Enabling SMB Direct SMB Direct is installed and enabled by default on Windows Server 2012 and 2012 R2 systems. RDMA functionality on Chelsio adapters will be enabled after installing the driver from the package. You can use the following PowerShell command...
Page 102 Verify that SMB driver is loaded and working. Open PowerShell window and execute the following command : C:\Users\Administrator> driverquery.exe | findstr /I smb  Verify that Chelsio driver is loaded and working. Open PowerShell window and execute the following command : C:\Users\Administrator> driverquery.exe | findstr /I chel ...
Page 103: Iii. Unified Wire Manager (Um)
Chapter III. Unified Wire Manager (UM) III. Unified Wire Manager (UM) Chelsio T5/T4 Unified Wire for Windows...
Page 104: Introduction
Chelsio hardware installed in the system. The software includes a command line interface (CLI) tool and a web management interface (Web GUI) to help you manage all Chelsio network adapter cards on the network across multiple operating systems.
Page 105: Reference Architecture
The Management Agent is a binary executable, which runs as a service on the system that has at least one Chelsio card installed. It is installed along with libraries that can manage various components of the system and enabled during system startup.
Page 106: Authentication And Encryption
The authentication credentials, as well as all data exchanged between the CLI client or the Web GUI and the agent, are encrypted using SSL. This ensures that the data cannot be accessed when it is being transmitted over the network. Chelsio T5/T4 Unified Wire for Windows...
Page 107: Hardware And Software
Chapter III. Unified Wire Manager (UM) 2. Hardware and Software 2.1. Supported Adapters Following are the currently shipping Chelsio Adapters that are compatible with Chelsio Unified Wire Manager: T5 Adapters  T502-BT  T520-CR  T580-CR  T580-LP-CR  T580-SO-CR ...
Page 108: Platform/Driver Matrix
Management Client, Management Station Windows 8 (64-bit) Management Client, Management Station Windows 7 (64-bit) Management Client, Management Station 2.3. Platform/Driver Matrix The table below lists the Chelsio T5/T4 driver(s) and their supported versions: Chelsio driver Version 5.3.22.0 Chelsio T5/T4 Unified Wire for Windows...
Page 109: Installing Unified Wire Manager
Chapter III. Unified Wire Manager (UM) 3. Installing Unified Wire Manager Chelsio Unified Wire has been designed to install Unified Wire Manager (UM) by default. Hence, no separate installation is required. Chelsio T5/T4 Unified Wire for Windows...
Page 110: Configuring Unified Wire Manager
2. Perform following tasks C:\Program Files (x86)\Apache Software Foundation\Apache2.2\Conf\httpd.conf file Change "DocumentRoot" to “C:/Program Files (x86)/Apache Software Foundation/Apache2.2/htdocs/chelsio” Uncomment "LoadModule rewrite_module modules/mod_rewrite.so" iii. Uncomment "Include conf/extra/httpd-ssl.conf" Uncomment "LoadModule ssl_module modules/mod_ssl.so" Add the following lines: Chelsio T5/T4 Unified Wire for Windows...
Page 111 Uncomment the following line SSLSessionCache "dbm:C:/Program Files (x86)/Apache Software Foundation/Apache2.2/logs/ssl_scache" Comment the following line SSLSessionCache "shmcb:C:/Program Files (x86)/Apache Software Foundation/Apache2.2/logs/ssl_scache(512000)" Use the Windows Event Log (Event Viewer) for troubleshooting any installation Note related issues. Chelsio T5/T4 Unified Wire for Windows...
Page 112: Verifying Um Components Status
Verifying Management Agent 1. On the system running Management Agent, launch Services from the Control Panel. You can also type services.msc in the Run command. This will open the Services window. Figure 5.1(a) – Windows Services Chelsio T5/T4 Unified Wire for Windows...
Page 113: Verifying Management Client
2. Search for Unified Wire Management Station in the list of services. You should get the options to stop,start and restart the service in the Actions menu on the left side. Figure 5.3 – Verifying Management Station service status Chelsio T5/T4 Unified Wire for Windows...
Page 114 Chapter III. Unified Wire Manager (UM) While accessing the Web Management Interface, if an error “Management Note Station is not running” is displayed at the log-in page, follow the above steps to restart Management Station and try again. Chelsio T5/T4 Unified Wire for Windows...
Page 115: Management Agent
If there is a firewall appliance / software protecting the network that the system is on, and you wish to connect to the system from a different network, using the client, the firewall appliance also needs to be configured appropriately. Chelsio T5/T4 Unified Wire for Windows...
Page 116: Cli Client
Also, two different Web GUI or CLI clients cannot connect to a management agent at the same time. There is no mechanism to allow this scenario. Chelsio T5/T4 Unified Wire for Windows...
Page 117: Web Gui Client
2. Search for “Apachex.x” in the list of services and click Start in the Action menu on the left. Figure 8.1.1 (a) – Starting Apache HTTP server 3. Search for “Unified Wire Management Station” and click Start in the Action menu on the left. Figure 8.1.1(b) – Starting Management Station service Chelsio T5/T4 Unified Wire for Windows...
Page 118: Accessing Web Management Interface
You will need to select the correct option to continue. Security Certificate prompt in Internet Explorer Figure 8.2 (a) - Security Certificate prompt in Mozilla Firefox Figure 8.2 (b) - Chelsio T5/T4 Unified Wire for Windows...
Page 119 Login button. Figure 8.2 (e) - Web GUI Login page Not performing any operation/action for 5 minutes will result in session timeout. Note You will have to re-login and connect to the Agents again. Chelsio T5/T4 Unified Wire for Windows...
Page 120: Layout And Navigation
Navigation Pane. The panels can be expanded and collapsed by clicking on the panel heading.  The Bottom bar has the About link on the right and copyright details on the left. Figure 8.3 – Web Management Interface Chelsio T5/T4 Unified Wire for Windows...
Page 121: Home Page
The passwords are encrypted, but it is still advisable to store passwords only if the system you are running the GUI client on, is secure. Figure 8.4.1 (a) - Bookmarks and history module Chelsio T5/T4 Unified Wire for Windows...
Page 122 Select the system from the Bookmark list and click Delete system to remove it. Once removed, the system will no longer appear in the Bookmarks and History Note module. If you wish to manage that system again, you will have to use the “Add system” option. Chelsio T5/T4 Unified Wire for Windows...
Page 123  Installing Driver 1. In the Choose the card fields, select T3 or T4/T5 depending on the chip revision of the network card. 2. Select the operating system for which drivers are to be installed in the Choose the OS Type field.
Page 124 Chapter III. Unified Wire Manager (UM) 3. Select a system or systems from the list and choose the driver to be installed in the Driver Installation section. 4. Download the appropriate driver from Chelsio’s Download Center, service.chelsio.com. 5. Locate the driver package.
Page 125 Use this option to disconnect an Agent. To remove an agent, click on the name of the system in the tree menu in the left and click Remove System. Then click Yes to confirm. Figure 8.4.3 - Removing a UM Agent Chelsio T5/T4 Unified Wire for Windows...
Page 126 This feature is available only on the Web Management Interface. Using this option, you can receive email alerts regarding the link status of a Chelsio Network Interface Card. This feature sends email notifications regarding the port and the card, on which the link up/down event has occurred.
Page 127 Various configurable parameters have been categorized into several modules like Boot Configuration module to install and erase option ROM, Network Configuration module to set MTU and VLAN ID, Card Configuration module to change driver parameters, etc. Chelsio T5/T4 Unified Wire for Windows...
Page 128 MTU size of a network interface (in the Network Configuration module), create a group with group type Network. To install or erase option ROM on a Chelsio T4 adapter (in the Boot Configuration module), create a group with group type t4adapter.
Page 129 Figure 8.4.6 (b) – Managing a group Boot Configuration Using this module, you can install option ROM or erase option ROM on Chelsio network devices. The Set Default Boot Settings button will reset the adapter to factory boot settings. Figure 8.4.6 (c) – Boot Configuration module...
Page 130 MTU can be set between 1500-9000 bytes. VLAN id can be set for an adapter within the range 0-4094 (enter 0 to disable it). The IP type can be static or DHCP. Figure 8.4.6 (d) – Network Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 131 The Card Configuration module allows you to set various adapter settings including TCP Offload. Offload settings are only available when using the TOE capable drivers (t3_tom and toecore for T3 cards; t4_tom and toecore for T4 cards). Figure 8.4.6 (e) – Card Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 132 In the Port Configuration module, you can set various port settings like enabling Tx checksum and TCP segmentation offload, setting Link speed and link duplex mode, etc. The settings depend on the device driver installed. Figure 8.4.6 (f) - Port Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 133 Chapter III. Unified Wire Manager (UM) Bypass Configuration Use the Bypass Configuration module to configure Chelsio’s bypass adapters like B420-SR and B404-BT. Figure 8.4.6 (g) - Bypass Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 134: System Page
The system page contains generic system and support modules which are discussed below: 8.5.1. System summary This module lists the system Hostname, Operating System, platform and also gives the count of the Chelsio cards found. Figure 8.5.1 (a) - System Summary module Chelsio T5/T4 Unified Wire for Windows...
Page 135 Chapter III. Unified Wire Manager (UM) 8.5.2. Drivers Installation Using this module, one can install various Chelsio drivers for different operating systems. Figure 8.5.2 (a) - Drivers Installation module connected to Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 136 Chapter III. Unified Wire Manager (UM) 8.5.3. Driver Details A list of Chelsio device drivers with related information like driver description, version, current load status and installation date is shown in this module. To load or unload a particular driver, select the appropriate option (Yes to load, No to unload) in the corresponding cell of the Loaded column and click Load/Unload Driver button.
Page 137 Chapter III. Unified Wire Manager (UM) 8.5.4. System Diagnostics Using this module, you can run various diagnostic tests on Chelsio adapters to troubleshoot adapter related issues. Select the adapter(s) from the list for which you want to run the test, select the operation (type of test;...
Page 138 A list of the Unified Wire Manager agent components installed on the managed system is shown in this module. The versions of the components are useful in case of reporting an issue to support. Figure 8.5.5 - Unified Wire Manager Component Versions module Chelsio T5/T4 Unified Wire for Windows...
Page 139 The properties box will display the domain state of the machines selected. Now, click on any of the system power actions provided at the bottom. Figure 8.5.6 - VM Configurations module Chelsio T5/T4 Unified Wire for Windows...
Page 140 Chapter III. Unified Wire Manager (UM) 8.5.7. Managed system application logs The management agent logs its activities and any errors that occur, in /var/log/chelsio in Linux and FreeBSD and in the Event log, in Windows. This log can be obtained in this module. Only 20 entries can be obtained and viewed at a time.
Page 141: Network Page
8.6.1. Network summary The Network Summary module provides the total number of Chelsio adapters present, including the number of T5, T4 and T3 adapters. It also provides the total number of Network interfaces including corporate and Chelsio interfaces and VLANs.
Page 142 Chapter III. Unified Wire Manager (UM) 8.6.2. Chelsio card page When a Chelsio card is selected in the tree menu on the left, this page is displayed. It provides details of the card and associated settings. It also displays any card specific statistics that the hardware provides.
Page 143 Highlight the system item in the tree menu on the left, and click "Refresh", to refresh data from the system, in case the updated settings are not being shown. Figure 8.6.2 (b) - TCP Offload Settings module for a FreeBSD Agent Chelsio T5/T4 Unified Wire for Windows...
Page 144 Chapter III. Unified Wire Manager (UM) Device Driver settings (Windows) The device driver settings applicable to the card are shown here. For Chelsio T5 and T4 adapters, only the MaxVMQueues field will be displayed. On changing the settings, the changed settings may not reflect immediately on refreshing the data.
Page 145 Chelsio card's port The port page is displayed on selecting a port of a Chelsio card listed in the tree menu on the left. It provides details of the port and port settings. It also displays any port specific statistics that the hardware provides.
Page 146 Port settings Port settings such as MTU, Link speed and others can be set in this module. The settings depend on the device driver installed. Figure 8.6.2.1 (b) - Port Settings of T4 CNA Chelsio T5/T4 Unified Wire for Windows...
Page 147 Chapter III. Unified Wire Manager (UM) Port statistics Ethernet statistics and additional hardware statistics for the port are displayed in this module. Figure 8.6.2.1 (c) - Port Statistics of T4 CNA on Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 148 0-4094 (enter 0 to disable it). You can use the View/Set IP addresses option to add, modify or delete IP aliases. Figure 8.6.3 (a) - System network configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 149 Chapter III. Unified Wire Manager (UM) Figure 8.6.3 (b) – Managing IP aliases Chelsio T5/T4 Unified Wire for Windows...
Page 150 Table view in the Advanced NIC characteristics. The polling time field sets the average time (in seconds) based on which the table/graph updates the report. Figure 8.6.3 (c) - System network statistics module Chelsio T5/T4 Unified Wire for Windows...
Page 151 Chapter III. Unified Wire Manager (UM) Figure 8.6.3 (d) - Network Throughput Vs Time instant Graph Figure 8.6.3 (e) - Network Throughput Vs Time instant Table Chelsio T5/T4 Unified Wire for Windows...
Page 152 Windows, you may set multiple default gateways. Use the option to set multiple default gateways with caution, since it may cause the system to stop communicating with external networks. Figure 8.6.3 (f) - Default gateway and DNS configuration module for a Windows Agent Chelsio T5/T4 Unified Wire for Windows...
Page 153 All modes may not be available with all configurations / combinations. Also, the team members can only be 2 ports of a single offload-enabled card, and not across Chelsio cards. Do not mix third party cards and offload-enabled Chelsio cards in a single team.
Page 154 Use the GetConnections utility to view currently active TCP/UDP connections. Offload status for each connection is also displayed if protocol offload hardware is available. This is useful for troubleshooting any connectivity issues for clients to various services. Figure 8.6.3 (h) - Ping Utility Chelsio T5/T4 Unified Wire for Windows...
Page 155 Chapter III. Unified Wire Manager (UM) Figure 8.6.3 (i) - TraceRoute Utility Figure 8.6.3 (j) - GetConnections Utility Chelsio T5/T4 Unified Wire for Windows...
Page 156 To do so, click on the virtual machine and click “Detach”. Similarly, detach all the virtual machines and then use the “Delete Switch” to delete the virtual network. Figure 8.6.3.1 (a) – Virtual Network Manager module Chelsio T5/T4 Unified Wire for Windows...
Page 157 Once created, you can manage the virtual networks in the Virtual Network Manager module. Figure 8.6.3.1 (b) – Creating external virtual network Figure 8.6.3.1 (c) – Creating internal virtual network Chelsio T5/T4 Unified Wire for Windows...
Page 158 To attach a virtual network to a virtual machine, select the virtual network from the Virtual Network list and the virtual machine from the VM list. Finally click Attach. Figure 8.6.3.1 (e) – Attaching Virtual Network to VM Chelsio T5/T4 Unified Wire for Windows...
Page 159 These settings can be set only when iWARP driver (iw_cxgb4 for T4 and T5; iw_cxgb3 for T3) is loaded. If you set any parameter for a T5 adapter, it applies for all the T5 adapters present. Same applies for T4 and T3 adapters.
Page 160 Chapter III. Unified Wire Manager (UM) Figure 8.6.4 (a) – iWARP settings for T4 CNA for FreeBSD Agent Chelsio T5/T4 Unified Wire for Windows...
Page 161 Chapter III. Unified Wire Manager (UM) Figure 8.6.4 (b) – iWARP settings for T4 CNA for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 162: Storage
Figure 7.7 – Storage Summary Module 8.7.1. FCoE Initiator (Linux, Windows, XenServer) All supported Chelsio FCoE initiators available on the operating system can be managed from this page. FCoE support is extended on Linux, Windows and XenServer platforms. Please refer to Platform/Driver matrix section on the list of operating systems that are supported.
Page 163 Figure 8.7.1.1 (a) – FCoE Card Summary module FCoE Attributes Information such as Interrupt modes (MSI/MSI-X/INTx), SCSI mode and the card state are provided in this module. Figure 8.7.1.1 (b) – FCoE Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 164 NPIV management support. It contains the following sections: FCoE Port Summary The SCSI adapter name and the underlying ENODE MAC address of the physical port can be found here. Figure 8.7.1.2 (a) – FCoE Port Summary module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 165 (10G/1G) being used. Note that only class 3 service is supported by the initiator for now and the frame size is fixed to 2128 bytes as per spec. Figure 8.7.1.2 (b) – FCoE Port Atrributes module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 166 To delete a virtual port, select the option Delete and select the virtual port WWPN which you want to delete and click on delete. Figure 8.7.1.2 (c) – FCoE NPIV management module Chelsio T5/T4 Unified Wire for Windows...
Page 167 This module provides details about the discovered target such as target’s FC ID, WWPN and WWNN so that the user can identify the discovered target accordingly. Figure 8.7.1.3 (a) – FCoE Remort Port Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 168 This module provides the LUN information such as size of the LUN, SCSI address, and LUN address. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format. Figure 8.7.1.3 (b) – FCoE Remote Port Lun Details module Chelsio T5/T4 Unified Wire for Windows...
Page 169 FCoE Virtual Port Summary The SCSI adapter name and the underlying ENODE MAC address of the physical port can be found here. Figure 8.7.1.4 (a) – FCoE Virtual Port Summary module for Linux Agent Chelsio T5/T4 Unified Wire for Windows...
Page 170 (10G/1G) being used. Note that only class 3 service is supported by the initiator for now and the frame size is fixed to 2128 bytes as per spec. Figure 8.7.1.4 (b) – FCoE Virtual Port Attributes module Chelsio T5/T4 Unified Wire for Windows...
Page 171 LUN, SCSI address, and LUN address are provided. For Linux, the SCSI address is displayed in H:C:T:L (Host:Channel:Target:Lun) format and for Windows, it is displayed in P:B:T:L(SCSI Port:Bus:Target:Lun) format. Figure 8.7.1.4 (d) - FCoE Remote Port Lun Details module Chelsio T5/T4 Unified Wire for Windows...
Page 172 (Chelsio node cannot be disabled in Windows), and its properties can be viewed and edited in this module. In the Chelsio Linux stack, new initiator nodes can be created too. Disabling the initiator causes it to log out of any iSCSI targets that it is connected to, thus removing any disks provided by the iSCSI targets that were connected.
Page 173 Chapter III. Unified Wire Manager (UM) Figure 8.7.2 (b) - Microsoft iSCSI initiator Chelsio T5/T4 Unified Wire for Windows...
Page 174 Chapter III. Unified Wire Manager (UM) Figure 8.7.2 (c) - Chelsio iSCSI initiator Chelsio T5/T4 Unified Wire for Windows...
Page 175 (the IP address and TCP Port specified when discovering the target). If there are any pre-existing iSCSI sessions established to the target, deletion of Note the target Portal from the discovered targets list will fail. Figure 8.7.2 (d) - Discover targets module Chelsio T5/T4 Unified Wire for Windows...
Page 176 If a target is connected, the sessions and connections to the target, and the disks provided by the target will be listed. Figure 8.7.2 (e) - Targets module after logging in Chelsio T5/T4 Unified Wire for Windows...
Page 177 8.7.3. FO iSCSI Initiator (Linux) Full Offload iSCSI Hardware Information PCI, firmware and other adapter related details are provided in this module. Select the Chelsio adapter for which you want to view properties from the Select a T4 Card drop-down list and the module will expand to display related properties.
Page 178 Here you can configure various port settings like VLAN id, Maximum Transmission Unit (MTU) and IP. Select a Chelsio adapter from Select a T4 Card drop-down list and then select the port for which you want set any of the aforementioned properties. MTU can be set between 1500- 9000 bytes.
Page 179 In the FO iSCSI Initiator Properties module, you can configure FO iSCSI Initiator by setting different properties like enabling/disabling CHAP authentication, setting Header and Data digest, etc. Figure 8.7.3 (c) - FO iSCSI Initiator Properties Chelsio T5/T4 Unified Wire for Windows...
Page 180 In this module, you can set upto 8 instances. Configurable parameters include initiator node name (IQN), alias (friendly) name, Initiator (CHAP) Username and password. Figure 8.7.3 (d) - FO iSCSI Manage Instances module Chelsio T5/T4 Unified Wire for Windows...
Page 181 Chapter III. Unified Wire Manager (UM) FO iSCSI Discover Details iSCSI Targets can be discovered using this module. Select a Chelsio adapter and initiator instance using which you want to discover targets. Next, provide the source (initiator) and destination (target) IP. Finally, click Discover. After successful discovery, all the discovered targets will appear in the Discovered Targets section.
Page 182 CHAP for a secure iSCSI connection. One-way (target authenticates the initiator) and Mutual (target and initiator authenticate each other) authentication methods are supported. Figure 8.7.3 (f) - FO iSCSI Session Details module: Login Chelsio T5/T4 Unified Wire for Windows...
Page 183 Established sessions section. Select the Adapter and session id. Details of the selected session will be displayed. To end the session, click Logout. Figure 8.7.3 (g) - FO iSCSI Session Details module: Established Sessions Chelsio T5/T4 Unified Wire for Windows...
Page 184 Target properties is also available. The modules available on this page are as below: Target Stack Globals This module displays various global properties of a currently connected iSCSI target. Authentication priority between CHAP and ACL can be set here. Figure 8.7.4 (a) - Target Stack Globals module Chelsio T5/T4 Unified Wire for Windows...
Page 185 Properties such as Target name and Alias, Max Data Receive Length, Authentication mode related to a specific iSCSI target can be viewed and modified here. iSCSI targets can be started/stopped or deleted. Figure 8.7.4 (b) - Target properties module Chelsio T5/T4 Unified Wire for Windows...
Page 186 Chapter III. Unified Wire Manager (UM) Session details Details including Session ID, Initiator IQN and Connections List of all discovered and currently connected iSCSI targets are listed here. Figure 8.7.4 (c) – Session Details module Chelsio T5/T4 Unified Wire for Windows...
Page 187 Chapter III. Unified Wire Manager (UM) New Target Creation New iSCSI target can be created here by specifying the Target IQN and Target Alias name. Figure 8.7.4 (d) - New Target Creation module Chelsio T5/T4 Unified Wire for Windows...
Page 188 View/Edit iSCSI Target LUNs This module displays various Logical Units created in an iSCSI Target. Selected LUNs can be deleted. Figure 8.7.5 (a) - View/Edit iSCSI Target LUNs module Chelsio T5/T4 Unified Wire for Windows...
Page 189 Device and RAM Disk Size etc. RW (Read-Write) and RO (Read Only) are the two kinds of permissions that can be set. If Ram Disk is selected, then a minimum of 16 MB should be provided. Figure 8.7.5 (b) - Adding a new LUN Chelsio T5/T4 Unified Wire for Windows...
Page 190 Portal List on the left displays details of the portal group on which an iSCSI target is listening and the related info is displayed on the right under Portal Details. Selected portals can be deleted. Figure 8.7.6 (a) - View/Edit iSCSI Target Portals module Chelsio T5/T4 Unified Wire for Windows...
Page 191 Chapter III. Unified Wire Manager (UM) Add Portal New Portals can be added here by choosing the specific target and Portal IP address. The Port number should be 3260. Figure 8.7.6 (b) – Adding a new Portal Chelsio T5/T4 Unified Wire for Windows...
Page 192 View/Edit iSCSI Target ACLs This module displays details for all the ACLs configured for an iSCSI Target. Selected ACLs can be deleted. Figure 8.7.7 (a) - Target ACL operations module Chelsio T5/T4 Unified Wire for Windows...
Page 193 Chapter III. Unified Wire Manager (UM) Add ACL New ACLs can be configured by specifying Target name, initiator IQN name, IP address and permission type. Figure 8.7.7 (b) - Adding new ACL Chelsio T5/T4 Unified Wire for Windows...
Page 194: Hardware Features
Chapter III. Unified Wire Manager (UM) 8.8. Hardware Features The Hardware module lists the status of configuration modules under Hardware Features section, running on the agent. Figure 8.8 – Hardware module Chelsio T5/T4 Unified Wire for Windows...
Page 195 Note time to reflect. Highlight the system item in the tree menu on the left, and click "Refresh system", to refresh data from the system, in case the updated settings are not being shown. Chelsio T5/T4 Unified Wire for Windows...
Page 196 The FILTERID and T4 CARD fields are mandatory. After providing appropriate values for the parameters click “Save Changes”. For a detailed explanation regarding different fields, please refer cxgbtool Note manual by running man cxgbtool command on Management Agent CLI. Figure 8.8.1(b) - T4 Filtering Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 197 (t3_tom for T3 adapters; t4_tom for T4 adapters). 8.8.3. Traffic Management configuration The Chelsio Card section on the left displays all the cards available in the server and their corresponding policies on the right. Policies can be added and deleted. Policy Details displays the primitives (maximum 8) and actions which can be modified.
Page 198 /ChelsioUwire- x.x.x.xx/src/network/firmware. For instance, to select Low latency Networking, locate the file, t4- config.txt, in /ChelsioUwire-x.x.x.xx/src/network/firmware/low_latency_config directory. Figure 8.8.4 - T4 Save Config File module Chelsio T5/T4 Unified Wire for Windows...
Page 199 8.8.5. T3 iSCSI / T3 PXE Boot Option Rom Management (Linux) The Chelsio T3 card may be used for PXE or iSCSI boot. This module allows managing the boot capability. The Option ROM (PXE/iSCSI) may be installed to the card, or erased from the card.
Page 200 8.8.6. T5/T4 Boot Option ROM management This module allows managing the PXE and FCoE boot capability for Chelsio T5 and T4 cards. The Option ROM (PXE and FCoE) may be installed to or erased from the card. The version of Option ROM flashed can be viewed here.
Page 201 FCoE targets. Enable the Option ROM only if you are planning to boot the system via PXE or install the operating system on FCoE LUN. Figure 8.8.7 (a) - PXE Boot configuration for T4 CNAs Chelsio T5/T4 Unified Wire for Windows...
Page 202 Figure 8.8.7 (c) - iSCSI Boot configuration for T4 CNAs 8.8.8. Bypass (Linux) You can use the Bypass page to configure various settings for Chelsio’s bypass adapters like setting bypass operation mode, creating rules (filters), starting/stopping BA server, etc. There are two modules available: Bypass Configuration and Redirect Configuration.
Page 203 The Watchdog timer is used to ensure that if there is a software failure, the switch will enter the default state. The Watchdog timeout value should be provided in milliseconds. Figure 8.8.8 (a) - Bypass Configuration module Chelsio T5/T4 Unified Wire for Windows...
Page 204 To edit an existing rule, select the corresponding checkbox, change the desired paremeters and click Save Changes. To delete a rule, select the corresponding checkbox and click Delete a Filter. Finally, click Save Changes. You can delete multiple rules using this method. Chelsio T5/T4 Unified Wire for Windows...
Page 205 Chapter III. Unified Wire Manager (UM) Figure 8.8.8 (b) - Redirect Configuration module: Table configuration tab Chelsio T5/T4 Unified Wire for Windows...
Page 206 Chapter III. Unified Wire Manager (UM) Figure 8.8.8 (c) - Redirect Configuration module: Rules configuration tab Chelsio T5/T4 Unified Wire for Windows...
Page 207 Chapter III. Unified Wire Manager (UM) 8.8.9. T4 Egress Class Schedulers (Linux) Schedulers can be set only when T5/T4 network driver (cxgb4) is loaded. Egress Queue Map Using this module, you can bind (map) NIC (non-offloaded) Tx queues to Tx Scheduler classes.
Page 208: Uninstalling Unified Wire Manager
Chapter III. Unified Wire Manager (UM) 9. Uninstalling Unified Wire Manager To uninstall Unified Wire Manager, use Programs and Features in the Control Panel. Chelsio T5/T4 Unified Wire for Windows...
Page 209 Chapter IV. UM for Win PE IV. UM for Win PE Chelsio T5/T4 Unified Wire for Windows...
Page 210: Introduction
Chapter IV. UM for Win PE 1. Introduction Chelsio UM for Win PE is a light-weight management tool developed for Windows PE (Windows Preinstallation Environment) platform and provides features to view and configure different aspects of the system, including Chelsio adapter installed.
Page 211: Software Requirements
Chapter IV. UM for Win PE T420-SO-CR T420-BT T404-BT 1.2. Software Requirements 1.2.1. Windows Requirement Currently Chelsio UM for Win PE is available for Windows server 2012 R2. Chelsio T5/T4 Unified Wire for Windows...
Page 212: Examples
Examples 1.3.1. Viewing help  Run the following command to view the list of commands available under a service. X:\windows\system32> chelsio_uwlite.exe <service-name> E.g. To view commands available under the chelsio service: X:\windows\system32> chelsio_uwlite.exe Chelsio Chelsio T5/T4 Unified Wire for Windows...
Page 213 Run the following command to view syntax and usage for a sub-command: X:\windows\system32> chelsio_uwlite.exe chelsio <sub-command> /? E.g. To view syntax and usage of EraseSettings sub-command under chelsio service: X:\windows\system32> chelsio_uwlite.exe chelsio erasesettings /? Chelsio T5/T4 Unified Wire for Windows...
Page 214 Chapter IV. UM for Win PE 1.3.2. Flashing Option ROM Run the following command to list all Chelsio CNAs present in the system. The list displays a unique index for each CNA found. X:\windows\system32> chelsio_uwlite.exe chelsio listadapters Now, run the following command to flash option ROM onto the adapter: X:\windows\system32>...
Page 215 Chapter IV. UM for Win PE 1.3.3. Erasing Option ROM Run the following command to list all Chelsio CNAs present on the system. The list displays a unique index for each CNA found. X:\windows\system32> chelsio_uwlite.exe chelsio listadapters Now, run the following command to erase option ROM from the adapter: X:\windows\system32>...
Page 216: V. Appendix
Chapter V. Appendix V. Appendix Chelsio T5/T4 Unified Wire for Windows...
Page 217: Chelsio End-User License Agreement (Eula)
Chapter V. Appendix Chelsio End-User License Agreement (EULA) Installation and use of the software implies acceptance of the terms in the Chelsio End-User License Agreement (EULA). IMPORTANT: PLEASE READ THIS SOFTWARE LICENSE CAREFULLY BEFORE DOWNLOADING OR OTHERWISE USING SOFTWARE ASSOCIATED...
Page 218 Agreement by returning the Software. 8. Limitation of Liability. IN NO EVENT SHALL CHELSIO HAVE ANY LIABILITY TO YOU OR...
Page 219 Agreement. Should you have any questions concerning this Agreement, you may contact Chelsio by writing to: Chelsio Communications, Inc. 370 San Aleso Ave.

Chelsio T5 Installation And User Manual

Quick Links

Need help?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Chelsio T5

Summary of Contents for Chelsio T5

This manual is also suitable for:

Table of Contents