Chelsio Communications T5 Installation And User Manual

Unified wire for xenserver
Hide thumbs Also See for T5:

Advertisement

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the T5 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Summary of Contents for Chelsio Communications T5

  • Page 2 For all support related questions please send email to support@chelsio.com Copyright © 2014.Chelsio Communications. All Rights Reserved. Chelsio ® is a registered trademark of Chelsio Communications. All other marks and names mentioned herein may be trademarks of their respective companies. Chelsio T5/T4 Unified Wire For XenServer...
  • Page 3: Document History

    Document History Version Revision Date 1.0.0 03/15/2013 1.0.1 04/02/2013 1.0.2 06/06/2014 Chelsio T5/T4 Unified Wire For XenServer...
  • Page 4: Table Of Contents

    ISCSI PDU OFFLOAD INITIATOR Introduction 1.1. Hardware Requirements Software/Driver Loading Software/Driver Unloading Software/Driver Configuration and Fine-tuning 4.1. Accelerating open-iSCSI Initiator 4.2. Auto login from cxgb4i initiator at OS bootup APPENDIX Chelsio End-User License Agreement (EULA) Chelsio T5/T4 Unified Wire For XenServer...
  • Page 5: Chelsio Unified Wire

    Chapter I. Chelsio Unified Wire I. Chelsio Unified Wire Chelsio T5/T4 Unified Wire For XenServer Page 5...
  • Page 6: Introduction

    Initiator drivers for Chelsio’s T5 and T4 adapters on XenServer. 1.2. Hardware Requirements Chelsio’s Unified Wire software supports Chelsio T5 and T4 Series of Unified Wire Adapters. To know more about the list of adapters supported by each driver, please refer to their respective sections.
  • Page 7: Package Contents

    1.4. Package Contents The software supplied is an ISO image. It consists of the following: RPM packages containing drivers and associated tools, firmware, etc. Shell script to install the driver package. Chelsio T5/T4 Unified Wire For XenServer Page 7...
  • Page 8: Hardware Installation

    07:00.4 Ethernet controller: Chelsio Communications Inc T520-LL-CR Unified Wire Ethernet Controller 07:00.5 SCSI storage controller: Chelsio Communications Inc T520-LL-CR Unified Wire Storage Controller 07:00.6 Fibre Channel: Chelsio Communications Inc T520-LL-CR Unified Wire Storage Controller Chelsio T5/T4 Unified Wire For XenServer Page 8...
  • Page 9 Storage Controller 03:00.7 Ethernet controller: Chelsio Communications Inc Device 0000 For Chelsio T5/T4 adapters, the physical functions are currently assigned as: Physical functions 0 - 3: for the SR-IOV functions of the adapter Physical function 4: for all NIC functions of the adapter...
  • Page 10 Note following convention: the port farthest from the motherboard will appear as the first network interface. However, for T5 40G and T420-BT adapters, the association of physical Ethernet ports and their corresponding network device names is opposite. For these adapters, the port nearest to the motherboard will appear as the first network interface.
  • Page 11: Software/Driver Installation

    3. Start an interactive install of XenServer. 4. When the installer prompts, opt for installing drivers through Supplemental Packs. Choose “Yes” and hit [Enter]. 5. Insert the disc into disc drive. Choose “Ok” and hit [Enter]. Chelsio T5/T4 Unified Wire For XenServer Page 11...
  • Page 12: Runtime Installation

    3. Mount the image onto a directory by running the following commands: [root@host]# mkdir /tmp/iso [root@host]# mount -o loop <driver.iso> /tmp/iso [root@host]# cd /tmp/iso install.sh 4. Run the script to install the drivers and tools [root@host]# ./install.sh Chelsio T5/T4 Unified Wire For XenServer Page 12...
  • Page 13: Firmware Update

    [root@host]# umount /tmp/iso 3.3. Firmware Update /lib/firmware/cxgb4 The T5 and T4 firmwares are installed on the system, typically in , and the driver will auto-load them if an update is required. The firmware version can be verified using ethtool: [root@host]# ethtool -i <iface>...
  • Page 14: Software/Driver Uninstallation

    [root@host ~]# rpm -e cxgb4-modules-kdump-2.6.32.43- 0.4.1.xs1.8.0.835.170778-1.2.6-2 [root@host ~]# rpm -e cxgb4-phyfw-1.2.6-2 [root@host ~]# rpm -e cxgb4-t5fw-1.10.11.252-2 [root@host ~]# rpm -e cxgb4-modules-xen-2.6.32.43-0.4.1.xs1.8.0.835.170778- 1.2.6-2 [root@host ~]# rpm -e cxgb4-tools-1.16-2 [root@host ~]# rpm –e cxgb4-t4fw-1.10.11.252-2 Chelsio T5/T4 Unified Wire For XenServer Page 14...
  • Page 15: Software/Driver Update

    For any distribution specific problems, please check README and Release Notes included in the release for possible workaround. Please visit Chelsio support web site http://service.chelsio.com/ for regular updates on various software/drivers. You can also subscribe to our newsletter for the latest software updates. Chelsio T5/T4 Unified Wire For XenServer Page 15...
  • Page 16: Network (Nic)

    Chapter II. Network (NIC) II. Network (NIC) Chelsio T5/T4 Unified Wire For XenServer Page 16...
  • Page 17: Introduction

    Chapter II. Network (NIC) 1. Introduction Chelsio’s T5 and T4 series of Unified Wire Adapters provide extensive support for NIC operation, including all stateless offload mechanisms for both IPv4 and IPv6 (IP, TCP and UDP checksum offload, LSO - Large Send Offload aka TSO - TCP Segmentation Offload, and assist mechanisms for accelerating LRO - Large Receive Offload).
  • Page 18: Software/Driver Loading

    2. Software/Driver Loading The driver must be loaded by the root user. Any attempt to load the driver as a regular user will fail. To load the driver, execute the following: [root@host]# modprobe cxgb4 Chelsio T5/T4 Unified Wire For XenServer Page 18...
  • Page 19: Software/Driver Configuration And Fine-Tuning

    (Guests). A maximum of 64 Virtual Functions can be instantiated with 16 Virtual Functions per Physical Function. To get familiar with physical and virtual function terminologies, please refer the Note PCI Express specification. Chelsio T5/T4 Unified Wire For XenServer Page 19...
  • Page 20: Iscsi Pdu Offload Initiator

    Chapter III. iSCSI PDU Offload Initiator III. iSCSI PDU Offload Initiator Chelsio T5/T4 Unified Wire For XenServer Page 20...
  • Page 21: Introduction

    Chapter III. iSCSI PDU Offload Initiator 1. Introduction The Chelsio T5 and T4 series adapters support iSCSI acceleration and iSCSI Direct Data Placement (DDP) where the hardware handles the expensive byte touching operations, such as CRC computation and verification, and direct DMA to the final host memory destination:...
  • Page 22 Chapter III. iSCSI PDU Offload Initiator T420-CR T420-LL-CR T440-CR T440-LP-CR T420-BCH T422-CR T420-CX T420-BT T404-BT Chelsio T5/T4 Unified Wire For XenServer Page 22...
  • Page 23: Software/Driver Loading

    Run the following command to load the driver: [root@host]# modprobe cxgb4i If loading of driver fails, then kill iscsid, unload all open iSCSI modules and Note related/dependent modules (like multipath, bnx2i etc). Finally, load the cxgb4i driver. Chelsio T5/T4 Unified Wire For XenServer Page 23...
  • Page 24: Software/Driver Unloading

    Chapter III. iSCSI PDU Offload Initiator 3. Software/Driver Unloading To unload the driver, execute the following commands: [root@host]# rmmod cxgb4i [root@host]# rmmod libcxgbi Chelsio T5/T4 Unified Wire For XenServer Page 24...
  • Page 25: Software/Driver Configuration And Fine-Tuning

    = <iface file name> iface.hwaddress = <MAC address> iface.transport_name = cxgb4i iface.net_ifacename = <ethX> iface.ipaddress = <iscsi ip address> E.g.:- iface.iscsi_ifacename = cxgb4i.00:07:43:04:5b:da iface.hwaddress = 00:07:43:04:5b:da iface.transport_name = cxgb4i iface.net_ifacename = eth3 iface.ipaddress = 102.2.2.137 Chelsio T5/T4 Unified Wire For XenServer Page 25...
  • Page 26 Discovering iSCSI Targets To discovery an iSCSI target execute a command in the following format: iscsiadm -m discovery -t st -p <target ip address>:<target port no> -I <cxgb4i iface file name> Chelsio T5/T4 Unified Wire For XenServer Page 26...
  • Page 27: Auto Login From Cxgb4I Initiator At Os Bootup

    Auto login from cxgb4i initiator at OS bootup For iSCSI auto login (via cxgb4i) to work on OS startup, please add the following line to start() /etc/rc.d/init.d/iscsid file on RHEL: modprobe -q cxgb4i Chelsio T5/T4 Unified Wire For XenServer Page 27...
  • Page 28 -q iscsi_tcpmodprobe -q ib_iser modprobe -q cxgb4i modprobe -q cxgb3i modprobe -q bnx2i modprobe -q be2iscsi daemon brcm_iscsiuio daemon $prog retval=$? echo [ $retval -eq 0 ] && touch $lockfile return $retval Chelsio T5/T4 Unified Wire For XenServer Page 28...
  • Page 29: Appendix

    Chapter IV. Appendix IV. Appendix Chelsio T5/T4 Unified Wire For XenServer Page 29...
  • Page 30: Chelsio End-User License Agreement (Eula)

    IF YOU DO NOT AGREE TO THE TERMS OF THIS AGREEMENT, CLICK THE "DO NOT ACCEPT" BUTTON TO TERMINATE THE INSTALLATION PROCESS. 1. License. Chelsio Communications, Inc. ("Chelsio") hereby grants you, the Licensee, and you hereby accept, a limited, non-exclusive,...
  • Page 31 If the Software is acquired under the terms of a DoD or civilian agency contract, use, duplication or disclosure by the Government is subject to the restrictions of this Agreement in accordance with 48 C.F.R. 12.212 of the Chelsio T5/T4 Unified Wire For XenServer Page 31...
  • Page 32 Should you have any questions concerning this Agreement, you may contact Chelsio by writing to: Chelsio Communications, Inc. 370 San Aleso Ave. Sunnyvale, CA 94085 Chelsio T5/T4 Unified Wire For XenServer Page 32...

This manual is also suitable for:

T4

Table of Contents