Page 1
Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 Part No: E24460-09 August 2018...
Page 3
Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4
Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...
Contents Using This Documentation ................. 9 1 Universal HBA Overview ................ 11 Kit Contents .................... 11 Universal HBA Features and Specifications ............ 11 Operating System and Technology Requirements .......... 15 Boot Support .................... 15 System Interoperability ................... 16 Host Platform Support ................ 16 Switch Compatibility ................ 17 Storage Support .................... 18 Array Storage Support ................ 18 Tape Storage Support ................
Page 6
▼ To Install the Universal HBA Software for the Windows OS .... 62 Diagnostic Support for the Oracle Solaris, Red Hat, SUSE Linux, and Windows OSes ...................... 63 ▼ To Install Diagnostic Support for Oracle Solaris, Red Hat, and SUSE Linux OSes .................... 63 Installing the CLI for Updating the BIOS and FCode ........... 64 Updating the Universal HBA Firmware .............
Page 7
Contents Perform a One-Time Firmware Update For FC SR-IOV Support ...... 70 vpd r/w failed Error Messages Are Displayed .......... 70 Cannot Boot Net Over DHCP Through the Universal HBA ........ 71 Glossary ...................... 73...
Page 8
Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
Audience – Technicians, system administrators, and authorized service providers ■ Required knowledge – Advanced experience troubleshooting and replacing hardware ■ Product Documentation Library Documentation and resources for this product and related products are available at http:// docs.oracle.com/cd/E24648_01/index.html. Feedback Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback. Using This Documentation...
Page 10
Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
C H A P T E R Universal HBA Overview This chapter provides a basic overview of Oracle's Sun Storage 16 Gb Fibre Channel (FC) PCIe Universal Host Bus Adapter (HBA), which is a low-profile, dual-port PCIe HBA that uses Cavium, formerly QLogic, technology. This chapter also describes the various operating systems, host platforms, storage, and infrastructure configurations that support the universal HBA, and lists the universal HBA environmental requirements.
Page 12
Universal HBA Features and Specifications QLogic, technology. The HBA is considered universal because it is a configurable board that enables you to change its operating protocol mode from a two-port 16 Gb FC HBA to a two- port 10 GbE Fibre Channel over Ethernet (FCoE) Converged Network Adapter. The universal HBA has four possible configurations: 10 GbE FCoE Copper —...
Page 13
Universal HBA Features and Specifications Sun Storage 16 Gb FC PCIe Universal Host Bus Adapter, QLogic, with SFP+ Transceiver Modules FIGURE 1 Table 1, “Universal Host Bus Adapter Features and Specifications,” on page 13 lists the features and specifications of the universal HBA. For a list of supported operating systems, see Table 2, “Supported Operating System/Technology Versions (Minimum) ,”...
Page 14
Universal HBA Features and Specifications Feature Description Test suite Provided by Oracle VTS software Receive side scaling (RSS) Supported MSI-X Supported Fibre Channel support ■ Dual-port Fibre Channel with 16/8/4 auto negotiation ■ Topologies supported: FC-SW switched fabric (N_Port), FC-AL arbitrated loop (not supported at 16 Gb) (NL_ Port), and Point-to-point (N_Port) ■...
Supported Operating System/Technology Versions (Minimum) Operating System/ Technology Supported Versions (minimum) Oracle Solaris OS ■ Oracle Solaris 10 1/13 for the x86 (64-bit) platform (+ patches 149168-07 and 149176-11) ■ Oracle Solaris 10 1/13 for the SPARC platform (+ patches 149167-07 and 149175-11) ■...
† † Windows Server 2012 † While using the Driver Update disk during the installation process. Driver Update is available at the Oracle support area of the QLogic web site: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx System Interoperability This section provides information about platforms and switches that are compatible with the universal host bus adapter.
Oracle Solaris Oracle's x86 Servers Sun Server X4-2, X4-2L, X4-4, and X4-8 Oracle Solaris, Windows, Linux, VMware Oracle Server X5-2, X5-2L, X5-4, and X5-8 Oracle Solaris, Windows, Linux, VMware Oracle Server X6-2 and X6-2L Oracle Solaris, Windows, Linux, VMware Oracle Exalytics In-Memory Machine X4-4 and X5-4...
To minimize the possibility of ESD-related damage, use both a workstation antistatic mat and an ESD wrist strap. You can get an ESD wrist strap from any reputable electronics store or from Oracle as part number 250-1007. Observe the following precautions to avoid ESD-related problems: Leave the universal HBA in its antistatic bag until you are ready to install it in the system.
First Time Setup First Time Setup Table 6, “First Time Setup Tasks,” on page 22 lists the tasks, in the order in which the tasks must be performed, to set up a new universal HBA for the first time. TABLE 6 First Time Setup Tasks Task Sections That Cover How to Do This...
HBA changes, based on the optical transceiver module that you install and based on your manual configuration(described in a later chapter). The supported transciever modules follow: 16 Gb FC SFP+ SW Optic Modules, QLogic (Oracle part number: 7101676) – Enables 16 ■ Gb FC HBA functionality.
Page 24
To Remove an SFP+ Optical Transceiver Module Removing and installing an SFP+ module can shorten its useful life. Do not remove and ■ insert any module more often than is absolutely necessary. To prevent ESD damage, follow the guidelines listed in “Observing ESD and Handling ■...
Replacement of SFP+ modules with supported modules from Oracle does not void Caution - the warranty. Replacement of SFP+ modules with non-Oracle supported modules will void the warranty or serviceability of the universal HBA. Chapter 2 • Universal HBA Installation and Removal...
Page 26
To Replace the PCI Bracket Remove the mounting bracket screws from the universal HBA. Remove the bracket and store it for future use. Align the mounting bracket tabs of the replacement bracket with the holes in the universal HBA. Ensure that the LEDs are properly aligned with the holes in the bracket. Do not to push the bracket past the grounding tabs of the transceiver housing.
To Replace the PCI Bracket Best Practices For HBA Installation Before installing the universal HBA into the system, review the best practices in this section to avoid potential issues: “General Best Practices” on page 27 ■ “Best Practices For Switches and Zoning” on page 27 ■...
Page 28
To Replace the PCI Bracket Use meaningful names for zones, and document the entire configuration. ■ Use only FCP-2 (also called FC-TAPE or FCP Error Recovery) with tape and/or sequential ■ devices. While FCP-2 might not cause problems for hard disk drives (HDDs), FCP-2 is a sequence-level error recovery mechanism that is irrelevant to HDDs.
■ To Install the Universal HBA If the system in which you are installing the universal HBA is running the Oracle Solaris OS, install the two driver patches or SRU for your platform, as described “Driver Software for the Oracle Solaris OS” on page Attach an ESD wrist strap to your wrist (see “Observing ESD and Handling...
To Install the Universal HBA Insert the universal HBA into an empty PCI Express x8 or larger slot. Press down firmly on the universal HBA until the universal HBA is seated in its slot. Secure the mounting bracket of the universal HBA to the case with the panel screw or clip.
Page 31
“Switch Compatibility” on page The following table lists cables that can be used with the universal HBA in the 10 GbE FCoE Copper configuration. Brocade Part Number Oracle Part Number Cable Description SN-TWX-0101 SG-XSWBROSFP+1MIPK Brocade Twinax, 1 meter, 1 pack, SN...
Page 32
To Connect the Optical Cables The following figure shows how to connect the universal HBA with copper cables (one cable per port). Insert the other end of the copper cable into an empty SFP+ cage on a supported switch. Link Aggregation Control Protocol (LACP) cannot be used on the same port as FCoE or Note - iSCSI.
Page 33
To Connect the Optical Cables You can connect one or two optical cables to the universal HBA. Perform the following steps for each optical cable that you connect to the universal HBA: Connect one end of the fiber-optic cable to an LC connector on the universal HBA.
To Apply Power To Apply Power Before you apply power to the system, read Chapter 3, “Operating Protocol Mode Note - Configuration”, which describes how to change the operating protocol mode of the universal HBA. It is important to perform the steps in Chapter 3, “Operating Protocol Mode Configuration”...
Page 35
To Apply Power The green LEDs can be seen through openings in the mounting bracket of the universal HBA, as shown in Broken Link (Target ID: Z40003121043785). Chapter 2 • Universal HBA Installation and Removal...
Understanding LED Status Indicators Callout Description Low profile mounting bracket (standard) Port 2 LEDs see Table 7, “Universal Host Bus Adapter LED Status Indicators for CNA Mode,” on page 36 Table 8, “Universal Host Bus Adapter LED Status Indicators for Fibre Channel Only Mode ,” on page 37 for explanation) Port 2 LC Connector Port 1 LC Connector...
Removing the Hardware Universal Host Bus Adapter LED Status Indicators for Fibre Channel Only Mode TABLE 8 16 Gb FC LED (Amber) 8 Gb FC LED (Green) 4 Gb FC LED (Amber) Activity Power off Power on (before firmware initialization) Flashing Flashing Flashing...
Page 38
Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
♦ ♦ ♦ C H A P T E R Operating Protocol Mode Configuration This chapter describes how to identify the current operating protocol mode of the universal HBA and how to change the universal HBA operating protocol mode, if needed. If you choose to change the HBA from its base version to another configuration, use the information in this chapter to manually configure the system to recognize the new operating protocol mode that corresponds to the configuration of the universal HBA.
UEFI utilty for x86 systems – See “To Determine and Change the Operating Protocol Mode ■ Using the UEFI Setup Menus” on page FCode for Oracle SPARC systems – See “To Determine and Change the Operating Protocol ■ Mode Using the FCode Utility” on page QLogic QConvergeConsole CLI management tool –...
To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility UEFI (new x86 servers) – x86 server documentation ■ FCode (Oracle SPARC servers) – Readme file ■ QConvergeConsole GUI management tool – Online Help ■ QConvergeConsole CLI management tool – QConvergeConsole CLI User's Guide, located ■...
Page 42
To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility The QLogic Fast!UTIL menu appears, as shown in the following two figures. Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...
Page 43
To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility When the Fast!UTIL utility begins, select the universal HBA. Chapter 3 • Operating Protocol Mode Configuration...
Page 44
To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility From the Options menu, select Personality Setting, and then press Enter. The current operating protocol mode of the universal HBA (either FC or CNA) is displayed. Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...
Page 45
Readme file to configure PXE booting. This procedure describes how to access the BIOS Fast!UTIL utility Readme file in order to configure PXE: Go to the Oracle support area of the QLogic Web site at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx Chapter 3 • Operating Protocol Mode Configuration...
To Determine and Change the Operating Protocol Mode Using the UEFI Setup Menus From the guided search selection boxes, choose the following: First box – Converged Network Adapters ■ Middle box – 7101674 ■ Last box - The operating system used by your system. ■...
Page 47
To Determine and Change the Operating Protocol Mode Using the UEFI Setup Menus Select the UEFI Driver Control tab, as shown in the following figure. On the left side of the screen, select the universal HBA. Chapter 3 • Operating Protocol Mode Configuration...
Page 48
To Determine and Change the Operating Protocol Mode Using the UEFI Setup Menus Select Advanced Settings, as shown in the following figure. Select Adapter Personality (operating protocol mode), and then select the mode (FC or CNA) as required, as shown in the following figure. Exit the UEFI menu with Save and Reset.
Mode Using the FCode Utility This procedure describes how to determine and change the operating protocol mode of the universal HBA using the FCode utility on Oracle SPARC systems. Type the show-disks command at the ok prompt to list the QLogic FC/FCoE device path.
Follow these instructions to determine and change the operating protocol mode of the universal HBA using the QConvergeConsole CLI in noninteractive mode in the Windows, Linux, or Oracle Solaris OS. Open an operating system shell. (Optional) Issue the following command to display the current operating protocol...
Page 51
To Determine and Change the Operating Protocol Mode Using the QConvergeConsole Interactive CLI hba-instance mode qaucli -pc --type Where: hba-instance is the HBA instance number of the universal HBA. To discover the instance number of the universal HBA, you can issue the -g command. mode is one of the following: fco or 0 to change the operating protocol mode to Fibre Channel only.
Page 52
To Determine and Change the Operating Protocol Mode Using the QConvergeConsole Interactive CLI Linux – Issue the following command: qaucli ■ Oracle Solaris – Issue the following command: qaucli ■ The Main Menu appears: Main Menu 1: Adapter Information 2: Adapter Configuration 3: Adapter Updates...
Page 53
To Determine and Change the Operating Protocol Mode Using the QConvergeConsole Interactive CLI 4: Target Persistent Binding 5: Boot Devices Configuration 6: Virtual Ports (NPIV) 7: Target Link Speed (iiDMA) 8: Driver Parameters 9: Selective LUNs 10: QoS 11: Export (Save) Configuration 12: Generate Reports 13: Personality (p or 0: Previous Menu;...
QCC GUI installation package. Additionally, a QLogic QConverge Console GUI User's Guide is available at the Oracle support area of the QLogic web site. Follow these instructions to determine and change the operating protocol mode of the universal HBA: Open a web browser.
Page 55
To Determine and Change the Operating Protocol Mode Using the QConvergeConsole GUI The QConvergeConsole main window is displayed, the following figure shows an example of the QConvergeConsole main screen and identifies the main parts of the screen. Connect to the host containing the universal HBA as follows: Locate the Input hostname/address field in the upper-left corner of the QConvergeConsole screen.
Page 56
To allow Oracle Solaris 10 hosts to connect to an Oracle Solaris 11 host, the Note - netservices open command must be issued on the Oracle Solaris 11 host after each reboot of the Oracle Solaris 11 host. However, connections can be made to Oracle Solaris 10 hosts from either Oracle Solaris 10 or Oracle Solaris 11 without needing to issue the netservices open command on either host.
Running Oracle Solaris 10 in an SR-IOV root or I/O domain is an unsupported configuration. To adjust the configuration so that it is supported, do the following: If running Oracle Solaris 10 in an SR-IOV root domain, update the root domain to the latest ■...
Page 58
Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
■ Driver Software for the Oracle Solaris OS Before using the universal HBA, update the universal HBA driver software for the Oracle Solaris OS with the following SRU version or patches: Oracle Solaris 11.1 OS for the SPARC and x86 platforms - SRU13.4 ■...
Installing Software for the Red Hat and SUSE Linux OSes Before using the universal HBA, check for the latest drivers at the Oracle support area of the QLogic web site. The drivers and utilities, as well as ReadMe guides, are located at: http:// driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx...
Installing Software for the VMware Technology Before using the universal HBA, check the Oracle support area of the QLogic web site for the latest drivers. The drivers and utilities, as well as their associated Readme files, are located at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx...
Installing Software for the Windows OS Before using the universal HBA, check the Oracle support area of the QLogic web site for the latest drivers. The drivers and utilities, as well as their associated Readme files, are located at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx...
Diagnostic Support for the Oracle Solaris, Red Hat, SUSE Linux, and Windows OSes Save the file to a directory on the hard disk of the system. Follow the installation instructions in the Readme file associated with the driver to complete the driver installation.
Follow the installation instructions in the README.TXT file. Installation instructions are also available in the QLogic user's guides for those tools, which can also be found in the Oracle support area of the QLogic web site. For instructions on how to update the BIOS and FCode, see the QConvergeConsole CLI User's Guide in the Software section in the Oracle support area of the QLogic web site.
Page 65
To Update the Universal HBA Firmware For example: Oracle_qle83xx_img2.02.24risc5.00.41 Unzip the image file that you downloaded in step 1, and save the .bin file to a local directory. From a terminal window, navigate to the directory where the .bin file is located, and run the QConvergeConsole command-line interface utility by typing qaucli the command line.
Page 66
To Update the Universal HBA Firmware (p or 0: Previous Menu; m or 98: Main Menu; ex or 99: Quit) Please Enter Selection: 1 From the Flash Update menu that is displayed, select the universal HBA and type the name of the flash .bin file from step 2. QConvergeConsole ...
Page 67
To Update the Universal HBA Firmware Please Enter Selection: 1 At the prompt, do one of the following: Type to activate the firmware immediately. ■ Type if you do not want to activate the new firmware immediately. ■ QConvergeConsole CLI - Version 1.1.0 (Build 9) ...
Page 68
Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
Link Aggregation Control Protocol (LACP) Cannot Be Used In Certain Conditions Bug 18707752 Conditions: System Platform: All supported systems using the Oracle Solaris driver ■ Operating Protocol Mode of Universal HBA: FC, CNA ■ Environment: Universal HBA connected directly to supported storage ■...
“Updating the Universal HBA Firmware” on page Workaround: Perform the one-time, FC SR-IOV firmware update: 1. Go to the Oracle support area of the QLogic web site at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search. aspx 2. Search for the universal HBA by using the HBA part number (7101674).
■ procedures Issue: After upgrading the Oracle Linux OS to UEK 3, you might receive “vpd r/w failed” messages upon issuing functional check commands, such as dmesg and lspci. Workaround: None. Ignore these messages as they do not adversely affect the functionality of the universal HBA.
Page 72
Cannot Boot Net Over DHCP Through the Universal HBA Workaround: If you are stuck in this time out situation, send a break at the command line. For future boot net booting at the OBP prompt, do not use DHCP booting. Instead, use RARP booting, as shown in the following screen.
Glossary ASIC application-specific integrated circuit BIOS Basic Input Output System CENELEC European Committee for Electrotechnical Standardization command line interface converged network adapter direct-attach copper direct-attached storage direct connecting receptacle DHHS Department of Health and Human Services Glossary...
Page 74
Error Checking and Correction Enhanced Ethernet EEPROM electrically erasable programmable read-only memory electrostatic discharge Fibre Channel FCoE Fibre Channel over Ethernet gigabit gigabit Ethernet graphical user interface host bus adapter IEEE Institute of Electrical and Electronics Engineers internet protocol iSCSI internet Small Computer System Interface Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...
Page 75
light emitting diode low-profile logical unit number media access control MSI-X message signaled interrupts - extended networking interface card optical fiber cable operating system Peripheral Component Interconnect PCIe Peripheral Component Interconnect Express POST power-on self test random access memory Glossary...
Page 76
relative humidity RoHS Restriction of Hazardous Substances Directive storage area network SFP+ enhanced small form factor pluggable transceiver short range short wave top of rack UCNA universal converged network adapter VLAN virtual local area network world wide name WWPN world wide port name Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...
Need help?
Do you have a question about the Sun Storage HBA and is the answer not in the manual?
Questions and answers