Oracle Sun Storage HBA Installation Manual

Oracle Sun Storage HBA Installation Manual

16 gb fibre channel pcie universal host bus adapter, qlogic
Table of Contents

Advertisement

Quick Links

Sun Storage 16 Gb Fibre Channel PCIe
Universal Host Bus Adapter, QLogic
Installation Guide For HBA Model
7101674
Part No: E24460-09
August 2018

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Sun Storage HBA and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Summary of Contents for Oracle Sun Storage HBA

  • Page 1 Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 Part No: E24460-09 August 2018...
  • Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
  • Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...
  • Page 5: Table Of Contents

    Contents Using This Documentation .................  9 1 Universal HBA Overview ................ 11 Kit Contents .................... 11 Universal HBA Features and Specifications ............ 11 Operating System and Technology Requirements .......... 15 Boot Support .................... 15 System Interoperability ...................  16 Host Platform Support ................ 16 Switch Compatibility ................ 17 Storage Support ....................  18 Array Storage Support ................ 18 Tape Storage Support ................
  • Page 6 ▼ To Install the Universal HBA Software for the Windows OS .... 62 Diagnostic Support for the Oracle Solaris, Red Hat, SUSE Linux, and Windows OSes ...................... 63 ▼ To Install Diagnostic Support for Oracle Solaris, Red Hat, and SUSE Linux OSes .................... 63 Installing the CLI for Updating the BIOS and FCode ...........  64 Updating the Universal HBA Firmware .............
  • Page 7 Contents Perform a One-Time Firmware Update For FC SR-IOV Support ...... 70 vpd r/w failed Error Messages Are Displayed .......... 70 Cannot Boot Net Over DHCP Through the Universal HBA ........ 71 Glossary ...................... 73...
  • Page 8 Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
  • Page 9: Using This Documentation

    Audience – Technicians, system administrators, and authorized service providers ■ Required knowledge – Advanced experience troubleshooting and replacing hardware ■ Product Documentation Library Documentation and resources for this product and related products are available at http:// docs.oracle.com/cd/E24648_01/index.html. Feedback Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback. Using This Documentation...
  • Page 10 Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
  • Page 11: Universal Hba Overview

    C H A P T E R Universal HBA Overview This chapter provides a basic overview of Oracle's Sun Storage 16 Gb Fibre Channel (FC) PCIe Universal Host Bus Adapter (HBA), which is a low-profile, dual-port PCIe HBA that uses Cavium, formerly QLogic, technology. This chapter also describes the various operating systems, host platforms, storage, and infrastructure configurations that support the universal HBA, and lists the universal HBA environmental requirements.
  • Page 12 Universal HBA Features and Specifications QLogic, technology. The HBA is considered universal because it is a configurable board that enables you to change its operating protocol mode from a two-port 16 Gb FC HBA to a two- port 10 GbE Fibre Channel over Ethernet (FCoE) Converged Network Adapter. The universal HBA has four possible configurations: 10 GbE FCoE Copper —...
  • Page 13 Universal HBA Features and Specifications Sun Storage 16 Gb FC PCIe Universal Host Bus Adapter, QLogic, with SFP+ Transceiver Modules FIGURE 1 Table 1, “Universal Host Bus Adapter Features and Specifications,” on page 13 lists the features and specifications of the universal HBA. For a list of supported operating systems, see Table 2, “Supported Operating System/Technology Versions (Minimum) ,”...
  • Page 14 Universal HBA Features and Specifications Feature Description Test suite Provided by Oracle VTS software Receive side scaling (RSS) Supported MSI-X Supported Fibre Channel support ■ Dual-port Fibre Channel with 16/8/4 auto negotiation ■ Topologies supported: FC-SW switched fabric (N_Port), FC-AL arbitrated loop (not supported at 16 Gb) (NL_ Port), and Point-to-point (N_Port) ■...
  • Page 15: Operating System And Technology Requirements

    Supported Operating System/Technology Versions (Minimum) Operating System/ Technology Supported Versions (minimum) Oracle Solaris OS ■ Oracle Solaris 10 1/13 for the x86 (64-bit) platform (+ patches 149168-07 and 149176-11) ■ Oracle Solaris 10 1/13 for the SPARC platform (+ patches 149167-07 and 149175-11) ■...
  • Page 16: System Interoperability

    † † Windows Server 2012 † While using the Driver Update disk during the installation process. Driver Update is available at the Oracle support area of the QLogic web site: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx System Interoperability This section provides information about platforms and switches that are compatible with the universal host bus adapter.
  • Page 17: Switch Compatibility

    Oracle Solaris Oracle's x86 Servers Sun Server X4-2, X4-2L, X4-4, and X4-8 Oracle Solaris, Windows, Linux, VMware Oracle Server X5-2, X5-2L, X5-4, and X5-8 Oracle Solaris, Windows, Linux, VMware Oracle Server X6-2 and X6-2L Oracle Solaris, Windows, Linux, VMware Oracle Exalytics In-Memory Machine X4-4 and X5-4...
  • Page 18: Storage Support

    Oracle's Sun Storage 6180 Array ■ Oracle's Sun Storage 6540 Array ■ Oracle's StorageTek 6580, 6780 with 8 Gbps FC host interface cards ■ Oracle's Pillar Axiom 600 storage system ■ Oracle's Sun Storage 7110, 7210, 7310, 7410 unified storage systems ■...
  • Page 19: Environmental Requirements

    Oracle's StorageTek SL500 Modular Library ■ Oracle's StorageTek SL3000 Modular Library ■ Oracle's StorageTek SL8500 Modular Library ■ Oracle's StorageTek Virtual Tape Library: VTL Value and VTL Value Plus ■ Oracle's StorageTek T10000B, T10000C Tape Drives ■ Oracle's StorageTek 9840C Tape Drive ■...
  • Page 20 Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
  • Page 21: Universal Hba Installation And Removal

    To minimize the possibility of ESD-related damage, use both a workstation antistatic mat and an ESD wrist strap. You can get an ESD wrist strap from any reputable electronics store or from Oracle as part number 250-1007. Observe the following precautions to avoid ESD-related problems: Leave the universal HBA in its antistatic bag until you are ready to install it in the system.
  • Page 22: First Time Setup

    First Time Setup First Time Setup Table 6, “First Time Setup Tasks,” on page 22 lists the tasks, in the order in which the tasks must be performed, to set up a new universal HBA for the first time. TABLE 6 First Time Setup Tasks Task Sections That Cover How to Do This...
  • Page 23: Installing And Removing Sfp+ Optical Transceiver Modules

    HBA changes, based on the optical transceiver module that you install and based on your manual configuration(described in a later chapter). The supported transciever modules follow: 16 Gb FC SFP+ SW Optic Modules, QLogic (Oracle part number: 7101676) – Enables 16 ■ Gb FC HBA functionality.
  • Page 24 To Remove an SFP+ Optical Transceiver Module Removing and installing an SFP+ module can shorten its useful life. Do not remove and ■ insert any module more often than is absolutely necessary. To prevent ESD damage, follow the guidelines listed in “Observing ESD and Handling ■...
  • Page 25: To Replace The Pci Bracket

    Replacement of SFP+ modules with supported modules from Oracle does not void Caution - the warranty. Replacement of SFP+ modules with non-Oracle supported modules will void the warranty or serviceability of the universal HBA. Chapter 2 • Universal HBA Installation and Removal...
  • Page 26 To Replace the PCI Bracket Remove the mounting bracket screws from the universal HBA. Remove the bracket and store it for future use. Align the mounting bracket tabs of the replacement bracket with the holes in the universal HBA. Ensure that the LEDs are properly aligned with the holes in the bracket. Do not to push the bracket past the grounding tabs of the transceiver housing.
  • Page 27: Best Practices For Hba Installation

    To Replace the PCI Bracket Best Practices For HBA Installation Before installing the universal HBA into the system, review the best practices in this section to avoid potential issues: “General Best Practices” on page 27 ■ “Best Practices For Switches and Zoning” on page 27 ■...
  • Page 28 To Replace the PCI Bracket Use meaningful names for zones, and document the entire configuration. ■ Use only FCP-2 (also called FC-TAPE or FCP Error Recovery) with tape and/or sequential ■ devices. While FCP-2 might not cause problems for hard disk drives (HDDs), FCP-2 is a sequence-level error recovery mechanism that is irrelevant to HDDs.
  • Page 29: Installing The Hardware

    ■ To Install the Universal HBA If the system in which you are installing the universal HBA is running the Oracle Solaris OS, install the two driver patches or SRU for your platform, as described “Driver Software for the Oracle Solaris OS” on page Attach an ESD wrist strap to your wrist (see “Observing ESD and Handling...
  • Page 30: Connecting The Cables

    To Install the Universal HBA Insert the universal HBA into an empty PCI Express x8 or larger slot. Press down firmly on the universal HBA until the universal HBA is seated in its slot. Secure the mounting bracket of the universal HBA to the case with the panel screw or clip.
  • Page 31 “Switch Compatibility” on page The following table lists cables that can be used with the universal HBA in the 10 GbE FCoE Copper configuration. Brocade Part Number Oracle Part Number Cable Description SN-TWX-0101 SG-XSWBROSFP+1MIPK Brocade Twinax, 1 meter, 1 pack, SN...
  • Page 32 To Connect the Optical Cables The following figure shows how to connect the universal HBA with copper cables (one cable per port). Insert the other end of the copper cable into an empty SFP+ cage on a supported switch. Link Aggregation Control Protocol (LACP) cannot be used on the same port as FCoE or Note - iSCSI.
  • Page 33 To Connect the Optical Cables You can connect one or two optical cables to the universal HBA. Perform the following steps for each optical cable that you connect to the universal HBA: Connect one end of the fiber-optic cable to an LC connector on the universal HBA.
  • Page 34: To Apply Power

    To Apply Power To Apply Power Before you apply power to the system, read Chapter 3, “Operating Protocol Mode Note - Configuration”, which describes how to change the operating protocol mode of the universal HBA. It is important to perform the steps in Chapter 3, “Operating Protocol Mode Configuration”...
  • Page 35 To Apply Power The green LEDs can be seen through openings in the mounting bracket of the universal HBA, as shown in Broken Link (Target ID: Z40003121043785). Chapter 2 • Universal HBA Installation and Removal...
  • Page 36: Understanding Led Status Indicators

    Understanding LED Status Indicators Callout Description Low profile mounting bracket (standard) Port 2 LEDs see Table 7, “Universal Host Bus Adapter LED Status Indicators for CNA Mode,” on page 36 Table 8, “Universal Host Bus Adapter LED Status Indicators for Fibre Channel Only Mode ,” on page 37 for explanation) Port 2 LC Connector Port 1 LC Connector...
  • Page 37: Removing The Hardware

    Removing the Hardware Universal Host Bus Adapter LED Status Indicators for Fibre Channel Only Mode TABLE 8 16 Gb FC LED (Amber) 8 Gb FC LED (Green) 4 Gb FC LED (Amber) Activity Power off Power on (before firmware initialization) Flashing Flashing Flashing...
  • Page 38 Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
  • Page 39: Operating Protocol Mode Configuration

    ♦ ♦ ♦ C H A P T E R Operating Protocol Mode Configuration This chapter describes how to identify the current operating protocol mode of the universal HBA and how to change the universal HBA operating protocol mode, if needed. If you choose to change the HBA from its base version to another configuration, use the information in this chapter to manually configure the system to recognize the new operating protocol mode that corresponds to the configuration of the universal HBA.
  • Page 40: Determining And Changing The Current Operating Protocol Mode

    UEFI utilty for x86 systems – See “To Determine and Change the Operating Protocol Mode ■ Using the UEFI Setup Menus” on page FCode for Oracle SPARC systems – See “To Determine and Change the Operating Protocol ■ Mode Using the FCode Utility” on page QLogic QConvergeConsole CLI management tool –...
  • Page 41: Mode

    To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility UEFI (new x86 servers) – x86 server documentation ■ FCode (Oracle SPARC servers) – Readme file ■ QConvergeConsole GUI management tool – Online Help ■ QConvergeConsole CLI management tool – QConvergeConsole CLI User's Guide, located ■...
  • Page 42 To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility The QLogic Fast!UTIL menu appears, as shown in the following two figures. Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...
  • Page 43 To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility When the Fast!UTIL utility begins, select the universal HBA. Chapter 3 • Operating Protocol Mode Configuration...
  • Page 44 To Determine and Change the Operating Protocol Mode Using the Fast!UTIL Utility From the Options menu, select Personality Setting, and then press Enter. The current operating protocol mode of the universal HBA (either FC or CNA) is displayed. Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...
  • Page 45 Readme file to configure PXE booting. This procedure describes how to access the BIOS Fast!UTIL utility Readme file in order to configure PXE: Go to the Oracle support area of the QLogic Web site at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx Chapter 3 • Operating Protocol Mode Configuration...
  • Page 46: To Determine And Change The Operating Protocol Mode Using The Uefi Setup Menus

    To Determine and Change the Operating Protocol Mode Using the UEFI Setup Menus From the guided search selection boxes, choose the following: First box – Converged Network Adapters ■ Middle box – 7101674 ■ Last box - The operating system used by your system. ■...
  • Page 47 To Determine and Change the Operating Protocol Mode Using the UEFI Setup Menus Select the UEFI Driver Control tab, as shown in the following figure. On the left side of the screen, select the universal HBA. Chapter 3 • Operating Protocol Mode Configuration...
  • Page 48 To Determine and Change the Operating Protocol Mode Using the UEFI Setup Menus Select Advanced Settings, as shown in the following figure. Select Adapter Personality (operating protocol mode), and then select the mode (FC or CNA) as required, as shown in the following figure. Exit the UEFI menu with Save and Reset.
  • Page 49: Utility

    Mode Using the FCode Utility This procedure describes how to determine and change the operating protocol mode of the universal HBA using the FCode utility on Oracle SPARC systems. Type the show-disks command at the ok prompt to list the QLogic FC/FCoE device path.
  • Page 50: Determining And Changing The Operating Protocol Mode Using The Qconvergeconsole Cli

    Follow these instructions to determine and change the operating protocol mode of the universal HBA using the QConvergeConsole CLI in noninteractive mode in the Windows, Linux, or Oracle Solaris OS. Open an operating system shell. (Optional) Issue the following command to display the current operating protocol...
  • Page 51 To Determine and Change the Operating Protocol Mode Using the QConvergeConsole Interactive CLI hba-instance mode qaucli -pc --type Where: hba-instance is the HBA instance number of the universal HBA. To discover the instance number of the universal HBA, you can issue the -g command. mode is one of the following: fco or 0 to change the operating protocol mode to Fibre Channel only.
  • Page 52 To Determine and Change the Operating Protocol Mode Using the QConvergeConsole Interactive CLI Linux – Issue the following command: qaucli ■ Oracle Solaris – Issue the following command: qaucli ■ The Main Menu appears:  Main Menu  1: Adapter Information  2: Adapter Configuration  3: Adapter Updates...
  • Page 53 To Determine and Change the Operating Protocol Mode Using the QConvergeConsole Interactive CLI  4: Target Persistent Binding  5: Boot Devices Configuration  6: Virtual Ports (NPIV)  7: Target Link Speed (iiDMA)  8: Driver Parameters  9: Selective LUNs 10: QoS 11: Export (Save) Configuration 12: Generate Reports 13: Personality (p or 0: Previous Menu;...
  • Page 54: To Determine And Change The Operating Protocol Mode Using The Qconvergeconsole Gui

    QCC GUI installation package. Additionally, a QLogic QConverge Console GUI User's Guide is available at the Oracle support area of the QLogic web site. Follow these instructions to determine and change the operating protocol mode of the universal HBA: Open a web browser.
  • Page 55 To Determine and Change the Operating Protocol Mode Using the QConvergeConsole GUI The QConvergeConsole main window is displayed, the following figure shows an example of the QConvergeConsole main screen and identifies the main parts of the screen. Connect to the host containing the universal HBA as follows: Locate the Input hostname/address field in the upper-left corner of the QConvergeConsole screen.
  • Page 56 To allow Oracle Solaris 10 hosts to connect to an Oracle Solaris 11 host, the Note - netservices open command must be issued on the Oracle Solaris 11 host after each reboot of the Oracle Solaris 11 host. However, connections can be made to Oracle Solaris 10 hosts from either Oracle Solaris 10 or Oracle Solaris 11 without needing to issue the netservices open command on either host.
  • Page 57: Sr-Iov/Fc-Ior Support

    Running Oracle Solaris 10 in an SR-IOV root or I/O domain is an unsupported configuration. To adjust the configuration so that it is supported, do the following: If running Oracle Solaris 10 in an SR-IOV root domain, update the root domain to the latest ■...
  • Page 58 Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
  • Page 59: Software Installation

    ■ Driver Software for the Oracle Solaris OS Before using the universal HBA, update the universal HBA driver software for the Oracle Solaris OS with the following SRU version or patches: Oracle Solaris 11.1 OS for the SPARC and x86 platforms - SRU13.4 ■...
  • Page 60: Oracle Solaris Diagnostic Support

    Installing Software for the Red Hat and SUSE Linux OSes Before using the universal HBA, check for the latest drivers at the Oracle support area of the QLogic web site. The drivers and utilities, as well as ReadMe guides, are located at: http:// driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx...
  • Page 61: To Install Universal Hba Software For The Red Hat And Suse Linux Oses

    Installing Software for the VMware Technology Before using the universal HBA, check the Oracle support area of the QLogic web site for the latest drivers. The drivers and utilities, as well as their associated Readme files, are located at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx...
  • Page 62: Installing Software For The Windows Os

    Installing Software for the Windows OS Before using the universal HBA, check the Oracle support area of the QLogic web site for the latest drivers. The drivers and utilities, as well as their associated Readme files, are located at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx...
  • Page 63: Diagnostic Support For The Oracle Solaris, Red Hat, Suse Linux, And Windows Oses

    Diagnostic Support for the Oracle Solaris, Red Hat, SUSE Linux, and Windows OSes Save the file to a directory on the hard disk of the system. Follow the installation instructions in the Readme file associated with the driver to complete the driver installation.
  • Page 64: Installing The Cli For Updating The Bios And Fcode

    Follow the installation instructions in the README.TXT file. Installation instructions are also available in the QLogic user's guides for those tools, which can also be found in the Oracle support area of the QLogic web site. For instructions on how to update the BIOS and FCode, see the QConvergeConsole CLI User's Guide in the Software section in the Oracle support area of the QLogic web site.
  • Page 65 To Update the Universal HBA Firmware For example: Oracle_qle83xx_img2.02.24risc5.00.41 Unzip the image file that you downloaded in step 1, and save the .bin file to a local directory. From a terminal window, navigate to the directory where the .bin file is located, and run the QConvergeConsole command-line interface utility by typing qaucli the command line.
  • Page 66 To Update the Universal HBA Firmware (p or 0: Previous Menu; m or 98: Main Menu; ex or 99: Quit)   Please Enter Selection: 1 From the Flash Update menu that is displayed, select the universal HBA and type the name of the flash .bin file from step 2. QConvergeConsole  ...
  • Page 67 To Update the Universal HBA Firmware Please Enter Selection: 1 At the prompt, do one of the following: Type to activate the firmware immediately. ■ Type if you do not want to activate the new firmware immediately. ■ QConvergeConsole   CLI - Version 1.1.0 (Build 9)  ...
  • Page 68 Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 • August 2018...
  • Page 69: Known Issues

    Link Aggregation Control Protocol (LACP) Cannot Be Used In Certain Conditions Bug 18707752 Conditions: System Platform: All supported systems using the Oracle Solaris driver ■ Operating Protocol Mode of Universal HBA: FC, CNA ■ Environment: Universal HBA connected directly to supported storage ■...
  • Page 70: Perform A One-Time Firmware Update For Fc Sr-Iov Support

    “Updating the Universal HBA Firmware” on page Workaround: Perform the one-time, FC SR-IOV firmware update: 1. Go to the Oracle support area of the QLogic web site at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search. aspx 2. Search for the universal HBA by using the HBA part number (7101674).
  • Page 71: Cannot Boot Net Over Dhcp Through The Universal Hba

    ■ procedures Issue: After upgrading the Oracle Linux OS to UEK 3, you might receive “vpd r/w failed” messages upon issuing functional check commands, such as dmesg and lspci. Workaround: None. Ignore these messages as they do not adversely affect the functionality of the universal HBA.
  • Page 72 Cannot Boot Net Over DHCP Through the Universal HBA Workaround: If you are stuck in this time out situation, send a break at the command line. For future boot net booting at the OBP prompt, do not use DHCP booting. Instead, use RARP booting, as shown in the following screen.
  • Page 73: Glossary

    Glossary ASIC application-specific integrated circuit BIOS Basic Input Output System CENELEC European Committee for Electrotechnical Standardization command line interface converged network adapter direct-attach copper direct-attached storage direct connecting receptacle DHHS Department of Health and Human Services Glossary...
  • Page 74 Error Checking and Correction Enhanced Ethernet EEPROM electrically erasable programmable read-only memory electrostatic discharge Fibre Channel FCoE Fibre Channel over Ethernet gigabit gigabit Ethernet graphical user interface host bus adapter IEEE Institute of Electrical and Electronics Engineers internet protocol iSCSI internet Small Computer System Interface Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...
  • Page 75 light emitting diode low-profile logical unit number media access control MSI-X message signaled interrupts - extended networking interface card optical fiber cable operating system Peripheral Component Interconnect PCIe Peripheral Component Interconnect Express POST power-on self test random access memory Glossary...
  • Page 76 relative humidity RoHS Restriction of Hazardous Substances Directive storage area network SFP+ enhanced small form factor pluggable transceiver short range short wave top of rack UCNA universal converged network adapter VLAN virtual local area network world wide name WWPN world wide port name Sun Storage 16 Gb Fibre Channel PCIe Universal Host Bus Adapter, QLogic Installation Guide For HBA Model 7101674 •...

This manual is also suitable for:

7101674

Table of Contents