Sun storage 10 gbe fcoe pcie converged network adapter from qlogic (68 pages)
Summary of Contents for Oracle Sun Storage 10 GbE FCoE
Page 1
Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q- TA, SG-XEMFCOE2-Q-TA, and 7101682 Part No: E20764-07 January 2017...
Page 3
Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4
Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l’accès à...
Converged Network Adapter LEDs .............. 26 Testing the Installation ................... 28 ▼ To Verify Proper Installation (Oracle SPARC Systems) ...... 29 ▼ To Verify Attached Storage (Oracle SPARC Systems) ...... 31 ▼ To Verify Proper Installation (Oracle x86 Systems) ......... 32 Updating the PXE .................. 35 PXE Operating Systems ................. 35...
Page 6
▼ To Manually Unconfigure the Unusable Device ........ 66 System Panic After Installing the Adapter in an x86 System ........ 67 Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
Page 7
Contents LEDs Turn On Sporadically After Pressing the Attention Button For Hot-Plug Removal ...................... 68 qlge Driver Keeps Sending NOTICE: Messages to the Console ...... 68 The Adapter Is Not Logging Into the Brocade 8000 Switch ........ 68 Windows Server 2008 R2 Stop Error .............. 69...
Page 8
Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Audience – Technicians, system administrators, and authorized service providers ■ Required knowledge – Advanced experience troubleshooting and replacing hardware ■ Product Documentation Library Documentation and resources for this product and related products are available at http:// docs.oracle.com/cd/E19964-01/index.html. Feedback Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback. Using This Documentation...
Page 10
Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
C H A P T E R Converged Network Adapter Overview This chapter provides a basic overview of Oracle's Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter, which uses Cavium, formerly QLogic, technology. This chapter also describes the various operating systems, storage, and infrastructure configurations that support the Converged Network Adapter, and lists the adapter's environmental requirements.
Page 12
Ethernet and NIC support Dual 10G interface support for: ■ SR optical, and twinax interfaces (SFP+ direct attach) Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Operating System/Technology Supported Versions (minimum) Oracle Solaris OS for the x86 (64-bit) platform ■ Oracle Solaris 10 1/13 with patches 149176-02 and 145649-04, at minimum ■ Oracle Solaris 11.1 with SRU 7 To obtain the latest patches and SRUs, go to http://support.oracle.com...
Support,” on page 15. For a list of the operating system versions that are supported by the Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
Oracle Solaris Sun Blade T6340 Oracle Solaris Oracle x86 Servers Sun Blade X3-2B Oracle Solaris, Linux, VMware, and Windows Sun Blade X4-2B Oracle Solaris, Linux, VMware, and Windows Sun Blade 6000 Oracle Solaris, Linux, VMware, and Windows Sun Blade 6048...
Page 16
Sun Storage 7110 ■ Sun Storage 7210 ■ Sun Storage 7310 ■ Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Ethernet (FCoE) switches: Brocade 8000 (FCoE top-of-rack [ToR] switch) ■ When operating with Oracle's Solaris 10 10/09 OS, logging in to a Brocade Elara Caution - 8000 switch requires VLAN 1002 configuration for that port. This is not a requirement in later versions of the Oracle Solaris OS.
VMware ESX/ESXi 5.0 and 5.1 ■ Windows Server 2008 R2 including SP1 ■ Windows Server 2012 ■ Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
To minimize the possibility of ESD-related damage, use both a workstation antistatic mat and an ESD wrist strap. You can get an ESD wrist strap from any reputable electronics store or from Oracle as part number 250-1007. Observe the following precautions to avoid ESD-related problems: Leave the adapter in its antistatic bag until you are ready to install it in the system.
Refer to your system documentation to shut down, power off, and unplug the system, if required. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Page 23
To Install the Converged Network Adapter Press down the plastic tab to release the ExpressModule latch and pull the lever out until it is nearly perpendicular with the ExpressModule front panel. Insert the adapter into an empty PCIe x8 or larger slot. Be careful that the tooth on the bottom of the lever does not come in contact with the chassis sheet metal during insertion.
Connect the fiber-optic cable, or cables, to an LC connector on the adapter. The following figure shows how to connect the dual-port adapter with fiber-optic cables. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
Link Aggregation Control Protocol (LACP) cannot be used on the same port as FCoE or Note - iSCSI. To Connect the Copper Cables Use only SFP+ direct attach twinax cables approved by Oracle. The following table lists the part numbers for the approved twinax copper cables. Brocade Part Number Oracle Part Number...
This section describes the light-emitting diodes (LEDs) on the adapter, as shown in the following figure. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Page 27
Converged Network Adapter LEDs Callout Description ExpressModule latch Port 1 SAN LED Port 1 LC Connector Port 2 SAN LED Port 2 LC Connector Port 1 LAN LED Port 2 LAN LED OK LED (system operating normally) Chapter 2 • Hardware Installation and Removal...
-ATTN button is pressed, and off when the hardware is powered off. Testing the Installation This section contains the following topics: Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
During system power-on initiation, the following system booting BIOS initialization screen is displayed. QLogic Corporation QEM8152 PCI3.0 Fibre Channel ROM BIOS version 2.14 Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Page 33
To Verify Proper Installation (Oracle x86 Systems) Copyright (c) QLogic Corporation 1992-2009. All rights reserved. www.qlogic.com Press <CTRL-Q> or <ALT-Q> for Fast!UTIL BIOS for Adapter 0 is disabled BIOS for Adapter 1 is disabled ROM BIOS NOT INSTALLED ...
Page 34
To exit the QLogic Fast!UTIL, press the Escape key. The following QLogic Fast!UTIL menu is displayed. QLogic Fast!UTIL Selected Adapter ---------------------------------------------------------- Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Updating the PXE Adapter Type Address Slot Device Function QEM8152 E800 01 05 00 2 ---------------------------------------------------------- Fast!UTIL Options Configuration Settings Scan Fibre Devices Fibre Disk Utility Loopback Data Test Select Host Adapter Exit Fast!UTIL Highlight Exit Fast!UTIL and press Enter. The following QLogic Fast!UTIL menu is displayed. QLogic Fast!UTIL ...
For instructions about booting from FCoE, refer to the Readme.txt file in the multi- Note - boot package located at the URL provided earlier in this section. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
■ Oracle Solaris boot server ■ Converged Network Adapter installed in Oracle's SPARC Solaris boot client ■ Software configuration requires that you verify (via the .properties command) the multi-boot version and release date by viewing the values of the following properties: revision-level - 3.15 or later...
The Attention LED near the button will blink for approximately five seconds, indicating that the adapter is being prepared for removal. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
To Prepare the Adapter for Hot-Plug Removal Using the Oracle Solaris OS When pressing the Attention button, press the button straight in, and upon release, ensure Note - that the button has not become wedged beneath the faceplate. If the Attention button remains depressed, or is wedged beneath the faceplate, press the button again to release it, and then start this procedure again.
Pull forward on the ejector lever to dislodge the adapter. Remove the adapter. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
■ Installing the Oracle Solaris Drivers The qlc and qlge drivers are included with the Oracle Solaris 10 01/13 and the Oracle Solaris 11.1 OSes (or later), and provide support for FCoE functionality with the Converged Network Adapter. You must load the latest qlc and qlge drivers by installing the appropriate platform...
Installing or updating the qlc and qlge Converged Network Adapter drivers from the patches listed in the previous section adds or updates both the FCoE driver and the networking driver. No additional steps are required to install or update those drivers on the Oracle Solaris OS. Log in as the root user.
OS version of the driver (for example 11.0 for SLES 11). Oracle Linux, RHEL 5.9 and later, and SLES 11 SP2 and later have Converged Network Note - Adapter driver support in the distro;...
43, you can install the drivers by following the procedures in the order listed in this section: Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
Page 45
■ “Deploying the Networking Driver” on page 47 ■ You do not need to install any drivers for the Oracle Linux OS. Note - To Build the FCoE Driver The driver installation makes extensive use of the build.sh script, which is located in driver source (extras/build.sh).
Page 46
” on page Install the driver module (*.ko) files to the appropriate kernel module directory. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Page 47
To Create the Driver # ./extras/build.sh install For SUSE Linux users, edit the /etc/sysconfig/kernel file and modify the INITRD_MODULES directive as shown in the following example. INITRD_MODULES="..qla2xxx" Change to the /boot directory. Back up the current RAMDISK image. # cp -f initrd-2.6.kernel-version.img initrd-2.6.kernel-version.img.bak Build the RAMDISK image with the mkinitrd command.
Page 48
Edit the INITRD_MODULES= line to append qlge; for example: INITRD_MODULES=piix thermal fan reiserfs qlge Issue the mkinitrd command; for example: Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Page 49
To Remove the Driver mkinitrd -i initrd-2.6.16.60-0.21-smp-qlge -k vmlinuz-2.6.16.60-0.21-smp -M boot/ System.map-2.6.16.60-0.21-smp Type the entire preceding command on a single line. Note - Modify the menu.lst file to include the new RAMDISK as an option to boot from. Reboot the system. Modify the variables in the sysconfig as follows: Open the following file to edit: /etc/sysconfig/kernel...
Go to the Oracle support area of the QLogic web site at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx Locate the table containing your Converged Network Adapter model. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Installing Software for the Oracle VM OS and VMware Technology The Converged Network Adapter drivers included on the Oracle VM and VMware distribution are sufficient for supporting the Converged Network Adapter. No further action is required. To verify that the drivers loaded successfully, look for the following lines in the /var/log/ vmkernel file: Initialization for qle8100_707_vmw succeeded with module ID 2.
Page 52
Windows Server 2008 (x64) Windows Server 2008 Server Core (x64) Windows Server 2008 SP2 (x64) Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
To Download the Networking Driver and Then Create a Driver Disk Miniport Driver Version Works With Windows Server 2008 SP2 Server Core (x64) Windows Server 2008 R2 (x64) Windows Server 2008 R2 Server Core (x64) Windows Server 2012 Go to the following web site: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx Click the Converged Network Adapters icon.
Page 54
If you are installing the driver from removable media, follow these steps: ■ Insert the media. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Page 55
To Update the Driver on Windows Click Locate and install driver software (recommended). If the Hardware Update Wizard prompts you to search online, click Don't search online. Click Next. The Update wizard locates the driver and automatically completes the installation. If you are not installing the driver from removable media, follow these steps: ■...
Page 56
The operating system manages and controls the driver installation process; the driver follows the process dictated by the OS. The driver installation cannot deviate from this process. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
Page 57
To Install the Networking Driver on Windows This section provides the most common ways of installing and upgrading the driver, as documented for each operating system. For other installation procedures, please consult the OS manuals. This section contains procedures for the following: “To Install the Networking Driver on Windows ”...
Page 58
If the Hardware Update Wizard prompts you to search online, click Don't search online. The Update Wizard locates the driver, and then automatically completes the installation. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
Page 59
To Remove the Driver If you are not installing the driver from removable media, follow these steps: ■ Click Browse my computer for driver software. Click I don't have the disk. Show me other options. Click Browse my computer for driver software (advanced). Browse to the location of the driver, and then click Next.
Click the utility name to download the utility to a local file system. For additional information, click the Read Me link for the utility. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
FCode when using this Converged Network Adapter. If you have not done so already, you can download the SANsurfer FC HBA CLI and SANsurfer Converged Network Adapter Networking CLI tools from the Oracle support area of the QLogic web site at: http://driverdownloads.qlogic.com/QLogicDriverDownloads_UI/Oracle_Search.aspx...
Page 62
Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...
“Windows Server 2008 R2 Stop Error” on page 69 ■ Link Aggregation Control Protocol (LACP) Cannot Be Used In Certain Conditions Bug 18707752 Conditions: System Platform: All supported systems using the Oracle Solaris driver ■ Chapter 4 • Known Issues...
Adapter is Automatically Configured Upon Insertion Into a Chassis, But Then Goes Offline When attempting to script rapid unconfiguration/configuration of the Converged Network Adapter, you might encounter the following error message: nwamd_ncu_handle_link_action_event: ignoring action for link:qlge1: permission denied Workaround: When running such scripts, keep in mind that it takes time to discover every device connected to the Converged Network Adapter.
Issue the cfgadm -c unconfigure -o unusable_SCSI_LUN unusable-device-attachment- point command to unconfigure the unusable devices on the attachment point. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
System Panic After Installing the Adapter in an x86 System Bug 15635205 Issue: If you install the adapter in an x86 system that is running the Oracle Solaris 10 10/09 OS, the system might panic when you perform any of the following actions: 1. Reboot the system.
Brocade 8000 switch unless VLAN 1002 is configured on the switch; specifically on the port to which the adapter is connected. Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 •...
Windows Server 2008 R2 Stop Error Workaround: Configure the Brocade 8000 port that is connected to the host-side adapter so that the port is included in VLAN 1002. For more information, see the Brocade documentation that describes how to configure ports. Windows Server 2008 R2 Stop Error Bug 15657319 Issue:...
Page 70
Sun Storage 10 GbE FCoE ExpressModule Converged Network Adapter From QLogic Installation Guide For Adapter Models SG-EMFCOE2-Q-SR, SG-XEMFCOE2-Q-SR, SG-EMFCOE2-Q-TA, SG-XEMFCOE2-Q-TA, and 7101682 • January 2017...