Sun Oracle Sun Dual 10GbE SFP+ PCIe ExpressModule User Manual
  1. Manuals
  2. Brands
  3. Sun Oracle Manuals
  4. Server
  5. Sun Dual 10GbE SFP+ PCIe ExpressModule
  6. User manual

Sun Oracle Sun Dual 10GbE SFP+ PCIe ExpressModule User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
Sun Dual 10GbE SFP+ PCIe
ExpressModule
User's Guide
Part No. 820-4979-12
May 2010, Revision A

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Sun Dual 10GbE SFP+ PCIe ExpressModule and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Sun Oracle Sun Dual 10GbE SFP+ PCIe ExpressModule

Summary of Contents for Sun Oracle Sun Dual 10GbE SFP+ PCIe ExpressModule

  • Page 1 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide Part No. 820-4979-12 May 2010, Revision A...
  • Page 2 Copyright © 2008, 2010, Oracle and/or its affiliates. All rights reserved. This software and related documentation are provided under a license agreement containing restrictions on use and disclosure and are protected by intellectual property laws. Except as expressly permitted in your license agreement or allowed by law, you may not use, copy, reproduce, translate, broadcast, modify, license, transmit, distribute, exhibit, perform, publish, or display any part, in any form, or by any means.

  • Page 3: Table Of Contents

    Contents Regulatory Compliance Statements vii Safety Agency Compliance Statements xi Using This Documentation xv Sun Dual 10GbE SFP+ PCIe ExpressModule Overview 1 Shipping Kit Contents 1 ExpressModule Hardware Overview 1 ExpressModule Features 2 Indicator Lights on the ExpressModule 3 Hardware and Software Requirements 5...
  • Page 4 To Boot Over the Network on Linux Systems 23 Configuring the Driver Parameters 25 Driver Overview 25 Driver Parameters for Solaris 26 Setting ixgbe Driver Parameters in Solaris 27 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 5 ▼ To Configure Bonding for Multiple ixgbe Interfaces 42 ▼ To Remove Bonding 42 Sun Dual 10GbE SFP+ PCIe ExpressModule Specifications 45 Connectors 46 Table lists the card’s operating range.Technical Features 47 Physical Characteristics 47 Power and Environmental Requirements 48...
  • Page 6 Index 49 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 7: Regulatory Compliance Statements

    Regulatory Compliance Statements Your Sun product is marked to indicate its compliance class: • Federal Communications Commission (FCC) — USA • Industry Canada Equipment Standard for Digital Equipment (ICES-003) — Canada • Voluntary Control Council for Interference (VCCI) — Japan •...
  • Page 8 T33012 CCC Class A Notice The following statement is applicable to products shipped to China and marked with “Class A” on the product’s compliance label. GOST-R Certification Mark viii Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 9 Compliance Model Number: 5945532 Product Family Name: Sun Dual 10GbE SFP+ PCIe ExpressModule USA—FCC Class A This equipment complies with Part 15 of the FCC Rules. Operation is subject to the following two conditions: 1. This equipment may not cause harmful interference.
  • Page 10 Santa Clara, CA 95054 U.S.A. Tel: 650-786-3255 Fax: 650-786-3723 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 11: Safety Agency Compliance Statements

    Safety Agency Compliance Depending on the type of power switch your device has, one of the following symbols may be used: Statements On – Applies AC power to the system. Read this section before beginning any procedure. The following text provides safety precautions to follow when installing a Sun Microsystems product.
  • Page 12 Selon le type d'interrupteur marche/arrêt dont votre appareil est équipé, l'un des symboles suivants sera utilisé: Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 13 Einhaltung sicherheitsbehördlicher Aus– Unterbricht die Wechselstromzufuhr Vorschriften zum Gerät. Lesen Sie vor dem Ausführen von Arbeiten diesen Abschnitt. Im folgenden Text werden Sicherheitsvor- kehrungen beschrieben, die Sie bei der Installation eines Wartezustand – Der Ein-/Standby-Netz- Sun Microsystems-Produkts beachten müssen. schalter befindet sich in der Standby-Position. Sicherheitsvorkehrungen Treffen Sie zu Ihrem eigenen Schutz bei der Installation des Modifikationen des Geräts...
  • Page 14 En función del tipo de interruptor de alimentación del que disponga el dispositivo, se utilizará uno de los símbolos siguientes: Encendido – Suministra alimentación de CA al sistema. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 15: Using This Documentation

    Using This Documentation This user’s guide provides hardware and software installation instructions for Oracle’s Sun Dual 10GbE SFP+ PCIe Express Module. This document also describes how to configure the driver software for the ixgbe driver for Solaris, Linux, and Microsoft Windows Server 2003 operating systems. These instructions are designed for enterprise system administrators with experience installing network hardware and software.
  • Page 16 Submit comments about this document by clicking the Feedback[+] link at http://docs.sun.com. Include the title and part number of your document with your feedback: Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide, part number 820-4979-12. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 17: Shipping Kit Contents

    The carton in which your Sun 10GbE XFP SR PCI Express Card was shipped should contain the following items: Sun 10GbE XFP SR PCI Express Card ■ Sun Dual 10GbE SFP+ PCIe ExpressModule Getting Started Guide ■ Safety and Compliance Manual ■...

  • Page 18: Sun Dual 10Gbe Sfp+ Pcie Expressmodule Overview

    ■ MSI-X support ■ Virtual Machine Device queues (VMDq) ■ Low latency ■ Optimized queues – 32 transmit (Tx) and 64 receive (Rx) per port ■ Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 19 On the front panel of the ExpressModule (shown in ) next to each port, FIGURE 1-2 there are viewing holes for two lights dedicated to that port. explains the TABLE 1-1 meaning of the lights for each port. Chapter 1 Sun Dual 10GbE SFP+ PCIe ExpressModule Overview...

  • Page 20: Indicator Lights On The Expressmodule

    FIGURE 3-1 FIGURE 3-2 transceiver. Indicator Lights for Each Port on the ExpressModule TABLE 1-1 Label Color Meaning ACT/LINK Green Activity 10G/1G Green 10GbE link 10G/1G Amber 1GbE link Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 21 Operation is normal. Amber Attention There is an operation problem at this slot. Amber Blinking Locate This slot is being identified at user request. Note – The Attention switch currently is not supported. Chapter 1 Sun Dual 10GbE SFP+ PCIe ExpressModule Overview...

  • Page 22: Hardware And Software Requirements

    * The Sun Blade X6450 Server Module supports only Solaris and Linux operating systems. Note that hardware and software support changes over time. For the latest information concerning I/O options supported by your server, check: http://www.sun.com Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 23: Patches And Updates

    To download the most recent drivers for the Solaris OS, go to: ■ http://www.sun.com/download To download the most recent drivers for Windows or a Linux OS, go to: ■ http://www.intel.com/support/network/adapter Chapter 1 Sun Dual 10GbE SFP+ PCIe ExpressModule Overview...

  • Page 24: Installing And Setting Up The Device Driver Software

    C H A P T E R Installing and Setting Up the Device Driver Software The ixgbe device driver software comes bundled with Solaris software. This chapter explains how to verify the ixgbe device driver software is present on an x86 or SPARC system that uses the Solaris OS, and how to download and install the ixgbe driver on Solaris, Linux and Microsoft Windows systems.

  • Page 25: To Check The Driver Version On A Solaris Platform

    Downloading, Installing and Removing the Driver on a Linux Platform If your system uses the RedHat or SuSe Linux operating system, you must download the ixgbe device driver to install it. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 26: To Download The Driver For A Linux Platform

    ▼ To Download the Driver for a Linux Platform 1. Log in to your system. 2. With a browser, go to this location: http://support.intel.com/support/network/adapter/10gbe/srdualserverxpr/ 3. Select the following product: Intel 10 Gigabit XF SR Dual Port ExpressModule 4. Select this option: Download drivers and software 5.

  • Page 27: To Remove The Driver From A Linux Platform

    Intel(R) 10 Gigabit PCI Express Network Driver srcversion: 5CFF6AEBA251050F8A4B746 vermagic: 2.6.18-53.el5 SMP mod_unload gcc-4.1 ▼ To Remove the Driver From a Linux Platform ● Use the rmmod command: # rmmod ixgbe Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 28: Downloading, Installing And Removing The Driver On A Microsoft Windows Platform

    Downloading, Installing and Removing the Driver on a Microsoft Windows Platform If your system uses the Microsoft Windows Server 2003 operating system, perform the following procedures to download and install the device driver. ▼ To Download and Install the Driver on a Microsoft Windows Platform 1.

  • Page 29: To Remove The Driver From A Microsoft Windows Platform

    ▼ To Remove the Driver From a Microsoft Windows Platform 1. From the Control Panel, double-click Add/Remove Programs. 2. Select Intel PRO Network Connections Drivers. 3. Click Add/Remove. 4. When the confirmation dialog displays, click OK. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 30: Installing The Expressmodule

    C H A P T E R Installing the ExpressModule This chapter describes how to install the ExpressModule in your system and verify that it is recognized by the operating system. This chapter contains the following sections: “Installing an Optical Transceiver” on page 13 ■...
  • Page 31 3. Applying even pressure at both corners of the transceiver, push the transceiver until it is firmly seated in the slot. 4. Push the handle closed to lock the optical transceiver in place. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 32 Closing the Transceiver Handle FIGURE 3-2 5. Repeat Step 1 through Step 4 to install the second optical transceiver. Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver entirely and reinstall it. The handle operates an internal lock.

  • Page 33: Installing The Expressmodule

    Wrap the other end twice around your wrist, with the adhesive side against your skin. 4. Remove the filler panel from the ExpressModule opening. 5. Open the latch on the ExpressModule. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 34 Opening the ExpressModule Latch FIGURE 3-3 6. Align the ExpressModule with the vacant ExpressModule slot (1 in the following figure). Ensure that the ExpressModule’s indicator lights on the front panel are facing toward you and that the ExpressModule ejector lever on the bottom is fully opened.
  • Page 35 You might damage the ExpressModule’s connector. If the ExpressModule does not seat properly when you apply even pressure, remove and carefully reinstall the ExpressModule. 9. Detach the wrist strap. 10. Connect the Ethernet cables. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 36: Verifying The Installation

    Connecting the Ethernet Cables FIGURE 3-5 Verifying the Installation After you have installed the Sun 10GbE XFP SR PCI Express Card, perform the following tasks to verify the installation. ▼ To Verify the Installation on a Solaris System 1. Power on the system. 2.

  • Page 37: To Verify The Installation In A Linux System

    3. To check the driver version, use the Administration Tool. The minimum Windows Server 2003 driver version is 1.2.22.0. 4. In the Administration Tool click Computer Management, Device Manager, and Network Adapter. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 38: Network Configuration

    C H A P T E R Network Configuration This chapter describes how to edit the network host files after the card has been installed on your system. This chapter contains the following section: “Configuring the Network Host Files for a Solaris System” on page 21 ■...

  • Page 39: To Configure The Network Host Files By Creating /Etc/Hostname.ixgbe# Files

    1000 Mbps duplex: full nge1 link: down speed: 0 Mbps duplex: unknown ixgbe1 link: up speed: 10000 Mbps duplex: full ixgbe2 link: up speed: 10000 Mbps duplex: full Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 40: To Boot Over The Network Using Pxe

    3. Use the ifconfig command to set up the adapter’s ixgbe interfaces. Your ifconfig command might look similar to the following: # ifconfig ixgbe0 plumb ip_address netmask [255.255.255.0] broadcast + up For more information, see ifconfig(1M). ▼ To Boot Over the Network using PXE ●...
  • Page 41 10. After the Linux OS install completes, use the BIOS to change the boot device priority to Boot from Hard Disk in order to boot up the newly installed OS. Unless the boot device priority is changed, the OS installation process will repeat. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 42: Configuring The Driver Parameters

    C H A P T E R Configuring the Driver Parameters The ixgbe device driver controls the Sun 10GbE SFP+ PCIe ExpressModule interfaces. You can manually set the ixgbe device driver parameters to customize each device in your system. This chapter lists the available device driver parameters and describes how you can set these parameters.

  • Page 43: Driver Parameters For Solaris

    Allowed values: 1 to 64 (default = 1) rx_queue_number Queues The number of the receive descriptors per Transmit/ tx/rx/queue: receive queue Receive rx_ring_size Queues Allowed values: 64 to 4096 (default = 512) Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 44: Setting Ixgbe Driver Parameters In Solaris

    Setting ixgbe Driver Parameters in Solaris ▼ To set driver parameters using the ixgbe.conf file 1. Obtain the hardware path names for the ixgbe devices in the device tree. Check the /etc/driver_aliases file to identify the name associated with a particular device.

  • Page 45: Improving Performance In Solaris

    ▼ To improve performance in the case of large numbers of connections and packets 1. Add the following lines to the /etc/system file: set ddi_msix_alloc_limit=9 set pcplusmp:apic_multi_msi_max=9 set pcplusmp:apic_msix_max=9 set pcplusmp:apic_intr_policy=1 set ip:ip_soft_rings_cnt=4 set ip_squeue_soft_ring=1 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 46: Driver Parameters For Linux Systems

    2. Set the rx_queue number to 8 in the /kernel/drv/ixgbe.conf file: rx_queue_number = 8; 3. Reboot the server. Driver Parameters for Linux Systems lists the tunable ixgbe driver parameters for Linux operating systems and TABLE 5-2 describes their function. Tunable ixgbe Driver Parameters for Linux Operating Systems TABLE 5-2 Keyword Valid Range...

  • Page 47: Setting Ixgbe Driver Parameters In Linux Systems

    Use the ifconfig command to increase MTUs to allow transmission of Jumbo Frames. For example, where the IP address for eth7 is 192.1.1.200, the following command increases MTUs to the maximum: # ifconfig eth7 192.1.1.200 mtu 15000 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 48: Configuring Link Aggregation

    C H A P T E R Configuring Link Aggregation This chapter describes how to configure link aggregation. It contains the following sections: “Link Aggregation Overview” on page 31 ■ “Configuring Link Aggregation in a Solaris Environment” on page 32 ■...

  • Page 49: Configuring Link Aggregation In A Solaris Environment

    No mode is specified for the link aggregation group in this example: # dladm create-aggr -d ixgbe2 -d ixgbe3 2 # ifconfig aggr2 plumb # ifconfig aggr2 193.2.2.84 up Note – These commands change the contents of the /etc/aggregation.conf file. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 50: To Display Information About Link Aggregations

    ▼ To Display Information About Link Aggregations The ifconfig and dladm commands provide different details about link aggregations, as in the following examples. For additional command options, see the man pages for ifconfig (1M) and dladm (1M). 1. Use the ifconfig command to examine the details about a link aggregation:. The following examples display the information about the two link aggregations created in “To Configure Link Aggregations”...
  • Page 51 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 52: Configuring Vlans

    C H A P T E R Configuring VLANs This chapter describes how to configure virtual local area networks (VLANs). This chapter contains the following sections: “VLAN Overview” on page 35 ■ “Configuring VLANs” on page 38 ■ “Configuring Bonding for Multiple Interfaces” on page 42 ■...
  • Page 53 The example network has the following features: The physical LAN network consists of a switch, two servers, and five clients. The LAN is logically organized into three different VLANs, each representing a different IP subnet. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 54 VLAN 1 is an IP subnet consisting of the Main Server, Client 3, and Client 5. This ■ represents an engineering group. VLAN 2 includes the Main Server, Clients 1 and 2 by means of a shared media ■ segment, and Client 5. This is a software development group. VLAN 3 includes the Main Server, the Accounting Server, and Client 4.

  • Page 55: Configuring Vlans

    VLAN tagging for the switch port is turned off. Note – If you configure a VLAN virtual device for an Ethernet adapter, all traffic sent or received by that Ethernet adapter must be in VLAN-tagged format. Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 56: To Configure Static Vlans In A Solaris Environment

    ▼ To Configure Static VLANs in a Solaris Environment 1. Create one /etc/hostname.ixgbe# file for each VLAN that will be configured for each adapter on the server. Use the following naming format, which includes both the VID and the physical point of attachment (PPA): VLAN logical PPA = 1000 * VID + Device PPA 123000 = 1000*123 + 0...

  • Page 57: To Configure Vlans In A Linux Environment

    Note – In Linux systems, you can use any single digit as the VID. 4. Configure the ixgbe VLAN (eth2 in this example): # ifconfig eth6.5 xxx.xxx.xx.xxx up where = the IP address of the interface. xxx.xxx.xx.xxx Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 58: To Configure Vlans In A Microsoft Windows 2003 Environment

    ▼ To Configure VLANs in a Microsoft Windows 2003 Environment 1. Click Control Panel. 2. Click Network Connection. 3. Click the folder icon from the sub-manual bar. 4. Right-click the Sun 10GbE XFP SR PCI Express Card port, then select Properties.

  • Page 59: Configuring Bonding For Multiple Interfaces

    193.2.2.15 netmask 255.255.255.0 broadcast 193.2.2.255 # ifenslave bond1 eth6 eth7 Refer to Linux documentation for more information. ▼ To Remove Bonding ● Use the rmmod command to remove bonding: # rmmod bonding Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 60 Chapter 7 Configuring VLANs...
  • Page 61 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 62: Sun Dual 10Gbe Sfp+ Pcie Expressmodule Specifications

    A P P E N D I X Sun Dual 10GbE SFP+ PCIe ExpressModule Specifications This appendix lists the specifications for Oracle’s Sun 10GbE XFP SR PCI Express Card. This appendix contains the following sections: “Connectors” on page 46 ■ “Table lists the card’s operating range.Technical Features”...

  • Page 63: Connectors

    Connectors shows the connectors for the Sun 10GbE XFP SR PCI Express Card. FIGURE A-1 Sun Dual 10GbE SFP+ PCIe ExpressModule Connectors (unpopulated) FIGURE A-1 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

  • Page 64: Physical Characteristics

    Length 6.62 in. (168.2 mm) Width 4.25 in. (108 mm) Power LED (green) Attention LED (yellow) Attention button (recessed) Activity LED (each port) Green: 10 GbE link Yellow: 1 GbE link Appendix A Sun Dual 10GbE SFP+ PCIe ExpressModule Specifications...

  • Page 65: Power And Environmental Requirements

    35 to 70 °C (95 to 158 °F) module inlet temperature Operating temperature -40 to 70 °C (-40 to 158 °F) Storage temperature 90% noncondensing relative humidity at 35 °C Storage humidity Airflow 2 to 12 CFM Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...
  • Page 66 1 shipping kit contents, 1 software and hardware requirements, 5 specifications, 45 ifconfig command, 39 Sun Dual 10GbE SFP+ PCIe ExpressModule installing the ExpressModule, 16 interfaces, 25 installing the ixgbe driver on Linux platforms, 8 on Windows platforms, 11...
  • Page 67 19 virtual device, 39 VLAN ID (VID), 38 VLAN naming format, 39 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • May 2010...

Table of Contents