Page 1
Dual 10GbE SFP+ PCIe ™ ExpressModule User’s Guide Sun Microsystems, Inc. www.sun.com Part No. 820-4979-10 August 2008, Revision A Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
Page 2
Cette distribution peut comprendre des composants développés par des tierces parties. Sun, Sun Microsystems, le logo Sun, SunSolve, Sun Fire, et Solaris sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc., ou ses filiales, aux Etats-Unis et dans d’autres pays.
Contents Preface xv Sun Dual 10GbE SFP+ PCIe ExpressModule Overview 1 Shipping Kit Contents 1 ExpressModule Hardware Overview 1 ExpressModule Features 2 Indicator Lights on the ExpressModule 3 Hardware and Software Requirements 5 Patch Requirements 5 Patches and Updates 6 Installing and Setting Up the Device Driver Software 7 Downloading and Installing the Driver on a Linux Platform 7 ▼...
Page 4
Installing an Optical Transceiver 13 ▼ To Install an Optical Transceiver 13 Installing the ExpressModule 16 ▼ To Install the ExpressModule With the Power Off 16 Verifying the Installation 19 ▼ To Verify the Installation in a Linux System 19 ▼...
Page 5
Physical Characteristics 37 Power and Environmental Requirements 38 Index 39 Contents...
Page 6
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
Operation of this equipment in a residential area is likely to cause harmful interference, in which case the user will be required to correct the interference at his own expense. Modifications: Any modifications made to this device that are not approved by Sun Microsystems, Inc. may void the authority granted to the user by the FCC to operate this equipment.
BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label. T33012 CCC Class A Notice The following statement is applicable to products shipped to China and marked with “Class A” on the product’s compliance label.
The On/Standby switch is in the standby position. Modifications to Equipment Do not make mechanical or electrical modifications to the equipment. Sun Microsystems is not responsible for regulatory compliance of a modified Sun product. Placement of a Sun Product Caution –...
Page 10
Veilleuse – L'interrupteur Marche/Veille est sur la position de veille. Modification du matériel N'apportez aucune modification mécanique ou électrique au matériel. Sun Microsystems décline toute responsabilité quant à la non-conformité éventuelle d'un produit Sun modifié. Positionnement d’un produit Sun Attention –...
Page 11
Wartezustand – Der Ein-/Standby-Netz- schalter befindet sich in der Standby-Position. Modifikationen des Geräts Nehmen Sie keine elektrischen oder mechanischen Gerätemodifikationen vor. Sun Microsystems ist für die Einhaltung der Sicherheitsvorschriften von modifizierten Sun-Produkten nicht haftbar. Gehäuseabdeckung Sie müssen die Abdeckung Ihres Sun-Computersystems entfernen, um Karten, Speicher oder interne Speichergeräte...
Page 12
Modificaciones en el equipo No realice modificaciones de tipo mecánico ni eléctrico en el equipo. Sun Microsystems no se hace responsable del cumplimiento de normativas en caso de que un producto Sun se haya modificado.
This equipment was tested and complies with all the requirements for the CE Mark. This equipment complies with the Restriction of Hazardous Substances (RoHS) directive 2002/95/EC. Dennis P. Symanski Worldwide Compliance Office Sun Microsystems, Inc. 4150 Network Circle, MPK15-102 Santa Clara, CA 95054 U.S.A. Tel: 650-786-3255 Fax: 650-786-3723...
Page 14
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
Preface This user’s guide provides hardware and software installation instructions for the Sun™ Dual 10GbE SFP+ PCIe Express Module. This document also describes how to configure the driver software for the ixgbe driver for Linux operating systems and Microsoft Windows Server 2003. These instructions are designed for enterprise system administrators with experience installing network hardware and software.
Chapter 6 explains virtual local area networks (VLANs), and provides configuration instructions and examples. Appendix A Typographic Conventions Typeface AaBbCc123 AaBbCc123 AaBbCc123 * The settings on your browser might differ from these settings. Shell Prompts Shell C shell C shell superuser Bourne shell and Korn shell Bourne shell and Korn shell superuser xvi Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide •...
Related Documentation The documents listed as online are available at: http://docs.sun.com/app/docs/prod/dual.sfp.pcie Application Title Release Notes Sun 10GbE XFP SR PCI Express Card, Sun Dual 10GbE XFP 2 SR PCI Express Card, and Sun Dual 10GbE SFP+ PCIe ExpressModule Release Notes Getting Started Sun Dual 10GbE SFP+ PCIe ExpressModule Getting Started Guide...
Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions. You can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your document with your feedback: Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide, part number 820-4979-10 xviii Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide •...
C H A P T E R Sun Dual 10GbE SFP+ PCIe ExpressModule Overview This chapter describes the Sun 10GbE XFP SR PCI Express Card hardware and software, and includes the following sections: “Shipping Kit Contents” on page 1 ■ “ExpressModule Hardware Overview”...
The ExpressModule is optimized for Intel I/O Acceleration Technology (I/OAT), which is designed to optimize network I/O. The ExpressModule is a high- performance, highly integrated 10 Gigabit Ethernet LAN card with PCIe host interface and fiber LAN connectors on the optical modules. The product conforms to the IEEE 802.3 standard and supports standards for system manageability and power management.
Compatible with x8 standard and low-profile PCI Express slots ■ Support for most network operating systems (NOS) ■ Remote management support ■ Support for SFP+ form factor transceivers ■ RoHS compliant, lead-free technology ■ Intel PROSet Utility for Windows Device Manager ■...
Page 22
Indicator Lights for Each Port on the ExpressModule TABLE 1-1 Label ACT/LINK 10G/1G 10G/1G Two LEDs are on the ExpressModule next to the Attention switch. One LED emits green light, the LED other emits amber light. Each light can be on, off, or blinking. explains the meaning of these lights.
Hardware and Software Requirements Before using the Sun 10GbE XFP SR PCI Express Card, ensure that your system meets the hardware and software requirements in Hardware and Software Requirements TABLE 1-3 Requirements Supported Products Hardware Sun Blade X6220 Server Module Sun Blade X6250 Server Module Sun Blade X6450 Server Module Sun Blade X8420 Server Module...
Patches and Updates Check the Sun Update Connection to ensure that you have the latest recommended patch clusters and security patches. You can download the latest recommended patch clusters and security patches at: http://sunsolve.sun.com/pub-cgi/show.pl?target=patchpage Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
C H A P T E R Installing and Setting Up the Device Driver Software This chapter explains how to install and remove the ixgbe driver on Linux and Microsoft Windows systems. This chapter contains the following sections: “Downloading and Installing the Driver on a Linux Platform” on page 7 ■...
4. Select this option: Download drivers and software 5. Select Linux as the operating system. 6. Locate the following driver and select Download: Network Adapter Driver for 10 GbE PCI-E Based Network Connections for Linux 7. Review and accept the software license agreement. 8.
6. Verify that the ixgbe driver has been successfully installed with this lsmod command: # lsmod | grep ixgbe The output should be similar to the following: ixgbe 7. Check the ixgbe driver version with this modinfo command: # modinfo ixgbe | grep ver For example, the output might be the following: filename: /lib/modules/2.6.18-53.el5/kernel/drivers/net/ixgbe/ixgbe.ko...
Downloading and Installing the Driver on a Microsoft Windows Platform If your system uses the Microsoft Windows Server 2003 operating system, perform the following procedures to download and install the device driver. To Download and Install the Driver on a ▼...
9. Click on the following exe files to install the driver: For a 64-bit driver: PROEM64T.exe ■ For a 32-bit driver: PRO2KXP.exe ■ 10. Follow the instructions in the installation wizard. 11. If the Found New Hardware Wizard screen is displayed, click Cancel. The autorun automatically runs after you have extracted the files.
Page 30
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
The Sun 10GbE XFP SR PCI Express Card requires a short-range optical transceiver in at least one port to create an Ethernet connection. The short-range optical transceiver (part number X5561A-Z) is available from Sun Microsystems. Note – Install the optical transceivers into the ExpressModule before installing the ExpressModule into the system.
Page 32
2. Holding the optical transceiver by the edges, align the transceiver with the slot in the ExpressModule and slide the transceiver into the opening. 3. Applying even pressure at both corners of the transceiver, push the transceiver until it is firmly seated in the slot. 4.
Page 33
5. Repeat Step 1 through Step 4 to install the second optical transceiver. Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver entirely and reinstall it. The handle operates an internal lock. Pulling the handle down can disconnect the optical transceiver, even though it might appear to be connected.
Installing the ExpressModule The following instructions describe the basic tasks required to install the ExpressModule. Refer to your system installation or service manual for detailed ExpressModule installation instructions. Note – To maintain proper cooling for the ExpressModule in your chassis, all ExpressModule slots must be filled with either operating ExpressModules or filler panels.
Page 35
6. Align the ExpressModule with the vacant ExpressModule slot (1 in the following figure). Ensure that the ExpressModule’s indicator lights on the front panel are facing toward you and that the ExpressModule ejector lever on the bottom is fully opened. Chapter 3 Installing the ExpressModule...
Page 36
7. Slide the ExpressModule into the vacant ExpressModule chassis slot until the ejector lever engages and starts to close (2 in the preceding figure). Failure to align the ExpressModule correctly can result in damage with the ExpressModule’s internal connection to the chassis midplane. 8.
Verifying the Installation After you have installed the Sun 10GbE XFP SR PCI Express Card, perform the following tasks to verify the installation. ▼ To Verify the Installation in a Linux System ● Verify the new network interface instances corresponding to the Sun 10GbE XFP SR PCI Express Card: # ifconfig -a | grep eth eth3...
Page 38
2. Click on Network Connection. The Ethernet adapter interfaces labeled as "Intel(R) 82598EB 10 Gigabit AF Dual Port Network Connection" will be displayed at the Network Connection window screen, if the driver is installed successfully. 3. To check the driver version, use the Administration Tool. The minimum Windows Server 2003 driver version is 1.2.22.0.
C H A P T E R Network Configuration This chapter describes how to edit the network host files after the card has been installed on your system. This chapter contains the following section: “Configuring the Network Host Files for Booting Over the Gigabit Ethernet ■...
Page 40
4. Plug the Ethernet cable into the card port. 5. Power on the system. 6. Press the F2 key or the Control-E keys to go to the BIOS. 7. Check and ensure that the boot order of the network devices is higher than the hard drive.
C H A P T E R Configuring the Driver Parameters The ixgbe device driver controls the Sun 10GbE SFP+ PCIe ExpressModule interfaces. You can manually set the ixgbe device driver parameters to customize each device in your system. This chapter lists the available device driver parameters and describes how you can set these parameters.
Driver Parameters for Linux Systems lists the tunable ixgbe driver parameters for Linux operating systems and TABLE 5-1 describes their function. Tunable ixgbe Driver Parameters for Linux Operating Systems TABLE 5-1 Keyword Valid Range 0 to 3 FlowControl (0=none, 1=Rx only, 2=Tx only, 3=Rx and Tx) 64 to 512...
Setting ixgbe Driver Parameters in Linux Systems ▼ To Configure Jumbo Frames Jumbo Frames can support up to 15000 MTU. The default value is 1500 MTU. ● Use the ifconfig command to increase MTUs to allow transmission of Jumbo Frames. For example, where the IP address for eth7 is 192.1.1.200, the following command increases MTUs to the maximum: # ifconfig eth7 192.1.1.200 mtu 15000...
Page 44
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
C H A P T E R Configuring VLANs This chapter describes how to configure virtual local area networks (VLANs). This chapter contains the following sections: “VLAN Overview” on page 27 ■ “Configuring VLANs” on page 30 ■ “Configuring Bonding for Multiple Interfaces” on page 32 ■...
Page 46
VLANs are commonly used to separate groups of network users into manageable broadcast domains, to create logical segmentation of workgroups, and to enforce security policies among each logical segment. Each defined VLAN behaves as its own separate network, with its traffic and broadcasts isolated from the others, increasing the bandwidth efficiency within each logical group.
Page 47
The physical LAN network consists of a switch, two servers, and five clients. The LAN is logically organized into three different VLANs, each representing a different IP subnet. VLAN 1 is an IP subnet consisting of the Main Server, Client 3, and Client 5. This ■...
Configuring VLANs VLANs can be created according to various criteria, but each VLAN must be assigned a VLAN tag or VLAN ID (VID). The VID is a 12-bit identifier between 1 and 4094 that identifies a unique VLAN. For each network interface (ixgbe0, ixgbe1, ixgbe2, and so on), 4094 possible VLAN IDs can be selected for each port.
2. Plumb the Sun 10GbE XFP SR PCI Express Card interface: # ifconfig eth6 xxx.xxx.xx.xxx up where = the IP address of the interface. xxx.xxx.xx.xxx 3. Add the VLAN instance (VID). For example: # vconfig add eth6 5 where eth6 is the interface and 5 is the VID. Note –...
11. Click Subnet Mask. The value 255.255.255.0 is displayed. 12. Click OK. 13. Repeat Step 3 Note – Ensure that the firewall is configured to allow VLAN traffic. Otherwise, the VLAN might not operate properly. Configuring Bonding for Multiple Interfaces To Configure Bonding for Multiple ixgbe ▼...
In this example, two bonds (bond0 and bond1) are configured: # modprobe bonding mode=balance-rr miimon=100 max_bonds=2 # ifconfig bond0 192.2.2.15 netmask 255.255.255.0 broadcast 192.2.2.255 # ifenslave bond0 eth4 eth5 # ifconfig bond1 193.2.2.15 netmask 255.255.255.0 broadcast 193.2.2.255 # ifenslave bond1 eth6 eth7 Refer to Linux documentation for more information.
Page 52
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
A P P E N D I X Sun Dual 10GbE SFP+ PCIe ExpressModule Specifications This appendix lists the specifications for the Sun 10GbE XFP SR PCI Express Card. This appendix contains the following sections: “Connectors” on page 36 ■ “Technical Features”...
Connectors shows the connectors for the Sun 10GbE XFP SR PCI Express Card. FIGURE A-1 Sun Dual 10GbE SFP+ PCIe ExpressModule Connectors FIGURE A-1 Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
Technical Features Performance Specifications TABLE A-1 Feature Data rate supported per port Bus type Bus width Conforms to Ethernet Standard Boot ROM Electromagnetic Interference (EMI) Physical Characteristics Physical Characteristics TABLE A-2 Dimension Length Width Power LED (green) Attention LED (yellow) Attention button (recessed) Activity LED (each port) Appendix A...
Power and Environmental Requirements Card Power Requirements TABLE A-3 Specification Typical power consumption Main host power supply Operating temperature Storage temperature Storage humidity Airflow Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008 Measurement 14W (1.17A at 12V) dual port 12 V ±...
Page 57
Index bonding for multiple interfaces, 32 booting over the network on Linux systems, 21 configuring bonding, 32 configuring the network host files, 21 configuring VLANs, 30 in Linux environments, 30 connectors, 36 driver parameters tunable for Linux OS, 24 editing the network host files, 21 Ethernet adapter features, 2 hardware and software requirements, 5 hardware components, 1...
Page 58
Sun Dual 10GbE SFP+ PCIe ExpressModule User’s Guide • August 2008...
Need help?
Do you have a question about the 5945532 and is the answer not in the manual?
Questions and answers