Sun Microsystems Dual XFP User Manual
  1. Manuals
  2. Brands
  3. Sun Microsystems Manuals
  4. PCI Card
  5. Dual XFP
  6. User manual
Sun Microsystems Dual XFP User Manual

Sun Microsystems Dual XFP User Manual

10gbe pci express card
Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
Sun
Dual 10GbE XFP PCI Express
™
Card User's Guide
Sun Microsystems, Inc.
www.sun.com
Part No. 820-0184-13
January 2009, Revision A
Submit comments about this document at:
http://www.sun.com/hwdocs/feedback

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Dual XFP and is the answer not in the manual?

Questions and answers

Related Manuals for Sun Microsystems Dual XFP

Summary of Contents for Sun Microsystems Dual XFP

  • Page 1 Dual 10GbE XFP PCI Express ™ Card User’s Guide Sun Microsystems, Inc. www.sun.com Part No. 820-0184-13 January 2009, Revision A Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
  • Page 2 Etats - Unis et dans les autres pays. Sun, Sun Microsystems, le logo Sun, SunVTS, et Solaris sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays.

  • Page 3: Table Of Contents

    Contents Preface xiii Product Overview 1 Components 1 Product Description 1 Hardware and Software Requirements 2 Features 3 Installing and Setting Up the Driver 5 Downloading and Installing the Driver on a Solaris SPARC or x86 Platform 5 ▼ To Download the Driver on a Solaris Platform 5 ▼...
  • Page 4 ▼ To Verify the Hardware Installation 18 Rebooting the System 20 Network Configuration 21 Configuring the Network Host Files 21 Setting Up a 10-Gigabit Ethernet Network on a Diskless Client System 23 ▼ To Set Up a 10-Gigabit Ethernet Port on a Diskless Client 24 Installing the Solaris Operating System Over a 10-Gigabit Ethernet Network 25 ▼...
  • Page 5 ▼ To Set Parameters Using the ethtool Utility 44 ▼ To Set Parameters Using the Bundled configtool Utility 48 Tuning for Maximum Performance on a Linux Platform 49 Configuring the Jumbo Frames Feature 51 Jumbo Frames Overview 51 Checking Jumbo Frames Configurations 51 ▼...
  • Page 6 Specifications 71 Connectors 71 Performance Specifications 72 Physical Characteristics 73 Power Requirements 73 Diagnostic Software 75 SunVTS Diagnostic Software 75 Updating SunVTS to Recognize the Adapter 76 ▼ To Update SunVTS to Recognize the Adapter 76 Using the SunVTS netlbtest 77 ▼...
  • Page 7 Tables Hardware and Software Requirements for Sun SPARC and X64 Servers 2 TABLE 1-1 XFP Connector Characteristics 72 TABLE A-1 Performance Specifications 72 TABLE A-2 Physical Characteristics 73 TABLE A-3 Low-Profile Power Requirements 73 TABLE A-4 SunVTS Documentation 76 TABLE B-1...
  • Page 8 viii Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...
  • Page 9 Figures Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter 2 FIGURE 1-1 Example of Servers Supporting Multiple VLANs With Tagging Adapters 68 FIGURE 8-1 Ethernet Tag Header Format 70 FIGURE 8-2 Sun x8 Express Dual 10 Gigabit Ethernet XFP Low Profile Adapter Connectors 73 FIGURE A-1...
  • Page 10 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 11: Declaration Of Conformity

    DATE Donald Cameron DATE Worldwide Compliance Engineering Program Manager/Customer Quality Sun Microsystems, Inc. Sun Microsystems Scotland, Limited 4150 Network Circle, MPK15-102 Blackness Road, Phase I, Main Bldg. Santa Clara, CA 95054 U.S.A. Springfield, EH49 7LR Tel: 650-786-3255 Scotland, United Kingdom...
  • Page 12 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 13: Preface

    Preface This guide provides instructions for installing both the hardware and software for the Sun Dual 10GbE XFP PCI Express card. This manual also describes how to configure the nxge driver, which controls the card. These instructions are designed for enterprise system administrators with experience installing network hardware and software.
  • Page 14 Chapter 6 describes how to configure the Jumbo Frame feature. Chapter 7 describes how to configure link aggregation. Chapter 8 explains Virtual Local Area Networks (VLANs) in detail and provides configuration instructions and examples. Appendix A lists the specifications for the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter.

  • Page 15: Typographic Conventions

    Shell Prompts Shell Prompt C shell machine-name% C shell superuser machine-name# Bourne shell and Korn shell Bourne shell and Korn shell superuser Typographic Conventions Typeface Meaning Examples The names of commands, files, Edit your.login file. AaBbCc123 and directories; on-screen Use ls -a to list all files. computer output % You have mail.

  • Page 16: Related Documentation

    Related Documentation The documents listed as online are available at: http://www.sun.com/documentation/ Application Title Part Number Format Location Release Notes Sun x8 Express Dual 10 Gigabit Ethernet XFP Low 820-0185 Online Profile Adapter Release Notes HTML Safety and Safety and Compliance Manual 816-7190 Online compliance...
  • Page 17 Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions. You can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your document with your feedback: Sun Dual 10GbE XFP PCI Express Card User’s Guide, part number 820-0184-13 Preface xvii...
  • Page 18 xviii Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 19: Product Overview

    C H A P T E R Product Overview This chapter provides an overview of the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter, including: “Components” on page 1 ■ “Product Description” on page 1 ■ “Hardware and Software Requirements”...

  • Page 20: Hardware And Software Requirements

    Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter FIGURE 1-1 Hardware and Software Requirements Before installing the adapter, make sure your system meets the hardware and software requirements. lists the supported hardware and software. TABLE 1-1 Hardware and Software Requirements for Sun SPARC and X64 Servers TABLE 1-1 Requirements...

  • Page 21: Features

    Features The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter provides the following features: Two full-duplex 10 gigabit Ethernet interface that use a 10 gigabit Ethernet small ■ form factor pluggable (XFP), optical transceiver with duplex LC fiber connector IEEE 802.3ae 2002 compliant ■...
  • Page 22 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 23: Installing And Setting Up The Driver

    C H A P T E R Installing and Setting Up the Driver This chapter explains how to download and install the nxge driver. The nxge gigabit Ethernet driver (nxge(7D)) is a multi-threaded, loadable, clonable, GLD-based STREAMS driver. The nxge driver is managed by the dladm(1M) command line utility, which allows VLANs to be defined on top of nxge instances and for nxge instances to be aggregated.
  • Page 24 2. Uncompress the gzipped tar file: # gunzip nxge.tar.gz 3. Unpack the tar file: # tar xvf nxge.tar a. For SPARC systems, change to the following directory: # cd 10_GigabitEthernet/Solaris_10/sparc/Packages b. For x86 systems: # cd 10_GigabitEthernet/Solaris_10/i386/Packages 4. For SPARC systems, determine which architecture your system is running: # uname -m a.

  • Page 25: Installing And Setting Up The Driver

    5. For x86 systems, install the software packages by typing the following at the command line: # /usr/sbin/pkgadd -d A menu similar to the following displays: The following packages are available: 1 SUNWnxge Sun PCI-E 10G/1G Ethernet Adapter Driver (i386) 1.0,REV=2006.12.05.10.0 Select package(s) you wish to process (or ’all’...

  • Page 26: To Remove The Driver From A Solaris Platform

    7. Verify that the nxge driver is installed on the system: Sun PCI-E 10G/1G Ethernet Adapter Driver(i386) 1.0,REV=2006.12.05.10.0 Copyright 2006 Sun Microsystems, Inc. All rights reserved. Use is subject to license terms. ## Executing checkinstall script. Using as the package base directory.

  • Page 27: Downloading And Installing The Driver On A Linux Platform

    Downloading and Installing the Driver on a Linux Platform 1. Login to your system. 2. Download the driver RPM for your operating system: http://www.sun.com/download/products.xml?id=44eb1efd For example: nxge-1.0-1.x86_64.rpm 3. Discover the network interfaces before adding the package by using the ifconfig -a command: # ifconfig -a |grep eth eth0 Link encap:Ethernet...
  • Page 28 Note – In RHEL5.0 and later releases, the driver is packaged in the kmod driver binary package format. This packaging allows forward and backward driver binary compatibility within the same flavors of RHEL5 releases. Driver packages nxge version 2.0.0 and later are not compatible with the earlier nxge-1.x-x releases. To upgrade from 1.x-x to 2.x.x rpm package, it is necessary to remove nxge-1.x- x package before installing the 2.x.x package.

  • Page 29: To Remove The Driver From A Linux Platform

    7. Use the ethtool command to check the parameter configurations that apply to the nxge driver. (For 10G) # ethtool -i eth4 driver: nxge version: 2.0.1 firmware-version: 2XGF PXE1.47 FCode 3.9 07/04/24 bus-info: 0000:84:00.0 (Equivalent for 1G) # ethtool -i eth4 driver: nxge version: 2.0.1 firmware-version: QGC PXE1.47 FCode 3.9 07/04/24...
  • Page 30 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 31: Installing The Adapter

    C H A P T E R Installing the Adapter This chapter describes how to install the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter in your system and verify that it has been installed correctly. This chapter contains the following section: “Installing the Adapter”...

  • Page 32: To Install The Adapter

    Adapter in slot-2 of a Sun Fire T2000 system. The SATA cables from the adjacent card slot prevent the proper installation of an Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter in this slot. (Note that this issue does not exist for Sun Fire T2000 that is RoHS compliant.) Caution –...
  • Page 33 Note – These illustrations show the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter being installed into a Sun Fire T2000, which requires a standard height bracket for the low profile adapter. 6. Open the retaining clip at the edge of the PCI-E opening. 7.
  • Page 34 9. Secure the retaining clip Caution – Do not use excessive force when installing the adapter into the PCI-E slot. You might damage the adapter’s PCI connector. If the adapter does not seat properly when you apply even pressure, remove the adapter and carefully reinstall 10.

  • Page 35: Installing An Optical Transceiver

    The Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter requires an optical transceiver in each port to create and Ethernet connection. The short-range optical transceiver Part Number: 135-1172-01 and the long-range optical transceiver Part Number: 375-3495-01 are both available from Sun Microsystems. Chapter 3 Installing the Adapter...

  • Page 36: To Install An Optical Transceiver

    To Install an Optical Transceiver ▼ 1. Pull the white locking handle into the full horizontal position. You will feel the handle click into position when it is fully opened. Note – If you are installing an optical transceiver in a SunFire T1000, ensure that the label and the edge connector is visible to you.
  • Page 37 4. Push the handle closed to lock the optical transceiver in place. Step 1 Step 4 5. Repeat through to install the second optical transceiver 6. Detach the wrist strap. Caution – If you pull the locking handle down when the optical transceiver is installed, remove the optical transceiver entirely and reinstall it.

  • Page 38: Verifying The Hardware Installation

    7. Connect the Ethernet cables. Verifying the Hardware Installation After you have installed the Sun 10-Gigabit Ethernet adapter, but before you boot your system, perform the following tasks to verify the installation. Refer to the your Solaris documentation for the detailed instructions. Note –...
  • Page 39 3. View the device that you installed. Using the previous example, type: ok cd /pci@7c0/pci@0/pci@8/network@0,1 4. Use the .properties command to display a list of device properties. The .properties command displays the specific information about the device. If you are using the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter, your output will be similar to the following: ok .properties assigned-addresses...

  • Page 40: Rebooting The System

    5. Type the following when you finish looking at the .properties values: ok device-end Rebooting the System After verifying the adapter installation, use the boot -r command to perform a reconfiguration boot on your system. ok boot -r Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 41: Network Configuration

    C H A P T E R Network Configuration This chapter describes how to edit the network host files after the adapter has been installed on your system. This chapter contains the following sections: “Configuring the Network Host Files” on page 23 ■...
  • Page 42 1. At the command line, use the grep command to search the /etc/path_to_inst file for nxge interfaces. # grep nxge /etc/path_to_inst # "/pci@7c0/pci@0/pci@9/network@0" 0 "nxge" # "/pci@7c0/pci@0/pci@9/network@0,1" 1 "nxge" In this example, the device instance is from a Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter installed in slot 1.

  • Page 43: Setting Up A 10-Gigabit Ethernet Network On A Diskless Client System

    The host name must be different from any other host name of any other interface, ■ for example: /etc/hostname.nxge0 and /etc/hostname.nxge1 cannot share the same host name. The following example shows the /etc/hostname.nxgenumber file required for a system called zardoz that has a Sun x4 PCI-Express Gigabit Ethernet driver (zardoz-11).

  • Page 44: To Set Up A 10-Gigabit Ethernet Port On A Diskless Client

    To Set Up a 10-Gigabit Ethernet Port on a ▼ Diskless Client 1. Locate the root directory of the diskless client on the host server. The root directory of diskless client system is commonly installed in the host server’s /export/root/client-name directory, where client_name is the diskless client’s host name.

  • Page 45: Installing The Solaris Operating System Over A 10-Gigabit Ethernet Network

    Installing the Solaris Operating System Over a 10-Gigabit Ethernet Network The Solaris Advanced Installation Guide describes the full procedure for installing the Solaris Operating System over the network. The following procedure assumes that you have created an install server, which contains the image of the Solaris CD, and that you have set up the client system to be installed over the network.
  • Page 46 2. Find the root directory of the client system. The client system’s root directory can be found in the install server’s /etc/bootparams file. Use the grep command to search this file for the root directory. # grep client-name /etc/bootparams client_name root=server-name:/netinstall/Solaris_10/Tools/Boot install=server-name:/netinstall boottype=:in rootopts=:rsize=32768 In this example, the root directory for the Solaris 10 client is /netinstall.
  • Page 47 5. Shut down and halt the client system. Use the shutdown command to go to the OpenBoot (ok) prompt. # shutdown -i0 -g0 -y . . . (shutdown command messages omitted) . . . 6. At the ok prompt, use the show-nets command to find the device path of the 10- Gigabit Ethernet device.
  • Page 48 9. After installing the Solaris Operating System, install the Sun x8 Dual 10 Gigabit Ethernet software on the client system. The software installed in Step 4 is required to boot the client system over the 10- Gigabit Ethernet interface. You now need to install the software in order for the operating system to use the client’s 10-Gigabit Ethernet interfaces in normal operation.

  • Page 49: Booting Over The 10-Gigabit Ethernet Network For Solaris X86 And Linux Systems

    Booting Over the 10-Gigabit Ethernet Network for Solaris x86 and Linux Systems To Boot Over the Network on Solaris x86 and ▼ Linux Systems 1. Obtain the MAC address from the target Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter. 2.
  • Page 50 9. Press the F10 key to save the boot configuration changes and exit. System should reboot after saving the boot configuration. Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...
  • Page 51 10. Press the F12 key to install the OS from the network. If the cable is connected to the right port, you should see the MAC address that you assigned to your PXE server displayed by BIOS. image : pxe-mac-addr PXE-E61: Media test failure, check cable PXE-MOF: Exiting Intel Boot Agent.
  • Page 52 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 53: Configuring The Nxge Device Driver Parameters

    C H A P T E R Configuring the nxge Device Driver Parameters The nxge device driver controls the Sun x8 Express Dual 10 Gigabit Ethernet interfaces. You can manually set the nxge driver parameters to customize each device in your system. This chapter lists the available device driver parameters and describes how you can set these parameters.

  • Page 54: Setting Nxge Driver Parameters On A Solaris Platform

    processing. The Sun 10-Gigabit Ethernet Adapter utilizes Sun’s own innovative MAC Controller to map the 10-Gigabit XAUI interface onto the PCI Express form factor. It supports 10 Gb/sec bandwidth using eight transmit and eight receive lanes. Setting nxge Driver Parameters on a Solaris Platform You can set the nxge device driver parameters in two ways: Using the ndd utility...

  • Page 55: To Specify Device Instances For The Ndd Utility

    To Specify Device Instances for the ndd Utility ▼ Before you use the ndd utility to get or set a parameter for a nxge device, you must specify the device instance for the utility. 1. Check the /etc/path_to_inst file to identify the instance associated with a particular device.

  • Page 56: Setting Parameters Using The Nxge.conf File

    After you enter the parameter name, the ndd utility prompts you for the parameter value. 2. To list all the parameters supported by the nxge driver, type ?. # ndd /dev/nxge1 name to get/set ? (read only) function_number (read only) adv_autoneg_cap (read and write) adv_10gfdx_cap...

  • Page 57: To Set Driver Parameters Using An Nxge.conf File

    To Set Driver Parameters Using an nxge.conf ▼ File 1. Obtain the hardware path names for the nxge devices in the device tree. a. Check the /etc/driver_aliases file to identify the name associated with a particular device: # grep nxge /etc/driver_aliases nxge "pciex108e,abcd"...
  • Page 58 apply only to 10gigabit ports. Half duplex is not supported on any NIU card. adv-autoneg-cap Advertise auto-negotiation capability. default is 1 # adv-autoneg-cap = 1; adv_10gfdx_cap Advertise 10gbps Full duplex capability. default is 1 # adv_10gfdx_cap = 1; adv_1000fdx_cap Advertise 1gbps Full duplex capability.
  • Page 59 #------- Receive DMA Configuration ---------------------------- rxdma-intr-time Interrupts after this number of NIU hardware ticks have elapsed since the last packet was received. A value of zero means no time blanking (Default = 8). # rxdma-intr-pkts Interrupt after this number of packets have arrived since the last packet was serviced.
  • Page 60 b. The following parameters operate on a per port basis and can be set using the /platform/sun4u/kernel/drv/nxge.conf file. # ------- How to set parameters for a particular interface -------- # The example below shows how to locate the device path and set a # parameter for a particular nxge interface.

  • Page 61: Tuning For Maximum Performance On A Solaris Platform

    d. The following example shows ports on two different cards being set. Only one node needs to be specified. name = "pciex108e,abcd" parent = "/pci@780/pci@0/pci@8/" unit-address = "0" class-opt-ipv4-tcp = 0x100; name = "pciex108e,abcd" parent = "/pci@7c0/pci@0/pci@9/" unit-address = "0" class-opt-ipv4-tcp = 0x40;...

  • Page 62: To Improve Performance On An Amd Cpu Based Sun Platform

    3. Add the following to a startup script, or use ndd before plumbing the interface: ndd -set /dev/ip ip_soft_rings_cnt 8 Utilizing more soft-rings provided by the Solaris TCP/IP stack significantly improves bulk throughput for Rx. The default number of soft-rings is 2, but changing it to 8 improves performance.

  • Page 63: To Obtain Higher Throughput Using The Generic Tunables For The Solaris Tcp/Ip Stack

    To Obtain Higher Throughput Using the Generic ▼ Tunables for the Solaris TCP/IP Stack ● To obtain higher throughput, add the following to a startup script: ndd -set /dev/tcp tcp_conn_req_max_q 8192 ndd -set /dev/tcp tcp_conn_req_max_q0 8192 ndd -set /dev/tcp tcp_max_buf 4194304 ndd -set /dev/tcp tcp_cwnd_max 2097152 ndd -set /dev/tcp tcp_recv_hiwat 400000 ndd -set /dev/tcp tcp_xmit_hiwat 400000...

  • Page 64: Setting Parameters On A Linux Platform

    Setting Parameters on a Linux Platform ▼ To Set Parameters Using the ethtool Utility 1. Determine which parameters are available using the ethtool utility: # ethtool -help eth4 ethtool version 1.8 Usage: ethtool DEVNAME ethtool -a DEVNAME ethtool -A DEVNAME \ [ autoneg on|off ] \ [ rx on|off ] \ [ tx on|off ]...
  • Page 65 ethtool -G DEVNAME \ [ rx N ] \ [ rx-mini N ] \ [ rx-jumbo N ] \ [ tx N ] ethtool -i DEVNAME ethtool -d DEVNAME ethtool -e DEVNAME \ [ raw on|off ] \ [ offset N ] \ [ length N ] ethtool -E DEVNAME \ [ magic N ] \...
  • Page 66 Following are some common parameters that can be changed: # ethtool -c eth8 Coalesce parameters for eth8: Adaptive RX: off TX: off stats-block-usecs: 0 sample-interval: 0 pkt-rate-low: 0 pkt-rate-high: 0 rx-usecs: 8 rx-frames: 512 rx-usecs-irq: 0 rx-frames-irq: 512 tx-usecs: 0 tx-frames: 0 tx-usecs-irq: 0 tx-frames-irq: 0...
  • Page 67 2. To change RX interrupt Coalesce parameters use the ethtool -C command: # ethtool -C eth4 rx-usecs 20 # ethtool -c eth4 Coalesce parameters for eth4: Adaptive RX: off TX: off stats-block-usecs: 0 sample-interval: 0 pkt-rate-low: 0 pkt-rate-high: 0 rx-usecs: 20 rx-frames: 512 rx-usecs-irq: 0 rx-frames-irq: 512...

  • Page 68: To Set Parameters Using The Bundled Configtool Utility

    To Set Parameters Using the Bundled ▼ configtool Utility 1. To get a list of tunable parameters, use the nxge_config if_name get command: # /usr/local/bin/nxge_config eth4 get The tunable parameters exported by this device are: class_opt_ipv4_tcp Read-Write class_opt_ipv4_udp Read-Write class_opt_ipv4_ah Read-Write class_opt_ipv4_sctp Read-Write...

  • Page 69: Tuning For Maximum Performance On A Linux Platform

    3. To set a particular variable, use the /usr/local/bin/nxge_config if_name set param_name value: # /usr/local/bin/nxge_config eth4 set class_opt_ipv4_tcp 0xfe0 Tuning for Maximum Performance on a Linux Platform The following tunings will improve the performance of the Sun x8 Express Dual 10 Gigabit Ethernet device driver on a system running the Linux operating system.
  • Page 70 2. Set up the sysctl utility. # sysctl -p /etc/sysctl_nxge.conf Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 71: Configuring The Jumbo Frames Feature

    C H A P T E R Configuring the Jumbo Frames Feature This chapter describes how to configure the Jumbo Frames feature. It contains the following sections: “Jumbo Frames Overview” on page 53 ■ “Checking Jumbo Frames Configurations” on page 53 ■...

  • Page 72: To Show The Driver Statistics In A Solaris Environment

    To Show the Driver Statistics in a Solaris ▼ Environment 1. Use the kstat command to display driver statistics, for example: # kstat nxge:1 |grep rdc_packets rdc_packets 798982054 rdc_packets 792546171 rdc_packets 803941759 rdc_packets 805674872 rdc_packets 798714912 rdc_packets 799293256 rdc_packets 806470537 rdc_packets 805413540 The previous example diplays the receive packet counts on all of the eight Receive...

  • Page 73: Enabling Jumbo Frames In A Solaris Environment

    2. Use the kstat command to display driver statistics of a VLAN interface, for example:. # kstat nxge:38001 module: nxge instance: 38001 name: nxge38001 class: brdcstrcv brdcstxmt collisions crtime 3842.493000352 ierrors ifspeed 10000000000 ipackets 2116069805 ipackets64 6411037101 multircv multixmt norcvbuf noxmtbuf obytes 2757388874...

  • Page 74: To Enable Jumbo Frames In A Solaris Environment Using Nxge.conf

    To Enable Jumbo Frames in a Solaris ▼ Environment Using nxge.conf 1. Enable Jumbo Frames for a port using the nxge.conf file. For example, name = "pciex108e,abcd" parent = "/pci@780/pci@0/pci@8/network@0" unit-address = "0" accept-jumbo=1; 2. Reboot the system: % boot -r 3.

  • Page 75: To Check Layer 3 Configuration

    To Check Layer 3 Configuration ▼ ● Check the Layer 3 configuration by using the dladm command with the show-link option, as shown in the following example: # dladm show-link e1000g0 type: non-vlan mtu: 1500 device: e1000g0 e1000g1 type: non-vlan mtu: 1500 device: e1000g1 e1000g2...

  • Page 76: To Show The Driver Statistics In A Linux Environment

    3. Set the MTU for maximum performance: # ifconfig ethx mtu 9194 Where x is the instance number of the interface you want to configure jumbo frames To Show the Driver Statistics in a Linux ▼ Environment 1. Use the ifconfig utility to display driver statistics, for example: # ifconfig eth4 eth9 Link encap:Ethernet...
  • Page 77 3. To get more specific statitics, use the grep command on the output of ethtool -S: # ethtool -S eth9 |grep tx_pac tx_packets: 8645339 tx_packets: 3418334 tx_packets: 26 tx_packets: 0 tx_packets: 22 tx_packets: 401791 tx_packets: 1466540 tx_packets: 0 tx_packets: 21 tx_packets: 725 tx_packets: 3357880 tx_packets: 0...
  • Page 78 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 79: Configuring Link Aggregation

    C H A P T E R Configuring Link Aggregation This chapter describes how to configure link aggregation. It contains the following sections: “Overview of Link Aggregation” on page 61 ■ “Configuring Link Aggregation in a Linux Environment” on page 64 ■...

  • Page 80: To Configure Link Aggregation In A Solaris Environment

    To Configure Link Aggregation in a Solaris ▼ Environment 1. Aggregate nxge0 and nxge1 to form an aggregation and a random number 33 as key. a. Unplumb the interfaces to be aggregated: # ifconfig down unplumb nxge0 # ifconfig down unplumb nxge1 b.
  • Page 81 2. Plumb up the interface aggrkey, which is aggr33 is this case: # ifconfig aggr33 plumb # ifconfig aggr33 aggr33: flags=1000842<BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 8 inet 0.0.0.0 netmask 0 ether 0:3:ba:d8:9d:e8 # ifconfig aggr33 192.168.1.1/24 broadcast + up # ifconfig aggr33 aggr33: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4>...

  • Page 82: Configuring Link Aggregation In A Linux Environment

    5. Use the dladm show-aggr -L command to display LACP specific information: # dladm show-aggr -L key: 33 (0x0021) policy: L4 address: 0:3:ba:d8:9d:e8 (auto) LACP mode: off LACP timer: short device activity timeout aggregatable sync coll dist defaulted expired nxge0 passive short nxge1...
  • Page 83 3. Configure bond0 interface. In this example, bond0 is the master of the two interfaces eth4 and eth5. # ip addr add 192.12.38.64/24 brd + dev bond0 # ip link set dev bond0 up # ifenslave bond0 eth4 eth5 Chapter 7 Configuring Link Aggregation...
  • Page 84 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 85: Configuring Vlans

    C H A P T E R Configuring VLANs This chapter explains Virtual Local Area Networks (VLANs) in detail and provides configuration instructions and examples. It contains the following sections: “Overview of VLANs” on page 67 ■ “Configuring VLANs in a Solaris Environment” on page 69 ■...
  • Page 86 Main Server Accounting Adapter Server Gigabit/Tagged (VLAN 3) (All VLANs) VLAN 1 VLAN 2 VLAN 3 Shared Media Segment Software Software Engineering Accounting Engineering/ PC 1 PC 2 PC 3 PC 4 Software PC 5 (VLAN 2) (VLAN 2) (VLAN 1) (VLAN 3) Adapter Gigabit/Tagged...

  • Page 87: Configuring Vlans In A Solaris Environment

    The Main Server is a heavily used server that needs to be accessed from all VLANs and IP subnets. The server has a Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter installed. All three IP subnets are accessed by means of the single physical adapter interface.

  • Page 88: To Configure Static Vlans

    Tagging an Ethernet frame requires the addition of a tag header to the frame. The header is inserted immediately following the destination MAC address and the Source MAC address. The tag header consists of two bytes of Ethernet Tag Protocol identifier (TPID, 0x8100) and two bytes of Tag Control Information (TCI).

  • Page 89: Configuring Vlans In A Linux Environment

    2. Use the ifconfig(1M) to configure a VLAN virtual device, for example: # ifconfig nxge123000 plumb up # ifconfig nxge224000 plumb up The output of ifconfig -a on a system having VLAN devices nxge123000 and nxge224000: # ifconfig -a lo0: flags=1000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4> mtu 8232 index 1 inet 127.0.0.1 netmask ff000000 hme0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4>...
  • Page 90 2. Plumb the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter interface: # ifconfig eth2 xxx.xxx.xx.xxx up where xxx.xxx.xx.xxx = the IP address of the interface. 3. Insert the VLAN module: # /sbin/modprobe 8021q 4. Add the VLAN instance (VID): # /sbin/vconfig add eth2 5 5.

  • Page 91: Connectors

    A P P E N D I X Specifications This appendix lists the specifications for the Sun x8 Express Dual 10 Gigabit Ethernet Fiber XFP Low Profile Adapter. It contains the following sections: “Connectors” on page 73 ■ “Performance Specifications” on page 74 ■...

  • Page 92: Table A-1 Xfp Connector Characteristics

    lists the characteristics of the fiber connectors used by the Sun x8 Express Dual TABLE A-1 10 Gigabit Ethernet Fiber XFP Low Profile Adapter. XFP Connector Characteristics TABLE A-1 Parameter Description Connector type Distance 10GBase-SR: Depending on fiber quality, up to 300 meters for high bandwidth multimode fiber 10GBase-LR: Depending on fiber quality, 10km maximum Fiber type...

  • Page 93: Table A-3 Physical Characteristics

    Physical Characteristics Physical Characteristics TABLE A-3 Dimension Measurement Length 167.65 mm (6.6 inches) Width 68.90 mm (2.713 inches) Height Component side = 14.48 mm (0.57 inches) maximum Solder side = 2.67 mm (0.105 inches) maximum Power Requirements Low-Profile Power Requirements TABLE A-4 Specification Measurement...
  • Page 94 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 95: Sunvts Diagnostic Software

    A P P E N D I X Diagnostic Software This appendix provides an overview of the SunVTS diagnostic application and instructions for updating the SunVTS software to recognize the adapter. This appendix contains the following sections: “SunVTS Diagnostic Software” on page 77 ■...

  • Page 96: Table B-1 Sunvts Documentation

    http://www.sun.com/products-n-solutions/hardware/docs/Software /system_administration/tools/testing_valid/sunvts/index.html Select the document for the Solaris release on your system. SunVTS Documentation TABLE B-1 Title Description SunVTS User’s Guide Describes the SunVTS diagnostic environment SunVTS Test Reference Manual Describes each SunVTS test (including the nettest) and describes the various test options and command-line arguments SunVTS Quick Reference Provides an overview of the user interface...

  • Page 97: Using The Sunvts Netlbtest

    Using the SunVTS netlbtest You must have the Ethernet card and the device driver installed, a loopback connector in place, and Intervention mode enabled before running netlbtest. netlbtest cannot run if the network interface is connected to a live network, and requires that the Ethernet device be configured offline before running the test.
  • Page 98 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

  • Page 99: Index

    Index Symbols /etc/hostname.nxgenumber file, 24 ndd utility, 37 assigning an IP address, 24 parameter values how to modify and display, 37 configuring the network host files, 23 setting nxge driver parameters configuring VLANs, 69 using ndd using nxge.conf, 36 setting nxge driver parameters, xiii, 35 diskless clients, 25 software documentation...
  • Page 100 Sun Dual 10GbE XFP PCI Express Card User’s Guide • January 2009...

Table of Contents