Contents Using This Documentation vii Understanding the Installation Process 1 Installation Overview (Oracle Solaris 10) 2 Installation Overview (Oracle Solaris 11) 3 Installation Overview (Linux) 4 Installation Overview (Windows) 5 Understanding the Adapter 7 Shipping Kit Contents 8 Product Description 8 Configuration Options 9 Front Panel Connectors and LEDs 11 Physical Characteristics 13...
Page 4
▼ Change the MTU Permanently 48 ▼ Change the MTU Temporarily (Oracle Solaris 10) 48 ▼ Change the MTU Temporarily (Oracle Solaris 11) 49 ▼ Configure Jumbo Frames (Linux) 50 Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 5
Configuring Link Aggregation 51 Link Aggregation Overview 52 ▼ Configure Link Aggregations (Oracle Solaris 10) 52 ▼ Display Information About Link Aggregations (Oracle Solaris 10) 53 ▼ Delete Link Aggregations (Oracle Solaris 10) 54 Configuring VLANs 57 VLAN Overview 58 VLAN Configuration 61 VLAN Naming Format 61 ▼...
Page 6
Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Important: The Sun Dual Port 10GBase-T Adapter was formerly named the Sun Dual Port 10 GbE PCIe 2.0 Low Profile Adapter, Base-T. The former product name might still appear in the product and document. The product name change does not indicate any change in product features or functionality.
10GBase-T Adapter SDP_10GbE-PCIe2.0-LPA_BASE-T Oracle Solaris 10 OS http://docs.oracle.com/cd/E23823_01/index.html Oracle Solaris 11 OS http://docs.oracle.com/cd/E23824_01/index.html Oracle Solaris OS and http://www.oracle.com/technetwork/indexes/documen systems software library tation/index.html#sys_sw Feedback Provide feedback on this documentation at: http://www.oracle.com/goto/docfeedback viii Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 9
Support and Accessibility Description Links Access electronic support http://support.oracle.com through My Oracle Support For hearing impaired: http://www.oracle.com/accessibility/support.html Learn about Oracle’s http://www.oracle.com/us/corporate/accessibility/index.html commitment to accessibility Using This Documentation...
Page 10
Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Understanding the Installation Process These topics provide an overview of the installation process for the Sun Dual Port 10GBase-T Adapter: “Installation Overview (Oracle Solaris 10)” on page 2 ■ “Installation Overview (Oracle Solaris 11)” on page 3 ■ “Installation Overview (Linux)” on page 4 ■...
“Delete Link Aggregations (Oracle Solaris 10)” on page 54 (Optional) Configure VLANs. “VLAN Overview” on page 58 “VLAN Configuration” on page 61 “Configure Static VLANs (Oracle Solaris 10)” on page 62 Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Installation Overview (Oracle Solaris 11) The installation, configuration, and administration of software packages, driver parameters, and network layers have changed in the Oracle Solaris 11 OS. The instructions for these procedures are in Oracle Solaris 11 documentation, located here: http://docs.oracle.com/cd/E23824_01/index.html Follow these steps to install the Adapter on an Oracle Solaris 11 platform.
Installation Overview (Windows) Follow these steps to install the Adapter on a Windows platform. Step Description Links Understand the Adapter. “Understanding the Adapter” on page 7 Install the driver. “Download and Install the Driver (Windows)” on page 22 Install the Adapter. “Install the Adapter”...
Page 16
Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Understanding the Adapter These topics provide an overview of the Sun Dual Port 10GBase-T Adapter. Description Links Understand the Adapter. “Shipping Kit Contents” on page 8 “Product Description” on page 8 “Front Panel Connectors and LEDs” on page 11 “Physical Characteristics” on page 13 “Performance Specifications”...
■ Product Description The Sun Dual Port 10GBase-T Adapter is a 10 GbE NIC for PCIe systems. The adapter offers a high density mutli-port design for Sun racks and blade servers. This adapter addresses the multi-port network connectivity needs of data center environments.
Related Information “Shipping Kit Contents” on page 8 ■ “Front Panel Connectors and LEDs” on page 11 ■ “Physical Characteristics” on page 13 ■ “Performance Specifications” on page 14 ■ “Power and Environmental Requirements” on page 14 ■ “OS Patches and Updates” on page 15 ■...
Related Information “Shipping Kit Contents” on page 8 ■ “Configuration Options” on page 9 ■ “Front Panel Connectors and LEDs” on page 11 ■ “Physical Characteristics” on page 13 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
“Performance Specifications” on page 14 ■ “Power and Environmental Requirements” on page 14 ■ “OS Patches and Updates” on page 15 ■ Front Panel Connectors and LEDs On the front panel, there is one LED dedicated to signal the port speed, state, and activity.
Page 22
Front Face of the Adapter FIGURE: Figure Legend Port 0 Port 1 OVERTEMP LED (unused) Speed LED LNK/ACT (link/activity) Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Color State Meaning Speed None Link is down. Green Steady on 1 GbE Yellow Steady on 10 GbE Link/activity None Link is down. Green Steady on Link is up. Green Blinking Activity on the link. OVERTEMP Not used. Related Information “Shipping Kit Contents”...
-40°C to 70°C (-40°F to 158°F), noncondensing noncondensing Humidity 10% to 90% noncondensing 93% noncondensing relative relative humidity at 27°C humidity at 38°C (100.4°F) (80.6°F) maximum wet bulb maximum wet bulb Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Specification Operation Storage Altitude 3,302 meters (10,833.3 feet) at 12,000 meters (39,370.1 feet) 35°C (95°F) ambient Vibration 0.20 G in all axes (5-500 Hz sine) 1.0 G in all axes (5-500 Hz sine) Shock 5 G (11 ms half-sine) 30 G (11 ms half-sine) Airflow at 55°C (131°F) Related Information...
■ “Front Panel Connectors and LEDs” on page 11 ■ “Physical Characteristics” on page 13 ■ “Performance Specifications” on page 14 ■ “Power and Environmental Requirements” on page 14 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Note – The Oracle Solaris 10 8/10 OS and the Oracle Solaris 11 OS are the first releases to support the Sun Dual Port 10GBase-T Adapter. You can upgrade to or install either one of these releases, but the version of the driver must be the same on both the client system and the server system.
Oracle Solaris 10 10/11 is the first release of the Oracle Solaris 10 OS to support the Sun Dual Port 10GBase-T Adapter. Depending on your version of the Oracle Solaris 10 OS, you might or might not need to download the updated driver.
▼ Verify the Driver Version (Oracle Solaris 11) 1. Check the version of the installed driver. # strings /kernel/drv/arch/ixgbe | grep ixgbe ixgbe 1.1.9 If the version number is not at least 1.1.9, you must install the latest driver, or you can reinstall the OS.
Network Adapter Driver for PCI-E 10 Gigabit Network Connections under Linux 6. Select Download. The download begins. The file named ixgbe-x.x.xx.tar.gz is saved in the ~/Desktop directory of your system. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 31
Note – The primary driver link is a buildable source archive that works with Linux 2.6.x kernels only and requires that the currently running kernel match the SRC RPM kernel files and headers in order to build the driver. See the bundled README file in the unpacked archive from Intel for more information.
(Windows) If your system uses the Windows Server 2003 or 2008 operating system, perform the following procedure to download and install the device driver. 1. Log in to your system. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 33
2. In a browser, go to this location: http://www.intel.com/p/en_US/support/highlights/network/ecna-x 540-t2 3. Select this option: Downloads and Drivers 4. Select one of the following as the operating system: For a 64-bit driver: ■ Windows Server 2003 Standard x64 Edition ■ Windows Server 2008 Standard x64 ■...
2. Select Intel PRO Network Connections Drivers. 3. Click Add/Remove. 4. When the confirmation dialog displays, click OK. Related Information “Download and Install the Driver (Windows)” on page 22 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Installing the Adapter These topics describe how to install the Adapter. Description Links Understand the connectors. “Front Panel Connectors and LEDs” on page 11 Install the Adapter. “Install the Adapter” on page 26 Verify the Adapter installation. “Verify the Installation (Oracle SPARC)” on page 27 “Verify the Installation (Oracle Solaris x86)”...
7. Slide the Adapter face plate into the small slot at the end of the PCIe opening. 8. Applying even pressure at both corners of the Adapter, push the Adapter until it is firmly seated in the slot. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Caution – Do not use excessive force when installing the Adapter into the PCIe slot. You might damage the Adapter’s PCIe connector. If the Adapter does not seat properly when you apply even pressure, remove the Adapter, and carefully reinstall 9.
Page 38
4. Check the .properties output for each device. The following examples assume that /pci@400/pci@2/pci@0/pci@a/network@0,1 is a port on the Adapter. a. Move to the device directory. ok cd /pci@400/pci@2/pci@0/pci@a/network@0,1 Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 39
430f0010 00000000 00000000 00000000 00200000 010f0018 00000000 00000000 00000000 00000020 430f0020 00000000 00000000 00000000 00004000 020f0030 00000000 00000000 00000000 00080000 local-mac-address a0 36 9f 01 2e a0 version Sun Dual Port 10GBase-T Adapter FCode version 3.11 2/25/12 phy-type board-model 701-4776 model ATO:701-4777, PTO:7011-4773 compatible pciex8086,1528.108e.7b15.1...
# grep ixgbe /etc/path_to_inst If the Adapter is properly installed, you should see output similar to the following: “/pci@0,0/pci8086,3c0a@3,2/pci108e,7b15@0” 0 “ixgbe” “/pci@0,0/pci8086,3c0a@3,2/pci108e,7b15@0,1” 1 “ixgbe” Related Information “Install the Adapter” on page 26 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
▼ Verify the Installation (Linux) ● Verify the new network interface instances corresponding to the Adapter. # ifconfig -a | grep eth eth3 Link encap:Ethernet HWaddr 00:1B:21:17:67:B0 eth4 Link encap:Ethernet HWaddr 00:1B:21:17:67:9B Related Information “Install the Adapter” on page 26 ■...
Page 42
Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Configuring the Network These topics describe how to configure the network for the Sun Dual Port 10GBase-T Adapter. Description Links Configure the network for an “Create Driver Instance Files (Oracle Solaris 10)” on Oracle Solaris system. page 34 “Configure the Network Host Files (Oracle Solaris 10)” on page 34 Boot over the network.
/etc/hostname.ixgbe0, where 0 is the number of the ixgbe(7D) interface. If the instance number were 1, the file name would be /etc/hostname.ixgbe1. The /etc/hostname.ixgbe# file must contain the host name for the appropriate ixgbe(7D) interface. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
2. Get the ixgbe(7D) instances. # dladm show-dev The output should include lines similar to the following: ixgbe0 link: up speed: 10000 Mbps duplex: full nge0 link: up speed: 1000 Mbps duplex: full nge1 link: down speed: 0 Mbps duplex: unknown ixgbe1 link: up speed: 10000...
MAC address is the MAC address from the label, plus 1. 2. Set up the PXE boot server with the MAC addresses. 3. Plug the Ethernet cable into the Adapter’s port. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 47
4. Power on the system. 5. Press the F2 key or the Control-E keys to go to the BIOS menu. 6. Go to the Boot - Boot Device Priority screen and ensure that the boot order of the network devices is higher than the hard drive. 7.
2. On the client system, shut down and halt the system to get to the OpenBoot (ok) prompt. # shutdown -i0 -g0 -y. . . (shutdown command messages omitted) . . . Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 49
3. Check the .properties output for each device. The following examples assume that /pci@7c0/pci@0/pci@9/network@0,1 is a port on the Adapter. a. Move to the device directory. ok cd /pci@7c0/pci@0/pci@9/network@0,1 Configuring the Network...
Page 50
00007b15 subsystem-vendor-id 0000108e revision-id 00000001 device-id 00001528 vendor-id 00008086 If you do not see the device listed, check that the Adapter is properly seated. If necessary, reinstall the Adapter. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 51
c. Type the following when you finish looking at the .properties values. ok device-end 4. At the ok prompt, display the device paths. You should see the full paths of all of the network devices, including two for the Adapter similar to this example. ok show-nets a) /pci@7c0/pci@0/pci@9/network@0,1 b) /pci@7c0/pci@0/pci@9/network@0...
Page 52
“Boot Options” on page 35 ■ “Boot Over the Network (PXE)” on page 36 ■ “Boot Over a 10 GbE Network (Oracle Solaris x86 and Linux)” on page 36 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Administering Driver Parameters and Jumbo Frames The ixgbe(7D) device driver controls the Adapter’s interfaces. You can manually set the ixgbe(7D) device driver parameters to customize each device in your system. These topics describe how to administer driver parameters. Description Links Administrate driver parameters “Driver Parameters (Oracle Solaris OS)”...
Allowed values: 64 to 4096 (default = 1024) Related Information “Set Driver Parameters (Oracle Solaris OS)” on page 45 ■ “Configuring Jumbo Frames (Oracle Solaris OS)” on page 48 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
▼ Set Driver Parameters (Oracle Solaris 1. Locate the path names and the associated instance numbers in the /etc/path_to_inst file. For example, on an Oracle SPARC system, you should see output similar to the following: # grep ixgbe /etc/path_to_inst "/pci@500/pci@2/pci@0/pci@a/network@0" 1 "ixgbe" "/pci@500/pci@2/pci@0/pci@a/network@0,1"...
1500 or less, the receive buffer size is 2048 bytes. When the MTU is greater than 1500, the receive buffer size will be either 4056, 8192, or 16384 bytes. The maximum MTU size is 16114. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Keyword Valid Range Default Value Description 0 to 65535 This value delays the generation of receive RxIntDelay interrupts in units of 0.8192 microseconds. (0=off) Receive interrupt reduction can improve CPU efficiency if properly tuned for specific network traffic. Increasing this value adds extra latency to frame reception and can end up decreasing the throughput of TCP traffic.
For example, where the device name is ixgbe0, the following command increases MTUs to the maximum: # ifconfig ixgbe0 plumb mtu 15500 up The temporary setting lasts only until the next reboot of the server. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Related Information “Driver Parameters (Oracle Solaris OS)” on page 44 ■ “Set Driver Parameters (Oracle Solaris OS)” on page 45 ■ “Change the MTU Permanently” on page 48 ■ “Change the MTU Temporarily (Oracle Solaris 11)” on page 49 ■ ▼...
MTUs to the maximum: # ifconfig eth7 192.1.1.200 mtu 15500 up Related Information “Driver Parameters (Linux)” on page 46 ■ “Set Driver Parameters (Linux)” on page 47 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Configuring Link Aggregation These topics describe how to configure link aggregation in the Oracle Solaris 10 OS. For instructions on how to configure link aggregations in the Oracle Solaris 11 OS, refer to Oracle Solaris Administration: Network Interfaces and Network Virtualization in the Oracle Solaris 11 documentation library.
The example in this procedure aggregates sample interfaces ixgbe0, ixgbe1, ixgbe2, and ixgbe3. Arbitrary key numbers (1 and 2) are used for each aggregation. Note – These commands change the contents of the /etc/aggregation.conf file. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
1. Unplumb the interfaces to be aggregated. # ifconfig ixgbe0 unplumb # ifconfig ixgbe1 unplumb # ifconfig ixgbe2 unplumb # ifconfig ixgbe3 unplumb 2. Create a link aggregation group with key 1 containing the first two interfaces, and bring up the link group. In this example, the -l active option turns on LACP mode:...
▼ Delete Link Aggregations (Oracle Solaris 10) 1. Use the ifconfig(1M) command to unplumb each link aggregation you want to delete. For example: # ifconfig aggr1 unplumb # ifconfig aggr2 unplumb Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 65
2. Use the dladm(1M) command to delete each unwanted link aggregation. For example: # dladm delete-aggr 1 # dladm delete-aggr 2 Related Information “Link Aggregation Overview” on page 52 ■ “Configure Link Aggregations (Oracle Solaris 10)” on page 52 ■ “Display Information About Link Aggregations (Oracle Solaris 10)”...
Page 66
Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Configuring VLANs These topics describe how to configure VLANs in the Oracle Solaris 10 OS. For instructions on how to configure VLANs in the Oracle Solaris 11 OS, refer to Oracle Solaris Administration: Network Interfaces and Network Virtualization in the Oracle Solaris 11 documentation library.
Although VLANs are commonly used to create individual broadcast domains or separate IP subnets, it can be useful for a server to have a presence on more than one VLAN simultaneously. Several Oracle Sun products support multiple VLANs on a per-port or per-interface basis, allowing very flexible network configurations.
Page 69
Example VLAN Configuration FIGURE: Figure Legend VLAN 1 VLAN 2 VLAN 3 Accounting server (VLAN 3) Main server with GbE-tagged adapter (all VLANs) Shared media segment PC 1: Software development (VLAN 2) PC 2: Software development (VLAN 2) PC 3: Engineering (VLAN 1) 10 PC 4: Accounting (VLAN 3) 11 PC 5: Software development and engineering with GbE-tagged adapter (VLAN 1 and VLAN 2) Configuring VLANs...
Page 70
■ servers. Tagging is not enabled on Client 4’s switch port. Client 5 is a member of both VLANs 1 and 2. This client has a Sun Dual Port ■ 10GBase-T Adapter installed. Client 5 is connected to switch port 10. Both the Ethernet adapter and the switch port are configured for VLANs 1 and 2, and both have tagging enabled.
Related Information “VLAN Configuration” on page 61 ■ “VLAN Naming Format” on page 61 ■ “Configure Static VLANs (Oracle Solaris 10)” on page 62 ■ VLAN Configuration You can create VLANs according to various criteria, but each VLAN must be assigned a VLAN tag or VLAN ID (VID).
This example shows the output of ifconfig -a on a system having VLAN devices ixgbe123002 and ixgbe224002: ixgbe123002: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS>\ mtu 1500 index 4 inet 192.2.2.82 netmask ffffff00 broadcast 192.2.2.255 ether 0:13:20:f5:f6:dc ixgbe224002: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS>\ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
mtu 1500 index 5 inet 0.0.0.0 netmask ffffff00 ether 0:13:20:f5:f6:dc Note – In the preceding examples, the second NIC output for ixgbe224002 was plumbed and enabled (that is, used the up option), but had no IP address. By default, the netmask and broadcast addresses are set by the system, which uses IP class C to make that setting 255.255.255.0.
1. Click Control Panel. 2. Click Network Connection. 3. Click the folder icon from the sub-manual bar. 4. Right-click the Sun Dual Port 10GBase-T Adapter port, then select Properties. 5. Click Configure. 6. Click VLAN, then click New. 7. Type VLAN with ID (for example, type VLAN10).
Page 75
13. Click OK. 14. Repeat Step 3 through Step 10 until all the network ports are VLAN configured. Note – Ensure that the firewall is configured to allow VLAN traffic. Otherwise, the VLAN might not operate properly. Related Information “VLAN Overview” on page 58 ■...
Page 76
Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Troubleshooting the Adapter These topics describe how to troubleshoot the installation and operation of the Adapter on an Oracle SPARC or x86 system running the Oracle Solaris 10 or 11 OS. These topics are not intended to be comprehensive. They cover basic installation issues.
See Oracle Solaris Administration: Network Interfaces and Network Virtualization for more information. Related Information “Analyze a Port Hang” on page 69 ■ “Analyze Slow Network Performance” on page 69 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
▼ Analyze a Port Hang 1. If the interface encounters a soft hang, replumb the device. For Oracle Solaris 10, use the ifconfig(1M) command. ■ For Oracle Solaris 11, use the dladm(1M) command. ■ 2. If the interface encounters a hard hang, reboot the system. If the interface encounters another hard hang, try to capture the trace information by using the dtrace(1M) command, as in the following example.
Page 80
DTrace script. For more information about the DTrace script, go to: http://support.oracle.com Related Information “Analyze Why the Device Link Is Missing” on page 68 ■ “Analyze a Port Hang” on page 69 ■ Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Glossary (activity) Indicates that the port is up and running. (basic input/output system) In this guide, the term BIOS refers to the BIOS BIOS software on the client or server system. (canonical format indicator) A 1-bit field in the Ethernet header. (change request) DHCP (Dynamic Host Configuration Protocol) Part of the application layer in the...
Page 82
(electronically erasable programmable read-only memory) (electromagnetic interference) The interference caused by the magnetic fields of electronic components. (Federal Communications Commission) FIFO (first-in-first-out) (gigabyte) (Gigabit Ethernet) Gbps (gigabits-per-second) (gigabit-transfer) GTps (GTs-per-second) Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 83
(local area network) Two or more devices connected to each other either physically or logically. (light-emitting diode) (linear feet per minute) (link) Indicates that the network link is up and running. (LAN-on-motherboard) A LAN design. (low profile adapter) Refers to the Sun Dual Port 10GBase-T Adapter, NIC Adapter from Oracle. Glossary...
Page 84
(physical layer) Controls the physical, analog signal access to a link. (physical point of attachment) Used in constructing VLAN IDs. (preboot execution environment) Enables clients to boot over a network interface, independent of the OS or other devices. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...
Page 85
(read-only memory) (RPM Package Manager) (really simple syndication) (response) The automatic response mechanism used by Ethernet PAUSE frames. SerDes (serializer/deserializer) A mechanism used in high-speed connections to compensate for limited input or output. SGMII (Serial Gigabit Media Independent Interface) A standard interface used to connect an Ethernet MAC-block to a PHY.
Page 86
(virtual LAN) Splits the physical LAN into logical subparts. Multiple VLANs are supported on a single port, enabling a server with a single adapter to have a logical presence on multiple IP subnets. Sun Dual Port 10GBase-T Adapter User’s Guide • July 2012...