Page 2
2E, Mountain View, CA 94043-1351. TRADEMARKS AND ATTRIBUTIONS Silicon Graphics, SGI, the SGI logo, Altix, IRIX, Onyx, Origin, and Silicon Graphics Tezro are registered trademarks and Silicon Graphics Prism is a trademark of Silicon Graphics, Inc., in the United States and/or other countries worldwide.
Page 3
International Special Committee on Radio Interference (CISPR) This equipment has been tested to and is in compliance with the Class A limits per CISPR publication 22. Canadian Department of Communications Statement This digital apparatus does not exceed the Class A limits for radio noise emissions from digital apparatus as set out in the Radio Interference Regulations of the Canadian Department of Communications.
Obtaining Publications xiii Conventions xiii Product Support Reader Comments 1. Features and Capabilities of the SGI 10-Gbit Ethernet Network Adapter Features Cabling Configuration Limits Tools 2. Connecting the Adapter to a Network ... . .
Page 10
Socket Buffer Size and IRIX Multibuffer Mode and IRIX SGI ProPack 3 Performance Tuning Socket Read and Write Buffer Sizes for SGI ProPack 3 Jumbo Frames and SGI ProPack 3 Read/Write Size and SGI ProPack 3 TCP/IP Socket Buffer Size and SGI ProPack 3 Glossary .
The SGI 10-Gbit Ethernet network adapter operates under the versions of the IRIX and SGI ProPack for Linux operating systems, as specified in the release notes. You can use the SGI 10-Gbit Ethernet network adapter in addition to your current adapter.
This guide is written to facilitate installation of the adapter and does not cover detailed points of network configuration. It contains the following chapters: • Chapter 1, "Features and Capabilities of the SGI 10-Gbit Ethernet Network Adapter", summarizes features, cabling, configuration limits, and tools.
• If it is installed on your SGI system, you can use InfoSearch, an online tool that provides a more limited set of online books, release notes, and man pages. With an IRIX system, enter infosearch at a command line or select Help >...
Reader Comments If you have comments about the technical accuracy, content, or organization of this publication, contact SGI. Be sure to include the title and document number of the publication with your comments. (Online, the document number is located in the front matter of the publication.
Page 15
® 10-Gigabit Ethernet Network Adapter User’s Guide • Send mail to the following address: Technical Publications 1500 Crittenden Lane, M/S 535 Mountain View, California 94043–1351 SGI values your comments and will respond to them promptly. 007–4669–002...
10 Gbits per second (Gbps), which is theoretically ten times the rate of existing technology. Given the limitations of the bus and the CPUs, realistic performance with the SGI 10-Gbit Ethernet network adapter will not exceed 4.5–6 Gbps.
1: Features and Capabilities of the SGI 10-Gbit Ethernet Network Adapter Features The adapter includes the following features: • Full-duplex Gigabit Ethernet interface as defined in the IEEE P802.3ae approved standard • Jumbo frame support (up to 9600 bytes) • 16 DMA channels (8 for reading, 8 for writing) •...
Consult with your SGI representative to determine the currently supported maximum for your configuration. Tools The SGI 10-Gbit Ethernet network adapter product contains the following IRIX tools: • xg(7F) driver • xgcmd(1M) diagnostic tool to interrogate and control both the driver itself and the...
The installation instructions for the SGI 10-Gbit Ethernet network adapter are different for different systems. Refer to the following sources for installation instructions: • Altix 3000, Onyx 3000, or Origin 3000: The adapter must be installed by an SGI certified service provider.
Page 22
2: Connecting the Adapter to a Network 2. Insert the LC connector on one end of the fiber-optic cable into the adapter, as shown in Figure 2-1. Ensure that the connector is inserted completely into the jack. Note: If the network connects to an Ethernet switch, consult the operating manual for the switch to ensure that the switch port is enabled and configured correctly and as the correct adapter type (10GBASE-SR).
Chapter 3 Operating the Adapter This chapter describes various issues that may occur when using the SGI 10-Gbit Ethernet network adapter in a 10-Gbit Ethernet network. It includes the following sections: • "Verifying Functionality" • "Resetting the Adapter" on page 11 •...
Verifying Adapter Recognition IRIX Adapter Recognition Verification Under IRIX, the network interface name for the SGI 10-Gbit Ethernet network adapter is xgN, where N is the number of the adapter: 1 for the first adapter, 2 for the second adapter (if installed), and so on. Use the commands in the examples below to display the network interface names.
02:02.0 Ethernet controller: S2io Inc.: Unknown device 5831 (rev 03) Note: At this point (before the module is loaded), the /proc/net/dev file will not display the device. On SGI ProPack 3 systems, you can also use the hinv command to display device information. 2. Load the s2io module: [root@linux root]# insmod s2io The device will now appear in the /proc/net/dev file:...
3: Operating the Adapter RX packets:0 errors:0 dropped:0 overruns:0 frame:0 TX packets:0 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:0 (0.0 b) TX bytes:0 (0.0 b) Interrupt:62 Enabling the Adapter To enable the adapter, enter the following: # ifconfig IPaddress broadcast broadcastaddress netmask netmaskvalue For other systems to see the new address, you must enter the new hosts addresses in DNS or in host files or NIS as required for your system.
® 10-Gigabit Ethernet Network Adapter User’s Guide In this address, the organizationally unique identifier (OUI) of the adapter vendor is represented by the first three sets of numbers (for example, 08:00:69). The last three sets vary, depending on the system.
3: Operating the Adapter • Linux: # ifconfig ethN down # ifconfig ethN up Configuration IRIX and Linux use different configuration tools. IRIX Configuration The configuration of the adapter is controlled by a number of parameters, which are discussed in the IRIX /etc/config/xgcmd.options file. To change the configuration of your adapter, use the xgcmd command.
Page 29
® 10-Gigabit Ethernet Network Adapter User’s Guide The output will display information about the network adapters currently installed in the system, as follows: Name Mtu Network Address Ipkts Ierrs Opkts Oerrs Coll 1500 10.50.1 system.name 0 2. To bring down the adapter, enter the following command, where N is the number...
Chapter 4 Performance Tuning This chapter discusses performance tuning topics for IRIX and SGI ProPack 3 for Linux. For good TCP performance, the socket buffers used by applications must be at least as large as the bandwidth-round trip delay product between the two endpoints.
4: Performance Tuning Read/Write Size and IRIX In a point-to-point configuration, use a buffer length of 513920 bytes. In a multiclient configuration, use a buffer length of 64240 bytes. Socket Buffer Size and IRIX Socket buffer size is set either: •...
SGI ProPack 3 Performance Tuning This section discusses the following: • "Socket Read and Write Buffer Sizes for SGI ProPack 3" on page 17 • "Jumbo Frames and SGI ProPack 3" on page 17 • "Read/Write Size and SGI ProPack 3" on page 17 •...
4: Performance Tuning TCP/IP Socket Buffer Size and SGI ProPack 3 In SGI ProPack 3, /proc/sys/net/core/rmem_max and /proc/sys/net/core/wmem_max are both set to 524288 bytes, which is usually large enough to provide good performance. If you to adjust the socket buffers, use sysctl(8) command.
Light-emitting diode, a light on a piece of hardware that indicates status or error conditions. Medium access control, also called the physical layer. MAC address The physical address of the SGI 10-Gbit Ethernet Network adapter, which is distinct from the IP address. 007–4669–002...
Page 36
Glossary Maximum Transmission Unit is a configuration parameter that controls the size of the Ethernet frames that the SGI 10-Gigabit Ethernet network adapter can transmit and receive. man (manual) page An online document that describes how to use a particular IRIX command. Also called reference page.
Need help?
Do you have a question about the 10-Gigabit Ethernet Network Adapter and is the answer not in the manual?
Questions and answers