Broadcom NetXtreme II SERIES User Manual
  1. Manuals
  2. Brands
  3. Broadcom Manuals
  4. Network Card
  5. NetXtreme II SERIES
  6. User manual
Broadcom NetXtreme II SERIES User Manual

Broadcom NetXtreme II SERIES User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Broadcom NetXtreme II® Network Adapter User Guide
Broadcom NetXtreme II
The information below is provided by the supplier of the referenced device without independent verification by Dell and is
subject to the
Restrictions and Disclaimers
Introduction
Functionality and Features
Teaming
Virtual LANs (VLANs)
Manageability
Installing the Hardware
Installing the Driver Software
Broadcom Boot Agent Driver Software
NDIS2 Driver Software
Linux Driver Software
Solaris Driver Software
VMware Driver Software
Installing Windows Drivers and Management Applications
Linux Management Application Installation
iSCSI
Advanced Teaming Concepts
NIC Partitioning
Fibre Channel Over Ethernet
Data Center Bridging
SR-IOV
Using Broadcom Advanced Control Suite
User Diagnostics
Specifications
Regulatory Information
Troubleshooting
Information in this document is subject to change without notice.
© 2014 Broadcom Corporation. All rights reserved.
Trademarks used in this text: Broadcom, NetXtreme II, Ethernet@Wirespeed, LiveLink, and Smart Load Balancing are among
the trademarks of Broadcom Corporation and/or its affiliates in the United States, certain other countries, and/or the EU. Dell
and the DELL logo are trademarks of Dell Inc. Microsoft and Windows are trademarks of Microsoft Corporation. Linux is a
trademark of Linus Torvalds. Intel is a trademark of Intel Corporation. Magic Packet is a trademark of Advanced Micro
Devices, Inc. Red Hat is a trademark of Red Hat, Inc. PCI Express is a trademark of PCI-SIG. Any other trademarks or trade
names mentioned are the property of their respective owners.
Restrictions and Disclaimers
The information contained in this document, including all instructions, cautions, and regulatory approvals and certifications, is
provided by the supplier and has not been independently verified or tested by Dell, except where specifically noted. Dell
file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/index.htm[9/5/2014 3:44:56 PM]
®
Network Adapter User Guide
noted below.

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the NetXtreme II SERIES and is the answer not in the manual?

Questions and answers

Related Manuals for Broadcom NetXtreme II SERIES

Summary of Contents for Broadcom NetXtreme II SERIES

  • Page 1 Trademarks used in this text: Broadcom, NetXtreme II, Ethernet@Wirespeed, LiveLink, and Smart Load Balancing are among the trademarks of Broadcom Corporation and/or its affiliates in the United States, certain other countries, and/or the EU. Dell and the DELL logo are trademarks of Dell Inc. Microsoft and Windows are trademarks of Microsoft Corporation. Linux is a trademark of Linus Torvalds.
  • Page 2 Broadcom NetXtreme II® Network Adapter User Guide cannot be responsible for damage caused as a result of either following or failing to follow these instructions. All statements or claims regarding the properties, capabilities, speeds or qualifications of the part referenced in this document are made by the supplier and not by Dell.

  • Page 3: Functional Description

    VLANs on Windows operating systems. Features The following is a list of the Broadcom NetXtreme II adapter features. Some features may not be available on all adapters. TCP Offload Engine (TOE) Internet Small Computer Systems Interface (iSCSI) offload...
  • Page 4 Functionality and Features: Broadcom NetXtreme II® Network Adapter User Guide PCI Express 1.0a x4 (Gigabit Ethernet) PCI Express Gen2 x8 (10 Gigabit Ethernet) Full fast-path TCP offload Zero copy capable hardware Other performance features TCP, IP, UDP checksum TCP segmentation...

  • Page 5: Power Management

    Without the TCP Offload Engine, the TCP/IP protocol suite runs on the host CPU, consuming a very high percentage of its resources and leaving little resources for the applications. With the use of the Broadcom NetXtreme II adapter, the TCP/IP processing can be moved to hardware, freeing the CPU for more important tasks such as application processing.

  • Page 6: Adaptive Interrupt Frequency

    ASIC with Embedded RISC Processor The core control for Broadcom NetXtreme II adapters resides in a tightly integrated, high-performance ASIC. The ASIC includes a RISC processor. This functionality provides the flexibility to add new features to the card and adapts it to future network requirements through software downloads.
  • Page 7 Functionality and Features: Broadcom NetXtreme II® Network Adapter User Guide Please read all Restrictions and Disclaimers. Back to Contents Page file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/features.htm[9/5/2014 3:44:57 PM]...

  • Page 8: Broadcom Advanced Server Program Overview

    Linux operating systems (called "Channel Bonding"), refer to your operating system documentation. Broadcom Advanced Server Program Overview Broadcom Advanced Server Program (BASP) is the Broadcom teaming software for the Windows family of operating systems. BASP settings are configured by Broadcom Advanced Control Suite (BACS) utility.

  • Page 9: Smart Load Balancing™ And Failover

    Smart Load Balancing™ and Failover Smart Load Balancing™ and Failover is the Broadcom implementation of load balancing based on IP flow. This feature supports balancing IP traffic across multiple adapters (team members) in a bidirectional manner. In this type of team, all adapters in the team have separate MAC addresses.

  • Page 10: Limitations Of Smart Load Balancing And Failover/Slb (Auto-Fallback Disable) Types Of Teams

    Other protocol packets are sent and received through one primary interface only. Failover for non-IP traffic is supported only for Broadcom network adapters. The Generic Trunking type of team requires the Ethernet switch to support some form of port trunking mode (for example, Cisco's Gigabit EtherChannel or other switch vendor's Link Aggregation mode).

  • Page 11: Vlan Overview

    Up to 64 VLANs (63 tagged and 1 untagged) can be defined for each Broadcom adapter on your server, depending on the amount of memory available in your system.

  • Page 12: Adding Vlans To Teams

    PC #4 port. A member of both VLANs #1 and #2, PC #5 has an Broadcom adapter installed. It is connected to switch port PC #5 #10. Both the adapter and the switch port are configured for VLANs #1 and #2 and have tagging enabled.

  • Page 13: Basp Subagent

    Broadcom's implementation of CIM will provide various classes to provide information to users through CIM client applications. Note that Broadcom CIM data provider will provide data only, and users can choose their preferred CIM client software to browse the information exposed by Broadcom CIM provider.

  • Page 14: Basp Extensible-Agent

    To monitor this information, an SNMP manager must load the Broadcom BASP MIB database files to allow monitoring of the information described above. These files, which are shown below, are included with the driver source media.

  • Page 15: System Requirements

    Overview This section applies to Broadcom NetXtreme II add-in network interface cards. System Requirements Before you install a Broadcom NetXtreme II adapter, verify that your system meets the following hardware and operating system requirements: Hardware Requirements IA32- or EMT64-based computer that meets operating system requirements One open PCI Express slot.

  • Page 16: Safety Precautions

    Installation of the Add-In NIC The following instructions apply to installing the Broadcom NetXtreme II adapter (add-in NIC) in most systems. Refer to the manuals that were supplied with your system for details about performing these tasks on your particular system.

  • Page 17: Connecting The Network Cables

    7. Close the system case and disconnect any personal antistatic devices. Connecting the Network Cables The Broadcom NetXtreme II adapter has either an RJ-45 connector used for attaching the system to an Ethernet copper-wire segment or a fiber optic connector for attaching the system to an Ethernet fiber optic segment.

  • Page 18: Setting Up Mba In A Client Environment

    (0,1,2, ...) to be programmed. Configuring the MBA Driver This section pertains to configuring the MBA driver on add-in NIC models of the Broadcom network adapter. For configuring the MBA driver on LOM models of the Broadcom network adapter, check your system documentation.

  • Page 19: Setting Up The Bios

    Broadcom Boot Agent Driver Software: Broadcom NetXtreme II® Network Adapter User Guide 3. Use the UP ARROW and DOWN ARROW keys to move to the Boot Protocol menu item. Then use the RIGHT ARROW or LEFT ARROW key to select the boot protocol of choice if other boot protocols besides Preboot Execution Environment (PXE) are available.

  • Page 20: Ms-Dos Undi/Intel Apitest

    The Initrd.img file distributed with Red Hat Enterprise Linux, however, does not have a Linux network driver for the Broadcom NetXtreme II adapters. This version requires a driver disk for drivers that are not part of the standard distribution. You can create a driver disk for the Broadcom NetXtreme II adapter from the image distributed with the installation CD.

  • Page 21: Pre-Installation Requirements

    The examples used in this section refer to the BXND20X driver, but also apply to the BNX2EV driver. Preinstallation Requirements Before you can successfully install the NDIS2 driver software, the Broadcom network adapter must be physically installed in the server. Networking software that is appropriate to the operating system (such as Microsoft LAN Manager 2.2 for MS-DOS) must already be running on your server.

  • Page 22: Modifying The Startup Disk

    NDIS2 Driver Software: Broadcom NetXtreme II® Network Adapter User Guide 8. Follow the on-screen instructions to make the network startup disk (choose NE2000 Compatible from the list of adapters). Modifying the Startup Disk To modify the startup disk 1. Edit A:\Net\Protocol.ini with Notepad or a similar text editor.

  • Page 23: Installing The Dos Ndis2 Driver Software On The Hard Disk

    NDIS2 Driver Software: Broadcom NetXtreme II® Network Adapter User Guide Example System.ini file [network] sizworkbuf=1498 filesharing=no printsharing=no autologon=yes computername=MYPC lanroot=A:\NET username=USER1 workgroup=WORKGROUP reconnect=yes dospophotkey=N lmlogon=0 logondomain= preferredredir=basic autostart=basic maxconnections=8 [network drivers] netcard=BXND20X.dos transport=ndishlp.sys,*netbeui devdir=A:\NET LoadRMDrivers=yes 3. Copy BXND20X.dos to A:\Net.

  • Page 24: Using Keywords For The Drivers

    6. Restart the computer to complete the installation. NOTE: The driver loads during system configuration and displays the Broadcom banner, controller name, MAC address, IRQ number, detected line speed, and the controller BusNum and DevNum. If the driver fails to load, an initialization fail message is displayed.

  • Page 25: Bnx2 Driver

    The cnic driver provides the interface between Broadcom's upper layer protocol (e.g., storage) drivers and cnic Broadcom's NetXtreme II 1 Gb and 10 Gb network adapters. The CNIC module works with the bnx2 and bnx2x network drives in the downstream and the bnx2fc (FCoE) and bnx2i (iSCSI) drivers in the upstream.

  • Page 26: Bnx2X Driver

    2.6.16 and newer kernels. NOTE: For Broadcom NetXtreme II BCM5708 devices with a silicon revision prior to B2, the open source bnx2 driver does not support the reporting and configuration of NetXtreme II WOL settings via ethtool. For silicon revisions of B2 or later, the bnx2 driver reports support for Magic Packet WOL via ethtool.

  • Page 27: Installing Linux Driver Software

    Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide The Linux driver has a dependency on open-fcoe userspace management tools as the front-end to control FCoE interfaces. The package name of the open-fcoe tool is fcoe-utils for RHEL 6.4 and open-fcoe for SLES11 SP2 and legacy versions.

  • Page 28: Building The Driver From The Source Tar File

    7. For SLES, use YaST to configure your Ethernet interfaces to automatically start at boot by setting a static IP address or enabling DHCP on the interface. 8. Disable lldpad on Broadcom CNA interfaces. This is required because Broadcom utilizes an offloaded DCBX client. lldptool set-lldp –i <ethX> adminStatus=disasbled 9.
  • Page 29 Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide tar xvzf netxtreme2-version.tar.gz 2. Build the driver bnx2.ko (or bnx2i.ko) as a loadable module for the running kernel: cd netxtreme2-version make 3. Test the driver by loading it (first unload the existing driver, if necessary): rmmod bnx2 (or bnx2x, or bnx2i) insmod bnx2/src/bnx2.ko (or bnx2x/src/bnx2x.ko, or bnx2i/src/bnx2i.ko)

  • Page 30: Load And Run Necessary Iscsi Software Components

    For more information, go to http://linux.dell.com. Load and Run Necessary iSCSI Software Components The Broadcom iSCSI Offload software suite consists of three kernel modules and a user daemon. Required software components can be loaded either manually or through system services.

  • Page 31: Patching Pci Files (Optional)

    Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide Patching PCI Files (Optional) NOTE: The examples used in this procedure refer to the bnx2 driver, but also apply to the bnx2x and bnx2i drivers. For hardware detection utilities such as Red Hat kudzu to properly identify bnx2 supported devices, a number of files containing PCI vendor and device information may need to be updated.
  • Page 32 Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide (TPA) feature. By default, the driver will aggregate TCP packets. Use disable_tpa to disable the advanced TPA feature. Set the disable_tpa parameter to 1 as shown below to disable the TPA feature on all NetXtreme II network adapters in the system.
  • Page 33 CAUTION! Do not use error_mask if you are not sure about the consequences. These values are to be discussed with Broadcom development team on a case-by-case basis. This is just a mechanism to work around iSCSI implementation issues on the target side and without proper knowledge of iSCSI protocol details, users are advised not to experiment with these parameters.

  • Page 34: Driver Defaults

    Defaults: 128 Range: 32 to 128 Note that Broadcom validation is limited to a power of 2; for example, 32, 64, 128. rq_size "Configure RQ size", used to choose the size of asynchronous buffer queue size per offloaded connections. RQ size is not required greater than 16 as it is used to place iSCSI ASYNC/NOP/REJECT messages and SCSI sense data.

  • Page 35: Driver Messages

    Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide bnx2 Driver Speed: Autonegotiation with all speeds advertised Flow Control: Autonegotiation with RX and TX advertised MTU: 1500 (range is 46–9000) RX Ring Size: 255 (range is 0–4080) RX Jumbo Ring Size: 0 (range 0–16320) adjusted by the driver based on MTU and RX Ring Size TX Ring Size: 255 (range is (MAX_SKB_FRAGS+1)–255).

  • Page 36: Bnx2 And Bnx2X Driver

    Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide <level> to control the level at which messages appear on the console. Most systems are set to level 6 by default. To see all messages, set the level higher. bnx2 and bnx2x Driver...
  • Page 37 Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide Target cannot be reached on any of the CNIC devices bnx2i: check route, cannot connect using cnic Network route is assigned to network interface, which is down bnx2i: check route, hba not found...

  • Page 38: Teaming With Channel Bonding

    Linux Driver Software: Broadcom NetXtreme II® Network Adapter User Guide Teaming with Channel Bonding With the Linux drivers, you can team adapters together using the bonding kernel module and a channel bonding interface. For more information, see the Channel Bonding information in your operating system documentation.
  • Page 39 Iface.mtu = 0 Iface.port = 0 #END Record NOTE: Although not strictly required, Broadcom recommends configuring the same VLAN ID on the iface.iface_num field for iface file identification purposes. Setting the VLAN ID on the Ethernet Interface If using RHEL5.X versions of Linux, it is recommended that you configure the iSCSI VLAN on the Ethernet interface. In RHEL6.3, and sles11sp3, it is not necessary to set the VLAN on the Ethernet driver.

  • Page 40: Making Connections To Iscsi Targets

    In the scenario where multiple CNIC devices are in the system and the system is booted via Broadcom's iSCSI boot solution, ensure that the iscsi node under /etc/iscsi/nodes for the boot target is bound to the NIC that is used for booting.

  • Page 41: Installing The Driver

    FCoE Support Overview This file describes how to install the Solaris driver for Broadcom's NetXtreme II 10 Gigabit Ethernet network adapters. Refer to the 'bnxe' manual page for details on how to configure the driver. The Solaris driver is released in two formats: BRCMbnxe-version.pkg: Datastream format...

  • Page 42: Uninstalling Driver

    Solaris Driver Software: Broadcom NetXtreme II® Network Adapter User Guide To upgrade the Broadcom driver package to the current version, you must first uninstall the previous driver version from the system. See Uninstalling Driver. Once the previous driver has been removed, you can follow any of the installation methods in this document to install the new driver version.

  • Page 43: Interrupt Management

    If your system has four Broadcom BCM57711 network adapter ports, each running in multifunction mode, Solaris will enumerate 16 bnxe interfaces. The last interface attached will fail to allocate its second MSIX interrupt and revert to Fixed.
  • Page 44 FCoE ports and then unload the driver. Unloading will occur only when all the instances are deleted. Supported FC/FCoE Devices The bnxef Broadcom 10 Gb FCoE driver works with all the major FCoE fabric devices. It is also compatible with all known FC disk devices and tape devices working through the FCoE fabric.

  • Page 45: Networking Support

    VMware VIB vmware-esx-drivers-net-bnx2x-version.x86_64.vib Networking Support This section describes the bnx2x VMware ESX driver for the Broadcom NetXtreme II PCIE 10 GbE network adapters. Drivers Download, Install, and Update Drivers To download, install, or update the VMware ESX/ESXi driver for NetXtreme II 10 GbE network adapters, see http://www.vmware.com/support.
  • Page 46 (BRB) is reaching a certain level of occupancy. This is a performance targeted flow control mechanism. On Broadcom network adapters, you can enable another flow control mechanism to send pause frames if one of the host buffers (when in RSS mode) is exhausted.

  • Page 47: Supported Distributions

    Table 3: Broadcom NetXtreme II iSCSI Driver Driver Description The bnx2i driver is Broadcom VMware iSCSI HBA driver. Similar to bnx2fc, bnx2i is a kernel mode driver used to provide a translation layer between the bnx2i VMware SCSI stack and the Broadcom iSCSI firmware/hardware. Bnx2i functions under the open-iscsi framework.
  • Page 48 VMware Driver Software: Broadcom NetXtreme II® Network Adapter User Guide 7. Configure the VLAN on VMKernel. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/vmware.htm[9/5/2014 3:45:03 PM]...

  • Page 49: Enabling Fcoe

    () Software FCoE NOTE: The label "Software FCoE" is a VMware term used to describe initiators that depend on the inbox FCoE libraries and utilities. Broadcom's FCoE solution is a fully state connection-based hardware offload solution designed to significantly reduce the CPU burden encumbered by a non-offload software initiator.

  • Page 50: Installing The Driver Software

    If your controller was installed at the factory, the driver software has been installed for you. When Windows first starts after a hardware device (such as a Broadcom NetXtreme II Adapter) has been installed, or after the existing device driver has been removed, the operating system automatically detects the hardware and prompts you to install the driver software for that device.

  • Page 51: Using Silent Installation

    10. The installer will determine if a system restart is necessary. Follow the on-screen instructions. To install the Microsoft iSCSI Software Initiator for iSCSI Crash Dump If supported and if you will use the Broadcom iSCSI Crash Dump utility, it is important to follow the installation sequence: Run the installer...
  • Page 52 IA32 platforms: setup /s /v"/qn ADDSOURCE=Driversi32" AMD64 platforms: setup /s /v"/qn ADDSOURCE=Driversa64" NOTE: The Broadcom device drivers are a required feature and are always installed, even if you do not specify ADDSOURCE. To perform a silent install from within a batch file...

  • Page 53: Removing The Device Drivers

    1. In Control Panel, double-click Add or Remove Programs. 2. Click Broadcom Drivers and Management Applications, and then click Remove. Follow the on-screen prompts. 3. Reboot your system to completely remove the drivers. If you fail to reboot your system, you will not be able to successfully install the drivers.
  • Page 54 2. Review the line below it which reads: %brcm% = broadcom, ntx86, ntamd64, ntia64 or equivalent. 3. Modify that line to read: %brcm% = broadcom.ntx86, ntamd64, ntia64. The change made replaces the comma and space after "broadcom" with a period.

  • Page 55: Configuring The Speed/Duplex Setting For The Netxtreme Ii Monolithic Driver

    2. Add the .inf file to the base image by using the dism command with the /Add-Driver option. For example Driver.inf is the Broadcom driver, evnd.inf is the driver for the 10 Gbps devices, and b06nd.inf is the driver for the 1 Gbps devices.

  • Page 56: Viewing Or Changing The Properties Of The Adapter

    Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide 2. Perform a search on the file for "Registry parameters" to locate the section that will allow you to configure the adapter speed/duplex. 3. Once located, notice the following information shown.
  • Page 57 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide NOTES: The Power Management tab is available only for servers that support power management. To enable Wake on LAN (WOL) when the computer is on standby, click Allow the device to bring the computer out of standby box.
  • Page 58 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide Using WS-MAN To use the WS-MAN communication protocol, follow the instructions in the following sections: WS-MAN Windows Server Configuration WS-MAN Windows Client Installation WS-MAN Windows Server Configuration Step 1: Install the WinRM Software Component on Server On the following operating systems, WinRM 2.0 is preinstalled:...
  • Page 59 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide 3. Under Computer Configuration, open the Administrative Templates folder and then open the Windows Components folder. 4. Select Windows Remote Management (WinRM). 5. Under Windows Remote Management (WinRM), select WinRm Client.
  • Page 60 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide openssl req -new -key server.key -out server.csr If this command does not work, try the following: openssl req –new –key server.key –out server.csr –config openssl.cnf The openssl.cnf file should be placed in the same directory where openssl is placed. Openssl.cnf is located in the folder C:\Program Files (x86)\GnuWin32\share.
  • Page 61 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide imported. If you plan to use a Windows client to connect to the server running BACS, then the certificate also needs to be transferred (copied and pasted) to the client system.
  • Page 62 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide 16. Ensure that only Server Authentication is enabled, as shown in the figure. 17. Open Trusted Root Certification Authorities and then open Certificates. 18. Follow the instructions from Step 11.
  • Page 63 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide NOTES: If the certificate was generated using the host name, enter the host name. If it was generated using the IP address, enter the IP address. For an IPv6 address, use brackets [ ] around the address.
  • Page 64 Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide winrm enumerate winrm/config/Listener or winrm e Helps to check which service listener are enabled and listening on which port and IP Address. winrm/config/Listener Checks WinRM Service Configuration.

  • Page 65: Step 1: Set Up Namespace Security Using Wmi Control

    Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide k. Browse to select the .pfx file you generated in To generate a self-signed certificate for the Windows Server:. Change the selection in the Files of type list to Personal Information Exchange (*.pfxas, *.p12), select the hostname.pfx file and click Open.

  • Page 66: Step 2: Grant Dcom Remote Launch And Activate Permission

    Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide Step 2: Grant DCOM Remote Launch and Activate Permission In the Windows domain environment, the Domain Administrator account has the necessary privilege level to access the WMI component for BACS management and, therefore, no special configuration is needed.

  • Page 67: Special Configuration For Wmi On Different Systems

    Windows Driver and Management Application Installation: Broadcom NetXtreme II® Network Adapter User Guide Special Configuration for WMI on Different Systems On a Windows XP Pro computer, ensure that remote logons are not being coerced to the GUEST account (referred to as "ForceGuest", which is enabled by default on computers that are not attached to a domain).

  • Page 68: Communication Protocols

    Installing the Broadcom Advanced Control Suite Overview The Broadcom Advanced Control Suite version 4 (BACS4) is a management application for configuring the NetXtreme II family of adapters, also known as Converge Network Adapters (CNAs). BACS4 software operates on Windows and Linux server and client operating systems.
  • Page 69 Linux BACS Installation: Broadcom NetXtreme II® Network Adapter User Guide host and on the selected communication protocol. Installing WS-MAN or CIM-XML on Linux Server Step 1: Install OpenPegasus On the Red Hat Linux OS, two installation options are available: From the Inbox RPM (Red Hat Only) From Source (Red Hat and SuSE) On the SUSE Linux Enterprise Server 11 (SLES11) OS, you must use the source RPM.

  • Page 70: Additional Settings

    Linux BACS Installation: Broadcom NetXtreme II® Network Adapter User Guide PATH $PATH:$PEGASUS_HOME/bin PEGASUS_ENABLE_CMPI_PROVIDER_MANAGER True PEGASUS_CIM_SCHEMA "CIM222" For Linux 32 bit systems: "LINUX_IX86_GNU" PEGASUS_PLATFORM For Linux 64 bit systems: "LINUX_X86_64_GNU" PEGASUS_HAS_SSL Optional. Set to "true" for HTTPS support. PEGASUS_ENABLE_PROTOCOL_WSMAN Optional. Set to "true" for WSMAN protocol support.
  • Page 71 CIM server must be started before running cimconfig, and must be restarted for configuration changes to take effect. Enable Authentication The following OpenPegasus properties have to be set as described in this section. Otherwise, the Broadcom CIM Provider will not work properly. Ensure the following are set before launching BACS and connecting to the provider.

  • Page 72: Step 5: Perform Linux Firewall Configuration, If Required

    Linux BACS Installation: Broadcom NetXtreme II® Network Adapter User Guide 1. Enable HTTPS connection with 'the following command: cimconfig -s enableHttpsConnection=true -p 2. Use the cimserver -s and cimserver commands, respectively, to stop and restart CIM server for the new configuration to take effect.
  • Page 73 If this fails, then the certificate is not installed correctly and an error message displays, indicating to take corrective action. Installing the Broadcom Advanced Control Suite The Broadcom Advanced Control Suite (BACS) software can be installed on a Linux system using the Linux RPM package. This installation includes a BACS GUI and a CLI client.
  • Page 74 Linux BACS Installation: Broadcom NetXtreme II® Network Adapter User Guide 1. Download the latest BACS management application RPM package. 2. Install the RPM package using the following command: % rpm -i BACS-{version}.{arch}.rpm To Use BACS To use the GUI, on XWindow, double-click the BACS4 desktop icon, or access the BACS program from the task bar under System Tools.

  • Page 75: Supported Operating Systems For Iscsi Boot

    Offload in Windows Server iSCSI Boot Broadcom NetXtreme II Gigabit Ethernet adapters support iSCSI boot to enable network boot of operating systems to diskless systems. iSCSI boot allows a Windows, Linux, or VMware operating system boot from an iSCSI target machine located remotely over a standard IP network.

  • Page 76: Configuring Iscsi Boot Parameters

    Protocol: Broadcom NetXtreme II® Network Adapter User Guide Initiator IQN CHAP ID and secret Configuring iSCSI Boot Parameters Configure the Broadcom iSCSI boot software for either static or dynamic configuration. Refer to Table 1 for configuration options available from the General Parameters screen.

  • Page 77: Iscsi Boot Configuration

    Protocol: Broadcom NetXtreme II® Network Adapter User Guide NOTE: If iSCSI boot firmware is not programmed in the NetXtreme II network adapter, selecting iSCSI Boot Configuration will not have any effect. iSCSI Boot Configuration Static iSCSI Boot Configuration Dynamic iSCSI Boot Configuration...

  • Page 78: Enabling Chap Authentication

    Protocol: Broadcom NetXtreme II® Network Adapter User Guide 8. Select ESC to return to the Main menu. 9. Select ESC and select Exit and Save Configuration. 10. Select F4 to save your MBA configuration. Dynamic iSCSI Boot Configuration In a dynamic configuration, you only need to specify that the system's IP address and target/initiator information are...

  • Page 79: Configuring The Dhcp Server To Support Iscsi Boot

    Protocol: Broadcom NetXtreme II® Network Adapter User Guide 1. From the General Parameters screen, set CHAP Authentication to Enabled. 2. From the Initiator Parameters screen, type values for the following: CHAP ID (up to 128 bytes) CHAP Secret (if authentication is required, and must be 12 characters in length or longer) 3.

  • Page 80: Dhcp Iscsi Boot Configuration For Ipv6

    DHCPv6 Option 16, Vendor Class Option DHCPv6 Option 17, Vendor-Specific Information NOTE: The DHCPv6 standard Root Path option is not yet available. Broadcom suggests using Option 16 or Option 17 for dynamic iSCSI Boot IPv6 support. DHCPv6 Option 16, Vendor Class Option DHCPv6 Option 16 (vendor class option) must be present and must contain a string that matches your configured DHCP Vendor ID parameter.

  • Page 81: Preparing The Iscsi Boot Image

    2. Load the latest Broadcom MBA and iSCSI boot images onto NVRAM of the adapter. 3. Configure the BIOS on the remote system to have the Broadcom MBA as the first bootable device, and the CDROM as the second device.
  • Page 82 2. Load the latest Broadcom MBA and iSCSI boot images into the NVRAM of the adapter. 3. Configure the BIOS on the remote system to have the Broadcom MBA as the first bootable device and the CDROM as the second device.
  • Page 83 Note that SLES 10.x and SLES 11 have support only for the non-offload path. 1. For driver update, obtain the latest Broadcom Linux driver CD. 2. Configure the iSCSI Boot Parameters for DVD direct install to target by disabling the Boot from target option on the network adapter.
  • Page 84 Protocol: Broadcom NetXtreme II® Network Adapter User Guide iSCSI Boot Parameters section, you have to boot the offload image. SLES 10.x and SLES 11 do not support offload. 17. For IPv6, you can now change the IP address for both the initiator and the target to the desired IPv6 address in the NVRAM configuration.
  • Page 85 Protocol: Broadcom NetXtreme II® Network Adapter User Guide esac rc_exit Removing Inbox Drivers from Windows 2008/R2 OS Image 1. Create a temporary folder, such as D:\temp. 2. Create the following two subfolders in the temporary folder: Win2008R2Copy Win2008R2Mod 3. Copy all the contents from the DVD installation media into the Win2008R2Copy folder.
  • Page 86 Injecting (Slipstreaming) Broadcom Drivers into Windows Image Files To inject Broadcom drivers into the Windows image files, you must obtain the following correct Broadcom driver packages for the applicable Windows Server version (2008R2, 2008SP2, 2012, or 2012R2) from the following location: http://www.broadcom.com/support/ethernet_nic/netxtremeii10.php...
  • Page 87 Protocol: Broadcom NetXtreme II® Network Adapter User Guide md C:\Temp\x cd /d C:\Temp\x 3. Use the following commands to create two subdirectories: md src md mnt 4. Use the following command to copy the original DVD into the src subdirectory.

  • Page 88: Locally Administered Address

    3. Ensure that the 2, 3, and 5 Runlevels of iSCSI service are on. 4. Update iscsiuio. You can get the iscsiuio package from the Broadcom CD. This step is not needed for SuSE 10. 5. Install the linux-nx2 package on your Linux system. You can get this package from Broadcom CD.

  • Page 89: Troubleshooting Iscsi Boot

    Solution: This is a known Windows TCP/IP stack issue. Problem: The Broadcom iSCSI Crash Dump utility will not work properly to capture a memory dump when the link speed for iSCSI boot is configured for 10 Mbps or 100 Mbps.

  • Page 90: Iscsi Crash Dump

    Crash Dump If you will use the Broadcom iSCSI Crash Dump utility, it is important to follow the installation procedure to install the iSCSI Crash Dump driver. See Using the Installer for more information.

  • Page 91: Configure Microsoft Initiator To Use Broadcom's Iscsi Offload

    1. Open BACS. 2. Select the Broadcom NetXtreme II C-NIC iSCSI adapter. If the C-NIC iSCSI adapter is not present, then select the VBD device and enable iSCSI offload by selecting iSCSI Offload Engine from the Resource Reservations area of the Configuration tab.
  • Page 92 Protocol: Broadcom NetXtreme II® Network Adapter User Guide 4. Select the Discovery tab and click Add to add a target portal. 5. Enter the IP address of the target and click Advanced. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/iscsi.htm[9/5/2014 3:45:06 PM]...
  • Page 93 Protocol: Broadcom NetXtreme II® Network Adapter User Guide 6. From the General tab, select Broadcom NetXtreme II C-NIC iSCSI Adapter from Local adapter. 7. Select the IP address for the adapter from Source IP. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/iscsi.htm[9/5/2014 3:45:06 PM]...
  • Page 94 Protocol: Broadcom NetXtreme II® Network Adapter User Guide 8. Click OK to close Advanced setting and then OK to add the target portal. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/iscsi.htm[9/5/2014 3:45:06 PM]...
  • Page 95 Protocol: Broadcom NetXtreme II® Network Adapter User Guide 9. From the Targets tab, select the target and click Log On to log into your iSCSI target using the Broadcom iSCSI adapter. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/iscsi.htm[9/5/2014 3:45:06 PM]...
  • Page 96 Protocol: Broadcom NetXtreme II® Network Adapter User Guide 10. Click on Advanced. 11. On the General tab, select the Broadcom NetXtreme Ii C-NIC iSCSI adapter from Local adapter. 12. Click OK to close Advanced settings. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/iscsi.htm[9/5/2014 3:45:06 PM]...

  • Page 97: Iscsi Offload Faqs

    Offload FAQs Q: How do I assign an IP address for iSCSI offload? A: Use the Configurations tab in Broadcom Advanced Control Suite (BACS). Q: What tools should be used to create the connection to the target? A: Use Microsoft iSCSI Software Initiator (version 2.08 or later).
  • Page 98 Protocol: Broadcom NetXtreme II® Network Adapter User Guide Event Log Messages Table 5 lists the offload iSCSI driver event log messages. Offload iSCSI (OIS) Driver Table 5: Offload iSCSI (OIS) Driver Event Log Messages Message Severity Message Number Initiator failed to connect to the target. Target IP address and TCP Port number are given in dump Error data.
  • Page 99 Protocol: Broadcom NetXtreme II® Network Adapter User Guide Information Initiator received an asynchronous logout message. The Target name is given in the dump data. Error Challenge size given by the target exceeds the maximum specified in iSCSI specification. A connection to the target was lost, but Initiator successfully reconnected to the target. Dump data Information contains the target name.
  • Page 100 Protocol: Broadcom NetXtreme II® Network Adapter User Guide Error Unexpected target portal IP types. Dump data contains the expected IP type. Please read all Restrictions and Disclaimers. Back to Contents Page file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/iscsi.htm[9/5/2014 3:45:06 PM]...

  • Page 101: Executive Summary

    This section describes the technology and implementation considerations when working with the network teaming services offered by the Broadcom software shipped with Dell's servers and storage products. The goal of Broadcom teaming services is to provide fault tolerance and link aggregation across a team of two or more adapters. The information in this document is provided to assist IT professionals during the deployment and troubleshooting of system applications that require network fault tolerance and load balancing.

  • Page 102: Teaming Concepts

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide HSRP Hot Standby Router Protocol ICMP Internet Control Message Protocol IGMP Internet Group Management Protocol Internet Protocol IPv6 Version 6 of the IP Protocol iSCSI Internet Small Computer Systems Interface Layer 2.

  • Page 103: Teaming And Network Addresses

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide assigned to the software stack. IP and IPX are examples of Layer 3 protocols. In addition, Layer 4 (Transport Layer) uses port numbers for each network upper level protocol such as Telnet or FTP. These port numbers are used to differentiate traffic flows across applications.

  • Page 104: Smart Load Balancing And Failover

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide Smart Load Balancing and Failover The Smart Load Balancing™ and Failover type of team provides both load balancing and failover when configured for load balancing, and only failover when configured for fault tolerance. This type of team works with any Ethernet switch and requires no trunking configuration on the switch.

  • Page 105: Toe Teaming

    TCP/IP traffic. A primary difference between the modes is that the SLB modes use a Broadcom proprietary algorithm to control how both inbound and outbound traffic is balanced across the network interfaces in the team. This has several advantages. First, with Generic Trunking or Link Aggregation modes, the team of network adapters must be connected to a switch that is specifically configured to support that particular mode of teaming.

  • Page 106: Limitations Of Teaming With Offloading

    For Broadcom NetXtreme II adapters, there are no specific setup requirements in order for TCP Offload Engine (TOE) to work with BASP. Once the individual adapters are configured to enable TOE, they can be added to a team and the offload is transparent to BASP.

  • Page 107: Hardware Requirements

    The Broadcom Advanced Control Suite utility is used to configure teaming in the supported operating system environments. The Broadcom Advanced Control Suite (BACS) utility is designed to run on 32-bit and 64-bit Windows family of operating systems. BACS is used to configure load balancing and fault tolerance teaming, and VLANs. In addition, it displays the MAC address, driver version, and status information about each network adapter.

  • Page 108: Selecting A Team Type

    SLB with one primary and one standby member. Requires at least one Broadcom adapter in the team. c TOE functionality can only be achieved with SLB teams that consist of all Broadcom TOE-enabled adapters. Selecting a Team Type The following flow chart provides the decision flow when planning for Layer 2 teaming. For TOE teaming, only Smart Load Balancing™...

  • Page 109: Teaming Mechanisms

    Attributes of the Features Associated with Each Type of Team Speeds Supported for Each Type of Team Architecture The Broadcom Advanced Server Program is implemented as an NDIS intermediate driver (see Figure 2). It operates below protocol stacks such as TCP/IP and IPX and appears as a virtual adapter. This virtual adapter inherits the MAC Address of the first port initialized in the team.

  • Page 110: Outbound Traffic Flow

    Figure 2: Intermediate Driver Outbound Traffic Flow The Broadcom Intermediate Driver manages the outbound traffic flow for all teaming modes. For outbound traffic, every packet is first classified into a flow, and then distributed to the selected physical adapter for transmission. The flow classification involves an efficient hash computation over known protocol fields.

  • Page 111: Inbound Traffic Flow (Slb Only)

    Inbound Traffic Flow (SLB Only) The Broadcom intermediate driver manages the inbound traffic flow for the SLB teaming mode. Unlike outbound load balancing, inbound load balancing can only be applied to IP addresses that are located in the same subnet as the load- balancing server.
  • Page 112 Switch-Independent The Broadcom Smart Load Balancing type of team allows two to eight physical adapters to operate as a single virtual adapter. The greatest benefit of the SLB type of team is that it operates on any IEEE compliant switch and requires no special configuration.

  • Page 113: Generic Static Trunking

    Outbound Load Balancing using MAC Address – No Outbound Load Balancing using IP Address - Yes Multivendor teaming – Supported (Must include at least one Broadcom Ethernet adapter as a team member) Applications Generic trunking works with switches that support Cisco Fast EtherChannel, Cisco Gigabit EtherChannel, Extreme Networks Load Sharing and Bay Networks or IEEE 802.3ad Link Aggregation static mode.

  • Page 114: Attributes Of The Features Associated With Each Type Of Team

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide Multivendor teaming – Supported (Must include at least one Broadcom Ethernet adapter as a team member) Applications Dynamic trunking works with switches that support IEEE 802.3ad Link Aggregation dynamic mode using LACP. Inbound load balancing is switch dependent.

  • Page 115: Speeds Supported For Each Type Of Team

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide Hot replace Hot add Hot remove Link speed support Different speeds Frame protocol Incoming packet management Switch Outgoing packet management BASP Failover event Loss of link only Failover time <500 ms Fallback time 1.5 s...

  • Page 116: Checksum Offload

    Large Send Offload Large Send Offload (LSO) is a feature provided by Broadcom network adapters that prevents an upper level protocol such as TCP from breaking a large data packet into a series of smaller packets with headers appended to them. The protocol stack need only generate a single header for a data packet as large as 64 KB, and the adapter hardware breaks the data buffer into appropriately-sized Ethernet frames with the correctly sequenced header (based on the single header originally provided).

  • Page 117: Jumbo Frames

    Without the TCP Offload Engine, the TCP/IP protocol suite runs on the host CPU, consuming a very high percentage of its resources and leaving little resources for the applications. With the use of the Broadcom NetXtreme II adapter, the TCP/IP processing can be moved to hardware, freeing the CPU for more important tasks such as application processing.

  • Page 118: Teaming With Microsoft Virtual Server 2005

    The only supported BASP team configuration when using Microsoft Virtual Server 2005 is with a Smart Load Balancing (TM) team-type consisting of a single primary Broadcom adapter and a standby Broadcom adapter. Make sure to unbind or deselect "Virtual Machine Network Services" from each team member prior to creating a team and prior to creating Virtual networks with Microsoft Virtual Server.
  • Page 119 Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide The addition of a link between the switches allows traffic from/to Blue and Gray to reach each other without any problems. Note the additional entries in the CAM table for both switches. The link interconnect is critical for the proper operation of the team.

  • Page 120: Spanning Tree Algorithm

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide Figure 5 represents a failover event in which the cable is unplugged on the Top Switch port 4. This is a successful failover with all stations pinging each other without loss of connectivity.
  • Page 121 Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide that has a lost link on one of its physical adapters. If the physical adapter were to be reconnected (also known as fallback), the intermediate driver would detect that the link has been reestablished and would begin to pass traffic through the port.

  • Page 122: Generic And Dynamic Trunking (Fec/Gec/Ieee 802.3Ad)

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide SLB Teams SLB teams are the only teaming type not dependant on switch configuration. The server intermediate driver handles the load balancing and fault tolerance mechanisms with no assistance from the switch. These elements of SLB make it the only team type that maintains failover and fallback characteristics when team ports are connected directly to a hub.

  • Page 123: Teaming And Clustering

    Multiple adapters may be used for each of these purposes: private, intracluster communications and public, external client communications. All Broadcom teaming modes are supported with Microsoft Cluster Software for the public adapter only. Private network adapter teaming is not supported. Microsoft indicates that the use of teaming on the private interconnect of a server cluster is not supported because of delays that could possibly occur in the transmission and receipt of heartbeat packets between the nodes.

  • Page 124: High-Performance Computing Cluster

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide NOTE: Microsoft Network Load Balancing is not supported with Microsoft Cluster Software. High-Performance Computing Cluster Gigabit Ethernet is typically used for the following three purposes in high-performance computing cluster (HPCC) applications: Inter-Process Communications (IPC): For applications that do not require low-latency, high-bandwidth interconnects (such as Myrinet, InfiniBand), Gigabit Ethernet can be used for communication between the compute nodes.

  • Page 125: Advanced Features

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide Advanced Features PXE is used extensively for the deployment of the cluster (installation and recovery of compute nodes). Teaming is typically not used on the host side and it is not a part of our standard offering. Link aggregation is commonly used between switches, especially for large configurations.

  • Page 126: Load Balancing And Failover

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide Load Balancing and Failover Fault Tolerance When you perform network backups in a nonteamed environment, overall throughput on a backup server adapter can be easily impacted due to excessive traffic and adapter overloading. Depending on the number of backup servers, data streams, and tape drive speed, backup traffic can easily consume a high percentage of the network link bandwidth, thus impacting production data and tape backup performance.

  • Page 127: Fault Tolerance

    If a network link fails during tape backup operations, all traffic between the backup server and client stops and backup jobs fail. If, however, the network topology was configured for both Broadcom SLB and switch fault tolerance, then this would allow tape backup operations to continue without interruption during the link failure.

  • Page 128: Troubleshooting Teaming Problems

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide Troubleshooting Teaming Problems Teaming Configuration Tips Troubleshooting Guidelines When running a protocol analyzer over a virtual adapter teamed interface, the MAC address shown in the transmitted frames may not be correct. The analyzer does not show the frames as constructed by BASP and shows the MAC address of the team and not the MAC address of the interface transmitting the frame.

  • Page 129: Frequently Asked Questions

    Question: What network protocols are load balanced when in a team? Answer: Broadcom's teaming software only supports IP/TCP/UDP traffic. All other traffic is forwarded to the primary adapter. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/teamsvcs.htm[9/5/2014 3:45:08 PM]...
  • Page 130 Setup installer. Question: How can I determine the performance statistics on a virtual adapter (team)? Answer: In Broadcom Advanced Control Suite, click the Statistics tab for the virtual adapter. Question: Can I configure NLB and teaming concurrently? Answer: Yes, but only when running NLB in a multicast mode (NLB is not supported with MS Cluster Services).

  • Page 131: Appendix A: Event Log Messages

    Base Driver (Physical Adapter/Miniport) Intermediate Driver (Virtual Adapter/Team) Virtual Bus Driver (VBD) Windows System Event Log Messages The known base and intermediate Windows System Event Log status messages for the Broadcom NetXtreme II adapters are listed in Table 8 Table 9.
  • Page 132 Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide usage. The driver cannot allocate Failed to allocate map Unload other drivers that may allocate map Error map registers from the registers. registers. operating system. Failed to access The driver cannot access PCI...

  • Page 133: Intermediate Driver (Virtual Adapter/Team)

    Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide This driver does not support this device. The driver does not recognize Upgrade to a driver version that supports Error Upgrade to the latest the installed adapter. this adapter. driver.
  • Page 134 Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide The physical adapter is Network adapter is Informational connected to the network (it No action is required. connected. has established link). Broadcom Advanced Program Features Driver is The driver does not support...
  • Page 135 Broadcom Teaming Services: Broadcom NetXtreme II® Network Adapter User Guide manually configured for Informational configured for 10Mb No action is required. the selected line speed full-duplex link. and duplex settings. The adapter has been Network controller manually configured for Informational configured for 100Mb No action is required.

  • Page 136: Supported Operating Systems For Nic Partitioning

    Overview NIC partitioning (NPAR) divides a Broadcom NetXtreme II 10 Gigabit Ethernet NIC into multiple virtual NICs by having multiple PCI physical functions per port. Each PCI function is associated with a different virtual NIC. To the OS and the network, each physical function appears as a separate NIC port.
  • Page 137 NIC Partitioning: Broadcom NetXtreme II® Network Adapter User Guide NOTE: In NPAR mode, SR-IOV cannot be enabled on any PF on which storage offload (FCoE or iSCSI) is configured. This does not apply to adapters in Single Function (SF) mode.
  • Page 138 NIC Partitioning: Broadcom NetXtreme II® Network Adapter User Guide FCoE FCoE World Wide Port Name. WWPN FCoE FCoE World Wide Node Name. WWNN Note: Ensure that the Network MAC Address and the iSCSI MAC Address are not the same. Configuring equal Bandwidth Weight values for all functions has different effects depending on the actual values used for configuration.
  • Page 139 Modify System Boot Order The Broadcom initiator must be the first entry in the system boot order. The second entry must be the OS installation media. It is important that the boot order be set correctly or else the installation will not proceed correctly. Either the desired boot LUN will not be discovered or it will be discovered but marked offline.
  • Page 140 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 2. Select the device through which boot is to be configured. NOTE: IMPORTANT: When running in NIC Partitioning (NPAR) mode, FCoE boot is supported only when the first function on each port is assigned an FCoE personality. FCoE boot is not supported when the FCoE personality is assigned to any other function.
  • Page 141 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 4. On some platforms, you may need to set the boot protocol through system BIOS configuration in the integrated devices pane as described above. For all other devices, set the Boot Protocol field to FCoE in the MBA Configuration Menu through CCM.
  • Page 142 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 6. Enable the Connect field. Enter the target WWPN and Boot LUN information for the target to be used for boot. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 143 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 7. Press ESC until prompted to exit and save changes. 8. Proceed to OS installation once storage access has been provisioned in the SAN. Provisioning Storage Access in the SAN Storage access consists of zone provisioning and storage selective LUN presentation, each of which is commonly provisioned per initiator WWPN.
  • Page 144 One-Time Disabled Broadcom's FCoE ROM is implemented as Boot Entry Vector (BEV). In this implementation, the Option ROM only connects to the target once it has been selected by BIOS as the chosen boot device. This is different from other implementations that will connect to the boot device even if another device has been selected by the system BIOS. For OS installation over the FCoE path, it is necessary to instruct the Option ROM to bypass FCoE and skip to CD/DVD installation media.
  • Page 145 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 2. Then load the bxfcoe (OFC) driver. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 146 Windows Server 2012 FCoE Boot Installation For Windows Server 2012 Boot from SAN installation, Broadcom requires the use of a "slipstream" DVD or iso image with the latest Broadcom drivers injected. See Injecting (Slipstreaming) Broadcom Drivers into Windows Image Files in the iSCSI chapter.
  • Page 147 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide SLES11 SP2 Installation RHEL6 Installation SLES11 SP2 Installation 1. Boot from the SLES11 SP2 installation medium and on the installation splash screen press F6 for driver update disk. Select Yes. In boot options, type withfcoe=1. Select Installation to proceed.
  • Page 148 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 3. Once the driver update is complete, select Next to continue with OS installation. 4. When requested, click Configure FCoE Interfaces. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 149 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 5. Ensure FCoE Enable is set to yes on the 10GbE Broadcom initiator ports you wish to use as the SAN boot path(s). file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 150 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 6. For each interface to be enabled for FCoE boot, click Change Settings and ensure FCoE Enable and AUTO_VLAN are set to yes and DCB required is set to no.
  • Page 151 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 9. Click Next to continue installation. YaST2 will prompt to activate multipath. Answer as appropriate. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 152 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 10. Continue installation as usual. 11. Under the Expert tab on the Installation Settings screen, select Booting. 12. Select the Boot Loader Installation tab and then select Boot Loader Installation Details, make sure you have one boot loader entry here. Delete all redundant entries.
  • Page 153 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 13. Click OK to proceed and complete installation. RHEL6 Installation 1. Boot from the installation medium. 2. For RHEL6.3, an updated Anaconda image is required for FCoE BFS. That updated image is provided by Red Hat at the following URL http://rvykydal.fedorapeople.org/updates.823086-fcoe.img.
  • Page 154 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 5. When prompted Do you have a driver disk, enter Yes. Note: RHEL does not allow driver update media to be loaded via the network when installing driver updates for network devices.
  • Page 155 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 6. Once drivers are loaded, proceed with installation. 7. Select Specialized Storage Devices when prompted. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 156 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 8. Click Add Advanced Target. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 157 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 9. Select Add FCoE SAN. and select Add drive. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 158 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 10. For each interface intended for FCoE boot, select the interface, deselect Use DCB, select Use auto vlan, and then click Add FCoE Disk(s). file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 159 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 11. Repeat steps 8 through 10 for all initiator ports. 12. Confirm all FCoE visible disks are visible under Multipath Devices and/or Other SAN Devices. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 160 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 13. Click Next to proceed. 14. Click Next and complete installation as usual. Upon completion of installation, the system will reboot. 15. Once booted, ensure all boot path devices are set to start on boot. Set onboot=yes under each network interface config file in /etc/sysconfig/network-scripts.
  • Page 161 # mkinitrd VMware ESXi 5.1 FCoE Boot Installation FCoE Boot from SAN requires that the latest Broadcom NetXtreme II async drivers be included into the ESXi 5.1 install image. Refer to Image_builder_doc.pdf from VMware on how to slipstream drivers. 1. Boot from the updated ESXi 5.1 installation image and select ESXi 5.1 installer when prompted.
  • Page 162 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 3. Press F11 to accept the agreement and continue. 4. Select the boot LUN for installation and press Enter to continue. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 163 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 5. Select the desired installation method. 6. Select the keyboard layout. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 164 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 7. Enter a password. 8. Press F11 to confirm the install. 9. Press Enter to reboot after installation. file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/fcoe.htm[9/5/2014 3:45:12 PM]...
  • Page 165 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide 10. On 57800 and 57810 boards, the management network is not vmnic0. After booting, open the GUI console and display the configure management network > network adapters screen to select the NIC to be used as the management network device.
  • Page 166 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide NOTE: ESXi 5.1 has a limitation in that a VLAN ID change for a boot device is not possible. It works only for non-boot devices. Configuring FCoE Boot from SAN on VMware Note that each host must have access only to its own boot LUN —...
  • Page 167 Fibre Channel Over Ethernet: Broadcom NetXtreme II® Network Adapter User Guide Driver Upgrade on Linux Boot From SAN Systems 1. Remove the existing installed NetXtreme ll package. Log in as root. Query for the existing NetXtreme ll package and remove it using the following commands: # rpm -e <NetXtreme II package name>...

  • Page 168: Configuring Fcoe

    Configuring FCoE By default, DCB is enabled on Broadcom NetXtreme II FCoE-, DCB-compatible C-NICs. Broadcom NetXtreme II FCoE requires a DCB-enabled interface. For Windows operating systems, use either Broadcom Advanced Control Suite (BACS) or Broadcom's Comprehensive Configuration Management (CCM) utility to configure the DCB parameters. See...

  • Page 169: Enhanced Transmission Selection (Ets)

    Data Center Bridging (DCB): Broadcom NetXtreme II® Network Adapter User Guide Back to Contents Page ® Data Center Bridging (DCB): Broadcom NetXtreme II Network Adapter User Guide Overview DCB Capabilities Configuring DCB DCB Conditions Data Center Bridging in Windows Server 2012...
  • Page 170 For more information on using PowerShell Cmdlets, see the "DCB Windows PowerShell User Scripting Guide" in the Microsoft Technet Library. To revert to standard BACS control over the Broadcom DCB feature set, uninstall the Microsoft QOS feature or disable Quality file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/dcb.htm[9/5/2014 3:45:14 PM]...
  • Page 171 Service in the NDIS advance properties page. NOTE: Broadcom recommends that you do not install the DCB feature if SR-IOV will be used. If you install the DCB feature, be aware that selecting Enable single-root I/O virtualization (SR-IOV) in Virtual Switch Manager will force the...
  • Page 172 Single-root I/O virtualization section, select Enable SR-IOV. 4. Install the Broadcom drivers for the adapters detected in the VM. Use the latest drivers available from your vendor for the host OS (do not use the inbox drivers). The same driver version must be installed on the host and the VM.
  • Page 173 SR-IOV: Broadcom NetXtreme II® Network Adapter User Guide To verify that SR-IOV is operational 1. Start the VM. 2. In Hyper-V Manager, select the adapter and select the VM in the Virtual Machines list. 3. Select the Networking tab at the bottom of the window and view the adapter status.

  • Page 174: Broadcom Advanced Control Suite Overview

    For information on the latest supported OS versions, refer to the release documentation provided with your software distribution. Starting Broadcom Advanced Control Suite In Control Panel, click Broadcom Control Suite 4, or click the BACS icon in the taskbar located at the bottom of the Windows or Windows Server desktop.

  • Page 175: Explorer View Pane

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide Context View selector below the menu bar, and the Description pane below the Context View pane. Drag the splitter between any two panes to vary the size of the panes.

  • Page 176: Context View Pane

    Explorer View: Displays/hides the Explorer View pane. Tool Bar: Displays/hides the tool bar. Status Bar: Displays/hides the status bar. Broadcom Logo: Displays/hides the Broadcom Logo on BACS to optimize the maximum viewable space. Tools menu Options: Used for configuring BACS preferences.

  • Page 177: Description Pane

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide Manage iSNS Servers The Manage iSNS Servers window is available from the iSCSI menu. From this window, you can add or remove Internet Storage Name Service (iSNS) servers.

  • Page 178: Managing The Host

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 1. From the Action menu, click Add Host. 2. Type the remote host's name or IP address in the Host box. 3. Select the protocol from the Protocol list. The protocol options for Windows are WMI, WSMan, or Try All. The protocol options for Linux are CimXML, WSMan, or Try All.

  • Page 179: Information Tab: Iscsi Initiator

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide Displays the operating system, including the version. Platform Displays the hardware architecture platform (for example, 32-bit or 64-bit) Information Tab: iSCSI Initiator The iSCSI Initiator section of the Information tab is available if iSCSI is enabled on the host.

  • Page 180: Managing The Network Adapter

    Information Tab: Resources Bus Type The type of input/output (I/O) interconnect used by the adapter. Bridge The bridge type, which is the PCI-E to PCI-X bridge. This information is only available for Broadcom NetXtreme II adapters. Bridge Lanes file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/bacs.htm[9/5/2014 3:45:16 PM]...

  • Page 181: Viewing Hardware Information

    The chip version of the Broadcom adapter (this information is not available for adapters made by others). Firmware Version The firmware version of the Broadcom adapter (this information is not available for adapters made by others). This information is only available for Broadcom NetXtreme adapters.

  • Page 182: Configuring Adapter Parameters

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide Family Firmware Version The global firmware version that represents all firmware on the device. Management Firmware The firmware version installed on the system. Vendor ID The vendor ID.

  • Page 183: Viewing Vital Signs

    To view Vital Signs information for any installed network adapter, select the name of the adapter listed in the Explorer View pane, then click the Information tab. NOTES: Information about Broadcom network adapters may be more comprehensive than information about network adapters made by others. Some information may not be available for all Broadcom network adapters.
  • Page 184 The link speed of the adapter, in megabits per second. Offload Capabilities The offload capabilities supported by the adapter. This information is only available for Broadcom NetXtreme II adapters. TOE. TCP Offload Engine (TOE) allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1-Gbps network adapters and 1880 fully offloaded TCP connections for 10-Gbps network adapters to the hardware.

  • Page 185: Viewing Nic Partitioning Information

    Each PCI function is associated with a different virtual NIC. To the OS and the network, each physical function appears as a separate NIC port. For more information, see the NIC Partitioning topic in the Broadcom NetXtreme II Network Adapter User Guide.

  • Page 186: Running Diagnostic Tests In Windows

    Running Diagnostic Tests in Windows The Diagnostic Tests option on the Diagnostics tab lets you check the state of the physical components on a Broadcom network adapter. You can trigger the tests manually, or choose to have BACS continuously perform them. If the test are performed continuously, then the number of passes and fails in the Result field for each test increments every time the tests are performed.
  • Page 187 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide other OSes. You can, however use BACS on a Linux client to connect to a Windows Server host and run the diagnostic test utility. You must have administrator privileges to run diagnostic tests.

  • Page 188: Analyzing Cables In Windows

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide An EEPROM image upgrade does not require a code change for this test. Internal Memory This test verifies that the internal memory of the adapter is functioning properly. The test writes patterned values to the memory and reads back the results.
  • Page 189 2. Click the name of the adapter to test in the Explorer View pane. NOTE: For Broadcom NetXtreme II adapters, select a VBD driver; for other adapters, select an NDIS driver. 3. From the Select a test to run list, select Cable Analysis.

  • Page 190: Managing The Lan Device

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide The valid cable length in meters (except when the Noise result is returned). Status The result of the analysis for the indicated pair. Good. Good cable/PCB signal paths, but no gigabit link.

  • Page 191: Viewing Ndis Information

    Select the NDIS driver in the Explorer View pane, and then select the Information tab to view NDIS-level information. NOTES: Information about Broadcom network adapters may be more comprehensive than information about network adapters made by others. Some information may not be available for all Broadcom network adapters.

  • Page 192: Configuring The Ndis Driver

    The unique hardware address assigned to the network adapter. Offload Capabilities The offload capabilities supported by the adapter. This information is only available for Broadcom NetXtreme II adapters. TOE. TCP Offload Engine (TOE) allows simultaneous operation of up to 1024 fully offloaded TCP connections for 1-Gbps network adapters and 1880 fully offloaded TCP connections for 10-Gbps network adapters to the hardware.
  • Page 193 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide NOTES: You must have administrator privileges to change the values for a property. The list of available properties for your particular adapter may be different. Some properties may not be available for all Broadcom network adapters.
  • Page 194 9000 bytes in length (9600 bytes for network adapters that operate at 10 Gbps). This property requires the presence of a switch that is able to process jumbo frames. This property is only available for Broadcom NetXtreme II adapters.
  • Page 195 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide Both Disabled. LSO & Jumbo frames are both disabled. LSO Enabled, Jumbo Off (default). LSO enabled and jumbo frames disabled. LSO Off, Jumbo 3000. Frame size of 3000 bytes and LSO off.
  • Page 196 Enables the network adapter to wake up from a low-power mode when it receives a network wake-up frame. Two types of wake-up frames are possible: Magic Packet™ and Wake Up Frame. This property is only available for Broadcom NetXtreme adapters.
  • Page 197 VLAN membership. Since support for VLAN tagging on Broadcom's NDIS 6.0 driver is limited to transmit (Tx) traffic only, there is a risk of inbound traffic (Rx) from a different VLAN being passed up to the operating system. However, based on the premise of a properly configured network above, the IP segmentation and/or the switch VLAN configuration may provide additional filtration to limit the risk.

  • Page 198: Viewing Resource Information

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide default value. Transmit Buffers (0=Auto) The number of transmit buffers. Transmit buffers are data segments that allow the network adapter to monitor transmit packets in the system memory. The range of valid transmit buffers is 0 to 5000 in increments of 1 with 250 transmit buffers as the default value.

  • Page 199: Configuring System Settings

    (IPv4) or TCP Connection Offload (IPv6) from the Advanced area of the Configuration tab. Viewing Statistics The information provided on the Statistics tab allows you to view traffic statistics for both Broadcom network adapters and network adapters made by others. Statistical information and coverage are more comprehensive for Broadcom adapters.
  • Page 200 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide General Statistics General Statistics show the transmitted and received statistics to and from the adapter. Frames Tx OK A count of the frames that were successfully transmitted. This counter is incremented when the transmit status is reported as Transmit OK.
  • Page 201 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide A count of frames that were successfully received and are directed to an active nonbroadcast group address. This does not include frames received with frame-too-long, FCS, length, or alignment errors, nor frames lost because of internal MAC sublayer errors. This counter is incremented as indicated by the Receive OK status.
  • Page 202 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide Session format error The number of sessions with errors due to inconsistent fields, reserved fields not 0, non-existent LUN, etc. Sessions failed The number of failed sessions.
  • Page 203 NOTE: Custom statistics are available only for an enabled Broadcom network adapter. Out of Recv. Buffer The number of times the adapter ran out of Receive Buffer Descriptors. This information is only available for Broadcom NetXtreme II adapters. Frames size less than 64-byte with bad FCS The number of frames with a size less than 64 bytes with bad FCS.

  • Page 204: Configuring The Ip Address For Iscsi Offload

    CPU to the Broadcom network adapter. 1. Click the name of the Broadcom NetXtreme II iSCSI device in the SCSI controller section of the Explorer View pane. 2. Depending on the protocol you will be using, for IPv4 DHCP or IPv6 DHCP, select Enable (not available for iSCSI booted adapters) to set the IP address dynamically using a DHCP server.

  • Page 205: Configuring Teaming

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide NOTES: The Licenses section of the Configurations tab is only available for Broadcom NetXtreme II adapters and VBD drivers. Not all offload technologies are available with all adapters.

  • Page 206: Standby Team Member And Auto-Fallback Disable Mode

    The purpose of LiveLink is to detect link loss beyond the switch and to route traffic only through team members that have a live link. Using the Broadcom Teaming Wizard You can use the Broadcom Teaming Wizard to create a team, configure an existing team if a team has already been created, or create a VLAN.
  • Page 207 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 2. To continue using the wizard, click Next. 3. Type the team name and then click Next. If you want to review or change any of your settings, click Back. Click Cancel to discard your settings and exit the wizard.
  • Page 208 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 4. Select the type of team you want to create. 5. Select Enable Hyper-V Mode if you want to enable Windows virtualization services. See "Microsoft Virtualization with Hyper- V"...
  • Page 209 Team Members list by clicking the adapter and then clicking Remove. Click Next. NOTE: There must be at least one Broadcom network adapter assigned to the team. NOTE: A team created with a single adapter will not have load balancing or failover capabilities.
  • Page 210 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 8. If you want to designate one of the adapters as a standby member (optional), select Use the following member as a standby member, then choose the standby member from the list of adapters.
  • Page 211 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 10. If you want to configure LiveLink, select Yes, otherwise select No, then click Next. 11. Select the probe interval (the number of seconds between each retransmission of a link packet to the probe target) and the maximum number of probe retries (the number of consecutively missed responses from a probe target before a failover is triggered).
  • Page 212 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 16. Type the VLAN name and then click Next. NOTE: The team name cannot exceed 39 characters, cannot begin with spaces, and cannot contain any of the following characters: &...
  • Page 213 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide add additional VLANs (see Step 19. of this procedure). 18. Type the VLAN tag value and then click Next. The value must be between 1 and 4094.
  • Page 214 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide additional VLANs. NOTE: You can define up to 64 VLANs per team (63 VLANs that are tagged and 1 VLAN that is not tagged). Adding several VLANS may slow down the reaction time of the Windows interface due to memory and processor time usage for each VLAN.
  • Page 215 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide NOTE: At any point in the Broadcom Teaming Wizard procedure, click Preview to get a visual representation of what the team will look like before committing any changes.

  • Page 216: Using Expert Mode

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide Using Expert Mode Use Expert Mode to create a team, modify a team, add a VLAN, and configure LiveLink for a Smart Load Balance and Failover and SLB (Auto-Fallback Disable) team.
  • Page 217 8. You can assign any other available adapter to be a standby member by selecting it from the Standby Member list. NOTE: There must be at least one Broadcom network adapter assigned to the team. NOTE: A team created with a single adapter will not have load balancing or failover capabilities.
  • Page 218 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 12. Click Apply/Exit to create all the teams you have defined and exit the Manage Teams window. 13. Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted.

  • Page 219: Adding A Vlan

    You can define up to 64 VLANs per team (63 VLANs that are tagged and 1 VLAN that is not tagged). VLANs can only be created when all teams members are Broadcom adapters. If you try to create a VLAN with a non-Broadcom adapter, an error message is displayed.
  • Page 220 Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide 8. Click Yes when the message is displayed indicating that the network connection will be temporarily interrupted. NOTE: To maintain optimum adapter performance, your system should have 64 MB of system memory for each of the eight VLANs created per adapter.

  • Page 221: Viewing Basp Statistics

    Using Broadcom Advanced Control Suite 4: Broadcom NetXtreme II® Network Adapter User Guide A probe target must be on the same subnet as the team, have a valid (not a broadcast, multicast, or unchaste), statically-assigned IP address, and be highly available (always on).

  • Page 222: Configuring With The Command Line Interface Utility

    For a complete list of available commands and examples, see the BACSCLI ReadMe text file on the Dell-provided CD. On a system with Broadcom NetXtreme I and NetXtreme II network adapters, BACSCLI is installed when BACS is installed with the installer.

  • Page 223: Performing Diagnostics

    Broadcom NetXtreme II User Diagnostics is an MS-DOS based application that runs a series of diagnostic tests (see Table on the Broadcom NetXtreme II network adapters in your system. Broadcom NetXtreme II User Diagnostics also allows you to update device firmware and to view and change settings for available adapter properties. There are two versions of the Broadcom NetXtreme II User Diagnostics: uxdiag.exe (for BCM5708/BCM5709 network adapters) and uediag.exe (for...
  • Page 224 <groups/tests> uxdiag -T Enables certain groups/tests. <groups/tests> uxdiag -ver Displays the version of Broadcom NetXtreme II User Diagnostics (uxdiag) and all installed adapters. Enables/disables Magic Packet WOL. uxdiag -wol <1/0> 1 = Enable 0 = Disable Table 2: uediag Command Options...

  • Page 225: Diagnostic Test Descriptions

    Disables certain groups/tests. <groups/tests> uediag -T Enables certain groups/tests. <groups/tests> uediag -ver Displays the version of Broadcom NetXtreme II User Diagnostics (uediag) and all installed adapters. Enables/disable Magic Packet WOL. uediag -wol <1/0> 1 = Enable 0 = Disable Diagnostic Test Descriptions The diagnostic tests are divided into four groups: Basic Functional Tests (Group A), Memory Tests (Group B), Block Tests (Group C), and Ethernet Traffic Tests (Group D).
  • Page 226 Scratchpad TAS Header Buffer TAS Payload The Group B tests verify all memory blocks of the Broadcom NetXtreme II adapter by writing Buffer various data patterns (0x55aa55aa, 0xaa55aa55, walking zeroes, walking ones, address, etc.) to RBUF via each memory location, reading back the data, and then comparing it to the value written. The fixed...
  • Page 227 This is another loopback path that is used by Layer 4 and Layer 5 traffic within the MAC block. As packets are received back by Broadcom NetXtreme II User Diagnostics, they are checked for errors. The adapter should not be connected to a network.
  • Page 228 Specifications: Broadcom NetXtreme II® Network Adapter User Guide Back to Contents Page ® Specifications: Broadcom NetXtreme II Network Adapter User Guide 10/100/1000BASE-T and 10GBASE-T Cable Specifications Interface Specifications NIC Physical Characteristics NIC Power Requirements Wake On LAN Power Requirements Environmental Specifications...
  • Page 229 Specifications: Broadcom NetXtreme II® Network Adapter User Guide Finisar Corp. FTLX8571D3BCL p/n N743D Intel Corp. AFBR-703SDZ-IN2 p/n R8H2F Intel Corp. FTLX8571D3BCV-IT Direct Attach Cables Cisco-Molex Inc. 74752-9093 p/n K585N Cisco-Molex Inc. 74752-9094 p/n J564N Cisco-Molex Inc. 74752-9096 p/n H603N Cisco-Molex Inc. 74752-9098...

  • Page 230: Interface Specifications

    Specifications: Broadcom NetXtreme II® Network Adapter User Guide Brocade 58-1000023-01 p/n 48V40 Amphenol 599700002 p/n C4D08 - Force10 1m DAC Amphenol 616740001 Amphenol 599700006 p/n 53HVN - Force10 3m DAC Amphenol 616740003 Amphenol 599700004 p/n 5CN56 - Force10 5m DAC...
  • Page 231 Specifications: Broadcom NetXtreme II® Network Adapter User Guide 10 Mbit 1.12 3.71 Table 11: BCM57710/BCM57711/BCM57712 NIC Power Requirements Link NIC 12V Current Draw (A) NIC 3.3V Current Draw (A) NIC Power (W) Idle (no link) 0.60 0.28 8.12 Low power mode 0.50...

  • Page 232: Wake On Lan Power Requirements

    Specifications: Broadcom NetXtreme II® Network Adapter User Guide Wake On LAN Power Requirements Nominal power: BCM957810A1006G: 3.0W BCM957810a1008G: 4.5W The tables below show the Wake On LAN power requirements for 1G adapters. Table 16: BCM5708C Wake On LAN Power Requirements (Nominal Conditions)
  • Page 233 Specifications: Broadcom NetXtreme II® Network Adapter User Guide Table 21: BCM957810A1008G Environmental Specifications Parameter Condition Operating Temperature 0°C to 55°C Air Flow Requirement (LFM) Storage Temperature –40°C to +65°C Storage Humidity 5% to 95% condensing Vibration and Shock IEC 68, FCC Part 68.302, NSTA, 1A...

  • Page 234: Fcc Notice

    Consult the dealer or an experienced radio/TV technician for assistance. Do not make mechanical or electrical modifications to the equipment. NOTE: If the device is changed or modified without permission of Broadcom, the user may void his or her authority to operate the equipment.

  • Page 235: Vcci Notice

    Plug the system into a different outlet so that the system and receiver are on different branch circuits. Do not make mechanical or electrical modifications to the equipment. NOTE: If the device is changed or modified without permission of Broadcom, the user may void his or her authority to operate the equipment.
  • Page 236 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide CAUTION! The potential exists for this equipment to become impaired in the presence of conducted radio frequency energy between the frequency range of 59–66 MHz. Normal operation will return upon removal of the RF energy source.
  • Page 237 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide Class A Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709A0916G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1022G BCM957710A1021G BCM957711A1113G BCM957711A1102G BCM957840A4006G BCM957840A4007G file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 238 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 239 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 240 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 241 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...

  • Page 242: Canadian Regulatory Information (Canada Only)

    Sunnyvale, California 94086 USA This Class B digital apparatus complies with Canadian ICES-003. Notice: The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment. Industry Canada, Class A...

  • Page 243: Korea Communications Commission (Kcc) Notice (Republic Of Korea Only)

    Sunnyvale, California 94086 USA This Class A digital apparatus complies with Canadian ICES-003. Notice: The Industry Canada regulations provide that changes or modifications not expressly approved by Broadcom could void your authority to operate this equipment. Industry Canada, classe B...

  • Page 244: A Class Device

    Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide Broadcom NetXtreme II Gigabit Ethernet Controller BCM95708A0804F BCM95709A0907G BCM95709A0906G Broadcom Corporation 190 Mathilda Place Sunnyvale, California 94086 USA Note that this device has been approved for non-business purposes and may be used in any environment, including residential areas.
  • Page 245 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide BCM957711A1113G BCM957711A1102G BCM957810A1008G BCM957840A4006G BCM957840A4007G Broadcom Corporation 190 Mathilda Place Sunnyvale, California 94086 USA BSMI file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 246 Certifications for BCM95709SA0908G, BCM957710A1023G, E02D001, and BCM957711A1123G (E03D001) This section is included on behalf of Dell, and Broadcom is not responsible for the validity or accuracy of the information. The BCM95709SA0908G Broadcom NetXtreme II Gigabit Ethernet Controller and the BCM957710A1023G, E02D001, and...

  • Page 247: Vcci Class A Statement (Japan)

    Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide One Dell Way PS4-30 Round Rock, Texas 78682, USA 512-338-4400 This device complies with Part 15 of the FCC Rules. Operations is subject to the following two conditions: 1) This device may not cause harmful interference, and 2) This device must accept any interference received, including interference that may cause undesired operation.
  • Page 248 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide CE Notice Class A Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709SA0908G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1023G BCM957711A1123G (E03D001) E02D001 Dell Inc. Worldwide Regulatory Compliance, Engineering and Environmental Affairs...
  • Page 249 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 250 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 251 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide file:///C|/Users/Nalina_N_S/Documents/NetXtremeII/English/regs.htm[9/5/2014 3:45:21 PM]...
  • Page 252 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide Canadian Regulatory Information (Canada Only) Industry Canada, Class A Broadcom NetXtreme II Gigabit Ethernet Controller BCM95709SA0908G Broadcom NetXtreme II 10 Gigabit Ethernet Controller BCM957710A1023G BCM957711A1123G (E03D001) E02D001 Dell Inc. Worldwide Regulatory Compliance, Engineering and Environmental Affairs...
  • Page 253 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide BCM957711A1123G (E03D001) E02D001 Dell Inc. Worldwide Regulatory Compliance, Engineering and Environmental Affairs One Dell Way PS4-30 Round Rock, Texas 78682, USA 512-338-4400 Cet appareil numérique de classe A est conforme à la norme canadienne ICES-003.
  • Page 254 Regulatory Information: Broadcom NetXtreme II® Network Adapter User Guide End of Dell-provided certification information. The remainder of this document conforms to the general Restrictions and Disclaimers listed at the beginning of this user guide. Please read all Restrictions and Disclaimers.

  • Page 255: Hardware Diagnostics

    Troubleshooting: Broadcom NetXtreme II® Network Adapter User Guide Back to Contents Page ® Troubleshooting: Broadcom NetXtreme II Network Adapter User Guide Hardware Diagnostics Checking Port LEDs Troubleshooting Checklist Checking if Current Drivers are Loaded Running a Cable Length Test Testing Network Connectivity...

  • Page 256: Checking Port Leds

    Safety Precautions. The following checklist provides recommended actions to take to resolve problems installing the Broadcom NetXtreme II adapter or running it in your system. Inspect all cables and connections. Verify that the cable connections at the network adapter and the switch are attached properly.

  • Page 257: Running A Cable Length Test

    Instead, you can view the logs to verify that the proper driver is loaded and will be active upon reboot: dmesg | grep -i "Broadcom" | grep -i "bnx2" Running a Cable Length Test...

  • Page 258: Microsoft Virtualization With Hyper-V

    Troubleshooting: Broadcom NetXtreme II® Network Adapter User Guide From the command line, type ping IP address, and then press ENTER. The ping statistics that are displayed indicate whether or not the network connection is working. Microsoft Virtualization with Hyper-V Microsoft Virtualization is a hypervisor virtualization system for Windows Server 2008 and Windows Server 2008 R2. This section is intended for those who are familiar with Hyper-V, and it addresses issues that affect the configuration of NetXtreme II network adapters and teamed network adapters when Hyper-V is used.

  • Page 259: Teamed Network Adapters

    Troubleshooting: Broadcom NetXtreme II® Network Adapter User Guide Windows Server 2008 R2 and 2012 When configuring a NetXtreme II network adapter on a Hyper-V system, be aware of the following: An adapter that is to be bound to a virtual network should not be configured for VLAN tagging through the driver's advanced properties.

  • Page 260: Windows Server 2008 R2

    Removing the Device Drivers. When removing the device drivers, Broadcom Advanced Control Suite is also removed as well as all other management applications. If you manually uninstalled the device drivers with Device Manager and attempted to reinstall the device drivers but could not, run the Repair option from the InstallShield wizard.

  • Page 261: Upgrading Windows Operating Systems

    From Windows Server 2008 to Windows Server 2008 R2 From Windows Server 2008 R2 to Windows Server 2012 Prior to performing an OS upgrade when a Broadcom NetXtreme II adapter is installed on your system, Broadcom recommends the procedure below.
  • Page 262 Troubleshooting: Broadcom NetXtreme II® Network Adapter User Guide Solution: If a team member supports underlying management software (ASF/UMP) or Wake-On-LAN, the link may be maintained on the switch for the adapter despite its driver being disabled. This may result in the switch continuing to pass traffic to the attached port rather than route the traffic to an active team member port.
  • Page 263 Solution: Enable iSCSI Crash Dump from the Advanced section of the BACS Configuration tab. Problem: The Broadcom NetXtreme II adapter may not perform at optimal level on some systems if it is added after the system has booted.
  • Page 264 Troubleshooting: Broadcom NetXtreme II® Network Adapter User Guide Solution: Enable flow control to reduce the number of packets lost. Problem: A DCOM error message (event ID 10016) appears in the System Even Log during the installation of the Broadcom adapter drivers.

Table of Contents