Page 1
IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Page 3
IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Page 4
Note: Before using this information and the product it supports, read the general information in Appendix B, “Notices,” the Safety Information and Environmental Notices and User Guide documents on the IBM Notices for Network Devices CD, and the Warranty Information document that comes with the product.
Be sure to read all caution and danger statements in this document before you perform the procedures. Read any additional safety information that comes with the server or optional device before you install the device. This device is intended for use with UL Listed IBM Flex Systems. Statement 1: DANGER Electrical current from power, telephone, and communication cables is hazardous.
Page 9
Safety statements Statement 3: CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following: DANGER Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following. Laser radiation when open.
There are no serviceable parts inside these components. If you suspect a problem with one of these parts, contact a service technician. UL Regulatory Information This device is for use only with Listed IBM Flex System Enterprise Chassis. IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
EN4023 10Gb Scalable Switch is a high-density, 64-port, 10-Gbps Ethernet switch that is used in the IBM Flex System chassis. The switch provides 42 internal ports to compute nodes by way of the midplane, and 14 external SFP+ ports that are capable of running 10-Gbps Ethernet.
IBM Flex System chassis. • IBM Flex System Manager System Management Guide This document explains how to use the IBM Flex System Manager user interface to manage chassis components. • IBM Flex System network device User’s Guides...
Notices and statements Notices and statements Notices for Network Device Features and specifications The IBM Flex System EN4023 10Gb Scalable Switch supports the following features and specifications. Features • 64 10-Gbps Ethernet ports • Up to 42 internal ports connected to 14 compute nodes at the midplane auto-negotiating to 10-Gbps Ethernet (available through Ports-On-Demand activation) •...
• LEDs noting external port status and switch module status • Up to four hot-pluggable switches per IBM Flex System chassis • Brocade Network OS (NOS), which delivers distributed intelligence throughout the network and enables a wide range of value-added applications, for example, virtualization features that are distributed throughout a fabric, and multitenancy features.
32 MB (2 MB x 16, or 4 MB); also supports 8 MB devices of boot memory Environmental conditions and specifications See the documentation that comes with your IBM Flex System chassis for information about the environmental conditions and specifications that are supported by the system. Introduction...
Switch components Switch components Figure 1 shows the components of the IBM Flex System EN4023 10Gb Scalable Switch when viewed from the port side. Release levers (x2) RJ-45 Ethernet port (Mgmt) Port LEDs (Fault and activity for each port) System LEDs...
The Media Access Control (MAC) address is on a label located on the top handle of the switch. You will need this information when you register the switch with IBM. You can register the switch at http://www.ibm.com/support/mysupport/. TABLE 4...
Page 18
Product name and serial number IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
System chassis to install the switch in the chassis; then return to this User’s Guide for the information and instructions needed to complete the installation. Installation guidelines Before you install the IBM Flex System EN4023 10Gb Scalable Switch in the IBM Flex System chassis, pay attention to the following guidelines: •...
• You have followed the reliability guidelines in the documentation that comes with the chassis. Cable requirements for the switch are described in the IBM System x Configuration and Options Guide at http://www.ibm.com/servers/eserver/xseries/cog/. See the documentation that comes with the compute node for cable-routing information.
Installing a second switch enables a redundant path and a separate connection from the compute node to the external Ethernet switch. The chassis supports a maximum of four IBM Flex System EN4023 10Gb Scalable Switches and a maximum of 14 1-bay compute nodes.
Page 22
During POST, the switch LEDs will go through a lamp test. When the switch has completed POST, all LEDs except the OK LED will power off and follow normal operation. Refer to “Locating the information panel, LEDs, and external ports” on page 19 for more information. IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Installing and removing an SFP+ or QSFP transceiver The IBM Flex System EN4023 10Gb Scalable Switch supports 10-Gbps SFP+ transceivers. An SFP+ transceiver is a laser product that converts electrical signals to optical signals. See...
Installing and removing an SFP+ or QSFP transceiver FIGURE 4 QSFP transceiver For information on supported components, go to the IBM Server Proven website at http://www-03.ibm.com/systems/info/x86servers/serverproven/compat/us/flex.html. Handling an SFP+ or QSFP transceiver NOTES: Before installing an SFP+ or QSFP transceiver, be aware of the following information: •...
Installing and removing an SFP+ or QSFP transceiver Statement 3: CAUTION: When laser products (such as CD-ROMs, DVD drives, fiber optic devices, or transmitters) are installed, note the following: DANGER Some laser products contain an embedded Class 3A or Class 3B laser diode. Note the following.
3. Remove the fiber-optic cable from the SFP+ or QSFP transceiver that you want to replace. ATTENTION To avoid damage to the cable or the SFP+ or QSFP transceiver, make sure you disconnect the fiber-optic cable before you remove the SFP+ or QSFP transceiver. IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Cabling the switch This section provides instructions for connecting and disconnecting the cables to the physical ports on the IBM Flex System EN4023 10Gb Scalable Switch. Connecting and disconnecting the USB console cable The mini-USB (RS-232) console port can be used for serial console management and diagnostics.
To connect the RJ-45 connector to the switch, push the connector into the port connector until it clicks into place, as shown in Figure FIGURE 8 RJ-45 Ethernet connection To disconnect the RJ-45 Ethernet cable, grasp the connector and gently pull the cable from the switch. IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Trunk Group C (shown as ports 57–58) Ethernet LED: Link Trunk Group B (shown as ports 51–56) System Status LED: Power Trunk Group A (shown as ports 43–50) FIGURE 9 IBM Flex System EN4023 10Gb Scalable Switch information panel LEDs and port groups Introduction...
Also supported are two Quad SFP (QSFP) ports that can support 40-Gbps Ethernet, or 4x10-Gbps Ethernet when configured in breakout mode. For the most current information on supported components, go to the IBM Server Proven website at http://www-03.ibm.com/systems/info/x86servers/serverproven/compat/us/flex.html. The information panel provides status information for the switch and for each port that is indicated by LED activity.
Page 31
Locating the information panel, LEDs, and external ports NOTE You can also use the CMM to ensure that the switch is operating correctly. For more information, see the documentation for the chassis. For more information, refer to the following sections: •...
The Tx/Rx LED appears as a steady green light when lit, which indicates a port speed of 100/1000 Mbps. If the Tx/Rx LED is not lit, port speed is 10 Mbps. NOTE Do not attach any devices to the RJ-45 connector other than a compatible cable. IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Locating the information panel, LEDs, and external ports Tx/Rx LED Link LED FIGURE 12 RJ-45 Ethernet port LEDs Table 6 identifies the Ethernet port status LEDs. TABLE 6 RJ-45 Ethernet port status LEDs Status LED Description Ethernet Link LED (green) No light.
SCSE Location LED Location LED operation from CMM Port mapping The IBM Flex System EN4023 10Gb Scalable Switch provides 64 ports that can be configured as Ethernet ports. NOTES: • Ports 1 through 42 provide up to 42 internal ports (available through Ports-On-Demand activation) connected to 14 compute nodes at the midplane, auto-negotiating to 10-Gbps Ethernet.
CMM, see the IBM Flex System Chassis Management Module User’s Guide. Configuring an IP address on the switch using the CLI 1. Install the IBM Flex System EN4023 10Gb Scalable Switch in the appropriate bay of the IBM Flex System chassis. For more information, see “Installing the switch”...
Configuring an IP address on the switch using the CMM GUI For IPv4 1. Install the IBM Flex System EN4023 10Gb Scalable Switch in the appropriate bay of the IBM Flex System chassis. For more information, see “Installing the switch”...
Page 37
Click Close to close the dialog box. FIGURE 16 Component IP Configuration page For IPv6 1. Install the IBM Flex System EN4023 10Gb Scalable Switch in the appropriate bay of the IBM Flex System chassis. For more information, see “Installing the switch” on page 11.
The passwords that are used to access the switch are case-sensitive. To increase system security, change the password after you log in for the first time. For more information, see the Network OS Administrator’s Guide. IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
The switch will default to using the internal management port with a switch reboot. Refer to the Technical Service Bulletin (TSB) for additional instructions when connecting to the switch using the front panel Ethernet (RJ-45) port. To access the TSB, go to the IBM Flex System Information Center at: http://pic.dhe.ibm.com/infocenter/flexsys/information/index.jsp.
Passwords are case-sensitive. TABLE 10 Default user accounts and passwords User ID Password (case-sensitive) admin password user password USERID PASSW0RD (wherein the sixth character is a zero) IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Managing the switch For more information about user accounts, user-based access, and password requirements, see the Network OS Administrator’s Guide. Managing the switch SNMP v3 authentication Two user roles are supported: • snmpadmin—Provides read-write access • snmpuser—Provides read-only access Table 11 lists user login information.
ATTENTION Restoring the switch to factory defaults is disruptive. Before doing so, save the switch configuration. Use the IBM Chassis Management Module (CMM) to reset the switch to factory defaults. See Figure 1. Open the CMM and log in with admin privileges.
Managing the switch For more information, go to http://pic.dhe.ibm.com/infocenter/flexsys/information/index.jsp. Navigate to IBM Flex System Information > Management Devices and Solutions >IBM Flex System Chassis Management Module > Using the Web interface > Web interface options > Chassis management options. NOTE Certain configuration settings are not restored to their default values when the request to restore factory default settings is initialized from the CMM.
Page 44
Managing the switch IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Management Module (CMM), or from the switch using the CLI. Determining firmware from the CMM 1. Log in to the CMM as described in the IBM Flex System Chassis Management Module User’s Guide. If necessary, obtain the IP address of the CMM from your system administrator. The login window opens.
Upgrading the switch firmware Upgrading the switch firmware After you locate the correct firmware to download to the IIBM Flex System EN4023 10Gb Scalable Switch, you can use the firmware download interactive command to perform the download. ATTENTION The firmware download for the switch is disruptive. Make sure no traffic is flowing through the switch during the download process.
Page 47
Upgrading the switch firmware Preparing packages for installation... dcm-4.0.0-4 ############################### [ 100% ] Done install Package All packages have been downloaded successfully. The command has completed successfully. EN4023# EN4023# NOTE If you are downloading firmware to the switch and you log in to the FTP server as an anonymous user (“anonymous”...
Page 48
Upgrading the switch firmware IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
The switch processes a series of power-on self-tests (POSTs) during power-up or a restart to ensure that it is fully operational. These tests take approximately one minute to complete. The IBM Chassis Management Module (CMM) reads the test results and displays them for you. During normal operation, these tests are completed without error, and the green OK LED is lit.
IBM Flex System EN4023 10Gb Scalable Switch 94Y5219 NOTE The optical transceivers and cables supporting your IBM Flex System EN4023 10Gb Scalable Switch are continually changing. For the most current information on supported components, go to the IBM Server Proven website at http://www-03.ibm.com/systems/info/x86servers/serverproven/compat/us/flex.html.
If you need help, service, or technical assistance, or just want more information about IBM products, you will find a wide variety of sources available from IBM to assist you. This section contains information about where to go for additional information about IBM and IBM products, what to do if you experience a problem with your system, and whom to call for service, if it is necessary.
In the U.S. and Canada, call 1-800-IBM-SERV (1-800-426-7378). Hardware service and support You can receive hardware service through your IBM reseller or IBM Services. To locate a reseller authorized by IBM to provide warranty service, go to http://www.ibm.com/partnerworld/ and click Resellers >...
Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
IBM, the IBM logo, and ibm.com are trademarks of International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at "Copyright and trademark information" at http://www.ibm.com/legal/copytrade.shtml Adobe and PostScript are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States and/or other countries.
Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment.
This Class A digital apparatus complies with Canadian ICES-003. Avis de conformité à la réglementation d’Industrie Canada Cet appareil numérique de la classe A est conforme à la norme NMB-003 du Canada. IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Electronic emission notices European Community contact: IBM Deutschland GmbH IBM Technical Regulations, Department M372 IBM-Allee 1,71139 Ehningen, Germany Telephone: +49 7032 15 2941 Email: lugi@de.ibm.com Notices...
Electronic emission notices This is electromagnetic wave compatibility equipment for business (Type A). Sellers and users need to pay attention to it. This is for any areas other than home. Notices...
Page 60
Electronic emission notices IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Page 62
NVRAM I/O Module Tasks IBM documentation important notes physical characteristics information panel port LEDs installation guidelines port maps ISL Trunking POST errors IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Page 63
power-on self-test see POST switch components switch management switch module physical dimensions weight QSFP switch specifications installation 15, 16 , 4, system LEDs transceivers system status QSFP external ports LEDs QSFP transceivers removal Taiwan support technical help release levers transceivers reliability guidelines QSFP requirements...
Page 64
IBM Flex System EN4023 10Gb Scalable Switch User’s Guide...
Page 66
Part Number: 47C9167 Printed in USA (IP) P/N: 47C9167 *47C9167*...