Page 1 Brocade SilkWorm 12000 Design, Deployment and Management Guide Publication Number 53-0000251-02...
Page 2 The authors and Brocade Communications Systems, Inc. shall have no liability or responsibility to any person or entity with respect to any loss, cost, liability or damages arising from the information contained in this book or the computer programs that accompany it.
Page 3: Table Of Contents
Dual Control Processors For High Availability ....Accessing the SilkWorm 12000 Switches ......
Page 4 Availability ........... SilkWorm 12000 Placement In The Fabric......
Page 5 Configuring the SilkWorm 12000 Configuring the SilkWorm 12000........
Page 6 Chapter 7 Maintaining the SilkWorm 12000 Hardware Maintenance ......... .
Page 7 Chapter 8 Troubleshooting/Support Software Issues ..........QuickLoop Issues .
Page 8 viii Publication Number 53-0000251-02...
Page 9: Preface
This document discusses the practical aspects of designing, deploying, and maintaining a SilkWorm 12000 based SAN. The SilkWorm 12000 is a new product because it has: a bladed architecture, two logical switches in one chassis, a new Fabric OS (version 4.0), and high availability/failover features.
Page 10 Web Tools User’s Guide Version 4.0 (publication number: 53-0000185-01) • Brocade Fabric Manager User’s Guide Version 3.0 (publication number: 53-0000204-0) • Brocade MIB Reference Version 3.0/4.0 (publication number: 53-0000184-01) • Brocade SilkWorm 12000 Core Migration User’s Guide v1.1 (53-0000477-02) viii Publication Number 53-0000251-02...
Page 11: Introducing The Silkworm 12000
Network (SAN). It is a revolutionary product: a dual 64-port Fibre Channel switch that delivers unprecedented performance, scalability, flexibility, functionality, reliability and availability. Figure 1-1 shows two views of the SilkWorm 12000. Several key features of the SilkWorm 12000 and the Fabric operating system (Fabric OS) are detailed below: •...
Page 12: Hardware
Fabric design, and maintenance. Using a 14U (rack unit) mechanical design, up to three SilkWorm 12000 chassis may be mounted in a standard 42U rack, supporting as many as 384 Fibre Channel ports in a single rack. As shown in Figure 1-2, the modular multi-card assembly chassis of the SilkWorm 12000 consists of the following: •...
Page 13: High Availability
24 hours per day by users and the system manager. Availability is designated in terms of 9s. For example, the architecture of the SilkWorm 12000 is designed for availability in excess of 99.999%. The following features contribute to the high availability design of the SilkWorm 12000: •...
Page 14: Reliability
In a reliable system, a user is not aware of the internal state of the chassis components and will experience continued system service with zero degradation of service. The SilkWorm 12000 provides the following features to ensure reliability. All data inside the switch is protected by the following Error Detection and Correction mechanisms as follows: •...
Page 15: Intelligent Fabric Services Architecture
Web Tools, Fabric Manager, and the command line interface. Intelligent Fabric Services Architecture Fabric OS v4.0 (required for the SilkWorm 12000) provides a wide variety of Advanced Fabric Services that are designed to improve the investment protection, security, performance, scalability, and efficiency of Brocade SAN fabrics.
Page 16: Fabric Watch
Therefore switches that do support QuickLoop or Fabric Assist can be connected to a SilkWorm 12000, even though the SilkWorm 12000 does not support QuickLoop or Fabric Assist directly. It is possible to connect devices that are accessed by QuickLoop/Fabric Assist devices to the SilkWorm 12000.
Page 17: Silkworm 12000 Architecture And What Is New
SilkWorm 12000 and SilkWorm 12000-based SANs. The 16-port card design of the SilkWorm 12000 introduces a new “slot” operand to many commands, and a new model for port identification that should be understood for effective operation of the SilkWorm 12000.
Page 18: Dual Switch Model
Dual Switch Model The SilkWorm 12000 houses two separate logical switches within a single chassis. Each switch is capable of scaling to 64 ports by adding up to four 16-port cards to the respective logical switch. It is possible to interconnect the two switches inside a chassis to form a fabric.
Page 19: Dual Control Processors For High Availability
SilkWorm 12000 Architecture and What Is New Logical Logical Switch 0 Switch 1 Figure 2-2 SilkWorm 12000 Dual-Switch Model Dual Control Processors For High Availability The dual control processors (CP) operate in an active/standby model. The CP cards are named “cp0” (the CP card on the left, when looking at the chassis) and “cp1”...
Page 20: Accessing The Silkworm 12000 Switches
Fabric OS environment. To determine a CP card state, whether inactive or active, use the command haShow (see Figure 2-3). When telnetting to a SilkWorm 12000 switch, the user will encounter a login prompt from the active CP card. This may seem confusing, since the destination is a switch and not the CP card;...
Page 21: How Logical Switch Behavior Differs
Some commands, such as passwd, are chassis-wide in scope and affect both logical switches. Port Addressing and Area Numbering Port addressing is different for the SilkWorm 12000 than with the SilkWorm 2000 and 3000 families of 8-port and 16-port switches. The change in port addressing is driven by several factors, including the...
Page 22 SilkWorm 12000 Architecture and What Is New sw0_156_22:admin> portShow 1/7 portCFlags: 0x0 portFlags: 0x20801 PRESENT DISABLED LED portType: portState: 2 Offline portPhys: No_Sync portScn: Offline portId: 160700 portWwn: 20:07:00:60:69:80:04:a0 Distance: normal portSpeed: 2Gbps Interrupts: Link_failure: 1 Frjt: Unknown: Loss_of_sync: 10...
Page 23 Since the port-addressing scheme has changed for the SilkWorm 12000, so has the decoding for a particular port ID. The concept of area number is new in the SilkWorm 12000. The area number is used in the same way a port number is used for the SilkWorm 2000 series and 3800 switches. When specifying zoning configurations by port number it is necessary to utilize the area number.
Page 24 0 through 3 (see Table 2-2). To calculate the area number of a port in the SilkWorm 12000, multiply the switch logical port card number by sixteen, add the port number, and convert the value to hexadecimal. SeeTable 2-1 for a complete map of physical ports to addresses.
Page 25 SilkWorm 12000 Architecture and What Is New In addition to the calculation method, you can determine the area by looking it up in Table 2-1. Table 2-1 Logical Port Card Numbers Port Note: If you look at the left-most digit in the Area, that corresponds to the logical port card. The right- most digit corresponds to the port.
Page 26: Compatibility
Fabric OS 3.0.2c or later on these switches, and Fabric OS v2.6 or later for SilkWorm 2000 series switches. When connecting a switch from the SilkWorm 2000 and 3000 product family to a SilkWorm 12000, you must enable the Core Switch PID Format parameter. You can do this using the configure command as shown in Figure 2-9.
Page 27: Software High Availability Model
Enabling Compatibility Between the SilkWorm 12000 and other SilkWorm Switches To enable compatibility between a SilkWorm 12000 switch and another vendor’s switch, it is necessary to invoke interoperability mode. Operating the Brocade switch in this mode places significant restrictions on the Brocade SilkWorm 12000 switch. Functionality such as Hard Zoning, Extended Fabrics, and Virtual Channels will not be available.
Page 28: Failover Details
SilkWorm 12000 Architecture and What Is New issues the haFailover command and the HAM demon on CP0 reboots the kernel. The HAM demon on CP1 is notified of the loss of CP0 through the hardware control lines, changes it’s state from standby to master, configures the switch IP addresses for it’s LAN interface and notifies the switching applications...
Page 29 SilkWorm 12000 Architecture and What Is New active. For larger fabrics, it may take longer for the fabric to become operational since the higher number of switches in the fabric necessitates a longer convergence period before the fabric becomes operational.
Page 30 SilkWorm 12000 Architecture and What Is New 2-14 Publication Number 53-0000251-02...
Page 31: Silkworm 12000 Based San Designs
53-0000231) and the book Building SANs with Brocade Fabric Switches by Syngress press (ISBN: 1-928994-30-x). The SilkWorm 12000 is an exceptionally flexible storage-networking switch. Its enhanced network features, high port density, high availability, and broad compatibility allow this switch to fill many different roles.
Page 32 500 Available Fabric Ports Figure 3-1 The SilkWorm 12000 Excels In Many Fabric Topologies While Brocade switches have the flexibility to support many topologies, the core/edge topology is the best “general purpose” choice. The core/edge topology delivers high performance, availability, and scalability.
Page 33: Scalability
If the network will expand to beyond a few hundred ports, the core/edge is the topology of choice. Even with the SilkWorm 12000, topologies such as the full mesh are difficult to scale past a few hundred ports non-disruptively or without significant re-cabling. If you use a large port-count switch at the core of your fabric, you greatly increase that fabric’s scalability.
Page 34: Performance
It is possible to dynamically tune a fabric by adding or removing ISLs between SilkWorm switches. With Trunking (SilkWorm 12000, 3800, and 3200), this tuning ability is further enhanced because trunking makes ISL addition transparent to SAN devices and optimizes ISL bandwidth utilization.
Page 35: Device Attachment Strategies
You must take availability, scalability, and performance into account when attaching devices to the SilkWorm 12000. Due to the high port density characteristics of the SilkWorm 12000, it is frequently easy to localize devices that communicate with each other onto the same switch. Localizing traffic enhances performance as fewer ISLs are utilized and higher scalability since more ports are available for nodes.
Page 36: Attaching Isls For Availability
SilkWorm 12000, this means using four x 2-ISL trunks instead of two x 4-ISL trunks. First make sure that ISLs connected to a SilkWorm 12000 are spread across two different 16-port cards. If using only two ISLs, availability becomes the overriding criteria. If using more ISLs, then spread them across the remaining 16-port cards.
Page 37: Attaching Nodes For Scalability
When the SilkWorm 12000 is used as a core in a core/edge topology, it is important to understand the implications of attaching SAN devices to the core. While device placement does not constitute fabric topology, it may very well affect and be affected by topology.
Page 38: Availability
SilkWorm 12000 Based SAN Designs Scenario “C” (Edge Attach) is the typical case. The number of available paths between the host and storage is equal to the number of ISLs used to attach the edge to the core. This greatly improves performance for devices that are located on different switches and that need to communicate with each other (i.e.
Page 39: Silkworm 12000 Placement In The Fabric
Use Dual Redundant Fabrics for the Highest Availability The dual switch – single chassis implementation of the SilkWorm 12000 ideally suits this switch for the role of a core switch. Recall that for a resilient core/edge fabric, two is the minimum number of core switches.
Page 40: Silkworm 12000 Based Fabric Topologies
The core/edge topology is the fabric topology of choice since it is highly scalable, highly available, and delivers high performance. The SilkWorm 12000 can be used both as a core switch and an edge switch. Of course, it also performs well as a standalone switch. A single chassis topology can scale to 124 ports.
Page 41 ISLs betw een the tw o halves of the chassis. 4 1- 4 1- 4 1- Figure 3-6 Expand a SilkWorm 12000 Chassis to 124 Ports Publication Number 53-0000251-02 3-11...
Page 42 SilkWorm 12000 Based SAN Designs The next stage is to establish the foundation for a core/edge fabric. Do so by connecting an additional chassis. Start with as little as 32 ports in the chassis and expand to two 64-port logical switches.
Page 43 SilkWorm 12000 Based SAN Designs Figure 3-7 Using the SilkWorm 12000 For a Partial Mesh or a Full Mesh Publication Number 53-0000251-02 3-13...
Page 44: Single Chassis Topology
SilkWorm 12000 Based SAN Designs Figure 3-8 shows a method of using the SilkWorm 12000 on both the core and the edge of the fabric. It is also possible to use Brocade 16-port products, such as the SilkWorm 2800 or 3800 at the edge. This might be done if there are established16-port switches which can be reused for investment protection, or if initial deployment cost needs to be kept at a minimum.
Page 45 SilkWorm 12000 Based SAN Designs Slot 2 4 Gb/s Trunks Slot 1 Ports 12-15 4 1- 4 1- 4 1- Slot 8 4 Gb/s Trunks Slot 7 Figure 3-9 A SilkWorm 12000 Configured As A 112-Port Fabric Publication Number 53-0000251-02 3-15...
Page 46: Core/Edge Topology
Make sure that the four trunks are on different 16-port cards for higher availability. When used purely as a core switch in a core/edge fabric, the SilkWorm 12000 is solely used to interconnect other switches. ISL connections should be distributed across the Core SilkWorm 12000 16- port cards from left to right.
Page 47 Allocated For Future ISls Allocated For Future ISls Allocated For Future ISls Port Allocations For A SilkWorm 12000 Operating As A Port Allocations For A SilkWorm 12000 Operating As An Core Switch With A 7:1 ISL Over Subscription Ratio Edge Switch With A 7:1 ISL Over Subscription Ratio...
Page 48: Core & Edge Switch Selection
SilkWorm 12000 Based SAN Designs Core & Edge Switch Selection Core and edge switch selection depends on scaling requirements, budget, geographic flexibility, and whether a Brocade SAN already exists. In general, scalability is greater if you build your fabrics using large port-count switches, especially at the core.
Page 49: Availability
One advantage of a dual fabric solution is the ability to perform maintenance on one fabric without impacting the other fabric. If a SilkWorm 12000 is used as a core and is split across each of the dual fabrics, it is no longer possible to do this. Another advantage to a dual fabric solution is the ability to run one version of Fabric OS in one fabric and a different version in the other fabric.
Page 50: Large Fabric Support Levels
SilkWorm 12000 Based SAN Designs Large Fabric Support Levels Brocade is currently testing and validating fabrics consisting of hundreds of ports and has plans for testing multi-thousand port fabrics. The ultimate limitation in fabric design as defined in the Fibre Channel standards is 239 physical switches.
Page 51: Silkworm 12000 Reference Topologies
ISL count and performance. Conversely, the lower the fabric port count, the higher the ISL count and performance. Single chassis topology This topology is a simple, single chassis fabric comprised of two logical SilkWorm 12000 switches. 2 x 12000 up to 124 Available Fabric Ports...
Page 52: Two Chassis/Four Switch Partial Mesh
SilkWorm 12000 Based SAN Designs Two Chassis/Four Switch Partial Mesh This topology is the foundation for the core/edge topology. It is possible to scale this base topology to over 896 ports with a combination of 16 and 64 port edge switches.
Page 53: Core/Edge With Maximal Config
SilkWorm 12000 Based SAN Designs Core/edge With Maximal Config (current support levels) The current maximum supported number of edge switches is twenty-four based on the existing data as of the publication date of this document. 4 x 12000 , 24 x 16-port switches...
Page 54 SilkWorm 12000 Based SAN Designs 3-24 Publication Number 53-0000251-02...
Page 55: Deploying The Silkworm 12000
Table 4-1 provides a list of the main installation and set up tasks, and the estimated time required for each task based on a fully populated SilkWorm 12000 switch (128 Fibre Channel ports). Less time will be required for configurations containing fewer than 128 ports.
Page 56: Unpacking And Installing The Silkworm 12000 In The Rack
Unpacking the Switch Due to the weight and size of the SilkWorm 12000, it is important to plan where to unpack it and how to transport it. For example, it might be easier to unpack it in the shipping room and use a cart or mobile hydraulic lift to bring it to the rack, or to transport to the rack while it is still in the packing crate, using a pallet jack, and then unpack it.
Page 57: Installing The Rack Mount Kit
Plan the location of the switch in the rack carefully to minimize the chance of having to re-rack the switch. • The SilkWorm 12000 requires an EIA rack space that is 14 rack units high, 30 inches deep, and 19 inches wide. •...
Page 58: Reinstalling The Chassis Door And Cable Management Tray
Note: Do not connect the switch to the network until the IP address is correctly set. For instructions on starting and configuring the switch, refer the SilkWorm 12000 Hardware Reference. Publication Number 53-0000251-02...
Page 59: Cable Management
Deploying the SilkWorm 12000 Cable Management A prime consideration of cable management for the SilkWorm 12000 is the ability to remove and replace the field-replaceable unit (FRU) components without having to unplug cables. Since the port cards, CP cards, power supplies, and blower assemblies are all hot-swappable, ensuring easy access to each component is vital toward contributing to the uptime of the SAN.
Page 60 Deploying the SilkWorm 12000 Figure 4-3 Poor Cable Management Additional cable management recommendations: • Leave at least one meter of slack for each fiber optic cable. This provides room to remove and replace the port card, allows for inadvertent movement of the rack, and helps prevent the cables from being bent to less than the minimum bend radius.
Page 61 Deploying the SilkWorm 12000 • Use a spreadsheet to track which devices are connected to which switch, port card, and port in the SilkWorm 12000. The serial numbers or other identifiers of the fiber optic cables can also be tracked. •...
Page 62 Deploying the SilkWorm 12000 Publication Number 53-0000251-02...
Page 63: Configuring The Silkworm 12000
Configuring the Switch Name on page 5-5 This chapter provides information and recommendations to aid in the deployment of a SilkWorm 12000 as a core fabric switch. Use this chapter in conjunction with the SilkWorm 12000 Hardware Reference (publication number 53-0000148), which provides step-by-step configuration instructions.
Page 64: Logging Into The Silkworm 12000
LED patterns, refer to the SilkWorm 12000 Hardware Reference). Use the serial cable provided with the SilkWorm 12000 to connect the lower serial port on the active CP card to a computer workstation. The haShow command can be used to determine which of the CP cards is active. The active CP card is usually the one that has been continuously functioning for the longest period of time.
Page 65: Configuring Ip Addresses
Make selection (0-2) Configuring IP Addresses The SilkWorm 12000 requires up to four IP addresses, which can be configured using the ipAddrSet command. IP addresses are required for both CP cards (CP0 and CP1), and up to two logical switches (SW0 and SW1).
Page 66 Gateway IP Address [192.168.155.1]: Figure 5-1 Example of Setting The IP Address for a SilkWorm 12000 Entering the ipAddrShow command without a numerical operand displays prompts to choose between five different options. Entering a “4” at the prompt displays all IP addresses associated with the chassis, as shown in Figure 5-2.
Page 67: Configuring The Switch Name
Each switch in the fabric must have a unique Domain ID. To simplify switch identification, use consecutive domain IDs for logical switches in the same SilkWorm 12000. For example, logical switch SW0 could be set to domain 1, and logical switch SW1 to domain 2. Domain IDs can be set using the configure command.
Page 68: Return Switches To Default Settings
Configuring the SilkWorm 12000 Return Switches to Default Settings If you desire to return your SilkWorm 12000 configuration settings to factory default use the “configdefault” command. The IP address and Zoning configuration will be unchanged. Each logical switch must be disabled using the “switchdisable” command in order to administer the “configdefault”...
Page 69: Silkworm 12000 Management Interfaces
• Fabric Manager 3.0 on page 6-16 The SilkWorm 12000 allows for the user to access and manage the switch in multiple ways. The ability to manage the SilkWorm 12000 through different methods enables flexibility for the administrators to accomplish their task. The interfaces that are available to choose from are telnet, serial console, SNMP, Web Tools, and Fabric Manager 3.0.
Page 70 SilkWorm 12000 Management Interfaces fimwareCommit: Allows the user to manually commit the firmware to the second half of the compact flash. firmwareDownload: This command is used to download new firmware to the switch; however there are additional management features to be aware of. One such feature to be aware of is that the only supported protocol is FTP.
Page 71 SilkWorm 12000 Management Interfaces haShow: Displays the current HA status of the SilkWorm 12000. The status includes whether a CP card is in “Active” or “Standby” mode. It also displays if HA is enabled or disabled along with the “Heartbeat” status. Refer to Figure 6-2 below for a sample output, notice that Slot 5 is CP0 and Slot 6 is CP1.
Page 72 Redundant Figure 6-5 Displaying the current session information on a SilkWorm 12000 nsShow: Displays the entries in the Name Server. Please note that the area portion of the 24-bit address is now used. In Figure 6-6, the digit that is in bold and circled is the logical area number. So in this example, this digit represents logical slot 1.
Page 73 : Use this command to add or remove a port from a trunk group. By default on the SilkWorm 12000 all ports are set to be members of a trunk group for their associated quad. The proper way of calling this command is portCfgTrunkPort <slot number>/<port number>...
Page 74 Displays diagnostic information for Support Engineers to analyze possible problems with the switch. Since the SilkWorm 12000 is now a slot based architecture, the way that the command is executed is now changed. The proper way to run the command is supportShow <slot...
Page 75 Instead of using port number when hard zoning, area number is used instead. Area numbers are discussed in Chapter 2, SilkWorm 12000 Architecture and What Is New. Notice in Figure 6-10 the use of Area Number instead of Port Number.
Page 76: Web Tools
SilkWorm 12000 Management Interfaces Web Tools Web Tools is an optionally licensed feature available on the SilkWorm 12000 used for simplified fabric management. Web Tools enables remote administration of a Storage Area Network (SAN) through a standard web browser with the Java Plug-in. Providing the status of all the switches in the fabric in one place, Web Tools can be used to dynamically manage individual switches or an overall topology.
Page 77 SilkWorm 12000 Management Interfaces When using Web Tools on the SilkWorm 12000, there are several new and modified features to be aware of. The “Hi Avail” button is now available in the Switch Management window. The “Hi Avail” button, highlighted with in a red circle in Figure 6-12, displays the current high availability status of each of the CP cards in table form.
Page 78: Zoning
The Zoning feature allows grouping of devices and/or ports for creating configuration files. When using this feature, the one major change is how a port is selected on the SilkWorm 12000. To select the appropriate port, it is now necessary to first select the slot on which the port resides. Notice in Figure 6- 13 that the SilkWorm 12000 contains slots and ports.
Page 79: Upload/Download
SilkWorm 12000 Management Interfaces Upload/Download The Upload/Download feature consists of all the functions that require Uploading or Downloading, which is a major change from how this task was performed in previous versions of Web Tools. This feature now allows the user to perform a configupload, configdownload, and firmwaredownload from the same location.
Page 80: Port Setting
The way that the user must access the ports is different in the SilkWorm 12000 as compared to other SilkWorm switches. As shown in Figure 6-15 each slot has its own tab, and each row on the tab is used to indicate the port.
Page 81: Configure
The configure function enables the user to change the switch configuration. The main modification to this feature in the SilkWorm 12000 is that it is now separated into tabs. The tabs consist of Fabric, Virtual Channels, Arbitrated Loop, and System. Figure 6-16 displays the Configure tab from Web Tools.
Page 82: Routing
The routing function enables the user to view and modify the routing tables. This function uses the multiple tabs for each Slot to access individual ports. Figure 6-17 shows the Slot tabs on the bottom of the Routing tab. Figure 6-17 SilkWorm 12000 Routing Management With Web Tools 6-14 Publication Number 53-0000251-02...
Page 83: Extended Fabric
SilkWorm 12000 Management Interfaces Extended Fabric The Extended Fabric function enables the configuration of individual ports to participate in an extended fabric. The user must select a Slot to access individual ports. Figure 6-18 displays the view of the Extended Fabric tab from Web Tools. The Slot tabs are displayed on the bottom of the main tab.
Page 84: Fabric Manager 3.0
Currently Fabric Manager v3.0 or earlier does not allow for Switch Reboot when used in conjunction with a SilkWorm 12000 running Fabric OS v4.0. However, it is still possible to perform the basic administration functions that are available in Web Tools. Full support for the SilkWorm 12000 will be available in a future release of Fabric Manager.
Page 85: Console
RS-232 serial connection wired as DCE (data communications equipment) on each of the CP cards in the SilkWorm 12000. The port can be connected to a DTE (data terminal equipment) device by use of a serial cable. Using the Console is one of the most secure ways of communicating with the switch since it is in a point-to-point communication with console terminal.
Page 86 SilkWorm 12000 Management Interfaces 6-18 Publication Number 53-0000251-02...
Page 87: Maintaining The Silkworm 12000
The Software maintenance section covers how to upgrade firmware and add licenses. Figure 7-1 shows the 16-port card, CP card, and power supply on the cable side of the SilkWorm 12000. Figure 7-2 shows the blower assemblies and the WWN bezel on the non-cable side of the SilkWorm 12000.
Page 88 Filler Panel (Four Shown) Power Supply Power Supply AC Power AC Power Switch (Two) Connector (Two) Provide Power to PS #1 & 3 Provide Power to PS #2 & 4 Figure 7-1 Cable-side of the SilkWorm 12000 Publication Number 53-0000251-02...
Page 89 • Check cable slack: Make sure there is plenty of cable slack to physically remove without optical / power/ Ethernet cable obstruction. Refer to the SilkWorm 12000 Hardware Reference Manual for cabling procedures for the SilkWorm 12000. Publication Number 53-0000251-02...
Page 90 Valid spare part: Make sure that the part numbers match for the unit being replaced. For example, a power supply for a SilkWorm 3800 will not work in a SilkWorm 12000. The Fabric OS v4.0 command chassisShow displays the FRU part number and Brocade serial number and additional status information.
Page 91 Maintaining the SilkWorm 12000 sw0_155:admin> chassisShow SW BLADE Slot: 1 Header Version: Power Consume Factor: -180 Brocade Part Num: 60-0001532-04 Brocade Serial Num: FQ000000986 Manufacture: Day: 21 Month: Year: 2002 Update: Day: 30 Month: 12 Year: 2001 Time Alive: 14 days...
Page 92: Hardware Maintenance
Maintaining the SilkWorm 12000 Hardware Maintenance The Fabric OS environmental commands chassisShow, psShow, sensorShow, and slotShow display the Brocade part numbers, 16-port card, and CP card location and its status. Brocade has optionally licensed software called Fabric Watch to monitor the system environment. This software can be used to set threshold values to pro-actively monitor environmental parameters such as temperature, fan speed and voltage.
Page 93: Power Supply Maintenance
The SilkWorm 12000 power is highly reliable. In the event of failure of any two power supplies in any combination, the chassis is capable of continuing its operation without any performance degradation.
Page 94 180-220 SilkWorm 12000. VDC. For installation and removal of power supplies, it is important to follow the cable harness procedures so as not to block accessibility. Refer to the SilkWorm 12000 Hardware Reference Manual for proper guidelines. Publication Number 53-0000251-02...
Page 95: Identify A Faulty Power Supply
Maintaining the SilkWorm 12000 Identify A Faulty Power Supply To determine if a power supply is marginal or has failed: Check the LED status on the power supply, or the power supply LEDs on the WWN bezel (card). Refer to Table 1 for interpretation.
Page 96: Blowers Maintenance
Three blower assemblies are used in conjunction with a pressurized plenum to cool the unit. The SilkWorm 12000 hardware is designed to withstand the loss of a single blower assembly and continue to run. Table 7-3 lists the operational efficiency based on blower assembly availability.
Page 97 Blower Power LED (3x) Blower Fault LED (3x) Handle (3x) Blower Assembly #1 Blower Assembly #3 Thumbscrew Blower Assembly #3 (Two on Each Blower) Figure 7-5 Non-cable Side of the SilkWorm 12000 with One Blower Assembly Removed Publication Number 53-0000251-02 7-11...
Page 98: Blower Removal
Maintaining the SilkWorm 12000 Table 7-4 Blower Assembly LED Pattern Location Purpose Color of Status of Hardware Recommended Action of LED of LED Left LED Blower Steady green Blower assembly has No action required. Assembly incoming power. Power No light...
Page 99: Control Processor Maintenance
Control Processor Maintenance There are two control processor (CP) cards in a SilkWorm 12000 chassis. The initial release supports an active-standby configuration where one CP card can manage two 64-port switches in the chassis. Figure 7-6 shows the CP card location in the chassis, Slots 5 and 6 are for the CP cards.
Page 100: Identify A Faulty Cp Card
Maintaining the SilkWorm 12000 CP Card Direction to Push Power LED Yellow Ejector Button CP Card Status LED RS-232 Modem Port 10101 Console Port Link Status LED Ethernet Port Link Speed LED 10/100 Mb/s Direction to Push Yellow Ejector Button...
Page 101: Cp Card Removal
Maintaining the SilkWorm 12000 sw0_155:admin> slotshow Slot 16-port card Type Status --------------------------------- SW 16-PORT CARD ENABLED SW 16-PORT CARD ENABLED UNKNOWN VACANT UNKNOWN VACANT UNKNOWN VACANT CP 16-PORT CARD ENABLED UNKNOWN VACANT UNKNOWN VACANT UNKNOWN VACANT UNKNOWN VACANT sw0_155:admin> haShow...
Page 102: Cp Card Installation
Maintaining the SilkWorm 12000 CP Card Installation Install the new CP Card or filler panel in the slot. Caution: Do not force the installation. If the CP Card or filler panel does not slide in easily, ensure it is correctly oriented and aligned in the rail guides before continuing. Installing a CP Card or filler panel with incorrect alignment damages the chassis and the CP Card or filler panel.
Page 103: Cp Card Verification
HA Enabled, Heartbeat Up sw0_155:admin> Note: The two CP cards in the SilkWorm 12000 are hot swappable and operate in an active standby configuration. Before removing a faulty CP card, verify that it is NOT the active CP card. 16-Port Card Maintenance Each 16-port card (see Figure 7-7) houses sixteen auto-sensing 1- 2 Gbit/sec Fibre Channel ports and uses SFP optical transceivers.
Page 104 Maintaining the SilkWorm 12000 16-Port Card Power LED 16-Port Card Status LED Port Speed LED (Sixteen) Port Status LED (Sixteen) Figure 7-7 Front of the 16-port Card 7-18 Publication Number 53-0000251-02...
Page 105 Maintaining the SilkWorm 12000 Table 7-5 16-Port Card LED Pattern Location of Purpose Color of LED Status of Hardware Recommended LED on of LED Action Installed Card Top LED 16-port Steady green 16-port card has incoming No action required. Card power.
Page 106: Identifying A Faulty 16-Port Card
Before removing any cables from the faulty 16-port card make a note of cable order by referring a cable to the physical port. This reduces the confusion during re-cabling. Refer to the SilkWorm 12000 Hardware Reference Manual for guidelines regarding cabling procedures. If multiple cards are being replaced, replace one card at a time to prevent confusion during the cable re-connection phase.
Page 107 Make sure the SFPs are 2 Gbit/sec by verifying the part number with the vendor. Even though the 1 Gbit/sec SFPs look the same as the 2 Gbit/sec SFP and will work in a SilkWorm 12000 switch, they would cause performance issues and ISL Trunking will not work. Figure 7-8 shows an example of the part number for IBM 1Gbit/sec and 2 Gbit/sec SFPs.
Page 108: Installing A 16-Port Card
Maintaining the SilkWorm 12000 Installing A 16-Port Card Caution: Do not force the installation. If the 16-Port Card or filler panel does not slide in easily, ensure it is correctly aligned inside the rail guides before continuing. Installing a 16-Port Card or filler panel with incorrect alignment damages both the chassis and the replacement part.
Page 109: Software Maintenance
CP cards as shown below: The SilkWorm 12000 has four IP addresses: one each for each switch (switch 0 and 1) and one each for the two CP cards (CP0 in slot 5 and CP1 in slot 6).
Page 110 Wed Dec 12 13:31:30 2001 BootProm: 3.1.12b To upgrade the firmware in a SilkWorm 12000, the switch administrator should perform the following sequence of steps: Verify that the FTP service is running on a UNIX or Windows machine Determine which CP card is the standby CP card by establishing a telnet connection to a switch IP address and issuing the haShow command.
Page 111: License Upgrade
The licenses for the SilkWorm 12000 are based on the 64-bit globally-unique chassis ID. The 64-bit chassis ID is used to activate licenses for both of the logical switches within the SilkWorm 12000. This is different from previous Brocade products in which licenses were based on the switch WWN. The chassis ID is available through the command licenseidShow.
Page 112 Maintaining the SilkWorm 12000 7-26 Publication Number 53-0000251-02...
Page 113: Software Issues
Troubleshooting/Support This chapter includes the following sections: • Software Issues on page 8-1 • Hardware Issues on page 8-5 Software Issues Table 8-1 Software Troubleshooting Problem Symptom Cause Solution(s) Area When booting the switch it Firmware never loaded Call tech support for Booting just comes up to a “SH…”...
Page 114: Quickloop Issues
• Trunking license is installed. • Each port on the SilkWorm 12000 (or compatible switch) must be set to 2 Gb or AUTO speed type. • Trunking enabled on each port using the portcfgshow slot#/port# command to get current status. Then use the switchCfgTrunk 1 to enable Trunking on all ports or portCfgTrunkPort slot#/port# 1 to enable a specific port.
Page 115: Web Tools Issues
Web Tools Issues If the user is unable to connect to the SilkWorm 12000 using a web browser, the first item to check is the existence of the Web Tools license. Use licenseShow in order to show status of all licenses.
Page 116: Zoning
Troubleshooting/Support Zoning The first requirement for zoning to function properly is the existence of a valid license. To check, use the licenseShow command. Other possible symptoms encountered are listed in Table 8-5: Table 8-5 Zoning Issues Problem Symptom Cause Solution(s) Area Zoning Zoning command not...
Page 117: Hardware Issues
Troubleshooting/Support Table 8-6 Other Possible Software Issues (Continued) Problem Symptom Cause Solution(s) Area Switch status Running switchShow, POST diags are running Wait for POST to finish all ports show (takes approx. 9 minutes to “TESTING” status run a fully loaded chassis) Use diagdisablepost to disable.
Page 118: Software Command Status
Troubleshooting/Support Software Command Status To get an overall hardware status, the user can start by logging-in to each logical switch and executing several software commands to determine switch health as follows: Table 8-7 Software Command Status Switch Command Function of Command Status Area Switch Status switchShow...
Page 119: Cable-Side Leds
Troubleshooting/Support Cable-side LEDs The LEDs listed in Table 8-8 appear on the cable side of the system. Table 8-8 Cable-Side LED Status Indicators Indication • Green indicates link speed. Control Processor (CP) card contains two additional LEDs for its Ethernet On indicates 100 mbps operation.
Page 120: Non-Cable Side Leds
Troubleshooting/Support Non-cable Side LEDs The LEDs listed in Table 8-9appear on the non-cable side of the system. Table 8-9 Non-Cable Side LED Status Indicators Indication • Green indicates that the blower has power. Blower LEDs. • Amber indicates that the blower lade needs attention.
Page 121: Diagnostic Commands
Troubleshooting/Support Diagnostic Commands Every time that the SilkWorm 12000 powers up it runs POST (Power On Self Test), the switch runs a series of diagnostic tests to determine the health of the switch and each of its components. This process takes approximately ten minutes to run POST with eight (8) 16-port cards inserted.
Page 122 Troubleshooting/Support 8-10 Publication Number 53-0000251-02...
Page 123 Glossary 8b/10b An encoding scheme that converts each 8-bit byte into 10 bits. Used to balance encoding ones and zeros in high-speed transports. address A 24-bit or 8-bit value used to identify the source or destination of a frame. identifier AL_PA Arbitrated loop physical address.
Page 124 beacon When all the port LEDs on a switch are set to flash from one side of the switch to the other, to enable identification of an individual switch in a large fabric. A switch can be set to beacon by telnet command or through Brocade Web Tools. beginning The disparity at the transmitter or receiver when the special character associated running...
Page 125 connection A port that has originated a Class 1 dedicated connection and received a response initiator from the recipient. connection A port that has received a Class 1 dedicated connection request and transmitted a recipient response to the originator. Cyclic redundancy check. A transmission error check which is included in every data frame.
Page 126 Entry Fabric The basic Brocade software license that allows one E_Port per switch. error As applies to Fibre Channel, a missing or corrupted frame, time-out, loss of synchronization, or loss of signal (link errors). See also loop failure. exchange The highest level Fibre Channel mechanism used for communication between N_Ports.
Page 127 FL_Port Fabric loop port. A port that is able to transmit under fabric protocol and also has arbitrated loop capabilities. Can be used to connect an NL_Port to a switch. See also F_Port, Fx_Port. FLOGI Fabric login. The process by which an N_Port determines whether a fabric is present, and if so, exchanges service parameters with it.
Page 128 Host bus adapter. The interface card between a server or workstation bus and the Fibre Channel network. A Fibre Channel wiring concentrator that collapses a loop topology into a physical star topology. Nodes are automatically added to the loop when active and removed when inactive.
Page 129 link services A protocol for link-related actions. Loop initialization primitive. The signal used to begin initialization in a loop. Indicates either loop failure or resetting of a node. LM_TOV Loop master time-out value. The minimum time that the loop master waits for a loop initialization sequence to return.
Page 130 ordered set A transmission word that uses 8B/10B mapping and begins with the K28.5 character. Ordered sets occur outside of frames, and include the following items: • Frame delimiters: Mark frame boundaries and describe frame contents. • Primitive signals: Indicate events. •...
Page 131 public device A device that supports arbitrated loop protocol, can interpret 8-bit addresses, and can log into the fabric. public key The public half of a key pair. See also key, key pair. public key A type of cryptography which uses a key pair, with the two keys in the pair called cryptography at different points in the algorithm.
Page 132 SNMP Simple network management protocol. An internet management protocol that uses either IP for network-level functions and UDP for transport-level functions, or TCP/IP for both. Can be made available over other protocols, such as UDP/IP, because it does not rely on the underlying communication protocols. See also community (SNMP).
Page 133 User datagram protocol. A protocol that runs on top of IP and provides port multiplexing for upper-level protocols. Upper-level protocol. The protocol that runs on top of Fibre Channel. Typical upper-level protocols are SCSI, IP, HIPPI, and IPI. ULP_TOV Upper-level time-out value. The minimum time that a SCSI ULP process waits for SCSI status before initiating ULP recovery.
Page 134 Glossary-12 Publication Number 53-0000251-02...

Brocade Communications Systems SilkWorm 12000 Design, Deployment And Management Manual

Preface

Chapter 1 Introducing the Silkworm 12000

Chapter 2 Silkworm 12000 Architecture and What Is New

Chapter 3 Silkworm 12000 Based SAN Designs

Chapter 4 Deploying the Silkworm 12000

Chapter 5 Configuring the Silkworm 12000

Chapter 6 Silkworm 12000 Management Interfaces

Chapter 7 Maintaining the Silkworm 12000

Chapter 8 Troubleshooting/Support

Quick Links

Need help?

Questions and answers

Related Manuals for Brocade Communications Systems SilkWorm 12000

Summary of Contents for Brocade Communications Systems SilkWorm 12000

Table of Contents