Page 3
Rack relocation (19" rack)........................xxi Product recycling and disposal........................ xxii About this document..................xxiii Product documentation........................... xxiii Brocade documents..........................xxiii IBM and Brocade product matrix......................xxiii Supported hardware..........................xxiv Chapter 1. Device overview..................1 Hardware components..........................2 Port-Side view of the device........................3 Installing the 14U chassis mid-mount rack kit for two-post racks............
Page 4
Time and items required........................22 Parts List............................... 23 Assembling the rack hardware......................24 Chapter 4. Initial setup and verification............... 27 Configuration and verification task guide....................27 Items required............................28 Providing power to the device........................28 Connecting the power cord to AC power supplies................29 Connecting to HVAC/HVDC power supplies..................
Page 5
psShow..............................86 sensorShow............................86 sfpShow..............................87 slotShow............................... 91 supportSave............................91 tempShow.............................93 Running diagnostic tests........................... 94 Chapter 7. Port and extension blades..............95 FC32-X7-48 port blade overview......................95 FC32-X7-48 port blade numbering and trunking................95 FC64-48 port blade overview........................97 FC64-48 port blade numbering and trunking..................98 FC32-64 port blade overview........................99 FC32-64 port blade numbering and trunking...................
Page 6
Using the wwnrecover utility........................140 Preparing for WWN card replacement....................141 Hot-swap replacement..........................142 Cold-swap replacement.......................... 143 Removing the WWN card and bezel......................145 Configuring the airflow direction on WWN cards..................145 Verifying WWN card operation........................ 146 Chapter 11. Power supply assemblies..............147 HVAC/HVDC power supply overview.......................148 Power supply assembly numbering......................
Page 7
Synchronizing airflow direction on WWN cards..................179 Downloading the configuration....................... 179 Reconnecting the system to the network and fabric................180 Verifying correct operation of the system....................180 Verifying correct configuration of the fabric................... 181 Chapter 17. Removing the battery..............183 Appendix A. Product specifications..............185 Notices......................209 Trademarks..............................210 Homologation statement.........................210...
Page 9
Figures 1. Port-Side View of SAN512B-7 Director......................4 2. Nonport Side of the SAN512B-7 Director (Example Configuration)............5 3. 14U Rack Kit Parts............................18 4. Left and Right Shelf Brackets Installed on Rails..................19 5. Nut and Screw Locations for Mounting the Device..................20 6.
Page 10
44. Removing and Installing a Core Routing Blade on an SAN512B-7 Director ........120 45. CPX7 Blade Port Identification.......................124 46. Removal and Replacement of the Control Processor Blade (CPX7) on an SAN512B-7 Director ..129 47. Removal and Replacement of the Control Processor Blade (CPX7) on an SAN512B-7 Director..134...
Page 11
57. Fan Assembly Numbering........................158 58. Removing and Installing a Fan Assembly....................161 59. Removing and Installing the Blade Filler Panel in an SAN512B-7 Director......... 164 60. Removing and Installing the Blade Filler Panel on an X7-8 Director............ 165 61. Removing or Installing the Cable Management Comb................167 62.
Page 13
Tables 1. Brocade and IBM product and model number matrix................xxiii 2. Supported FRUs............................xxv 3. Rack Mount Kits............................xxvii 4. Facility Requirements ...........................8 5. Installation Tasks, Time, and Items Required ..................10 6. Installation Prerequisites..........................12 7. Installation and Basic System Configuration .................... 13 8.
Page 14
24. Fan Assembly LED Descriptions ......................81 25. Port Groups for Configuring Trunks......................97 26. Port Groups for Configuring Trunks......................99 27. Port Groups for Configuring Trunks......................101 28. External Port to slotShow Port Mapping for Core Blades..............113 29. Messages That May Indicate WWN Card Failure .................. 138 30.
Page 15
Search for the product Machine type or product name. For Fabric OS Release Notes and access to Fabric OS firmware downloads, go to the IBM Support Portal www.ibm.com/supportportal. Search for the product Machine type or product name, and then follow links for Downloads.
Page 16
Vendor software This product includes certain vendor software that is not covered under the IBM license agreement. IBM makes no representation about the accessibility features of these products. Contact the vendor for the accessibility information about its products. Related accessibility information You can view the publications for this product in Adobe Portable Document Format (PDF) using the Adobe Acrobat Reader.
Page 17
Safety Notices publication that is shipped with this product. The following notices and statements are used in IBM documents. They are listed below in order of increasing severity of potential hazards. Follow the links for more detailed descriptions and examples of the danger, caution, and attention notices in the sections that follow.
Page 18
A Danger statement indicates conditions or situations that can be potentially lethal or extremely hazardous to you. Safety labels are also attached directly to products to warn of these conditions or situations. xviii IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 19
General Dangers DANGER: The procedures in this manual are for qualified service personnel. Dangers Related to Equipment Weight DANGER: Use safe lifting practices when moving the product. DANGER: Make sure the rack housing the device is adequately secured to prevent it from becoming unstable or falling over.
Page 20
• Wear a wrist grounding strap connected to chassis ground (if the switch is plugged in) or a bench ground. Note: For safety reasons, the ESD wrist strap should contain a series 1 megaohm resistor. • Store ESD-sensitive components in antistatic packaging xx IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 21
Rack safety Rack installation DANGER: Observe the following precautions when working on or around your IT rack system: • Heavy equipment—personal injury or equipment damage might result if mishandled. • Always lower the leveling pads on the rack cabinet. • Always install stabilizer brackets on the rack cabinet. •...
Page 22
(R002) Product recycling and disposal Refer to the IBM Systems Environmental Notices and User Guide (Z125-5823) for translated environmental statements and information regarding product recycling and disposal. This document may be provided either in printed version or on the product documentation CD. A more current version may be available through this link ftp://public.dhe.ibm.com/systems/support/warranty/envnotices/...
Page 23
Brocade products. Table 1 on page xxiii provides a product matrix to correlate the Brocade products and models to the IBM product names and machine types and model numbers. Products withdrawn from marketing are not listed.
Page 24
The following tables list the orderable SKUs and the rack mount kits that are supported on this device. ® The first release of this product was at Fabric OS 9.0.0. xxiv IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 25
Table 2. Supported FRUs Part Number Short Description Introduced (OS) Currently Supported AC Power XBR-X6- Provides 1450W (100–120 VAC) Fabric OS 9.0.0 Supply RACNPIPSU-010 and 2870W (200–240 VAC). This model supports nonport-side intake (NPI) airflow. XBR-X6- Provides 1450W (100–120 VAC) Fabric OS 9.0.0 RACNPEPSU-01 and 2870W (200–277 VAC).
Page 26
The following blades require optics that are labeled with an SEC designation: • Brocade FC64-48 Port Blade • Brocade FC32-X7-48 Port Blade The following image provides an example of an optic label with SEC in the description (32G LW-SEC 10km). xxvi IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 27
Table 3. Rack Mount Kits Par Number Short Description Rack Mount Kits XBR-DCX-0121 Mid-mount rack mount kit for two-post rack XBR-DCX-0120 14U rack mount kit for four-post rack (27–31 in.) XBR-DCX-0152 14U rack mount kit for four-post rack (22 in.) Rack Mount Kits XBR-DCX4S-0120 27–31-in.
Page 28
IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 30
- Redundant primary power connections ensure high availability. Each power supply assembly has its own connector, so the number of primary power connections is four for optimum efficiency and redundancy. 2 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 31
Port-Side view of the device The following figure shows the port-side view of the SAN512B-7 Director with installed blades identified. Note that the SX6 extension blades is not shown in the following figure, but would install in the same slots as the FC32-X7-48 or FC64-64 port blades.
Page 32
Use the following instructions to install a Brocade modular device in a telecommunications (Telco) rack, using the 14U Chassis Mid-Mount Rack Kit for Two-Post Racks. Observe the following considerations when mounting this device: 4 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 33
Nonport-side view of the device The following figure shows the nonport-side view of the SAN512B-7 Director with all fan and power supply assemblies installed. Figure 2. Nonport Side of the SAN512B-7 Director (Example Configuration) 1.
Page 34
Although not illustrated, the chassis label that contains the serial number, SKU, and WWN is located on the lower portion of the chassis, below the fan assemblies. 6 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 36
Ensure that the air intake and exhaust vents have a minimum of 5.1 cm (2 in.) of air space. Ensure that the air intake temperature is less than 40°C (104°F) during operation. 8 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 37
Table 4. Facility Requirements (continued) Type Requirements Rack (when rack- Ensure that the following airflow requirements are met: mounted) • Plan to install the device with the air-intake side facing the cool-air aisle. The device can be installed facing either direction if serviceability and cooling requirements are met.
Page 38
20–30 minutes SFP+, QSFP28, or QSFP56 needed. optical transceivers as needed. Attaching fiber-optic cables, 2‒3 hours Fiber-optic cables, cable ties, cable ties, and cable guides. and cable management comb. 10 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 39
15. Verify that you have the following items. Save shipping cartons and packaging in the event you need to return the device. The following items are packaged in device shipping carton: • SAN512B-7 Director with a shipping tray • Packing foam • Antistatic plastic •...
Page 40
The initial setup includes mounting the device on a flat surface or in a rack and completing the configuration tasks necessary to bring the device online and verify the operation. 12 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 41
Table 7. Installation and Basic System Configuration Task Task Details or Additional Information Complet Install blades or power supply Install any blades or power supply assemblies that have shipped assemblies. separately from the chassis. Be sure to use a No.1 Phillips screwdriver for captive screws to lock these FRUs into place.
Page 42
Optional: Power off the devices. Enter the shutdowncommand and wait for the device to power down, and then unplug the power cords. See “Powering down the chassis” on page 42 for more information. 14 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 43
“Facility requirements” on page 8 are met. Note: The preceding rack mount kits are supported for these devices on the publication date of this guide. For current support information, contact IBM Support. Mounting precautions The following precautions specifically apply to mounting the device.
Page 44
• Before mounting your device, review any specific installation and facility requirements in this Hardware Installation Guide. • Hardware devices illustrated in these procedures are only for reference and may not depict the device you are installing into the rack. 16 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 45
Time and items required Allow approximately one hour to unpack and install a device in a rack. The following tools are required when installing the 14U Rack Mount Kit for Four-Post Rack: • Torque screwdriver with No. 2 Phillips screwdriver tip •...
Page 46
1. Locate the shelf brackets in the device. 2. Locate and loosen the screws on the adjustable ends of the brackets (see the following figure) to allow for adjustment to rack depth. 18 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 47
Figure 4. Left and Right Shelf Brackets Installed on Rails CAUTION: Use the screws specified in the procedure. Using longer screws can damage the device. 3. Position the shelf brackets with the adjustable ends on the intake air aisle side of the rack (see the previous figure).
Page 48
1. Ensure that the door, if installed, is removed from the port side of the device. For instructions, see the instructions for removing and replacing the device door in the device installation guide. 2. Use a lift to raise the device to the level of the shelf brackets. 20 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 49
3. Move the lift as close as possible to the rack, with the air-intake side of the device facing the front of the rack (see the following figure). 4. If applicable, lock the wheels of the lift. 5. Gently slide the device onto the shelf brackets, ensuring that it remains supported during the transfer. Figure 6.
Page 50
• Hardware devices illustrated in these procedures are only for reference and may not depict the device you are installing into the rack. Time and items required Allow approximately one hour to unpack and install a chassis in a rack. 22 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 51
The following tools are required when installing the 14U Chassis Mid-Mount Rack Kit for Two-Post Racks. • Torque wrench with No. 2 Phillips screwdriver tip • Flathead screwdriver • Hydraulic or assisted lift with a minimum raise of 140 cm (55 in.) and a minimum capacity of 113 kg (250 lbs) Parts List The following parts are provided with the 14U Chassis Mid-Mount Rack Kit for Two-Post Racks.
Page 52
3. Verify that the rear edge of the front tray is seated into the front edge of the rear tray. 2. Tray, Rear, Mid-Mount, Chassis 3. Adapter, Rear, Mid-Mount, Right 4. Adapter, Rear, Mid-Mount, Left 5. Screws Figure 9. Attaching the Rear Tray to the Rack Rails 24 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 53
1. Tray, Front, Mid-Mount, Chassis 5. Screws Figure 10. Attaching the Front Tray to the Rack Rails Chapter 3. Mounting the switch 25...
Page 54
26 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 56
• Before connecting power, refer to the following sources of information: – Electrical caution and danger statements in “Safety precautions” on page 7 and “Facility requirements” on page 8 28 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 57
– Power supply specifications section in the Appendix A, “Product specifications,” on page 185 for power supply requirements of your device. • Connect each power supply to a different power source or circuit to provide full redundancy. • Route the power cords so they will be out of the way when connected to the power source. Ensure that the power cords have a minimum service loop of 15.2 cm (6 in.) and are routed to avoid stress.
Page 58
The connector on the power cord is keyed so that it only fits one way into the power supply connector. Note that the connector's latch should be positioned under the connector and will latch when the power cord connector is fully inserted into the power supply. 30 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 59
6. Attach the cable restraint cover under the power cord connector using its two torx head screws (see Step “4” on page 30). Note: This retainer cover protects the power cord from being accidentally unlatched and disconnected from the power supply. 7.
Page 60
Note that the connector's latch should be positioned under the connector and will latch when the power cord connector is fully inserted into the power supply. 32 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 61
Establishing a serial connection to the device About this task To establish a serial connection to the console port on the device, complete the following steps. Procedure 1. Verify that the device is powered on and that POST is complete by verifying that all power LED indicators on the power supplies, fans, and blades display a steady green light.
Page 62
• 10.77.77.75 / CP0 (the CP blade in slot 1 at the time of configuration) • 10.77.77.74 / CP1 (the CP blade in slot 2 at the time of configuration) 34 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 63
Use one of the following formats for IPv4 or IPv6 addressing when entering the IP address using the ipaddrset command: • If using an IPv4 IP address, enter the IP address in dotted-decimal notation as prompted. Ethernet IP Address: [192.168.74.102] •...
Page 64
You can use the fabricshow command on another device in the fabric to view domain IDs already assigned. Manually configure a unique domain ID using the configure command as in the following steps: 36 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 65
Procedure 1. Log on to the device using one of the following methods: • A serial console connection to the active CP blade. The active CP is indicated by an illuminated blue LED on the blade front panel. • A telnet session using the chassis management IP address. 2.
Page 66
– For Eastern Standard Time, enter tsTimeZone -5,0. Table 11. Example: tsTimeZone Command Parameter Selection for the U.S. Time Zones Local Time tsTimeZone Parameter (Difference from UTC) Atlantic Standard –4,0 Atlantic Daylight –3,0 Eastern Standard –5,0 38 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 67
Table 11. Example: tsTimeZone Command Parameter Selection for the U.S. Time Zones (continued) Local Time tsTimeZone Parameter (Difference from UTC) Eastern Daylight –4,0 Central Standard –6,0 Central Daylight –5,0 Mountain Standard –7,0 Mountain Daylight –6,0 Pacific Standard –8,0 Pacific Daylight –7,0 Alaskan Standard –9,0...
Page 68
This will list installed licenses and display a license key, such as aNYtMJg7tcMZrTZ9JTXBC4SXWLJMY3QfBKYHG. 4. Enter the license --show command on the active CP blade to obtain the license ID (the switchWwn, formerly chassis ID). 40 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 69
The chassis ID is required to obtain and activate licenses for the device. 5. Store and record the license key file for future reference. What to do next Refer to the Fabric OS Administration Guide for more information. Verifying correct operation About this task Perform the following steps to verify correct operation of the device.
Page 70
5. Enter the following commands for additional configuration information that you can save to files: • configShow • ipaddrShow • licenseShow • switchShow Powering down the chassis About this task Perform the following steps to power down the chassis. 42 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 71
Procedure 1. Shut down the chassis using the sysShutdowncommand. switch::admin> sysshutdown This command will shutdown the operating systems on your switch. You are required to power-cycle the switch in order to restore operation. Are you sure you want to shutdown the switch [y/n]?y HA is disabled Stopping blade 1 Shutting down the blade..
Page 72
44 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 74
The following note applies to QSFP transceivers on core routing blades. • To connect an ICL between a QSFP on a SAN256B-7 or SAN512B-7 Director core routing blade and a QSFP on a SAN384B-2 or SAN768B-2 Director core routing blade, use the 4x32Gb/s QSFP28 SWL transceiver that supports 4x32Gb/s and 4x16Gb/s operation.
Page 75
1. QSFP Quad Connector Figure 11. QSFP to QSFP Standard Cables This is only useful for ICLs if connecting to a patch panel. 1. QSFP MPO Connector 2. SFP Connectors Figure 12. QSFP to SFP Breakout/Cables DANGER: Use only optical transceivers that are qualified by Broadcom and comply with the FDA Class 1 radiation performance requirements defined in 21 CFR Subchapter I, and with IEC 60825 and EN60825.
Page 76
A separate fiber optic cable connects to the transceiver. Some QSFP transceivers have an integrated pull tab that releases the transceiver from the port. 48 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 77
Core routing blades QSFPs installed in core routing blades are used for connecting inter-switch links (ICLs) between SAN256B-7 and SAN512B-7 Directors or between SAN256B-7/SAN512B-7 and SAN256B-6/SAN512B-6 or SAN384B-2 and SAN768B-2 Directors. Interconnecting these devices increases the number of useable ports for device connections.
Page 78
4x32Gb/s and 4x16Gb/s speeds so can be used for an ICL connection between a 32Gb/s QSFP on a SAN256B-7 and SAN512B-7 Director core routing blade and a 16Gb/s QSFP transceiver on a SAN384B-2 or SAN768B-2 Director core routing blade. The 32Gb/s QSFP can also be used to connect an SAN256B-7 or SAN512B-7 Director to an SAN256B-6 or SAN512B-6 Director.
Page 79
All 16 ICL ports can be used for 2 km distances when 20 buffer credits are configured per virtual channel. Time and items required The installation or replacement procedure for one transceiver takes less than 5 minutes. Ensure that the following items are available: •...
Page 80
• If the transceiver has a bail latch mechanism (10GbE transceivers), ensure that the bail (wire handle) is in the unlocked position, grasp the transceiver, and push it into the port until firmly seated. Close the bail to latch the transceiver in the slot. 52 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 81
Figure 19. Installing an SFP+ Transceiver with a Bail Latch into a Blade Port Transceivers are keyed so that they can be inserted only with the correct orientation. If a transceiver does not slide in easily, ensure that it is correctly oriented. 2.
Page 82
Insert the cable into the transceiver until the latching mechanism clicks. Cables are keyed so that they can be inserted in only one way. If a cable does not slide in easily, ensure that it is correctly oriented. 54 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 83
Installing a QSFP transceiver About this task The device supports only transceivers qualified for Brocade devices. If you use an unqualified transceiver, the switchshow command output shows the port in a Mod_Inv state. The operating system also logs the issue in the system error log. Also, note the following: •...
Page 84
Note: Cables are keyed so that they can be inserted in only one way. If a cable does not slide in easily, ensure that it is correctly oriented. 5. Organize cables to avoid covering LEDs and air vents. See “Cable management” on page 51. 56 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 85
Verifying the operation of new transceivers About this task You can use the following commands to verify if the transceivers are working correctly: • errDump • fabricShow • sfpShow • switchShow • switchshow -qsfp • switchshow -slot, where slot is the slot number For output examples and additional information on Fabric OS commands, see “Using monitoring commands”...
Page 86
58 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 88
Fast-flashing amber (on Environmental range has Check for out-of-bounds 1/2 second, then off 1/2 been exceeded. environmental second) conditions and correct them. 60 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 89
Table 13. Port Blade LED Descriptions (continued) LED Purpose Color Status Recommended Action FC port Status No light (LED is off) Port has no incoming Verify that the power power, or there is no LED is on, check the light or signal carrier transceiver and cable.
Page 90
3. Status LED for Right FC Port 4. Status LED for Left FC Port The following table describes the port blade LED patterns and the recommended actions for those patterns. 62 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 91
Table 14. Port Blade LED Descriptions LED Purpose Color Status Recommended Action Power Steady green The blade is operational. No action is required. No light (LED is off) The blade is not Ensure that the blade is powered on. firmly seated, with ejectors pushed in fully to the center of blade and ensure that the...
Page 92
Interpreting FC32-64 port blade LEDs See the following figure and table to interpret the LED patterns for the FC32-64 blade. The LED patterns temporarily change during POST and other diagnostic tests. 64 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 93
Figure 26. FC32-64 Port Blade LEDs 1. Blade Power LED 2. Blade Status LED 3. Status LEDs for QSFP+ Ports The following table describes the blade LED patterns and the recommended actions for those patterns. Note: When the QSFP is operating in breakout mode, each of the four LEDs to the right of the QSFP quad port indicates the status of an individual breakout port.
Page 94
Fast-flashing amber (on Environmental range has Check for out-of-bounds 320 ms second, then off been exceeded. environmental 320 ms) conditions and correct them. 66 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 95
Table 15. Port Blade LED Descriptions (continued) LED Purpose Color Status Recommended Action QSFP port Status No light (LED is off) Port has no incoming Verify that the blade power, or there is no power LED is on, check light or signal carrier the transceiver and detected.
Page 96
3. Right 40GbE QSFP (Port 0) Status LED 4. Left 40GbE QSFP (Port 1) Status LED 5. Right 1 or 10GbE Port Status LED 6. Left 1 or 10GbE Port Status LED 68 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 97
7. Right FC Port Status LED 8. Left FC Port Status LED 1. Blade Power LED 2. Blade Status LED 3. Upper 40GbE QSFP (Port 0) Status LED 4. Lower 40GbE QSFP (Port 1) status LED 5. Upper 1 or 10GbE Port Status LED 6.
Page 98
No action is required. traffic lowing through the port. Blinking amber A transceiver or port has Change the transceiver an error or is faulty. or reset the switch from the workstation. 70 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 99
Table 16. Extension Blade LED Descriptions (continued) LED Purpose Color Status Recommended Action FC port status No light (LED off) Port has no incoming Verify that the power power, or there is no LED is on, check the light or signal carrier transceiver and cable.
Page 100
The CP blade is on. No action is required. No light (LED is off) The CP blade is not on. Ensure that the blade is firmly seated and has power. 72 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 101
Table 17. CP Blade LED Descriptions (continued) LED Purpose Color Status Recommended Action Attention No light (LED is off) The CP blade is either Verify that the power LED healthy or does not have is on. power. Steady amber If the LED is on for more Ensure that the blade is than 5 seconds, the CP firmly seated and the...
Page 102
Interpreting core routing blade LEDs See the following figure and table to interpret the LED patterns on the CR64-4 blade. The LED patterns temporarily change during POST and other diagnostic tests. 74 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 103
Figure 29. CR64-8 Core Routing Blade LEDs 1. Blade Power LED 2. Blade Status LED 3. QSFP Status LED for Right QSFP Port 4. QSFP Status LED for Left QSFP Port Chapter 6. Monitoring the switch 75...
Page 104
Steady green The QSFP module is in No action is needed. and all ports are online. 76 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 105
Interpreting power supply LEDs See the following information to interpret the LED patterns on the power supply. The LED patterns may temporarily change during POST and other diagnostic tests. The SAN512B-7 Director can have up to four power supplies. Chapter 6. Monitoring the switch 77...
Page 106
In the unlikely event of a faulty power supply, the status LED will flash in a coded pattern to provide additional fault information. Record the sequence of flashes and status as defined in the table to provide to your support representative along with supportsave output data. 78 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 107
Table 22. AC Power Supply LED Descriptions LED Purpose Color Status Recommended Action Power status No light (LED is off) The power supply does Ensure that the power supply is not have incoming firmly seated, the power cable is power and is not connected, and the power cable providing power to the is connected to the power...
Page 108
Interpreting fan assembly LEDs See the following figure and table to interpret the LED patterns on fan assemblies. The LED patterns may temporarily change during POST and other diagnostic tests. The SAN512B-7 Director has three fan assemblies. 80 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 109
Figure 33. Fan Assembly LEDs 1. Power LED 2. Status LED Table 24. Fan Assembly LED Descriptions LED Purpose Color Status Recommended Action Power No light (LED is off) The fan assembly does Ensure that the fan not have power. assembly is firmly seated and has power.
Page 110
For information about turning beaconing on or off, refer to the Fabric OS Administration Guide. • Verify that the switch prompt displays when POST completes. 82 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 111
If it does not display, POST was not successfully completed. Contact the device supplier for support. • Review the system error log using the errShow or errDump commands. Any errors detected during POST are written to the system log, which is accessible through the errShow command.
Page 112
Fan 2 is Ok, speed is 7471 RPM Fan 3 is Ok, speed is 7434 RPM haShow Use the haShow command to display the control processor (CP) status. The display includes the following information: 84 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 113
• Local CP state (slot number and CP ID), warm or cold, recovering or recovered. • Remote CP state (slot number and CP ID). • High Availability (enabled or disabled). • Heartbeat (up or down). • Health of standby CP. •...
Page 114
7: (Temperature) is Ok, value is 39 C sensor 8: (Temperature) is Ok, value is 46 C sensor 9: (Temperature) is Ok, value is 29 C sensor 10: (Temperature) is Ok, value is 30 C 86 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 115
sensor 11: (Temperature) is Ok, value is 43 C sensor 12: (Temperature) is Ok, value is 46 C sensor 13: (Temperature) is Ok, value is 41 C sensor 14: (Temperature) is Ok, value is 36 C sensor 15: (Temperature) is Ok, value is 38 C sensor 16: (Temperature) is Ok, value is 36 C sensor 17: (Temperature) is Ok, value is 37 C sensor 18: (Temperature) is Ok, value is 32 C...
Page 122
For more information about diagnostic tests and how to run them, refer to the Fabric OS Administration Guide and the Fabric OS Command Reference Manual. For information about system error messages (errShow or errDump), refer to the Fabric OS Troubleshooting and Diagnostics Guide. 94 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 124
1. FC Ports 0–23 (numbered bottom to top) 2. FC Ports 24–47 (numbered bottom to top) See Supported Transceivers and Cables for a list of qualified transceivers for blade ports. 96 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 125
The following table defines the eight-port Fibre Channel port groups for configuring trunk groups or "trunks." On the blade, ports belonging to the same port group are indicated with the same color border beneath the port on the blade label. Ports belonging to the same ASIC are indicated by a border with a similar color tone.
Page 126
The following figure shows how ports are numbered on the blade. Figure 35. FC64-48 Blade Port Numbering 1. FC Ports 0–23 (numbered bottom to top) 2. FC Ports 24–47 (numbered bottom to top) 98 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 127
7 and 8. Up to eight hot-swappable port blades can be installed in a single chassis to provide up to 384 32Gb/s FC ports. • It is recommended that three fan assemblies be installed on the SAN512B-7 chassis if blades are being used.
Page 128
• For more details on FCoE, Flexport, and breakout mode features and commands, refer to the Fabric OS Administration Guide and Fabric OS Command Reference Manual. FC32-64 port blade numbering and trunking The following illustration shows how ports are numbered on the blade. 100 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 129
Figure 36. FC32-64 Blade Port Numbering Note: Numbering (0-63) on this figure accounts for the quad ports available for 16 installed QSFP+ transceivers. The physical QSFP+ ports are numbered 0-15 from bottom to top. See “Supported transceivers and cables” on page 45 for a list of qualified transceivers for blade ports. The following table defines the eight-port Fibre Channel port groups for configuring trunk groups or "trunks."...
Page 130
1GbE ports operate at 10Gb/s or 1Gb/s fixed speeds with appropriate 10Gb/s or 1Gb/s transceivers installed. The 40GbE QSFP ports operate at 40Gb/s fixed speed. Extension blades have the following LED indicators: • Green blade power LED • Amber blade status LED 102 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 131
• Bicolor green/amber 40GbE and 10GbE or 1GbE port status LEDs • Bicolor green/amber FC port status LEDs For details on interpreting LED operation, see “Interpreting extension blade LEDs” on page 67. All features are supported on this blade with no license requirements. Extension features The SX6 Extension blade supports the following extension features: Note: For full details on extension blade features and configuration, refer to the Fabric OS Extension.
Page 132
Following are the eight-port Fibre Channel port groups for configuring trunk groups or "trunks": • Port group 0: ports 0–7 • Port group 1: ports 8–15 Following are the requirements for forming trunk groups: 104 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 133
• All ports in a trunk group must belong to the same port group. For example, to form an 8-port trunk select all eight ports from port group 0 or port group 1. You cannot use ports from each port group for the trunk.
Page 134
Delete all IP routes defined on the blade to be removed using the portcfg iproute delete command. c) Delete all IP interfaces (IPIFs) defined on the blade using the portcfg ipif slot/geX delete command. 106 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 135
d) If logical switches are used on the switch, move all blade ports back to the default logical switch. Refer to the lscfg command in the for details. Note: If you are removing the extension blade to install in a different slot, you must remove configuration using the preceding steps, then reconfigure the blade in the new slot.
Page 136
• “Interpreting FC32-64 port blade LEDs” on page 64 • “Interpreting FC64-48 port blade LEDs” on page 62 • “Interpreting extension blade LEDs” on page 67 2. Enter the following commands and note any error conditions: 108 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 137
• slotshow -p – Displays the current data on each slot in the system, including blade type, blade ID, status, and Brocade model name. • tempShow – Displays temperature reading of blades. • chassisShow – Displays information about each component in the system. •...
Page 138
110 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 139
These transceivers can create ICL connections for up to nine separate directors in a full-mesh topology and 12 directors in a core-to-edge topology. This core switch blade is compatible only with the SAN512B-7. Core routing blades contain the following LED indicators: •...
Page 140
Each numbered QSFP port on the blade provides four Gen 7 ICL FC ports. The following table shows the mappings from the numbered QSFP ports on the face of the core blade to the individual FC port numbers. 112 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 141
QSFPs within a port trunk group on a core blade installed in one device must be connected to a pair of QSFPs within a trunk group on a core blade in another device. Each CR64-8 blade on the SAN512B-7 Director has four ICL trunking groups consisting of the following QSFP ports.
Page 142
• Up to 12 directors can be connected in a core-to-edge topology. To connect multiple SAN256B-7 or SAN512B-7 Directors via ICLs, a minimum of four ICL ports (two on each core routing blade) must be connected between each chassis. The dual connections on each core blade must reside within the same trunk group.
Page 143
Figure 41. ICL Cable Connections for the SAN Director (Sample Configuration) The following illustration shows the minimum connectivity between an SAN512B-7 Director and a SAN768B-2 chassis: Figure 42. ICL Cable Connections for the X6 Director (Sample Configuration) The following requirements apply for ICLs: •...
Page 144
Although SAN256B-6 and SAN512B-6 Directors are shown in the figure, the same principles apply to SAN256B-7 and SAN512B-7 Directors. The cabling scheme should follow the parallel example shown in the previous figure. Each line in the example actually represents four cables running between the devices.
Page 145
CAUTION: If you do not install a module or a power supply in a slot, you must keep the slot filler panel in place. If you run the chassis with an uncovered slot, the system will overheat. CAUTION: Static electricity can damage the chassis and other electronic devices. To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them.
Page 146
119 and “Installing a core routing blade” on page 120. Note: After installing the new blade, allow sufficient time for it to initialize and for all decommissioned ports to transition back online. 118 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 147
Removing a core routing blade About this task Perform the following procedures to remove one core routing blade at a time with chassis power on. You must replace the blade and ensure its operation before removing the other core routing blade. Removing both blades will power down the chassis.
Page 148
Figure 44. Removing and Installing a Core Routing Blade on an SAN512B-7 Director 13. If the blade is not being replaced by another blade, install a filler panel and reinstall the chassis door. The filler panel is required for proper chassis cooling. The door is required to meet EMI compliance.
Page 149
b) Continue pushing with your thumbs or fingers until the ejectors move in toward the blade slightly, indicating that the connectors are engaged. c) Simultaneously push both ejector handles in toward the blade center with even pressure until the blade completely seats in the slot. Note: As you move the handles, you will hear connectors engaging the backplane connector and possibly a slight popping noise.
Page 150
122 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 151
Chapter 9. Control processor blades The CPX7 control processor blades are half the slot height of other SAN512B-7 Director blades. Two CPX7 control processor blades are stacked vertically in the half slots on the left side of the chassis to provide CP redundancy.
Page 152
CPX7 blades located in slots 1 and 2. Observe the following precautions when replacing these blades: • The CPX7 blade is compatible only with the SAN256B-7 and SAN512B-7 Director. • Wear an appropriately grounded ESD wrist strap when handling and installing blades and cards. Follow electrostatic discharge (ESD) precautions.
Page 153
CAUTION: Static electricity can damage the chassis and other electronic devices. To avoid damage, keep static-sensitive devices in their static-protective packages until you are ready to install them. CAUTION: Before plugging a cable into any port, be sure to discharge the voltage stored on the cable by touching the electrical contacts to ground surface.
Page 154
Fabric OS Command Reference Guide. c) In a FICON environment, log on as root and enter configupload --map to upload port-to-area mapping information. Specify a folder name, when prompted. 126 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 155
This command saves the port-to-area addressing mode configuration files to the folder specified. Be sure to upload the configuration using the -map option for a FICON-enabled device if port- bound addressing is used. For more information, refer to the Fabric OS Command Reference Guide. 2.
Page 156
9. Continue pulling the blade from the slot by the blade edges. As you slide out the blade, place one hand under it for support. Do not support the blade by the injector handles after removal. 128 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 157
Figure 46. Removal and Replacement of the Control Processor Blade (CPX7) on an SAN512B-7 Director 10. If the blade is not being replaced by another blade, install a filler panel and reinstall the chassis door. The filler panel is required for proper chassis cooling. The door is required to meet EMI compliance.
Page 158
WARNING: The local CP and remote CP have different versions of firmware, please 5. Bring the replacement blade firmware to the same firmware level as the active blade using one of the following procedures: 130 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 159
• Run the firmwaresync command on the active CP blade to copy all firmware from the active CP blade to the standby CP blade. Note: To use this command, you must restart the existing telnet, secure telnet, or SSH sessions to the standby CP blade.
Page 160
7. Ensure that you are still logged on to the standby CP blade (the blade for which you just changed the firmware level) and type reboot. The reboot of the standby CP will initiate a firmwarecommit to the secondary partition and log you out. 132 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 161
Chassis_1: admin> reboot Broadcast message from root (ttyS0) Fri Jun 17 14:49:45 2016... The system is going down for reboot NOW !! INIT: Switching to runlevel: 6 INIT: Sending processes the TERM signal Chassis_1:admin> HAMu Heartbeat down, stop FSS Unmounting all ##exiting due to signal: 9, pending signals: 0x20000, 0x0 ilesystems.
Page 162
Do not support the blade by the injector handles after removal. Figure 47. Removal and Replacement of the Control Processor Blade (CPX7) on an SAN512B-7 Director 9. If the blade is not being replaced by another blade, install a filler panel and reinstall the chassis door.
Page 163
5. Enter configDownload -vf to download device virtual fabric data to the local system. The device reboots and partitions are restored. 6. Enter chassisDisable. 7. Enter configDownload -map to download port-to-area addressing mode configuration files to the local system. 8. Power-cycle the chassis. The system recovers.
Page 164
See Using Monitoring Commands and the Fabric OS Command Reference Manual for output examples and additional information on Fabric OS commands. For more information about error messages, refer to the Fabric OS Message Reference Manual. 136 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 166
WWN unit fails to power on. <timestamp>, [EM-1004], <sequence-number>, CRITICAL, <system-name>, WWN # failed to power onor<timestamp>, [EM-1043], <sequence-number>, WARNING, <system-name>, Can't power <FRU Id> <state (on or off)>. 138 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 167
Table 29. Messages That May Indicate WWN Card Failure (continued) Type of Message Sample Error Message WWN unit is faulted. 0x24c (fabos): Switch: switchname , Critical EM-WWN_UNKNOWN, 1, Unknown WWN #2 is being faultedor<timestamp>, [EM-1003], 40, SLOT 7 | FFDC | CHASSIS, CRITICAL, Brocade_Chassis, WWN 2 has unknown hardware identifier: FRU faultedor<timestamp>, [EM-1034], <sequence-number>, ERROR,...
Page 168
Recovery is not possible. Please The license ID on the two WWN cards does not contact Brocade Technical Support for match. replacement of the corrupted or inaccessible WWN(s). 140 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 169
The wwnrecover utility must be used to maintain data integrity when replacing one or both WWN cards using instructions in the WWN card removal and replacement section. To run wwnrecover, log on as admin and enter the following command: switch:admin# wwnrecover For more information on wwnrecover and command syntax, refer to the Fabric OS Command Reference Manual.
Page 170
IP addresses on installed WWN cards do not match, follow instructions in the message to recover the IP address so that both cards use the same address. 5. Determine the active CP blade by entering the haShow command. 142 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 171
6. On the active CP blade, run the wwnrecover command and specify the WWN card that you replaced (WWN 2 or WWN 1) when prompted. 7. If wwnrecover messages prompt for a system reboot, reboot both CP blades to ensure the system is running with valid WWN card data.
Page 172
Insert and tighten both screws using a Phillips screwdriver. 15. Pack faulty WWN card assemblies in the packaging provided with the replacement cards, and return them to Brocade Support for failure analysis (FA). 144 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 173
Removing the WWN card and bezel About this task Two WWN cards are located behind the WWN bezel. As you face the bezel on the nonport side of the device, WWN 1 is located on the left side, and WWN 2 is on the right. When cards have been determined faulty and the replacement WWN cards have been received, complete the following steps to remove the bezel and faulty WWN cards.
Page 174
For information on interpreting LED patterns, see “Interpreting WWN card LEDs” on page 77. 2. Enter the errDump command. This displays the system error log. Refer to the Fabric OS Messages Reference Manual for more information on the messages in this log. 146 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 175
6. Airflow Label 7. Captive Screw The SAN512B-7 Director can have up to four power supplies in a 2+2 full redundant configuration. Only two PSUs are required at any given time to support all possible blade configurations using AC high-line (200 to 240 VAC).
Page 176
HVAC/HVDC power supply overview The SAN256B-7 and SAN512B-7 chassis support a dual-function high-voltage AC, high-voltage DC (HVAC/HVDC) power supply assembly. This power supply converts AC or DC input to the required DC output power required for device operation. Each HVAC/HVDC power supply assembly provides the following power outputs in Watts at the indicated AC and DC input rated voltages: •...
Page 177
Consider the following information when connecting AC power: • The SAN512B-7 Director can have three or four power supplies installed, depending on the quantity ordered. You should use the high-voltage line (200 to 277 VAC) because of better power conversion efficiency.
Page 178
FRUs from chassis connectors. Precautions specific to power supply assembly Observe the following precautions when replacing the power supply assembly: 150 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 179
Note: Depending on the blade configuration of the device and the number of power supplies installed, the device may be able to continue operating while replacing a power supply. See "Power Supply Requirements" in the Appendix A, “Product specifications,” on page 185 for minimum power supplies required for AC low and high voltage line operation, redundancy in case of power supply failure, and other specifications.
Page 180
If there is insufficient power, the chassis will power down blades until the power demand can be met. 2. Perform one of the following steps: 152 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 181
• If you need to power down the chassis to remove a power supply, enter the sysShutdown command. See “Powering down the chassis” on page 42 for detailed procedures. When the chassis completes shut-down, remove power cords from all power supply assemblies. Note: To remove a power cord from an HVAC/HVDC power supply, you must remove the power cord retainer cover, if attached under the power cord connector, and then unlatch the power cord release latch located under the power cord connector.
Page 182
See Using Monitoring Commands and the Fabric OS Command Reference Manual for output examples and additional information on Fabric OS commands. For more information about error messages, refer to the Fabric OS Message Reference Manual.. 154 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 184
FRU, contains either NPI or NPE. If a mismatched power source or fan assembly is installed by mistake, a RASlog message occurs indicating that a mismatch in fan or power supply airflow has occurred and the FRU is faulted. 156 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 185
Note: If airflow direction for a power supply assembly does not match the chassis airflow direction as stored on WWN cards, the power supply will have a "fault" status. However, the LED operation for the power supply will not indicate a fault. If the airflow direction for a fan assembly does not match the chassis airflow direction, the fan LED will indicate a fault condition.
Page 186
Note: Make sure that the captive screws securing fan assemblies to the chassis are tightened. If they are not tightened, high pressure from fan operation may unseat the fan from chassis connectors. 158 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 187
Fan assembly fault indicators Use one of the following methods to determine if a fan assembly is faulty: • Check the fan status LED. – Steady amber – fan assembly has a failure (full or partial). – Slow-flashing amber (on 2 seconds, then off 2 seconds) – fan assembly is not seated correctly or is faulty.
Page 188
Use a No. 1 Phillips screwdriver if necessary. 4. Grasp the handle and pull, sliding the fan assembly from the chassis while supporting the fan assembly from beneath as you remove it. 160 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 189
Figure 58. Removing and Installing a Fan Assembly 5. If you are leaving power on for replacement (hot-swap), be sure to replace the fan assembly as soon as possible. Installing a fan assembly About this task Complete the following steps to replace the fan assembly in a chassis: Procedure 1.
Page 190
162 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 191
Note: Filler panels for SAN384B-2 and SAN768B-2 Directors are not interchangeable with filler panels for SAN256B-7 and SAN512B-7 Directors. Note: SAN256B-7 and SAN512B-7 blade filler panels have been designed to meet the thermal specifications of a SAN256B-7 and SAN512B-7 chassis. Do not replace SAN256B-7 and SAN512B-7 blade filler panels with those from a SAN256B-6 or SAN512B-6 chassis.
Page 192
Figure 59. Removing and Installing the Blade Filler Panel in an SAN512B-7 Director Note: Filler panels for SAN768B-2 and SAN384B-2 Directors are not interchangeable with filler panels for SAN256B-7 and SAN512B-7 Directors. Installing a filler panel Procedure 1. Pull out the spring-loaded latch release on the latch at each end of the cover using your thumb and forefinger and slide the latches toward the center of the cover.
Page 193
Figure 60. Removing and Installing the Blade Filler Panel on an X7-8 Director 4. Reinstall the chassis door. The door must be installed to meet EMI compliance. Chapter 13. Blade filler panels 165...
Page 194
166 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 195
Chapter 14. Cable management comb Use the cable management comb to organize and route cables attached to blade ports. The SAN512B-7 Director can continue to operate while removing or installing the cable management comb. Time and items required for removal and installation The replacement procedure for the cable management comb takes less than five minutes.
Page 196
Complete the following steps to replace the cable management comb: Procedure 1. Position and tighten the four (4) screws to secure the cable management comb to the chassis. 2. Arrange the cables along with the cable management comb. 168 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 198
2. Align the six ball stud attachment holes in the back of the door with the six ball studs in the chassis and push the door into place. It will snap onto the studs. Figure 64. Installing Chassis Door 170 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 200
This includes information on licenses, IP addresses, WWNs, serial numbers, switch IDs, location of 172 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 201
configuration files, and fabric details. It also includes information that might be required by Technical Support. “Recording critical device and SAN information” on page 173 instructs you to run the following commands and record specific output: • chassisShow • configUpload - all •...
Page 202
File Name [config.txt]: config-switch0.txt Password: Upload complete switch:admin> 3. Record the WWN value: Enter wwn, and then copy the command output into a file named config- miscinfo.txt. switch:admin> wwn 10:00:00:60:69:00:00:0a 174 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 203
4. Enter ipAddrShow, and then copy the command output into the config-miscinfo.txt file. switch:admin> ipaddrshow Chassis Ethernet IP Address: 10.33.60.85 Ethernet Subnetmask: 255.255.240.0 Ethernet IP Address: 10.33.60.86 Ethernet Subnetmask: 255.255.240.0 Host Name: cp0 Gateway IP Address: 10.33.48.1 Ethernet IP Address: 10.33.60.87 Ethernet Subnetmask: 255.255.240.0 Host Name: cp1 Gateway IP Address: 10.33.48.1...
Page 204
You must power-cycle the switch in order to restore operation. Are you sure you want to shutdown the switch [y/n]?y HA is disabled Stopping blade 1 Shutting down the blade..Stopping blade 2 Shutting down the blade..176 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 205
Stopping blade 8 Shutting down the blade..Broadcast message from root (pts/1) Tue April 12 14:23:06 2008... The system is going down for system halt NOW !! DANGER: Disconnect the power cord from all power sources to completely remove power from the device.
Page 206
7. Verify that the device is powered on and POST is complete (all power LED indicators on the blades should be a steady green). 178 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 207
8. Verify that all components are functioning correctly by checking their LEDs. If the LEDs do not indicate correct operation, try reinstalling the corresponding component. Synchronizing airflow direction on WWN cards An airflow direction mismatch may occur if the airflow direction, nonport-side intake (NPI) or nonport- side exhaust (NPE), for installed fan and power supply assembly FRUs does not match the airflow direction set on the new WWN cards shipped with replacement chassis.
Page 208
The following example shows the mismatch of the system airflow and the airflow direction in the installed fan and the power supply. POWER SUPPLY Unit: 1 Power Source: Fan Direction: Non-portside Intake 180 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 209
Unit: 2 Fan Direction: Non-portside Intake Unit: 1 System AirFlow: Non-portside Exhaust Unit: 2 System AirFlow: Non-portside Exhaust The WWN units should indicate "Non-portside Intake." If there is a mismatch of airflow direction, RASlog messages will indicate a mismatch between the system airflow direction and the airflow direction of fan in power supply or fan assembly.
Page 210
• If there are any mechanical problems, try re-seating the associated component. • If the configuration information is not correct for the device, modify as required. • If other issues exist, contact your support provider. 182 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 211
Exchange only with the IBM-approved part. Recycle or discard the battery as instructed by local regulations. In the United States, IBM has a process for the collection of this battery. For information, call 1-800-426-4333. Have the IBM part number for the battery unit available when you call.
Page 212
6. Recycle the battery as appropriate, following local regulations. Refer to the Environmental Notices and User Guide shipped with the product for more information on battery recycling and disposal. 184 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 213
2Tb/s for FC32-64: 64 ports x 32Gb/s (data rate). bandwidth Chassis bandwidth SAN512B-7 Director: 31 Tb/s per chassis (384 device ports with 64Gb/s data rate plus 32 4x50Gb/s Gen7 ICLs). Can use up to 8 ports in a trunk group to form a 256-Gbps trunk.
Page 214
System processors FreeScale P4080 (8 core), 1.5 GHz. Aggregate bandwidth SAN512B-7 Director: 131Tb/s when populated with 384 x 64Gb/s ports and using 32 ICL ports at 128Gb/s (including 4Tb/s of ICL bandwidth). Switch latency FC64-48 port blade: < 900 ns (including FEC) any port to any port local switching and 2.7 μsec blade to blade (including FEC) at 32Gb/s, cut-through...
Page 215
Chassis-to-chassis linkage through connectors on the core routing (CR) blade. Fibre Channel System Component Description Fibre Channel ports SAN512B-7 Director: Up to 384 64Gb/s ports, universal FC (E_Port, EX_Port, F_Port, M_Port, D_Port, FICON) and Ethernet. Appendix A. Product specifications 187...
Page 216
Unicolor (green) displaying power-off and power-on condition. Unicolor (amber) fault LED. Fan status Unicolor (green) displaying power-off and power-on condition. Unicolor (amber) displaying four different LED states based on fan operation. 188 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 217
1.29 in. 8.09 in. 13.57 in. 4.25 lb CR64-8 Core routing blade 3.63 cm 42.06 cm 34.13 cm 4.72 kg blade for SAN512B-7 1.43 in. 16.56 in. 13.44 in. 10.40 lb (without Director. media) FC32-X7-48 48-port port blade 3.63 cm 42.06 cm...
Page 219
Although examples for different port and blade configurations are provided, for more information and help with determining the actual number of power supplies for your deployment, contact your local IBM representative. Appendix A. Product specifications 191...
Page 220
Director ports and QSFP ICLs 200–240 VAC (high line) 3 (N+1) 200–277 HVAC (high line) 240–380 HVDC 200–240 VAC (high line) 4 (N+N) 200–277 HVAC (high line) 240–380 VDC 192 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 221
Ports Power Power Supplies for Supplies for Operation Redundancy Any combination 100–120 VAC (low line) Not supported SAN512B-7 of 32Gb/s ports, Director Extension 200–240 VAC (high line) 3 (N+1) blades, and 200–277 HVAC (high line) QSFP ICLs 240–380 HVDC 200–240 VAC (high line) 4 (N+N) 200–277 HVAC (high line)
Page 222
3 fan power efficiency and assemblies redundancy. 2252W 2202W Same power supplies as Same supported above. configuration as 7685 Btu/hr 7516 Btu/hr above, but port blades are FC64-48. 194 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 223
40°C (104°F). Maximum power is used for all supported optics. Power specifications do not include the power draw for the SX6 extension blade. Note: Volt-ampere (VA) power measurement is provided only for power consumption using the maximum chassis configuration. For VA power measurements for your configuration, contact your IBM representative. Model...
Page 224
Name Input Input @ 240 or 277 VAC Input 1209W 1182W Same power Same configuration as above, but port supplies as blades are FC64-48. 4126 Btu/hr 4036 above. Btu/hr 196 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 225
Minimum Number of Power Supplies Notes @ 100 VAC @ 380 VDC Name Input Input @ 240 or 277 VAC Input SAN512B-7 1515W 1481W 2 power supplies for DC input (192–400 IBM SAN512B-7 VDC) Director fully 5171 5055 Btu/hr loaded: 2 CP Btu/hr 3 power supplies for AC low line (100–...
Page 226
Typical 1 = 50W Typical 2 = 50W Maximum = 50W CR64-4 Core Routing Blade for SAN256B-7 Idle = 50W Typical 1 = 195W Typical 2 = 240W Maximum = 255W244W 198 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 227
Module Name Module Description Power Consumption CR64-8 Core Routing Blade for SAN512B-7 Idle = 80W Typical 1 = 420W Typical 2 = 480W Maximum = 505W Extension Blade Idle = 300W Typical 1 = TBD Typical 2 = 340W Maximum = 420W...
Page 228
20m (65.6 ft) (OM2) 70m (230 ft) (OM3) 100m (328 ft) (OM4) 62.5 10m (32.8 ft) 10 km (6.2 miles) Gen 7 ICL 70 (230 ft) (OM3) 100m (328 ft) (OM4) 200 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 229
Data Port Specifications (Fibre Channel) Model Port Type Number Description of Ports 4x16Gb/s E, F, D, M, QSFP+ and EX Fibre Channel ports using four FC32-64 Fibre Channel port blades. 32Gb/s E, F, D, M, SFP+ and EX Fibre Channel ports using four FC64-48,...
Page 230
EX operation Fibre only) Channel ports using four FC64-48, FC32- X7-48, FC32-48 Fibre Channel port blades. E, F, D, M, and EX Fibre Channel ports using four extension blades. 202 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 231
Model Port Type Number Description of Ports SAN512B 4x32Gb/s E, F, D, M, and EX Fibre Channel ports using eight FC32-64 QSFP28 Fibre Channel port blades. 4x16Gb/s QSFP+ 512 E, F, D, M, and EX Fibre Channel ports using eight FC32-64Fibre Channel port blades.
Page 232
4 SX6 extension blades. 10GbE Up to 64 10GbE ports supported with 4 SX6 extension blades. 1GbE Up to 64 1GbE ports supported with 4 SX6 extension blades. 204 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 233
Model Port Type Number of Description Ports SAN512B-7 40GbE Up to 128 40GbE ports supported with 8 FC32-G7-64 port blades for FCoE applications. 25GbE Up to 512 25GbE ports supported with 8 FC32-G7-64 port blades for FCoE applications. The 512 ports are provided by 16 100GbE transceivers installed on each blade operating in 4x25 GbE breakout mode.
Page 234
• VCCI-32 (Japan) Regulatory Compliance (Environmental) • 1907/2006 of the European Parliament and of the Council of 18 December 2006 concerning the Registration, Evaluation, Authorisation, and Restriction of Chemicals (EU REACH). 206 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 235
• 2006/66/EC – Batteries and accumulators and waste batteries and accumulators (EU battery directive). • 2011/65/EU – Restriction of the use of certain hazardous substances in electrical and electronic equipment (EU RoHS). • 2012/19/EU – Waste electrical and electronic equipment (EU WEEE). •...
Page 236
208 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 237
Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe on any IBM intellectual property right may be used instead.
Page 238
International Business Machines Corp., registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at Copyright and trademark information atwww.ibm.com/legal/copytrade.shtml Adobe, the Adobe logo, PostScript, and the PostScript logo are either registered trademarks or trademarks of Adobe Systems Incorporated in the United States, and/or other countries.
Page 239
Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung von IBM verändert bzw.
Page 240
This topic contains the product service contact information for Taiwan. IBM Taiwan Product Service Contact Information: IBM Taiwan Corporation 3F, No 7, Song Ren Rd., Taipei Taiwan Tel: 0800-016-888 212 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 241
Japan Voluntary Control Council for Interference (VCCI) Notice Japan Electronics and Information Technology Industries Association (JEITA) Notice This statement applies to products less than or equal to 20 A per phase. This statement applies to products greater than 20 A, single phase. This statement applies to products greater than 20 A per phase, three-phase.
Page 242
Korea Notice Russia Notice 214 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 243
209 boot results 82 trademarks 210 POST 82 IBM contacts xv director of licensing, address 209 IBM Publications Center xv documentation IBM Support Portal xv Brocade xxiii Fabric Operating System (FOS) xxiii installing 49 installation tasks 9 intellectual property 209...
Page 244
183 blade filler panel 163 chassis 171 QSFP cables 49 transceivers 45 safety notices xvii rack installation xxi rack relocation xxi safety labels xix SAN512B-7 library xxiii 216 IBM Storage Networking SAN512B-7: SAN512B-7 Installation, Service, and User Guide...
Page 246
IBM® Part Number: 03GM373 SC28-3150-00...
Need help?
Do you have a question about the SAN512B-7 and is the answer not in the manual?
Questions and answers