Page 1 NetApp™ Hardware Hardware Cabling Guide NetApp, Inc. 495 East Java Drive Sunnyvale, CA 94089 U.S.A. Telephone: +1 (408) 822-6000 Fax: +1 (408) 822-4501 Support telephone: +1 (888) 4-NETAPP Document comments: doccomments@netapp.com Information Web: http://www.netapp.com Part number: 52904-00, Rev. A April 2012...
Page 2 NetApp assumes no responsibility or liability arising from the use of products described herein, except as expressly agreed to in writing by NetApp. The use or purchase of this product does not convey a license under any patent rights, trademark rights, or any other intellectual property rights of NetApp.
Page 3 SnapSuite, SnapValidator, SnapVault, StorageGRID, StoreVault, the StoreVault logo, SyncMirror, Tech OnTap, The evolution of storage, Topio, vFiler, VFM, Virtual File Manager, VPolicy, WAFL, Web Filer, and XBB are trademarks or registered trademarks of NetApp, Inc. in the United States, other countries, or both.
Page 4 Trademark information...
Page 5: Table Of Contents
Table of Contents Chapter 1 Cabling Concepts and Best Practices........1 Cabling Concepts .
Page 6 Considerations for Drive Channel Speed ......17 Multiple Types of Drive Trays ........18 Single-Controller Topologies and Dual-Controller Topologies .
Page 7 Connection for the CE7922 Controller Tray or the CE7900 Controller Tray and One to Four FC4600 Drive Trays......72 Connection for the CE7922 Controller Tray or the CE7900 Controller Tray and Five to Eight FC4600 Drive Trays .
Page 8 One CE6998 Controller Tray and Multiple Types of Drive Trays ..103 Guidelines for Connecting FC2610 Drive Trays or FC4600 Drive Trays Guidelines for Connecting AT2655 Drive Trays....103 Drive Cabling Topologies for the E5400 Controller-Drive Trays .
Page 9 Component Locations on the DE6600 Drive Tray..... . 181 Component Locations on the FC4600 Drive Tray ..... . 182 Component Locations on the AT2655 Drive Tray.
Page 10 Getting Ready..........187 HotScale Technology .
Page 11: Chapter 1 Cabling Concepts And Best Practices
Cabling Concepts and Best Practices This chapter has three sections: Concepts” on page 1, provides definitions of the The first section, “Cabling  terms used in this document. This section is intended primarily for reference. Read the entire section to increase your overall understanding of the storage array and help you to optimize your storage array.
Page 12: Switched Bunch Of Disks
FC-AL-2 protocol. As a result, system firmware changes are not required. In this document, the FC2610 drive trays and the FC4600 drive trays are referred to as SBODs in the cabling diagrams. The AT2655 drive trays are identified as SATA (Serial Advanced Technology).
Page 13: Controller Tray
Controller Tray A controller tray contains controllers. A controller tray does not contain drives. Controller trays configure, access, and manage the storage space of attached drive trays. Controller-Drive Tray A controller-drive tray contains both controllers and drives. The controllers configure, access, and manage the storage space of the drives in the controller-drive tray.
Page 14: Dual-Ported Drives
Dual-Ported Drives Each drive in a controller-drive tray or a drive tray is dual ported. Circuitry in the drive tray or the controller-drive tray connects one drive port to one channel and the other port to another channel. Therefore, if one drive port or drive channel fails, the data on the drive is accessible through the other drive port or drive channel.
Page 15: Failover
Failover Failover is an automatic operation that switches from a failed component or failing component to an operational component. In the case of a Redundant Array of Independent Disks (RAID) controller failover, an operational controller takes over the ownership of volumes. The operational controller processes I/O from the host in place of the failing component or failed controller.
Page 16: Sfp Transceivers, Fiber-Optic Cables, And Copper Cables
SFP Transceivers, Fiber-Optic Cables, and Copper Cables Controller-drive trays, controller trays, and drive trays use fiber-optic cables or copper cables for Fibre Channel connections. For copper Fibre Channel cables, a passive copper Small Form-factor Pluggable (SFP) transceiver is attached to each end of the cable.
Page 17: Host Adapters
(SAN). For the HBAs to perform correctly, use HBAs from only one manufacturer in a SAN. You can obtain information about supported host adapters from the NetApp Interoperability Matrix Tool (IMT). To check for current compatibility, visit the web site at: http://now.netapp.com.
Page 18: Host Interface Cards
Host Interface Cards Each controller in a CE7900 controller tray has one or two host interface cards (HICs) that contain the host ports. Each controller in a CE4900 controller-drive tray has two Fibre Channel host ports built in, as well as an optional HIC for additional host ports. Each controller in an E2600 controller-drive tray or an E2660 controller-drive tray has two SAS host ports built in, as well as an optional HIC for additional host ports.
Page 19: How Initiators And Targets Respond To Zoning
How Initiators and Targets Respond to Zoning When an initiator first accesses the fabric, it queries the World Wide Identifier (WWID) name server for all of the attached disks and drive trays and their capabilities. Zoning is like a filter that the WWID name server applies to the query from the initiator that limits the information returned by the WWID name server to the initiator.
Page 20: In-Band Management And Out-Of-Band Management
In-Band Management and Out-of-Band Management A system administrator manages a storage array from a storage management station, which is a workstation on which the SANtricity ES Storage Manager Client is installed. Requests and status information sent between the storage array and the storage management station are managed in one of two ways: in-band or out-of-band.
Page 21 When you use out-of-band management, the storage management station is connected, through an Ethernet network, to each of the controllers in the controller tray or the controller-drive tray. Figure 5 Example of Out-of-Band Management Topology Ethernet Network User Workstations Sending and Receiving Data Storage Management Station Host Host Adapters...
Page 22 When using out-of-band management, a Dynamic Host Configuration Protocol (DHCP) server is recommended for assigning Internet Protocol (IP) addresses and other network configuration settings. A DHCP server provides the network administrators the ability to manage and automatically assign IP addresses. If a DHCP server is not used, you must manually configure the controllers.
Page 23: Best Practices
Best Practices This section explains recommended practices. To make sure that your cabling topology results in optimal performance and reliability, familiarize yourself with these best practices. NOTE If your existing storage array cabling do not comply with the best practices described in this section, do not re-attach your storage array unless specifically requested to do so by your Technical Support representative.
Page 24 The following figure shows a typical scenario. In this example, each of the eight drive trays has two connections directly to the controller tray: one from Environmental Services Module A to controller A and one from ESM B to controller B. Each redundant path pair on the controller tray connects to one drive tray.
Page 25: Host Cabling For Redundancy
Host Cabling for Redundancy To ensure that, in the event of a host channel failure, the storage array will stay accessible to the host, establish two physical paths from each host to the controllers, and install alternate path software on the host. This cabling topology, when used with alternate path software, makes sure that a redundant path exists from the host to the controllers.
Page 26: Cabling For Performance
Cabling for Performance Generally speaking, performance is enhanced by maximizing bandwidth, which is the ability to process more I/O across more channels. Therefore, a configuration that maximizes the number of host channels and the number of drive channels available to process I/O will maximize performance.
Page 27: Considerations For Drive Channel Speed
Table 1 Specifications for the Drive Trays Maximum Number of Model Port Speed Drives per Tray Drive Trays per Loop FC4600 drive tray 4 Gb/s FC2610 drive tray 2 Gb/s AT2655 drive tray 2 Gb/s DE6900 drive tray...
Page 28: Multiple Types Of Drive Trays
"Connecting to Drive Trays That Support Loop Switch described in Technology" on page 22. Do not create multiple series of FC2610 drive trays and FC4600 drive trays  (SBODs) that are separated by AT2655 SATA drive trays. Whenever possible, and with consideration of the previously stated rules and ...
Page 29 DE6900 drive tray and up to three FC4600 drive trays can share a loop. CE6998 Not supported Up to seven FC4600 drive trays per channel; up to 14 per  Controller Tray controller tray CE6994 Not supported Up to eight AT2655, FC2610, or FC2600 drive trays per channel;...
Page 30 Table 3 Drive Tray Connection Combinations for the CE4900, CDE3994, and CDE3992 Controller-Drive Trays DE6900 Drive FC4600 Drive AT2655 Drive FC2610 Drive FC2600 Drive Tray Tray Tray Tray Tray CE4900 Not supported Up to six per Not supported Not supported...
Page 31: Single-Controller Topologies And Dual-Controller Topologies
DE1600 Drive Trays DE5600 Drive Trays DE6600 Drive Trays E5424 Controller-Drive Tray Up to 15 per Up to nine per Up to three per controller-drive tray controller-drive tray controller-drive tray High Performance Coomputing when the when the when the Configuration controller-drive tray controller-drive tray controller-drive tray...
Page 32: Connecting To Drive Trays That Support Loop Switch Technology
Loop Switch Technology The FC2610 drive trays and the FC4600 drive trays operate internally as an array of drives that are connected in a point-to-point configuration by a Fibre Channel-Arbitrated Loop (FC-AL) loop switch. These drive trays are referred to as a Switched Bunch of Disks (SBOD).
Page 33 For example, if you mix FC4600 drive trays with FC2610 drive trays, the total number of drivedrives might be more than the maximum number that each drive channel can support.
Page 34: Labeling Cables
Labeling Cables Connecting cables is an important part of creating a robust storage array. Labeling the cables identifies system components, drive channels, and loops. System maintenance is easier when the cables are correctly identified. Label both ends of each cable. You can use adhesive office labels that are folded in half over the ends of each cable.
Page 35: Common Procedures
Common This section provides procedures that are common to most cable installations. Procedures Handling Static-Sensitive Components Static electricity can damage dual inline memory modules (DIMMs), system boards, and other static-sensitive components. To prevent damaging the system, follow these precautions: Move and store all components in the static-protective packaging in which they ...
Page 36 Put on antistatic protection. Make sure that your cables are fiber-optic cables by comparing them to the fiber-optic cable shown in the following figure. Your SFP transceivers might look slightly different from the one shown. The differences do not affect the performance of the SFP transceiver.
Page 37: Installing A Copper Cable With A Passive Sfp Transceiver
Installing a Copper Cable with a Passive SFP Transceiver ATTENTION Possible hardware damage – To prevent electrostatic discharge damage to the tray, use proper antistatic protection when handling tray components. Put on antistatic protection. Verify that your cables are copper cables by comparing them to the cable shown in the following figure.
Page 38: Installing An Iscsi Cable
Installing an iSCSI Cable ATTENTION Possible hardware damage – To prevent electrostatic discharge damage to the tray, use proper antistatic protection when handling tray components. Put on antistatic protection. Verify that you have the correct cables for an iSCSI connections by comparing them to the cable shown in the following figure.
Page 39: Installing A Sas Cable
Installing a SAS Cable ATTENTION Possible hardware damage – To prevent electrostatic discharge damage to the tray, use proper antistatic protection when handling tray components. Put on antistatic protection. Verify that you have the correct cables for a SAS connections by comparing them to the cable shown in the following figure.
Page 41: Product Compatibility
Product Compatibility This chapter lists all currently supported products, along with their host and drive channel specifications. Host Channel Information by Model The following table lists the specifications and restrictions that affect host-cabling topologies. Make sure that your planned controller tray topology or your planned controller-drive tray topology is compatible with these specifications and restrictions.
Page 42 Number of Maximum Maximum Maximum Host Ports Number of Product Host Port Type Host Port Number of Cable Type Hosts per Speed Hosts controller Cluster CDE3994 controller-drive Fibre Channel 2 Gb/s 1024 Fiber-optic tray CDE3992 controller-drive Fibre Channel 2 Gb/s 2 or 4 Fiber-optic tray...
Page 43: Drive Channel Information By Model
There is a limit of two expansion drive trays for each redundant pair of loops. Up to 448 drives are possible when FC4600 drive trays are used exclusively. There is a limit of seven expansion drive trays for each redundant pair of loops.
Page 44 Mixing drive tray types is supported. The maximum number of drives for a mixed configuration is 448. With a CE7900 controller tray, FC4600 drive trays support solid-state drives (SSDs). A drive tray can have both SSDs and hard disk drives. The maximum number of SSDs for the storage array is 20.
Page 45 Notes Speeds Drives Trays CE6998 controller 2 Gb/s or FC4600 Copper FC If you are using the FC4600 drive tray tray and CE6994 cables or in your configuration, design for a limit 4 Gb/s AT2655 controller tray fiber-optic FC of seven expansion drive trays for each...
Page 46 Drive Port Product Number of Drive Cable Type Notes Speeds Drives Trays CE4900 4 Gb/s FC4600 Copper FC Design for a limit of six expansion controller-drive cables or drive trays per dual-ported drive tray fiber-optic FC channel. cables Copper iSCSI...
Page 47: Drive Tray Information By Model
Table 3 Specifications for Non-SAS Drive Trays Maximum Number of Drive Model Port Speed Drives per Tray Trays per Channel DE6900 drive tray 4 Gb/s FC4600 drive tray 4 Gb/s FC2610 drive tray 2 Gb/s FC2600 drive tray 2 Gb/s AT2655 drive tray 2 Gb/s The E5400 controller-drive tray models are: E5412, E5424, and the E5460.
Page 48 Table 4 Specifications for SAS Drive Trays Maximum Number Maximum Number Model Port Speed Drives per Tray of Drives per of Drive Trays per Channel Channel DE6600 drive tray 6 Gb/s With E5400: 360 With E5400: 5 With E5400 With E5400 (InfiniBand): 240 (InfiniBand): 3 With E2660: 180...
Page 49: Host Connection
Host Connection This chapter provides examples of possible cabling topologies between one or more hosts and a controller tray or a controller-drive tray. Direct-attach topologies, fabric topologies, and mixed topologies are addressed. You are not limited to using only these topologies. Examples are provided to show basic concepts to help you define an optimal host-cabling topology.
Page 50: Host Interface Connections
Host Interface Connections The CE7900 controller tray connects to hosts through one or two host interface cards (HICs). The CE4900 controller-drive tray has built-in (base) Fibre Channel storage array (FC) connectors for host connections and might also have an optional HIC. The E2600 controller-drive tray and the E2660 controller-drive tray have built-in (base) SAS connectors for host connections and might also have an optional HIC.
Page 51 NOTE When a E2600 controller-drive tray or a E2660 controller-drive tray has a 10-Gb/s iSCSI HIC, some restrictions apply to the types of cables you can use for host connection. The following table shows the types and lengths of cables you can use. Do not use Category 5e cables or Category 6 cables.
Page 52 A HIC is connected to a host adapter: a host bus adapter (HBA) for Fibre Channel or SAS, or an Ethernet adapter for iSCSI. The host adapter in the host must match the type of HIC to which it is connected. For best performance, connect an 8-Gb/s Fibre Channel HIC to an 8-Gb/s HBA.
Page 53: Maximum Number Of Host Connections
Maximum Number of Host Connections Table 3 Maximum Number of Host Connections by Model to a Controller Tray or a Controller-Drive Tray Model Maximum Number of Hosts CE7922 controller tray and CE7900 2048 controller tray CE6998 controller tray and CE6994 1024 controller tray E5460, E5424, and E5412...
Page 54: Direct-Attach Topologies
Direct-Attach Topologies The host-to-controller tray topologies presented in this section do not use switches. The host adapters might be HBAs for Fibre Channel or SAS, HCAs for InfiniBand, or Ethernet for iSCSI. Some controller trays and controller-drive trays support more direct host connections than the examples shown.
Page 55 ATTENTION Possible loss of data access – You must install alternate path software or an alternate path (failover) driver on the host to support failover in the event of an HBA, an HCA, or an iSCSI Ethernet adapter failure or a host channel failure. Table 4 Redundant and Non-Redundant Components in a Direct-Attached Configuration with One Host and a Controller Tray or a Controller-Drive Tray Component...
Page 56: Two Hosts To A Controller Tray Or A Controller-Drive Tray
Two Hosts to a Controller Tray or a Controller-Drive Tray The following table lists the components in this topology which are non-redundant and present a risk of a single point of failure. The following figure shows an example of a direct-attach topology with two hosts and a dual-controller controller tray or a dual-controller controller-drive tray.
Page 57: One Hosts With Direct Sas Connections To Four Controller-Drive Trays
One Hosts with Direct SAS Connections to Four Controller-Drive Trays The following table lists the components in this topology that are non-redundant and present a risk of a single point of failure. The following figure shows an example of a direct-attach topology with one host and a dual-controller controller-drive tray.
Page 58 Figure 3 Direct-Attach Topology – One Host and Four Controller-Drive Trays with SAS Connections...
Page 59: One Single-Hba Host To A Single-Controller Controller Tray Or A Single-Controller Controller-Drive Tray
One Single-HBA Host to a Single-Controller Controller Tray or a Single-Controller Controller-Drive Tray The following figure shows an example of a direct-attach topology with one host and a single-controller controller tray or a single-controller controller-drive tray. The following table describes which of the components in this topology are non-redundant and present a risk of a single point of failure.
Page 60: Switch Topologies
Switch Topologies The host-to-controller tray topologies or host-to-controller-drive tray topologies presented in this section include one or more switches. The host adapters in the hosts might be HBAs for Fibre Channel, HCAs for InfiniBand, or Ethernet for iSCSI. Switches are not supported for SAS host connections. When a host is connected to a dual-controller controller-drive tray or a dual-controller controller tray, each attached host should have two host adapters installed.
Page 61: Two Hosts To A Controller Tray Or A Controller-Drive Tray
In the following figure, each outlined group of ports represents a zone. Figure 5 Switch Topology – One Host and a Controller Tray or a Controller-Drive Tray with a Switch Two Hosts to a Controller Tray or a Controller-Drive Tray The following figure shows an example of a switch topology with two hosts, a controller tray or a controller-drive tray, and a zoned switch.
Page 62 In the following figure, each outlined group of ports represents a zone. Figure 6 Switch Topology – Two Hosts and a Controller Tray or a Controller-Drive Tray with a Zoned Switch...
Page 63: Two Hosts To A Controller-Drive Tray With Switched Sas Connections
Two Hosts to a Controller-Drive Tray with Switched SAS Connections The following figure shows an example of a switch topology with two hosts, a controller-drive tray, and two SAS switches. The following table describes which of the components in this topology are non-redundant and present a risk of a single point of failure.
Page 64 Figure 7 Switch Topology – Two Hosts and a E2600 Controller-Drive Tray with SAS Connections Figure 8 Switch Topology – Two Hosts and a E2660 Controller-Drive Tray with SAS Connections...
Page 65: Four Hosts To A Controller Tray Or A Controller-Drive Tray
Four Hosts to a Controller Tray or a Controller-Drive Tray The following figure shows an example of a switch topology with four hosts, a controller tray or a controller-drive tray, and two zoned switches. The following table describes which of the components in this topology are non-redundant and present a risk of a single point of failure.
Page 66 In the following figure, each outlined group of ports represents a zone. Figure 9 Switch Topology – Four Hosts and a Controller Tray or a Controller-Drive Tray with Two Zoned Switches...
Page 67: Mixed Topologies
Mixed Topologies The following table describes which of the components in this topology are non-redundant and present a risk of a single point of failure. The following figure shows an example of a mixed topology; that is, a topology that combines both switch topology and direct-attach topology.
Page 68 Table 12 Redundant and Non-Redundant Components in a Mixed Configuration with Three Hosts and a Controller Tray or a Controller-Drive Tray Component Redundant Non-Redundant Host/servers 1 and 2 (see note) Redundant Host/server 3 Non-redundant HBA or Ethernet iSCSI adapter Redundant Host-to-controller cable Redundant Switch...
Page 69: Drive Connection
Drive Connection This chapter provides examples of connecting between a controller tray or a controller-drive tray and the environmental services modules (ESMs) of one or more expansion drive trays. This chapter also shows potential combinations of these products in storage array configurations. NOTE Each example in this chapter provides redundant access to each drive.
Page 70: Controller Tray
Drive Channel Redundancy for the CE7900 Controller Tray and the CE7922 Controller Tray Each controller has four drive channels, and each drive channel has two ports. Therefore, each controller has eight drive ports. A controller tray has eight redundant path pairs that are formed using one drive channel of controller A and one drive channel of controller B.
Page 71 Table 1 Redundant Path Pairs on the CE7900 Controller Tray and the CE7922 Controller Tray Drive Ports on Drive Channels Ports on Drive Channels Controller A on Controller A Controller B on Controller B Port 8 Channel 1 Port 1 Channel 5 Port 7 Channel 1...
Page 72: Drive Channel Redundancy For The Ce6998 Controller Tray
Drive Channel Redundancy for the CE6998 Controller Tray Each controller has two drive channels, and each drive channel has two ports. Therefore, each controller has four drive ports. A controller tray has four redundant path pairs that are formed using one drive channel of controller A and one drive channel of controller B.
Page 73: Drive Channel Redundancy For The E5460 Controller-Drive Tray
Drive Channel Redundancy for the E5460 Controller-Drive Tray Each controller in an E5460 controller-drive tray has one drive port. When a controller-drive tray has two controllers, the drive port on controller A and the drive port on controller B form a redundant pair. The following figure shows the drive ports on a dual-controller configuration.
Page 74: Controller-Drive Tray
Drive Channel Redundancy for the E5412 Controller-Drive Tray and the E5424 Controller-Drive Tray Each controller in a E5412 or a E5424 has one drive port. When a controller-drive tray has two controllers, the drive port on controller A and the drive port on controller B form a redundant pair.
Page 75: Drive Channel Redundancy For The Ce4900 Controller-Drive Tray
Drive Channel Redundancy for the CE4900 Controller-Drive Tray Each controller has one drive channel, and each drive channel has two ports. Therefore, each controller has two drive ports. A controller-drive tray has two redundant path pairs that are formed using one drive channel of controller A and one drive channel of controller B.
Page 76: Cde3992 Controller-Drive Tray
Drive Channel Redundancy for the CDE3994 Controller-Drive Tray and the CDE3992 Controller-Drive Tray Each controller has one drive channel, and each drive channel has two ports. Therefore, each controller has two drive ports. A controller-drive tray has two redundant path pairs that are formed using one drive channel of controller A and one drive channel of controller B.
Page 77: Drive Channel Redundancy For The E2600 Controller-Drive Tray
Drive Channel Redundancy for the E2600 Controller-Drive Tray Each controller in a E2600 has one drive port. When a controller-drive tray has two controllers, the drive port on controller A and the drive port on controller B form a redundant pair. The following figure shows the drive ports on a dual-controller configuration.
Page 78: Drive Channel Redundancy For The E2660 Controller-Drive Tray
Drive Channel Redundancy for the E2660 Controller-Drive Tray Each controller in a E2660 controller-drive tray has one drive port. When a controller-drive tray has two controllers, the drive port on controller A and the drive port on controller B form a redundant pair. The following figure shows the drive ports on a dual-controller configuration.
Page 79: Esm Canister Arrangements
ESM Canister Arrangements Many of the figures in topics for drive cabling topologies show storage arrays that use drive trays with side-by-side ESMs. Each ESM canister has one In port and one Out port (for Fibre Channel) or two SAS In ports and one SAS Expansion port (SAS). The canisters are located adjacent to one another, as shown in the following figures.
Page 80 The following figure shows a drive tray with ESM canisters one above the other. Figure 12 Drive Tray with Stacked ESMs...
Page 81: Controller Tray
DE6900 drive trays may be connected to any one loop pair. When a mix of FC4600 drive trays and DE6900 drive trays is connected to the controller tray, the total number of drives must not exceed 448.
Page 82: Connection For The Ce7922 Controller Tray Or The Ce7900 Controller Tray And One To Four Fc4600 Drive Trays
Connection for the CE7922 Controller Tray or the CE7900 Controller Tray and One to Four FC4600 Drive Trays The figures and tables in this section show representative configurations for redundant cabling. Figure 13 One CE7922 Controller Tray or CE7900 Controller Tray and Two...
Page 83 The following table specifies the cabling pattern for a controller tray that is attached to one to four drive trays. The “Cable” column indicates that two cables are used for each drive tray. In the rows for cable 1 and cable 2, for example, the “Xs” indicate that the cables are connected to controller A, channel 1, port 8 and controller B, channel 5, port 1 respectively.
Page 84: Connection For The Ce7922 Controller Tray Or The Ce7900 Controller Tray And Five To Eight Fc4600 Drive Trays
CE7922 Controller Tray or the CE7900 Controller Tray and Five to Eight FC4600 Drive Trays The figures and tables in this section show representative configurations for redundant cabling. Use the information in the previous topic to connect the first four drive trays, and then continue with this topic to connect up to eight additional drive trays.
Page 85 The following table specifies the cabling pattern for a controller tray that is attached to five to eight drive trays. The “Cable” column indicates that two cables are used for each drive tray. In the rows for cable 9 and cable 10, for example, the “Xs” indicate that the cables are connected to controller A, channel 1, port 7 and controller B, channel 5, port 2 respectively.
Page 86: Fc4600 Drive Trays
Controller Tray or CE7900 Controller Tray and Nine to 16 FC4600 Drive Trays When the number of drive trays exceeds eight, the cabling pattern changes significantly. From this point, you begin to use the “A” ports on the ESMs, and connect the drive trays beyond the eighth one to another drive tray.
Page 87 You can connect to 16 drive trays by following the pattern shown in this example. Figure 16 One CE7922 Controller Tray or CE7900 Controller Tray and Ten Drive Trays Chapter 4: Drive Connection...
Page 88 Table 8 One CE7922 Controller Tray or CE7900 Controller Tray and 10 Drive Trays Controller A Controller B Channel Number Channel Number Drive Trays Cable Port Number Port Number ESMs (Left or Right) 8 7 6 5 4 3 2 1 1 2 3 4 5 6 7 8 L R L R L R L R L R...
Page 89: One Ce7922 Controller Tray Or Ce7900 Controller Tray And 17 To
CE7900 Controller Tray and 17 to 28 FC4600 Drive Trays You can add drive trays in series to each redundant pair of drive ports up to 28 drive trays. In a configuration with 28 drive traydrive trays, four of the port pairs will have four drive trays each, while the other four will have three drive trays each.
Page 90 Figure 17 One CE7922 or CE7900 Controller Tray and 28 Drive Trays...
Page 91: De6900 Drive Trays Without Trunking
One CE7922 Controller Tray or CE7900 Controller Tray and One to Four DE6900 Drive Trays without Trunking In the cabling configuration figures that follow, the controller tray is placed on top, and the controllers are labeled as A and B. Because the DE6900 drive trays are very heavy, they are installed starting at the bottom of the cabinet.
Page 92 The following table specifies the cabling pattern for a controller tray that is attached to one to four drive trays. The “Cable” column indicates that two cables are used for each drive tray. In the rows for cable 1 and cable 2, for example, the “Xs” indicate that the cables are connected to controller A, channel 1, port 8 and controller B, channel 5, port 1 respectively.
Page 93: De6900 Drive Trays Without Trunking
One CE7922 Controller Tray or CE7900 Controller Tray Five to Eight DE6900 Drive Trays without Trunking In the cabling configuration shown in the following figure, the controller tray is placed on top, and the controllers are labeled as A and B. Because the DE6900 drive trays are very heavy, they are installed starting at the bottom of the cabinet.
Page 94 The figure and table in this topic show a representative configuration for redundant drive connection. Use the information in the previous topic to connect the first four drive trays, and then continue with this topic to connect up to four additional drive trays.
Page 95 The following table specifies the cabling pattern for a controller tray that is attached to five to eight drive trays. The “Cable” column indicates that two cables are used for each drive tray. In the rows for cable 9 and cable 10, for example, the “Xs” indicate that the cables are connected to controller A, channel 1, port 7 and controller B, channel 5, port 2 respectively.
Page 96 One CE7922 Controller Tray or CE7900 Controller Tray and One to Four DE6900 Drive Trays with Trunking In the figures that follow, the controller tray is shown on top, and the controllers are labeled as A and B. Because the DE6900 drive trays are very heavy, they are installed starting at the bottom of the cabinet.
Page 97 The figures in this section show representative configurations for cabling. Figure 20 One CE7922 Controller Tray or CE7900 Controller Tray and One DE6900 Drive Tray with Drive-Side Trunking Figure 21 One CE7922 Controller Tray or CE7900 Controller Tray and Two DE6900 Drive Trays with Drive-Side Trunking Chapter 4: Drive Connection...
Page 98 Figure 22 One CE7922 Controller Tray or CE7900 Controller Tray and Four DE6900 Drive Trays with Drive-Side Trunking Table 12 One CE7922 Controller Tray or CE7900 Controller Tray and DE6900 Drive Tray 1 with Drive-Side Trunking Controller A Controller B Drive Tray 1 Cable Top ESM...
Page 99 Table 13 One CE7922 Controller Tray or CE7900 Controller Tray and DE6900 Drive Tray 2 with Drive-Side Trunking Controller A Controller B Drive Tray 2 Cable Top ESM Bottom ESM 8 7 6 5 4 3 2 1 1 2 3 4 5 6 7 8 1A 1B 2A 2B 1A 1B 2A 2B Table 14 One CE7922 Controller Tray or CE7900 Controller Tray and DE6900 Drive Tray 3 with Drive-Side Trunking Controller A...
Page 100: De6900 Drive Trays With Drive-Side Trunking
One CE7922 Controller Tray or CE7900 Controller Tray and Five to Eight DE6900 Drive Trays with Drive-Side Trunking In the cabling configuration figure that follows, the controller tray is placed on top, and the controllers are labeled as A and B. Because the DE6900 drive trays are very heavy, they are installed starting at the bottom of the cabinet.
Page 101 Figure 23 One CE7922 Controller Tray or CE7900 Controller Tray and Eight DE6900 Drive Trays with Drive-Side Trunking Chapter 4: Drive Connection...
Page 102 Table 16 One CE7922 Controller Tray or CE7900 Controller Tray and DE6900 Drive Trays 1 and 2 with Drive-Side Trunking Controller A Controller B Drive Tray 1 Cable Top ESM Bottom ESM 8 7 6 5 4 3 2 1 1 2 3 4 5 6 7 8 1A 1B 2A 2B 1A 1B 2A 2B Drive Tray 1 Drive Tray 2 Cable...
Page 103 Table 17 One CE7922 Controller Tray or CE7900 Controller Tray and DE6900 Drive Trays 3 and 4 with Drive-Side Trunking Controller A Controller B Drive Tray 3 Cable Top ESM Bottom ESM 8 7 6 5 4 3 2 1 1 2 3 4 5 6 7 8 1A 1B 2A 2B 1A 1B 2A 2B Drive Tray 3 Drive Tray 4 Cable...
Page 104 Table 18 One CE7922 Controller Tray or CE7900 Controller Tray and DE6900 Drive Trays 5 and 6 with Drive-Side Trunking Controller A Controller B Drive Tray 5 Cable Top ESM Bottom ESM 8 7 6 5 4 3 2 1 1 2 3 4 5 6 7 8 1A 1B 2A 2B 1A 1B 2A 2B Drive Tray 5 Drive Tray 6 Cable...
Page 105 Table 19 One CE7922 Controller Tray or CE7900 Controller Tray and DE6900 Drive Trays 7 and 8 with Drive-Side Trunking Controller A Controller B Drive Tray 7 Cable Top ESM Bottom ESM 8 7 6 5 4 3 2 1 1 2 3 4 5 6 7 8 1A 1B 2A 2B 1A 1B 2A 2B Drive Tray 7 Drive Tray 8 Cable...
Page 106: One Ce7900 Controller Tray And Multiple Types Of Drive Trays
Controller Tray and Multiple Types of Drive Trays If you are connecting a mix of DE6900 drive trays and FC4600 drive trays, the following restrictions apply: Connect no more than two DE6900 drive trays per loop pair and no more than ...
Page 107: Drive Cabling Topologies For The Ce6998 Controller Tray
Drive Cabling Topologies for the CE6998 Controller Tray One CE6998 Controller Tray and One Drive Tray If you are connecting one CE6998 controller tray to one drive tray, use the cabling topology shown in the following table and figure. Figure 24 One CE6998 Controller Tray and One Drive Tray Table 20 One CE6998 Controller Tray and One Drive Tray Connection Point Connection Point...
Page 108: One Ce6998 Controller Traycontroller Tray And Two Drive Trays
One CE6998 Controller TrayController Tray If you are connecting one CE6998 controller tray to two drive trays, use the cabling and Two Drive Trays topology described in the following table and figure. Figure 25 One CE6998 Controller Tray and Two Drive Trays Table 21 One CE6998 Controller Tray and Two Drive Trays Connection Point Connection Point...
Page 109: One Ce6998 Controller Tray And Four Drive Trays
One CE6998 Controller Tray and Four Drive Trays If you are connecting one CE6998 controller tray to four drive trays, use the cabling topology shown in the following figure and table. Figure 26 One CE6998 Controller Tray and Four Drive Trays Chapter 4: Drive Connection...
Page 110 Table 22 One CE6998 Controller Tray and Four Drive Trays Connection Point Connection Point Drive Channel Port Number and Port Number and Tray or Component Tray or Component Location Location Controller A Drive tray 1 Left ESM, port B Controller A Drive tray 2 Left ESM, port B Controller A...
Page 111: One Ce6998 Controller Tray And Eight Drive Trays
One CE6998 Controller Tray and If you are connecting one CE6998 controller tray to eight drive trays, use the cabling Eight Drive Trays topology described in the following table and figure. Figure 27 One CE6998 Controller Tray and Eight Drive Trays Chapter 4: Drive Connection...
Page 112 Table 23 One CE6998 Controller Tray and Eight Drive Trays Connection Point Connection Point Drive Channel Port Number and Port Number and Tray or Component Tray or Component Location Location Controller A Drive tray 1 Left ESM, port B Drive tray 1 Drive tray 2 Left ESM, port B Controller A...
Page 113: One Ce6998 Controller Tray And Multiple Types Of Drive Trays
If your storage array includes FC2610 drive trays or FC4600 drive trays, connect  the FC2610 drive trays or the FC4600 drive trays so that they are the first devices on the drive channel (after controller A). The first device on the drive channel is distinguished by the fact that the left ESM of the first device is connected directly to controller A of the controller tray.
Page 114 For example, if you mix FC4600 drive trays with FC2610 drive trays, the total number of drives might be more than the maximum number that each drive channel can support.
Page 115: Drive Cabling Topologies For The E5400 Controller-Drive Trays
Drive Cabling Topologies for the E5400 Controller-Drive Trays This section provides examples of drive cabling topologies for the E5400 controller-drive trays. The E5400 controller-drive tray models are: E5412, E5424, and the E5460. The E5400 controller-drive trays can be connected to DE1600 drive trays, DE5600 drive trays, DE6600 drive trays, or combinations of these three types of drive trays DE5600 drive trays, DE6600 drive trays, or combinations of these two types of drive trays.
Page 116 The following figures show the SAS ports on a DE1600 drive tray or a DE5600 drive tray. You may connect either of the SAS ports labeled SAS 1 and SAS 2 to the SAS expansion port on another drive tray or on a controller-drive tray. Do not make connections to both the SAS 1 port and the SAS 2 port on the same ESM.
Page 117 Figure 31 One E5424 Controller-Drive Tray or E5412 Controller-Drive Tray and Two DE1600 Drive Trays or DE5600 Drive Trays Chapter 4: Drive Connection...
Page 118 The following figures show the SAS ports on a DE6600 drive tray. You may connect either the left or right SAS port on an ESM to the SAS expansion port on another drive tray or on a controller-drive tray. Do not make connections to both the left and right SAS ports on the same ESM.
Page 119 Figure 33 One E5424 Controller-Drive Tray or E5412 Controller-Drive Tray and One DE6600 Drive Tray Figure 34 One E5424 Controller-Drive Tray or E5412 Controller-Drive Tray and Two DE6600 Drive Trays Chapter 4: Drive Connection...
Page 120 The following figure shows how the cabling pattern can be continued for additional drive trays until the 15 drive tray limit or the limit on the total number of drives in the storage array is reached. The figure uses the schematic representation for DE1600 drive trays or DE5600 drive trays.
Page 121 Figure 35 One E5424 Controller-Drive Tray or E5412 Controller-Drive Tray and Seven or More Drive Trays NOTE The cabling pattern is independent of the physical location of the trays in the cabinet. If the controller-drive tray is installed in the middle of the cabinet, as shown Figure 31, the physical cabling pattern will be different from what is shown in Figure...
Page 122: Drive Cabling Topologies For The E5460 Controller-Drive Tray
Drive Cabling Topologies for the E5460 Controller-Drive Tray The figures in this section show representative cabling configurations. The configurations shown guarantee that redundant data paths exist between the controller-drive tray and all attached drive trays in a storage array. The E5460 controller-drive tray can be connected to DE1600 drive trays, DE5600 drive trays, DE6600 drive trays, or various combinations of those three models of drive tray.
Page 123 The following figures show the SAS ports on a DE1600 drive tray or a DE5600 drive tray. You may connect either the left or right SAS port on an ESM to the SAS expansion port on another drive tray or on a controller-drive tray. Do not make connections to both the left and right SAS ports on the same ESM.
Page 124 Figure 38 One E5460 Controller-Drive Tray and Two DE1600 Drive Trays or DE5600 Drive Trays...
Page 125 The following figures show the SAS ports on a DE6600 drive tray. You may connect either of the SAS ports labeled SAS 1 and SAS 2 to the SAS expansion port on another drive tray or on a controller-drive tray. Do not make connections to both the SAS 1 port and the SAS 2 port on the same ESM.
Page 126 Figure 40 One E5460 Controller-Drive Tray and One DE6600 Drive Tray...
Page 127 Figure 41 One E5460 Controller-Drive Tray and Two DE6600 Drive Trays Chapter 4: Drive Connection...
Page 128 The following figure shows how the cabling pattern can be continued for additional drive trays until the 15 drive tray limit or the limit on the total number of drives in the storage array is reached. The figure uses the schematic representation for DE1600 drive traydrive trays or DE5600 drive trays.
Page 129 The following figure shows cables for a storage array with the capacity for 384 drives, the maximum number. The storage array consists of a E5460 controller-drive tray with five DE6600 drive trays and one DE5600 drive tray. The maximum capacity can also be achieved by replacing the DE5600 drive tray in this example with two DE1600 drive trays.
Page 130: Drive Cabling Topologies For The Ce4900 Controller-Drive Tray
This section provides examples of drive cabling topologies that can be used for connecting the CE4900 controller-drive tray to FC4600 drive trays. Depending on the number of drive trays that you need to connect, see the applicable figure for a cable configuration.
Page 131 Figure 45 One CE4900 Controller-Drive Tray and Two FC4600 Drive Trays Chapter 4: Drive Connection...
Page 132 Figure 46 One CE4900 Controller-Drive Tray and Three FC4600 Drive Trays...
Page 133 Figure 47 One CE4900 Controller-Drive Tray and Four FC4600 Drive Trays Chapter 4: Drive Connection...
Page 134 Figure 48 One CE4900 Controller-Drive Tray and Five FC4600 Drive Trays...
Page 135 Figure 49 One CE4900 Controller-Drive Tray and Six FC4600 Drive Trays Chapter 4: Drive Connection...
Page 136: Drive Cabling Topologies For The Cde3994 Controller-Drive Tray And The Cde3992 Controller-Drive Tray
Drive Cabling Topologies for the CDE3994 Controller-Drive Tray and the CDE3992 Controller-Drive Tray This section provides examples of drive cabling topologies that can be used for the CDE3994 controller-drive tray. The controllers on the lower-cost CDE3992 controller-drive tray have two host ports and two drive ports. The controllers on the higher-cost CDE3994 controller-drive tray have four host ports and two drive ports.
Page 137 Figure 50 One CDE3994 Controller-Drive Tray and One Drive Tray with Inverted ESMs Table 24 One CDE3994 Controller-Drive Tray and One Drive Tray with Inverted ESMs Connection Point Connection Point Drive Channel Port Number and Port Number and Tray or Component Tray or Component Location Location...
Page 138 One CDE3994 Controller-Drive Tray or CDE3992 Controller-Drive Tray and Two Drive Trays If you are connecting one CDE3994 controller-drive tray to two drive trays, and those drive trays have inverted ESM canisters, use the cabling topology shown in the following table and figure. Figure 51 One CDE3994 Controller-Drive Tray and Two Drive Trays with Inverted ESMs...
Page 139 Table 25 One CDE3994 Controller-Drive Tray and Two Drive Trays with Inverted ESMs Connection Point Connection Point Drive Channel Port Number and Port Number and Tray or Component Tray or Component Location Location Controller A Drive tray 2 ESM A, port 1B Controller A Drive tray 1 ESM A, port 1B...
Page 140 One CDE3994 Controller-Drive Tray or CDE3992 Controller-Drive Tray and Three Drive Trays If you are connecting one CDE3994 controller-drive tray to three drive trays, and those drive traydrive trays have inverted ESM canisters, use the cabling topology described in the following table and figure. Figure 52 One CDE3994 Controller-Drive Tray and Three Drive Trays with Inverted ESMs...
Page 141 Table 26 One CDE3994 Controller-Drive Tray and Three Drive Trays with Inverted ESMs Connection Point Connection Point Drive Channel Port Number and Port Number and Tray or Component Tray or Component Location Location Controller A Drive tray 2 ESM A, Port 1B Controller A Drive tray 1 ESM A, Port 1B...
Page 142 One CDE3994 Controller-Drive Tray or CDE3992 Controller-Drive Tray and Four Drive Trays If you are connecting one CDE3994 controller-drive tray to four drive trays, and those drive trays have inverted ESM canisters, use the cabling topology described in the following figure and table. Figure 53 One CDE3994 Controller-Drive Tray and Four Drive Trays with Inverted ESMs...
Page 143 *The firmware that controls the controller-drive tray automatically assigns drive tray tray IDs to the FC4600 drive trays that will usually not match the drive tray numbers shown in this table and preceding figure. The connection is not affected by the assignment of drive tray tray IDs by the firmware.
Page 144 One CDE3994 Controller-Drive Tray or CDE3992 Controller-Drive Tray and Five Drive Trays If you are connecting one CDE3994 controller-drive tray to five drive trays, and those drive trays have inverted ESM canisters, use the cabling topology described in the following figure and table. Figure 54 One CDE3994 Controller-Drive Tray and Five Drive Trays with Inverted ESMs...
Page 145 NOTE The CDE3994 controller-drive tray supports a maximum of seven drive trays. However, if you are using the FC4600 drive tray in your configuration, plan for a limit of six FC4600 drive trays. Seven FC4600 drive trays fully populated with drives exceed the maximum number of drives supported on a single drive channel.
Page 146 Figure 55 One CDE3994 Controller-Drive Tray and Six Drive Trays with Inverted ESMs...
Page 147 ESM B, port 1B *The firmware for the controller-drive tray automatically assigns tray IDs to the FC4600 drive trays. Those tray IDs usually will not match the drive tray numbers shown in this table and in the preceding figure. The cabling pattern is not affected by the assignment of drive tray tray IDs by the firmware.
Page 148 For example, if you mix FC4600 drive trays with FC2610 drive trays, the total number of drives might be more than the maximum number that each drive channel can support.
Page 149 Figure 56 One CDE3994 Controller-Drive Tray and Multiple Types of Drive Trays Chapter 4: Drive Connection...
Page 150 Drive cabling topologies for the E2600 Controller-Drive Tray This section provides examples of drive cabling topologies for the E2600 controller-drive tray. The E2600 controller-drive tray can be connected to DE1600 drive trays, DE5600 drive trays, or combinations of these two drive trays. The total number of drives in the storage array, including the drives in the controller-drive tray and those in the drive trays, must not exceed 192.
Page 151 Figure 57 SAS Ports on a DE1600 Drive Tray or a DE5600 Drive Tray ESM A SAS Port 1 SAS Port 2 SAS Expansion Port ESM B Figure 58 One E2600 Controller-Drive Tray and One Drive Tray Chapter 4: Drive Connection...
Page 152 Figure 59 One E2600 Controller-Drive Tray and Two Drive Trays Figure 60 One E2600 Controller-Drive Tray and Three Drive Trays...
Page 153 Figure 61 One E2600 Controller-Drive Tray and Eight Drive Trays Chapter 4: Drive Connection...
Page 154 Drive cabling topologies for the E2660 Controller-Drive Tray This section provides examples of drive cabling topologies for the E2660 controller-drive tray. The E2660 controller-drive tray can be connected only to DE6600 drive trays. The total number of drives in the storage array, including the drives in the controller-drive tray and those in the drive trays, must not exceed 192.
Page 155 The following figures show the SAS ports on a DE6600 drive tray. You may connect either of the SAS ports labeled SAS 1 and SAS 2 to the SAS expansion port on another drive tray or on a controller-drive tray. Do not make connections to both the SAS 1 port and the SAS 2 port on the same ESM.
Page 156 Figure 63 One E2660 Controller-Drive Tray and One Drive Tray Figure 64 One E2660 Controller-Drive TrayController-Drive Tray and Two...
Page 157 Drive Trays Chapter 4: Drive Connection...
Page 159 Ethernet Connection This chapter provides examples of how to connect your storage array to an Ethernet network for out-of-band storage array management. If you plan to use in-band storage array management, Ethernet cable might not be necessary for management connections. For illustrations showing the Ethernet port locations on the specific controller tray model or controller-drive tray model that you are installing, see the topics under Locations"...
Page 160 Direct Out-of-Band Ethernet Topology The following figure shows storage array management connections from the controller tray or controller-drive tray to the Ethernet. In this topology, you must install a network interface card (NIC) in the storage management station in which the client software resides.
Page 161 Fabric Out-of-Band Ethernet Topology The following figure shows two storage array management connections from the controller tray or the controller-drive tray to two ports on an Ethernet switch. In this topology, you must install a NIC in the storage management station where the client software resides.
Page 163 Component Locations This chapter shows the rear of each controller tray, controller-drive tray, and drive tray. The figures identify the locations of controllers, environmental services modules (ESMs), host ports, drive ports, and Ethernet ports. The figures also show port identifiers. Use the figures in the following topics to make sure that you have correctly identified the cable connection for host cable, drive cable and Ethernet cable.
Page 164 Port Locations on the CE7922 and the CE7900 Controller Tray The CE7922 controller tray and the CE7900 controller tray have host channels that you can attach to the hosts, and drive channels that you can attach to the drive trays. The examples in this section show the CE7900 controller tray.
Page 165 Each controller in the CE7922 controller tray and the CE7900 controller tray has  four drive channels, and each drive channel has two ports, so each controller has eight drive ports. Controller A is inverted from controller B, which means that its drive channels ...
Page 166 Component Locations on the CE6998 Controller Tray Figure 3 Component Locations on the CE6998 Controller Tray – Rear View Controller A (Inverted) Controller B Host Ports Drive Ports Ethernet Ports NOTE Host port 4 on each controller of the CE6998 controller tray is reserved for the Synchronous Mirroring premium feature.
Page 167 Table 1 Drive Ports and DriveDrive Channels on the CE6998 Controller Tray Drive Channel Number Controller Drive Port Numbers 4 and 3 2 and 1 1 and 2 3 and 4 NOTE When you connect the CE6998 controller tray, it is important to note that drive channel 1 and drive channel 3 are a redundant pair, and drive channel 2 and drive channel 4 are a redundant pair.
Page 168 Component Locations on the E5400 Controller-Drive Trays The E5400 controller-drive trays include three models: the E5460, the E5424, and the E5412. Keep these points in mind when you compare the figures in this section to your hardware. The top of the controller-drive tray is the side with the labels. ...
Page 169 Figure 5 E5460 Controller-Drive Tray – Rear View Fan Canister Fan Power LED Fan Service Action Required LED Fan Service Action Allowed LED USB Connector Ethernet Link 1 Active LED Ethernet Connector 1 Ethernet Link 1 Rate LED Ethernet Link 2 Active LED 10.
Page 170 23. Second Seven-Segment Display Field 24. First Seven-Segment Display Field 25. Cache Active LED 26. Controller A Service Action Required LED 27. Controller A Service Action Allowed LED 28. Battery Charging LED 29. Battery Service Action Required LED 30. Power Canister 31.
Page 171 Figure 6 E5424 Controller-Drive Tray – Front View Standby Power LED Power LED Over-Temperature LED Service Action Required LED Locate LED Drive Canister Figure 7 E5412 Controller-Drive Tray – Front View Standby Power LED Power LED Over-Temperature LED Service Action Required LED Locate LED Drive Canister Chapter 6: Component Locations...
Page 172 Figure 8 E5424 Controller-Drive Tray and E5412 Controller-Drive Tray– Rear View Controller A Canister Seven-Segment Display Host Interface Card Connector 1 Host Interface Card Connector 2 Serial Connector Ethernet Connector 1 Ethernet Link Active LED Ethernet Link Rate LED Ethernet Connector 2 10.
Page 173 Figure 9 E5400 Right-Rear Subplate with No Host Interface Card Mini USB Connector ESM Expansion Fault LED ESM Expansion Active LED Expansion SFF-8088 Port Connector Figure 10 E5400 Right-Rear Subplate with an Fibre Channel Host Interface Card Mini USB Connector SAS Expansion Fault LED SAS Expansion Active LED SAS Expansion SFF-8088 Port Connector...
Page 174 10. Host Interface Card Link 6 LED 1 11. FC Host Interface Card Connector 7 12. Host Interface Card Link 7 LED 0 13. Host Interface Card Link 7 LED 1 14. FC Host Interface Card Connector 8 15. Host Interface Card Link 8 LED 0 16.
Page 175 Component Locations on the CE4900 Controller-Drive Tray The top controller, controller A, is inverted from the bottom controller, controller  The top of the controller-drive tray is the side with labels.  The configuration of the host ports might appear different on your system ...
Page 176 Power-Fan Canister AC Power Connector AC Power Switch Battery Canister Ethernet Ports 10. Drive Channels 11. Host Channels 12. Serial Port 13. Seven-Segment Display 14. Optional DC Power Connector and DC Power Switch...
Page 177 Component Locations on the CDE3994 Controller-Drive Tray and the CDE3992 Controller-Drive Tray The following figure shows the AC power option. Figure 13 Component Locations on the CDE3994 Controller-Drive Tray and the CDE3992 Controller-Drive Tray – Rear View Controller A (Inverted) Controller B Host Ports (2 Ports for the CDE3992 Controller-Drive Tray or 4 Ports for the CDE3994 Controller-Drive Tray)
Page 178 Component Locations on the E2600 Controller-Drive Tray The E2600 controller-drive tray is available in two different drive configurations: one with up to twelve 3.5-in. drives and another with up to twenty-four 2.5-in. drives. With either drive configuration, the controller-drive tray is available in two different controller configurations: simplex and duplex.
Page 179 Figure 15 E2600 Controller-Drive Tray with 24 Drives – Front View Standby Power LED Power LED Over-Temperature LED Service Action Required LED Locate LED Drive Canister Chapter 6: Component Locations...
Page 180 Figure 16 E2600 Controller-Drive Tray Duplex Configuration – Rear View Controller A Canister Seven-Segment Display Host Interface Card Connector 1 Host Interface Card Connector 2 Serial Connector Ethernet Connector 1 Ethernet Link Active LED Ethernet Link Rate LED Ethernet Connector 2 10.
Page 181 Figure 17 E2600 Right-Rear Subplate with No Host Interface Card ESM Expansion Fault LED ESM Expansion Active LED Expansion SFF-8088 Port Connector Figure 18 E2600 Right-Rear Subplate with a SAS Host Interface Card Host Interface Card Link 3 Up LED Host Interface Card Link 3 Active LED SFF-8088 Host Interface Card Connector 3 Host Interface Card Link 4 Up LED...
Page 182 Figure 19 E2600 Right-Rear Subplate with an FC Host Interface Card Host Interface Card Link 3 Up LED Host Interface Card Link 3 Active LED FC Host Interface Card Connector 3 Host Interface Card Link 4 Up LED Host Interface Card Link 4 Active LED FC Host Interface Card Connector 4 Host Interface Card Link 5 Up LED Host Interface Card Link 5 Active LED...
Page 183 Figure 20 E2600 Right-Rear Subplate with an iSCSI Host Interface Card Host Interface Card Link 3 Up LED Host Interface Card Link 3 Active LED iSCSI Host Interface Card Connector 3 Host Interface Card Link 4 Up LED Host Interface Card Link 4 Active LED iSCSI Host Interface Card Connector 4 Host Interface Card Link 5 Up LED Host Interface Card Link 5 Active LED...
Page 184 Figure 21 E2600 Controller-Drive Tray Simplex Configuration – Rear View Controller A Canister Seven-Segment Display Host Interface Card Connector 1 Host Interface Card Connector 2 ESMESM Expansion Fault LED ESM Expansion Active LED Expansion Port SFF-8088 Connector Power-Fan A Canister Standby Power LED 10.
Page 185 Component Locations on the E2660 Controller-Drive Tray The E2660 controller-drive tray is available in two different controller configurations: simplex and duplex. Keep these points in mind when you compare the figures in this section to your hardware. The top of the controller-drive tray is the side with the labels. ...
Page 186 Figure 23 E2660 Controller-Drive Tray – Rear View Fan Canister Fan Power LED Fan Service Action Required LED Fan Service Action Allowed LED Serial Connector Ethernet Link 1 Active LED Ethernet Connector 1 Ethernet Link 1 Rate LED Ethernet Link 2 Active LED 10.
Page 187 23. First Seven-Segment Display 24. Cache Active LED 25. Controller A Service Action Required LED 26. Controller A Service Action Allowed LED 27. Battery Service Action Required LED 28. Battery Charging LED 29. Power Canister 30. Power AC Power LED 31.
Page 188 Figure 24 E2660 Right-Rear Subplate with No Host Interface Card ESM Expansion Fault LED ESM Expansion Active LED Expansion SFF-8088 Port Connector Figure 25 E2660 Right-Rear Subplate with a SAS Host Interface Card Host Interface Card Link 3 Up LED Host Interface Card Link 3 Active LED SFF-8088 Host Interface Card Connector 3 Host Interface Card Link 4 Up LED...
Page 189 Component Locations on the DE6900 Drive Tray Figure 26 DE6900 Drive Tray – Front View with the Bezel Figure 27 DE6900 Drive Tray – Front View with the Bezel Removed Drive Drawer 1 Drive Drawer 2 Drive Drawer 3 Drive Drawer 4 Drive Drawer 5 Chapter 6: Component Locations...
Page 190 Figure 28 DE6900 Drive Tray – Rear View Standard Expansion Connectors Drive-Side Trunking Expansion Connectors...
Page 191 Component Locations on the DE6600 Drive Tray Figure 29 DE6600 Drive Tray – Front View with the Bezel Figure 30 DE6600 Drive TrayDrive Tray – Front View with the Bezel Removed Figure 31 DE6600 Drive Tray – Rear View ESM A ESM B SAS In Connectors Expansion Connectors...
Page 192 Secondary SFP Ports Primary SFP Ports The ESM on the FC4600 drive tray has four SFP ports. The two primary ports are active. The secondary ports are reserved for future use. If SFP transceivers are placed in the secondary ports, the SFP Port LEDs blink, as a reminder that these ports are not...
Page 193 Component Locations on the AT2655 Drive Tray Figure 33 Component Locations on the AT2655 Drive Tray – Rear View Left ESM Right ESM In Ports Out Ports Chapter 6: Component Locations...
Page 194 Component Locations on the FC2610 Figure 34 Component Locations on the FC2610 Drive Tray – Rear View Drive Tray Left ESM Right ESM In Ports Out Ports Component Locations on the FC2600 Figure 35 Component Locations on the FC2600 Drive Tray – Rear View Drive Tray In Ports Out Ports...
Page 195 Component Locations on the DE1600 Drive Tray and the DE5600 Drive Tray The DE1600 drive tray can have two to twelve 3.5-in. drives. The DE5600 drive tray can have two to twenty-four 2.5-in. drives. The component locations on the rear of these drive trays are the same.
Page 196 Figure 38 DE1600 Drive Tray or DE5600 Drive Tray – Rear View ESM A Canister Host Connector 1 Host Connector 2 Seven-Segment Display Indicators Serial Connector Ethernet Connector Expansion Port SFF-8088 Connector Power-Fan Canister Power Connector 10. Power Switch 11. ESM B Canister...
Page 197: Getting Ready
Adding a Drive Tray to an Existing System This chapter provides information about adding a drive tray to an existing system. Getting Ready If you need to add another drive tray to an existing storage array, contact your Technical Support representative before proceeding. Your Technical Support representative might direct you to complete preparatory tasks before installing and connecting the new drive tray.
Page 198: Hotscale Technology
You do so while power is still applied to the other drive trays. ATTENTION Risk of equipment damage – If your FC4600 drive tray, DE1600 drive tray, or DE5600 drive tray uses the optional DC power connection, a different procedure exists for turning on and turning off the power to a DC-powered drive tray.
Page 199: Hardware Installation For Synchronous Mirroring
Hardware Installation for Synchronous Mirroring This appendix provides information about these topics: Site preparation  Hardware requirements  Cabling  Review this information and complete the steps before starting any hardware installation procedures. Refer to the online help system for background information on the Synchronous Mirroring (SM) premium feature and for software-related procedures to set the configuration of the feature and use it.
Page 200: Switch Zoning Overview
Switch Zoning Overview Because of possible restrictions at the host level, the supported Synchronous Mirroring configurations contain Fibre Channel switches. These Fibre Channel switches are zoned so that a single host adapter can access only one controller per storage array. Additionally, all configurations use a separate zone for the ports that are reserved for the Synchronous Mirroring premium feature.
Page 201 Figure 1 Switch Zoning in Cascaded and non-Cascaded Fibre Channel Switches For more information about Fibre Channel switch zoning or setting up a zone configuration, refer to the manufacturer’s documentation that is provided with the switch. Because of the varying Synchronous Mirroring configurations, the switch zone settings are presented preceding each configuration in this appendix.
Page 202: Hardware Installation
Hardware Installation Select one of the following configuration options to connect and configure one or more storage arrays for use with the Synchronous Mirroring premium feature. Table 1 Configuration Options for Synchronous Mirroring Configuration Description Highest availability This configuration has the greatest redundancy. It is the most stable of the three campus configuration configurations.
Page 203 Configuration Description Intra-site configuration The intra-site configuration is the lowest-cost configuration of all three configurations. It is used in environments where a long-distance fabric is not required because of the close proximity of the hosts and storage arrays. Because the intra-site configuration only has two switches, it is similar to ...
Page 204: Highest Availability Campus Configuration - Recommended
Highest Availability Campus Configuration – Recommended NOTE The highest availability campus configuration is the recommended configuration for the Synchronous Mirroring premium feature. This configuration has two Fibre Channel switches at the primary site and two Fibre Channel switches at the secondary site (four switches total), which provide for complete failover and redundancy.
Page 205 Figure 2 Highest Availability Campus Configuration Using CE6994 Controller Tray Host Fibre Channel Cable Storage Array Fibre Channel Cable Fibre Channel Cable Dedicated for the Synchronous Mirroring Premium Feature Fabric Uplink Cable Chapter 8: Hardware Installation for Synchronous Mirroring...
Page 206: Switch Zoning For Highest Availability Campus Configuration
Switch Zoning for Highest Availability Campus Configuration The highest availability campus configuration provides a separate zone for each reserved port for the Synchronous Mirroring premium feature. The switches do not need to be zoned exactly as presented in this configuration. However, you must meet the following requirements when zoning switches for the highest availability campus configuration.
Page 207 The following figure shows how the four switches are zoned for the highest availability campus configuration. The switches have 16 ports each, which leaves unused ports on each switch when following the preceding requirements. The remaining ports can be distributed among the other zones.
Page 208: Connection For The Highest Availability Campus Configuration
Connection for the Highest Availability Campus Configuration NOTE Start the installation at the primary site. Repeat these steps for the secondary site when instructed to do so. After the four Fibre Channel switches are correctly zoned, complete this procedure to set up the highest availability campus configuration for the Synchronous Mirroring premium feature.
Page 209 The following figure shows the connection that is described in step 4 and step 5. Figure 4 Host Bus Adapter Connections to Fibre Channel Switches NOTE You can connect the cables to any port in the correct zone of the switch for all of the controller trays except the CE6998 controller tray.
Page 210 Connect controller port B2 of the storage array to an available port in zone 2 of switch 2. In a four-host-port system, connect controller port B4 to an available port in zone 2 of switch 2. Figure 5 Storage Array Connections to Fibre Channel Switches in the CE6998 Controller Tray NOTE Controller port A2 and controller port B2 are reserved for mirror relationship synchronization upon activation of the Synchronous Mirroring premium feature.
Page 211 10. The primary site connection is now complete. Is the secondary site connection complete? No – Repeat step 1 through step 9 for the secondary site. — Yes – Go to step 11. — 11. Complete the fabric environment for switch 1 by connecting switch 1A to switch The following figure shows the connection that is described in step 11 and step Figure 6 Connecting Remote Switches to Complete Fabric Environments 12.
Page 212: Campus Configuration
Campus Configuration The campus configuration offers the same functionality as the highest availability campus configuration, but the campus configuration contains only one switch at each site, rather than two. The configuration is still redundant for host bus adapters, controllers, and remote mirroring ports, but the configuration has a single point of failure for switches.
Page 213: Switch Zoning For The Campus Configuration
Switch Zoning for the Campus Configuration The campus configuration allows for a separate zone for each reserved port for the Synchronous Mirroring premium feature. The switches do not need to be zoned exactly as presented in this configuration. However, you must meet the following requirements when you zone switches for the campus configuration.
Page 214: Connection For The Campus Configuration
Connection for the Campus Configuration NOTE Start the installation at the primary site. Repeat these steps for the secondary site when instructed to do so. After both Fibre Channel switches are correctly zoned, complete this procedure to set up the campus configuration for the Synchronous Mirroring premium feature. NOTE Complete all connections by using Fibre Channel cables of the correct length.
Page 215 Connect the secondary host bus adapter for each host at this site to an available port in zone 2 of switch 1A. Figure 9 Host Bus Adapter Connections to Fibre Channel Switches Connect controller port A1 of the storage array to an available port in zone 1 of switch 1A.
Page 216 Connect controller port B2 of the storage array to an available port in zone 4 of switch 1A. In a four-host-port system, connect controller port B4. NOTE Controller ports A2 and B2 are reserved for mirror relationship synchronization upon activation of the Synchronous Mirroring premium feature. In a four-host-port system, controller port A4 and controller port B4 are reserved.
Page 217 10. The primary site connection is now complete. Is the secondary site connection complete? — No – Repeat step 1 through step 9 for the secondary site. Yes – Go to step 11. — 11. Complete fabric 1 by connecting switch 1A to switch 1B. The following figure shows the connection that is described in this step.
Page 218: Intra-Site Configuration
Intra-Site Configuration The intra-site configuration is used in environments where a long-distance fabric is not required because of the close proximity of the hosts and storage arrays. The configuration is still redundant for host bus adapters, controllers, remote mirroring ports, and switches, but the configuration is a single point of failure for the site because all of the equipment can be destroyed by the same disaster.
Page 219: Switch Zoning For The Intra-Site Configuration
Switch Zoning for the Intra-Site Configuration The intra-site configuration provides switch redundancy, but the switches are not cascaded and are independent of each other. NOTE The switches do not need to be zoned exactly as presented in this configuration. However, you must meet the following requirements when zoning switches for the intra-site configuration.
Page 220: Connection For The Intra-Site Configuration
Connection for the Intra-Site Configuration After both Fibre Channel switches are correctly zoned, complete this procedure to set up the intra-site configuration for the Synchronous Mirroring premium feature. NOTE Complete all connections by using Fibre Channel cables of the correct length. Are you adding equipment for the Synchronous Mirroring premium feature to an existing storage array environment? Yes –...
Page 221 Connect the primary host bus adapter for each host to an available port in zone 1 of switch 1. The following figure shows the connection that is described in step 4. NOTE You can connect the cables to any port in the correct zone of the switch. Figure 15 Primary Host Bus Adapter Connections to Fibre Channel Switches Connect the secondary host bus adapter for each host to an available port in zone 1 of switch 2.
Page 222 Connect controller port A1 of the primary storage array to an available port in zone 1 of switch 1. The following figure shows the connection that is described in step 6 through step 9. Figure 17 Primary Storage Array Connections to Fibre Channel Switches Connect controller port B1 of the primary storage array to an available port in zone 3 of switch 2.
Page 223 13. Connect controller port B2 of the secondary storage array to an available port in zone 4 of switch 2. In a four-host-port system, connect controller port B4 to an available port in zone 4 of switch 2. Figure 18 Secondary Storage Array Connections to Fibre Channel Switches 14.
Page 224: Installing And Using Synchronous Mirroring With A Wide Area Network
Software Release field. Verify that the maximum latency and distance are supported by referring to the vendor specifications for your router and by checking the NetApp Interoperability Matrix Tool (IMT) site at http://now.netapp.com.
Page 225: Line Capacities
Line Capacities Table 2 Line Capacities and Line Speeds Line Type Capacity in Mb/s Speed in MB/s 1.544 0.193 43.232 5.404 OC-3 155.6352 19.454 OC-12 622.5408 77.8176 OC-48 2490.1632 311.27 OC-192 9960.6528 1245.085 The following table shows average write operations in Mb/s with corresponding line capacity calculations.
Page 227: Regulatory Compliance Statements
NetApp, Inc. is not responsible for any radio or television interference caused by unauthorized modification of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by NetApp.
Page 228 This Class A digital apparatus meets all requirements of the Canadian Interference-Causing Equipment Regulations. Cet appareil numérique de la classé A respecte toutes les exigences du Règlement sure le matèriel brouilleur du Canada. FCC-2 Regulatory Compliance Statement...

This manual is also suitable for:

Fc2610 At2655 De6900 De6600 De5600 De1600

NetApp FC4600 Hardware Cabling Manual

Chapter 1 Cabling Concepts and Best Practices

Chapter 2 Product Compatibility

Chapter 3 Host Connection

Chapter 4 Drive Connection

Chapter 8 Hardware Installation for Synchronous Mirroring

Regulatory Compliance Statements

Quick Links

Need help?

Questions and answers

Related Manuals for NetApp FC4600

Summary of Contents for NetApp FC4600

This manual is also suitable for:

Table of Contents