Page 2
Artico, Be Certain (and the Q brackets design), DLT, DXi, DXi Accent, DXi V1000, DXi V2000, DXi V4000, DXiV-Series, FlexTier, Lattus, the Q logo, the Q Quantum logo, Q-Cloud, Quantum (and the Q brackets design), the Quantum logo, Quantum Be Certain...
Page 3
Titan RAID controller, only). Refer to the NetApp to Quantum Naming Decoder section for additional information. This section provides the following information: • Audience • Prerequisites • NetApp to Quantum Naming Decoder • Product Safety Statements • Contacts • Comments • Quantum Global Services Audience This manual is intended for storage customers and technicians.
Page 4
Product Quantum-Storage Description Controller-Drive Tray Base System Quantum uses Base System when referring to a drive tray with the RAID controllers. Drive Tray Expansion Unit Quantum uses Expansion Unit when referring to a drive tray with the environmental services modules (ESMs).
Page 6
Preface Product Safety Quantum will not be held liable for damage arising from unauthorized Statements use of the product. The user assumes all risk in this aspect. This unit is engineered and manufactured to meet all safety and regulatory requirements. Be aware that improper use may result in bodily injury, damage to the equipment, or interference with other equipment.
Page 7
Preface Contacts For information about contacting Quantum, including Quantum office locations, go to: http://www.quantum.com/aboutus/contactus/index.aspx Comments To provide comments or feedback about this document, or about other Quantum technical publications, send e-mail to: doc-comments@quantum.com Hardware Cabling Guide...
Page 8
Online Service accounts are free from Quantum. That account can also be used to access Quantum’s Knowledge Base, a comprehensive repository of product support information. Get started at: http://www.quantum.com/customercenter/ For further assistance, or if training is desired, contact the Quantum Customer Support Center: North America 1-800-284-5101 (toll free) +1-720-249-5700...
Table of Contents | 3 Contents Deciding whether to use this guide ............. 6 Cabling concepts and best practices ............7 Cabling concepts ......................7 Fabric (switched) topologies compared to direct-attach topologies ....7 Trays and shelves .................... 7 Host channels and drive channels ..............8 Host ports and drive ports ................
Page 12
4 | Hardware Cabling Guide Component locations on the E2800 controller shelves ..........33 Component locations on the E2700 controller-drive trays ........37 Component locations on the E2600 controller-drive trays ........45 Component locations on the DE6600 drive shelf (drive tray) ........53 Component locations on the DE212C drive shelf and the DE224C drive shelf ..
Page 13
Table of Contents | 5 Drive tray cabling topologies for the E2600 controller-drive trays ......115 Drive channel redundancy for the E2612 and E2624 controller-drive trays ....................... 116 Drive tray cabling topologies for the E2612 controller-drive tray and the E2624 controller-drive tray ..............118 Drive cabling topologies for the E2660 controller-drive tray with DE6600 drive trays ................
Deciding whether to use this guide This guide contains conceptual information and best practices for cabling your storage array. It includes the following types of procedures: • Host cabling • Drive cabling • Ethernet cabling for a management station • Cabling to support mirroring features This guide is intended for a hardware installer or system administrator who is installing or expanding a storage array, or cabling to support mirroring features.
Cabling concepts and best practices This chapter describes cabling concepts, best practices, and common procedures that apply generally across the specific cabling configuration that are covered in subsequent chapters. Cabling concepts Learn more about cabling concepts to help you cable your storage array. Fabric (switched) topologies compared to direct-attach topologies Fabric topologies use a switch or router, while direct-attach topologies do not.
8 | Hardware Cabling Guide Term used for E2700 and Term used for E2800 storage Definition E5600 storage arrays, and arrays EF560 flash arrays controller canister controller canister The component in a controller- drive tray or controller shelf that includes a controller card, a battery, and–optionally–a host interface card.
Cabling concepts and best practices | 9 Host ports and drive ports The ports are the physical connectors on the controller shelf (controller-drive tray) that, along with the cabling, enable the transfer of data. If the port communicates with the host server, it is a host port .
10 | Hardware Cabling Guide For more information, see the SANtricity Power Guide for Advanced Users for your operating system. Related information SANtricity 11.30 Installing and Configuring for Linux Power Guide for Advanced Users SANtricity 11.30 Installing and Configuring for VMware Power Guide for Advanced Users SANtricity 11.30 Installing and Configuring for Windows Power Guide for Advanced Users Redundant and non-redundant components In storage area network technology, redundancy means that essential services are implemented using...
Cabling concepts and best practices | 11 73136 Copper cable Passive SFP transceiver Host adapters Each connection from a host port on a controller to a host is made through a host adapter on the host. A host adapter can be a host bus adapter (HBA) for Fibre Channel or SAS connections, a host channel adapter (HCA) for InfiniBand connections, or an Ethernet adapter for iSCSI connections.
12 | Hardware Cabling Guide required for network communication. Each Ethernet cable connection for out-of-band storage array management is made through an NIC. If your configuration requires a host Ethernet connection through an NIC, you must obtain Note: and install the required NICs. Related concepts In-band management and out-of-band management on page 12...
Cabling concepts and best practices | 13 Host cabling for redundancy To ensure that the storage array remains accessible to the host in the event that a host channel fails, establish two physical paths from each host to the controllers, and install alternate path software on the host.
14 | Hardware Cabling Guide iSCSI connections for mirroring, any one of the iSCSI ports can be used for the mirroring connection. Single-controller topologies and dual-controller topologies A controller shelf (controller-drive tray) that contains two controllers is called a duplex configuration. A controller shelf with only one controller is called a simplex configuration.
Page 23
Cabling concepts and best practices | 15 Controller-drive tray for the storage array When you use out-of-band management , the storage management station is connected through an Ethernet network to each of the controllers in the controller shelf or controller-drive tray. E2800 controller shelves can use out-of-band management with SANtricity System Manager.
16 | Hardware Cabling Guide Where two Ethernet ports are available on a controller, use the port labeled P1 for out-of- Note: band Ethernet connections. Reserve the second Ethernet port (labeled P2) for access by technical support. For information about how to create a redundant out-of-band topology, see Fabric out-of-band Ethernet topology on page 134.
Cabling concepts and best practices | 17 Installing an SFP transceiver and a fiber-optic cable You must install SFP transceivers into each connector to which you will connect a fiber-optic cable. About this task Be aware of potential hardware risks when performing this task. Attention: Potential degraded performance –...
18 | Hardware Cabling Guide Fiber-optic cable SFP transceiver Host interface port 4. Install the fiber-optic cable. Installing a copper cable with a passive SFP transceiver You must install a passive SFP transceiver into each connector to which you will connect a copper cable.
Cabling concepts and best practices | 19 Your passive SFP transceivers might look slightly different from the one shown. The differences do not affect the performance of the SFP transceiver. 73136 Copper cable Passive SFP transceiver Note: Make sure that the passive SFP transceiver installs with an audible click. 3.
20 | Hardware Cabling Guide 3. For each cable, insert one RJ-45 connector into a host interface port on the controller and the other RJ-45 connector into a port on the host’s Ethernet adapter or Ethernet switch. Installing a SAS cable You must install SAS cables to be used for drive shelf (drive tray) connections or for host connections.
Component locations You must make sure that you have correctly identified the cable connection for host cabling, drive shelf cabling, and Ethernet cabling. The figures included in this section identify the locations of controllers, environmental services modules or I/O modules (ESMs/IOMs), host ports, drive ports, and Ethernet ports. The figures also show port identifiers.
Page 30
22 | Hardware Cabling Guide E5560 controller-drive tray or E5660 controller-drive tray - front view with bezel removed Drive drawer Locate LED Service Action Required LED Over-Temperature LED Power LED Standby Power LED The following figure shows the controller-drive tray or flash array with a 12-Gb/s SAS HIC. Your controller-drive tray might have a different HIC.
Page 31
Component locations | 23 E5524, E5624, EF550, and EF560 controller-drive trays - front view with bezel removed End cap Standby Power LED End cap Power LED End cap Over-Temperature LED End cap Service Action Required LED End cap Locate LED Drive canister E5512 controller-drive tray and E5612 controller-drive tray - front view with bezel removed Identify LED...
Page 32
24 | Hardware Cabling Guide Controller canister A Drive channel port (SAS drive expansion connectors) Controller canister B Drive channel port (SAS drive expansion connectors) E5500, E5600, EF550, and EF560 controller module USB connector 11. SAS Expansion Link 2 Fault LED 1GbE management connector 1 12.
Page 33
Component locations | 25 Mini-SAS Port 1 Link Fault LED Mini-SAS Port 3 Link Fault LED Mini-SAS Port 1 Link Up LED Mini-SAS Port 3 Link Up LED SFF-8088 HIC connector 2 SFF-8088 HIC connector 4 Mini-SAS Port 2 Link Fault LED Mini-SAS Port 4 Link Fault LED Mini-SAS Port 2 Link Up LED Mini-SAS Port 4 Link UP LED...
Page 34
26 | Hardware Cabling Guide HIC Logical Link 1 Active LED HIC Physical Link 1 Active LED Serial port HIC Logical Link 2 Active LED HIC Physical Link 2 Active LED HIC QSFP channel 2 Right, rear subplate with a 56-Gb InfiniBand HIC HIC QSFP channel 1 HIC Logical Link 1 Active LED HIC Physical Link 1 Active LED...
Component locations | 27 HIC Link 1 Fault LED HIC Link 3 Active LED HIC Link 1 Active LED Serial port SFP+ HIC channel 2 HIC Link 4 Fault LED HIC Link 2 Fault LED HIC Link 4 Active LED HIC Link 2 Active LED SFP+ HIC channel 4 SFP+ HIC channel 3...
Page 36
28 | Hardware Cabling Guide E5460 controller-drive tray - rear view 9 10 1 1 12 13 14 15 17 18 19 92045-05 Fan canister 19. Mini USB connector Fan Power LED 20. Expansion Fault LED Fan Service Action Required LED 21.
Page 37
Component locations | 29 E5424 controller-drive tray and EF540 flash array - front view Locate LED Service Action Required LED Over-Temperature LED Power LED Standby Power LED Drive canister E5412 controller-drive tray - front view 1 2 3 98006-06 Locate LED Service Action Required LED Over-Temperature LED Power LED...
Page 38
30 | Hardware Cabling Guide E5424 controller-drive tray and EF540 flash array - rear view 9 10 1 1 12 14 15 50004-04 18 19 Controller A canister 13. Base host Fibre Channel SFP+ connectors Seven-segment display 14. Expansion SFF-8088 port connector HIC connector 1 15.
Page 39
Component locations | 31 Right, rear subplate with no HIC Mini USB connector SAS expansion Fault LED SAS expansion Active LED SAS SFF-8088 port connector Right, rear subplate with a Fibre Channel HIC Mini USB connector HIC Link 6 LED 0 SAS expansion Fault LED HIC Link 6 LED 1 SAS expansion Active LED...
Page 40
32 | Hardware Cabling Guide Right, rear subplate with a SAS HIC 1. SAS expansion SFF-8088 port connector 1 SAS Host SFF-8088 port connector 3 2. SAS Host Interface Port 1 Fault LED SAS Host Interface Port 3 Fault LED 3.
Component locations | 33 SAS expansion Link Up LED IB HIC connector 2 SAS expansion SFF-8088 port connector IB HIC Physical Link 2 LED (Green) IB HIC connector 1 IB HIC Logical Link 2 LED (Amber) Component locations on the E2800 controller shelves The E2812 controller shelf has twelve 3.5 in.
Page 42
34 | Hardware Cabling Guide E2860 controller shelf front bezel Power Attention Locate E2812 or E2824 controller shelf – duplex configuration (rear view) E2812 or E2824 controller shelf – simplex configuration (rear view)
Page 43
Component locations | 35 E2860 controller shelf (rear view) E2800 controller LEDs Cache Active Locate Attention Activity Ethernet Activity Ethernet Link Speed Expansion Port Link Status (SAS expansion port) Expansion Port Attention (SAS expansion port) Host Port Link Status (baseboard host port) Host Port Attention (baseboard host port) Host Port Link Status (HIC host port) Host Port Attention (HIC host port)
Page 44
36 | Hardware Cabling Guide E2800 controller with RJ-45 baseboard ports and no host interface card Two baseboard host ports – 10 Gb/s iSCSI E2800 controller with RJ-45 baseboard ports and a dual-port RJ-45 host interface card Two baseboard host ports –10 Gb/s iSCSI Two HIC ports –10 Gb/s iSCSI E2800 controller with SFP baseboard ports and no host interface card Two baseboard host ports –16 Gb/s FC or 10 Gb/s iSCSI...
Component locations | 37 Two HIC ports – 12 Gb/s SAS E2800 controller with SFP baseboard ports and a quad-port SAS host interface card Two baseboard host ports –16 Gb/s FC or 10 Gb/s iSCSI Four HIC ports –12 Gb/s SAS E2800 controller with SFP baseboard ports and a dual-port SFP (FC or iSCSI) host interface card Two baseboard host ports –16 Gb/s FC or 10 Gb/s iSCSI...
Page 46
38 | Hardware Cabling Guide two different controller configurations: simplex (one controller) and duplex (two controllers). The E2760 controller-drive tray is available only in the duplex configuration. Keep these points in mind when you compare the figures in this section to your hardware: •...
Page 47
Component locations | 39 Locate LED Drive Canister E2712 controller-drive tray or E2724 controller-drive tray duplex configuration - rear view Battery Charging LED 15. Host Link 1 Active LED Battery Service Action Required LED 16. Base Host SFF-8644 Connector 1 Controller A Service Action Allowed LED 17.
Page 48
40 | Hardware Cabling Guide E2712 controller-drive tray or E2724 controller-drive tray simplex configuration - rear view Controller A Canister Unused Controller B Slot Seven-Segment Display Power-Fan A Canister Host Interface Card Connector 1 Standby Power LED Host Interface Card Connector 2 Power-Fan DC Power LED Expansion Fault LED Power-Fan Service Action Allowed LED...
Page 49
Component locations | 41 E2760 controller-drive tray duplex configuration - rear view Fan Canister 19. Expansion Fault LED Fan Power LED 20. Expansion Active LED Fan Service Action Required LED 21. Expansion SFF-8644 Port Connector Fan Service Action Allowed LED 22.
Page 50
42 | Hardware Cabling Guide E2700 right, rear subplate with no host interface card Expansion Fault LED Expansion Active LED Expansion SFF-8644 Port Connector E2700 right, rear subplate with a dual port SAS host interface card Host Interface Link 3 Fault LED SFF-8644 Host Interface Connector 4 Host Interface Link 3 Active LED Expansion Fault LED...
Page 51
Component locations | 43 Host Interface Card Link 4 Active LED E2700 right, rear subplate with a quad port SAS host interface card Host Interface Link 3 Fault LED SFF-8644 Host Interface Connector 4 Host Interface Link 3 Active LED Expansion Fault LED SFF-8644 Host Interface Connector 3 Expansion Active LED...
Page 52
44 | Hardware Cabling Guide Host Interface Link 3 Up LED FC Host Interface Connector 4 Host Interface Link 3 Active LED Expansion Fault LED FC Host Interface Connector 3 Expansion Active LED Host Interface Link 4 Up LED Expansion SFF-8644 Port Connector Host Interface Card Link 4 Active LED For each pair of LEDs associated with a host connector (1 and 2, 4 and 5), the following table shows what different lighting patterns indicate.
Component locations | 45 Left (green) on Left (green) off Left (green) on Left (green) off Right (yellow) on Right (yellow) on Right (yellow) off Right (yellow) off link down link up, 8Gb/s link up, 4Gb/s link up, 16Gb/s iSCSI 1.
Page 54
46 | Hardware Cabling Guide the handle and the host port might make it difficult to remove a cable that is attached to the host port. If this problem occurs, use a flat-blade screwdriver to compress the release on the cable connector.
Page 55
Component locations | 47 E2600 controller-drive tray duplex configuration - rear view Controller A 15. Host SFF-8088 Connector 1 Battery Charging LED 16. Host Link 1 Fault LED Battery Service Action Required LED 17. Host Link 1 Active LED Controller A Service Action Allowed LED 18.
Page 56
48 | Hardware Cabling Guide E2600 controller-drive tray simplex configuration - rear view Controller A Canister Unused Controller B Slot Seven-Segment Display Power-Fan A Canister Host Interface Card Connector 1 Standby Power LED Host Interface Card Connector 2 Power-Fan DC Power LED Expansion Fault LED Power-Fan Service Action Allowed LED Expansion Active LED...
Page 57
Component locations | 49 E2660 controller drive tray - rear view Fan Canister Controller A Canister Fan Power LED Expansion Fault LED Fan Service Action Required LED Expansion Active LED Fan Service Action Allowed LED Expansion SFF-8088 Port Connector Serial Connector Second Seven-Segment Display Ethernet Link 1 Active LED First Seven-Segment Display...
Page 58
50 | Hardware Cabling Guide E2600 right, rear subplate with no host interface card Drive Expansion 98019-04 Expansion Fault LED Expansion Active LED Expansion SFF-8088 Port Connector E2600 right, rear subplate with a SAS host interface card Drive Expansion 98019-03 Host Interface Link 3 Fault LED SFF-8088 Host Interface Connector 4 Host Interface Link 3 Active LED...
Page 59
Component locations | 51 E2600 right, rear subplate with an FC host interface card 2 3 4 9 10 1 1 12 13 14 15 Drive Expansion 98019-01 Host Interface Link 3 Up LED FC Host Interface Connector 5 Host Interface Link 3 Active LED Host Interface Card Link 6 Up LED FC Host Interface Connector 3 Host Interface Card Link 6 Active LED...
Component locations | 53 iSCSI Host Interface Connector 3 iSCSI Host Interface Connector 4 Host Interface Link 3 Up LED Expansion Fault LED Host Interface Link 3 Active LED Expansion Active LED Host Interface Link 4 Up LED Expansion SFF-8088 Port Connector Host Interface Card Link 4 Active LED Component locations on the DE6600 drive shelf (drive tray) DE6600 drive shelf - front view with the bezel in place...
54 | Hardware Cabling Guide DE6600 drive shelf - rear view ESM A ESM B SAS In connectors Expansion connectors Component locations on the DE212C drive shelf and the DE224C drive shelf The DE212C drive shelf has twelve 3.5 in. drive bays. The DE224C drive shelf has twenty-four 2.5 in.
Component locations | 55 DE212C or DE224C drive shelf - IOM LEDs SAS port Attention IOM Attention Locate SAS port Link Status Component locations on the DE460C drive shelf The DE460C drive shelf has five drawers. Each drawer has twelve 2.5 in. drive bays. The front view and the location of LEDs on the operator display panel are the same as for the E2860 controller shelves.
56 | Hardware Cabling Guide SAS port Attention IOM Attention Locate SAS port Link Status Component locations on the DE1600 drive shelf (drive tray) and the DE5600 drive shelf (drive tray) The DE1600 drive shelf has twelve 3.5 in. drive bays. The DE5600 drive shelf has twenty-four 2.5 in. drive bays.
Page 65
Component locations | 57 DE1600 drive shelf or DE5600 drive shelf - rear view ESM A canister Expansion port SFF-8088 connector SAS In connector 1 Power-fan canister SAS In connector 2 Power connector Seven-segment display indicators Power switch Serial connector ESM B canister Ethernet connector...
Host cabling This chapter provides examples of cabling topologies between one or more hosts and a controller shelf or controller-drive tray. Direct-attach topologies, fabric topologies, and mixed topologies are addressed. You have several options for cabling between one or more hosts and a controller shelf or controller- drive tray.
Page 67
Host cabling | 59 Cable Data rate and Number of Connector Type Length protocol connectors 12 Gb/s SAS MiniSAS-HD passive copper 1-5m MiniSAS-HD active copper 8-15m MiniSAS-HD optical 5-100m Fan-out cable type passive copper Fan-out cable type passive copper 6 Gb/s SAS MiniSAS passive copper 1-10m...
Page 68
60 | Hardware Cabling Guide HICs and Base Ports Cable Data rate and Number of Connector Type Length protocol connectors 6 Gb/s SAS MiniSAS passive copper 1-10m MiniSAS active copper 5-20m Fan-out cable type passive copper 40 Gb/s InfiniBand QSFP+ passive copper 1-5m QSFP+...
Page 69
Host cabling | 61 HICs and base ports Cable Data rate and Number Connector Type Length protocol and type of connectors 10 Gb/s iSCSI or 4 HIC SFP+ OM2 optical 2,3,5,10,25 optical ports 1 Gb/s iSCSI SFP+ OM3 optical 50-300m Twin-Ax (DAC) passive copper 2-7m...
Page 70
62 | Hardware Cabling Guide Cable Data rate and Number of Connector Type Length protocol connectors 16 Gb/s Fibre SFP+ OM2 SW optical 2,3,5,10,25 Channel SFP+ OM3 SW optical 50-150m SFP+ OS2 LW optical 50-300m SFP+ OM2 SW optical 2,3,5,10,25 SFP+ OM3 SW optical 50-150m...
Page 71
Host cabling | 63 HICs and base ports Cable Data rate and Number of Connector Type Length protocol connectors Base Ports: MiniSAS passive copper 1-5m 6 Gb/s SAS Fan-out cable type passive copper 6 Gb/s SAS MiniSAS passive copper 1-5m Fan-out cable type passive copper 8 Gb/s Fibre...
64 | Hardware Cabling Guide HIC port Before the conversion to After the conversion to split mode split mode 16 Gb/s Fibre Channel or 10 Gb/s iSCSI 10 Gb/s iSCSI 16 Gb/s Fibre Channel or 10 Gb/s iSCSI 10 Gb/s iSCSI 16 Gb/s Fibre Channel or 16 Gb/s Fibre Channel 10 Gb/s iSCSI...
Host cabling | 65 Possible loss of data access – Do not use a combination of HBAs from different Attention: vendors in the same storage area network (SAN). For the HBAs to perform correctly, use only HBAs from one manufacturer in a SAN. Direct-attach topologies This section describes topologies that do not use switches to connect hosts to your storage array.
Page 74
66 | Hardware Cabling Guide The following figure shows an example of a direct-attach topology with two hosts and a duplex controller shelf. In this example, the hosts/servers must be clustered to guarantee redundancy. Note: Host/Server Host/Server HBA 1 HBA 2 HBA 1 HBA 2 Host...
Host cabling | 67 Host/Server HBA 1 Host Host Port 1 Port 2 Controller A 74099 The following table lists the redundant and non-redundant components in a direct-attached configuration with one host and a simplex controller shelf. Component Redundancy Host/server Non-redundant HBA, HCA, or iSCSI Ethernet adapter Non-redundant...
68 | Hardware Cabling Guide The following table lists the redundant and non-redundant components in a direct-attached configuration with one host and four duplex controller-drive trays. Component Redundant Non-redundant Host/server (see note) Non-redundant HIC (SAS) Redundant Host-to-controller cables Redundant Controllers Redundant Switch topologies This section describes topologies that use switches to connect hosts to your storage array.
Page 77
Host cabling | 69 Host/Server HBA 1 HBA 2 Host Host Host Host Port 1 Port 2 Port 1 Port 2 Controller A Controller B 74102 The following table lists the redundant and non-redundant components in a switched configuration with one host and a controller shelf. Component Redundant Host/server...
Page 78
70 | Hardware Cabling Guide The following table lists the redundant and non-redundant components in a switched configuration with two hosts and a controller shelf. Component Redundancy Host/server (see note) Redundant Host adapter Redundant Host-to-controller cable Redundant Switch Use two switches for full redundancy. A single zoned switch is not redundant.
Host cabling | 71 The following table lists the redundant and non-redundant components in a switched configuration with four hosts, a controller shelf, and two zoned switches. Component Redundancy Host/server (see note) Redundant Host adapter Redundant Host-to-controller cable Redundant Switch Redundant Controller Redundant...
Page 80
72 | Hardware Cabling Guide Host/Server 1 Host/Server 2 Host/Server 3 HBA 1 HBA 2 HBA 1 HBA 2 HBA 1 HBA 2 Host Host Host Host Port 1 Port 1 Port 2 Port 2 Controller A Controller B 74104 The following table lists the redundant and non-redundant components in a mixed configuration with three hosts and a controller shelf.
Drive shelf or drive tray cabling A controller shelf (controller-drive tray) along with any drive shelves (drive trays) that are attached to it, comprise a storage array. When a storage array includes drive shelves, each controller in the controller shelf is connected to an environmental services module (ESM) for SAS-2 connections, or to an I/O module (IOM) for SAS-3 connections in a drive shelf.
74 | Hardware Cabling Guide Controller DE1600 and DE212C, DE6600 DE1600, DE5600, shelf or DE5600 DE224C, and and DE6600 controller- DE460C drive tray EF540 DE5600 only. Not Supported Not Supported Not Supported Solid state drives (SSDs) only not to exceed 120 drive slots or 5 enclosures* E5500...
Page 83
Drive shelf or drive tray cabling | 75 Side-by-side ESMs in DE1600 drive shelves and DE5600 drive shelves ESM A SAS In - Port 1 SAS In - Port 2 SAS Out (Expansion) Port ESM B Side-by-side ESMs in DE212C drive shelves and DE224C drive shelves ESM A SAS Port 1 SAS Port 2...
76 | Hardware Cabling Guide Stacked ESMs in DE6600 drive shelves ESM A ESM B SAS In Ports SAS In Ports SAS Out (Expansion) Ports Stacked IOMs in DE460C drive shelves IOMs Drive tray cabling topologies for the E5500 and E5600 controller-drive trays and the EF550 and EF560 flash arrays This section provides examples of drive tray cabling topologies for the E5600 (E5612, E5624, E5660) controller-drive trays, the EF560 flash array, the E5500 controller-drive trays (E5512, E5524,...
Drive shelf or drive tray cabling | 77 Ports Cable Data rate and Number of Connector Type Length protocol connectors Expansion: MiniSAS to passive copper 2m or 1.5m MiniSAS 6 Gb/s SAS Drive channel redundancy for the E5500 controller drive trays, E5600 controller drive trays, EF550 flash arrays and EF560 flash arrays Controller-drive trays Each controller in these controller-drive trays and flash arrays has two drive expansion ports.
Page 86
78 | Hardware Cabling Guide Controller canister A Drive expansion ports (SAS drive expansion connectors) Controller Canister B Drive expansion ports (SAS drive expansion connectors) Drive trays The following figure shows the SAS ports on a DE1600 drive tray or a DE5600 drive tray. Each environmental services module (ESM) has two SAS-2 in ports and one SAS-2 expansion (out) port.
Drive shelf or drive tray cabling | 79 ESM A ESM B SAS in ports SAS out (expansion) port Drive Shelves The following figures show the SAS ports on a DE212C drive shelf or a DE224C drive shelf. The I/O modules (IOMs) occupy the top half of the shelf.
Page 88
80 | Hardware Cabling Guide The EF550 controller-drive tray and the EF560 controller-drive tray can be cabled to the Note: DE5600 drive trays only. The total number of drives in the storage array, including the drives in the EF550 controller-drive tray or the EF560 controller-drive tray and those in all of the attached drive trays, must not exceed 120.
Page 89
Drive shelf or drive tray cabling | 81 One E5500 or E5600 controller drive tray or one EF550 or EF560 flash array and three drive trays...
Page 90
82 | Hardware Cabling Guide One E5500 or E5600 controller drive tray or one EF550 or EF560 flash array and up to 15 drive trays The previous figures show storage arrays with DE1600 drive trays or DE5600 drive trays. A storage array might also include DE6600 drive trays.
Drive shelf or drive tray cabling | 83 storage array includes DE6600 drive trays, install those drive trays beginning from the bottom of the cabinet so that the cabinet does not become top-heavy. A top-heavy cabinet has a greater risk of falling over.
Page 92
84 | Hardware Cabling Guide One E5560 controller-drive tray or one E5660 controller-drive tray and one DE6600 drive tray...
Page 93
Drive shelf or drive tray cabling | 85 One E5560 controller-drive tray or one E5660 controller-drive tray and five DE6600 drive trays The figures above show storage arrays with DE6600 drive trays. A storage array with an E5560 controller-drive tray or an E5660 controller-drive tray might also include DE1600 drive trays or DE5600 drive trays.
86 | Hardware Cabling Guide page 79 shows the arrangement of ESMs and the location of ports on the DE1600 drive trays and DE5600 drive trays. The figures above show storage arrays with DE6600 drive trays. A storage array with an E5560 controller-drive tray or an E5660 controller-drive tray might also include DE1600 drive trays or DE5600 drive trays.
Page 95
Drive shelf or drive tray cabling | 87 Controller canister A Drive expansion connector (connectors 2 and 4 comprise a redundant path pair.) Controller canister B Drive expansion connector (connectors 2 and 4 comprise a redundant path pair.) Redundant path pair on the E5460 controller-drive tray 92045-08 Controller canister A Drive expansion connector (connectors 2 and 4 comprise a redundant path pair.)
88 | Hardware Cabling Guide SAS in - port 1 SAS in - port 2 SAS out (expansion) port ESM B The following figures show the SAS ports on a DE6600 drive tray. Each environmental services module (ESM) has two SAS in ports and one SAS expansion (out) port. You can connect the SAS in ports to the SAS expansion port on another drive tray or to the SAS expansion port on a controller- drive tray.
Page 97
Drive shelf or drive tray cabling | 89 SAS ports on a DE1600 drive tray or a DE5600 drive tray ESM A SAS IN - Port 1 SAS IN - Port 2 SAS Out (Expansion) Port ESM B One E5424 or E5412 controller-drive tray or one EF540 flash array and one DE1600 drive tray or DE5600 drive tray...
Page 98
90 | Hardware Cabling Guide One E5424 or E5412 controller-drive tray or one EF540 flash array and two DE1600 drive trays or DE5600 drive trays The following figures show the SAS ports on a DE6600 drive tray. You can connect either the left or right SAS port on an ESM to the SAS expansion port on another drive tray or on a controller-drive tray.
Page 99
Drive shelf or drive tray cabling | 91 ESM A ESM B SAS IN Ports SAS IN Ports SAS Out (Expansion) Port Warning: Risk of bodily injury – An empty tray weighs approximately 56.7 kg (125 lb). Three persons are required to safely move an empty tray. If the tray is populated with components, a mechanized lift is required to safely move the tray.
Page 100
92 | Hardware Cabling Guide One E5424 or E5412 controller-drive tray or one EF540 flash array and two DE6600 drive trays The following figure shows how the cabling pattern can be continued for additional drive trays until the 15 drive tray limit or the limit on the total number of drive slots in the storage array is reached. The figure uses the schematic representation for DE1600 drive trays or DE5600 drive trays.
Drive shelf or drive tray cabling | 93 One E5424 or E5412 controller-drive tray or one EF540 flash array and seven or more DE6600 drive trays Drive tray cabling topologies for the E5460 controller-drive tray The figures in this section show representative cabling configurations. The configurations shown guarantee that redundant data paths exist between the controller-drive tray and all attached drive trays in a storage array.
Page 102
94 | Hardware Cabling Guide For any one controller-drive tray, you must not exceed the limit of 15 connected drive trays or the limit for the total number of drive slots in the storage array. The total numbers of drive slots is limited to 384.
Page 103
Drive shelf or drive tray cabling | 95 One E5460 controller-drive tray and two DE1600 or DE5600 drive trays The following figures show the SAS ports on a DE6600 drive tray. You can connect either of the SAS ports labeled SAS 1 and SAS 2 to the SAS Expansion port on another drive tray or on a controller- drive tray.
Page 104
96 | Hardware Cabling Guide SAS ports on a DE6600 drive tray ESM A ESM B SAS IN Port SAS IN Port SAS Expansion Ports One E5460 controller-drive tray and one DE6600 drive tray...
Page 105
Drive shelf or drive tray cabling | 97 One E5460 controller-drive tray and two DE6600 drive trays The following figure shows how the cabling pattern can be continued for additional drive trays until the 15 drive tray limit or the limit on the total number of drives in the storage array is reached. The figure uses the schematic representation for DE1600 drive trays or DE5600 drive trays.
Page 106
98 | Hardware Cabling Guide One E5460 controller-drive tray and seven or more DE6600 drive trays The following figure shows cabling for a storage array with the capacity for 384 drives, the maximum number. The storage array consists of a E5460 controller-drive tray with five DE6600 drive trays and one DE5600 drive tray.
Drive shelf or drive tray cabling | 99 A storage array with the capacity for 384 drives using a E5460 controller-drive tray Drive cabling topologies for the E2800 controller shelves...
100 | Hardware Cabling Guide This section provides examples of drive shelf cabling topologies for the E2800 controller shelves. The E2800 controller shelf models are the E2812, E2824, and E2860. The total number of drive bays in the storage array, including the drive bays in the controller shelf and those in the drive shelves, must not exceed 180.
Page 109
Drive shelf or drive tray cabling | 101 Controller A SAS port 1 SAS port 2 Controller B The following figure shows the drive ports (SAS expansion ports) on a dual-controller configuration for the E2860 controller shelf. The drive ports are at the far right of each controller. Controller A Controller B SAS port 1...
Page 110
102 | Hardware Cabling Guide SAS port 2 SAS port 3 SAS port 4 The following figure shows the SAS ports on a DE460C drive shelf. The I/O modules (IOMs) occupy the middle positions in the shelf Each IOM has four SAS-3 expansion ports. You can connect these ports to SAS-3 expansion ports on another drive shelf or to SAS expansion ports on a controller shelf.
Drive shelf or drive tray cabling | 103 Drive cabling topologies for the E2824 controller shelf and the E2812 controller shelf Depending on the number and type of drive shelves that you need to connect, see the applicable figure for a cabling topology. Each example shows a duplex controller shelf configuration with redundant paths to the drive shelves.
104 | Hardware Cabling Guide One E2800 controller shelf and a single stack of SAS-2 drive shelves One E2800 controller shelf and dual stacks with a mix of SAS-2 and SAS-3 drive shelves Drive cabling topologies for the E2860 controller shelf Depending on the number and type of drive shelves that you need to connect, see the applicable figure for a cabling topology.
Page 113
Drive shelf or drive tray cabling | 105 One E2860 controller shelf and one SAS-3 drive shelf One E2860 controller shelf and a single stack of SAS-3 drive shelves One E2860 controller shelf and a single stack of SAS-2 drive shelves...
106 | Hardware Cabling Guide One E2860 controller shelf and dual stacks with a mix of SAS-2 and SAS-3 drive shelves Drive tray cabling topologies for the E2700 controller-drive trays This section provides examples of drive tray cabling topologies for the E2700 controller-drive trays. The E2700 controller-drive tray models are: the E2712, the E2724 and the E2760.
Drive shelf or drive tray cabling | 107 Drive channel redundancy for the E2700 controller-drive trays Learn the physical features of the E2700 controller trays that support drive cabling to minimize the risk of losing access to data. Controller-drive trays Each controller in an E2712 or an E2724 controller-drive tray has two drive ports.
Page 116
108 | Hardware Cabling Guide SAS Drive Expansion Connector Drive trays The following figure shows the SAS ports on a DE1600 drive tray or a DE5600 drive tray. Each environmental services module (ESM) has two SAS-2 in ports and one SAS-2 expansion (out) port. You can connect the SAS in ports to the SAS expansion port on another drive tray or to the SAS expansion port on a controller-drive tray.
Drive shelf or drive tray cabling | 109 SAS out (expansion) port Drive shelves The following figures show the SAS ports on a DE212C drive shelf or a DE224C drive shelf. The I/O modules (IOMs) occupy the top half of the shelf. Each IOM has four SAS-3 expansion ports. You can connect these ports to SAS-3 expansion ports on another drive shelf or drive tray or to SAS expansion ports on a controller shelf or controller-drive tray.
Page 118
110 | Hardware Cabling Guide The following figures shows the SAS ports on a DE1600 drive tray or a DE5600 drive tray. Note: You can connect either of the SAS ports labeled SAS 1 and SAS 2 to the SAS Expansion port on another drive tray or on a controller-drive tray.
Page 119
Drive shelf or drive tray cabling | 111 One E2700 controller-drive tray and two drive trays (dual stack configuration)
Page 120
112 | Hardware Cabling Guide One E2700 controller-drive tray and eight drive trays (dual stack configuration) The pattern shown can be extended to include additional drive trays as long as neither the limit on maximum number of drive slots nor the limit on maximum number of trays is exceeded.
Drive shelf or drive tray cabling | 113 Drive tray cabling topologies for the E2760 controller-drive tray This section provides examples of drive tray cabling topologies for the E2760 controller-drive tray. The E2760 controller-drive tray can be cabled only to DE6600 drive trays. The total number of drives in the storage array, including the drives in the controller-drive tray and those in the drive trays, must not exceed 192.
Page 122
114 | Hardware Cabling Guide One E2760 controller-drive tray and one drive tray...
Drive shelf or drive tray cabling | 115 One E2760 controller-drive tray and two drive trays (dual stack) Drive tray cabling topologies for the E2600 controller-drive trays Learn the physical features of the E2600 controller trays that support drive cabling to minimize the risk of losing access to data.
116 | Hardware Cabling Guide Drive channel redundancy for the E2612 and E2624 controller-drive trays Controller-drive trays Each controller in an E2612 or E2624 controller-drive tray has one drive port. When a controller- drive tray has two controllers, the drive port on controller A and the drive port on controller B form a redundant pair.
Page 125
Drive shelf or drive tray cabling | 117 Controller A Controller B SAS drive expansion connector (connectors 3 and 4 comprise a redundant path pair) SAS drive expansion connector (connectors 3 and 4 comprise a redundant path pair) Drive trays The following figure shows the SAS ports on a DE1600 drive tray or a DE5600 drive tray.
118 | Hardware Cabling Guide ESM A ESM B SAS in ports SAS out (expansion) port Drive tray cabling topologies for the E2612 controller-drive tray and the E2624 controller-drive tray Depending on the number of drive trays that you need to connect, see the applicable figure for a cabling topology.
Page 127
Drive shelf or drive tray cabling | 119 One E2600 controller-drive tray and one drive tray Controller A Controller B SAS IN SAS IN SAS IN SAS IN SAS EXP SAS EXP ESM B ESM A 98010-08 One E2600 controller-drive tray and two drive trays...
Page 128
120 | Hardware Cabling Guide One E2600 controller-drive tray and three drive trays...
Drive shelf or drive tray cabling | 121 One E2600 controller-drive tray and eight drive trays Drive cabling topologies for the E2660 controller-drive tray with DE6600 drive trays Depending on the number of drive trays that you need to connect, see the applicable figure for a cabling topology.
Page 130
122 | Hardware Cabling Guide The following figures show the SAS ports on a DE6600 drive tray. You can connect either of the SAS ports labeled SAS 1 and SAS 2 to the SAS Expansion port on another drive tray or on a controller- drive tray.
Page 131
Drive shelf or drive tray cabling | 123 One E2660 controller-drive tray and one drive tray...
124 | Hardware Cabling Guide One E2660 controller-drive tray and two drive trays Using SANtricity Storage Manager to add a drive tray to an existing storage array If you manage your storage array with SANtricity Storage Manager, use the tasks in this section to add a new drive tray to your storage array.
Drive shelf or drive tray cabling | 125 Preparing to add a drive tray Steps for preparing to add a new drive shelf (drive tray) while power is still applied to the other components of a storage array. Before you begin Make sure that the power source for your storage array can accommodate the power requirements of Storage the new drive shelf (drive tray).
126 | Hardware Cabling Guide Option Description To install a drive tray that has Remove the drives before you continue with step on page 126. The previously been installed in a drives must be installed one at a time later in this procedure. storage array.
Page 135
Drive shelf or drive tray cabling | 127 Steps 1. Choose one of the following options: Option Description The new drive tray is the only Attach a cable between the SAS expansion port on controller A of the drive tray in a storage array controller-drive tray and a SAS IN port on ESM A of the new drive tray.
128 | Hardware Cabling Guide Option Description The new drive tray is the only Attach a cable between the SAS expansion port labeled Ch 2 on drive tray in a storage array controller A of the controller-drive tray and a SAS IN port on ESM B of with an E5500 or E5600 the new drive tray and then attach a cable between the SAS expansion controller-drive tray or an...
Drive shelf or drive tray cabling | 129 Preparing to add a drive shelf or drive tray Perform the following steps to prepare to add a new drive shelf (drive tray) using SANtricity System Manager while power is still applied to the other components of a storage array. Before you begin •...
130 | Hardware Cabling Guide Installing the drive shelf or drive tray and applying power Perform these steps for add a new drive shelf (drive tray) using SANtricity System Manager while power is still applied to the other components of a storage array. Steps 1.
Page 139
Drive shelf or drive tray cabling | 131 • If the new drive shelf or drive tray is the only drive shelf in the storage array, attach a cable between one of the SAS expansion ports on controller A of the controller shelf and a SAS expansion port 1 on IOM/ESM A of the new drive shelf.
Page 140
132 | Hardware Cabling Guide of the new drive shelf. Connect SAS expansion port 1 on IOM/ESM B of the new drive shelf to the SAS expansion port 1 on the drive shelf that was previously the last in the stack. •...
Cabling for out-of-band management This chapter provides examples of how to connect your storage array to an Ethernet network for out- of-band storage array management. If you plan to use in-band storage array management, Ethernet cabling might not be necessary for management connections. For illustrations showing the Ethernet port locations on the specific controller-drive tray model that Component locations you are installing, see the topics under...
134 | Hardware Cabling Guide Fabric out-of-band Ethernet topology The following figure shows two storage array management connections from the controller-drive tray to two ports on an Ethernet switch. In this topology, the storage management station where the client software resides requires a NIC or some other Ethernet interface. You must use Ethernet cables for all storage array management connections.
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring The Asynchronous Mirroring feature uses a remote point-in-time replication method. Asynchronous Mirroring differs from Synchronous Mirroring in one essential way: it captures the state of the source volume at a particular point in time and includes just the data that has changed since the last image capture.
136 | Hardware Cabling Guide iSCSI connections for Asynchronous Mirroring You can use iSCSI connections for the Asynchronous Mirroring feature. Connect one iSCSI port on each controller of the local (primary) storage array to the corresponding controller on the remote (secondary) storage array.
Page 145
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 137 For more information about Fibre Channel switch zoning or setting up a zone configuration, refer to the manufacturer’s documentation that is provided with the switch. Because of the varying Synchronous Mirroring configurations, the switch zone settings are presented preceding each configuration in this appendix.
138 | Hardware Cabling Guide Configuration Description Highest availability This configuration has the greatest redundancy. It is the most stable of the campus configuration three configurations. (recommended) • Two Fibre Channel switches (for a total of four) at both the primary site and the secondary site provide for complete failover and redundancy in the Fibre Channel switches and fabrics, in addition to all storage array components and hosts.
Page 147
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 139 This configuration has two Fibre Channel switches at the primary site and two Fibre Channel switches at the secondary site (four switches total), which provide for complete failover and redundancy. Failures could involve Fibre Channel switches, Fibre Channel cables, and any host or storage array.
Page 148
140 | Hardware Cabling Guide Switch zoning for highest availability campus configuration The highest availability campus configuration provides a separate zone for each reserved port for the Synchronous Mirroring feature or the Asynchronous Mirroring feature. The switches do not need to be zoned exactly as presented in this configuration. However, you must meet the following requirements when zoning switches for the highest availability campus configuration.
Page 149
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 141 Cabling for the highest availability campus configuration After the four Fibre Channel switches are correctly zoned, set up the highest availability campus configuration for the Synchronous Mirroring feature or the Asynchronous Mirroring feature. About this task Start the installation at the primary site.
Page 150
142 | Hardware Cabling Guide Ho s t Gro u p Ho s t 1 Ho s t 2 HBA1a HBA1b HBA2a HBA2b S witc h 1 10 12 Zo n e 2 Zo ne 1 13 15 Zo ne 3 Zo ne 4 S witc h 2 10 12...
Page 151
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 143 Controller port A2 and controller port B2 are reserved for mirror relationship Note: synchronization upon activation of the Synchronous Mirroring feature. In a four-host-port system, controller port A4 and controller port B4 are reserved. The primary site cabling is now complete.
144 | Hardware Cabling Guide 12. Repeat Step on page 143 for switch 2A and switch 2B to complete the fabric environment for switch 2. Cabling for the highest availability campus configuration is complete. 13. Repeat Step on page 141 through Step on page 143 for other storage arrays that exist in the same cabinet that use the Synchronous Mirroring feature or the Asynchronous Mirroring feature.
Page 153
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 145 Host Fibre Channel cable Storage array Fibre Channel cable Fibre Channel cable dedicated for mirroring Fabric uplink cable Switch zoning for the campus configuration The campus configuration allows for a separate zone for each reserved port for the Synchronous Mirroring feature or the Asynchronous Mirroring feature.
Page 154
146 | Hardware Cabling Guide You must configure the zones on the switches so that there is one port per zone for a storage array connection and one port per zone for each host. You must zone the switches so that a single host adapter can access only one controller per storage array.
Page 155
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 147 Complete all connections by using Fibre Channel cables of the correct length. Note: Steps 1. Determine whether you adding equipment for mirroring to an existing storage array environment. • If so, stop I/O activity from all hosts before proceeding. Go to Step on page 147.
Page 156
148 | Hardware Cabling Guide following Step on page 148 shows the cabling configuration schematically with four host ports on each of two controllers in each controller-drive tray. 7. Connect controller port B1 of the storage array to an available port in zone 2 of switch 1A. 8.
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 149 Switch 1B Switch 1A Fabric 1 10 12 Zone 1 Zone 2 Zone 1 Zone 2 13 15 Zone 3 Zone 3 84004-06 Zone 4 Zone 4 Cabling for the campus configuration is complete. 12.
Page 158
150 | Hardware Cabling Guide Host Fibre Channel cable Storage array Fibre Channel cable Fibre Channel cable dedicated for mirroring Switch zoning for the intra-site configuration The intra-site configuration provides switch redundancy, but the switches are not cascaded and are independent of each other.
Page 159
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 151 Before proceeding, review the requirements in this section and the zoning example in the figures to make sure that both switches are correctly zoned. For more information, see Fibre Channel Configurations Overview on page 136.
Page 160
152 | Hardware Cabling Guide 5. Connect the secondary host bus adapter for each host to an available port in zone 1 of switch 2. The following figure shows the cabling that is described in this step. 6. Connect controller port A1 of the primary storage array to an available port in zone 1 of switch 1.
Page 161
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 153 The following figure shows the cabling that is described in Step on page 152 through Step page 153. Host Fibre Channel cable Storage array Fibre Channel cable Fibre Channel cable dedicated for mirroring 7.
154 | Hardware Cabling Guide Host Fibre Channel cable Storage array Fibre Channel cable Fibre Channel cable dedicated for mirroring Cabling for the intra-site configuration is complete. 14. Repeat Step on page 151 through Step on page 153 for any additional storage arrays that exist in the same cabinet that will use the Synchronous Mirroring feature or the Asynchronous Mirroring feature.
Page 163
Hardware installation for Synchronous Mirroring and Asynchronous Mirroring | 155 • The smaller the bandwidth on the WAN, the longer it takes a mirror to synchronize. • If the bandwidth does not exceed the average rate, you might not be able to synchronize the data at all.
How to send comments about documentation and receive update notifications You can help us to improve the quality of our documentation by sending us your feedback. You can receive automatic notification when production-level (GA/FCS) documentation is initially released or important changes are made to existing production-level documents. If you have suggestions for improving this document, send us your comments by email.
Need help?
Do you have a question about the StorNext QD7000 and is the answer not in the manual?
Questions and answers