1. Manuals
  2. Brands
  3. NetApp Manuals
  4. Storage
  5. EF550
  6. Installation manual

NetApp EF550 Installation Manual

Hide thumbs Also See for EF550:
Table of Contents

Advertisement

Quick Links

Download this manual
NetApp® EF550 Flash Array

Installation Guide

NetApp, Inc.
495 East Java Drive
Sunnyvale, CA 94089
U.S.
Telephone: +1 (408) 822-6000
Fax: +1 (408) 822-4501
Support telephone: +1 (888) 463-8277
Web: http://www.netapp.com
Feedback: doccomments@netapp.com
Part number: 215-08288_A0
Release date: December 2013

Advertisement

Table of Contents
loading

Related Manuals for NetApp EF550

Summary of Contents for NetApp EF550

  • Page 1: Installation Guide

    NetApp® EF550 Flash Array Installation Guide NetApp, Inc. Telephone: +1 (408) 822-6000 Part number: 215-08288_A0 495 East Java Drive Fax: +1 (408) 822-4501 Release date: December 2013 Sunnyvale, CA 94089 Support telephone: +1 (888) 463-8277 U.S. Web: http://www.netapp.com Feedback: doccomments@netapp.com...

  • Page 3: Table Of Contents

    Tools and Other Items............................7 Things to Know – Cables, SFPs, and QSFPs......................8 Things to Know – Taking a Quick Glance at the Hardware in a EF550 Flash Array Configuration......9 Step 2 – Installing and Configuring the Switches....................14 Things to Know – Switches and Routers....................... 14 Procedure –...
  • Page 4 Procedure – Connecting AC Power Cords......................50 Step 10 – Turning on the Power and Checking for Problems in an EF550 Flash Array Configuration....51 Procedure –Turning On the Power to the Storage Array and Checking for Problems in a EF550 Flash Array Configuration................................

  • Page 5: About This Guide

    About This Guide Use this document to install the EF550 flash array and all attached drive trays for your configuration. To access these products, go to the NetApp Support Site at support.netapp.com 215-08288_A0_EF550 Flash Array Installation Guide - 1...

  • Page 6: Registering Your Ef550 Flash Array

    Registering your EF550 Flash Array Before you begin the installation, register your EF550 Flash Array at support.netapp.com using the serial number for the integrated flash array. Use of any other component serial numbers (such as those for individual controllers or drive trays) will not enable correct registration for the flash array.

  • Page 7: Step 1 - Preparing For An Ef550 Flash Array Installation

    Step 1 – Preparing for an EF550 Flash Array Installation Storage arrays for 6-Gb/s SAS drives consist of a EF550 flash array model and can have one or more drive trays in a cabinet: Use this document to install the following EF550 flash array and all necessary drive trays for your configuration: The following table shows the various configuration options.

  • Page 8: Controller

    Use the tables in this section to verify that you have all of the necessary items to install the flash array. ATTENTION Possible hardware damage – To prevent electrostatic discharge damage to the tray, use proper antistatic protection when handling tray components. Basic Hardware EF550 Configuration Cables and Connectors Tools and Other Items 4 - 215-08288_A0_EF550 Flash Array Installation Guide...

  • Page 9: Basic Hardware

    Drive Trays with end caps that are packaged separately. This drive tray can be used with all three variations of the EF550 flash array. Mounting rails and screws The mounting rails that are available with the drive tray are designed for an industry-standard cabinet.
  • Page 10 Item Included with the Flash Array or Drive Trays Ethernet cable For information about out-of-band storage array management, see the description for “Deciding on the Management Method” in the Initial Configuration and Software Installation Guide. SAS host cables 1m-to-10m passive SAS cables 25m active cables 1m-to2m fan-out single x4 port to 4-single port passive cables...

  • Page 11: Tools And Other Items

    Item Included with the Flash Array or Drive Trays DB9-to-PS2 adapter cable This cable adapts the DB9 connector on commercially available serial cables to the PS2 connector on the ESM for drive trays in the storage array. This cable is used for support only.

  • Page 12: Things To Know - Cables, Sfps, And Qsfps

    Things to Know – Cables, SFPs, and QSFPs The figures in this topic display the SAS copper cables and SAS cables with a SFF-8088 Connector, QSFPs for IB connections using copper cables, QSFP transceiver connectors for IB connections using optical cables, an SFP transceiver with a Fibre-Optic cable, a passive SFP transceiver with a copper cable for 10Gb/s iSCSI connections, and an iSCSI cable with an RJ-45 connector.

  • Page 13: Things To Know - Taking A Quick Glance At The Hardware In A Ef550 Flash Array Configuration

    Each drive tray in a storage array must have a minimum of two drives for proper operation. This section provides an overview of hardware described in this document. For specific details about how LEDs operate, see “Step 10 – Turning on the Power and Checking for Problems in an EF550 Flash Array Configuration" on page 51.
  • Page 14 4. End Cap Service Action Required LED 5. End Cap Locate LED 6. Drive Canister Figure 7. EF550 Controller with a SAS HIC – Rear View 1. USB Connector 2. 1GbE Management Connector 1 3. 1GbE Link 1 Fault LED 4.
  • Page 15 12. Host Interface Card Link 4 Fault LED 13. Host Interface Card Link 4 Active LED Figure 9. EF550 Right-Rear Subplate with a 40-Gb InfiniBand Host Interface Card 1. Host Interface Card QSFP Channel 1 2. Host Interface Card Logical Link 1Active LED 3.
  • Page 16 Figure 10. EF550 Right-Rear Subplate with a 16-Gb FC or a 10-Gb iSCSI Host Interface Card 1. SFP+ Host Interface Card Channel 1 2. Host Interface Card Link 1Fault LED 3. Host Interface Card Link 1 Active LED 4. SFP+ Host Interface Card Channel 2 5.
  • Page 17 9. Power Connector 10. Power Switch 11. ESM B Canister Refer to the Storage System Site Preparation Guide for information about the installation requirements of the various EF550 flash array storage array components. 215-08288_A0_EF550 Flash Array Installation Guide - 13...

  • Page 18: Step 2 - Installing And Configuring The Switches

    Depending on the configuration of your storage array, you might use either Fibre Channel switches, iSCSI switches, or InfiniBand switches. The switches and routers in the following tables are certified for use with an EF550 storage array, an EF550 storage array, and an EF550 storage array using SANtricity Storage Manager Version 11.10.

  • Page 19: Procedure - Installing And Configuring Switches

    Vendor Model Version/Data Rate MDS for HP Blade Center 8 Gb/s AW564A 9710 16 Gb/s Cisco Nexus 5010 8 Gb/s 5020 8 Gb/s Table 7. Supported InfiniBand Switches Vendor Model Speed Mellanox SX6012 Edge Switch 56 Gb/s (FDR) SX6018 Edge Switch 56 Gb/s (FDR) SX6036 Edge Switch 56 Gb/s (FDR)
  • Page 20 Change the In-Order Delivery (IOD) option EF550 Flash Array” on page 17. to ON. Mellanox Go to "Step 3 -- Installing the Host Bus Adapters for the EF550 Flash Array" on PowerConnect page 17. 16 - 215-08288_A0_EF550 Flash Array Installation Guide...

  • Page 21: Step 3 - Installing The Host Bus Adapters For The Ef550 Flash Array

    Step 3 – Installing the Host Bus Adapters for the EF550 Flash Array Key Terms Things to Know – Host Bus Adapters, Host Channel Adapters, and Ethernet Network Interface Cards Procedure – Installing Host Bus Adapters Procedure – Installing Host Channel Adapters...

  • Page 22: Hca Host Port

    A 16-character unique name that is provided fore each port on the host channel adapter (HCA). Things to Know – Host Bus Adapters, Host Channel Adapters, and Ethernet Network Interface Cards The EF550 flash array supports host interface cards (HICs) for one of the following: Four 6-Gb/s SAS host ports Two 40-Gb/s InfiniBand host ports...

  • Page 23: Procedure - Installing Host Channel Adapters

    NOTE If your operating system is either Windows Server 2008 Server Core, or Windows 2012 Sever, you might have additional installation requirements. Refer to the Microsoft Developers Network (MSDN) for more information about Windows Server 2008 Server Core. You can access these resources from www.microsoft.com. 3.

  • Page 24: Step 4 - Installing The Ef550 Flash Array

    NOTE Make sure that the combined power requirements of your trays do not exceed the power capacity of your cabinet. For power ratings on EF550 flash arrays and its related drive trays, refer to the Storage System Site Preparation Guide.
  • Page 25 1. Make sure that the cabinet is in the final location. Make sure that the cabinet installation site meets the clearance requirements (see the figure for "Airflow Direction Through and Clearance Requirements for the EF550 Flash Array"). Figure 13. EF550 Flash Array Airflow and Clearance Requirements 1.
  • Page 26 a. Make sure that the adjustment screws on the mounting rail are loose so that the mounting rail can extend or contract as needed. Figure 14. Attaching the Mounting Rails to the Cabinet 1. Cabinet Mounting Holes 2. Adjustment Screws for Locking the Mounting Rail Length 3.
  • Page 27 The front flange of each mounting rail has two alignment spacers. The alignment spacers are designed to fit into the mounting holes in the cabinet. The alignment spacers help position and hold the mounting rail. Figure 15. Alignment Spacers on the Mounting Rail 1.
  • Page 28 The holes in the flash array sheet metal for the rear hold-down screws align with the captured nuts in the side of the mounting rails. Figure 16. Sliding the Flash Array into the Clip on the Mounting Rail 1. Mounting Rail 2.

  • Page 29: Procedure - Installing Drives In The Ef550 Flash Array

    Repeat substep a for the second flange. Figure 17. Securing the EF550 Flash Array to the Cabinet 1. Screw NOTE The rear of the flash array contains two controllers. The top of the flash array is the side with the labels.
  • Page 30 1. Beginning with the first drive slot in the first drive slot on the left side of the EF550 flash array, place the drive on the slot guides, and slide the drive all the way into the slot.

  • Page 31: Step 5 - Connecting The Ef550 Flash Array To The Hosts

    Step 5 – Connecting the EF550 Flash Array to the Hosts Key Terms Things to Know – Storage Array Configuration Specifications for the EF550 Flash Array Things to Know – Host Channels Procedure – Connecting Host Cables on a EF550 Flash Array...

  • Page 32: Things To Know - Host Channels

    ATTENTION Possible hardware damage – To prevent electrostatic discharge damage to the tray, use proper antistatic protection when you handle tray components. The EF550 flash arrays contain no native host ports. One of the following host interface cards (HICs) is installed on each controller:...

  • Page 33: Procedure - Connecting Host Cables On A Ef550 Flash Array

    Figure 20. Host Channels on the EF550 Controllers with an InfiniBand HIC – Rear View 1. QSFP Channel 1 2. QSFP Channel 2 Figure 21. Host Channels on the EF550 Controllers with an FC HIC or an iSCSI HIC– Rear View 1. SFP+ Host Channel 1 2. SFP+ Host Channel 2 3.
  • Page 34 NOTE Make sure that you have installed the HBAs. Refer to “Step 3 – Installing the Host Bus Adapters for the EF550 Flash Array“ on page for information about how to install the HBA and how to use the supplied configuration utilities.
  • Page 35 Figure 23. Direct Topology – Two Hosts and a Dual Flash Array With a Four-Port Connection for Maximum Redundancy 1. Hosts 2. HBA 1 or NIC 1 3. HBA 2 or NIC 2 4. Host Port 1 5. Host Port 2 6.
  • Page 36 Figure 24. Switch or Fabric Topology – Two Hosts and a Dual Flash Array With a Four-Port Connection and a Zoned Switch 1. Hosts 2. HBA 1 or NIC 1 3. HBA 2 or NIC 2 4. Host Port 1 5.
  • Page 37 Figure 25. Mixed Topology – Three Hosts and a Dual Flash Array 1. Host 1 2. HBA 1 or NIC 1 3. HBA 2 or NIC 2 4. Host 2 5. Host 3 6. Host Port 1 7. Host Port 2 8.

  • Page 38: Step 6 - Installing The Drive Trays For The Ef550 Flash Array Configurations

    Step 6 – Installing the Drive Trays for the EF550 Flash Array Configurations Things to Know – General Installation of Drive Trays with the EF550 Flash Array Procedure – Installing the Drive Trays Procedure – Installing Drives in the Drive Trays Things to Know –...
  • Page 39 WARNING (W05) Risk of bodily injury – If the bottom half of the cabinet is empty, do not install components in the top half of the cabinet. If the top half of the cabinet is too heavy for the bottom half, the cabinet might fall and cause bodily injury.
  • Page 40 a. Make sure that the adjustment screws on the mounting rail are loose so that the mounting rail can extend or contract as needed. Figure 27. Attaching the Mounting Rails to the Cabinet 1. Cabinet Mounting Holes 2. Adjustment Screws for Locking the Mounting Rail Length 3.
  • Page 41 The front flange of each mounting rail has two alignment spacers. The alignment spacers are designed to fit into the mounting holes in the cabinet. The alignment spacers help position and hold the mounting rail. Figure 28. Alignment Spacers on the Mounting Rail 1.
  • Page 42 The holes in the drive tray sheet metal for the rear hold-down screws align with the captured nuts in the side of the mounting rails. Figure 29. Sliding the Drive Tray into the Clip on the Mounting Rail 1. Mounting Rail 2.

  • Page 43: Procedure - Installing Drives In The Drive Trays

    b. Repeat substep a for the second flange. Figure 30. Securing the Drive Tray to the Cabinet 1. Screw NOTE The rear of the flash array contains two controllers. The top of the flash array is the side with the labels. 7.

  • Page 44: Things To Know - Connecting The Power Cords

    NOTE The installation order is from top to bottom and from left to right for the DE1600 drive tray, and left to right for the DE5600 drive tray. The installation order is important because the drives might already contain configuration information that depends upon the correct sequence of the drives in the tray.

  • Page 45: Procedure - Connecting The Power Cords

    Procedure – Connecting the Power Cords 1. Make sure that the circuit breakers in the cabinet are turned off. 2. Make sure that both of the Power switches on the drive trays are turned off. 3. Connect the primary power cords from the cabinet to the external power source. 215-08288_A0_EF550 Flash Array Installation Guide - 41...

  • Page 46: Step 7 - Connecting The Ef550 Flash Array To The Drive Trays

    Step 7 – Connecting the EF550 Flash Array to the Drive Trays Use this step to cable the EF550 flash array and related drive trays. For additional information, be sure to consult the Hardware Cabling Guide. Key Terms Things to Know – EF550 Flash Array Things to Know –...

  • Page 47: Things To Know - Drive Trays

    NOTE To maintain data access in the event of the failure of a controller, an ESM, or a drive channel, you must connect a drive tray or a string of drive trays to both drive channels on a redundant path pair. Figure 33. EF550 Controller with Drive Channel Ports (CH1 and CH2) Things to Know – Drive Trays Each drive tray can contain a maximum of twenty-four 6.35-cm (2.5-in.) drives.

  • Page 48: Things To Know - Drive Tray Cabling Configurations For The Ef550 Flash Array

    Except for the ESMs connected directly to the controllers and the last ESMs in the stack, each ESM should have only a single connection to the ESM that follows it. NOTE On the EF550 flash array models, the expansion connectors to the drive trays are always on the left side of the controllers from the rear view.

  • Page 49: Procedure - Connecting The Drive Trays To The Ef550 Flash Array

    Drive Tray 74198-14 Procedure – Connecting the Drive Trays to the EF550 Flash Array You need four SAS cables to attach one drive tray to the flash array. For each additional drive tray, you need two more SAS cables. These general rules apply:...
  • Page 50 Expansion Channel 1 from both controllers must be connected to the same ESM A of the first drive tray in the drive tray stack. Expansion Channel 2 from both controllers must be connected to the same ESM B of the last drive tray in the drive tray stack.
  • Page 51 Yes – Go to step 4. No – Go to step 6. 6. Attach a cable between the SAS Expansion (CH2) connector on controller Ain the flash array and a SAS In connector on ESM B in the last drive tray. 7.

  • Page 52: Step 8 - Connecting The Ethernet Cables

    Step 8 – Connecting the Ethernet Cables Use this step if you are using out-of-band management for your flash array. If you use in-band management, you can ignore this step and continue with "Step 9 – Connecting the Power Cords" on page 50. Key Terms Things to Know –...

  • Page 53: Procedure - Connecting Ethernet Cables

    Procedure – Connecting Ethernet Cables Perform these steps to connect Ethernet cables for out-of-band management. 1. Connect one end of an Ethernet cable into the Ethernet port 1 on controller A. 2. Connect the other end to the applicable network connection. 3.

  • Page 54: Step 9 - Connecting The Power Cords

    1. Make sure that the circuit breakers in the cabinet are turned off. 2. Make sure that both of the Power switches on the flash array are turned off. Figure 37. Power Switches on the EF550 Flash Array 1. Power Switches 3.

  • Page 55: Step 10 - Turning On The Power And Checking For Problems In An Ef550 Flash Array Configuration

    Checking for Problems in a EF550 Flash Array Configuration NOTE If you are running a EF550 flash array that has either DE1600 drive trays or DE5600 drive trays, the flash arraymust have a 725-watt power supply. If the EF550 flash array contains a 585-watt power supply, the controllers lock down and your storage array is not operational.

  • Page 56: Things To Know - Leds On The Ef550 Flash Array Or The Ef550 Flash Array

    Things to Know – LEDs on the EF550 Flash Array or the EF550 Flash Array The following topics provide details on the LEDs found on the EF550 flash array or the EF550 flash array. LEDs on the Left End Cap Figure 38.
  • Page 57 LEDs on the Drive Figure 39. LEDs on the Drive Table 12. LEDs on the Drive Location Color Blinking Drive Power Green The power is turned Drive I/O activity The power is turned on, and the driveis is taking place. off.
  • Page 58 Drive State Drive Power LED Drive Service Action (Green) Required LED (Amber) Service action required –A fault condition exists, and the drive is offline. LEDs on the Controller Canister Main Faceplate Figure 40. LEDs on the Controller Canister Main Faceplate Table 14.
  • Page 59 Location Color Native Host Link Green At least one of the four A link error has occurred. 2 Service Action PHYs in the Host IN port is Allowed LED working and a link exists to the device connected to the IN port connector.
  • Page 60 Location Color Host Interface Card Green The link is up (LED blinks The link is not active. Link 2 Active LED when there is activity). Host Interface Card Amber At least one link is active. The Ethernet link is down. If Link 3 Fault LED both LEDs are off, a cable is unplugged.
  • Page 61 Location Color SFP+ Channel 3 Green The physical link is active. The physical link is not active. Physical Link Up SFP+ Channel 4 Green The link is up (LED blinks The controller has not yet Logical Link Up LED when there is activity). loaded the driver for the ConnectX Host Channel Adapter.

  • Page 62: Things To Know - General Behavior Of The Leds On The Flash Array

    LEDs on the Power-Fan Canister Figure 44. LEDs on the Power-Fan Canister Table 18. LEDs on the Power-Fan Canister Location Color Standby Power Green The flash array is in Standby The flash array is not in mode, and DC power is not Standby mode, and DC power available.
  • Page 63 Symbol Location Function (Canisters) Battery Fault Battery On – The battery is missing or has failed. Off – The battery is operating normally. Blinking – The battery is charging. Service Action Allowed Drive (left LED, no On – You can remove the canister symbol) safely.

  • Page 64: Things To Know - Service Action Allowed Leds

    Symbol Location Function (Canisters) Standby Power Front bezel on the On – The controller tray is in flash array standby mode and the main DC power is off. Off – The flash array is not in standby mode and the main DC power is on.

  • Page 65: Things To Know - Leds On The Drive Tray

    ATTENTION Possible loss of data access – Never remove a controller canister, a power-fan canister, or a battery canister unless the appropriate Service Action Allowed LED is on. If a controller canister or a power-fan canister fails and must be replaced, the Service Action Required (Fault) LED on that canister comes on to indicate that service action is required.
  • Page 66 Table 20. LEDs on the Left End Cap Location Color Drive Tray Locate White Identifies a drive tray that Normal status. you are trying to find. Drive Tray Service Action Amber A component within the drive Normal status. Required tray needs attention. Drive Tray Over- Amber The temperature of the drive...
  • Page 67 Location Color Blinking Drive Service Action Blue The drive canister The drive canister Allowed can be removed cannot be removed safely from the drive safely from the drive tray. tray. Table 22. Drive State Represented by LEDs Drive State Drive Power LED Drive Service Action (Green) Required LED (Amber)
  • Page 68 Location Color Host Link 2 Active Green At least one of the four PHYs A link error has occurred. in the IN port is working, and a link exists to the device connected to the Host In connector. Ethernet Link Active Green The link is up.

  • Page 69: General Behavior Of The Leds On The Drive Trays

    Location Color Power-Fan Service Blue The power-fan canister can The power-fan canister Action Allowed be removed safely from the cannot be removed safely drive tray. from the drive tray. Power-Fan Service Amber A fault exists within the Normal status. Action Required power-fan canister.

  • Page 70: Things To Know - Seven Segment Display Sequence Code Definitions On The Ef550 Flash Array

    ID. The category code may be followed by a "--"+ and a "CF," followed by one of the component location codes described in "Things to Know -- Seven-Segment Component Failure Identifications for the EF550 Flash Array" on the following page.

  • Page 71: Things To Know - Seven-Segment Component Failure Identifications For The Ef550 Flash Array

    4 No codes display, and the Diagnostic LED is off. Things to Know – Seven-Segment Component Failure Identifications for the EF550 Flash Array Use the Seven Segment display values to identify component. Table 27. EF550 Flash Array Failure Identifications Component Seven-Segment Display Used in this Controller State...

  • Page 72: Things To Know - Lock-Down Codes For The Flash Array

    Component Seven-Segment Display Used in this Controller State Power-on Suspended Operational Code Diagnostics Host Card (HX +) Flash Drive (FX +) Category delimiter (--) The separator between category-detail After (--), a "CF" (for Component Failure) is code pairs is used displayed, followed by one of the codes specified when more than one above.
  • Page 73 Diagnostic Code Description An unsupported host interface card has been detected, which results in a suspended controller state. A sub-model identifier either has not been set or has been mismatched, which results in a suspended controller state. A memory configuration error has occurred, which results in a suspended controller state.

  • Page 74: Things To Know - Seven-Segment Display Use Cases

    Things to Know – Seven-Segment Display Use Cases The following table shows both startup errors and operation errors that can be used to point to a component failure. Seven-Segment Display Uses Cases with Repeating Sequences Use Cases Repeating Sequence Use Case: Controller power-on SE+ 88+ blank- Normal power-on controller insertion Controller inserted while held in reset...

  • Page 75: Things To Know - Seven-Segment Display For The Esms On The Drive Trays

    Use Cases Repeating Sequence Use Case: The controller is suspended because of component errors. OE+ L2+ "--"+ CF+ CX+ blank- Persistent processor DIMM error correcting code (ECC) errors have been detected. OE+ L2+ "--"+ CF+ CX+ blank- Persistent cache DIMM ECC errors have been detected. OE+ L2+ "--"+ CF+ CX+ blank- Persistent processor or cache DIMM ECC errors have been detected.
  • Page 76 Diagnostic Code Description An over-temperature condition has been detected in either the ESM or the power supply. The midplane SBB VPD EEPROM cannot be accessed. The ESM canister is not valid for this drive tray. Drive port mapping tables are not found. The ESM configuration is invalid or incomplete, and it operates in a Degraded state.

  • Page 77: Regulatory Compliance Statements

    NetApp, Inc. is not responsible for any damage or injury caused by unauthorized modification of this equipment or the substitution or attachment of connecting cables and equipment other than those specified by NetApp. It is the user’s responsibility to correct interference caused by such unauthorized modification, substitution, or attachment.
  • Page 78 74 - 215-08288_A0_EF550 Flash Array Installation Guide...

  • Page 79: Copyright Information

    NetApp. The use or purchase of this product does not convey a license under any patent rights, trademark rights, or any other intellectual property rights of NetApp.

  • Page 80: Trademark Information

    OnTap, The evolution of storage, Topio, vFiler, VFM, Virtual File Manager, VPolicy, WAFL, Web Filer, and XBB are trademarks or registered trademarks of NetApp, Inc. in the United States, other countries, or both. IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both.

  • Page 81: How To Send Your Comments

    Your feedback is important in helping us to provide the most accurate and high-quality information. If you have suggestions for improving this document, send us your comments by email to doccomments@netapp.com. To help us direct your comments to the correct division, include in the subject line the product name, version, and operating system.

Table of Contents