HPE CS1000H Hardware Manual

Quick Links

Download this manual

Hardware Guide

CS1000H, CS1000, CS3000, CS5000, CS7000,

SF100, SF300, ES2-H, ES2-AFS2, SF-ES2

Published April, 2023

Table of Contents

Need help?

Do you have a question about the CS1000H and is the answer not in the manual?

Questions and answers

Summary of Contents for HPE CS1000H

Page 1 Hardware Guide CS1000H, CS1000, CS3000, CS5000, CS7000, SF100, SF300, ES2-H, ES2-AFS2, SF-ES2 Published April, 2023...
Page 2 Document ID wlm1470859383923 Support All documentation and knowledge base articles are available on HPE InfoSight at https://infosight.hpe.com. To register for HPE InfoSight, click the Create Account link on the main page. Email: support@nimblestorage.com For all other general support contact information, go to https://www.hpe.com/us/en/services/nimble-storage.html.
Page 3: Table Of Contents
Contents Install the HPE Nimble Storage Array...................6 Network Considerations............................................6 Network Topology..............................................6 IP Addresses................................................11 Subnets...................................................12 Subnet Traffic Types..........................................12 Subnet Traffic Assignments......................................12 IP Address Zones in Subnets......................................13 Interface Pairs................................................14 Interface Numbering...............................................16 Installation Checklist...............................................18 Rack Mount Safety Precautions........................................20 Install the Square-Hole Adapter........................................20 Install the Array.................................................23 Network Connections.............................................28...
Page 4 Controller LEDs............................................58 Find the Serial Number of an Array Using the GUI................................60 Find the Serial Number of an Array Using the CLI................................60 Check Array Model Number, NimbleOS Version, and Operating State Using the GUI..................60 Check Array Model, OS Version, and Operating State Using the CLI........................61 Install an Expansion Shelf ......................62 Connect and Activate an ES2-H or SF-ES2 Expansion Shelf...........67 Connect and Activate an ES2-AFS2 Expansion Shelf..............70...
Page 5 Determine the Operating State of the Controllers Using the CLI......................104 Find the NimbleOS Version of an Array Using the GUI..........................104 Expander Maintenance............................................105 Replace an Expander.........................................105 Power Supply Maintenance..........................................107 How to Tell that a Power Supply has Failed................................107 Replace an AC Power Supply......................................107 Replace a DC Power Supply......................................110 Replace AC Power Supplies with DC Power Supplies.............................113 Replace DC Power Supplies with AC Power Supplies.............................117...
Page 6: Install The Hpe Nimble Storage Array
Install the HPE Nimble Storage Array There are several steps to install the HPE Nimble Storage array, such as providing a suitable operating environment, installing the array into your rack, and making network connections appropriate to your current and anticipated topologies. After the array has been configured, you can perform maintenance and upgrade tasks as needed.
Page 7 Choose this option: To limit iSCSI traffic to 10Gb interfaces To isolate the subnets for network security If you want a dedicated broadcast domain reserved for iSCSI traffic Install the HPE Nimble Storage Array 7...
Page 8 Note that the subnet addresses in the illustration are just examples. This arrangement enables the maximum data throughput by isolating management traffic from the data. Install the HPE Nimble Storage Array 8...
Page 9 Figure 3: Topology diagram - advanced network configuration, data connections Host/server Host data connections, switch 1 Ethernet switch 1, subnet 10.10.30.x/24 Host data connections, switch 2 Ethernet switch 2, subnet 10.10.20.x/24 Inter-switch link Array Array data connections Install the HPE Nimble Storage Array 9...
Page 10 Fibre Channel switches fails, the host remains connected to both controllers through the remaining host Fibre Channel port or Fibre Channel switch, and Fibre Channel traffic continues uninterrupted. Note that only one data connection is shown. You can add more connections and use different ports as needed. Install the HPE Nimble Storage Array 10...
Page 11: Ip Addresses
An IP address is a 32-bit identifier for devices on a TCP/IP network. IP addresses allow devices on a network, such as servers, switches, and arrays, to communicate with each other. HPE storage arrays use IP addresses for the following purposes:...
Page 12: Subnets
Traffic assignments determine what type of iSCSI traffic a data subnet carries. You can assign a data subnet on an iSCSI array to carry one of the following kinds of traffic. Note: Traffic assignments are not required for Fibre Channel arrays. Install the HPE Nimble Storage Array 12...
Page 13: Ip Address Zones In Subnets
There are two zones, defined as Red and Blue. Red zone consists of: Host IP 192.168.1.1 Array Data IP 192.168.1.3 Array Data IP 192.168.1.5 Blue zone consists of: Host IP 192.168.1.2 Array Data IP 192.168.1.4 Array Data IP 192.168.1.6 Install the HPE Nimble Storage Array 13...
Page 14: Interface Pairs
Interface Pairs HPE uses the term interface to identify specific ports on the controller. For iSCSI, an interface is an Ethernet port connection that can be used for data, management, or both; for Fibre Channel, an interface is a Fibre Channel port connection that can be used for data only.
Page 15 A Fibre Channel interface pair refers to a set of two Fibre Channel data connections, one from each controller, to the Fibre Channel switch. The cables for an interface pair connect to the same data port on each controller. See Interface Numbering on page 16. Install the HPE Nimble Storage Array 15...
Page 16: Interface Numbering
Interface Numbering All array models have two 10GBaseT ports (eth1, eth2). Adding additional NICs can support up to six 10GBaseT, SFP, as well as GbE ports, for a total of up to eight ports. Install the HPE Nimble Storage Array 16...
Page 17 Figure 10: Array interface example (Ethernet and Fibre Channel ports) eth3 eth4 eth1 SAS Out eth2 SAS Out For more information on SFPs and connecting 10GbE ports to your array, see SFP Specifications on page 144. Install the HPE Nimble Storage Array 17...
Page 18: Installation Checklist
Subnet mask Default gateway Array access Administrator password Controller A diagnostic IP address Controller B diagnostic IP address Domain name DNS server IP addresses, up to 5 Time zone NTP (time) server IP address Install the HPE Nimble Storage Array 18...
Page 19 Jumbo (9000 bytes) Custom number of bytes VLAN ID – 1 to 4094 Interfaces assigned to this subnet: CS1000, CS1000H, CS3000, CS5000, CS7000, SF100 and SF300 models: eth1, eth2, eth3, eth4, eth5, eth6 Subnet type: Data only Management + data...
Page 20: Rack Mount Safety Precautions
HTTP proxy: HTTP proxy server user name HTTP proxy server password Rack Mount Safety Precautions Observe these safety precautions when you install the HPE Nimble Storage array or expansion shelf in a rack. Table 5: Rack Mount Safety Precautions Consideration Precaution If the array or expansion shelf is installed in a closed or multi-unit rack assembly, the operating temper- ature may be greater than the ambient (room) temperature.
Page 21 The bottom screw is located nine holes from the top screw (where the bottom of the chassis goes, twelfth hole from the top of the 4U rail section). 4. Align the upper hook of the rail at the desired location on the rack. Install the HPE Nimble Storage Array 21...
Page 22 When the rack rails are seated into the adapter, press each rail into the post and slide it down to lock it in position. c) Check that both rails are hooked in position. Install the HPE Nimble Storage Array 22...
Page 23: Install The Array
This product is intended for installation in restricted-access locations only, such as a dedicated equipment room or an electrical closet. Attention: If you are installing more than just one HPE Nimble Storage array, refer to the Hardware Guide available on HPE InfoSight for information about your model. https://infosight.hpe.com/ docs?Document+Type=Hardware+Guide Note: Cold air comes into the front of the array (drive side) and is exhausted out the back (controller side) of the array by the fans.
Page 24 2. Separate the inner rails from the rail assemblies. a) Press the catch at the front end of the middle rail. b) Slide the inner rail out of the rail assembly. c) Repeat steps a and b with the other rail. Install the HPE Nimble Storage Array 24...
Page 25 Align the upper hook of the rail at the position you want. b) Press the rail into the post and slide it down to lock it in position. c) Repeat steps a and b on the other side. Install the HPE Nimble Storage Array 25...
Page 26 Insert the chassis into the rack, back side first. Be sure the inner rails insert into the outer rails. b) Gently slide the chassis into position. When you hear a click, the inner rails have locked into the rail assembly. Install the HPE Nimble Storage Array 26...
Page 27 The chassis has two handles. Each handle has a thumbscrew that holds the chassis to the rails so it does not slide out of the rack. Tighten the thumbscrew in each handle until secure. 7. Secure the bezel to the front of the chassis. Install the HPE Nimble Storage Array 27...
Page 28: Network Connections
Note that only one management connection and one data connection are shown. You can add more connections and use different ports as needed. Install the HPE Nimble Storage Array 28...
Page 29 The separated management and data paths on this network provide higher performance and high availability. Note that only one management connection and one data connection are shown. You can add more connections and use different ports as needed. Install the HPE Nimble Storage Array 29...
Page 30 Your settings will differ. The advanced configuration uses the maximum number of data connections on the iSCSI network, to obtain the best availability and throughput. In more advanced configurations, you can define your own network configuration to handle the desired I/O flow. Install the HPE Nimble Storage Array 30...
Page 31 Figure 13: An example of advanced network configuration: data connections Host/server Array Ethernet switch 1, subnet 10.10.30.x/24 Odd numbered data ports to switch 2 Ethernet switch 2, subnet 10.10.20.x/24 Even numbered data ports to switch 1 Install the HPE Nimble Storage Array 31...
Page 32 Note that you must create the group using the NimbleOS software. You can have up to four arrays in a group. For instructions on how to create groups, refer to the GUI Administration Guide or the CLI Administration Guide. Install the HPE Nimble Storage Array 32...
Page 33 Fibre Channel switches. The separated data paths on this network provide higher performance and high availability. Note that only one management connection and one data connection are shown. You can add more connections and use different ports as needed. Install the HPE Nimble Storage Array 33...
Page 34: Connect The Power To The Array
Connect the Power to the Array Before you begin Before you perform this task, you must have already installed the Nimble array in a rack or enclosure and the array must be connected to a network. Install the HPE Nimble Storage Array 34...
Page 35 Press down on the side lever to adjust the sizing. b) Close the clip to fit snugly around the base of each cord. Tug gently on each cord to ensure it is secure. Install the HPE Nimble Storage Array 35...
Page 36: Initial Setup Using The Nimble Setup Manager
This chapter describes using the HPE Nimble Storage Setup Manager (NSM), which has been installed on a Windows host as part of the HPE Nimble Storage Windows Toolkit, to complete the initial setup. The NSM has a graphical user interface (GUI) that allows you to easily complete the initial setup.
Page 37: Install The Windows Toolkit On A Client
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Before you begin To download the NWT, you must have an Internet connection from the Windows host or client to the HPE Nimble Storage InfoSight. Important: HPE Nimble Storage Setup Manager (NSM) is only required for array setup.
Page 38: Complete The Initial Setup Using The Nimble Setup Manager - Nimbleos 4.1 And Earlier
The Windows host must have the following software installed: Adobe Flash Player Nimble Windows Toolkit Before you start, complete the Installation Checklist on page 18. You need the information from the checklist to perform the initial GUI setup. Install the HPE Nimble Storage Array 38...
Page 39 Documentation Feedback: doc-feedback-hpe-storage@hpe.com CAUTION: If you have multiple unconfigured HPE Nimble Storage arrays and you plan to add them to the same group, configure only one array now. Later, add the remaining arrays to the group. For information about how to add an array to a group, refer to the GUI Administration Guide or the CLI Administration Guide.
Page 40 This section displays the link status for all Fibre Channel ports. No configuration is required. c) Diagnostic IP: Controller A diagnostic IP address within the specified network Controller B diagnostic IP address within the specified network 12. Provide the following Domain information and click Next: Install the HPE Nimble Storage Array 40...
Page 41 Include the group or array name for easy identification. Send to Address HPE Nimble Storage recommends that you check the Send event data to Nimble Storage Support check box. Simple Mail Transfer Protocol (SMTP) server hostname or IP address...
Page 42: Complete The Initial Setup Using The Nimble Setup Manager - Nimbleos 4.2 And Later
GUI setup. CAUTION: If you have multiple unconfigured HPE Nimble Storage arrays and you plan to add them to the same group, configure only one array now. Later, add the remaining arrays to the group. For information about how to add an array to a group, refer to the GUI Administration Guide or the CLI Administration Guide.
Page 43 Note: This field is hidden if you are running a Fibre Channel array. IP Address Zone - Single, Bisect, or Even/Odd Note: This field is hidden if you are running a Fibre Channel array. Maximum Transmission Unit (MTU) – Standard, Jumbo, or Custom Install the HPE Nimble Storage Array 43...
Page 44 Include the group or array name for easy identification. Send to Addresses HPE Nimble Storage recommends that you check the Send event data to Nimble Storage Support check box. Simple Mail Transfer Protocol (SMTP) server hostname or IP address...
Page 45: Initial Setup Using The Array Cli
Firewalls should allow outbound communications, from the Management IP address and both Controller Diagnostic IP addresses, to the following TCP ports and host addresses: SSH: 2222 hogan.nimblestorage.com – For a Secure Tunnel connection to HPE Nimble Storage Support HTTPS: 443 nsdiag.nimblestorage.com – For Diagnostic Analysis and heartbeat HTTPS: 443 update.nimblestorage.com –...
Page 46: Set Up A Serial Connection
The CLI requires a serial connection for the initial setup of the array. After setup, the CLI can also use an SSH connection over the network. Before you begin Obtain these items: Laptop computer or workstation Install the HPE Nimble Storage Array 46...
Page 47 After you have logged in, the CLI is ready to accept commands. What to do next Type ? to see a list of commands. Type the command followed by --help to see the usage information for that command. Install the HPE Nimble Storage Array 47...
Page 48: Complete The Initial Setup Using The Nimbleos Cli
9 Enter data IP address for NIC eth1: 10.64.32.250 10 Enter support IP address for controller A: 10.64.33.10 11 Enter support IP address for controller B: 10.64.33.11 Note: Use your own values for each item in the preceding sample. Install the HPE Nimble Storage Array 48...
Page 49: After Installation And Initial Setup
HPE Storage Path Selection Plugin – Optimized path management. See the VMware Integration Guide for more information. Linux Environments The HPE storage array fits well into a generic Linux environment. For help setting up MPIO in a Linux environment, see the Linux Integration Guide. Using the Array OS The operating system has a multitude of features only touched upon in this document.
Page 50 See the quick start guide that ships with the upgrade component. The Hardware Guide also covers upgrades. Maintenance and Repair The HPE storage array is a proven and reliable product. But on occasion, you may need to replace a controller, power supply, drive, or other component.
Page 51: Array Components
You can connect up to two SF-ES2 expansion shelves to an SF100 or SF300 Secondary Flash array. The rules for connecting expansion shelves to Adaptive Flash arrays (CS1000H, CS1000, CS3000, CS5000, and CS7000) are as follows: Up to six ES2-H expansion shelves can be connected to an array (up to three ES2-H shelves per SAS port).
Page 52: Array Rear Panel
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Slots 1-4 Slots 13-16 Slots 5-8 Slots 17-20 Slots 9-12 Slots 21-24 Important: Do not attempt to install drives into the empty carriers. The array does not recognize them and reports the slots as VOID. Array Rear Panel The rear of the array includes two controllers and two power supplies.
Page 53: Controller States And Status
A controller status of Active/Standby is the normal operating status. This insures that the array is running in a optimal state for full redundancy in the event that a controller takeover is required. If controllers are not in this state, contact HPE Support for further diagnoses.
Page 54: Shut Down The Array Using The Gui
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 19: Power button on the array 1 Power button Shut Down the Array Using the GUI This action shuts down the array and any expansion shelves managed by the array. For most hardware changes you do not need to shut down (power off) the array because the components are redundant and hot swappable.
Page 55: Shut Down The Array (Power Button)
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Shut Down the Array (Power Button) This action shuts down only the array. It does not shut down any expansion shelves that may be attached. Procedure To shut down the array, press and hold the Power button for four seconds.
Page 56: Array Leds
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Array LEDs Figure 21: Front LEDs Power button eth1 Power indicator Power failure Heartbeat Temperature 4 eth2 The array front LEDs are located on both handles. The power button is only on the right handle. The following table describes the front LEDs.
Page 57: Drive Leds
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Status One of the following conditions: Blinking indicates at least two fan failures: If both fans are failing in the same zone, only the bezel on that side will blink. If fan failures are on both controllers, OverTemp LED on both sides will blink.
Page 58: Controller Leds
Documentation Feedback: doc-feedback-hpe-storage@hpe.com In an SSD drive carrier, there are two individual drive slots, each with two LEDs. The following table describes the drive carrier LEDs. Table 8: SSD Drive Carrier LEDs Status Drive carrier fault (far right) Solid red indicates that the drive carrier itself has failed. Contact Nimble Storage Support to send a replacement drive carrier.
Page 59 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Table 9: Controller LEDs Status Power supply Green: Power switched on, AC power connected Amber: Power switched off, AC power connected The power supply is not properly seated in its slot The array is powered off Power supply internal fault. (See Replace a Power Supply.)
Page 60: Find The Serial Number Of An Array Using The Gui
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Find the Serial Number of an Array Using the GUI Procedure 1. Do one of the following in the GUI: For version 3.x or earlier, choose Manage > Arrays. For version 4.x or later, click Hardware. 2. Click the link of the array you want.
Page 61: Check Array Model, Os Version, And Operating State Using The Cli
Note the Model and Version number. 2. Check the operating state of the controllers. ctrlr --list Important: One controller should be Active and the other in Standby. If any other state is shown, contact HPE Support. Example $ array --info...
Page 62: Install An Expansion Shelf
CAUTION: Start-up current draw may exceed 6A. When attaching multiple shelves, attach and activate the shelves one at a time. Before beginning, download and read the Release Notes, available on HPE InfoSight (https://infosight.hpe.com). If you do not have an HPE InfoSight account, click Create Account and provide the required information.
Page 63 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Save the original packaging. 2. Separate the inner rails from the rail assemblies. a) Press the catch at the front end of the middle rail. b) Slide the inner rail out of the rail assembly. c) Repeat steps a and b with the other rail.
Page 64 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Inner rail (left) Rail holes aligned with chassis hooks Set screw Set screw Chassis Inner rail (right) 4. Install the outer rail assemblies onto the rack. Note: The middle rails attach to the front posts. The outer rails attach to the back posts.
Page 65 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Left back rack post Middle left rail Right back rack post Middle right rail Outer left rail Left front rack post Outer right rail Right front rack post 5. Slide the chassis into the rack. The chassis weighs over 32 kg (70 lb). Always use at least two people or a server lift when lifting the chassis.
Page 66 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Tighten the thumbscrew in each handle. What to do next Connect and activate the expansion shelf. Install an Expansion Shelf 66...
Page 67: Connect And Activate An Es2-H Or Sf-Es2 Expansion Shelf
Connect and Activate an ES2-H or SF-ES2 Expansion Shelf Use this procedure to connect and activate up to six ES2-H expansion shelves or up to two SF-ES2 expansion shelves, depending on the model of your HPE Nimble Storage array. Before you begin Important: Fully configure the array, updating the NimbleOS version if necessary.
Page 68 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Array SAS In SAS expansion port (P2) Expansion shelf Expansion shelf SAS In 4 SAS Out Connect and Activate an ES2-H or SF-ES2 Expansion Shelf 68...
Page 69 Documentation Feedback: doc-feedback-hpe-storage@hpe.com 3. Connect additional shelves as needed. a) Connect the SAS OUT (expansion) port of controller A on the array to the SAS IN port of expander A on the expansion shelf. b) Connect the SAS OUT (expansion) port of expander B on the expansion shelf to the SAS IN port of expander B on the next expansion shelf.
Page 70: Connect And Activate An Es2-Afs2 Expansion Shelf
Use this procedure to connect and activate an ES2-AFS2 expansion shelf and up to six ES2-H expansion shelves, depending on the model of your HPE Nimble Storage array. The recommendation is to connect the ES2-AFS2 directly to the array, although it is not a requirement.
Page 71 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Array Expansion shelf SAS expansion port (P2) SAS In 3. Connect additional shelves as needed. a) Connect the SAS OUT (expansion) port of expander A on the expansion shelf to the SAS IN port of expander A on the next expansion shelf.
Page 72 Documentation Feedback: doc-feedback-hpe-storage@hpe.com 5. Activate the expansion shelves. Note: Ensure that all drives are detected and all drive LEDs are green before activating the expansion shelf. When you activate the expansion shelf, there is a momentary pause in data services from the array. You might need to activate the expansion shelf during a maintenance window.
Page 73: Expansion Shelf Components
Expansion Shelf Components An expansion shelf increases the number of SSDs or HDDs available to the array. Each ES2-H and SF-ES2 model expansion shelf includes the chassis, two power supplies, and two I/O units on the back with cooling fans, called expanders. Like the controllers in an array, expanders are also replaced in the field.
Page 74: Start The Expansion Shelf
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 24: A single expander and power supply from the ES2-H and SF-ES2 model expansion shelves Power supply Expander fans Power connector SAS In Power supply fan SAS Out Start the Expansion Shelf CAUTION: When you add an expansion shelf, there is a momentary pause in data service from the Nimble array. If this brief interruption might cause a problem in your environment, add the expansion shelf during a maintenance window.
Page 75: Shut Down The Expansion Shelf
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 25: Power button on the array 1 Power button Shut Down the Expansion Shelf For most hardware changes you do not need to shut down (power off) the expansion shelf because the components are redundant and hot swappable.
Page 76: Restart The Expansion Shelf
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Restart the Expansion Shelf You rarely need to restart an expansion shelf. You must use the CLI to restart the array and its expansion shelf. CAUTION: When you restart the array, all volumes temporarily go offline. Procedure 1.
Page 77: Drive Leds
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Table 11: Expansion shelf front LEDs Status Power indicator Solid green indicates that the power is on. Heartbeat The heartbeat LED is solid during normal operation. SAS In / SAS Out Flashing indicates network activity is present.
Page 78: Expander Leds
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 28: SSD drive and carrier LEDs Drive B fault Drive A fault Drive B operation Drive carrier fault 3 Drive A operation In an SSD drive carrier, there are two individual drive slots, each with two LEDs. The following table describes the drive carrier LEDs.
Page 79 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 29: Expansion shelf expander LEDs Power supply SAS In Firmware SAS Out Expander LEDs report several functions. The following table describes the expander LEDs. Table 14: Expansion shelf expander LEDs Status Power supply Green: Power switched on, AC power connected...
Page 80: Find The Serial Number Of An Expansion Shelf Using The Gui
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Find the Serial Number of an Expansion Shelf Using the GUI Procedure 1. Do one of the following in the GUI: For version 3.x or earlier, choose Manage > Arrays. For version 4.x or later, click Hardware.
Page 81: Maintenance Procedures
How the Storage Array Handles a Failed Drive The HPE storage array is designed to be highly available, with redundant components. With Triple+ Parity RAID, an Adaptive Flash array continues serving data with up to two independent HDD failures. At the RAID level, three drives are dedicated to parity, which is striped evenly across the RAID group.
Page 82 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Verify that the replacement drive matches the part shown on the RMA work order. Before you begin Procedure 1. Gently pull the front bezel away from the array chassis. The bezel includes power connection pins on both sides.
Page 83: How To Tell That A Drive Has Failed
Push the handle until it fully engages with the release tab. 6. After no more than two minutes, make sure that the drive operation LED is green. If the LED does not light, remove and reinsert the drive. If unsuccessful, contact HPE Support. Drive operation Drive fault 7.
Page 84: How To Tell That The Drive Carrier Has Failed
If both the drive and the carrier fault LEDs are lit, try replacing the failed drive first. If the carrier fault LED persists, then replace the carrier. Contact Nimble Storage Support. Replace a Dual Flash Carrier Use this procedure to replace the entire failed Dual Flash drive carrier in your HPE storage array or expansion shelf. Time required: 5 to 10 minutes...
Page 85 Documentation Feedback: doc-feedback-hpe-storage@hpe.com You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page. After a maintenance window is set, no further communication with HPE Support is required. CAUTION: Before you attempt to replace the failed drive carrier: Do not remove the drive carrier or individual SSD slots from the drive carrier until you are ready to install the replacement.
Page 86 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Drive B operation Drive carrier fault 2 Drive A operation 3. Release and remove both drive sleds (B and A) from the failed drive carrier. a) To release the handle, slide the small tab to the right on the sled of the drive (A, bottom). The sled handle springs open.
Page 87: Controller Maintenance
Support contact: See Support. Note: HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows. Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information. You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page.
Page 88 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 32: Array rear view Controller A Controller B Note: When replacing a controller, reuse the USB device from the old controller. If the old USB device cannot be used, contact Nimble Storage Support. If one controller fails, the other controller takes over. The array can function with one healthy controller while the replacement is installed.
Page 89 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Example NimbleOS $ halt --array array123 --controller A 2. Remove the failed controller. a) Label all the cables (to ensure proper recabling), then remove them from the controller. b) Loosen the keeper screw to release the controller handle.
Page 90 Documentation Feedback: doc-feedback-hpe-storage@hpe.com USB port Controller handle 2 Fans b) Gently but firmly pull the USB stick up and out of its socket. c) Mark or label the USB stick from the failed controller. d) Remove the USB stick from the replacement controller and set that USB stick aside.
Page 91: Replace A Pcie Card
7. Return the failed controller as directed on the RMA work order. Replace a PCIe Card Use this procedure to replace existing network interface cards (NICs) or host bus adapters (HBAs) on your HPE Nimble Storage array. Before you begin...
Page 92 Documentation Feedback: doc-feedback-hpe-storage@hpe.com b) Determine which controller is in Standby or Unknown mode. ctrlr --list --array array_name c) halt --array array_name --controller {A | B} 2. Physically remove the standby controller. a) Label all cables to ensure proper recabling later, then remove them from the controller.
Page 93 Documentation Feedback: doc-feedback-hpe-storage@hpe.com PCIe cage Thumbscrew Controller panel PCIe cage Note: If the PCIe cage does not have a retention bracket, go to Step 4. Loosen the two thumbscrews on the PCIe cage, then slide the retention bracket out to loosen the PCIe cards.
Page 94: Replace A Fan
Note: Ports that are not configured for management traffic (NIC ports only) or data traffic (NIC or HBA ports) report an unconfigured (gray) status. HBA ports cannot be configured for management traffic. Replace a Fan Use this procedure to replace the mid-plane fan in your HPE Nimble Storage array or expansion shelf. Maintenance Procedures 94...
Page 95 ESD (Electrostatic Discharge) wrist strap or other grounding device Support contact: See Support. HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows. Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information. You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page.
Page 96 Documentation Feedback: doc-feedback-hpe-storage@hpe.com b) Slide the top cover to the rear of the chassis until it stops. Note: Ensure that the power and networking cables do not interfere with the top cover. 2. Slide the array out of the rack to expose the mid-plan fan.
Page 97 Documentation Feedback: doc-feedback-hpe-storage@hpe.com b) Slide the array out from the front of the rack until the rails lock into place (15 inches). 3. Locate the failed fan to be replaced. Nimble Storage Support will provide the location of the failed fan (1A, 2A, 1B, or 2B).
Page 98 Documentation Feedback: doc-feedback-hpe-storage@hpe.com 4. Replace the failed fan. a) Press the two latches in the side of the fan and lift straight up. b) Insert the replacement fan into the empty slot and apply gentle downward pressure to ensure that the fan fully seats.
Page 99 Documentation Feedback: doc-feedback-hpe-storage@hpe.com 5. Replace and secure the array chassis top cover. a) From the back of the array, slide the top cover forward until it is fully seated. Maintenance Procedures 99...
Page 100 Documentation Feedback: doc-feedback-hpe-storage@hpe.com b) Screw in the two green thumb screws to secure the top cover to the chassis. 6. Slide the array back into position and secure to rack. a) Slide the array back into the rack in its original position until it is fully seated in the rack.
Page 101: Fail Over A Controller Using The Gui
Documentation Feedback: doc-feedback-hpe-storage@hpe.com 7. Verify that the mid-plane fan is operating properly. a) Do one of the following in the GUI: For version 3.x or earlier, choose Manage > Arrays, then click the link for an array. For version 4.x or later, click Hardware, then click the array.
Page 102: Find The Model Number Of An Array Or Expansion Shelf Using The Gui
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Procedure 1. Determine the name of the array. array --list The name of the array appears in the list. 2. Perform the failover. failover --array array_name During the failover operation, the standby controller first goes into Solo mode, and then into Active mode. The active controller goes into Unknown mode, then into Stale mode, and finally into Standby mode.
Page 103 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 35: GUI View of Array Controllers - 3.x Figure 36: GUI View of All Flash Array Controller - 4.x Maintenance Procedures 103...
Page 104: Determine The Operating State Of The Controllers Using The Cli
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Figure 37: GUI View of Adaptive Flash Array Controller - 4.x One controller should be in Active mode and the other in Standby mode. Determine the Operating State of the Controllers Using the CLI Procedure List the controllers.
Page 105: Expander Maintenance
ESD (electrostatic discharge) strap or appropriate grounding device Support contact: See Support. HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows. Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information. You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page.
Page 106 4. Verify that the new expander is powered on. After it is installed, the expander powers on automatically. The LEDs on the expansion shelf light solid green. If the expander does not power on automatically, contact HPE Support. Maintenance Procedures 106...
Page 107: Power Supply Maintenance
Replace an AC Power Supply Use this procedure to replace a failed AC power supply unit (PSU) on your HPE storage array or expansion shelf. Power supplies are replaced as a complete unit. One PSU can adequately power the array while the other PSU is being replaced.
Page 108 A power supply internal fault has occurred Verify that the power cord is plugged in, then check for and correct these conditions before you assume that the PSU in your HPE storage array needs to be replaced. CAUTION: Before you attempt to replace a power supply:...
Page 109 Handle 4. Insert the new PSU. Push in gently until you hear a click. Do not force the power supply. If it fails to install properly, contact HPE Support. 5. Attach the power cord and secure the retention clip. Power is automatically restored to the PSU as soon as the cord is plugged in.
Page 110: Replace A Dc Power Supply
Replace a DC Power Supply Use this procedure to replace a failed DC power supply unit (PSU) on your HPE storage array or expansion shelf. Power supplies are replaced as a complete unit. One PSU can adequately power the array while the other PSU is being replaced.
Page 111 You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page. After a maintenance window is set, no further communication with HPE Support is required. A PSU with an amber LED may have a fault. But an amber LED also indicates:...
Page 112 Handle 4. Insert the new PSU. Push in gently until you hear a click. Do not force the power supply. If it fails to install properly, contact HPE Support. 5. Attach the power connections to the PSU. Screw in the two wires from your DC power source to the connections labeled + (RTN) and - (-48V).
Page 113: Replace Ac Power Supplies With Dc Power Supplies
Replace AC Power Supplies with DC Power Supplies Use this procedure to replace the AC power supply units (PSUs) on your HPE Nimble Storage array with DC PSUs. One PSU can adequately power the array while the other PSU is being replaced.
Page 114 Phillips screwdriver Support contact: See Support. HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows. Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information. You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page.
Page 115 Documentation Feedback: doc-feedback-hpe-storage@hpe.com 1 Power supply LED 2. Remove the power cord from the PSU by pulling back on the sliding tabs on the sides of the cord and then pulling the cord out of the socket. Carefully loosen the retention clip surrounding the cord, and remove the power cord.
Page 116 Handle 4. Insert a replacement DC PSU in A. Push in gently until you hear a click. Do not force the power supply. If it fails to install properly, contact HPE Support. 5. Attach the power connections to the PSU.
Page 117: Replace Dc Power Supplies With Ac Power Supplies
Replace DC Power Supplies with AC Power Supplies Use this procedure to replace the DC power supply units (PSUs) on your HPE storage array or expansion shelf with AC PSUs. One PSU can adequately power the array while the other PSU is being replaced.
Page 118 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Procedure 1. Identify the DC PSU in A. CAUTION: Before proceeding, verify that the DC power source is turned off at the circuit breaker. 1 Power supply LED 2. Remove the power cord from the PSU by pulling back on the sliding tabs on the sides of the cord and then pulling the cord out of the socket.
Page 119: Chassis Maintenance
HPE Support. 7. Repeat steps 1 through 5 for the PSU in B. 8. Contact HPE Nimble Storage Support. They will verify that the new PSU is operating properly. Chassis Maintenance If your existing chassis needs to be replaced, you can move your array components (drives, power supply, and controllers) with all network cabling to a new chassis, ordered from Nimble Storage.
Page 120: Replace The Chassis
HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows.
Page 121 Documentation Feedback: doc-feedback-hpe-storage@hpe.com 6. Install the new chassis into the rack. 7. Move the drive carriers from the existing array to the new chassis. Do not remove a drive from its drive carrier. a) Slide the black tab down to release the drive carrier handle. The handle springs open.
Page 122 Documentation Feedback: doc-feedback-hpe-storage@hpe.com New chassis Old array chassis 8. Move the controllers from the existing array to the new chassis. a) Unscrew the keeper to release the handle on one of the controllers. b) Grasp the controller by the handle, pull the controller firmly to remove it from the chassis bay.
Page 123 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Release lever Handle Holding screw Power supply Release tab Controller With all the components from the existing array installed into the new chassis, the new chassis becomes the new array. 10. Plug in the network cables first, then SAS cables, followed by the power cords into the new array, and replace the front bezel.
Page 124: Upgrade Procedures
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Upgrade Procedures Your HPE Nimble Storage array can be upgraded to include new SSDs or HDDs to increase capacity, as well as by installing new NICs or FC HBAs and cabling additional expansion shelves. For more details about your model array, see Model Specifications in the Hardware Specifications section of this guide. To check for all supported upgrades for your array, refer to the Array Configuration Matrix available on InfoSight at: https://infosight.nimblestorage.com.
Page 125 Documentation Feedback: doc-feedback-hpe-storage@hpe.com HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows. Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information. You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page.
Page 126 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Important: Use caution while removing the keeper screw to avoid screwdriver tip slipping through the fan grill and hitting the fan blade. Keeper screw Thumbscrew 2 Handle Note: Do not remove the power cord above the controller. If clips are installed, it is recommended to secure retention clips around the power cord to avoid accidental power cord removal or displacement.
Page 127 NimbleOS. Do not remove the controller during this period because interrupted firmware updates might render the hardware non-functional. If the controller takes longer than 90 minutes to report an Active/Standby state, contact HPE Support for assistance. Upgrade Procedures 127...
Page 128: Upgrade Cache
ESD (electrostatic discharge) strap or appropriate grounding device Support contact: See Support. HPE recommends using the Maintenance Window functionality within the HPE InfoSight portal to inform HPE Support of upcoming maintenance windows. Refer to https://infosight.hpe.com/dashboards/nimble/wellness/maintenance-windows for more information. You can disable automated support case generation during planned maintenance from the Manage Maintenance Windows page.
Page 129 Documentation Feedback: doc-feedback-hpe-storage@hpe.com You must update the array to NimbleOS 3.3.x (for CS1000, CS3000, CS5000, CS7000), or NimbleOS 3.4.x (for CS1000H) before adding new SSDs in each drive carrier (Drive B). Failing to do so may result in unavailability of service.
Page 130 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Procedure 1. Gently pull the front bezel away from the array chassis. The bezel includes power connection pins on both sides. 2. Identify the empty drive. The empty drive sled in an SSD drive carrier should be for Drive B (top), with Drive A (bottom) already populated. (Do not remove the sled for Drive A or the drive carrier.)
Page 131 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Drive B (empty) Drive carrier 2 Drive A operation (populated) 3. Release and remove the empty drive sled B from the drive carrier. a) To release the handle, slide the small tab to the right on the sled of drive B. The sled handle springs open.
Page 132: Upgrade A Pcie Card
2.3.12.x or later. Arrays running earlier versions need to run the update only if both controllers have been upgraded to symmetrical configurations. If you are upgrading a NIC or HBA in a CS1000 or CS1000H array, you can upgrade only one card, and you must install that new card in slot 1.
Page 133 Documentation Feedback: doc-feedback-hpe-storage@hpe.com If you are upgrading to a quad port 1GB NIC, your array must be running NimbleOS 3.7 or later. If you are upgrading to a quad port 10 GB NIC or 10 GB SFP+ NIC, your array must be running NimbleOS 3.8 or later.
Page 134 Documentation Feedback: doc-feedback-hpe-storage@hpe.com b) Gently pull the PCIe cage up from the controller to unseat the PCIe cage riser card from the motherboard connector. c) Remove the two screws to loosen the PCIe cage cover, then separate the cover from the cage.
Page 135 Install the new NIC or HBA. After the card is successfully installed, reinsert the transceiver into port 1 if you removed Note: If you are upgrading a NIC or HBA in a CS1000 or CS1000H array, you can upgrade only one card, and you must install that new card in slot 1.
Page 136: Upgrade Hdds
Note: Ports that are not configured for management traffic (NIC ports only) or data traffic (NIC or HBA ports) report an unconfigured (gray) status. HBA ports cannot be configured for management traffic. Upgrade HDDs Use this procedure to add HDDs to your HPE Nimble Storage Adaptive Flash array. Before you begin Time required:...
Page 137 Before you install the new drives: For a model CS1000H Nimble Storage array, the minimum SSD cache required to support the 11 x 1TB HDD field upgrade is 960GB. If your array does not have the minimum SSD cache capacity, you must upgrade the cache before proceeding with the HDD upgrade.
Page 138 5. After no more than two minutes, make sure that the drive operation LED is green. If the LED does not light, remove and reinsert the drive. If unsuccessful, contact HPE Support. The image below depicts an HDD in the Nimble Storage CS1000H array.
Page 139: Hardware And Model Specifications
Rack Units Approximate Weight Chassis only (CS1000, CS3000, CS5000, CS7000, SF100, SF300) : 48 kg (105 lb), 68kg (150lbs) with packaging Chassis only (CS1000H) : 41 kg (90 lb), 61kg (135lb) with packaging Table 16: Operating Environment Component Specification Temperature Operating: 10°...
Page 140 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Table 17: Electrical Requirements Component Specification Power supplies Hardware and Model Specifications 140...
Page 141 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Component Specification AC input rating: 1000W: AC input voltage: 100-127V Maximum rated input current: 12-10A Rated input frequency: 50-60Hz 1200W AC input voltage: 200-240V Maximum rated input current: 8.5-7A Rated input frequency: 50-60Hz Efficiency: Typical 96%+ at 230VAC. 80 Plus Titanium.
Page 142 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Component Specification This equipment is to be Installed Only in Restricted Access Locations (such as Dedicated Equipment Rooms, or Electrical Closets). Supply Wiring: Marking on the Product is provided near the input terminal blocks on the power supply: Use 12 AWG wiring.
Page 143 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Table 18: Connectors and Ports Component Specification Controllers / Expanders Two controllers per chassis Ethernet ports 2x 10GbE per controller (minimum) Note: Actual ports will vary depending on the configuration and upgrades. Fibre Channel ports CS1000HP: 1 or 2 x 16GbFC ports per controller, 2 or 4 x 16GbFC ports per array...
Page 144: Model Specifications
HPE Nimble Storage website at: https://h20195.www2.hpe.com/v2/GetDocument.aspx?docname=a00008275enw&ver=4 SFP Specifications Optical Fiber HPE Nimble Storage Array 10GbE cards and 16Gb Fibre Channel (FC) cards include SFP+ optical transceivers. The following tables list supported SFP+ transceivers. SFP+ Specifications (10GbE) Table 21: Finisar...
Page 145 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Item Description Wavelength 850nm VCSEL laser Applications 10GBASE-SR Ethernet 10Gb/s Ethernet Voltage, per power supply 3.3V Connector type LC Duplex RoHS 2011/65/EU Operating temperature -5° to 70°C (23° to 158°F) Maximum link length 300m on OM3 multimode fiber IEEE Standard 802.3ae...
Page 146 50 μm multimode 500MHz OM2 82 meters (269 ft) 50 μm multimode 2000MHz OM3 300 meters (980 ft) Note: HPE Nimble Storage recommends OM3 or better Fibre Channel (FC) cables. Table 26: Fibre Channel Cabling Cable Grade Speed Maximum Distance by Optical Cable/Media Type OM1 62.5μm...
Page 147: Statement Of Volatility
Statement of Volatility HPE Nimble Storage AFx000 Product Family Description - Below are the identifications of all the volatile and non-volatile devices found in the HPE Nimble Storage products AF1000, AF3000, AF5000, AF7000, and AF9000 model arrays. Table 27: Table of Volatile and Non-Volatile Devices...
Page 148 Note: The 1G and 10G LAN, 4Gb FC FW EEPROM,disk drive media, and disk drive EEPROM items apply if configured. HPE Nimble Storage CSx000 and SFx00 Product Families Description - Below are the identifications of all the volatile and non-volatile devices found in the HPE Nimble Storage CS1000H, CS1000, CS3000, CS5000, CS7000, SF100, and SF300 model arrays.
Page 149 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Item Non-Volatile or Quantity Location User Data? Procedure to Clear Volatile 10G LAN FW EEP- Non-Volatile Motherboard Use Programmer to erase PLX EEPROM Non-Volatile Motherboard Use Programmer to erase CPLD Non-Volatile Motherboard Use Programmer to erase VGA memory...
Page 150 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Item Non-Volatile or Quantity Location User Data? Procedure to Clear Volatile NVDIMM DRAM Volatile NVRAM PCIe card Remove AC for 5 minutes NVDIMM EEPROM Non-Volatile NVRAM PCIe card Use Programmer to erase 1G LAN FW EEP- Non-Volatile...
Page 151: Troubleshooting
This section describes how to check the temperature of your storage array and expansion shelves to prevent overheating, and keep your system operating at safe levels. Check System Temperature Like any electronic device, HPE storage arrays and expansion shelves generate heat. The amount of heat generated, BTU per hour, depends on the model. Fans and Sensors HPE Nimble Storage arrays and expansion shelves have multiple cooling fans.
Page 152: Check System Temperature Using The Gui
If the external temperature in your environment is below the specified safe level for the array, you have verified that there is ample air flow around the system, and you still get alert messages, contact HPE Support. See Support. Check System Temperature using the GUI Procedure 1.
Page 153: Regulatory And Safety Information
For important safety, environmental, and regulatory information, refer to this section and to the Safety and Compliance Information for Server, Storage, Power, Networking, and Rack Products guide available at http://www.hpe.com/support/Safety-Compliance-EnterpriseProducts. Regulatory Warnings This section describes all regulatory warnings which apply to Nimble Storage arrays.
Page 154 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Saudi Arabia Warning Nimble Storage product arrays comply with the CITC Technical Specification CITC IT001. Warning This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
Page 155 Documentation Feedback: doc-feedback-hpe-storage@hpe.com Regulatory and Safety Information 155...
Page 156: Safety Warnings
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Safety Warnings This section describes the safety warnings that apply to HPE storage arrays. Regulatory and Safety Information 156...
Page 157: Electrical Safety
Documentation Feedback: doc-feedback-hpe-storage@hpe.com Note: Access can only be gained by Service Persons or by Users who have been instructed about the reasons for the restrictions applied to the location and about any precautions that shall be taken. The storage is intended for...
Page 158: Battery Safety
Avoid contact between electronic components and clothing. Even if you are wearing a wrist strap, your clothing may still retain a charge. Battery Safety All HPE storage arrays ship with a super-capacitor to power the NVDIMM. The super-capacitor is not user-replaceable. Regulatory and Safety Information 158...

This manual is also suitable for:

Cs1000 Cs3000 Cs5000 Cs7000 Sf100 Sf300 ... Show all