Installing the DS3500 storage subsystem . 2-1 configuration . . 3-28 Inventory checklist. . 2-1 Connecting SAS hosts to the DS3500 . . 3-28 DS3500 installation overview . . 2-2 Connecting Fibre Channel hosts to the Handling static-sensitive devices .
Page 4
Replacing an ESM . 5-37 People's Republic of China Class A electronic Replacing a midplane assembly . . 5-38 emission statement . C-7 Taiwan Class A compliance statement . . C-7 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Connecting a mini-SAS cable . . 3-4 3-36. Dual-controller DS3500 or single-controller 3-7. Removing a mini-SAS cable . . 3-5 DS3500 SAS connection to multiple hosts 3-8. SFP module and protective cap . . 3-7 using one SAS switch . . 3-32 3-9.
Page 8
. 4-8 storage enclosure parts . . 7-4 4-5. DS3512 storage subsystem and EXP3512 A-1. Serial number location on the DS3500 storage enclosure front LEDs and controls . 4-8 viii System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 9
Tables 1-1. Features and operating specifications 3-3. DC power supply connector - pin 1-2. DS3500 models and optional devices descriptions . . 3-48 1-3. DC power supply connector - pin 3-4. DC power source wiring descriptions 3-48 descriptions . . 1-13 4-1.
Page 10
System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Be sure to read all caution and danger statements in this documentation before you perform the procedures. Read any additional safety information that comes with your system or optional device before you install the device. Statement 1 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 13
Statement 2 CAUTION: ® When replacing the lithium battery, use only IBM Part Number 33F8354 or an equivalent type battery recommended by the manufacturer. If your system has a module containing a lithium battery, replace it only with the same module type made by the same manufacturer. The battery contains lithium and can explode if not properly used, handled, or disposed of.
Page 14
Appareil A Laser de Classe 1 Statement 4 ≥ 18 kg (39.7 lb) ≥ 32 kg (70.5 lb) ≥ 55 kg (121.2 lb) CAUTION: Use safe practices when lifting. Statement 5 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 15
CAUTION: The power control button on the device and the power switch on the power supply do not turn off the electrical current supplied to the device. The device also might have more than one power cord. To remove all electrical current from the device, ensure that all power cords are disconnected from the power source.
Page 16
CAUTION: Make sure that the rack is secured properly to avoid tipping when the server unit is extended. Statement 17 CAUTION: The following label indicates moving parts nearby. Statement 26 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 17
CAUTION: Do not place any object on top of rack-mounted devices. Statement 29 CAUTION: This equipment is designed to permit the connection of the earthed conductor of the dc supply circuit to the earthing conductor at the equipment. If this connection is made, all of the following conditions must be met: v This equipment shall be connected directly to the dc supply system earthing electrode conductor or to a bonding jumper from an earthing terminal bar or bus to which the dc supply system earthing...
Page 18
Multiple devices extended into the service position can cause your rack cabinet to tip. v If you are not using the IBM 9308 rack cabinet, securely anchor the rack cabinet to ensure its stability.
DS3500 storage subsystem and EXP3500 storage enclosure. If firmware and documentation updates are available, you can download them from the IBM Web site. The DS3500 storage subsystem and EXP3500 storage enclosure might have features that are not described...
With direct-attached Serial Attached SCSI (SAS) connectivity and support for RAID levels 0, 1, 3, 5, and 6, the DS3500 storage subsystem provides an internal physical storage capacity that is scalable up to 36 TB (terabytes) for the DS3512 and 24 TB for the DS3524 storage subsystem.
NEBS level 3/Telco operating environments and standard IT and office environments. The IBM System Storage DS Storage Manager version 10 software is also available for the DS3500 storage subsystem. This storage-management software is designed to help centralize storage management, simplify partitioning of the DS3500 series storage into as many as 128 virtual servers, and strategically allocate storage capacity to maximize storage space.
Features and operating specifications Table 1-1 contains a summary of the features and operating specifications of the DS3500 storage subsystem and EXP3500 storage enclosure. Depending on your model, some features might not be available, or some specifications might not apply.
The DS3500 storage subsystem controller cache size, partitions, and other features vary depending the model and optional devices. Table 1-2 shows the DS3500 models and options available at time of publication. Contact your IBM marketing representative or authorized reseller for more information about the models and options.
Important: To keep your storage subsystem up-to-date with the latest firmware and other product updates, register the storage subsystem for technical support notifications. Go to http://www.ibm.com/ servers/storage/support/disk/. From the menu at the top of the page, click My IBM and select My Technical Support. On the next page, click register now.
Back up the data on your storage drives periodically. v To maintain power redundancy, connect the DS3500 storage subsystem and EXP3500 storage enclosure right and left power supplies to two independent external power circuits through ac power distribution units (PDUs) inside a rack or directly into external receptacles.
– The disconnect device (circuit breaker) must be rated at 20 A. – Make sure that only 12 AWG or larger copper conductor wires are used for all of the wiring between the DS3500 or EXP3500 dc power connectors and the dc power source. DS3500 storage subsystem and EXP3500 storage enclosure...
DS3524 storage subsystem and EXP3524 storage enclosure. Filler panel The DS3500 storage enclosure and EXP3500 storage enclosure come with filler panels in the empty drive bays. Before you install a disk drive, remove the filler panel and save it for future use.
(or drives) in an offline state before you remove the drive from the enclosure. Controllers The DS3500 storage subsystem comes with one or two controllers. When the DS3500 storage subsystem has two controllers, the controllers are hot-swappable and redundant. The controllers contain the storage subsystem control logic, interface ports, and LEDs.
The storage management software automatically sets the enclosure ID for the controllers. You can change the enclosure ID setting through the Storage Manager software only. There are no switches on the DS3500 chassis to manually set the enclosure ID. Both controller enclosure IDs are identical under normal operating conditions.
Figure 1-8. Rear view, single ESM model storage enclosure AC power supply and fan units The DS3500 storage subsystem (models DS3512-C2A and DS3524-C4A) and EXP3500 storage enclosure (models EXP3512-E2A and EXP3524-E4A) each have two removable ac power supplies. Each ac power supply contains two fans.
Power Power Power Power connector switch switch connector Figure 1-10. DC power supply components Figure 1-11 and Table 1-3 below show the location and describe the function of the dc power supply connector pins. Figure 1-11. DC power supply connector - pin positions Table 1-3.
Software and firmware support code upgrades To enable support for the DS3500, you must make sure that your system software and firmware are at the latest levels. To find the latest Storage Manager software, controller firmware, NVSRAM, ESM firmware, and drive firmware, check the firmware readme files.
ESM firmware version Specifications The specifications of the DS3500 storage subsystem and EXP3500 storage enclosure are listed in Table 1-1 on page 1-4. This section provides additional site specifications for the DS3500 storage subsystem and EXP3500 storage enclosure. Before you install the storage subsystem, you must either make sure that your planned installation site meets these requirements or prepare the site so that it does meet these requirements.
8.4 kg (18.5 lb) EXP3512 26.3 kg (57.9 lb) Chassis with dual controller or ESMs and 12 drives. Chassis without power supplies, controllers or ESMs, and drive filler panels. 1-16 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
EXP3524 with dc power supply and 25.15 kg (55.45 lb) fan units Chassis with dual controller or ESMs and 24 drives. Chassis without power supplies, controllers or ESMs, and drive filler panels. Table 1-6. DS3500 component weights Unit Weight 2.5–inch drive 0.25 kg (0.55 lb) 3.5–inch drive...
(such as air conditioning motors, elevator motors, and factory loads). v Power failures: If a total power failure occurs, the unit automatically performs a power-on recovery sequence without operator intervention after power is restored. 1-18 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
12 AWG or larger copper conductor wires must be used for all of the wiring between the DS3500 or EXP3500 dc power connectors and the dc power source. See the “DS3524 storage subsystem and EXP3524 storage enclosure parts listing” on page 7-3 for more information.
Heat output, airflow, and cooling Air enters at the front of the DS3500 storage subsystem and EXP3500 storage enclosure and leaves at the back. Allow at least 30 inches in front of the DS3500 storage subsystem and EXP3500 storage enclosure and at least 24 inches at the rear for service clearance, proper ventilation, and heat dissipation.
This chapter provides instructions for installing the DS3500 storage subsystem and the EXP3500 storage enclosure in a rack. To install the DS3500 storage subsystem in a rack, see Chapter 2, “Installing the storage subsystem and storage enclosure.” To install the EXP3500 storage enclosure in a rack, see “Installing the EXP3500 storage enclosure”...
Attention: A fully configured DS3500 storage subsystem weighs up to 27 kg (60 lb). At least two people should lift the DS3500 storage subsystem from the shipping box. You might want to open the sides of the shipping box and remove the components from the DS3500 storage subsystem before you lift it from the shipping box, to lighten the storage subsystem.
Preparing for installation Before you install the DS3500 storage subsystem, create a detailed plan of how the device will be used in your storage configuration. The plan should include determining RAID levels, failover requirements, operating systems that are to be used, and total storage capacity requirements.
Installing the DS3500 storage subsystem in a rack To install the DS3500 in a rack, follow the instructions in the DS3500 and EXP3500 Rack Installation and Quick Start Guide. Then, continue with Chapter 3, “Cabling the storage subsystem and storage enclosure,”...
– IBM System Storage DS3500 and EXP3500 Installation, User's, and Maintenance Guide (this document) – IBM Systems Safety Notices All documents are available on the IBM Documentation CD or from the IBM support Web site at http://www.ibm.com/servers/storage/support/. Installing the EXP3500 storage enclosure in a rack You can install the EXP3500 storage subsystem in an Electronic Industries Association (EIA) 310 standard rack.
Page 44
System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Controller B Drive expansion port Seven-segment numeric display Figure 3-1. Dual-controller DS3500 storage subsystem ports and controllers (with optional Fibre Channel host port adapter) Fibre Channel host ports Each Fibre Channel host port supports a small-form-factor pluggable (SFP) transceiver and is capable of operating at 8 Gbps, 4 Gbps, or 2 Gbps.
Figure 3-3. Dual-controller DS3500 storage subsystem ports and controllers (with optional 10 iSCSI host port adapter) 10 Gbps iSCSI host ports The 10 Gbps iSCSI host ports are auto-negotiated 1/10Gbps Ethernet ports that support iSCSI off load. The host ports also provide support for both Internet Protocol version 4 (IPv4) and IPv6, and have the advanced networking functions of jumbo frames, IEEE 802.1p, and virtual local area...
Controller connectors (with SAS host port adapters) Figure 3-4 shows the optional SAS host port adapter installed in both controllers at the rear of the DS3500 storage subsystem. SAS host port 2 SAS host port 3 SAS host port 1...
To remove a mini-SAS cable, complete the following steps: 1. Put one finger into the hole on the blue plastic tab on the mini-SAS connector and gently pull on the tab to release the locking mechanism. System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Blue plastic tab Figure 3-7. Removing a mini-SAS cable 2. As you pull on the tab, pull out the connector to remove it from the port. Working with SFP modules and fiber optic cables Each storage controller can have up to four Fibre Channel host ports. You use a small-form-factor pluggable (SFP) module to connect a host port to a host.
4-Gbps-capable port will limit the speed of that port to a maximum of 2 Gbps. Attention: Carefully check the IBM part number, option number, and FRU part number of the SFP module to identify its speed. There are no physical features that distinguish an 8 Gbps, 4 Gbps, or 2 Gbps SFP module from each other.
CAUTION: This product might contain one or more of the following devices: CD-ROM drive, DVD-ROM drive, DVD-RAM drive, or laser module, which are Class 1 laser products. Note the following information: v Do not remove the covers. Removing the covers of the laser product could result in exposure to hazardous laser radiation.
Figure 3-10. Unlocking the SFP module latch - plastic variety v For SFP modules that contain wire tabs, unlock the SFP module latch by pulling the wire latch outward 90°, as shown in Figure 3-11 on page 3-9. System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Wire Protective module Figure 3-11. Unlocking the SFP module latch - wire variety 3. With the SFP module latch in the unlocked position, remove the SFP module. v For SFP modules that contain plastic tabs, slide the SFP module out of the port. v For SFP modules that contain wire tabs, grasp the wire latch and pull the SFP module out of the port.
Page 54
The cable connector is keyed for correct installation. Holding the connector, push in the cable until it clicks into place, as shown in Figure 3-14 on page 3-11. 3-10 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Figure 3-14. Inserting an LC-LC Fibre Channel cable into an SFP module 5. Remove the two protective caps from the other end of the LC-LC cable. Save the protective caps for future use. 6. Connect this end of the LC-LC cable to one of the following devices: v An SFP module that is installed in a Fibre Channel switch port v A Fibre Channel host bus adapter port Removing an LC-LC Fibre Channel cable:...
For more information, see the documentation that comes with the LC-SC Fibre Channel cable adapter. LC connector SC connector Figure 3-17. LC-SC Fibre Channel cable adapter The following sections provide the procedures for correctly connecting and removing an LC-SC Fibre Channel cable. 3-12 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
To connect an LC-SC Fibre Channel cable adapter to a device, complete the following steps. 1. Read the information in “Handling fiber optic cables” on page 3-5. 2. Connect one end of an LC-LC cable to an SFP module in the DS3500. For instructions, see “Using LC-LC Fibre Channel cables” on page 3-9.
2. Carefully pull on the connector to remove it. Make sure you grasp the connector and not the cable when removing the LC-LC cable from the LC-SC cable adapter as shown in Figure 3-21 on page 3-15. 3-14 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
SAS out connector Figure 3-22. ESM connectors SAS In 1 Connect a SAS cable to this connector and to either an IBM SAS controller or the SAS Out (↓) connector of another EXP3500. SAS In 2 Connect a SAS cable to this connector and to either an IBM SAS controller or the SAS Out (↓) connector of another EXP3500.
Repeat steps 2a and 2b for each EXP3500 storage enclosure that you add. Dual-ESM configuration The EXP3500 storage enclosure comes with one ESM. If your DS3500 storage subsystem is a dual controller configuration, it supports redundant drive paths. You must install a second ESM. See “Installing an additional ESM”...
Page 61
Connect the other end of the SAS cable to one of the In (↑) SAS connectors on the right ESM in the EXP3500 storage enclosure. Dual-ESM configuration with two or more EXP3500 storage enclosures: The DS3500 controllers support more than one EXP3500 storage enclosure per physical port, so multiple EXP3500 storage enclosures can be connected by chaining them together. 3-17...
Page 62
1. Connect one EXP3500 storage enclosure to controller A: a. Connect one end of a SAS cable to the drive expansion port on the DS3500 controller A. b. Connect the other end of the SAS cable to one of the In (↑) SAS connectors on the left ESM in the EXP3500 storage enclosure.
Connecting storage enclosures to the DS3500 The DS3500 supports the attachment of either the EXP3512 or EXP3524 storage enclosure. The DS3500 supports a total of 192 drives (with controller firmware 7.77.xx.xx and later) or 96 drives (with controller firmware 7.75.xx.xx and earlier), with the purchase of an optional Storage Partition Premium Feature upgrade.
3. Follow the cabling diagram for your chosen topology. 4. If required, set unique enclosure IDs for all storage enclosures that are cabled to the DS3500. See the DS Storage Manager 10 Installation and Host Support Guide for information about setting the enclosure...
The DS3500 storage subsystem locates the drives in the storage enclosures after you power-on the configuration. Always turn on the storage enclosures first and then turn on the DS3500. After you have powered-on the configuration, use the Storage Manager software to check the status of the new drives, correct any errors, and configure the new drives.
One dual-controller DS3500 and one storage enclosure: To cable one dual-controller DS3500 to one storage enclosure, connect them as shown in Figure 3-25. Figure 3-25. One dual-controller DS3500 and one storage enclosure One dual-controller DS3500 and two storage enclosures: To cable one dual-controller DS3500 and two storage enclosures, connect them as shown in Figure 3-26.
ESM, see the Installation Guide that comes with the storage enclosure. To add a storage enclosure to a dual-controller DS3500 storage subsystem that is running, complete the following steps: 1. Make sure that the DS3500 storage subsystem status is Optimal in the Storage Manager software.
6. Connect the other end of the SAS cable to either of the In ports on the left ESM in the storage enclosure. 7. Connect one end of a second SAS cable to the Drive expansion port on Controller B in the DS3500 storage subsystem.
3-27). Important: 1. To minimize security risks, do not connect the DS3500 to a public LAN or public subnet. Use a local private network for the DS3500 and the storage management station Ethernet connectors. 2. For proper EMI shielding, always use quality braided and shielded serial cables.
Storage Manager 10 Installation and Host Support Guide for the operating system of the host server that you will use to manage the DS3500 storage subsystem. The document is in the Documentation folder on the IBM System Storage DS3500 Support DVD.
Figure 3-30 on page 3-28 shows the direct (out-of-band) management method. Note: Do not connect the DS3500 storage subsystem Ethernet ports to a public network or public subnet. To minimize security risks, create a private network between the DS3500 storage subsystem and the management station.
For a Fibre Channel attached host, attach a fibre channel cable to each HBA. Continue with “Connecting Fibre Channel hosts to the DS3500” on page 3-34 to connect the other end of each cable to the controller. For an iSCSI attached host, attach an Ethernet cable to each host. Continue with “Connecting iSCSI hosts to the DS3500”...
Page 73
Redundant host connections provide path failover but limit the number of redundant host connections to one. 2. The DS3500 ships with four storage partitions by default. For additional storage partitions, purchase an optional Storage Partition Premium Feature upgrade. Contact your IBM reseller or marketing representative for more information.
Figure 3-32. Single-controller direct-attached SAS connection to dual HBAs in a single-host (redundant host connection) The following illustration shows a direct-attached SAS connection to single HBAs in multiple hosts. 3-30 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
DS3500 Figure 3-33. Single-controller direct-attached SAS connection to single HBAs in multiple hosts Direct-attached dual-controller connections: The following illustration shows a direct-attached SAS connection from each controller to a single HBA in the same host (redundant host connection).
The illustration Figure 3-36 shows the connections from the host server to the dual-controller or single-controller DS3500 using one SAS switch. This figure also illustrates the use of the SAS switch to allow the host server connected to multiple DS3500s.
SAS switch SAS switch DS3500 with Dual- controller Figure 3-37. Dual-controller DS3500 SAS connection to multiple hosts using two separate SAS switches Host system Host system with two SAS with two SAS host adapter host adapter...
Dual- controller controller Figure 3-39. Dual-controller DS3500 SAS connection to multiple hosts using two SAS switches that are connected together via an interlink switch Connecting Fibre Channel hosts to the DS3500 Using Fibre Channel switches, up to 64 hosts can be redundantly attached to the DS3500 storage subsystem in a Fibre Channel storage area network (SAN) fabric.
The following illustration shows a direct-attached connection to a single host HBA. Host system with single host adapter DS3500 Figure 3-41. Single-controller direct-attached Fibre Channel connection to a single host HBA The following illustration shows a direct-attached connection to dual HBAs in a single host (redundant host connection).
Figure 3-43. Single-controller direct-attached Fibre Channel connection to single HBAs in multiple hosts Direct-attached dual-controller connections: The following illustration shows a direct-attached connection from each controller to a single HBA in the same host (redundant host connection). 3-36 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Host system with dual host adapters DS3500 Figure 3-44. Dual-controller direct-attached Fibre Channel connection to two HBAs in the same host (redundant host connection) The following illustration shows multiple redundant direct-attached host connections. Host system Host system with dual host...
Page 82
In Figure 3-47 on page 3-39, the Fibre Channel switches are not connected together through an ISL. Each switch forms its own SAN fabric. This configuration is also the configuration to use for a dual-node cluster configuration. 3-38 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Connecting iSCSI hosts to the DS3500 The DS3500 can support up to 64 hosts, depending on the number of host ports and host partitions that are used on the controller. To protect against the loss of any one path from the host servers to the storage subsystem, use redundant host connections.
Page 84
Note: These cables must be customer-supplied and are not available for ordering with the DS3500. IBM recommends the use of Category 6A or Category 7 cables to obtain the highest signal quality and reliability when operating at 10 Gbps, because these cables are designed to support 10 Gbps and minimize alien crosstalk.
Page 85
Ethernet switch DS3500 Figure 3-50. Multiple-port, single-controller iSCSI configuration The following illustration is an example of multiple single-port host systems that are connected to a single-controller DS3500 using multiple connections. 3-41 Chapter 3. Cabling the storage subsystem and storage enclosure...
3-43 with one large gigabit Ethernet switch that has the required number of ports. Virtual local area network (VLAN) can also be used to isolate the two iSCSI networks, instead of a single switch. 3-42 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
1 Gigabit/10 Gigabit 1 Gigabit/10 Gigabit Ethernet switch Ethernet switch DS3500 DS3500 Figure 3-53. Multiple-host, multiple-port, multiple-storage-subsystem iSCSI configuration Dual-controller iSCSI configurations: The following illustration is an example of a multiple port, single-host configuration. A system that uses multiple iSCSI ports can provide enhanced performance compared to a single-port iSCSI connection.
Overview of installing an IBM BladeCenter configuration to connect to a DS3500 This section gives an overview and guidelines for installing an IBM BladeCenter configuration to connect to a DS3500. 3-44 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
The dual-controller DS3500 comes with two SAS host connectors on each controller, enabling up to 28 blade servers in one BladeCenter unit to be redundantly connected to the storage subsystem. To protect against the loss of any one path from the host blade servers to the DS3500, use redundant host connections.
Cabling the DS3500 and EXP3500 ac power supplies To connect the DS3500 and EXP3500 ac power-supply cords, complete the following steps: 1. Connect a power cord to a power supply in the DS3500 or EXP3500. 2. Attach the power cord to the strain relief guide.
See the specifications in the product documentation for the required torque values for the wiring-terminal nuts. To connect the DS3500 and EXP3500 dc power-supply cables, complete the following steps: 1. Make sure that the power on-off switch on both of the dc power supply and fan units in the chassis are in the off position.
Pin 3: GND Green/yellow 4. Connect the - 48V wire (brown) of the dc power cable to an approved disconnect device (circuit breaker) rated at 20 A. The disconnect device must be easily accessible from the back of the DS3500 unit. Attention: v The disconnect device (circuit breaker) must be rated at 20 A.
Page 93
Table 3-4. DC power source wiring descriptions (continued) Number Description DC power source Disconnect device 3-49 Chapter 3. Cabling the storage subsystem and storage enclosure...
Page 94
3-50 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Attention: Save these event-log files to a server disk that will remain accessible in the event of a DS3500 storage configuration failure. Do not save these event log files only to a LUN in the DS3500 storage subsystem.
Maintain an up-to-date storage subsystem profile for the storage configuration. Save the profile to a server disk that will remain accessible in case of a DS3500 storage configuration failure. Do not save the profile only to a LUN in the storage subsystem.
4. If you have enclosures with dc power supplies, turn on the disconnect device that you installed on the -48V line in “Cabling the DS3500 and EXP3500 dc power supplies” on page 3-47. 5. Turn on both power switches on the rear of each storage enclosure that is attached to the storage subsystem.
Storage Manager software. The document is in the Documentation folder on the IBM System Storage DS3500 Support DVD. Use that document and the online help to configure the logical drives, partitions, and so on for the controllers. Follow the instructions in the operating-system documentation to make the new logical drives accessible to the operating system.
Important: See the DS Storage Manager 10 Installation and Host Support Guide for the applicable operating system for instructions for installing the Storage Manager software. The document is in the Documentation folder on the IBM System Storage DS3500 Support DVD. To download the latest version of the Storage Manager software, controller firmware, NVSRAM firmware, and the latest ESM firmware, go to http://www.ibm.com/servers/storage/support/disk/.
Attention: Save the storage subsystem profile before you perform any controller or ESM firmware upgrades. Save the profile and all configuration (.cfg) files to a server disk that will remain accessible in the event of a DS3500 storage configuration failure. Do not save these files only to a LUN in the storage subsystem.
LEDs indicate a possible failure; a blue LED on a component indicates that it is safe to remove the component. The DS3500 also has a blue system locator LED that is lit when the menu function is selected in the Subsystem Management window, causing the Locate command to be sent to the DS3500.
Standby power LED (green) Future use only. DC Out LED (green) When this green LED is lit, it indicates that the DS3500 is turned on and is supplying both 5-volt and 12-volt dc power. OK to remove LED (blue) When this blue LED is lit, it indicates that it is safe to remove the power supply.
Power-on LED System locator LED Overtemperature LED System error LED Standby power LED Hard disk Hard disk drive status drive activity LED (amber) LED (green) Figure 4-6. DS3524 storage subsystem and EXP3524 storage enclosure front LEDs Power-on LED (green) LED is lit, it indicates that the power supply is turned on and is supplying both 5-volt and 12-volt dc power.
OK to remove LED (blue) When this LED is lit, it indicates that it is safe to remove the controller from the DS3500; no activity is taking place, and no data remains in the memory cache. The normal condition of this LED is off.
If the optional Fibre Channel host port adapter is installed in the controller, the host port adapter contains four additional Fibre Channel host connectors with LEDs. Figure 4-9. Fibre Channel host port adapter LEDs Fibre Channel speed LEDs 2 Gbps and 4 Gbps These LEDs in combination indicate the speed of the Fibre Channel host port.
Attention LED is on. The definitions for Lx diagnostic codes are listed in Table 4-2. Table 4-2. Controller numeric display diagnostic codes Value Description Mismatched controller board ID. Missing interconnect canister. Persistent memory errors. 4-12 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
When this green LED is lit, it indicates that the ESM is receiving power. Turning off the storage subsystem The DS3500 is designed to run continuously. After you turn it on, do not turn it off. Turn off the power only in the following situations: v Instructions in a hardware or software procedure require that you turn off the power.
Page 109
Attention: Turning off and turning on power without waiting for the storage subsystem disk drives to spin down can damage the drives and might cause data loss. Always wait at least 70 seconds after you turn off the power before you turn on the power again. Power-off overview Review the following information before you continue with the power-off procedure: Turn off the power to each device according to the following shutdown sequence:...
Page 110
When the recovery procedure is completed, click Recheck in the Recovery Guru. This action runs the Recovery Guru again to make sure that the problem is corrected. d. If the problem has not been corrected, contact your IBM technical-support representative. Do not turn off power until all problems are corrected.
Is there evidence of damage to any of the storage subsystem components, cables, or equipment that is attached to the storage subsystem? v Yes: Do not continue with this procedure. Contact your IBM technical-support representative for assistance. Depending on the current service agreements, you might have to return the equipment to the factory or local service center for repair.
6. Turn on both of the power-supply switches on the DS3500. The green LEDs on the front and the rear of the DS3500 should remain lit. If other amber LEDs are lit, see Chapter 6, “Solving problems,” on page 6-1.
Page 113
No: Go to step 6. 6. Turn off both power switches on the DS3500 (see Figure 4-1 on page 4-3) and then power-off all connected storage enclosures. Wait 1 minute and then turn on power to all connected storage enclosures.
Cache memory and cache battery Each storage controller in the DS3500 storage subsystem contains 1 GB or 2 GB of cache memory to store read and write operations. In a dual controller configuration, both controllers in the DS3500 must have the same amount of cache memory.
when the Battery fault LEDs indicate that only one battery unit has failed. Each controller has a green Battery charging LED that indicates the status of the battery unit. v The LED is on when the battery is fully charged v The LED flashes when the battery is charging or performing a self-test v The LED is off when the battery or the battery charger has failed or is missing Cache battery learn cycle...
Page 116
4-22 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
5-5. Attention: Handle and install cables correctly to avoid degraded performance or loss of communication with devices. See “Cabling the DS3500 storage subsystem” on page 3-1 for more information. 3. Disconnect all attached interface cables from the controller. Be sure to label each cable so that you can reconnect it correctly.
NVSRAM” in the DS Storage Manager 10 Installation and Host Support Guide for information about how to download the NVSRAM firmware. Note: Obtain the latest dual-controller NVSRAM firmware from http://www.ibm.com/servers/ storage/support/disk/. 3. Start the command-line interface; then, enter the following command to change controller A from simplex (single-controller) mode to duplex (dual-controller) mode: Smcli ctlr_A_IP_address -c "set storageSubsystem redundancyMode=duplex;"...
Figure 5-3. Installing a controller 10. Wait up to 5 minutes for the Storage Manager software to recognize the new controller. 11. Connect the host interface cables to the controller. See “Cabling the DS3500 storage subsystem” on page 3-1 for more information.
Obtain the following information about your storage subsystem and components: v Determine whether you have a single-controller storage subsystem or a dual-controller storage subsystem. For details, see “DS3500 storage subsystem overview” on page 1-2. See Figure 1-7 on page 1-11 for an illustration of a single-controller storage subsystem.
LEDs. Attention: Handle and install cables correctly to avoid degraded performance or loss of communication with devices. See “Cabling the DS3500 storage subsystem” on page 3-1 for more information.
10. Remove the cover (see “Removing and installing a cover” on page 5-2). 11. Remove the battery from the failed controller. Battery connector Memory cache battery Captive fastener Figure 5-5. Removing the battery unit from the controller a. Loosen the blue captive fastener till you can move the battery in the direction that is indicated by the arrow.
(Needs Attention) status? v Yes: Click Recovery Guru in the Subsystem Management window toolbar, and complete the recovery procedure. If the problem remains, contact your IBM technical-support representative. v No: Go to step 24. 24. Use the Storage Manager software to print a new storage subsystem profile.
For information on disposal of batteries outside the United States, see http://www.ibm.com/ ibm/environment/products/batteryrecycle.shtml or contact your local waste disposal facility. In the United States, IBM has established a return process for reuse, recycling, or proper disposal of used batteries. For information on proper disposal of these batteries, contact IBM at 1-800-426-4333.
Flip the top edge of the cover plate outward to release the alignment tab and remove the cover plate from the controller. Host port adapter filler panel Screws Alignment tab Figure 5-7. Removing the host port adapter filler panel 5-10 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
8. Touch the static-protective package that contains the host port adapter to any unpainted metal surface on the storage subsystem; then, remove the adapter from the package. 9. If you are replacing a failed host port adapter, skip to the next step. Otherwise, install the host port cover that comes with the optional host port adapter.
- Up to 24 SFF 2.5–inch 6 Gbps SAS, NL SAS, or SSD drives (DS3524 and EXP3524) – For optimum performance, never insert a drive into the storage subsystem without first confirming the drive firmware level. Contact your IBM technical-support representative for information about supported drive firmware levels.
Hard disk drive activity LED Hard disk drive status LED Figure 5-9. DS3512 storage subsystem and EXP3512 storage enclosure drive LEDs Hard disk Hard disk drive status drive activity LED (amber) LED (green) Figure 5-10. DS3524 storage subsystem and EXP3524 storage enclosure drive LEDs Drive activity LED (green) When this LED flashes, it indicates that there is activity to the drive.
Push up the latch on the handle, then open the drive handle and pull the drive assembly out of the server. 5-14 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
b. Pull the drive approximately 12 mm (0.5 in.) out of the bay and wait 70 seconds to allow the drive to spin down and the storage subsystem controller to recognize that a drive is removed from the configuration. 5. Make sure that there is proper identification (such as a label) on the drive; then, slide the drive completely out of the bay.
There are two methods for upgrading drives: v Replacing all the drives at the same time This method requires that you back up the data on the affected drives and then turn off the DS3500 storage subsystem. Attention: Turn off the DS3500 storage subsystem before you turn off the attached storage enclosures.
Compare the kit instructions with this procedure to determine whether you must modify this procedure. 2. Use the Storage Manager software to check the status of the DS3500. Correct any problems that are reported. 3. Perform a complete backup of the drives that you are replacing.
c. Make sure that the green cache active LEDs are off. See “Controller LEDs” on page 4-9 for the location of the cache active LEDs. d. If applicable, use the operating-system software to disconnect the storage subsystem logical drives from the host before you power-off the storage subsystem. Attention: To turn off all power to the storage subsystem, you must turn off both power-supply switches and disconnect both power cords.
Page 136
“Installing a hard disk drive” on page 5-15 to install the new drives in the storage subsystem. The new drive automatically reconstructs the data after you install it in the drive bay. 5-20 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
During data reconstruction, the amber drive fault LED might be lit for a few minutes and then turn off when the green drive activity LED begins flashing. A flashing drive activity LED indicates that data reconstruction is in progress. Note: If the storage subsystem has active hot spares, data might not start copying to the new drive until the data is reconstructed on the hot spare.
Page 138
Do not run the storage subsystem without adequate ventilation and cooling, because it might cause damage to the internal components and circuitry. To replace a power supply, complete the following steps. 5-22 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 139
Attention: To prevent damage to the storage subsystem components from overheating, replace a failed power supply within 10 minutes of removal. If replacing it will take longer than 10 minutes, stop all I/O activity to the storage subsystem and turn off the power until you complete the replacement. Do not remove the failed power supply from the storage enclosure until you: v Review the replacement procedure in this section.
Page 140
Turn on the devices. (D005a) 9. Turn off the power switch and disconnect the power cord from the failed power supply. 10. Remove the power supply from the bay 5-24 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Go to step 18. v The fault and ac power LEDs are lit but the dc power LED is off: The power supply is faulty. Turn off the power switch and contact your IBM technical-support representative for a replacement power supply.
21. Are any amber LEDs lit on any of the components? v Yes : Click Recovery Guru in the Subsystem Management window toolbar and complete the recovery procedure. If a problem is still indicated, contact your IBM technical-support representative. v No: Go to step 22.
Page 143
CAUTION: To reduce the risk of electric shock or energy hazards: v This equipment must be installed by trained service personnel in a restricted-access location, as defined by the NEC and IEC 60950-1, First Edition, The Standard for Safety of Information Technology Equipment.
Page 144
7. Make sure that the OK to remove LED is lit. Do not remove the power supply if the LED is off. For more information about the OK to remove LED, see “OK to remove LED” on page 5-1. 5-28 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 145
DANGER When working on or around the system, observe the following precautions: Electrical voltage and current from power, telephone, and communication cables are hazardous. To avoid a shock hazard: v Connect power to this unit only with the provided power cord. Do not use the provided power cord for any other product.
Go to step 18. v The fault and dc power in LEDs are lit but the dc power out LED is off: The power supply is faulty. Turn off the power switch and contact your IBM technical-support representative for a replacement power supply.
3. Locate the controller that contains the failed battery unit (see “Controller LEDs” on page 4-9). Attention: Before you remove a controller in a single-controller DS3500, shut down the DS3500 to avoid data loss (see “Turning off the storage subsystem” on page 4-14).
Slide the battery unit out of the controller in the direction that is indicated by the arrow. c. Dispose of the battery as required by local ordinances or regulations. For more information, see the IBM Systems Environmental Notices and User's Guide on the IBM Support DVD. 5-32...
DANGER Electrical voltage and current from power cables are hazardous. To avoid a shock hazard, always place electrical equipment on dry, static-free level surfaces. Never turn on any electrical equipment when there is evidence of fire, water, or structural damage. 8.
Place the controller on a dry, static-free level surface. 3. Remove the cover (see “Removing and installing a cover” on page 5-2). 4. Remove the DIMM from the connector. 5-34 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Figure 5-21. Removing the DIMM from the controller a. Open the retaining clip on each end of the DIMM connector. b. Lift the DIMM out of the connector. 5. If the DIMM is functional, place the DIMM in a static-protective package until you are ready to install Installing the DIMM Complete the following steps to install the DIMM in the controller: 1.
Review the replacement procedure for the failed part in this guide. v Locate screw drivers or any other hand tools that you might need to replace the failed part. 5-36 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
v Receive the replacement part and are ready to install it in the enclosure. Installing an additional ESM The storage enclosure comes with one environmental services module (ESM). If your controller supports redundant drive paths (see the documentation that comes with the controller or the device that contains the controller), you can install a second ESM.
9. Connect the cable to the ESM. 10. Turn on the power. For more information, see “Turning on the storage subsystem” on page 4-2. 11. Go to http://www.ibm.com/servers/storage/support/ to check for ESM code updates. For more information, see the download instructions on page 1.
Captive screws Midplane assembly Figure 5-25. Replacing the midplane assembly in a DS3512 or EXP3512 a. Loosen the four captive screws at the rear of the chassis. b. Remove the failed midplane from the chassis and insert the replacement midplane. c.
Page 156
14. Check the LEDs to make sure that the storage subsystem or storage enclosure is fully operational (see “Checking the LEDs” on page 4-7). 5-40 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Solving problems in the DS3500 storage subsystem For instructions for obtaining service and technical assistance for the storage subsystem and other IBM products, see Appendix B, “Getting help and technical assistance,” on page B-1. Use the LEDs, the diagnostics and test information, the symptom-to-FRU index, and the connected server Hardware Maintenance Manual or Problem Determination and Service Guide to diagnose problems.
Page 158
LEDs to be lit. (Drive PFA exceeded or nominal temperature exceeded errors are examples.) Follow the corrective actions in the Recovery Guru window. System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 159
Check for and solve one of the following situations: All amber and green All drives v storage enclosures are not correctly connected to the DS3500. LEDs are slowly v DS3500 does not have the correct firmware version. (activity and fault...
Page 160
DS3500 storage DS3500 storage subsystem are made. subsystem have failed. v Make sure that all the storage enclosures in the same channel pair have the same enclosure speed setting. System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 161
ESM or “Replacing components,” on page 5-1 for controller. more information. Incorrect firmware Make sure that the DS3500 has the correct version firmware version. See “Software and hardware compatibility and upgrades” on page 1-14. In a dual-controller Replace the failed controller and ESM.
2. Replace the SAS cable. failure 3. If the LED is still lit, replace either the ESM or the controller or device into which the other end of the SAS cable is connected. System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 163
Front panel Power supply Make sure that the cables are connected and the power supplies are turned on. Hardware failure If any other LEDs are lit, contact your IBM technical-support representative. Some or all Intermittent or Defective ac or dc 1.
Page 164
System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Tier 1 CRU at your request, you will be charged for the installation. v Tier 2 customer replaceable unit: You may install a Tier 2 CRU yourself or request IBM to install it, at no additional charge, under the type of warranty service that is designated for your server.
81Y9878 2U rail kit 39R6550 DS3512 and EXP3512 midplane 69Y0249 Controller or environmental service module filler panel 69Y0194 Power supply, ac 69Y0201 6 GB SAS 2–port host port adapter 69Y2840 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
DS3524 storage subsystem and EXP3524 storage enclosure parts listing Figure 7-2 on page 7-4 and the following table provide a parts listing for the DS3524 storage subsystem and EXP3524 storage enclosure. Chapter 7. Parts listing, DS3500 storage subsystem and EXP3500 storage enclosure...
8 GB shortwave SFP transceiver 49Y4123 Power cords For your safety, IBM provides a power cord with a grounded attachment plug to use with this IBM product. To avoid electrical shock, always use the power cord and plug with a properly grounded receptacle.
Table 7-3. IBM power cords (continued) IBM power cord part number Used in these countries and regions 39M5123 Afghanistan, Albania, Algeria, Andorra, Angola, Armenia, Austria, Azerbaijan, Belarus, Belgium, Benin, Bosnia and Herzegovina, Bulgaria, Burkina Faso, Burundi, Cambodia, Cameroon, Cape Verde, Central African Republic, Chad, Comoros,...
Hard disk drive locations Use Table A-2 to keep a record of the drives that are installed in or attached to the DS3500 or EXP3500. This information can be helpful when you install additional drives or if you have to report a hardware problem.
Table A-3. Storage subsystem and controller information record Storage subsystem Management method Controller Ethernet and IP addresses, and Host IP address and name host name host name Controller A Controller B System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Table A-3. Storage subsystem and controller information record (continued) Storage subsystem Management method Controller Ethernet and IP addresses, and Host IP address and name host name host name Controller A Controller B Table A-4 shows a sample information record. This network contains storage subsystems that are managed by using both the direct-management and host-agent-management method.
Page 174
System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
IBM to assist you. Use this information to obtain additional information about IBM and IBM products, determine what to do if you experience a problem with your IBM system or optional device, and determine whom to call for service, if it is necessary.
To locate a reseller authorized by IBM to provide warranty service, go to http://www.ibm.com/ partnerworld/ and click Find Business Partners on the right side of the page. For IBM support telephone numbers, see http://www.ibm.com/planetwide/ . In the U.S. and Canada, call 1-800-IBM-SERV (1-800-426-7378).
IBM Taiwan product service Use this information to contact IBM Taiwan product service. IBM Taiwan product service contact information: v IBM Taiwan Corporation v 3F, No 7, Song Ren Rd. v Taipei, Taiwan v Telephone: 0800-016-888 Appendix B. Getting help and technical assistance...
Page 178
System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
, including but not limited to the implied warranties of merchantability and fitness for a particular purpose. These products are offered and warranted solely by third parties. IBM makes no representations or warranties with respect to non-IBM products. Support (if any) for the non-IBM products is provided by the third party, not IBM.
If IBM determines that the levels of particulates or gases in your environment have caused damage to the device, IBM may condition provision of repair or replacement of devices or parts on implementation of appropriate remedial measures to mitigate such environmental contamination.
When you send information to IBM, you grant IBM a nonexclusive right to use or distribute the information in any way it believes appropriate without incurring any obligation to you. Electronic emission notices Federal Communications Commission (FCC) statement Note: This equipment has been tested and found to comply with the limits for a Class A digital device, pursuant to Part 15 of the FCC Rules.
Um dieses sicherzustellen, sind die Geräte wie in den Handbüchern beschrieben zu installieren und zu betreiben. Des Weiteren dürfen auch nur von der IBM empfohlene Kabel angeschlossen werden. IBM übernimmt keine Verantwortung für die Einhaltung der Schutzanforderungen, wenn das Produkt ohne Zustimmung der IBM verändert bzw.
Japan Electronics and Information Technology Industries Association (JEITA) Confirmed Harmonics Guidelines with Modifications (products greater than 20 A per phase) Korean Communications Commission (KCC) Class A Statement Russia Electromagnetic Interference (EMI) Class A statement System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
People's Republic of China Class A electronic emission statement Taiwan Class A compliance statement Notices...
Page 186
System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 187
DS3500 storage subsystem replacing 4-20, 5-31 replacing 5-5 Solving problems 6-1 bays, drive 1-8, 4-8, 5-12 sample information record A-2 DS3500 storage subsystem overview 1-2 best practices 1-7 controllers, dual DS3512 storage subsystem parts bezels host port adapter 1-11 listing 7-1...
Page 188
5-21 drive bays 1-8, 4-8, 5-12 DC power supply 4-8 specifications 1-4 drive LEDs described 5-12 diagnostic 4-12 hardware 5-12 drive 5-12 power supplies 5-1, 5-21, 5-26 during power-on 4-7 System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 189
4-6 fault LED 4-7, 4-8 site preparation 2-4 Troubleshooting OK to remove LED 4-7, 4-8 size 1-4 DS3500 storage subsystem 6-1 power connector 4-2 small-form-factor pluggable (SFP) module turning off power power switch 4-2 connecting an LC-LC Fibre Channel...
Page 190
System Storage DS3500 and EXP3500: Installation, User's, and Maintenance Guide...
Page 192
Part Number: 90Y8716 Printed in USA GA32-0952-01...
Page 193
Click below to find more Mipaper at www.lcis.com.tw Mipaper at www.lcis.com.tw...