Front and Rear IO LEDs..............................7 IOM LEDs..................................... 9 IOM Fan LED..................................9 PSU LED..................................... 10 Rear Fan LED..................................11 Drive Assembly LED................................12 Ultrastar Data60 Rack Requirements............................13 Compatible Rack Hardware Configuration........................14 Power Requirements................................16 ESD......................................17 Enclosure Cooling..................................17 Host Connectivity..................................17 Supported SKUs..................................
Page 3
User Guide Table of Contents Chassis Specifications..............................39 Chassis Layout.................................. 40 IOM Description..................................41 IOM Specifications................................41 IOM Layout..................................42 IOM Blank Description..............................42 PSU Description..................................43 PSU Specifications................................43 PSU Layout..................................44 Rear Fan Description................................44 Rear Fan Specifications..............................45 Rear Fan Layout................................45 IOM Fan Description................................
Page 4
User Guide Table of Contents Drive Assembly Replacement..............................71 CMA Replacement................................... 76 Rails Replacement..................................93 Chassis Replacement................................122 Special Considerations for Cable Routing........................... 157 Cabling for CMA..................................159 Before You Begin................................159 Cabling CMA................................... 160 Chapter 5. System Management..............................162 Firmware Upgrade..................................163 Downloading Firmware from the Support Portal......................163 Linux Upgrade Preparation.............................165 Linux Upgrade to New Firmware...........................167 Non-Automatic Firmware Activation in Linux........................169...
Page 5
User Guide Table of Contents One Host Cable Configurations.............................212 Two Host Cable Configurations.............................217 Cabling for Daisy Chaining............................222 Chapter 6. Safety..................................229 Electrostatic Discharge................................. 230 Optimizing Location................................230 Power Connections................................230 Power Cords..................................230 Rackmountable Systems................................ 231 Safety and Service..................................231 Safety Warnings and Cautions.............................
April 2018 Revision 1.4 • Updated Compatible Drives List. See List of Compatible Drives (page 19). • Updated the Rack Requirements. See Ultrastar Data60 Rack Requirements (page 13). • Updated the Firmware Upgrades. See: Firmware Upgrade (page 163) May 2018 Revision 1.5...
Page 7
Updated the Host Connectivity section. See: Host Connectivity (page 17) July 2019 Revision 1.12 Moved the following topics to the Overview (page 1) section: • Ultrastar Data60 Rack Requirements (page 13) • Power Requirements (page 16) • ESD (page 17)
Page 8
LEDs (page 7) section. Updated servicing image to correct length values and rail servicing extension in Ultrastar Data60 Rack Requirements (page 13) section. Added a note about OOBM ports configured for DHCP by default to the OOBM Management Overview (page 36) section.
5601 Great Oaks Parkway San Jose, CA 95119 Long Live Data™ is a trademark of Western Digital, Inc. and its affiliates in the United States and/or other countries. Western Digital trademarks are authorized for use in countries and jurisdictions in which Western Digital has the right to use, market and advertise the brands.
Points of Contact Points of Contact For further assistance with a Western Digital product, contact Western Digital Datacenter Platforms technical support. Please be prepared to provide the following information: part number (P/N), serial number (S/N), product name and/or model number, and a brief description of the issue.
60 SAS or SATA drives. The maximum data storage capacity of the Ultrastar Data60 is 840 TB using 14TB Ultrastar® HC530 drives . (For a full list of compatible drives and total storage capacities, see the hg (page 19).) The enclosure runs on an input voltage of 200 - 240 VAC and...
The devices connected on the I C buses include the enclosure VPDs, temp sensors, baseboard FPGAs, and SAS connectors among others. 1.3 System Level Block Diagram The following image shows the system block diagram for the Ultrastar Data60. Figure 3: System Block Diagram...
Page 14
Caution: The Ultrastar Data60 can only be plugged into highline. If the unit is plugged into lowline, the PSU will report a "Critical" state when status pages are queried using SES. In this case, the enclosure will power up, but the drives will not.
12Gbps SAS / 6Gbps SATA Max Raw Data Storage Capacity 840 TB using 14TB Ultrastar® HC530 drives SAS Ports 12 x Mini-SAS HD ( 6 per IOM) 2 x 10/100/1G Ethernet 1.5 Ultrastar Data60 Layout Figure 4: Front and Rear Product Layout...
Chassis Cover Rear Cover Alignment Brackets Rails The following is an image of the layout of the major system components inside the Ultrastar Data60. Figure 5: Component Layout 1.6 List of Customer Replaceable Units (CRUs) The following table lists the replaceable components and their part numbers.
1.7.1 Front and Rear IO LEDs The Ultrastar Data60 has a number of LEDs on the exterior of the enclosure that display various system statuses. There are three on the front and three on the rear that mirror each other and provide general status.
Page 18
1. Overview User Guide 1.7 LEDs Table 7: Front LED Identification Number LED Name Color Behavior Blink @ 1 Hz (50% duty cycle) – Blinks only Identify Blue when Identification has been activated. Will blink when any component is identified. Blink @ 1 Hz (50% duty cycle) –...
1. Overview User Guide 1.7 LEDs Number LED Name Color Behavior Blink @ 1 Hz (50% duty cycle) – Blinks only 3 Identification Blue when Identification has been activated. Will blink when any component is identified. Blink @ 1 Hz (50% duty cycle) – Enclosure has a fault Off –...
1. Overview User Guide 1.7 LEDs 1.7.3 IOM Fan LED The IOM Fan has a single LED that has three distinct states, one each for a fault condition, identification, and power off. Figure 9: IOM Fan LED Table 10: IOM Fan LED Identification LED Name Color Behavior...
1. Overview User Guide 1.7 LEDs Figure 10: PSU LEDs Table 11: PSU LED Identification LED Name Color Behavior Solid – PSU is on and reporting no faults Green Blink @ 2Hz (50% duty cycle) – PSU in firmware update mode Off –...
1. Overview User Guide 1.7 LEDs Figure 11: Fan LED Table 12: Fan LED Identification LED Name Color Behavior Blink @ 1 Hz (50% duty cycle) – Fan is reporting faults Blink @ 2 Hz (50% duty cycle) – Fan is being identified Off –...
1.8 Ultrastar Data60 Rack Requirements The Ultrastar Data60 is designed to be installed into a rack that meets the EIA-310 standard at a minimum 900mm (35.43in.) usable rack space, frame to frame. The vertical rack rails must be set between 24 in. - 32 in.
The following section provides specific information necessary to install, service, and remove the Ultrastar Data60. The installation of the Ultrastar Data60 requires two people and a space of 1270mm / 50in. in front of the installation space. The servicing of the enclosure requires one person and a minimum of 863.6mm / 34in.
Page 25
1. Overview User Guide 1.8 Ultrastar Data60 Rack Requirements PDU Mounting Additional Mounting Parameter Rack PDU (Vertical) Bracket Bracket Hardware AS-160099-03 KIT-MBVPT-1B 412-0761-11_STV-4501 4 x M6 x 16 Hex (Drawing (one kit per PDU) Cap Screws 412-0761-20_STV-4502 Number EMCOR Part...
Nylon Lock Quantity 1 rack Varies 1.9 Power Requirements The following table describes the A/C input power specification for the Ultrastar Data60. Table 19: AC Power Specifications Power Alternating Current (AC) Power Supply (2 per enclosure) Wattage (per power supply) *...
1.12 Host Connectivity The Ultrastar Data60 can use passive cables that are limited to 3m or less, or active cables of any length for SAS connections to the host. Active cables must be used for Ultrastar Data60 to Ultrastar Data60 daisy...
Page 28
If you are connecting more than one host port per I/O, you must connect cables to every other port per IOM and do not need all six ports, Western Digital recommends connecting the cables to every other port as a best practice. The recommended connection order on IOM A ports A6, A4, and A2 for subsystems with three or fewer connected hosts.
12 Gbps link from the expander to the initiator in a more efficient manner. 1.13 Supported SKUs The following table lists the versions of this Western Digital product that are supported by this document. Table 21: List of Supported SKUs...
Page 30
1. Overview User Guide 1.14 List of Compatible Drives Table 22: HDD w/ 3.5 in drive carrier Drive Type Interface Sector Size Encryption Volume Part Number Western Digital® Ultrastar® DC SAS 12Gb/s 1EX1993 HC310 w/ 3.5 in. drive carrier Western Digital®...
Page 31
1. Overview User Guide 1.14 List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number w/ 3.5 in. drive carrier Western Digital® Ultrastar® DC SAS 12Gb/s 512e TCG-FIPS 1EX1853 HC310 w/ 3.5 in. drive carrier Western Digital® Ultrastar® DC SATA 6Gb/s 1EX1187 HC310...
Page 32
1. Overview User Guide 1.14 List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number Western Digital® Ultrastar® DC SATA 6Gb/s 1EX1225 HC320 w/ 3.5 in. drive carrier Western Digital® Ultrastar® DC SATA 6Gb/s 1EX1224 HC320 w/ 3.5 in. drive carrier Western Digital®...
Page 33
1. Overview User Guide 1.14 List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number Western Digital® Ultrastar® DC SATA 6Gb/s 10TB 1EX2439 HC330 w/ 3.5 in. drive carrier Western Digital® Ultrastar® DC SATA 6Gb/s 512e 10TB 1EX2440 HC330 w/ 3.5 in.
Page 34
1. Overview User Guide 1.14 List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number Western Digital® Ultrastar® DC SATA 6Gb/s 10TB 1EX0494 HC510 w/ 3.5 in. drive carrier Western Digital® Ultrastar® DC SATA 6Gb/s 10TB 1EX0496 HC510 w/ 3.5 in.
Page 35
1. Overview User Guide 1.14 List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number Western Digital® Ultrastar® DC SAS 12Gb/s 512e 12TB 1EX1009 HC520 w/ 3.5 in. drive carrier Western Digital® Ultrastar® DC SAS 12Gb/s 512e 12TB 1EX1008 HC520...
Page 36
1. Overview User Guide 1.14 List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number Western Digital® Ultrastar® DC SAS 12Gb/s TCG-FIPS 14TB 1EX1854 HC530 w/ 3.5 in. drive carrier Western Digital® Ultrastar® DC SAS 12Gb/s 512e 14TB 1EX1791 HC530...
Page 37
Ultrastar® SS200 SAS 12Gb/s RI-3DW/D TCG-FIPS 400GB 1EX1481 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS300 SAS 12Gb/s ME-10DW/D 400GB 1EX1287 w/ 3.5 in to 2.5 in drive carrier Western Digital® SSD SAS 12Gb/s ME-10DW/D 400GB 1EX1289...
Page 38
Part Drive Type Interface Drive Writes Encryption Volume Number Ultrastar® SS300 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS300 SAS 12Gb/s ME-10DW/D 400GB 1EX1312 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS300...
Page 39
1.14 List of Compatible Drives Part Drive Type Interface Drive Writes Encryption Volume Number w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS530 SAS 12Gb/s RI-1DW/D 480GB 1EX2031 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS530...
Page 40
Ultrastar® SS200 SAS 12Gb/s RI-3DW/D 1.6TB 1EX1313 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS300 SAS 12Gb/s RI-3DW/D 1.6TB 1EX1299 w/ 3.5 in to 2.5 in drive carrier Western Digital® SSD SAS 12Gb/s RI-3DW/D 1.6TB 1EX1300...
Page 41
Part Drive Type Interface Drive Writes Encryption Volume Number Ultrastar® SS300 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS300 SAS 12Gb/s RI-3DW/D 1.6TB 1EX1307 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS300...
Page 42
1.14 List of Compatible Drives Part Drive Type Interface Drive Writes Encryption Volume Number w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS530 SAS 12Gb/s RI-1DW/D 1.92TB 1EX2034 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS530...
Page 43
1. Overview User Guide 1.14 List of Compatible Drives Part Drive Type Interface Drive Writes Encryption Volume Number Western Digital® Ultrastar® SS530 SAS 12Gb/s RI-1DW/D 3.84TB 1EX2036 w/ 3.5 in to 2.5 in drive carrier Western Digital® Ultrastar® SS530 SAS 12Gb/s RI-1DW/D 3.84TB...
Management Overview This chapter provides an overview of the system management features available in the Ultrastar Data60 through the in-band SAS connections using SG3_utils software, and out-of-band using a REST interface over HTTPS to access Western Digital's implementation of the DMTF Redfish API.
SEP. The SEP operates in a dual IOM environment. To a host server, the SEP exists as a dual ported SAS device, one port on each IOM. The firmware on Ultrastar Data60 provides an Active/Active architecture for IOM redundancy. This allows each IOM to independently report the enclosure status information such as drive power, fan speed, and LED states.
8.10 2.3 OOBM Management Overview The Ultrastar Data60 uses an implementation of DMTF Redfish for out-of-band system management. All the SES enclosure information can be obtained through the out-of-band management port using RESTful API calls to the management port over HTTPS. The OOBM ports are configured for DHCP by default.
Page 47
2. System Management Overview User Guide 2.4 SCSI Enclosure Services Page 02 Note: Refer to the SES Firmware Management Interface Specification for more information on SES Page 02.
Western Digital Component Overviews This section is intended to give an overview of all of the major components contained within the Ultrastar Data60. Each section includes specifications, descriptions, and images that explain the features of each component. In This Chapter: - Chassis Description........
The chassis is the primary housing that contains and connects all of the system components that comprise the Ultrastar Data60. The chassis is comprised of the drive bay that contains all of the system data storage drives and a number of other bays that contain the major system components such as the PSUs and . Other system components are attached to the exterior of the chassis such as the rear fans and rails to provide system cooling andrackmounting capability.
3. Component Overviews User Guide 3.1 Chassis Description Specification Value Part Number 1EX0443 / 1EX0442 for single IOM chassis replacement Hot Swappable? Weight 20 kg / 44 lbs 3.1.2 Chassis Layout Figure 16: Layout Table 26: Exterior Components Number Feature IOM and IOM Fan Bay Drive Bay...
The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail. This can cause serious damage to the unit or serious bodily harm to those handling the unit.
3. Component Overviews User Guide 3.2 IOM Description 3.2.1 IOM Specifications Specification Value Connector Type x6 HD Mini-SAS (connected externally at the rear of the enclosure) Number per Enclosure Part Number 1EX0430 Hot Swappable? FRU or CRU? Weight 1.27 kg / 2.8 lbs 3.2.2 ...
The IOM Blank is a placeholder component that is used to fill the unused IOM slot. in versions of the Ultrastar Data60 that do not leverage redundant IOMs. The IOM Blank may only be installed into IOM slot B under all circumstances. When at the front of the enclosure, Slot B is the left-hand slot. It is necessary to have a blank installed in this unused slot in order to ensure the proper airflow dynamics that are within operational parameters designed for the enclosure, but has no functional component beyond this feature.
3. Component Overviews User Guide 3.3 PSU Description Specification Value Input Voltage 200 - 240 VAC Connector Type Number per Enclosure Part Number 1EX0434 Hot Swappable? FRU or CRU? Weight 1 kg / 2.2 lbs. 3.3.2 PSU Layout Figure 21: Layout Table 28: Exterior Components Number Feature...
Figure 22: Overview Image The Rear Fans are toolless fan modules that provide the primary system cooling for the Ultrastar Data60. They are attached to the rear of the chassis in the fan housing by a 6 pin connector and two latches, that also provides power and control signals to the modules.
3. Component Overviews User Guide 3.5 IOM Fan Description Figure 23: Layout Table 30: Exterior Components Number Feature Latch Releases Internal Power and IO Connector 3.5 IOM Fan Description...
3. Component Overviews User Guide 3.5 IOM Fan Description Figure 24: Overview Image The IOM Fan is designed to focus cooling on the enclosure's IOMs. It is installed in the central chassis bay and is accessed from the top of the enclosure underneath the lid. It is attached to the chassis toolless release mechanism that allows for easy replacement.
Figure 26: Overview Image The Ultrastar Data60 is installed into a rack using a toolless-attach rail system. The rails are a two-piece system with one rail that attaches directly to the chassis called the inner rail and the other that attaches to the rack.
The rear cover alignment brackets are designed to keep the top cover of the chassis in the rack while extending the Ultrastar Data60 out of the rack for servicing. The rear cover alignment brackets will attach to the rear vertical rack rails and rest on top of the toolless rail system.
The design of the Ultrastar Data60 CMA is a two-arm design that separates the connections to the two sides of the enclosure. The lower arm supports the cables that connect to the dual SAS ports and Ethernet on the right hand side of the unit as viewed from the rear, as well as the lower PSU power cord.
3. Component Overviews User Guide 3.8 Drive Assembly Description Figure 31: Overview Image The cable management assembly (CMA) comes with an optional CMA tray that is used to support cable loads greater than ten (five per arm). This tray is mounted at the bottom of the chassis using four M3 x 8mm T10 Torx screws (two per side).
3. Component Overviews User Guide 3.8 Drive Assembly Description 3.8.1 Drive Assembly Specifications Specification Value Number per Enclosure up to 60 drives Part Number See the List of Compatible Drives (page 19) to find the specific part number required. Hot Swappable? Weight .68 kg / 1.5 lbs.
Page 66
The 2.5" carrier assembly is used to adapt a 2.5" form factor data storage drive to the 3.5" drive slots in the Ultrastar Data60 drive bays. This allows the enclosure to accommodate high speed SSD drives as its primary data storage medium. The carrier operates by utilizing an innovative clamping mechanism. The 2.5"...
Page 67
3. Component Overviews User Guide 3.8 Drive Assembly Description Figure 35: Clamp Release (clamp shown in blue for visual clarity) Step 2 : Slide the clamp in the direction shown in the following image to loosen it from the drive. Be sure not to slide too far as this will allow the clamp to fall from the carrier body and it will have to be reinstalled.
The drive blank is a placeholder component that is used to fill empty drive slots in the chassis when a Ultrastar Data60 enclosure is partially populated with drives. The purpose of the drive blank is to maintain proper airflow and cooling of the enclosure and the components within the enclosure. For more...
Western Digital Part Replacement In This Chapter: - Part Replacement Service Window.... 61 - IOM Replacement..........61 - PSU Replacement......... 64 - Rear Fan Replacement......... 67 - IOM Fan Replacement........70 - Drive Assembly Replacement...... 71 - CMA Replacement........76 - Rails Replacement........93 - Chassis Replacement.........
4. Part Replacement User Guide 4.1 Part Replacement Service Window 4.1 Part Replacement Service Window The following table contains a time required and a replacement window related to each hot swappable replacement part within the enclosure. The time required for replacement is the expected amount of time it requires to replace the part.
Page 72
4. Part Replacement User Guide 4.2 IOM Replacement Figure 39: Chassis Handle Operation Step 2 : Locate the faulty IOM by the amber LED that will be lit on top if there is a fault or by activating the identify LED on the IOM being replaced. Step 3 : Uninstall the IOM(s).
Page 73
4. Part Replacement User Guide 4.2 IOM Replacement Step 5 : Install the IOM. Caution: If a pin on the IOM’s internal connectors is bent or damaged, the IOM will have to be replaced. For this reason it is imperative that the IOM is not forced into position, that it is inserted straight, and that the directions for installing the IOM are followed exactly.
4. Part Replacement User Guide 4.3 PSU Replacement f. Once the IOM is seated properly in the slot, close the handles until they latch closed. Step 6 : Push the chassis back into the rack. Verify that the fans have slowed to their regular RPM. This ensures that the enclosure is back to its proper cooling settings.
Page 75
4. Part Replacement User Guide 4.3 PSU Replacement Figure 45: CMA(s) in service position (Cables not shown) Step 2 : Locate the faulty PSU by finding the amber LED lit at the rear of the enclosure. Step 3 : Detach the retention clip from the PSU cable. Figure 46: Cable Retention Mechanism Step 4 : Remove the power cable from the faulty PSU.
Page 76
4. Part Replacement User Guide 4.3 PSU Replacement Figure 47: Uninstalling PSU b. Pull the PSU straight out with even pressure. Step 6 : Remove the new PSU from its packaging. Step 7 : Install the PSU. a. Align the PSU in the orientation shown in the following image. b.
4. Part Replacement User Guide 4.4 Rear Fan Replacement Figure 49: Cable Retention Mechanism e. Slide the retention clip forward until it stops near the cable connector. Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason.
Page 78
4. Part Replacement User Guide 4.4 Rear Fan Replacement Table 39: Replacement Procedure Info Required Tools # of People Required Time Required Replacement Window None 5 Minutes Step 1 : Place the CMA(s) into service position. a. Unlatch the CMA(s) from the rail at the elbow connector by pressing the blue release button.
Page 79
4. Part Replacement User Guide 4.4 Rear Fan Replacement Figure 53: Uninstalling the Rear Fan Step 3 : Install Rear Fan a. Orient the rear fan as shown in the following image. b. Insert the rear fan into the housing as shown in the following image.
4. Part Replacement User Guide 4.5 IOM Fan Replacement Figure 54: Installing the Rear Fan Step 4 : Make sure the CMA(s) is in operational position by folding the arm(s) in toward the enclosure and attaching the elbow end(s) to the connector(s) attached to the rail. Verify that all of the cabling is in functional order and does not bind or catch.
Page 81
4. Part Replacement User Guide 4.5 IOM Fan Replacement Step 2 : Remove the IOM Fan. a. With one hand, grasp around the center square of the fan housing as shown in the following image. b. Pinch the IOM fan housing to release the latching mechanism and pull it straight out from the chassis.
4. Part Replacement User Guide 4.6 Drive Assembly Replacement 4.6 Drive Assembly Replacement Table 41: Replacement Procedure Info Required Tools # of People Required Time Required Replacement Window None 5 Minutes Step 1 : Grasp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches.
Page 83
4. Part Replacement User Guide 4.6 Drive Assembly Replacement a. Find the latch release mechanism on the Drive Assembly being removed. b. Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly. Figure 60: Unlatch Drive Carrier (IOM Not Shown) c.
Page 84
4. Part Replacement User Guide 4.6 Drive Assembly Replacement Figure 61: Removing Drive Assembly Step 4 : Remove the new Drive Assembly from its packaging. Step 5 : Install the Drive Assembly. a. Ensure that the enclosure has been pulled out of the rack until the rail latches engage. b.
Page 85
4. Part Replacement User Guide 4.6 Drive Assembly Replacement Figure 62: LED Pointer Orientation c. Align the drive with the empty slot that will receive it. Lower it into the slot, making sure it stays level and does not snag.
4. Part Replacement User Guide 4.7 CMA Replacement Figure 63: Installing a Drive Assembly d. Pinch the latch release and carefully press downward to seat the Drive Assembly the rest of the way. Step 6 : Push the enclosure back into the rack to ensure proper cooling. 4.7 ...
Page 87
4. Part Replacement User Guide 4.7 CMA Replacement a. Unlatch the CMA(s) at the elbow connector by pressing the blue release button to unlatch the connector from the rail. Figure 64: Unlatching a CMA Connector b. Swing the CMA(s) away from the enclosure. c.
Page 88
4. Part Replacement User Guide 4.7 CMA Replacement Figure 66: Open Baskets b. Remove one cable from the CMA at a time making sure not to put too much strain on the arm. c. Repeat these steps to remove the cables from the second arm. CMA Lite: a.
Page 89
4. Part Replacement User Guide 4.7 CMA Replacement Step 5 : Unlatch all of the connectors that attach the CMA(s) to the enclosure and the rail by locating the latch release button and pressing it from either side of the latch. There are three total connections that need to be removed, one at the elbow and two at the opposite end.
Page 90
4. Part Replacement User Guide 4.7 CMA Replacement Figure 70: Unlatch Drive Carrier (IOM Not Shown) c. Lift the Drive Assembly free from the enclosure. Figure 71: Removing Drive Assembly...
Page 91
Warning: The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail. This can cause serious damage to the unit or serious bodily harm to those handling the unit.
Page 92
4. Part Replacement User Guide 4.7 CMA Replacement Figure 73: Safety Latch Release d. Depress the latch release lever for the safety latches on the rail and push the chassis very slightly forward. The chassis is now unsecured from the rack. e.
Page 93
4. Part Replacement User Guide 4.7 CMA Replacement Figure 74: Captive Screws Removal b. Remove the nut plate from the mounting pin on the back of the spacer bracket. Figure 75: Rack Spacer Nut Plate Removal c. Remove the spacer brackets from the rack.
Page 94
4. Part Replacement User Guide 4.7 CMA Replacement Figure 76: Spacer Bracket Removal Step 12 : CMA Lite: Install the new spacer brackets. Step 13 : Install the chassis into the rails. a. Extend the bearing plates on the inside of the mid-rails until they are fully forward (detent has engaged).
Page 95
The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail.
Page 96
4. Part Replacement User Guide 4.7 CMA Replacement c. Team-lift the enclosure until the inner rails (which are attached to the chassis) align with the extended mid-rails (which are attached to the rack), and guide the inner rails on the chassis to mate with the rack rails.
Page 97
4. Part Replacement User Guide 4.7 CMA Replacement Step 14 : Install the CMA(s). Note: The CMA has two arms, labeled "upper" and "lower." The lower arm should have the elbow on the left side and be installed first; the upper arm should have the elbow on the right side and be installed last.
Page 98
4. Part Replacement User Guide 4.7 CMA Replacement Figure 81: CMA Cable Routing c. Open all of the baskets. Figure 82: Open Baskets...
Page 99
Close all of the baskets. i. If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport.
Page 100
4. Part Replacement User Guide 4.7 CMA Replacement Step 16 : Make sure the CMA(s) is in operational position by folding the arm(s) in toward the enclosure and attaching the elbow end(s) to the connector(s) attached to the rail. Verify that all of the cabling is in functional order and does not bind or catch.
Page 101
4. Part Replacement User Guide 4.7 CMA Replacement Figure 85: Chassis Handle Operation Step 21 : Perform this same action two more times without the drives loaded to make sure the rail kits are installed properly. Step 22 : Install the Drive Assembly. a.
Page 102
4. Part Replacement User Guide 4.7 CMA Replacement c. Align the drive with the empty slot that will receive it. Lower it into the slot, making sure it stays level and does not snag. Figure 87: Installing a Drive Assembly d.
4. Part Replacement User Guide 4.8 Rails Replacement Step 24 : Now that the drives are installed into the chassis, test the installation by sliding the enclosure in and out of the rack a minimum of three times. If the enclosure binds, catches, or displays any incorrect motion or behavior retry the installation of the drives and chassis.
Page 104
4. Part Replacement User Guide 4.8 Rails Replacement Step 1 : Place the CMA(s) into service position. a. Unlatch the CMA(s) from the rail at the elbow connector by pressing the blue release button. Figure 90: Unlatching a CMA Connector b. Swing the CMA(s) away from the enclosure. c.
Page 105
4. Part Replacement User Guide 4.8 Rails Replacement Figure 92: Cable Retention Mechanism c. Power down the enclosure by disconnecting both power cables, one from each PSU. Step 3 : Disconnect the HD Mini-SAS cables from the rear of the enclosure by pulling (don't jerk) on the blue tab that is extending outward from the connector.
Page 106
4. Part Replacement User Guide 4.8 Rails Replacement Figure 93: Open Baskets b. Remove one cable at a time from the arm, making sure not to put too much strain on the arm. Step 6 : Remove the CMA(s). a. Release all of the connectors that attach the CMA(s) to the enclosure and the rail. There are three total connections that need to be released, one at the elbow and two at the opposite end.
Page 107
4. Part Replacement User Guide 4.8 Rails Replacement Warning: The following steps regarding uninstalling drives from the enclosure should be followed in order to reduce the weight enough to remove the chassis during the rails replacement process. However, if there is proper lift/support equipment rated to support the full weight of the enclosure, 79.4 kg.
Page 108
4. Part Replacement User Guide 4.8 Rails Replacement c. Lift the Drive Assembly free from the enclosure. Figure 97: Removing Drive Assembly Step 10 : Follow the previous step for each drive in the enclosure. Attach a label or mark the drives with the drive slot they were removed from in order to add them to the same slot in the future.
Page 109
Warning: The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail. This can cause serious damage to the unit or serious bodily harm to those handling the unit.
Page 110
4. Part Replacement User Guide 4.8 Rails Replacement Figure 100: Safety Latch Release d. Depress the latch release lever for the safety latches on the rail and push the chassis very slightly forward. The chassis is now unsecured from the rack. e.
Page 111
4. Part Replacement User Guide 4.8 Rails Replacement Figure 101: Remove Inner Rail b. Locate and unlatch the springlock on the side of the inner rail. Figure 102: Inner Rail Spring Latch c. Slide the inner rail toward the front of the enclosure to unlock it from the pegs that secure it to the sidewall and pull it free.
Page 112
4. Part Replacement User Guide 4.8 Rails Replacement Figure 103: Rear Screw Locations b. Uninstall the rest of the screws in the rear rack rail. c. Move to the front of the rack and remove the three screws that hold the rack latch bracket to the front of the rack using a T15 Torx screwdriver.
Page 113
4. Part Replacement User Guide 4.8 Rails Replacement Figure 104: Rack Latch Bracket Installed Step 17 : Uninstall the rack rails from the rack. a. From the front of the rack, locate the release clip as shown in the following image. Figure 105: Front Rail Release Clip Operation...
Page 114
4. Part Replacement User Guide 4.8 Rails Replacement b. Press the release clip and press lightly toward the rear of the rack to compress the rail clear of the rack post. c. Let go of the rail and move to the rear of the rack. d.
Page 115
4. Part Replacement User Guide 4.8 Rails Replacement Step 20 : Install the inner rail onto the chassis making sure they are installed on the correct side. Each inner rail will read "R" for the right or "L" for the left embossed on the side that faces away from the chassis.
Page 116
4. Part Replacement User Guide 4.8 Rails Replacement e. Follow these steps for the second inner rail on the opposite side of the enclosure. Step 21 : Install the outer rails into the rack. Pay special attention to which side is being installed. The embossed R is for the right side and L is for the left side.
Page 117
4. Part Replacement User Guide 4.8 Rails Replacement Figure 111: Front Rail Release Clip Operation g. Use a level to make sure that the rails are aligned properly. h. Follow these steps for the other outer rail. Step 22 : Install the rear cover alignment brackets. a.
Page 118
4. Part Replacement User Guide 4.8 Rails Replacement b. Use five of the M5 x 12mm T15 Flat Head Torx screws and five of the included washers and attach the rear cover alignment bracket to the vertical rail with the Long T15 Torx Screwdriver.
Page 119
4. Part Replacement User Guide 4.8 Rails Replacement Figure 114: Screw Installation Location Step 23 : Install the two rack latch brackets at the front of the rack. a. Orient the brackets so that the screw holes are between the two pins supporting the outer rails as shown in the following image.
Page 120
4. Part Replacement User Guide 4.8 Rails Replacement Figure 115: Rack Latch Bracket Installed b. Use 6 of the included M5 x 12mm screws and the T15 Torx screwdriver to install each bracket, 3 screws per bracket. Caution: Always install the top cover onto the enclosure before installing the chassis into a rack.
Page 121
The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail.
Page 122
4. Part Replacement User Guide 4.8 Rails Replacement c. Team-lift the enclosure until the inner rails (which are attached to the chassis) align with the extended mid-rails (which are attached to the rack), and guide the inner rails on the chassis to mate with the rack rails.
Page 123
4. Part Replacement User Guide 4.8 Rails Replacement Step 25 : Secure the chassis top cover to the rack using the captive M5 thumb-screws as shown in the following image. Use a T15 Torx screwdriver, and tighten the screws to 3.38-3.61 Nm / 30-32 in- lbf.
Page 124
4. Part Replacement User Guide 4.8 Rails Replacement Step 27 : Install the Drive Assembly. a. Ensure that the enclosure has been pulled out of the rack until the rail latches engage. b. Find the LED pointer on the top of the drive carrier. This pointer should point toward the front of the unit as shown in the following image.
Page 125
4. Part Replacement User Guide 4.8 Rails Replacement Figure 122: Installing a Drive Assembly d. Pinch the latch release and carefully press downward to seat the Drive Assembly the rest of the way. Step 28 : Install each drive in the place it was removed from by following the labels or marks that were added earlier.
Page 126
4. Part Replacement User Guide 4.8 Rails Replacement Figure 123: Lower CMA Orientation c. Slowly slide the enclosure forward to ensure the arm is operating properly, then slide it back into the rack. a. Repeat these steps to install the upper arm with the elbow facing to the right. Step 30 : Cable the CMA(s).
Page 127
4. Part Replacement User Guide 4.8 Rails Replacement Figure 124: CMA Cable Routing c. Open all of the baskets. Figure 125: Open Baskets...
Page 128
Close all of the baskets. i. If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport.
Page 129
4. Part Replacement User Guide 4.8 Rails Replacement a. Unlatch the elbow side of the CMA arm and swing it forward by pressing the blue button that says “push” to unlatch it. b. Gather the SAS cables, one power cable, and one Ethernet cable to install in the left hand side.
Page 130
4. Part Replacement User Guide 4.8 Rails Replacement Figure 128: Connected Cable Routing d. Wrap cable tie around the installed cable bundle between the ports and the first basket of the CMA Note: Each cable must be given enough slack at the connector end to operate smoothly.
Page 131
4. Part Replacement User Guide 4.8 Rails Replacement Figure 129: Nominal Cable Length at Connectors e. Loop the retention clip on the PSU cables around the cable and pinch it until the clip catches and locks in place. Figure 130: Cable Retention Mechanism f.
Figure 131: Cinching Cable Retention Clip g. If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport.
Page 133
4. Part Replacement User Guide 4.9 Chassis Replacement Required Tools Required Parts # of People Required Time Required • • Cable Ties (for Optional (if using configurations CMA Tray): M3 x with greater than 8mm T10 Torx screws 10 total cables) •...
Page 134
4. Part Replacement User Guide 4.9 Chassis Replacement a. Locate the redundant PSUs at the rear of the enclosure. b. Detach the cable retention clip from both power cords. Figure 134: Cable Retention Mechanism c. Power down the enclosure by disconnecting both power cables, one from each PSU. Step 3 : Disconnect the HD Mini-SAS cables from the rear of the enclosure by pulling (don't jerk) on the blue tab that is extending outward from the connector.
Page 135
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 135: Open Baskets b. Remove one cable at a time from the arm, making sure not to put too much strain on the arm. Step 6 : Remove the CMA(s). a. Release all of the connectors that attach the CMA(s) to the enclosure and the rail. There are three total connections that need to be released, one at the elbow and two at the opposite end.
Page 136
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 137: Unscrew Thumbscrew b. Swing the crossbar away from the enclosure. Figure 138: Crossbar Swinging Out c. Once the crossbar is straight it should easily come free from the mounting bracket. Step 9 : Uninstall the PSU.
Page 137
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 139: Uninstalling PSU b. Pull the PSU straight out with even pressure. Step 10 : To unlatch the rear fan from the fan housing, use one hand to press the clip at the top and bottom of the fan and pull to free it from the chassis and remove it.
Page 138
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 140: Uninstalling the Rear Fan Step 11 : Grasp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches. The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets.
Page 139
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 141: Chassis Handle Operation Step 12 : Remove all of the drives from the chassis before uninstalling the chassis. Be prepared to label the drives as they are removed so they can be reinstalled in the same location in the new chassis. Step 13 : Follow these steps to remove a Drive Assembly.
Page 140
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 143: Removing Drive Assembly Step 14 : Follow the previous step for each drive in the enclosure. Attach a label or mark the drives with the drive slot they were removed from in order to add them to the same slot in the future. Store the drives in an ESD safe location until the drives are ready to be installed back into an enclosure.
Page 141
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 145: Removing IOM Step 16 : Remove the second IOM. Step 17 : Remove the IOM Fan. a. With one hand, grasp around the center square of the fan housing as shown in the following image.
Page 142
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 147: Inner Rail Safety Latch Release Step 19 : Push the chassis back into the rack. Step 20 : Locate the M5 thumb-screws on the top cover of the enclosure that keep it in place when the drawer is extended, and unscrew them using a T15 Torx screwdriver.
Page 143
Warning: The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail. This can cause serious damage to the unit or serious bodily harm to those handling the unit.
Page 144
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 150: Remove Inner Rail b. Locate and unlatch the springlock on the side of the inner rail. Figure 151: Inner Rail Spring Latch c. Slide the inner rail toward the front of the enclosure to unlock it from the pegs that secure it to the sidewall and pull it free.
Page 145
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 152: Uninstalling the Cable Tray Caution: Always install the top cover onto the enclosure before installing the chassis into a rack. Not having the top cover installed may damage the alignment brackets. Step 25 : Ensure the top cover is installed.
Page 146
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 153: Inner Rail Attachment c. Slide the inner rail toward the rear of the chassis to lock it in place. There will be an audible click and the mounting pegs will cover the front part of the keyhole. Figure 154: Slide Inner Rail Caution: When installing the inner rail onto the chassis, make sure to only use the special Low-Profile M4 x 3.2mm Philips screws provided in the...
Page 147
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 155: Installing the Cable Tray Step 28 : Extend the mid-rails out of the rack so that they are protruding from the front of the rack and the safety latches engage. Figure 156: Extend Mid-Rails Step 29 : Install the chassis into the rails.
Page 148
The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail.
Page 149
4. Part Replacement User Guide 4.9 Chassis Replacement c. Team-lift the enclosure until the inner rails (which are attached to the chassis) align with the extended mid-rails (which are attached to the rack), and guide the inner rails on the chassis to mate with the rack rails.
Page 150
4. Part Replacement User Guide 4.9 Chassis Replacement Step 30 : Secure the chassis top cover to the rack using the captive M5 thumb-screws as shown in the following image. Use a T15 Torx screwdriver, and tighten the screws to 3.38-3.61 Nm / 30-32 in- lbf.
Page 151
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 161: Lower CMA Orientation c. Slowly slide the enclosure forward to ensure the arm is operating properly, then slide it back into the rack. a. Repeat these steps to install the upper arm with the elbow facing to the right. Step 33 : Grasp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches.
Page 152
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 163: Unlatching IOM Handles c. Align the IOM with the empty slot on the top of the chassis so that the arrow on the IOM latch release is facing toward the side shown in the following image. d.
Page 153
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 165: Installing the IOM Fan b. Pinch the latch release mechanism slightly and carefully lower the IOM Fan into the slot. Step 37 : Install the Drive Assembly. a. Ensure that the enclosure has been pulled out of the rack until the rail latches engage. b.
Page 154
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 166: LED Pointer Orientation c. Align the drive with the empty slot that will receive it. Lower it into the slot, making sure it stays level and does not snag.
Page 155
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 167: Installing a Drive Assembly d. Pinch the latch release and carefully press downward to seat the Drive Assembly the rest of the way. Step 38 : Install each drive in the place it was removed from by following the labels or marks that were added earlier.
Page 156
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 168: Shipping Bracket Screw Locations Step 40 : Install the PSU. a. Align the PSU in the orientation shown in the following image. b. Slide the PSU into the slot until it seats fully into the chassis. Figure 169: Installing the PSU c.
Page 157
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 170: Cable Retention Mechanism e. Slide the retention clip forward until it stops near the cable connector. Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason.
Page 158
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 172: Installing the Rear Fan Step 43 : Install the rest of the rear fans into the rear of the enclosure. Step 44 : Install the CMA(s). Note: The CMA has two arms, labeled "upper" and "lower." The lower arm should have the elbow on the left side and be installed first;...
Page 159
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 173: Lower CMA Orientation c. Slowly slide the enclosure forward to ensure the arm is operating properly, then slide it back into the rack. a. Repeat these steps to install the upper arm with the elbow facing to the right. Step 45 : Install the crossbar onto the CMA mounting bracket.
Page 160
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 175: Crossbar Underside Peg c. Swing the crossbar so that the thumbscrew lines up with the mounting hole on the opposite side of the enclosure. Figure 176: Swinging Motion of Crossbar to Locking Position d.
Page 161
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 177: Tightening the Thumbscrew a. Check that the crossbar is fully secured to the CMA mounting bracket by pulling on the bar to ensure it does not move. Step 46 : Cable the CMA(s). a.
Page 162
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 178: CMA Cable Routing c. Open all of the baskets. Figure 179: Open Baskets...
Page 163
Close all of the baskets. i. If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport.
Page 164
4. Part Replacement User Guide 4.9 Chassis Replacement a. Unlatch the elbow side of the CMA arm and swing it forward by pressing the blue button that says “push” to unlatch it. b. Gather the SAS cables, one power cable, and one Ethernet cable to install in the left hand side.
Page 165
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 182: Connected Cable Routing d. Wrap cable tie around the installed cable bundle between the ports and the first basket of the CMA Note: Each cable must be given enough slack at the connector end to operate smoothly.
Page 166
4. Part Replacement User Guide 4.9 Chassis Replacement Figure 183: Nominal Cable Length at Connectors e. Loop the retention clip on the PSU cables around the cable and pinch it until the clip catches and locks in place. Figure 184: Cable Retention Mechanism f.
Figure 185: Cinching Cable Retention Clip g. If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get damaged during transport.
Page 168
4. Part Replacement User Guide 4.10 Special Considerations for Cable Routing Figure 186: Nominal Cable Length at Connectors The cables at the port side of the CMA should crisscross in front of the IOMs. To accomplish this, the cables connected to the ports for IOM B (right hand side when facing the rear) should be connected to the upper CMA, and the cables connected to the ports for IOM A (left hand side when facing the rear) should be connected to the lower CMA.
4. Part Replacement User Guide 4.11 Cabling for CMA When the cables are routed into the CMA, make sure there is some slack given to the elbow joint of the CMA. It is recommended not to wrap the cables tightly around this joint because this can cause binding and prevent smooth operation.
4. Part Replacement User Guide 4.11 Cabling for CMA 4.11.1 Before You Begin The cable configurations detailed in this section are intended to provide the optimal setup for your specific configuration. During the cabling of the CMA, the HD Mini-SAS and SFP+ cables should be installed into the CMA first, followed by Ethernet cables, and finally the power cables on top.
Page 171
4. Part Replacement User Guide 4.11 Cabling for CMA 4.11.2.1 SFP+ and HD Mini-SAS Cable Configuration This configuration includes the use of up to four SFP+ and two HD Mini-SAS cables installed into a CMA arm. Figure 191: Service Loop Dimension Figure Table 46: Service Loop Dimension Table 6in.
/portal.wdc.com/Support/s/. The Western Digital Enterprise Support Center will appear. Step 2 : Log in to the Western Digital enterprise support center using a Email and password. You will be logged into the Western Digital Enterprise Support Center and several support options will appear on the page.
Page 174
5. System Management User Guide 5.1 Firmware Upgrade Figure 192: Logged into the Western Digital Enterprise Support Center Step 3 : Click the Downloads option. The Western Digital downloads page will appear. Step 4 : Locate and download the firmware update for your product.
To prepare the firmware package for download, do the following: Step 1 : Connect the Ultrastar Data60 to a standard SAS HBA or a RAID SAS HBA hosted on the Linux Server that presents the Enclosure Services Processor to the Linux operating system. The Enclosure Services Processor in the Ultrastar Data60 will be referred to as an IOM.
Page 176
HGST H4060-J 2020 [rmb=0 cmdq=1 pqual=0 pdev=0xd] Note: If the Ultrastar Data60 is connected to an HBA that does not present the Enclosure Services Processor to the host for management purposes, Western Digital recommends attaching the Ultrastar Data60 to a host that does expose the Enclosure Services Processor so that the upgrade may be performed.
5. System Management User Guide 5.1 Firmware Upgrade Figure 198: Ethernet Ports ( IOM A port magnified) b. After connecting both Ethernet interfaces and obtaining IP addresses via DHCP, locate the <dev> device name from the sg_scan -i output from step 2. c.
Page 178
5. System Management User Guide 5.1 Firmware Upgrade Important: Due to the firmware image being a .tar.gz file, the enclosure has to unpack and load the firmware onto the respective ICs which may take up to 15 minutes. Once the sg_ses_microcode command is issued wait 20 minutes to ensure the enclosure has time to perform this process.
5. System Management User Guide 5.1 Firmware Upgrade Step 7 : Verify the installation is correct by repeating the sg_scan -i again. Note: The firmware update is downloaded to both IOMs at the same time. Step 8 : Ensure multi-pathing can see all of the expected drives. a.
Page 180
5. System Management User Guide 5.1 Firmware Upgrade Attention: If the OOBM is not being used, query Page Eh by executing the following command . The first time this command is sg_ses <device> -p0xe issued, the output may be inaccurate, please ignore and issue the command again.
Step 2 : Connect the Ultrastar Data60 to a standard SAS HBA or a RAID SAS HBA hosted on the Windows Server that presents the Enclosure Services Processor to the operating system. The Enclosure Services Processor in the Ultrastar Data60 will be referred to as an IOM.
5. System Management User Guide 5.1 Firmware Upgrade a. IMPORTANT: There is a firmware upgrade requirement which requires both Ethernet interfaces interface to be connected and obtain IP addresses via DHCP prior to starting the upgrade process. The Ethernet ports are shown in the following image: Figure 200: Ethernet Ports ( IOM A port magnified) b.
Page 183
5. System Management User Guide 5.1 Firmware Upgrade Note: If the Ultrastar Data60 is connected to an HBA that does not present the Enclosure Services Processor to the host for management purposes, Western Digital recommends attaching the Ultrastar Data60 to a host that does expose the Enclosure Services Processor so that the upgrade may be performed.
Page 184
5. System Management User Guide 5.1 Firmware Upgrade download microcode expected buffer id offset: 0 Step 5 : Once the download is complete, type: sg_ses_microcode <dev> -m 0xf Step 6 : Press Enter. The IOMs will reset in a staggered manner. This process can take up to 5 minutes to activate. Step 7 : Ensure multi-pathing can see all of the expected drives.
5. System Management User Guide 5.1 Firmware Upgrade Address Weight ----------------------------------------------------------- 5.1.7 Non-Automatic Firmware Activation in Windows Step 1 : Ensure Windows MPIO can see all paths to the drives. Note: This should be completed before beginning the firmware upgrade procedure.
Page 186
5. System Management User Guide 5.1 Firmware Upgrade Attention: If the OOBM is not being used, query Page Eh by executing the following command . The first time this command is sg_ses <device> -p0xe issued, the output may be inaccurate, please ignore and issue the command again.
Page 187
5. System Management User Guide 5.1 Firmware Upgrade Adapter, SAS3 3008 Fury -StorPo... (B|D|F: 132|000|000) Controller: 46616B65436F6E74726F6C6C6572 (State: Active) MPIO Disk98: 02 Paths, Least Blocks, ALUA Not Supported SN: 5000CCA2532558CC Supported Load Balance Policies: FOO RR RRWS LQD WP LB Path ID State SCSI Address Weight -------------------------------------------------------------------...
State SCSI Address Weight ----------------------------------------------------------- 5.1.8 Upgrading Firmware with OOBM The following procedure should be followed to upgrade the firmware of the Ultrastar Data60 using the OOBM API. Step 1 : Open a web browser, go to: https:/ /portal.wdc.com/Support/s/, and download the firmware package for the Ultrastar Data60.
5. System Management User Guide 5.2 Configuring OOBM Network Settings curl -G -k -u admin:admin -H "Content-type: application/json" https://<IP address>/redfish/v1/UpdateService/Actions/UpdateService.SimpleUpdate/ Status a. Execute the command until you see the following result: "ErrorCode":0, "StatusCode":2, "Description":"FW update completed. Waiting for activation.", "EstimatedRemainingMinutes":0 Step 5 : To activate the firmware, send a POST request: •...
Page 190
5. System Management User Guide 5.2 Configuring OOBM Network Settings 5.2.1 Configuring OOBM Network Settings Using SES Changing the OOBM Network Configuration Step 1 : To change the OOBM network configuration, enter the following: sg_wr_mode <dev> --dbd --page=0x23,0x01 -- contents=e3,01,00,1A,<IOM>,00,00,00,<setting>,00,00,00,<IPaddr>, <netmask>,<gateway>,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00 Where: •...
Page 191
5. System Management User Guide 5.2 Configuring OOBM Network Settings • Setting = 01 (DHCP) • IP Address = 0.0.0.0 • Netmask = 0.0.0.0 • Gateway = 0.0.0.0 To change the OOBM network configuration on IOM B to DHCP: sg_wr_mode /dev/sg3 --dbd --page=0x23,0x01 -- contents=e3,01,00,1A,02,00,00,00,01,00,00,00,00,00,00,00, 00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00,00 •...
Portal (page 163) 5.3.2 Predefined Zoning Configurations There are three predefined zoning configurations for the Ultrastar Data60. Each configuration connects a different number of hosts to a set number of drives. Each of these drives are part of a grouping called a zone group.
Page 193
5. System Management User Guide 5.3 Zoning Figure 201: Configuration 0 There is no SAS cable connection Configuration table for this Configuration. This is because the host servers do not rely on any order of connection to see the drives and drive slots. Configuration 1: Configuration 1 allows up to six redundantly configured hosts to view a specific zone group of drives.
Page 194
5. System Management User Guide 5.3 Zoning Figure 202: Configuration 1 Each SAS port in the following image matches the color of another set of drives in that specific zone group. Connect the host servers to the enclosure using SAS cables in the Configuration listed in the table below.
Page 195
5. System Management User Guide 5.3 Zoning Host connection (SAS Port) Enclosure IOM connection (SAS Port) Host 5 Host 6 Host 6 Configuration 2: Configuration 2 allows up to three redundantly configured hosts to view a specific zone group of drives. Each host will be able to view up to 20drives that are mapped to both IOMs.
Page 196
5. System Management User Guide 5.3 Zoning Each SAS port in the following image matches the color of another set of drives in that specific zone group. Connect the host servers to the enclosure using SAS cables in the Configuration listed in the table below.
Page 197
5. System Management User Guide 5.3 Zoning Figure 204: Configuration 3 Each SAS port in the following image matches the color of another set of drives in that specific zone group. Connect the host servers to the enclosure using SAS cables in the Configuration listed in the table below.
Host 2 5.3.3 sg_senddiag Command The sg_senddiag command is used to configure zoning on Ultrastar Data60. This command contains several values that are important to enable and disable zoning through the use of the IOMs and expanders. The following section breaks down how to understand the necessary information to properly enable or disable zoning on the enclosure.
5.3.4 Enabling Zoning using Linux Step 1 : From the host server, identify the sg devices that are associated with the Ultrastar Data60 IOMs. a. Issue the following command: sg_scan -i | grep -i H4060-J -B 1 b.
Page 201
5. System Management User Guide 5.3 Zoning Note: A comma should be placed after each bit of data in the IOM SAS Address that was recorded. For example, if the IOM SAS Address output was 5000CCAB0300007C, the address that should be added to the sg_senddiag command should be 50,00,CC,AB,03,00,00,7C.
9, PHYs 14-27 as being in zone group 10, and so on. 5.3.5 Disabling Zoning using Linux Step 1 : From the host server, identify the sg devices that are associated with the Ultrastar Data60 IOMs. a. Issue the following command: sg_scan -i | grep -i H4060-J -B 1 b.
Page 203
5. System Management User Guide 5.3 Zoning sg_ses <dev> -p7 | grep -i esce b. Identify the IOM SAS address for both IOMs from the output. Each address appears before the IP Address as bolded in the example below. Element 0 descriptor: ESCE IOMA,1EB0246-B2 ,THCLS03517EL0091 ,5000CCAB0300003C,10.202.238.225 Element 1 descriptor: ESCE IOMB,1EB0246...
Page 204
5. System Management User Guide 5.3 Zoning Note: A comma should be placed after each bit of data in the IOM SAS Address that was recorded. For example, if the IOM SAS Address output was 5000CCAB0300003C, the address that should be added to the sg_senddiag command should be 50,00,CC,AB,03,00,00,3C.
Note: Repeat this substep for all hosts. 5.3.6 Enabling Zoning using Windows Step 1 : From the host server, identify the SCSI devices that are associated with the Ultrastar Data60 IOMs. Note: The operating system associates each SEP device as a SCSI device. The SCSI device of the SEP can be used to get status from or control elements within the enclosure.
Page 206
5. System Management User Guide 5.3 Zoning sg_scan -s | findstr /i H4060-J b. Identify the SCSI devices from the output. The device information follows SCSI0. The devices appear as SCSI0:1,62,0 and SCSI0:1,124,0 bolded in the example below. SCSI0:1,62,0 claimed=0 pdt=dh HGST H460-J 0101...
Page 207
5. System Management User Guide 5.3 Zoning sg_senddiag <a> --pf --raw=04,00,00,90,<b>,<c>,00,00,<d> a. SCSI device (<dev>): device associated with IOM A b. Enable Zoning: 61 c. Zoning Configuration: configuration 01, 02, or 03 Note: For information on preconfigured zoning configurations, see: Predefined Zoning Configurations (page 182).
Page 208
5. System Management User Guide 5.3 Zoning b. Enabling a predefined zoning configuration will reset the SAS connector ports which may cause the sg_senddiag command to return a status of DID_TIME_OUT or DID_SOFT_ERROR. Despite the error, the zoning configuration will be enabled. The zoning configuration can be verified after both IOMs have been zoned.
5.3.7 Disabling Zoning using Windows PENDING - Remove references to sg and replace with SCSI device handles. Step 1 : From the host server, identify the SCSI devices that are associated with the Ultrastar Data60 IOMs. Note: The operating system associates each SEP device as a SCSI device. The SCSI device of the SEP can be used to get status from or control elements within the enclosure.
Page 210
5. System Management User Guide 5.3 Zoning a. Issue the following command: sg_vpd <dev> -p0x83 b. Identify and match the IOM SAS address and sg device for both IOMs from the output. Each address appears bolded in the example below. Addressed logical unit: designator type: NAA, code set: Binary...
Page 211
5. System Management User Guide 5.3 Zoning a. SCSI device (<dev>): device associated with IOM B b. Disable Zoning: 60 c. Zoning Configuration: configuration 00 Note: For information on preconfigured zoning configurations, see: Predefined Zoning Configurations (page 182). d. IOM SAS Address: SAS Address associated with IOM B Note: A comma should be placed after each bit of data in the IOM SAS Address that was recorded.
5. System Management User Guide 5.4 Subenclosure Nickname ls /dev/bsg Example of the Expander Handles 0:2:0:0 9:0:1297:0 9:0:1378:0 9:0:1390:0 end_device-9:41:26 end_device-9:44:12 end_device-9:44:9 10:0:0:0 9:0:1298:0 9:0:1379:0 9:0:1391:0 end_device-9:41:27 end_device-9:44:13 expander-9:39 7:0:0:0 9:0:1299:0 9:0:1380:0 end_device-9:39:2 end_device-9:41:28 end_device-9:44:14 expander-9:40 9:0:1220:0 9:0:1300:0 9:0:1381:0 end_device-9:41:17 end_device-9:41:29 end_device-9:44:15 expander-9:41...
Page 213
5. System Management User Guide 5.4 Subenclosure Nickname • An enclosure consists of one or more subenclosures. If a single subenclosure is present, then that subenclosure is considered the primary subenclosure, and there are no secondary subenclosures. If multiple subenclosures are present, then: 1.
5. System Management User Guide 5.5 Partially Populated Enclosures No errors Note: If the nickname contains one or more spaces, enclose the name in either single quotes (i.e. 'device nickname') or double quotes (i.e. "device nickname"). If the command was successful, will be returned.
5.5 Partially Populated Enclosures 5.5.1 Partial Population Configurations The Ultrastar Data60 supports partially-populated configurations that allow a user to increase the size of storage based on their needs. There are specific requirements that must be followed to ensure that the enclosure functions properly during operation.
Page 216
5. System Management User Guide 5.5 Partially Populated Enclosures The enclosure supports a minimum of 24 HDDs and one SSD for a partially populated enclosure. The enclosure can support a minimum of one SSD with the remaining drive slots within that row being completed with drive blanks.
5. System Management User Guide 5.5 Partially Populated Enclosures The enclosure supports a minimum of 24 HDDs and one SSD for a partially populated enclosure. The enclosure can support a maximum of up to 24 total SSDs in this configuration. The enclosure does not support a mix of SAS and SATA drives.
Page 218
5. System Management User Guide 5.5 Partially Populated Enclosures This section provides steps on how to install drives into the enclosure. The enclosure is shipped with a minimum of 24 HDDs and may require HDDs to be moved to other drives slots if SSDs are being installed. Before beginning the process of adding drives, refer to the Partial Population Configurations (page 204) section to determine what configuration will be used and what is required of that configuration.
Page 219
5. System Management User Guide 5.5 Partially Populated Enclosures Figure 209: LED Pointer Orientation c. Align the drive with the empty slot that will receive it. Lower it into the slot, making sure it stays level and does not snag.
Page 220
5. System Management User Guide 5.5 Partially Populated Enclosures Figure 210: Installing a Drive Assembly d. Pinch the latch release and carefully press downward to seat the Drive Assembly the rest of the way. Step 5 : Install each drive in the same way the first was installed. Make sure to follow the drive layout shown in the following image.
5.6.1 Daisy Chaining Configurations The Ultrastar Data60 supports configurations up to four enclosures daisy chained together using active cables. The Daisy Chaining Key identifies the specific information needed to use the cable maps in the following sections. The daisy chaining configurations are broken into two sections: one host configurations and two host configurations.
5. System Management User Guide 5.6 Daisy Chaining Type of Enclosure Number of Hosts Number of HBAs per Host Number of Enclosures 2 HBAs SATA 1 HBA 5.6.2 One Host Cable Configurations This section provides the information required to connect two or more enclosures to a single host via SAS connections.
Page 223
5. System Management User Guide 5.6 Daisy Chaining Two Enclosures: One Host with a Two HBAs Source Device Destination Device Host1: P1 Enclosure1: IOMA, A6 Host1: P2 Enclosure2: IOMB, B1 Host1: P3 Enclosure2: IOMA, A6 Host1: P4 Enclosure1: IOMB, B1 Enclosure1: IOMA, A1 Enclosure2: IOMA, A2 Enclosure1: IOMB, B6...
Page 224
5. System Management User Guide 5.6 Daisy Chaining Three Enclosures: One Host with a Two HBAs Source Device Destination Device Host1: P1 Enclosure1: IOMA, A6 Host1: P2 Enclosure3: IOMB, B1 Host1: P3 Enclosure3: IOMA, A6 Host1: P4 Enclosure1: IOMB, B1 Enclosure1: IOMA, A1 Enclosure2: IOMA, A2 Enclosure1: IOMB, B6...
Page 225
5. System Management User Guide 5.6 Daisy Chaining Four Enclosures: One Host with a Single HBA Source Device Destination Device Host1: P1 Enclosure1: IOMA, A6 Host1: P2 Enclosure4: IOMB, B1 Enclosure1: IOMA, A3 Enclosure2: IOMA, A1 Enclosure1: IOMB, B3 Enclosure2: IOMB, B6 Enclosure2: IOMA, A3 Enclosure3: IOMA, A1 Enclosure2: IOMB, B3...
Page 226
5. System Management User Guide 5.6 Daisy Chaining Four Enclosures: One Host with a Two HBAs Source Device Destination Device Host1: P1 Enclosure1: IOMA, A6 Host1: P2 Enclosure4: IOMB, B1 Host1: P3 Enclosure4: IOMA, A6 Host1: P4 Enclosure1: IOMB, B1 Enclosure1: IOMA, A1 Enclosure2: IOMA, A2 Enclosure1: IOMB, B6...
5. System Management User Guide 5.6 Daisy Chaining Four Enclosures: Two Hosts with Two HBAs Source Device Destination Device Host1: P1 Enclosure1: IOMA, A6 Host1: P2 Enclosure4: IOMB, B1 Host1: P3 Enclosure1: IOMA, A4 Host1: P4 Enclosure4: IOMB, B3 Host2: P1 Enclosure1: IOMB, B1 Host2: P2 Enclosure4: IOMA, A6...
Page 233
5. System Management User Guide 5.6 Daisy Chaining Note: Before cabling the lower CMA, note the following routing of the cables. For best results, the cables that are supported by the upper CMA are inserted into IOM B (right hand side looking at the rear) and the lower CMA cables are routed to IOM A (left hand side looking at the rear) in a "criss-cross"...
Page 234
5. System Management User Guide 5.6 Daisy Chaining Figure 227: Open Baskets d. Connect all of the SAS cables that will be used and route them through the baskets one at a time. Make sure to follow the labels to make sure they are connected to the proper port.
Page 235
5. System Management User Guide 5.6 Daisy Chaining Figure 228: Nominal Cable Length at Connectors f. Close all of the baskets. g. Reconnect the CMA at the elbow to the connectors on the rail. Step 3 : Cable the upper CMA. a.
Page 236
5. System Management User Guide 5.6 Daisy Chaining Figure 229: Open Baskets a. Connect the SAS cables and route them through the baskets one at a time. Make sure to follow the labels to make sure they are connected to the proper port. b.
Page 237
5. System Management User Guide 5.6 Daisy Chaining Figure 230: Connected Cable Routing c. Wrap cable tie around the installed cable bundle between the ports and the first basket of the CMA Note: Each cable must be given enough slack at the connector end to operate smoothly.
Page 238
5. System Management User Guide 5.6 Daisy Chaining Figure 231: Nominal Cable Length at Connectors d. Close all of the baskets. e. Reconnect the CMA at the elbow to connector A. Step 4 : Connect the SAS cables to the host server(s) according to the One Host Cable Configurations (page 212) Two Host Cable Configurations (page...
Western Digital Safety The following chapter provides safety and regulatory information for the Ultrastar Data60. In This Chapter: - Electrostatic Discharge......230 - Optimizing Location........230 - Power Connections........230 - Power Cords..........230 - Rackmountable Systems......231 - Safety and Service........231...
6.1 Electrostatic Discharge CAUTION Electrostatic discharge can harm delicate components inside Western Digital products. Electrostatic discharge (ESD) is a discharge of stored static electricity that can damage equipment and impair electrical circuitry. It occurs when electronic components are improperly handled and can result in complete or intermittent failures.
6.5 Rackmountable Systems CAUTION Always install rack rails and storage enclosure according to Ultrastar Data60 product documentation. Follow all cautions, warnings, labels, and instructions provided within the rackmount instructions. Reliable grounding of rack-mounted equipment should be maintained.
6. Safety User Guide 6.7 Safety Warnings and Cautions The power supply in this product contains no user-serviceable parts. Do not open the power supply. Hazardous voltage, current and energy levels are present inside the power supply. Return to manufacturer for servicing.
Learn about the Regulatory, Safety, and Electromagnetic standards for which this product is compliant. The following chapter describes the Regulatory Statement of Compliance, Safety Compliance, and Electromagnetic Compatibility Agency Requirements for the Ultrastar Data60. In This Chapter: - Restricted Access Location.......234 - Safety Compliance........234 - Electromagnetic Compatibility (EMC) Class A Compliance..........234...
7.1 Restricted Access Location 7.1 Restricted Access Location The Ultrastar Data60 is intended for installation in a server room or computer room where at least one of the following conditions apply: • access can only be gained by service persons or by users who have been instructed about the restrictions applied to the location and about any precautions that shall be taken and/or •...
7. Disclaimers User Guide 7.4 Country Certifications • EN 61000-4-2 ESD • EN 61000-4-3 Radiated Immunity • EN 61000-4-4 EFT • EN 61000-4-5 Surge • EN 61000-4-6 RF Common Mode • EN 61000-4-8 Power Frequency Magnetic Field • EN 61000-4-11 Voltage Dips and Interruptions 7.4 ...
Statements The following chapter provides regulatory statements for the Ultrastar Data60, H4060-J . Western Digital Storage Enclosures are marked to indicate compliance to various country and regional standards. Note: Potential equipment damage: Operation of this equipment with cables that are not properly...
Any modifications made to this device that are not approved by Western Digital may void the authority granted to the user by the FCC to operate equipment.
Page 248
8. Regulatory Statements User Guide 8.5 Taiwan Warning Label Statement, Class A ITE English translation: This is a Class A product. In a domestic environment, this product may cause radio interference, in which case, the user may be required to take adequate measures.
Need help?
Do you have a question about the Ultrastar Data60 and is the answer not in the manual?
Questions and answers