Table of Contents

Advertisement

User Guide
Ultrastar Data60
Regulatory Model: H4060-J
December 2018
Rev. 1.7
1ET1101
Long Live Data
| www.hgst.com

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Ultrastar Data60 H4060-J and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Summary of Contents for HGST Ultrastar Data60 H4060-J

  • Page 1 User Guide Ultrastar Data60 Regulatory Model: H4060-J December 2018 Rev. 1.7 1ET1101 ™ Long Live Data | www.hgst.com...
  • Page 2: Table Of Contents

    Contents User Guide Contents Revision History....................7 Copyright......................9 Chapter 1 Overview..................10 1.1 Ultrastar Data60 Description............10 1.2 System Architecture Overview............11 System Level Block Diagram............12 1.4 Ultrastar Data60 Specification Summary.........12 Ultrastar Data60 Layout..............14 1.6 List of Customer Replaceable Units (CRUs)........15 LEDs....................16 1.7.1 Front and Rear IO LEDs...............16 1.7.2 IOM LEDs..................18 1.7.3 IOM Fan LED................19...
  • Page 3 Contents User Guide 3.1.2 Chassis Layout................35 IOM Description................36 3.2.1 IOM Specifications...............36 3.2.2 IOM Layout...................37 3.2.3 IOM Blank Description..............38 3.3 PSU Description................38 3.3.1 PSU Specifications...............39 3.3.2 PSU Layout..................40 Rear Fan Description...............41 3.4.1 Rear Fan Specifications...............41 3.4.2 Rear Fan Layout................42 IOM Fan Description................43 3.5.1 IOM Fan Specifications..............43 3.5.2...
  • Page 4 Contents User Guide IOM Replacement................57 4.3 PSU Replacement................60 4.4 Rear Fan Replacement..............64 4.5 IOM Fan Replacement..............66 4.6 Drive Assembly Replacement............68 CMA Replacement................71 Rails Replacement................81 Chassis Replacement..............110 4.10 Special Considerations for Cable Routing ........142 Chapter 5 System Management............146 Firmware Upgrade.................146 5.1.1 Downloading Firmware from the Support Portal......146 5.1.2 Linux Upgrade Preparation............148...
  • Page 5 Contents User Guide Daisy Chaining................188 5.4.1 Daisy Chaining Configurations...........188 5.4.2 One Host Cable Configurations..........191 5.4.3 Two Host Cable Configurations..........195 5.4.4 Cabling for Daisy Chaining............199 Chapter 6 Safety..................204 Electrostatic Discharge..............204 6.2 Optimizing Location................204 Power Connections................204 6.4 Power Cords...................205 Rackmountable Systems...............205 6.6 Safety and Service.................205 6.7 Safety Warnings and Cautions............206 Chapter 7 Disclaimers................207 7.1 Restricted Access Location............207...
  • Page 6 Contents User Guide Appendix A Site and System Operation Requirements......212 Power Requirements..............212 Supported Operating Systems............212 A.3 List of Supported Server Components..........212 A.4 Ultrastar Data60 Rack Requirements..........214 A.4.1 Compatible Hardware Configuration..........215 ESD....................216 A.6 Enclosure Cooling................217 A.7 Host Connectivity................217...
  • Page 7: Revision History

    Revision History User Guide Revision History Date Revision Comment November 2017 Revision 1.0 Initial Release November 2017 Revision 1.1 • The crossbar on the CMA was changed. See Description on page 47. • Removed Lowline power specs from Detailed Power Specifications.
  • Page 8 Revision History User Guide Date Revision Comment • Updated the System Architecture Overview section. See System Architecture Overview on page 11 • Updated the Daisy Chaining section. See Daisy Chaining on page 188 • Added the Rear Cover Alignment Bracket Description. SeeRear Cover Alignment Bracket Description on page November 2018...
  • Page 9: Copyright

    Long Live Data is a trademark of HGST, Inc. and its affiliates in the United States and/or other countries. HGST trademarks are authorized for use in countries and jurisdictions in which HGST has the right to use, market and advertise the brands.
  • Page 10: Chapter 1 Overview

    60 SAS or SATA drives. The maximum data storage capacity of the Ultrastar Data60 is 840 TB using 14TB HGST Ultrastar HC530 drives . (For a full list of compatible drives and total storage capacities, see the List of Compatible Drives on page 23.) The enclosure runs on an input voltage...
  • Page 11: System Architecture Overview

    Overview User Guide System Architecture Overview 1.2 System Architecture Overview The Ultrastar Data60 IOM uses a cascaded expander design to allow for connection to all 60 drives. A 48-port primary expander connects with the six host ports, has a x3 link to the other IOM for IOM-IOM communication and syncing, and also has a x10 SAS link to each secondary expander.
  • Page 12: System Level Block Diagram

    Overview User Guide System Level Block Diagram 1.3 System Level Block Diagram The following image shows the system block diagram for the Ultrastar Data60. . Figure 2: System Block Diagram 1.4 Ultrastar Data60 Specification Summary Table 1: Environmental Specification Summary Specification Non-Operational Operational...
  • Page 13 Overview User Guide Ultrastar Data60 Specification Summary Specification Non-Operational Operational Altitude -300m to 12,000m / -984 ft. to 39,370 ft -300m to 3048m / -984 ft. to 10,000 ft. Table 2: Electrical Specifications Specification Value Max Power Consumption ~1250W Typical Power Consumption ~1000W Note: Max and Typical Power Consumption values represent the output power to the...
  • Page 14: Ultrastar Data60 Layout

    Number of Drive Slots Data Transfer Rates 12Gbps SAS / 6Gbps SATA ® Max Raw Data Storage Capacity 840 TB using 14TB HGST Ultrastar HC530 drives SAS Ports 12 x Mini-SAS HD ( 6 per IOM) 2 x 10/100/1G Ethernet 1.5 Ultrastar Data60 Layout...
  • Page 15: List Of Customer Replaceable Units (Crus)

    Overview User Guide List of Customer Replaceable Units (CRUs) Number Component PSUs Chassis Cover Rear Alignment Brackets Rails The following is an image of the layout of the major system components inside the Ultrastar Data60. Figure 4: Component Layout 1.6 List of Customer Replaceable Units (CRUs) The following table lists the replaceable components and their part numbers.
  • Page 16: Leds

    Overview User Guide LEDs Component Part Number 3.5 in. to 2.5 in. conversion Drive Carrier, Qty=1 1EX0439 3.5 in. Drive Blank, Qty=1 1EX0429 Power Cable for PDU, C13-C14, 18AWG, 3m, Qty=1 1EX1530 Dual Port 1/10/25GbE Unified Wire Adapter 1EX1161 HD Mini-SAS to HD Mini-SAS, 3m, Qty=2 1EX1533 1.7 LEDs 1.7.1...
  • Page 17 Overview User Guide LEDs Number LED Name Color Behavior Power Green Solid - Powered On Figure 6: Rear IO LEDs Table 8: Rear LED Identification Number LED Name Color Behavior SAS Link Green Solid – SAS Cable Connected Status Off – SAS Cable Not Connected Blink @ 1 Hz –...
  • Page 18: Iom Leds

    Overview User Guide LEDs 1.7.2 IOM LEDs The IOM has three LEDs, one each for power, fault, and identification. Figure 7: IOM LEDs Table 9: IOM LED Identification LED Name Color Behavior IOM Identification Blue Blink @ 1 Hz – Blinks only when IOM Identification has been activated.
  • Page 19: Iom Fan Led

    Overview User Guide LEDs 1.7.3 IOM Fan LED The IOM Fan has a single LED that has three distinct states, one each for a fault condition, identification, and power off. Figure 8: IOM Fan LED Table 10: IOM Fan LED Identification LED Name Color Behavior...
  • Page 20: Psu Led

    Overview User Guide LEDs 1.7.4 PSU LED The PSU has a single multi-function LED. See the table below for a detailed functional description. Figure 9: PSU LEDs Table 11: PSU LED Identification LED Name Color Behavior PSU Multi-function LED Green Solid –...
  • Page 21: Rear Fan Led

    Overview User Guide LEDs 1.7.5 Rear Fan LED The Rear Fan has a single LED that has three distinct states, one for a fault condition, one for Identification, and off. Figure 10: Fan LED Table 12: Fan LED Identification LED Name Color Behavior Fan LED...
  • Page 22: Drive Assembly Led

    Blinking @ 1 Hz – Drive Identify Off – Drive has no faults 1.8 Supported SKUs The following table lists the versions of this HGST product that are supported by this document. Table 14: List of Available SKUs SKUs 1ES0256...
  • Page 23: List Of Compatible Drives

    Table 15: HDDs Drive Type Interface Sector Size Encryption Volume Part Number HGST Ultrastar DC HC310 SAS 12Gb/s 1EX1183 w/ 3.5 in. drive carrier HGST Ultrastar DC HC310 SAS 12Gb/s 1EX1182 w/ 3.5 in. drive carrier HGST Ultrastar DC HC310...
  • Page 24 User Guide List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number HGST Ultrastar DC HC320 SAS 12Gb/s TCG-FIPS 1EX1342 w/ 3.5 in. drive carrier HGST Ultrastar DC HC320 SAS 12Gb/s 512e 1EX1223 w/ 3.5 in. drive carrier...
  • Page 25 User Guide List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number HGST Ultrastar DC HC510 SATA 6Gb/s 10TB 1EX0496 w/ 3.5 in. drive carrier HGST Ultrastar DC HC510 SATA 6Gb/s 10TB 1EX0495 w/ 3.5 in. drive carrier...
  • Page 26 Overview User Guide List of Compatible Drives Drive Type Interface Sector Size Encryption Volume Part Number HGST Ultrastar He12 SATA 6Gb/s 512e 12TB 1EX1015 w/ 3.5 in. drive carrier HGST Ultrastar He12 SATA 6Gb/s 512e 12TB 1EX1014 w/ 3.5 in. drive carrier...
  • Page 27 User Guide List of Compatible Drives Drive Type Interface Drive Encryption Volume Part Writes Number HGST Ultrastar SS300 SAS 12Gb/s ME-10DW/D 400GB 1EX1273 w/ 2.5 in. drive carrier HGST Ultrastar SS300 SAS 12Gb/s ME-10DW/D 400GB 1EX1159 w/ 2.5 in. drive carrier...
  • Page 28 Number Sandisk Cloudspeed Ultra Gen. II SATA 6Gb/s RI-1.8DW/D 400GB 1EX1294 w/ 3.5 in to 2.5 in drive carrier HGST Ultrastar SS200 SAS 12Gb/s RI-1DW/D 480GB 1EX1318 w/ 3.5 in to 2.5 in drive carrier HGST Ultrastar SS200 SAS 12Gb/s...
  • Page 29 User Guide List of Compatible Drives Drive Type Interface Drive Encryption Volume Part Writes Number HGST Ultrastar SS300 SAS 12Gb/s RI-3DW/D 800GB 1EX1297 w/ 3.5 in to 2.5 in drive carrier HGST Ultrastar SS300 SAS 12Gb/s RI-3DW/D 800GB 1EX1308 w/ 3.5 in to 2.5 in drive carrier...
  • Page 30 User Guide List of Compatible Drives Drive Type Interface Drive Encryption Volume Part Writes Number HGST Ultrastar SS200 SAS 12Gb/s RI-3DW/D 1.6TB 1EX1780 w/ 2.5 in. drive carrier HGST Ultrastar SS200 SAS 12Gb/s RI-3DW/D 1.6TB 1EX1781 w/ 2.5 in. drive carrier...
  • Page 31 User Guide List of Compatible Drives Drive Type Interface Drive Encryption Volume Part Writes Number HGST Ultrastar SS300 SAS 12Gb/s RI-3DW/D 3.2TB 1EX1285 w/ 3.5 in to 2.5 in drive carrier HGST Ultrastar SS300 SAS 12Gb/s RI-3DW/D 3.2TB 1EX1306 w/ 3.5 in to 2.5 in drive carrier...
  • Page 32: Chapter 2 System Management Overview

    This chapter provides an overview of the system management features available in the Ultrastar Data60 through the in-band SAS connections using SG3_utils software, and out-of-band using a REST interface over HTTPS to access HGST's implementation of the DMTF Redfish API. 2.1 Firmware Features Overview The enclosure services functionality is compatible with the SES-3 (SES3r14) standard.
  • Page 33: Oobm Management Overview

    System Management Overview User Guide OOBM Management Overview The enclosure operates visual indicators. These indicators can be set or cleared via host request, or autonomously by the enclosure if it detects fault conditions. The enclosure provides non-volatile memory that records enclosure serialization and branding information. The SEP records event log entries to non-volatile memory.
  • Page 34: Chapter 3 Component Overviews

    Component Overviews User Guide Chassis Description Chapter 3 Component Overviews This section is intended to give an overview of all of the major components contained within the Ultrastar Data60. Each section includes specifications, descriptions, and images that explain the features of each component.
  • Page 35: Chassis Layout

    Component Overviews User Guide Chassis Description 3.1.2 Chassis Layout Figure 13: Layout Table 18: Exterior Components Number Feature IOM and IOM Fan Bay Drive Bay Chassis Handles Rear Fans Bays PSU Bays IOM A Dual HD-Mini SAS Ports (x6) 1GB Ethernet Port (x1) IOM B Dual HD-Mini SAS Ports (x6) 1GB Ethernet Port (x1) The chassis has a removable lid that encloses the internal system components and ensures proper airflow.
  • Page 36: Iom Description

    Component Overviews User Guide IOM Description Warning: The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail.
  • Page 37: Iom Layout

    Component Overviews User Guide IOM Description Specification Value FRU or CRU? Weight 1.27 kg / 2.8 lbs 3.2.2 IOM Layout Figure 15: Layout Rear Front Table 20: Exterior Components Number Feature IOM Handle Latch Release Internal IO Connector Card Edge Power Receptacle Internal IO Connector...
  • Page 38: Iom Blank Description

    Component Overviews User Guide PSU Description 3.2.3 IOM Blank Description Figure 16: Overview Image The IOM Blank is a placeholder component that is used to fill the unused IOM slot. in versions of the Ultrastar Data60 that do not leverage redundant IOMs. The IOM Blank may only be installed into IOM slot B under all circumstances.
  • Page 39: Psu Specifications

    Component Overviews User Guide PSU Description 3.3.1 PSU Specifications Table 21: Specification Summary Specification Value Power Output 1600W 80 PLUS Standard Platinum Input Voltage 200 - 240 VAC Connector Type Number per Enclosure Part Number 1EX0434 Hot Swappable? FRU or CRU? Weight 1 kg / 2.2 lbs.
  • Page 40: Psu Layout

    Component Overviews User Guide PSU Description 3.3.2 PSU Layout Figure 18: Layout Rear/Front Table 22: Exterior Components Number Feature Internal Connector C14 Power Receptacle Latch Release Lever Handle...
  • Page 41: Rear Fan Description

    Component Overviews User Guide Rear Fan Description 3.4 Rear Fan Description Figure 19: Overview Image The Rear Fans are toolless fan modules that provide the primary system cooling for the Ultrastar Data60. They are attached to the rear of the chassis in the fan housing by a 6 pin connector and two latches, that also provides power and control signals to the modules.
  • Page 42: Rear Fan Layout

    Component Overviews User Guide Rear Fan Description 3.4.2 Rear Fan Layout Figure 20: Layout Table 24: Exterior Components Number Feature Latch Releases Internal Power and IO Connector...
  • Page 43: Iom Fan Description

    Component Overviews User Guide IOM Fan Description 3.5 IOM Fan Description Figure 21: Overview Image The IOM Fan is designed to focus cooling on the enclosure's IOMs. It is installed in the central chassis bay and is accessed from the top of the enclosure underneath the lid. It is attached to the chassis toolless release mechanism that allows for easy replacement.
  • Page 44: Iom Fan Layout

    Component Overviews User Guide IOM Fan Description 3.5.2 IOM Fan Layout Figure 22: Layout Front Table 26: Exterior Components Number Feature Latch Mechanism Fan Module Internal Connector...
  • Page 45: Rails Description

    Component Overviews User Guide Rails Description 3.6 Rails Description Figure 23: Overview Image The Ultrastar Data60 is installed into a rack using a toolless-attach rail system. The rails are a two-piece system with one rail that attaches directly to the chassis called the inner rail and the other that attaches to the rack.
  • Page 46: Rails Layout

    Component Overviews User Guide Rails Description 3.6.2 Rails Layout Figure 24: Layout Table 28: Exterior Components Number Features Lower CMA Connectors Rear Latch Release Rear Rack Mounting Bracket Rear Cover Alignment Bracket Front Rack Mounting Bracket and Latch Release6 Inner Rail Upper CMA Connectors...
  • Page 47: Rear Cover Alignment Bracket Description

    Component Overviews User Guide CMA Description 3.6.3 Rear Cover Alignment Bracket Description Figure 25: Overview Image The rear cover alignment brackets are designed to keep the top cover of the chassis in the rack while extending the Ultrastar Data60 out of the rack for servicing. The rear cover alignment brackets will attach to the rear vertical rack rails and rest on top of the toolless rail system.
  • Page 48: Cma Specifications

    Component Overviews User Guide CMA Description ensures that the cables contained by the CMA arm do not snag or get pulled out of the ports as the enclosure moves. The design of the Ultrastar Data60 CMA is a two-arm design that separates the connections to the two sides of the enclosure.
  • Page 49: Cma Layout

    Component Overviews User Guide CMA Description 3.7.2 CMA Layout Figure 27: Layout Table 30: Exterior Components Number Feature Crossbar Rail and Rack Connectors Baskets (retains cables) Elbow Connector...
  • Page 50: Cma Cable Tray

    Component Overviews User Guide CMA Description 3.7.3 CMA Cable Tray Figure 28: Overview Image The cable management assembly (CMA) comes with an optional CMA tray that is used to support cable loads greater then ten (five per arm). This tray is mounted at the bottom of the chassis using four M3 x 8mm T10 Torx screws (two per side).
  • Page 51: Drive Assembly Description

    Component Overviews User Guide Drive Assembly Description 3.8 Drive Assembly Description Figure 29: Overview Image The Drive Assembly is comprised of two parts: the storage drive and the drive carrier. The carrier attaches to the exterior of the data storage drive and caddies the drive into the enclosure. It stabilizes the motion of the drive into the drive bay so that the drive properly mounts onto the drive board.
  • Page 52: Drive Assembly Layout

    Component Overviews User Guide Drive Assembly Description 3.8.2 Drive Assembly Layout Figure 30: Layout Side Bottom Table 32: Exterior Components Number Feature Latches Latch Release IO and Power Connectors Drive Carrier Disk Drive...
  • Page 53: Drive Carrier Description

    Component Overviews User Guide Drive Assembly Description 3.8.3 2.5" Drive Carrier Description Figure 31: Overview Image The 2.5" carrier assembly is used to adapt a 2.5" form factor data storage drive to the 3.5" drive slots in the Ultrastar Data60 drive bays. This allows the enclosure to accommodate high speed SSD drives as its primary data storage medium.
  • Page 54 Component Overviews User Guide Drive Assembly Description 1. Locate the release clips on the rear and press them inward to release the clamp. Figure 32: Clamp Release (clamp shown in blue for visual clarity) 2. Slide the clamp in the direction shown in the following image to loosen it from the drive. Be sure not to slide too far as this will allow the clamp to fall from from the carrier body and it will have to be reinstalled.
  • Page 55: Drive Blank Description

    Component Overviews User Guide Drive Assembly Description 4. Slide the clamp back toward the drive making sure that the two plastic pins on the side of the drive properly install into the drive screwholes. If these pins are not seated properly, unlatch the clamp and retry. Figure 34: Clamp Pins (clamp shown in blue for visual clarity) 3.8.4 Drive Blank Description...
  • Page 56 Component Overviews User Guide Drive Assembly Description When the number of drives that are used in a row is less then the total that are necessary to fill that row, the drive blank is used to fill out the row in place of actual drives. Figure 35: 3.5"...
  • Page 57: Chapter 4 Part Replacement

    Part Replacement User Guide Part Replacement Service Window Chapter 4 Part Replacement 4.1 Part Replacement Service Window The following table contains a time required and a replacement window related to each hot swappable replacement part within the enclosure. The time required for replacement is the expected amount of time it requires to replace the part.
  • Page 58 Part Replacement User Guide IOM Replacement 1. Grasp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches. The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets.
  • Page 59 Part Replacement User Guide IOM Replacement Caution: If a pin on the IOM’s internal connectors is bent or damaged, the IOM will have to be replaced. For this reason it is imperative that the IOM is not forced into position, that it is inserted straight, and that the directions for installing the IOM are followed exactly.
  • Page 60: Psu Replacement

    Part Replacement User Guide PSU Replacement 7. Check the fault LEDs on the IOM or on the enclosure's front and rear LED panels to determine if there is a firmware mismatch between the replacement IOM and the IOM that was not replaced. a) If the fault LED is illuminated, open a command prompt on the host server issue the following command using SG3_utils.
  • Page 61 Part Replacement User Guide PSU Replacement d) Both arms should be extended away from the enclosure as shown in the following example. Figure 42: CMAs in service position (Cables not shown) 2. Locate the faulty PSU by finding the amber LED lit at the rear of the enclosure. 3.
  • Page 62 Part Replacement User Guide PSU Replacement a) Grasp the release lever and the metal handle in a downward pinching motion to release the latching mechanism. Figure 44: Uninstalling PSU b) Pull the PSU straight out with even pressure. 6. Remove the new PSU from its packaging. 7.
  • Page 63 Part Replacement User Guide PSU Replacement d) Loop the retention clip on the PSU cables around the cable and pinch it until the clip catches and locks in place. Figure 46: Cable Retention Mechanism e) Slide the retention clip forward until it stops near the cable connector. Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason.
  • Page 64: Rear Fan Replacement

    Part Replacement User Guide Rear Fan Replacement 4.4 Rear Fan Replacement Table 37: Replacement Procedure Info Required Tools # of People Required Time Required Replacement Window None 5 Minutes 1. Place both CMAs into service position. a) Unlatch the upper CMA at the elbow connector by pressing the blue release button to unlatch the connector from the rail.
  • Page 65 Part Replacement User Guide Rear Fan Replacement 2. To unlatch the rear fan from the fan housing, use one hand to press the clip at the top and bottom of the fan and pull to free it from the chassis and remove it. Figure 50: Uninstalling the Rear Fan 3.
  • Page 66: Iom Fan Replacement

    Part Replacement User Guide IOM Fan Replacement b) Insert the rear fan into the housing as shown in the following image. Figure 51: Installing the Rear Fan 4. Make sure the CMA is in operational position by folding the arm in toward the enclosure and attaching the elbow end of the CMA to the connector that is attached to the rail.
  • Page 67 Part Replacement User Guide IOM Fan Replacement 2. Remove the IOM Fan. a) With one hand, grasp around the center square of the fan housing as shown in the following image. b) Pinch the IOM fan housing to release the latching mechanism and pull it straight out from the chassis. Figure 53: Removing IOM Fan 3.
  • Page 68: Drive Assembly Replacement

    Part Replacement User Guide Drive Assembly Replacement 4. Push the enclosure back into the rack to ensure proper cooling. 4.6 Drive Assembly Replacement Table 39: Replacement Procedure Info Required Tools # of People Required Time Required Replacement Window None 5 Minutes 1.
  • Page 69 Part Replacement User Guide Drive Assembly Replacement b) Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly. Figure 57: Unlatch Drive Carrier (IOM Not Shown)
  • Page 70 Part Replacement User Guide Drive Assembly Replacement c) Lift the Drive Assembly free from the enclosure. Figure 58: Removing Drive Assembly 4. Remove the new Drive Assembly from its packaging. 5. Install the Drive Assembly. a) Ensure that the enclosure has been pulled out of the rack until the rail latches engage.
  • Page 71: Cma Replacement

    Part Replacement User Guide CMA Replacement b) Find the LED pointer on the top of the drive carrier. This pointer should point toward the front of the unit as shown in the following image. Figure 59: LED Pointer Orientation c) Align the drive with the empty slot that will receive it. Lower it into the slot, making sure it stays level and does not snag.
  • Page 72 Part Replacement User Guide CMA Replacement a) Unlatch the upper CMA at the elbow connector by pressing the blue release button to unlatch the connector from the rail. Figure 61: Unlatching a CMA Connector b) Swing the CMA away from the enclosure. c) Do the same for the lower CMA arm as what was done for the upper.
  • Page 73 Part Replacement User Guide CMA Replacement b) Detach the cable retention clip from both power cords. Figure 63: Cable Retention Mechanism c) Power down the enclosure by disconnecting both power cables, one from each PSU. Disconnect the HD Mini-SAS cables from the rear of the enclosure by pulling (don't jerk) on the blue tab that is extending outward from the connector.
  • Page 74 Part Replacement User Guide CMA Replacement Unlatch all of the connectors that attach the CMA to the enclosure and the rail by locating the latch release button and pressing it from either side of the latch. There are three total connections that need to be removed, one at the elbow and two at the opposite end.
  • Page 75 Part Replacement User Guide CMA Replacement b) Attach all of the connectors to the brackets on the rails and chassis. There should be one at the elbow side and two at the other end. Figure 66: Lower CMA Orientation c) Slowly slide the enclosure forward to ensure the CMA arm is operating properly, then slide it back into the rack.
  • Page 76 Part Replacement User Guide CMA Replacement a) Orient the CMA so that the elbow is on the right hand side as it is being installed. Figure 67: Upper CMA Orientation b) Attach all of the connectors to the brackets on the rails and chassis. There should be one at the elbow side and two on the left hand side.
  • Page 77 Part Replacement User Guide CMA Replacement in a "criss-cross" pattern. See the Special Considerations for Cable Routing on page 142 for more information. Figure 68: Connected Cable Routing c) Open all of the baskets Figure 69: Open Baskets d) Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA.
  • Page 78 Part Replacement User Guide CMA Replacement g) If the installation includes more than 10 total cables, follow the recommendations in Special Considerations for Cable Routing on page 142. Read this section before proceeding. Note: Each cable must be given enough slack at the connector end to operate smoothly. For the lower CMA allow 20"...
  • Page 79 Part Replacement User Guide CMA Replacement c) Open all of the baskets Figure 71: Open Baskets a) Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA. b) Connect the SAS cables and route them through the baskets one at a time.
  • Page 80 Part Replacement User Guide CMA Replacement Note: Each cable must be given enough slack at the connector end to operate smoothly. For the upper CMA allow 20" - 21" (508 – 533.4mm) between the end of the connector and the first basket.
  • Page 81: Rails Replacement

    Part Replacement User Guide Rails Replacement f) Slide the retention clip forward until it stops near the cable connector. Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason. Figure 75: Cinching Cable Retention Clip g) If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get...
  • Page 82 Part Replacement User Guide Rails Replacement Place both CMAs into service position. a) Unlatch the upper CMA at the elbow connector by pressing the blue release button to unlatch the connector from the rail. Figure 76: Unlatching a CMA Connector b) Swing the CMA away from the enclosure.
  • Page 83 Part Replacement User Guide Rails Replacement b) Detach the cable retention clip from both power cords. Figure 78: Cable Retention Mechanism c) Power down the enclosure by disconnecting both power cables, one from each PSU. Disconnect the HD Mini-SAS cables from the rear of the enclosure by pulling (don't jerk) on the blue tab that is extending outward from the connector.
  • Page 84 Part Replacement User Guide Rails Replacement Unlatch all of the connectors that attach the CMA to the enclosure and the rail by locating the latch release button and pressing it from either side of the latch. There are three total connections that need to be removed, one at the elbow and two at the opposite end.
  • Page 85 Part Replacement User Guide Rails Replacement b) Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly. Figure 82: Unlatch Drive Carrier (IOM Not Shown)
  • Page 86 Part Replacement User Guide Rails Replacement c) Lift the Drive Assembly free from the enclosure. Figure 83: Removing Drive Assembly 10. Follow the previous step for each drive in the enclosure. Attach a label or mark the drives with the drive slot they were removed from in order to add them to the same slot in the future.
  • Page 87 Part Replacement User Guide Rails Replacement 11. Release the safety latch on the inner rails on each side of the chassis as shown in the following image. Figure 84: Inner Rail Safety Latch Release 12. Push the chassis back into the rack. 13.
  • Page 88 Part Replacement User Guide Rails Replacement serious bodily harm to those handling the unit. Always team lift the chassis by gripping the underside of the unit, and never try to lift a chassis that is filled with drives. c) Locate the safety catches on the inner rails attached to the enclosure. Figure 85: Safety Latch Release d) Depress the latch release lever for the safety latches on the rail and push the chassis very slightly forward.
  • Page 89 Part Replacement User Guide Rails Replacement a) Unscrew the two Low-Profile M4 x 3.2mm Philips screws that attach the inner rails to the chassis using a #2 Philips head screwdriver. Figure 86: Remove Inner Rail b) Locate and unlatch the springlock on the side of the inner rail. Figure 87: Inner Rail Spring Latch c) Slide the inner rail toward the front of the enclosure to unlock it from the pegs that secure it to the sidewall and pull it free.
  • Page 90 Part Replacement User Guide Rails Replacement a) Uninstall the alignment bracket by removing the screws that secure it to the rack posts using the screw locations in the following image. Be careful, the alignment bracket will be free once the screws are removed.
  • Page 91 Part Replacement User Guide Rails Replacement c) Move to the front of the rack and remove the three screws that hold the rack latch bracket to the front of the rack using a T15 Torx screwdriver. Be careful, the rack latch bracket will be free once the screws are removed.
  • Page 92 Part Replacement User Guide Rails Replacement a) From the front of the rack, locate the release clip as shown in the following image. Figure 90: Front Rail Release Clip Operation Unlatch He re b) Press the release clip and press lightly toward the rear of the rack to compress the rail clear of the rack post.
  • Page 93 Part Replacement User Guide Rails Replacement b) Press on the safety latch release spring located on the side of the rail and slide the inner rail out the rest of the way. Figure 92: Rail Safety Latch 20. Install the inner rail onto the chassis making sure they are installed on the correct side. Each inner rail will read "R"...
  • Page 94 Part Replacement User Guide Rails Replacement b) Align the keyholes on the inner rail to the mounting pegs on the side of the enclosure and press the inner rail flush against the chassis. If the keyholes don't line up with the pegs, flip the rail length-wise to see if this will align them.
  • Page 95 Part Replacement User Guide Rails Replacement Install the two special low-profile M4 x 3.2mm Philips screws provided to secure the inner rail to the chassis. e) Follow these steps for the second inner rail on the opposite side of the enclosure. 21.
  • Page 96 Part Replacement User Guide Rails Replacement f) Align the front of the rail with the holes on the rack posts that will receive the rails and pull the rail toward the holes until the toolless latching mechanism engages the rack. Figure 96: Front Rail Release Clip Operation g) Use a level to make sure that the rails are aligned properly.
  • Page 97 Part Replacement User Guide Rails Replacement b) Use five of the M5 x 10mm T15 Torx screws and five of the included washers and attach the rear cover alignment bracket to the vertical rail with the Long T15 Torx Screwdriver. Add three M5 x 10mm T15 Torx screws and three included washers to attach the rear rail (the three lower holes) to the rack posts as shown in the following image.
  • Page 98 Part Replacement User Guide Rails Replacement Caution: Be careful to set the screw properly into the cage nuts to prevent crossthreading. Figure 99: Screw Installation Location Screw Locations 23. Install the two rack latch brackets at the front of the rack. a) Orient the brackets so that the screw holes are between the two pins supporting the outer rails as shown in the following image.
  • Page 99 Part Replacement User Guide Rails Replacement orient this bracket and mirror it for the other side. Notice the increased distance between the top two screw holes and the lower screwholes and the flange being oriented on the outside. Figure 100: Rack Latch Bracket Installed b) Use 6 of the included M5 x 12mm screws and the T15 Torx screwdriver to install each bracket, 3 screws per bracket.
  • Page 100 Part Replacement User Guide Rails Replacement Warning: The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail.
  • Page 101 Part Replacement User Guide Rails Replacement bodily harm to those handling the unit. Always team lift the chassis by gripping the underside of the unit, and never try to lift a chassis that is filled with drives. Figure 101: Bearing Plate Figure 102: Installing the Chassis Caution: Make sure that the bearing plate on the inside of the mid-rails are fully forward...
  • Page 102 Part Replacement User Guide Rails Replacement Position one individual on each side of the enclosure to perform a team lift and have the third individual standing at the protruding rack rails to guide the chassis to mate with rack rails. c) Team-lift the enclosure until the inner rails that are attached to the chassis align with the extended mid-rails attached to the rack, and guide the inner rails on the chassis to mate with the rack rails.
  • Page 103 Part Replacement User Guide Rails Replacement Note: If any drives were removed earlier to facilitate the removal of the chassis, follow the rest of the steps to reinstall the drives by following the labeling scheme noted earlier. If not, proceed to the cabling section.
  • Page 104 Part Replacement User Guide Rails Replacement b) Find the LED pointer on the top of the drive carrier. This pointer should point toward the front of the unit as shown in the following image. Figure 106: LED Pointer Orientation c) Align the drive with the empty slot that will receive it. Lower it into the slot, making sure it stays level and does not snag.
  • Page 105 Part Replacement User Guide Rails Replacement a) Orient the CMA so that the elbow is on the right hand side as it is being installed. Figure 108: Upper CMA Orientation b) Attach all of the connectors to the brackets on the rails and chassis. There should be one at the elbow side and two on the left hand side.
  • Page 106 Part Replacement User Guide Rails Replacement in a "criss-cross" pattern. See the Special Considerations for Cable Routing on page 142 for more information. Figure 109: Connected Cable Routing c) Open all of the baskets Figure 110: Open Baskets d) Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA.
  • Page 107 Part Replacement User Guide Rails Replacement g) If the installation includes more than 10 total cables, follow the recommendations in Special Considerations for Cable Routing on page 142. Read this section before proceeding. Note: Each cable must be given enough slack at the connector end to operate smoothly. For the lower CMA allow 20"...
  • Page 108 Part Replacement User Guide Rails Replacement c) Open all of the baskets Figure 112: Open Baskets a) Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA. b) Connect the SAS cables and route them through the baskets one at a time.
  • Page 109 Part Replacement User Guide Rails Replacement Note: Each cable must be given enough slack at the connector end to operate smoothly. For the upper CMA allow 20" - 21" (508 – 533.4mm) between the end of the connector and the first basket.
  • Page 110: Chassis Replacement

    Part Replacement User Guide Chassis Replacement f) Slide the retention clip forward until it stops near the cable connector. Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason. Figure 116: Cinching Cable Retention Clip g) If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get...
  • Page 111 Part Replacement User Guide Chassis Replacement Place both CMAs into service position. a) Unlatch the upper CMA at the elbow connector by pressing the blue release button to unlatch the connector from the rail. Figure 117: Unlatching a CMA Connector b) Swing the CMA away from the enclosure.
  • Page 112 Part Replacement User Guide Chassis Replacement b) Detach the cable retention clip from both power cords. Figure 119: Cable Retention Mechanism c) Power down the enclosure by disconnecting both power cables, one from each PSU. Disconnect the HD Mini-SAS cables from the rear of the enclosure by pulling (don't jerk) on the blue tab that is extending outward from the connector.
  • Page 113 Part Replacement User Guide Chassis Replacement Unlatch all of the connectors that attach the CMA to the enclosure and the rail by locating the latch release button and pressing it from either side of the latch. There are three total connections that need to be removed, one at the elbow and two at the opposite end.
  • Page 114 Part Replacement User Guide Chassis Replacement b) Swing the crossbar away from the enclosure. Figure 123: Crossbar Swinging Out c) Once the crossbar is straight it should easily come free from the mounting bracket. Uninstall the PSU. a) Grasp the release lever and the metal handle in a downward pinching motion to release the latching mechanism.
  • Page 115 Part Replacement User Guide Chassis Replacement 10. To unlatch the rear fan from the fan housing, use one hand to press the clip at the top and bottom of the fan and pull to free it from the chassis and remove it. Figure 125: Uninstalling the Rear Fan 11.
  • Page 116 Part Replacement User Guide Chassis Replacement b) Insert a finger and a thumb into the latch release and pinch to unlatch the Drive Assembly. Figure 127: Unlatch Drive Carrier (IOM Not Shown)
  • Page 117 Part Replacement User Guide Chassis Replacement c) Lift the Drive Assembly free from the enclosure. Figure 128: Removing Drive Assembly 14. Follow the previous step for each drive in the enclosure. Attach a label or mark the drives with the drive slot they were removed from in order to add them to the same slot in the future.
  • Page 118 Part Replacement User Guide Chassis Replacement b) Grasp both handles, one handle in each hand, and lift evenly with both hands to ensure the IOM comes out straight. This will prevent any damage to the pins on the internal connectors. Figure 130: Removing IOM 16.
  • Page 119 Part Replacement User Guide Chassis Replacement 18. Release the safety latch on the inner rails on each side of the chassis as shown in the following image. Figure 132: Inner Rail Safety Latch Release 19. Push the chassis back into the rack. 20.
  • Page 120 Part Replacement User Guide Chassis Replacement Warning: The handles on the front of the chassis are not intended to be used to support the weight of the Ultrastar Data60. Lifting the unit by the chassis handles or trying to support the unit on the handles can cause them to fail.
  • Page 121 Part Replacement User Guide Chassis Replacement a) Unscrew the two Low-Profile M4 x 3.2mm Philips screws that attach the inner rails to the chassis using a #2 Philips head screwdriver. Figure 134: Remove Inner Rail b) Locate and unlatch the springlock on the side of the inner rail. Figure 135: Inner Rail Spring Latch c) Slide the inner rail toward the front of the enclosure to unlock it from the pegs that secure it to the sidewall and pull it free.
  • Page 122 Part Replacement User Guide Chassis Replacement 24. Uninstall the Cable Tray by removing the M3 x 8mm screws using the long T10 Torx head screwdriver. Figure 136: Uninstalling the Cable Tray Caution: Always install the top cover onto the enclosure before installing the chassis into a rack. Not having the top cover installed may damage the alignment brackets.
  • Page 123 Part Replacement User Guide Chassis Replacement b) Align the keyholes on the inner rail to the mounting pegs on the side of the enclosure and press the inner rail flush against the chassis. If the keyholes don't line up with the pegs, flip the rail length-wise to see if this will align them.
  • Page 124 Part Replacement User Guide Chassis Replacement Install the two special low-profile M4 x 3.2mm Philips screws provided to secure the inner rail to the chassis. e) Follow these steps for the second inner rail on the opposite side of the enclosure. Note: The cable tray only needs to be installed if the number of cables being installed into the CMA will be greater than 10.
  • Page 125 Part Replacement User Guide Chassis Replacement 28. Extend the mid-rails out of the rack so that they are protruding from the front of the rack and the safety latches engage. Figure 140: Extend Mid-Rails 29. Install the chassis into the rails. Caution: This step in the installation requires a minimum of 3 individuals to install safely, two to lift and one to guide the others whom may have difficulty seeing because the enclosure...
  • Page 126 Part Replacement User Guide Chassis Replacement bodily harm to those handling the unit. Always team lift the chassis by gripping the underside of the unit, and never try to lift a chassis that is filled with drives. Figure 141: Bearing Plate Figure 142: Installing the Chassis Caution: Make sure that the bearing plate on the inside of the mid-rails are fully forward...
  • Page 127 Part Replacement User Guide Chassis Replacement Position one individual on each side of the enclosure to perform a team lift and have the third individual standing at the protruding rack rails to guide the chassis to mate with rack rails. c) Team-lift the enclosure until the inner rails that are attached to the chassis align with the extended mid-rails attached to the rack, and guide the inner rails on the chassis to mate with the rack rails.
  • Page 128 Part Replacement User Guide Chassis Replacement 31. Now that the chassis is installed, test the installation by sliding the enclosure in and out of the rack a minimum of three times. If the enclosure binds, catches, or displays any incorrect motion or behavior retry the installation.
  • Page 129 Part Replacement User Guide Chassis Replacement coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets. Figure 146: Chassis Handle Operation 34. Install the IOM. Caution: If a pin on the IOM’s internal connectors is bent or damaged, the IOM will have to be replaced.
  • Page 130 Part Replacement User Guide Chassis Replacement d) Slowly lower the IOM into the empty slot while being careful to keep it level. Do not to force it. Figure 148: Installing the IOM e) When the IOM is lowered fully, apply light pressure with both hands evenly on the IOM body, not the handles, to seat the IOM in the connector.
  • Page 131 Part Replacement User Guide Chassis Replacement 37. Install the Drive Assembly. a) Ensure that the enclosure has been pulled out of the rack until the rail latches engage. b) Find the LED pointer on the top of the drive carrier. This pointer should point toward the front of the unit as shown in the following image.
  • Page 132 Part Replacement User Guide Chassis Replacement T15 Torx Screwdriver. If this chassis will not be installed into a rack for shipping purposes, skip this step and move on to the next one. Figure 152: Shipping Bracket Screw Locations Screw Location 40.
  • Page 133 Part Replacement User Guide Chassis Replacement b) Slide the PSU into the slot until it seats fully into the chassis. Figure 153: Installing the PSU c) Plug the power cable into the receptacle at the back of the PSU. d) Loop the retention clip on the PSU cables around the cable and pinch it until the clip catches and locks in place.
  • Page 134 Part Replacement User Guide Chassis Replacement e) Slide the retention clip forward until it stops near the cable connector. Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason. Figure 155: Cinching Cable Retention Clip 41.
  • Page 135 Part Replacement User Guide Chassis Replacement a) Orient the CMA so that the elbow is on the right hand side as it is being installed. Figure 157: Upper CMA Orientation b) Attach all of the connectors to the brackets on the rails and chassis. There should be one at the elbow side and two on the left hand side.
  • Page 136 Part Replacement User Guide Chassis Replacement b) Insert the peg on the underside of the crossbar into the slot on the CMA mounting bracket. Figure 159: Crossbar Underside Peg c) Swing the crossbar so that the thumbscrew lines up with the mounting hole on the opposite side of the enclosure.
  • Page 137 Part Replacement User Guide Chassis Replacement d) Press the crossbar against the CMA mounting bracket and secure the crossbar in place by pressing and turning the thumbscrew clockwise until snug. Figure 161: Tightening the Thumbscrew a) Check that the crossbar is fully secured to the CMA mounting bracket by pulling on the bar to ensure it does not move.
  • Page 138 Part Replacement User Guide Chassis Replacement in a "criss-cross" pattern. See the Special Considerations for Cable Routing on page 142 for more information. Figure 162: Connected Cable Routing c) Open all of the baskets Figure 163: Open Baskets d) Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA.
  • Page 139 Part Replacement User Guide Chassis Replacement g) If the installation includes more than 10 total cables, follow the recommendations in Special Considerations for Cable Routing on page 142. Read this section before proceeding. Note: Each cable must be given enough slack at the connector end to operate smoothly. For the lower CMA allow 20"...
  • Page 140 Part Replacement User Guide Chassis Replacement c) Open all of the baskets Figure 165: Open Baskets a) Connect the Ethernet cable to the Ethernet port on the right hand side of the Ultrastar Data60 and route the cable through each of the baskets on the CMA. b) Connect the SAS cables and route them through the baskets one at a time.
  • Page 141 Part Replacement User Guide Chassis Replacement Note: Each cable must be given enough slack at the connector end to operate smoothly. For the upper CMA allow 20" - 21" (508 – 533.4mm) between the end of the connector and the first basket.
  • Page 142: Special Considerations For Cable Routing

    Part Replacement User Guide 4.10 Special Considerations for Cable Routing f) Slide the retention clip forward until it stops near the cable connector. Doing this will ensure that the retention clip functions properly in the event the cable is pulled on for some reason. Figure 169: Cinching Cable Retention Clip g) If the Ultrastar Data60 is being installed in a rack and will subsequently be transported inside that rack, it is important to use the included cable tie to wrap the CMA bundle to ensure it does not get...
  • Page 143 Part Replacement User Guide 4.10 Special Considerations for Cable Routing The distance from the end of the connector at the port to the first basket on the CMA should be 20” – 21” long. This will give the cables enough slack at this end to prevent stress on the port and binding during operation cycles.
  • Page 144 Part Replacement User Guide 4.10 Special Considerations for Cable Routing CMA, and the cables connected to the ports for IOM A (left hand side when facing the rear) should be connected to the lower CMA. Figure 171: Crisscross Cables When the cables are routed into the CMA, make sure there is some slack given to the elbow joint of the CMA. It is recommended not to wrap the cables tightly around this joint because this can cause binding and prevent smooth operation.
  • Page 145 Part Replacement User Guide 4.10 Special Considerations for Cable Routing At the end of the CMA where the cables exit, use a cable tie to bundle the cables together. Make sure the cables are bending and not twisting. Figure 173: Cable Tie at Exit of CMA...
  • Page 146: Chapter 5 System Management

    System Management User Guide Firmware Upgrade Chapter 5 System Management 5.1 Firmware Upgrade This section provides information on actions that should be taken before starting a firmware upgrade on the Ultrastar Data60. The storage administrator should determine if the applications on the enclosure should be quiesced before the online upgrade is completed.
  • Page 147 System Management User Guide Firmware Upgrade 1. Open a web browser and navigate to: https://support.hgst.com/. 2. Navigate to the Platforms page by clicking Explore under the Platform Support category. The Platforms Support page will appear. 3. Locate the Ultrastar Data60 and click Explore under the product.
  • Page 148: Linux Upgrade Preparation

    System Management User Guide Firmware Upgrade The Downloads page will appear. Figure 175: Dashboard 7. Select the Ultrastar Data60 from the Downloads list. The product downloads will appear. 8. View the firmware download options by selecting Firmware > Enclosure > (firmware folder). The Downloads page will appear and display the firmware files.
  • Page 149 Note: If the Ultrastar Data60 is connected to an HBA that does not present the Enclosure Services Processor to the host for management purposes, HGST recommends attaching the Ultrastar Data60 to a host that does expose the Enclosure Services Processor so that the upgrade may be performed.
  • Page 150: Linux Upgrade To New Firmware

    System Management User Guide Firmware Upgrade a) IMPORTANT: There is a firmware upgrade requirement which requires both Ethernet interfaces be connected and obtain IP addresses via DHCP prior to starting the upgrade process. The Ethernet ports are shown in the following image: Figure 177: Ethernet Ports ( IOM A port magnified) F AN 1 FAN 2...
  • Page 151 The string to observe for download microcode status is “Complete, no error, start after hard reset or power cycle [0x11]” before proceeding to the activate step. Example output: sg_ses /dev/sg0 -p 0xe HGST H460-J 2020 Download microcode status diagnostic page: number of secondary subenclosures: 0...
  • Page 152: Non-Automatic Firmware Activation In Linux

    The string to observe for download microcode status is “Complete, no error, start after hard reset or power cycle [0x11]” before proceeding to the activate step. Example output: sg_ses /dev/sg0 -p 0xe HGST H460-J 2020...
  • Page 153: Windows Upgrade Preparation

    System Management User Guide Firmware Upgrade Download microcode status diagnostic page: number of secondary subenclosures: 0 generation code: 0x0 subenclosure identifier: 0 [primary] download microcode status: Complete, no error, start after hard reset or power cycle [0x11] download microcode additional status: 0x0 download microcode maximum size: 1703914 bytes download microcode expected buffer id: 0x0 download microcode expected buffer id offset: 0...
  • Page 154 Note: If the Ultrastar Data60 is connected to an HBA that does not present the Enclosure Services Processor to the host for management purposes, HGST recommends attaching the Ultrastar Data60 to a host that does expose the Enclosure Services Processor so that the upgrade may be performed.
  • Page 155: Windows Upgrade To New Firmware

    Note: If the Ultrastar Data60 is connected to an HBA that does not present the Enclosure Services Processor to the host for management purposes, HGST recommends attaching the Ultrastar Data60 to a host that does expose the Enclosure Services Processor so that the upgrade may be performed.
  • Page 156 The string to observe for download microcode status is “Complete, no error, start after hard reset or power cycle [0x11]” before proceeding to the activate step. Example output: sg_ses /dev/sg0 -p 0xe HGST H460-J 2020 Download microcode status diagnostic page: number of secondary subenclosures: 0...
  • Page 157: Non-Automatic Firmware Activation In Windows

    System Management User Guide Firmware Upgrade The IOMs will reset in a staggered manner. This process can take up to 5 minutes to activate. 7. Ensure multi-pathing can see all of the expected drives. a) Execute the following command to verify that there are two paths to each drive: multipath -ll | grep -i “active ready running”...
  • Page 158 System Management User Guide Firmware Upgrade Note: This should be completed before beginning the firmware upgrade procedure. a) Execute the following command: C:\mpclaim –v C: \Users\Administrator\Desktop\mpclaim_output.txt b) Verify that there are two paths to each drive by executing the following command: C:\more C: \Users\Administrator\Desktop\mpclaim_output.txt 2.
  • Page 159 System Management User Guide Firmware Upgrade HGST H460-J 2020 Download microcode status diagnostic page: number of secondary subenclosures: 0 generation code: 0x0 subenclosure identifier: 0 [primary] download microcode status: Complete, no error, start after hard reset or power cycle [0x11]...
  • Page 160 System Management User Guide Firmware Upgrade 134|000|000) Controller: 46616B65436F6E74726F6C6C6572 (State: Active) 0000000077000430 Active/Optimized 000|004|048|000 0 Adapter: Avago Adapter, SAS3 3008 Fury -StorPo... (B|D|F: 132|000|000) Controller: 46616B65436F6E74726F6C6C6572 (State: Active) MPIO Disk97: 02 Paths, Least Blocks, ALUA Not Supported SN: 5000CCA253255E9C Supported Load Balance Policies: FOO RR RRWS LQD WP LB Path ID State SCSI Address Weight ---------------------------------------------------------------------------...
  • Page 161: Upgrading Firmware With Oobm

    1. Ensure multi-pathing can see all of the expected drives. a) Execute the following command to verify that there are two paths to each drive: multipath -ll | grep -i “active ready running” -c 2. Visit the HGST Support portal at http://www.hgst.com/support/platforms-support and download the firmware package for the Ultrastar Data60.
  • Page 162: Zoning

    System Management User Guide Zoning 6. To activate the firmware, send a POST to the UpdateService object using the FWActivate command. curl -X POST -k -u admin:admin -H "Content-type: application/json" https://<ip address>/redfish/v1/UpdateService/Actions/UpdateService.FWActivate 5.2 Zoning 5.2.1 Before Zoning This section provides information on actions that should be taken before starting zoning on the Ultrastar Data60.
  • Page 163 System Management User Guide Zoning • Out-of-band management: Configuration 0 can be initiated to disable zoning in the out-of-band management by using 0 in the ZoningConfig option. See: Out-of-Band Management for the actual senddiag commands. Figure 180: Configuration 0 There is no SAS cable connection Configuration table for this Configuration. This is because the host servers do not rely on any order of connection to see the drives and drive slots.
  • Page 164 System Management User Guide Zoning • Out-of-band management: Configuration 1 can be initiated in the out-of-band management by using 1 in the ZoningConfig option. See: Out-of-Band Management for the actual senddiag commands. Figure 181: Configuration 1 Each SAS port in the following image matches the color of another set of drives in that specific zone group. Connect the host servers to the enclosure using SAS cables in the Configuration listed in the table below.
  • Page 165 System Management User Guide Zoning Host connection (SAS Port) Enclosure IOM connection (SAS Port) Host 6 Host 6 Configuration 2: Configuration 2 allows up to three redundantly configured hosts to view a specific zone group of drives. Each host will be able to view up to 20 drives that are mapped to both IOMs. Each zone group will display all of the devices that are contained within that zone.
  • Page 166 System Management User Guide Zoning The left side of the table displays the host connection and the right side displays the enclosure IOM SAS port connection. Table 44: SAS Cable connections for Configuration 2 Host connection (SAS Port) Enclosure IOM connection (SAS Port) Host 1 Host 1 Host 1...
  • Page 167 System Management User Guide Zoning • Out-of-band management: Configuration 3 can be initiated in the out-of-band management by using 3 in the ZoningConfig option. See: Out-of-Band Management for the actual senddiag commands. Figure 183: Configuration 3 Each SAS port in the following image matches the color of another set of drives in that specific zone group. Connect the host servers to the enclosure using SAS cables in the Configuration listed in the table below.
  • Page 168: Sg_Senddiag Command

    System Management User Guide Zoning Host connection (SAS Port) Enclosure IOM connection (SAS Port) Host 2 Host 2 5.2.3 sg_senddiag Command The sg_senddiag command is used to configure zoning on Ultrastar Data60. This command contains several values that are important to enable and disable zoning through the use of the IOMs and expanders. The following section breaks down how to understand the necessary information to properly enable or disable zoning on the enclosure.
  • Page 169: Enabling Zoning Using Linux

    Identify the sg devices from the output. The devices can be identified by the /dev/sg<dev>. The devices appear as /dev/sg3 and /dev/sg106 bolded in the example below. /dev/sg3: scsi9 channel=0 id=43 lun=0 HGST H460-J 0101 [rmb=0 cmdq=1 pqual=0 pdev=0xd]...
  • Page 170 System Management User Guide Zoning b) Identify and match the IOM SAS address and sg device for both IOMs from the output. Each address appears bolded in the example below. Addressed logical unit: designator type: NAA, code set: Binary 0x5000ccab0300003c Target port: designator type: NAA, code set: Binary...
  • Page 171 System Management User Guide Zoning b) Use the example of the sg_senddiag command shown in the image above to complete the specific sg_senddiag command for IOM B. Replace letters a through d with the information recorded in previous steps. Figure 185: sg_senddiag Command a.
  • Page 172: Disabling Zoning Using Linux

    System Management User Guide Zoning 7. Verify the zone groups for each of the host using the smp_discover_list command. a) Issue the following command to locate the expander handles: ls /dev/bsg Example of the Expander Handles 0:2:0:0 9:0:1297:0 9:0:1378:0 9:0:1390:0 end_device-9:41:26 end_device-9:44:12 end_device-9:44:9...
  • Page 173 Identify the sg devices from the output. The devices can be identified by the /dev/sg<dev>. The devices appear as /dev/sg3 and /dev/sg106 bolded in the example below. /dev/sg3: scsi9 channel=0 id=43 lun=0 HGST H460-J 0101 [rmb=0 cmdq=1 pqual=0 pdev=0xd]...
  • Page 174 System Management User Guide Zoning a) Use the example of the sg_senddiag command shown in the image above to complete the specific sg_senddiag command for IOM A. Replace letters a through d with the information recorded in previous steps. Figure 186: sg_senddiag Command a.
  • Page 175 System Management User Guide Zoning c) The following are examples of completed sg_senddiag commands for IOM A and B. • IOM A: sg_senddiag /dev/sg3 --pf --raw=04,00,00,90,60,00,00,00,50,00,CC,AB,03,00,00,3C • IOM B: sg_senddiag /dev/sg106 --pf --raw=04,00,00,90,60,00,00,00,50,00,CC,AB,03,00,00,7C 5. Disable zoning on IOM A using the sg_senddiag command. a) Issue the command for IOM A that was built in the previous step.
  • Page 176: Enabling Zoning Using Windows

    -s | findstr /i H4060-J b) Identify the SCSI devices from the output. The device information follows SCSI0. The devices appear as SCSI0:1,62,0 and SCSI0:1,124,0 bolded in the example below. SCSI0:1,62,0 claimed=0 pdt=dh HGST H460-J 0101 0428 SCSI0:1,124,0 claimed=0 pdt=dh...
  • Page 177 System Management User Guide Zoning designator type: Relative target port, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) Relative target port: 0x1 Target device that contains addressed lu: designator type: NAA, code set: Binary transport: Serial Attached SCSI Protocol (SPL-4) 0x5000ccab0300003c 4.
  • Page 178 System Management User Guide Zoning Note: For information on preconfigured zoning configurations, see: Predefined Zoning Configurations on page 162. d. IOM SAS Address: SAS Address associated with IOM B Note: A comma should be placed after each bit of data in the IOM SAS Address that was recorded.
  • Page 179: Disabling Zoning Using Windows

    -s | findstr /i H4060-J b) Identify the SCSI devices from the output. The device information follows SCSI0. The devices appear as SCSI0:1,62,0 and SCSI0:1,124,0 bolded in the example below. SCSI0:1,62,0 claimed=0 pdt=dh HGST H4060-J 0101 0428 SCSI0:1,124,0 claimed=0 pdt=dh...
  • Page 180 System Management User Guide Zoning a) Issue the following command: sg_ses <dev> -p7 | finstr /i esce Note: For scsi<dev>, type the number of the SCSI device recorded in the previous step. b) The IP Address for each IOM will appear at the end of each resulting line. Each IP Address is labeled for either IOM A or IOM B and occurs after the last comma as seen bolded in the following example.
  • Page 181 System Management User Guide Zoning Note: For information on preconfigured zoning configurations, see: Predefined Zoning Configurations on page 162. d. IOM SAS Address: SAS Address associated with IOM A Note: A comma should be placed after each bit of data in the IOM SAS Address that was recorded.
  • Page 182 System Management User Guide Zoning the zoning configuration will be enabled. The zoning configuration can be verified after both IOMs have been zoned. send diagnostic: transport: Host_status=0x03 [DID_TIME_OUT] Driver_status=0x00 [DRIVER_OK] 6. Disable zoning on IOM B using the sg_senddiag command. a) Issue the command for IOM B that was built in the previous step.
  • Page 183: Partially Populated Enclosures

    System Management User Guide Partially Populated Enclosures b) Issue the following command to access a single host's SMP Discover output: smp_discover_list /dev/bsg/expander-9:39 Note: Repeat this substep for all expanders. c) Zone groups will not be visible due to zoning being disabled. All hosts will have access to all drives. d) Issue the following command to access all hosts smp_discover_list: smp_discover_list --ignore /dev/bsg/expander-9:39 5.3 Partially Populated Enclosures...
  • Page 184 System Management User Guide Partially Populated Enclosures installed into the enclosure, any unfinished rows must be completed with drive blanks. The image below details the minimum required configuration for an HDD only configuration. Figure 192: Minimum HDD Partial Population Minimum HDD and Minimum SSD Partial Population: The enclosure supports a minimum of 24 HDDs and one SSD for a partially populated enclosure.
  • Page 185 System Management User Guide Partially Populated Enclosures Note: When installing SSDs for this configuration, the preinstalled HDDs will have to be moved one entire row to the next vacant row near the front of the enclosure. Figure 193: Minimum HDD and Minimum SSD Partial Population Minimum HDD and Maximum SSD Partial Population: The enclosure supports a minimum of 24 HDDs and one SSD for a partially populated enclosure.
  • Page 186: Installing Drives

    System Management User Guide Partially Populated Enclosures Note: When installing SSDs for this configuration, the preinstalled HDDs will have to be moved two entire rows to the next vacant pair of rows near the front of the enclosure. Figure 194: Minimum HDD and Maximum SSD Partial Population 5.3.2 Installing Drives This section provides steps on how to install drives into the enclosure.
  • Page 187 System Management User Guide Partially Populated Enclosures 1. Grasp both handles at the front of the enclosure and pull with even pressure to extend the chassis out of the rack until it is stopped by the safety latches. The safety latches will prevent the enclosure from coming out of the rack completely and the cover will remain in the rack attached to the rear alignment brackets.
  • Page 188: Daisy Chaining

    System Management User Guide Daisy Chaining 5. Install each drive in the same way the first was installed. Make sure to follow the drive layout shown in the following image. Figure 198: Drive Layout 6. Push the enclosure back into the rack to ensure proper cooling. 5.4 Daisy Chaining 5.4.1 Daisy Chaining Configurations...
  • Page 189 System Management User Guide Daisy Chaining The following diagram identifies the host, host ports, IOM configuration, and IO SAS connections. Figure 199: Daisy Chaining Key One Host Configurations: The following diagram is an example of how the enclosures will be connected via the IO SAS ports and what number each enclosure is.
  • Page 190 System Management User Guide Daisy Chaining • Four SAS Enclosures: One Host with Two HBAs • Four SATA Enclosures: One Host with a Single HBA Two Host Configurations: The following diagram is an example of how the enclosures will be connected via the IO SAS ports and what number each enclosure is.
  • Page 191: One Host Cable Configurations

    System Management User Guide Daisy Chaining 5.4.2 One Host Cable Configurations This section provides the information required to connect two or more enclosures to a single host via SAS connections. Choose the cable map that fits the preferred daisy chaining requirement. Figure 202: Enclosure Configurations with One Host with a Single HBA Note: The diagram displays red SAS cables to indicate passive connections between the host and the enclosure.
  • Page 192 System Management User Guide Daisy Chaining Hardware Source Device Destination Device Enclosure2: IOMB, B3 Enclosure3: IOMB, B1 Table 48: Four Enclosures: One Host with a Single HBA Hardware Source Device Destination Device Host Connections Host1: P1 Enclosure1: IOMA, A1 Host1: P2 Enclosure3: IOMB, B3 Enclosure Connections Enclosure1: IOMA, A3...
  • Page 193 System Management User Guide Daisy Chaining Hardware Source Device Destination Device Enclosure Connections Enclosure1: IOMA, A3 Enclosure2: IOMA, A1 Enclosure1: IOMA, A4 Enclosure2: IOMA, A2 Enclosure1: IOMB, B3 Enclosure2: IOMB, B1 Enclosure1: IOMB, B4 Enclosure2: IOMB, B2 Table 50: Three Enclosures: One Host with Two HBAs Hardware Source Device Destination Device...
  • Page 194 System Management User Guide Daisy Chaining Hardware Source Device Destination Device Enclosure2: IOMB, B4 Enclosure3: IOMB, B2 Enclosure3: IOMA, A3 Enclosure4: IOMA, A1 Enclosure3: IOMA, A4 Enclosure4: IOMA, A2 Enclosure3: IOMB, B3 Enclosure4: IOMB, B1 Enclosure3: IOMB, B4 Enclosure4: IOMB, B3 Figure 204: SATA Enclosure Configuration One Host with a Single HBA Note: The diagram displays red SAS cables to indicate passive connections between the host and the enclosure.
  • Page 195: Two Host Cable Configurations

    System Management User Guide Daisy Chaining Hardware Source Device Destination Device Enclosure3: IOMA, A3 Enclosure4: IOMA, A1 Enclosure3: IOMA, A4 Enclosure4: IOMA, A2 5.4.3 Two Host Cable Configurations This section provides the information required to connect two or more enclosures to two hosts via SAS connections.
  • Page 196 System Management User Guide Daisy Chaining Hardware Source Device Destination Device Host1: P2 Enclosure3: IOMB, B6 Host2: P1 Enclosure1: IOMB, B1 Host2: P2 Enclosure3: IOMA, A6 Enclosure Connections Enclosure1: IOMA, A3 Enclosure2: IOMA, A1 Enclosure1: IOMA, A4 Enclosure2: IOMA, A2 Enclosure1: IOMB, B3 Enclosure3: IOMB, B1 Enclosure1: IOMB, B4...
  • Page 197 System Management User Guide Daisy Chaining Hardware Source Device Destination Device Enclosure3: IOMB, B4 Enclosure4: IOMB, B2 Figure 206: Enclosure Configurations with Two Hosts with Two HBAs Note: The diagram displays red SAS cables to indicate passive connections between the host and the enclosure.
  • Page 198 System Management User Guide Daisy Chaining Hardware Source Device Destination Device Enclosure1: IOMB, B4 Enclosure2: IOMB, B2 Table 57: Three Enclosures: Two Hosts with Two HBAs Hardware Source Device Destination Device Host Connections Host1: P1 Enclosure1: IOMA, A1 Host1: P2 Enclosure3: IOMB, B3 Host1: P3 Enclosure1: IOMA, A2...
  • Page 199: Cabling For Daisy Chaining

    System Management User Guide Daisy Chaining Hardware Source Device Destination Device Enclosure1: IOMB, B3 Enclosure2: IOMB, B1 Enclosure1: IOMB, B4 Enclosure2: IOMB, B2 Enclosure2: IOMA, A3 Enclosure3: IOMA, A1 Enclosure2: IOMA, A4 Enclosure3: IOMA, A2 Enclosure2: IOMB, B3 Enclosure3: IOMB, B1 Enclosure2: IOMB, B4 Enclosure3: IOMB, B2 Enclosure3: IOMA, A3...
  • Page 200 System Management User Guide Daisy Chaining a "criss-cross" pattern. See the Special Considerations for Cable Routing on page 142 for more information. Figure 207: Connected Cable Routing c) Open all of the baskets Figure 208: Open Baskets d) Connect all of the SAS cables that will be used and route them through the baskets one at a time. Make sure to follow the labels to make sure they are connected to the proper port.
  • Page 201 System Management User Guide Daisy Chaining Note: Each cable must be given enough slack at the connector end to operate smoothly. For the lower CMA allow 20" - 21" (508 – 533.4mm) between the connector and the first basket. Figure 209: Nominal Cable Length at Connectors f) Close all of the baskets.
  • Page 202 System Management User Guide Daisy Chaining c) Open all of the baskets Figure 210: Open Baskets a) Connect the SAS cables and route them through the baskets one at a time. Make sure to follow the labels to make sure they are connected to the proper port. b) Connect the power cable to the lower PSU and route it through each basket.
  • Page 203 System Management User Guide Daisy Chaining Note: Each cable must be given enough slack at the connector end to operate smoothly. For the upper CMA allow 20" - 21" (508 – 533.4mm) between the end of the connector and the first basket.
  • Page 204: Chapter 6 Safety

    6.1 Electrostatic Discharge CAUTION Electrostatic discharge can harm delicate components inside HGST products. Electrostatic discharge (ESD) is a discharge of stored static electricity that can damage equipment and impair electrical circuitry. It occurs when electronic components are improperly handled and can result in complete or intermittent failures.
  • Page 205: Power Cords

    All maintenance and service actions appropriate to the end-users are described in the product documentation. All other servicing should be referred to an HGST-authorized service technician. To avoid shock hazard, turn off power to the unit by unplugging both power cords before servicing the unit.
  • Page 206: Safety Warnings And Cautions

    Safety User Guide Safety Warnings and Cautions The power supply in this product contains no user-serviceable parts. Do not open the power supply. Hazardous voltage, current and energy levels are present inside the power supply. Return to manufacturer for servicing. Use caution when accessing part of the product that are labeled as potential shock hazards, hazardous access to moving parts such as fan blades or caution labels.
  • Page 207: Chapter 7 Disclaimers

    Disclaimers User Guide Restricted Access Location Chapter 7 Disclaimers Learn about the Regulatory, Safety, and Electromagnetic standards for which this product is compliant. The following chapter describes the Regulatory Statement of Compliance, Safety Compliance, and Electromagnetic Compatibility Agency Requirements for the Ultrastar Data60. 7.1 Restricted Access Location The Ultrastar Data60 is intended for installation in a server room or computer room where at least one of the following conditions apply:...
  • Page 208: Country Certifications

    Disclaimers User Guide Country Certifications • TR CU 020/2011 Immunity • EN 61000-3-2 Harmonic Current Emissions • EN 61000-3-3 Voltage Fluctuations and Flicker • EN 55024 • KN35 • EN 61000-4-2 ESD • EN 61000-4-3 Radiated Immunity • EN 61000-4-4 EFT •...
  • Page 209: Chapter 8 Regulatory Statements

    Any modifications made to this device that are not approved by HGST may void the authority granted to the user by the FCC to operate equipment.
  • Page 210: Taiwan Warning Label Statement, Class A Ite

    Regulatory Statements User Guide Taiwan Warning Label Statement, Class A ITE English translation: This is a Class A product based on the Technical Requirement of the Voluntary Control Council for Interference by Information Technology (VCCI). In a domestic environment, this product may cause radio interference, in which case the user may be required to take corrective actions.
  • Page 211: Chapter 9 Points Of Contact

    User Guide Chapter 9 Points of Contact For further assistance with an HGST product, contact Platform Engineering technical support. Please be prepared to provide the following information: Serial Number (S/N), product name, model number, and a brief description of the issue.
  • Page 212: Appendix A Site And System Operation Requirements

    Site and System Operation Requirements User Guide Power Requirements Appendix A Site and System Operation Requirements A.1 Power Requirements The following table describes the A/C input power specification for the Ultrastar Data60. Table 60: AC Power Specifications Power Alternating Current (AC) Power Supply (2 per enclosure) Supply Rating: 80 PLUS Platinum rated Wattage (per power supply) Max Power Consumption:~1250W...
  • Page 213 Site and System Operation Requirements User Guide List of Supported Server Components Product Clock Frequency Cores L4 Cache Wattage Intel Xeon Gold 6140 2.30GHz 18 Cores 24.75MB 140W Table 62: List of Supported DIMMs Brand Model Number Size Type Form Factor Rank Speed Samsung...
  • Page 214: Ultrastar Data60 Rack Requirements

    Site and System Operation Requirements User Guide Ultrastar Data60 Rack Requirements Brand Model Type Connection Speed Broadcom 9305-16e External SAS HBA 12Gb/s Broadcom 9305-16i External SAS HBA 12Gb/s Broadcom 9300-16i External SAS HBA 12Gb/s Broadcom 9300-8e External SAS HBA 12Gb/s Broadcom 9300-8i External SAS HBA...
  • Page 215: Compatible Hardware Configuration

    Site and System Operation Requirements User Guide Ultrastar Data60 Rack Requirements The following section provides specific information necessary to install, service, and remove the Ultrastar Data60. The installation of the Ultrastar Data60 requires two people and a space of 914.4mm / 36in. in front of the installation space.
  • Page 216: Esd

    Site and System Operation Requirements User Guide Parameter Rack PDU (Vertical) PDU Mounting Additional Mounting Bracket Bracket Hardware Quantity Varies Table 66: Compatible Hardware Configuration 2 Parameter Rack PDU (Vertical) PDU Mounting Additoinal Mounting Bracket Bracket Hardware Vendor AFCO/Legrand Server Technology Server Technology Various Part...
  • Page 217: Enclosure Cooling

    Site and System Operation Requirements User Guide Enclosure Cooling A.6 Enclosure Cooling The Ultrastar Data60 has an advanced thermal algorithm running within the logical enclosure services process called the SEP that monitors all of the temperature sensors in the enclosure. The SEP makes adjustments to the fan speeds based upon the thermal sensors.
  • Page 218 Site and System Operation Requirements User Guide Host Connectivity Type Part Number Vendor Part Number Passive - Amphenol FCI I/O Cable, HD Mini-SAS to HD 10117949-4030LF Mini-SAS, 3m, 26AWG Passive - Amphenol FCI I/O Cable, HD Mini-SAS to HD 10117949-4040LF Mini-SAS, 4m, 26AWG Passive - Molex I/O Cable, HD Mini-SAS to HD Mini-SAS, 1110751004...

Table of Contents