Page 1 Oracle ZFS Storage Appliance Customer ® Service Manual For ZS5-x, ZS4-4, ZS3-x, 7x20 Controllers, and DEx-24, Sun Disk Shelves, Release OS8.6.x Part No: E76485-02 December 2016...
Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l’accès à...
Page 5: Table Of Contents
Configuring the Management Port .............. 32 Using Oracle ILOM to Diagnose Hardware Faults .......... 33 ▼ Logging in to Oracle ILOM Using a Local Serial Connection .... 33 ▼ Logging in to Oracle ILOM Remotely Using a Web Interface .... 34 ▼ Logging in to Oracle ILOM Remotely Using a Command Line...
Page 6 Servicing the ZS5-4 Controller ................ 57 ▼ Replacing a ZS5-4 HDD ................ 57 ▼ Replacing a ZS5-4 Fan Module .............. 59 ▼ Replacing a ZS5-4 Power Supply .............. 63 ▼ Replacing a ZS5-4 DIMM ................. 66 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 7 Contents ▼ Replacing a ZS5-4 Memory Riser Card ............ 69 ▼ Replacing or Adding a ZS5-4 PCIe Card ............ 72 ▼ Replacing a ZS5-4 System Battery .............. 78 ZS5-4 Controller Hardware Overview ............... 82 ZS5-4 Configuration Options .............. 82 ZS5-4 Front and Rear Panel Components .......... 83 ZS5-4 Specifications ................
Page 8 ▼ Replacing a ZS3-2 Flash Drive .............. 244 ▼ Replacing a ZS3-2 Battery ............... 246 ZS3-2 Controller Hardware Overview ............. 248 ZS3-2 Base Configuration .............. 248 ZS3-2 Front and Rear Panel Components .......... 249 ZS3-2 Specifications ................ 253 ZS3-2 Internal Components .............. 254 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 9 Contents ZS3-2 PCIe I/O Cards ................ 261 ZS3-2 Optional Cable Management Arm .......... 262 ZS3-2 Attached Storage ................ 263 Servicing the 7x20 Controller ................ 265 ▼ Replacing a 7x20 HDD or SSD .............. 265 ▼ Replacing a 7x20 Fan Module .............. 267 ▼ Replacing a 7x20 Power Supply .............. 272 ▼...
Page 10 ▼ Retrying a Failed Support Bundle Upload (CLI) ........... 395 ▼ Canceling a Pending Support Bundle Operation (BUI) ........ 396 ▼ Canceling a Pending Operation (CLI) ............ 396 ▼ Deleting a Support Bundle (BUI) .............. 396 ▼ Deleting a Support Bundle (CLI) ............... 396 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 11 Contents Performing the Initial Setup ................ 399 Restarting the Appliance ................. 401 Performing a Factory Reset ................ 403 Backing Up the Configuration ................. 405 Configuration Backup Contents .............. 405 Configuration Restore Impact ................ 406 Security Considerations for Configuration Backups .......... 408 ▼ Creating a Configuration Backup (BUI) ............ 408 ▼...
Page 12 Multiple Initiator Groups per LUN Deferred Update .......... 450 Large Block Sizes Deferred Update .............. 451 Sequential Resilvering Deferred Update ............ 451 NDMP-zfs Replica Backup Deferred Update ............ 451 ACL Passthrough with Mode Preservation Deferred Update ........ 452 Understanding Deferred Updates .............. 452 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 13 Contents Working with Firmware Updates .............. 455 ▼ Checking the Status of Firmware Updates (BUI) .......... 457 ▼ Checking the Status of Firmware Updates (CLI) .......... 457 Rolling Back System Software ................ 459 ▼ Fail-safe Rollback ................... 459 ▼ Rolling Back the System Software (BUI) ............ 460 ▼...
Page 14 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 15: Servicing The Oracle Zfs Storage Appliance
Servicing the Oracle ZFS Storage Appliance This document encompasses the following sections that describe maintenance procedures for the Oracle ZFS Storage Appliance. To service the appliance hardware components, use the following sections: “Getting Started with Servicing the Hardware” on page 17 ■...
Page 16 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 17: Getting Started With Servicing The Hardware
■ “CLI Hardware View” on page 28 ■ “Configuring the Management Port” on page 32 ■ “Using Oracle ILOM to Diagnose Hardware Faults” on page 33 ■ “Understanding Hardware Status” on page 35 ■ “Working with Problems” on page 38 ■...
Page 18: Introduction To The Cli
Leave this detailed view Power off, reboot, or diagnostic reboot Click for more details Offline disk Hardware component is ok Port active (green) Hardware component is Port inactive not present (grey) Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 19: Viewing The Remaining Ssd Endurance (Bui)
Viewing the Remaining SSD Endurance (BUI) Icon Description Icon Description Hardware component is faulted (amber) Viewing the Remaining SSD Endurance (BUI) Use the following procedure to view the remaining SSD endurance. Go to Maintenance > Hardware. Click Show Details to view controller details. Click Disk.
Page 20: Setting A Threshold Alert For Ssd Endurance (Bui)
In the Threshold field, select SSD: Endurance on any device and specify and its parameters. Specify the parameters for Timing and Alert actions. (Optional) Click TEST to verify the settings. Click APPLY. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 21: Viewing Cpu Details (Bui)
Viewing CPU Details (BUI) Viewing CPU Details (BUI) Use the following procedure to view CPU details. Go to Maintenance > Hardware. Click Show Details to view controller details. Click CPU. Hover over a CPU row and click its information icon .
Page 22: System Chassis
(power cycle), or reboot the appliance with diagnostics. Only select the diagnostic reboot option when instructed by Oracle Service personnel because it could take a long time to complete and could have adverse results if not performed properly. Do not perform a diagnostic reboot when system-affecting operations are occurring, such as upgrading firmware, executing commands, and configuring or unconfiguring storage.
Page 23: Disk Shelves
Viewing CPU Details (BUI) Property Description If there are no cache devices installed in the system chassis, "-" will be displayed. Size and number of log disks in the system chassis. This is only valid for standalone systems. If there are no log devices installed in the system chassis, "-"...
Page 24: Chassis Details View
Chassis Component Properties TABLE 4 Property Description Label Human-readable identifier for this component within the chassis. This is typically, but not necessarily, equivalent to the label printed on the physical chassis. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 25: Disk Shelf Details View
Chassis Details View Property Description FMRI Fault managed resource identifier (FMRI) for the component. This is an internal identifier used to identify the component within faults and is intended for service personnel. Active Problems For a faulted component, links to active problems affecting the component. Manufacturer Component manufacturer.
Page 26 Faulted devices are already avoided, so this option should only be required if a disk is exhibiting performance problems that do not result in pathological failure. It is not Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 27: Ssd Endurance
You can set a threshold alert when an SSD exceeds a specified percentage. For example, set an alert to occur when one or more SSD devices exceeds a 95% threshold. For more information, see “Threshold Alerts” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x.
Page 28: Service Processor
CPU 1 Quad-Core AMD Op cpu-002 CPU 2 Quad-Core AMD Op cpu-003 CPU 3 Quad-Core AMD Op disk-000 HDD 0 STEC MACH8 IOPS disk-001 HDD 1 STEC MACH8 IOPS Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 29: Component Properties
CLI Hardware View disk-002 HDD 2 absent disk-003 HDD 3 absent disk-004 HDD 4 absent disk-005 HDD 5 absent disk-006 HDD 6 HITACHI HTE5450SASUN500G disk-007 HDD 7 HITACHI HTE5450SASUN500G fan-000 FT 0 unknown ASY,FAN,BOARD,H2 fan-001 FT 0 FM 0 Sun Microsystems, Inc. 541-2068 fan-002 FT 0 FM 1 Sun Microsystems, Inc.
Page 30: Viewing The Remaining Ssd Endurance (Cli)
= 2014-3-3 22:04:14 locate = false offline = false As shown above, disk-015 is at 100% which indicate a new SSD. The remaining endurance estimate decreases as the disk is used. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 31: Setting A Threshold Alert For Ssd Endurance (Cli)
Setting a Threshold Alert for SSD Endurance (CLI) Setting a Threshold Alert for SSD Endurance (CLI) Use the following procedure to set a threshold alert for SSD endurance. To set a threshold alert for SSD endurance, use the following CLI commands: hostname:configuration alerts>...
Page 32: Performing A Diagnostic Reboot (Cli)
= 4 speed = 2.14G Performing a Diagnostic Reboot (CLI) Only issue the diagnostic reboot command as instructed by Oracle Service personnel. Caution - A diagnostic reboot gathers diagnostic information before power cycling the appliance. This operation could take a long time to complete and could cause adverse results if not performed properly.
Page 33: Using Oracle Ilom To Diagnose Hardware Faults
In rare cases, faults associated with uncorrectable CPU errors are not diagnosable or displayed in the controller. These faults are preserved by and observable on the Oracle Integrated Lights Out Manager (ILOM), which resides in the Service Processor (SP). Connect to the server ILOM to diagnose hardware faults that do not appear in the BUI.
Page 34: Logging In To Oracle Ilom Remotely Using A Web Interface
Logging in to Oracle ILOM Remotely Using a Web Interface Use the following procedure to log in to Oracle ILOM remotely using a web interface. This procedure requires that you know the administrative account name and password (defaults Before You Begin are root and changeme), and that you know the IP address or host name of the controller Service Processor (SP).
Page 35: Viewing And Clearing Cpu Faults From Ilom
IP address or host name of the controller Service Processor (SP). Using a Secure Shell (SSH) session, log in to Oracle ILOM by specifying your administrative account user name and the IP address or host name of the controller SP.
Page 36: Locating The Chassis Serial Number
You can find a chassis serial number label on the storage controller front panel on the left side. Another label is on the top of the storage controller. You can click the Sun/Oracle logo in the BUI masthead to obtain the serial number.
Page 37 Locating a Failed Component (CLI) Go to the maintenance hardware context: hostname:> maintenance hardware List the appliance components: hostname:maintenance hardware> list NAME STATE MODEL SERIAL chassis-000 hostname Sun Storage 7320 unknown chassis-001 000000000C faulted J4410 000000000C Select the chassis and list its components: hostname:maintenance hardware>...
Page 38: Working With Problems
(defects, often included under faults) and reports them as active problems on this screen. If the phone home service is enabled, active problems are automatically reported to Oracle Support, where a support case may be opened depending on the service contract and the nature of the fault.
Page 39: Repairing Active Problems
If a problem persists after completing the suggested action, contact Oracle support. You might be instructed to mark the problem as repaired. Manually marking a problem as repaired should only be done under the direction of Oracle service personnel or as part of a documented Oracle repair procedure.
Page 40: Related Features
Example BUI Alert Log Entry Displays TABLE 10 Time Event ID Description Type 2013-9-16 13:01:56 An I/O path from slot 'PCIe 0' to chassis Major alert f18bbad1- 'JBOD #1' has been removed. 8084-4cab-c950- 82ef5b8228ea Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 41: Fault Log Entries
This is configured in the Alerts section. All alerts appear in this log, regardless of whether they have actions configured for them. For more information about alerts, see “Configuring Alerts” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x.
Page 42: System Log Entries
Session Annotation 2013-10-12 05:20:24 root deimos Disabled ftp service 2013-10-12 03:17:05 root deimos User logged in 2013-10-11 22:38:56 root deimos Browser session timed out 2013-10-11 21:13:35 root <console> Enabled ftp service Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 43: Phone Home Log Entries
Viewing Logs (BUI) Phone Home Log Entries If Phone Home is used, this log shows communication events with Oracle support. For information about Phone Home, see “Phone Home Configuration” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. The following is an example phone home entry as it would appear in the BUI:...
Page 44: Viewing All Log Entries (Cli)
To view up to 100 log entries at a time, use the following CLI commands: hostname:maintenance logs> select audit hostname:maintenance logs audit> show ENTRY TIME SUMMARY entry-2874 2014-2-20 18:05:44 root, 10.159.134.211, Beginning system update Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 45 2014-2-20 18:18:20 root, 10.159.134.211, Deleted update media ak-nas@2011.04.24.8.0,1-1.43 entry-2879 2014-2-20 18:34:19 root, 10.159.134.211, Cluster takeover requested entry-2970 2014-2-27 17:40:37 root, dhcp-amer-vpn-rmdc-anyconnect-10-159-100-157.vpn.oracle. com, User logged out of CLI entry-2971 2014-2-27 17:48:23 root, 10.159.100.157, User logged in entry-2972 2014-2-27 19:05:46 root, 10.159.100.157, Browser session timed out entry-2973 2014-2-27 23:53:31 root, dhcp-amer-vpn-rmdc-anyconnect-10-159-125-20.vpn.oracle.
Page 46: Viewing Entry Details (Cli)
Use the following procedure to export logs using the BUI. You can export any combination of log types to your local machine by using the BUI Collect button. To view logs, navigate to the Maintenance > Logs screen. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 47: Exporting Logs (Cli)
Exporting Logs (CLI) Click Collect. In the Collect Logs dialog box, choose the log types you want to export. To export the logs, click Apply. A <stdout> gz file containing all the requested log information is downloaded to your local machine. Exporting Logs (CLI) Use the following procedure to export logs using the CLI.
Page 48 IMPACT: Performance degradation of the system due to the original fault may have been recovered. REC-ACTION: No action is required. hostname:maintenance logs fltlog> Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 49: Using Workflows
Using Workflows Using Workflows A workflow is a script that is uploaded to and managed by the Oracle ZFS Storage Appliance by itself. For information on scripting, see “Working with CLI Scripting” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x.
Page 50 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 51: Prerequisites For Servicing Hardware
Follow all cautions, warnings, and instructions marked on the equipment and described in ■ Important Safety Information for Oracle's Hardware Systems included with your system. Ensure that the voltage and frequency of your power source match the voltage inscribed on ■...
Page 52: Required Tools And Information
If you have not completed the initial configuration steps, power off the controller using one of the following methods: Use a pen or non-conducting pointed object to press and release the Power button on the ■ front panel. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 53: Extending The Storage Controller From The Rack
Extending the Storage Controller from the Rack SSH or use a serial connection to log in to the service processor (SP), and then issue the ■ command stop /SYS. To initiate an emergency shutdown during which all applications and files will be closed ■...
Page 54: Removing The Top Cover
To access internal controller components for servicing, remove the top cover. Use the following procedure to remove the top cover. Fully loosen the two captive screws at the rear of the top cover (1). Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 55: Powering Off The Disk Shelf
Powering Off the Disk Shelf Slide the top cover rearward 0.5 in (13 mm) and lift it straight up and off the chassis (2), and set the top cover aside. Powering Off the Disk Shelf Most disk shelf components are hot-swappable; you do not need to remove power when replacing them.
Page 56 Note - Related Topics “Powering Off the Controller” on page 52 ■ For details on NSPF profiles, see “Storage Pool Concepts” in Oracle ZFS Storage ■ Appliance Administration Guide, Release OS8.6.x Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 57: Servicing The Zs5-4 Controller
HDDs are hot-swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities. Use the following procedure to replace a ZS5-4 HDD. For information on disk compatibility, see the Oracle Systems Handbook. Servicing the ZS5-4 Controller...
Page 58 On the drive you want to remove, push the drive release button (1) to open the latch. Grasp the latch (2) and pull the drive out of the drive slot (3). Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 59: Replacing A Zs5-4 Fan Module
(1) until it is fully seated. Close the latch (2) to lock the drive in place. Oracle ZFS Storage Appliance software automatically detects and configures the new drive. Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow...
Page 60 Remove the top cover as described in “Removing the Top Cover” on page Lift the green handle at the top of the fan module to unlock the module, and pull the module straight up and out. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 61 Replacing a ZS5-4 Fan Module Excessive movement or rocking of the fan module during removal can cause damage Caution - to the internal connector on the fan module board. When removing a fan module, do not rock it back and forth. Position the replacement fan module so the connector on the bottom of the module is aligned with the connector on the inside of the slot and all keying and labeling are correctly positioned.
Page 62 Verify that the green OK indicator is lit. Verify that the Top Fan indicator and the Service Action Required indicator on the server front panel are not lit. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 63: Replacing A Zs5-4 Power Supply
Replacing a ZS5-4 Power Supply Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon for the controller, click Fan, and verify that the status icon is green for the newly installed fan module. To view details about the new fan module, click its information icon.
Page 64 Align the power supply with the empty power supply bay. Slide the power supply into the bay (1) until it stops. To seat the power supply, rotate the release handle upward (2) until it locks in place. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 65 Replacing a ZS5-4 Power Supply The latch at the hinge of the handle must engage the slot at the bottom of the power Note - supply bay. This action of rotating the handle upward draws the power supply into the server and engages it with the internal connector.
Page 66: Replacing A Zs5-4 Dimm
Remove the memory riser card in which the faulted DIMM resides. See “Replacing a ZS5-4 Memory Riser Card” on page 69 Rotate both DIMM slot ejector levers outward as far as they will go. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 67 Replacing a ZS5-4 DIMM The action unlocks the DIMM and expels it from the socket. Carefully lift the DIMM straight up to remove it from the socket. Repeat the above steps until all faulty DIMMs are removed. Ensure that the DIMM ejector levers at both ends of the DIMM slot are in their fully open position.
Page 68 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Reconnect the power cords to the power supplies. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 69: Replacing A Zs5-4 Memory Riser Card
Replacing a ZS5-4 Memory Riser Card Verify that standby power is on. Approximately two minutes after plugging in the power cords, the Power/OK status indicator on the front panel flashes. Press and release the recessed Power button on the storage controller front panel.
Page 70 On the replacement memory riser card, ensure that all populated and unpopulated DIMM slot ejector levers are in the closed and locked position. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 71 Replacing a ZS5-4 Memory Riser Card Open DIMM ejector levers can break off during the installation of the memory riser Caution - card. All populated and unpopulated DIMM slot ejector levers on the memory riser card must be in the fully closed and locked position before installing the card in the controller. Ensure that all populated and unpopulated DIMM slot ejector levers are in the closed and locked position.
Page 72: Replacing Or Adding A Zs5-4 Pcie Card
HBA as described in “Upgrading the Software” on page 419. All HBAs must be of the same type. Use the following procedure to replace or add a ZS5-4 PCle card. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 73 Replacing or Adding a ZS5-4 PCIe Card Identify the PCIe card slot location. If replacing a faulted PCIe card, identify the PCIe card to be replaced. ■ Go to the Maintenance > Hardware section of the BUI, click the right-arrow icon for the controller, click Slot, and note the ID of the faulted PCIe card, which has an amber icon.
Page 74 Replacing or Adding a ZS5-4 PCIe Card To disengage the PCIe card retaining bar, push down on the bar, move it away from the server back wall, and lift it to an upright position. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 75 Replacing or Adding a ZS5-4 PCIe Card Carefully remove the PCIe card from the PCIe card slot. Whenever you remove a PCIe card, you should replace it with another PCIe card or a Caution - filler panel; otherwise, the controller might overheat due to improper airflow. Ensure the PCIe card retaining bar is open.
Page 76 Replacing or Adding a ZS5-4 PCIe Card Install the replacement PCIe card into the PCIe card slot. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 77 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide.
Page 78: Replacing A Zs5-4 System Battery
Extend the controller from the rack as described in “Extending the Storage Controller from the Rack” on page Remove the top cover as described in “Removing the Top Cover” on page Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 79 Replacing a ZS5-4 System Battery The battery (1) is located toward the back of the controller between PCIe slot 1 and the power supply side wall. If necessary, remove the PCIe card in slot 1 to access the battery. See “Replacing or Adding a ZS5-4 PCIe Card”...
Page 80 Press the new battery into the battery holder with the positive (+) side facing the metal tab that holds it in place. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 81 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide.
Page 82: Zs5-4 Controller Hardware Overview
“Setting Clock Synchronization (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. ZS5-4 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage ZS5-4 controller. “ZS5-4 Configuration Options” on page 82 ■ “ZS5-4 Front and Rear Panel Components” on page 83 ■...
Page 83: Zs5-4 Front And Rear Panel Components
PCIe Slots 4-port (4x4) SAS-2 6 Gb/s external The most recent component specification is located at https://www.oracle.com/storage/ nas/index.html. ZS5-4 Front and Rear Panel Components ZS5-4 Front Panel Components - The ZS5-4 controller drive slots and front panel components are shown in the following figure.
Page 84 18 Fourth PCIe (slot 1) PCIe (slot 3) 19 System status LEDs (left to right) 20 PSU 1 AC inlet 21 PSU 0 AC inlet ■ Power/OK (green) ■ Attention (amber) ■ Locate (white) Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 85 The service processor NET MGT port is the optional connection to the Oracle ILOM service processor. The NET MGT port is configured by default to use Dynamic Host Configuration Protocol (DHCP). The service processor NET MGT port uses an RJ-45 cable for a 10/100/1000BASE-T connection.
Page 86 The service processor SER MGT port uses an RJ-45 cable and is the default connection to the Oracle ILOM service processor. This port supports local connections to the server and only recognizes Oracle ILOM command-line interface (CLI) commands. Typically you connect a terminal or terminal emulator to this port.
Page 87: Zs5-4 Specifications
17.2 in./436.5 mm Weight (Maximum) 88 lb./40 kg ZS5-4 Electrical Specifications: The ZS5-4 controller has two hot-swappable rear accessible power supplies with N+N redundancy. To understand the overall power consumption, see Oracle's online power calculator at http://www.oracle.com/goto/powercalculators. Servicing the ZS5-4 Controller...
Page 88: Zs5-4 Internal Components
75 dBA (bystander position, max. ambient). ZS5-4 Internal Components The components of the ZS5-4 controller are shown in the following figure and identified in the legend. ZS5-4 Internal Components FIGURE 4 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 89 ZS5-4 Controller Hardware Overview Callout Description Callout Description Motherboard Storage drive backplane board SP card Heatsinks and CPUs (4) HBA card Memory riser cards (8) Power supplies (2) Fan modules (6) System battery Fan board Power supply backplane Storage drive slots (2) HBA SAS cables (2) Servicing the ZS5-4 Controller...
Page 90 ZS5-4 Internal Components (Exploded View) FIGURE 5 Callout Description Callout Description Power supplies Memory riser card Power supply backplane board Motherboard SP card Storage drive System battery Fan module HBA card Fan board Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 91 ZS5-4 Controller Hardware Overview Callout Description Callout Description Storage drive backplane board Heatsink Controller chassis Cover ZS5-4 Storage Drive This section shows the location and explains the functions of the storage drive status indicators. Callout Description Ready to Remove (blue) Service Action Required (amber) OK/Activity (green) ZS5-4 Fan Module...
Page 92 The slots are accessible from the back of the controller. From the back of the controller, the left slot is designated as PS-0, and the right slot is PS-1. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 93 ZS5-4 Controller Hardware Overview Callout Description PS 1 PS 0 The two power supplies ensure redundancy by allowing the controller to operate when one of the power supplies fails. However, when the controller is operating on one power supply, redundancy no longer exists, and the risk for an unexpected shut down and a loss of data is high.
Page 94 12 slots. The slots are designated numerically from top to bottom. The left bank of slots are designated as D0–D6. The right bank of slots are designated as D7–D11. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 95 ZS5-4 Controller Hardware Overview Callout Description Callout Description Slot D0 Slot D6 Slot D1 Slot D7 Slot D2 Slot D8 Slot D3 Slot D9 Slot D4 Slot D10 Slot D5 Slot D11 Memory Riser layout: The following illustration shows the DIMM slot and channel designations on the memory riser card: Call Out Description...
Page 96: Zs5-4 Cpus And Memory Riser Card
The eight memory riser (MR) card slots are located between the fan module slots and the CPU sockets. Consecutively from right to left, the rightmost slot is slot 0, and the leftmost slot is slot Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 97 ZS5-4 Controller Hardware Overview The slots are also designated by their association with the four CPU sockets (P0-P3). Two slots are assigned to each CPU socket. For example, slots 0 and 1 are paired with CPU socket, P0, and are designated as P0/MR0 and P0/MR1. Slots 2 and 3 are paired with CPU socket, P1 and are designated as P1/MR0 and P1/MR1.
Page 98 CPUs are labeled from right to left when viewed from the front of the controller as follows: Each CPU has two assigned card slots (MR0 and MR1). Note - P0/MR0 (rightmost slot) ■ P0/MR1 ■ P1/MR0 ■ P1/MR1 ■ Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 99 ZS5-4 Controller Hardware Overview P2/MR0 ■ P2/MR1 ■ P3/MR0 ■ P3/MR1 (leftmost slot) ■ The following illustration shows the numbering for the memory riser slots and their associated CPUs as described above: Memory Riser Card Population Rules The memory riser population rules for the controller are as follows: 1.
Page 100: Zs5-4 Pcie Slots
PCI-1 to PCI-6. The five slots on the left are designated as PCI-7 to PCI-11. Callout Description Callout Description PCIe 1 PCIe 7 PCIe 2 PCIe 8 PCIe 3 PCIe 9 PCIe 4 PCIe 10 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 101: Zs5-4 Attached Storage
ZS5-4 Controller Hardware Overview Callout Description Callout Description PCIe 5 PCIe 11 PCIe 6 PCIe Slot Length and Capabilities The controller contains eleven low-profile PCIe 2.0 card slots, which have the following length and capabilities: Slots 1, 2, 3, 4, 5, 6, 7, 9 and 10 have x8 connectors (x8 electrical interface) ■...
Page 102 For disk shelf configuration details, see “Disk Shelf Configurations” on page 384. The ZS5-4 does not support the Sun Disk Shelf. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 103: Servicing The Zs5-2 Controller
HDDs are hot-swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities. Use the following procedure to replace a ZS5-2 HDD. For information on disk compatibility, see the Oracle Systems Handbook. Servicing the ZS5-2 Controller...
Page 104 BUI to flash the locator indicator on the faulted drive. To remove a faulted drive, press the release button and pivot the release lever open to the right. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 105 Replacing a ZS5-2 HDD Grasp the release lever, pull the drive out of the chassis, and set the drive aside. After at least 30 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present.
Page 106: Replacing A Zs5-2 Fan Module
Press the release lever fully closed until it clicks, securing the drive into the chassis. Oracle ZFS Storage Appliance software automatically detects and configures the new drive. Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow...
Page 107 Replacing a ZS5-2 Fan Module Power off the storage controller as described in “Powering Off the Controller” on page Disconnect the AC power cords from the rear panel of the storage controller. Because 3.3 VDC standby power is always present in the system, you must unplug Caution - the power cords before accessing any cold-serviceable components.
Page 108 Align the replacement fan module with the fan tray slot. The green band is on the top of the fan module and the arrow points to the rear of the chassis. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 109 Replacing a ZS5-2 Fan Module Lower the fan module into the fan tray. Servicing the ZS5-2 Controller...
Page 110 Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon for the controller, click Fan, and verify that the status icon is green for the Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 111: Replacing A Zs5-2 Power Supply
Replacing a ZS5-2 Power Supply newly installed fan module. To view details about the new fan module, click its information icon. If a fault does not self-clear, see “Repairing Active Problems” on page Replacing a ZS5-2 Power Supply If a power supply fails and you do not have a replacement available, do not remove Caution - the failed power supply.
Page 112 Replacing a ZS5-2 Power Supply Press and hold the CMA release tab (a), and rotate the arm out of the way (b). Disconnect the power cord from the faulted power supply. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 113 Replacing a ZS5-2 Power Supply Press the release tab toward the right while pulling on the handle. Servicing the ZS5-2 Controller...
Page 114 Continue to pull on the handle to slide the power supply out of the chassis. Set the power supply aside. Align the replacement power supply with the chassis slot. The PDB connector is toward the chassis, and the release tab is on the left. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 115 Slide the replacement power supply into the chassis until the release tab clicks. Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide.
Page 116: Replacing A Zs5-2 Dimm
Extend the controller from the rack as described in “Extending the Storage Controller from the Rack” on page Remove the top cover as described in “Removing the Top Cover” on page Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 117 Replacing a ZS5-2 DIMM Press the Fault Remind button on the motherboard to illuminate the DIMM fault LED. Servicing the ZS5-2 Controller...
Page 118 Replacing a ZS5-2 DIMM To remove the faulted DIMM, press down and out on the release levers at both ends of the DIMM slot. See ZS5-2 DIMM Configuration for reference. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 119 Replacing a ZS5-2 DIMM Lift the DIMM up and out the slot, and set the DIMM aside. Align the replacement DIMM with the chassis slot. Ensure that the notch in the DIMM lines up with the key in the slot. Servicing the ZS5-2 Controller...
Page 120 Power/OK status indicator on the front panel flashes. Press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 121: Replacing Or Adding A Zs5-2 Pcle Card
Replacing or Adding a ZS5-2 PCle Card Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon for the controller, click DIMM, and verify that the status icon is green for the newly installed module. To view details about the new module, click its information icon.
Page 122 Return the controller to the normal rack position by pushing the release tabs on the side of each rail while slowly pushing the storage controller into the rack. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 123: Replacing A Zs5-2 System Battery
To view details about the new card, click its information icon. If you replaced or installed a new HBA, connect the disk shelves to it as described in Oracle ZFS Storage Appliance Cabling Guide. If a fault does not self-clear, see “Repairing Active Problems” on page Replacing a ZS5-2 System Battery Removing the battery is a cold-service operation.
Page 124 Extend the controller from the rack as described in “Extending the Storage Controller from the Rack” on page Remove the top cover as described in “Removing the Top Cover” on page Remove the air duct. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 125 Replacing a ZS5-2 System Battery To remove the battery, tilt the battery slightly to left (a) and lift it out of the receptacle (b). Set the battery aside. Servicing the ZS5-2 Controller...
Page 126 Connect the power cords to the power supplies. Verify that standby power is on. Approximately two minutes after plugging in the power cords, the Power/OK status indicator on the front panel flashes. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 127: Zs5-2 Controller Hardware Overview
“Setting Clock Synchronization (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. ZS5-2 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage ZS5-2 controller. “ZS5-2 Configuration Options” on page 127 ■ “ZS5-2 Front and Rear Panel Components” on page 128 ■...
Page 128: Zs5-2 Front And Rear Panel Components
5 RFID tag 6 System disk 0 7 Alarm indicators (not used) ZS5-2 Rear Panel Components - The ZS5-2 controller PCIe slots and rear panel components are shown in the following figure. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 129 Version 2. For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Ethernet Ports The ZS5-2 has four RJ-45 10-Gigabit Ethernet (10GbE) network connectors, labeled NET3, NET 2, NET 1, and NET 0 (left to right) on the rear panel.
Page 130 The service processor NET MGT port is the optional connection to the Oracle ILOM service processor. The NET MGT port is configured by default to use Dynamic Host Configuration Protocol (DHCP). The service processor NET MGT port uses an RJ-45 cable for a 10/100/1000BASE-T connection.
Page 131: Zs5-2 Specifications
ZS5-2 Controller Hardware Overview 4x4 SAS HBA Ports The 4x4 SAS HBA, installed in PCle slot 2 of the ZS5-2, provides connectivity to external disk shelves. The HBA ports are numbered 3-0, top to bottom, as shown in the following figure. FIGURE 8 ZS5-2 4x4 SAS HBA ZS5-2 Specifications...
Page 132: Zs5-2 Internal Components
The ZS5-2 chassis contains both customer-replaceable units (CRUs) and field-replaceable units (FRUs) as shown in the following figure. FRUs must be replaced by trained Oracle service technicians. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 133 ZS5-2 Controller Hardware Overview ZS5-2 Storage, Power, and Fan Modules FIGURE 9 Servicing the ZS5-2 Controller...
Page 134 ZS5-2 Memory, PCIe Cards, and System Battery - The ZS5-2 memory, PCle cards, and system battery are described in the following figure and legend. These components are customer-replaceable units (CRUs) as shown in the following figure. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 135 ZS5-2 Controller Hardware Overview ZS5-2 Memory, PCle Cards, and Battery FIGURE 10 Servicing the ZS5-2 Controller...
Page 136 Oracle ILOM /System targets for the DIMMs are provided across the bottom. For example, the slot on the far left has the Oracle ILOM legacy target of /SYS/MB/P1/D0. This same slot has the Oracle ILOM /System target of /System/Memory/DIMMs/DIMM_0.
Page 137: Zs5-2 Pcie Card Configuration
ZS5-2 Controller Hardware Overview ZS5-2 DIMM Configuration FIGURE 11 Figure Legend /SYS/MB/P0/D(0-5) /SYS/MB/P0/D(6-11) /SYS/MB/P1/D(0-5) /SYS/MB/P1/D(6-11) /System/Memory/DIMMs/ /System/Memory/DIMMs/ DIMM_(0-11) DIMM_(12-23) ZS5-2 PCIe Card Configuration The ZS5-2 controller is equipped with six PCle Gen3 expansion slots. One of these slots is always dedicated to an external HBA and one is reserved for a cluster interface card. The remaining slots may be used for an additional external HBA or one of several client-facing adapters.
Page 138: Zs5-2 Cable Management Arm
The following figure identifies the components of the cable management arm (CMA). See the CMA installation instructions as described in “Installing a ZS5-2 Cable Management Arm” in Oracle ZFS Storage Appliance Installation Guide. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 139: Zs5-2 Attached Storage
ZS5-2 Controller Hardware Overview ZS5-2 Controller Cable Management Arm FIGURE 12 Figure Legend Connector A Connector D Front slide bar Slide-rail latching bracket (used with connector D) Velcro straps (6) Rear slide bar Connector B Cable covers Connector C ZS5-2 Attached Storage The ZS5-2 controller connects to external storage through a 4-port (4x4) SAS HBA.
Page 140 For disk shelf configuration details, see “Disk Shelf Configurations” on page 384. The ZS5-2 does not support the Sun Disk Shelf. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 141: Servicing The Zs4-4 Controller
HDDs and SSDs are hot-swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities. Use the following procedure to replace a ZS4-4 HDD or SSD. For information on disk compatibility, see the Oracle Systems Handbook. Servicing the ZS4-4 Controller...
Page 142 On the drive you want to remove, push the drive release button (1) to open the latch. Grasp the latch (2) and pull the drive out of the drive slot (3). Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 143: Replacing A Zs4-4 Power Supply
(1) until it is fully seated. Close the latch (2) to lock the drive in place. Oracle ZFS Storage Appliance software automatically detects and configures the new drive. Go to the Maintenance > Hardware screen of the BUI, click the right-arrow...
Page 144 Shut down the controller using one of the power-off methods described in “Powering Off the Controller” on page Ensure that the replacement power supply handle is in the open position. Align the replacement power supply with the empty power supply bay. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 145 Replacing a ZS4-4 Power Supply Slide the power supply into the bay (1) until it stops. To seat the power supply, rotate the release handle upward (2) until it locks in place. This action of rotating the handle upward draws the power supply into the controller and engages it with the internal connector.
Page 146: Replacing A Zs4-4 Fan Module
Position the replacement fan module so the connector on the bottom of the module is aligned with the connector on the inside of the slot and all keying and Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 147 Replacing a ZS4-4 Fan Module labeling are correctly positioned. The fan modules are keyed to ensure that they are installed in the correct orientation. Slide the fan module into the slot until it stops. Press downward on the top of the fan module, on the Press Here to Latch label, until the fan module is fully seated.
Page 148: Identifying A Faulted Zs4-4 Memory Module
“Removing the Top Cover” on page To locate the faulted component, first press and hold the Fault Remind button to verify that the remind circuitry is usable. The Fault Remind button is located on Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 149 Identifying a Faulted ZS4-4 Memory Module the divider between cooling zone 1 and cooling zone 2. The Power LED, next to the button, is green when the remind circuitry is usable. If a memory riser card has failed, see “Replacing a ZS4-4 Memory Riser ■...
Page 150: Replacing A Zs4-4 Dimm
The following example, shows the Fault indicators for memory riser cards, P0/MR0 and P0/MR1 are lit, as is the Fault indicator for CPU, P0. A CPU is a field replaceable unit (FRU) and must be replaced by a trained Oracle Caution - service technician.
Page 151 Replacing a ZS4-4 DIMM Remove the top cover as described in “Removing the Top Cover” on page Remove the memory riser card with the lighted Fault indicators (P0/MR0 and P0/MR1), and locate the failed DIMM. Use the DIMM Fault Remind circuit to locate the failed DIMM.
Page 152 Ensure that all levers are closed and locked. Replace the memory riser card. See “Replacing a ZS4-4 Memory Riser Card” on page 153. Replace the top cover on the chassis. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 153: Replacing A Zs4-4 Memory Riser Card
Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide.
Page 154 In the controller, ensure that the memory riser card ejector levers are in the closed position. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 155 Replacing a ZS4-4 Memory Riser Card The ejector levers are only used to remove a memory riser card and are not used to Note - install a card. Position the memory riser card over the slot on the motherboard. The DIMMs on the card must face to the left (when positioned at the front of the controller). Lower the memory riser card into the controller and set it on the slot on the motherboard.
Page 156: Replacing A Zs4-4 Pcie Card
Shut down the controller using one of the power-off methods described in “Powering Off the Controller” on page Disconnect the AC power cords from the rear panel of the storage controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 157 Replacing a ZS4-4 PCIe Card Because 3.3 VDC standby power is always present in the system, you must unplug Caution - the power cords before accessing any cold-serviceable components. Extend the controller from the rack as described in “Extending the Storage Controller from the Rack”...
Page 158 Whenever you remove a PCIe card, you should replace it with another PCIe card or a Caution - filler panel; otherwise, the controller might overheat due to improper airflow. Ensure the PCIe card retaining bar is open. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 159 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide.
Page 160: Replacing A Zs4-4 Battery
Disconnect the AC power cords from the rear panel of the storage controller. Caution - Because 3.3 VDC standby power is always present in the system, you must unplug the power cords before accessing any cold-serviceable components. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 161 Replacing a ZS4-4 Battery Extend the controller from the rack as described in “Extending the Storage Controller from the Rack” on page Remove the top cover as described in “Removing the Top Cover” on page The battery is located toward the back of the controller between PCIe slot 1 and the power supply side wall.
Page 162 Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK status indicator flashing on the front panel about two minutes after the power cords are plugged Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 163: Zs4-4 Controller Hardware Overview
When the system has finished booting, log in and set the time using the steps in the BUI Clock task. For more information, see “Setting Clock Synchronization (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. ZS4-4 Controller Hardware Overview To understand the ZS4-4 controller, use the following topics: “ZS4-4 Base Configuration”...
Page 164: Zs4-4 Front And Rear Panel Components
ZS4-4 Controller Hardware Overview Refer to the Oracle ZFS Storage ZS4-4 data sheet at http://www.oracle.com/goto/zs4-4 for the most recent component specification and physical, electrical, and environmental specifications. For information about supported disks and capacities, refer to the Oracle Systems Handbook.
Page 165 ZS4-4 Controller Hardware Overview Figure Legend Figure Legend 7 Power Supply (PS) Service action required LED 15 Solid state drive 4 (optional) (amber) 8 Over temperature warning LED (amber) 16 Solid state drive 5 (optional) Rear Panel Components - The ZS4-4 rear panel is shown in the following figure. Base configuration PCIe cards are not depicted in this illustration.
Page 166 The network management connector (NET MGT), shown in the figure below, is an RJ-45 10/100/1000 BASE-T Ethernet port and provides an alternate terminal interface to the service processor (SP) console. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 167 ZS4-4 Controller Hardware Overview ZS4-4 Network Management Port FIGURE 16 Serial Management Port The serial management connector (SER MGT), shown in the figure below, is an RJ-45 port and provides a terminal connection to the SP console. FIGURE 17 ZS4-4 Serial Management Port 4x4 SAS-2 HBA The 4x4 SAS-2 HBA provides connectivity to external disk shelves.
Page 168: Zs4-4 Pcie I/O Cards
One 8-port SAS-2 internal HBA (slot 2) ■ Two 4-port (4x4) SAS-2 external HBAs (slot 6 and slot 7) ■ One cluster interface card (slot 4) ■ The following figure shows the PCIe I/O slot numbers. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 169 ZS4-4 Controller Hardware Overview ZS4-4 PCIe I/O Slot Numbers FIGURE 19 PCIe Slot Order - Install optional PCIe cards in the following order: Install additional 4x4 SAS-2 HBAs in slot 9, then slot 3. ■ Install InfiniBand CX3 HCAs into the first available client-option slot starting with slot 11, ■...
Page 170 Optional FC target or initiator (Backup) 4-port (4x4) SAS-2 External Base configuration 2-port InfiniBand CX3 HCA Optional recommended front- 2-port 10Gb Ethernet Optical Optional recommended front- 2-port 10Gb Ethernet Copper Optional recommended front- Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 171 ZS4-4 Controller Hardware Overview Slot Description Type Note 16GB Dual Universal FC HBA Optional FC target or initiator (Backup) 2-port InfiniBand CX3 HCA Optional recommended front- 2-port 10Gb Ethernet Optical Optional recommended front- 2-port 10Gb Ethernet Copper Optional recommended front- 16GB Dual Universal FC HBA Optional FC target or initiator (Backup)
Page 172: Zs4-4 Internal Components
ZS4-4 Internal Components The ZS4-4 chassis contains both customer-replaceable units (CRUs) and field-replaceable units (FRUs) as shown in the following figure. FRUs must be replaced by trained Oracle service technicians. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 173 ZS4-4 Controller Hardware Overview Internal Components (Exploded View) FIGURE 20 Figure Legend Power supplies (CRU) Memory riser card (CRU) Power supply backplane (FRU) Motherboard (FRU) Servicing the ZS4-4 Controller...
Page 174 2.8 GHz CPUs and eight memory riser cards as shown in the following figure. The memory configuration is 16GB DDR3 DIMMs to accommodate up to 1.5TB (ninety-six 16GB). All ZS4-4 DIMM risers are fully populated to accommodate this offering. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 175 ZS4-4 Controller Hardware Overview ZS4-4 CPU and Memory FIGURE 22 Figure Legend Memory riser card P3/MR1 Memory riser card P0/MR1 Memory riser card P3/MR0 Memory riser card P0/MR0 Memory riser card P2/MR1 CPU P3 Memory riser card P2/MR0 CPU P2 Memory riser card P1/MR1 CPU P1 Memory riser card P1/MR0...
Page 176 The following figure shows the cooling zones and the approximate location of the temperature sensors. The accompanying legend table provides sensor NAC names and sensor motherboard designations. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 177 ZS4-4 Controller Hardware Overview ZS4-4 Cooling Subsysem FIGURE 23 Figure Legend Cooling zone 0 Temperature sensor TS_ZONE2 (U4505) Cooling zone 1 Temperature sensor TS_OUT (U4506) Cooling zone 2 Temperature sensor TS_TVL_1 (U4002) Cooling zone 3 (power supply Temperature sensor TS_TVL_0 backplane area) (U4302) Temperature sensor TS_PS (U4603)
Page 178: Zs4-4 Attached Storage
“Disk Shelf Configurations” on page 384. Related Topics “Connecting to Attached Storage” on page 365 ■ “Disk Shelf Hardware Overview” on page 365 ■ Oracle ZFS Storage Appliance Cabling Guide ■ Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 179: Servicing The Zs3-4 Controller
Most hardware faults clear after replacing the affected component. If a fault does not self-clear, “Repairing Active Problems” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to upgrade your controllers for disk shelf interoperability.
Page 180 After at least 30 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 181: Replacing A Zs3-4 Fan Module
Slide the replacement drive into the slot until it is fully seated. Close the latch to lock the drive in place. Oracle ZFS Storage Appliance software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller or drive shelf.
Page 182 If a fault does not self-clear, see “Repairing Active Problems” on page Push the release tabs on the side of each rail and slowly slide the storage controller into the rack. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 183: Replacing A Zs3-4 Power Supply
Replacing a ZS3-4 Power Supply Replacing a ZS3-4 Power Supply Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to ensure proper air flow. A faulted power supply is indicated by an amber colored status LED. Use the following procedure to replace a ZS3-4 power supply.
Page 184 Replacing a ZS3-4 Power Supply Grasp the power supply handle and press the release latch to remove the power supply. Align the replacement power supply with the empty power supply chassis bay. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 185: Replacing A Zs3-4 Dimm
Replacing a ZS3-4 DIMM Slide the power supply into the bay until it is fully seated. The following figure shows the power supply. Connect the power cord to the power supply. Verify that the green AC Present status indicator is lit. Close the CMA, inserting the CMA into the rear left rail bracket.
Page 186 Remove the top cover as described in “Removing the Top Cover” on page To locate the DIMM you want to service, press the Fault Remind Button on the storage controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 187 Replacing a ZS3-4 DIMM The following illustration shows the Fault remind button on the ZS3-4 controller. Servicing the ZS3-4 Controller...
Page 188 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 189 Replacing a ZS3-4 DIMM Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly. Push the DIMM into the connector until the ejector tabs lock the component in place.
Page 190 Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 191 Replacing a ZS3-4 DIMM Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage. Servicing the ZS3-4 Controller...
Page 192 Replacing a ZS3-4 DIMM Push the release tabs on the side of each rail and slowly push the storage controller into the rack. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 193 The following image shows the chassis. Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 194: Replacing A Zs3-4 Pcie Card Or Riser
Remove the top cover as described in “Removing the Top Cover” on page Locate the PCIe card position in the storage controller, see “ZS3-4 PCIe I/O Cards” on page 212. To replace the PCIe card: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 195 Replacing a ZS3-4 PCIe Card or Riser Disengage the PCIe card slot crossbar from its locked position and rotate the crossbar into an upright position. Remove the retaining screw that holds the PCIe card to the chassis. Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary.
Page 196 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 197 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 198: Replacing A Zs3-4 Battery
Extend the controller from the rack as described in “Extending the Storage Controller from the Rack” on page Remove the top cover as described in “Removing the Top Cover” on page Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 199 Replacing a ZS3-4 Battery Using a small, non-metallic screwdriver, press the latch and remove the battery from the motherboard. The battery is shown here. Press the replacement battery into the motherboard with the positive side (+) facing upward. To install the top cover: Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Page 200 Use a pen, or other pointed object, to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 201: Zs3-4 Controller Hardware Overview
Connect data cables to the PCIe card, routing them through the cable management arm. When the system has finished booting, log in and set the time using the steps in the task “Setting Clock Synchronization (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. ZS3-4 Controller Hardware Overview To understand the ZS3-4, see the following topics: “ZS3-4 Base Configuration”...
Page 202: Zs3-4 Front And Rear Panel Components
Volt-Ampere rating: 1837 VA @ 240 VAC, 0.98 P.F. ■ ZS3-4 Front and Rear Panel Components ZS3-4 Front Panel Components - The ZS3-4 controller drive slots and front panel components are shown in the following figure. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 203 ZS3-4 Controller Hardware Overview ZS3-4 Controller Front Panel FIGURE 24 Figure Legend Figure Legend Locator LED and button (white) USB 2.0 Connectors Service Required LED (amber) DB-15 video connector Power/OK LED (green) Boot drive 0 Power button Boot drive 1 (required) Service Processor (SP) OK LED (green) Solid state drive 2 (optional) Fan/CPU/Memory Service Required LED...
Page 204 This card cannot be replaced with a Version 3 cluster interface card. For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 205 ZS3-4 Controller Hardware Overview Ethernet Ports There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec. These network interfaces must be configured before use. Network Management Port The network management connector (NET MGT) is an RJ-45 10/100 BASE-T Ethernet port and provides a LAN interface to the SP console.
Page 206: Zs3-4 Internal Components
Figure Legend Figure Legend Motherboard CPUs and heatsinks Low-profile PCIe cards Memory risers Power supplies Fan board Power supply backplane Fan modules Drive backplane Boot drives and SSDs System lithium battery Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 207 ZS3-4 Internal Boards - The ZS3-4 controller chassis contains the following field-replaceable units (FRUs). FRUs are not customer-serviceable, and should only be replaced by trained Oracle service technicians. Motherboard - The motherboard includes CPU modules, slots for eight DIMM risers, ■...
Page 208 ZS3-4 4x4 SAS-2 HBA - The 4x4 SAS-2 HBA, installed in the ZS3-4, provides connectivity to external DE2 and Sun Disk Shelves. The HBA ports are numbered 3-0, top to bottom: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 209 ZS3-4 Controller Hardware Overview ZS3-4 Controller 4x4 SAS-2 HBA Port Numbers FIGURE 30 “ZS3-4 PCIe I/O Cards” on page 212 for slot placement. ZS3-4 CPU and Memory - The ZS3-4 controller supports 16GB DDR3 DIMMs installed on all eight risers, accommodating 1TB of memory. Servicing the ZS3-4 Controller...
Page 210 D0, D2, D4, and D6 must be populated; optionally, slots D1, D3, D5, and D7 may be populated as a group on installed memory risers. All DIMMs in the system must be identical. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 211 ZS3-4 Controller Hardware Overview ZS3-4 Controller DIMM Placement FIGURE 32 DIMM names in appliance logs and the Maintenance > Hardware view are displayed with the full name, such as /SYS/MB/P0/D7. ZS3-4 Fan Modules - The Fan Modules and Fan Module LEDs of the controller are shown in the following figure.
Page 212: Zs3-4 Pcie I/O Cards
ZS3-4 Controller PCIe Options Mfg Part Slot Description Note Number 7047852 8-port SAS-2 internal HBA Base configuration 7067091 4-port (4x4) SAS-2 external Base configuration 7067091 4-port (4x4) SAS-2 external Additional optional back-end Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 213 ZS3-4 Controller Hardware Overview Mfg Part Slot Description Note Number 7070006 2-port 10Gb Ethernet Copper Optional recommended front- 375-3696-01 2-port InfiniBand CX2 HCA Optional recommended front- 7070195 4-port 1Gb Ethernet Copper Optional recommended front- UTP NIC 7051223 2-port 10Gb Ethernet Optical Optional recommended front- 371-4325-02 2-port 8Gb FC HBA...
Page 214 Optional FC target or initiator (backup) 7067091 4-port (4x4) SAS-2 external Base configuration 371-4325-02 2-port 8Gb FC HBA Optional FC target or initiator (backup) 7070006 2-port 10Gb Ethernet Copper Optional recommended front- Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 215 ZS3-4 Controller Hardware Overview Mfg Part Slot Description Note Number 7070195 4-port 1Gb Ethernet Copper Optional recommended front- UTP NIC 7051223 2-port 10Gb Ethernet Optical Optional recommended front- 7023303 2-port 16Gb FC HBA Optional FC target or initiator (backup) ZS3-4 NIC/HBA Options - This table describes NIC/HBA PCIe card options for ZS3-4 standalone and cluster configurations.
Page 216: Zs3-4 Attached Storage
Any combination of disk-only, or disk, log, and read cache devices can be combined within the chain in any order. You can also attach Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 217 ZS3-4 Controller Hardware Overview mixed disk shelf types (DE2 family and legacy Sun Disk Shelves) behind the same controllers, but each chain must contain only the same disk shelf type. Directly connecting different disk shelf types is not supported. Read cache devices must be installed in either the controller or a DE2-24 disk Note - shelf.
Page 218 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 219: Servicing The Zs3-2 Controller
Most hardware faults clear after replacing the affected component. If a fault does not self-clear, “Repairing Active Problems” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to upgrade your controllers for disk shelf interoperability.
Page 220: Installing Optional Pcie Slot Cards In Order
Install 10Gb Ethernet Optical NICs (7051223) and or, Install 10Gb Ethernet Copper NICs (7070006) and or, Install 8Gb FC HBAs (371-4325-02) or 16Gb FCs HBA (7023303) and or, Install 1Gb Ethernet Copper NICs (7070195). Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 221: Disconnecting The Rj-45 Cable From The Cluster Serial Port
Disconnecting the RJ-45 Cable from the Cluster Serial Port Disconnecting the RJ-45 Cable from the Cluster Serial Port Using your index finger, press down fully on the RJ-45 release tab. Be sure the tab is fully disengaged from the port. Servicing the ZS3-2 Controller...
Page 222: Replacing A Zs3-2 Hdd Or Ssd
Identify the failed drive by going to the Maintenance > Hardware section of the BUI and clicking the drive information icon . If you are physically at the system, the amber Service Required indicator on the HDD or SSD should be illuminated. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 223 Replacing a ZS3-2 HDD or SSD If you are not physically at the system, turn on the locator indicator by clicking the locator icon At the front of the controller, pinch the air filter's left and right release levers inward (1). Pivot the air filter forward and lift if out of the chassis (2).
Page 224 Align the replacement drive with the drive slot. Press on the release button to slide the drive into the chassis until the release lever moves slightly inward. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 225: Replacing A Zs3-2 Power Supply
Replacing a ZS3-2 Power Supply Press the release lever fully closed with a click, securing the drive into the drive slot. Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon for the controller and then click Disk to verify that the online icon is green for the newly installed drive.
Page 226 Disconnect the power cord from the faulted power supply. Press the release tab to the left and pull on the handle. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 227 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Servicing the ZS3-2 Controller...
Page 228: Replacing A Zs3-2 Fan Module
Hardware screen of the BUI for the fan you want to replace. Power off the storage controller as described in “Powering Off the Controller” on page Disconnect the AC power cords from the rear panel of the storage controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 229 Replacing a ZS3-2 Fan Module Because 3.3 VDC standby power is always present in the system, you must unplug Caution - the power cords before accessing any cold-serviceable components. Extend the controller from the rack as described in “Extending the Storage Controller from the Rack”...
Page 230 Replace the top cover and tighten the two captive screws. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 231: Replacing A Zs3-2 Dimm
Replacing a ZS3-2 DIMM Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 232 Disconnect the cables attached to the drive backplane, and the cable attached to the USB board. Fully loosen the four screws securing the drive cage to the chassis (1). Raise the drive cage to the vertical position (2). Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 233 Replacing a ZS3-2 DIMM Fully loosen the thumbscrews that secure the air duct. Slide the left (L) thumbscrew bracket forward and off of the mounting pins. Slide the right (R) thumbscrew bracket rearward and off of the mounting pins. Set the thumbscrew bracket aside. Servicing the ZS3-2 Controller...
Page 234 Lift the air duct straight up and off the alignment pins. Set the air duct aside. Press the button on the midplane. An amber LED indicates the faulty DIMM. Press down and out on the release levers at both ends of the DIMM slot. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 235 Replacing a ZS3-2 DIMM Lift the DIMM up and out of the slot. Set the DIMM aside on an antistatic mat. Servicing the ZS3-2 Controller...
Page 236 Replacing a ZS3-2 DIMM Align the DIMM to the location where it installs into the slot. Ensure that the notch in the DIMM lines up with the key in the slot. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 237 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 238: Replacing A Zs3-2 Pcie Card Or Riser
Remove the top cover as described in “Removing the Top Cover” on page Locate the PCIe card position in the storage controller, see “ZS3-2 PCIe I/O Cards” on page 261. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 239 Replacing a ZS3-2 PCIe Card or Riser Fully loosen the two captive screws securing the riser to the motherboard. Servicing the ZS3-2 Controller...
Page 240 Disconnect any internal cables attached to the PCIe cards installed in the riser. Swing the retainer to its fully open (120 degrees) position. Note that the riser 3 latch is slightly different than the latch for riser 1 and 2. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 241 Replacing a ZS3-2 PCIe Card or Riser Lift the PCIe card off of the bracket alignment pin and out of the socket. Position the replacement PCIe card with where it will install into the riser. The PCIe card bracket mates with the alignment pin and the socket of the riser. Press the PCIe card into the socket.
Page 242 Align the riser to the location where it installs into the chassis. Reconnect any previously removed internal cables to the PCIe card installed in the riser, if doing so will ease installation of the riser. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 243 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 244: Replacing A Zs3-2 Flash Drive
Remove the top cover as described in “Removing the Top Cover” on page If a PCIe card installed in Riser 2 prevents you from accessing the USB drive, remove Riser 2. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 245 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 246: Replacing A Zs3-2 Battery
Remove the top cover as described in “Removing the Top Cover” on page Remove Riser 1. Press the tab of the battery receptacle forward to release the battery. The battery pops up. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 247 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 248: Zs3-2 Controller Hardware Overview
SAS-2 6Gb/s external 512GB 16x32GB Refer to the product site at for the most https://www.oracle.com/storage/nas/index.html recent component specification. For information about supported disks and capacities, refer to the Oracle Systems Handbook. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 249: Zs3-2 Front And Rear Panel Components
ZS3-2 Controller Hardware Overview ZS3-2 Front and Rear Panel Components ZS3-2 Front Panel Components - The ZS3-2 controller drive slots and front panel components are shown in the following figure. FIGURE 35 ZS3-2 Controller Front Panel Drive slots 0 and 1 have two mirrored boot drives. Up to four read-optimized cache solid state drives (SSDs) fill slots 2 through 5, in order.
Page 250 Cluster Interface Compatibility - The ZS3-2 controller contains embedded support for Version 2 clustering ports. It does not have a cluster interface card nor can one be installed in a PCIe slot. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 251 ZS3-2 Controller Hardware Overview Ethernet Ports The ZS3-2 has four RJ-45 10-Gigabit Ethernet (10GbE) network connectors, labeled NET 3, NET 2, NET 1, and NET 0 (left to right) on the rear panel. The ports operate at 100 Mbits/sec, 1000 Mbits/sec, or 10-Gbits/sec. Use these ports to connect the appliance to the network. ZS3-2 Ethernet Port LEDs Description TABLE 27 Connection Type...
Page 252 When disconnecting an RJ-45 cable from a cluster serial port (0 and 1), use extreme Caution - care not to damage the internal RJ-45 receptacle. To properly remove an RJ-45 cable from a cluster serial port, do the following: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 253: Zs3-2 Specifications
ZS3-2 Controller Hardware Overview ZS3-2 Controller Cluster I/O Ports: Serial 0, Serial 1, Ethernet FIGURE 40 4x4 SAS-2 HBA The 4x4 SAS-2 HBA, installed in PCIe slot 2 of the ZS3-2, provides connectivity to external DE2 and Sun Disk Shelves. The HBA ports are numbered 0-3, left to right, as shown in the following figure.
Page 254: Zs3-2 Internal Components
The ZS3-2 chassis has the following field replaceable units (FRUs). FRUs are not customer- serviceable and must be replaced by trained Oracle service technicians. PCIe Risers - There are three risers per system, each attached to the rear of the ■...
Page 255 ZS3-2 Motherboard, Memory, and PCIe Cards - The ZS3-2 controller motherboard, memory, and PCIe components are described in the following figure and legend. Field replaceable components (FRUs) are not customer-serviceable, and must be Note - replaced by trained Oracle service technicians. Servicing the ZS3-2 Controller...
Page 256 ZS3-2 Controller Motherboard, Memory, and PCIe Components FIGURE 42 Figure Legend Drive cage (FRU) Airduct Battery Drive backplane (FRU) PCIe Risers (FRU) PDB duct Motherboard (FRU) PCIe cards Power distribution board (FRU) Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 257 ZS3-2 Controller Hardware Overview Figure Legend DIMMs USB flash drive ZS3-2 CPU and Memory - The ZS3-2 controller motherboard has 16 slots in two groups that hold industry-standard DDR3 low voltage (LV) DIMMS. ZS3-2 Controller CPU and Memory Components FIGURE 43 All sockets must be occupied by identical DDR3 DIMMs.
Page 258 ZS3-2 Storage, Power, and Fan Components - The ZS3-2 controller's internal storage, power, and cooling components are described in the following figure and legend. A component identified as a field replaceable unit (FRU) must be replaced by trained Oracle service technicians.
Page 259 ZS3-2 Controller Hardware Overview ZS3-2 Controller Storage, Power, and Fan Components FIGURE 44 Figure Legend Air Filter Drive power cable (FRU) Fan modules Drives Drive signal cable (FRU) Fan tray Chassis (FRU) Top cover USB board (FRU) Servicing the ZS3-2 Controller...
Page 260 (FRU) internal cables. FRUs are not customer-serviceable, and must be replaced by trained Oracle service technicians. ZS3-2 Controller Internal Cables FIGURE 45 Figure Legend PDB signal cable Drive signal cable Drive power cable USB board cable LED board cable Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 261: Zs3-2 Pcie I/O Cards
ZS3-2 Controller Hardware Overview ZS3-2 PCIe I/O Cards ZS3-2 PCIe I/O Options - The following table describes the supported PCIe configuration options for the ZS3-2 controller. Slots 1 and 2 are reserved for internal and external HBAs, as shown in the following table. When adding PCIe cards, populate from higher order slots (6) first toward lower order slots.
Page 262: Zs3-2 Optional Cable Management Arm
Riser 3 contains slots 3 and 6 ■ ZS3-2 Optional Cable Management Arm The following figure identifies the components of the second-generation cable management arm (CMA). See the CMA installation instructions. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 263: Zs3-2 Attached Storage
ZS3-2 Controller Hardware Overview ZS3-2 Controller Optional Cable Management Arm FIGURE 46 Figure Legend Connector A Connector D Front slide bar Slide-rail latching bracket (used with connector D) Velcro straps (6) Rear slide bar Connector B Cable covers Connector C ZS3-2 Attached Storage The ZS3-2 controller connects to external storage through a 4-port (4x4) SAS-2 HBA.
Page 264 For more information, see “Connecting to Attached Storage” on page 365. See also “Disk Shelf Hardware Overview” on page 365 for component specifications and diagrams. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 265: Servicing The 7X20 Controller
Most hardware faults clear after replacing the affected component. If a fault does not self-clear, “Repairing Active Problems” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to upgrade your controllers for disk shelf interoperability.
Page 266 After at least 30 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 267: Replacing A 7X20 Fan Module
Replacing a 7x20 Fan Module Slide the replacement drive into the slot until it is fully seated. Close the latch to lock the drive in place. Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon for the controller or disk shelf and then click Disk to verify that the online icon is green for the newly installed drive.
Page 268 The storage controller might overheat and shut down if the door is left open for more Caution - than 60 seconds. 7420: The following illustration shows the fan modules in the 7420 storage controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 269 Replacing a 7x20 Fan Module To flash the locator LED on the chassis to service, go to Maintenance > Hardware in the BUI and click the associated locator icon , or go to the service processor (SP) prompt and enter set /SYS/LOCATE status=on To locate the faulted component, go to Maintenance >...
Page 270 If the system is still powered on, identify the fan module with the lit fault indicator. Using thumb and forefinger, squeeze the tabs together to pull the fan module up and out. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 271 Replacing a 7x20 Fan Module Insert the replacement fan module into the slot and apply firm pressure to fully seat it. On the replaced fan module, verify that the Fan OK indicator is lit, and that the fault indicator is not lit. Close the door immediately to maintain airflow in the storage controller.
Page 272: Replacing A 7X20 Power Supply
Replacing a 7x20 Power Supply Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 273 Replacing a 7x20 Power Supply ensure proper air flow. A faulted power supply is indicated by an amber-colored status LED. Use the following procedure to replace a 7x20 power supply. Gain access to the rear of the storage controller where the faulted power supply is located.
Page 274 7120 or 7320: Release the latch, then remove the power supply. Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 275 Replacing a 7x20 Power Supply 7420: Grasp the power supply handle and press the release latch to remove the power supply. Align the replacement power supply with the empty power supply chassis bay. Servicing the 7x20 Controller...
Page 276: Replacing A 7X20 Dimm
This procedure requires that you handle components that are sensitive to static Caution - discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 277 Replacing a 7x20 DIMM To identify a specific memory module that has faulted, you must open the storage controller and use the amber status LEDs on the motherboard. To identify a general memory fault, go to the Maintenance > Hardware screen of the BUI, and click on the right-arrow icon on the controller.
Page 278 Replacing a 7x20 DIMM Also remove the air baffle by pressing the air baffle connectors outward and lifting the air baffle up and out of the server. 7420: To remove the top cover: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 279 Replacing a 7x20 DIMM Simultaneously lift both cover latches in an upward motion. Lift up and remove the top cover. To locate the DIMM you want to service, press the Fault Remind Button on the storage controller. Servicing the 7x20 Controller...
Page 280 Replacing a 7x20 DIMM The following illustration shows the Fault remind button on the 7120 controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 281 Replacing a 7x20 DIMM The following illustration shows the Fault remind button on the 7420 controller. Servicing the 7x20 Controller...
Page 282 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 283 Replacing a 7x20 DIMM Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly. Push the DIMM into the connector until the ejector tabs lock the component in place.
Page 284 Replacing a 7x20 DIMM Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on. 7420: To replace the cover: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 285 Replacing a 7x20 DIMM Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place. Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Page 286 Replacing a 7x20 DIMM Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 287 Replacing a 7x20 DIMM Push the release tabs on the side of each rail and slowly push the storage controller into the rack. Servicing the 7x20 Controller...
Page 288 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 289: Replacing A 7X20 Controller Pcie Card Or Riser
Note that the 7120 Sun Flash Accelerator F20 card is a FRU and must be replaced by an Oracle service representative. Go to the Maintenance > Hardware screen of the BUI and click the right-arrow icon on the controller, and then click Slots to locate the faulted component.
Page 290 7120 or 7320: To replace the PCIe card: Disconnect any data cables connected to the cards on the PCIe riser you want to replace. Label the cables for proper connection later. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 291 Replacing a 7x20 Controller PCIe Card or Riser Loosen the two captive Phillips screws on the end of the rear panel crossbar and lift the crossbar up and back to remove it. Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser.
Page 292 Replacing a 7x20 Controller PCIe Card or Riser Carefully remove the PCIe card from the riser board connector and clean the slot with filtered, compressed air if necessary. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 293 Replacing a 7x20 Controller PCIe Card or Riser Seat the replacement PCIe card in the slot of the riser and connect the cables. Servicing the 7x20 Controller...
Page 294 Slide the back of the riser into the motherboard rear panel stiffener. Tighten the screw that secures the riser to the motherboard. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 295 Replacing a 7x20 Controller PCIe Card or Riser Replace the rear panel PCI crossbar by sliding it down over the PCIe risers, ensuring the crossbar is secured with two captive Phillips screws. 7420: To replace the PCIe card: Servicing the 7x20 Controller...
Page 296 Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary. Install the replacement PCIe card into the PCIe card slot. Install the retaining screw to hold the PCIe card to the chassis. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 297 Replacing a 7x20 Controller PCIe Card or Riser Return the crossbar to its closed and locked position. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller.
Page 298 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 299 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 300: Replacing A 7X20 Battery
Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there. Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm). Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 301 Replacing a 7x20 Battery Lift up and remove the top cover. 7420: To remove the top cover: Simultaneously lift both cover latches in an upward motion. Lift up and remove the top cover. Servicing the 7x20 Controller...
Page 302 Replacing a 7x20 Battery Using a small, non-metallic screwdriver, press the latch and remove the battery from the motherboard. The 7420 battery is shown here. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 303 Replacing a 7x20 Battery The following figure shows the 7120 battery. Press the replacement battery into the motherboard with the positive side (+) facing upward. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however, service procedures for each are identical. The illustration shows the 7320.
Page 304 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 305 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 306: 7420 Controller Hardware Overview
“Setting Clock Synchronization (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. 7420 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7420 controller. See the following for details: “7420 Configuration Options” on page 306 ■...
Page 307: 7420 Front And Back Panel Components
“7420 Controller System Drive,” on page 313. Refer to the product site at for the most https://www.oracle.com/storage/nas/index.html recent component specification. 7420 Front and Back Panel Components 7420 Front Panel Components - The 7420 controller drive slots and front panel components are shown in the following figure.
Page 308 Supply Fail: amber AC OK: green Power supply unit 0 AC inlet USB 2.0 ports Power supply unit 1 status LEDs OK: green Power PCIe slots 5-9 Supply Fail: amber AC OK: green Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 309 This card cannot be replaced with a Version 3 cluster interface card. For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Ethernet Ports There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec.
Page 310: 7420 Specifications
Maximum current AC RMS: 12A @ 100 VAC / 12A @ 200 VAC ■ Power Dissipation Max power consumption: 1800 W ■ Max heat output: 6143 BTU/hr ■ Volt-Ampere rating: 1837 VA @ 240 VAC, 0.98 P.F. ■ Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 311: 7420 Internal Components
Fan modules Drive backplane Boot drives and SSDs System lithium battery 7420 Internal Boards - The 7420 controller chassis has the following boards installed. Field- replaceable units (FRUs) should only be replaced by trained Oracle service technicians. Servicing the 7x20 Controller...
Page 312 Up to four read-optimized cache SSDs, may fill slots 2 through 5, in order. In a 7420 clustered configuration, the number of SSDs installed in both controllers must match. For information about supported disks and capacities, refer to the Oracle Systems Handbook. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 313 7420 Controller Hardware Overview 7420 Controller System Drive FIGURE 52 Figure Legend 1 Ready to remove (blue) 2 Service action required (amber) 3 OK/Activity (green) The 7420 controller supports the following configurations: Two, four, or eight 8GB DDR3 DIMMs installed on each riser, accommodating 128GB, ■...
Page 314 D0, D2, D4, and D6 must be populated; optionally, slots D1, D3, D5, and D7 may be populated as a group on all installed memory risers. All DIMMs in the system must be identical. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 315 7420 Controller Hardware Overview 7420 Controller CPU and Memory FIGURE 54 DIMM names in appliance logs and the Maintenance > Hardware view are displayed with the full name, such as /SYS/MB/P0/D7. 7420 Fan Modules - The Fan Modules and Fan Module LEDs of the storage controller are shown in the following figure.
Page 316: 7420 Pcie I/O Cards
Note - external HBAs. 7420 Controller PCIe Options TABLE 35 Slot Mfg Part Number Description Note 7054001 8-port 6Gb/s SAS-2 Slot 0 of the 7420 internal HBA M2 is reserved for Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 317 7420 Controller Hardware Overview Slot Mfg Part Number Description Note the SAS-2 internal 371-4325-02 8Gb 2-port FC HBA Optional FC target or initiator (Backup) for the 7420 controller 7051223 2-port optical 10GbE Optional recommended front- end for the 7420 controller 7054739 4-port copper NIC Optional...
Page 318 F375-3609-03 2-port SAS external Additional optional (7059331 for EU back-end countries) 7054739 4-port copper NIC Optional recommended front- 371-4325-02 8Gb 2-port FC HBA Optional FC target or initiator (Backup) Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 319 7420 Controller Hardware Overview Slot Mfg Part Number Description Note 375-3606-03 CX1 InfiniBand Optional recommended front- 7051223 2-port optical 10GE Optional recommended front- 375-3696-01 CX2 InfiniBand Optional recommended front- F375-3609-03 DP SAS external Additional optional (7059331 for EU back-end countries) 7054739 4-port copper NIC Optional...
Page 320 Install optional PCIe cards in the following order: 7420 Controller Optional PCIe Cards and Slot Order TABLE 37 PCIe Card Slot Order 1. SAS-2 external HBA Slot 2, 7, 3, 6 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 321: 7420 Attached Storage
Hardware Overview” on page 365 for component specifications and diagrams. 7320 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7320 controller. See the following for details: “7320 Configuration Options” on page 321 ■...
Page 322 7320 Standalone Controller PCIe Configuration Options TABLE 39 Slot Type Part Number Vendor Part Description Note PCIe 375-3617-01 Intel Niantic DP Optical Optional 10GE NIC Recommended Front-end Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 323 7320 Controller Hardware Overview Slot Type Part Number Vendor Part Description Note PCIe 375-3696-01 Mellanox InfiniBand HCA Optional Recommended Front-end PCIe 375-3606-03 MHJH29-XTC InfiniBand HCA Optional Recommended Front-end PCIe 375-3481-01 Intel QP Copper NIC Optional EXPI9404PT Recommended Front-end PCIe 371-4325-01 QLogic 8Gb DP FC Optional...
Page 324: 7320 Front And Back Panel Components
PCIe 375-3609-03 Sun Thebe External SAS Cluster Base Configuration 7320 Front and Back Panel Components 7320 Front Panel Components - The following figure and legend identify the front panel LEDs. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 325 7320 Controller Hardware Overview 7320 Controller Front Panel LEDs FIGURE 57 Figure Legend Locate Button/LED Service Required LED (amber) Power/OK LED (green) Power Button Rear Power Supply System Overtemperature LED Top Fan The following figure and legend identify the 7320 front panel drive locations. Two mirrored hard disk drives (HDDs) that store the operating system reside in slots 0 and 1.
Page 326 Serial management port PCIe slots Cluster Interface Card Compatibility - The 7320 controller contains a Version 2 cluster interface card. This card cannot be replaced with a Version 3 cluster interface card. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 327 7320 Controller Hardware Overview For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Ethernet Ports There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec.
Page 328: 7320 Electrical Specifications
■ 7320 Internal Components The 7320 storage controller chassis has the following boards installed. Field-replaceable units (FRUs) should only be replaced by trained Oracle service Note - technicians. PCIe Risers: The storage controller contains three PCIe risers that are customer-replaceable ■...
Page 329 7320 Controller Hardware Overview Motherboard: The motherboard is a FRU and includes CPU modules, slots for 18 DIMMs, ■ memory control subsystems, and the service processor (SP) subsystem. The SP subsystem controls the host power and monitors host system events (power and environmental). The SP controller draws power from the host 3.3V standby supply rail, which is available whenever the system is receiving AC input power, even when the appliance is turned off.
Page 330 7320 Controller CPU and Memory Components FIGURE 62 7320 Power Distribution and Fan Module Components - The following figure and legend identify the Power Distribution/Fan Module components of the storage controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 331 7320 Controller Hardware Overview 7320 Controller Power Distribution and Fan Module Components FIGURE 63 Figure Legend Figure Legend Fan Modules Power Distribution/Bus Bar Assembly Fan Board Power Supplies Paddle Board 7320 I/O Components - The following figure and legend identify the I/O components of the storage controller.
Page 332 7320 PCIe Cards and Risers - Following is the complete list of replaceable PCIe cards for the 7320 system. TABLE 45 7320 Controller Replaceable PCIe Cards Part Number Description FRU/CRU F371-4325-01 8Gb FC HBA (PCIe) Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 333: 7320 Attached Storage
Storage” on page 365. See also “Disk Shelf Hardware Overview” on page 365 component specifications and diagrams. 7120 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7120 controller. Servicing the 7x20 Controller...
Page 334: 7120 Base Configuration
18 DIMM slots into a compact 2U footprint. Refer to the product site at https://www. for the most recent component specification. oracle.com/storage/nas/index.html Refer to the white paper Implementing Fibre Channel SAN Boot with Oracle's Sun ZFS Storage Appliance at http://www.oracle.com/technetwork/articles/servers-storage-admin/ for details on FC SAN boot solutions using the Sun ZFS Storage fbsanboot-365291.html...
Page 335: 7120 Front Panel
7120 Controller Hardware Overview 7120 Front Panel The following figure and legend show the front panel and the drive locations. The Logzilla 3.5" SSD belongs in slot 3 and is not supported in controllers configured with the internal Sun Aura flash HBA Logzilla.
Page 336: 7120 Physical Specifications
The following list shows the electrical specifications for the 7120. Note that the power dissipation numbers listed are the maximum rated power numbers for the power supply. The numbers are not a rating of the actual power consumption of the appliance. Connectors Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 337: 7120 Internal Boards
Volt-Ampere rating: 1261 VA @ 240 VAC, 0.98P.F. ■ 7120 Internal Boards The chassis has the following boards installed. Field-replaceable units (FRU) should only be replaced by trained Oracle service Note - technicians. PCIe Risers: Each riser supports two PCIe cards that are customer-replaceable. There are ■...
Page 338: 7120 Cpu And Memory
All sockets must be occupied by either a filler or a DDR3 DIMM. All DDR3 DIMMs must be identical. DIMMs are pre-installed in P0 slots D1, D2, D4, D5, D7, and D8. FIGURE 67 7120 Controller CPU and Memory Components Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 339: 7120 Power Distribution, Fan Module And Disk Components
7120 Controller Hardware Overview 7120 Power Distribution, Fan Module and Disk Components The fan modules and LEDs are shown in the following illustration. 7120 Controller Fan Modules and LEDs FIGURE 68 The following figure and legend show the power distribution and associated components. Servicing the 7x20 Controller...
Page 340: 7120 I/O Components
SAS Expander Board Connector Board Disk Backplane Power Supply Backplane Front Control Panel Light Pipe Assembly 7120 I/O Components The following figure and legend show the I/O components of the 7120 system. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 341: 7120 Nic/Hba Options
7120 Controller Hardware Overview 7120 Controller I/O Components FIGURE 70 Figure Legend Top Cover Hard Disk Drives Right Control Panel Light Pipe Assembly Left Control Panel Light Pipe Assembly 7120 NIC/HBA Options The following table describes NIC/HBA options for the 7120. TABLE 51 7120 Controller NIC/HBA Options Mktg Part Number...
Page 342: 7120 Pcie Options
375-3606-01 Mellanox InfiniBand HCA Optional MHJH29-XTC Recommended Front-end PCIe 375-3481-01 Intel QP Copper NIC Optional EXPI9404PT Recommended Front-end PCIe 371-4325-01 QLogic 8Gb DP FC Optional FC Target or Initiator (Backup) Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 343: 7120 Connectors
7120 Controller Hardware Overview Sun Part Vendor Part Slot Type Description Note Number Number PCIe 375-3665-01 Sun Thebe (INT) Internal SAS Base Configuration PCIe 375-3481-01 Intel QP Copper NIC Optional EXPI9404PT Recommended Front-end PCIe 371-4325-01 QLogic 8Gb DP FC Optional FC Target or Initiator (Backup)
Page 344: 7120 Cables
The rear boot drives are not depicted in this illustration. Note - 7120 Controller Storage Drive Data Cable FIGURE 73 Cable Connection Connection between the HBA PCI-Express Card and the Storage Drive Data Cable storage drive backplane. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 345: 7120 Attached Storage
7120 Controller Hardware Overview 7120 Controller Ribbon Cable FIGURE 74 Cable Connection Connection is between the power distribution board and Ribbon cable the motherboard. 7120 Attached Storage The 7120 standalone configurations allow a single chain of 1 or 2 disk shelves. Write-optimized (Logzilla) SSDs are not supported in the expansion storage for the 7120.
Page 346 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 347: Servicing The Disk Shelves
■ “Adding a Disk Shelf Cache Device” on page 363 ■ To understand disk shelf components and configurations, see the following topics: “Oracle Storage Drive Enclosure DE3-24” on page 365 ■ “Oracle Storage Drive Enclosure DE2-24” on page 373 ■...
Page 348: Replacing A Faulty Disk Shelf Drive
“Adding a Disk Shelf Cache Device” on page 363. Locate the failed disk drive with an amber LED at the front of the chassis. Press the release button or latch to release the drive lever. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 349 Replacing a Faulty Disk Shelf Drive Pull the drive lever fully open to unlock and partially eject the drive from the chassis. - OR - Grasp the middle of the drive body and pull it toward you to remove it from the chassis.
Page 350 Replacing a Faulty Disk Shelf Drive While constantly pushing toward the pivot point of the lever, slide the drive fully into the chassis slot. - OR - Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 351: Replacing A Disk Shelf Power Supply
Replacing a Disk Shelf Power Supply Press the drive lever closed until it locks in place. If a vertically oriented drive is higher than surrounding drives, push down on the top of the drive to properly seat it. The Activity LED will be steady green to indicate a ready state. Go to the Maintenance >...
Page 352 Push the lever fully downward. Oracle Storage Drive Enclosure DE2-24P or DE2-24C: Grasp the latch and the opposite side of the module, and squeeze together to release the lever. Sun Disk Shelf: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 353 With the lever/ejection arms fully open (if applicable), slide the new module into the chassis slot until it contacts the chassis backplane, and the lever/ejection arms begin to engage. If an Oracle Storage Drive Enclosure DE3-24, the module clicks in place and the lever engages; then go to step 9.
Page 354 Push on the handle until you hear or feel a click. Close the lever/ejection arms. Oracle Storage Drive Enclosure DE2-24P or DE2-24C: Push the lever fully closed until you hear or feel a click. Sun Disk Shelf: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 355 If not, power off the disk shelf and reseat the faulted module. If the module status indicator is not a steady green after module reinsertion, contact Oracle Customer Service. Servicing the Disk Shelves...
Page 356 PSU or Fan to verify that the online icon is green for the newly installed power supply with fan module. If a fault does not self-clear, see “Repairing Active Problems” on page Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 357: Replacing A Disk Shelf I/O Module
Refer to “Disk Shelf Hardware Overview” on page 365 for component locations. The following disk shelves have I/O Modules (IOMs): Oracle Storage Drive Enclosure DE3-24P ■ Oracle Storage Drive Enclosure DE3-24C ■...
Page 358 Slot to verify that the I/O Module online icon is green for the newly installed I/O Module. If a fault does not self-clear, see “Repairing Active Problems” on page Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 359: Replacing A Disk Shelf Sim Board
Replacing a Disk Shelf SIM Board Replacing a Disk Shelf SIM Board Do not remove a component if you do not have an immediate replacement. The disk Caution - shelf must not be operated without all components in place, including filler panels. Refer to “Disk Shelf Hardware Overview”...
Page 360 Pull each ejector tab outward and push to the sides to release and partially eject the SIM from the chassis. Grasp the middle of the SIM board and slide it out of the slot. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 361 Replacing a Disk Shelf SIM Board With the ejector arms in the full open position, align the new SIM board with the open slot and slide it into the tray until the ejector arms contact the tray connectors and begin to swing closed. Swing both ejector arms in until they are flush with the SIM board panel to seat the board.
Page 362: Adding A New Disk Shelf
For disk shelf guidelines as well as cabling diagrams, see “Getting Started with Cabling” in Oracle ZFS Storage Appliance Cabling Guide. Stabilize the appliance rack. If your rack includes an anti-tip foot, extend it from the bottom of the rack.
Page 363: Adding A Disk Shelf Cache Device
Adding a Disk Shelf Cache Device Administration Guide, Release OS8.6.x, or “Remote Replication” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. Adding a Disk Shelf Cache Device Use the following procedure to install a new cache device, an SSD, into an available and appropriate drive slot.
Page 364 Click the Add button to add the drive to the pool. Select the drive you are adding to the pool, and click Commit. Select the log profile (if applicable), and click Commit. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 365: Connecting To Attached Storage
Oracle ZFS Storage Appliance Cabling Guide. Contact Oracle Service if you want to move a disk shelf between Oracle ZFS Storage Note - Appliances. Certain limitations exist when importing storage pools, and can cause problems if not done properly by Oracle Service personnel.
Page 366 Disk Shelf Hardware Overview DE3-24P Disk Shelf The Oracle Storage Drive Enclosure DE3-24P is a 2U chassis that supports 24 2.5'' SAS-3 drives. The high-performance HDDs provide reliable storage, and the SSDs provide accelerated write operations. This disk shelf features dual, redundant I/O Modules (IOMs), and dual power supply with fan modules.
Page 367 Disk Shelf Hardware Overview DE3-24P Status Indicators (Front View) FIGURE 76 Figure Legend 1 Locate indicator 2 Service required indicator 3 OK indicator 4 Power supply fault indicator 5 SAS I/O Module fault indicator 6 Power/Activity indicator 7 Drive service required indicator 8 Ready-to-remove indicator Servicing the Disk Shelves...
Page 368 4 Power supply with fan module 1 DE3-24C Disk Shelf The Oracle Storage Drive Enclosure DE3-24C is a 4U chassis that supports 24 3.5" SAS-3 drives. The SSDs provide accelerated write operations, and the high-capacity HDDs provide reliable storage. This disk shelf features dual, redundant I/O Modules (IOMs), and dual power supply with fan modules.
Page 369 Disk Shelf Hardware Overview DE3-24C Drive Locations (Front View) FIGURE 78 Up to four write-optimized log SSDs are supported per disk shelf. Log devices should be populated in order of slots 20, 21, 22, and 23. External Read Cache Devices - Read cache devices, installed in DE3-24 disk shelves, are external to the controller and referred to as external second level adaptive replacement cache (EL2ARC).
Page 370 1 Locate indicator 2 Service required indicator 3 OK indicator 4 Power supply fault indicator 5 SAS I/O Module fault indicator 6 Ready-to-remove indicator 7 Drive service required indicator 8 Power/Activity indicator Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 371 Disk Shelf Hardware Overview DE3-24C Rear Panel FIGURE 80 Figure Legend 1 Power supply filler panel, slot 4 2 I/O Module 1 3 I/O Module filler panel 4 Power supply with fan module 2 5 Power supply filler panel, slot 2 6 I/O Module filler panel 7 I/O Module 0 8 Power supply with fan module 1...
Page 372 9 Host port activity indicator 10 Power/Activity indicator 11 Drive service required indicator 12 Ready-to-remove indicator 13 For Oracle service only The DE3-24C and DE3-24P disk shelves use the same I/O Module. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 373: Oracle Storage Drive Enclosure De2-24
DE2-24 Disk Shelf The Oracle Storage Drive Enclosure DE2-24P is a 2U chassis that supports 24 2.5" SAS-2 drives. The high-capacity HDDs provide reliable storage. The SSDs provide accelerated write operations, and for some controllers, read-optimized cache operations. This disk shelf features dual, redundant I/O Modules (IOMs), and dual power supply with fan modules.
Page 374 “Disk Shelf Configurations” on page 384. FIGURE 84 DE2-24P Status Indicators (Front View) Figure Legend 1 System power indicator 2 Module fault indicator 3 Locate indicator Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 375 4 Power supply with fan module 1 DE2-24C Disk Shelf The Oracle Storage Drive Enclosure DE2-24C is a 4U chassis that supports 24 3.5" SAS-2 drives. The high-capacity HDDs provide reliable storage. The SSDs provide accelerated write operations, and for some controllers, read-optimized cache operations. This disk shelf features dual, redundant I/O Modules (IOMs), and dual power supply with fan modules.
Page 376 (EL2ARC). When a cluster takeover occurs, read cache remains persistent and sharable between controllers, enabling read performance to be sustained. For slot configuration details and minimum software requirements, see “Disk Shelf Configurations” on page 384. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 377 Disk Shelf Hardware Overview DE2-24C Status Indicators (Front View) FIGURE 87 Figure Legend 1 System power indicator 2 Module fault indicator 3 Locate indicator 4 Power/Activity indicator 5 Drive fault indicator Servicing the Disk Shelves...
Page 378 6 I/O Module 0 7 I/O Module filler panel 8 I/O Module 1 It is especially important that power supplies and their filler panels are in the correct Note - slots. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 379 3 SAS-2 Port 0 4 SAS-2 Port 1 5 SAS-2 Port 2 6 Host port activity indicators 7 For Oracle service only 8 For Oracle service only The DE2-24C and DE2-24P disk shelves use the same I/O Module. Servicing the Disk Shelves...
Page 380: Sun Disk Shelf
Sun Disk Shelf The Sun Disk Shelf is a 4U chassis that supports 24 3.5" SAS-2 drives. The SSDs provide accelerated write operations, and the high-capacity HDDs provide reliable storage. This disk Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 381 Disk Shelf Hardware Overview shelf features dual, redundant SAS Interface Module (SIM) boards, and dual power supply with fan modules. FIGURE 91 Sun Disk Shelf Drive Locations (Front View) Read cache devices cannot be installed in the Sun Disk Shelf. Servicing the Disk Shelves...
Page 382 4 Disk ready to be removed indicator 5 Disk fault indicator 6 Disk activity indicator 7 Over temperature warning 8 SIM board fault indicator 9 Power supply fault indicator indicator Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 383 Disk Shelf Hardware Overview Sun Disk Shelf Rear Panel FIGURE 93 Figure Legend 1 Power supply modules with built-in fans. Power supply 2 Removable SAS Interface Module (SIM) Boards. SIM 0 is on the left and power supply 1 is on the right. 0 is on the left, and SIM 1 is on the right.
Page 384: Disk Shelf Configurations
The following table describes device types supported for each disk shelf. For cabling information, see Oracle ZFS Storage Appliance Cabling Guide. For information on disk compatibility, see the Oracle Systems Handbook. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 385 Disk Shelf Hardware Overview Disk Shelf Configurations TABLE 53 Shelf Device Types Data Slots Cache/Log Notes/Examples Slots DE3-24P/DE2-24P Data 0 - 23 none Fully populated HDD data devices. 20 Data and 0 - 19 20 - 23 Twenty HDD data devices 1-4 Log and up to four log devices.
Page 386: Maximum Disk Shelves Per Controller Configuration
HBA type. TABLE 54 Supported Disk Shelf Chains per HBA HBA Type Number of Disk Shelf Chains per HBA SAS-3 4x4 port SAS-2 4x4 port SAS-2 2x4 port Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 387: And Sas-3
SAS-2 - The SAS-2 (Serial Attached SCSI 2.0) host bus adapter (HBA) is designed for the Oracle ZFS Storage Appliance with a standard chip set to support a high-density of target devices, up to 1024. You can daisy-chain SAS-2 disks to as many as 36 disk shelves for certain systems, for a total of 864 disks.
Page 388 4x4 port (16 PHYs), with each port supporting 12 Gbit/s (SAS-3) devices. For more information about the SAS-3 HBA, see the hardware overview for your controller. For supported disk shelf configurations, see “Disk Shelf Configurations” on page 384. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 389: Viewing System Disks Status
Viewing System Disks Status The system disks section shows the status of the system disks, and their current usage. The BUI displays this with a pie-chart, and the CLI as a text list. For example: hostname:> maintenance system disks show Properties: profile = mirror root = 1.14G...
Page 390 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 391: Working With Support Bundles
In a cluster configuration, the controller that originally diagnoses a fault uploads the support bundle to Oracle Service. For example, a fault occurring on a disk shelf that is shared by both controllers is reported on both controllers, but the fault is posted by the controller that initially diagnosed the fault.
Page 392: Generating And Uploading A Support Bundle (Bui)
The SR number format is 3-nnnnnnnnnn, where n is a digit between 0 and (Optional) Uncheck Send to Oracle Support to create a local bundle for analysis. This bundle can be uploaded to Oracle Support later if an SR is provided.
Page 393: Viewing Support Bundle Details (Bui)
Enter bundle and the SR number. hostname:maintenance system bundles> bundle 3-9999999999 A support bundle is being created and sent to Oracle. You will receive an alert when the bundle has finished uploading. Please save the following filename, as Oracle support personnel will need it in order to access the bundle: /upload/issue/3-9999999999/3-9999999999_ak.edd08324-f091-cd19-b4c9-...
Page 394: Viewing Support Bundle Details (Cli)
“Deleting a Support Bundle (CLI)” on page 396 ■ Uploading a Locally Generated Bundle (CLI) Use the following procedure to upload a locally generated support bundle. To select a support bundle, enter select and the bundle's UUID. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 395: Retrying A Failed Support Bundle Upload (Bui)
Retrying a Failed Support Bundle Upload (BUI) hostname:maintenance system bundles> select fee4b98a-e3f7-e600-877d-b6d7933255f3 To upload the selected bundle, use the send command with the SR number: hostname:maintenance system bundles fee4b98a-e3f7-e600-877d-b6d7933255f3> send 3- 9999999999 An SR number is required when running send on a locally generated bundle, or else an Note - error will be thrown.
Page 396: Canceling A Pending Support Bundle Operation (Bui)
Go to Maintenance > System. Hover over the appropriate support bundle row and click its trash icon Deleting a Support Bundle (CLI) Use the following procedure to delete a support bundle using the CLI. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 397 Deleting a Support Bundle (CLI) To select a support bundle, use the following CLI command: hostname:maintenance system bundles> select fee4b98a-e3f7-e600-877d-b6d7933255f3 To delete a support bundle, use the following CLI command: hostname:maintenance system bundles 5ff532a2-2377-e72d-b0fe-f2efc2aa8aaf> destroy Working with Support Bundles...
Page 398 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 399: Performing The Initial Setup
You can repeat the initial setup process after you have already configured the appliance for the first time, as described in “Configuring the Appliance for the First Time” in Oracle ZFS Storage Appliance Installation Guide. This does not change any of the current settings unless explicitly requested.
Page 400 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 401: Restarting The Appliance
Restarting the Appliance Only issue the restart command as instructed by Oracle Service personnel. Caution - This function is only available via the CLI and is not the same as a reboot (power cycle) via the BUI. The restart command is a software-only operation that restarts the management server, which could impact some client services, like replication.
Page 402 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 403: Performing A Factory Reset
Performing a Factory Reset Factory reset resets the appliance configuration back to factory settings of the current software version, and reboots the appliance. All configuration changes are lost, and the appliance needs to go through initial configuration again, as when it was first installed. User data on the storage pool (including projects and shares) is not affected - however the pool needs to be imported as part of the initial setup process.
Page 404 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 405: Backing Up The Configuration
Backing Up the Configuration The configuration backup function enables an administrator to: Back up the appliance configuration, consisting of system metadata only (such as the ■ network configuration, local users and roles, service settings, and other appliance metadata). Restore a previously saved configuration from a backup. ■...
Page 406: Configuration Restore Impact
ZS3-2 appliance. Attempting to restore a configuration to a different platform results in several failures that requires a factory reset to return to a normal state. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 407 Because of the possibility of data loss to unconfigure clustering, contact Oracle support. Then, restore the configuration backup on a selected head, and then re-cluster the two systems, at which point the other system automatically synchronizes itself with the restored configuration.
Page 408: Security Considerations For Configuration Backups
Click the Backup button above the list of saved configurations and follow the instructions. You are prompted to enter a descriptive comment for the backup. Click APPLY to create the backup configuration. Click the download icon to download the configuration locally. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 409: Creating A Configuration Backup (Cli)
Creating a Configuration Backup (CLI) Creating a Configuration Backup (CLI) Use the following procedure to create a configuration backup. To back up a configuration, use the backup CLI command. You are prompted to enter a descriptive comment for the backup. hostname:maintenance system configs>...
Page 410: Deleting A Saved Configuration (Bui)
Deleting a Saved Configuration (CLI) Use the following procedure to delete a saved configuration. To delete a saved configuration, use the following CLI command and specify the universal unique identifier for the backup: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 411: Exporting A Saved Configuration (Bui)
Exporting a Saved Configuration (BUI) hostname:maintenance system configs> destroy cb2f005f-cf2b-608f-90db-fc7a0503db2a Are you sure you want to delete the saved configuration "new"? y hostname:maintenance system configs> Exporting a Saved Configuration (BUI) Use the following procedure to export a saved configuration. You can also use the export function to export the file to a share on the appliance itself, that has the HTTP or FTP protocol enabled for writing.
Page 412: Importing A Saved Configuration (Cli)
Go to Maintenance > System. The appliance configurations are listed at the bottom of the page. Viewing Appliance Configurations (CLI) Use the following procedure to view appliance configurations. To view appliance configurations, use the following CLI command: Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 413 Viewing Appliance Configurations (CLI) hostname:maintenance system configs> list CONFIG DATE SYSTEM VERSION bfa614d7-1db5-655b-cba5-bd0bb0a1efc4 2009-8-5 17:14:28 hostname 2009.08.04,1-0 cb2f005f-cf2b-608f-90db-fc7a0503db2a 2009-8-24 17:56:53 hostname 2009.08.18,1-0 Backing Up the Configuration...
Page 414 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 415: Working With Software Notifications And Updates
You can set up periodic checks for software updates, or you can check for updates at any time. When an updated software package is available, you are directed to download the latest package from My Oracle Support (MOS). It is recommended that you remove older system updates to avoid accruing unnecessary space on the system disks.
Page 416: Setting Up Software Notification (Cli)
Click the download link shown in the popup window, and save the zip file. Checking for and Downloading Software Updates (CLI) Use the following procedure to check for software updates using the CLI. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 417: Removing System Updates (Bui)
2013.1.1.5> show Properties: version = 2013.1.1.5 date = 2014-2-18 08:00 status = downloadable url = https://updates.oracle.com/Orion/Services/download /p18269573_20131_Generic.zip?aru=17312483&patch_file=p18269573_20131_Generic.zip checkdate = 2014-3-4 hostname:maintenance system 2013.1.1.5> Removing System Updates (BUI) Use the following procedure to remove extraneous system updates. To avoid accruing too much space on the system disks, maintain no more than three updates at any given time.
Page 418 Enter destroy and the update that you want to remove. hostname:maintenance system updates> destroy ak-nas@2013.06.05.1,1-1.2 Enter Y to confirm your action. This will destroy the update "ak-nas@2013.06.05.1,1-1.2". Are you sure? (Y/N) Y Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 419: Upgrading The Software
Upgrading the Software This section describes how to upgrade the system software for an Oracle ZFS Storage Appliance. You can upgrade software using either the BUI or CLI. Use the following topics and tasks to upgrade the software: “Preparing for a Software Upgrade” on page 419 ■...
Page 420: Upgrading Software On A Standalone Controller
Upgrading Software on a Standalone Controller This section describes how to upgrade the system software for an Oracle ZFS Storage Appliance with a standalone controller. Use one of the following tasks to upgrade software on standalone controllers using either the BUI or CLI: “Upgrading Software on a Standalone Controller (BUI)”...
Page 421: Upgrading Software On A Standalone Controller (Bui)
Upgrading Software on a Standalone Controller (BUI) “Upgrading Software on a Standalone Controller (CLI) ” on page 423 ■ Upgrading Software on a Standalone Controller (BUI) Use the following procedure to upgrade software on a standalone controller. Complete “Preparing for a Software Upgrade” on page 419.
Page 422 To cancel the update at any time (and without an adverse effect), click the cancel icon Enable any data services that were disabled before the upgrade, as described “Enabling a Service (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x.
Page 423: Upgrading Software On A Standalone Controller (Cli)
Upgrading Software on a Standalone Controller (CLI) Upgrading Software on a Standalone Controller (CLI) Use the following procedure to upgrade software on a standalone controller. Complete “Preparing for a Software Upgrade” on page 419. Before You Begin On your local system, download the software update as described in “Checking for and Downloading Software Updates (CLI)”...
Page 424 = onreboot hostname:maintenance system updates ak-nas@2013.06.05.4.0,1-1.6> After you set any properties, enter the upgrade command and then enter y to start the update. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 425: Upgrading Software On Clustered Controllers
OS8.6.x. Upgrading Software on Clustered Controllers This section describes how to upgrade the system software for an Oracle ZFS Storage Appliance with clustered controllers. Cluster update is also referred to as a rolling update. Controllers are upgraded one at a time, and each controller is upgraded while the cluster peer provides service to clients.
Page 426: Preparing To Upgrade Clustered Controllers (Bui)
In the Add Software Update box, browse and select the update you want to install. A progress bar is displayed showing the progress of the upload. Repeat steps 2-5 on controller B. Next Steps “Upgrading Clustered Controllers (BUI)” on page 429 ■ Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 427: Preparing To Upgrade Clustered Controllers (Cli)
Preparing to Upgrade Clustered Controllers (CLI) Preparing to Upgrade Clustered Controllers (CLI) Use the following procedure to prepare to upgrade clustered controllers. Complete “Preparing for a Software Upgrade” on page 419. Before You Begin For the purpose of this procedure, the first controller to be upgraded is referred to as Note - controller A and its peer is controller B.
Page 428 (uncommitted)> commit Transferred 157M of 484M (52.1%) ... Wait for the package to fully download and unpack before proceeding. Next Steps “Upgrading Clustered Controllers (CLI)” on page 431 ■ Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 429: Upgrading Clustered Controllers (Bui)
Go to Configuration > Cluster and verify that controller A is in the "Ready (waiting for failback)" state. For information about the cluster states, see “Cluster Takeover and Failback” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. (Optional) To monitor firmware updates, go to Maintenance > System and check the update counter.
Page 430 If any components have errors, check for pool errors by going to Configuration > Storage, and check the STATUS and ERRORS columns for each pool. Pools should be online and have no errors. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 431: Upgrading Clustered Controllers (Cli)
Upgrading Clustered Controllers (CLI) Log in to controller B and repeat steps 18-20 for controller B. Enable any data services that were disabled before the upgrade, as described “Enabling a Service (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x.
Page 432 Log in to controller B and enter configuration cluster show to verify that controller B is in the "Active (takeover completed)" state. For information about the cluster states, see “Cluster Takeover and Failback” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 433 Upgrading Clustered Controllers (CLI) In the example below, the state of controller B is AKCS_OWNER, with a description of "Active (takeover completed)." controller-b:> configuration cluster show state = AKCS_OWNER description = Active (takeover completed) peer_state = AKCS_STRIPPED peer_description = Ready (waiting for failback) Enter configuration cluster failback, and then enter y to change the cluster to an Active/Active configuration.
Page 434 No Failed Updates In Progress No Updates in Progress Log in to controller A and enter configuration cluster show to verify that controller A is in the "Active (takeover completed)" state. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 435 = AKCS_STRIPPED peer_description = Ready (waiting for failback) For information about the cluster states, see “Cluster Takeover and Failback” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. To verify that all firmware updates are complete, go to maintenance system updates firmware show to monitor firmware updates.
Page 436 Log in to controller B and repeat steps 18-19 for controller B. Enable any data services that were disabled before the upgrade, as described “Enabling a Service (CLI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 437: Working With Health Checks
Working with Health Checks System-level health checks are provided to help ensure that no pathologies interfere with the software update. If a problem is encountered, it is noted in the Alert Log and the update process is aborted. System software updates do not proceed until all problems have been corrected. You can manually run the same health checks in advance of any planned update.
Page 438 Apply Software Update dialog box in the BUI by clicking Check. The system remains in the Unchecked state until the Check button is clicked. During the health check operation, an indicator shows its progress. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 439: Checking System Health (Cli)
Checking System Health (CLI) After completion, the System Ready state changes to Yes or No with a link to the Alert Log. Checking System Health (CLI) Use the following procedure to check system health using the CLI. To select the update media, use the following CLI command: hostname:maintenance system updates>...
Page 440: Troubleshooting Update Health Check Failures
Alert Log message and recommended order of steps you can take to resolve the issue. For component faults, follow the instructions for removal and installation found in the maintenance procedures for your controller. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 441: Resolving Health Check Alerts
Resolving Health Check Alerts Resolving Health Check Alerts TABLE 57 ID and Alert Log Message Failure Resolution Steps SIM or IOM cannot be detected. 1, 2, 4 "System software update cannot proceed: Slot <label> in disk shelf <name> is reported as absent." SIM or IOM is faulted.
Page 442 After two minutes, re-seat SIM or IOM and wait for steady Power LED before reconnecting cables. Identify affected chassis, and remove faulted disk. After 30 seconds, re-seat disk and wait for steady or flashing LED. Contact Oracle Support for component service or replacement. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 443: Deferred Updates
Replication failures can occur if the target appliance does not support a feature used Note - by the project or share being replicated. See the "Incompatible Target" failure in section “Replication Failures” in Oracle ZFS Storage Appliance Administration Guide, Release OS8. 6.x. To apply deferred updates, use one of the following tasks: Applying Deferred Updates BUI, ■...
Page 444: Applying Deferred Updates (Bui)
Waiting media is listed as unavailable if the currently active software is not sufficiently recent to be able to upgrade to that waiting media. In this example, media has been downloaded for Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 445: Passthrough X Deferred Update
Passthrough x Deferred Update both 2011.1.4.2 and 2013.1 but the 2013.1 update is unavailable because you first need to upgrade to at least 2011.1.4.2. Deferred updates: The following incompatible updates are available. Applying these updates will enable new software features as described below, but will prevent older versions of the software from accessing the underlying resources.
Page 446: User Quotas Deferred Update
COMSTAR Deferred Update The COMSTAR framework relies on a ZFS pool update for complete support of persistent group reservations (PGRs). Before this update has been applied, the number of reservations Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 447: Triple Parity Raid Deferred Update
Triple Parity RAID Deferred Update stored with each LUN is severely limited, and may even be zero. Applying this update is equivalent to upgrading the on-disk ZFS pool to version 16. Related Topics Applying Deferred Updates BUI, ■ “Understanding Deferred Updates” on page 452 ■...
Page 448: Replication Deferred Update
Before this update has been applied, log records continue to be written in the old format and performance may be reduced. Applying this update is equivalent to upgrading the on-disk ZFS pool to version 23. Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 449: Snapshot Deletion Deferred Update
Snapshot Deletion Deferred Update Related Topics Applying Deferred Updates BUI, ■ “Understanding Deferred Updates” on page 452 ■ Snapshot Deletion Deferred Update This deferred update increases snapshot deletion parallelism and reduces the size of transaction groups associated with snapshot deletion to improve systemic responsiveness. Before this update has been applied, new snapshot data is stored in the old format and deleted using the old algorithm.
Page 450: Raidz Mirror Deferred Update
This deferred update allows a LUN to be associated with more than one initiator group at a time. If replicating LUNs with this update applied, also apply the update to the replication target system(s). Related Topics Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 451: Large Block Sizes Deferred Update
Large Block Sizes Deferred Update Applying Deferred Updates BUI, ■ “Understanding Deferred Updates” on page 452 ■ Large Block Sizes Deferred Update This feature provides improved performance when blocksize/recordsize larger than 128K are used. The supported block sizes are: 256k, 512k, and 1M. If large block sizes are used for projects or shares, replication of those projects or shares to systems that do not support large block sizes fail.
Page 452: Acl Passthrough With Mode Preservation Deferred Update
Once the update is applied, rolling back to previous versions will result in undefined behavior. For these updates, you will always be given an explicit option of applying them automatically Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 453 Understanding Deferred Updates during upgrade or applying them after the fact. They are therefore referred to as "deferred updates". When applying an update to a version with incompatible version changes, you are given an option to apply these version changes as part of the update. For each version change, the benefits of applying the change are presented to you.
Page 454 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 455: Working With Firmware Updates
Following the application of a software update, any hardware for which the update includes newer versions of firmware is upgraded. Before the upgrade window, it is recommended to run a scrub as described in “Scrubbing a Storage Pool (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.x.
Page 456 UI in the form of missing or offline devices. This is not a cause for concern; however, if a device remains offline or missing for an extended period of time Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 457: Checking The Status Of Firmware Updates (Bui)
Checking the Status of Firmware Updates (BUI) (several minutes or more) even after refreshing the hardware view, this may be an indication of a problem with the device. Check the Maintenance > Problems view for any relevant faults that may have been identified. Additionally, in some cases, the controllers in the disk shelves may remain offline during firmware update.
Page 458 Checking the Status of Firmware Updates (CLI) Component Current Version Status Chassis 0945QCQ00A (SAS Expander 00) 3232 some disks only have 1 path(s) (2 paths required) In Progress No Updates in Progress Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 459: Rolling Back System Software
Rolling Back System Software The rollback procedure reverts all of the system software and all of the metadata settings of the system back to their state just prior to applying an update. This feature is implemented by taking a snapshot of various aspects of the system before the new update is applied, and rolling back this snapshot to implement the rollback.
Page 460: Rolling Back The System Software (Bui)
The confirmation step looks like this: SunOS Release 5.11 Version ak/generic@2011.04.24.4.2,1-1.28 64-bit Copyright (c) 1983, 2010, Oracle and/or its affiliates. All rights reserved. System rollback in progress. Rollback to: ak/nas@2011.04.24.4.2,1-1.28...
Page 461: Rolling Back The System Software (Cli)
Rolling Back the System Software (CLI) Rolling Back the System Software (CLI) Use the following procedure to roll back the system software using the CLI. To roll back to a previous software version, select the update that corresponds to that version and execute the rollback command. You will be asked to confirm to execute a rollback, and then the system will reboot and execute the rollback.
Page 462 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...
Page 463: Removing An Update Package
Removing an Update Package This section describes how to remove an update package. Removing an Update Package (BUI) Use the following steps to remove an update package using the BUI. To remove an update package, highlight the corresponding row and click on the trash icon Removing an Update Package (CLI) Use the following steps to remove an update package using the CLI.
Page 464 Oracle ZFS Storage Appliance Customer Service Manual • December 2016...

This manual is also suitable for:

Zs5 series Zs4-4 De 24 series Zs5-4 Zs5-2 Zs3-4 ... Show all

Oracle ZS3 Series Owner's Manual

Quick Links

Related Manuals for Oracle ZS3 Series

Summary of Contents for Oracle ZS3 Series