Page 1 Oracle ZFS Storage Appliance Customer ® Service Manual For ZS4-4, ZS3-x, 7x20 Controllers, and DE2-24, Sun Disk Shelves, Release OS8.6.0 Part No: E71921-01 July 2016...
Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l’accès à...
Page 5: Table Of Contents
Configuring the Management Port .............. 30 Using Oracle ILOM to Diagnose Hardware Faults .......... 31 ▼ Logging in to Oracle ILOM Using a Local Serial Connection .... 31 ▼ Logging in to Oracle ILOM Remotely Using a Web Interface .... 32 ▼ Logging in to Oracle ILOM Remotely Using a Command Line...
Page 6 Servicing the ZS4-4 Controller ................ 55 ▼ Replacing a ZS4-4 HDD or SSD .............. 55 ▼ Replacing a ZS4-4 Power Supply .............. 57 ▼ Replacing a ZS4-4 Fan Module .............. 58 ▼ Identifying a Faulted ZS4-4 Memory Module .......... 60 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 7 Contents ▼ Replacing a ZS4-4 DIMM ................. 62 ▼ Replacing a ZS4-4 Memory Riser Card ............ 64 ▼ Replacing a ZS4-4 PCIe Card .............. 66 ▼ Replacing a ZS4-4 Battery ................. 71 ZS4-4 Controller Hardware Overview ............... 74 ZS4-4 Base Configuration ............... 74 ZS4-4 Front and Rear Panel Components .......... 75 ZS4-4 PCIe I/O Cards ................
Page 8 7120 Base Configuration ............... 242 7120 Chassis Overview ................ 242 7120 Front Panel ................. 243 7120 Rear Panel .................. 243 7120 Physical Specifications .............. 244 7120 Electrical Specifications .............. 244 7120 Internal Boards ................ 245 7120 CPU and Memory ................ 246 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 9 Contents 7120 Power Distribution, Fan Module and Disk Components ....... 247 7120 I/O Components ................ 248 7120 NIC/HBA Options ................ 249 7120 PCIe Options ................ 250 7120 Connectors .................. 251 7120 Cables .................. 252 7120 Attached Storage ................ 253 Servicing the Disk Shelves ................ 255 Electrostatic Discharge Precautions .............. 255 ▼ Replacing a Faulty Disk Shelf Drive ............ 256 ▼...
Page 10 ▼ Checking for and Downloading Software Updates (BUI) ....... 318 ▼ Checking for and Downloading Software Updates (CLI) ........ 318 ▼ Removing System Updates (BUI) .............. 319 ▼ Removing System Updates (CLI) .............. 319 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 11 Contents Upgrading the Software ................... 321 Preparing to Upgrade the Software .............. 321 Upgrading Software on a Standalone Controller .......... 322 ▼ Upgrading Software on a Standalone Controller (BUI) ...... 323 ▼ Upgrading Software on a Standalone Controller (CLI) ...... 324 Upgrading Software on Clustered Controllers ........... 327 ▼...
Page 12 ▼ Rolling Back the System Software (BUI) ............ 360 ▼ Rolling Back the System Software (CLI) ............ 361 Removing an Update Package ................ 363 ▼ Removing an Update Package (BUI) ............ 363 ▼ Removing an Update Package (CLI) ............ 363 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 13: Servicing The Oracle Zfs Storage Appliance
Servicing the Oracle ZFS Storage Appliance This document encompasses the following sections that describe maintenance procedures for the Oracle ZFS Storage Appliance. To service the appliance hardware components, use the following sections: “Getting Started with Servicing the Hardware” on page 15 ■...
Page 14 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 15: Getting Started With Servicing The Hardware
■ “CLI Hardware View” on page 26 ■ “Configuring the Management Port” on page 30 ■ “Using Oracle ILOM to Diagnose Hardware Faults” on page 31 ■ “Understanding Hardware Status” on page 33 ■ “Working with Problems” on page 36 ■...
Page 16: Introduction To The Cli
Leave this detailed view Power off, reboot, or diagnostic reboot Click for more details Offline disk Hardware component is ok Port active (green) Hardware component is Port inactive not present (grey) Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 17: Viewing The Remaining Ssd Endurance (Bui)
Viewing the Remaining SSD Endurance (BUI) Icon Description Icon Description Hardware component is faulted (amber) Viewing the Remaining SSD Endurance (BUI) Use the following procedure to view the remaining SSD endurance. Go to Maintenance > Hardware. Click Show Details to view controller details. Click Disk.
Page 18: Setting A Threshold Alert For Ssd Endurance (Bui)
In the Threshold field, select SSD: Endurance on any device and specify and its parameters. Specify the parameters for Timing and Alert actions. (Optional) Click TEST to verify the settings. Click APPLY. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 19: Viewing Cpu Details (Bui)
Viewing CPU Details (BUI) Viewing CPU Details (BUI) Use the following procedure to view CPU details. Go to Maintenance > Hardware. Click Show Details to view controller details. Click CPU. Hover over a CPU row and click its information icon .
Page 20: System Chassis
(power cycle), or reboot the appliance with diagnostics. Only select the diagnostic reboot option when instructed by Oracle Service personnel because it could take a long time to complete and could have adverse results if not performed properly. Do not perform a diagnostic reboot when system-affecting operations are occurring, such as upgrading firmware, executing commands, and configuring or unconfiguring storage.
Page 21: Disk Shelves
Viewing CPU Details (BUI) Property Description If there are no cache devices installed in the system chassis, "-" will be displayed. Size and number of log disks in the system chassis. This is only valid for standalone systems. If there are no log devices installed in the system chassis, "-"...
Page 22: Chassis Details View
Chassis Component Properties TABLE 4 Property Description Label Human-readable identifier for this component within the chassis. This is typically, but not necessarily, equivalent to the label printed on the physical chassis. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 23: Disk Shelf Details View
Chassis Details View Property Description FMRI Fault managed resource identifier (FMRI) for the component. This is an internal identifier used to identify the component within faults and is intended for service personnel. Active Problems For a faulted component, links to active problems affecting the component. Manufacturer Component manufacturer.
Page 24 Faulted devices are already avoided, so this option should only be required if a disk is exhibiting performance problems that do not result in pathological failure. It is not Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 25: Ssd Endurance
You can set a threshold alert when an SSD exceeds a specified percentage. For example, set an alert to occur when one or more SSD devices exceeds a 95% threshold. For more information, see “Threshold Alerts” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0.
Page 26: Service Processor
CPU 1 Quad-Core AMD Op cpu-002 CPU 2 Quad-Core AMD Op cpu-003 CPU 3 Quad-Core AMD Op disk-000 HDD 0 STEC MACH8 IOPS disk-001 HDD 1 STEC MACH8 IOPS Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 27: Component Properties
CLI Hardware View disk-002 HDD 2 absent disk-003 HDD 3 absent disk-004 HDD 4 absent disk-005 HDD 5 absent disk-006 HDD 6 HITACHI HTE5450SASUN500G disk-007 HDD 7 HITACHI HTE5450SASUN500G fan-000 FT 0 unknown ASY,FAN,BOARD,H2 fan-001 FT 0 FM 0 Sun Microsystems, Inc. 541-2068 fan-002 FT 0 FM 1 Sun Microsystems, Inc.
Page 28: Viewing The Remaining Ssd Endurance (Cli)
= 2014-3-3 22:04:14 locate = false offline = false As shown above, disk-015 is at 100% which indicate a new SSD. The remaining endurance estimate decreases as the disk is used. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 29: Setting A Threshold Alert For Ssd Endurance (Cli)
Setting a Threshold Alert for SSD Endurance (CLI) Setting a Threshold Alert for SSD Endurance (CLI) Use the following procedure to set a threshold alert for SSD endurance. To set a threshold alert for SSD endurance, use the following CLI commands: hostname:configuration alerts>...
Page 30: Performing A Diagnostic Reboot (Cli)
= 4 speed = 2.14G Performing a Diagnostic Reboot (CLI) Only issue the diagnostic reboot command as instructed by Oracle Service personnel. Caution - A diagnostic reboot gathers diagnostic information before power cycling the appliance. This operation could take a long time to complete and could cause adverse results if not performed properly.
Page 31: Using Oracle Ilom To Diagnose Hardware Faults
In rare cases, faults associated with uncorrectable CPU errors are not diagnosable or displayed in the controller. These faults are preserved by and observable on the Oracle Integrated Lights Out Manager (ILOM), which resides in the Service Processor (SP). Connect to the server ILOM to diagnose hardware faults that do not appear in the BUI.
Page 32: Logging In To Oracle Ilom Remotely Using A Web Interface
Logging in to Oracle ILOM Remotely Using a Web Interface Use the following procedure to log in to Oracle ILOM remotely using a web interface. This procedure requires that you know the administrative account name and password (defaults Before You Begin are root and changeme), and that you know the IP address or host name of the controller Service Processor (SP).
Page 33: Viewing And Clearing Cpu Faults From Ilom
IP address or host name of the controller Service Processor (SP). Using a Secure Shell (SSH) session, log in to Oracle ILOM by specifying your administrative account user name and the IP address or host name of the controller SP.
Page 34: Locating The Chassis Serial Number
You can find a chassis serial number label on the storage controller front panel on the left side. Another label is on the top of the storage controller. You can click the Sun/Oracle logo in the BUI masthead to obtain the serial number.
Page 35 Locating a Failed Component (CLI) Go to the maintenance hardware context: hostname:> maintenance hardware List the appliance components: hostname:maintenance hardware> list NAME STATE MODEL SERIAL chassis-000 hostname Sun Storage 7320 unknown chassis-001 000000000C faulted J4410 000000000C Select the chassis and list its components: hostname:maintenance hardware>...
Page 36: Working With Problems
(defects, often included under faults) and reports them as active problems on this screen. If the phone home service is enabled, active problems are automatically reported to Oracle Support, where a support case may be opened depending on the service contract and the nature of the fault.
Page 37: Repairing Active Problems
If a problem persists after completing the suggested action, contact Oracle support. You might be instructed to mark the problem as repaired. Manually marking a problem as repaired should only be done under the direction of Oracle service personnel or as part of a documented Oracle repair procedure.
Page 38: Related Features
Example BUI Alert Log Entry Displays TABLE 10 Time Event ID Description Type 2013-9-16 13:01:56 An I/O path from slot 'PCIe 0' to chassis Major alert f18bbad1- 'JBOD #1' has been removed. 8084-4cab-c950- 82ef5b8228ea Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 39: Fault Log Entries
This is configured in the Alerts section. All alerts appear in this log, regardless of whether they have actions configured for them. For more information about alerts, see “Configuring Alerts” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0.
Page 40: System Log Entries
Session Annotation 2013-10-12 05:20:24 root deimos Disabled ftp service 2013-10-12 03:17:05 root deimos User logged in 2013-10-11 22:38:56 root deimos Browser session timed out 2013-10-11 21:13:35 root <console> Enabled ftp service Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 41: Phone Home Log Entries
Viewing Logs (BUI) Phone Home Log Entries If Phone Home is used, this log shows communication events with Oracle support. For information about Phone Home, see “Phone Home Configuration” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0. The following is an example phone home entry as it would appear in the BUI:...
Page 42: Viewing All Log Entries (Cli)
To view up to 100 log entries at a time, use the following CLI commands: hostname:maintenance logs> select audit hostname:maintenance logs audit> show ENTRY TIME SUMMARY entry-2874 2014-2-20 18:05:44 root, 10.159.134.211, Beginning system update Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 43 2014-2-20 18:18:20 root, 10.159.134.211, Deleted update media ak-nas@2011.04.24.8.0,1-1.43 entry-2879 2014-2-20 18:34:19 root, 10.159.134.211, Cluster takeover requested entry-2970 2014-2-27 17:40:37 root, dhcp-amer-vpn-rmdc-anyconnect-10-159-100-157.vpn.oracle. com, User logged out of CLI entry-2971 2014-2-27 17:48:23 root, 10.159.100.157, User logged in entry-2972 2014-2-27 19:05:46 root, 10.159.100.157, Browser session timed out entry-2973 2014-2-27 23:53:31 root, dhcp-amer-vpn-rmdc-anyconnect-10-159-125-20.vpn.oracle.
Page 44: Viewing Entry Details (Cli)
Use the following procedure to export logs using the BUI. You can export any combination of log types to your local machine by using the BUI Collect button. To view logs, navigate to the Maintenance > Logs screen. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 45 Exporting Logs (BUI) Click Collect. FIGURE 1 Logs Screen In the Collect Logs dialog box, choose the log types you want to export. To export the logs, click Apply. A <stdout> gz file containing all the requested log information is downloaded to your local machine. Getting Started with Servicing the Hardware...
Page 46: Exporting Logs (Cli)
IMPACT: Performance degradation of the system due to the original fault may have been recovered. REC-ACTION: No action is required. hostname:maintenance logs fltlog> Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 47: Using Workflows
Using Workflows Using Workflows A workflow is a script that is uploaded to and managed by the Oracle ZFS Storage Appliance by itself. For information on scripting, see “Working with CLI Scripting” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0.
Page 48 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 49: Prerequisites For Servicing Hardware
Follow all cautions, warnings, and instructions marked on the equipment and described in ■ Important Safety Information for Oracle's Hardware Systems included with your system. Ensure that the voltage and frequency of your power source match the voltage inscribed on ■...
Page 50: Required Tools And Information
If you have not completed the initial configuration steps, power off the controller using one of the following methods: Use a pen or non-conducting pointed object to press and release the Power button on the ■ front panel. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 51: Extending The Storage Controller From The Rack
Extending the Storage Controller from the Rack SSH or use a serial connection to log in to the service processor (SP), and then issue the ■ command stop /SYS. To initiate an emergency shutdown during which all applications and files will be closed ■...
Page 52: Removing The Top Cover
To access internal controller components for servicing, remove the top cover. Use the following procedure to remove the top cover. Fully loosen the two captive screws at the rear of the top cover (1). Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 53: Powering Off The Disk Shelf
Powering Off the Disk Shelf Slide the top cover rearward 0.5 in (13 mm) and lift it straight up and off the chassis (2), and set the top cover aside. Powering Off the Disk Shelf Most disk shelf components are hot-swappable; you do not need to remove power when replacing them.
Page 54: Related Topics
Note - Related Topics “Powering Off the Controller” on page 50 ■ For details on NSPF profiles, see “Storage Pool Concepts” in Oracle ZFS Storage ■ Appliance Administration Guide, Release OS8.6.0 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 55: Servicing The Zs4-4 Controller
HDDs and SSDs are hot-swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities. Use the following procedure to replace a ZS4-4 HDD or SSD. For information on disk compatibility, see the Oracle Systems Handbook. Servicing the ZS4-4 Controller...
Page 56 After at least 30 seconds, go to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 57: Replacing A Zs4-4 Power Supply
On the replacement drive, open the release lever and slide the drive into the same slot (1) until it is fully seated. Close the latch (2) to lock the drive in place. The Oracle ZFS Storage Appliance software automatically detects and configures the new drive.
Page 58: Replacing A Zs4-4 Fan Module
For this reason, the replacement fan should be unpacked in advance and ready to insert into the controller chassis as soon as the faulted fan is removed. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 59 Replacing a ZS4-4 Fan Module Fan modules cool the motherboard and its components. The fan modules are arranged in stacked pairs (a front row and a back row) to provide redundancy. If you remove a failed fan module, replace it immediately. Fan modules are hot-swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities.
Page 60: Identifying A Faulted Zs4-4 Memory Module
To identify a general memory fault, go to the Maintenance > Hardware screen of the BUI, and click the right-arrow icon for the controller. Then click DIMM and note the ID of the faulted module, which has an amber icon. To highlight the Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 61 Identifying a Faulted ZS4-4 Memory Module location of the memory module in the controller picture, click on the module ID. To view details about the faulted module, click its information icon and then click Active Problems. Shut down the controller using one of the power-off methods described in “Powering Off the Controller”...
Page 62: Replacing A Zs4-4 Dimm
Replacing a ZS4-4 DIMM A CPU is a field replaceable unit (FRU) and must be replaced by a trained Oracle Caution - service technician. Replacing a ZS4-4 DIMM Use the following procedure to replace a ZS4-4 DIMM. Shut down the controller using one of the power-off methods described in “Powering Off the Controller”...
Page 63 Replacing a ZS4-4 DIMM To remove the failed DIMM, rotate both DIMM slot ejector levers outward as far as they will go. Carefully lift the DIMM straight up to remove it from the socket. Repeat the previous steps for any other faulty DIMMs. Ensure that the DIMM ejector levers at both ends of the DIMM slot are in a fully open position.
Page 64: Replacing A Zs4-4 Memory Riser Card
Because 3.3 VDC standby power is always present in the system, you must unplug Caution - the power cords before accessing any cold-serviceable components. Extend the controller from the rack as described in “Extending the Storage Controller from the Rack” on page Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 65 Replacing a ZS4-4 Memory Riser Card Remove the top cover as described in “Removing the Top Cover” on page To remove the memory riser card, pull the handles upward to disengage the connector from the motherboard, and carefully lift the memory riser straight up and out of the controller.
Page 66: Replacing A Zs4-4 Pcie Card
To highlight the location of the card in the controller picture, click on the card ID. To view details about the faulted card, click its information icon and then click Active Problems. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 67 Replacing a ZS4-4 PCIe Card This procedure requires that you handle components that are sensitive to static Caution - discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components. Shut down the controller using one of the power-off methods described in “Powering Off the Controller”...
Page 68 Carefully remove the PCIe card from the PCIe card slot. Whenever you remove a PCIe card, you should replace it with another PCIe card or a Caution - filler panel; otherwise, the controller might overheat due to improper airflow. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 69 Replacing a ZS4-4 PCIe Card Ensure the PCIe card retaining bar is open. Servicing the ZS4-4 Controller...
Page 70 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 71: Replacing A Zs4-4 Battery
272. If you installed a new HBA, install the disk shelf as described in “Installation Prerequisites and Hardware Overviews” in Oracle ZFS Storage Appliance Installation Guide and connect the expansion storage as described in “Connecting to Attached Storage” on page 272.
Page 72 Do not deform the metal tab on the positive (+) side of the battery. The metal tab Caution - maintains the positive battery connection and secures the battery in the holder. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 73 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide.
Page 74: Zs4-4 Controller Hardware Overview
Boot Disks Two 2.5-inch SAS-2 HDDs Read Flash Up to four optional 2.5-inch SAS-2 SSDs HBAs Two 4x4-port SAS-2 (base configuration) PCIe slots 11 (4 base configuration, 7 expansion slots) Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 75: Zs4-4 Front And Rear Panel Components
ZS4-4 Controller Hardware Overview Refer to the Oracle ZFS Storage ZS4-4 data sheet at http://www.oracle.com/goto/zs4-4 for the most recent component specification and physical, electrical, and environmental specifications. For information about supported disks and capacities, refer to the Oracle Systems Handbook.
Page 76 Cluster Interface Card Compatibility - The ZS4-4 controller can contain a Version 2 or Version 3 cluster interface card. For clustered controllers, ensure you are using the same version in each controller because these two versions are not compatible. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 77 ZS4-4 Controller Hardware Overview For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Ethernet Ports The ZS4-4 has four RJ-45 10-Gigabit Ethernet (10GbE) network connectors on the rear panel, labeled NET 0, NET 1, NET 2, and NET 3 (bottom left to top right), as shown in the figure below.
Page 78 ZS4-4 Serial Management Port 4x4 SAS-2 HBA The 4x4 SAS-2 HBA provides connectivity to external DE2-24 disk shelves. The HBA ports are numbered 3-0, top to bottom, as shown in the following figure. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 79: Zs4-4 Pcie I/O Cards
ZS4-4 Controller Hardware Overview 4x4 SAS-2 HBA Port Numbers FIGURE 7 ZS4-4 PCIe I/O Cards The ZS4-4 base configuration contains the following PCIe cards: One 8-port SAS-2 internal HBA (slot 2) ■ Two 4-port (4x4) SAS-2 external HBAs (slot 6 and slot 7) ■...
Page 80 See the legend for a description of the interconnect types and option codes shown in the Type column. Slot Description Type Note 2-port InfiniBand CX3 HCA Optional recommended front- 2-port 10Gb Ethernet Optical Optional recommended front- 2-port 10Gb Ethernet Copper Optional recommended front- Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 81 ZS4-4 Controller Hardware Overview Slot Description Type Note 16GB Dual Universal FC HBA Optional FC target or initiator (Backup) 8-port SAS-2 Internal HBA Base configuration 4-port (4x4) SAS-2 External Optional back-end 2-port InfiniBand CX3 HCA Optional recommended front- 2-port 10Gb Ethernet Optical Optional recommended front- 2-port 10Gb Ethernet Copper Optional recommended front-...
Page 82 10GBase-SR/LR port 1GBase-T - Optical Transceiver SFP Short -Copper RJ-45 Serial RS-232 Range 10Gbs -Copper RJ-45 Unshielded Twisted - Optical Transceiver SFP Long Pair Range 10Gbs GbE NIC UTP 10GBase-T Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 83: Zs4-4 Internal Components
- Copper RJ-45 Unshielded Twisted Pair ZS4-4 Internal Components The ZS4-4 chassis contains both customer-replaceable units (CRUs) and field-replaceable units (FRUs) as shown in the following figure. FRUs must be replaced by trained Oracle service technicians. FIGURE 9 Internal Components (Exploded View)
Page 84 2.8 GHz CPUs and eight memory riser cards as shown in the following figure. The memory configuration is 16GB DDR3 DIMMs to accommodate up to 1.5TB (ninety-six 16GB). All ZS4-4 DIMM risers are fully populated to accommodate this offering. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 85 ZS4-4 Controller Hardware Overview ZS4-4 CPU and Memory FIGURE 11 Figure Legend Memory riser card P3/MR1 Memory riser card P0/MR1 Memory riser card P3/MR0 Memory riser card P0/MR0 Memory riser card P2/MR1 CPU P3 Memory riser card P2/MR0 CPU P2 Memory riser card P1/MR1 CPU P1 Memory riser card P1/MR0...
Page 86 The following figure shows the cooling zones and the approximate location of the temperature sensors. The accompanying legend table provides sensor NAC names and sensor motherboard designations. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 87 ZS4-4 Controller Hardware Overview ZS4-4 Cooling Subsysem FIGURE 12 Figure Legend Cooling zone 0 Temperature sensor TS_ZONE2 (U4505) Cooling zone 1 Temperature sensor TS_OUT (U4506) Cooling zone 2 Temperature sensor TS_TVL_1 (U4002) Cooling zone 3 (power supply Temperature sensor TS_TVL_0 backplane area) (U4302) Temperature sensor TS_PS (U4603)
Page 88: Zs4-4 Attached Storage
Read cache devices must be contained in either the controller or disk shelf, not both. Note - Related Topics “Connecting to Attached Storage” on page 272 ■ “Disk Shelf Hardware Overview” on page 272 ■ Oracle ZFS Storage Appliance Cabling Guide ■ Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 89: Servicing The Zs3-4 Controller
Most hardware faults clear after replacing the affected component. If a fault does not self-clear, “Repairing Active Problems” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to upgrade your controllers for disk shelf interoperability.
Page 90 After at least 30 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 91: Replacing A Zs3-4 Fan Module
Slide the replacement drive into the slot until it is fully seated. Close the latch to lock the drive in place. The Oracle ZFS Storage system software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller or drive shelf.
Page 92 If a fault does not self-clear, see “Repairing Active Problems” on page Push the release tabs on the side of each rail and slowly slide the storage controller into the rack. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 93: Replacing A Zs3-4 Power Supply
Replacing a ZS3-4 Power Supply Replacing a ZS3-4 Power Supply Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to ensure proper air flow. A faulted power supply is indicated by an amber colored status LED. Use the following procedure to replace a ZS3-4 power supply.
Page 94 Replacing a ZS3-4 Power Supply Grasp the power supply handle and press the release latch to remove the power supply. Align the replacement power supply with the empty power supply chassis bay. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 95: Replacing A Zs3-4 Dimm
Replacing a ZS3-4 DIMM Slide the power supply into the bay until it is fully seated. The following figure shows the power supply. Connect the power cord to the power supply. Verify that the green AC Present status indicator is lit. Close the CMA, inserting the CMA into the rear left rail bracket.
Page 96 Remove the top cover as described in “Removing the Top Cover” on page To locate the DIMM you want to service, press the Fault Remind Button on the storage controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 97 Replacing a ZS3-4 DIMM The following illustration shows the Fault remind button on the ZS3-4 controller. Servicing the ZS3-4 Controller...
Page 98 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 99 Replacing a ZS3-4 DIMM Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly. Push the DIMM into the connector until the ejector tabs lock the component in place.
Page 100 Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 101 Replacing a ZS3-4 DIMM Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage. Servicing the ZS3-4 Controller...
Page 102 Replacing a ZS3-4 DIMM Push the release tabs on the side of each rail and slowly push the storage controller into the rack. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 103 The following image shows the chassis. Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 104: Replacing A Zs3-4 Pcie Card Or Riser
Remove the top cover as described in “Removing the Top Cover” on page Locate the PCIe card position in the storage controller, see “ZS3-4 PCIe I/O Cards” on page 121. To replace the PCIe card: Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 105 Replacing a ZS3-4 PCIe Card or Riser Disengage the PCIe card slot crossbar from its locked position and rotate the crossbar into an upright position. Remove the retaining screw that holds the PCIe card to the chassis. Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary.
Page 106 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 107 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 108: Replacing A Zs3-4 Battery
Extend the controller from the rack as described in “Extending the Storage Controller from the Rack” on page Remove the top cover as described in “Removing the Top Cover” on page Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 109 Replacing a ZS3-4 Battery Using a small, non-metallic screwdriver, press the latch and remove the battery from the motherboard. The battery is shown here. Press the replacement battery into the motherboard with the positive side (+) facing upward. To install the top cover: Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Page 110 Use a pen, or other pointed object, to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 111: Zs3-4 Controller Hardware Overview
Connect data cables to the PCIe card, routing them through the cable management arm. When the system has finished booting, log in and set the time using the steps in the task “Setting Clock Synchronization (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0. ZS3-4 Controller Hardware Overview To understand the ZS3-4, see the following topics: “ZS3-4 Base Configuration”...
Page 112: Zs3-4 Front And Rear Panel Components
Volt-Ampere rating: 1837 VA @ 240 VAC, 0.98 P.F. ■ ZS3-4 Front and Rear Panel Components ZS3-4 Front Panel Components - The ZS3-4 controller drive slots and front panel components are shown in the following figure. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 113 ZS3-4 Controller Hardware Overview ZS3-4 Controller Front Panel FIGURE 13 Figure Legend Figure Legend Locator LED and button (white) USB 2.0 Connectors Service Required LED (amber) DB-15 video connector Power/OK LED (green) Boot drive 0 Power button Boot drive 1 (required) Service Processor (SP) OK LED (green) Solid state drive 2 (optional) Fan/CPU/Memory Service Required LED...
Page 114 This card cannot be replaced with a Version 3 cluster interface card. For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 115 ZS3-4 Controller Hardware Overview Ethernet Ports There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec. These network interfaces must be configured before use. Network Management Port The network management connector (NET MGT) is an RJ-45 10/100 BASE-T Ethernet port and provides a LAN interface to the SP console.
Page 116: Zs3-4 Internal Components
Figure Legend Figure Legend Motherboard CPUs and heatsinks Low-profile PCIe cards Memory risers Power supplies Fan board Power supply backplane Fan modules Drive backplane Boot drives and SSDs System lithium battery Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 117 ZS3-4 Internal Boards - The ZS3-4 controller chassis contains the following field-replaceable units (FRUs). FRUs are not customer-serviceable, and should only be replaced by trained Oracle service technicians. Motherboard - The motherboard includes CPU modules, slots for eight DIMM risers, ■...
Page 118 “ZS3-4 PCIe I/O Cards” on page 121 for slot placement. ZS3-4 CPU and Memory - The ZS3-4 controller supports 16GB DDR3 DIMMs installed on all eight risers, accommodating 1TB of memory. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 119 ZS3-4 Controller Hardware Overview ZS3-4 Controller DIMM Risers FIGURE 20 Refer to the service label on the cover for DIMM placement information. On every memory riser, slots D0, D2, D4, and D6 must be populated; optionally, slots D1, D3, D5, and D7 may be populated as a group on installed memory risers.
Page 120 ZS3-4 Fan Modules - The Fan Modules and Fan Module LEDs of the controller are shown in the following figure. The following LEDs are lit when a fan module fault is detected: Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 121: Zs3-4 Pcie I/O Cards
ZS3-4 Controller Hardware Overview ZS3-4 Controller Fan Modules FIGURE 22 Front and rear Service Action Required LEDs ■ Fan Module Service Action Required (TOP) LED on the front of the server ■ Fan Fault LED on or adjacent to the faulty fan module ■...
Page 122 2-port 16Gb FC HBA Optional FC target or initiator (backup) 511-1496-05 Cluster Controller 200 Cluster base configuration 7070006 2-port 10Gb Ethernet Copper Optional recommended front- 375-3696-01 2-port InfiniBand CX2 HCA Optional recommended front- Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 123 ZS3-4 Controller Hardware Overview Mfg Part Slot Description Note Number 7070195 4-port 1GbE UTP Ethernet Optional recommended front- 7051223 2-port 10Gb Ethernet Optical Optional recommended front- 371-4325-02 2-port 8Gb FC HBA Optional FC target or initiator (backup) 7023303 2-port 16Gb FC HBA Optional FC target or initiator (backup) 7070006...
Page 124 Slot 0 is always populated with a SAS-2 internal HBA. Slots 1 and 8 are reserved for Note - 4x4 SAS-2 external HBAs. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 125: Zs3-4 Attached Storage
ZS3-4 Controller Hardware Overview ZS3-4 Controller PCIe Cards Slot Order FIGURE 23 Install optional PCIe cards in the following order: TABLE 21 ZS3-4 Controller Optional PCIe Cards and Slot Order PCIe Card Slot Order 1. 4-port (4x4) SAS-2 external HBA Slot 2, 7 2.
Page 126 Read cache devices must be contained in either the controller or disk shelf, not both. Note - Related Topics “Connecting to Attached Storage” on page 272 ■ “Disk Shelf Hardware Overview” on page 272 ■ Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 127: Servicing The Zs3-2 Controller
Most hardware faults clear after replacing the affected component. If a fault does not self-clear, “Repairing Active Problems” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to upgrade your controllers for disk shelf interoperability.
Page 128: Installing Optional Pcie Slot Cards In Order
Install 10Gb Ethernet Optical NICs (7051223) and or, Install 10Gb Ethernet Copper NICs (7070006) and or, Install 8Gb FC HBAs (371-4325-02) or 16Gb FCs HBA (7023303) and or, Install 1Gb Ethernet Copper NICs (7070195). Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 129: Disconnecting The Rj-45 Cable From The Cluster Serial Port
Disconnecting the RJ-45 Cable from the Cluster Serial Port Disconnecting the RJ-45 Cable from the Cluster Serial Port Using your index finger, press down fully on the RJ-45 release tab. Be sure the tab is fully disengaged from the port. Servicing the ZS3-2 Controller...
Page 130: Replacing A Zs3-2 Hdd Or Ssd
Identify the failed drive by going to the Maintenance > Hardware section of the BUI and clicking the drive information icon . If you are physically at the system, the amber Service Required indicator on the HDD or SSD should be illuminated. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 131 Replacing a ZS3-2 HDD or SSD If you are not physically at the system, turn on the locator indicator by clicking the locator icon At the front of the controller, pinch the air filter's left and right release levers inward (1). Pivot the air filter forward and lift if out of the chassis (2).
Page 132 Align the replacement drive with the drive slot. Press on the release button to slide the drive into the chassis until the release lever moves slightly inward. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 133: Replacing A Zs3-2 Power Supply
Replacing a ZS3-2 Power Supply Press the release lever fully closed with a click, securing the drive into the drive slot. Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon for the controller and then click Disk to verify that the online icon is green for the newly installed drive.
Page 134 Disconnect the power cord from the faulted power supply. Press the release tab to the left and pull on the handle. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 135 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Servicing the ZS3-2 Controller...
Page 136: Replacing A Zs3-2 Fan Module
Hardware screen of the BUI for the fan you want to replace. Power off the storage controller as described in “Powering Off the Controller” on page Disconnect the AC power cords from the rear panel of the storage controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 137 Replacing a ZS3-2 Fan Module Because 3.3 VDC standby power is always present in the system, you must unplug Caution - the power cords before accessing any cold-serviceable components. Extend the controller from the rack as described in “Extending the Storage Controller from the Rack”...
Page 138 Replace the top cover and tighten the two captive screws. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 139: Replacing A Zs3-2 Dimm
Replacing a ZS3-2 DIMM Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 140 Disconnect the cables attached to the drive backplane, and the cable attached to the USB board. Fully loosen the four screws securing the drive cage to the chassis (1). Raise the drive cage to the vertical position (2). Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 141 Replacing a ZS3-2 DIMM Fully loosen the thumbscrews that secure the air duct. Slide the left (L) thumbscrew bracket forward and off of the mounting pins. Slide the right (R) thumbscrew bracket rearward and off of the mounting pins. Set the thumbscrew bracket aside. Servicing the ZS3-2 Controller...
Page 142 Lift the air duct straight up and off the alignment pins. Set the air duct aside. Press the button on the midplane. An amber LED indicates the faulty DIMM. Press down and out on the release levers at both ends of the DIMM slot. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 143 Replacing a ZS3-2 DIMM Lift the DIMM up and out of the slot. Set the DIMM aside on an antistatic mat. Servicing the ZS3-2 Controller...
Page 144 Replacing a ZS3-2 DIMM Align the DIMM to the location where it installs into the slot. Ensure that the notch in the DIMM lines up with the key in the slot. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 145 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 146: Replacing A Zs3-2 Pcie Card Or Riser
Remove the top cover as described in “Removing the Top Cover” on page Locate the PCIe card position in the storage controller, see “ZS3-2 PCIe I/O Cards” on page 169. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 147 Replacing a ZS3-2 PCIe Card or Riser Fully loosen the two captive screws securing the riser to the motherboard. Servicing the ZS3-2 Controller...
Page 148 Disconnect any internal cables attached to the PCIe cards installed in the riser. Swing the retainer to its fully open (120 degrees) position. Note that the riser 3 latch is slightly different than the latch for riser 1 and 2. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 149 Replacing a ZS3-2 PCIe Card or Riser Lift the PCIe card off of the bracket alignment pin and out of the socket. Position the replacement PCIe card with where it will install into the riser. The PCIe card bracket mates with the alignment pin and the socket of the riser. Press the PCIe card into the socket.
Page 150 Align the riser to the location where it installs into the chassis. Reconnect any previously removed internal cables to the PCIe card installed in the riser, if doing so will ease installation of the riser. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 151 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 152: Replacing A Zs3-2 Flash Drive
Remove the top cover as described in “Removing the Top Cover” on page If a PCIe card installed in Riser 2 prevents you from accessing the USB drive, remove Riser 2. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 153 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 154: Replacing A Zs3-2 Battery
Remove the top cover as described in “Removing the Top Cover” on page Remove Riser 1. Press the tab of the battery receptacle forward to release the battery. The battery pops up. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 155 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies. Verify that standby power is on, indicated by the Power/OK and SP status indicators flashing green on the front panel.
Page 156: Zs3-2 Controller Hardware Overview
SAS-2 6Gb/s external 512GB 16x32GB Refer to the product site at for the most https://www.oracle.com/storage/nas/index.html recent component specification. For information about supported disks and capacities, refer to the Oracle Systems Handbook. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 157: Zs3-2 Front And Rear Panel Components
ZS3-2 Controller Hardware Overview ZS3-2 Front and Rear Panel Components ZS3-2 Front Panel Components - The ZS3-2 controller drive slots and front panel components are shown in the following figure. FIGURE 24 ZS3-2 Controller Front Panel Drive slots 0 and 1 have two mirrored boot drives. Up to four read-optimized cache solid state drives (SSDs) fill slots 2 through 5, in order.
Page 158 Cluster Interface Compatibility - The ZS3-2 controller contains embedded support for Version 2 clustering ports. It does not have a cluster interface card nor can one be installed in a PCIe slot. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 159 ZS3-2 Controller Hardware Overview Ethernet Ports The ZS3-2 has four RJ-45 10-Gigabit Ethernet (10GbE) network connectors, labeled NET 3, NET 2, NET 1, and NET 0 (left to right) on the rear panel. The ports operate at 100 Mbits/sec, 1000 Mbits/sec, or 10-Gbits/sec. Use these ports to connect the appliance to the network. ZS3-2 Ethernet Port LEDs Description TABLE 23 Connection Type...
Page 160 When disconnecting an RJ-45 cable from a cluster serial port (0 and 1), use extreme Caution - care not to damage the internal RJ-45 receptacle. To properly remove an RJ-45 cable from a cluster serial port, do the following: Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 161: Zs3-2 Specifications
ZS3-2 Controller Hardware Overview ZS3-2 Controller Cluster I/O Ports: Serial 0, Serial 1, Ethernet FIGURE 29 4x4 SAS-2 HBA The 4x4 SAS-2 HBA, installed in PCIe slot 2 of the ZS3-2, provides connectivity to external DE2 and Sun Disk Shelves. The HBA ports are numbered 0-3, left to right, as shown in the following figure.
Page 162: Zs3-2 Internal Components
PCIe Risers - There are three risers per system, each attached to the rear of the ■ motherboard. Each riser supports two PCIe cards (which are customer replaceable units (CRUs). Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 163 ZS3-2 Motherboard, Memory, and PCIe Cards - The ZS3-2 controller motherboard, memory, and PCIe components are described in the following figure and legend. Field replaceable components (FRUs) are not customer-serviceable, and must be Note - replaced by trained Oracle service technicians. Servicing the ZS3-2 Controller...
Page 164 ZS3-2 Controller Motherboard, Memory, and PCIe Components FIGURE 31 Figure Legend Drive cage (FRU) Airduct Battery Drive backplane (FRU) PCIe Risers (FRU) PDB duct Motherboard (FRU) PCIe cards Power distribution board (FRU) Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 165 ZS3-2 Controller Hardware Overview Figure Legend DIMMs USB flash drive ZS3-2 CPU and Memory - The ZS3-2 controller motherboard has 16 slots in two groups that hold industry-standard DDR3 low voltage (LV) DIMMS. ZS3-2 Controller CPU and Memory Components FIGURE 32 All sockets must be occupied by identical DDR3 DIMMs.
Page 166 ZS3-2 Storage, Power, and Fan Components - The ZS3-2 controller's internal storage, power, and cooling components are described in the following figure and legend. A component identified as a field replaceable unit (FRU) must be replaced by trained Oracle service technicians.
Page 167 ZS3-2 Controller Hardware Overview ZS3-2 Controller Storage, Power, and Fan Components FIGURE 33 Figure Legend Air Filter Drive power cable (FRU) Fan modules Drives Drive signal cable (FRU) Fan tray Chassis (FRU) Top cover USB board (FRU) Servicing the ZS3-2 Controller...
Page 168 (FRU) internal cables. FRUs are not customer-serviceable, and must be replaced by trained Oracle service technicians. ZS3-2 Controller Internal Cables FIGURE 34 Figure Legend PDB signal cable Drive signal cable Drive power cable USB board cable LED board cable Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 169: Zs3-2 Pcie I/O Cards
ZS3-2 Controller Hardware Overview ZS3-2 PCIe I/O Cards ZS3-2 PCIe I/O Options - The following table describes the supported PCIe configuration options for the ZS3-2 controller. Slots 1 and 2 are reserved for internal and external HBAs, as shown in the following table. When adding PCIe cards, populate from higher order slots (6) first toward lower order slots.
Page 170: Zs3-2 Optional Cable Management Arm
Riser 3 contains slots 3 and 6 ■ ZS3-2 Optional Cable Management Arm The following figure identifies the components of the second-generation cable management arm (CMA). See the CMA installation instructions. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 171: Zs3-2 Attached Storage
ZS3-2 Controller Hardware Overview ZS3-2 Controller Optional Cable Management Arm FIGURE 35 Figure Legend Connector A Connector D Front slide bar Slide-rail latching bracket (used with connector D) Velcro straps (6) Rear slide bar Connector B Cable covers Connector C ZS3-2 Attached Storage The ZS3-2 controller connects to external storage through a 4-port (4x4) SAS-2 HBA.
Page 172 For more information, see “Connecting to Attached Storage” on page 272. See also “Disk Shelf Hardware Overview” on page 272 for component specifications and diagrams. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 173: Servicing The 7X20 Controller
Most hardware faults clear after replacing the affected component. If a fault does not self-clear, “Repairing Active Problems” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to upgrade your controllers for disk shelf interoperability.
Page 174 After at least 30 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 175: Replacing A 7X20 Fan Module
Replacing a 7x20 Fan Module Slide the replacement drive into the slot until it is fully seated. Close the latch to lock the drive in place. Go to the Maintenance > Hardware screen of the BUI. Click the right-arrow icon for the controller or disk shelf and then click Disk to verify that the online icon is green for the newly installed drive.
Page 176 The storage controller might overheat and shut down if the door is left open for more Caution - than 60 seconds. 7420: The following illustration shows the fan modules in the 7420 storage controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 177 Replacing a 7x20 Fan Module To flash the locator LED on the chassis to service, go to Maintenance > Hardware in the BUI and click the associated locator icon , or go to the service processor (SP) prompt and enter set /SYS/LOCATE status=on To locate the faulted component, go to Maintenance >...
Page 178 If the system is still powered on, identify the fan module with the lit fault indicator. Using thumb and forefinger, squeeze the tabs together to pull the fan module up and out. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 179 Replacing a 7x20 Fan Module Insert the replacement fan module into the slot and apply firm pressure to fully seat it. On the replaced fan module, verify that the Fan OK indicator is lit, and that the fault indicator is not lit. Close the door immediately to maintain airflow in the storage controller.
Page 180: Replacing A 7X20 Power Supply
Replacing a 7x20 Power Supply Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 181 Replacing a 7x20 Power Supply ensure proper air flow. A faulted power supply is indicated by an amber-colored status LED. Use the following procedure to replace a 7x20 power supply. Gain access to the rear of the storage controller where the faulted power supply is located.
Page 182 7120 or 7320: Release the latch, then remove the power supply. Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 183 Replacing a 7x20 Power Supply 7420: Grasp the power supply handle and press the release latch to remove the power supply. Align the replacement power supply with the empty power supply chassis bay. Servicing the 7x20 Controller...
Page 184: Replacing A 7X20 Dimm
This procedure requires that you handle components that are sensitive to static Caution - discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 185 Replacing a 7x20 DIMM To identify a specific memory module that has faulted, you must open the storage controller and use the amber status LEDs on the motherboard. To identify a general memory fault, go to the Maintenance > Hardware screen of the BUI, and click on the right-arrow icon on the controller.
Page 186 Replacing a 7x20 DIMM Also remove the air baffle by pressing the air baffle connectors outward and lifting the air baffle up and out of the server. 7420: To remove the top cover: Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 187 Replacing a 7x20 DIMM Simultaneously lift both cover latches in an upward motion. Lift up and remove the top cover. To locate the DIMM you want to service, press the Fault Remind Button on the storage controller. Servicing the 7x20 Controller...
Page 188 Replacing a 7x20 DIMM The following illustration shows the Fault remind button on the 7120 controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 189 Replacing a 7x20 DIMM The following illustration shows the Fault remind button on the 7420 controller. Servicing the 7x20 Controller...
Page 190 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 191 Replacing a 7x20 DIMM Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly. Push the DIMM into the connector until the ejector tabs lock the component in place.
Page 192 Replacing a 7x20 DIMM Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on. 7420: To replace the cover: Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 193 Replacing a 7x20 DIMM Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place. Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Page 194 Replacing a 7x20 DIMM Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 195 Replacing a 7x20 DIMM Push the release tabs on the side of each rail and slowly push the storage controller into the rack. Servicing the 7x20 Controller...
Page 196 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 197: Replacing A 7X20 Controller Pcie Card Or Riser
Note that the 7120 Sun Flash Accelerator F20 card is a FRU and must be replaced by an Oracle service representative. Go to the Maintenance > Hardware screen of the BUI and click the right-arrow icon on the controller, and then click Slots to locate the faulted component.
Page 198 7120 or 7320: To replace the PCIe card: Disconnect any data cables connected to the cards on the PCIe riser you want to replace. Label the cables for proper connection later. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 199 Replacing a 7x20 Controller PCIe Card or Riser Loosen the two captive Phillips screws on the end of the rear panel crossbar and lift the crossbar up and back to remove it. Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser.
Page 200 Replacing a 7x20 Controller PCIe Card or Riser Carefully remove the PCIe card from the riser board connector and clean the slot with filtered, compressed air if necessary. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 201 Replacing a 7x20 Controller PCIe Card or Riser Seat the replacement PCIe card in the slot of the riser and connect the cables. Servicing the 7x20 Controller...
Page 202 Slide the back of the riser into the motherboard rear panel stiffener. Tighten the screw that secures the riser to the motherboard. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 203 Replacing a 7x20 Controller PCIe Card or Riser Replace the rear panel PCI crossbar by sliding it down over the PCIe risers, ensuring the crossbar is secured with two captive Phillips screws. 7420: To replace the PCIe card: Servicing the 7x20 Controller...
Page 204 Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary. Install the replacement PCIe card into the PCIe card slot. Install the retaining screw to hold the PCIe card to the chassis. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 205 Replacing a 7x20 Controller PCIe Card or Riser Return the crossbar to its closed and locked position. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller.
Page 206 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 207 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 208: Replacing A 7X20 Battery
Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there. Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm). Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 209 Replacing a 7x20 Battery Lift up and remove the top cover. 7420: To remove the top cover: Simultaneously lift both cover latches in an upward motion. Lift up and remove the top cover. Servicing the 7x20 Controller...
Page 210 Replacing a 7x20 Battery Using a small, non-metallic screwdriver, press the latch and remove the battery from the motherboard. The 7420 battery is shown here. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 211 Replacing a 7x20 Battery The following figure shows the 7120 battery. Press the replacement battery into the motherboard with the positive side (+) facing upward. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however, service procedures for each are identical. The illustration shows the 7320.
Page 212 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 213 Reconnect all cables to their original ports, referring to the labels previously added as a guide. For cabling details, see the Oracle ZFS Storage Appliance Cabling Guide. Connect the power cords to the power supplies.
Page 214: 7420 Controller Hardware Overview
“Setting Clock Synchronization (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0. 7420 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7420 controller. See the following for details: “7420 Configuration Options” on page 214 ■...
Page 215: 7420 Front And Back Panel Components
“7420 Controller System Drive,” on page 221. Refer to the product site at for the most https://www.oracle.com/storage/nas/index.html recent component specification. 7420 Front and Back Panel Components 7420 Front Panel Components - The 7420 controller drive slots and front panel components are shown in the following figure.
Page 216 Supply Fail: amber AC OK: green Power supply unit 0 AC inlet USB 2.0 ports Power supply unit 1 status LEDs OK: green Power PCIe slots 5-9 Supply Fail: amber AC OK: green Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 217 This card cannot be replaced with a Version 3 cluster interface card. For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Ethernet Ports There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec.
Page 218: 7420 Specifications
Maximum current AC RMS: 12A @ 100 VAC / 12A @ 200 VAC ■ Power Dissipation Max power consumption: 1800 W ■ Max heat output: 6143 BTU/hr ■ Volt-Ampere rating: 1837 VA @ 240 VAC, 0.98 P.F. ■ Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 219: 7420 Internal Components
Fan modules Drive backplane Boot drives and SSDs System lithium battery 7420 Internal Boards - The 7420 controller chassis has the following boards installed. Field- replaceable units (FRUs) should only be replaced by trained Oracle service technicians. Servicing the 7x20 Controller...
Page 220 Up to four read-optimized cache SSDs, may fill slots 2 through 5, in order. In a 7420 clustered configuration, the number of SSDs installed in both controllers must match. For information about supported disks and capacities, refer to the Oracle Systems Handbook. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 221 7420 Controller Hardware Overview 7420 Controller System Drive FIGURE 41 Figure Legend 1 Ready to remove (blue) 2 Service action required (amber) 3 OK/Activity (green) The 7420 controller supports the following configurations: Two, four, or eight 8GB DDR3 DIMMs installed on each riser, accommodating 128GB, ■...
Page 222 D0, D2, D4, and D6 must be populated; optionally, slots D1, D3, D5, and D7 may be populated as a group on all installed memory risers. All DIMMs in the system must be identical. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 223 7420 Controller Hardware Overview 7420 Controller CPU and Memory FIGURE 43 DIMM names in appliance logs and the Maintenance > Hardware view are displayed with the full name, such as /SYS/MB/P0/D7. 7420 Fan Modules - The Fan Modules and Fan Module LEDs of the storage controller are shown in the following figure.
Page 224: 7420 Pcie I/O Cards
Note - external HBAs. 7420 Controller PCIe Options TABLE 31 Slot Mfg Part Number Description Note 7054001 8-port 6Gb/s SAS-2 Slot 0 of the 7420 internal HBA M2 is reserved for Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 225 7420 Controller Hardware Overview Slot Mfg Part Number Description Note the SAS-2 internal 371-4325-02 8Gb 2-port FC HBA Optional FC target or initiator (Backup) for the 7420 controller 7051223 2-port optical 10GbE Optional recommended front- end for the 7420 controller 7054739 4-port copper NIC Optional...
Page 226 F375-3609-03 2-port SAS external Additional optional (7059331 for EU back-end countries) 7054739 4-port copper NIC Optional recommended front- 371-4325-02 8Gb 2-port FC HBA Optional FC target or initiator (Backup) Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 227 7420 Controller Hardware Overview Slot Mfg Part Number Description Note 375-3606-03 CX1 InfiniBand Optional recommended front- 7051223 2-port optical 10GE Optional recommended front- 375-3696-01 CX2 InfiniBand Optional recommended front- F375-3609-03 DP SAS external Additional optional (7059331 for EU back-end countries) 7054739 4-port copper NIC Optional...
Page 228 Install optional PCIe cards in the following order: 7420 Controller Optional PCIe Cards and Slot Order TABLE 33 PCIe Card Slot Order 1. SAS-2 external HBA Slot 2, 7, 3, 6 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 229: 7420 Attached Storage
Hardware Overview” on page 272 for component specifications and diagrams. 7320 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7320 controller. See the following for details: “7320 Configuration Options” on page 229 ■...
Page 230 7320 Standalone Controller PCIe Configuration Options TABLE 35 Slot Type Part Number Vendor Part Description Note PCIe 375-3617-01 Intel Niantic DP Optical Optional 10GE NIC Recommended Front-end Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 231 7320 Controller Hardware Overview Slot Type Part Number Vendor Part Description Note PCIe 375-3696-01 Mellanox InfiniBand HCA Optional Recommended Front-end PCIe 375-3606-03 MHJH29-XTC InfiniBand HCA Optional Recommended Front-end PCIe 375-3481-01 Intel QP Copper NIC Optional EXPI9404PT Recommended Front-end PCIe 371-4325-01 QLogic 8Gb DP FC Optional...
Page 232: 7320 Front And Back Panel Components
PCIe 375-3609-03 Sun Thebe External SAS Cluster Base Configuration 7320 Front and Back Panel Components 7320 Front Panel Components - The following figure and legend identify the front panel LEDs. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 233 7320 Controller Hardware Overview 7320 Controller Front Panel LEDs FIGURE 46 Figure Legend Locate Button/LED Service Required LED (amber) Power/OK LED (green) Power Button Rear Power Supply System Overtemperature LED Top Fan The following figure and legend identify the 7320 front panel drive locations. Two mirrored hard disk drives (HDDs) that store the operating system reside in slots 0 and 1.
Page 234 Serial management port PCIe slots Cluster Interface Card Compatibility - The 7320 controller contains a Version 2 cluster interface card. This card cannot be replaced with a Version 3 cluster interface card. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 235 7320 Controller Hardware Overview For information about how to connect cables to form a cluster, see “Connecting Cluster Cables” in Oracle ZFS Storage Appliance Cabling Guide. Ethernet Ports There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec.
Page 236: 7320 Electrical Specifications
■ 7320 Internal Components The 7320 storage controller chassis has the following boards installed. Field-replaceable units (FRUs) should only be replaced by trained Oracle service Note - technicians. PCIe Risers: The storage controller contains three PCIe risers that are customer-replaceable ■...
Page 237 7320 Controller Hardware Overview Motherboard: The motherboard is a FRU and includes CPU modules, slots for 18 DIMMs, ■ memory control subsystems, and the service processor (SP) subsystem. The SP subsystem controls the host power and monitors host system events (power and environmental). The SP controller draws power from the host 3.3V standby supply rail, which is available whenever the system is receiving AC input power, even when the appliance is turned off.
Page 238 7320 Controller CPU and Memory Components FIGURE 51 7320 Power Distribution and Fan Module Components - The following figure and legend identify the Power Distribution/Fan Module components of the storage controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 239 7320 Controller Hardware Overview 7320 Controller Power Distribution and Fan Module Components FIGURE 52 Figure Legend Figure Legend Fan Modules Power Distribution/Bus Bar Assembly Fan Board Power Supplies Paddle Board 7320 I/O Components - The following figure and legend identify the I/O components of the storage controller.
Page 240 7320 PCIe Cards and Risers - Following is the complete list of replaceable PCIe cards for the 7320 system. TABLE 41 7320 Controller Replaceable PCIe Cards Part Number Description FRU/CRU F371-4325-01 8Gb FC HBA (PCIe) Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 241: 7320 Attached Storage
Storage” on page 272. See also “Disk Shelf Hardware Overview” on page 272 component specifications and diagrams. 7120 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7120 controller. Servicing the 7x20 Controller...
Page 242: 7120 Base Configuration
18 DIMM slots into a compact 2U footprint. Refer to the product site at https://www. for the most recent component specification. oracle.com/storage/nas/index.html Refer to the white paper Implementing Fibre Channel SAN Boot with Oracle's Sun ZFS Storage Appliance at http://www.oracle.com/technetwork/articles/servers-storage-admin/ for details on FC SAN boot solutions using the Sun ZFS Storage fbsanboot-365291.html...
Page 243: 7120 Front Panel
7120 Controller Hardware Overview 7120 Front Panel The following figure and legend show the front panel and the drive locations. The Logzilla 3.5" SSD belongs in slot 3 and is not supported in controllers configured with the internal Sun Aura flash HBA Logzilla.
Page 244: 7120 Physical Specifications
The following list shows the electrical specifications for the 7120. Note that the power dissipation numbers listed are the maximum rated power numbers for the power supply. The numbers are not a rating of the actual power consumption of the appliance. Connectors Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 245: 7120 Internal Boards
Volt-Ampere rating: 1261 VA @ 240 VAC, 0.98P.F. ■ 7120 Internal Boards The chassis has the following boards installed. Field-replaceable units (FRU) should only be replaced by trained Oracle service Note - technicians. PCIe Risers: Each riser supports two PCIe cards that are customer-replaceable. There are ■...
Page 246: 7120 Cpu And Memory
All sockets must be occupied by either a filler or a DDR3 DIMM. All DDR3 DIMMs must be identical. DIMMs are pre-installed in P0 slots D1, D2, D4, D5, D7, and D8. FIGURE 56 7120 Controller CPU and Memory Components Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 247: 7120 Power Distribution, Fan Module And Disk Components
7120 Controller Hardware Overview 7120 Power Distribution, Fan Module and Disk Components The fan modules and LEDs are shown in the following illustration. 7120 Controller Fan Modules and LEDs FIGURE 57 The following figure and legend show the power distribution and associated components. Servicing the 7x20 Controller...
Page 248: 7120 I/O Components
SAS Expander Board Connector Board Disk Backplane Power Supply Backplane Front Control Panel Light Pipe Assembly 7120 I/O Components The following figure and legend show the I/O components of the 7120 system. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 249: 7120 Nic/Hba Options
7120 Controller Hardware Overview 7120 Controller I/O Components FIGURE 59 Figure Legend Top Cover Hard Disk Drives Right Control Panel Light Pipe Assembly Left Control Panel Light Pipe Assembly 7120 NIC/HBA Options The following table describes NIC/HBA options for the 7120. TABLE 47 7120 Controller NIC/HBA Options Mktg Part Number...
Page 250: 7120 Pcie Options
375-3606-01 Mellanox InfiniBand HCA Optional MHJH29-XTC Recommended Front-end PCIe 375-3481-01 Intel QP Copper NIC Optional EXPI9404PT Recommended Front-end PCIe 371-4325-01 QLogic 8Gb DP FC Optional FC Target or Initiator (Backup) Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 251: 7120 Connectors
7120 Controller Hardware Overview Sun Part Vendor Part Slot Type Description Note Number Number PCIe 375-3665-01 Sun Thebe (INT) Internal SAS Base Configuration PCIe 375-3481-01 Intel QP Copper NIC Optional EXPI9404PT Recommended Front-end PCIe 371-4325-01 QLogic 8Gb DP FC Optional FC Target or Initiator (Backup)
Page 252: 7120 Cables
The rear boot drives are not depicted in this illustration. Note - 7120 Controller Storage Drive Data Cable FIGURE 62 Cable Connection Connection between the HBA PCI-Express Card and the Storage Drive Data Cable storage drive backplane. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 253: 7120 Attached Storage
7120 Controller Hardware Overview 7120 Controller Ribbon Cable FIGURE 63 Cable Connection Connection is between the power distribution board and Ribbon cable the motherboard. 7120 Attached Storage The 7120 standalone configurations allow a single chain of 1 or 2 disk shelves. Write-optimized (Logzilla) SSDs are not supported in the expansion storage for the 7120.
Page 254 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 255: Servicing The Disk Shelves
Servicing the Disk Shelves Be sure to read sections “Getting Started with Servicing the Hardware” on page 15 “Prerequisites for Servicing Hardware” on page To replace disk shelf components, use the following tasks. “Replacing a Faulty Disk Shelf Drive” on page 256 ■...
Page 256: Replacing A Faulty Disk Shelf Drive
“Adding a Disk Shelf Cache Device” on page 270. Locate the failed disk drive with an amber LED at the front of the chassis. Press the release button or latch to release the drive lever. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 257 Replacing a Faulty Disk Shelf Drive Pull the drive lever fully open to unlock and partially eject the drive from the chassis. - OR - Grasp the middle of the drive body and pull it toward you to remove it from the chassis.
Page 258 Replacing a Faulty Disk Shelf Drive While constantly pushing toward the pivot point of the lever, slide the drive fully into the chassis slot. - OR - Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 259: Replacing A Disk Shelf Power Supply
Replacing a Disk Shelf Power Supply Press the drive lever closed until it locks in place. If a vertically oriented drive is higher than surrounding drives, push down on the top of the drive to properly seat it. The Activity LED will be steady green to indicate a ready state. Go to the Maintenance >...
Page 260 Replacing a Disk Shelf Power Supply Oracle Storage Drive Enclosure DE2-24P or DE2-24C: Grasp the latch and the opposite side of the module, and squeeze together to release the lever. Sun Disk Shelf: Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 261 With the lever/ejection arms fully open, slide the new module into the chassis slot until it contacts the chassis backplane, and the lever/ejection arms begin to engage. Close the lever/ejection arms. Oracle Storage Drive Enclosure DE2-24P or DE2-24C: Servicing the Disk Shelves...
Page 262 Replacing a Disk Shelf Power Supply Push the lever fully closed until you hear or feel a click. Sun Disk Shelf: Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 263 Replacing a Disk Shelf Power Supply Push the ejection arms fully closed and secure both captive screws to seat and secure the module in the chassis. Ensure the power supply on/off switch is in the "O" off position. Plug the power cord into the new power supply and attach the power cord tie strap to the power cord.
Page 264: Replacing A Disk Shelf I/O Module
“Disk Shelf Hardware Overview” on page 272 for component locations. The following disk shelves have I/O Modules (IOMs): Oracle Storage Drive Enclosure DE2-24P ■ Oracle Storage Drive Enclosure DE2-24C ■ Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 265 Replacing a Disk Shelf I/O Module The I/O Modules (IOMs), which are similar to SIM boards, are hot-swappable so you can replace them without removing power to the system. A faulted I/O Module is indicated by an amber LED. Go to the Maintenance > Hardware section of the BUI, click the right-arrow icon at the beginning of the appropriate disk shelf row, and then click Slot to view details, or click the locator...
Page 266: Replacing A Disk Shelf Sim Board
If the tab breaks, use a small sharp object (such as a fine-tipped screwdriver) to lift the metal spring at the top of the connector shell to unlatch it. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 267 Replacing a Disk Shelf SIM Board Loosen the two extraction arm captive screws using your thumb and forefinger. If the captive screws are too tight to loosen by hand, use a No.2 Phillips screwdriver to loosen each screw. Pull each ejector tab outward and push to the sides to release and partially eject the SIM from the chassis.
Page 268 Slot to verify that the SIM board online icon is green for the newly installed SIM board. If a fault does not self-clear, see “Repairing Active Problems” on page Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 269: Adding A New Disk Shelf
To back up and restore user data, you can use NDMP backup software, snapshots, and/or remote replication. Accordingly, see “NDMP Configuration” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0, “Snapshots and Clones”...
Page 270: Adding A Disk Shelf Cache Device
272. Ensure the new drive lever is in the fully extended position. While constantly pushing toward the pivot point of the lever, slide the drive fully into the chassis slot. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 271 Adding a Disk Shelf Cache Device - OR - Press the drive lever closed until it locks in place. If a vertically oriented drive is higher than surrounding drives, push down on the top of the drive to properly seat it. The Activity LED will be steady green to indicate a ready state. Go to the Maintenance >...
Page 272: Connecting To Attached Storage
Oracle ZFS Storage Appliance Cabling Guide. Contact Oracle Service if you want to move a disk shelf between ZFS storage Note - appliances. Certain limitations exist when importing storage pools, and can cause problems if not done properly by Oracle Service personnel.
Page 273 Oracle Storage Drive Enclosure DE2-24P FIGURE 64 The Oracle Storage Drive Enclosure DE2-24P is a 2U chassis that supports 24 2.5" SAS-2 devices. The high-performance HDDs provide reliable data storage. SSDs provide read- optimized cache and write-optimized log operations. This disk shelf also features dual, redundant I/O Modules (IOMs), and dual power supplies with integrated fan modules.
Page 274 SAS Interface Module (SIM) boards, and dual power supply with fan modules. Disk Shelf Back Panel Components - The back panel consists of the power supplies, fans, I/O Modules (IOMs) or SAS Interface Modules (SIMs), and indicator lights. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 275 Disk Shelf Hardware Overview Oracle Storage Drive Enclosure DE2-24P Back Panel FIGURE 67 Figure Legend Figure Legend Power Supply with Fan Module 0 I/O Module 0 I/O Module 1 Power Supply with Fan Module 1 Servicing the Disk Shelves...
Page 276 I/O Module 1 Power Supply with Fan Module 2 I/O Module 0 It is especially important that power supplies and their filler panels are in the correct Note - slots. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 277: Disk Shelf Indicators
Disk Shelf Hardware Overview Sun Disk Shelf Back Panel FIGURE 69 Figure Legend Power supply modules with built-in fans. Power supply 0 is on the left and power supply 1 is on the right. Removable SAS Interface Module (SIM) Boards. SIM 0 is on the left, and SIM 1 is on the right. Disk Shelf Indicators Disk Shelf Front Panel Indicators - The following figures show the front panel indicators.
Page 278 Disk Shelf Hardware Overview Oracle Storage Drive Enclosure DE2-24P Front Panel Indicators FIGURE 70 Figure Legend Figure Legend System power indicator Drive fault indicator Module fault indicator Power / Activity indicator Locate indicator Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 279 Disk Shelf Hardware Overview Oracle Storage Drive Enclosure DE2-24C Front Panel Indicators FIGURE 71 Figure Legend Figure Legend System power indicator Power / Activity indicator Module fault indicator Drive fault indicator Locate indicator Servicing the Disk Shelves...
Page 280 Power supply fault indicator Disk Shelf I/O Module Indicators - The following disk shelves have I/O Modules (IOMs): Oracle Storage Drive Enclosure DE2-24P ■ Oracle Storage Drive Enclosure DE2-24C ■ Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 281 FIGURE 73 Figure Legend Figure Legend Figure Legend Fault / Locate indicator SAS-2 Port 1 For Oracle service only Power / OK indicator SAS-2 Port 2 For Oracle service only SAS-2 Port 0 Host port activity indicators Disk Shelf SIM Board Indicators - The following disk shelves have SIM boards: Sun Disk Shelf ■...
Page 282 Disk Shelf Power Supply Indicators - The following figure shows power supply with fan module indicators for these disk shelves: Oracle Storage Drive Enclosure DE2-24P ■ Oracle Storage Drive Enclosure DE2-24C ■ Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 283 Disk Shelf Hardware Overview DE2 Disk Shelf Power Supply Indicators FIGURE 75 Figure Legend Figure Legend DC power fail indicator Universal power input connector Fan fail indicator Power cord tie wrap AC power fail indicator Power supply status indicator Power on/off switch The following figure shows power supply with fan module indicators for these disk shelves: Sun Disk Shelf ■...
Page 284: Disk Shelf Drive Locations
8 Right ejection arm and captive screw latch 4 Power supply status indicator 5 Power on/off switch Disk Shelf Drive Locations The following figures show the location of the drives. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 285 Disk Shelf Hardware Overview Oracle Storage Drive Enclosure DE2-24P Drive Locations FIGURE 77 For DE2-24P device types and slot details, see “Disk Shelf Configurations” on page 286. FIGURE 78 Oracle Storage Drive Enclosure DE2-24C Drive Locations For DE2-24C device types and slot details, see “Disk Shelf Configurations”...
Page 286: Disk Shelf Configurations
286. Disk Shelf Configurations The following table describes device types supported for each disk shelf. For cabling information, see “Cabinet and Cabling Guidelines” in Oracle ZFS Storage Appliance Cabling Guide. For information on disk compatibility, see the Oracle Systems Handbook.
Page 287 Disk Shelf Hardware Overview Shelf Device Types Data Slots Cache/Log Slots Notes/ Examples (filler), Slot 23 (filler) 20 Data and 1-4 0 - 19 20 - 23 Software version Cache devices OS8.6.0 (or later) is required for read cache devices. Up to four read cache devices installed in...
Page 288 20 Data and 1-4 Log 0-23 20-23 20 HDD data devices devices and up to four SSD log devices installed in consecutive slots. Note - Read cache devices cannot be Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 289: Maximum Number Of Disk Shelves Per Controller Configuration
7120 SAS-2 The SAS-2 (Serial Attached SCSI 2.0) host bus adapter (HBA) is designed for the Oracle ZFS Storage Appliance with a standard chip set to support a high-density of target devices, up to 1024. You can daisy-chain SAS-2 disks to as many as 36 disk shelves for certain systems, for a total of 864 disks.
Page 290 With this fabric, you are encouraged to apply entire shelves to pools, so you can gain the benefits of No Single Point of Failure configurations, and striping across the maximum possible number of devices. For supported disk shelves, see “Disk Shelf Configurations” on page 286. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 291: Viewing System Disks Status
Viewing System Disks Status The system disks section shows the status of the system disks, and their current usage. The BUI displays this with a pie-chart, and the CLI as a text list. For example: hostname:> maintenance system disks show Properties: profile = mirror root = 1.14G...
Page 292 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 293: Working With Support Bundles
In a cluster configuration, the controller that originally diagnoses a fault uploads the support bundle to Oracle Service. For example, a fault occurring on a disk shelf that is shared by both controllers is reported on both controllers, but the fault is posted by the controller that initially diagnosed the fault.
Page 294: Generating And Uploading A Support Bundle (Bui)
The SR number format is 3-nnnnnnnnnn, where n is a digit between 0 and (Optional) Uncheck Send to Oracle Support to create a local bundle for analysis. This bundle can be uploaded to Oracle Support later if an SR is provided.
Page 295: Viewing Support Bundle Details (Bui)
Enter bundle and the SR number. hostname:maintenance system bundles> bundle 3-9999999999 A support bundle is being created and sent to Oracle. You will receive an alert when the bundle has finished uploading. Please save the following filename, as Oracle support personnel will need it in order to access the bundle: /upload/issue/3-9999999999/3-9999999999_ak.edd08324-f091-cd19-b4c9-...
Page 296: Viewing Support Bundle Details (Cli)
“Deleting a Support Bundle (CLI)” on page 298 ■ Uploading a Locally Generated Bundle (CLI) Use the following procedure to upload a locally generated support bundle. To select a support bundle, enter select and the bundle's UUID. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 297: Retrying A Failed Support Bundle Upload (Bui)
Retrying a Failed Support Bundle Upload (BUI) hostname:maintenance system bundles> select fee4b98a-e3f7-e600-877d-b6d7933255f3 To upload the selected bundle, use the send command with the SR number: hostname:maintenance system bundles fee4b98a-e3f7-e600-877d-b6d7933255f3> send 3- 9999999999 An SR number is required when running send on a locally generated bundle, or else an Note - error will be thrown.
Page 298: Canceling A Pending Support Bundle Operation (Bui)
Go to Maintenance > System. Hover over the appropriate support bundle row and click its trash icon Deleting a Support Bundle (CLI) Use the following procedure to delete a support bundle using the CLI. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 299 Deleting a Support Bundle (CLI) To select a support bundle, use the following CLI command: hostname:maintenance system bundles> select fee4b98a-e3f7-e600-877d-b6d7933255f3 To delete a support bundle, use the following CLI command: hostname:maintenance system bundles 5ff532a2-2377-e72d-b0fe-f2efc2aa8aaf> destroy Working with Support Bundles...
Page 300 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 301: Performing The Initial Setup
You can repeat the initial setup process after you have already configured the appliance for the first time, as described in “Configuring the Appliance for the First Time” in Oracle ZFS Storage Appliance Installation Guide. This does not change any of the current settings unless explicitly requested.
Page 302 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 303: Restarting The Appliance
Restarting the Appliance Only issue the restart command as instructed by Oracle Service personnel. Caution - This function is only available via the CLI and is not the same as a reboot (power cycle) via the BUI. The restart command is a software-only operation that restarts the management server, which could impact some client services, like replication.
Page 304 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 305: Performing A Factory Reset
Performing a Factory Reset Factory reset resets the appliance configuration back to factory settings of the current software version, and reboots the appliance. All configuration changes are lost, and the appliance needs to go through initial configuration again, as when it was first installed. User data on the storage pool (including projects and shares) is not affected - however the pool needs to be imported as part of the initial setup process.
Page 306 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 307: Backing Up The Configuration
Backing Up the Configuration The configuration backup function enables an administrator to: Back up the appliance configuration, consisting of system metadata only (such as the ■ network configuration, local users and roles, service settings, and other appliance metadata). Restore a previously saved configuration from a backup. ■...
Page 308: Configuration Backup Contents
Configuration Restore Impact The restore operation takes a selected configuration backup, and modifies all of the corresponding system settings to reflect those in the backup, including removing aspects of the Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 309 Because of the possibility of data loss to unconfigure clustering, contact Oracle support. Then, restore the configuration backup on a selected head, and then re-cluster the two systems, at which point the other system automatically synchronizes itself with the restored configuration.
Page 310: Security Considerations For Configuration Backups
Creating a Configuration Backup (BUI) Use the following procedure to create a configuration backup. Go to Maintenance > System. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 311: Creating A Configuration Backup (Cli)
Creating a Configuration Backup (CLI) Click the Backup button above the list of saved configurations and follow the instructions. You are prompted to enter a descriptive comment for the backup. Click APPLY to create the backup configuration. Click the download icon to download the configuration locally.
Page 312: Restoring From A Saved Configuration (Cli)
Storage pools are not automatically unconfigured when you execute the restore command. Deleting a Saved Configuration (BUI) Use the following procedure to delete a saved configuration. Go to Maintenance > System. For the appropriate configuration, click the trash icon Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 313: Deleting A Saved Configuration (Cli)
Deleting a Saved Configuration (CLI) Deleting a Saved Configuration (CLI) Use the following procedure to delete a saved configuration. To delete a saved configuration, use the following CLI command and specify the universal unique identifier for the backup: hostname:maintenance system configs> destroy cb2f005f-cf2b-608f-90db-fc7a0503db2a Are you sure you want to delete the saved configuration "new"? y hostname:maintenance system configs>...
Page 314: Importing A Saved Configuration (Bui)
Use the following procedure to view appliance configurations. Go to Maintenance > System. The appliance configurations are listed at the bottom of the page. Viewing Appliance Configurations (CLI) Use the following procedure to view appliance configurations. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 315 Viewing Appliance Configurations (CLI) To view appliance configurations, use the following CLI command: hostname:maintenance system configs> list CONFIG DATE SYSTEM VERSION bfa614d7-1db5-655b-cba5-bd0bb0a1efc4 2009-8-5 17:14:28 hostname 2009.08.04,1-0 cb2f005f-cf2b-608f-90db-fc7a0503db2a 2009-8-24 17:56:53 hostname 2009.08.18,1-0 Backing Up the Configuration...
Page 316 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 317: Working With Software Notifications And Updates
You can set up periodic checks for software updates, or you can check for updates at any time. When an updated software package is available, you are directed to download the latest package from My Oracle Support (MOS). It is recommended that you remove older system updates to avoid accruing unnecessary space on the system disks.
Page 318: Setting Up Software Notification (Cli)
Click the download link shown in the popup window, and save the zip file. Checking for and Downloading Software Updates (CLI) Use the following procedure to check for software updates using the CLI. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 319: Removing System Updates (Bui)
2013.1.1.5> show Properties: version = 2013.1.1.5 date = 2014-2-18 08:00 status = downloadable url = https://updates.oracle.com/Orion/Services/download /p18269573_20131_Generic.zip?aru=17312483&patch_file=p18269573_20131_Generic.zip checkdate = 2014-3-4 hostname:maintenance system 2013.1.1.5> Removing System Updates (BUI) Use the following procedure to remove extraneous system updates. To avoid accruing too much space on the system disks, maintain no more than three updates at any given time.
Page 320: Oracle Zfs Storage Appliance Customer Service Manual • July
Enter destroy and the update that you want to remove. hostname:maintenance system updates> destroy ak-nas@2013.06.05.1,1-1.2 Enter Y to confirm your action. This will destroy the update "ak-nas@2013.06.05.1,1-1.2". Are you sure? (Y/N) Y Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 321: Upgrading The Software
Upgrading the Software This section describes how to upgrade the system software for an Oracle ZFS Storage Appliance. You can upgrade software using either the BUI or CLI. Use the following topics and tasks to upgrade the software: “Preparing to Upgrade the Software” on page 321 ■...
Page 322: Upgrading Software On A Standalone Controller
■ Upgrading Software on a Standalone Controller This section describes how to upgrade the system software for an Oracle ZFS Storage Appliance with a standalone controller. You can upgrade software on a standalone controller using either the BUI or CLI.
Page 323: Upgrading Software On A Standalone Controller (Bui)
Upgrading Software on a Standalone Controller (BUI) Upgrading Software on a Standalone Controller (BUI) Use the following procedure to upgrade software on a standalone controller. On your local system, download the software update. Before You Begin Go to Maintenance > System. Click the add icon next to Software Updates.
Page 324: Upgrading Software On A Standalone Controller (Cli)
URL (for example, ftp://myusername:mypasswd@myserver/export/ mydirectory), or you can leave the username and password out of the URL and instead set the user and password properties. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 325 Upgrading Software on a Standalone Controller (CLI) After the file has been transferred, it is automatically unpacked and verified. hostname:maintenance system updates download (uncommitted)> set url=ftp://mydirectory/ update.pkg.gz url = ftp://mydirectory/update.pkg.gz hostname:maintenance system updates download (uncommitted)> set user=bmc user = bmc hostname:maintenance system updates download (uncommitted)>...
Page 326 Updating from ... ak/nas@2013.06.05.4.0,1-1.6 Backing up smf(5) ... done. Loading media metadata ... ^C This will cancel the current update. Are you sure? (Y/N) y error: interrupted by user hostname:maintenance system updates ak-nas@2013.06.05.4.0,1-1.7-nd> Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 327: Upgrading Software On Clustered Controllers
Upgrading Software on Clustered Controllers Upgrading Software on Clustered Controllers This section describes how to upgrade the system software for an Oracle ZFS Storage Appliance with clustered controllers. Cluster update is also referred to as a rolling update. Controllers are upgraded one at a time, and each controller is upgraded while it is not providing service to clients.
Page 328: Preparing To Upgrade Clustered Controllers (Cli)
If both controllers have active resources, choose either controller to upgrade first. On controller A, go to configuration cluster resources show. controller-a:> configuration cluster resources show Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 329 Preparing to Upgrade Clustered Controllers (CLI) Resources: RESOURCE OWNER TYPE LABEL CHANGES DETAILS net/igb0 brm7320-250 private Untitled I... no 10.80.2xx.112 On controller B, go to configuration cluster resources show. controller-b:> configuration cluster resources show Resources: RESOURCE OWNER TYPE LABEL CHANGES DETAILS net/igb1 brm7320-260 private...
Page 330: Upgrading Controller A (Bui)
To verify that there are no pool errors, go to Configuration > Storage, and check the STATUS and ERRORS columns for both pools. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 331: Upgrading Controller A (Cli)
= AKCS_STRIPPED peer_state = AKCS_OWNER peer_description = Active For information about the clustered states, see “Cluster Takeover and Failback” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0. Go to maintenance system updates and enter show to view the available updates.
Page 332 Pending No Pending Updates Failed No Failed Updates In Progress No Updates in Progress Go to maintenance hardware show to verify that all disks are online. controller-a:> maintenance hardware show Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 333: Upgrading Controller B (Bui)
After the reboot completes, log in to controller A and go to Configuration > Cluster to verify that controller B is in the passive state. For information about the clustered states, see “Cluster Takeover and Failback” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0.
Page 334: Upgrading Controller B (Cli)
After the reboot completes, log back into the CLI and enter configuration cluster show to verify that controller B is in the passive state. In the example below, the state of controller B is AKCS_STRIPPED, which is the passive state. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 335 = AKCS_STRIPPED peer_state = AKCS_OWNER peer_description = Active For information about the clustered states, see “Cluster Takeover and Failback” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0. Go to maintenance system updates and enter show to view the available updates.
Page 336 The pool should be online and have no errors. controller-b:> configuration storage show Pools: POOL OWNER DATA PROFILE LOG PROFILE STATUS ERRORS -> pool25 brm7320-250 online pool26 brm7320-260 online Controller B is now upgraded. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 337: Working With Health Checks
Working with Health Checks System-level health checks are provided to help ensure that no pathologies interfere with the software update. If a problem is encountered, it is noted in the Alert Log and the update process is aborted. System software updates do not proceed until all problems have been corrected. You can manually run the same health checks in advance of any planned update.
Page 338 During the health check operation, an indicator shows its progress. FIGURE 81 Update Health Checks in Progress in the BUI After completion, the System Ready state changes to Yes or No with a link to the Alert Log. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 339: Checking System Health (Cli)
Checking System Health (CLI) Completed Update Health Checks in the BUI FIGURE 82 Checking System Health (CLI) Use the following procedure to check system health using the CLI. To select the update media, use the following CLI command: hostname:maintenance system updates> select ak-nas@2013.06.05.0.0,1-1.6 To upgrade the software and check system health, use the following CLI command: hostname:maintenance system updates:ak-nas@2013.06.05.0.0,1-1.6>...
Page 340: Troubleshooting Update Health Check Failures
Alert Log message and recommended order of steps you can take to resolve the issue. For component faults, follow the instructions for removal and installation found in the maintenance procedures for your controller. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 341: Resolving Health Check Alerts
Resolving Health Check Alerts Resolving Health Check Alerts TABLE 52 ID and Alert Log Message Failure Resolution Steps SIM or IOM cannot be detected. 1, 2, 4 "System software update cannot proceed: Slot <label> in disk shelf <name> is reported as absent." SIM or IOM is faulted.
Page 342 After two minutes, re-seat SIM or IOM and wait for steady Power LED before reconnecting cables. Identify affected chassis, and remove faulted disk. After 30 seconds, re-seat disk and wait for steady or flashing LED. Contact Oracle Support for component service or replacement. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 343: Deferred Updates
Replication failures can occur if the target appliance does not support a feature used Note - by the project or share being replicated. See the "Incompatible Target" failure in section “Replication Failures” in Oracle ZFS Storage Appliance Administration Guide, Release OS8. 6.0. To apply deferred updates, use one of the following tasks: Applying Deferred Updates BUI, ■...
Page 344: Applying Deferred Updates (Bui)
Waiting media is listed as unavailable if the currently active software is not sufficiently recent to be able to upgrade to that waiting media. In this example, media has been downloaded for Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 345: Passthrough X Deferred Update
Passthrough x Deferred Update both 2011.1.4.2 and 2013.1 but the 2013.1 update is unavailable because you first need to upgrade to at least 2011.1.4.2. Deferred updates: The following incompatible updates are available. Applying these updates will enable new software features as described below, but will prevent older versions of the software from accessing the underlying resources.
Page 346: User Quotas Deferred Update
COMSTAR Deferred Update The COMSTAR framework relies on a ZFS pool update for complete support of persistent group reservations (PGRs). Before this update has been applied, the number of reservations Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 347: Triple Parity Raid Deferred Update
Triple Parity RAID Deferred Update stored with each LUN is severely limited, and may even be zero. Applying this update is equivalent to upgrading the on-disk ZFS pool to version 16. Related Topics Applying Deferred Updates BUI, ■ “Understanding Deferred Updates” on page 352 ■...
Page 348: Replication Deferred Update
Before this update has been applied, log records continue to be written in the old format and performance may be reduced. Applying this update is equivalent to upgrading the on-disk ZFS pool to version 23. Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 349: Snapshot Deletion Deferred Update
Snapshot Deletion Deferred Update Related Topics Applying Deferred Updates BUI, ■ “Understanding Deferred Updates” on page 352 ■ Snapshot Deletion Deferred Update This deferred update increases snapshot deletion parallelism and reduces the size of transaction groups associated with snapshot deletion to improve systemic responsiveness. Before this update has been applied, new snapshot data is stored in the old format and deleted using the old algorithm.
Page 350: Raidz Mirror Deferred Update
This deferred update allows a LUN to be associated with more than one initiator group at a time. If replicating LUNs with this update applied, also apply the update to the replication target system(s). Related Topics Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 351: Large Block Sizes Deferred Update
Large Block Sizes Deferred Update Applying Deferred Updates BUI, ■ “Understanding Deferred Updates” on page 352 ■ Large Block Sizes Deferred Update This feature provides improved performance when blocksize/recordsize larger than 128K are used. The supported block sizes are: 256k, 512k, and 1M. If large block sizes are used for projects or shares, replication of those projects or shares to systems that do not support large block sizes fail.
Page 352: Acl Passthrough With Mode Preservation Deferred Update
Once the update is applied, rolling back to previous versions will result in undefined behavior. For these updates, you will always be given an explicit option of applying them automatically Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 353 Understanding Deferred Updates during upgrade or applying them after the fact. They are therefore referred to as "deferred updates". When applying an update to a version with incompatible version changes, you are given an option to apply these version changes as part of the update. For each version change, the benefits of applying the change are presented to you.
Page 354 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 355: Working With Firmware Updates
Following the application of a software update, any hardware for which the update includes newer versions of firmware is upgraded. Before the upgrade window, it is recommended to run a scrub as described in “Scrubbing a Storage Pool (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release OS8.6.0.
Page 356 UI in the form of missing or offline devices. This is not a cause for concern; however, if a device remains offline or missing for an extended period of time Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 357: Checking The Status Of Firmware Updates (Bui)
Checking the Status of Firmware Updates (BUI) (several minutes or more) even after refreshing the hardware view, this may be an indication of a problem with the device. Check the Maintenance > Problems view for any relevant faults that may have been identified. Additionally, in some cases, the controllers in the disk shelves may remain offline during firmware update.
Page 358 Checking the Status of Firmware Updates (CLI) Component Current Version Status Chassis 0945QCQ00A (SAS Expander 00) 3232 some disks only have 1 path(s) (2 paths required) In Progress No Updates in Progress Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 359: Rolling Back System Software
Rolling Back System Software The rollback procedure reverts all of the system software and all of the metadata settings of the system back to their state just prior to applying an update. This feature is implemented by taking a snapshot of various aspects of the system before the new update is applied, and rolling back this snapshot to implement the rollback.
Page 360: Rolling Back The System Software (Bui)
The confirmation step looks like this: SunOS Release 5.11 Version ak/generic@2011.04.24.4.2,1-1.28 64-bit Copyright (c) 1983, 2010, Oracle and/or its affiliates. All rights reserved. System rollback in progress. Rollback to: ak/nas@2011.04.24.4.2,1-1.28...
Page 361: Rolling Back The System Software (Cli)
Rolling Back the System Software (CLI) Rolling Back the System Software (CLI) Use the following procedure to roll back the system software using the CLI. To roll back to a previous software version, select the update that corresponds to that version and execute the rollback command. You will be asked to confirm to execute a rollback, and then the system will reboot and execute the rollback.
Page 362 Oracle ZFS Storage Appliance Customer Service Manual • July 2016...
Page 363: Removing An Update Package
Removing an Update Package This section describes how to remove an update package. Removing an Update Package (BUI) Use the following steps to remove an update package using the BUI. To remove an update package, highlight the corresponding row and click on the trash icon Removing an Update Package (CLI) Use the following steps to remove an update package using the CLI.
Page 364: Oracle Zfs Storage Appliance Customer Service Manual • July
Oracle ZFS Storage Appliance Customer Service Manual • July 2016...

This manual is also suitable for:

Zs4-4 Zs3-4 7320 7120 De2-24 Sun diskshelves ... Show all

Oracle ZFS Storage Appliance Service Manual

Servicing the Oracle ZFS Storage Appliance

Getting Started with Servicing the Hardware

Prerequisites for Servicing Hardware

Servicing the ZS4-4 Controller

Servicing the ZS3-4 Controller

Servicing the ZS3-2 Controller

Servicing the 7X20 Controller

Servicing the Disk Shelves

Viewing System Disks Status

Working with Support Bundles

Performing the Initial Setup

Restarting the Appliance

Performing a Factory Reset

Backing up the Configuration

Working with Software Notifications and Updates

Upgrading the Software

Working with Health Checks

Deferred Updates

Working with Firmware Updates

Rolling Back System Software

Removing an Update Package

Quick Links

Need help?

Questions and answers

Related Manuals for Oracle ZFS Storage Appliance

Summary of Contents for Oracle ZFS Storage Appliance