Page 1 Oracle ZFS Storage Appliance Customer ® Service Manual For ZS4-4, ZS3-x, 7x20 Controllers, and DE2-24, Sun Disk Shelves, Release 2013.1.5.0 Part No: E69256-02 February 2016...
Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l’accès à...
Page 5 Introduction to the BUI ................ 11 Introduction to the CLI ................ 12 BUI Hardware View ................ 12 CLI Hardware View ................ 18 Configuring the Management Port ............ 23 Using Oracle ILOM to Diagnose Hardware Faults ........ 23 Understanding Hardware Status ............... 26 Working with Problems ................ 28 Using Logs ................... 30 Using Workflows ................... 39 Prerequisites for Servicing Hardware ..............
Page 6 ▼ How to Import a Saved Configuration (CLI) ........ 280 ▼ How to List Configurations (CLI) ............ 280 Working with Software Notifications and Updates .......... 280 ▼ How to Set Up Software Notification (BUI) ........ 281 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 7 Contents ▼ How to Set Up Software Notification (CLI) ......... 281 ▼ How to Check for Software Updates (BUI) ......... 282 ▼ How to Check for Software Updates (CLI) .......... 282 Updating Software on a Single Controller ............ 283 ▼ How to Update Software on a Single Controller (BUI) ...... 283 ▼...
Page 8 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 9 Servicing the Oracle ZFS Storage Appliance This document encompasses the following sections that describe maintenance procedures for the Oracle ZFS Storage Appliance. “Servicing the Hardware” on page 11 ■ “Maintaining the System” on page 267 ■ Servicing the Oracle ZFS Storage Appliance...
Page 10 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 11 The management software is designed to be fully featured and functional on a variety of web browsers, as described in “Browser User Interface (BUI)” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0. Direct your browser to the system using either the IP address or host name you assigned to the NET-0 port during initial configuration as follows: https://ipaddress:215 or https://hostname:215.
Page 12 Leave this detailed view Power off, reboot, or diagnostic reboot Click for more details Offline disk Hardware component is ok Port active (green) Hardware component is Port inactive not present (grey) Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 13 (power cycle), or reboot the appliance with diagnostics. Only select the diagnostic reboot option when instructed by Oracle Service personnel because it could take a long time to complete and could have adverse results if not performed properly. Do not perform a diagnostic reboot when system-affecting operations are occurring, such as upgrading firmware, executing commands, and configuring or unconfiguring storage.
Page 14 "-" is displayed. Total size of all write-optimized cache devices ("Logzillas") within the drive shelf. If there are no log devices within the shelf, then "-" is displayed. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 15 Getting Started with Servicing the Hardware Property Description Paths Total number of I/O paths to the disk shelf. The only supported configurations are those with multiple paths to all disks, so this should read "2" under normal operating circumstances. Clicking the information icon will bring up a dialog with information about each path.
Page 16 The lifetime percentage remaining on an SSD. Lifetime starts at 100% and decreases with disk usage. Last Update The date and time of the last endurance reading of the SSD. Disks Disks support the additional options: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 17 You can set a threshold alert when an SSD exceeds a specified percentage. For example, set an alert to occur when one or more SSD devices exceeds a 95% threshold. For more information, see “Threshold Alerts” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0.
Page 18 Hardware status details are available in the CLI under the maintenance hardware section. Use the show command to list the status of all components. The list command will list available chassis, which can be selected and then viewed using show. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 19 Getting Started with Servicing the Hardware tarpon:> maintenance hardware show Chassis: NAME STATE MANUFACTURER MODEL chassis-000 0839QCJ01A Sun Microsystems, Inc. Sun Storage 7320 cpu-000 CPU 0 Quad-Core AMD Op cpu-001 CPU 1 Quad-Core AMD Op cpu-002 CPU 2 Quad-Core AMD Op cpu-003 CPU 3 Quad-Core AMD Op...
Page 20 Properties: label = HDD 15 present = true faulted = false manufacturer = SANDISK model = LB806M---SUN800G serial = 40042896 revision = S30E size = 745G Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 21 How to Set a Threshold Alert for SSD Endurance (CLI) type = data use = data rpm = -- device = c0t5001E82002630190d0 pathcount = 2 interface = SAS endurance = 100% endurance_updated = 2014-3-3 22:04:14 locate = false offline = false As shown above, disk-015 is at 100% which indicate a new SSD.
Page 22 To restart the appliance, use the following CLI command: tarpon:maintenance system> restart How to Perform a Diagnostic Reboot (CLI) Only issue the diagnostic reboot command as instructed by Oracle Service personnel. Caution - Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 23 In rare cases, faults associated with uncorrectable CPU errors are not diagnosable or displayed in the controller. These faults are preserved by and observable on the Oracle Integrated Lights Out Manager (ILOM), which resides in the Service Processor (SP). Connect to the server ILOM to diagnose hardware faults that do not appear in the BUI.
Page 24 How to Log in to Oracle ILOM Using a Local Serial Connection Use the following procedure to log in to Oracle ILOM using a local serial connection. Prepare an administrative client (terminal or terminal emulator) with the serial connection parameters: 8N1: eight data bits, no parity, one stop bit ■...
Page 25 How to Log in to Oracle ILOM Remotely Using a Command Line Interface Use the following procedure to log in to Oracle ILOM remotely using a command line interface. This procedure requires that you know the administrative account name and password (defaults...
Page 26 You can find a chassis serial number label on the storage controller front panel on the left side. Another label is on the top of the storage controller. You can click the Sun/Oracle logo in the BUI masthead to obtain the serial number.
Page 27 How to Locate a Failed Component (CLI) Go to the Maintenance > Hardware screen. Click the right-arrow icon on the Storage System or Disk Shelf which has the fault icon. Locate the fault icon in the lists of hardware components, and click it. The image should be updated to show where that component is physically located.
Page 28 (defects, often included under faults) and reports them as active problems on this screen. If the phone home service is enabled, active problems are automatically reported to Oracle Support, where a support case may be opened depending on the service contract and the nature of the fault.
Page 29 How to Locate a Failed Component (CLI) Active Problems Display For each problem, the appliance reports what happened, when the problem was detected, the severity and type of the problem, and whether it has been phoned home. Below are some example faults as they would be displayed in the BUI: Example BUI Problem Displays TABLE 9...
Page 30 If a problem persists after the affected components have been repaired, contact support. You may be instructed to mark the problem repaired. This should only be done under the direction of service personnel or as part of a documented Oracle repair procedure. Related Features A persistent log of all faults and defects is available under Logs as the .
Page 31 This is configured in the Alerts section. All alerts appear in this log, regardless of whether they have actions configured for them. For more information about alerts, see “Configuring Alerts” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0.
Page 32 “Configuring Users” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0), each audit entry should be noted with a reason. The following are example audit log entries as they would appear in the BUI: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 33 <console> Enabled ftp service Phone Home Log Entries If Phone Home is used, this log shows communication events with Oracle support. For information about Phone Home, see “Working with Phone Home” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0.
Page 34 How to View Groups of Log Entries (CLI) Use the following procedure to view groups of log entries. To view up to 100 log entries at a time, use the following CLI commands: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 35 2014-2-20 18:18:20 root, 10.159.134.211, Deleted update media ak-nas@2011.04.24.8.0,1-1.43 entry-2879 2014-2-20 18:34:19 root, 10.159.134.211, Cluster takeover requested entry-2970 2014-2-27 17:40:37 root, dhcp-amer-vpn-rmdc-anyconnect-10-159-100-157.vpn.oracle. com, User logged out of CLI entry-2971 2014-2-27 17:48:23 root, 10.159.100.157, User logged in entry-2972 2014-2-27 19:05:46 root, 10.159.100.157, Browser session timed out entry-2973 2014-2-27 23:53:31 root, dhcp-amer-vpn-rmdc-anyconnect-10-159-125-20.vpn.oracle.
Page 36 The "annotation" is the session annotation, which can be enabled when configuring users. For information about user configuration, see “Configuring Users” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 37 BUI Collect button. For information on using the RESTful API, see its product documentation at Oracle ZFS Storage Appliance RESTful API Guide, Release 2013.1.5.0 To view logs, navigate to the Maintenance > Logs screen.
Page 38 2013-1-14 18:19:59 caji:maintenance logs> select fltlog caji:maintenance logs fltlog> collect SUNW-MSG-ID: AK-8000-86, TYPE: Defect, VER: 1, SEVERITY: Major EVENT-TIME: Wed Nov 13 03:50:15 UTC 2013 PLATFORM: Sun-Fire-X4240, CSN: 0000000000, Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 39 REC-ACTION: No action is required. caji:maintenance logs fltlog> Using Workflows A workflow is a script that is uploaded to and managed by the Oracle ZFS Storage Appliance by itself. For information on scripting, see “Working with CLI Scripting” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0.
Page 40 Follow all cautions, warnings, and instructions marked on the equipment and described in ■ Important Safety Information for Oracle's Hardware Systems included with your system. Ensure that the voltage and frequency of your power source match the voltage inscribed on ■...
Page 41 How to Power off the Controller Controller and Disk Shelf Prerequisite Tasks This section describes the prerequisite tasks for servicing controllers and disk shelves: “How to Power off the Controller” on page 41 ■ “How to Extend the Storage Controller from the Rack” on page 41 ■...
Page 42 How to Remove the Top Cover To access internal controller components for servicing, remove the top cover. Use the following procedure to remove the top cover. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 43 To avoid this, shut down the controller(s) before decommissioning the shelf. For details on NSPF profiles, see “Choose a Storage Profile” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0 Stop all input and output to and from the disk shelf.
Page 44 Servicing the ZS4-4 Controller This section describes how to service the ZS4-4 controller. ZS4-4 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage ZS4-4 controller. ZS4-4 Base Configuration The ZS4-4 controller can be configured as a single controller or two controllers to create a high- availability cluster configuration.
Page 45 Servicing the ZS4-4 Controller ZS4-4 Front Panel The ZS4-4 controller drive slots and front panel components are shown in the following figure. ZS4-4 Controller Front Panel FIGURE 2 Figure Legend Figure Legend 1 Locator LED/button (white) 9 USB 2.0 connectors (2) 2 Service action required LED (amber) 10 DB-15 video port 3 Power/OK LED (green)
Page 46 2 Service action required (amber) 3 OK/Activity (green) ZS4-4 Rear Panel The ZS4-4 rear panel is shown in the following figure. Base configuration PCIe cards are not depicted in this illustration. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 47 Servicing the ZS4-4 Controller ZS4-4 Controller Rear Panel FIGURE 4 Figure Legend Figure Legend 1 Power supply unit (PSU) 0 indicator panel 7 Network (NET) 10 GbE ports: NET0NET3 2 PSU 0 AC inlet 8 USB 2.0 connectors (2) 3 PSU 1 indicator panel 9 PCIe card slots 711 4 PSU 1 AC inlet 10 Service processor (SP) network management (NET...
Page 48 ZS4-4 Internal Components The ZS4-4 chassis contains both customer-replaceable units (CRUs) and field-replaceable units (FRUs) as shown in the following figure. FRUs must be replaced by trained Oracle service technicians. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 49 Servicing the ZS4-4 Controller Internal Components (Exploded View) FIGURE 6 Figure Legend Figure Legend Power supplies (CRU) Memory riser card (CRU) Power supply backplane (FRU) Motherboard (FRU) SP card (FRU) System drive (CRU) HBA/PCIe cards (CRU) Fan module (CRU) CPU (FRU) Fan board (FRU) Heatsink (FRU) Drive backplane (FRU)
Page 50 Memory riser card P3/MR0 Memory riser card P0/MR0 Memory riser card P2/MR1 CPU P3 Memory riser card P2/MR0 CPU P2 Memory riser card P1/MR1 CPU P1 Memory riser card P1/MR0 CPU P0 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 51 Servicing the ZS4-4 Controller Each memory riser card contains twelve DIMM slots, four DDR3 channels, and two memory buffer ASICs. Each each memory buffer has two channels (A and B) and links to three DIMM slots per channel. Each memory buffer is connected to the processor's built-in memory controller by an SMI-2 link.
Page 52 2-port 10Gb Ethernet Optical Optional recommended front- 2-port 10Gb Ethernet Copper Optional recommended front- 16GB Dual Universal FC HBA Optional FC target or initiator (Backup) Cluster Interface (second Base configuration generation) Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 53 Servicing the ZS4-4 Controller Slot Description Type Note 2-port InfiniBand CX3 HCA Optional recommended front- 2-port 10Gb Ethernet Optical Optional recommended front- 2-port 10Gb Ethernet Copper Optional recommended front- 16GB Dual Universal FC HBA Optional FC target or initiator (Backup) 4-port (4x4) SAS-2 External Base configuration 4-port (4x4) SAS-2 External...
Page 54 NET 0, NET 1, NET 2, and NET 3 (bottom left to top right), as shown in the following figure. Use these ports to connect the appliance to the network. The LEDs located above the NET ports, labeled 2, 0, 3, 1 (left to right) are Link/Activity indicators. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 55 Servicing the ZS4-4 Controller Ethernet Ports FIGURE 9 Status OFF (1) No Link ON (0) Link and no activity Blink Link and activity Speed is not indicated for the NET ports. Note - ZS4-4 Network Management Port The network management connector (NET MGT), shown in the following figure, is an RJ-45 port and provides an alternate terminal interface to the service processor (SP) console.
Page 56 The following figure shows the cooling zones and the approximate location of the temperature sensors. The accompanying legend table provides sensor NAC names and sensor motherboard designations. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 57 Servicing the ZS4-4 Controller ZS4-4 Cooling Subsystem FIGURE 12 Figure Legend Figure Legend Cooling zone 0 Temperature sensor TS_ZONE2 (U4505) Cooling zone 1 Temperature sensor TS_OUT (U4506) Cooling zone 2 Temperature sensor TS_TVL_1 (U4002) Cooling zone 3 (power supply Temperature sensor TS_TVL_0 backplane area) (U4302) Temperature sensor TS_PS (U4603)
Page 58 HDDs and SSDs are hot-swappable and can be removed and installed while the storage controller is running without affecting other hardware capabilities. Use the following procedure to replace a ZS4-4 HDD or SSD. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 59 How to Replace a ZS4-4 HDD or SSD If you have more than one failed drive, replace only one drive at a time. Removing more Note - than one drive in quick succession will cause a hardware/pool fault. Also, do not perform a pool configuration operation while a disk firmware upgrade is occurring.
Page 60 On the replacement drive, open the release lever and slide the drive into the same slot (1) until it is fully seated. Close the latch (2) to lock the drive in place. The Oracle ZFS Storage Appliance software automatically detects and configures the new drive.
Page 61 How to Replace a ZS4-4 Fan Module Shut down the controller using one of the power-off methods described in “How to Power off the Controller” on page Ensure that the replacement power supply handle is in the open position. Align the replacement power supply with the empty power supply bay. Slide the power supply into the bay (1) until it stops.
Page 62 Position the replacement fan module so the connector on the bottom of the module is aligned with the connector on the inside of the slot and all keying and Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 63 How to Identify a Faulted ZS4-4 Memory Module labeling are correctly positioned. The fan modules are keyed to ensure that they are installed in the correct orientation. Slide the fan module into the slot until it stops. Press downward on the top of the fan module, on the Press Here to Latch label, until the fan module is fully seated.
Page 64 The following example, shows the Fault indicators for memory riser cards, P0/MR0 and P0/MR1 are lit, as is the Fault indicator for CPU, P0. A CPU is a field replaceable unit (FRU) and must be replaced by a trained Oracle Caution - service technician.
Page 65 How to Replace a ZS4-4 DIMM Extend the controller from the rack as described in “How to Extend the Storage Controller from the Rack” on page Remove the top cover as described in “How to Remove the Top Cover” on page Remove the memory riser card with the lighted Fault indicators (P0/MR0 and P0/MR1), and locate the failed DIMM.
Page 66 DIMM. To view details about the new DIMM, click its information icon. How to Replace a ZS4-4 Memory Riser Card Use the following procedure to replace a ZS4-4 memory riser card. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 67 How to Replace a ZS4-4 Memory Riser Card Shut down the controller using one of the power-off methods described in “How to Power off the Controller” on page Extend the controller from the rack as described in “How to Extend the Storage Controller from the Rack”...
Page 68 Replacing a PCIe card is a cold-swap procedure, and you must remove power from the storage controller. If you are installing a newly released HBA, upgrade your system software before Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 69 How to Replace a ZS4-4 PCIe Card installing the HBA. All HBAs must be of the same type. Use the following procedure to replace a ZS4-4 PCle card. Go to the Maintenance > Hardware screen of the BUI, click the right-arrow icon for the controller, click Slot, and note the ID of the faulted PCIe card, which has an amber icon.
Page 70 Carefully remove the PCIe card from the PCIe card slot. Whenever you remove a PCIe card, you should replace it with another PCIe card or a Caution - filler panel; otherwise, the controller might overheat due to improper airflow. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 71 How to Replace a ZS4-4 PCIe Card Ensure the PCIe card retaining bar is open. Servicing the Hardware...
Page 72 Return the controller to the normal rack position by pushing the release tabs on the side of each rail while slowly pushing the storage controller into the rack. Reconnect the power cords to the power supplies. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 73 266. If you installed a new HBA, install the disk shelf as described in “Installation Prerequisites and Hardware Overviews” in Oracle ZFS Storage Appliance Installation Guide and connect the expansion storage as described in “Connecting to Attached Storage” on page 266.
Page 74 Do not deform the metal tab on the positive (+) side of the battery. The metal tab Caution - maintains the positive battery connection and secures the battery in the holder. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 75 How to Replace a ZS4-4 Battery Press the new battery into the battery holder with the positive (+) side facing the metal tab that holds it in place. If you removed the PCIe card from slot 1, re-install it. See Replacing a ZS4-4 PCIe Card.
Page 76 Servicing the ZS3-4 Controller This section describes how to service the ZS3-4 controller. ZS3-4 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage ZS3-4 controller. ZS3-4 Base Configuration The ZS3-4 controller can be configured as a single controller or two controllers to create a high- availability cluster configuration.
Page 77 Servicing the ZS3-4 Controller ZS3-4 Controller Front Panel FIGURE 13 Figure Legend Figure Legend Locator LED and button (white) USB 2.0 Connectors Service Required LED (amber) DB-15 video connector Power/OK LED (green) Boot drive 0 Power button Boot drive 1 (required) Service Processor (SP) OK LED (green) Solid state drive 2 (optional) Fan/CPU/Memory Service Required LED...
Page 78 Service action required (amber) OK/Activity (green) ZS3-4 Rear Panel The following graphic shows the rear panel. Base configuration HBAs are not depicted in this illustration. FIGURE 15 ZS3-4 Controller Rear Panel Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 79 Servicing the ZS3-4 Controller Figure Legend Figure Legend Power supply unit 0 status LEDs OK: green Power Network (NET) 10/100/1000 ports: NET0-NET3 Supply Fail: amber AC OK: green Power supply unit 0 AC inlet USB 2.0 ports Power supply unit 1 status LEDs OK: green Power PCIe slots 5-9 Supply Fail: amber AC OK: green Power supply unit 1 AC inlet...
Page 80 (3RU) in height. The chassis dimensions are as follows: TABLE 18 ZS3-4 Controller Dimensions Dimension Measurement Dimension Measurement Height 13.3 cm/5.25 in Depth 70.6 cm/27.8 in Width 43.7 cm/17.19 in Weight 16.36 kg/96 lbs Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 81 ZS3-4 Internal Boards The ZS3-4 controller chassis contains the following field-replaceable units (FRUs). FRUs are not customer-serviceable, and should only be replaced by trained Oracle service technicians. Motherboard - The motherboard includes CPU modules, slots for eight DIMM risers, ■...
Page 82 The components of the ZS3-4 controller are shown in the following figure and identified in the legend. FIGURE 17 ZS3-4 Controller Components Figure Legend Figure Legend Motherboard CPUs and heatsinks Low-profile PCIe cards Memory risers Power supplies Fan board Power supply backplane Fan modules Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 83 Servicing the ZS3-4 Controller Figure Legend Figure Legend Drive backplane Boot drives and SSDs System lithium battery ZS3-4 CPU and Memory The ZS3-4 controller supports 16GB DDR3 DIMMs installed on all eight risers, accommodating 1TB of memory. ZS3-4 Controller DIMM Risers FIGURE 18 Refer to the service label on the cover for DIMM placement information.
Page 84 ZS3-4 Fan Modules The Fan Modules and Fan Module LEDs of the controller are shown in the following figure. The following LEDs are lit when a fan module fault is detected: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 85 Servicing the ZS3-4 Controller ZS3-4 Controller Fan Modules FIGURE 20 Front and rear Service Action Required LEDs ■ Fan Module Service Action Required (TOP) LED on the front of the server ■ Fan Fault LED on or adjacent to the faulty fan module ■...
Page 86 Optional FC target or initiator (backup) 7023303 2-port 16Gb FC Optional FC target or initiator (backup) 7070006 2-port 10Gb Ethernet Optional Copper NIC recommended front- 375-3696-01 2-port InfiniBand Optional CX2 HCA recommended front- Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 87 Servicing the ZS3-4 Controller Slot Mfg Part Number Description Note 7070195 4-port 1Gb Ethernet Optional Copper UTP NIC recommended front- 7051223 2-port 10Gb Ethernet Optional Optical NIC recommended front- 371-4325-02 2-port 8Gb FC HBA Optional FC target or initiator (backup) 7023303 2-port 16Gb FC Optional FC target or...
Page 88 (backup) 7067091 4-port (4x4) SAS-2 Base configuration external HBA 371-4325-02 2-port 8Gb FC HBA Optional FC target or initiator (backup) 7070006 2-port 10Gb Ethernet Optional Copper NIC recommended front- Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 89 Servicing the ZS3-4 Controller Slot Mfg Part Number Description Note 7070195 4-port 1Gb Ethernet Optional Copper UTP NIC recommended front- 7051223 2-port 10Gb Ethernet Optional Optical NIC recommended front- 7023303 2-port 16Gb FC Optional FC target or initiator (backup) ZS3-4 PCIe Slot Order When installing additional PCIe cards to your base configuration, cards must be added in a specific order.
Page 90 ZS3-4 Controller Serial Management Port The network management connector (NET MGT) is an RJ-45 connector and provides a LAN interface to the SP console. FIGURE 23 ZS3-4 Controller Network Management Port Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 91 “Getting Started with Servicing the Hardware” on page 11 “Prerequisites for Servicing Hardware” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to update your controllers for disk shelf interoperability.
Page 92 After at least 30 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 93 Slide the replacement drive into the slot until it is fully seated. Close the latch to lock the drive in place. The Oracle ZFS Storage system software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller or drive shelf.
Page 94 How to Replace a ZS3-4 Power Supply Storage controllers are equipped with redundant hot-swappable power supplies. If a power supply fails and you do not have a replacement, leave the failed power supply installed to Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 95 How to Replace a ZS3-4 Power Supply ensure proper air flow. A faulted power supply is indicated by an amber colored status LED. Use the following procedure to replace a ZS3-4 power supply. Gain access to the rear of the storage controller where the faulted power supply is located.
Page 96 How to Replace a ZS3-4 Power Supply Grasp the power supply handle and press the release latch to remove the power supply. Align the replacement power supply with the empty power supply chassis bay. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 97 How to Replace a ZS3-4 Memory Slide the power supply into the bay until it is fully seated. The following figure shows the power supply. Connect the power cord to the power supply. Verify that the green AC Present status indicator is lit. Close the CMA, inserting the CMA into the rear left rail bracket.
Page 98 Cover” on page To locate the DIMM you want to service, press the Fault Remind Button on the storage controller. The following illustration shows the Fault remind button on the ZS3-4 controller. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 99 How to Replace a ZS3-4 Memory Identify the memory riser that hosts the faulted DIMM by the Service Required status indicator. Lift the memory riser straight up to remove it from the motherboard, and place it on an antistatic mat. Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket.
Page 100 Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly. Push the DIMM into the connector until the ejector tabs lock the component in place. To replace the cover: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 101 How to Replace a ZS3-4 Memory Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place. Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Page 102 How to Replace a ZS3-4 Memory Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 103 How to Replace a ZS3-4 Memory Push the release tabs on the side of each rail and slowly push the storage controller into the rack. Servicing the Hardware...
Page 104 The Power/OK status indicator next to the Power button lights and remains lit. The Maintenance > Hardware screen of the BUI provides status of the replacement on the Details page for DIMMs. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 105 How to Replace a ZS3-4 PCIe Card or Riser How to Replace a ZS3-4 PCIe Card or Riser This procedure requires that you handle components that are sensitive to static Caution - discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components.
Page 106 Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary. Install the replacement PCIe card into the PCIe card slot. Install the retaining screw to hold the PCIe card to the chassis. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 107 How to Replace a ZS3-4 PCIe Card or Riser Return the crossbar to its closed and locked position. To install the top cover: Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Page 108 Use a pen or other pointed object to press and release the recessed Power button on the storage controller front panel. The Power/OK status indicator next to the Power button lights and remains lit. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 109 The online icon should be green. Install the disk shelf as described in “Installation Prerequisites and Hardware Overviews” in Oracle ZFS Storage Appliance Installation Guide connect the expansion storage as described in “Connecting to Attached Storage” on page 266.
Page 110 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 111 How to Replace a ZS3-4 Battery Press down on the cover with both hands until both latches engage. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
Page 112 Servicing the ZS3-2 Controller This section describes how to service the ZS3-2 controller. ZS3-2 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage ZS3-2 controller. ZS3-2 Base Configuration The ZS3-2 controller is an enterprise-class, rackmount x86 system powered by the Intel Xeon processor.
Page 113 Servicing the ZS3-2 Controller ZS3-2 Controller Front Panel FIGURE 24 Drive slots 0 and 1 have two mirrored 900GB SAS-2 boot drives. Up to four 1.6TB flash read- optimized (Readzilla) solid state drives (SSDs) fill slots 2 through 5, in order. Slots 6 and 7 are empty and must contain drive fillers.
Page 114 The 4x4 SAS-2 HBA, installed in PCIe slot 2 of the ZS3-2, provides connectivity to external DE2 and Sun Disk Shelves. The HBA ports are numbered 0-3, left to right, as shown in the following figure. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 115 Servicing the ZS3-2 Controller ZS3-2 Controller 4x4 SAS-2 HBA Port Numbers FIGURE 26 For controllers with an additional 4x4 SAS-2 HBA, see “ZS3-2 PCIe Options” on page 123 for slot placement. ZS3-2 Physical Specifications The ZS3-2 controller 2U chassis dimensions are as follows: ZS3-2 Controller Physical Specifications TABLE 23 Dimension...
Page 116 The ZS3-2 chassis has the following field replaceable units (FRUs). FRUs are not customer- serviceable and must be replaced by trained Oracle service technicians. PCIe Risers - There are three risers per system, each attached to the rear of the ■...
Page 117 The ZS3-2 controller's internal storage, power, and cooling components are described in the following figure and legend. A component identified as a field replaceable unit (FRU) must be replaced by trained Oracle service technicians. FIGURE 27 ZS3-2 Controller Storage, Power, and Fan Components...
Page 118 Power supplies ZS3-2 Internal Cables The ZS3-2 controller contains the following field-replaceable unit (FRU) internal cables. FRUs are not customer-serviceable, and must be replaced by trained Oracle service technicians. FIGURE 28 ZS3-2 Controller Internal Cables Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 119 ZS3-2 Motherboard, Memory, and PCIe Cards The ZS3-2 controller motherboard, memory, and PCIe components are described in the following figure and legend. Field replaceable components (FRUs) are not customer-serviceable, and must be Note - replaced by trained Oracle service technicians. Servicing the Hardware...
Page 120 ZS3-2 Controller Motherboard, Memory, and PCIe Components FIGURE 29 Figure Legend Drive cage (FRU) Airduct Battery Drive backplane (FRU) PCIe Risers (FRU) PDB duct Motherboard (FRU) PCIe cards Power distribution board (FRU) Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 121 Servicing the ZS3-2 Controller Figure Legend DIMMs USB flash drive ZS3-2 CPU and Memory The ZS3-2 controller motherboard has 16 slots in two groups that hold industry-standard DDR3 low voltage (LV) DIMMS. ZS3-2 Controller CPU and Memory Components FIGURE 30 All sockets must be occupied by identical DDR3 DIMMs.
Page 122 Riser 1 installs at the left rear of the chassis, Riser 2 at the center rear, and Riser 3 at the right rear of the chassis. Each riser can accommodate two PCIe cards: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 123 Servicing the ZS3-2 Controller Riser 1 contains slots 1 and 4 ■ Riser 2 contains slots 2 and 5 ■ Riser 3 contains slots 3 and 6 ■ ZS3-2 PCIe Options The following table describes the supported PCIe configuration options for the ZS3-2 controller.
Page 124 I/O ports. ZS3-2 Serial Management Port The serial management connector (SER MGT) is an RJ-45 port and provides a terminal connection to the service processor (SP) console. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 125 How to Install Optional PCIe Slot Cards in Order ZS3-2 Controller Serial Management Port FIGURE 31 ZS3-2 Network Management Port The network management connector (NET MGT) is an RJ-45 port and provides an alternate terminal interface to the SP console. ZS3-2 Controller Network Management Port FIGURE 32 ZS3-2 Ethernet Ports...
Page 126 “Cabling ZS3-2 Clusters” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0. ZS3-2 Controller Cluster I/O Ports: Serial 0, Serial 1, Ethernet FIGURE 34 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 127 How to Disconnect the RJ-45 Cable from the Cluster Serial Port When disconnecting an RJ-45 cable from a cluster serial port (0 and 1), use extreme Caution - care not to damage the internal RJ-45 receptacle. To properly remove an RJ-45 cable from a cluster serial port, do the following: How to Disconnect the RJ-45 Cable from the Cluster Serial Port Using your index finger, press down fully on the RJ-45 release tab.
Page 128 ZS3-2 Optional Cable Management Arm The following figure identifies the components of the second-generation cable management arm (CMA). See the CMA installation instructions. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 129 How to Disconnect the RJ-45 Cable from the Cluster Serial Port ZS3-2 Controller Optional Cable Management Arm FIGURE 35 Figure Legend Connector A Connector D Front slide bar Slide-rail latching bracket (used with connector D) Velcro straps (6) Rear slide bar Connector B Cable covers Connector C...
Page 130 “Getting Started with Servicing the Hardware” on page 11 “Prerequisites for Servicing Hardware” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to update your controllers for disk shelf interoperability.
Page 131 How to Replace a ZS3-2 HDD or SSD Identify the failed drive by going to the Maintenance > Hardware section of the BUI and clicking the drive information icon . If you are physically at the system, the amber Service Required indicator on the HDD or SSD should be illuminated.
Page 132 After at least 30 seconds, navigate to the Hardware > Maintenance screen, and click the right-arrow icon on the system controller to verify that the software has detected that the drive is not present. Align the replacement drive with the drive slot. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 133 Press the release lever fully closed with a click, securing the drive into the drive slot. The Oracle ZFS Storage system software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller or drive shelf.
Page 134 Disconnect the power cord from the faulted power supply. Press the release tab to the left and pull on the handle. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 135 How to Replace a ZS3-2 Power Supply Continue to pull on the handle to slide the power supply out of the chassis. Align the replacement power supply with the empty power supply chassis bay. Slide the power supply into the bay until the power supply seats and the release tab clicks.
Page 136 Extend the controller from the rack as described in “How to Extend the Storage Controller from the Rack” on page Remove the top cover as described in “How to Remove the Top Cover” on page Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 137 How to Replace a ZS3-2 Fan Module Grasp the green band of the fan module to be removed with your forefinger and press down on the fan module with your thumb. Pull the band straight up and lift the fan module out of the chassis. Align the replacement fan module into the fan tray slot.
Page 138 This procedure requires that you handle components that are sensitive to static Caution - discharge, which can cause the component to fail. To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 139 How to Replace a ZS3-2 Memory Removing a DIMM is a cold-service operation. You must power off the appliance before you remove the DIMM. There will be a loss of access to the storage unless the system is in a clustered configuration.
Page 140 How to Replace a ZS3-2 Memory Raise the drive cage to the vertical position (2). Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 141 How to Replace a ZS3-2 Memory Fully loosen the thumbscrews that secure the air duct. Slide the left (L) thumbscrew bracket forward and off of the mounting pins. Slide the right (R) thumbscrew bracket rearward and off of the mounting pins. Set the thumbscrew bracket aside.
Page 142 Lift the air duct straight up and off the alignment pins. Set the air duct aside. Press the button on the midplane. An amber LED indicates the faulty DIMM. Press down and out on the release levers at both ends of the DIMM slot. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 143 How to Replace a ZS3-2 Memory Lift the DIMM up and out of the slot. Set the DIMM aside on an antistatic mat. Servicing the Hardware...
Page 144 How to Replace a ZS3-2 Memory Align the DIMM to the location where it installs into the slot. Ensure that the notch in the DIMM lines up with the key in the slot. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 145 How to Replace a ZS3-2 Memory Insert the DIMM into the slot, pressing firmly so that both release levers click closed. Replace and secure the air duct. Lower the drive cage to the horizontal position and with the cage slightly elevated, reconnect the power cable.
Page 146 Remove the top cover as described in “How to Remove the Top Cover” on page Locate the PCIe card position in the storage controller, see “ZS3-2 PCIe Options” on page 123. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 147 How to Replace a ZS3-2 PCIe Card or Riser Fully loosen the two captive screws securing the riser to the motherboard. Servicing the Hardware...
Page 148 Disconnect any internal cables attached to the PCIe cards installed in the riser. Swing the retainer to its fully open (120 degrees) position. Note that the riser 3 latch is slightly different than the latch for riser 1 and 2. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 149 How to Replace a ZS3-2 PCIe Card or Riser Lift the PCIe card off of the bracket alignment pin and out of the socket. Position the replacement PCIe card with where it will install into the riser. The PCIe card bracket mates with the alignment pin and the socket of the riser. Press the PCIe card into the socket.
Page 150 Align the riser to the location where it installs into the chassis. Reconnect any previously removed internal cables to the PCIe card installed in the riser, if doing so will ease installation of the riser. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 151 How to Replace a ZS3-2 PCIe Card or Riser Lower the riser card onto the motherboard and press the card edge connector securely into the socket. The bracket of the riser (riser 2 and 3) overlaps the bracket of the adjacent riser. Tighten the two captive screws that secure the riser to the motherboard.
Page 152 Remove the top cover as described in “How to Remove the Top Cover” on page If a PCIe card installed in Riser 2 prevents you from accessing the USB drive, remove Riser 2. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 153 How to Replace a ZS3-2 Flash Drive Grasp the USB drive and pull it straight up and out of the chassis. Position the replacement USB drive to where it installs onto the motherboard. The USB drive installs into the USB socket that is most forward. The socket is labeled USB 1.
Page 154 Remove Riser 1. Press the tab of the battery receptacle forward to release the battery. The battery pops up. Lift the battery out of the receptacle and set it aside. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 155 Power button lights and remains lit. When the system has finished booting, log in and set the time using the steps in the task “Setting Clock Synchronization using the BUI” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0.
Page 156 Servicing the 7x20 Controller This section describes how to service the 7x20 controller. 7420 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7420 controller. 7420 Configuration Options The Sun ZFS Storage 7420 Appliance consists of a standalone storage controller, or two storage controllers in a high-availability cluster configuration, and one to 36 disk shelves.
Page 157 Servicing the 7x20 Controller 7420 Front Panel The 7420 controller drive slots and front panel components are shown in the following figure. 7420 Controller Front Panel FIGURE 36 Figure Legend Figure Legend Figure Legend Locator LED and button (white) Power Supply (PS) Service SSD 2 (optional) Required LED Service Required LED (amber)
Page 158 In a 7420 cluster, the number of SSDs installed in both controllers must match. 7420 Controller System Drive FIGURE 37 Figure Legend Ready to remove (blue) Service action required (amber) OK/Activity (green) Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 159 Servicing the 7x20 Controller 7420 Rear Panel The following graphic shows the rear panel of the controller. Base configuration HBAs are not depicted in this illustration. FIGURE 38 7420 Controller Rear Panel Figure Legend Figure Legend Power supply unit 0 status LEDs OK: green Power Network (NET) 10/100/1000 ports: NET0-NET3 Supply Fail: amber AC OK: green Power supply unit 0 AC inlet...
Page 160 Vertical PDB card, and to the motherboard through a bus bar and ribbon cable. It also supports a top cover interlock ("kill") switch. In the storage controller, the power supplies connect to the power supply backplane which connects to the power distribution board. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 161 Servicing the 7x20 Controller Vertical PDB Card: The vertical power distribution board, or Paddle Card is a FRU and ■ serves as the interconnect between the power distribution board and the fan power boards, hard drive backplane, and I/O board. Power Supply Backplane Card: This board connects the power distribution board to ■...
Page 162 CPU. Four or eight 4GB or 8GB DDR3 DIMMs are installed on each riser, accommodating up to 256GB of memory for two CPUs, or up to 512GB for four CPUs. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 163 Servicing the 7x20 Controller 7420 Controller Memory Risers FIGURE 40 Refer to the service label on the cover for DIMM placement information. On every memory riser, slots D0, D2, D4, and D6 must be populated; optionally, slots D1, D3, D5, and D7 may be populated as a group on all installed memory risers.
Page 164 7420 Fan Modules The Fan Modules and Fan Module LEDs of the storage controller are shown in the following figure. The following LEDs are lit when a fan module fault is detected: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 165 Servicing the 7x20 Controller 7420 Controller Fan Module LEDs FIGURE 42 Front and rear Service Action Required LEDs ■ Fan Module Service Action Required (TOP) LED on the front of the server ■ Fan Fault LED on or adjacent to the faulty fan module ■...
Page 166 F375-3609-03 2-port SAS external Additional optional (7059331 for EU back-end countries) 7054739 4-port copper NIC Optional recommended front- 371-4325-02 8Gb DP FC HBA Optional FC target or initiator (Backup) Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 167 Servicing the 7x20 Controller Slot Mfg Part Number Description Note 375-3606-03 CX1 InfiniBand Optional recommended front- 7051223 2-port optical 10GE Optional recommended front- 375-3696-01 CX2 InfiniBand Optional recommended front- F375-3609-03 2-port SAS external Additional optional (7059331 for EU back-end countries) 7054739 4-port copper NIC Optional...
Page 168 371-4325-02 8Gb 2-port FC HBA Optional FC target or initiator (Backup) 375-3606-03 CX1 InfiniBand Optional recommended front- 7051223 2-port optical 10GE Optional recommended front- 375-3696-01 CX2 InfiniBand Optional recommended front- Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 169 Servicing the 7x20 Controller Slot Mfg Part Number Description Note F375-3609-03 2-port SAS external Base configuration (7059331 for EU (2 minimum) countries) 371-4325-02 8Gb 2-port FC HBA Optional FC target or initiator (Backup) 7051223 2-port optical 10GbE Optional recommended front- 7054739 4-port copper NIC Optional...
Page 170 7420 Controller Serial Management Port The network management connector (NET MGT) is an RJ-45 connector and provides a LAN interface to the SP console. FIGURE 45 7420 Controller Network Management Port Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 171 Hardware Overview” on page 234 for component specifications and diagrams. 7320 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7320 controller. 7320 Configuration Options The single controller base configuration is 96GB RAM, 2x2.4GHz Quad-Core processors, one external SAS HBA, and four 10/100/1000 Ethernet ports.
Page 172 When you cluster a 7320, you must identically configure the cards in both of the Note - clustered storage controllers, and you must identically configure all optional NIC/HBA cards used in the clustered storage controllers in both chassis. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 173 Servicing the 7x20 Controller 7320 Clustered Controllers Configurations TABLE 36 Slot Type Part Number Vendor Part Description Note PCIe 375-3617-01 Intel Niantic DP Optical Optional 10GE NIC Recommended Front-end PCIe 375-3696-01 Mellanox InfiniBand HCA Optional Recommended Front-end PCIe 375-3606-03 MHJH29-XTC InfiniBand HCA Optional Recommended...
Page 174 The following figure and legend identify the front panel LEDs. FIGURE 46 7320 Controller Front Panel LEDs Figure Legend Locate Button/LED Service Required LED (amber) Power/OK LED (green) Power Button Rear Power Supply System Overtemperature LED Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 175 Servicing the 7x20 Controller Figure Legend Top Fan The following figure and legend identify the 7320 front panel drive locations. Two mirrored hard disk drives (HDDs) that store the operating system reside in slots 0 and 1. Up to four solid state drives (ReadZilla SSDs), which store the read cache, fill slots 2 through 5, in order.
Page 176 Volt-Ampere rating: 891 VA @ 240 VAC, 0.98P.F. ■ 7320 Internal Boards The 7320 storage controller chassis has the following boards installed. Field-replaceable units (FRUs) should only be replaced by trained Oracle service Note - technicians. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 177 Servicing the 7x20 Controller PCIe Risers: The storage controller contains three PCIe risers that are customer-replaceable ■ units (CRUs) and are attached to the rear of the motherboard. Each riser supports one PCIe card. Motherboard: The motherboard is a FRU and includes CPU modules, slots for 18 DIMMs, ■...
Page 178 The storage controller motherboard has 18 slots in two groups that hold industry-standard DDR3 DIMM memory cards. All sockets must be occupied by either a filler or a DDR3 DIMM. FIGURE 49 7320 Controller CPU and Memory Components Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 179 Servicing the 7x20 Controller 7320 Power Distribution and Fan Module Components The following figure and legend identify the Power Distribution/Fan Module components of the storage controller. FIGURE 50 7320 Controller Power Distribution and Fan Module Components Figure Legend Figure Legend Fan Modules Power Distribution/Bus Bar Assembly Fan Board...
Page 180 Drive Cage Solid State Drives blank/USB Module Right Control Panel Light Pipe Assembly 7320 PCIe Cards and Risers Following is the complete list of replaceable PCIe cards for the 7320 system. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 181 Servicing the 7x20 Controller 7320 Controller Replaceable PCIe Cards TABLE 41 Part Number Description FRU/CRU F371-4325-01 8Gb FC HBA (PCIe) F375-3609-02 PCA, SAS 6GBS 8 Port (PCIe) F375-3606-03 Dual Port (x4) IB HCA (PCIe) F375-3696-01 Dual Port CX2 4XQDR (PCIe) F375-3617-01 2X10GbE SFP+, X8 (PCIe) F375-3481-01...
Page 182 “Disk Shelf Hardware Overview” on page 234 component specifications and diagrams. 7120 Controller Hardware Overview This section describes the internal and external components of the Oracle ZFS Storage 7120 controller. 7120 Base Configuration The following table shows the configuration options for a 7120 controller. All PCIe cards are low-profile, and must be fitted with low-profile mounting brackets.
Page 183 18 DIMM slots into a compact 2U footprint. Refer to the product site at https://www. for the most recent component specification. oracle.com/storage/nas/index.html Refer to the white paper Implementing Fibre Channel SAN Boot with Oracle's Sun ZFS Storage Appliance at http://www.oracle.com/technetwork/articles/servers-storage-admin/ for details on FC SAN boot solutions using the Sun ZFS Storage fbsanboot-365291.html...
Page 184 Optional Sun Dual Port 40Gb/sec 4x InfiniBand QDR HCAdapter PCIe cards (375- Note - 3606-01) may be located in slots 1, 2, or 3. 375-3606-01 HCA expansion cards are not supported in the 10Gb network configurations. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 185 Servicing the 7x20 Controller 7120 Controller Rear Panel FIGURE 55 Figure Legend Power Supply Unit 1 PCIe 4 Network Management port Power Supply Unit 0 Boot HDD 1 Gbit Ethernet ports NET 0, 1, 2, 3 PCIe 0 Boot HDD 0 USB 2.0 ports (0, 1) PCIe 3 Rear Panel System Status LEDs...
Page 186 Volt-Ampere rating: 1261 VA @ 240 VAC, 0.98P.F. ■ 7120 Internal Boards The chassis has the following boards installed. Field-replaceable units (FRU) should only be replaced by trained Oracle service Note - technicians. PCIe Risers: Each riser supports two PCIe cards that are customer-replaceable. There are ■...
Page 187 Servicing the 7x20 Controller Storage Drive Backplane: The storage drive backplane is a FRU and includes the ■ connectors for the storage drives, as well as the interconnect for the I/O board, power and locator buttons, and system/component status LEDs. The system has a 12-disk backplane. Each drive has an LED indicator for Power/Activity, Fault, and Locate.
Page 188 Servicing the 7x20 Controller 7120 Controller Fan Modules and LEDs FIGURE 57 The following figure and legend show the power distribution and associated components. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 189 Servicing the 7x20 Controller 7120 Controller Power Distribution Board and Associated Components FIGURE 58 Figure Legend Fan Board Power Distribution Board SAS Expander Board Connector Board Disk Backplane Power Supply Backplane Front Control Panel Light Pipe Assembly 7120 I/O Components The following figure and legend show the I/O components of the 7120 system.
Page 190 The following table describes NIC/HBA options for the 7120. TABLE 47 7120 Controller NIC/HBA Options Mktg Part Number Description Mfg Part Number SG-XPCIESAS-GEN2-Z 2-port External Sun Thebe SAS (x4) 594-5889-01 HBA, PCIe Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 191 Servicing the 7x20 Controller Mktg Part Number Description Mfg Part Number SG-XPCIE2FC-QF8-Z 2-port FC HBA, 8Gb, PCIe 594-5684-01 X4446A-Z 4-port PCI-E Quad GigE UTP 594-4024-01 X4237A-N 2-port 4X IB HCA PCIe 594-5862-02 X1109A-Z 2-port 10Gig SFP+ NIC, PCIe 594-6039-01 7120 PCIe Options The following table describes the supported PCIe configuration option summary for the 7120.
Page 192 7120 Controller Serial Management Port FIGURE 60 The network management connector (NET MGT) is an RJ-45 port and provides an alternate terminal interface to the SP console. FIGURE 61 7120 Controller Network Management Port Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 193 Servicing the 7x20 Controller There are four RJ-45 Gigabit Ethernet ports (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec. These network interfaces must be configured before use. 7120 Cables The following figure and legend show the storage controller internal cables. The rear boot drives are not depicted in this illustration.
Page 194 “How to Replace a 7x20 HDD or SSD” on page 195 ■ “How to Replace a 7x20 Fan Module” on page 197 ■ “How to Replace a 7x20 Power Supply” on page 201 ■ Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 195 “Getting Started with Servicing the Hardware” on page 11 “Prerequisites for Servicing Hardware” on page Oracle DE2-24s and Sun Disk Shelves can be used together with standalone and clustered controllers after certain hardware modifications. Contact Oracle Service to update your controllers for disk shelf interoperability.
Page 196 Slide the replacement drive into the slot until it is fully seated. Close the latch to lock the drive in place. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 197 How to Replace a 7x20 Fan Module The Sun ZFS Storage system software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller or drive shelf. How to Replace a 7x20 Fan Module Operating a controller for an extended period of time with fans removed reduces the Caution -...
Page 198 Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the locator icon on the Maintenance > Hardware screen of the BUI for the fan you want to replace. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 199 How to Replace a 7x20 Fan Module Using thumb and forefinger, pull the fan module up and out. Install the replacement fan module into the storage controller fan slot. Servicing the Hardware...
Page 200 Close the top cover door immediately after replacing the fan to maintain airflow in the storage controller. 7420: To replace the fan module: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 201 How to Replace a 7x20 Power Supply Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the locator icon on the Maintenance > Hardware screen of the BUI for the fan you want to replace. Lift the latch at the top of the fan module to unlock the fan module, and pull the fan module out.
Page 202 Disconnect the power cord from the faulted power supply. Shut down the controller using one of the power-off methods described in “How to Power off the Controller” on page Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 203 How to Replace a 7x20 Power Supply 7120 or 7320: Release the latch, then remove the power supply. Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller. Servicing the Hardware...
Page 204 How to Replace a 7x20 Power Supply 7420: Grasp the power supply handle and press the release latch to remove the power supply. Align the replacement power supply with the empty power supply chassis bay. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 205 How to Replace a 7x20 Memory Slide the power supply into the bay until it is fully seated. The following figure shows the 7420 power supply. Connect the power cord to the power supply. Verify that the green AC Present status indicator is lit. Close the CMA, inserting the CMA into the rear left rail bracket.
Page 206 Lift up and remove the top cover. Also remove the air baffle by pressing the air baffle connectors outward and lifting the air baffle up and out of the server. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 207 How to Replace a 7x20 Memory 7420: To remove the top cover: Simultaneously lift both cover latches in an upward motion. Lift up and remove the top cover. To locate the DIMM you want to service, press the Fault Remind Button on the storage controller.
Page 208 How to Replace a 7x20 Memory The following illustration shows the Fault remind button on the 7120 controller. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 209 How to Replace a 7x20 Memory The following illustration shows the Fault remind button on the 7420 controller. Servicing the Hardware...
Page 210 Rotate both DIMM slot ejectors outward as far as they will go and carefully lift the faulted DIMM straight up to remove it from the socket. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 211 How to Replace a 7x20 Memory Line up the replacement DIMM with the connector, aligning the notch with the key to ensure that the component is oriented correctly. Push the DIMM into the connector until the ejector tabs lock the component in place.
Page 212 How to Replace a 7x20 Memory Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on. 7420: To replace the cover: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 213 How to Replace a 7x20 Memory Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place. Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
Page 214 How to Replace a 7x20 Memory Slide the top cover toward the rear of the chassis until it seats and press down on the cover with both hands until both latches engage. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 215 How to Replace a 7x20 Memory Push the release tabs on the side of each rail and slowly push the storage controller into the rack. Servicing the Hardware...
Page 216 The Power/OK status indicator next to the Power button lights and remains lit. The Maintenance > Hardware screen of the BUI provides status of the replacement on the Details page for DIMMs. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 217 Note that the 7120 Sun Flash Accelerator F20 card is a FRU and must be replaced by an Oracle service representative. Go to the Maintenance > Hardware screen of the BUI and click the right-arrow icon on the controller, and then click Slots to locate the faulted component.
Page 218 7120 or 7320: To replace the PCIe card: Disconnect any data cables connected to the cards on the PCIe riser you want to replace. Label the cables for proper connection later. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 219 How to Replace a 7x20 Controller PCIe Card or Riser Loosen the two captive Phillips screws on the end of the rear panel crossbar and lift the crossbar up and back to remove it. Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser.
Page 220 How to Replace a 7x20 Controller PCIe Card or Riser Carefully remove the PCIe card from the riser board connector and clean the slot with filtered, compressed air if necessary. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 221 How to Replace a 7x20 Controller PCIe Card or Riser Seat the replacement PCIe card in the slot of the riser and connect the cables. Servicing the Hardware...
Page 222 Slide the back of the riser into the motherboard rear panel stiffener. Tighten the screw that secures the riser to the motherboard. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 223 How to Replace a 7x20 Controller PCIe Card or Riser Replace the rear panel PCI crossbar by sliding it down over the PCIe risers, ensuring the crossbar is secured with two captive Phillips screws. 7420: To replace the PCIe card: Servicing the Hardware...
Page 224 Carefully remove the PCIe card from the connector and clean the slot with filtered, compressed air if necessary. Install the replacement PCIe card into the PCIe card slot. Install the retaining screw to hold the PCIe card to the chassis. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 225 How to Replace a 7x20 Controller PCIe Card or Riser Return the crossbar to its closed and locked position. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320 controller.
Page 226 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 227 How to Replace a 7x20 Controller PCIe Card or Riser Press down on the cover with both hands until both latches engage. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
Page 228 Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm). Lift up and remove the top cover. 7420: To remove the top cover: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 229 How to Replace a 7x20 Battery Simultaneously lift both cover latches in an upward motion. Lift up and remove the top cover. Servicing the Hardware...
Page 230 How to Replace a 7x20 Battery Using a small, non-metallic screwdriver, press the latch and remove the battery from the motherboard. The 7420 battery is shown here. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 231 How to Replace a 7x20 Battery The following figure shows the 7120 battery. Press the replacement battery into the motherboard with the positive side (+) facing upward. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however, service procedures for each are identical. The illustration shows the 7320.
Page 232 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 233 How to Replace a 7x20 Battery Press down on the cover with both hands until both latches engage. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller.
Page 234 FIGURE 64 Oracle Storage Drive Enclosure DE2-24P The Oracle Storage Drive Enclosure DE2-24P is a 2U chassis that supports 24 2.5" SAS-2 drives. The high-performance HDDs provide reliable storage, and the SSDs provide accelerated Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 235 FIGURE 65 Oracle Storage Drive Enclosure DE2-24C The Oracle Storage Drive Enclosure DE2-24C is a 4U chassis that supports 24 3.5" SAS-2 drives. The SSDs provide accelerated write operations, and the high-capacity HDDs provide reliable storage. This disk shelf features dual, redundant I/O Modules (IOMs), and dual power supply with fan modules.
Page 236 864 disks. In addition, the high-performance SAS-2 HBA is designed for the Oracle ZFS Storage Appliance family with a standard chip set to support a high-density of target devices, capable of attachment to 1024 targets.
Page 237 FIGURE 68 Up to four Logzilla SSDs are supported per disk shelf. Logzilla SSDs should be populated in order of slots 20, 21, 22, and 23. (The Oracle Storage Drive Enclosure DE2-24C is shown and represents both models.) Disk Shelf Front Panel Indicators The following figures show the front panel indicators.
Page 238 Servicing the Disk Shelves Oracle Storage Drive Enclosure DE2-24P Front Panel Indicators FIGURE 69 Figure Legend Figure Legend System power indicator Drive fault indicator Module fault indicator Power / Activity indicator Locate indicator Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 239 Servicing the Disk Shelves Oracle Storage Drive Enclosure DE2-24C Front Panel Indicators FIGURE 70 Figure Legend Figure Legend System power indicator Power / Activity indicator Module fault indicator Drive fault indicator Locate indicator Servicing the Hardware...
Page 240 Disk activity indicator Power supply fault indicator Disk Shelf Back Panel The back panel consists of the power supplies, fans, I/O Modules (IOMs) or SAS Interface Modules (SIMs), and indicator lights. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 241 Servicing the Disk Shelves Oracle Storage Drive Enclosure DE2-24P Back Panel FIGURE 72 Figure Legend Figure Legend Power Supply with Fan Module 0 I/O Module 0 I/O Module 1 Power Supply with Fan Module 1 Servicing the Hardware...
Page 242 I/O Module 1 Power Supply with Fan Module 2 I/O Module 0 It is especially important that power supplies and their filler panels are in the correct Note - slots. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 243 Removable SAS Interface Module (SIM) Boards. SIM 0 is on the left, and SIM 1 is on the right. Disk Shelf I/O Module Indicators The following disk shelves have I/O Modules (IOMs): Oracle Storage Drive Enclosure DE2-24P ■ Oracle Storage Drive Enclosure DE2-24C ■...
Page 244 Host port activity indicators Disk Shelf SIM Board Indicators The following disk shelves have SIM boards: Sun Disk Shelf ■ The following figure shows the SIM board indicators for the Sun Disk Shelf. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 245 Universal power connector SIM locator indicator Disk Shelf Power Supply Indicators The following figure shows power supply with fan module indicators for these disk shelves: Oracle Storage Drive Enclosure DE2-24P ■ Oracle Storage Drive Enclosure DE2-24C ■ Servicing the Hardware...
Page 246 Power cord tie wrap AC power fail indicator Power supply status indicator Power on/off switch The following figure shows power supply with fan module indicators for these disk shelves: Sun Disk Shelf ■ Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 247 Right ejection arm and captive screw latch Power supply status indicator Power on/off switch Disk Shelf Configurations The following tables describe and provide part numbers for the supported expansion storage shelves. Oracle Storage Drive Enclosure DE2-24P The following sections describe disk shelf components. Servicing the Hardware...
Page 248 Servicing the Disk Shelves Oracle Storage Drive Enclosure DE2-24P The Oracle Storage Drive Enclosure DE2-24P can contain the following components: Drive Enclosure DE2-24P Base Chassis ■ 300GB 10Krpm, SAS-2, 2.5" HDD ■ 900GB 10Krpm, SAS-2, 2.5" HDD ■ 73GB SSD SAS-2, 2.5" Write Flash Accelerator ■...
Page 249 How to Replace a Faulty Disk Shelf Drive Replacing the Disk Shelf Hardware This section describes how to replace the disk shelf components. “How to Replace a Faulty Disk Shelf Drive” on page 249 ■ “How to Replace a Disk Shelf Power Supply” on page 253 ■...
Page 250 Locate the failed disk drive with an amber LED at the front of the chassis. Press the release button or latch to release the drive lever. Pull the drive lever fully open to unlock and partially eject the drive from the chassis. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 251 How to Replace a Faulty Disk Shelf Drive - OR - Grasp the middle of the drive body and pull it toward you to remove it from the chassis. Wait at least 30 seconds. Ensure the new drive lever is in the fully extended position. Servicing the Hardware...
Page 252 How to Replace a Faulty Disk Shelf Drive While constantly pushing toward the pivot point of the lever, slide the drive fully into the chassis slot. - OR - Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 253 Ensure the power supply on/off switch is in the "O" off position. Disconnect the power cord tie strap from the power cord, and unplug the power cord from the power supply. Release the lever/ejection arms. Oracle Storage Drive Enclosure DE2-24P or DE2-24C: Servicing the Hardware...
Page 254 How to Replace a Disk Shelf Power Supply Grasp the latch and the opposite side of the module, and squeeze together to release the lever. Sun Disk Shelf: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 255 With the lever/ejection arms fully open, slide the new module into the chassis slot until it contacts the chassis backplane, and the lever/ejection arms begin to engage. Close the lever/ejection arms. Oracle Storage Drive Enclosure DE2-24P or DE2-24C: Servicing the Hardware...
Page 256 How to Replace a Disk Shelf Power Supply Push the lever fully closed until you hear or feel a click. Sun Disk Shelf: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 257 How to Replace a Disk Shelf Power Supply Push the ejection arms fully closed and secure both captive screws to seat and secure the module in the chassis. Ensure the power supply on/off switch is in the "O" off position. Plug the power cord into the new power supply and attach the power cord tie strap to the power cord.
Page 258 ■ Oracle Storage Drive Enclosure DE2-24C ■ The I/O Modules (IOMs), which are similar to SIM boards, are hot-swappable so you can replace them without removing power to the system. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 259 How to Replace a Disk Shelf I/O Module A faulted I/O Module is indicated by an amber LED. Go to the Maintenance > Hardware section of the BUI, click the right-arrow icon at the beginning of the appropriate disk shelf row, and then click Slot to view details, or click the locator icon to turn on the locator LED.
Page 260 Loosen the two extraction arm captive screws using your thumb and forefinger. If the captive screws are too tight to loosen by hand, use a No.2 Phillips screwdriver to loosen each screw. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 261 How to Replace a Disk Shelf SIM Board Pull each ejector tab outward and push to the sides to release and partially eject the SIM from the chassis. Grasp the middle of the SIM board and slide it out of the slot. Servicing the Hardware...
Page 262 Go to the Maintenance > Hardware section of the BUI, click the right-arrow icon at the beginning of the appropriate disk shelf row, and then click Slot to verify that the SIM board online icon is green for the newly installed SIM board. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 263 To back up and restore user data, you can use NDMP backup software, snapshots, and/or remote replication. Accordingly, see “Working with NDMP” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0, “Working with Snapshots”...
Page 264 234. Ensure the new drive lever is in the fully extended position. While constantly pushing toward the pivot point of the lever, slide the drive fully into the chassis slot. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 265 How to Add a Disk Shelf Cache Device - OR - Press the drive lever closed until it locks in place. If a vertically oriented drive is higher than surrounding drives, push down on the top of the drive to properly seat it.
Page 266 4X4 port SAS-2 HBAs, which are only supported with software version 2013.1.0 and later. Maximum Number of Disk Shelves per Controller TABLE 49 Controller Max. Shelves Max. 2X4 port SAS-2 HBA Max. 4X4 port SAS-2 HBA ZS4-4 ZS3-4 ZS3-2 7420 7320 7120 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 267 Maintaining the System The following sections describe how to maintain the system. “Viewing System Disks Status” on page 268 ■ “Working with Support Bundles” on page 268 ■ “Performing the Initial Setup” on page 272 ■ “Performing a Factory Reset” on page 272 ■...
Page 268 Working with Support Bundles The appliance can generate support bundles containing system configuration information and core files for use by Oracle support personnel for troubleshooting system problems. When the Phone Home service is enabled, support bundles will be generated automatically and securely uploaded in response to faults.
Page 269 Before You Begin configured, the following message is displayed: You must register for Phone Home before uploading support bundles to Oracle Support. Note - Continue to collect the bundle for local analysis, or Cancel to register your account and activate Phone Home.
Page 270 3-9999999999 A support bundle is being created and sent to Oracle. You will receive an alert when the bundle has finished uploading. Please save the following filename, as Oracle support personnel will need it in order to access the bundle: /upload/issue/3-9999999999/3-9999999999_ak.edd08324-f091-cd19-b4c9-...
Page 271 How to Retry a Failed Upload (CLI) loader:maintenance system bundles> select edd08324-f091-cd19-b4c9-bb508d6ecc59 loader:maintenance system bundles edd08324-f091-cd19-b4c9-bb508d6ecc59> show Properties: filename = /upload/uuid/edd08324-f091-cd19-b4c9-bb508d6ecc59/ak. edd08324-f091-cd19-b4c9-bb508d6ecc59.tar.gz status = building date = 2014-1-9 17:42:09 type = User initiated step_progress = 6 loader:maintenance system bundles> select fee4b98a-e3f7-e600-877d-b6d7933255f3 loader:maintenance system bundles fee4b98a-e3f7-e600-877d-b6d7933255f3>...
Page 272 Performing the Initial Setup Initial setup steps through the tasks performed as part of the initial configuration as described “Initial Appliance Configuration” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0. This does not change any of the current settings unless explicitly requested.
Page 273 Backing Up the Configuration pool (including projects and shares) is not affected - however the pool needs to be imported as part of the initial setup process. To perform a factory reset: BUI: Click the Factory Reset button on the Maintenance > System screen. ■...
Page 274 ■ destinations using Alerts rules. System software. The system software is automatically backed up as part of the System ■ Update capability. Replication targets. ■ iSCSI targets and initiators. ■ Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 275 “Unconfiguring Clustering using the BUI” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0 “Unconfiguring Clustering using the CLI” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0. Then, restore the configuration backup on a selected head, and then re-cluster the two systems, at which point the other system automatically synchronizes itself with the restored configuration.
Page 276 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 277 How to Create a Configuration Backup (BUI) How to Create a Configuration Backup (BUI) Use the following procedure to create a configuration backup. Go to Maintenance > System. Click the Backup button above the list of saved configurations and follow the instructions.
Page 278 To delete a saved configuration, use the following CLI command and specify the universal unique identifier for the backup: host:maintenance system configs> destroy cb2f005f-cf2b-608f-90db-fc7a0503db2a Are you sure you want to delete the saved configuration "new"? y Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 279 How to Export a Saved Configuration (BUI) host:maintenance system configs> How to Export a Saved Configuration (BUI) Use the following procedure to export a saved configuration. You can also use the export function to export the file to a share on the appliance itself, that has the HTTP or FTP protocol enabled for writing.
Page 280 You can set up periodic checks for software updates, or you can check for updates at any time. When an updated software package is available, you are directed to download the latest package Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 281 How to Set Up Software Notification (BUI) from My Oracle Support (MOS). To use the update notification feature, the Phone Home service must be enabled, as described in “Working with Phone Home” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0.
Page 282 How to Check for Software Updates (BUI) Use the following procedure to check for software updates using the BUI. For a description of a software release, refer to the release notes located in the My Oracle Support document Oracle ZFS Storage Appliance: Software Updates (2021771.1) (https:// support.oracle.com/epmos/faces/DocumentDisplay?id=2021771.1 Oracle ZFS Storage...
Page 283 /p18269573_20131_Generic.zip?aru=17312483&patch_file=p18269573_20131_Generic.zip checkdate = 2014-3-4 zfs-appliance:maintenance system 2013.1.1.5> Updating Software on a Single Controller This section describes updating the system software for an Oracle ZFS Storage Appliance with a standalone controller. How to Update Software on a Single Controller (BUI) This section describes updating the system software for a non-clustered Oracle ZFS Storage Appliance controller.
Page 284 After the media is done uploading, it is automatically unpacked and verified. When the verification completes, the software update is displayed: Click the information icon to view the Release Notes for the software update. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 285 How to Update Software on a Single Controller (CLI) To begin the update, click the apply icon. During this process, an update health check will be performed to verify the appliance is ready to update. As the update progresses, you will see the most recent message in the status field of the update.
Page 286 Creating system/boot/ak-nas-2009.10.14_1-0 ... done. Creating system/root/ak-nas-2009.10.14_1-0 ... done. After you set any properties, execute the upgrade command. You are prompted for confirmation and (assuming an affirmative) the update begins: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 287 Updating Software on Clustered Controllers This section describes updating the system software for an Oracle ZFS Storage Appliance with clustered controllers. Cluster update is also referred to as a rolling update. Controllers are updated one at a time, and each controller is updated while it is not providing service to clients.
Page 288 Note - Controller A, the other one is Controller B. On your local system, download the software update from My Oracle Support or from another official source. The update is a single compressed file named with the version number, such as ak-nas-2013-06-05-0-0.0.pkg.gz. You can rename the file if needed;...
Page 289 (CLI) For information about logging in to and using the CLI, see “Command Line Interface (CLI)” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0. Use the following procedure to prepare to update clustered controllers using the CLI. Note - For the purpose of this procedure, the first controller to be updated is referred to as Controller A, the other one is Controller B.
Page 290 If both controllers have active resources, choose either controller to update first. On your local system, download the software update from My Oracle Support or from another official source. The update is a single compressed file named with the version number, such as ak-nas-2013-06- 05-0-0.0.pkg.gz.
Page 291 Go to Configuration > Cluster on Controller A, and verify that Controller A is in the passive state. For information about the clustered states, see “Cluster Takeover and Failback” in Oracle ZFS Storage Appliance Administration Guide, Release 2013.1.5.0. On Controller A, go to Maintenance > System, and click the apply icon next to the version you want to install.
Page 292 Chassis: NAME STATE MANUFACTURER MODEL SERIAL RPM disk-000 HDD 0 ok SEAGATE ST330057SSUN300G 001117G1G929 6SJ1G929 15000 disk-001 HDD 1 ok SEAGATE ST330057SSUN300G 001117G1GA8Y 6SJ1GA8Y 15000 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 293 How to Update Controller B (BUI) disk-002 HDD 2 ok SEAGATE ST330057SSUN300G 001117G1KDPZ 6SJ1KDPZ 15000 Ensure there are no pool errors. controller-a:> configuration storage show Pools: POOL OWNER DATA PROFILE LOG PROFILE STATUS ERRORS -> pool25 brm7320-250 - - exported - pool26 brm7320-260 - - exported - Controller A is now updated.
Page 294 You can manually run the same health checks in advance of any planned update. This allows you to check the state of the system prior to scheduling an update maintenance window so you Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 295 How to Check System Health (BUI) can correct any problems that could interfere with the update process. Any problem report that is issued by a manual health check is identical to that issued by the health checks integrated in the update process. As with the integrated health checks, you are presented with a link to the Alert Log, as described in “Alert Log Entries”...
Page 296 Update Health Checks in Progress in the BUI FIGURE 80 After completion, the System Ready state changes to Yes or No with a link to the Alert Log. Completed Update Health Checks in the BUI FIGURE 81 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 297 How to Check System Health (CLI) How to Check System Health (CLI) Use the following procedure to check system health using the CLI. To select the update media, use the following CLI command: zfs-appliance:maintenance system updates> select ak-nas@2013.06.05.0.0,1-1.6 To upgrade the media and check system health, use the following CLI command: zfs-appliance:maintenance system updates:ak-nas@2013.06.05.0.0,1-1.6>...
Page 298 Disk shelf <name> has <just one path or zero paths>." Disk shelf path is not online. 1, 2, 4 "System software update cannot proceed: Disk shelf <name> path <pathname> is <state>." Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 299 Identify affected chassis, and remove faulted disk. After 30 seconds, re-seat disk and wait for steady or flashing LED. Contact Oracle Support for component service or replacement. Applying Deferred Updates Each update may come with new firmware or updates to external resources. In general, these updates are backwards-compatible and applied automatically without user intervention.
Page 300 “Support for Recursize Snapshots Deferred 2010.Q3.1.0 Update” on page 304 “Support for Multi Replace Deferred 2010.Q3.1.0 Update” on page 304 “Support for RAIDZ Mirror Deferred 2011.1.0.0 Update” on page 303 Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 301 How to Apply Deferred Updates (BUI) Feature Version introduced “Support for Optional Child Dir Deferred 2011.1.0.0 Update” on page 303 “Support for Multiple Initiator Groups per LUN Deferred 2011.1.8.0 Update” on page 303 “Support for Large Block Sizes Deferred 2013.1.1.0 Update”...
Page 302 Replicas of user-generated snapshots can also be backed up. After applying this update on a target appliance, source appliances running software versions earlier than 2011.1.0.x will not be able to send replication updates to the target. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 303 How to Apply Deferred Updates (CLI) Support for Sequential Resilvering Deferred Update The previous resilvering algorithm repairs blocks from oldest to newest, which can degrade into a lot of small random I/O. The new resilvering algorithm uses a two-step process to sort and resilver blocks in LBA order.
Page 304 Before this update has been applied, log records continue to be written in the old format and performance may be reduced. Applying this update is equivalent to upgrading the on-disk ZFS pool to version 23. Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 305 How to Apply Deferred Updates (CLI) Support for Received Properties Deferred Update The 2010.Q1 feature that enables administrators to customize properties on replicated shares relies on a ZFS pool upgrade. This upgrade provides support of persistent local changes to received properties. Before this upgrade has been applied, the system does not allow administrators to change properties on replicated shares.
Page 306 Previous versions of software allowed four options for this setting: "discard", "noallow", "restricted", and "passthrough". The 2009.Q2.0.0 release introduces a new option, "passthrough-x", with slightly different semantics as described in the product documentation: Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 307 Working with Firmware Upgrades Same as "passthrough", except that the owner, group, and everyone ACL entries inherit the execute permission only if the file creation mode also requests the execute bit. The "passthrough" mode is typically used to cause all "data" files to be created with an identical mode in a directory tree.
Page 308 Upgrading the firmware in a disk shelf requires that both back-end storage paths be active ■ to all disks within all enclosures, and for storage to be configured on all shelves to be Oracle ZFS Storage Appliance Customer Service Manual • February 2016...
Page 309 Rolling Back System Software upgraded. For clusters with at least one active pool on each controller, these restrictions mean that disk shelf firmware upgrade can be performed only by a controller that is in the "owner" state. During the firmware upgrade process, hardware may appear to be removed and inserted, or offlined and onlined.
Page 310 The confirmation step looks like this: SunOS Release 5.11 Version ak/generic@2011.04.24.4.2,1-1.28 64-bit Copyright (c) 1983, 2010, Oracle and/or its affiliates. All rights reserved. System rollback in progress. Rollback to: ak/nas@2011.04.24.4.2,1-1.28 Proceed with system rollback [y,n,?] Entering "y"...
Page 311 How to Roll Back the System Software (CLI) To roll back, locate a previous image and click on the rollback icon . You are asked to confirm that you wish to execute a rollback, and then the system reboots and executes the rollback. Unlike fail-safe rollback, you are not asked for further confirmation when the system reboots.
Page 312 How to Remove an Update Package (CLI) dory:maintenance system updates> destroy ak-nas@2009.10.14,1-0-nd This will destroy the update "ak-nas@2009.10.14,1-0-nd". Are you sure? (Y/N) y dory:maintenance system updates> Oracle ZFS Storage Appliance Customer Service Manual • February 2016...

This manual is also suitable for:

Zfs zs4-4 Zfs 7x20 De2-24

Oracle ZFS ZS3 Series Customer Service Manual

Quick Links

Need help?

Questions and answers

Related Manuals for Oracle ZFS ZS3 Series

Summary of Contents for Oracle ZFS ZS3 Series

This manual is also suitable for: