Oracle Sun ZFS Service Manual
  1. Manuals
  2. Brands
  3. Oracle Manuals
  4. Storage
  5. Sun ZFS
  6. Service manual

Oracle Sun ZFS Service Manual

Storage 7x20 appliance customer
Hide thumbs
Table of Contents

Advertisement

Quick Links

Sun ZFS Storage 7x20 Appliance Customer
Service Manual
Part No: E26399
December 2011 E26399–02

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Sun ZFS and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Oracle Sun ZFS

Summary of Contents for Oracle Sun ZFS

  • Page 1 Sun ZFS Storage 7x20 Appliance Customer Service Manual Part No: E26399 December 2011 E26399–02...
  • Page 2 If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.

  • Page 3: Table Of Contents

    Contents Preface ..............................7 Introduction ............................9 Overview ..............................9 Introduction ............................9 Hardware .............................. 12 Hardware View ..........................13 BUI ..............................13 CLI ..............................19 Tasks .............................. 21 Hardware Maintenance ........................23 Maintenance ............................23 Introduction ..........................23 7120 ............................... 24 7120 Hardware Overview ......................24 Chassis Overview .........................
  • Page 4 Expanding from 3 to 4 HBAs ....................100 System Maintenance .........................105 System ..............................105 Introduction ..........................105 System Disks ..........................105 Support Bundles ......................... 106 Initial Setup ..........................107 Factory Reset ..........................108 Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 5 Contents Updates ............................... 108 System Updates .......................... 108 Passthrough x ............................. 125 Passthrough-x Deferred Update ....................125 User Quotas ............................125 User Quotas Deferred Update ....................125 COMSTAR ............................126 COMSTAR Deferred Update ....................126 Triple Parity RAID ..........................126 Triple-Parity RAID Deferred Update ..................
  • Page 6 Contents Introduction ..........................136 BUI ............................... 138 CLI ............................... 138 Glossary .............................. 141 Index ..............................145 Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 7: Preface

    Help button. The appliance documentation may be updated using the System Upgrade procedure documented in the System Maintenance chapter of this book. Who Should Use This Book These notes are for users and system administrators who service and use the Sun ZFS Storage 7x20 Appliances. Related Documentation Refer to the following documentation for installation instructions, hardware overviews, service procedures and software update notes.

  • Page 9: Introduction

    Overview Introduction The Sun ZFS Storage 7000 family of products provide efficient file and block data services to clients over a network, and a rich set of data services that can be applied to the data stored on the system.

  • Page 10: Key Features

    Data Services To manage the data that you export using these protocols, you can configure your Sun ZFS Storage system using the built-in collection of advanced data services, including: LICENSE NOTICE: Remote Replication and Cloning may be evaluated free of charge, but each feature requires that an independent license be purchased separately for use in production.
  • Page 11 NDMP backup and restore ■ Availability To maximize the availability of your data in production, Sun ZFS Storage appliances include a complete end-to-end architecture for data integrity, including redundancies at every level of the stack. Key features include: Predictive self-healing and diagnosis of all system hardware failures: CPUs, DRAM, I/O ■...

  • Page 12: Hardware

    Available topics are displayed by tab-completing the help command, or by typing help topics. You can combine these two principles, as follows: dory:> help tab builtins commands general help properties script Hardware Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 13: Hardware View

    Hardware Locating a disk Hardware View The Maintenance > Hardware screen (also known as the "hardware view") provides component status of the appliance and attached disk shelves. This information is available from both the BUI and the CLI. The BUI hardware view provides interactive illustrations that enable you to browse through the appliance and attached disk shelf components.

  • Page 14: System Overview

    Details" link takes you to a detailed view of the chassis, and is identical to clicking on the right pointing arrow at the top left of the view. The following information is presented in a summary view: Property Description Manufacturer Manufacturer of the system Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 15 Hardware Property Description Model System model name Serial System chassis hardware serial number Processors Count and description of processors in the system Memory Total memory in the system System Size and number of system disks used for the system image Data Size and number of data disks in the system chassis.
  • Page 16 Disk ■ Slot ■ CPU (controller only) ■ Memory (controller only) ■ ■ Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 17 Hardware Power supply (PSU) ■ Service processor (SP) (controller only) ■ Clicking on a component type will display a list of all physical locations within the chassis where components may be present. Clicking on a component within the list will highlight it within the appropriate chassis image.

  • Page 18: Service Processor

    The following properties control the behavior of the service processor network management port. Property Description MAC Address Hardware MAC address. This is read-only Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 19: Cli

    Hardware Property Description IP Address Either 'DHCP' or 'Static'. Controls whether DHCP should be used on the interface. Source IP Address IPv4 Address, when using static IP configuration. IPv6 is not supported. Subnet Dotted decimal subnet, when using static IP configuration. Default Gateway IPv4 default gateway address.
  • Page 20 Viewing CPU details For example, the following shows details for component "CPU 0": tarpon:maintenance hardware> select chassis-000 tarpon:maintenance chassis-000> select cpu tarpon:maintenance chassis-000 cpu> select cpu-000 tarpon:maintenance chassis-000 cpu-000> show Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 21: Tasks

    Hardware Properties: label = CPU 0 present = true faulted = false manufacturer = AMD model = Quad-Core AMD Opteron(tm) Processor 8356 part = 1002 revision = 03 cores = 4 speed = 2.14G Tasks ▼ Locating a failed component Go to the Maintenance >...
  • Page 22 Select the faulted disk and turn on the locate LED: hostname:maintenance chassis-001 disk> select disk-001 hostname:maintenance chassis-001 disk-001> set locate=true locate = true (uncommitted) hostname:maintenance chassis-001 disk-001> commit Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 23: Hardware Maintenance

    C H A P T E R Hardware Maintenance Maintenance Introduction This section describes concepts and procedural instructions for performing hardware and software maintenance tasks. The graphic above illustrates locating a spare disk within the chassis by highlighting its name in the BUI Hardware Maintenance list. The Maintenance >...

  • Page 24: 7120 Hardware Overview

    7120 system. Refer to the following for procedural instructions: Controller Tasks - replace system controller components ■ Disk Shelf Tasks - replace disk shelf components ■ Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 25: Chassis Overview

    7120 Chassis Overview The Sun ZFS Storage 7120 is an enterprise-class two-socket rackmount x64 system powered by the Intel Xeon processor. It packs high performance and room for growth with four PCIe slots and 18 DIMM slots into a compact 2U footprint. Refer to the http://www.oracle.com/us/...

  • Page 26: Rear Panel

    9 Rear Panel System Status LEDs 14 HD15 Video port 5 PCIe 1 10 Serial Management port The serial management connector (SER MGT) is an RJ-45 port and provides a terminal connection to the SP console. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 27: Electrical Specifications

    ■ Internal Components The chassis has the following boards installed. Field-replaceable units (FRU) should only be replaced by trained Oracle service technicians. PCIe Risers - Each riser supports two PCIe cards that are customer-replaceable. There are ■ two risers per system, each attached to the rear of the motherboard.
  • Page 28 I/O board, Power and Locator buttons, and system/component status LEDs. The system has a 12-disk backplane. Each drive has an LED indicator for Power/Activity, Fault, and Locate. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 29 7120 I/O Components The I/O components of the 7120 system are shown in the following figure and described in the table. Figure Legend 1 Top Cover 3 Hard Disk Drives 2 Right Control Panel Light Pipe Assembly 4 Left Control Panel Light Pipe Assembly Chapter 2 •...
  • Page 30 Cable Connection 1 Storage Drive Data Cable Connection between the HBA PCI-Express Card and the storage drive backplane. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 31: Cpu And Memory

    7120 Cable Connection 2 Ribbon cable Connection is between the power distribution board and the motherboard. CPU and Memory The 7120 motherboard has 18 slots in two groups that hold industry-standard DDR3 DIMMs. The 7120 CPU and memory should only be replaced by field service professionals. All sockets must be occupied by either a filler or a DDR3 DIMM.

  • Page 32: Standalone Controller Configurations

    Description Mfg Part Number TA7120-12TB S7120, 1xCPU, 24GB, 12TB 597-0754-01 TA7120-24TB S7120, 1xCPU, 24GB, 24TB 597-0755-01 This table describes base configurations for the 7120 with Logzilla 3.5" SSD. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 33 7120 Mktg Part Number Description Mfg Part Number 7101282 S7120, 1xCPU, 24GB, 3.3TB 7014523 7101284 S7120, 1xCPU, 24GB, 6.6TB 7014525 NIC/HBA Options This table describes NIC/HBA options for the 7120. Mktg Part Number Description Mfg Part Number SG-XPCIESAS-GEN2-Z 2-port External Sun Thebe SAS (x4) HBA, PCIe 594-5889-01 SG-XPCIE2FC-QF8-Z 2-port FC HBA, 8Gb, PCIe 594-5684-01...

  • Page 34: Attached Storage

    ■ Chassis Overview The Sun ZFS Storage 7320 System consists of either a single storage controller, or two storage controllers in a high availability cluster configuration, and one to four Sun Disk Shelves. The 7320 controller base configuration includes two CPUs, built-in 4 x 1Gb/s front-end GigE ports, redundant power supplies, NIC options for expanded front-end support, tape backup, Infiniband, and dual port SAS HBA for storage expansion.
  • Page 35 Boards The storage controller chassis has the following boards installed. Field-replaceable units (FRUs) should only be replaced by trained Oracle service technicians. PCIe Risers - The storage controller contains three PCIe risers that are ■...
  • Page 36 F530-3883-01 FRU,2M,4X Mini SAS Cable CRU (external) 7320 I/O Components The I/O components of the storage controller are shown in the following figure and identified in the table. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 37 7320 Figure Legend 1 Top cover 2 Left Control Panel Light Pipe Assembly 3 Drive Cage 4 Solid State Drives 5 blank/USB Module 6 Right Control Panel Light Pipe Assembly 7320 CPU and Memory Components Following are the replaceable CPU and memory components of the 7320 system. Part Number Description FRU/CRU...
  • Page 38 Nominal voltage range: 100-120/200-240 VAC ■ Maximum current AC RMS: 9.0 amps Max ■ AC operating range: 90-264 VAC ■ Output 3.3 VDC STBY: 3.6A ■ +12 VDC: 62.3A ■ Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 39: Front Panel

    7320 Power dissipation Max power consumption: 873 W ■ Max heat output: 2977 BTU/hr ■ Volt-Ampere rating: 891 VA @ 240 VAC, 0.98P.F. ■ 7320 Front Panel The following graphic illustrates the front panel LEDs. The table describes the LEDs. Figure Legend 1 Locate Button/LED 2 Service Required LED (amber)

  • Page 40: 7320 Replaceable Components

    Dual Port (x4) IB HCA (PCIe) F375-3696-01 Dual Port CX2 4XQDR (PCIe) F375-3617-01 2X10GbE SFP+, X8 (PCIe) F375-3481-01 NIC Card Quad Port 1GigE Cu (PCIe) F511-1496-04 Sun Fishworks Cluster Controller 200 (PCIe) FRU Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 41: 7320 Single And Cluster Controller Configurations

    7320 7320 Rear Panel Following is an illustration of the 7320 storage controller rear panel. The Sun 375-3609 belongs in slot 2, cannot be installed in any other slots, and a second is not offered as an option. Figure Legend 1 Power supplies 4 Network management port 2 SC summary status LEDs 5 Ethernet ports...

  • Page 42: Cluster Configurations

    PCIe 375-3609-03 Sun Thebe External SAS HBA Cluster Base Configuration 7320 Connector Pinouts The serial management connector (SERIAL MGT) is an RJ-45 connector and a terminal connection to the SP console. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 43: 7420 Hardware Overview

    7420 The network management connector (NET MGT) is an RJ-45 connector on the motherboard and provides an alternate terminal interface to the SP console. There are four RJ-45 Gigabit Ethernet connectors (NET0, NET1, NET2, NET3) located on the motherboard that operate at 10/100/1000 Mbit/sec. These network interfaces must be configured before use.

  • Page 44: Chassis Overview

    7420 Chassis Overview The Sun ZFS Storage 7420 Appliance consists of either a single storage controller, or two storage controllers in a high availability cluster configuration, and one to 24 Sun Disk shelves. Refer to the http://www.oracle.com/us/products/servers-storage/storage/unified-storage/ index.html (http://www.oracle.com/ for the most us/products/servers-storage/storage/unified-storage/index.html)
  • Page 45 7420 The 500GB boot drives (HDDs) reside in slots 0 and 1 as a mirrored set, and Sun Storage Readzilla 512GB solid state drives (SSDs), may optionally fill, in order, slots 2 through 5. Each storage controller may have 0, 2, 3, or 4 Readzilla devices. Figure Legend 1 Locate (white) 2 Service action required (amber) 3 OK/Activity (green) Rear Panel...

  • Page 46: Internal Boards

    LEDs. Each drive has an LED indicator for Power/Activity, Fault, and Locate. Components The components of the storage controller are shown in the following figure and identified in the table. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 47 7420 Figure Legend 1 Motherboard 8 System lithium battery 2 Low-profile PCIe cards 9 CPUs and heatsinks 3 Power supplies 10 Memory Risers 4 Power supply backplane 11 Fan board 5 Filler 12 Fan Modules 7 Drive backplane 14 Boot drives and SSDs CPU and Memory The 7420 appliance supports two or four CPUs, with two memory risers required by each CPU.
  • Page 48 D0, D2, D4, and D6 must be populated; optionally, slots D1, D3, D5, and D7 may be populated as a group on all installed memory risers. All DIMMs in the system must be identical. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 49: Fan Modules

    7420 DIMM names in appliance logs and the Maintenance > Hardware view are displayed with the full name, such as /SYS/MB/P0/D7. Fan Modules The Fan Modules and Fan Module LEDs of the storage controller are shown in the following figure. The following LEDs are lit when a fan module fault is detected: Front and rear Service Action Required LEDs ■...

  • Page 50: 7420 Standalone And Cluster Controller Configurations

    Description Mfg Part Number TA7420-26A S7420, no DIMMs, 2x1.86GHz-6C 597-0789-01 TA7420-28A S7420, no DIMMs, 2x2.00GHz-8C 597-0790-01 7100566 S7420, no DIMMs, 4x2GHz-8C 7014572 7100568 S7420, no DIMMs, 4x2.40GHz-10C 7014573 Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 51 7420 Cluster Base Options This table describes 7420 cluster base configurations. Mktg Part Number Description Mfg Part Number TA7420-26AR00HA S7420, no DIMMs, 2x1.86GHz-6C, Cluster 597-0795-01 TC7420-28AR00HA S7420, no DIMMs, 2x2.00GHz-8C, Cluster 597-0792-01 7100566 S7420, no DIMMs, 4x2GHz-8C, Cluster 7014572 7100568 S7420, no DIMMs, 4x2.40GHz-10C, Cluster 7014573 NIC/HBA Options This table describes NIC/HBA options for 7420 single and cluster configurations.

  • Page 52: Attached Storage

    PCIe 371-4325-01 8Gb DP FC HBA Optional FC Target or Initiator (Backup) Attached Storage The 7420 does not contain primary storage within its chassis, and therefore connects to external storage shelves and cages. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 53: 7X20

    See Disk Shelf Overview for component specifications and diagrams. 7x20 7x20 CRU Maintenance Procedures This section provides instructions on how to replace customer replaceable components (CRUs) in Oracle's Sun ZFS Storage 7120, 7320, and 7420 controllers. Refer to Disk Shelf Details for replacing expansion storage shelf components.

  • Page 54: Required Tools And Information

    1. Identify the failed HDD or SSD by going to the Maintenance > Hardware section of the BUI and clicking the drive details icon . If you are physically at the system, the amber Service Required indicator on the HDD or SSD should be illuminated. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 55: Fan Module

    6. Slide the replacement drive into the slot until it is fully seated. 7. Close the latch to lock the drive in place. The Sun ZFS Storage system software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller, drive shelf or cage.
  • Page 56 4. While squeezing the slide release latches, slowly pull the storage controller forward until the slide rails latch. 5. 7120 or 7320: To replace the fan module: Open the fan module door while unlatching the release tabs on the door. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 57 7x20 Identify the faulted fan module by locating the corresponding Service Required status indicator or by clicking the locate icon on Maintenance > Hardware screen of the BUI for the fan you want to replace. Using thumb and forefinger, pull the fan module up and out. Install the replacement fan module into the storage controller fan slot.

  • Page 58: Power Supply

    A faulted power supply is indicated by an amber colored status LED. 1. Gain access to the rear of the storage controller where the faulted power supply is located. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 59 7x20 2. If a cable management arm (CMA) is installed, press and hold the CMA release tab and rotate the arm out of the way. 3. Disconnect the power cord from the faulted power supply. 4. Remove the power supply. 7120 or 7320: Release the latch, then remove the power supply.
  • Page 60 Power/OK status indicator on the front panel flashes, indicating that the storage controller is in standby power mode. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 61 7x20 1. Disconnect the AC power cords from the rear panel of the storage controller. 2. Verify that no cables will be damaged or will interfere when the storage controller is extended from the rack. 3. From the front of the storage controller, release the two slide release latches. 4.
  • Page 62 7. To locate the DIMM you want to service, press the Fault Remind Button on the storage controller. The following illustration shows the Fault remind button on the 7120. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 63 7x20 The following illustration shows the Fault remind button on the 7420. 8. 7420: Identify the memory riser that hosts the faulted DIMM by the Service Required status indicator. Lift the memory riser straight up to remove it from the motherboard, and place it on an antistatic mat.
  • Page 64 Close the fan cover and engage the fan cover latches. The cover must be completely closed for the storage controller to power on. 13. 7420: To replace the cover: Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 65 7x20 Push the memory riser module into the associated CPU memory riser slot until the riser module locks in place. Place the top cover on the chassis so that it is forward of the rear of the storage controller by about an inch (2.5 cm).
  • Page 66 The Power/OK status indicator next to the Power button lights and remains lit. The Maintenance > Hardware screen of the BUI provides status of the replacement on the Details page for DIMMs. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 67 To avoid damage, wear an antistatic wrist strap and use an antistatic mat when handling components. Note that the 7120 Sun Flash Accelerator F20 card is a FRU and must be replaced by an Oracle service representative.
  • Page 68 Loosen the captive retaining screw holding the front end of the riser and the Phillips screw on the end of the riser. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 69 7x20 Lift the riser up to remove it from the storage controller. Carefully remove the PCIe card from the riser board connector and clean the slot with filtered, compressed air if necessary. Seat the replacement PCIe card in the slot of the riser and connect the cables. Align the riser, together with any attached PCIe cards, with the intended location on the motherboard, and carefully insert it into its slot.
  • Page 70 Install the replacement PCIe card into the PCIe card slot. Install the retaining screw to hold the PCIe card to the chassis. Return the crossbar to its closed and locked position. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 71 7x20 10. 7120 or 7320: Components may differ slightly between the 7120 and 7320, however service procedures for each are identical. The illustration shows the 7320. To install the top cover: Place the top cover on the chassis so that it hangs over the rear of the storage controller by about an inch (2.5 cm), then slide the top cover forward until it seats.
  • Page 72 5. 7120 or 7320: To remove the top cover: Unlatch the fan module door, pull the two release tabs back, rotate the fan door to the open position and hold it there. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 73 7x20 Press the top cover release button and slide the top cover to the rear about a half-inch (1.3 cm). Lift up and remove the top cover. 6. 7420: To remove the top cover: Simultaneously lift both cover latches in an upward motion. 7.
  • Page 74 Place the top cover on the chassis (1) so that it is forward of the rear of the storage controller by about an inch (2.5 cm). Slide the top cover toward the rear of the chassis (2) until it seats. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 75 7x20 Press down on the cover with both hands until both latches engage. 12. Push the release tabs on the side of each rail and slowly push the storage controller into the rack, making sure no cables obstruct the path of the controller. 13.
  • Page 76 6. Slide the replacement drive into the slot until it is fully seated. 7. Close the latch to lock the drive in place. The Sun ZFS Storage system software automatically detects and configures the new drive. The device appears in the BUI Maintenance > Hardware screen when you view details for the controller, drive shelf or cage.
  • Page 77 7x20 3. Unpack the new fan tray, and ensure that the metal locking handle is in the out position. 4. Align the fan tray with the slot, and push the fan tray into the slot, ensuring that the fan tray is fully seated.
  • Page 78 Fault (amber), which indicates a system-level fault ■ OK (green), which indicates that the storage system is operating normally ■ The front-panel indicator board also contains LEDs for components located on the rear panel. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 79 7x20 Front Panel LED Indicators 1 System-level locator 4 Rear panel fan tray fault 2 System-level fault 5 Rear panel drive set fault 3 System-level OK 6 Rear panel RCC fault In addition to system-level indicators, the rear panel indicator board also includes LEDs for components on the front panel.

  • Page 80: Sas2

    6. Push the board into the slot, and ensure that the board is fully seated in the slot. 7. Verify that the procedure was successful by logging in to the Sun ZFS Storage appliance software, checking the system status, and clicking the associated locator icon in the Cabinets section of the Maintenance >...
  • Page 81 SAS2 The main components are hot-swappable, including the SAS Interface Module (SIM) boards and drives, and the dual load-sharing power supplies and fans. This provides a fault-tolerant environment with no single point of failure. System faults are indicated by an amber colored light on the front panel.
  • Page 82 Drive Locations The following table shows the shelf drive locations. Drive Locations SSD20 SSD21 SSD22 SSD23 HDD16 HDD17 HDD18 HDD19 HDD12 HDD13 HDD14 HDD15 HDD8 HDD9 HDD10 HDD11 Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 83 SAS2 Drive Locations HDD4 HDD5 HDD6 HDD7 HDD0 HDD1 HDD2 HDD3 The following figure shows the Sun Disk Shelf front panel. Figure Legend 1 Locate button and indicator 4 Disk ready to be removed inidicator 7 Over temperature warning indicator 2 System fault indicator 5 Disk fault indicator 8 SIM board fault indicator...
  • Page 84 2 Host or SIM Link In 4 SIM link out 6 For Sun service only The following figure shows the SIM board and Power Supply exterior indicator LEDs. SIM 0 is on the left, and SIM 1 is on the right. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 85: Sun Disk Shelf

    SAS2 Figure Legend 1 AC power indicator 6 Power switch 2 DC power indicator 7 Port fault indicator 3 Fan fault indicator 8 Port OK indicator 4 Power supply fault indicator 9 SIM board OK indicator 5 Universal power connector 10 SIM locator indicator Disk Shelf Configurations The following tables describe and provide part numbers for the supported expansion storage...

  • Page 86: Shelf

    Safety Information Follow all Sun cautions, warnings, and instructions marked on the equipment and described in Important Safety Information for Sun Hardware Systems located at http://download.oracle.com/ docs/cd/E19446-01/en/821-1590-10/821-1590-10.pdf. (http://download.oracle.com/docs/ cd/E19446-01/en/821-1590-10/821-1590-10.pdf.) Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 87: Electrostatic Discharge Precautions

    Shelf Electrostatic Discharge Precautions Remove all plastic, vinyl, and foam material from the work area. ■ Wear an antistatic wrist strap at all times when handling any CRU. ■ Before handling any CRU, discharge any static electricity by touching a grounded surface. ■...
  • Page 88 Ensure the new drive ejection lever is in the fully extended position. Align the new drive with the open slot and slide the drive into the disk chassis. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 89: Replacing A Power Supply

    Shelf Push the drive into the chassis slot until the ejection lever engages the chassis connectors and begins to swing closed. Press the ejection lever closed until it locks in place to seat the drive and lock it into the chassis. The Activity LED with be steady green to indicate a ready state.
  • Page 90 With the ejection arms fully open, slide the new power supply into the chassis slot until it contacts the chassis backplane and the ejection arms begin to swing closed. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 91 Shelf Push the ejection arms closed fully and secure both captive screws to seat and secure the power supply in the chassis. Ensure the power supply on/off switch is in the "O" off position. Plug the power cord into the new power supply and attach the power cord tie strap to the power cord.
  • Page 92 Pull each ejector tab outward and push to the sides to release and partially eject the SIM from the chassis. Grasp the middle of the SIM board and slide it out of the slot. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 93: Faults

    Faults With the ejector arms in the full open position, align the new SIM board with the open slot and slide it into the tray until the ejector arms contact the tray connectors and begin to swing closed. Swing both ejector arms in until they are flush with the SIM board panel to seat the board. Tighten both captive screws to secure the board.
  • Page 94 Log in to the server as root using the ILOM CLI. To view server faults, type the following command to list all known faults on the system: -> show /SP/faultmgmt The server lists all known faults, for example: SP/faultmgmt Targets: 0 (/SYS/MB/P0) Properties: Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 95: Hba Expansion Pt.1

    HBA Expansion pt.1 Commands: show To clear the CPU fault, type the following command: -> set /SYS/MB/Pn clear_fault_action=true For example, to clear a fault on CP0: -> set /SYS/MB/P0 clear_fault_action=true Are you sure you want to clear /SYS/MB/P0 (y/n)? y See Also Cluster Configuration HBA Expansion pt.1...
  • Page 96 HBA Expansion pt.1 fig.2 Power down and remove all cabling from the first controller. Add and cable together the new chain of disk shelves, then power on shelves. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 97 HBA Expansion pt.1 fig.3 Install new HBA according to the instructions on installing PCI cards, and connect the controller to the second and third chain as shown. fig.4 Reconnect the two original HBAs as before to the first two chains. Power on the controller and wait for it to regain control of connected storage.
  • Page 98 Power down and remove all cabling from the second controller. fig.6 Install new HBA according to the instructions on installing PCI cards, and connect the controller to the second and third chain as shown. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 99 HBA Expansion pt.1 fig.7 Reconnect the two original HBAs as before to the first two chains. Power on the controller and wait for it to regain control of connected storage. fig.8 Cluster with three HBAs Chapter 2 • Hardware Maintenance...

  • Page 100: Hba Expansion Pt.2

    The figures below show steps to migrate a cluster from three to four HBAs. NOTE: Diagrams below are not representative of proper slot location for HBAs. Cabling Diagrams fig.1 Cluster with three HBAs and chains of disk shelves Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 101 HBA Expansion pt.2 fig.2 Power down and remove all cabling from the first controller. Add and cable together the new chain of disk shelves, then power on shelves. fig.3 Install new HBA according to the instructions on installing PCI cards, and connect the controller to the third and fourth chain as shown.
  • Page 102 Reconnect the three original HBAs as before to the first three chains. Power on the controller and wait for it to regain control of connected storage. fig.5 Power down and remove all cabling from the second controller. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 103 HBA Expansion pt.2 fig.6 Install new HBA according to the instructions on installing PCI cards, and connect the controller to the third and fourth chain as shown. fig.7 Reconnect the three original HBAs as before to the first three chains. Power on the controller and wait for it to regain control of connected storage.
  • Page 104 HBA Expansion pt.2 fig.8 Cluster with four HBAs Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 105: System Maintenance

    C H A P T E R System Maintenance System Introduction The Maintenance > System screen provides several system-level features. The screen allows the administrator to: View the status of the system disks ■ Manage software updates and update the system software ■...

  • Page 106: Support Bundles

    Phone Home service is enabled. Administrators can manually generate and upload a support bundle from this section of the Maintenance > System screen. Once generated, support bundles are automatically uploaded to Oracle's Support files Service at http://support.oracle.com. (http://support.oracle.com.) To facilitate this, the appliance must be connected to the Internet, either directly or through the web proxy configured on the Phone Home service screen.

  • Page 107: Initial Setup

    A support bundle is being created and sent to Oracle. You will receive an alert when the bundle has finished uploading. Please save the following filename, as Oracle support personnel will need it in order to access the bundle: /cores/ak.9a4c3d7b-50c5-6eb9-c2a6-ec9808ae1cd8.tar.gz...

  • Page 108: Factory Reset

    Procedure The procedure for updating the system is as follows: First, the software update media is downloaded from an Oracle support website or retrieved ■ from another official source. The media is represented by a single compressed file named after the version number, such as: ak-nas-2010-02-09-1-0.pkg.gz.
  • Page 109 Updates Second, the software media is uploaded to the appliance. This can be done via either the BUI ■ or the CLI; see below for details of this operation. After the media is uploaded, it will be unpacked and verified. If all verification checks pass, it ■...
  • Page 110 See Incompatible target Replication Failure for a description. Feature Version introduced "passthrough-x" aclinherit property 2009.Q2.0.0 User quotas 2009.Q3.0.0 COMSTAR 2009.Q3.0.0 Triple-Parity RAID 2009.Q3.0.0 Dedup 2010.Q1.0.0 Replication 2010.Q1.0.0 Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 111 Updates Feature Version introduced Received Properties 2010.Q1.0.0 Slim ZIL 2010.Q3.1.0 Snapshot Deletion 2010.Q3.1.0 Recursive Snapshots 2010.Q3.1.0 Multi Replace 2010.Q3.1.0 RAIDZ Mirror 2011.1.0.0 Optional Child Directory 2011.1.0.0 Hardware Firmware Updates Following the application of a software upgrade, any hardware for which the upgrade includes newer versions of firmware will be upgraded.
  • Page 112 For clusters with at least one active pool on each controller, these restrictions mean that disk shelf firmware upgrade can be performed only a controller that is in the "owner" state. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 113 Updates During the firmware upgrade process, hardware may appear to be removed and inserted, or offlined and onlined. While alerts attributed to these actions are suppressed, if you are viewing Maintenance/Hardware screen or the Configuration/Storage screen, you may see the effects of these upgrades in the UI in the form of missing or offline devices.
  • Page 114 GNU GRUB version 0.95 (613K lower / 3537536K upper memory) +-------------------------------------------------------------------------+ Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 115 Updates | Sun Storage 7110 2010.02.09,1-0 | Sun Storage 7110 2009.09.01,1-18 +-------------------------------------------------------------------------+ Use the ^ and v keys to select which entry is highlighted. Press enter to boot the selected OS, ’e’ to edit the commands before booting, or ’c’ for a command-line. After the rollback boot menu entry is selected, the system will boot the old kernel software, but the rollback must be manually confirmed on the console in order to commit the rollback, which will effectively remove all changes to the system that have happened since, as described above.
  • Page 116 Step Controller A State Controller A Version Controller B State Controller B Version 1,2 CLUSTERED V CLUSTERED V STRIPPED OWNER STRIPPED OWNER 5,6 OWNER STRIPPED OWNER STRIPPED CLUSTERED V+1 CLUSTERED V+1 Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 117 Updates It is not advisable to make configuration changes to either storage controller while an upgrade is in progress. Most notably, while controllers are running different software versions, configuration changes made to one controller will not be propagated to its peer controller.
  • Page 118 Updates The system will remain in the Unchecked state until the Check button is clicked. During the health check operation, an indicator will show its progress. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 119 Updates Once complete, the System Ready state will change to Yes or No with a link to the Alert Log. Chapter 3 • System Maintenance...
  • Page 120 Available Updates and specify the pathname on your desktop or local client of the update media. During the upload, a progress bar is displayed indicating the progress of the upload: Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 121 Updates Note that on some older browsers, the progress bar may not be updated continuously during the upload; if you see a "watch" cursor just wait a minute -- in the worst case the upload will proceed all the way to completion and you may not see the progress bar. Unpacking and verifying media This step will happen automatically after the media is done uploading: Beginning an upgrade...
  • Page 122 (uncommitted)> set user=bmc user = bmc dory:maintenance system updates download (uncommitted)> set password Enter password: password = ******** dory:maintenance system updates download (uncommitted)> commit Transferred 157M of 484M (32.3%) ... Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 123 Updates Unpacking and verifying media After the file has been transferred, it will be automatically unpacked and verified: dory:maintenance system updates download (uncommitted)> commit Transferred 484M of 484M (100%) ... done Unpacking ... done dory:maintenance system updates> list UPDATE DATE STATUS ak-nas@2009.10.14,1-0-nd 2009-10-14 08:45...
  • Page 124 Applying deferred updates in a cluster will also update any resources on the cluster peer. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 125: Passthrough X

    User Quotas 1. Support for the "passthrough-x" aclinherit property for shares. clownfish:maintenance system updates> apply Applying deferred updates will prevent rolling back to previous versions of software. Are you sure? (Y/N) clownfish:maintenance system updates> apply Passthrough x Passthrough-x Deferred Update For filesystems, ACLs are inherited according to the "aclinherit"...

  • Page 126: Comstar

    There is no other implication of applying this update, and it can be ignored if there is no need to use this new setting. Applying this update is equivalent to upgrading the on-disk ZFS pool to version 17. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 127: Dedup

    Received Properties Dedup Data Deduplication Deferred Update This update provides the ability to use data deduplication. In order to use this new mode, the storage pool must be upgraded. If you choose not to upgrade the pool and attempt to use this new property, you will get an error indicating that the storage pool needs to be upgraded first.

  • Page 128: Slim Zil

    Applying this update is equivalent to upgrading the on-disk ZFS pool to version 27. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 129: Multi Replace

    Optional Child Dir Multi Replace Multi Replace Deferred Update This deferred update allows importing a pool with a missing log device and corrects the behavior of the system when a device that is being resilvered is itself removed or replaced. These fixes rely on a ZFS pool upgrade provided by this update.

  • Page 130: Configurationbackup

    Analytics and logs. Events can be redirected to external SNMP trap receivers or e-mail ■ destinations using Alerts rules. System software. The system software is automatically backed up as part of the System ■ Update capability. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 131 ConfigurationBackup Restore Impact The restore operation takes a selected configuration backup, and modifies all of the corresponding system settings to reflect those in the backup, including removing aspects of the configuration that were not present at the time of the backup. Administrators should adhere to the following guidelines when planning a restore: Scheduled downtime - The restore process takes several minutes to complete and will ■...

  • Page 132: Security Considerations

    To create a backup, simply click the "Backup" button above the list of saved configurations and follow the instructions. You will be prompted to enter a descriptive comment for the backup. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 133 ConfigurationBackup Restore from a Saved Configuration Click the rollback icon on any saved configuration to begin the process of reverting the system to that saved configuration. Review the Restore Impact guidance above, and confirm that it is ok to proceed. Delete a Saved Configuration To delete a Saved Configuration simply click the trash can icon to delete the configuration...
  • Page 134 HTTP or FTP protocol enabled for reading. You can enter a username and password for authentication to the remote server if one is required. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 135: Problems

    (defects, often included under faults) and reports them as active problems on this screen. If the phone home service is enabled, active problems are automatically reported to Oracle Support, where a support case may be opened depending on the service contract and the nature of the fault.

  • Page 136: Repairing Problems

    If a problem persists after the affected components have been repaired, contact support. You may be instructed to mark the problem repaired. This should only be done under the direction of service personnel or as part of a documented Oracle repair procedure. Related features...
  • Page 137 Logs Time Event ID Description Type 2009-9-16 446654fc-b898-6da5-e87e-8d23ff12d5d0 A disk has been inserted into Minor alert 13:01:51 slot 'HDD 15' of chassis 'JBOD #1'. An info icon next to the Event ID means that extended information is available. Click the icon and this information will be displayed below the list of alerts.

  • Page 138: Bui

    Browser session timed out 2009-10-11 21:13:35 root <console> Enabled ftp service Phone Home If Phone Home is used, this log will show communication events with Oracle support. The following are example phone home entry as it would appear in the BUI: Time...
  • Page 139 Logs Listing logs Use the show command to list available logs, and the timestamp of the last log entry: caji:> maintenance logs caji:maintenance logs> show Logs: ENTRIES LAST alert 2009-10-16 02:44:04 audit 2009-10-16 18:19:53 fltlog 2009-10-16 02:44:04 scrk system 2009-10-16 03:51:01 Up to 100 recent entries for each log are visible using the CLI.
  • Page 140 Logs address = <console> summary = Enabled datalink:nge0 service annotation = The "annotation" is the session annotation, which can be enabled when configuring users. Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...

  • Page 141: Glossary

    Glossary 7110 Sun Storage 7110 Unified Storage System Sun ZFS Storage 7120 7120 7210 Sun Storage 7210 Unified Storage System 7310 Sun Storage 7310 Unified Storage System 7320 Sun ZFS Storage 7320 7410 Sun Storage 7410 Unified Storage System 7420...
  • Page 142 Network Information Service Peripheral Component Interconnect Express PCIe provide storage space that is shared across all filesystems and LUNs Pool Project a collection of shares Power Supply Unit Sun ZFS Storage 7x20 Appliance Customer Service Manual • December 2011 E26399–02...
  • Page 143 quad data rate Readzilla read-optimized flash SSD for the L2ARC Remote replicating shares to another appliance Replication Rollback reverts all of the system software and all of the metadata settings of the system back to their state just prior to applying an update Serial Attached SCSI Serial Attached SCSI 2.0 SAS-2...

  • Page 145: Index

    Index Numbers and Symbols SSD, 75 7120, 24, 25, 27, 29, 31, 32, 33, 34, 53, 67 7320, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 53 Updates, 111, 112 DIMM, 47, 48, 49 Disk Shelf, 80, 81, 83, 84 FRU, 35 Hardware, Locating a failed component, 21 Logzilla, 25, 32...

This manual is also suitable for:

Sun zfs 7120Sun zfs 7320Sun zfs 7420

Table of Contents