Related Manuals for Oracle Solaris Cluster 3.3
Summary of Contents for Oracle Solaris Cluster 3.3
- Page 1 Oracle® Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual For Solaris OS (SPARC Platform Edition) Part No: E22718 May 2011, Revision A...
- Page 2 If you use this software or hardware in dangerous applications, then you shall be responsible to take all appropriate fail-safe, backup, redundancy, and other measures to ensure its safe use. Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.
-
Page 3: Table Of Contents
▼ How to Correct Mismatched Device ID Numbers ..............29 Maintaining Storage Arrays ....................... 31 FRUs That Do Not Require Oracle Solaris Cluster Maintenance Procedures ...... 32 ▼ How to Remove a Storage Array ....................34 ▼ How to Replace a Failed Controller or Restore an Offline Controller ........37 ▼... - Page 4 Installing a Sun StorEdge A3500 Storage System ..............51 Adding a Sun StorEdge A3500 Storage System ................ 51 Index ..............................53 Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 5: Preface
This document is intended for experienced system administrators with extensive knowledge of Oracle software and hardware. Do not use this document as a planning or a pre-sales guide. You should have already determined your system requirements and purchased the appropriate equipment and software before reading this document. -
Page 6: Revision History
Sun StorEdge A1000/Sun StorEdgeA3x00/Sun StorEdge A3500FC/Sun StorEdge Software/Firmware Configuration Matrix 1.61 Log into My Oracle Support to view this Technical Instruction. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... - Page 7 Using UNIX Commands This document contains information about commands that are used to install, configure, or upgrade an Oracle Solaris Cluster configuration. This document might not contain complete information about basic UNIX commands and procedures such as shutting down the system, booting the system, and configuring devices.
-
Page 8: Getting Help
Documentation and Support See the following web sites for additional resources: Documentation (http://www.oracle.com/technetwork/indexes/documentation/ ■ index.html) Support (http://www.oracle.com/us/support/systems/index.html) ■ Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... -
Page 9: Typographic Conventions
The following table shows the default UNIX system prompt and superuser prompt for shells that are included in the Oracle Solaris OS. Note that the default system prompt that is displayed in command examples varies, depending on the Oracle Solaris release. - Page 10 Bash shell, Korn shell, and Bourne shell Bash shell, Korn shell, and Bourne shell for superuser C shell machine_name% C shell for superuser machine_name# Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 11: Installing And Maintaining A Scsi Raid Storage Device
Device This chapter describes the procedures about how to install, configure, and maintain SCSI RAID storage devices that use Sun StorEdge RAID Manager software in an Oracle Solaris Cluster environment. The procedures in this chapter apply to the following SCSI RAID storage devices: Oracle's Netra st A1000 array ■... -
Page 12: Installing Storage Arrays
Cable the storage arrays. For cabling diagrams, see Appendix A, “Cabling Diagrams. ” Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... - Page 13 Installing Storage Arrays Ensure that each device in the SCSI chain has a unique SCSI address. To avoid SCSI-chain conflicts, the following steps instruct you to reserve SCSI address 7 for one host adapter in the SCSI chain and change the other host adapter's global scsi-initiator-id to an available SCSI address.
- Page 14 If necessary, power on the second node, but do not allow it to boot. If necessary, halt the system to continue with OBP Monitor tasks. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
- Page 15 For the procedure about how to install the RAID Manager software, see the Sun StorEdge RAID Manager User’s Guide. For the required version of the RAID Manager software that Oracle Solaris Cluster software supports, see “Restrictions and Requirements” on page Install patches for the controller modules and RAID Manager software.
-
Page 16: How To Add A Storage Array To An Existing Cluster
To upgrade storage arrays, remove the old storage array and then add the new storage array. To replace a storage array with the same type of storage array, use this procedure. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... - Page 17 To perform this procedure, become superuser or assume a role that provides solaris.cluster.read RBAC (role-based access control) authorization. Install the RAID Manager software. For the required version of the RAID Manager software that Oracle Solaris Cluster software ■ supports, see “Restrictions and Requirements”...
- Page 18 Use this information to change the SCSI addresses in the nvramrc script. Do not include the /sd directories in the device paths. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
- Page 19 Installing Storage Arrays e. Edit the nvramrc script to set the scsi-initiator-id for the local devices on the first node to 7. For a full list of commands, see the OpenBoot 2.x Command Reference Manual. Insert exactly one space after the first double quote and before Caution –...
- Page 20 If necessary, power on the second node, but do not allow it to boot. If necessary, halt the system to continue with OBP Monitor tasks. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
- Page 21 Step If you powered off Node B to install a host adapter, perform a reconfiguration boot to create the new Oracle Solaris device files and links. Check the controller module NVSRAM file revision. If necessary, install the most recent revision.
-
Page 22: Configuring Storage Arrays
Use this procedure to create a logical unit number (LUN) from unassigned disk drives or remaining capacity. For information about LUN administration, see the Sun StorEdge RAID Manager Release Notes. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... - Page 23 This product supports the use of hardware RAID and host-based software RAID. For host-based software RAID, this product supports RAID levels 0+1 and 1+0. You must use hardware RAID for Oracle RAC data stored on the storage array. Do not Note –...
- Page 24 # cldevice show DID Device Name: /dev/did/rdsk/d3 Full Device Path: phys-schost-2:/dev/rdsk/c1t3d0 Full Device Path: phys-schost-1:/dev/rdsk/c1t3d1 Replication: none default_fencing: global Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 25: How To Delete A Lun
(A1000 Only) If the LUN that you are removing is a quorum device, relocate that quorum device to another suitable storage array. For procedures about how to add and remove quorum devices, see your Oracle Solaris Cluster system administration documentation. For a list of Oracle Solaris Cluster documentation, see “Related Documentation”... - Page 26 On both nodes, remove all obsolete device IDs. # cldevice clear Move all resource groups and device groups off the node. # clnode evacuate from-node Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 27: How To Reset The Lun Configuration
Configuring Storage Arrays Shut down the node. For the procedure about how to shut down and power off a node, see your Oracle Solaris Cluster system administration documentation. For a list of Oracle Solaris Cluster documentation, see “Related Documentation” on page Perform a reconfiguration boot to create the new Solaris device files and links. - Page 28 Substitute the cNtXdY number from the other controller module in the storage array to determine the alternate path. Example: # lad c0t5d0 1T93600714 LUNS: 0 1 c1t4d0 1T93500595 LUNS: 2 Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 29: How To Correct Mismatched Device Id Numbers
# clnode evacuate from-node Shut down the node. For the procedure about how to shut down and power off a node, see your Oracle Solaris Cluster system administration documentation. For a list of Solaris Cluster documentation, see “Related Documentation” on page To create the new Oracle Solaris device files and links, perform a reconfiguration boot by adding -r to your boot instruction. - Page 30 On both nodes, remove all obsolete device IDs. # cldevice clear Move all resource groups and device groups off the node. # clnode evacuate from-node Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 31: Maintaining Storage Arrays
Maintaining Storage Arrays Shut down the node. For the procedure about how to shut down and power off a node, see your Oracle Solaris Cluster system administration documentation. For a list of Oracle Solaris Cluster documentation, see “Related Documentation” on page To create the new Oracle Solaris device files and links, perform a reconfiguration boot by adding -r to your boot instruction. -
Page 32: Frus That Do Not Require Oracle Solaris Cluster Maintenance Procedures
Replacing a storage array-to-host SCSI cable requires no cluster-specific procedures. See the Sun StorEdge RAID Manager User’s Guide and the Sun StorEdge RAID Manager Release Notes for these procedures. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... - Page 33 A3500/A3500FC Controller Module Guide, the Sun StorEdge A1000 and D1000 Installation, Operations, and Service Manual, and the Sun StorEdge Expansion Cabinet Installation and Service Manual for the following procedures. See the Oracle Solaris Cluster system administration documentation for procedures about how to shut down a cluster. For a list of Oracle Solaris Cluster documentation, see “Related Documentation”...
-
Page 34: How To Remove A Storage Array
Halt all activity to the controller module. For instructions, see your storage device documentation and your operating system documentation. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... - Page 35 Maintaining Storage Arrays If a volume manager does not manage any of the LUNs on the controller module you are removing, proceed to Step If a volume manager manages any LUNs on the controller module that you are removing, remove the LUN from any diskset or disk group. For more information, see your Solaris Volume Manager or Veritas Volume Manager documentation.
- Page 36 If this is the last storage array or storage system in the cluster, remove RAID Manager patches, then remove RAID Manager software packages. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 37: How To Replace A Failed Controller Or Restore An Offline Controller
(StorEdge A1000 Only) If any of the LUNs in the storage array is a quorum device, relocate that quorum device to another suitable storage array. For procedures about how to add and remove quorum devices, see your Oracle Solaris Cluster system administration documentation. For a list of Oracle Solaris Cluster documentation, see “Related Documentation”... - Page 38 In the following command, devicename is the full UNIX path name of the device, for example /dev/dsk/c1tXdY # cldevice repair devicename Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 39: How To Upgrade Controller Module Firmware
Maintaining Storage Arrays (StorEdge A3500 Only) Set the controller to active/active mode. Assign LUNs to the controller. For more information about controller modes, see the Sun StorEdge RAID Manager Installation and Support Guide and the Sun StorEdge RAID Manager User’s Guide. (StorEdge A3500 Only) Reset the System_LunReDistribution parameter in the /etc/raid/rmparams file to true. -
Page 40: How To Add A Disk Drive
If any old DacStore information remains, it can cause aberrant behavior including the appearance of ghost disks or LUNs in the RAID Manager interfaces. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... -
Page 41: How To Replace A Disk Drive
Your nodes are not configured with dynamic reconfiguration functionality. ■ If your nodes are configured for dynamic reconfiguration, see the Oracle Solaris Cluster system administration documentation and skip steps that instruct you to shut down the node. For a list of Oracle Solaris Cluster documentation, see “Related Documentation”... - Page 42 1, return the LUNs to volume management control. For more information, see your Solaris Volume Manager or Veritas Volume Manager documentation. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 43: How To Remove A Disk Drive
Your nodes are not configured with dynamic reconfiguration functionality. ■ If your nodes are configured for dynamic reconfiguration, see the Oracle Solaris Cluster system administration documentation and skip steps that instruct you to shut down the node. For a list of Oracle Solaris Cluster documentation, see “Related Documentation”... -
Page 44: How To Upgrade Disk Drive Firmware
The node on which the host adapter resides is attached to a SCSI-based storage array or ■ storage system. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A... - Page 45 # clnode evacuate fromnode Without powering off the node, shut down Node A. For the procedure about how to shut down and power off a node, see your Oracle Solaris Cluster system administration documentation. For a list of Oracle Solaris Cluster documentation, see “Related Documentation”...
- Page 46 For instructions, see the Sun StorEdge RAID Manager User’s Guide. Rebalance all logical unit numbers (LUNs). For instructions, see the Sun StorEdge RAID Manager User’s Guide. Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
- Page 47 Maintaining Storage Arrays Boot Node A into cluster mode. (Optional) Return resource groups and device groups to Node A. If you moved device groups off their original node in Step 2, restore the device groups that you identified in Step 1 to their original node.
-
Page 49: Cabling Diagrams
Installing a Sun StorEdge A1000 or Netra st A1000 Storage Array The storage arrays must be configured in pairs for the Oracle Solaris Cluster environment. To cable the storage arrays, connect the differential SCSI cable between the node and the storage array. - Page 50 SCSI chain, ensure that each storage array's ID dial is set to a unique number. Storage Array With Two Pairs and Daisy Chaining FIGURE A–2 Node A Node B Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 51: Sun Storedge A3500 Cabling Diagrams
Sun StorEdge A3500 Cabling Diagrams Sun StorEdge A3500 Cabling Diagrams Installing a Sun StorEdge A3500 Storage System Installing a StorEdge A3500 Storage System: An Example FIGURE A–3 Node A Node B For more sample configurations, see the Sun StorEdge A3500/A3500FC Hardware Configuration Guide. - Page 52 Controller B Cabling a StorEdge A3500 Storage System: An Example, Part 2 FIGURE A–5 Node A Node B Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
-
Page 53: Index
Index configuring (Continued) storage systems, 22–31 A1000 controller module fan canisters, replacing, 33 FRUs, 32 procedures, 11–47 controller modules related documents, 7 replacing assemblies, 33 A3500 replacing card cages, 33 FRUs, 33 replacing power cords, 33 procedures, 11–47 upgrading firmware, 39–40 related documents, 7 controllers, replacing and restoring, 37–39 adding... - Page 54 43–44 storage arrays, 34–37 LUNs creating, 22–24 storage systems, 34–37 deleting, 25–27 replacing rebalancing, 22 battery harness, 33 Oracle Solaris Cluster 3.3 With StorEdge A1000 Array, Netra st A1000 Array, or StorEdge A3500 System Manual • May 2011, Revision A...
- Page 55 Index replacing (Continued) storage systems (Continued) battery units (for A1000), 32 maintaining, 31–47 battery units (for A3500), 33 removing, 34–37 controller module assemblies, 33 Sun StorEdge A1000 procedures, 11–47 controller module card cages, 33 Sun StorEdge A3500 procedures, 11–47 controller module fan canisters, 33 switches, replacing, 33 controller module power cords, 33 controllers, 37–39...