Summary of Contents for Sun Microsystems StorEdge T3+
Page 1
Sun Cluster 3.0-3.1 With Sun StorEdge T3 or T3+ Array Manual for Solaris OS SPARC Platform Edition Sun Microsystems, Inc. 4150 Network Circle Santa Clara, CA 95054 U.S.A. Part No: 817–0176–13 January 2006, Revision A...
Page 2
Etats-Unis et dans d’autres pays; elle est licenciée exclusivement par X/Open Company, Ltd. Sun, Sun Microsystems, le logo Sun, le logo Solaris, le logo Java Coffee Cup, docs.sun.com, Java et Solaris sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc.
Contents Preface Installing and Configuring a Sun StorEdge T3 or T3+ Array Installing Sun StorEdge T3 and T3+ Arrays M How to Install a Storage Array in a New Cluster Using a Single-Controller Configuration M How to Install a Storage Array in a New Cluster, Using a Partner-Group Configuration M How to Add a Storage Array to an Existing Cluster, Using a Single-Controller Configuration...
Page 4
M How to Replace an FC Switch or Storage Array-to-Switch Component in a Partner-Group Configuration M How to Replace a Storage Array Controller M How to Replace a Chassis M How to Replace a Host Adapter M How to Remove a Storage Array in a Single-Controller Configuration M How to Remove a Partner Group Upgrading Sun StorEdge T3 or T3+ Storage Arrays M How to Upgrade Storage Array Firmware (No Submirrors)
Preface The Sun Cluster 3.0-3.1 With Sun StorEdge T3 or T3+ Array Manual for Solaris OS provides procedures specific to Sun StorEdge™ T3 or T3+ arrays in single-controller and partner-group configurations when placed in a Sun™ Cluster environment. Use this manual with any version of Sun Cluster 3.0 and 3.1 software. Unless otherwise noted, procedures are the same for all Sun Cluster 3.0 and 3.1 versions.
Chapter 2 discusses how to maintain the StorEdge T3 and T3+ storage array. Revision History The following table lists the information that has been revised or added since the initial release of this documentation. The table also lists the revision date for these changes.
Page 7
Hardware Documentation (Continued) TABLE P–2 Title Part Number Sun StorEdge T3 and T3+ Array Installation, Operation, and Service 816-0773 Manual Available on http://www.sun.com/products-n-solutions/hardware/docs Sun StorEdge T3 and T3+ Array Release Notes 816-3652 Available on http://www.sun.com/products-n-solutions/hardware/docs Sun StorEdge T3 Array Controller Upgrade Manual 816-0780 Available on http://www.sun.com/products-n-solutions/hardware/docs...
Page 8
Using UNIX Commands This document contains information about commands that are used to install, configure, or upgrade a Sun Cluster configuration. This document might not contain ® complete information about basic UNIX commands and procedures such as shutting down the system, booting the system, and configuring devices. See one or more of the following sources for this information: Online documentation for the Solaris™...
Page 9
Typographic Conventions The following table describes the typographic conventions that are used in this book. Typographic Conventions TABLE P–4 Typeface Meaning Example The names of commands, files, and Edit your .login file. AaBbCc123 directories, and onscreen computer Use ls -a to list all files. output machine_name% you have mail.
Page 10
Bourne shell and Korn shell for superuser Product Training Sun Microsystems offers training in many Sun technologies through a variety of instructor-led courses and self-paced courses. For information about the training courses that Sun offers and to enroll in a class, visit Sun Training at http://training.sun.com/.
CHAPTER Installing and Configuring a Sun StorEdge T3 or T3+ Array This chapter contains the procedures about how to install and configure Sun™ StorEdge™ T3 and Sun StorEdge T3+ arrays in a single-controller (noninterconnected) or partner-group (interconnected) configuration in a Sun™ Cluster environment. This chapter contains the following topics.
Task Map: Installing a Storage Array (Continued) TABLE 1–1 Task Information Installing arrays in a new cluster, using a partner-group “How to Install a Storage Array in a configuration New Cluster, Using a Partner-Group Configuration” on page 16 Adding arrays to an existing cluster, using a “How to Add a Storage Array to an single-controller configuration.
Page 13
When you upgrade firmware on a storage device or on an enclosure, redefine Note – the stripe size of a LUN, or perform other LUN operations, a device ID might change unexpectedly. When you perform a check of the device ID configuration by running the scdidadm -c command, the following error message appears on your console if the device ID changed unexpectedly.
Page 14
5. If necessary, install gigabit interface converters (GBICs) or Small Form-Factor Pluggables (SFPs) in the FC hubs/switches, as shown in Figure 1–1. The GBICs or SFPs let you connect the FC hubs/switches to the storage array that you are installing. For the procedure about how to install an FC hub/switch GBIC or an SFP, see the documentation that shipped with your FC hub/switch hardware.
Page 15
9. Install power cords to each storage array that you are installing. 10. Power on the storage array and confirm that all components are powered on and functional. The storage array might require a few minutes to boot. Note – For the procedure about how to power on a storage array, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes. To continue with Sun Cluster software installation tasks, see your Sun Cluster See Also software installation documentation. How to Install a Storage Array in a New Cluster, Using a Partner-Group Configuration Use this procedure to install and configure the first storage array partner groups in a new cluster.
Page 17
If you are using two FC switches and Sun SAN software to create a storage Note – area network (SAN), see “SAN Considerations” on page 69 for more information. 3. Are you installing Sun StorEdge T3+ arrays? If no, proceed to Step 4 If yes, install the media interface adapters (MIAs) in the Sun StorEdge T3 arrays that you are installing, as shown in...
Page 18
5. Set up a Reverse Address Resolution Protocol (RARP) server on the network on which the new storage arrays are to reside. This RARP server enables you to assign an IP address to the new storage arrays. Assign an IP address by using the storage array’s unique MAC address. For the procedure about how to set up a RARP server, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Page 19
PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software. PatchPro provides an Interactive Mode tool especially for Sun Cluster. The Interactive Tool makes the installation of patches easier. PatchPro’s Expert Mode tool helps you to maintain your configuration with the latest set of patches.
17. Install any required patches or software for Sun StorEdge Traffic Manager software support to nodes. For the procedure about how to install the Sun StorEdge Traffic Manager software, see “How to Install Sun Multipathing Software” in Sun Cluster Software Installation Guide for Solaris OS.
Page 21
3. Install the media interface adapter (MIA) in storage array that you are adding, as shown in Figure 1–3. For the procedure about how to install a media interface adapter (MIA), see the Sun StorEdge T3 and T3+ Array Configuration Guide. 4.
Page 22
8. Does this new storage array have a unique target address? If yes, proceed to Step If no, change the target address for this new storage array. For the procedure about how to verify and assign a target address, see the Sun StorEdge T3 and T3+ Array Configuration Guide.
Page 23
11. Determine the resource groups and device groups that are running on Node A and Node B. Record this information because you use this information in Step 41 of this procedure to return resource groups and device groups to these nodes. # scstat 12.
Page 24
19. If necessary, power on and boot Node A into noncluster mode. For the procedure about how to boot a node in noncluster mode, see your Sun Cluster system administration documentation. 20. If necessary, upgrade the host adapter firmware on Node A. PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software.
Page 25
Node A Hub/Switch Hub/Switch Node B Administrative console Adding a Single-Controller Configuration: Part II FIGURE 1–4 22. If necessary, install the required Solaris patches for array support on Node A. For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes.
Page 26
If yes, proceed to Step If no, skip to Step 28. Is the host adapter that you are installing the first FC host adapter on Node B? If no, skip to Step If yes, determine whether the Fibre Channel support packages are already installed on these nodes.
Page 27
To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches. For third-party firmware patches, see the SunSolve Online site at http://sunsolve.ebay.sun.com.
Page 28
Node A Hub/Switch Hub/Switch Node B Administrative console Adding a Single-Controller Configuration: Part III FIGURE 1–5 37. If necessary, install the required Solaris patches for storage array support on Node B. For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 and T3+ Array Release Notes.
For more information, see your Sun Cluster system administration documentation. 42. Perform volume management administration to incorporate the new logical volumes into the cluster. For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation. How to Add a Storage Array to an Existing Cluster, Using a Partner-Group Configuration This procedure contains instructions about how to add new storage array partner groups to a running cluster.
Page 30
Hub/Switch Node A Hub/Switch Node B Administrative console Adding a Partner-Group Configuration: Part I FIGURE 1–6 4. Power on the storage arrays. The storage arrays might require several minutes to boot. Note – For the procedure about how to power on storage arrays, see the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual.
Page 31
7. Ensure that each storage array has a unique target address. For the procedure about how to verify and assign a target address to a storage array, see the Sun StorEdge T3 and T3+ Array Configuration Guide. 8. Ensure that the cache and mirror settings for each storage array are set to auto.
Page 32
16. Move all resource groups and device groups off Node A. # scswitch -S -h from-node 17. Do you need to install host adapters in Node A? If no, skip to Step If yes, proceed to Step 18. Is the host adapter that you are installing the first host adapter on Node A? If no, skip to Step If yes, determine whether the required support packages are already installed...
Page 33
makes the installation of patches easier. PatchPro’s Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches. To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode.
Page 34
Node A Hub/Switch Hub/Switch Node B Administrative console Adding a Partner-Group Configuration: Part II FIGURE 1–7 25. If necessary, install the required Solaris patches for storage array support on Node A. PatchPro is a patch-management tool that eases the selection and download of patches required for installation or maintenance of Sun Cluster software.
Page 35
26. Shut down Node A. For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation. 27. Perform a reconfiguration boot on Node A to create the new Solaris device files and links.
Page 36
The support packages are located in the Product directory of the Solaris CD-ROM. Add any missing packages. 35. Shut down and power off Node B. For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation.
Page 37
Node A Hub/Switch Hub/Switch Node B Administrative console Adding a Partner-Group Configuration: Part III FIGURE 1–8 41. If necessary, install the required Solaris patches for storage array support on Node B. For a list of required Solaris patches for storage array support, see the Sun StorEdge T3 Disk Tray Release Notes.
46. (Optional) On Node B, verify that the DIDs are assigned to the new LUNs. # scdidadm -l 47. On one node that is attached to the new storage arrays, reset the SCSI reservation state. # scdidadm -R n Where n is the DID instance of a storage array LUN that you are adding to the cluster.
When you upgrade firmware on a storage device or on an enclosure, redefine Note – the stripe size of a LUN, or perform other LUN operations, a device ID might change unexpectedly. When you perform a check of the device ID configuration by running the scdidadm -c command, the following error message appears on your console if the device ID changed unexpectedly.
Page 40
Completely set up the logical volume. When you are finished, the volume must be created, mapped, mounted, and initialized. If necessary, partition the volume. To allow multiple clusters and nonclustered nodes to access the storage device, create initiator groups by using LUN masking. 2.
To create a new resource or configure a running resource to use the new logical volume, see Chapter 2, “Administering Data Service Resources,” in Sun Cluster Data Services Planning and Administration Guide for Solaris OS. How to Remove a Logical Volume Use this procedure to remove a logical volume.
Page 42
5. If you are using volume management software, run the appropriate Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager commands to remove the logical volume from any diskset or disk group. For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.
Page 43
12. For each additional node that is connected to the shared storage that hosted the logical volume, repeat Step 8 Step 13. (Optional) Return the resource groups and device groups that you identified in Step 8 to all cluster nodes. Chapter 1 •...
Page 44
Sun Cluster 3.0-3.1 With Sun StorEdge T3 or T3+ Array Manual for Solaris OS • January 2006, Revision A...
CHAPTER Maintaining and Upgrading a Sun StorEdge T3 or T3+ Array This chapter contains the procedures about how to maintain Sun StorEdge™ T3 and Sun StorEdge T3+ arrays in a single-controller (noninterconnected) or partner-group (interconnected) configuration in a Sun™ Cluster environment. This book contains the following topics.
Page 46
If you remove any field-replaceable unit (FRU) for an extended period of Caution – time, thermal complications might result. To prevent this complication, the storage array is designed so that an orderly shutdown occurs. This shutdown occurs when you remove a component for longer than 30 minutes. Therefore, a replacement part must be immediately available before you start an FRU replacement procedure.
Page 47
Task Map: Maintaining a Storage Array (Continued) TABLE 2–1 Task Information Replace an FC hub/switch. “How to Replace a Hub/Switch or Hub/Switch-to-Array Component in a Single-Controller Configuration” on page 51 Replace an FC switch. “How to Replace a Hub/Switch or Hub/Switch-to-Array Component in This procedure applies to SAN-configured clusters only.
Sun StorEdge T3 and T3+ Array FRUs The following is a list of administrative tasks that require no cluster-specific procedures. See the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual for the following procedures. Replacing an Ethernet cable. Replacing a power cable on the storage array.
4. (Optional) If the new disk drive is part of a logical volume that you want to be a quorum device, add the quorum device. For the procedure about how to add a quorum device, see your Sun Cluster system administration documentation.
How to Replace a Node-to-Switch Component in a Cluster That Uses Multipathing 1. Is your configuration active-passive? Steps If yes, and the active path is the path that needs a component replaced, make that path passive. 2. Replace the component. Refer to your hardware documentation for any component-specific instructions.
How to Replace a Hub/Switch or Hub/Switch-to-Array Component in a Single-Controller Configuration Use this procedure to replace a hub/switch or the following hub/switch-to-array components for an array in a single-controller configuration. To replace these components for an array in a partner-group configuration, see “How to Replace an FC Switch or Storage Array-to-Switch Component in a Partner-Group Configuration”...
Page 52
If you are replacing an FC switch and you intend to save the switch Note – configuration for restoration to the replacement switch, do not connect the cables to the replacement switch until after you recall the Fabric configuration to the replacement switch.
Page 53
3. Are you replacing an FC switch or component that is attached to a storage array controller that is ONLINE or DISABLED? If the controller is already DISABLED, skip to Step If the controller is ONLINE, disable the controller. For more information, see the Sun StorEdge T3 and T3+ Array Administrator’s Guide. 4.
Page 54
7. Enable the storage array that you disabled in Step For more information, see the Sun StorEdge T3 and T3+ Array Administrator’s Guide. 8. Verify that the controller’s state has been changed to ONLINE. How to Replace a Storage Array Controller 1.
Page 55
3. Reattach the submirrors to resynchronize the submirrors. The world wide names (WWNs) change as a result of this procedure. You Caution – must reconfigure your volume manager software to recognize the new WWNs. For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation.
Page 56
4. Power off Node A. 5. Replace the failed host adapter. For the procedure about how to remove and add host adapters, see the documentation that shipped with your nodes. 6. Do you need to upgrade the node’s host adapter firmware? If yes, boot Node A into noncluster mode.
Page 57
How to Remove a Storage Array in a Single-Controller Configuration Use this procedure to remove a storage array and its submirrors from a running cluster. This procedure provides the flexibility to remove the host adapters from the nodes for the storage array that you are removing. To remove a partner group from the cluster, see “How to Remove a Partner Group”...
Page 58
5. Shut down Node A. For the procedure about how to shut down and power off a node, see your Sun Cluster system administration documentation. 6. Is the storage array that you are removing the last storage array that is connected to Node A? If yes, disconnect the fiber-optic cable between Node A and the FC hub/switch that is connected to this storage array.
Page 59
If no, proceed to Step For the procedure about how to remove a fiber-optic cable, see the Sun StorEdge T3 and T3+ Array Configuration Guide. If you are use your storage array in a SAN-configured cluster, you must Note – keep two FC switches configured in parallel.
Page 60
When you upgrade firmware on a storage device or on an enclosure, redefine Note – the stripe size of a LUN, or perform other LUN operations, a device ID might change unexpectedly. When you perform a check of the device ID configuration by running the scdidadm -c command, the following error message appears on your console if the device ID changed unexpectedly.
Page 61
7. Is any storage array that you are removing the last storage array connected to an FC switch that is on Node A? If no, skip to Step If yes, disconnect the fiber-optic cable between Node A and the FC switch that was connected to this storage array.
Page 62
If you are using your storage arrays in a SAN-configured cluster, you must Note – keep two FC switches configured in parallel. This configuration maintains cluster availability. See “SAN Considerations” on page 69 for more information. 14. Do you want to remove the host adapters from Node B If no, proceed to Step If yes, power off Node B.
Page 63
When you upgrade firmware on a storage device or on an enclosure, redefine Note – the stripe size of a LUN, or perform other LUN operations, a device ID might change unexpectedly. When you perform a check of the device ID configuration by running the scdidadm -c command, the following error message appears on your console if the device ID changed unexpectedly.
Page 64
1. On one node that is attached to the storage array, detach the submirrors. This Steps storage array is the storage array that you are upgrading. For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation. 2.
Page 65
array on which you are upgrading firmware. For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation. 2. Apply the controller, disk drive, and UIC firmware patches. For the list of required storage array patches, see the Sun StorEdge T3 Disk Tray Release Notes.
Page 66
3. Reattach the submirrors to resynchronize the submirrors. For more information, see your Solstice DiskSuite/Solaris Volume Manager or VERITAS Volume Manager documentation. How to Migrate From a Single-Controller Configuration to a Partner-Group Configuration Use this procedure to migrate your storage arrays from a single-controller (noninterconnected) configuration to a partner-group (interconnected) configuration.
Page 67
To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode. Follow the instructions in the PatchPro tool to describe your cluster configuration and download the patches. For third-party firmware patches, see the SunSolve Online site at http://sunsolve.ebay.sun.com.
Page 68
makes the installation of patches easier. PatchPro’s Expert Mode tool helps you to maintain your configuration with the latest set of patches. Expert Mode is especially useful for obtaining all of the latest patches, not just the high availability and security patches. To access the PatchPro tool for Sun Cluster software, go to http://www.sun.com/PatchPro/, click Sun Cluster, then choose either Interactive Mode or Expert Mode.
Page 69
22. Perform volume management administration to incorporate the new logical volumes into the cluster. For more information, see your Solstice DiskSuite or VERITAS Volume Manager documentation. The best way to enable multipathing for a cluster is to install the multipathing Next Steps software and enable multipathing before installing the Sun Cluster software and establishing the cluster.
Page 70
SAN Clustering Considerations If you are replacing an FC switch and you intend to save the switch IP configuration for restoration to the replacement switch, wait to connect the cables to the replacement switch. Connect the cables to the replacement switch after you recall the Fabric configuration to the replacement switch.
Page 71
Index disk drives, replacing, 48-49 adding See also installing disk drive, 48 nodes, 47 Ethernet cables, replacing, 48 partner groups, 29-38 single-controller storage arrays, 20-29 array-to-switch components, replacing, 52-54 arrays See storage array s FC switches, replacing, 52-54 installing partner groups, 16-20 FRUs, 48 chassis HBAs, replacing, 55-56...
Page 72
logical unit numbers, See logical volumes replacing (Continued) logical volumes FC switches, 52-54 creating, 39-41 host adapters, 55-56 removing, 41-43 hub-to-array components, 51-52 LUNs, See logical volumes midplane, 54-55 node-to-switch components, 49-50 power cables, 48 power units, 48 switch-to-array components, 51-52 maintaining unit interconnect cards, 48 storage arrays, 45-70...
Need help?
Do you have a question about the StorEdge T3+ and is the answer not in the manual?
Questions and answers