Page 1 Sun StorEdge T3+ Array ™ Installation and Conﬁguration Manual Version 2.1 Controller Firmware Sun Microsystems, Inc. 4150 Network Circle Santa Clara, CA 95054 U.S.A. 650-960-1300 Part No. 816-4769-10 April 2002, Revision Send comments about this document to: docfeedback@sun.com...
Page 2 Enterprise, Sun Fire, Sun VTS, Solstice DiskSuite, Sun StorEdge, et Solaris sont des marques de fabrique ou des marques déposées, ou marques de service, de Sun Microsystems, Inc. aux Etats-Unis et dans d’autres pays. Toutes les marques SPARC sont utilisées sous licence et sont des marques de fabrique ou des marques déposées de SPARC International, Inc.
Page 3: Table Of Contents
Contents Preface xvii Overview of the Sun StorEdge T3+ Array 1 Product Description 2 Array Components 4 Disk Drive 4 Array Controller Card 5 Unit Interconnect Cards (UIC) 7 Power and Cooling Unit 9 Array Features 9 Firmware Version 2.1 New Features List 11 Array Architecture 11 Supported Configurations 13 Workgroup 14...
Page 4 Sun Cluster Support 19 Supported Software 21 Supported Operational Environment 22 Supported Multiple Operational Environments 22 Supported Multi-Pathing Software 22 Supported Clustering Software 22 Supported Host Side Drivers 23 Supported SAN Switch Support 23 Supported Diagnostics and Monitoring Software 23 Administrative Tools 23 End-User Tools 24 Supported Interfaces 24...
Page 5 Single Host With Two Hubs and Four Controller Units Configured as Two Partner Groups 35 Single Host With Two Hubs and Eight Controller Units Configured as Four Partner Groups 38 Dual Hosts With Two Hubs and Four Controller Units 40 Dual Hosts With Two Hubs and Eight Controller Units 42 Dual Hosts With Two Hubs and Four Controller Units Configured as Two Partner Groups 44...
Page 6 Changing the Default Configuration 88 Connecting the Host System 89 Verifying the Data Host Connection 89 Establishing Logical Volumes on the Host 90 Creating Soft Partitions on the Data Host 90 To Establish Alternate Pathing on the Host 91 Powering Off and On 94 To Power Off 94 To Power On 95 Controller Firmware Version 2.1 Upgrade 97...
Page 7 Mirrored Cache Enabling 118 Cache Allocation Configuration 118 Configuring Logical Volumes 119 Guidelines for Configuring Logical Volumes 119 Determining the Number of Logical Volumes 120 Determining the RAID Level 120 Determining a Hot-Spare 121 Creating and Labeling a Logical Volume 122 Setting the LUN Reconstruction Rate 122 Using RAID Levels to Configure Redundancy 123 RAID 0 124...
Page 8 Creating Partner Groups 138 Post-Installation Host Connections 139 Sun Enterprise SBus+ and Graphics+ I/O Boards 140 System Requirements 140 Sun StorEdge PCI FC-100 Host Bus Adapter 141 System Requirements 141 Sun StorEdge SBus FC-100 Host Bus Adapter 142 System Requirements 142 Sun StorEdge PCI Single Fibre Channel Network Adapter 143 System Requirements 143 Sun StorEdge PCI Dual Fibre Channel Network Adapter 144...
Page 9 Telnet Session 156 Array LEDs 156 Disk Drive LEDs 156 Power and Cooling Unit LEDs 157 Interconnect Card LEDs 159 Controller Card LEDs 160 Channel Connection Failures 162 FRU Failures 162 Servicing the Array 163 ofdg Notice 164 Preparing for Service 165 Removing and Replacing Components 165 Disk Drives 166 Disk Drive LEDs 166...
Page 10 Specifications 181 Power Specifications 182 Environmental Specifications 183 Mechanical Specifications 184 Cable Specifications 185 Illustrated Parts 187 Glossary 193 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 11 Figures Sun StorEdge T3+ Array 3 FIGURE 1-1 Disk Drives (Front View) 4 FIGURE 1-2 Controller Card (Rear View) 5 FIGURE 1-3 Sun StorEdge T3+ Array Controller Card Front Panel 5 FIGURE 1-4 Sun StorEdge T3+ array Controller Card and Ports 6 FIGURE 1-5 Interconnect Card and Ports 7 FIGURE 1-6...
Page 12 Dual Hosts With Two Hubs and Eight Controller Units Configured as Four Partner FIGURE 4-11 Groups 47 Dual Hosts With Two Switches and Two Controller Units 49 FIGURE 4-12 Dual Hosts With Two Switches and Eight Controller Units 51 FIGURE 4-13 Sun StorEdge T3+ Array Cables 55 FIGURE 5-1 Removing the Front Panel 56...
Page 13 Interconnect Card LEDs 160 FIGURE 13-3 Sun StorEdge T3+ Array Controller Card LEDs 161 FIGURE 13-4 Removing the Front Panel 167 FIGURE 14-1 Disk Drive Numbering 167 FIGURE 14-2 Releasing the Latch Handle 168 FIGURE 14-3 Removing a Disk Drive 169 FIGURE 14-4 Power Cords Connected to the Power and Cooling Units 170 FIGURE 14-5...
Page 14 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 15 Tables Sun StorEdge T3+ Array Key Features—73-Gbyte Drive 10 TABLE 1-1 Required Patches 60 TABLE 5-1 Drive Status Messages 83 TABLE 6-1 Explanation of ver Command Results 103 TABLE 7-1 t3.sh Utility Installation Prompts 106 TABLE 7-2 Explanation of ver Command Results 111 TABLE 7-3 RAID 0 Data Blocks 124 TABLE 8-1...
Page 16 Cable Specifications 185 TABLE A-4 Illustrated Part Numbers 187 TABLE B-1 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 17: Preface
Preface This manual contains information on how to install, operate, and service the Sun StorEdge™ T3+ array. Most of the procedures in this manual can be performed by an experienced system administrator. Topics covered here are: “Before You Read This Book” on page xviii “Using UNIX Commands”...
Page 18: Before You Read This Book
Before You Read This Book Read the safety information in the Sun StorEdge T3+ Array Regulatory and Safety Compliance Manual that is included with the array before attempting the installation. Make sure you have prepared for the installation by reviewing the Sun StorEdge T3+ Array Site Preparation Guide.
Page 19: Typographic Conventions
Typographic Conventions Typeface Meaning Examples The names of commands, files, Edit your.login file. AaBbCc123 and directories; on-screen Use ls -a to list all files. computer output % You have mail. What you type, when AaBbCc123 contrasted with on-screen Password: computer output AaBbCc123 Book titles, new words or terms, Read Chapter 6 in the User’s Guide.
Page 20: Related Documentation
Related Documentation Application Title Part Number Latest array updates Sun StorEdge T3+ Array Release Notes 816-4771 Installation overview Sun StorEdge T3+ Array Start Here 816-4768 Safety procedures Sun StorEdge T3+ Array Regulatory and 816-0774 Safety Compliance Manual Site preparation Sun StorEdge T3+ Array Site Preparation 816-0778 Guide Installation and...
Page 21: Accessing Sun Documentation Online
Accessing Sun Documentation Online You can find the Sun StorEdge T3+ array documentation and other select product documentation for Network Storage Solutions at: http://www.sun.com/products-n-solutions/hardware/docs/ Network_Storage_Solutions Sun Welcomes Your Comments Sun is interested in improving its documentation and welcomes your comments and suggestions.
Page 22 xxii Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 23: Overview Of The Sun Storedge T3+ Array
C H A P T E R Overview of the Sun StorEdge T3+ Array This chapter provides a high-level introduction to the Sun StorEdge T3+ array. Topics in this chapter include: “Product Description” on page 2 “Array Components” on page 4 “Array Features”...
Page 24: Product Description
Product Description The Sun StorEdge T3+ array is a high-performance, modular, scalable storage device that contains an internal RAID controller and nine disk drives with Fibre Channel connectivity to the data host. Extensive reliability, availability, and serviceability (RAS) features include redundant components, notification of failed components, and the ability to replace components while the unit is online.
Page 25: Figure 1-1 Sun Storedge T3+ Array
Sun StorEdge T3+ Array FIGURE 1-1 Chapter 1 Overview of the Sun StorEdge T3+ Array...
Page 26: Array Components
Array Components The array contains four basic components that can be easily replaced: Disk drive Controller card Interconnect card Power and cooling unit All components plug into a centerplane; there is no internal cabling. For information on how to remove and replace these components, see Chapter 14. Note –...
Page 27: Array Controller Card
Note – All Sun StorEdge T3+ array disk drives in a workgroup or in an enterprise configuration must have the same storage capacity and drive speed. Array Controller Card The Sun StorEdge T3+ array has a specific controller card that contains slightly different features on the exterior and a different design on the internal controller board.
Page 28: Figure 1-5 Sun Storedge T3+ Array Controller Card And Ports
The Sun StorEdge T3+ array controller card contains the RAID controller hardware and firmware, including: One Fibre Channel-Arbitrated Loop (FC-AL) port that uses an LC small-form factor (SFF) connector. The fiber-optic cable that provides data channel connectivity to the array has an LC-SFF connector that attaches directly to the port on the controller card.
Page 29: Unit Interconnect Cards (Uic)
Unit Interconnect Cards (UIC) The interconnect cards are alike on both array models. Each card has two interconnect ports: one input and one output for interconnecting multiple arrays. The interconnect card provides switch and failover capabilities, as well as an environmental monitor for the array.
Page 30: Figure 1-7 Interconnect Cards (Rear View)
The interconnect card contains the interface circuitry and two connectors for interconnecting multiple arrays. It provides loop-switch capability and contains an environmental monitor for the array. See . For information on how to FIGURE 1-7 service the interconnect card, see Chapter 14. Interconnect card 2 Interconnect card 1 Interconnect Cards (Rear View)
Page 31: Power And Cooling Unit
Power and Cooling Unit The power and cooling unit contains a power supply, two cooling fans, an integrated uninterruptible power source (UPS) battery, and LED status indicators for AC power. Each array contains two power and cooling units for redundancy. See Chapter 14 for information on how to service the power and cooling unit and for information on UPS battery maintenance.
Page 32: Table 1-1 Sun Storedge T3+ Array Key Features-73-Gbyte Drive
Sun StorEdge T3+ Array Key Features—73-Gbyte Drive TABLE 1-1 Feature Sun StorEdge T3+ Array Capacity per unit 657 GB (9 x 73-GB drives) 1 GB cache Performance per controller 95+ MB/sec for large RAID 5 reads from disk (64K >) 90+ MB/sec for large RAID 5 writes to disk 7,200 IOPS for 8 KB (100% cache hit reads) Connectivity per controller...
Page 33: Firmware Version 2.1 New Features List
Firmware Version 2.1 New Features List The following is a complete list of all firmware version 2.1 new features: Volume slicing LUN masking LUN mapping Auto upgrade Split loop mode Host side initiators Fabric point-to-point support Persistent group reservation (PGR) Network time protocol (NTP) See the Sun StorEdge T3+ Array Administrator’s Manual for more information on these features.
Page 34 Each disk drive has a drive label, of which approximately 150 Mbytes is reserved for the system area, contains the configuration data, boot firmware, and file system information. The system area information is mirrored across all nine drives for redundancy so that data can be recovered from the other functional drives. Finally, the unique switched-loop architecture provides the flexibility to configure multiple units together for scalability and availability, and enables loops to be reconfigured dynamically for diagnosis and recovery in case of loop-related failures.
Page 35: Supported Configurations
C H A P T E R Supported Configurations This chapter describes the two supported array configurations: workgroup and enterprise. It also describes basic rules and recommendations for configuring the array. Topics in this chapter include: “Workgroup” on page 14 “Enterprise”...
Page 36: Workgroup
Workgroup This standalone array is a high-performance, high-RAS configuration with a single hardware RAID-cached controller. See . The unit is fully populated with FIGURE 2-1 redundant hot-swap components and nine disk drives. Application host FC-AL connection Management host Ethernet connection Ethernet port Workgroup Configuration FIGURE 2-1...
Page 37: Figure 2-2 Enterprise Configuration
Alternate master unit Application host Ethernet connection Interconnect cables Host-bus adapters Master unit FC-AL connection Management host Ethernet connection Ethernet port Enterprise Configuration FIGURE 2-2 Also called a partner group, this is a configuration of two controller units paired with interconnect cables for back-end data and administrative connections.
Page 38: Enterprise
Enterprise An enterprise configuration has a master controller unit and an alternate master controller unit. In all default enterprise configurations, the master controller unit is the array positioned at the bottom of an array stack in either a rack-mounted or tabletop installation.
Page 39: Configuration Guidelines And Restrictions
Configuration Guidelines and Restrictions Workgroup Configuration Restrictions The media access control (MAC) address is required to assign an IP address to the controller unit. The MAC address uniquely identifies each node of a network. The MAC address is available on the pull-out tab on the front left side of the array. A host-based mirroring solution is necessary to protect data in cache.
Page 40: Configuration Recommendations
Configuration Recommendations Use enterprise configurations for controller redundancy. Use host-based software such as VERITAS Volume Manager (VxVM), VERITAS Dynamic Multipathing (DMP), or Sun StorEdge Traffic Manager for multipathing support. Connect redundant paths to separate host adapters, I/O cards, and system buses. Configure active paths over separate system buses to maximize bandwidth.
Page 41: Sun Cluster Support
Sun Cluster Support The Sun StorEdge T3+ array is supported in Sun Cluster configurations with the following restrictions: Array controller firmware version 2.0 or later is required on each Sun StorEdge T3+ array. Sun Cluster 3.0 environments support the Sun StorEdge T3+ array. Enterprise configurations are supported only in Sun Cluster 3.0 environments.
Page 42 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 43: Supported Software
C H A P T E R Supported Software Note – For the latest information on supported software, refer to the storage solutions web site at http://www.sun.com/storage and look for details on the Sun StorEdge T3+ array product family. Topics in this chapter include: “Supported Operational Environment”...
Page 44: Supported Operational Environment
Supported Operational Environment Solaris 2.6, and 8 operating environment software Microsoft NT operating environment software HP-UX Supported Multiple Operational Environments With the volume slicing feature enabled, the slices can be masked to support multiple operating systems simultaneously. Note – In the absence of a clustering software, managing each slice by a single host will be assumed.
Page 45: Supported Host Side Drivers
Supported Host Side Drivers Sun StorEdge Network Foundation Software Sun StorEdge Traffic Manager Software (STMS) Supported SAN Switch Support Sun StorEdge 16-port FC-AL switch Sun StorEdge FC-AL switch Supported Diagnostics and Monitoring Software Administrative Tools Device Manager StorADE 2.0 Network Storage Agent (Solaris 2.6 only) StorTools™...
Page 46: End-User Tools
End-User Tools StorTools 3.1, 4.0, 4.0.1, 4.1 StorADE 1.1 Network Storage Agent 1.1 fru stat Command-Line Interface (CLI Supported Interfaces The protocols by which Sun StorEdge T3 2.1 firmware incorporates with others are: SNMP–read-only access HTTP–Token-based interface for use by Gotham CLI–Command-line interface Management applications use out-of-band interfaces with SNMP, TCP/IP, SMTP, HTTP protocols...
Page 47: Supported Bootability
Supported Bootability To use the Sun StorEdge T3+ array as a bootable device, contact your SunService™ provider for information. Supported Multi-Platform Software T3 Multi-Platform 2.0 Supported Multi-Host Environments CSI 2 Reserve/Release SCSI III persistent group reservation (PGR) LUN masking Chapter 3 Supported Software...
Page 48: Summary Of Supported Software
Summary of Supported Software The following software is supported on Sun StorEdge T3+ array: Solaris 2.6, 8, and 9 operating environments VERITAS Volume Manager 3.1.1 and later with Dynamic Multipathing (DMP) Sun Enterprise Server Alternate Pathing (AP) 2.3.1 Sun StorEdge Component Manager 2.1 and later StorTools 3.3 Diagnostics Sun Cluster 2.2 and 3.0 software (see “Sun Cluster Support”...
Page 49: Configuration Scenarios
C H A P T E R Configuration Scenarios This chapter includes sample reference configurations for Sun StorEdge T3+ arrays. Although many configurations are supported, these reference configurations provide the best solution for many installations. Topics in this chapter include: “Direct Host Connection”...
Page 50: Direct Host Connection
Direct Host Connection This section contains examples of the following configurations: “Single Host With One Controller Unit” on page 28 “Single Host With Two Controller Units Configured as a Partner Group” on page 29 “Single Host With Four Controller Units Configured as Two Partner Groups” on page 31 “Single Host With Eight Controller Units Configured as Four Partner Groups”...
Page 51: Single Host With Two Controller Units Configured As A Partner Group
Single Host With Two Controller Units Configured as a Partner Group shows one application host connected through FC-AL cables to one array FIGURE 4-2 partner group, which consists of two Sun StorEdge T3+ arrays. The Ethernet connection from the master controller unit is on a secure private network and requires an IP address for the partner group.
Page 52: Host Multi-Pathing Management Software
Host Multi-Pathing Management Software While Sun StorEdge T3+ arrays are redundant devices that automatically reconfigure whenever a failure occurs on any internal component, a host-based solution is needed for a redundant data path. Supported multipathing solutions include: VERITAS DMP by VERITAS Volume Manager Sun StorEdge Traffic Manager software During normal operation, I/O moves on the host channel connected to the controller that owns the LUNs.
Page 53: Single Host With Four Controller Units Configured As Two Partner Groups
Single Host With Four Controller Units Configured as Two Partner Groups shows one application host connected through FC-AL cables to four FIGURE 4-4 arrays configured as two separate partner groups. This configuration can be used for capacity and I/O throughput requirements. Host-based multi-pathing software is required for this configuration.
Page 54: Figure 4-4 Single Host With Four Controller Units Configured As Two Partner Groups
Alternate master controller Ethernet unit Application host FC-AL Interconnect cables Master controller unit FC-AL Ethernet port Secure private LAN Management host Single Host With Four Controller Units Configured as Two Partner Groups FIGURE 4-4 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 55: Single Host With Eight Controller Units Configured As Four Partner Groups
Single Host With Eight Controller Units Configured as Four Partner Groups shows one application host connected through FC-AL cables to eight Sun FIGURE 4-5 StorEdge T3+ arrays, forming four partner groups. This configuration is the maximum allowed in a 72-inch cabinet. This configuration can be used for footprint and I/O throughput.
Page 56: Figure 4-5 Single Host With Eight Controller Units Configured As Four Partner Groups
Alternate master Ethernet controller unit Application host Interconnect FC-AL cables Master controller unit FC-AL Ethernet port Secure private LAN Management host Single Host With Eight Controller Units Configured as Four Partner Groups FIGURE 4-5 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 57: Hub Host Connection
Hub Host Connection The following sample configurations are included in this section: “Single Host With Two Hubs and Four Controller Units Configured as Two Partner Groups” on page 35 “Single Host With Two Hubs and Eight Controller Units Configured as Four Partner Groups”...
Page 58 The following three parameters must be set on the master controller unit: Multi-path support software: DMP: sys mp_support rw STMS: sys mp_support mpxio sys cache auto sys mirror auto Note – For information on setting these parameters, refer to the Sun StorEdge T3+ Array Administrator’s Manual.
Page 59: Figure 4-6 Single Host With Two Hubs And Four Controller Units Configured As Two Partner Groups
Application host Alternate master controller Ethernet unit FC-AL Interconnect cables Master controller unit FC-AL Ethernet port Management host Secure private LAN Single Host With Two Hubs and Four Controller Units Configured as Two FIGURE 4-6 Partner Groups Chapter 4 Configuration Scenarios...
Page 60: Single Host With Two Hubs And Eight Controller Units Configured As Four Partner Groups
Single Host With Two Hubs and Eight Controller Units Configured as Four Partner Groups shows one application host connected through FC-AL cables to two hubs FIGURE 4-7 and to eight Sun StorEdge T3+ arrays, forming four partner groups. This configuration is the maximum allowed in a 72-inch cabinet. This configuration can be used for footprint and I/O throughput.
Page 61 Application host Alternate master Ethernet controller unit FC-AL Interconnect cables Master FC-AL controller unit Ethernet port Management host Secure private LAN Single Host With Two Hubs Configured and Eight Controller Units as Four FIGURE 4-7 Partner Groups Chapter 4 Configuration Scenarios...
Page 62: Dual Hosts With Two Hubs And Four Controller Units
Dual Hosts With Two Hubs and Four Controller Units shows two application hosts connected through FC-AL cables to two hubs FIGURE 4-8 and four Sun StorEdge T3+ arrays. This configuration, also known as a multi-initiator configuration, can be used for footprint and I/O throughput. The following limitations should be evaluated when proceeding with this configuration: Use host-based mirroring software such as VERITAS Volume Manager or Solaris Volume Manager to avoid the risk caused by any array or data path single point...
Page 63: Figure 4-8 Dual Hosts With Two Hubs And Four Controller Units
Application host 1 Application host 2 Controller unit FC-AL Ethernet Ethernet port Secure private LAN Management host Dual Hosts With Two Hubs and Four Controller Units FIGURE 4-8 Chapter 4 Configuration Scenarios...
Page 64: Dual Hosts With Two Hubs And Eight Controller Units
Dual Hosts With Two Hubs and Eight Controller Units shows two application hosts connected through FC-AL cables to two hubs FIGURE 4-9 and eight Sun StorEdge T3+ arrays. This configuration, also known as a multi- initiator configuration, can be used for footprint and I/O throughput. The following limitations should be evaluated when proceeding with this configuration: Avoid the risk caused by any array or data path single point of failure using host- based mirroring software such as VERITAS Volume Manager or Solaris Volume...
Page 65: Figure 4-9 Dual Hosts With Two Hubs And Eight Controller Units
Application host 1 Application host 2 Controller unit Ethernet FC-AL Ethernet port Secure private LAN Management Host Dual Hosts With Two Hubs and Eight Controller Units FIGURE 4-9 Chapter 4 Configuration Scenarios...
Page 66: Dual Hosts With Two Hubs And Four Controller Units Configured As Two Partner Groups
Dual Hosts With Two Hubs and Four Controller Units Configured as Two Partner Groups shows two application hosts connected through FC-AL cables to two hubs FIGURE 4-8 and four Sun StorEdge T3+ arrays forming two partner groups. This multi-initiator configuration can be used for footprint and I/O throughput. Note –...
Page 67: Figure 4-10 Dual Hosts With Two Hubs And Four Controller Units Configured As Two Partner Groups
Application host 1 Application host 2 Alternate master controller unit FC-AL Interconnect cables Ethernet Master controller unit FC-AL Ethernet port Management host Secure private LAN Dual Hosts With Two Hubs and Four Controller Units Configured as Two FIGURE 4-10 Partner Groups Chapter 4 Configuration Scenarios...
Page 68: Dual Hosts With Two Hubs And Eight Controller Units Configured As Four Partner Groups
Dual Hosts With Two Hubs and Eight Controller Units Configured as Four Partner Groups shows two application hosts connected through FC-AL cables to two hubs FIGURE 4-9 and eight Sun StorEdge T3+ arrays forming four partner groups. This multi-initiator configuration can be used for footprint and I/O throughput. This configuration is a recommended enterprise configuration for RAS functionality because the controller is not a single point of failure.
Page 69: Figure 4-11 Dual Hosts With Two Hubs And Eight Controller Units Configured As Four Partner Groups
Application host 1 Application host 2 Alternate master controller unit FC-AL Interconnect cables Ethernet Master controller FC-AL unit Secure private LAN Management host Ethernet port Dual Hosts With Two Hubs and Eight Controller Units Configured as Four FIGURE 4-11 Partner Groups Chapter 4 Configuration Scenarios...
Page 70: Switch Host Connection
Switch Host Connection This section contains the following example configurations: “Dual Hosts With Two Switches and Two Controller Units” on page 48 “Dual Hosts With Two Switches and Eight Controller Units” on page 50 Dual Hosts With Two Switches and Two Controller Units shows two application hosts connected through FC-AL cables to two FIGURE 4-12...
Page 71: Figure 4-12 Dual Hosts With Two Switches And Two Controller Units
Switch Application host A Switch Application host B Controller unit Ethernet FC-AL Ethernet port Management Host Secure private LAN Dual Hosts With Two Switches and Two Controller Units FIGURE 4-12 Chapter 4 Configuration Scenarios...
Page 72: Dual Hosts With Two Switches And Eight Controller Units
Dual Hosts With Two Switches and Eight Controller Units shows two application hosts connected through FC-AL cables to two FIGURE 4-13 switches and eight Sun StorEdge T3+ arrays. This multi-initiator configuration can be used for footprint and I/O throughput. Note – This configuration is not recommended for RAS functionality because the controller is a single point of failure.
Page 73: Figure 4-13 Dual Hosts With Two Switches And Eight Controller Units
Switch Application host 1 Switch Application host 2 Controller unit Ethernet FC-AL Secure private LAN Management host Ethernet port Dual Hosts With Two Switches and Eight Controller Units FIGURE 4-13 Chapter 4 Configuration Scenarios...
Page 74 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 75: Preparing To Install
C H A P T E R Preparing to Install This chapter outlines the steps you need to take to prepare your system for installing the product. Topics in this chapter include: “Preparing for the Installation” on page 54 “To Inspect the Array” on page 55 “To Edit the Host Files”...
Page 76: Preparing For The Installation
Preparing for the Installation Before you install the array, make sure you have completed the following tasks: Prepare the area according to the guidelines and procedures in the Sun StorEdge T3+ Array Site Preparation Guide. Review safety requirements for the array installation in the Sun StorEdge T3+ Array Regulatory and Safety Compliance Manual.
Page 77: To Inspect The Array
To Inspect the Array Caution – This procedure requires two people to lift and move the array. Use care to avoid injury. An array can weigh up to 67 pounds (30 kg). 1. Unpack the array. You should have the following items: Sun StorEdge T3+ array One 5m fiber-optic cable (unique to the array model) Two power cords...
Page 78: Figure 5-2 Removing The Front Panel
Latch Latch Removing the Front Panel FIGURE 5-2 5. Locate the pull-out tab at the left side of the array next to the first disk drive FIGURE 5-3 This tab contains the array serial number and media access control (MAC) address. Record this information;...
Page 79: To Edit The Host Files
6. Make sure that all the disk drives, the power and cooling units, the interconnect cards, and the controller card (if present) are firmly seated in the unit. 7. Replace the front panel. Caution – You must replace the front panel for the array to meet regulatory emissions requirements.
Page 80 array-name is the name of the array you are installing. 2. Add the IP address and array name to the /etc/hosts file. For example: 192.129.122.111 array-name In this example: 192.129.122.111 is the assigned IP address. 3. Edit the /etc/nsswitch.conf file to reference the local system files. To ensure that the Solaris software environment uses the changes made to the /etc/ethers and /etc/hosts files, edit the host and ethers entries in the /etc/nsswitch.conf file so that the files parameter appears before the...
Page 81: To Install Required Patches
Note – In some cases, the array could time out before it receives the RARP request through an Ethernet switch. If this happens, the array cannot receive the assigned IP address. If the array should time out before receiving the RARP request, it could be due to an improper spanning-tree setting of the Ethernet switch.
Page 82: Table 5-1 Required Patches
Required Patches TABLE 5-1 Solaris 2.6 Solaris 7 Solaris 8 System Type Operating Environment Operating Environment Operating Environment 105356-18 or later 107458-13 or later 109524-09 or later (ssd driver) (ssd driver) (ssd driver) 106226-02 or later 107473-07 or later (format patch) (luxadm patch) 105181-29 or later 107834-03 or later...
Page 83: Installation Checklist
Installation Checklist Diagram of lab and network configuration Host ID Host name Host IP address Gateway IP address Gateway netmask Array IP address Top array IP address bottom array IP adders Array name Top array name Bottom array name root password for array TFTP IP host address OS/patch revision level Veritas DMP release...
Page 84 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 85: Array Installation
C H A P T E R Array Installation This chapter describes how to install the Sun StorEdge T3+ array in either a workgroup (single) or enterprise (partner group) configuration. Note – This chapter is for installing new array units only. To reconfigure existing single array units into an enterprise configuration, contact your SunService representative.
Page 86: To Install The Array
“Powering Off and On” on page 94 To Install the Array This section describes the procedures for installing either a workgroup or enterprise configuration; see Chapter 1 for an explanation of each configuration. The array can either be placed on a tabletop or rackmounted in a server cabinet or expansion cabinet.
Page 87: To Connect The Cables
Caution – Do not stack more than two arrays together. Stacking more than two arrays could damage them. You are now ready to connect the cables. To Connect the Cables This section explains how to connect cables for both a workgroup (standalone) and for an enterprise (partner group) configuration.
Page 88: Figure 6-1 Sun Storedge T3+ Array Cables
SC connector Fiber-optic cable LC-SFF connector Interconnect cable AC power cord Ethernet cable (category 5) Sun StorEdge T3+ Array Cables FIGURE 6-1 1. Connect the fiber-optic cable to the host bus adapter (HBA). Make sure you attach the standard connector (SC) on the fiber-optic cable to the HBA.
Page 89: Figure 6-2 Connecting The Fiber-Optic Cable To The Fc-Al Connector On A Sun Storedge T3+ Array
FC-AL connector LC-SFF connector Fiber-optic cable Connecting the Fiber-Optic Cable to the FC-AL Connector on a FIGURE 6-2 Sun StorEdge T3+ Array 4. Attach one end of the Ethernet cable to the Ethernet port on the controller card of the master unit ( FIGURE 6-3 Use a category 5 Ethernet cable.
Page 90: Figure 6-4 Connecting The Power Cords
5. Attach the other end of the Ethernet cable to a network hub or router. Note – You must use a shielded Ethernet interface cable to comply with regulatory emissions requirements. 6. Partner group only: Repeat Step 4 and Step 5 to connect the alternate master unit to a hub or router using a second Ethernet cable.
Page 91: Figure 6-5 Connecting The Interconnect Cables
9. Partner group only: Connect the interconnect cables to the interconnect cards as shown in FIGURE 6-5 Make sure you connect the cables to the correct interconnect card connectors exactly as shown in the figure. This cable connection determines the master and alternate master relationship.
Page 92: To Power On And Verify The Hardware Configuration
A fully cabled partner group is shown in FIGURE 6-6 Power connectors (cords not shown) Alternate master controller unit Application host Interconnect cables HBAs Master controller unit FC-AL connections Ethernet connections Ethernet port Management host Fully Cabled Partner Group (Enterprise Configuration) FIGURE 6-6 To Power On and Verify the Hardware Configuration...
Page 93: Figure 6-7 Power And Cooling Unit Leds And Power Button Location
AC LED Power button PS LED Power and Cooling Unit LEDs and Power Button Location FIGURE 6-7 4. Check the LEDs at the front and back of the each array to ensure that all components are receiving power and are functional. While the drives are spinning up, the LEDs will blink.
Page 94: To Establish A Network Connection
The array displays the banner information, which appears similar to the following: Login: root Password: <Return> T3B Release 2.00 2001/04/02 15:21:29 (192.168.209.243) Copyright (C) 1997-2001 Sun Microsystems, Inc. All Rights Reserved. :/:<1> Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 95 3. Use the passwd command to set a password for the root account. Press Return when prompted for the OLD password. :/:<1>passwd OLD password: <Return> NEW password: New password NEW password (confirm): New password :/:<2> Note – It is important to set a root password for security reasons. 4.
Page 96 8. Use the set command to confirm the setting. :/:<7> set bootmode tftp bootdelay 103676 10.4.31.28 netmask 255.255.255.0 gateway 10.4.31.1 tftphost 10.4.31.83 tftpfile t4ssl.bin hostname InUseByAlbert timezone :America/Los_Angeles vendor 0301 model 501-5710-02(51) revision 0200 logto /Apr02 loglevel rarp 00:20:f2:01:94:fc 9. Set the date using the date command. The date syntax is yyyymmddHHMM.SS.
Page 97: To Verify The Firmware Level And Configuration
11. On the host, exit the telnet session by pressing Control and the right bracket (]) symbol. The telnet prompt is displayed. Type quit. # <Control>] telnet>quit To Verify the Firmware Level and Configuration The array contains various types of firmware that are peculiar to the array model. The Sun StorEdge T3+ array contains the following firmware: Controller firmware: Level 1...
Page 98 Here is an example of header information for a Sun StorEdge T3+ array: :/:<5>ver T3B Release 2.00 2001/08/02 15:21:29 (192.168.209.243) Copyright (C) 1997-2001 Sun Microsystems, Inc. All Rights Reserved. In this example, the Sun StorEdge T3+ array is shown running 2.00 level 3 controller firmware.
Page 99 4. Type fru list to display the firmware versions for the disk drives and interconnect card on both array models. For example (enterprise configuration): :/:<6>fru list TYPE VENDOR MODEL REVISION SERIAL ------ ----------------- ----------- ----------- ------------- -------- u1ctr controller card 0034 501-5710-02( 0200 123456...
Page 100 Sun StorEdge T3+ array level 2 controller firmware, the level 2 image is 0200. 5. Refer to the SunSolve web site at http://sunsolve.sun.com for the latest firmware release information: a. In the SunSolve Online column, click on Patches. b. In the Patches column, click on PatchPro. c.
Page 101 8. Type sys stat to view the controller status. An example of sys stat output for a single controller unit: :/:<9>sys stat Unit State Role Partner ----- --------- ------ ------- ONLINE Master An example of sys stat output for a partner group: :/:<10>sys stat Unit State...
Page 102 10. Type fru stat to display the health status of each FRU. All FRUs must be in optimal condition, as shown in this example for a workgroup configuration: :/:<12>fru stat CTLR STATUS STATE ROLE PARTNER TEMP ------ ------- ---------- ---------- ------- ---- u1ctr...
Page 103: Installing The Administration Tools
Installing the Administration Tools The Sun StorEdge T3+ array can be used with management software, such as Sun StorEdge Component Manager, to aid in the operation, monitoring, and management of one or more arrays that are connected to a host. Sun StorEdge Component Manager software enables you to administer some of the components of the array, and it constantly monitors system health.
Page 104: Figure 6-8 Disk Drive Physical Numbering
The physical location of the disk drives is shown in FIGURE 6-8 Disk Drive Physical Numbering FIGURE 6-8 If you want to change the default configuration, do not continue with this section. Instead, refer to the Sun StorEdge T3+ Array Administrator’s Manual for information on how to remove the default volume and reconfigure the disk drives.
Page 105: To Configure The Workgroup
To Configure the Workgroup To display and mount the default volume of a single controller unit: 1. On the array, type vol stat to check the status of the volume. :/:<2> vol stat u1d1 u1d2 u1d3 u1d4 u1d5 u1d6 u1d7 u1d8 u1d9 unmounted...
Page 106 3. Use the vol stat command to verify that the volume is mounted. :/:<5> vol stat u1d1 u1d2 u1d3 u1d4 u1d5 u1d6 u1d7 u1d8 u1d9 mounted After the volume is mounted, it becomes available to the attached host system. Note – If you are running on the Solaris 7, 11/99 operating environment or a later release of the Solaris operating environment, skip Step 4 and proceed to Step 5.
Page 107: To Configure The Enterprise
5. Verify that the new volume is available to the host system by using the format(1M) command on the data host. 7# format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c0t0d0 <SUN4.2G cyl 3880 alt 2 hd 16 sec 135> /pci@1f,4000/scsi@3/sd@0,0 1.
Page 108 3. Type vol stat to verify that the volume on the master controller unit is mounted. :/:<3> vol stat u1d1 u1d2 u1d3 u1d4 u1d5 u1d6 u1d7 u1d8 u1d9 mounted 4. Use the vol add command to create the default volume on the alternate master as follows: a.
Page 109 7. Use the vol mount command to mount the volume on the alternate master. :/:<7>vol mount v1 8. Type vol list to confirm that you created the volume correctly. <8>vol list volume capacity raid data standby 143.2 GB u1d1-9 none 143.2 GB u2d1-9 none...
Page 110: Changing The Default Configuration
10. Verify that the new volume is available to the host system by using the format(1M) command on the data host. # format Searching for disks...done AVAILABLE DISK SELECTIONS: 0. c0t0d0 <SUN4.2G cyl 3880 alt 2 hd 16 sec 135> /pci@1f,4000/scsi@3/sd@0,0 1.
Page 111: Connecting The Host System
Connecting the Host System This section contains procedures that are performed on the host system for the array. Have the documentation for the host available to assist you in completing these tasks. “Verifying the Data Host Connection” on page 89 “Establishing Logical Volumes on the Host”...
Page 112: Establishing Logical Volumes On The Host
Establishing Logical Volumes on the Host Using the format(1M) utility within the Solaris environment, you can view the disk space available on the array from the host. At this point in the installation process, you can use this disk space as you would any physical disk. This includes performing operations such as installing a file system, using the device as a raw device, or partitioning the device.
Page 113: To Establish Alternate Pathing On The Host
Second, you can use third-party software on the host to create as many partitions as desired from a given volume. In the Solaris environment, VERITAS Volume Manager can be used for this purpose. For information on using the format utility, refer to the format(1M) man page. For more information on third-party software such as VERITAS Volume Manager, refer to the documentation for that product.
Page 114 a. On the host, use the telnet command with the array name (or IP address) to connect to the array. # telnet array-name Trying 129.150.47.101... Connected to 129.150.47.101. Escape character is ’^]’. pSOSystem (129.150.47.101) b. Log in to the array by typing root and your password at the prompts. 2.
Page 115 4. Type port list to display the world-wide name (wwn). An example of port list output for a partner group: :/:<7>port list port targetid addr_type status host u1p1 hard online 50020f23000003c3 u2p1 hard online 50020f2300000341 5. Use the wwn from the port list output to correlate the volume to the Solaris environment by using the format(1M) utility on the data host.
Page 116: Powering Off And On
Powering Off and On You do not need to power off the array except under the following circumstances: Hardware reconfiguration Relocation Centerplane and chassis replacement Emergency, such as a threat of flooding To Power Off Caution – This procedure will power off the array and all arrays connected to it. Note –...
Page 117: To Power On
Power switches Power Switch Locations FIGURE 6-9 To Power On When powering on a configuration, always power on the arrays before booting the host server. Power on the master unit by pressing the power button on each power and cooling unit. At this point, all power and cooling unit LEDs on the array and any units connected to it will turn green, indicating that power has been restored.
Page 118 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 119: Controller Firmware Version 2.1 Upgrade
C H A P T E R Controller Firmware Version 2.1 Upgrade This chapter explains how to upgrade the Sun StorEdge T3+ array controller firmware version 2.0 or 2.0.1 to version 2.1. This chapter contains the following topics: “Upgrading Overview” on page 98 “Upgrading Requirements”...
Page 120: Upgrading Overview
Upgrading Overview To upgrade controller firmware version 2.1, perform the following steps: 1. Check to see that the requirements are met. See “Upgrading Requirements” on page 98. 2. Make sure that your requirements are not in conflict with the section “Upgrading Limitations”...
Page 121: Upgrading Limitations
Upgrading Limitations 1. Once the upgrade is completed and volume slicing is enabled, you cannot revert back to the prior controller firmware version without reconfiguring the entire system. This would require that you: a. Back up all the data to a safe location. b.
Page 122: Connecting To The Array
Connecting to the Array This section contains the following topics: “To Establish an ftp Session” on page 100 “To Establish a Telnet Session” on page 101 To Establish an ftp Session To establish an ftp session: 1. Start an ftp session from the management host to the array. For example: mgmt-host:/:<15>ftp 123.123.123.2 Connected to 123.123.123.2.
Page 123: To Establish A Telnet Session
To Establish a Telnet Session The Telnet session is a direct network link to the array unit through the command- line interface (CLI). You can execute individual commands to query and repair the unit from this interface. The Telnet session requires access to the unit’s IP address. The CLI can then be run from any host that is part of the same subnetwork.
Page 124 3. To view the available commands on the array, type help at the prompt. :/:<1>help telnet date echo head help mkdir ping rmdir tail touch boot disable disk enable logger more passwd port proc reset shutdown sync tzset refresh route For more information on how to set up the syslog file and interpret it, see “Connecting to the Array”...
Page 125: To Determine The Firmware Version
. In this case “2.00.01” represents firmware version TABLE 7-1 2.0.1 and an upgrade to version 2.1 is appropriate. T3B Release 2.00.01 2001/01/04 15:18:16 (10.4.32.211) Copyright (C) 1997-2001 Sun Microsystems, Inc. All Rights Reserved. Level 3 Firmware Version Check Output for Master Unit FIGURE 7-1...
Page 126: Upgrading The System Firmware
Upgrading the System Firmware The controller firmware cannot be upgraded on an operational system. And for the upgrade to take effect, the controller must be reset (rebooted). While the controller reboots, the array is not available for storage. This procedure must be done through an Ethernet connection. The following conditions apply to this patch and firmware upgrade: The patch and firmware have to be resident on the host.
Page 127 2. Verify communication with the Sun StorEdge T3+ array to be upgraded. $ ping IP_address t3 is alive Where IP_address is the T3+ IP address 3. Establish a telnet session to the Sun StorEdge T3+ array controller as described in “To Establish a Telnet Session”...
Page 128: Table 7-2 T3.Sh Utility Installation Prompts
The t3.sh utility prompts for the information shown in TABLE 7-2 t3.sh Utility Installation Prompts TABLE 7-2 Prompt Information Required Please Enter Hostname or IP Hostname or IP address of the target Sun StorEdge T3+ Address of Target T3+ To Be arra system Upgraded: Please Enter Patch Location...
Page 129: To Install The Interconnect Card Firmware
To Install the Interconnect Card Firmware The Interconnect card firmware is stored in the flash memory device on the interconnect card. The array can be operational during the interconnect card firmware upgrade. 1. Check the Interconnect Cards firmware version by typing: :/: lpc version LOOP A LOOP B...
Page 130 2. Use the fru stat command to find the Interconnect card port IDs. These are listed under “LOOP.” :/: fru stat CTLR STATUS STATE ROLE PARTNER TEMP ------ ------ ---------- ---------- ------- ---- u1ctr ready enabled master u2ctr 28.0 u2ctr ready enabled alt master...
Page 131: To Upgrade The Controller Firmware
3. Upgrade all Interconnect cards in an enterprise configuration by typing: :/: lpc download u2l1 lpc_05.02 :/: lpc download u2l2 lpc_05.02 :/: lpc download u1l1 lpc_05.02 :/: lpc download u1l2 lpc_05.02 4. Verify the results by typing: :/: lpc version LOOP A LOOP B Enclosure 1...
Page 132 4. Reboot the Sun StorEdge T3+ array by typing: :/: reset -y Note – If, during the boot process, a controller detects a firmware version on the system disk different from the image loaded in flash, the controller will reflash its local level 3 image and reset.
Page 133: To Verify The Upgrade
. In this case, “2.01.00” represents firmware version TABLE 7-3 2.1 and indicates that the upgrade was successful. T3B Release 2.01.00 2002/03/05 13:18:16 (10.4.32.211) Copyright (C) 1997-2001 Sun Microsystems, Inc. All Rights Reserved. Level 3 Firmware Version Check Output for Master Unit FIGURE 7-2...
Page 134 2. Use the vol mode command to verify that the volumes have been mounted, and that cache mirroring has been turned on. The following is an example of the vol mode command output that shows volumes are mounted properly and cache mirroring is enabled in an enterprise configuration. :/: vol mode volume mounted...
Page 135 4. Use the fru stat command to verify that the state of all components in the arrays is enabled. The following is an example of fru stat command output from an enterprise configuration that indicates all components are operating properly: :/: fru stat CTLR STATUS...
Page 136 5. Use the fru list command to make sure that all components in both arrays are detected by the host. The following is an example of fru list command output from an enterprise configuration that shows all components detected by the host: :/: fru list TYPE VENDOR...
Page 137: Post-Installation Global Parameters Configurations
C H A P T E R Post-Installation Global Parameters Configurations Before an array is shipped, the global parameters are set to default values. This chapter describes how to reconfigure your array by changing these default values. Caution – If you are planning an enterprise configuration using new factory units, be sure to install and set up the units as a partner group before you power on, and change any parameters or create or change any logical volumes.
Page 138: Configuring Cache
Configuring Cache Each Sun StorEdge T3 array controller unit has a 256-Mbytes data cache; each Sun StorEdge T3+ array controller unit has 1 GByte of data cache. Writing to cache improves write performance by staging data in cache, assembling the data into data stripes, and then destaging the data from cache to disk, when appropriate.
Page 139: Data Block Size Configuration
None. No reads or writes are cached. Note – For full redundancy in an enterprise configuration, set the cache mode and the mirror variable to Auto. This ensures that the cache is mirrored between controllers and that write-behind cache mode is in effect. If a failure occurs, the data is synchronized to disk, and then write-through mode takes effect.
Page 140: Mirrored Cache Enabling
Attribute-intensive NFS file system, version 3 64-Kbyte data block size Data-intensive NFS file system, version 3 Decision Support Systems (DSS) Data Warehouse (DW) High Performance Computing (HPC) Note – The data block size must be configured before any logical volumes are created on the units.
Page 141: Configuring Logical Volumes
Configuring Logical Volumes Also called a logical unit number (LUN), a logical volume is one or more disk drives that are grouped together to form a single unit. Each logical volume is represented to the host as a logical unit number. Using the utility on the application host, format you can view the logical volumes presented by the array.
Page 142: Determining The Number Of Logical Volumes
Determining the Number of Logical Volumes You can configure a volume into seven partitions (also known as slices) using the (1M) utility. Alternatively, you can configure virtually a large number of format partitions (also known as subdisks) using VERITAS Volume Manager. Therefore, arrays are best configured as one large volume.
Page 143: Determining A Hot-Spare
The following applications benefit most from the RAID controller hardware of the array: Data-intensive NFS file system, version 3 Note – For more information about RAID levels, see “Using RAID Levels to Configure Redundancy” on page 123. Determining a Hot-Spare A hot-spare is always optional.
Page 144: Creating And Labeling A Logical Volume
Creating and Labeling a Logical Volume You must set the RAID level and the hot-spare disk when you create a logical volume. For the Solaris operating system to recognize a volume, it must be labeled with the or fmthard command. format Caution –...
Page 145: Using Raid Levels To Configure Redundancy
Using RAID Levels to Configure Redundancy The RAID level determines how the controller reads and writes data and parity on the drives. The Sun StorEdge T3+ array can be configured with RAID level 0, RAID level 1 (1+0), or RAID level 5. The factory-configured LUN is a RAID 5 LUN. Note –...
Page 146: Raid
RAID 0 Data blocks in a RAID 0 volume are striped across all the drives in the volume in order. There is no parity data, so RAID 0 uses the full capacity of the drives. There is, however, no redundancy. If a single drive fails, all data on the volume is lost. shows the data layout in a RAID 0 volume.
Page 147: Raid 5
RAID 5 In a RAID level 5, data is striped across the drives in the volumes in segments, with parity information striped across the drives, as well. Because of this parity, if a single drive fails, data can be recovered from the remaining drives. Two drive failures cause all data to be lost.
Page 148 Sun StorEdge T3+ Array Installation and Configuration Guide • April 2002...
Page 149: Post-Installation Array Settings Configuration
C H A P T E R Post-Installation Array Settings Configuration This chapter describes how to reconfigure the default settings of the array as well as how to monitor the array. Topics in this chapter include: “Reconfiguring the Array Settings” on page 128 “Monitoring the Array”...
Page 150: Reconfiguring The Array Settings
Reconfiguring the Array Settings The array is set with the following default configuration: A RAID volume configuration Cache mode set to auto Disk drives set to autodisable and autoreconstruct These default settings and other possible configurations are described in the following sections.
Page 151: Raid Levels
Note – If you are creating new volumes or changing the volume configuration, you must first manually rewrite the label of the previous volume by using the autoconfigure option of the format(1M) utility. Refer to the Sun StorEdge T3+ Array Administrator’s Manual for more information on this procedure. Examples of valid volume configurations are shown in TABLE 9-1 Examples of Volume Configurations...
Page 152: Table 9-2 Cache Transition States
Four cache modes are supported: auto, write-behind, write-through, and none. The default mode for the Sun StorEdge T3+ Array is auto. In the auto cache mode, the caching mode is write-behind if the array has full redundancy available. If any component is nonredundant, the cache mode is set to write-through.
Page 153: Disabling And Reconstructing A Drive
Cache Transition States (Continued) TABLE 9-2 Failure or Problem Write-Behind Cache State Interconnect card 2 Disabled Interconnect card 1+2 Disable (system down) Controller Disable (controller failover) Battery Disabled Battery warranty expires Disabled Battery refresh Disable (hold time low) 28-day battery refresh Disable (during 12-minute battery discharge) Power and cooling unit 1 Disabled...
Page 154: Monitoring The Array
Monitoring the Array You can monitor the array remotely by using any of the following tools: Sun StorEdge Component Manager software Simple Network Management Protocol (SNMP) notification syslog error reports StorEdge Component Manager The Sun StorEdge Component Manager software provides a graphical user interface (GUI) to monitor and manage one or more arrays that are connected to a host.
Page 155: Syslog Error Reports
An SNMP MIB file is provided with the array for use with SNMP-based applications. The MIB file is located in the following directory on the array: /web/snmp/t300.mib To use this file, use ftp to transfer this MIB file from the array to your SNMP management host and refer to your specific SNMP management documentation for correct MIB file installation procedures.
Page 156 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 157: Post-Installation Partner Groups Configuration
C H A P T E R Post-Installation Partner Groups Configuration This chapter describes how to configure array partner groups. Sun StorEdge T3+ arrays can be interconnected in partner groups to form a redundant and larger storage system. Note – The terms partner group and enterprise configuration refer to the same type of configuration and are used interchangeably in this document.
Page 158: Understanding Partner Groups
Understanding Partner Groups In a partner group, there is a master controller unit and an alternate master controller unit. The master controller unit is the array positioned at the bottom of an array stack in either a rackmounted or tabletop installation. The alternate master controller unit is positioned on top of the master controller unit.
Page 159: How Partner Groups Work
The partner group connection also allows for a single point of control. The bottom unit will assume the role of the master, and from its Ethernet connections, it will be used to monitor and administer the unit installed above it. The master controller unit will set the global variables within this storage system, including cache block size, cache mode, and cache mirroring.
Page 160: Creating Partner Groups
Note – In order for a feature such VERITAS DMP to access a LUN through both controllers in a redundant partner group, the parameter must be set to mp_support to enable this feature. If you are using Sun StorEdge Traffic Manager, the mp_support parameter must be set to mpxio.
Page 161: Post-Installation Host Connections
C H A P T E R Post-Installation Host Connections This chapter describes the host bus adapters (HBAs) that are supported by Sun StorEdge T3+ arrays. Topics in this chapter include: “Sun Enterprise SBus+ and Graphics+ I/O Boards” on page 140 “Sun StorEdge PCI FC-100 Host Bus Adapter”...
Page 162: Sun Enterprise Sbus+ And Graphics+ I/O Boards
Sun Enterprise SBus+ and Graphics+ I/O Boards The SBus+ and Graphics+ I/O boards each provide mounting for two Gigabit Interface Converters (GBICs). For more detailed information about these I/O boards, refer to the Sun Enterprise 6x00/5x00/4x00/3x00 Systems SBus+ and Graphics+ I/O Boards Installation Guide.
Page 163: Sun Storedge Pci Fc-100 Host Bus Adapter
Sun StorEdge PCI FC-100 Host Bus Adapter The Sun StorEdge PCI FC-100 host bus adapter is a 33-MHz, 100 Mbytes/second, single-loop Fibre Channel PCI host bus adapter with an onboard GBIC. This host bus adapter is PCI Version 2.1-compliant. For more detailed information about this product, refer to the Sun StorEdge PCI FC-100 Host Adapter Installation Manual.
Page 164: Sun Storedge Sbus Fc-100 Host Bus Adapter
Sun StorEdge SBus FC-100 Host Bus Adapter The Sun StorEdge SBus FC-100 host bus adapter is a single-width Fibre Channel SBus card with a Sun Serial Optical Channel (SOC+) application-specific integrated circuit (ASIC). You can connect up to two loops to each card, using hot-pluggable GBICs.
Page 165: Sun Storedge Pci Single Fibre Channel Network Adapter
Sun StorEdge PCI Single Fibre Channel Network Adapter The Sun StorEdge PCI Single Fibre Channel network adapter is a Fibre Channel PCI card with one onboard optical receiver. This network adapter is PCI Version 2.1-compliant. For more detailed information about this product, refer to the Sun StorEdge PCI Single Fibre Channel Network Adapter Installation Guide.
Page 166: Sun Storedge Pci Dual Fibre Channel Network Adapter
Sun StorEdge PCI Dual Fibre Channel Network Adapter The Sun StorEdge PCI Dual Fibre Channel network adapter is a Fibre Channel PCI card with two onboard optical transceivers. This network adapter is PCI Version 2.1-compliant. For more detailed information about this product, refer to the Sun StorEdge PCI Dual Fibre Channel Network Adapter Installation Guide.
Page 167: Compact Pcisun Storedge Compactpci Dual Fibre Channel Network Adapter
Compact PCISun StorEdge CompactPCI Dual Fibre Channel Network Adapter The Sun StorEdge CompactPCI Dual Fibre Channel network adapter has two 1-Gbit Fibre Channel ports on a cPCI card. For more detailed information about this product, refer to the Sun StorEdge CompactPCI Dual Fibre Channel Network Adapter Installation Guide.
Page 168 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 169: Post-Installation Array Cabling
C H A P T E R Post-Installation Array Cabling This chapter describes the array configurations supported by the Sun StorEdge T3+ arrays. Topics in this chapter include: “Overview of Array Cabling” on page 148 “Workgroup Configurations” on page 150 “Enterprise Configurations”...
Page 170: Overview Of Array Cabling
Overview of Array Cabling Sun StorEdge T3+ arrays supports the following connections: One FC-AL interface to the application host One Ethernet interface to the management host (by way of a LAN) for administration purposes One serial interface to be used for service tasks by qualified service personnel only Interconnect ports for configuring arrays into partner groups Data Path...
Page 171: Figure 12-1 Sun Storedge T3+ Array Controller Card And Interconnect Cards
Note – An array enterprise configuration is not supported by Sun Cluster 2.2. Note – In a workgroup (standalone) configuration, these interconnect cards cannot be used to connect to the administrative console or to the application host. These interconnect cards are used solely for ensuring redundancy and failover mechanisms in partner groups.
Page 172: Workgroup Configurations
Workgroup Configurations The following configuration rules apply to array workgroup configurations FIGURE 12-2 The interconnect ports, which are used only in partner group configurations, cannot be used for host connections. The FC-AL connection provides a data path to the application host. The Ethernet connection provides a link to the management host.
Page 173: Enterprise Configurations
Enterprise Configurations The following rules configuration rules apply to enterprise (partner group) configurations ( FIGURE 12-3 The interconnect ports, which are used only in enterprise configurations, cannot be used for host connections. The FC-AL connection provides a data path to the application host. The Ethernet connection provides a link to the management host.
Page 174 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 175: Troubleshooting The Array
C H A P T E R Troubleshooting the Array This chapter describes how to approach troubleshooting the array. Use the information in this chapter along with the Sun StorEdge T3+ Array Administrator’s Manual or Sun StorEdge Component Manager User’s Guide to determine the service required.
Page 176: Ofdg Notice
ofdg Notice Note – Sun StorEdge T3+ array ofdg utility is for service use only. This utility makes data unavailable. The Sun StorEdge T3+ array firmware provides a command-line and graphical user interface to a diagnostics tab provided by Sun StorEdge Component Manager 2.2. The ofdg utility is used to perform offline diagnostic testing.
Page 177: Analyzing The Problem
Analyzing the Problem To begin the problem analysis, check one or a combination of the following four resources, as described in the following sections. “Host-Generated Message” on page 155 “Telnet Session” on page 156 “Array LEDs” on page 156 Host-Generated Message The data host sees the array as one or two logical volumes.
Page 178: Telnet Session
Telnet Session The Telnet session is a direct network link to the array unit by means of the command-line interface (CLI). You can run individual commands to query and repair the unit from this interface. The Telnet session requires access to the unit’s IP address.
Page 179: Power And Cooling Unit Leds
Disk drive LEDs Disk Drive LEDs (Viewed Through Front Cover) FIGURE 13-1 Disk Drive LED Descriptions TABLE 13-1 Drive Activity Drive Status (green) (amber) Description Drive is not installed (not recognized) Slow blink Drive is spinning up or down Solid Drive is OK and is idle Flashing Drive is OK and is active...
Page 180: Figure 13-2 Power And Cooling Unit Leds
AC LED PS LED Power and Cooling Unit LEDs FIGURE 13-2 Power and Cooling Unit LED Descriptions TABLE 13-2 AC LED (green PS LED or amber) (green or amber) Description Power is off No AC power is available Amber Power is off Power switch turned off AC power is available array...
Page 181: Interconnect Card Leds
Power and Cooling Unit LED Descriptions (Continued) TABLE 13-2 AC LED (green PS LED or amber) (green or amber) Description Green Blinking green Battery on refresh cycle Green Blinking amber Indicates one or more of the following: • PCU disabled •...
Page 182: Controller Card Leds
Interconnect card 1 Interconnect card 2 Interconnect Card LEDs FIGURE 13-3 Interconnect Card LED Descriptions TABLE 13-3 Interconnect Card Status LED (green or amber) Description Interconnect card not installed (not recognized) Green-solid Interconnect card OK Cable OK (if present) Green-slow blink Interconnect card OK Cable bad;...
Page 183: Figure 13-4 Sun Storedge T3+ Array Controller Card Leds
Sun StorEdge T3+ Array Controller Card LEDs The Sun StorEdge T3+ array controller card has two channel-active LEDs—one for the FC-AL interface port and one for the Ethernet port—and a controller status (online) LED. lists the possible states of the controller card LEDs and TABLE 13-4 describes each state.
Page 184: Channel Connection Failures
Channel Connection Failures Host-to-array channel failures occur when the connection between the array and the host is either severed or intermittent. The components that make up this data channel connection are: Host bus adapter (HBA), which resides on the host GBIC adapter, used to connect the FC-AL cable to an SBus HBA Fibre Channel cable that connects the array to the host Channel interface port in the array...
Page 185: Servicing The Array
C H A P T E R Servicing the Array This chapter contains information about removing and replacing the field- replaceable units (FRUs) in an array and upgrading software and firmware. Caution – Any FRU that is removed must be replaced within 30 minutes or the array and all attached arrays will automatically shut down and power off.
Page 186: Ofdg Notice
ofdg Notice Note – Sun StorEdge T3+ array ofdg utility is for service use only. Use of this feature will make data unavailable. The Sun StorEdge T3+ array firmware provides a command-line and graphical user interface to a diagnostics tab provided by Sun StorEdge Component Manager 2.2. The ofdg utility is used to perform offline diagnostic testing.
Page 187: Preparing For Service
Preparing for Service Follow these procedures to help prevent damaging FRUs: Wear a grounding wrist strap. Before handling a FRU, discharge any static electric charge by touching a ground surface. Do not remove a FRU from its antistatic protective bag until it is ready for installation.
Page 188: Disk Drives
Disk Drives Caution – Replace only one disk drive in an array at a time to ensure that no data is lost. Ensure that the disk drive is fully reenabled before replacing another disk drive in the same array. The default configuration for the array is to automatically spin up and reenable a replaced disk drive, then automatically reconstruct the data from the parity or hot- spare disk drives.
Page 189: To Remove And Replace A Disk Drive
To Remove and Replace a Disk Drive 1. Observe static electricity precautions. 2. Remove the front panel by pressing in on the side latches (shown in FIGURE 14-1 and pulling the front panel forward. Latch Latch Removing the Front Panel FIGURE 14-1 3.
Page 190: Figure 14-3 Releasing The Latch Handle
4. Use a coin or small screwdriver to press in and release the drive latch handle FIGURE 14-3 Releasing the Latch Handle FIGURE 14-3 5. Use the latch handle to slowly pull the disk drive out an inch. Wait 30 seconds before pulling the drive out completely, giving the disk drive time to spin down.
Page 191: Figure 14-4 Removing A Disk Drive
Removing a Disk Drive FIGURE 14-4 7. Push in the latch handle on the removed disk drive to protect it from damage. 8. Release the latch handle on the disk drive to be installed. 9. Insert the new disk drive gently on the middle of the rails and push it in until it is seated with the centerplane connector.
Page 192: Power And Cooling Units
Power and Cooling Units The power and cooling unit has two active power sources: standby and primary power. Standby power, which is used to power the microcontroller on the interconnect card, is activated when AC power is present. Primary power, which is used to power all remaining circuits and disk drives, is activated when AC or battery power is present and the power switch is on.
Page 193: Power And Cooling Unit Leds
Power and Cooling Unit LEDs Each power and cooling unit has an AC LED and a power supply (PS) LED. For information about the power and cooling unit LEDs and how to interpret them to diagnose a failure, see “Power and Cooling Unit LEDs” on page 171. Note –...
Page 194: Figure 14-6 Removing The Power And Cooling Unit
Caution – Any power and cooling unit that is removed must be replaced within 30 minutes or the array and all attached arrays will automatically shut down and power off. Latch handle Latch handle Removing the Power and Cooling Unit FIGURE 14-6 6.
Page 195: Ups Battery
UPS Battery The UPS battery is located within the power and cooling unit. The battery provides backup in case of a complete AC power failure and will sustain power to the array long enough to flush cache data to the drives. During a power failure, if the battery is flushing cache data to the drives, battery power becomes depleted.
Page 196: Removing And Replacing The Ups Battery
The battery service life is two years. When the battery approaches the end of its life span, warning messages are sent to the syslog file. The first message is sent 45 days before the end of the life span, followed by a warning message every 5 days thereafter.
Page 197: To Removing And Replacing An Interconnect Card
Note – Even if the LED indicates an interconnect card failure, you should always verify the FRU status using either the CLI or Sun StorEdge Component Manager before replacing the unit. Refer to the Sun StorEdge T3+ Array Administrator’s Manual or Sun StorEdge Component Manager User’s Guide for more information.
Page 198: Figure 14-7 Removing The Interconnect Card
3. Remove the interconnect cable from the failed interconnect card only ( FIGURE 14-7 Mark the connector with either 1 or 2. 4. Unlock the failed interconnect card by pushing in on the latch handle. Latch handle Removing the Interconnect Card FIGURE 14-7 5.
Page 199: Controller Card
Controller Card The controller card is redundant only when the array is configured in an enterprise configuration; that is, when the array is connected to another array that contains a controller card. In an enterprise configuration, if there is a controller card failure in a master unit, the controller would failover to the alternate master, which would then assume master controller status.
Page 200: Figure 14-8 Removing The Controller Card
4. Remove the fiber-optic cable from the FC-AL connector. 5. Unlock the controller card by pushing in on the latch handles ( FIGURE 14-8 6. Pull the controller card out using the latch handles. Caution – The controller card that is removed must be replaced within 30 minutes or the array and all attached arrays will automatically shut down and power off.
Page 201: Chassis
Note – After replacing the controller card, you might need to upgrade the controller firmware and EPROM firmware to make sure you are running the same firmware versions that you had on the previous controller card. To upgrade the controller firmware, see “Controller Firmware Version 2.1 Upgrade”...
Page 202 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 203: Table A-1 Power Specifications
A P P E N D I X Specifications Topics in this chapter include: “Power Specifications” on page 182 “Environmental Specifications” on page 183 “Mechanical Specifications” on page 184 “Cable Specifications” on page 185...
Page 204: Power Specifications
Power Specifications Refer to TABLE A-1 Power Specifications TABLE A-1 Specification Rating Voltage and frequency 100 to 240 VAC, 47 to 63 Hz Input current 5A max Input power 450W max Heat load 1540 BTUs/hr max Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 205: Environmental Specifications
Environmental Specifications Refer to TABLE A-2 Environmental Specifications TABLE A-2 Specifications Operating Non-operating Notes Temperature 41°F (5°C) to 95°F 68°F (-20°C) to 140°F (60°C) (35°C) with with maximum gradient 20°C maximum gradient per hour 20°C per hour Relative humidity 20 to 80% 5 to 93% noncondensing with nonconducting with maximum gradient 10% per...
Page 206: Table A-3 Physical Specifications
Mechanical Specifications To provide adequate clearance for FRU replacement, allow accessibility in front and rear of chassis. Allow a minimum of four inches in the front and rear for air circulation (the airflow direction is from front to rear). Refer to TABLE A-3 Physical Specifications TABLE A-3...
Page 207: Cable Specifications
Cable Specifications Refer to TABLE A-4 Cable Specifications TABLE A-4 Cable Type Connector Maximum Length Host interface (FC-AL): 82.021 ft (25 m) • Sun StorEdge T3 array DB-9 copper requires copper adapter (MIA) • Sun StorEdge T3+ array LC-SFF requires LC-SFF to SC fiber- optic cable Shielded Ethernet: RJ45...
Page 208 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 209 A P P E N D I X Illustrated Parts This appendix contains part numbers and illustrations of field-replaceable units (FRUs) for the Sun StorEdge T3+ array. See TABLE B-1 Illustrated Part Numbers TABLE B-1 Part Part Number Page Number Disk drive in canister;...
Page 210: Figure B-1 Disk Drive In Canister
Disk Drive in Canister FIGURE B-1 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 211: Figure B-2 Sun Storedge T3+ Array Controller Card
Sun StorEdge T3+ Array Controller Card FIGURE B-2 Interconnect Card FIGURE B-3 Power and Cooling Unit FIGURE B-4 Appendix B Illustrated Parts...
Page 212: Figure B-5 Cables, Adapters, And Cords
Interconnect cable Power cord Fiber-optic cable, Sun StorEdge T3+ array Shielded Ethernet cable (category 5), Sun StorEdge T3+ array Cables, Adapters, and Cords FIGURE B-5 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 213: Figure B-6 Door Assembly (Front Panel)
Front panel Door Assembly (Front Panel) FIGURE B-6 Appendix B Illustrated Parts...
Page 214 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 215: Glossary
Glossary administrative domain Partner groups (interconnected controller units) that share common administration through a master controller. alternate master controller unit Also called alternate master unit, the secondary array unit in a partner group that provides failover capability from the master controller unit. Alternate Pathing (AP) A mechanism that reroutes data to the other array controller in a partner group...
Page 216 command-line interface (CLI) The interface between the Sun StorEdge T3 and T3+ array’s pSOS operating system and the user in which the user types commands to administer the array. controller unit A Sun StorEdge T3 and T3+ array that includes a controller card. It can be use as a standalone unit or configured with other Sun StorEdge T3 and T3+ arrays.
Page 217 Fibre Channel Arbitrated Loop (FC-AL) A 100 Mbyte/s serial channel that enables connection of multiple devices (disk drives and controllers). field-replaceable unit (FRU) A component that is easily removed and replaced by a field service engineer or a system administrator. FLASH memory device (FMD) A device on the controller card that stores EPROM firmware.
Page 218 input/output operations per second (IOPS) A performance measurement of the transaction rate. interconnect cable An FC-AL cable with a unique switched-loop architecture that is used to interconnect multiple Sun StorEdge T3 and T3+ arrays. interconnect card An array component that contains the interface circuitry and two connectors for interconnecting multiple Sun StorEdge T3 and T3+ arrays.
Page 219 multi-initiator configuration A supported array configuration that connects two hosts to one or more array administrative domains through hub or switch connections. parity Additional information stored with data on a disk that enables the controller to rebuild data after a drive failure. partner group A pair of interconnected controller units.
Page 220 reverse address resolution protocol (RARP) A utility in the Solaris operating environment that enables automatic assignment of the array IP address from the host. An industry standard name used to describe a connector standard. Simple Network Management Protocol (SNMP) A network management protocol designed to give a user the capability to remotely manage a computer network.
Page 221 workgroup configuration A standalone array connected to a host system. world wide name (WWN) A number used to identify array volumes in both the array system and Solaris environment. write caching Data used to build up stripes of data, eliminating the read-modify-write overhead.
Page 222 Sun StorEdge T3+ Array Installation and Configuration Manual • April 2002...
Page 223 Index auto cache mode, 116 AC power cord connection, 68 administration path, 148 alternate master controller unit, 57 battery, 173 Alternate Pathing (AP) removing and replacing See power and cooling conﬁguration recommendations, 18 unit array architecture of, 11 components of, 4 controller card and ports, 6 default conﬁguration, 81 cabled partner group, 70...
Page 224 See Sun Cluster 2.2 support components, 4 data, 86 controller card description, 5 data block size disk drive description, 4 deﬁnition, 117 power and cooling unit description, 9 data path, 148 configurations default configuration, 81 direct host changing, 88 single host with eight controllers, 33, 34 disabling and reconstructing disk drives, 131 single host with four controllers, 31 disk drive, 4...
Page 225 fiber-optic cable hw conﬁguration, 70 illustrated, 190 mounting volumes, 81 network connection, 72 field-replaceable units (FRUs), 191 post instructions, 115 front panel, 56 power on/off, 94 illustrated, 191 preparing, 53, 54 removing and replacing, 167 required patches, 59 ftp, 100 setting the IP address, 57 steps, 64 verifying fw, 75...
Page 226 array monitoring, 132 array settings, 127 MAC address, 17 concept of partner group, 136 location of, 56 conﬁguring cache, 116 master controller unit, 57 conﬁguring logical volumes, 119 in a partner group, 137 global parameters conﬁguration, 115 parameters controlled by, 18 host connection, 139 mechanical specifications, 184 partner group conﬁguration, 135...
Page 227 multi-host environments, 25 multi-platform, 25 scalability, 10 SAN switch support, 23 serial number location, 56 syslog command, 133 service system area, 12 centerplane, 179 chassis, 179 controller card, 177 interconnect card, 174 power and cooling units, 170 telnet preparing, 165 command, 101 removing and replacing components, 165 connection, 101...
Page 228 workgroup configuration, 28 conﬁguration rules, 150 write-behind cache mode, 116 write-through cache mode, 116 Sun StorEdge T3+ Array Installation and Conﬁguration Guide • April 2002...

Sun Microsystems StorEdge T3+ Installation And Configuration Manual

Table of Contents

Overview of the Sun Storedge T3+ Array

Supported Configurations

Supported Software

Hub Host Connection

Figure 4-11 Dual Hosts with Two Hubs and Eight Controller Units Configured as Four Partner Groups

Preparing to Install

Array Installation

Controller Firmware Version 2.1 Upgrade

Post-Installation Host Connections

Preparing for Service

Quick Links

Chapters

Related Manuals for Sun Microsystems StorEdge T3+

Summary of Contents for Sun Microsystems StorEdge T3+