Sun Microsystems StorEdge T3 Service Manual
  1. Manuals
  2. Brands
  3. Sun Microsystems Manuals
  4. Storage
  5. Sun StorEdge T3
  6. Service manual
Sun Microsystems StorEdge T3 Service Manual

Sun Microsystems StorEdge T3 Service Manual

Array
Hide thumbs Also See for StorEdge T3:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Configuration Manual, User Manual
Sun StorEdge
T3 and T3+ Array
™
Field Service Manual
Sun Microsystems, Inc.
901 San Antonio Road
Palo Alto, CA 94303-4900 U.S.A.
650-960-1300
Part No. 816-0779-10
September
2001, Revision A
Send comments about this document to: docfeedback@sun.com

Advertisement

Table of Contents
loading

Related Manuals for Sun Microsystems StorEdge T3

Summary of Contents for Sun Microsystems StorEdge T3

  • Page 1 Sun StorEdge T3 and T3+ Array ™ Field Service Manual Sun Microsystems, Inc. 901 San Antonio Road Palo Alto, CA 94303-4900 U.S.A. 650-960-1300 Part No. 816-0779-10 September 2001, Revision A Send comments about this document to: docfeedback@sun.com...
  • Page 2 Sun, Sun Microsystems, the Sun logo, AnswerBook2, docs.sun.com, JumpStart, Sun StorEdge, StorTools, SunSolve, and Solaris are trademarks, registered trademarks, or service marks of Sun Microsystems, Inc. in the U.S. and other countries. All SPARC trademarks are used under license and are trademarks or registered trademarks of SPARC International, Inc. in the U.S. and other countries. Products bearing SPARC trademarks are based upon an architecture developed by Sun Microsystems, Inc.

  • Page 3: Regulatory Compliance Statements

    Regulatory Compliance Statements Your Sun product is marked to indicate its compliance class: Federal Communications Commission (FCC) — USA Industry Canada Equipment Standard for Digital Equipment (ICES-003) - Canada Voluntary Control Council for Interference (VCCI) — Japan Bureau of Standards Metrology and Inspection (BSMI) — Taiwan Please read the appropriate section that corresponds to the marking on your Sun product before attempting to install the product.
  • Page 4 ICES-003 Class B Notice - Avis NMB-003, Classe B This Class B digital apparatus complies with Canadian ICES-003. Cet appareil numérique de la classe B est conforme à la norme NMB-003 du Canada. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 5 Regulatory Compliance Statements...

  • Page 6: Bsmi Class A Notice

    BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 7: Safety Agency Compliance Statements

    Modifications to Equipment power cords into a grounded power outlet that is Do not make mechanical or electrical modifications to the nearby the system and is readily accessible. equipment. Sun Microsystems is not responsible for regulatory compliance of a modified Sun product.

  • Page 8: Lithium Battery

    Aus – Unterbricht die Wechselstromzufuhr zum herein may result in hazardous radiation exposure. Gerät. Wartezustand (Stand-by-Position) - Der Ein-/ Wartezustand-Schalter steht auf Wartezustand. Änderungen an Sun-Geräten. viii Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 9 Nehmen Sie keine mechanischen oder elektrischen Die folgende Warnung gilt nur für Geräte mit Wartezustand- Änderungen an den Geräten vor. Sun Microsystems Netzschalter: übernimmt bei einem Sun-Produkt, das geändert wurde, keine Verantwortung für die Einhaltung behördlicher Achtung – Die Ein/Aus-Schalter dieses Geräts Vorschriften.
  • Page 10 La température des surfaces est élevée et leur électrique du local, veuillez vous adresser au contact peut provoquer des blessures corporelles. directeur de l’exploitation ou à un électricien qualifié. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 11 Ne remplacez cette batterie que par une descargas eléctricas o daños en el equipo. batterie Sun Microsystems du même type. Ne la démontez pas et n’essayez pas de la recharger hors du système. Ne faites pas brûler la batterie mais mettez-la au rebut conformément aux...
  • Page 12 Precaución – De acuerdo con la norma DIN 45 635, sección 1000, se admite un nivel de presión acústica para puestos de trabajo máximo de 70Db(A). Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 13 Batería de litio GOST-R Certification Mark Precaución – En las placas de control del sistema hay Nordic Lithium Battery Cautions una batería de litio insertada en el reloj de tiempo real, tipo SGS Núm. MK48T59Y, MK48TXXB-XX, Norge MK48T18-XXXPCZ, M48T59W-XXXPCZ, M4T28- XXYYSHZ o MK48T08.
  • Page 14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 15: Table Of Contents

    Host-Generated Message 1-2 Sun StorEdge Component Manager 1-4 Sun StorEdge StorTools Software 1-4 Static Electricity Precautions 1-5 Connecting to the Sun StorEdge T3 and T3+ Array 2-1 Establishing a Serial Port Connection Establishing a Telnet Session Establishing an FTP Session...
  • Page 16 Controller Card LEDs 4-1 Removing and Replacing a Controller Card 4-4 Upgrading Controller Firmware 4-5 4.3.1 Sun StorEdge T3 Array Controller Firmware 4-6 4.3.2 Sun StorEdge T3+ Array Controller Firmware 4-8 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 17 Disks and Drives 5-1 Monitoring Drive Status 5-1 5.1.1 Checking Drive Status Codes 5-2 5.1.2 Checking the Hot Spare 5-3 5.1.3 Checking Data Parity 5-4 5.1.4 Checking Drive Temperature 5-5 Disk Drive LEDs 5-6 Repairing Disk Drives 5-7 5.3.1 Removing and Replacing a Disk Drive 5-8 5.3.2 Rebuilding a Replaced Drive FRU 5-11 Upgrading Disk Drive Firmware 5-13...
  • Page 18 RAID Controller Replacement Procedure 8-22 8.4.3 Off-Line Drive Diagnostics and Replacement 8-23 8.4.4 Chassis Replacement Procedure 8-29 Chassis/Backplane Assembly 9-1 Troubleshooting the Chassis/Backplane Assembly 9-1 Replacing the Chassis/Backplane Assembly 9-2 xviii Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 19 Interconnect Card Assembly A-5 Power Supply and Cooling Unit A-6 Controller Card A-7 Drive Assembly A-8 Cable and Interconnect Assemblies A-9 B. Sun StorEdge T3 Array System Defaults B-1 Boot Defaults B-1 System Defaults B-2 Volume Defaults B-3 Default Directories and Files B-4...
  • Page 20 D. Sun StorEdge T3 Array System Commands D-1 Commands List D-1 FRU Identifiers D-3 E. FC-AL Loop Identifiers E-1 F. Sun StorEdge T3 Array Configuration Worksheets F-1 Worksheets F-1 System Information Worksheets F-2 Glossary Glossary-1 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 21 MAC Address on the Pull-Out Tab 3-20 FIGURE 3-4 Power Switch Locations 3-22 FIGURE 3-5 Sun StorEdge T3 Array Controller Card LEDs 4-2 FIGURE 4-1 Sun StorEdge T3+ Array Controller Card LEDs 4-3 FIGURE 4-2 Removing the Controller Card 4-4...
  • Page 22 Interconnect Card Assembly A-5 FIGURE A-4 Power Supply A-6 FIGURE A-5 Controller Card A-7 FIGURE A-6 Drive Assembly A-8 FIGURE A-7 Cables and Interconnects A-9 FIGURE A-8 xxii Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 23 Diagnostic Functions and Tools TABLE 3-1 Firmware Status Indicators 3-13 TABLE 3-2 FC-AL Channel-Active LED Descriptions (Sun StorEdge T3 array) 4-2 TABLE 4-1 Controller Status LED Descriptions (Sun StorEdge T3 array) 4-2 TABLE 4-2 Sun StorEdge T3+ Array Controller Card LED Descriptions 4-3...
  • Page 24 Firmware Status Boot Messages C-6 TABLE C-6 Commands Listed in Alphabetical Order D-2 TABLE D-1 FRU Identifiers D-3 TABLE D-2 Assigned Loop Identifier E-1 TABLE E-1 Sun StorEdge T3 and T3+ array Information Worksheet F-2 TABLE F-1 xxiv Book Title • Month 2001...

  • Page 25: Preface

    Preface The Sun StorEdge T3 and T3+ Array Field Service Manual is designed to provide the qualified service-trained maintenance provider with sufficient information to effectively troubleshoot and resolve any Sun StorEdge™ T3 or T3+ array failure. The procedures in this manual describe how to isolate the failure, remove and replace component(s), effectively reconfigure the module and system, and place the product back into the customer’s network.
  • Page 26 Chapter 1 provides a troubleshooting overview on the Sun StorEdge T3 and T3+ array. Chapter 2 describes how to connect to and boot the Sun StorEdge T3 and T3+ array. Chapter 3 provides the qualified service provider with troubleshooting techniques for the Sun StorEdge T3 and T3+ array.
  • Page 27 Using UNIX Commands ® This document contains some information on basic UNIX commands and procedures such as booting the devices. For more information outside of this document, see the following: AnswerBook2™ online documentation for the Solaris™ software environment Other software documentation that you received with your system Preface xxvii...

  • Page 28: Typographic Conventions

    Shell Prompts Shell Prompts TABLE P-2 Shell Prompt C shell machine_name% C shell superuser machine_name# Bourne shell and Korn shell Bourne shell and Korn shell superuser xxviii Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 29: Related Documentation

    Related Documentation Application Title Part Number Installation overview Sun StorEdge T3 and T3+ Array Start Here 816-0772 Safety procedures Sun StorEdge T3 and T3+ Array Regulatory 816-0774 and Safety Compliance Manual Site preparation Sun StorEdge T3 and T3+ Array Site...
  • Page 30 Sun is interested in improving its documentation and welcomes your comments and suggestions. You can email your comments to Sun at: docfeedback@sun.com Please include the part number (816-0779-10) of your document in the subject line of your email. xxx Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 31: Troubleshooting Overview

    An understanding of a network storage environment is required before any troubleshooting can take place. Each Sun StorEdge T3 and T3+ array can be structured to a maximum of two different RAID volumes, or logical unit numbers (LUNs). This means that each array...

  • Page 32: Error Messages And Logs

    StorEdge T3 and T3+ array, and to the individual components in the array. Error Messages and Logs Both the Sun StorEdge T3 and T3+ array and the host server create log message files of system conditions and events. These log files are the most useful immediate tools for troubleshooting.
  • Page 33 Indicates a system event that has no impact upon the system or storage networks ability to perform tasks. The syntax of the error message uses a field-replaceable unit (FRU) identifier to refer to a particular FRU in a Sun StorEdge T3 and T3+ array ( ). This identifier TABLE 1-2...

  • Page 34: Sun Storedge Component Manager

    Component Manager User’s Guide. Sun StorEdge StorTools Software Errors in the host data channel are outside of the scope of the Sun StorEdge T3 and T3+ array. To determine failures in the data path, use host-based application diagnostics, such as the Sun StorEdge StorTools™ product for the Solaris operating environment.

  • Page 35: Static Electricity Precautions

    Host-to-array channel failures occur when the connection between the array and the host is either severed or intermittent. The components that make up this data channel connection are: Host bus adapter (HBA), which resides on the host Gigabit interface converter (GBIC) adapter, used to connect the FC-AL cable to an SBus HBA Fibre Channel cable that connects the array to the host Media interface adapter (MIA), which converts the light source from the host to...
  • Page 36 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 37 C H A P T E R Connecting to the Sun StorEdge T3 and T3+ Array This chapter describes how to connect to the Sun StorEdge T3 and T3+ array and contains the following sections: Section 2.1, “Establishing a Serial Port Connection” on page 2-1 Section 2.2, “Establishing a Telnet Session”...

  • Page 38: Figure 2-1 Serial Port Location

    1. Connect a serial cable from the serial port on the array master unit to any host system available serial port. Note – The serial cables used by the Sun StorEdge T3 and T3+ arrays are different. Both cables are supplied in the F370-4119-02 Diagnostic Kit. The T3 array uses the serial cable with RJ-11 connectors and the T3+ array uses the serial cable with RJ-45 connectors.

  • Page 39: Connecting To The Sun Storedge T3 And T3+ Array

    If the Sun StorEdge T3 disk tray is being booted, the following message is displayed: auto boot is enabled hit the RETURN key within 3 seconds to cancel... In a boot situation, if the Return key is pressed within 3 seconds, the array stops booting and the EPROM takes control of the array.
  • Page 40 Section 2.6, “Setting Up Remote Logging” on page 2-10, and for information on how to use the CLI commands, see Sun StorEdge T3 and T3+ Array Administrator’s Guide. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 41: Establishing An Ftp Session

    2. Log in to the array by typing root and the supervisor password at the prompts. Name (123.123.123.2:root): root 331 Password required for root. Password: password 230 User root logged in. ftp> Note – Be sure to set Binary mode if transferring firmware. Chapter 2 Connecting to the Sun StorEdge T3 and T3+ Array...

  • Page 42: Using Tftpboot To Boot A Single Array Or A Partner Group Remotely

    4. Set the array boot mode to tftpboot. T3-1>set bootmode tftp T3-1>set bootmode tftp bootdelay 3 000596 123.123.123.4 netmask 255.255.255.0 gateway 0.0.0.0 tftphost 123.123.123.6 tftpfile nb100.bin hostname mgmts-host spindelay 0 revision 0210 00:20:f2:00:02:ba rarp Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 43 RETURN key within 3 seconds to cancel... Initializing TFTP... Loading 123.123.123.6:nb113.bin login: 7. Copy the firmware from the tftp boot server to the Sun StorEdge T3 and T3+ array. Chapter 2 Connecting to the Sun StorEdge T3 and T3+ Array...
  • Page 44 (If you forget this step, the system will continue doing tftpboots.) :/:<4>set bootmode auto 10. Reset the system. :/:<5>reset Reset the system, are you sure? [N]: y 11. Reconnect the Ethernet cable to the alternate master. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 45: Configuring A Server For Remote Booting

    Configuring a Server for Remote Booting If a Sun StorEdge T3 and T3+ array is unable to boot you can use tftboot to reload the firmware. This requires configuring a remote server. To configure a remote server to tftp boot a Sun StorEdge T3 and T3+ array, follow these steps: 1.

  • Page 46: Setting Up Remote Logging

    Setting Up Remote Logging The Sun StorEdge T3 and T3+ array can provide remote notification of array events to designated hosts using Simple Network Management Protocol (SNMP) traps. To enable SNMP notification, edit the /etc/syslog.conf and the /etc/hosts files on the array to configure system message logging. Because files cannot be edited on the array, ftp the files to a host to make the edits and then ftp the files back to the array.
  • Page 47 Diagnosing Problems This chapter provides the qualified service provider with troubleshooting techniques for the Sun StorEdge T3 and T3+ array and contains the following sections: Section 3.1, “Diagnostic Information Sources” on page 3-1 Section 3.2, “Troubleshooting Flow Charts” on page 3-3 Section 3.3, “Initial Troubleshooting Guidelines”...

  • Page 48: Table 3-1 Diagnostic Functions And Tools

    OFDG = Off-line Drive Diagnostic utility as described in Section 8.3.8, “Using the ofdg Diagnostic Utility” on page 8-16. SNMP = Simple Network Monitoring Protocol as described in Sun StorEdge T3 and T3+ Array Administrator’s Guide. SNMP(CA) = Simple Network Monitoring Protocol used with a customer-written application as described in Sun StorEdge T3 and T3+ Array Administrator’s Guide.

  • Page 49: Diagnosing Problems

    StorTools(M) = The StorTools application runs on a management host as described in Sun StorEdge StorTools User’s Guide, Version 4.1. syslog = Sun StorEdge T3 and T3+ array syslog file. syslog(CA) = Sun StorEdge T3 and T3+ array syslog with customer-written application. SRS = Sun Remote Service.
  • Page 50 Data Connection Troubleshooting Flow Chart FIGURE 3-1 Note that only SBus systems can test with a loopback plug. You cannot use a loopback cable with a PCI card. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 51 Unable to Telnet to the array from the same subnet. Have you ever been able to access this array through the network? Ensure the network cables are properly connected. Fix network cable and On Admin host is the correct reset the array. Can ENET address in /etc/ethers it be accessed? file and correct IP address in...
  • Page 52 Can DONE to resolve the conflict. you access the array? Change RAID controller board. Set up IP address. Procedure “A” FIGURE 3-3 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 53: Initial Troubleshooting Guidelines

    3.3.1 Troubleshooting Sources 1. The array LEDs, which provide a visual status as described in Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual. 2. Sun StorEdge T3 array generated messages, found in a log file, indicating a problem or system status with the array.

  • Page 54: Verifying The Data Host Connection

    3.5.1 Primary Path Verification by the Host To determine a Sun StorEdge T3 array’s primary and alternate paths, from the host console, do the following: Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 55 [disk formatted] In this example, four Sun StorEdge T3 disk devices are shown as disk numbers 2 through 5. They are identified by the SUN-T3-0100 label. Note – To view device paths using the format command, the mp_support setting on the array must be set to rw.
  • Page 56 - show vendor, product and revision scsi - independent SCSI mode selects volname - set 8-character volume name !<cmd> - execute <cmd>, then return0 quit scsi> inquiry 3-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 57: Verifying Hub Connectivity

    The output of the inquiry command is as follows (the sample output below assumes that mp_support is set to rw (otherwise there is only one path to each volume): Inquiry: 00 00 03 12 5b 00 10 02 53 55 4e 20 20 20 20 20 ..[...SUN 54 33 30 30 20 20 20 20 20 20 20 20 20 20 20 20 30 30 39 36 30 30 30 30 30 32 35 38 31 30 00 00...
  • Page 58 2. Boot the array. There are several ways to initiate a boot cycle: Power off the Sun StorEdge T3 or T3+ array and power on again. Log into a disk tray and issue a reset command. Log into a disk tray and issue a shutdown command (this requires a power cycle to get the system to start booting).

  • Page 59: Table 3-2 Firmware Status Indicators

    Firmware status codes are good indicators of internally detected system and configuration problems. In the previous boot message example, a firmware status of 3 is displayed. This status implies the array is ready for operation. lists TABLE 3-2 other firmware status codes that can be reported through the serial-port console during a array boot cycle.

  • Page 60: Telnet Connection Status Checks

    In a failover state, unit 2 assumes the role of master controller and unit 1 is disabled, as shown in the following example: :/:<3>sys stat Unit State Role Partner ----- --------- ------ ------- DISABLED Slave ONLINE Master 3-14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 61: Verifying The Firmware Level And Configuration

    In the example above, the WWN of 50020f23000002ba identifies the port and volume match. 3.7.2 Verifying the Firmware Level and Configuration The Sun StorEdge T3 array has four different types of firmware: Controller firmware. See Section 4.3, “Upgrading Controller Firmware” on page 4-5”. Controller electrically erasable programmable read-only memory (EPROM) firmware.
  • Page 62 Escape character is ’^]’. pSOSystem (123.123.123.3) 2. Log in to the array by typing root and the supervisor password at the prompts. The array prompt is displayed. 3-16 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 63 3. Enter ver to identify the controller firmware. For example: :/:<5>ver T3 Release 1.13 2000/05/17 16:15:41 (129.150.47.104) Copyright (C) 1997-2000 Sun Microsystems, Inc. All Rights Reserved. The ver command displays the header information. In the example above, the controller firmware is listed as Release 1.13...

  • Page 64: Checking Fru Status

    3-18 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 65: Testing The Array With Stortools

    Note – The fru stat command reports temperature readings on the interconnect cards, controller board, disk drives, and PCUs. For the PCU, the fru stat output does not display a temperature value, but reports a normal value. For all other FRUs, fru stat reports a numerical temperature.

  • Page 66: Figure 3-4 Mac Address On The Pull-Out Tab

    Edit the /etc/ethers file by adding the MAC address and array name. For example: 8:0:20:7d:93:7e array name In this example: 8:0:20:7d:93:7e is the MAC address is the name of the master controller unit. array name 3-20 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 67 b. Edit the /etc/hosts file with the IP address and array name. For example: 123.123.123.111 array name In this example, 123.123.123.111 is the assigned IP address. c. Edit the /etc/nsswitch.conf file to reference the local system files. To ensure the Solaris software environment uses the changes made to /etc/ethers and /etc/hosts files, edit the host and ethers entries in the /etc/nsswitch.conf file so that the files parameter appears before the [NOTFOUND=return] statements as shown:...

  • Page 68: Figure 3-5 Power Switch Locations

    Inoperable network connections. If using hubs to connect to the network, try eliminating or replacing the hub. Incorrect IP address. Connect to the array through the serial port, and verify that the IP address is correct. 3-22 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 69: Identifying Data Channel Failures

    (MIA) attached to the array. Errors in the host data channel are outside of the scope of the Sun StorEdge T3 and T3+ array. To determine failures in the data path, use host-based application diagnostics, such as the StorTools product for the Solaris operating environment.
  • Page 70 3-24 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 71: Controller Card Assembly

    Section 4.3, “Upgrading Controller Firmware” on page 4-5 Controller Card LEDs The controller card LEDs for a Sun StorEdge T3 array differ from that of a Sun StorEdge T3+ array. The controller LEDs of both array models are described in the following sections.

  • Page 72: Figure 4-1 Sun Storedge T3 Array Controller Card Leds

    Controller boot, shutdown, or firmware download in progress Blinking amber Controller failure; OK to replace controller Note—Verify a controller card failure using the CLI or Sun StorEdge Component Manager. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 73 Sun StorEdge T3+ Array Controller Card LEDs The Sun StorEdge T3+ array controller card has two channel-active LEDs, one for the FC-AL interface port and one for the Ethernet port, and a controller status (online) LED. lists the possible states of the controller card LEDs and describes each TABLE 4-3 state.

  • Page 74: Removing And Replacing A Controller Card

    (redundant controller unit configuration). Caution – A removed controller card must be replaced within 30 minutes or the Sun StorEdge T3 and T3+ array and all attached arrays will automatically shut down and power off. To replace the controller card: 1.

  • Page 75: Upgrading Controller Firmware

    The following conditions apply to firmware upgrades: The firmware has to be resident on the host for this operation. The Sun StorEdge T3 and T3+ array has to have a supervisor password prior to attempting this procedure. Chapter 4 Controller Card Assembly...

  • Page 76: Sun Storedge T3 Array Controller Firmware

    Press the power button on each power and cooling unit to remove AC power. c. Press the power buttons again to return AC power to the array. Caution – Power cycling a Sun StorEdge T3 and T3+ array causes an interruption in array operation.
  • Page 77 The generalized firmware upgrade procedures described below must be done through the Ethernet connection. The firmware must be resident on the host for this operation. Note – Create a supervisor password for the Sun StorEdge T3 and T3+ array prior to attempting this procedure. To upgrade the EPROM firmware: 1.

  • Page 78: Sun Storedge T3 Array Controller Firmware

    The level 1 code starts at 0xFFF00100 and extends to 0xFFF20000. If there is no valid level 2 code, the code prints 0 after T3B- and reboot. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 79 Second Level Boot Code The second level boot code is comparable to the EPROM mode of the Sun StorEdge T3 Array except the auto bootmode will boot from ROM instead of from disks. The level 2 code allows the user to: Set basic system configuration.
  • Page 80 The file content must be the binary image to be loaded into ROM or RAM. It cannot be an elf file, a hex file, or a srecord file. 4-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 81 The following explains each field in the header. Channel Active LED Descriptions TABLE 4-4 Header Description This is the size of the code without the header information. code_size This value must be a multiple of four. The real file size should be code_size plus sizeof (EP_HEADER).
  • Page 82 See Section 2.1, “Establishing a Serial Port Connection” on page 2-1. Note – The serial cables used by the Sun StorEdge T3 and T3+ arrays are different. Both cables are supplied in the F370-4119-02 Diagnostic Kit. The T3 array uses the serial cable with RJ-11 connectors and the T3+ array uses the serial cable with RJ-45 connectors.
  • Page 83 3. Reset the controller and press any key on the console when the system prompt appears (within three seconds). 4. Set the bootmode and tftp settings as follows: T3B-EP> set bootmode tftp T3B-EP> set tftphost xxx.xxx.xxx.xxx Where xxx.xxx.xxx.xxx is the host IP address. 5.
  • Page 84 Press the power button on each power and cooling unit to remove AC power. c. Press the power buttons again to return AC power to the array. 4-14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 85 Note – If during the boot process, a controller detects a level 3 firmware version on the system disk different than the level 3 image loaded in flash, the controller will reflash its local level 3 image and reset. This can appear as two sequential boot cycles.
  • Page 86 4-16 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 87: Disks And Drives

    C H A P T E R Disks and Drives This chapter describes how to monitor and replace the disk drives, upgrade the firmware, and repair corrupted disk labels. This chapter contains the following sections: Section 5.1, “Monitoring Drive Status” on page 5-1 Section 5.2, “Disk Drive LEDs”...

  • Page 88: Checking Drive Status Codes

    Drive is spun up Drive is disabled Drive has been replaced Invalid system area on drive Drive not present Drive is disabled and is being reconstructed Drive substituted Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 89: Checking The Hot Spare

    5.1.2 Checking the Hot Spare 1. Use the vol list command to check the location of the hot spare (standby) drive. :/:<41> vol list volume capacity raid data standby 125.2 GB u1d1-8 u1d9 125.2 GB u2d1-8 u2d9 2. Use the vol stat command to check the status of the hot spare drive. :/:<42>...

  • Page 90: Checking Data Parity

    Note – It is a good practice to run vol verify before recycling backup tapes to be sure the image is correct before over-writing previous images. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 91: Checking Drive Temperature

    5.1.4 Checking Drive Temperature Use the fru stat command on the array to check disk drive temperatures. :/:<43> fru stat CTLR STATUS STATE ROLE PARTNER TEMP ------ ------- ---------- ---------- ------- ---- u1ctr ready enabled master u2ctr 33.5 u2ctr ready enabled alt master u1ctr...

  • Page 92: Disk Drive Leds

    Disk Drive LED Descriptions TABLE 5-2 Drive Activity Drive Status (Green) (Amber) Descriptions Drive not installed (not recognized) Slow blink Drive is spinning up or down Solid Drive OK, idle Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 93: Repairing Disk Drives

    To prevent automatic reenabling of the disk drive, change the default setting using the sys command. For more information on the sys command, refer to the Sun StorEdge T3 and T3+ Array Administrator’s Guide. Chapter 5 Disks and Drives...

  • Page 94: Removing And Replacing A Disk Drive

    3. Locate the disk drive that needs to be replaced. Disk drives are numbered from 1 to 9 starting on the left side of the array. Disk 1 Disk 9 Disk Drive Numbering FIGURE 5-3 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 95: Figure 5-4 Releasing The Latch Handle

    Push in the latch handle on the removed disk drive to protect it from damage. Caution – Any disk drive that is removed must be replaced within 30 minutes or the Sun StorEdge T3 and T3+ array and all attached arrays will automatically shut down and power off.

  • Page 96: Figure 5-5 Removing A Disk Drive

    (u) number (n) dn is the drive (d) number(n). See Section 5.4, “Upgrading Disk Drive Firmware” on page 5-13,” for instructions, if necessary. 5-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 97: Rebuilding A Replaced Drive Fru

    5.3.2 Rebuilding a Replaced Drive FRU A replaced drive FRU should begin to rebuild itself automatically. Note – Data is not copied back from a hot spare to a newly replaced data drive until the reconstruction of data to the hot spare from parity is completed. This means that you might not see any activity lights immediately after replacing a drive.
  • Page 98 5-12 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 99: Upgrading Disk Drive Firmware

    Upgrading Disk Drive Firmware The latest disk drive firmware versions are located on the SunSolve web site: http://sunsolve.sun.com During a disk drive firmware download, the functionality of the array is limited. To avoid system problems, verify that: A current backup copy of array data exists. The data path to the host has been quiesced.
  • Page 100 Component Manager. 9. Use the fru list command to verify that the firmware download was successful. The current drive firmware level is displayed in the fru list output. 5-14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 101: Clearing Corrupted Disk Labels

    10. Use the reset command to reboot the Sun StorEdge T3 and T3+ array after all drives have been upgraded. :/:<3> reset 11. After the array is back online, log in to the array and verify that all FRU states are optimal as follows: a.
  • Page 102 /web, and /webgui directories so the array works correctly with Component Manager. To recover from corrupted labels, do the following: 1. Configure the tftpboot server so the Sun StorEdge T3 and T3+ array can be tftp booted. See Section 2.5, “Configuring a Server for Remote Booting” on page 2-9.
  • Page 103 5. Verify the boot values with the set command. :/: set bootmode auto bootdelay 3 000596 123.123.123.7 netmask 255.255.255.0 gateway 0.0.0.0 tftphost 123.123.123.6 tftpfile nb113.bin hostname T3-1 vendor model 0082f-f0 revision 0210 logto loglevel rarp 00:20:f2:00:02:ba Where: bootmode should be tftp tftphost should be the IP address of the tftpboot host machine tftpfile is the file you specified in Step 3 6.
  • Page 104 12. Reset the Sun StorEdge T3 and T3+ array. :/: reset -y The array should cleanly boot off its own disks. 13. Recreate the volumes and restore customer data. 5-18 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 105: Interconnect Card Assemblies

    C H A P T E R Interconnect Card Assemblies This chapter describes how to monitor and replace the interconnect card, and upgrade firmware. The chapter contains the following sections: Section 6.1, “Interconnect Card LEDs” on page 6-2 Section 6.2, “Removing and Replacing an Interconnect Card” on page 6-3 Section 6.3, “Upgrading Interconnect Card Firmware”...

  • Page 106: Interconnect Card Leds

    CLI or Component Manager before replacing the interconnect card. Refer to Section 3.7.3, “Checking FRU Status” on page 3-18, or the Sun StorEdge Component Manager User’s Guide for instructions. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 107: Removing And Replacing An Interconnect Card

    Removing and Replacing an Interconnect Card Caution – Use the interconnect cables only for cabling Sun StorEdge T3 and T3+ arrays together using the interconnect card connectors. Do not use these cables for any other FC-AL connection. Caution – The interconnect card is extremely sensitive to static electricity. Use proper antistatic wrist straps and antistatic procedures when handling any FRU.

  • Page 108: Figure 6-2 Removing The Interconnect Card

    5. Pull the interconnect card out using the latch handle. Caution – The interconnect card that is removed must be replaced within 30 minutes or the Sun StorEdge T3 and T3+ array and all attached arrays will automatically shut down and power off.

  • Page 109: Upgrading Interconnect Card Firmware

    The latest firmware versions are located on the SunSolve web site: http://sunsolve.sun.com The firmware must be resident on the host for this operation. The Sun StorEdge T3 and T3+ arrays must have a supervisor password prior to attempting this procedure. To upgrade the firmware: 1.
  • Page 110 Note – It is not necessary to reboot the array for the interconnect card firmware to become effective. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 111: Power And Cooling Unit Assemblies

    C H A P T E R Power and Cooling Unit Assemblies This chapter describes how to replace the power and cooling unit and monitor the UPS battery. The chapter contains the following sections: Section 7.1, “Power and Cooling Unit” on page 7-1 Section 7.2, “Power and Cooling Unit LEDs”...

  • Page 112: Power And Cooling Unit Leds

    Each of the power and cooling units has an AC LED and a power supply (PS) LED. lists the possible conditions of these LEDs with a description of each state. TABLE 7-1 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 113: Figure 7-2 Power And Cooling Unit Leds

    7.2.1 Power and Cooling Unit LEDs Each power and cooling unit has an AC LED and a power-supply (PS) LED. lists the possible conditions of these LEDs and describes each state. TABLE 7-1 AC LED PS LED Power and Cooling Unit LEDs FIGURE 7-2 Power and Cooling Unit LED Descriptions TABLE 7-1...

  • Page 114: Removing And Replacing A Power And Cooling Unit

    Caution – Replace only one power and cooling unit at a time to prevent system interruption. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 115: Figure 7-3 Removing The Power And Cooling Unit

    Caution – Any power and cooling unit that is removed must be replaced within 30 minutes or the Sun StorEdge T3 and T3+ array and all attached arrays automatically shut down and power off.

  • Page 116: Ups Battery

    When a Sun StorEdge T3 and T3+ array is first powered up, write-behind caching is disabled (cache runs in write-through mode) for a short time. The write-behind...

  • Page 117: Checking The Battery

    Note – The batteries in the power and cooling units recharge after powering on the array. If the batteries are less than fully charged, fru stat output will display batteries in a fault condition, and write-behind cache is disabled until the batteries are charged.

  • Page 118: Battery Maintenance

    When refresh is suspended, battery write-behind caching is turned off automatically as a safety precaution. Note – During the discharge period of a refresh cycle (approximately 12 minutes), write-behind cache is turned off. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 119 The syslog file indicates battery refresh operation in progress. Use the refresh - s command to view an active refresh operation. Refer to the Sun StorEdge T3 and T3+ Array Administrator’s Guide for more information on this command. Refresh cycle time is controlled by the array’s /etc/schd.conf file.

  • Page 120: Removing And Replacing The Ups Battery

    See “Removing and Replacing a Power and Cooling Unit” on page 4. Caution – Any power and cooling unit that is removed must be replaced within 30 minutes or the Sun StorEdge T3 and T3+ array and all attached arrays automatically shut down and power off.

  • Page 121: Figure 7-5 Removing The Screws From The Pcu Bottom Panel

    Note – The battery is attached to the bottom panel of the PCU. When removing the bottom panel, do not attempt to remove it completely as the battery is still connected to the unit. Removing the Screws from the PCU Bottom Panel FIGURE 7-5 4.

  • Page 122: Figure 7-6 Lifting The Pcu Bottom Panel And Battery Slightly Away From The Unit

    Lifting the PCU Bottom Panel and Battery Slightly Away from the Unit FIGURE 7-6 7-12 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 123: Figure 7-7 The Battery Connector Details Inside The Pcu

    The Battery Connector Details Inside the PCU FIGURE 7-7 5. Remove the battery connector by pulling on if firmly straight out from the connector inside the PCU. 6. Lift the bottom panel with the battery away from the unit and set it aside as shown in FIGURE 7-8 Chapter 7 Power and Cooling Unit Assemblies...

  • Page 124: Figure 7-8 Ups Battery Setting Right Side Up

    4. Replace the PCU in the array and prepare the PCU for return to service as described in “Removing and Replacing a Power and Cooling Unit” on page 4. 7-14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 125: Diagnosing And Correcting Fc-Al Loop Problems

    CLI status commands, StorTools, StorTools message monitoring, Component Manager, the Sun StorEdge T3 array syslog, and the FC-AL connected host messages file. Data from these sources is used to determine the most likely failed FRU within the Sun StorEdge T3 array system.

  • Page 126: Normal Status

    Perform the this step only if steps 2 and 3 fail to resolve the problem. To run the loop diagnostics to identify a failed drive FRU, the Sun StorEdge T3 array must be removed from operation. Removing the array is highly disruptive to the customer.

  • Page 127: Figure 8-1 Backend Loop Configuration

    contains a block diagram showing the two back-end drive loops in a FIGURE 8-1 normal (no failures) configuration. Alternate u2 Standard mirrored loop configuration Loop 1 Loop 2 Path 0 Path 1 Interconnect card Interconnect card Loop Nonsplit loop Nonsplit loop cables Normal: Normal:...
  • Page 128 .disk pathstat (see Section 8.2.5, “The .disk pathstat Command” on page 8-7) .disk linkstat (see Section 8.2.6, “The .disk linkstat Command” on page 8-8) The examples that follow show a Sun StorEdge T3 and T3+ array in a redundant partner group configuration, with no failed FUR’s.

  • Page 129: The Fru Stat Command

    8.2.1 The fru stat Command The fru stat command returns the current condition of both disk ports (port 1 and port 2), as well as the status of the interconnect cards. If there are loop problems, this might indicate certain disk ports have a status other than ready, or the loop cards with a status other than ready or enabled.

  • Page 130: The Vol Mode Command

    Note – The “+” symbol represents the presence of the isp2100 chip. .loop stat Command—Normal Ouput CODE EXAMPLE 8-4 :/:<4> .loop stat Loop 1: <1+2+> Loop 2: <1+2+> Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 131: The .Disk Pathstat Command

    Where: <1+> means u1d1-9 and u1ctr ISP2100 are on the loop. <2+> means u2d1-9 are u2ctr ISP2100 are on the loop. <1+><2+> means the loop is split into 2 segments. <1+2+> means u1d1-9 and u2d1-9 and u1ctr and u2ctr ISP2100s are all on the loop.

  • Page 132: The .Disk Linkstat Command

    If the link status register cannot be accessed this may indicate a path problem to those disk(s) ports. Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 133 Note – The Telnet session will always run the command through the master controller. Although it is possible to connect directly to the alternate controller, it is not supported. .disk linkstat Command—Normal Ouput CODE EXAMPLE 8-6 :/:<9> .disk linkstat u1d1-9 path 0 DISK LINKFAIL LOSSSYNC LOSSSIG PROTOERR INVTXWORD INVCRC -------------------------------------------------------- u1d1...

  • Page 134: Diagnosing An Fc-Al Loop

    The program looks through this log file at a customer- determined 8-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 135 4. A fourth indication of a problem may be a warning or error log entry in the local Sun StorEdge T3 array syslog file. Examine this file by using CLI commands via a Telnet or Tip connection. This file can also be transferred via ftp to another host for examination and archiving.

  • Page 136: Checking Performance Against Baseline Data

    If the customer regularly runs a performance monitoring program where thresholds have been set, the iostat command shows whether one path to a Sun StorEdge T3 and T3+ array partner group is not performing to the established base line. For...

  • Page 137: Stortools Message Monitoring

    In this example, this data was pulled by StorTools message monitoring from the remote host log file that the Sun StorEdge T3 array sent syslog entries to. StorTools message monitoring was run on that host and scanned the log looking for array log file messages of a warning or error class.

  • Page 138: Example Syslog Error Messages

    Sep 28 07:15:05 T3A ISR1[1]:W:SCSI Disk Error Occurred (path = 0x1, port = 0x1, lun = 0x0) Sep 28 07:15:05 T3A ISR1[1]:W:Sense Data Description = SCSI Parity Error Sep 28 07:18:03 T3A ISR1[1]:W:Sense Data Description = SCSI Parity Error 8-14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 139: Using Cli Diagnostic Commands

    8.3.7 Using CLI Diagnostic Commands Once the syslog file has been examined for warning or error messages and a conclusion is reached on which loop might have failed, other CLI commands can be used to verify or support that conclusion. These commands display the various status and current configuration of the loops.

  • Page 140: Using The Ofdg Diagnostic Utility

    Before running the ofdg utility, all disks other than those located in the u1 tray must be assigned to a LUN. Problems might occur if ofdg is run on systems where non u1 disks have not been assigned to volumes. 8-16 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 141 ofdg does not detect missing loop cables. ofdg output goes to the syslog and serial port only. ofdg assumes at least one back-end loop cable is functional. After installing a new drive, wait two minutes before running ofdg. Follow these steps to run ofdg: 1.
  • Page 142 The fast_test option uses only the two worst case data patterns as shown below: #define ONDG_PATTERN_FOUR 0x7E7E7E7E /* from SUN */ #define ONDG_PATTERN_SIX 0x4A4A4A4A /* from SUN */ 8-18 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 143 For each data pattern, the fast_test option performs the following: 2 synchronous Write/Read/Compares at 64-KB. 250 asynchronous Read/Writes at 64-KB. Monitors for errors (using all the FC-AL port counters on the Loop DUT, plus the counters from the single disk DUT). 8.3.8.3 The ofdg fast_find Option The fast_find option provides a fast Go/No-Go Loop test (identical to...
  • Page 144 If you observe this behavior, replace both back-end interconnect cables and run the ofdg operation again. 8-20 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 145: Repair Procedures

    Repair Procedures Begin by replacing the FRU that have the minimum impact to the customer’s operation, as shown in the following order: 1. Section 8.4.1, “Interconnect Card Replacement Procedure” on page 8-21 2. Section 8.4.2, “RAID Controller Replacement Procedure” on page 8-22 3.

  • Page 146: Raid Controller Replacement Procedure

    Consult your VERITAS documentation for VERITAS diagnostic procedures. 7. Verify the repair by using the listed CLI status commands. See Section 8.3.7, “Using CLI Diagnostic Commands” on page 8-15. 8-22 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 147: Off-Line Drive Diagnostics And Replacement

    The test to use is the ofdg off-line diagnostic utility. The ofdg diagnostic requires the Sun StorEdge T3 array partner group to be removed from host access. This is a highly disruptive procedure that stops all data access to the disk tray. Coordinate and schedule this down time with the customer.
  • Page 148 :/:<4> vol unmount v0 6. Disconnect the fiber optic cables from the array MIAs. 7. Disable Component Manager polling to the target Sun StorEdge T3 array. Consult your Component Manager documentation for details. 8. Establish a serial connection and Tip session to the Master RAID controller of the problem array.
  • Page 149 10. From the host Tip session, set the logto to 1 and the loglevel to 4. :/:<5> set logto 1 :/:<6> set loglevel 4 These settings display all messages to the Tip session screen. The output includes all messages from information up to error. 11.
  • Page 150 May 26 19:19:41 ISR1[1]: N: u1ctr ISP2100[0] Received LIP(f7,ef) async event May 26 19:19:43 SVDT[1]: N: 10 fcal ports were detected on l1 May 26 19:20:04 BELP[1]: N: u1l1 ONDG No Loop Trouble Found 8-26 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 151 May 26 19:20:04 CFGT[1]: N: u1ctr: Release A Loop: A Mask=<1>; B Mask=<1> May 26 19:20:05 ISR1[1]: N: u1d4 SVD_PATH_FAILBACK: path_id = 1 May 26 19:20:05 ISR1[1]: N: u1d5 SVD_PATH_FAILBACK: path_id = 1 May 26 19:20:05 ISR1[1]: N: u1d6 SVD_PATH_FAILBACK: path_id = 1 May 26 19:20:05 ISR1[1]: N: u1d7 SVD_PATH_FAILBACK: path_id = 1 May 26 19:20:05 ISR1[1]: N: u1d8 SVD_PATH_FAILBACK: path_id = 1 May 26 19:20:05 ISR1[1]: N: u1d9 SVD_PATH_FAILBACK: path_id = 1...
  • Page 152 18. Restart the volume reconstruction with the vol recon command on the replaced disk drive. :/:<16> vol recon u1d9 8-28 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 153: Chassis Replacement Procedure

    A replacement part must be on site before beginning this procedure. Before starting, the customer must off load all the data that is contained in the Sun StorEdge T3 array. The array must then be removed from host operation.
  • Page 154 8-30 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 155: Chassis/Backplane Assembly

    C H A P T E R Chassis/Backplane Assembly This chapter describes how to replace the chassis/backplane assembly and contains the following sections: Section 9.1, “Troubleshooting the Chassis/Backplane Assembly” on page 9-1 Section 9.2, “Replacing the Chassis/Backplane Assembly” on page 9-2 Troubleshooting the Chassis/Backplane Assembly The array chassis FRU rarely needs to be replaced.

  • Page 156: Replacing The Chassis/Backplane Assembly

    Caution – Replacing a Sun StorEdge T3 and T3+ array chassis interrupts array operation. Note – If the Sun StorEdge T3 and T3+ array is part of a partner group, access to all volumes in the partner group is unavailable during this backplane replacement procedure.

  • Page 157: Figure 9-1 Power Switch Location

    All arrays power down automatically when any one array in the partner group is powered down. 6. Record the Sun StorEdge T3 and T3+ array system serial number and MAC address. Locate the pull-out tab at the left side of the array next to the first disk drive as shown in .

  • Page 158: Figure 9-3 Removing The Chassis

    7. On the Sun StorEdge T3 and T3+ array, disconnect all external cables. Disconnect all power, interconnect, host FC-AL, MIA, and Ethernet cables. Note – If the array is part of a partner group, note down the placement of the host FC-AL connections and loop cables.
  • Page 159 9. Move the failed array to an area that both the front and back can be easily accessed. Caution – Use two people to lift and move the array. It can weight up to 67 lbs (30 kg). 10. One at a time, remove all the FRU components from the failed chassis and put them in the new chassis, ensuring same location placement.

  • Page 160: Figure 9-4 Serial Number And Mac Address On Pull-Out Tab

    Note – If the array is part of a partner group, make sure that the host FC-AL cables are recabled to the same Sun StorEdge T3 and T3+ array FC-AL connections that they were removed from as you noted down in Step 7. Also ensure that loop cables are properly recabled.
  • Page 161 15. On the RARP server, update the /etc/ethers file. Replace the MAC address entry of the failed chassis with the MAC address of the new chassis. For example: 8:0:20:6d:93:7e array-name In this example: 8:0:20:6d:93:7e is the new MAC address array is the name of the old array.
  • Page 162 FIGURE 9-1 on the power and cooling units show green. After you power on, the Sun StorEdge T3 and T3+ array JumpStart™ feature reassigns the array’s previous IP address to the new MAC address. Allow time to complete the boot cycle. When all LEDs are green, proceed to the next step.
  • Page 163 Note – Any applications specifically dependent on the volume’s device path also need to be changed. Refer to each application’s documentation for instructions. 25. Execute a format command on the data host to verify that the Sun StorEdge T3 and T3+ array devices are seen.
  • Page 164 9-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 165: Hardware Reconfiguration

    C H A P T E R Hardware Reconfiguration This chapter provides procedures for reconfiguring existing array hardware to create new configurations. It includes the following sections: Section 10.1, “Connecting Single Controller Units to Form a Partner Group” on page 10-1 Section 10.2, “Disconnecting a Partner Group to Form Single Controller Units”...

  • Page 166: Preparing The Arrays

    T300 Release 1.14 2000/08/01 10:43:22 (129.150.47.135) Copyright (C) 1997-2000 Sun Microsystems, Inc All Rights Reserved. In this example, the controller firmware level is listed as Release 1.14 10-2 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 167 Refer to the upgrading firmware instructions in Section 4.3, “Upgrading Controller Firmware” on page 4-5 or in Chapter 5 of the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual. Chapter 10 Hardware Reconfiguration...

  • Page 168: Cabling A Partner Group

    To change the block size, delete the master unit volumes, set the block size, and then re-create the master unit volumes. Refer to the Sun StorEdge T3 and T3+ Array Administrator’s Guide for more detailed information on setting block size.
  • Page 169 If you need to change the position in the cabinet, refer to the rackmount installation instructions in the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual. If the units are cabled to the hosts and power sources such that they cannot be placed in close proximity, rearrange the cabling so that the units can be placed together.

  • Page 170: Figure 10-1 Connecting The Interconnect Cables

    Tighten the retaining screws. The remaining connectors are reserved for expansion units. Alternate master controller unit Master controller unit Connecting the Interconnect Cables FIGURE 10-1 10-6 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 171: Establishing A New Ip Address

    A fully cabled partner group is shown below. Alternate master controller unit Master controller unit Fully Cabled Partner Group FIGURE 10-2 Caution – Do not power on the arrays yet. You must configure a RARP server, connected to the array, with the IP address before powering on. 10.1.3 Establishing a New IP Address The JumpStart feature automatically downloads a newly assigned IP address to the...

  • Page 172: Figure 10-3 Location Of Pull-Out Tab With Mac Address

    2. Edit the /etc/hosts file with the IP address and array name. For example: 192.129.122.111 array-name In this example, 192.129.122.111 is the assigned IP address. 10-8 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 173 3. Edit the /etc/nsswitch.conf file to reference the local system files. To ensure that the Solaris software environment uses the changes made to /etc/ethers and /etc/hosts files, edit the host and ethers entries in the /etc/nsswitch.conf file so that the files parameter appears before the [NOTFOUND=return] statements.

  • Page 174: Defining And Mounting Volumes On The Alternate Master

    IP address in a serial cable connection and verify that the RARP server is functional. b. Log in to the array by typing root and your password at the prompts. The array prompt is displayed. 10-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 175 2. Check the FRU status using the fru list and fru stat commands. Make sure that all FRUs are displayed and that FRU conditions are good, as shown in the following examples: :/:<1> fru list TYPE VENDOR MODEL REVISION SERIAL ------ ----------------- -----------...
  • Page 176 Note – The batteries in the power and cooling units recharge after powering on the unit. During the recharge, a fault message is displayed in the fru stat output for the batteries. While the batteries are recharging, write-behind cache is disabled. 10-12 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 177 3. Use the vol add command to create the volume(s) on the alternate master as follows: a. Define the volume name (vol add volume-nam b. Define the drives (data u dn-n) on which the volume resides, where: is the array unit number. dn-n are the disk drives, n = 1 to 9.
  • Page 178 -r) to ensure that the host recognizes the new volumes. After the luxadm command has completed, you can remount the volumes on the data host and restore the original data. 10-14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 179: Disconnecting A Partner Group To Form Single Controller Units

    10.2 Disconnecting a Partner Group to Form Single Controller Units Caution – Back up all data before beginning this procedure. This section describes how to reconfigure a partner group to form two existing single controller units. This procedure includes the following sections: Section 10.2.1, “Preparing the Arrays”...

  • Page 180: Figure 10-4 Interconnect Cable Location

    Note – Do not power on the arrays until you complete the instructions in Section 10.2.2, “Establishing a New IP Address” on page 10-17. 10-16 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 181: Establishing A New Ip Address

    10.2.2 Establishing a New IP Address In a partner group, the alternate master unit assumes the IP address of the master unit. When the partner group is disconnected, assign a new IP address to the previous alternate master unit for it to operate as a single controller unit. The JumpStart feature automatically downloads a newly assigned IP address to the array.

  • Page 182: Defining And Mounting Volumes

    Note – If you need to create a new password or change some of the parameters, such as the gateway, netmask, and others, refer to Chapter 2 of the Sun StorEdge T3 and T3+ Array Installation, Operation, and Service Manual for instructions.
  • Page 183 3. Use the vol list and vol stat commands to verify that the phantom volume has been deleted and that the existing volume remains. For example: :/:<3> vol list volume capacity raid data standby 289.6 GB u1d1-9 none :/:<4> vol stat u1d1 u1d2 u1d3...
  • Page 184 To correct this situation and ensure that the array is ready for operation: 1. Install the latest firmware patch on the array. This patch is available on the SunSolve web site: http://sunsolve.sun.com 10-20 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 185 Select the Storage Products option from the Patches web page. Refer to the README file on the web page for specific details on installing the patch for the Sun StorEdge T3 array firmware. 2. Use the vol list and vol stat commands to verify that the volume(s) is mounted correctly.
  • Page 186 If the array reports a ready status with functional FRUs, you can now restore the data, if necessary, and return the array to operation as a single controller unit. 10-22 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 187: Changing The Port Id On The Array

    To add a partner group to a hub configuration, you must set the port ID values on the arrays to unique values. Sun systems support hard addressing only. However, the port command on the Sun StorEdge T3 array contains the option to set soft addressing. Changing the setting to soft addressing can create problems with host site HBAs.
  • Page 188 10-24 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 189: Illustrated Parts Breakdown

    The following assemblies are illustrated in this chapter: Section A.1, “Sun StorEdge T3 Array” on page A-2 Section A.2, “Sun StorEdge T3 Array Assemblies” on page A-3 Section A.3, “Door Assembly” on page A-4 Section A.4, “Interconnect Card Assembly” on page A-5 Section A.5, “Power Supply and Cooling Unit”...

  • Page 190: Sun Storedge T3 Array

    Sun StorEdge T3 Array Sun StorEdge T3 Array (Front View) FIGURE A-1 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 191: Sun Storedge T3 Array Assemblies

    Sun StorEdge T3 Array Assemblies 12765 Sun StorEdge T3 Array (Back View) FIGURE A-2 Sun StorEdge T3 Array Assemblies TABLE A-1 Item Part Number Description F540-4306 Door assembly F370-3990 Empty chassis/backplane assembly F300-1454 Power supply and cooling unit F375-0084 T3 controller card (shown)

  • Page 192: Door Assembly

    Door Assembly FIGURE A-3 Door Assembly TABLE A-2 Item Part Number Description F540-4306 Door assembly F370-3990 Empty chassis/backplane assembly F540-4287 Drive assembly, 18 GB F540-4367 Drive assembly, 36 GB Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 193: Interconnect Card Assembly

    Interconnect Card Assembly 12767 Interconnect Card Assembly FIGURE A-4 Interconnect Card Assembly TABLE A-3 Item Part Number Description F375-0085 Interconnect card assembly F370-3990 Empty chassis/backplane assembly F300-1454 Power supply and cooling unit F375-0084 T3 controller card (shown) F501-5710 T3+ controller card Appendix A Illustrated Parts Breakdown...

  • Page 194: Power Supply And Cooling Unit

    Description F300-1454 Power supply and cooling unit F375-0085 Interconnect card assembly F370-3990 Empty chassis/backplane assembly F375-0084 T3 controller card (shown) F501-5710 T3+ controller card F370-3956 Battery pack, NIMH Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 195: Controller Card

    Controller Card 12766 13273 Controller Card FIGURE A-6 Controller Card TABLE A-5 Item Part Number Description F375-0084 T3 controller card F501-5710 T3+ controller card F375-0085 Interconnect card assembly F370-3990 Empty chassis/backplane assembly F300-1454 Power supply and cooling unit Appendix A Illustrated Parts Breakdown...

  • Page 196: Drive Assembly

    13564 13275 Drive Assembly FIGURE A-7 Drive Assembly TABLE A-6 Item Part Number Description F540-4287 Drive assembly, 18 GB F540-4367 Drive assembly, 36 GB F370-3990 Empty chassis/backplane assembly Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 197: Cable And Interconnect Assemblies

    Cable and Interconnect Assemblies 13271 Cables and Interconnects FIGURE A-8 Appendix A Illustrated Parts Breakdown...

  • Page 198: Table A-7 Cable And Interconnect Assemblies

    Fiber-optic cable, Sun StorEdge T3+ array (LC-SFF to SC) Shielded Ethernet cable (category 5) F537-1020 Fiber-optic cable, Sun StorEdge T3 array F370-3989 MIA adapter 1. Found in F370-4119-02 Diagnostic Cable Kit A-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 199: Sun Storedge T3 Array System Defaults

    A P P E N D I X Sun StorEdge T3 Array System Defaults This appendix lists the Sun StorEdge T3 and T3+ array defaults and is divided into the following sections: Section B.1, “Boot Defaults” on page B-1 Section B.2, “System Defaults” on page B-2 Section B.3, “Volume Defaults”...

  • Page 200: System Defaults

    Controller MAC address. Set by firmware System Defaults Specify system defaults with the sys command. See the Sun StorEdge T3 and T3+ Array Administrator’s Guide for more information on using the sys command. System Default Settings TABLE B-2...

  • Page 201: Volume Defaults

    Set by controller, read-only. In MBytes memsize Set by controller, read-only. In MBytes cache memsize Volume Defaults Specify system defaults with the vol command. See the Sun StorEdge T3 and T3+ Array Administrator’s Guide for more information. Volume Defaults TABLE B-3 Parameter...

  • Page 202: Default Directories And Files

    SNMP required file /web/snmp/T3.mib Note – At time of manufacture, Sun StorEdge T3 and T3+ array system disks do not contain controller firmware, interconnect card binaries, EP binaries, or drive firmware images. You can download all of these from the SunSolve web site.

  • Page 203: Sun Storedge T3 And T3+ Array Messages

    Sun StorEdge T3 and T3+ Array Messages This appendix contains a description of array error messages. See the Sun StorEdge T3 and T3+ Array Administrator’s Guide for explanations of the more important error messages. This chapter contains the following sections: Section C.1, “Message Syntax”...
  • Page 204 = unit number (1, 2, ...) n = interconnect number (1, 2) Disk drive undn n = unit number (1, 2, ...) n = disk drive number (1 to 9) Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 205: Reset Log Types

    Component Manager Req’d File /web/elemprop.htm Component Manager Req’d File /web/encmap.htm Component Manager Req’d File /web/sysprop.htm Component Manager Req’d File /web/voloper.htm SNMP Req’d File /web/snmp/t3.mib Contains old browser based admin files /webgui Appendix C Sun StorEdge T3 and T3+ Array Messages...

  • Page 206: Boot Messages

    Refers to the QLogic Fibre Channel driver QLCF The intelligent SCSI processor used in the T3 ISP2x00 The error checking and correcting mechanism used in the T3+ array controller Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 207 Initializing loop 1 ISP2200 ... firmware status = 3 Detected 20 FC-AL ports on loop 1 Initializing loop 2 ISP2200 ... firmware status = 3 Detected 20 FC-AL ports on loop 2 Appendix C Sun StorEdge T3 and T3+ Array Messages...
  • Page 208 A status of 7 (not participating) does not necessarily indicate a problem. The attached host might not be running, and thus cannot respond to the T3 array. Initializing host port u2p1 ISP2200 ... firmware status = 7 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 209 Found 9 disks in U1... Trying to boot from encid 1... Booting from U1D1... Executing ... Starting... T300 Release 1.16 2000/08/21 19:42:08 (129.150.28.80) Copyright (C) 1997-2000 Sun Microsystems, Inc. All Rights Reserved. Appendix C Sun StorEdge T3 and T3+ Array Messages...
  • Page 210 Starting snmpd... Starting schd... Checking disk positions... Initializing host port u1p1 ISP2100 ... firmware status = 7 Host port u1p1 TARGET_ID = 0xffff (ALPA = 0x7c) Starting psh... Login: Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 211 Found 9 disks in U2... Trying to boot from encid 1... Booting from U1D1... Executing ... Starting... T300 Release 1.16 2000/08/21 19:42:08 (129.150.28.80) Copyright (C) 1997-2000 Sun Microsystems, Inc. All Rights Reserved. Appendix C Sun StorEdge T3 and T3+ Array Messages...
  • Page 212 Waiting for configuration data from master System has 2 active controller(s) Initializing TFTP... Starting ftpd... Starting telnetd... Starting timed... Starting pshd... Starting httpd... Starting snmpd... Starting schd... Checking disk positions... C-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 213 Copyright (C) 1997-2001 Sun Microsystems, Inc. All Rights Reserved. Initializing software... Found units: [u1-ctr] Default master is u1 Starting Heartbeats... Assigning Select IDs: u1(1) Initializing system drivers... Initializing XPT component... Appendix C Sun StorEdge T3 and T3+ Array Messages C-11...
  • Page 214 Starting schd... Checking disk positions... Initializing host port u1p1 ISP2200 ... firmware status = 7 Host port u1p1 TARGET_ID = 0xffff (ALPA = 0x5) Starting psh... Login: C-12 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 215 Initializing loop 1 ISP2200 ... firmware status = 3 Detected 19 FC-AL ports on loop 1 Initializing loop 2 ISP2200 ... firmware status = 3 Detected 19 FC-AL ports on loop 2 Initializing SVD services... Appendix C Sun StorEdge T3 and T3+ Array Messages C-13...
  • Page 216 Starting schd... Checking disk positions... Initializing host port u1p1 ISP2200 ... firmware status = 7 Host port u1p1 TARGET_ID = 0xffff (ALPA = 0x5) Starting psh... Login: C-14 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 217 Initializing loop 1 ISP2200 ... firmware status = 3 Detected 20 FC-AL ports on loop 1 Initializing loop 2 ISP2200 ... firmware status = 3 Detected 20 FC-AL ports on loop 2 Initializing SVD services... Appendix C Sun StorEdge T3 and T3+ Array Messages C-15...
  • Page 218 Waiting for configuration data from master... Initializing host port u2p1 ISP2200 ... firmware status = 7 Host port u2p1 TARGET_ID = 0xffff (ALPA = 0x5) Starting psh... Login: C-16 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 219: Sun Storedge T3 Array System Commands

    A P P E N D I X Sun StorEdge T3 Array System Commands This appendix lists the commands supported by the Sun StorEdge T3 and T3+ array and is divided into the following sections: Section D.1, “Commands List” on page D-1 Section D.2, “FRU Identifiers”...
  • Page 220 CLI commands supported by the TABLE D-1 array. See the Sun StorEdge T3 and T3+ Array Administrator’s Guide for a detailed description of each command’s syntax, options, and arguments. Commands Listed in Alphabetical Order...

  • Page 221: Fru Identifiers

    = unit number (1, 2, ...) uencidl[1|2] n = interconnect card number (1, 2) Disk drive encid = unit number (1, 2, ...) uenciddn n = disk drive number (1 to 9) Appendix D Sun StorEdge T3 Array System Commands...
  • Page 222 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 223: Fc-Al Loop Identifiers

    A P P E N D I X FC-AL Loop Identifiers This Appendix lists the FC-AL loop identifies by AL_PA (hex), Switch (hex) and Setting (decimal) values. The values are listed from lowest to highest priority. The AL_PA value of 00 is reserved for an FL_PORT.
  • Page 224 Assigned Loop Identifier (Continued) TABLE E-1 AL_PA Switch Setting AL_PA Switch Setting AL_PA Switch Setting (hex) (hex) (dec) (hex) (hex) (dec) (hex) (hex) (dec) Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

  • Page 225: Sun Storedge T3 Array Configuration Worksheets

    Host types are defined as the following: Application host The application host utilizes the FC-AL connection as a data path to and from the Sun StorEdge T3 and T3+ array. Management host The management host administers configuration and health monitoring of the Sun StorEdge T3 and T3+ array, through a network connection.

  • Page 226: System Information Worksheets

    System Information Worksheets The following information should be documented before troubleshooting any Sun StorEdge T3 and T3+ array. Make copies of this blank form, and complete it for each Sun StorEdge T3 and T3+ array. Sun StorEdge T3 and T3+ array...
  • Page 227 Sun StorEdge T3 and T3+ array Information Worksheet (Continued) TABLE F-1 Management Host Application Host TFTP Host Legend: Required Field Optional Field Not Applicable Appendix F Sun StorEdge T3 Array Configuration Worksheets...
  • Page 228 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 229 The default cache mode for the Sun StorEdge T3 array. In a fully redundant configuration, cache is set to write-behind mode. In a nonredundant configuration, cache is set to write-through. Read caching is always performed.
  • Page 230 A Sun StorEdge T3 array that includes a controller card. It can be use as a standalone unit or configured with other Sun StorEdge T3 arrays.
  • Page 231 A performance measurement of the transaction rate. interconnect cable An FC-AL cable with a unique switched loop architecture that is used to interconnect multiple Sun StorEdge T3 arrays. Sometimes referred to as a loop cable. interconnect card A array component that contains the interface circuitry and two connectors for interconnecting multiple Sun StorEdge T3 array units.
  • Page 232 A FRU component in the Sun StorEdge T3 array. The unit contains a power supply, cooling fans, and an integrated UPS battery. A Sun StorEdge T3 array contains two power and cooling units.
  • Page 233 redundant array of independent disks (RAID) A configuration in which multiple drives are combined into a single virtual drive, to improve performance and reliability. Simple Network Management Protocol (SNMP) A protocol for remotely managing a computer network. synchronous dynamic random access memory (SDRAM) A form of dynamic random access memory (DRAM) that can run at higher clock speeds than conventional DRAM.
  • Page 234 Data used to build up stripes of data, eliminating the read-modify-write overhead. Write caching improves performance for applications that are writing to disk. Glossary-6 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 235 Index SYMBOLS id read command, 7-7 maintenance, 7-8 .boot -c command, 5-17 not fully charged, 7-7 .disk linkstat command, 8-8, 8-15 refresh cycle, 7-8 .disk pathstat command, 8-7 refresh -s command, 7-8 .loop stat command, 8-6 removing and replacing, 7-10 /etc/ethers file, 9-7 service life, 7-9 /etc/hosts file, 2-10, 9-7...
  • Page 236 (reset log type), C-3 host-generated messages, 1-2 hostname, B-2 hosts file, 2-10 hot spare ep download command, 4-7 checking, 5-3 EPROM, 2-3, 4-6 error (message type), C-2 Index-8 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 237 LUNs, 1-1 id read command, 7-7 inetd.conf file, 2-9 information (message type), C-2 Information (severity level), 1-3 mac, B-2 init, B-3 MAC addresses initcheck command, 3-19 location, 3-20, 9-3, 9-6 installation memsize, B-3 setting the IP address, 10-8 messages interconnect assemblies, A-9 syntax, 1-3, C-1 interconnect cable types, C-2...
  • Page 238 3-20, 9-3, 9-6 defaults, B-2 set bootmode command, 5-17, 5-18 remote logging, 2-10 set command, B-1 verifying firmware level, 3-15 set tftpfile command, 5-16 System generated messages, 1-2 Index-10 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...
  • Page 239 defaults, B-3 initializing, 10-14 Takeover (reset log type), C-3 mounting, 10-14 telnet command, 2-4, 5-1, 5-11 volume WWN, 9-8 master vs alternate controller, 8-9 volumes Telnet connection, 2-3 disabling, 8-27 tftp command, 5-16 mounting, 8-28 tftp filename, 2-7 reconstruction of, 8-28 tftpboot command, 2-6, 2-9, 5-16 unmounting, 5-13, 8-24 tftpfile, 5-16, B-2...
  • Page 240 Index-12 Sun StorEdge T3 and T3+ Array Field Service Manual • September 2001...

Table of Contents