Sun Oracle SPARC T3-2 Service Manual
  1. Manuals
  2. Brands
  3. Sun Oracle Manuals
  4. Server
  5. SPARC T3-2
  6. Service manual

Sun Oracle SPARC T3-2 Service Manual

Hide thumbs Also See for SPARC T3-2:
Table of Contents

Advertisement

Quick Links

Download this manual
SPARC T3-2 Server

Service Manual

Part No.: E20793-05
December 2013

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SPARC T3-2 and is the answer not in the manual?

Questions and answers

Related Manuals for Sun Oracle SPARC T3-2

Summary of Contents for Sun Oracle SPARC T3-2

  • Page 1: Service Manual

    SPARC T3-2 Server Service Manual Part No.: E20793-05 December 2013...
  • Page 2 Corporation and its affiliates are not responsible for and expressly disclaim all warranties of any kind with respect to third-party content, products, and services. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services.

  • Page 3: Table Of Contents

    Front and Rear Panel System Controls and LEDs 20 Ethernet and Network Management Port LEDs 21 Managing Faults With ILOM 22 ILOM Troubleshooting Overview 22 ▼ Access the Service Processor (Oracle ILOM) 24 ▼ Display FRU Information With the show Command 27...
  • Page 4 Interpret POST Fault Messages 50 ▼ Clear POST-Detected Faults 51 POST Output Quick Reference 52 Managing Components With Automatic System Recovery Commands 54 Automatic System Recovery Overview 55 ▼ Display System Components 56 SPARC T3-2 Server Service Manual • December 2013...
  • Page 5 ▼ Disable System Components 56 ▼ Enable System Components 57 Checking if SunVTS Software Is Installed 58 SunVTS Overview 58 ▼ Check if SunVTS Software Is Installed 59 Preparing for Service 61 Safety Information 62 Safety Precautions 62 Safety Symbols ESD Measures 63 Antistatic Wrist Strap Use 63 Antistatic Mat 63...
  • Page 6 Verify Fan Module Functionality 99 Servicing Power Supplies 101 Power Supply Overview 101 ▼ Locate a Faulty Power Supply 102 ▼ Remove a Power Supply 104 ▼ Install a Power Supply 106 SPARC T3-2 Server Service Manual • December 2013...
  • Page 7 ▼ Verify Power Supply Functionality 107 Servicing Memory Risers and DIMMs 109 About Memory Risers 109 Memory Risers Overview 110 Memory Riser Population Rules 110 Memory Riser FRU Names 111 About DIMMs 112 DIMM Population Rules 112 Supported Memory Configurations 113 DIMM FRU Names 114 DIMM Rank Classification Labels 115 ▼...
  • Page 8 Install the Motherboard 167 ▼ Reactivate RAID Volumes 170 ▼ Verify Motherboard Functionality 173 Servicing the Service Processor 175 Service Processor Firmware and Configuration 176 ▼ Remove the Service Processor 176 viii SPARC T3-2 Server Service Manual • December 2013...
  • Page 9 ▼ Install the Service Processor 179 ▼ Verify Service Processor Functionality 181 Servicing the Hard Disk Drive Backplane 183 ▼ Remove the Hard Disk Drive Backplane 183 ▼ Install the Hard Disk Drive Backplane 185 ▼ Verify Hard Disk Drive Backplane Functionality 187 Servicing the Power Supply Backplane 189 ▼...
  • Page 10 SPARC T3-2 Server Service Manual • December 2013...

  • Page 11: Using This Documentation

    Using This Documentation This service manual explains how to diagnose hardware problems and replace parts in the SPARC T3-2 server from Oracle. This document is written for technicians, system administrators, authorized service providers, and users who have advanced experience troubleshooting and replacing hardware.
  • Page 12 Feedback Provide feedback on this documentation at: http://www.oracle.com/goto/docfeedback Support and Accessibility Description Links Access electronic support http://support.oracle.com through My Oracle Support For hearing impaired: http://www.oracle.com/accessibility/support.html Learn about Oracle’s http://www.oracle.com/us/corporate/accessibility/index.html commitment to accessibility SPARC T3-2 Server Service Manual • December 2013...

  • Page 13: Identifying Server Components

    Identifying Server Components These topics identify key components of the servers, including major boards and internal system cables, as well as front and rear panel features. “Front Components” on page 1 ■ “Rear Components” on page 3 ■ “Infrastructure Boards in the Server” on page 4 ■...

  • Page 14: Related Information

    Required) LED: amber Over Temperature Warning LED: amber 17 Hard disk drive 5 (optional) USB 2.0 connectors (2) Related Information “Rear Components” on page 3 ■ “Internal Components” on page 5 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 15: Rear Components

    Rear Components The following figure shows the layout of the I/O ports, PCIe ports, 10 Gbit Ethernet (XAUI) ports (if equipped) and power supplies on the rear panel. Server Back Panel Connectors FIGURE: Figure Legend Power supply unit 0 status indicator LEDs: Network (NET) 10/100/1000 ports: Service Action Required: amber NET0–NET3...

  • Page 16: Infrastructure Boards In The Server

    Related Information “Internal Components” on page 5 ■ “Servicing the Motherboard” on page 163 ■ “Servicing the Fan Board” on page 157 ■ “Servicing the Hard Disk Drive Backplane” on page 183 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 17: Internal System Cables

    Internal System Cables The following table identifies the internal system cables used in the server. Cable Description Top cover interlock cable This cable connects the safety interlock switch on the top cover to the power distribution board. When the top cover is removed, this connection is broken, which causes the server to power down.
  • Page 18 Motherboard System lithium battery Low-profile PCIe cards Memory risers Power supplies Fan board Power supply backplane (and cover) Fan modules Hard disk drive backplane DVD drive Service processor Hard disk drives (HDDs) SPARC T3-2 Server Service Manual • December 2013...

  • Page 19: Exploring Parts Of The System

    Exploring Parts of the System The following topics identify the components that can be individually replaced. These components are grouped into three functional categories: “Motherboard Components” on page 8 ■ “I/O Components” on page 10 ■ “Power Distribution and Fan Module Components” on page 12 ■...

  • Page 20: Motherboard Components

    The following figure illustrates replaceable components related to the motherboard. Exploded View of Motherboard Components FIGURE: The following table identifies the components located on the motherboard and includes FRU names, where applicable. SPARC T3-2 Server Service Manual • December 2013...
  • Page 21 Motherboard Components TABLE: Item Notes FRU Name (If Applicable) Memory riser Remove this to service DIMMs. /SYS/MB/CMP0/MR0 /SYS/MB/CMP0/MR1 /SYS/MB/CMP1/MR0 /SYS/MB/CMP1/MR1 Service processor Back panel PCI cross beam must /SYS/MB/SP be removed to access risers. DIMMs See configuration rules before /SYS/MP/CMPn/MRn/BOBn/CHn/Dn upgrading DIMMs.

  • Page 22: I/O Components

    The following table identifies the I/O components in the server and FRU names, where applicable. I/O Components TABLE: Item Notes FRU Name (If Applicable) Hard disk drives Must be removed to service the /SYS/SASBP/HDD0 hard drive backplane. /SYS/SASBP/HDD1 /SYS/SASBP/HDD2 /SYS/SASBP/HDD3 /SYS/SASBP/HDD4 /SYS/SASBP/HDD5 SPARC T3-2 Server Service Manual • December 2013...
  • Page 23 I/O Components (Continued) TABLE: Item Notes FRU Name (If Applicable) Front control panel light Metal light pipe bracket is not a pipe assembly FRU. DVD module, USB module Must be removed to service the /SYS/DVD hard drive backplane. /SYS/USBBD Hard drive backplane /SYS/SASBP Related Information “Understanding Component Replacement Categories”...

  • Page 24: Power Distribution And Fan Module Components

    The following figure illustrates replaceable components related to power distribution and the fan modules. Exploded View of Power Distribution/Fan Module Components FIGURE: The following table identifies the power distribution and fan module components in the server and FRU names, where applicable. SPARC T3-2 Server Service Manual • December 2013...
  • Page 25 Power Distribution/Fan Module Components TABLE: Item Notes FRU Name (If Applicable) Power supply backplane The power supplies must and cover be partially removed from the chassis to remove this component. Air duct A plastic cover that rests on top of the CPUs. Power supplies Two power supplies /SYS/PS0...
  • Page 26 SPARC T3-2 Server Service Manual • December 2013...

  • Page 27: Detecting And Managing Faults

    LEDs – Provide a quick visual notification of the status of the server and of some ■ of the field-replaceable units (FRUs). Oracle ILOM – This firmware runs on the service processor. In addition to ■ providing the interface between the hardware and OS, ILOM also tracks and reports the health of key server components.

  • Page 28: Diagnostics Process

    Log files and command interface – Provide the standard Oracle Solaris OS log ■ files and investigative commands that can be accessed and displayed on the device of your choice.
  • Page 29 Diagnostic Flowchart FIGURE: The following table provides brief descriptions of the troubleshooting actions shown in the flowchart. It also provides links to topics with additional information on each diagnostic action. Detecting and Managing Faults...
  • Page 30 28 Faulty FRUs are identified in fault messages using the FRU name. Check the Solaris The Oracle Solaris message buffer and log files record • “Interpreting Log Files and log files for fault system events, and provide information about faults.

  • Page 31: Interpreting Diagnostic Leds

    Determine if the If the fault message does not begin with the characters • “Using the Oracle Solaris fault was detected “SPT”, the fault was detected by the Oracle Solaris Predictive Self-Healing by PSH. Predictive Self-Healing (PSH) software. Feature” on page 38...

  • Page 32: Front And Rear Panel System Controls And Leds

    • Steady on, green – Service processor is running in its normal operating state. No service actions are required. • Blink, green – Service processor is initializing ILOM firmware. • Steady on, amber – An SP error has occurred and service is required. SPARC T3-2 Server Service Manual • December 2013...

  • Page 33: Ethernet And Network Management Port Leds

    Front Panel Controls and Indicators (Continued) TABLE: LED or Button Icon or Label Description Service action FAN, CPU, Provides the following operational indications for the fans, CPU, and memory: required LEDs • Off – Indicates a steady state, no service action is required. (amber) •...

  • Page 34: Managing Faults With Ilom

    “ILOM Properties that Affect POST Behavior” on page 46 ■ ILOM Troubleshooting Overview The Integrated Lights Out Manager (Oracle ILOM) firmware enables you to remotely run diagnostics, such as power-on self-test (POST), that would otherwise require physical proximity to the server’s serial port.
  • Page 35 The service processor runs independently of the server, using the server’s standby power. Therefore, Oracle ILOM firmware and software continue to function when the server OS goes offline or when the server is powered off. Error conditions detected by Oracle ILOM, POST, and the Oracle Solaris Predictive Self-Healing (PSH) technology are forwarded to Oracle ILOM for fault handling.

  • Page 36: Access The Service Processor (Oracle Ilom)

    You can log into multiple service processor accounts simultaneously and have separate Oracle ILOM shell commands executing concurrently under each account. Note – The CLI includes a feature that enables you to access Oracle Solaris Fault Manager commands, such as fmadm, fmdump, and fmstat, from within the Oracle ILOM shell.
  • Page 37 DHCP, or you can assign an IP address. 2. Decide which interface to use: Oracle ILOM CLI – Is the default ILOM user interface and most of the ■ commands and examples in this service manual use this interface. The default login account is root with a password of changeme.
  • Page 38 – Manually clears ■ PSH-detected faults. “Clear Faults With the clear_fault_action Property” on page Note – You can use fmadm faulty in the faultmgmt shell as an alternative to show faulty. SPARC T3-2 Server Service Manual • December 2013...

  • Page 39: Display Fru Information With The Show Command

    ▼ Display FRU Information With the show Command Use the ILOM show command to display information about individual FRUs. ● At the -> prompt, enter the show command. In the following example, the show command displays information about a DIMM. ->...

  • Page 40: Check For Faults Using The Show Faulty Command

    | /SYS/PS0/VOLT_FAULT faults/0 Related Information “Diagnostics Process” on page 16 ■ “Clear Faults With the clear_fault_action Property” on page 30 ■ “Check for Faults With the fmadm faulty Command” on page 29 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 41: Check For Faults With The Fmadm Faulty Command

    The fmadm faulty command was invoked from within the ILOM faultmgmt shell. Note – The characters “SPT” at the beginning of the message ID indicate that the fault was detected by Oracle ILOM. 1. At the -> prompt, access the faultmgmt shell.

  • Page 42: Clear Faults With The Clear_Fault_Action Property

    Use the clear_fault_action property of a FRU with the set command to manually clear ILOM-detected faults from the service processor. If Oracle ILOM detects a FRU replacement, it will automatically clear the fault so that manual clearing of the fault is not necessary. For PSH diagnosed faults, if the replacement of the FRU is detected by the system or the fault is manually cleared on the host, the fault will also be cleared from the ILOM.
  • Page 43 -> set /SYS/PS0 clear_fault_action=true Are you sure you want to clear /SYS/PS0 (y/n)? y -> show /SYS/PS0 Targets: VINOK PWROK CUR_FAULT VOLT_FAULT FAN_FAULT TEMP_FAULT V_IN I_IN V_OUT I_OUT INPUT_POWER OUTPUT_POWER Properties: type = Power Supply ipmi_name = PSO fru_name = /SYS/PSO fru_description = Powersupply fru_manufacturer = Delta Electronics fru_version = 03...

  • Page 44: Fault Management Command Examples

    | 2010-08-11/14:54:23 faults/0 /SP/faultmgmt/0/ | fru_part_number | ******* faults/0 /SP/faultmgmt/0/ | fru_serial_number | ****** faults/0 /SP/faultmgmt/0/ | product_serial_number | ********** faults/0 /SP/faultmgmt/0/ | chassis_serial_number | ********** faults/0 /SP/faultmgmt/0/ | detector | /SYS/PS0/VOLT_FAULT faults/0 SPARC T3-2 Server Service Manual • December 2013...

  • Page 45: Fmadm Faulty Example Of A Power Supply Fault

    The fmadm faulty command was invoked from within the ILOM faultmgmt shell. Note – The characters “SPT” at the beginning of the message ID indicate that the fault was detected by Oracle ILOM. -> start /SP/faultmgmt/shell Are you sure you want to start /SP/faultmgmt/shell (y/n)? y faultmgmtsp>...

  • Page 46: Show Faulty Example Of A Post-Detected Fault

    | Value --------------------+------------------------+-------------------------------- /SP/faultmgmt/0 | fru | /SYS/MB /SP/faultmgmt/0/ | class | fault.cpu.generic-sparc.strand faults/0 /SP/faultmgmt/0/ | sunw-msg-id | SUN4V-8002-6E faults/0 /SP/faultmgmt/0/ | uuid | ********-****-****-****-************ faults/0 | 7a8a /SP/faultmgmt/0/ | timestamp | 2010-08-13/15:48:33 SPARC T3-2 Server Service Manual • December 2013...

  • Page 47: Service-Related Ilom Command Summary

    faults/0 /SP/faultmgmt/0/ | chassis_serial_number | ********** faults/0 /SP/faultmgmt/0/ | product_serial_number | ********** faults/0 /SP/faultmgmt/0/ | fru_serial_number | *******-********** faults/0 /SP/faultmgmt/0/ | fru_part_number | 541-3857-07 faults/0 /SP/faultmgmt/0/ | mod-version | 1.16 faults/0 /SP/faultmgmt/0/ | mod-name | eft faults/0 /SP/faultmgmt/0/ | fault_diagnosis | /HOST faults/0 /SP/faultmgmt/0/...
  • Page 48 Displays firmware versions and HOST status. show /HOST Displays product information, including the show /SYS part number and serial number. Related Information “Managing Components With Automatic System Recovery Commands” on ■ page 54 SPARC T3-2 Server Service Manual • December 2013...

  • Page 49: Interpreting Log Files And System Messages

    If POST or the Oracle Solaris PSH features do not indicate the source of a fault, check the message buffer and log files for notifications for faults. Hard disk drive faults are usually captured by the Oracle Solaris message files.

  • Page 50: Using The Oracle Solaris Predictive Self-Healing Feature

    “Check the Message Buffer” on page 37 Using the Oracle Solaris Predictive Self-Healing Feature The following topics describe the Solaris Predictive Self-Healing feature: “Oracle Solaris Predictive Self-Healing Technology Overview” on page 39 ■ “PSH-Detected Fault Example” on page 40 ■...

  • Page 51: Oracle Solaris Predictive Self-Healing Technology Overview

    Oracle Solaris OS is running and mitigate many problems before they negatively affect operations. The Oracle Solaris OS uses the Fault Manager daemon, fmd(1M), which starts at boot time and runs in the background to monitor the system. If a component generates an error, the daemon correlates the error with data from previous errors and other relevant information to diagnose the problem.

  • Page 52: Psh-Detected Fault Example

    ■ ▼ Check for PSH-Detected Faults Use the fmadm faulty command to display the list of faults detected by the Oracle Solaris PSH facility. You can run this command either from the host or through the Oracle ILOM fmadm shell.
  • Page 53 1. Check the event log using fmadm faulty: # fmadm faulty TIME EVENT-ID MSG-ID SEVERITY Aug 13 11:48:33 ********-****-****-****-************ SUN4V-8002-6E Major Platform : sun4v Chassis_id Product_sn Fault class : fault.cpu.generic-sparc.strand Affects : cpu:///cpuid=**/serial=********************* faulted and taken out of service : "/SYS/MB" (hc://:product-id=*****:product-sn=**********:server-id=***-******-*****: chassis-id=********:**************-**********:serial=******:revision=05/ chassis=0/motherboard=0)

  • Page 54: Clear Psh-Detected Faults

    ■ ▼ Clear PSH-Detected Faults When the Oracle Solaris PSH facility detects faults, the faults are logged and displayed on the console. In most cases, after the fault is repaired, the corrected state is detected by the system and the fault condition is repaired automatically. However, this repair should be verified.
  • Page 55 1. After replacing a faulty FRU, power on the server. 2. At the host prompt, use the fmadm faulty command to determine whether the replaced FRU still shows a faulty state. # fmadm faulty TIME EVENT-ID MSG-ID SEVERITY Aug 13 11:48:33 ********-****-****-****-************ SUN4V-8002-6E Major Platform...
  • Page 56 # fmadm replaced ********-****-****-****-************ Note that you should use one of the following fmadm commands released with the Oracle Solaris 10 05/09 OS based on whether you are replacing a component or whether you have repaired the component in some way: Use fmadm repaired when a physical repair is performed to resolve a ■...

  • Page 57: Running Post

    You can also run POST as system-level hardware diagnostic tool. To do this, use the Oracle ILOM set command to set the parameter keyswitch_state to diag. You can also set other Oracle ILOM properties to control various other aspects of POST operations. For example, you can specify the events that cause POST to run, the level of testing POST performs, and the amount of diagnostic information POST displays.

  • Page 58: Ilom Properties That Affect Post Behavior

    (Default) Runs POST if fatal errors are detected. error-reset Equivalent to power-on-reset, hw-change, and all-resets error-reset. POST output displays all test and informational /HOST/diag verbosity normal messages. POST output displays functional tests with a banner and pinwheel. SPARC T3-2 Server Service Manual • December 2013...
  • Page 59 ILOM Properties Used to Manage POST Operations TABLE: Parameter Values Description POST displays all test and informational messages. debug MAX POST plus debugging messages. No POST output is displayed. none The following flowchart is a graphic illustration of the same set of ILOM set command variables.

  • Page 60: Configure How Post Runs

    4. To see the current values for settings, use the show command. Example: -> show /HOST/diag /HOST/diag Targets: Properties: error_reset_level = min error_reset_verbosity = min hw_change_level = min hw_change_verbosity = min level = min mode = off power_on_level = min power_on_verbosity = min SPARC T3-2 Server Service Manual • December 2013...

  • Page 61: Run Post With Maximum Testing

    This procedure describes how to configure the server to run the maximum level of POST. 1. Access the ILOM -> prompt: “Access the Service Processor (Oracle ILOM)” on page 2. Set the virtual keyswitch to diag so that POST will run in service mode. -> set /SYS keyswitch_state=diag Set ‘keyswitch_state' to ‘Diag'...

  • Page 62: Interpret Post Fault Messages

    > END_ERROR In this syntax, n = the node number, c = the core number, s = the strand number. Warning and informational messages use the following syntax: ■ INFO or WARNING: message SPARC T3-2 Server Service Manual • December 2013...

  • Page 63: Clear Post-Detected Faults

    1. After replacing a faulty FRU, at the Oracle ILOM prompt use the show faulty command to identify POST detected faults. POST detected faults are distinguished from other kinds of faults by the text: Forced fail.

  • Page 64: Post Output Quick Reference

    > ERROR: TEST = failing-test n:c:s > H/W under test = FRU n:c:s > Repair Instructions: Replace items in order listed by H/W under test above n:c:s > MSG = test-error-message n:c:s > END_ERROR SPARC T3-2 Server Service Manual • December 2013...
  • Page 65 Warning messages use the following syntax: WARNING: message Informational messages use the following syntax: INFO: message In the following example, POST reports an uncorrectable memory error affecting DIMM locations /SYS/MB/CMP0/MR0/B0B0/CH0/D0 and /SYS/MB/CMP0/B0B1/CH0/D0. The error was detected by POST running on node 0, core 7, strand 2.

  • Page 66: Managing Components With Automatic System Recovery Commands

    (ASR) feature and how to manage the components it controls. “Automatic System Recovery Overview” on page 55 ■ “Display System Components” on page 56 ■ “Disable System Components” on page 56 ■ “Enable System Components” on page 57 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 67: Automatic System Recovery Overview

    Automatic System Recovery Overview The ASR feature enables the server to automatically configure failed components out of operation until they can be replaced. In the server, the following components are managed by the ASR feature: CPU strands ■ Memory DIMMs ■...

  • Page 68: Display System Components

    You disable a component by setting its component_state property to Disabled. This adds the component to the ASR blacklist. 1. At the -> prompt, set the component_state property to Disabled. -> set /SYS/MB/CMP0/BR1/CH0/D0 component_state=Disabled SPARC T3-2 Server Service Manual • December 2013...

  • Page 69: Enable System Components

    2. Reset the server so that the ASR command takes effect. -> stop /SYS Are you sure you want to stop /SYS (y/n)? y Stopping /SYS -> start /SYS Are you sure you want to start /SYS (y/n)? y Starting /SYS Note –...

  • Page 70: Checking If Sunvts Software Is Installed

    You can run SunVTS through a browser UI, terminal UI, or command UI. You can run tests in a variety of modes for online and offline testing. SunVTS also provides a choice of security mechanisms. SPARC T3-2 Server Service Manual • December 2013...

  • Page 71: Check If Sunvts Software Is Installed

    SunVTS software is provided on the preinstalled Solaris OS that shipped with the server, but it might not be installed. Related Information SunVTS documentation ■ “Check if SunVTS Software Is Installed” on page 59 ■ ▼ Check if SunVTS Software Is Installed 1.
  • Page 72 SPARC T3-2 Server Service Manual • December 2013...

  • Page 73: Preparing For Service

    Preparing for Service These topics describe how to prepare the server for servicing. “Safety Information” on page 62 ■ “Tools Needed For Service” on page 64 ■ “Find the Chassis Serial Number” on page 64 ■ “Locate the Server” on page 65 ■...

  • Page 74: Safety Information

    Caution – Hot surface. Avoid contact. Surfaces are hot and might cause personal injury if touched. Caution – Hazardous voltages are present. To reduce the risk of electric shock and danger to personal health, follow the instructions. SPARC T3-2 Server Service Manual • December 2013...

  • Page 75: Esd Measures

    ESD Measures Electrostatic discharge (ESD) sensitive devices, such as the Flash Modules, PCI cards, hard disk drives, and DIMMS, require special handling. Caution – Circuit boards and hard disk drives contain electronic components that are extremely sensitive to static electricity. Ordinary amounts of static electricity from clothing or the work environment can destroy the components located on these boards.

  • Page 76: Tools Needed For Service

    ● Type show /SYS at the ILOM prompt. -> show /SYS /SYS Targets: MB_ENV USBBD FANBD Properties: type = Host System keyswitch_state = Normal product_name = SPARC T3-2 SPARC T3-2 Server Service Manual • December 2013...

  • Page 77: Locate The Server

    = 602-4954-02 product_serial_number = BDL1026F8F product_manufacturer = Oracle Corporation fault_state = OK clear_fault_action = (none) power_state = On Commands: reset show start stop Note – When a PDB, fan board, or HDD backplane is replaced, the chassis serial number and part number might need to be programmed into the new component.

  • Page 78: Understanding Component Replacement Categories

    Although hot service procedures can be performed while the server is running, you should usually bring it to standby mode as the first step in the replacement procedure. Refer to “Power Off the Server (Power Button - Standby Mode)” on page 70 for instructions. SPARC T3-2 Server Service Manual • December 2013...

  • Page 79: Cold Service, Replaceable By Customer

    Cold Service, Replaceable by Customer The following table identifies the components that require the server to be powered down. These components can be replaced by customers. Component Service information Notes DIMMs “Servicing Memory Risers and DIMMs” on page 109 DVD drive/filler “Servicing DVD Drives”...

  • Page 80: Shut Down The Server

    You also might want to run diagnostics before you shut down the server. 2. Notify affected users that the server will be shut down. Refer to the Oracle Solaris system administration documentation for additional information. 3. Save any open files and quit all running programs.

  • Page 81: Removing Power From The System

    Removing Power From the System Description Links Power off the server in one of three ways, • “Power Off the Server (Service Processor depending on your circumstances. Command)” on page 69 • “Power Off the Server (Power Button - Standby Mode)” on page 70 •...

  • Page 82: Power Off The Server (Power Button - Standby Mode)

    You may need to use a pointed object, such as a pen or pencil. Related Information “Power Off the Server (Service Processor Command)” on page 69 ■ “Power Off the Server (Emergency Shutdown)” on page 71 ■ “Front Components” on page 1 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 83: Power Off The Server (Emergency Shutdown)

    ▼ Power Off the Server (Emergency Shutdown) Caution – All applications and files will be closed abruptly without saving changes. File system corruption might occur. ● Press and hold the Power button for five seconds. Related Information “Power Off the Server (Service Processor Command)” on page 69 ■...

  • Page 84: Positioning The System For Servicing

    2. From the front of the server, release the two slide release latches. Squeeze the green slide release latches to release the slide rails. SPARC T3-2 Server Service Manual • December 2013...

  • Page 85: Release The Cma

    3. While squeezing the slide release latches, slowly pull the server forward until the slide rails latch. Related Information “Release the CMA” on page 73 ■ “Remove the Server From the Rack” on page 75 ■ ▼ Release the CMA For some service procedures, if you are using a cable management arm (CMA), you might need to release the CMA to gain access to the back of the chassis.
  • Page 86 Related Information “Extend the Server to the Maintenance Position” on page 72 ■ “Remove the Server From the Rack” on page 75 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 87: Remove The Server From The Rack

    ▼ Remove the Server From the Rack The server must be removed from the rack to remove or install the following components: Motherboard ■ Power supply backplane ■ Disk drive backplane ■ Caution – The server requires two people to safely remove and carry it. 1.

  • Page 88: Accessing Internal Components

    Any changes you make to the memory riser or DIMM configurations will not be properly reflected in the service processor’s inventory until you replace the top cover. 1. Ensure that the AC power cords are disconnected from the server power supplies. SPARC T3-2 Server Service Manual • December 2013...
  • Page 89 2. To unlatch the server top cover, insert your fingers under the two cover latches and simultaneously lift both latches in an upward motion as shown in panel 1 of the following figure. 3. Lift the cover slightly and slide it toward the front of the server chassis about 0.5 inch (12 mm).

  • Page 90: Filler Panels

    “Back Panel Connectors” on page 78 ■ “Cable the Server” on page 79 ■ Back Panel Connectors The following figure shows and describes the locations of the back panel connectors and rear LEDs on the server. SPARC T3-2 Server Service Manual • December 2013...

  • Page 91: Cable The Server

    Server Back Panel Connectors FIGURE: Figure Legend Power supply unit 0 AC inlet Service processor (SP) network management (NET MGT) Ethernet port Power supply unit 1 AC inlet Serial management (SER MGT)/RJ-45 serial port Gigabit Ethernet ports NET-0, 1, 2, 3 DB-15 video connector USB 2.0 ports ▼...
  • Page 92 4. If you plan to access the ILOM command-line interface (CLI) using the management port, connect a serial null modem cable to the RJ-45 serial port labeled SER MGT. SPARC T3-2 Server Service Manual • December 2013...

  • Page 93: Servicing Hard Disk Drives

    Servicing Hard Disk Drives These topics explain how to remove and install hard disk drives. “Hard Disk Drive Overview” on page 82 ■ “Locate a Faulty Hard Disk Drive” on page 83 ■ “Remove a Hard Disk Drive Filler Panel” on page 84 ■...

  • Page 94: Hard Disk Drive Overview

    “Remove a Hard Disk Drive” on page 86 ■ “Install a Hard Disk Drive” on page 88 ■ “Install a Hard Disk Drive Filler Panel” on page 90 ■ “Verify Hard Disk Drive Functionality” on page 91 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 95: Locate A Faulty Hard Disk Drive

    ▼ Locate a Faulty Hard Disk Drive This procedure describes how to identify a faulty HDD using the fault LEDs on the drive. ● View the hard disk drive LEDs to determine the status of the hard drive. When the amber Service Required LED on the front of a drive is lit, a fault has occurred on that drive.

  • Page 96: Remove A Hard Disk Drive Filler Panel

    Service, Replaceable by Customer” on page 66 for more information about hot service procedures. 1. Attach an antistatic wrist strap. 2. On the hard disk drive filler panel you want to remove, complete the following tasks. SPARC T3-2 Server Service Manual • December 2013...
  • Page 97 Caution – The latch is not an ejector. Do not bend it too far to the right. Doing so can damage the latch. a. Push the release button to open the latch and unlock the drive filler panel by moving the latch to the right. b.

  • Page 98: Remove A Hard Disk Drive

    You must unconfigure any drive whose status is listed as configured, as described in Step b. Unconfigure the drive using the cfgadm -c unconfigure command. Example: # cfgadm -c unconfigure c0::dsk/c1t1d0 Replace c0:dsk/c1t1d0 with the drive name that applies to your situation. SPARC T3-2 Server Service Manual • December 2013...
  • Page 99 c. Verify that the drive’s blue Ready-to-Remove LED is lit. 3. Determine whether you can replace the disk drive using the hot-swap procedure or whether you need to power off the server using the cold-swap procedure. A cold-swap is required if the disk drive: Contains the operating system, and the operating system is not mirrored on ■...

  • Page 100: Install A Hard Disk Drive

    Note – Drives are physically addressed according to the slot in which they are installed. If you are replacing a drive, install the replacement drive in the same slot as the drive that was removed. SPARC T3-2 Server Service Manual • December 2013...
  • Page 101 a. Slide the drive into the drive slot until it is fully seated. b. Close the latch to lock the drive in place. 4. Return the drive to operation by doing one of the following: If you cold-swapped the drive, restore power to the server. Complete the ■...

  • Page 102: Install A Hard Disk Drive Filler Panel

    “Remove a Hard Disk Drive” on page 86 ■ “Install a Hard Disk Drive” on page 88 ■ “Remove a Hard Disk Drive Filler Panel” on page 84 ■ “Verify Hard Disk Drive Functionality” on page 91 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 103: Verify Hard Disk Drive Functionality

    Refer to the Solaris OS administration documentation for more information. 2. At the Oracle Solaris prompt, type the cfgadm -al command to list all drives in the device tree, including any drives that are not configured: # cfgadm -al This command helps you identify the drive you installed.
  • Page 104 5. At the Oracle Solaris prompt, type the cfgadm -al command to list all drives in the device tree, including any drives that are not configured: # cfgadm -al The replacement drive is now listed as configured, as shown in the following...

  • Page 105: Servicing Fan Modules

    Servicing Fan Modules These topics explain how to service faulty fan modules. “Fan Module Overview” on page 94 ■ “Locate a Faulty Fan Module” on page 95 ■ “Remove a Fan Module” on page 96 ■ “Install a Fan Module” on page 98 ■...

  • Page 106: Fan Module Overview

    “Understanding Component Replacement Categories” on page 66 ■ “Remove a Fan Module” on page 96 ■ “Install a Fan Module” on page 98 ■ “Verify Fan Module Functionality” on page 99 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 107: Locate A Faulty Fan Module

    ▼ Locate a Faulty Fan Module This procedure describes how to identify a faulty fan module. ● View the following LEDs, which are lit when a fan module fault is detected. Fan Module (FAN) Fault LED on the front of the server (refer to “Front ■...

  • Page 108: Remove A Fan Module

    Service, Replaceable by Customer” on page 66 for more information about hot service procedures. 1. Prepare for servicing: a. Attach an antistatic wrist strap. b. Extend the server to the maintenance position. SPARC T3-2 Server Service Manual • December 2013...
  • Page 109 2. Identify the faulty fan module with a corresponding Service Required LED. The Service Action Required LEDs are located on the fan module as shown in “Locate a Faulty Fan Module” on page 3. Using your thumb and forefinger, grasp the handle on the fan module and lift it out of the server.

  • Page 110: Install A Fan Module

    2. Install the replacement fan module into the server by completing the following tasks. a. Align the fan module and slide it into the fan slot. Note – Fan modules are keyed to ensure they are installed in the correct orientation. SPARC T3-2 Server Service Manual • December 2013...

  • Page 111: Verify Fan Module Functionality

    b. Apply firm pressure to fully seat the fan module. You will hear a click when the fan is properly seated. 3. Return the server to the normal rack position. Related Information “Return the Server to the Normal Rack Position” on page 197 ■...
  • Page 112 SPARC T3-2 Server Service Manual • December 2013...

  • Page 113: Servicing Power Supplies

    Disabling the LLEM Policy causes the power supplies to share the load at all times, at the expense of efficiency during light loads. For information about configuration policies, refer to the SPARC T3 Series Servers Administration Guide and the Oracle ILOM documentation.

  • Page 114: Locate A Faulty Power Supply

    View the following LEDs, which are lit when a power supply fault is detected. Rear PS Fault LED on the front bezel of the server (refer to “Front Components” ■ on page Service Action Required LED on the faulted power supply. ■ SPARC T3-2 Server Service Manual • December 2013...
  • Page 115 Legend Symbol Color Lights When... Service Amber The power supply is faulty. Service Action action is required. Required Green Both DC outputs (3.3V standby and 12V main) are active and within regulation. AC Present Green This LED turns on when AC voltage is applied to the power supply.

  • Page 116: Remove A Power Supply

    Caution – Whenever you remove a power supply, you should replace it with another power supply; otherwise, the server might overheat due to improper airflow. If a new power supply is not available, leave the failed power supply installed until it can be replaced. SPARC T3-2 Server Service Manual • December 2013...
  • Page 117 Related Information “Locate a Faulty Power Supply” on page 102 ■ “Install a Power Supply” on page 106 ■ Servicing Power Supplies...

  • Page 118: Install A Power Supply

    6. Verify that the following LEDs are not lit: Service Action Required LED on the power supply ■ Front and rear Service Action Required LEDs ■ Rear PS Failure LED on the bezel of the server ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 119: Verify Power Supply Functionality

    Related Information “Remove a Power Supply” on page 104 ■ “Verify Power Supply Functionality” on page 107 ■ ▼ Verify Power Supply Functionality 1. Verify that the amber Service Required LED on the replaced power supply is not lit. 2. Verify that the PS Fault LED on the front of the server is not lit. 3.
  • Page 120 SPARC T3-2 Server Service Manual • December 2013...

  • Page 121: Servicing Memory Risers And Dimms

    Servicing Memory Risers and DIMMs These topics explain how to remove and install memory risers, DIMMs, and filler panels in the server. “About Memory Risers” on page 109 ■ “About DIMMs” on page 112 ■ “Locate a Faulty DIMM (DIMM Fault Remind Button)” on page 117 ■...

  • Page 122: Memory Risers Overview

    “DIMM Configuration Error Messages” on page 132. Related Information “Memory Risers Overview” on page 110 ■ “Memory Riser FRU Names” on page 111 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 123: Memory Riser Fru Names

    “About DIMMs” on page 112 ■ “Verify DIMM Functionality” on page 130 ■ “DIMM Configuration Error Messages” on page 132 ■ Memory Riser FRU Names Two memory risers are supported per CMP: Memory risers associated with CMP0: ■ /SYS/MB/CMP0/MR0 ■ /SYS/MB/CMP0/MR1 ■...

  • Page 124: About Dimms

    Full—In all memory risers, install DIMMs in all slots (labeled 1, 2, and 3 in the ■ illustration), for a total of 32 DIMMs installed in the server. SPARC T3-2 Server Service Manual • December 2013...

  • Page 125: Supported Memory Configurations

    Any slot without a DIMM must have a DIMM filler installed. ■ Related Information “Memory Riser Population Rules” on page 110 ■ “Supported Memory Configurations” on page 113 ■ “DIMM FRU Names” on page 114 ■ “DIMM Rank Classification Labels” on page 115 ■...

  • Page 126: Dimm Fru Names

    DIMM FRU IDs are based on the location of the memory riser in the server and the DIMM slot on the memory riser. For example, the full FRU ID for the top-most DIMM slot (BOB1/CH1/D0) on the first memory riser (CMP0/MR0) is: /SYS/MB/CMP0/MR0/BOB1/CH1/D0 SPARC T3-2 Server Service Manual • December 2013...

  • Page 127: Dimm Rank Classification Labels

    DIMM FRU Identifyers TABLE: DIMM FRU Identifyer (From Top to Bottom on Memory Riser) /SYS/MB/CMPx/MRx/BOB1/CH1/D0 /SYS/MB/CMPx/MRx/BOB1/CH1/D1 /SYS/MB/CMPx/MRx/BOB1/CH0/D0 /SYS/MB/CMPx/MRx/BOB1/CH0/D1 /SYS/MB/CMPx/MRx/BOB0/CH0/D0 /SYS/MB/CMPx/MRx/BOB0/CH0/D1 /SYS/MB/CMPx/MRx/BOB0/CH1/D0 /SYS/MB/CMPx/MRx/BOB0/CH1/D1 Related Information “Memory Riser Population Rules” on page 110 ■ “Memory Riser FRU Names” on page 111 ■ “DIMM Population Rules”...
  • Page 128 “Supported Memory Configurations” on page 113 ■ “DIMM FRU Names” on page 114 ■ “Increase Server Memory With Additional DIMMs” on page 126 ■ “DIMM Configuration Error Messages” on page 132 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 129: Locate A Faulty Dimm (Dimm Fault Remind Button)

    ▼ Locate a Faulty DIMM (DIMM Fault Remind Button) Each memory riser has a Remind button, a Power LED, and Fault LEDs adjacent to each DIMM. This procedure describes how to identify a faulty DIMM using these buttons and LEDs. 1.
  • Page 130 “Remove a Memory Riser” on page 120. 4. Press the Remind button on the memory riser to identify the faulty DIMM. An amber Fault LED will light next to the faulty DIMM. SPARC T3-2 Server Service Manual • December 2013...
  • Page 131 Color Description Memory riser Blue Push this button to identify the faulty or remind button misconfigured DIMM(s). Memory riser power Green Indicates that the riser is operating normally. Amber Indicates that the riser has a fault. DIMM Fault LED Amber Identifies a faulty or misconfigured DIMM.

  • Page 132: Locate A Faulty Dimm (Show Faulty Command)

    ▼ Locate a Faulty DIMM (show faulty Command) The Oracle ILOM show faulty command displays current system faults, including DIMM failures. ● Type show faulty at the Oracle ILOM prompt. -> show faulty Target | Property | Value --------------------+-------------------+------------------- /SP/faultmgmt/0...

  • Page 133: Install A Memory Riser

    Caution – Whenever you remove a memory riser or DIMM, you must replace it with another memory riser or a DIMM or a filler panel; otherwise, the server might overheat due to improper airflow. Related Information “About Memory Risers” on page 109 ■...

  • Page 134: Remove A Dimm

    “Remove a Memory Riser” on page 120 ■ “Verify DIMM Functionality” on page 130 ■ ▼ Remove a DIMM A DIMM is a cold-service component that can be replaced by a customer. SPARC T3-2 Server Service Manual • December 2013...
  • Page 135 Caution – Do not leave DIMM slots empty. You must install filler panels in all empty DIMM slots. 1. Consider your first steps: Familiarize yourself with DIMM configuration rules. ■ “DIMM Population Rules” on page 112. Prepare the system for service. ■...

  • Page 136: Install A Dimm

    Familiarize yourself with DIMM population rules. ■ “DIMM Population Rules” on page 112. Prepare the system for service. ■ “Preparing for Service” on page Remove the memory riser(s). ■ “Remove a Memory Riser” on page 120. SPARC T3-2 Server Service Manual • December 2013...
  • Page 137 2. Unpack the replacement DIMMs and place them on an antistatic mat. 3. Ensure that the ejector tabs on the connector that will receive the DIMM are in the open position. 4. Align the DIMM notch with the key in the connector. Caution –...

  • Page 138: Increase Server Memory With Additional Dimms

    5. Align the DIMM notch with the key in the connector. Caution – Ensure that the orientation is correct. The DIMM might be damaged if the orientation is reversed. SPARC T3-2 Server Service Manual • December 2013...
  • Page 139 6. Push the DIMM into the connector until the ejector tabs lock the DIMM in place. If the DIMM does not easily seat into the connector, check the DIMM’s orientation. 7. Repeat Step 2 through Step 5 until all DIMMs are installed. 8.

  • Page 140: Remove A Memory Riser Filler Panel

    1. Prepare the system for service. “Preparing for Service” on page 2. Locate the memory riser filler panel you want to remove. 3. Lift the filler panel straight up to remove it from the memory module socket. SPARC T3-2 Server Service Manual • December 2013...

  • Page 141: Install A Memory Riser Filler Panel

    Related Information “About Memory Risers” on page 109 ■ “Install a Memory Riser Filler Panel” on page 129 ■ ▼ Install a Memory Riser Filler Panel Caution – All memory risers and memory riser filler panels must be installed in order to ensure proper server airflow.

  • Page 142: Verify Dimm Functionality

    Power cycle the server. -> stop /SYS Are you sure you want to stop /SYS (y/n)? y Stopping /SYS -> start /SYS Are you sure you want to start /SYS (y/n)? y Starting /SYS SPARC T3-2 Server Service Manual • December 2013...
  • Page 143 Return the virtual keyswitch to Normal mode. -> set /SYS keyswitch_state=normal Set ‘ketswitch_state’ to ‘normal’ f. Switch to the system console and type the Oracle Solaris OS fmadm faulty command. # fmadm faulty If any faults are reported, refer to the diagnostics instructions described in “Oracle ILOM Troubleshooting Overview”...

  • Page 144: Dimm Configuration Error Messages

    UUID, you are done with the verification process. 7. Switch to the system console and type the fmadm repaired command, using the same FRU ID that was displayed from the output of the Oracle ILOM show faulty command. # fmadm repaired /SYS/MB/CMP0/MR1/BOB1/CM0/D0 Related Information “DIMM Population Rules”...

  • Page 145: Dimm Configuration Errors-System Console

    DIMM configuration error messages. Note – The messages described in this table apply to SPARC T3-2 servers. The DIMM configuration requirements for other servers in the SPARC T3 series are different in some details, so some of their configuration error messages will also be different.
  • Page 146 Either add DIMM components to fill a partially populated set or remove DIMM components to empty a partial set. Note - The DIMM slots labeled set 1 in the figure must always be fully populated. SPARC T3-2 Server Service Manual • December 2013...

  • Page 147: Dimm Configuration Errors-Show Faulty Command Output

    DIMM Configuration Error Messages Notes Add or remove DIMM components to achieve one of the Invalid DIMM population. T3-2 only supported memory configurations. supports 1/2 or full memory configs. “DIMM Population Rules” on page 112. If the CMPs in a server have different DIMM DIMM population across nodes is populations, add or remove DIMM components until different.

  • Page 148: Dimm Configuration Errors-Fmadm Faulty Output

    : The administrator should review the ILOM event log for additional information pertaining to this diagnosis. Please refer to the Details section of the Knowledge Article for additional information. ------------------- ------------------------------------ -------------- ------ SPARC T3-2 Server Service Manual • December 2013...
  • Page 149 2012-09-24/17:00:40 2caf416b-4fe0-6509-db02-aa719f5dd543 SPT-8000-PX Major Fault class : fault.component.misconfigured Related Information “DIMM Configuration Errors—System Console” on page 133 ■ “DIMM Configuration Errors—show faulty Command Output” on page 135 ■ Servicing Memory Risers and DIMMs...
  • Page 150 SPARC T3-2 Server Service Manual • December 2013...

  • Page 151: Servicing Dvd Drives

    Servicing DVD Drives These topics explain how to remove and install an optional DVD drive in the server. “DVD Drive Overview” on page 139 ■ “Remove a DVD Drive or Filler Panel” on page 140 ■ “Install a DVD Drive or Filler Panel” on page 141 ■...

  • Page 152: Remove A Dvd Drive Or Filler Panel

    Caution – Whenever you remove the DVD drive or filler panel, you should replace it with another DVD drive or a filler panel; otherwise the server might overheat due to improper airflow. Related Information “Install a DVD Drive or Filler Panel” on page 141 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 153: Install A Dvd Drive Or Filler Panel

    ▼ Install a DVD Drive or Filler Panel 1. Unpack the DVD drive or filler panel. If it is a DVD drive, attach an antistatic wrist wrap and place the drive on an antistatic mat. 2. Slide the DVD drive or filler panel into the front of the chassis until it seats. 3.
  • Page 154 Reinstall the power cords to the power supplies and power on the server. “Returning the Server to Operation” on page 195. Related Information “Remove a DVD Drive or Filler Panel” on page 140 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 155: Servicing The System Lithium Battery

    Servicing the System Lithium Battery These topics explain how to remove and install the system battery in the server. “System Battery Overview” on page 143 ■ “Remove the System Battery” on page 144 ■ “Install the System Battery” on page 146 ■...

  • Page 156: Remove The System Battery

    2. Remove the battery from the battery holder by pulling back on the metal tab holding it in place and sliding the battery up and out of the battery holder as shown in the following figure. SPARC T3-2 Server Service Manual • December 2013...
  • Page 157 Related Information “Install the System Battery” on page 146 ■ Servicing the System Lithium Battery...

  • Page 158: Install The System Battery

    4. If the service processor is not configured to use NTP, you must reset the ILOM clock using the ILOM CLI or the web interface. For instructions, see the Oracle Integrated Lights Out Manager (ILOM) 3.0 Documentation Collection.

  • Page 159: Servicing Expansion (Pcie) Cards

    Servicing Expansion (PCIe) Cards These topics explain how to remove and install PCIe cards in the server. “PCIe Card Configuration Rules” on page 147 ■ “Remove a PCIe Card Filler Panel” on page 148 ■ “Remove a PCIe Card” on page 150 ■...

  • Page 160: Remove A Pcie Card Filler Panel

    Power off the server and disconnect all power cords from the server power supplies. “Removing Power From the System” on page c. Extend the server to the maintenance position. “Extend the Server to the Maintenance Position” on page SPARC T3-2 Server Service Manual • December 2013...
  • Page 161 d. Remove the top cover. “Remove the Server Top Cover” on page 2. Locate the PCIe card filler panel that you want to remove. “Rear Components” on page 3 for information about PCIe slots and their locations. 3. Remove the PCIe card filler panel by completing the following tasks. a.

  • Page 162: Remove A Pcie Card

    3. If necessary, make a note of where the PCIe cards are installed. 4. Unplug all data cables from the PCIe card. Note the location of all cables for reinstallation later. 5. Remove the PCIe card filler panel by completing the following tasks. SPARC T3-2 Server Service Manual • December 2013...

  • Page 163: Install A Pcie Card

    a. Disengage the PCIe card slot crossbar from its locked position and rotate the crossbar to an upright position. b. Carefully remove the PCIe card from the card slot. Related Information “Remove a PCIe Card Filler Panel” on page 148 ■...
  • Page 164 Install the top cover. “Install the Top Cover” on page 196. b. Return the server to the normal rack position. “Return the Server to the Normal Rack Position” on page 197. SPARC T3-2 Server Service Manual • December 2013...

  • Page 165: Cable An Internal Sas Hba Pcie Card

    198. 6. If the PCIe card being installed is replacing a faulty PCIe card, manually clear the PCIe card fault using Oracle Integrated Lights Out Manager (ILOM). For instructions on clearing server faults, refer to the SPARC T3 Series Servers Administration Guide and to the Oracle ILOM documentation.
  • Page 166 “Install a PCIe Card” on page 151. Related Information “PCIe Card Configuration Rules” on page 147 ■ “Install a PCIe Card” on page 151 ■ The SAS HBA PCIe card documentation ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 167: Install A Pcie Card Filler Panel

    ▼ Install a PCIe Card Filler Panel Caution – This procedure requires that you handle components that are sensitive to static discharge. This sensitivity can cause the component to fail. To avoid damage, ensure that you follow antistatic practices as described in “ESD Measures”...
  • Page 168 “Power On the Server” on page 198. Related Information “Remove a PCIe Card Filler Panel” on page 148 ■ “Remove a PCIe Card” on page 150 ■ “Install a PCIe Card” on page 151 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 169: Servicing The Fan Board

    Servicing the Fan Board These topics explain how to remove and install the server’s fan board. “Remove the Fan Board” on page 157 ■ “Install the Fan Board” on page 159 ■ “Verify Fan Board Functionality” on page 161 ■ ▼...
  • Page 170 Remove the front memory riser guide by pulling it up and out of the chassis. d. Pull the fan board back and out of chassis. SPARC T3-2 Server Service Manual • December 2013...

  • Page 171: Install The Fan Board

    Related Information “Install the Fan Board” on page 159 ■ ▼ Install the Fan Board 1. Unpack the replacement fan board unit and place it on an antistatic mat. 2. Remove the fan board cable and power cables from the faulty fan board unit and plug them into the fan board on the replacement fan board unit.
  • Page 172 EZ label. Related Information “Remove the Fan Board” on page 157 ■ “Verify Fan Board Functionality” on page 161 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 173: Verify Fan Board Functionality

    ▼ Verify Fan Board Functionality 1. Run the ILOM show faulty command to verify that the fault has been cleared. “Managing Faults With ILOM” on page 22 for more information on using the show faulty command. 2. Perform one of the following tasks based on your verification results: If the previous steps did not clear the fault, see “Detecting and Managing ■...
  • Page 174 SPARC T3-2 Server Service Manual • December 2013...

  • Page 175: Servicing The Motherboard

    Servicing the Motherboard These topics explain how to remove and install the motherboard. “Motherboard Overview” on page 164 ■ “Remove the Motherboard” on page 164 ■ “Install the Motherboard” on page 167 ■ “Reactivate RAID Volumes” on page 170 ■ “Verify Motherboard Functionality”...

  • Page 176: Motherboard Overview

    When replacing the motherboard, remove the service processor and System Configuration PROM from the old motherboard and install these components on the new motherboard. The service processor contains the Oracle ILOM system configuration data and the System Configuration PROM contains the system host ID and MAC address.
  • Page 177 This is a cold service procedure that must be performed by qualified service personnel. The system must be completely powered down before performing this procedure. See “Cold Service, Replaceable by Authorized Service Personnel” on page 67 for more information about this category of service procedures. 1.
  • Page 178 Loosen the captive screw in the corner near the fans that secures the motherboard to the chassis. b. Grasp the handle on the motherboard and slide it toward the front of the chassis. c. Lift the motherboard out of the chassis. SPARC T3-2 Server Service Manual • December 2013...

  • Page 179: Install The Motherboard

    11. Remove the service processor from the motherboard so you can reinstall it on the new motherboard. “Remove the Service Processor” on page 176. Related Information “Motherboard Overview” on page 164 ■ “Install the Motherboard” on page 167 ■ “Verify Motherboard Functionality” on page 173 ■...
  • Page 180 14. Return the server to the normal rack position. “Return the Server to the Normal Rack Position” on page 197. 15. Reinstall the power cords to the power supplies. “Connect Power Cords to the Server” on page 198. SPARC T3-2 Server Service Manual • December 2013...
  • Page 181 16. Prior to powering on the server, connect a terminal or a terminal emulator (PC or workstation) to the service processor SER MGT port. Refer to the SPARC T3-2 Server Installation Guide for instructions. If the service processor detects the host firmware on the replacement motherboard...

  • Page 182: Reactivate Raid Volumes

    4. At the OpenBoot PROM prompt, use the show-devs command to list the device paths on the server: ok show-devs /pci@400/pci@2/pci@0/pci@e/scsi@0 You can also use the devalias command to locate device paths specific to your server: ok devalias scsi0 /pci@400/pci@2/pci@0/pci@e/scsi@0 scsi /pci@400/pci@2/pci@0/pci@e/scsi@0 SPARC T3-2 Server Service Manual • December 2013...
  • Page 183 5. Use the select command to choose the RAID module on the motherboard: ok select scsi Instead of using the alias name scsi, you could type the full device path name (such as /pci@400/pci@2/pci@0/pci@e/scsi@0). 6. List all connected logical RAID volumes to determine which volumes are in an inactive state: ok show-volumes For example, the following show-volumes output shows an inactive volume:...
  • Page 184 OS when powered-on. ok setenv auto-boot? true 11. Reboot the server. Related Information “Install the Motherboard” on page 167 ■ “Reactivate RAID Volumes” on page 170 ■ “Verify Motherboard Functionality” on page 173 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 185: Verify Motherboard Functionality

    ▼ Verify Motherboard Functionality 1. Run the ILOM show faulty command to verify that the fault has been cleared. “Managing Faults With ILOM” on page 22 for more information on using the show faulty command. 2. Perform one of the following tasks based on your verification results: If the previous steps did not clear the fault, see “Detecting and Managing ■...
  • Page 186 SPARC T3-2 Server Service Manual • December 2013...

  • Page 187: Servicing The Service Processor

    Servicing the Service Processor These topics describe service procedures for the service processor in the server. “Service Processor Firmware and Configuration” on page 176 ■ “Remove the Service Processor” on page 176 ■ “Install the Service Processor” on page 179 ■...

  • Page 188: Service Processor Firmware And Configuration

    When replacing the service processor, you must restore the configuration settings maintained in the service processor. Before replacing the service processor, save the configuration using the Oracle ILOM backup utility. Refer to the Oracle ILOM documentation for instructions on backing up and restoring the Oracle ILOM configuration.
  • Page 189 After you replace the service processor, restoring the service processor configuration will be easier if you had previously saved the configuration using the Oracle ILOM backup utility. If possible, back up the ILOM configuration before removing the service processor. Refer to the Oracle ILOM documentation for instructions on backing up and restoring the Oracle ILOM configuration.
  • Page 190 Lift the service processor up and away from the motherboard. Related Information “Service Processor Firmware and Configuration” on page 176 ■ “Install the Service Processor” on page 179 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 191: Install The Service Processor

    ▼ Install the Service Processor 1. Install the service processor by completing the following tasks. a. Lower the side of the service processor with the Align Tab sticker at an angle down on the service processor tab on the motherboard. b.
  • Page 192 Note – You can load any supported system firmware version, including the firmware version that was installed prior to replacing the service processor. c. If you created a backup of your Oracle ILOM configuration, use the ILOM restore utility to restore the configuration of the replacement service processor.

  • Page 193: Verify Service Processor Functionality

    ▼ Verify Service Processor Functionality 1. Verify that the SP Status LED is illuminated green. Note that the LED will flash green while the service processor initializes the ILOM firmware. See “Front and Rear Panel System Controls and LEDs” on page 20 information about the status of the SP LED.
  • Page 194 SPARC T3-2 Server Service Manual • December 2013...

  • Page 195: Servicing The Hard Disk Drive Backplane

    Servicing the Hard Disk Drive Backplane These topics explain how to remove and install memory risers, DIMMs, and filler panels in the server. “Remove the Hard Disk Drive Backplane” on page 183 ■ “Install the Hard Disk Drive Backplane” on page 185 ■...
  • Page 196 Swing the hard disk drive backplane back and out of the chassis. Related Information “Install the Hard Disk Drive Backplane” on page 185 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 197: Install The Hard Disk Drive Backplane

    ▼ Install the Hard Disk Drive Backplane 1. Unpack the replacement power supply backplane and place it on an antistatic mat. 2. Insert the hard disk drive backplane into the chassis. Verify that the hard disk drive backplane is seated properly at the bottom, in the small slot near the DVD drive.
  • Page 198 Related Information “Remove the Hard Disk Drive Backplane” on page 183 ■ “Install the Hard Disk Drive Backplane” on page 185 ■ “Verify Hard Disk Drive Backplane Functionality” on page 187 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 199: Verify Hard Disk Drive Backplane Functionality

    ▼ Verify Hard Disk Drive Backplane Functionality 1. Run the ILOM show faulty command to verify that the fault has been cleared. “Managing Faults With ILOM” on page 22 for more information on using the show faulty command. 2. Perform one of the following tasks based on your verification results: If the previous steps did not clear the fault, see “Detecting and Managing ■...
  • Page 200 SPARC T3-2 Server Service Manual • December 2013...

  • Page 201: Servicing The Power Supply Backplane

    Servicing the Power Supply Backplane These topics explain how to remove and install memory risers, DIMMs, and filler panels in the server. “Remove the Power Supply Backplane” on page 189 ■ “Install the Power Supply Backplane” on page 191 ■ “Verify Power Supply Backplane Functionality”...
  • Page 202 “Remove the Motherboard” on page 164. c. Disconnect the AC cables from power supply backplane and lift the backplane out of the chassis. SPARC T3-2 Server Service Manual • December 2013...

  • Page 203: Install The Power Supply Backplane

    Related Information “Install the Power Supply Backplane” on page 191 ■ ▼ Install the Power Supply Backplane 1. Unpack the replacement power supply backplane and place it on an antistatic mat. 2. Hold the power supply backplane at the end of the power supply cage and connect the AC cables to the AC connectors on the power supply backplane.
  • Page 204 Reinstall the power cords to the power supplies and power on the server. “Returning the Server to Operation” on page 195. Related Information “Remove the Power Supply Backplane” on page 189 ■ “Verify Power Supply Backplane Functionality” on page 193 ■ SPARC T3-2 Server Service Manual • December 2013...

  • Page 205: Verify Power Supply Backplane Functionality

    ▼ Verify Power Supply Backplane Functionality 1. Run the ILOM show faulty command to verify that the fault has been cleared. “Managing Faults With ILOM” on page 22 for more information on using the show faulty command. 2. Perform one of the following tasks based on your verification results: If the previous steps did not clear the fault, see “Detecting and Managing ■...
  • Page 206 SPARC T3-2 Server Service Manual • December 2013...

  • Page 207: Returning The Server To Operation

    Returning the Server to Operation These topics explain how to return the server to operation after you have performed service procedures. “Install the Top Cover” on page 196 ■ “Return the Server to the Normal Rack Position” on page 197 ■...

  • Page 208: Install The Top Cover

    2. Slide the top cover toward the rear of the chassis until the rear cover lip engages with the rear of the chassis. 3. To close the top cover, press down on the cover with both hands until both latches engage. SPARC T3-2 Server Service Manual • December 2013...

  • Page 209: Return The Server To The Normal Rack Position

    ▼ Return the Server to the Normal Rack Position Caution – The chassis is heavy. To avoid personal injury, use two people to lift it and set it in the rack. 1. Release the slide rails from the fully extended position by pushing the release tabs on the side of each rail.

  • Page 210: Connect Power Cords To The Server

    The first time the server powers on, the power-on self-test (POST) executes and can take several minutes to complete. SPARC T3-2 Server Service Manual • December 2013...
  • Page 211 Severe damage to server components can occur if the server is operated without adequate cooling mechanisms. Related Information “Access the Service Processor (Oracle ILOM)” on page 24 ■ “Power Off the Server (Service Processor Command)” on page 69 ■...
  • Page 212 SPARC T3-2 Server Service Manual • December 2013...

  • Page 213: Glossary

    Glossary baseboard management controller cable management arm chip level multiprocessor DHCP Dynamic Host Configuration Protocol data terminal equipment electrostatic discharge...
  • Page 214 ILOM Oracle Integrated Lights Out Manager Internet Protocol NET MGT network management port network interface card or controller Oracle Solaris Operation System Oracle Solaris OS POST POST power-on self-test SPARC T3-2 Server Service Manual • December 2013...
  • Page 215 QSFP quad small form-factor pluggable serial attached SCSI SER MGT serial management port service processor sold-state drive Secure Shell user interface UUID Universal Unique Identifier WWID world-wide identifier. A unique number that identifies a SAS target. Glossary...
  • Page 216 SPARC T3-2 Server Service Manual • December 2013...

  • Page 217: Index

    Index Symbols PCIe cards, 147 /var/adm/messages file, 37 DB-15 video connector, location of, 3 default Oracle ILOM password, 24 AC OK LED, location of, 3 diag level parameter, 46 accessing the service processor, 24 diag mode parameter, 46 accounts, Oracle ILOM, 24...
  • Page 218 DIMMs, 126 DVD drive, 141 installing hard disk drives, 90 DIMMs, 121, 124 memory riser, 129 DVD drive or filler panel, 141 PCIe card, 155 fan board, 159 removing SPARC T3-2 Server Service Manual • December 2013...
  • Page 219 HDDs, 83 over temperature LED, location of, 2 power supplies, 102 server, 65 location of replaceable components, 5 password, default Oracle ILOM, 24 log files, viewing, 37 PCIe card filler panels logging into Oracle ILOM, 24 installing, 155 removing, 148...
  • Page 220 157 showcomponent command, 56 fan modules, 96 slide rail latch, 72 hard disk drive backplane, 183 Solaris log files, 18 hard disk drive filler panels, 84 Solaris OS hard disk drives, 86 SPARC T3-2 Server Service Manual • December 2013...
  • Page 221 LEDs, locations of, 3 top cover installing, 196 removing, 76 troubleshooting by checking Oracle Solaris OS log files, 18 using POST, 19 using SunVTS, 18 using the show faulty command, 18 Universal Unique Identifier (UUID), 40 USB ports...
  • Page 222 SPARC T3-2 Server Service Manual • December 2013...

Table of Contents