Oracle SPARC T7-4 Service Manual
  1. Manuals
  2. Brands
  3. Oracle Manuals
  4. Server
  5. SPARC T7-4
  6. Service manual

Oracle SPARC T7-4 Service Manual

Hide thumbs Also See for SPARC T7-4:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Installation Manual
SPARC T7-4 Server Service Manual
Part No: E54994-07
May 2017

Advertisement

Table of Contents
loading

Related Manuals for Oracle SPARC T7-4

Summary of Contents for Oracle SPARC T7-4

  • Page 1 SPARC T7-4 Server Service Manual Part No: E54994-07 May 2017...
  • Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
  • Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...

  • Page 5: Table Of Contents

    PSH Overview .................. 25 Diagnostics Process ................ 26 Checking for Faults .................. 27 Interpreting LEDs ..................  27 ▼ Log In to Oracle ILOM (Service) ............ 32 ▼ Check for Faults ................ 33 Interpreting Log Files and System Messages ............ 35 ▼ Check the Message Buffer .............. 36 ▼ View Log Files (Oracle Solaris) ............ 36 ▼...
  • Page 6 ▼ Remove a Processor Module or Processor Filler Module .........  60 ▼ Install a Processor Module or Processor Filler Module ........ 64 ▼ Verify a Processor Module .................  67 Servicing DIMMs .................... 69 Understanding DIMM Configurations ...............  69 SPARC T7-4 Server Service Manual • May 2017...
  • Page 7 DIMM FRU Names .................. 73 DIMM Fault Handling ...................  74 Identifying Faulty DIMMs ................ 74 ▼ Determine Which DIMM Is Faulty (Oracle ILOM) ......... 75 ▼ Determine Which DIMM Is Faulty (PSH) .......... 75 ▼ Determine Which DIMM Is Faulty (DIMM Fault LEDs) ...... 76 ▼ Remove a DIMM .................. 78 ▼...
  • Page 8 ▼ Install a Power Supply ................ 153 ▼ Verify a Power Supply ................ 156 Servicing Fan Modules .................. 157 Fan Module Configuration ................ 157 Fan Module LED .................. 158 ▼ Determine Which Fan Module Is Faulty .............  158 ▼ Remove a Fan Module ................ 159 SPARC T7-4 Server Service Manual • May 2017...
  • Page 9 ▼ Remove the Rear Chassis Subassembly ............ 194 ▼ Install the Rear Chassis Subassembly ............ 197 ▼ Verify the Rear Chassis Subassembly ............ 198 Returning the Server to Operation .............. 201 ▼ Connect Power Cords ................ 201 ▼ Power On the Server (Oracle ILOM) ............ 202 Index ........................  203...
  • Page 10 SPARC T7-4 Server Service Manual • May 2017...

  • Page 11: Using This Documentation

    Audience – Technicians, system administrators, and authorized service providers ■ Required knowledge – Advanced experience troubleshooting and replacing hardware ■ Product Documentation Library Documentation and resources for this product and related products are available at http://www. oracle.com/goto/t7-4/docs. Feedback Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback. Using This Documentation...
  • Page 12 SPARC T7-4 Server Service Manual • May 2017...

  • Page 13: Identifying Components

    Identifying Components These topics identify key components of the server, including major boards and internal system cables, as well as front and rear panel features. “Front Panel Components (Service)” on page 14 ■ “Rear Panel Components (Service)” on page 16 ■...

  • Page 14: Front Panel Components (Service)

    “Returning the Server to Operation” on page 201 Main module “Main Module Components” on page 20 “Servicing the Main Module” on page 99 Power supplies (4) “Servicing Power Supplies” on page 147 SPARC T7-4 Server Service Manual • May 2017...
  • Page 15 Front Panel Components (Service) Related Information “Rear Panel Components (Service)” on page 16 ■ “Chassis Subassembly Components” on page 18 ■ “Processor Module Components” on page 19 ■ “Main Module Components” on page 20 ■ “Supported Storage and Backup Devices” on page 22 ■...

  • Page 16: Rear Panel Components (Service)

    “Servicing PCIe Cards” on page 165 These components are accessible within the rear chassis subassembly, which you can access after you have removed all the components from the rear of the server. SPARC T7-4 Server Service Manual • May 2017...
  • Page 17 Rear Panel Components (Service) Description Links Chassis Midplane assembly “Servicing the Rear Chassis Subassembly” on page 193 Rear chassis subassembly “Servicing the Rear Chassis Subassembly” on page 193 Related Information “Front Panel Components (Service)” on page 14 ■ “Chassis Subassembly Components” on page 18 ■...

  • Page 18: Chassis Subassembly Components

    “Servicing Fan Modules” on page 157 PCIe carriers (16) “Servicing PCIe Cards” on page 165 Rear I/O module “Servicing the Rear I/O Module” on page 183 Power supplies (4) “Servicing Power Supplies” on page 147 SPARC T7-4 Server Service Manual • May 2017...

  • Page 19: Processor Module Components

    Processor Module Components Related Information “Front Panel Components (Service)” on page 14 ■ “Rear Panel Components (Service)” on page 16 ■ “Processor Module Components” on page 19 ■ “Main Module Components” on page 20 ■ “Supported Storage and Backup Devices” on page 22 ■...

  • Page 20: Main Module Components

    “Component Service Task Reference” on page 22 ■ “System Schematic” on page 41 ■ Main Module Components These components are accessible after you remove the main module from the front of the server. SPARC T7-4 Server Service Manual • May 2017...
  • Page 21 Main Module Components Description Links Hard drives “Servicing Hard Drives” on page 87 Front I/O assembly and cables “Servicing the Front I/O Assembly” on page 143 Storage backplane “Servicing the Drive Backplane” on page 119 Main module motherboard “Servicing the SPM” on page 125 SCC PROM “Servicing the SCC PROM”...

  • Page 22: Supported Storage And Backup Devices

    “Component Service Task Reference” on page 22 ■ “System Schematic” on page 41 ■ Component Service Task Reference This table lists the names of serviceable components. It also lists the system names and task locations for the components. SPARC T7-4 Server Service Manual • May 2017...
  • Page 23 Component Service Task Reference Component Max. NAC Name SDM Name Link to Service Procedure Processor “Servicing Processor /SYS/PMx /System/CPU_Modules/CPU_Module_x module Modules” on page 55 Processor “Servicing Processor /SYS/PFMx filler module Modules” on page 55 DIMM “Servicing /SYS/PMx/CMx/CMP/ /System/Memory/DIMMs/DIMM_x DIMMs” on page 69 BOBxx/CHx/DIMM Main module None...
  • Page 24 “Chassis Subassembly Components” on page 18 ■ “Processor Module Components” on page 19 ■ “Main Module Components” on page 20 ■ “Supported Storage and Backup Devices” on page 22 ■ “System Schematic” on page 41 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 25: Detecting And Managing Faults

    Detecting and Managing Faults These topics explain how to use various diagnostic tools to monitor server status and troubleshoot faults in the server. The examples use the PSH fmadm faulty command. “Understanding Diagnostics” on page 25 ■ “Checking for Faults” on page 27 ■...

  • Page 26: Diagnostics Process

    If system messages indicate a faulty component, replace “Interpreting Log Files and System information. Messages” on page 35 Run POST to provide If POST indicates a faulty component, replace it. “Configuring POST” on page 37 additional low-level SPARC T7-4 Server Service Manual • May 2017...

  • Page 27: Checking For Faults

    ■ Checking for Faults Use these methods to check for faults: “Interpreting LEDs” on page 27 ■ “Log In to Oracle ILOM (Service)” on page 32 ■ “Check for Faults” on page 33 ■ Interpreting LEDs Use these steps to determine if an LED indicates that a component has failed in the server.
  • Page 28 ■ “Determine if the Rear I/O Module Is Faulty” on page 186 Related Information “Front Panel Controls and LEDs” on page 29 ■ “Rear Panel Controls and LEDs” on page 31 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 29: Front Panel Controls And Leds

    Checking for Faults Front Panel Controls and LEDs Icon or Label Description Locator LED and You can turn on the Locator LED to identify a particular button (white) server. When lit, the LED blinks rapidly. Turn on the Locator LED by pressing the Locator button, or see “Locate the Server”...
  • Page 30 ■ Off – Indicates a steady state, no service action is required. ■ Steady on – Indicates that a failure event has been acknowledged and a service action is required on at least one of the PCIe cards. SPARC T7-4 Server Service Manual • May 2017...
  • Page 31 Checking for Faults Rear Panel Controls and LEDs Icon or Label Description AC 0 (left) and AC 1 (right) Indicates these conditions: power LED ■ Off – No power is applied to the server. ■ Green – Power is applied to the server. Net MGT port link LED Indicates these conditions: ■...

  • Page 32: Log In To Oracle Ilom (Service)

    ■ Steady on, green – SPM is running in its normal operating state. No service actions are required. ■ Blink, green – SPM is initializing the Oracle ILOM firmware. ■ Steady on, amber – An SPM error has occurred and service is required.

  • Page 33: Check For Faults

    “Log In to Oracle ILOM (Service)” on page Check for PSH-diagnosed faults. This example shows how to check for faults through the Oracle ILOM fault management shell. -> start /SP/faultmgmt/shell Are you sure you want to start /SP/faultmgmt/shell (y/n)? y faultmgmtsp>...
  • Page 34 : Refer to the associated reference document at               https://support.oracle.com/msg/PCIEX-8000-8R for the latest               service procedures and policies regarding this diagnosis. faultmgmtsp> In this example, a fault is displayed that includes these details: ■ Date and time of the fault (2012-08-27/19:46:26). SPARC T7-4 Server Service Manual • May 2017...

  • Page 35: Interpreting Log Files And System Messages

    ■ Interpreting Log Files and System Messages With the OS running on the server, you have the full complement of Oracle Solaris OS files and commands available for collecting information and for troubleshooting. If PSH does not indicate the source of a fault, check the message buffer and log files for notifications for faults.

  • Page 36: Check The Message Buffer

    Over a period of time, the messages are further rotated to messages.2 and messages.3, and then deleted. Log in as superuser. Type: # more /var/adm/messages To view all logged messages, type: SPARC T7-4 Server Service Manual • May 2017...

  • Page 37: View Log Files (Oracle Ilom)

    POST checks the basic integrity of the critical hardware components in the server. You can also set other Oracle ILOM properties to control various other aspects of POST operations. For example, you can specify the events that cause POST to run, the level of testing...

  • Page 38: Configure Post

    : Possible values = off, min, max default_level : User role required for set = r default_verbosity : Diag verbosity in the default cause (no error or hw change) default_verbosity : Possible values = none, min, normal, max SPARC T7-4 Server Service Manual • May 2017...
  • Page 39 Configure POST default_verbosity : User role required for set = r error_level : Diag level when running after an error reset error_level : Possible values = off, min, max error_level : User role required for set = r error_verbosity : Diag verbosity when running after an error reset error_verbosity : Possible values = none, min, normal, max error_verbosity : User role required for set = r hw_change_level : Diag level when running after a hw change...

  • Page 40: Clear A Fault Manually

    In some cases, even though the fault is cleared, some persistent fault information remains and results in erroneous fault messages at boot time. To ensure that these messages are not displayed, type this PSH command: faultmgmtsp> fmadm acquit UUID If required, reset the server. SPARC T7-4 Server Service Manual • May 2017...

  • Page 41: System Schematic

    System Schematic In some cases, the output of the fmadm faulty command might include this message for the faulty component: Component faulted and taken out of service If this message appears in the output, you must reset the server after you manually repair the fault.

  • Page 42: Related Information

    ■ “Processor Module Components” on page 19 ■ “Main Module Components” on page 20 ■ “Supported Storage and Backup Devices” on page 22 ■ “Component Service Task Reference” on page 22 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 43: Preparing For Service

    Preparing for Service These topics describe how to prepare the server for servicing. Step Description Link Review safety and handling information. “Safety Information” on page 43 Gather the tools needed for service. “Tools Needed for Service” on page 45 Consider filler options. “Component Fillers”...

  • Page 44: Safety Symbols

    PCIe cards. When servicing or removing server components, attach an antistatic strap to your wrist and then to a metal area on the chassis. Following this practice equalizes the electrical potentials between you and the server. SPARC T7-4 Server Service Manual • May 2017...

  • Page 45: Antistatic Mat

    Tools Needed for Service Antistatic Mat Place ESD-sensitive components such as motherboards, memory, and other PCBs on an antistatic mat. Related Information “Tools Needed for Service” on page 45 ■ “Component Fillers” on page 46 ■ “Component Service Categories” on page 46 ■...

  • Page 46: Component Fillers

    Cold-serviceable components require that the server is shut down. In addition, some service procedures require that the power cables be disconnected between the power supplies and the power source. The following table identifies the server components that are replaceable. SPARC T7-4 Server Service Manual • May 2017...

  • Page 47: Find The Server Serial Number

    Find the Server Serial Number Component Power Status for Authorized Remove and Replace Instructions Removal Service Personnel Only Processor module “Servicing Processor Modules” on page 55 DIMM “Servicing DIMMs” on page 69 Hard drive Off or On “Servicing Hard Drives” on page 87 †...
  • Page 48 “Tools Needed for Service” on page 45 ■ “Component Fillers” on page 46 ■ “Component Service Categories” on page 46 ■ “Locate the Server” on page 49 ■ “Prevent ESD Damage” on page 49 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 49: Locate The Server

    Locate the Server You can use the Locator LEDs to identify a particular server. At the Oracle ILOM prompt, type: -> set /SYS/LOCATE value=Fast_Blink The white Locator LEDs (one on the front panel and one on the rear panel) blink.

  • Page 50: Removing Power From The Server

    These topics describe different methods for removing power from the chassis. “Prepare to Power Off the Server” on page 51 ■ “Power Off the Server (Oracle ILOM)” on page 51 ■ “Power Off the Server (Power Button – Graceful Shutdown)” on page 52 ■...

  • Page 51: Prepare To Power Off The Server

    Depending on the type of problem, you might want to view server status or log files. You also might want to run diagnostics before you shut down the server. Switch from the system console to the Oracle ILOM -> prompt by typing the #. (Hash-Period) key sequence.

  • Page 52: Power Off The Server (Power Button - Graceful Shutdown)

    If you are powering off the server in order to add a second processor module, return to “Server Upgrade Process” on page Related Information “Power Off the Server (Oracle ILOM)” on page 51 ■ “Power Off the Server (Power Button – Emergency Shutdown)” on page 52 ■...

  • Page 53: Disconnect Power Cords

    Disconnect Power Cords Related Information “Power Off the Server (Oracle ILOM)” on page 51 ■ “Power Off the Server (Power Button – Graceful Shutdown)” on page 52 ■ Disconnect Power Cords You must disconnect the power cords before accessing the following components: Main module ■...

  • Page 54: Attachment Of Devices During Service

    “Connecting Cables” in SPARC T7-4 Server Installation Guide. If you plan to connect to the Oracle ILOM software over the network, connect an Ethernet ■ cable to the Ethernet port labeled NET MGT. The SP uses the NET MGT (out-of-band) port by default. You can configure the Note - SP to share one of the sever's four Ethernet ports instead.

  • Page 55: Servicing Processor Modules

    Servicing Processor Modules This topic describes how to service processor modules, and how to upgrade the server from a single processor module configuration to a dual processor module configuration. You must disconnect the power cords before servicing this component. See Caution - “Disconnect Power Cords”...

  • Page 56: Server Upgrade Process

    Server Upgrade Process “Returning the Server to Operation” on page 201 ■ Server Upgrade Process The SPARC T7-4 server supports two processor module configurations: Fully-populated — Two processor modules ■ Half-populated— One processor module and one processor filler module ■...

  • Page 57: Processor Module Configuration

    “Returning the Server to Operation” on page 201 ■ Processor Module Configuration Processor modules are accessed from the front of the server. In Oracle ILOM, the processor modules are numbered PM0 and PM1, starting with the lower slot. Servicing Processor Modules...
  • Page 58 Processor Module 1 (PM1) or processor filler module Processor Module 0 (PM0) In servers with two processor modules installed, DIMMs configurations Note - in both processor modules must be identical. See “Understanding DIMM Configurations” on page SPARC T7-4 Server Service Manual • May 2017...

  • Page 59: Processor Module Leds

    Processor Module LEDs Processor Module LEDs Icon Description (No function.) Not supported. Service Required (amber) Indicates that the processor module has experienced a fault condition. OK (green) Indicates if the processor module is available for use. ■ On – The server is running and the processor module is functioning correctly.

  • Page 60: Determine Which Processor Module Is Faulty

    For the location of the modules, see “Processor Module Configuration” on page You must disconnect the power cords before servicing this component. See Caution - “Disconnect Power Cords” on page SPARC T7-4 Server Service Manual • May 2017...
  • Page 61 Remove a Processor Module or Processor Filler Module This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. Prepare the server for service. “Preparing for Service” on page Ensure that the server is powered off.
  • Page 62 Press the two extraction levers in toward the server and pull the extraction levers out to disengage the processor module or processor filler module from the server. Pull the processor module or processor filler module halfway out of the server, and close the levers. SPARC T7-4 Server Service Manual • May 2017...
  • Page 63 Remove a Processor Module or Processor Filler Module This action protects the levers from damage while the module is outside the server. Using two hands, completely remove the processor module or processor filler module and place the module on an antistatic mat. Do not touch the connectors at the rear of the module.

  • Page 64: Install A Processor Module Or Processor Filler Module

    This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. Ensure the power cords are disconnected. “Disconnect Power Cords” on page SPARC T7-4 Server Service Manual • May 2017...
  • Page 65 Install a Processor Module or Processor Filler Module Determine your next step. If you are installing a processor module after replacing or installing DIMMs, ■ go to Step If you are installing a new processor module to replace a faulty one, install ■...
  • Page 66 “Processor Module LEDs” on page 59 ■ “Determine Which Processor Module Is Faulty” on page 60 ■ “Remove a Processor Module or Processor Filler Module” on page 60 ■ “Servicing DIMMs” on page 69 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 67: Verify A Processor Module

    “Verify a Processor Module” on page 67 ■ Verify a Processor Module Use the Oracle ILOM fault management shell to determine if the new processor module is shown as enabled or disabled. -> start /SP/faultmgmt/shell Are you sure you want to start /SP/faultmgmt/shell (y/n)? y  ...
  • Page 68 “Determine Which Processor Module Is Faulty” on page 60 ■ “Remove a Processor Module or Processor Filler Module” on page 60 ■ “Install a Processor Module or Processor Filler Module” on page 64 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 69: Servicing Dimms

    Servicing DIMMs Up to 32 DIMMs can be installed in each processor module, for a total of 64 DIMMs in the server. DIMMs are cold-service components that can be replaced by customers. For the location of the DIMMs, see “Processor Module Components” on page This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge.

  • Page 70: Supported Memory Configurations

    “Remove a DIMM” on page 78 ■ “Install a DIMM” on page 80 ■ “Verify a DIMM” on page 83 ■ “Server Upgrade Process” on page 56 ■ “Processor Module Configuration” on page 57 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 71: Identifying Dimms

    Understanding DIMM Configurations Identifying DIMMs Each DIMM is affixed with an identifying label. The first four characters on the label describe the DIMM memory capacity; the second four characters describe the rank classification. Use these labels to identify the DIMMs installed in the server, to verify that any replacement DIMMs are compatible, or to confirm that upgrade DIMMs may be installed in a supported configuration.

  • Page 72: Dimm Configuration Errors

    “Clear a Fault Manually” on page 40 ■ “Understanding DIMM Configurations” on page 69 ■ “DIMM FRU Names” on page 73 ■ “Identifying DIMMs” on page 71 ■ “DIMM Fault Handling” on page 74 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 73: Dimm Fru Names

    DIMM FRU Names DIMM FRU Names The following table illustrates the DIMM addresses on a processor module, with the front of the processor module oriented toward the left: CM1/BOB21/CH1 CM1/BOB01/CH1 CM1/BOB21/CH0 CM1/BOB01/CH0 CM1/BOB20/CH0 CM1/BOB00/CH0 CM1/BOB20/CH1 CM1/BOB00/CH1 CM1/BOB30/CH1 CM1/BOB10/CH1 CM1/BOB30/CH0 CM1/BOB10/CH0 CM1/BOB31/CH0 CM1/BOB11/CH0 CM1/BOB31/CH1...

  • Page 74: Dimm Fault Handling

    PSH reports the fault and suggests a replacement for the DIMMs associated with the fault. If you suspect the server has a memory problem, run the Oracle ILOM show faulty command. This command lists memory faults and identifies the DIMM modules associated with the fault.

  • Page 75: Determine Which Dimm Is Faulty (Oracle Ilom)

    “Determine Which DIMM Is Faulty (DIMM Fault LEDs)” on page 76 ■ Determine Which DIMM Is Faulty (Oracle ILOM) If you suspect that the server has a memory problem, run the Oracle ILOM show faulty command. This command lists memory faults and identifies the DIMM modules associated with the fault.

  • Page 76: Determine Which Dimm Is Faulty (Dimm Fault Leds)

    Please refer to the associated reference document at http://support.oracle.com/msg/SPSUN4V-8000-EJ for the latest service procedures and policies regarding this diagnosis. Related Information “Determine Which DIMM Is Faulty (Oracle ILOM)” on page 75 ■ “Determine Which DIMM Is Faulty (DIMM Fault LEDs)” on page 76 ■...
  • Page 77 Determine Which DIMM Is Faulty (DIMM Fault LEDs) Consider your first steps. Familiarize yourself with DIMM configuration rules. ■ “Understanding DIMM Configurations” on page 69 Prepare the system for service. ■ “Preparing for Service” on page Remove the processor module containing the faulty DIMM. Place the ■...

  • Page 78: Remove A Dimm

    Note the address of the DIMM next to any illuminated Memory DIMM Fault LED. Ensure that all other DIMMs are seated correctly in their slots. Related Information “Determine Which DIMM Is Faulty (Oracle ILOM)” on page 75 ■ “Determine Which DIMM Is Faulty (PSH)” on page 75 ■...
  • Page 79 Remove a DIMM Press the green button near the front edge of the cover and slide the cover back and up off the main module. Locate the DIMMs that need to be replaced. “Determine Which DIMM Is Faulty (DIMM Fault LEDs)” on page Push down on the ejector tabs on each side of the DIMM until the DIMM is released.

  • Page 80: Install A Dimm

    This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. Consider your first steps. Familiarize yourself with DIMM population rules. ■ “Understanding DIMM Configurations” on page 69 SPARC T7-4 Server Service Manual • May 2017...
  • Page 81 Install a DIMM Prepare the system for service. ■ “Preparing for Service” on page Remove the processor module. Place the processor module on an ESD- ■ protect work surface. “Remove a Processor Module or Processor Filler Module” on page Consider your next steps. If you are replacing a faulty DIMM, ensure that you have removed the faulty ■...
  • Page 82 Place the cover onto the processor module and slide the cover forward until the latch clicks into place. Consider your next steps. If you are adding a second processor module to the server, return to “Server ■ Upgrade Process” on page SPARC T7-4 Server Service Manual • May 2017...

  • Page 83: Verify A Dimm

    “DIMM Configuration Errors” on page 72 ■ Verify a DIMM Access the Oracle ILOM prompt. Refer to the SPARC T7 Series Server Administration Guide for instructions. Use the show faulty command to determine how to clear the fault. If show faulty indicates a POST-detected fault, go to Step ■...
  • Page 84 4g. If it Note - remains at the ok prompt go to Step If the server remains at the ok prompt, type boot. Return the virtual keyswitch to normal mode. -> set /SYS keyswitch_state=normal SPARC T7-4 Server Service Manual • May 2017...
  • Page 85 UUID, you are done with the verification process. Switch to the system console and use the fmadm repair command with the UUID. Use the same UUID that was displayed from the output of the Oracle ILOM show faulty command. For example:...
  • Page 86 SPARC T7-4 Server Service Manual • May 2017...

  • Page 87: Servicing Hard Drives

    Servicing Hard Drives Hard drives are hot-service components that can be replaced by customers. For the location of the hard drives, see “Hard Drive Configuration” on page This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge.
  • Page 88 “Component Service Task Reference” on page 22 ■ “Hard Drive LEDs” on page 89 ■ “Determine Which Hard Drive Is Faulty” on page 90 ■ “Remove a Hard Drive” on page 90 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 89: Hard Drive Leds

    Hard Drive LEDs “Install a Hard Drive” on page 94 ■ “Verify a Hard Drive” on page 95 ■ Hard Drive LEDs Icon Description Ready to Remove Indicates that a drive can be removed during a hot-service operation. (blue) Service Required Indicates that the drive has experienced a fault condition.

  • Page 90: Determine Which Hard Drive Is Faulty

    This discharge can cause failure of server components. Locate the drive in the server that you want to remove. “Hard Drive Configuration” on page 87 for the locations of the drives in the server. ■ SPARC T7-4 Server Service Manual • May 2017...
  • Page 91 Take the drive offline: For a standard drive: ■ At the Oracle Solaris prompt, type the cfgadm -al command to list all drives in the device tree, including drives that are not configured. # cfgadm -al This command lists dynamically reconfigurable hardware resources and shows their operational status.
  • Page 92 # hotplug list -lc In this state, the blue OK to Remove LED on the NVMe drive is lit. Do not remove the drive unless the blue OK to Remove LED is lit. Note - SPARC T7-4 Server Service Manual • May 2017...
  • Page 93 Remove a Hard Drive Press the drive release button to unlock the drive. Pull on the latch to remove the drive from the server. The latch is not an ejector. Do not force the latch too far to the right. Doing so can Caution - damage the latch.

  • Page 94: Install A Hard Drive

    “Hard Drive Configuration” on page 87 for drive slot information. Close the latch to lock the drive in place. Verify the installation. SPARC T7-4 Server Service Manual • May 2017...

  • Page 95: Verify A Hard Drive

    Refer to the Oracle Solaris OS administration documentation for more information. At the Oracle Solaris prompt, type the cfgadm -al command to list all drives in the device tree, including any drives that are not configured.
  • Page 96 Verify that the blue Ready-to-Remove LED is no longer lit on the drive that you installed. “Hard Drive LEDs” on page At the Oracle Solaris prompt, type the cfgadm -al command to list all drives in the device tree, including any drives that are not configured. # cfgadm -al The replacement drive is now listed as configured.
  • Page 97 ■ the tasks required to configure the drive. These tasks are covered in the Oracle Solaris OS administration documentation. For additional drive verification, you can run the Oracle VTS software. Refer to the Oracle VTS documentation for details. Related Information “Determine Which Hard Drive Is Faulty”...
  • Page 98 SPARC T7-4 Server Service Manual • May 2017...

  • Page 99: Servicing The Main Module

    Servicing the Main Module For the location of the main module, see “Front Panel Components (Service)” on page This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. You must disconnect the power cords before servicing this component.

  • Page 100: Main Module Leds

    Main Module LEDs Icon Description Service Required LED Indicates that service is required. POST and Oracle ILOM are two (amber) diagnostic tools that can detect a fault or failure resulting in this indication. The Oracle ILOM show faulty command provides details about any faults that cause this indicator to illuminate.

  • Page 101: Determine If The Main Module Is Faulty

    ■ Steady on, green – SPM is running in its normal operating state. No service actions are required. ■ Blink, green – SPM is initializing the Oracle ILOM firmware. ■ Steady on, amber – A SPM error has occurred and service is required.
  • Page 102 Locate the main module in the server. “Front Panel Components (Service)” on page Squeeze the release latches together on the two extraction levers, and pull the extraction levers out to disengage the main module from the server. SPARC T7-4 Server Service Manual • May 2017...
  • Page 103 Remove the main module completely from the server. Consider your next steps: If you have removed the main module to prepare the server for installation, ■ return to “Preparing for Installation” in SPARC T7-4 Server Installation Guide. Servicing the Main Module...
  • Page 104 If you are replacing a component inside the main module, use one of the ■ following links: “Servicing the SPM” on page 125 ■ “Servicing the Battery” on page 137 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 105: Install The Main Module

    Install the Main Module “Servicing the SCC PROM” on page 133 ■ “Servicing the Front I/O Assembly” on page 143 ■ “Servicing the Drive Backplane” on page 119 ■ Related Information “Main Module Components” on page 20 ■ “Main Module LEDs” on page 100 ■...
  • Page 106 Insert the main module into its slot in the server until the levers begin to engage. Press the levers back together, toward the center of the module, then press the levers firmly against the module to fully seat the module back into the server. SPARC T7-4 Server Service Manual • May 2017...
  • Page 107 You must upgrade the firmware to a newer version that supports this chassis. Download the system firmware. Configure the SER MGT port to enable the firmware image to be downloaded. Refer to the Oracle ILOM documentation for network configuration instructions. Servicing the Main Module...

  • Page 108: Verify The Main Module

    You can load any supported system firmware version, including the firmware revision Note - that had been installed prior to the replacement of the main module. However, Oracle strongly recommends installing the newest version of the system firmware. Restore the ILOM configuration settings.
  • Page 109 Verify the Main Module “Remove the Main Module” on page 101 ■ “Install the Main Module” on page 105 ■ Servicing the Main Module...
  • Page 110 SPARC T7-4 Server Service Manual • May 2017...

  • Page 111: Servicing Nvme Switch Cards

    Servicing NVMe Switch Cards Two optional NVMe switch cards can be installed in the main module. If you are replacing a faulty main module, you must remove the NVMe switch cards to transfer them to the new main module. Part Description NVMe Switch 2 ( /SYS/MB/PCIE2/PCIESW ) NVMe Switch 1 ( /SYS/MB/PCIE1/PCIESW )

  • Page 112: Disconnect The Nvme Cables

    If you are moving the NVMe switch cards to a new main module, unplug the ■ cables from the backplane. If you are replacing the NVMe cables, unplug the cables from the card and ■ the backplane and remove them from the main module. SPARC T7-4 Server Service Manual • May 2017...

  • Page 113: Remove A Nvme Switch Card

    Remove a NVMe Switch Card Note the locations of the cable connectors so can install them correctly. Remove the NVMe switch card. “Remove a NVMe Switch Card” on page 113. Remove a NVMe Switch Card Identify which NVMe switch card you want to remove. Unlock the card.

  • Page 114: Install A Nvme Switch Card

    Push the card away from its connector on the motherboard and lift the card out of the main module. Install a NVMe Switch Card Align the NVMe switch card with its connector on the motherboard. SPARC T7-4 Server Service Manual • May 2017...
  • Page 115 Install a NVMe Switch Card Insert the rear edge of the NVMe switch card into the corresponding tab on the Note - motherboard. Insert the card into its connector. Servicing NVMe Switch Cards...
  • Page 116 Install a NVMe Switch Card The card is inserted laterally into the motherboard connector. Lock the card. Rotate the retention lever toward the card bracket. SPARC T7-4 Server Service Manual • May 2017...

  • Page 117: Connect The Nvme Cables

    “Install the Main Module” on page 105. Verify a NVMe Switch Card Use the Oracle ILOM fault management shell to determine if the replacement NVMe switch card is shown as enabled or disabled: -> start /SP/faultmgmt/shell Are you sure you want to start /SP/faultmgmt/shell (y/n)? y  ...
  • Page 118 Related Information “Main Module Components” on page 20 ■ “Remove the Main Module” on page 101 ■ “Install the Main Module” on page 105 ■ “Servicing the Drive Backplane” on page 119 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 119: Servicing The Drive Backplane

    Servicing the Drive Backplane For the location of the drive backplane, see “Processor Module Components” on page This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. “Remove the Drive Backplane”...
  • Page 120 Remove the Drive Backplane Disconnect the four drive backplane cables from the drive backplane. Data cables(2) Power cables (2) Unplug the data cables from the drive backplane. Unplug the power cables from the drive backplane. SPARC T7-4 Server Service Manual • May 2017...

  • Page 121: Install The Drive Backplane

    Install the Drive Backplane Lift up on the plastic retaining clips to disengage them from the top of the hard drive assembly. Push the plastic panel toward the rear of the main module, and remove the plastic panel from the main module. Push the top edge of the drive backplane slightly toward the rear of the main module, then lift the drive backplane up and remove it from the main module.
  • Page 122 Press on the press point on the retaining panel to secure it to the top of the hard drive assembly. Connect the drive backplane cables to the drive backplane and the motherboard. Connect the data cable to the drive backplane and the motherboard. SPARC T7-4 Server Service Manual • May 2017...
  • Page 123 Install the Drive Backplane Connect the power cable to the drive backplane and the motherboard. Data cable, drive backplane connections Power cable, drive backplane connections Insert the main module back into the server. “Install the Main Module” on page 105. Install the hard drives into the main module.
  • Page 124 SPARC T7-4 Server Service Manual • May 2017...

  • Page 125: Servicing The Spm

    Servicing the SPM These topics describe service procedures for the service processor module (SPM) in the server. Caution - This procedure requires that you handle components that are sensitive to electrostatic discharge. This discharge can cause failure of server components. Steps Description Links...

  • Page 126: Remove The Spm

    The acceptable values for uri are: ■ tftp ■ ■ sftp ■ ■ http ■ https ■ target is the remote location where you want to store the configuration ■ information. For example: -> dump -destination tftp://129.99.99.99/pathname SPARC T7-4 Server Service Manual • May 2017...
  • Page 127 Remove the SPM Take the necessary ESD precautions. “Prevent ESD Damage” on page Remove the main module from the server. “Remove the Main Module” on page 101. Locate the SPM on the main module. “Main Module Components” on page Grasp the SPM by the two grasp points, and lift up to disengage the SPM from the connectors on the motherboard.

  • Page 128: Install The Spm

    This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. Take the necessary ESD precautions. “Prevent ESD Damage” on page SPARC T7-4 Server Service Manual • May 2017...
  • Page 129 Install the SPM Lower the side of the SPM with the Align Tab sticker down on the service processor tab on the motherboard. Lower the other side of the SPM down and press down on the SPM to seat it into the connectors on the motherboard.
  • Page 130 You can load any supported system firmware version, including the firmware revision Note - that had been installed prior to the replacement of the SPM. However, Oracle strongly recommends installing the newest version of the system firmware. Restore the service processor configuration information that you backed up earlier.

  • Page 131: Verify The Spm

    Restore the TPM data and keys that were backed up to the new SP you install. For information about migrating or restoring TPM data and keys, see Securing Systems and Attached Devices in Oracle Solaris 11.3. Verify the installation of the SPM. “Verify the SPM” on page 131.
  • Page 132 No further action is required. Related Information “Determine if the SPM Is Faulty” on page 125 ■ “Remove the SPM” on page 126 ■ “Install the SPM” on page 128 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 133: Servicing The Scc Prom

    Servicing the SCC PROM These topics describe service procedures for the SCC PROM in the server. The SCC PROM stores the host ID and MAC address. If you have to replace the motherboard, be sure to move the System configuration PROM from the old motherboard to the new motherboard.

  • Page 134: Install The Scc Prom

    “Install the SCC PROM” on page 134 ■ Install the SCC PROM Before beginning this procedure, ensure that you are familiar with the cautions and safety instructions described in “Safety Information” on page SPARC T7-4 Server Service Manual • May 2017...
  • Page 135 Install the SCC PROM This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. Orient the SCC PROM properly onto the main module. Press down on the SCC PROM until it is completely seated on the main module. Insert the main module back into the server.

  • Page 136: Verify The Scc Prom

    Use the Oracle ILOM show command to display the MAC address: ■ -> show /HOST macaddress /HOST Properties: macaddress = **:**:**:**:**:** Use Oracle Solaris OS commands to display the hostid and Ethernet address: ■ # hostid 8534299c   # ifconfig -a lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL>...

  • Page 137: Servicing The Battery

    Servicing the Battery The battery is a cold-service component that can be replaced by a customer. For the location of the battery, see “Processor Module Components” on page Caution - This procedure requires that you handle components that are sensitive to electrostatic discharge.
  • Page 138 Locate the battery in the main module. “Main Module Components” on page Remove the old battery Pinch the battery between two fingers and slide it up and out of the battery holder. Unpack and install the new battery. SPARC T7-4 Server Service Manual • May 2017...
  • Page 139 Return the Server to Operation. Reset the system clock. Use the Oracle ILOM clock command to reset the system clock. The following example sets the date to August 22, 2016, and the timezone to EDT. -> set /SP/clock datetime=081221302016timezone=EDT Set 'datetime' to '081221302016' set 'timezone' to 'EDT' ->...

  • Page 140: Verify The Battery

    = N/A lower_noncritical_threshold = 2.704 Volts lower_critical_threshold = N/A lower_nonrecov_threshold = N/A alarm_status = cleared Commands: show Verify that the value in the value column shows a voltage of 2.8V or more. SPARC T7-4 Server Service Manual • May 2017...
  • Page 141 Verify the Battery Related Information “Replace the Battery” on page 137 ■ Servicing the Battery...
  • Page 142 SPARC T7-4 Server Service Manual • May 2017...

  • Page 143: Servicing The Front I/O Assembly

    Servicing the Front I/O Assembly The front I/O assembly consists of the following components: Two circuit boards (FIO and VGA boards) ■ A ribbon cable connecting the front I/O assembly to the motherboard ■ This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge.
  • Page 144 Gently pull the front I/O assembly toward the back of the main module until the ports at the front of the assembly clear the front of the main module, and then remove the front I/O assembly from the main module (panel 3). SPARC T7-4 Server Service Manual • May 2017...

  • Page 145: Install The Front I/O Assembly

    Install the Front I/O Assembly Related Information “Main Module Components” on page 20 ■ “Install the Front I/O Assembly” on page 145 ■ Install the Front I/O Assembly This procedure requires that you handle components that are sensitive to static Caution - discharge.
  • Page 146 Install the Front I/O Assembly Related Information “Main Module Components” on page 20 ■ “Remove the Front I/O Assembly” on page 143 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 147: Servicing Power Supplies

    Servicing Power Supplies The server contains four power supplies, which provide 2 + 2 power redundancy. If you need to replace a power supply, you can do so while the server is operating. To take full advantage of the server's power redundancy, plug the four power supplies Note - into at least two separate power sources.
  • Page 148 Power Supply Configuration Power supply 0 (PS0) Power supply 1 (PS1) Power supply 2 (PS2) Power supply 3 (PS3) Power cords are accessed from the rear of the server. SPARC T7-4 Server Service Manual • May 2017...
  • Page 149 Power Supply Configuration Connector for power supply 3 (PS3) Connector for power supply 2 (PS2) Connector for power supply 1 (PS1) Connector for power supply 0 (PS0) Related Information “Power Supply and AC Power Connector LEDs” on page 150 ■ “Determine Which Power Supply Is Faulty”...

  • Page 150: Power Supply And Ac Power Connector Leds

    “Power Supply Configuration” on page 147 ■ “Determine Which Power Supply Is Faulty” on page 151 ■ “Remove a Power Supply” on page 151 ■ “Install a Power Supply” on page 153 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 151: Determine Which Power Supply Is Faulty

    Determine Which Power Supply Is Faulty “Verify a Power Supply” on page 156 ■ Determine Which Power Supply Is Faulty The following LEDs are lit when a power supply fault is detected: System Service Required LEDs on the front panel and rear I/O module ■...
  • Page 152 Go to the front of the server and, on the power supply to be removed, squeeze the release latches together, then pull the extraction lever toward you to disengage the power supply from the server. SPARC T7-4 Server Service Manual • May 2017...

  • Page 153: Install A Power Supply

    Install a Power Supply Pull the power supply out of the server. Install the replacement power supply. “Install a Power Supply” on page 153. Related Information “Power Supply Configuration” on page 147 ■ “Power Supply and AC Power Connector LEDs” on page 150 ■...
  • Page 154 Install a Power Supply Verify that the power supply is oriented as shown in the following figure. Slide the power supply into the chassis. SPARC T7-4 Server Service Manual • May 2017...
  • Page 155 Install a Power Supply Press the lever against the power supply to fully seat the power supply in the server. Insert the power cord into the AC connector for the power supply that you just installed. Verify the power supply. “Verify a Power Supply”...

  • Page 156: Verify A Power Supply

    “Power Supply and AC Power Connector LEDs” on page 150 ■ “Determine Which Power Supply Is Faulty” on page 151 ■ “Remove a Power Supply” on page 151 ■ “Install a Power Supply” on page 153 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 157: Servicing Fan Modules

    Servicing Fan Modules The server continues to operate at full capacity if one or two fan modules is not operational. You can perform a hot-service on a fan module only when four or five fan modules are operational. These topics describe service procedures for the fan modules in the server. “Fan Module Configuration”...

  • Page 158: Fan Module Led

    The following LEDs are illuminated when a fan module fault is detected: System Service Required LEDs on the front panel and rear I/O module ■ Server Fan Fail LED on the front panel ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 159: Remove A Fan Module

    Remove a Fan Module Service Required LED on the faulty fan module ■ Determine if the System Service Required LEDs are illuminated on the front panel or the rear I/O module. “Interpreting LEDs” on page Determine if the Server Fan Fail LED on the front panel is illuminated. “Front Panel Controls and LEDs”...

  • Page 160: Sparc T7-4 Server Service Manual • May

    If you cannot remove a fan module with the server running, see “Removing ■ Power From the Server” on page 50 to power down the server before continuing. Press the green button to disengage the fan module from the chassis. SPARC T7-4 Server Service Manual • May 2017...

  • Page 161: Install A Fan Module

    Install a Fan Module Pull the fan module out of the server. Related Information “Fan Module Configuration” on page 157 ■ “Determine Which Fan Module Is Faulty” on page 158 ■ “Install a Fan Module” on page 161 ■ “DIMM Configuration Errors” on page 72 ■...

  • Page 162: Verify A Fan Module

    “Verify a Fan Module” on page 162 ■ Verify a Fan Module Ensure that you have completed the following: Applied power to the server. ■ “Connect Power Cords” on page 201. Powered on the server. ■ SPARC T7-4 Server Service Manual • May 2017...
  • Page 163 Verify a Fan Module “Power On the Server (Oracle ILOM)” on page 202. Check the front or rear panel LEDs for the following: Green System OK LED – lit ■ Amber System Fault LED – not lit ■ Amber System Fan Fault LED – not lit ■...
  • Page 164 SPARC T7-4 Server Service Manual • May 2017...

  • Page 165: Servicing Pcie Cards

    Servicing PCIe Cards These topics describe service procedures for the PCIe cards that are installed in the PCIe card carriers in the server. “Understanding PCIe Root Complex Connections” on page 165 ■ “PCIe Card Configuration” on page 168 ■ “PCIe Carrier Handle and LEDs” on page 169 ■...
  • Page 166 O fabric consists of the PCIe switches, PCIe slots, and leaf devices associated with the root complex. Understanding the relationship of the PCIe root complexes to the PCIe I/O fabrics will help you properly assign devices when configuring Oracle VM Server for SPARC logical domains.
  • Page 167 Understanding PCIe Root Complex Connections PCIe slots are available. In addition, all 16 PCIe slots are still available even if PM1 goes offline. The port ID values shown in the diagram correspond to the pci@ values reported in the showdevs command output. PCIe Slot Device Path Maximum...

  • Page 168: Pcie Card Configuration

    “Remove a PCIe Card” on page 174 ■ “Install a PCIe Card” on page 177 ■ “Install a PCIe Card Carrier” on page 180 ■ “Verify a PCIe Card” on page 181 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 169: Pcie Carrier Handle And Leds

    PCIe Carrier Handle and LEDs PCIe Carrier Handle and LEDs Button/LED Icon Description Card carrier handle. Attention ATTN Press this button to bring the PCIe card offline. Required Press this button again to bring the PCIe card online. button OK (green) Indicates the following conditions: ■...

  • Page 170: Determine Which Pcie Card Is Faulty

    Determine if the System Service Required LEDs are illuminated on the front panel or the rear I/O module. “Interpreting LEDs” on page Determine if the PCIe Fault LED is illuminated on the front panel. SPARC T7-4 Server Service Manual • May 2017...

  • Page 171: Remove A Pcie Card Carrier

    Removing PCIe card carriers while the server is at the OpenBoot prompt is not Note - supported. The server must be either powered off, or booted into the Oracle Solaris OS. Take the necessary ESD precautions. “Prevent ESD Damage” on page Locate the PCIe card carrier at the rear of the server.
  • Page 172 # hotplug list -cv Connection State Description ______________________________________________________________________________ PCIE1 EMPTY PCIe-Native PCIE7 ENABLED PCIe-Native Device Usage ___________________________________________________________________________ SUNW,qlc@0 disk fp@0,0 SUNW,qlc@0,1 disk fp@0,0 PCIE13 EMPTY PCIe-Native PCIE15 EMPTY PCIe-Native Bring the PCIe card offline. SPARC T7-4 Server Service Manual • May 2017...
  • Page 173 Remove a PCIe Card Carrier For example: # hotplug disable PCIE7 Verify that the PCIe card status is PRESENT. For example: # hotplug list -cv PCIE7 Connection State Description ______________________________________________________________________________ PCIE7 PRESENT PCIe-Native Verify that the card's green Power OK LED is off. ■...

  • Page 174: Remove A Pcie Card

    This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. Ensure that you have already taken antistatic measures. “Prevent ESD Damage” on page SPARC T7-4 Server Service Manual • May 2017...
  • Page 175 Remove a PCIe Card Unlatch and open the PCIe card carrier top cover. Servicing PCIe Cards...
  • Page 176 “Remove a PCIe Card Carrier” on page 171 ■ “Install a PCIe Card” on page 177 ■ “Install a PCIe Card Carrier” on page 180 ■ “Verify a PCIe Card” on page 181 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 177: Install A Pcie Card

    Install a PCIe Card Install a PCIe Card This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. Determine your first step. If you are installing a new PCIe card and need an empty PCIe card carrier, ■...
  • Page 178 PCIe card's connector is fully seated in the PCIe card carrier's slot, and that the notch in the PCIe card's rear bulkhead is seated around the PCIe carrier's alignment tab. SPARC T7-4 Server Service Manual • May 2017...
  • Page 179 Install a PCIe Card Close and latch the PCIe card carrier's top cover. Related Information “Understanding PCIe Root Complex Connections” on page 165 ■ “PCIe Card Configuration” on page 168 ■ “PCIe Carrier Handle and LEDs” on page 169 ■ “Determine Which PCIe Card Is Faulty”...

  • Page 180: Install A Pcie Card Carrier

    Installing PCIe card carriers while the server is at the OpenBoot prompt is not supported. Note - The server must either be powered off, or booted into the Oracle Solaris OS. Insert the PCIe card carrier into the card cage until it stops.

  • Page 181: Verify A Pcie Card

    Press the ATTN button. The PCIe card carrier's Power OK LED should light, ■ indicating that the PCIe card is online. ■ Use the Oracle Solaris hotplug command. For example: # hotplug enable PCIE7 ■ Use the Oracle Solaris cfgadm command: # cfgadm -c connect Ap-id where Ap_id is the ID of the card that you want to connect.
  • Page 182 If none of the LEDs are illuminated, go to Step ■ Verify that the green Power LED is lit on the PCIe card carrier that you installed. At the Oracle Solaris prompt, ensure that the PCIe card is connected and online: # hotplug list -cv Connection State...

  • Page 183: Servicing The Rear I/O Module

    Servicing the Rear I/O Module This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. You must disconnect the power cords before servicing this component. See Caution - “Disconnect Power Cords”...
  • Page 184 Amber indicates a fault with PSU1. AC0 connector LED (amber/ Indicates the state of the AC connector. Green indicates that the AC green) connector is functioning correctly. Amber indicates a fault with PSU 0. SPARC T7-4 Server Service Manual • May 2017...
  • Page 185 ■ Issuing the Oracle ILOM command set /SYS/LOCATE value=Fast_Blink ■ Pressing the Locator button System Service Required Indicates that service is required. POST and Oracle ILOM are two LED (amber) diagnostic tools that can detect a fault or failure resulting in this indication.

  • Page 186: Determine If The Rear I/O Module Is Faulty

    ■ rear I/O module in the server. “Determine if the Rear I/O Module Is Faulty” on page 186 to verify that ■ the rear I/O module has failed. Power off the server. SPARC T7-4 Server Service Manual • May 2017...
  • Page 187 Remove the Rear I/O Module “Removing Power From the Server” on page Disconnect the power cords. “Disconnect Power Cords” on page Label the cables connected to the ports on the rear I/O module, and then disconnect the cables from the ports. You will reconnect the cables to the same ports on the replacement rear I/O module.

  • Page 188: Install The Rear I/O Module

    “Install the Rear I/O Module” on page 188 ■ “Verify the Rear I/O Module” on page 190 ■ Install the Rear I/O Module Take the necessary ESD precautions. “Prevent ESD Damage” on page SPARC T7-4 Server Service Manual • May 2017...
  • Page 189 Install the Rear I/O Module With the levers in the extended position, insert the rear I/O module into the slot at the rear of the server. Servicing the Rear I/O Module...

  • Page 190: Verify The Rear I/O Module

    “Remove the Rear I/O Module” on page 186 ■ “Verify the Rear I/O Module” on page 190 ■ “Returning the Server to Operation” on page 201 ■ Verify the Rear I/O Module Ensure that you have completed the following: SPARC T7-4 Server Service Manual • May 2017...
  • Page 191 “Connect Power Cords” on page 201. Started the system. ■ “Power On the Server (Oracle ILOM)” on page 202. Verify that the System Service Required LED on the rear I/O module is not lit. “Rear I/O Module LEDs” on page 183.
  • Page 192 SPARC T7-4 Server Service Manual • May 2017...

  • Page 193: Servicing The Rear Chassis Subassembly

    Servicing the Rear Chassis Subassembly For the location of the rear chassis subassembly, see “Rear Panel Components (Service)” on page This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This discharge can cause failure of server components. You must disconnect the power cords before servicing this component.

  • Page 194: Remove The Rear Chassis Subassembly

    “Remove the Rear Chassis Subassembly” on page 194 ■ “Install the Rear Chassis Subassembly” on page 197 ■ Remove the Rear Chassis Subassembly Verify that the rear chassis subassembly needs to be replaced. SPARC T7-4 Server Service Manual • May 2017...
  • Page 195 Remove the Rear Chassis Subassembly Use the server software to determine if the rear chassis subassembly needs to be replaced. See “Detecting and Managing Faults” on page 25 for more information. Power off the server. “Removing Power From the Server” on page Disconnect the power cords.
  • Page 196 Using a Phillips screwdriver, loosen the five screws that secure the rear chassis subassembly to the system chassis. Slide the rear chassis subassembly out and away from the server. Related Information “Install the Rear Chassis Subassembly” on page 197 ■ SPARC T7-4 Server Service Manual • May 2017...

  • Page 197: Install The Rear Chassis Subassembly

    Install the Rear Chassis Subassembly Install the Rear Chassis Subassembly Slide the rear chassis subassembly into the server. From the front of the server, tighten the eight green screws that secure the rear chassis subassembly in the server. Tighten the screws in the following order: Lower right screw.

  • Page 198: Verify The Rear Chassis Subassembly

    “Connect Power Cords” on page 201. Started the system. ■ “Power On the Server (Oracle ILOM)” on page 202. Log in to Oracle ILOM. “Log In to Oracle ILOM (Service)” on page SPARC T7-4 Server Service Manual • May 2017...
  • Page 199 Verify the Rear Chassis Subassembly Start the faultmagmt shell. -> start SP/faultmgmt/shell Are you sure you want to start the faultmgmt shell (y/n)? y   faultmgmtsp> Use the fmadm faulty command to determine if the server is operating normally. If a fault was detected, see “Diagnostics Process”...
  • Page 200 SPARC T7-4 Server Service Manual • May 2017...

  • Page 201: Returning The Server To Operation

    Returning the Server to Operation These topics explain how to return the Oracle SPARC T7-4 server to operation after you have performed service procedures. Steps Description Links Connect the power cords. “Connect Power Cords” on page 201 Power on the server.

  • Page 202: Power On The Server (Oracle Ilom)

    Power On the Server (Oracle ILOM) Power On the Server (Oracle ILOM) The boot process depends on the most recent power state of the server and on Oracle Note - ILOM policy settings. You must determine if the server is running before you issue the start /System command.

  • Page 203: Index

    74 antistatic wrist strap, 44 identifying, 71 installing, 80 locating, 19 locating faulty using DIMM Fault Remind button, 76 using Oracle ILOM, 74 backup devices, supported, 22 using PSH, 75 battery NAC names, 73 verifying, 140 rank classification, 71...
  • Page 204 161 DIMMs, faulty front I/O assembly, 145 using Fault Remind button, 76 hard drives, 94 using PSH, 75 main module, 105 fan modules, 16 NVMe switch cards, 114 front I/O assembly, 20 SPARC T7-4 Server Service Manual • May 2017...
  • Page 205 20 verifying, 117 PCIe carriers, 16 power supplies, 14 processor modules, 14 RAID expansion modules, 20 Oracle Solaris OS files and commands, 35 rear I/O module, 16 Oracle Solaris PSH server, 49 checking for faults, 33 system configuration PROM, 20...
  • Page 206 Rear Fan Module Fault LED, 29 servicing rear I/O module NVMe switch cards, 111 finding faulty, 186 installing, 188 installing, 128 LEDs, 31, 183 locating faulty, 125 locating, 16 removing, 126 removing, 186 verifying, 131 SPARC T7-4 Server Service Manual • May 2017...
  • Page 207 System Power button, 29 System Power OK LED, 29, 31 system schematic, 41 System Service Required LED, 29, 31 tools needed for service, 45 upgrading the server, 56 using Oracle VTS, 26 UUID, 33 /var/adm/messages file, 36 verifying battery, 140 DIMMs, 83...
  • Page 208 SPARC T7-4 Server Service Manual • May 2017...

Table of Contents