Page 1
SPARC T7-1 Server Service Manual Part No: E54980-06 May 2017...
Page 3
Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4
Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...
▼ Check the Message Buffer .............. 34 ▼ View Log Files (Oracle Solaris) ............ 35 ▼ View Log Files (Oracle ILOM) ............ 35 POST Overview .................. 36 ▼ Configure POST ................ 36 Oracle ILOM Properties That Affect POST Behavior ........ 38 ▼ Clear a Fault Manually ................ 39...
Page 6
▼ Remove a Drive or Drive Filler .............. 63 ▼ Install a Drive or Drive Filler .............. 68 ▼ Verify a Drive .................. 69 Servicing Fan Modules .................. 73 Fan Module LEDs .................. 74 ▼ Determine Which Fan Module Is Faulty ............ 75 SPARC T7-1 Server Service Manual • May 2017...
Page 7
Memory Riser and DIMM FRU Names ............. 91 ▼ Add Memory to the Server ................ 93 Locating and Replacing a Faulty DIMM ............ 94 ▼ Locate a Faulty DIMM (Oracle ILOM) .......... 94 ▼ Locate a Faulty DIMM (LEDs) ............ 95 ▼ Replace a Faulty DIMM .............. 96 ▼...
Page 8
▼ Return the Server to the Normal Operating Position ........ 179 ▼ Attach Power Cords ................ 180 ▼ Power On the Server (Oracle ILOM) ............ 180 ▼ Power On the Server (System Power Button) .......... 181 Glossary ...................... 183 SPARC T7-1 Server Service Manual • May 2017...
Page 9
Contents Index ........................ 187...
Page 10
SPARC T7-1 Server Service Manual • May 2017...
Audience – Technicians, system administrators, and authorized service providers ■ Required knowledge – Advanced experience troubleshooting and replacing hardware ■ Product Documentation Library Documentation and resources for this product and related products are available at http://www. oracle.com/goto/t7-1/docs. Feedback Provide feedback about this documentation at http://www.oracle.com/goto/docfeedback. Using This Documentation...
Page 12
SPARC T7-1 Server Service Manual • May 2017...
Identifying Components These topics identify key components of the server, including major boards and internal system cables, as well as front and rear panel features. “Front Panel Components (Service)” on page 13 ■ “Rear Panel Components (Service)” on page 15 ■...
Page 14
“Servicing Drives” on page 61 HDD 7 “Servicing Drives” on page 61 DVD drive (SATA) “Servicing the DVD Drive” on page 139 Fan Service LEDs (amber) “Servicing Fan Modules” on page 73 SPARC T7-1 Server Service Manual • May 2017...
“Servicing Power Supplies” on page 83 Server Overtemp LED (amber) “Front Panel Controls and LEDs” on page 30 USB 2.0 connectors (2) “USB Ports” in SPARC T7-1 Server Installation Guide Related Information “Rear Panel Components (Service)” on page 15 ■...
■ “Server Block Diagram” on page 19 ■ Internal Component Locations The following figure identifies the replaceable component locations with the top cover removed. The two memory risers are optional. Note - SPARC T7-1 Server Service Manual • May 2017...
Page 17
Internal Component Locations Component Oracle ILOM Target Links Drives “Servicing Drives” on page 61 /SYS/DBP/HDD0 (lower left) /SYS/DBP/HDD1 /SYS/DBP/HDD2 or /SYS/DBP/NVME0 /SYS/DBP/HDD3 or /SYS/DBP/NVME1 /SYS/DBP/HDD4 or /SYS/DBP/NVME2 /SYS/DBP/HDD5 or /SYS/DBP/NVME3 /SYS/DBP/HDD6 /SYS/DBP/HDD7 (right) DVD drive “Servicing the DVD /SYS/MB/DBP/DVD Drive” on page 139 Drive backplane (on drive cage) “Servicing the Drive...
Page 18
Motherboard” on page 147 Processor chip (replaceable only by “Servicing the /SYS/MB/CM/CMP replacing the motherboard) Motherboard” on page 147 Power supplies “Servicing Power /SYS/PS0 (outer) Supplies” on page 83 /SYS/PS1 (inner) Chassis eUSB drive /SYS/MB/EUSB_DISK SPARC T7-1 Server Service Manual • May 2017...
Use these tools to identify components that require service. Step Description Links “Log In to Oracle ILOM (Service)” on page 24 Run the fmadm faulty command to display information about components “Identify Faulted Components” on page 24 that require service.
■ Identify Faulted Components The fmadm faulty command displays the list of faults detected by PSH. You can run this command from the host or through the Oracle ILOM fault management shell. SPARC T7-1 Server Service Manual • May 2017...
Page 25
From the Oracle ILOM prompt, start the fault management shell and type fmadm faulty. This example shows how to check for faults through the Oracle ILOM fault management shell. You can also check for faults by typing show faulty at the Oracle ILOM prompt.
“Component Names Displayed by Diagnostic Software ” on page 27 ■ Identify Disabled Components You can run the show disabled command from the Oracle ILOM prompt to identify components that have been disabled either intentionally, by a user, or automatically, because of a fault.
| Configuration Rules /SYS/MB/CM/CMP/BOB21/CH1/DIMM | fru_name | 8192MB DDR4 SDRAM DIMM Related Information “Log In to Oracle ILOM (Service)” on page 24 ■ “Identify Faulted Components” on page 24 ■ “Component Names Displayed by Diagnostic Software ” on page 27 ■...
Page 28
“Servicing the /SYS/MB Motherboard” on page 147 PCIe cards “Servicing PCIe /SYS/MB/PCIE1 Cards” on page 113 /SYS/MB/PCIE2 /SYS/MB/PCIE3 /SYS/MB/PCIE4 /SYS/MB/PCIE5 /SYS/MB/PCIE6 Power supplies “Servicing Power /SYS/PS0 (outer) Supplies” on page 83 /SYS/PS1 (inner) SPARC T7-1 Server Service Manual • May 2017...
Component Oracle ILOM Target Links “Servicing the SPM” on page 131 /SYS/MB/SPM Related Information “Log In to Oracle ILOM (Service)” on page 24 ■ “Identify Faulted Components” on page 24 ■ “Identify Disabled Components” on page 26 ■ Interpreting LEDs Use these steps to determine if an LED indicates that a component has failed.
■ Slow blink – A normal but transitory activity is taking place. Slow blinking might indicate that server diagnostics are running or that the server is booting. SP OK LED Indicates these conditions: ■ Off – AC power might have been connected to the power supplies. SPARC T7-1 Server Service Manual • May 2017...
Page 31
■ Steady on, green – SP is running in its normal operating state. No service actions are required. ■ Blink, green – SP is initializing the Oracle ILOM firmware. ■ Steady on, amber – An SP error has occurred and service is required.
■ Off – 12V DC output from this power supply is disabled or not within specification. ■ Steady on – 12V DC output from this power supply is present and within specifications. SPARC T7-1 Server Service Manual • May 2017...
Page 33
Interpreting LEDs Icon or Label Description Locator LED and button Turn on the Locator LED by pressing the Locator button, or see (white) “Locate the Server” on page 45. When lit, the LED blinks rapidly. The blinking will time out after 15 minutes. Service Required LED The fmadm faulty command provides details about any (amber)
The dmesg command checks the system buffer for recent diagnostic messages and displays the messages. Log in as superuser. Type: # dmesg Related Information “View Log Files (Oracle Solaris)” on page 35 ■ SPARC T7-1 Server Service Manual • May 2017...
View Log Files (Oracle Solaris) “View Log Files (Oracle ILOM)” on page 35 ■ “POST Overview” on page 36 ■ View Log Files (Oracle Solaris) The error logging daemon, syslogd, automatically records various system warnings, errors, and faults in message files. These messages can alert you to system problems such as a device that is about to fail.
You can also set other Oracle ILOM properties to control various other aspects of POST operations. For example, you can specify the events that cause POST to run, the level of testing POST performs, and the amount of diagnostic information POST displays.
Page 37
Configure POST This example sets the virtual keyswitch default_level to min, which configures POST to run according to other parameter values. -> set /HOST default_level=min Set default_level to min For possible values for the default_level parameter, type: -> help /HOST diag /HOST/diag : Manage Host Power On Self Test Diagnostics Targets: Properties:...
Oracle ILOM Properties That Affect POST Behavior There are a number of Oracle ILOM commands that you can use to perform host diagnostic tests. For details about using these commands, refer to the chapter that describes configuring SPARC T7-1 Server Service Manual • May 2017...
Clear a Fault Manually host server management actions in the Oracle ILOM Administrator's Guide for Configuration and Maintenance Firmware Release 3.2.x. Related Information “POST Overview” on page 36 ■ “Configure POST” on page 36 ■ Clear a Fault Manually When the server detects faults, the faults are logged and displayed on the console. In most cases, after the fault is repaired the fault condition is repaired automatically.
Page 40
Clear the fault in the Oracle Enterprise Manager Ops Center software, if applicable. Clearing a fault with the fmadm aquit command does not clear that fault in the Oracle Enterprise Manager Ops Center software. You must manually clear the fault or incident. For...
Preparing for Service These topics describe how to prepare the server for servicing. Step Description Links Review safety and handling information. “Safety Information” on page 41 Gather the tools needed for service. “Tools Needed For Service” on page 43 Consider filler options. “Fillers”...
PCIe cards. When servicing or removing server components, attach an antistatic strap to your wrist and then to a metal area on the chassis. Following this practice equalizes the electrical potentials between you and the server. SPARC T7-1 Server Service Manual • May 2017...
Tools Needed For Service An antistatic wrist strap is no longer included in the accessory kit for this server. Note - However, antistatic wrist straps are still included with options. Antistatic Mat Place ESD-sensitive components such as motherboards, memory, and other PCBs on an antistatic mat.
At the Oracle ILOM prompt, type. ■ -> show /System /System Targets: . . . In the output look for a line under Properties that identifies the product serial number. For example: product_serial_number = BDL1026F8F SPARC T7-1 Server Service Manual • May 2017...
30 minutes before turning off. After locating the server with the blinking Locator LED, turn it off by pressing the Server Locator button. Alternatively, you can type an Oracle ILOM command to turn off the Locator LED. -> set /System/locator_indicator=off Related Information “Front Panel Components (Service)”...
LED indicator modules (front left and front right) Related Information “Internal Component Locations” on page 16 ■ Removing Power From the Server These topics describe how to power off the server. SPARC T7-1 Server Service Manual • May 2017...
Save any open files and quit all running programs. Refer to your application documentation for specific information on these processes. Shut down all LDoms. Refer to Oracle Solaris system administration and Oracle VM Server for SPARC documentation for additional information. Shut down the Oracle Solaris OS.
Shutting Down Oracle Solaris” in SPARC T7 Series Servers Administration Guide. Prepare to power off the server. “Prepare to Power Off the Server” on page Switch from the system console to the Oracle ILOM prompt by typing the #. (Hash-Dot) key sequence. Power off the server. -> stop /System...
You might need to use a pointed object, such as a pen or pencil. Related Information “Prepare to Power Off the Server” on page 47 ■ “Power Off the Server (Oracle ILOM)” on page 48 ■ “Power Off the Server (Emergency Shutdown)” on page 49 ■...
Related Information “Safety Information” on page 41 ■ “Power Off the Server (Oracle ILOM)” on page 48 ■ “Power Off the Server (Server Power Button - Graceful)” on page 48 ■ “Power Off the Server (Emergency Shutdown)” on page 49 ■...
Extend the Server to the Service Position Place ESD-sensitive components such as the printed circuit boards on an antistatic mat. The following items can be used as an antistatic mat: Antistatic bag used to wrap a replacement part ■ ESD mat ■...
Note - For instructions on how to install the CMA for the first time, refer to “Prepare the CMA for Installation” in SPARC T7-1 Server Installation Guide. Press and hold the tab. SPARC T7-1 Server Service Manual • May 2017...
Page 53
Release the CMA The tab is on the inside rear of the left side of the CMA. Swing the CMA out of the way. Do not allow the CMA to hang unsupported while it is unattached. When you have finished the service steps that require the CMA to be out of the way, swing the CMA closed and latch it to the left rack rail.
Set the server on a sturdy work surface. Related Information “Extend the Server to the Service Position” on page 51 ■ “Release the CMA” on page 52 ■ “Remove the Top Cover” on page 55 ■ SPARC T7-1 Server Service Manual • May 2017...
Remove the Top Cover Remove the Top Cover Removing the top cover without properly powering down the server and Caution - disconnecting the AC power cords from the power supplies results in a chassis intrusion switch failure. This failure causes the server to be immediately powered off. Any changes you make to the memory riser or DIMM configurations will not be properly reflected in the service processor's inventory until you replace the top cover.
Lift the edge of the airflow cover closest to the rear of the server. The airflow cover can stand in its upright position. Perform the next steps if you need to remove the airflow cover. Open the fan cover. SPARC T7-1 Server Service Manual • May 2017...
Remove the Fan Cover Pull open the plastic tabs to release the airflow cover's hinge edge from the server. Related Information “Install and Close the Airflow Cover” on page 175 ■ “Remove the Top Cover” on page 55 ■ “Remove the Fan Cover” on page 57 ■...
Page 58
Remove the Fan Cover The fan covers on some units are secured with T6 Torx screws. Other units are secured Note - with No. 2 Phillips screws. (Illustration shows T6 Torx screws.) SPARC T7-1 Server Service Manual • May 2017...
Attachment of Devices During Service Lift the fan cover from the server. Related Information “Replace the Fan Cover” on page 173 ■ “Open and Remove the Airflow Cover” on page 56 ■ “Remove the Top Cover” on page 55 ■ Attachment of Devices During Service During service procedures, you might have to connect devices to the server.
Page 60
“Connecting Cables” in SPARC T7-1 Server Installation Guide. If you plan to connect to the Oracle ILOM software over the network, connect an Ethernet ■ cable to the Ethernet port labeled NET MGT. The SP uses the NET MGT (out-of-band) port by default. You can configure the Note - SP to share one of the sever's four Ethernet ports instead.
Servicing Drives The server provides eight 2.5-inch drive bays, accessible through the front panel. See “Front Panel Components (Service)” on page 13. Drives can be removed and installed while the server is running. This feature, referred to as being hot-serviceable, depends on how the drives are configured.
See “Front Panel Components (Service)” on page 13 “Rear Panel Components (Service)” on page Related Information “Front Panel Components (Service)” on page 13 ■ “Rear Panel Components (Service)” on page 15 ■ SPARC T7-1 Server Service Manual • May 2017...
Determine Which Drive Is Faulty “Remove a Drive or Drive Filler” on page 63 ■ “Install a Drive or Drive Filler” on page 68 ■ “Verify a Drive” on page 69 ■ Determine Which Drive Is Faulty You must determine which drive is faulty before you replace it. Check to see if any System Service Required LEDs are lit or flashing.
Page 64
Take the drive offline. For a standard drive: ■ At the Oracle Solaris prompt, list all drives in the device tree, including drives that are not configured. # cfgadm -al This command lists dynamically reconfigurable hardware resources and shows their operational status.
Page 65
Remove a Drive or Drive Filler Verify that the drive's blue Ready to Remove LED is lit. ■ For an NVMe Drive: Determine the name of the NVMe drive to be removed. # hotplug list -lc Locate the name of the drive, such as /SYS/DBP/NVME0 in this example. You can use this same command to check the state of the drive at other stages of the removal procedure.
Page 66
On the drive or drive filler you want to remove, complete the following tasks. The latch is not an ejector. Do not bend it too far to the right. Doing so can damage Caution - the latch. Push the release button to open the latch. SPARC T7-1 Server Service Manual • May 2017...
Page 67
Remove a Drive or Drive Filler Unlock the drive by moving the latch to the right. Grasp the latch and pull the drive out of the slot. When you remove a drive, replace it with a drive filler or another drive. Otherwise, Caution - the server might overheat due to improper airflow.
Install the drive or drive filler by completing the following tasks. Slide the drive or drive filler into the drive slot until it is fully seated. Close the latch to lock the drive or drive filler in place. SPARC T7-1 Server Service Manual • May 2017...
If the OS is shut down, and the drive you replaced was not the boot device, boot the OS. Depending on the nature of the replaced drive, you might need to perform administrative tasks to reinstall software before the server can boot. Refer to the Oracle Solaris OS administration documentation for more information. Servicing Drives...
Page 70
Verify a Drive At the Oracle Solaris prompt, list all drives in the device tree, including any drives that are not configured. # cfgadm -al This command helps you identify the drive you installed. Ap_id Type Receptacle Occupant Condition scsi-bus...
Page 71
■ the tasks required to configure the drive. These tasks are covered in the Oracle Solaris OS administration documentation. For additional drive verification, you can run Oracle VTS. Refer to the Oracle VTS documentation for details. Related Information “Determine Which Drive Is Faulty” on page 63 ■...
Page 72
SPARC T7-1 Server Service Manual • May 2017...
Servicing Fan Modules The four fan modules in the server are located at the front of the chassis. See “Identifying Components” on page 13. You can access the fan modules without removing the server cover. You might need to extend the server from the rack to access the fans. Each fan module contains two fans mounted in an integrated, hot-serviceable component.
Fan Module LEDs Fan Module LEDs Color Status When Lit Power OK Green The server is powered on, and the fan module is functioning correctly. Service Required Amber The fan module is faulty. SPARC T7-1 Server Service Manual • May 2017...
Determine Which Fan Module Is Faulty Related Information “Determine Which Fan Module Is Faulty” on page 75 ■ “Detecting and Managing Faults” on page 23 ■ Determine Which Fan Module Is Faulty View the following LEDs, which are lit when a fan fault is detected. Fan (FAN) Fault LED on the front of the server.
“Extend the Server to the Service Position” on page Open the fan door. Slide the two green buttons to unlock the fan door, then swing it open. Identify the faulty fan module with a corresponding Service Required LED. SPARC T7-1 Server Service Manual • May 2017...
Page 77
Remove a Fan Module The Service Required LEDs are located near the fan modules as shown in “Determine Which Fan Module Is Faulty” on page Loosen the screw on the fan module (panel 1). The screws should only be finger tight. If you have difficulty loosening a screw by hand, use a No.
Remove a fan module. “Remove a Fan Module” on page Unpack the replacement fan module and place it on an antistatic mat. Open the fan door. SPARC T7-1 Server Service Manual • May 2017...
Page 79
Install a Fan Module Install the replacement fan module into the server by completing the following tasks. Align the fan module and slide it into the fan slot (panel 1). Fan modules are keyed to ensure that they are installed in the correct orientation. Note - Ensure that the cables threaded between the two middle fan modules are not caught.
Page 80
Return the server to the normal operating position. “Return the Server to the Normal Operating Position” on page 179. When the server is powered, verify the new fan module. See “Verify a Fan Module” on page SPARC T7-1 Server Service Manual • May 2017...
Use the Oracle ILOM show faulty command to verify that the fault has been cleared. “Identify Faulted Components” on page 24 for more information on using the show faulty command.
Page 82
SPARC T7-1 Server Service Manual • May 2017...
For information about power configuration policies, refer to “Configuring Policy Settings” in SPARC T7 Series Servers Administration Guide and the Oracle ILOM documentation. These topics describe how to service power supply modules. “Locate a Faulty Power Supply” on page 83 ■...
“Release the CMA” on page Do not allow the CMA to hang unsupported while it is unattached. Disconnect the power cord from the power supply that displays a lit amber Service Required LED. SPARC T7-1 Server Service Manual • May 2017...
Install a Power Supply Press the release latch to the left to open the ejector arm (panel 1). Slide the power supply out of the chassis (panel 2). There is no restraint mechanism on the power supply to prevent it from sliding Caution - completely out of the chassis.
Page 86
Reconnect the power cord to the power supply. If you disconnected the two CMA left-side connectors, reconnect the CMA. For instructions on reconnecting the CMA see “Attach the CMA to the Server” in SPARC T7-1 Server Installation Guide. Verify that the AC OK LED is lit.
Verify that the amber Service Required LED on the replaced power supply is not lit. Verify that the PS Fault LED on the front of the server is not lit. Use the Oracle ILOM show faulty command to verify that the fault has been cleared. “Identify Faulted Components” on page 24 for more information on using the show faulty command.
Page 88
Verify a Power Supply “Rear Panel Components (Service)” on page 15 ■ SPARC T7-1 Server Service Manual • May 2017...
Servicing Memory Risers and DIMMs These topics describe how to remove and install memory risers and DIMMs in the server. “Memory Riser and DIMM Configuration” on page 89 ■ “Checking DIMM Compatibility” on page 90 ■ “Memory Riser and DIMM FRU Names” on page 91 ■...
Use these labels to identify the DIMMs installed in the server, to verify that any replacement DIMMs are compatible, or to confirm that upgrade DIMMs may be installed in a supported configuration. SPARC T7-1 Server Service Manual • May 2017...
Memory Riser and DIMM FRU Names The following DIMMs are supported. DIMM Capacity DRAM Density Rank Classification Label 16 Gbyte 4 Gbit Dual-rank x4 2Rx4 32 Gbyte 4 Gbit Quad-rank x4 4Rx4 32 Gbyte 8 Gbit Dual-rank x8 2Rx4 64 Gbyte 8 Gbit Quad-rank x8 4Rx4...
Page 92
Physical Location (Seen From Memory Riser or DIMM FRU Name Ejector Color Rear) Left Memory Riser /SYS/MB/CM/CMP/MR1 (riser) Black /SYS/MB/CM/CMP/MR1/BOB00/CH0 White /SYS/MB/CM/CMP/MR1/BOB00/CH1 Black /SYS/MB/CM/CMP/MR1/BOB10/CH0 White /SYS/MB/CM/CMP/MR1/BOB10/CH1 Left motherboard Black /SYS/MB/CM/CMP/BOB11/CH0 White /SYS/MB/CM/CMP/BOB11/CH1 Black SPARC T7-1 Server Service Manual • May 2017...
“Checking DIMM Compatibility” on page 90 ■ “Locate a Faulty DIMM (LEDs)” on page 95 ■ “Locate a Faulty DIMM (Oracle ILOM)” on page 94 ■ “Enable and Verify a DIMM” on page 109 ■ Add Memory to the Server These procedures require that you handle components that are sensitive to ESD.
After locating the faulty DIMM, install verify the replacement DIMM. Locate a Faulty DIMM (Oracle ILOM) The Oracle ILOM show faulty command displays current faults, including DIMM failures. Type show faulty at the Oracle ILOM prompt. SPARC T7-1 Server Service Manual • May 2017...
Locate a Faulty DIMM (LEDs) If a DIMM is faulty, the show faulty output is similar to this example. -> show faulty Target | Property | Value --------------------+-------------------+------------------- /SP/faultmgmt/0 | fru | /SYS/MB/CM/CMP/BOB21/CH0 /SP/faultmgmt/0 | timestamp | Dec 21 16:40:56 /SP/faultmgmt/0/ | timestamp | Dec 21 16:40:56 faults/0...
Replace a Faulty DIMM Press the button briefly to avoid using up the stored power available to illuminate fault LEDs. Related Information “Locate a Faulty DIMM (Oracle ILOM)” on page 94 ■ “Remove a Memory Riser” on page 97 ■...
Remove a Memory Riser Customers can perform this procedure, but the system must first be completely powered down and all power cords unplugged. See “Component Service Categories” on page 45 for more information about cold-service procedures. Perform this procedure to replace a faulty DIMM on the motherboard or a memory riser. Identify the faulty DIMM to be removed using the ILOM show faulty command.
Page 98
Extend the server to the service position. Remove the top cover. Loosen the four screws that attach the memory riser to the standoffs. Use a No. 2 Phillips screwdriver to loosen the captive screws. SPARC T7-1 Server Service Manual • May 2017...
Page 99
Remove a Memory Riser Lift the handle on the memory riser to release it from the connector. Servicing Memory Risers and DIMMs...
Page 100
Related Information “Remove a DIMM or DIMM Filler” on page 101 ■ “Install a DIMM or DIMM Filler” on page 102 ■ “Install a Memory Riser” on page 105 ■ SPARC T7-1 Server Service Manual • May 2017...
Remove a DIMM or DIMM Filler Remove a DIMM or DIMM Filler This procedure requires handling components that are sensitive to ESD. Follow Caution - antistatic practices to avoid damage or component failure. DIMMs or DIMM fillers must be removed: When adding memory to the server.
“Install a Memory Riser” on page 105 ■ Install a DIMM or DIMM Filler This procedure requires handling components that are sensitive to ESD. Follow Caution - antistatic practices to avoid damage or component failure. SPARC T7-1 Server Service Manual • May 2017...
Page 103
Install a DIMM or DIMM Filler DIMMs are installed: When adding memory to the server. ■ When replacing faulty DIMMs. ■ When replacing a faulty motherboard. ■ To ensure proper airflow, DIMM fillers must be installed if you are downgrading memory in the server, or are replacing a faulty memory riser without upgrading memory.
Page 104
The notch ensures that the DIMM is oriented correctly. Gently press the DIMM into the slot until the ejector tabs lock the DIMM in place. Related Information “Memory Riser and DIMM Configuration” on page 89 ■ SPARC T7-1 Server Service Manual • May 2017...
Install a Memory Riser “Checking DIMM Compatibility” on page 90 ■ “Remove a Memory Riser” on page 97 ■ “Remove a DIMM or DIMM Filler” on page 101 ■ “Install a Memory Riser” on page 105 ■ “Enable and Verify a DIMM” on page 109 ■...
Page 106
Install a Memory Riser The handle on the memory riser is closest to the center of the server. SPARC T7-1 Server Service Manual • May 2017...
Page 107
Install a Memory Riser Lower the handle on the memory riser to seat the connector. Tighten the four screws that secure the memory riser to the standoffs. Servicing Memory Risers and DIMMs...
Page 108
“Remove a Memory Riser” on page 97 ■ “Remove a DIMM or DIMM Filler” on page 101 ■ “Install a Memory Riser” on page 105 ■ “Enable and Verify a DIMM” on page 109 ■ SPARC T7-1 Server Service Manual • May 2017...
Enable and Verify a DIMM Access the Oracle ILOM prompt. Refer to “Display the Oracle ILOM Prompt” in SPARC T7 Series Servers Administration Guide. Use the show faulty command to determine how to clear the fault. If the output indicates a POST-detected fault, go to Step ■...
Page 110
Return the virtual keyswitch to Normal mode. -> set /HOST keyswitch_state=Normal Set 'keyswitch_state' to 'Normal' Switch to the system console and type the Oracle Solaris fmadm faulty command. # fmadm faulty If any faults are reported, refer to the diagnostics instructions described in “Identify...
DIMM Configuration Errors Use the same UUID that was displayed from the output of the Oracle ILOM show faulty command. # fmadm repair 3aa7c854-9667-e176-efe5-e487e520 Related Information “Memory Riser and DIMM Configuration” on page 89 ■ “Checking DIMM Compatibility” on page 90 ■...
Page 112
SPARC T7-1 Server Service Manual • May 2017...
To determine the slot in which to install a PCIe card, follow these guidelines: 1. Install cards that require a specific slot. Refer to the SPARC T7-1 Server Product Notes and the documentation for each card to determine if there are slot requirements.
This procedure requires that you handle components that are sensitive to ESD. This Caution - sensitivity can cause the component to fail. To avoid damage, ensure that you follow antistatic practices as described in “ESD Measures” on page SPARC T7-1 Server Service Manual • May 2017...
Page 115
Remove a PCIe Card or Filler You can perform this procedure. The server must be completely powered down before performing this procedure. See “Component Service Categories” on page 45 for more information about cold-service procedures. Prepare for servicing. Attach an antistatic wrist strap. Power off the server and disconnect all power cords from the server power supplies.
Page 116
Replace with another PCIe card or filler before the server is connected to power again. “Install a PCIe Card or Filler” on page 117. Related Information “Install a PCIe Card or Filler” on page 117 ■ SPARC T7-1 Server Service Manual • May 2017...
Install a PCIe Card or Filler Install a PCIe Card or Filler This procedure requires that you handle components that are sensitive to ESD. This Caution - sensitivity can cause the component to fail. To avoid damage, ensure that you follow antistatic practices as described in “ESD Measures”...
Page 118
Return the server to the normal operating position. “Return the Server to the Normal Operating Position” on page 179. Reconnect all power cords to the server power supplies. “Attach Power Cords” on page 180. Power on the server. SPARC T7-1 Server Service Manual • May 2017...
Page 119
Install a PCIe Card or Filler “Power On the Server (Oracle ILOM)” on page 180 “Power On the Server (System Power Button)” on page 181. Refer to the documentation shipped with the PCIe card for information about configuring the PCIe card, including installing required operating systems.
Page 120
SPARC T7-1 Server Service Manual • May 2017...
Servicing the eUSB Drive The eUSB drive is mounted on the motherboard towards the front on the power supply side. These topics describe how to service the eUSB drive. “Install the eUSB Drive” on page 123 ■ “Remove the eUSB Drive” on page 121 ■...
Page 122
Lift the eUSB drive up to disconnect it from the motherboard. Install a new eUSB drive. “Install the eUSB Drive” on page 123. Related Information “Install the eUSB Drive” on page 123 ■ SPARC T7-1 Server Service Manual • May 2017...
Install the eUSB Drive Install the eUSB Drive You can perform this cold-service procedure. Power down the server completely before performing this procedure. This procedure requires that you handle components that are sensitive to ESD. This Caution - sensitivity can cause the components to fail. To avoid damage, ensure that you follow antistatic practices as described in “Prevent ESD Damage”...
Page 124
Do not use a tool to tighten the screw further. Return the server to operation. “Returning the Server to Operation” on page 173. Related Information “Remove the eUSB Drive” on page 121 ■ SPARC T7-1 Server Service Manual • May 2017...
Servicing the Battery The battery is located inside the chassis. See “Internal Component Locations” on page 16. The battery maintains system time when the server is powered off and disconnected from AC power. If the IPMI logs indicate a battery failure, replace the battery. Ensure that all power is removed from the server before removing or installing Caution - the battery.
Page 126
Prepare the server for service. If a PCIe card is in slot 6, remove it to improve access to the battery. “Remove a PCIe Card or Filler” on page 114. Remove the old battery SPARC T7-1 Server Service Manual • May 2017...
Page 127
Replace the Battery Pinch the battery between two fingers and slide it up and out of the battery holder. Unpack and install the new battery. Servicing the Battery...
Page 128
Return the Server to Operation. Reset the system clock. Use the Oracle ILOM clock command to reset the system clock. The following example sets the date to August 22, 2016, and the timezone to EDT. -> set /SP/clock datetime=081221302016timezone=EDT Set 'datetime' to '081221302016' set 'timezone' to 'EDT' SPARC T7-1 Server Service Manual •...
Page 129
Replace the Battery -> show -d properties /SP/clock Properties datetime = Mon Aug 22 13:20:16 2016 timezone = EDT (EST5EDT) uptime = 2 days 19:56:49 usentpserver = disabled If the SP policy HOST_POWER_ON was enabled before you replaced the battery, you must re-enable it.
Page 130
SPARC T7-1 Server Service Manual • May 2017...
When replacing the SPM, you must restore the configuration settings maintained in the SPM. Before replacing the SPM, save the configuration using the Oracle ILOM backup utility. Refer to the Oracle ILOM documentation for instructions on backing up and restoring the Oracle ILOM configuration.
After you replace the SPM, restoring the SPM configuration will be easier if you previously saved the configuration using the Oracle ILOM backup utility. Refer to the Oracle ILOM documentation for instructions on backing up and restoring the Oracle ILOM configuration.
Page 133
Remove the SPM Locate the SPM (panel 1). Remove the SPM. If you are removing the SPM because you are replacing the motherboard, set the SPM Note - aside where it is protected from static. You must reinstall the SPM on the new motherboard. Grasp the SPM by the two grasp points (panel 2) and lift up to disengage the SPM from the connectors on the motherboard.
“Component Service Categories” on page 45 for more information about this category of service procedures. Remove a defective SPM or remove the SPM you will install in a new motherboard. “Remove the SPM” on page 132. SPARC T7-1 Server Service Manual • May 2017...
Page 135
Install the SPM Lower the side of the SPM with the Align Tab sticker at an angle onto the SPM support on the motherboard (panel 1). Press the SPM straight down until it is fully seated in its socket (panel 2). Ensure that the notched tab at the other end of the SPM is held in place (panel 3).
Page 136
Prior to powering on the server, connect a terminal or a terminal emulator (PC or workstation) to the SER MGT port. Refer to “Connect a Terminal or Emulator to the SER MGT Port” in SPARC T7-1 Server Installation Guide. If the replacement SPM detects that the SPM firmware is not compatible with the existing host...
Verify the SPM For information about initializing TPM using the Oracle ILOM interface to enable failover, Securing Systems and Attached Devices in Oracle Solaris 11.3. Restore the TPM data and keys that were backed up to the new SP you install.
Page 138
Verify the SPM Note that the LED flashes green while the SPM initializes the Oracle ILOM firmware. See “Interpreting LEDs” on page 29 for information about the status of the SP LED. Use the Oracle ILOM show faulty command to verify that the fault has been cleared.
Servicing the DVD Drive The SATA DVD drive is mounted in a slot that is accessed from the system's front panel. You also must detach cables inside the chassis to remove the DVD drive. See “Internal Component Locations” on page 16.
Page 140
Attach an antistatic wrist strap. “Safety Information” on page Remove the fan cover. “Remove the Fan Cover” on page If necessary, remove fan modules from the chassis. “Remove a Fan Module” on page SPARC T7-1 Server Service Manual • May 2017...
Page 141
Remove a DVD Drive Reach into the server directly behind the DVD drive, and disconnect the power and DVD data connectors from rear of the DVD drive. Lift up on the release tab on the rear of the DVD drive to disengage the drive from the chassis.
Authorized service personnel can perform this procedure. The server must be completely powered down before performing this procedure. See “Component Service Categories” on page 45 for more information about cold-service procedures. Remove the defective DVD drive. SPARC T7-1 Server Service Manual • May 2017...
Page 143
Install a DVD Drive “Remove a DVD Drive” on page 139. Unpack the DVD drive. Attach an antistatic wrist wrap and place the drive on an antistatic mat. Gently push the replacement DVD drive into the chassis. Continue to push the DVD drive into the chassis until the release tab on the rear of the drive engages the chassis with an audible click.
Page 144
Install the fan cover, and close its latch. “Replace the Fan Cover” on page 173. Install the top cover. “Replace the Top Cover” on page 178. Return the server to operation. Return the server to the normal rack position. SPARC T7-1 Server Service Manual • May 2017...
Page 145
179. Reconnect the power cords to the server power supplies, and power on the server. “Attach Power Cords” on page 180 “Power On the Server (Oracle ILOM)” on page 180 “Power On the Server (System Power Button)” on page 181.
Page 146
SPARC T7-1 Server Service Manual • May 2017...
Servicing the Motherboard The motherboard includes one CMP module, memory control subsystems, and all SP (Oracle ILOM) logic. The motherboard hosts a removable SC PROM, which contains MAC addresses and host ID. These topics describe how to service the motherboard.
Page 148
Note - motherboard, and install these components on the new motherboard. The SPM contains the Oracle ILOM system configuration data, and the SC PROM contains the system host ID and MAC address. Transferring these components preserves the system-specific information stored on these modules.
Page 149
Remove the Motherboard You will reinstall it on the new motherboard. Remove the SPM. You will reinstall the SPM on the new motherboard. See “Remove the SPM” on page 132. Remove any memory risers. “Remove a Memory Riser” on page You will reinstall the memory risers on the new motherboard.
Page 150
Disconnect the cable from the server intrusion switch (panel 1). Disconnect the DVD drive cable from the motherboard (panel 2). SPARC T7-1 Server Service Manual • May 2017...
Page 151
Remove the Motherboard Carefully guide the DVD drive cable through the chassis mid-wall. Place the cable on top of the disk cage so that it is away from the motherboard. You do not need to disconnect the DVD drive cable from the DVD drive. Disconnect the signal cable and power cable from the motherboard to the drive backplane.
Page 152
(panel 3). Loosen the four green captive screws that secure the mid-wall to the bottom of the chassis (panel 4). Use a No. 2 Phillips screwdriver to loosen the captive screws. SPARC T7-1 Server Service Manual • May 2017...
Page 153
Remove the Motherboard Lift the mid-wall out of the chassis (panel 5) Release the power supplies and pull them slightly out of the server. The power supplies do not need to be removed from the chassis to lift out the motherboard. Lift the motherboard out of the chassis.
When replacing the motherboard, remove the SPM and SC PROM from the old motherboard and install these components on the new motherboard. The SPM contains the Oracle ILOM system configuration data, and the SC PROM contains the system host ID and MAC address.
Page 155
Install the Motherboard Grasp the motherboard by the handle and place it into the chassis (panel 1). You can use the metal handle in front of the cable channel and the bar by the rear I/O panel as handles to lift the motherboard. Ensure that the remaining cables do not get caught on edges of the motherboard.
Page 156
Insert the mid-wall into the chassis (panel 2). Fasten the mid-wall to the chassis. Tighten the four green captive screws that secure the mid-wall to the bottom of the chassis (panel 3). SPARC T7-1 Server Service Manual • May 2017...
Page 157
Install the Motherboard Use a No. 2 Phillips screwdriver to tighten the captive screws. Fasten a screw on each side of the chassis to secure the mid-wall to the chassis (panel 4). Servicing the Motherboard...
Page 158
Reconnect the signal cable and power cable from the motherboard to the drive backplane. “Install the Drive Backplane” on page 168. Connect the DVD drive cable to the motherboard. Thread the DVD cable through the chassis mid-wall to reach the motherboard connector. SPARC T7-1 Server Service Manual • May 2017...
Page 159
Install the Motherboard Install the four fan modules. “Install a Fan Module” on page Install DIMMs on the motherboard. Place each DIMM in the same motherboard slot where it had been before. Install the SPM on the motherboard. Use the SPM you removed from a motherboard. See “Install the SPM”...
Page 160
Prior to powering on the server, connect a terminal or a terminal emulator (PC or workstation) to the SP through the SER MGT port. Refer to “Connect a Terminal or Emulator to the SER MGT Port” in SPARC T7-1 Server Installation Guide.
“Log In to Oracle ILOM” in SPARC T7 Series Servers Administration Guide instructions. At the Oracle ILOM prompt, disable auto-boot so that the server will not boot the OS when the server powers on. -> set /HOST/bootmode script="setenv auto-boot? false"...
Page 162
Reactivate RAID Volumes “Power On the Server (Oracle ILOM)” on page 180 “Power On the Server (System Power Button)” on page 181. At the OpenBoot prompt, list the device paths on the server. ok show-devs /pci@301/pci@2/scsi@0/disk@p0 You can also use the devalias command to locate device paths specific to your server.
Page 163
1.00 Set the server to boot the OS when powered on. ok setenv auto-boot? true Reboot the server. See Server Administration, booting and shutting down Oracle Solaris. Related Information “Install the Motherboard” on page 154 ■ “Verify the Motherboard” on page 164 ■...
Verify the Motherboard Verify the Motherboard Use the Oracle ILOM show faulty command to verify that the fault has been cleared. “Identify Faulted Components” on page 24 for more information on using the show faulty command. Perform one of the following tasks based on your verification results: If the previous steps did not clear the fault, see “Detecting and Managing...
Servicing the Drive Backplane This board provides connectors for the drive signal cables. These topics describe how to service the drive backplane. “Remove the Drive Backplane” on page 165 ■ “Install the Drive Backplane” on page 168 ■ “Verify the Drive Backplane” on page 171 ■...
Page 166
Disconnect the cables from the drive backplane. Disconnect the two SAS cables from the drive backplane to the motherboard (panel 1). SPARC T7-1 Server Service Manual • May 2017...
Page 167
Remove the Drive Backplane Note the cable connections in order to ease proper reconnection of the cables. Disconnect the power cable from the drive backplane (panel 2). If present, disconnect the two optional NVMe cables from the drive backplane (panel 2). Servicing the Drive Backplane...
Lower the drive backplane into the server, and then position it under the spring tab to engage the standoff hooks (panels 1 and 2). The standoff hooks fit into small openings in the drive backplane. SPARC T7-1 Server Service Manual • May 2017...
Page 169
Install the Drive Backplane Ensure that ribbon cables aren't caught under the drive backplane. Using a No. 2 Phillips screwdriver, install and tighten the spring-mounted screw (on the power supply side of the server) to secure the drive backplane to the chassis (panel 3).
Page 170
This number is used for service entitlement and warranty coverage. The correct product serial number is located on a label on the front of the chassis. Verify the drive backplane. SPARC T7-1 Server Service Manual • May 2017...
“Remove the Drive Backplane” on page 165 ■ Verify the Drive Backplane Use the Oracle ILOM show faulty command to verify that the fault has been cleared. “Identify Faulted Components” on page 24 for more information on using the show faulty command.
Page 172
SPARC T7-1 Server Service Manual • May 2017...
Position” on page 179 Connect the power cords to the server. “Attach Power Cords” on page 180 Power on the server. “Power On the Server (Oracle ILOM)” on page 180 “Power On the Server (System Power Button)” on page 181 Replace the Fan Cover Align the fan cover with the screw holes.
Page 174
Replace the Fan Cover There are 12 screws securing the fan cover. Fasten the 12 screws to the top and side. SPARC T7-1 Server Service Manual • May 2017...
Install and Close the Airflow Cover The fan covers on some units are secured with T6 Torx screws. Other units are secured Note - with No. 2 Phillips screws. (Illustration shows T6 Torx screws.) Check that the two latches will engage when you close the fan cover. Related Information “Replace the Top Cover”...
Page 176
Install and Close the Airflow Cover Align the airflow cover on its hinge edge. Attach the hinged tabs to the server. Lower the airflow cover. SPARC T7-1 Server Service Manual • May 2017...
Page 177
Install and Close the Airflow Cover Make sure the two pairs of side tabs clear the sides of the server. Related Information “Replace the Top Cover” on page 178 ■ Returning the Server to Operation...
When the top cover is seated, the green button clicks into place. Related Information “Remove the Top Cover” on page 55 ■ “Return the Server to the Normal Operating Position” on page 179 ■ SPARC T7-1 Server Service Manual • May 2017...
If the CMA is in the way, disconnect the left CMA release and swing the CMA open. See “Release the CMA” on page Reconnect the CMA. Swing the CMA closed and latch it to the left rack rail. Refer to “Attach the CMA to the Server” in SPARC T7-1 Server Installation Guide. Returning the Server to Operation...
Note - the server. Depending on how the firmware is configured, the server might boot at this time. Power on the server. “Power On the Server (Oracle ILOM)” on page 180 “Power On the Server (System Power Button)” on page 181.
Each time the server powers on, POST can take several minutes to complete tests. Related Information “Power On the Server (Oracle ILOM)” on page 180 ■ “Clear a Fault Manually” on page 39 ■...
Page 182
SPARC T7-1 Server Service Manual • May 2017...
Glossary Memory buffer on board. chassis Server enclosure. Cable management arm (SPARC T7-1 and SPARC T7-2). Cable management assembly (SPARC T7-4). Chip multiprocessor. Customer-replaceable unit. Electrostatic discharge. eUSB drive Embedded universal serial bus drive. Field-replaceable unit. Glossary...
The part of the server or server module with the CPU and other hardware that runs the Oracle Solaris OS and other applications. The term host is used to distinguish the primary computer from the SP. See SP.
Page 185
Oracle ILOM Oracle Integrated Lights Out Manager. Oracle ILOM firmware is preinstalled on a variety of Oracle systems. Oracle ILOM enables you to remotely manage your Oracle servers regardless of the state of the host system. Oracle Solaris Oracle Solaris operating system.
Page 186
Solid-state drive. Secure shell. UUID Universal unique identifier. SPARC T7-1 Server Service Manual • May 2017...
Need help?
Do you have a question about the SPARC T7-1 and is the answer not in the manual?
Questions and answers