Oracle SPARC S7-2 Service Manual
Hide thumbs Also See for SPARC S7-2:
Table of Contents

Advertisement

SPARC S7-2 Server Service Manual
Part No: E72376-04
March 2017

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the SPARC S7-2 and is the answer not in the manual?

Questions and answers

Summary of Contents for Oracle SPARC S7-2

  • Page 1 SPARC S7-2 Server Service Manual Part No: E72376-04 March 2017...
  • Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
  • Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...
  • Page 5: Table Of Contents

    ▼ View Log Files (Oracle Solaris) ............ 27 ▼ View Log Files (Oracle ILOM) ............ 27 POST Overview .................. 28 ▼ Configure POST ................ 28 Oracle ILOM Properties That Affect POST Behavior ........ 30 ▼ Clear a Fault Manually ................ 31 Preparing for Service .................. 33 Safety Information .................. 33...
  • Page 6 Fan Module LEDs .................. 62 ▼ Remove a Fan Module ................ 63 ▼ Install a Fan Module ................. 65 ▼ Verify a Fan Module ................. 66 Servicing Power Supplies .................  69 Power Supply LEDs .................. 69 ▼ Remove a Power Supply ................ 70 SPARC S7-2 Server Service Manual • March 2017...
  • Page 7 Contents ▼ Install a Power Supply ................ 72 Servicing DIMMs .................... 75 DIMM Layout and Population Rules .............. 75 ▼ Identify and Remove a Failed DIMM ............ 76 ▼ Install a DIMM .................. 78 ▼ Verify a DIMM .................. 80 Servicing the Battery .................. 83 ▼ Replace the Battery ..................  83 Servicing PCIe Cards ..................
  • Page 8 ▼ Replace the Top Cover ................ 145 ▼ Return the Server to the Normal Operating Position ........ 147 ▼ Reconnect Data Cables and Power Cords ............  149 ▼ Power On the Server ................ 151 Index ........................  153 SPARC S7-2 Server Service Manual • March 2017...
  • Page 9: Using This Documentation

    Using This Documentation Overview – Describes how to troubleshoot and maintain the SPARC S7-2 server. ■ Audience – Technicians, system administrators, and authorized service providers. ■ Required knowledge – Advanced experience troubleshooting and replacing hardware. ■ Product Documentation Library Documentation and resources for this product and related products are available at http://www.
  • Page 10 SPARC S7-2 Server Service Manual • March 2017...
  • Page 11: Identifying Components

    These topics identify key components of the server, including major boards and internal system cables, as well as front and rear panel features. For system overview information, see “Understanding the Server” in SPARC S7-2 Server Installation Guide. “Front Panel Components” on page 11 ■...
  • Page 12 Fan Service Required LED Drive 6 (HDD/SDD) (amber) PS Service Required LED (amber) Drive 7 (HDD/SDD) Related Information “Rear Panel Components” on page 13 ■ “Internal Component Locations” on page 14 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 13: Rear Panel Components

    Rear Panel Components “Device Paths” on page 15 ■ Rear Panel Components Description Description PS 0 Fault LED NET 0 100/1000/10000 port PS 0 OK LED NET 1 100/1000/10000 port PS 1 Fault LED NET 2 100/1000/10000 port PS 1 OK LED NET 3 100/1000/10000 port PCIe card slot 1 NET MGT port...
  • Page 14: Internal Component Locations

    “Servicing Power Supplies” on page 69 PCIe slots 1, 2, and 3 “Servicing PCIe Cards” on page 87 Front Indicator Module “Servicing the Front Indicator Module” on page 111 Drives “Servicing Drives” on page 51 SPARC S7-2 Server Service Manual • March 2017...
  • Page 15: Device Paths

    Device Paths Related Information “Front Panel Components” on page 11 ■ “Rear Panel Components” on page 13 ■ “Server Block Diagram” on page 18 ■ “Device Paths” on page 15 ■ Device Paths This table describes the device paths for servers populated with 1 CPU. Device NAC Name Description Device Path PCIe...
  • Page 16 7 disk@p4 CPU0 CPU 0 /SYS/MB/CMP0/IOS0/RP0 /pci@300/pci@1 PCIe root port 0 CPU0 CPU 0 /SYS/MB/CMP0/IOS0/RP1 /pci@300/pci@2 PCIe root port 1 This table describes the device paths for servers populated with 2 CPUs. SPARC S7-2 Server Service Manual • March 2017...
  • Page 17 Device Paths Device NAC Name Description Device Path PCIe Physical Device Owned By Width Switch Port Number USB host SW 0 Port 12 pci@2 CPU 0 /SYS/MB/USB_CTLR /pci@300/pci@1/pci@0/ controller pci@2/usb@0 Ethernet SW 0 Port 4 pci@1 CPU 0 /SYS/MB/XGBE /pci@300/pci@1/pci@0/ controller pci@1 NET 0...
  • Page 18: Server Block Diagram

    This block diagram shows the connections between and among components and device slots on a two CPU server. Use this block diagram to determine the optimum locations for optional cards or other peripherals, based on your server's configuration and intended use. SPARC S7-2 Server Service Manual • March 2017...
  • Page 19 Server Block Diagram Related Information “Rear Panel Components” on page 13 ■ Identifying Components...
  • Page 20 Server Block Diagram “Front Panel Components” on page 11 ■ “Internal Component Locations” on page 14 ■ “Device Paths” on page 15 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 21: Detecting And Managing Faults

    Use these tools to identify components that require service. Step Description Links “Log In to Oracle ILOM (Service)” on page 22 Run the fmadm faulty command to display information about components “Identify Faulted Components” on page 22 that require service.
  • Page 22: Log In To Oracle Ilom (Service)

    The fmadm faulty command displays the list of faults detected by PSH. You can run this command from the host or through the Oracle ILOM fault management shell. Identify fault LEDs. SPARC S7-2 Server Service Manual • March 2017...
  • Page 23 From the Oracle ILOM prompt, start the fault management shell and type fmadm faulty. This example shows how to check for faults through the Oracle ILOM fault management shell. You can also check for faults by typing show faulty at the Oracle ILOM prompt.
  • Page 24 Obtain the message ID from console output (SPT-8000-PX in the example above). Go to https://support.oracle.com, and search on the message ID in the Knowledge tab, or type the URL from the Action field into a browser. Follow the suggested actions to repair the fault.
  • Page 25: Identify Disabled Components

    Identify Disabled Components Identify Disabled Components You can run the show disabled command from the Oracle ILOM prompt to identify components that have been disabled either intentionally, by a user, or automatically, because of a fault. At the Oracle ILOM prompt, type: ->...
  • Page 26: Performing Advanced Troubleshooting

    Log in as superuser. Type: # dmesg Related Information “View Log Files (Oracle Solaris)” on page 27 ■ “View Log Files (Oracle ILOM)” on page 27 ■ “POST Overview” on page 28 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 27: View Log Files (Oracle Solaris)

    To view all logged messages, type: # more /var/adm/messages* Related Information “Check the Message Buffer” on page 26 ■ “View Log Files (Oracle Solaris)” on page 27 ■ “POST Overview” on page 28 ■ View Log Files (Oracle ILOM) View the event log.
  • Page 28: Post Overview

    You can also set other Oracle ILOM properties to control various other aspects of POST operations. For example, you can specify the events that cause POST to run, the level of testing POST performs, and the amount of diagnostic information POST displays.
  • Page 29 Configure POST Set default_level to min For possible values for the default_level parameter, type: -> help /HOST/diag /HOST/diag : Manage Host Power On Self Test Diagnostics Targets: Properties: default_level : Diag level in the default cause (no error or hw change) default_level : Possible values = off, min, max default_level : User role required for set = r default_verbosity : Diag verbosity in the default cause (no error or hw...
  • Page 30: Oracle Ilom Properties That Affect Post Behavior

    Oracle ILOM Properties That Affect POST Behavior There are a number of Oracle ILOM commands that you can use to perform host diagnostic tests. For details about using these commands, refer to the chapter that describes configuring host server management actions in the Oracle ILOM Administrator's Guide for Configuration and Maintenance Firmware Release 3.2.x.
  • Page 31: Clear A Fault Manually

    Clear a Fault Manually Related Information “POST Overview” on page 28 ■ “Configure POST” on page 28 ■ Clear a Fault Manually When the server detects faults, the faults are logged and displayed on the console. In most cases, after the fault is repaired the fault condition is repaired automatically. In cases where the fault condition is not automatically cleared, you must clear the fault manually.
  • Page 32 Clear the fault in the Oracle Enterprise Manager Ops Center software, if applicable. Clearing a fault with the fmadm aquit command does not clear that fault in the Oracle Enterprise Manager Ops Center software. You must manually clear the fault or incident. For...
  • Page 33: Preparing For Service

    Preparing for Service Step Description Links Review safety and handling information. “Safety Information” on page 33 Gather the tools needed for service. “Service Tools” on page 35 Consider filler options. “Fillers” on page 35 Find the server serial number. “Find the Server Serial Number” on page 36 Identify the server to be serviced.
  • Page 34: Safety Symbols

    PCIe cards. When servicing or removing server components, attach an antistatic strap to your wrist and then to a metal area on the chassis. Following this practice equalizes the electrical potentials between you and the server. SPARC S7-2 Server Service Manual • March 2017...
  • Page 35: Antistatic Mat

    Service Tools Antistatic Mat Place ESD-sensitive components such as motherboards, memory, and other PCBs on an antistatic mat. Related Information “Prevent ESD Damage” on page 41 ■ “Service Tools” on page 35 ■ Service Tools You need the following tools for most service operations: Antistatic wrist strap ■...
  • Page 36: Find The Server Serial Number

    At the Oracle ILOM prompt, type: ■ -> show /System   /System    Targets: . . . In the output look for a line under Properties that identifies the product serial number. For example: serial_number = BKL1026F8F SPARC S7-2 Server Service Manual • March 2017...
  • Page 37: Locate The Server

    After locating the server with the blinking Server Locator LED, turn it off by pressing the Locator button with a stylus. Alternatively, you can type an Oracle ILOM command to turn off the Server Locator LED. -> set /System locator_indicator=off Related Information “Front Panel Components”...
  • Page 38: Prepare To Power Off The Server

    Save any open files and quit all running programs. Refer to your application documentation for specific information on these processes. Shut down all logical domains. Refer to Oracle Solaris system administration and Oracle VM Server for SPARC documentation for additional information. Shut down the Oracle Solaris OS.
  • Page 39 Power Off (Server Power Button - Graceful) “Prepare to Power Off the Server” on page Log in to the Oracle ILOM (CLI) using an Administrator account. At the Oracle ILOM prompt, shut down the operating system: -> stop /System Power Off (Server Power Button - Graceful) Use this procedure to place the server in the power standby mode.
  • Page 40: Disconnect Cables From The Server

    “Remove the Server From the Rack” on page 47 ■ “Open the Server Fan Door” on page 48 ■ “Remove the Top Cover” on page 49 ■ Related Information “Safety Information” on page 33 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 41: Prevent Esd Damage

    Caution - all anti tilt devices before extending the server from the rack. For instructions for stabilizing the rack, see the “Stabilize the Rack” in SPARC S7-2 Server Installation Guide. Verify that no cables will be damaged or will interfere when the server is extended.
  • Page 42: Remove The Cable Management Arm

    ■ Remove the Cable Management Arm Before you begin this procedure, refer to “Install the Cable Management Arm” in SPARC S7-2 Server Installation Guide and identify CMA connectors A, B, C, and D. You should disconnect SPARC S7-2 Server Service Manual • March 2017...
  • Page 43 Extend all rack anti tilt devices to prevent the rack from tipping over. For instructions for stabilizing the rack, refer to “Stabilize the Rack” in SPARC S7-2 Server Installation Guide. Extend the server approximately 13 cm (5 inches) out of the front of the rack, to make it easier to remove the CMA.
  • Page 44 (toward the left) on the slide rail latching bracket release tab labeled PUSH (callout 2), and pull the latching bracket out of the left slide rail and put it aside (frames 3 and 4). SPARC S7-2 Server Service Manual • March 2017...
  • Page 45 Remove the Cable Management Arm Disconnect connector. Place your left arm under the CMA to support it. Use your right thumb to push in (toward the right) on the connector C release tab labeled PUSH (callout 1), and pull connector C out of the right slide rail (frame 1 and 2).
  • Page 46 (panels 1 and 2). Description Connector B release lever Disconnect connector A. Place your left arm under the CMA to support it and grasp the rear end of connector A with your left hand. SPARC S7-2 Server Service Manual • March 2017...
  • Page 47: Remove The Server From The Rack

    Remove the Server From the Rack Use your right thumb to pull the connector A release lever to the right away from the left slide rail (callout 1), and use your left hand to pull the connector out of the slide rail (frames 1 and 2). Description Connector A release lever Remove the CMA from the rack and place it on a flat surface.
  • Page 48: Open The Server Fan Door

    Open the server fan door by sliding the fan door latches to the front of the server and swinging the door up to the open position. SPARC S7-2 Server Service Manual • March 2017...
  • Page 49: Remove The Top Cover

    Remove the Top Cover Related Information “Prevent ESD Damage” on page 41 ■ “Remove the Top Cover” on page 49 ■ Remove the Top Cover Servicing most of the server components requires that the top cover be removed. If the top cover is removed without first removing the AC power cords, the server Caution - host shuts down immediately and an event is logged to indicate that the chassis top cover has been removed.
  • Page 50 Remove the Top Cover Related Information “Prevent ESD Damage” on page 41 ■ “Replace the Top Cover” on page 145 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 51: Servicing Drives

    Servicing Drives The server provides eight 2.5-inch drive bays, accessible through the front panel. See “Front Panel Components” on page 11. Drives can be removed and installed while the server is running. This feature, referred to as being hot-serviceable, depends on how the drives are configured.
  • Page 52: Remove A Drive

    Cannot be logically isolated from the online operations of the server. ■ To shut down the drive, see “Power Off the Server” on page 38 and go to Step Take the drive offline. SPARC S7-2 Server Service Manual • March 2017...
  • Page 53 Remove a Drive For a standard drive: ■ At the Oracle Solaris prompt, list all drives in the device tree, including drives that are not configured. # cfgadm -al This command lists dynamically reconfigurable hardware resources and shows their operational status. In this case, look for the status of the drive you plan to remove.
  • Page 54 If you are hot-servicing the drive, locate the drive that displays the amber Fault LED and ensure that the blue Ready to Remove LED is lit. On the drive you want to remove, complete these tasks. SPARC S7-2 Server Service Manual • March 2017...
  • Page 55: Remove A Drive Filler

    Remove a Drive Filler The latch is not an ejector. Do not bend it too far to the right. Doing so can damage Caution - the latch. Push the release button to open the latch and unlock the drive. Grasp the latch and pull the drive out of the slot. When you remove a drive, replace it with a filler or another drive.
  • Page 56: Install A Drive

    This is a hot-service procedure that can be performed by a customer while the server is running. Take the necessary ESD precautions. “Prevent ESD Damage” on page Fully open the release lever on the drive. SPARC S7-2 Server Service Manual • March 2017...
  • Page 57 Install a Drive Install the drive by completing the following tasks. Slide the drive into the drive slot until it is fully seated. Close the latch to lock the drive in place. Return the drive to operation: If you cold-serviced the drive, restore power to the server. ■...
  • Page 58: Install A Drive Filler

    OS. Depending on the nature of the replaced drive, you might need to perform administrative tasks to reinstall software before the server can boot. Refer to the Oracle Solaris OS administration documentation for more information. SPARC S7-2 Server Service Manual • March 2017...
  • Page 59 Verify a Drive At the Oracle Solaris prompt, list all drives in the device tree, including any drives that are not configured. # cfgadm -al This command helps you identify the drive you installed. Ap_id Type        Receptacle Occupant   Condition scsi-bus    connected configured   unknown...
  • Page 60 ■ the tasks required to configure the drive. These tasks are covered in the Oracle Solaris OS administration documentation. For additional drive verification, you can run Oracle VTS. Refer to the Oracle VTS documentation for details at http://docs.oracle.com/cd/E19719-01/index.html. Related Information “Remove a Drive”...
  • Page 61: Servicing Fan Modules

    Servicing Fan Modules You need to extend the server from the rack and open the server fan door to access the fan modules. In single-processor servers, only three fans are supported. In this case, slot FM 3 Note - contains a fan filler. “Fan Module LEDs”...
  • Page 62: Fan Module Leds

    Service Required LEDs are also lit if the system detects a fan module fault. Related Information “Preparing for Service” on page 33 ■ “Detecting and Managing Faults” on page 21 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 63: Remove A Fan Module

    Remove a Fan Module Remove a Fan Module This is a hot-service procedure that can be performed by a customer while the server is running. Do not remove a fan without installing a replacement fan to ensure adequate cooling Caution - and maintain server availability.
  • Page 64 Consider your next step: If you removed the fan assembly as part of another procedure, return to that procedure. ■ Otherwise, continue to “Install a Fan Module” on page ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 65: Install A Fan Module

    Install a Fan Module Related Information “Extend the Server to the Service Position” on page 41 ■ “Install a Fan Module” on page 65 ■ Install a Fan Module This is a hot-service procedure that can be performed by a customer while the server is running. Remove the replacement fan module from its packaging and place it on an antistatic mat.
  • Page 66: Verify A Fan Module

    Verify that the Service Required LED on the replaced fan module is not lit. “Fan Module LEDs” on page At the Oracle ILOM prompt, start the fault management shell. -> start /SP/faultmgmt/shell Are you sure you want to start /SP/faultmgmt/shell (y/n)? y  ...
  • Page 67 Verify a Fan Module Related Information “Front Panel Components” on page 11 ■ “Rear Panel Components” on page 13 ■ Servicing Fan Modules...
  • Page 68 SPARC S7-2 Server Service Manual • March 2017...
  • Page 69: Servicing Power Supplies

    The server has redundant hot-serviceable power supplies. You can remove and replace a power supply without shutting the server down, provided that the other power supply is online and working. For information about power configuration policies, refer to the administration guide and the Oracle ILOM documentation. “Power Supply LEDs” on page 69 ■...
  • Page 70: Remove A Power Supply

    ■ ■ You can also use the Oracle ILOM show faulty command at the Oracle ILOM command line prompt (->) to identify a power supply failure. Gain access to the rear of the server where the faulty power supply is located.
  • Page 71 Remove a Power Supply For instructions for disconnecting the CMA left-side connectors, see “Remove the Cable Management Arm” on page Caution - When disconnecting the CMA left-side connectors, use your arm to support the CMA so that it does not hang down under its own weight and stress the right-side connectors; otherwise, the CMA might be damaged.
  • Page 72: Install A Power Supply

    Reconnect the power cord to the power supply. Verify that the amber LED on the replaced power supply and the Service Required LEDs on the front and rear panels of the server are not lit. SPARC S7-2 Server Service Manual • March 2017...
  • Page 73 If you disconnected the two CMA left-side connectors, reconnect the connectors. For instructions for reconnecting the CMA left-side connectors, refer to “Install the Cable Management Arm” in SPARC S7-2 Server Installation Guide. Related Information “Remove a Power Supply” on page 70 ■...
  • Page 74 SPARC S7-2 Server Service Manual • March 2017...
  • Page 75: Servicing Dimms

    Servicing DIMMs The server supports a variety of DDR4 DIMM configurations that can include quad-rank (QR), dual-rank (DR), and single-rank (SR) DDR4 DIMMs. Follow antistatic practices as described in “Prevent ESD Damage” on page 41 Caution - avoid component damage. These procedures require that you handle components that are sensitive to electrostatic discharge.
  • Page 76: Identify And Remove A Failed Dimm

    This is a cold-service procedure that can be performed by a customer. Power down the server completely before performing this procedure. Gain access to the DIMMs by preparing the server for service and removing the top cover. “Preparing for Service” on page SPARC S7-2 Server Service Manual • March 2017...
  • Page 77 Identify and Remove a Failed DIMM Remove the air baffle by lifting it straight up and out of the system. Identify and note the location of the failed DDR4 DIMM by pressing the Fault Remind button on the motherboard. Failed DDR4 DIMMs display an amber LED on the motherboard. Servicing DIMMs...
  • Page 78: Install A Dimm

    Unpack the replacement DDR4 DIMM and place it on an antistatic mat. Ensure that the replacement DDR4 DIMM matches the size of the DIMM it is replacing. SPARC S7-2 Server Service Manual • March 2017...
  • Page 79 (Optional) Use Oracle ILOM to clear DDR4 DIMM faults. DDR4 DIMM faults are automatically cleared after a new DIMM has been installed. If you need to manually clear DDR4 DIMM faults, refer to the Oracle Integrated Lights Out Manager (ILOM) 3.2 Documentation Library at http://www.oracle.com/goto/ILOM/docs.
  • Page 80: Verify A Dimm

    When the host is powered off, the console displays status=Powered Off. Switch to the system console to view POST output. Watch the POST output for possible fault messages. This output indicates that POST did not detect any faults: SPARC S7-2 Server Service Manual • March 2017...
  • Page 81 Switch to the system console and type: # fmadm faulty If any faults are reported, refer to the diagnostics instructions described in “Identify Faulted Components” on page Switch to the Oracle ILOM command shell. Type: -> show faulty Target | Property...
  • Page 82: Related Information

    UUID, you are done with the verification process. Switch to the system console and type the fmadm repair command with the UUID. Use the same UUID that was displayed from the output of the Oracle ILOM show faulty command. For example, type:...
  • Page 83: Servicing The Battery

    To correctly reset the date and time after replacing a battery, you must prevent the host from automatically powering on, and also disable any NTP server connections. Before you remove power from the server, perform these steps. Check the AUTO_HOST_POWER_ON state. At the Oracle ILOM prompt: -> show /SP/policy HOST_AUTO_POWER_ON /SP/policy...
  • Page 84 -> set /SP/clock usentpserver=disabled Replace the battery. Replacing the battery is a cold-service procedure. The server must be completely powered down before performing this procedure. Prepare the server for service. “Preparing for Service” on page SPARC S7-2 Server Service Manual • March 2017...
  • Page 85 “Returning the Server to Operation” on page 145. Reset the system clock. Use the Oracle ILOM clock command to set the day and time. The following example sets the date to August 22, 2016, and the timezone to EDT. -> set /SP/clock datetime=0812213202016 timezone=EDT...
  • Page 86 If the /SP/clock usentpserver property was enabled before you replaced the battery, you must re-enable it. -> set /SP/clock usentpserver=enabled Verify the battery. Check the status of the system battery. -> show /SYS/MB/BAT Related Information “Identify Faulted Components” on page 22 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 87: Servicing Pcie Cards

    Servicing PCIe Cards These topics describe how to service PCIe risers, PCIe cards, and PCIe card fillers. “Servicing PCIe Risers” on page 87 ■ “Servicing PCIe Cards” on page 96 ■ “Servicing the Internal HBA Card” on page 101 ■ Servicing PCIe Risers PCIe cards in all slots are installed on vertical risers.
  • Page 88: Pcie Riser Location And Differences

    PCIe riser and installed cards (2) in slots 3 and 4 (the internal HBA card is installed slot 4 of this riser.) Note:This riser is different from the risers in slots 1 and 2. SPARC S7-2 Server Service Manual • March 2017...
  • Page 89: Remove A Pcie Riser From Pcie Slot 1 Or 2

    Remove a PCIe Riser From PCIe Slot 1 or 2 Related Information “PCIe Slot Characteristics” on page 97 ■ Remove a PCIe Riser From PCIe Slot 1 or 2 This is a cold-service procedure that can be performed by a customer. Power down the server completely before performing this procedure.
  • Page 90 PCIe riser was originally installed. Otherwise, set the PCIe riser aside. Related Information “Install a PCIe Riser Into PCIe Slot 1 or 2” on page 91 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 91: Install A Pcie Riser Into Pcie Slot 1 Or 2

    Install a PCIe Riser Into PCIe Slot 1 or 2 Install a PCIe Riser Into PCIe Slot 1 or 2 The PCIe riser that is installed for PCIe slots 3 and 4 is different than the risers for PCIe Note - slots 1 and 2.
  • Page 92: Remove The Pcie Riser From Pcie Slots 3 And 4

    Use Oracle ILOM to clear the server PCIe riser fault. If the PCIe riser fault message in Oracle ILOM is not cleared under Open Problems, you must manually clear the fault in Oracle ILOM. For instructions for manually clearing a PCIe riser fault, see the procedure "Clear Faults for Undetected Replaced or Repaired...
  • Page 93 Remove the PCIe Riser From PCIe Slots 3 and 4 Do not disconnect the SAS cable from the internal HBA card until after you have Note - removed the riser from the server. Open the green-tabbed latch located on the rear of the server chassis next to PCIe slot 3 to release the rear bracket on the PCIe card (1).
  • Page 94: Install The Pcie Riser Into Pcie Slots 3 And 4

    This is a cold-service procedure that can be performed by a customer. Power down the server completely before performing this procedure. Retrieve the PCIe riser and any PCIe cards attached to it. Reconnect the SAS cables to the internal host bus adapter card. SPARC S7-2 Server Service Manual • March 2017...
  • Page 95 Install the PCIe Riser Into PCIe Slots 3 and 4 Be sure to connect the SAS cable for storage drives 0 through 3 (HDDs 0-3) to the connector that is farthest from the riser in which the HBA card is installed. Otherwise, the server will incorrectly identify the storage drives when it is powered on.
  • Page 96: Servicing Pcie Cards

    Use Oracle ILOM to clear the server PCIe riser fault. If the PCIe riser fault message in Oracle ILOM is not cleared under Open Problems, you must manually clear the fault in Oracle ILOM. For instructions for manually clearing a PCIe riser fault, see the procedure "Clear Faults for Undetected Replaced or Repaired...
  • Page 97: Pcie Slot Characteristics

    Caution - PCIe cards. You must disconnect all power cables from the system before performing these procedures. For a complete list of supported PCIe cards, refer to the SPARC S7-2 Product Notes at Note - http://www.oracle.com/goto/S7-2/docs. “PCIe Slot Characteristics” on page 97 ■...
  • Page 98: Remove A Pcie Card From Pcie Slot 1 Or 2

    Hold the riser in one hand and use your other hand to carefully pull the PCIe card connector out of the riser. Disconnect the rear bracket that is attached to the PCIe card from the rear of the PCIe riser. SPARC S7-2 Server Service Manual • March 2017...
  • Page 99: Install A Pcie Card In Pcie Slot 1 Or 2

    Install a PCIe Card in PCIe Slot 1 or 2 Place the PCIe card on an antistatic mat. Whenever you remove a PCIe card, you should replace it with another PCIe card or Caution - a PCIe filler panel. Installing PCIe filler panels in vacant PCIe slots helps reduce the level of electromagnetic interference (EMI) emitted by the server.
  • Page 100: Remove A Pcie Card From Pcie Slot 3

    Whenever you remove a PCIe card, you should replace it with another PCIe card or Caution - a PCIe filler panel. Installing PCIe filler panels in vacant PCIe slots helps reduce the level of electromagnetic interference (EMI) emitted by the server. SPARC S7-2 Server Service Manual • March 2017...
  • Page 101: Install A Pcie Card In Pcie Slot 3

    Install a PCIe Card in PCIe Slot 3 Install a PCIe Card in PCIe Slot 3 This is a cold-service procedure that can be performed by a customer. Power down the server completely before performing this procedure. Retrieve the PCIe card and riser you want to install. Insert the rear bracket that is attached to the PCIe card into the PCIe riser.
  • Page 102: Remove The Internal Hba Card From Pcie Slot 4

    “Remove the PCIe Riser From PCIe Slots 3 and 4” on page Remove the internal HBA card from the riser. Hold the riser in one hand and use your other hand to carefully remove the card from slot 4 of the riser. SPARC S7-2 Server Service Manual • March 2017...
  • Page 103 Remove the Internal HBA Card From PCIe Slot 4 Disconnect the rear bracket attached to the PCIe card from the rear of the PCIe riser. Servicing PCIe Cards...
  • Page 104 Disconnect the SAS cables from the internal HBA card and place the card on an antistatic mat. If you are replacing the internal HBA card, use a T10 Torx screwdriver to remove the special fitted bracket from the HBA card. SPARC S7-2 Server Service Manual • March 2017...
  • Page 105: Install The Internal Hba Card In Pcie Slot 4

    Install the Internal HBA Card in PCIe Slot 4 You must install the special fitted bracket on the replacement HBA card. Set aside the bracket until you are ready to install the replacement HBA card. If you need to remove the SAS cables, see “Remove the HBA SAS Cable Assembly”...
  • Page 106 Unpack the replacement HBA card and the SAS cables, and retrieve the PCIe riser for slot 3. Using a T10 Torx screwdriver, remove the standard HBA bracket that shipped with the replacement HBA card. SPARC S7-2 Server Service Manual • March 2017...
  • Page 107 Install the Internal HBA Card in PCIe Slot 4 Install the special fitted bracket that was removed in “Remove the Internal HBA Card From PCIe Slot 4” on page 102. If you are installing new SAS cables, see “Install the HBA SAS Cable Assembly”...
  • Page 108 Install the Internal HBA Card in PCIe Slot 4 Connect the SAS cables to the internal HBA card. SPARC S7-2 Server Service Manual • March 2017...
  • Page 109 Install the Internal HBA Card in PCIe Slot 4 Insert the rear bracket on the internal HBA card into the rear connector on the PCIe riser. Insert the internal HBA card connector into the bottom connector on the riser for PCIe slot 3 and 4.
  • Page 110 SPARC S7-2 Server Service Manual • March 2017...
  • Page 111: Servicing The Front Indicator Module

    Servicing the Front Indicator Module The FIM is mounted on left side of the chassis face next to the drives. See “Front Panel Components” on page “Remove the FIM” on page 111 ■ “Install the FIM” on page 113 ■ Related Information “Detecting and Managing Faults”...
  • Page 112 Carefully slide the FIM assembly toward the rear of the server enough to lift it over the Phillips screw and out of the server (2). Disconnect the FIM cable from the FIM assembly and set the assembly aside (3). SPARC S7-2 Server Service Manual • March 2017...
  • Page 113: Install The Fim

    Install the FIM Related Information “Install the FIM” on page 113 ■ Install the FIM This is a cold-service procedure that must be performed by qualified service personnel. Power down the server completely before performing this procedure. Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis.
  • Page 114 SPARC S7-2 Server Service Manual • March 2017...
  • Page 115: Servicing The Eusb Drive

    Servicing the eUSB Drive These procedures require that you handle components that are sensitive to static Caution - discharge. This sensitivity can cause the component to fail. To avoid damage, ensure that you follow antistatic practices to “Prevent ESD Damage” on page Ensure that all power is removed from the server before removing or installing an Caution - eUSB drive or damage to the drive might occur.
  • Page 116: Install The Eusb Drive

    Install the eUSB Drive This is a cold-service procedure that can be performed by a customer. Power down the server completely before performing this procedure. Prevent ESD damage. “Prevent ESD Damage” on page SPARC S7-2 Server Service Manual • March 2017...
  • Page 117 Install the eUSB Drive Press the new eUSB drive into the socket on the motherboard. Tighten the screw to secure the drive to the motherboard. Return the server to operation. “Returning the Server to Operation” on page 145. Related Information “Remove the eUSB Drive”...
  • Page 118 SPARC S7-2 Server Service Manual • March 2017...
  • Page 119: Servicing Cables

    Servicing Cables These procedures require that you handle components that are sensitive to Caution - electrostatic discharge. This sensitivity can cause the components to fail. To avoid damage, ensure that you follow antistatic practices as described in “Prevent ESD Damage” on page The system supplies power to the cables even when the server is powered off.
  • Page 120 Disconnect each SAS cables from the drive backplane by pressing the latch on the cable connectors, then pull the connectors. (1). Remove the PCIe riser from PCIe slots 3 and 4. “Remove the PCIe Riser From PCIe Slots 3 and 4” on page SPARC S7-2 Server Service Manual • March 2017...
  • Page 121: Install The Hba Sas Cable Assembly

    Install the HBA SAS Cable Assembly On the under side of the HBA card, press the SAS cable connector latches and then pull out the connectors (2). Carefully remove the SAS cables from the server. Related Information “Install the HBA SAS Cable Assembly” on page 121 ■...
  • Page 122: Remove The Nvme Cables

    This is a cold-service procedure that must be performed by qualified service personnel. The server must be completely powered down before performing this procedure. Prepare for servicing. “Preparing for Service” on page SPARC S7-2 Server Service Manual • March 2017...
  • Page 123 Remove the NVMe Cables Remove the air baffle by lifting it straight out of the system. Remove the server fan modules. “Install a Fan Module” on page Remove the server mid-wall. Loosen the four green captive screws that secure the mid-wall to the server chassis, using a No.
  • Page 124: Install The Nvme Cables

    This is a cold-service procedure that must be performed by qualified service personnel. The server must be completely powered down before performing this procedure. Guide the NVMe card cables along the side of the chassis. SPARC S7-2 Server Service Manual • March 2017...
  • Page 125 Install the NVMe Cables Connect the cables to the drive backplane (1). Connect the cable labeled "A" to the connector on the drive backplane labeled "NMVe A". Connect the cable labeled "B" to the connector on the drive backplane labeled "NMVe B". Connect the NVMe card cables to the motherboard (2).
  • Page 126 SPARC S7-2 Server Service Manual • March 2017...
  • Page 127: Servicing The Drive Backplane

    Servicing the Drive Backplane This board provides connectors for the drive signal cables. This board also serves as the interconnect for the front I/O board, the Power and Locator buttons, and server or component status LEDs. “Remove the Drive Backplane” on page 127 ■...
  • Page 128 If you do remove the storage drives from the server, record their locations so that you can reinstall them in the same locations. SPARC S7-2 Server Service Manual • March 2017...
  • Page 129 Remove the Drive Backplane Remove six Philips screws from the disk cage cover and slide toward the front of the server and lift up to remove it (1). Servicing the Drive Backplane...
  • Page 130: Install The Drive Backplane

    (1.3) Continue to lower the drive backplane into the disk cage until it is positioned in all six troughs that are located at the bottom of the disk cage (1.4) . SPARC S7-2 Server Service Manual • March 2017...
  • Page 131 Install the Drive Backplane Turn the drive backplane captive screw clockwise until the drive backplane is secure (1.5). Servicing the Drive Backplane...
  • Page 132: Verify The Drive Backplane

    145. Related Information “Remove the Drive Backplane” on page 127 ■ Verify the Drive Backplane At the Oracle ILOM prompt, start the fault management shell. -> start /SP/faultmgmt/shell Are you sure you want to start /SP/faultmgmt/shell (y/n)? y   faultmgmtsp>...
  • Page 133 Verify the Drive Backplane “Install the Drive Backplane” on page 130 ■ Servicing the Drive Backplane...
  • Page 134 SPARC S7-2 Server Service Manual • March 2017...
  • Page 135: Servicing The Motherboard

    Servicing the Motherboard The motherboard includes two CMPs, NVMe connections, power distribution, memory control subsystems, and all SPM (Oracle ILOM) logic. The motherboard hosts a removable SCC PROM, which contains all MAC addresses, host ID, and Oracle ILOM configuration data.
  • Page 136: Remove The Motherboard

    Use the Oracle ILOM backup utility prior to removing the motherboard. This utility Caution - backs up the Oracle ILOM configuration of the service processor. For more information, see the "Back Up the Oracle ILOM Configuration Settings" section in the Oracle ILOM Documentation Library at https://docs.oracle.com/cd/E37444_01/html/E37446/ z400371a1482122.html#scrolltoc.
  • Page 137 Remove the Motherboard Disconnect the drive backplane power cable from the motherboard by pressing in on the connector latch and pull the connector (1). Servicing the Motherboard...
  • Page 138 DIMMs will be installed in the wrong slots. If you do not reinstall the DIMMs in the same sockets, server performance might suffer and some DIMMs might not be used by the server. SPARC S7-2 Server Service Manual • March 2017...
  • Page 139: Install The Motherboard

    Install the Motherboard Related Information “Install the Motherboard” on page 139 ■ Install the Motherboard This is a cold-service procedure that must be performed by qualified service personnel. Power down the server completely before performing this procedure. Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis.
  • Page 140 Install the Motherboard Insert the motherboard into the server chassis (1). SPARC S7-2 Server Service Manual • March 2017...
  • Page 141 Install the Motherboard Grasp the metal bracket located to the rear of the DIMMs and tilt the front of the motherboard up slightly and push it into the opening in the rear of the server chassis. Lower the motherboard into the server chassis and slide it to the rear until it engages the seven mushroom-shaped standoffs located on the server chassis under the motherboard.
  • Page 142: Verify The Motherboard

    “Returning the Server to Operation” on page 145. Update the system firmware. See the Performing Firmware Updates section in the Oracle® ILOM Administrator's Guide for Configuration and Maintenance. When you replace a motherboard that contains an SP, download the fallback miniroot image for your hardware and your Oracle Solaris version from My Oracle Support at https://support.oracle.com.
  • Page 143 Verify the Motherboard faultmgmtsp> Type fmadm faulty to check for faults. If faults are reported, see “Detecting and Managing Faults” on page 21 ■ If no faults are reported, then the motherboard has been replaced ■ successfully. Related Information “Install the Motherboard” on page 139 ■...
  • Page 144 SPARC S7-2 Server Service Manual • March 2017...
  • Page 145: Returning The Server To Operation

    Returning the Server to Operation These topics describe how to return the server to operation after servicing. Step Description Links Replace the top cover and return the server to its “Remove the Top Cover” on page 49 normal operating position “Return the Server to the Normal Operating Position”...
  • Page 146 Close the server fan door. Remove the antistatic precautions. Related Information “Remove the Top Cover” on page 49 ■ “Return the Server to the Normal Operating Position” on page 147 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 147: Return The Server To The Normal Operating Position

    Return the Server to the Normal Operating Position Return the Server to the Normal Operating Position Deploy any rack anti tilt mechanisms before installing the server into the rack. Caution - The server weighs approximately 18.1 kg (40.0 lbs). Two people are required to carry Caution - the chassis and install it into the rack.
  • Page 148 Continue pushing the server into the rack until the slide rail locks (on the front of the server) engage the slide rail assemblies. SPARC S7-2 Server Service Manual • March 2017...
  • Page 149: Reconnect Data Cables And Power Cords

    Power Cords” on page 149. For detailed information on connecting cables to the rear of the server, refer to “Cabling the ■ Server” in SPARC S7-2 Server Installation Guide. Related Information “Remove the Server From the Rack” on page 47 ■...
  • Page 150 You will hear an audible click when the server is in the normal rack position. Related Information “Return the Server to the Normal Operating Position” on page 147 ■ “Power On the Server” on page 151 ■ SPARC S7-2 Server Service Manual • March 2017...
  • Page 151: Power On The Server

    Log in to the Oracle ILOM web interface, click Host Management → Power Control and ■ select Power On from the Select Action list. Log in to the Oracle ILOM CLI, and type this command at the Oracle ILOM prompt: ■ ->start /System When the server is powered on and the power-on self-test (POST) code checkpoint tests have completed, the green Power status indicator on the front panel lights and remains lit.
  • Page 152 SPARC S7-2 Server Service Manual • March 2017...
  • Page 153: Index

    Index removing, 127 verifying function of replaced, 132 battery drives installing, 83 about, 51 removing, 83 installing, 56 block diagram, 18 removing, 52 verifying function of replaced, 58 cable management arm (CMA) uninstalling, 42 enabling new DIMMs, 80 cables, data and power ESD, preventing, 34 connecting, 40, 149 eUSB drive...
  • Page 154: Sparc S7-2 Server Service Manual • March

    (Oracle Solaris), 27 slot locations, 13 PCIe risers installing in slots 1 and 2, 91 installing in slots 3 and 4, 94 message buffer, checking the, 26 location and differences, 88 SPARC S7-2 Server Service Manual • March 2017...
  • Page 155 SER MGT port, location of, 13 power-on self-test, see POST, 28 serial number (chassis), locating, 36 powering off, 38 server Oracle ILOM, 38 locating, 37 power button, emergency, 39 removing from rack, 47 power button, gracefull, 39 service position, 41...
  • Page 156 Index /var/adm/messages file, 27 verifying function of replaced drive backplane, 132 drives, 58 fan modules, 66 motherboard, 142 viewing message log files Oracle ILOM, 27 Oracle Solaris, 27 weight of server, 47 SPARC S7-2 Server Service Manual • March 2017...

Table of Contents