Oracle Netra SPARC S7-2 Service Manual

Hide thumbs Also See for Netra SPARC S7-2:
Table of Contents

Advertisement

Netra SPARC S7-2 Server Service Manual
Part No: E73207-03
February 2017

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Netra SPARC S7-2 and is the answer not in the manual?

Questions and answers

Summary of Contents for Oracle Netra SPARC S7-2

  • Page 1 Netra SPARC S7-2 Server Service Manual Part No: E73207-03 February 2017...
  • Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
  • Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l’accès à...
  • Page 5: Table Of Contents

    Related Information ................ 20 Device Paths .................... 20 Server Block Diagram (Dual Processor) ............ 21 Detecting and Managing Faults ................  25 Checking for Faults .................. 25 ▼ Log In to Oracle ILOM (Service) ............ 26 ▼ Identify Faulted Components .............. 27 ▼ Identify Disabled Components ............ 29 Interpreting LEDs .................. 30 Front Panel LEDs .................. 31 Rear Panel LEDs ................... 33...
  • Page 6 ▼ Rotate the Drive Cage to the Service Position .......... 71 ▼ Remove the PSU Duct ................ 74 ▼ Remove the Air Duct ................ 75 Servicing the Air Filter .................. 79 ▼ Remove the Filter .................. 79 ▼ Install the Filter .................. 82 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 7 Contents Servicing SAS Drives .................. 85 SAS Drive Configuration ................ 86 SAS Drive LEDs ................... 86 ▼ Locate a Faulty Drive ................ 87 ▼ Remove a SAS Drive ................ 89 ▼ Install a SAS Drive ..................  92 ▼ Verify a SAS Drive ..................  95 Servicing NVMe Storage Drives ................  97 ▼...
  • Page 8 I/O Root Complex Connections .............. 171 PCIe Device NAC Names ................ 172 ▼ Locate a Faulty PCIe Card ...............  172 ▼ Remove a PCIe Card ................ 174 ▼ Install a PCIe Card .................  176 ▼ Verify a PCIe Card .................  177 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 9 Contents Servicing the Internal HBA PCIe Card .............  179 ▼ Remove the Internal HBA PCIe Card ............ 179 ▼ Install the Internal HBA PCIe Card ............ 183 ▼ Verify the Internal HBA PCIe Card ............ 187 Servicing the Battery .................. 189 ▼ Remove the Battery ................ 189 ▼...
  • Page 10 ▼ Install the Fan Tray ................. 244 ▼ Install the Top Cover ................ 246 ▼ Connect AC Power Cords ................  249 ▼ Power On the Server (Oracle ILOM) ............ 249 ▼ Power On the Server (Power Button) ............ 250 Index ........................  251 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 11: Using This Documentation

    Using This Documentation Overview – Describes how to troubleshoot and maintain the Netra SPARC S7-2 server from ■ Oracle Audience – Technicians, system administrators, and authorized service providers ■ Required knowledge – Advanced experience troubleshooting and replacing hardware ■ Product Documentation Library Documentation and resources for this product and related products are available at http://www.
  • Page 12 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 13: Identifying Components

    Identifying Components For system overview information, see the Netra SPARC S7-2 Server Installation Guide. These topics identify key components of the server. “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page 14 ■ “Component Locations (Motherboard, Memory, and PCIe Cards)” on page 16 ■...
  • Page 14: Component Locations (Storage, Power, Nvme, And Fan Modules)

    “Servicing the NVMe Cables” on page 207 “Servicing NVMe Storage Drives” on page 97 Drive backplane data cable “Servicing the Cables” on page 193 Top cover with service labels “Remove the Top Cover” on page 67 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 15 Component Locations (Storage, Power, NVMe, and Fan Modules) Name Service Links “Install the Top Cover” on page 246 “Component Service Task Reference” on page 47 Fan modules and tray “Servicing Fan Modules” on page 151 “Remove the Fan Tray” on page 69 “Install the Fan Tray”...
  • Page 16: Component Locations (Motherboard, Memory, And Pcie Cards)

    “Servicing the Internal HBA PCIe Card” on page 179 PCIe cards “Servicing PCIe Cards” on page 169 DIMMs “Servicing DIMMs” on page 159 PSU duct “Remove the PSU Duct” on page 74 “Install the PSU Duct” on page 240 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 17: Front Panel Components (Service)

    Front Panel Components (Service) Related Information “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page 14 ■ “Front Panel Components (Service)” on page 17 ■ “Rear Panel Components (Service)” on page 18 ■ “Customer-Replaceable Units” on page 19 ■ “Field-Replaceable Units”...
  • Page 18: Rear Panel Components (Service)

    ■ Slots 1, 2, 3, and 4 on left ■ Slots 5 and 6 on right Grounding studs (Optional) for AC servers. See “Connect the Chassis Ground Wire” in Netra SPARC S7-2 Server Installation Guide Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 19: Customer-Replaceable Units

    USB port (rear) “USB Ports” in Netra SPARC S7-2 Server Installation Guide Host network 100/1000/10000 ports (NET 0 to 3) “10 Gigabit Ethernet Ports” in Netra SPARC S7-2 for host Server Installation Guide NET MGT RJ-45 network port “Log In to Oracle ILOM (Service)” on page 26 SER MGT RJ-45 serial port “Log In to Oracle ILOM (Service)”...
  • Page 20: Related Information

    ■ “Returning a Server to Operation” on page 235 ■ Field-Replaceable Units FRUs can only be serviced by Oracle authorized service personnel. Damage to the components and the server might occur if the FRUs are improperly serviced. Description Links LED board “Servicing the LED Board”...
  • Page 21: Server Block Diagram (Dual Processor)

    Server Block Diagram (Dual Processor) Device Path PCIe 3 /pci@302/pci@1/pci@0/pci@12 PCIe 4 /pci@302/pci@1/pci@0/pci@13 PCIe 5 /pci@300/pci@2/pci@0/pci@14 PCIe 6 /pci@302/pci@2/pci@0/pci@15 NET 0 /pci@300/pci@1/pci@0/pci@1/network@0 NET 1 /pci@300/pci@1/pci@0/pci@1/network@0,1 NET 2 /pci@300/pci@1/pci@0/pci@1/network@0,2 NET 3 /pci@300/pci@1/pci@0/pci@1/network@0,3 SSD/HDD 0 /pci@302/pci@2/pci@0/pci@6/LSI,sas@0/disk@p2 NVMe 0 /pci@300/pci@2/pci@0/pci@18/nvme@0/disk@1 SSD/HDD 1 /pci@302/pci@2/pci@0/pci@6/LSI,sas@0/disk@p3 NVMe 1 /pci@302/pci@2/pci@0/pci@19/nvme@0/disk@1 SSD/HDD 2...
  • Page 22 Server Block Diagram (Dual Processor) For more detail on root complexes related to the PCIe slots, see “I/O Root Complex Note - Connections” on page 171. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 23 Server Block Diagram (Dual Processor) Related Information “Rear Panel Components (Service)” on page 18 ■ “Front Panel Components (Service)” on page 17 ■ “Customer-Replaceable Units” on page 19 ■ “Field-Replaceable Units” on page 20 ■ “Device Paths” on page 20 ■...
  • Page 24 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 25: Detecting And Managing Faults

    Use these tools to identify components that require service. Step Description Links “Log In to Oracle ILOM (Service)” on page 26 Run the fmadm faulty command to display information about components “Identify Faulted Components” on page 27 that require service.
  • Page 26: Log In To Oracle Ilom (Service)

    At the terminal prompt, type: ssh root@SP-IP-address Password: password Oracle (R) Integrated Lights Out Manager Version 3.2.x Copyright (c) 2016, Oracle and/or its affiliates, Inc. All rights reserved. -> Related Information “Identify Faulted Components” on page 27 ■ “Identify Disabled Components” on page 29 ■...
  • Page 27: Identify Faulted Components

    From the Oracle ILOM prompt, start the fault management shell and type fmadm faulty. This example shows how to check for faults through the Oracle ILOM fault management shell. You can also check for faults by typing this command at the Oracle ILOM prompt.
  • Page 28 Obtain the message ID from console output (SPT-8000-PX in the previous example). Go to https://support.oracle.com, and search on the message ID in the Knowledge tab, or type the URL from the Action field into a browser. Follow the suggested actions to repair the fault.
  • Page 29: Identify Disabled Components

    “Interpreting LEDs” on page 30 ■ Identify Disabled Components You can run the show disabled command from the Oracle ILOM prompt to identify components that have been disabled either intentionally, by a user, or automatically, because of a fault. At the Oracle ILOM prompt, type: ->...
  • Page 30: Interpreting Leds

    ■ “Servicing the Motherboard” on page 225 Related Information “Checking for Faults” on page 25 ■ “Performing Advanced Troubleshooting” on page 34 ■ “Clear a Fault Manually” on page 40 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 31: Front Panel Leds

    Interpreting LEDs Front Panel LEDs Description Alarm LEDs: ■ Critical Alarm LED (red) Indicates a critical alarm condition. ■ Major Alarm LED (red) Indicates a major alarm condition. ■ Minor Alarm LED (amber) Indicates a minor alarm condition. ■ User Alarm LED (amber) Indicates a user alarm condition.
  • Page 32 Description Service Required LED (amber) Indicates that service is required. The Oracle ILOM show faulty command provides details about any faults that cause this indicator to light. Under some fault conditions, individual component fault LEDs are turned on in addition to the Service Required LED.
  • Page 33: Rear Panel Leds

    Indicates that power supply is functional (on) or with fault (off). ■ Service Required LED On indicates that service for the power supply is required. POST and Oracle ILOM are two (amber) diagnostic tools that can detect a fault or failure resulting in this indication.
  • Page 34: Performing Advanced Troubleshooting

    ■ Typing the Oracle ILOM command set /SYS/LOCATE value=Fast_Blink. ■ Pressing the Locator button. ■ Service Required LED Indicates that service is required. POST and Oracle ILOM are two diagnostics tools that can (center, amber) detect a fault or failure resulting in this indication.
  • Page 35: Check The Message Buffer

    The dmesg command checks the system buffer for recent diagnostic messages and displays the messages. Log in as superuser. Type: # dmesg Related Information “View Log Files (Oracle Solaris)” on page 35 ■ “View Log Files (Oracle ILOM)” on page 36 ■ “POST Overview” on page 37 ■...
  • Page 36: View Log Files (Oracle Ilom)

    View the audit log. -> show /SP/logs/audit/list Related Information “Check the Message Buffer” on page 35 ■ “View Log Files (Oracle Solaris)” on page 35 ■ “POST Overview” on page 37 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 37: Post Overview

    Also, you can set other Oracle ILOM properties to control various other aspects of POST operations. For example, you can specify the events that cause POST to run, the level of testing POST performs, and the amount of diagnostic information POST displays.
  • Page 38 To set error_level, to max, and to set hw_change_level to max, type: -> set /HOST/diag error_level=max -> set /HOST/diag hw_change_level=max Refer to the section on setting the SPARC host keyswitch state in the Oracle ILOM Administrator’s Guide for Configuration and Maintenance Firmware Release 3.2.x for a description of parameters and values.
  • Page 39: Oracle Ilom Properties That Affect Post Behavior

    Oracle ILOM Properties That Affect POST Behavior There are a number of Oracle ILOM commands that you can use to perform host diagnostic tests. For details about using these commands, refer to the chapter that describes configuring host server management actions in the Oracle ILOM Administrator's Guide for Configuration and Maintenance Firmware Release 3.2.x.
  • Page 40: Clear A Fault Manually

    If this message appears in the output, you must reset the server after you repair the fault. faultmgmtsp> exit -> reset /System Are you sure you want to reset /System? y Resetting /System ... Clear the fault in the Oracle Enterprise Manager Ops Center software, if applicable. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 41: Server Fault Remind Button Operation

    Server Fault Remind Button Operation Clearing a fault with the fmadm aquit command does not clear that fault in the Oracle Enterprise Manager Ops Center software. You must manually clear the fault or incident. For more information, refer to Oracle Enterprise Manager Ops Center Feature Reference Guide at: http://www.oracle.com/pls/topic/lookup?ctx=oc122...
  • Page 42 Server Fault Remind Button Operation Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 43: Preparing For Service

    Preparing for Service These topics describe how to prepare the server for servicing. Step Description Link Review safety and handling information. “Safety Information” on page 44 Gather the tools for service. “Service Tools” on page 46 Consider filler options. “Fillers” on page 46 Find the server serial number.
  • Page 44: Safety Information

    There is a risk of personal injury or equipment damage. To avoid personal injury and Caution - equipment damage, follow the instructions. Hot surface. Avoid contact. Surfaces are hot and might cause personal injury if Caution - touched. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 45: Esd Measures

    Safety Information Hazardous voltages are present. To reduce the risk of electric shock and danger to Caution - personal health, follow the instructions. The system supplies power to the cables even when the server is powered off. Caution - To avoid personal injury or damage to the server, you must disconnect power cords before servicing the cables.
  • Page 46: Service Tools

    The fillers are installed at the factory and must remain in the server until you replace them with a functional component to ensure proper airflow through the system. If you remove a filler and Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 47: Find The Server Serial Number

    You can find the chassis serial number on a sticker located on the front top of the server. If it is not convenient to read either sticker, follow this procedure. Access Oracle ILOM. “Log In to Oracle ILOM (Service)” on page Display the serial number. -> show /System serial_number...
  • Page 48: Locate The Server

    “Log In to Oracle ILOM (Service)” on page Turn on the Locator LED. -> set /SYS/LOCATE value=Fast_Blink The white Locator LEDs (one on the front panel and one on the rear panel) blink. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 49: Removing Power From A Server

    Removing Power From a Server After locating the server with the blinking Locator LED, turn the LED off by pressing the Locator button. Alternatively, you can turn off the Locator LED by running the Oracle ILOM set /SYS/ Note - LOCATE value=off command.
  • Page 50: Prepare To Power Off A Server

    Perform this procedure before powering off a server. Notify affected users that the server will be shut down. Refer to the Oracle Solaris system administration documentation for additional information. Save any open files and quit all running programs. Refer to your application documentation for specific information for these processes.
  • Page 51: Power Off The Server (Power Button - Graceful)

    “Prepare to Power Off a Server” on page 50 ■ “Disconnect Power Cords and Data Cables” on page 52 ■ “Power On the Server (Oracle ILOM)” on page 249 ■ “Power Off the Server (Power Button - Graceful)” on page 51 ■...
  • Page 52: Power Off The Server (Emergency Shutdown)

    Unplug all power cords from the server. Because 12+ VDC standby power is always present in the system, you must unplug Caution - the power cords before accessing any cold-serviceable components. For AC power cords. ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 53 Disconnect Power Cords and Data Cables For DC power supply: ■ Turn off the main power circuit breaker to the server's power supply unit. ■ ■ Do not proceed with these instructions until you are sure that there is no voltage Caution - present on the DC cords and their power source.
  • Page 54 Disconnect and remove all of the data cables that are attached to the rear of the server. “Servicing the Cables” on page 193. Related Information “Power Off the Server (Oracle ILOM)” on page 50 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 55: Accessing Internal Components

    Accessing Internal Components “Power Off the Server (Power Button - Graceful)” on page 51 ■ “Power Off the Server (Emergency Shutdown)” on page 52 ■ “Prevent ESD Damage” on page 55 ■ “Connect AC Power Cords” on page 249 ■ Accessing Internal Components These topics provide procedures and guidelines when accessing internal components.
  • Page 56: Removing The Server From The Rack

    The steps to remove the server from a 4-post, 19-inch rack depend on the type of server mounting. Either the server is hard mounted with the hardmount rack kit, or the server is mounted with a sliding rail kit. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 57 Remove a Server From the 4-Post, 19-inch Rack Disconnect all the cables and power cords from the server. If the server has a sliding rail kit with a cable management arm (CMA), remove the CMA. “Remove the Cable Management Arm” on page Support the weight of the server for removal.
  • Page 58 4-Post, 19-Inch rack with sliding rails for servers. Before you begin this procedure, refer to “Installing the 19-Inch Sliding Rail Kit With the CMA” in Netra SPARC S7-2 Server Installation Guide and identify CMA connectors A, B, C, Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 59 Caution - devices before extending the server from the rack. For instructions for stabilizing the rack, see “Stabilize the Rack” in Netra SPARC S7-2 Server Installation Guide. To make it easier to remove the CMA, extend the server approximately 13 cm (5 inches) out of the front of the rack.
  • Page 60 (labeled PUSH) Use your right hand to support the CMA and use your left thumb to push in (toward the left) on the slide-rail latching bracket release tab labeled PUSH Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 61 Remove the Cable Management Arm (callout 2), and pull the latching bracket out of the left slide-rail and put it aside (frames 3 and 4). Disconnect connector. Place your left arm under the CMA to support it. Use your right thumb to push in (toward the right) on the connector C release tab labeled PUSH (callout 1), and pull connector C out of the right slide-rail (frame 1 and 2).
  • Page 62 (frames 1 and 2). Description Connector B release lever Disconnect connector A. Place your left arm under the CMA to support it and grasp the rear end of connector A with your left hand. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 63 Remove a Server From the 2-Post, 19-inch Rack Use your right thumb to pull the connector A release lever to the right away from the left slide-rail (callout 1), and use your left hand to pull the connector out of the slide-rail (frames 1 and 2). Description Connector A release lever Remove the CMA from the rack and place it on a flat surface.
  • Page 64 Remove a Server From the 2-Post, 19-inch Rack Remove the two screws that secure each rear plate to the back of the post. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 65 Remove a Server From the 2-Post, 19-inch Rack Loosen the two screws that secure each rear plate to the eyelets of the side bracket. Slide each rear plate out of the eyelets and set them aside. Preparing for Service...
  • Page 66 Related Information “Prevent ESD Damage” on page 55 ■ “Remove the Top Cover” on page 67 ■ “Install the Top Cover” on page 246 ■ “Safety Information” on page 44 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 67: Remove The Top Cover

    Remove the Top Cover Remove the Top Cover Remove the server from the rack. “Removing the Server From the Rack” on page Fully loosen the two captive screws at the rear of the top cover. Preparing for Service...
  • Page 68 Slide the top cover back 0.5 in (13 mm), and lift it straight up and off the chassis. Set the top cover aside. Consider your next step. Service these components: ■ “Servicing Fan Modules” on page 151 “Servicing PCIe Cards” on page 169 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 69: Remove The Fan Tray

    Remove the Fan Tray “Servicing the Battery” on page 189 ■ “Remove the Fan Tray” on page 69 ■ Related Information “Prevent ESD Damage” on page 55 ■ “Removing the Server From the Rack” on page 56 ■ “Install the Top Cover” on page 246 ■...
  • Page 70 Remove the fan tray bracket that is attached to the chassis. Consider your next step. Service the hard drive signal, hard drive power, or cables. ■ “Servicing the Cables” on page 193. Pivot the drive cage. ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 71: Rotate The Drive Cage To The Service Position

    Rotate the Drive Cage to the Service Position “Rotate the Drive Cage to the Service Position” on page Related Information “Remove the Top Cover” on page 67 ■ “Install the Fan Tray” on page 244 ■ “Rotate the Drive Cage to the Service Position” on page 71 ■...
  • Page 72 Rotate the Drive Cage to the Service Position Fully loosen the four screws securing the drive cage to the server. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 73 Rotate the Drive Cage to the Service Position Rotate the drive cage to the vertical position. Consider your next step. Service the drive backplane. ■ “Servicing the Drive Backplane” on page 117. Remove the PSU duct. ■ “Remove the PSU Duct” on page Remove the air duct.
  • Page 74: Remove The Psu Duct

    Set the PSU duct aside. Consider your next step. See: “Servicing the eUSB Drive” on page 103 ■ “Servicing the USB Board” on page 109 ■ “Servicing DIMMs” on page 159 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 75: Remove The Air Duct

    Remove the Air Duct “Servicing the PDB” on page 141 ■ “Servicing the Cables” on page 193 ■ Related Information “Remove the Air Duct” on page 75 ■ “Install the PSU Duct” on page 240 ■ Remove the Air Duct Complete these prerequisites in this order.
  • Page 76 Remove the Air Duct Fully loosen the thumbscrew on the left bracket. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 77 Remove the Air Duct Slide the left thumbscrew bracket forward and off of the mounting pins. Set the thumbscrew bracket aside. Remove the routed cables from the cable ties on the air duct and from the cutouts in the air duct. Preparing for Service...
  • Page 78 ■ Related Information “Rotate the Drive Cage to the Service Position” on page 71 ■ “Install the PSU Duct” on page 240 ■ “Install the Air Duct” on page 236 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 79: Servicing The Air Filter

    Servicing the Air Filter The air filter traps larger dust particles from entering the server. The air filter is located at the air intake end of the server. See “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page Description Links Replace the air filter.
  • Page 80 Remove the Filter Press down on the two release latches. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 81 Remove the Filter Tilt and pivot the air filter away from the server. Lift the air filter from the server. Set the air filter aside. Consider your next step. If you removed the air filter to replace it, install the new air filter. ■...
  • Page 82: Install The Filter

    If you installed the air filter as part of another component's removal or installation procedure, return to that procedure. “Component Service Task Reference” on page 47 for assistance. Related Information “Remove the Filter” on page 79 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 83 Install the Filter “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Servicing the Air Filter...
  • Page 84: Netra Sparc S7-2 Server Service Manual • February

    Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 85: Servicing Sas Drives

    Servicing SAS Drives SAS drives are used for nonvolatile storage of information. The drives are located across the front of the server, behind the filter. See “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page Description Links Replace a faulty drive. “SAS Drive Configuration”...
  • Page 86: Sas Drive Configuration

    The status of each SAS drive is represented by the same three LEDs. The LEDs are located above the release button of each drive. See “Front Panel Components (Service)” on page This illustration and table describe the functionality of the drive LEDs. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 87: Locate A Faulty Drive

    Visually inspect the drives to see if any of their status LEDs are lit or flashing. “SAS Drive LEDs” on page If a drive is faulty, replace it. See “Remove a SAS Drive” on page In Oracle ILOM, check the health of the storage system. -> show /System/Storage /System/Power Targets:...
  • Page 88 If a FRU value different from /SYS/DBP/HDDx is displayed, see “Component Service Task Reference” on page 47 to identify which component is faulty. Use the Oracle ILOM faultmgmt shell to identify the faulty component. “Identify Faulted Components” on page Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 89: Remove A Sas Drive

    Remove a SAS Drive Check the Fault class and Description fields for more information. If a drive is faulty, replace it. “Remove a SAS Drive” on page If you are unable to determine if a drive is faulty, seek further information. “Detecting and Managing Faults”...
  • Page 90 See the OS documentation. Verify that the drive's blue Ready-to-Remove LED is lit. “SAS Drive LEDs” on page Press the release button and pivot the release lever open to the right. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 91 Remove a SAS Drive Grasp the release lever and pull the drive out of the server. Set the drive aside. Repeat from Step 5 for any additional drives to be removed. Consider your next step. ■ If you removed a drive as part of a replacement operation, install a new drive.
  • Page 92: Install A Sas Drive

    “Preparing for Service” on page 43 ■ “SAS Drive Configuration” on page 86 ■ “Remove the Filter” on page 79 ■ Push the release button of the drive. The release lever pops out. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 93 Install a SAS Drive Align the drive with the slot where it installs into the server. The connector is at the rear of the drive and the release button is on the left. Press on the drive to slide the drive into the server until the release lever moves slightly inward.
  • Page 94 “Install the Filter” on page Complete these tasks to finish the service procedure. See: “Returning a Server to Operation” on page 235 ■ “Verify a SAS Drive” on page 95 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 95: Verify A Sas Drive

    “Returning a Server to Operation” on page 235 ■ Verify a SAS Drive After you install a SAS drive, you can verify its functionality. Access Oracle ILOM. “Log In to Oracle ILOM (Service)” on page Check for the presence of the drive. -> show /SYS/DBP/HDDx/PRSNT /SYS/DBP/HDD0/PRSNT Targets:...
  • Page 96 Related Information “Install a SAS Drive” on page 92 ■ “SAS Drive Configuration” on page 86 ■ “SAS Drive LEDs” on page 86 ■ “Locate a Faulty Drive” on page 87 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 97: Servicing Nvme Storage Drives

    NVMe storage drives are supported only on servers that are running Oracle Solaris. Note - Servers that are running Oracle VM, Windows Server, or VMware ESXi do not support NVMe drives. Support for NVMe is on the motherboard. Overheating hazard. There must be no empty drive slots. Use fillers.
  • Page 98: Unmount An Nvme Drive

    Verify that the NVMe drive is unmounted. The state of the slot must be PRESENT. # hotplug list –lc Connection State Description Path ------------------------------------------------------------------ pcie13 PRESENT PCIe-Native /pci@7a,0/pci8086,2f08@3/pci111d,80b5@4 Remove the NVMe drive. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 99: Remove An Nvme Drive

    Remove an NVMe Drive “Remove an NVMe Drive” on page Related Information “Remove an NVMe Drive” on page 99 ■ “Verify Removal of an NVMe Drive” on page 100 ■ “Install an NVMe Drive” on page 100 ■ Remove an NVMe Drive After you unmount the NVMe drive, the steps to physically remove the dirve are the same as the steps to remove a SAS storage dirve.
  • Page 100: Verify Removal Of An Nvme Drive

    Note - installing a replacement drive. Follow safety and ESD precautions. “Prevent ESD Damage” on page Remove the new drive from its packaging, and place the drive on an antistatic mat. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 101: Power On An Nvme Drive And Attach A Device Driver

    Power On an NVMe Drive and Attach a Device Driver Consider your next step. If adding a drive to an empty slot, remove the drive filler. ■ If replacing a faulty NVMe drive, remove the drive. ■ “Remove an NVMe Drive” on page Align the new drive with the drive slot.
  • Page 102: Verify The Operation Of An Nvme Storage Drive

    “Verify Removal of an NVMe Drive” on page 100 ■ “Install an NVMe Drive” on page 100 ■ “Power On an NVMe Drive and Attach a Device Driver” on page 101 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 103: Servicing The Eusb Drive

    Servicing the eUSB Drive These procedures require that you handle components that are sensitive to static Caution - discharge. This sensitivity can cause the component to fail. To avoid damage, ensure that you follow antistatic practices to “Prevent ESD Damage” on page Ensure that all power is removed from the server before removing or installing an Caution - eUSB drive, or damage to the drive might occur.
  • Page 104: Locate An Eusb Drive

    In Oracle ILOM, verify that the eUSB drive is recognized and check the fault_state. ->show/SYS/MB/EUSB_DISK/ ./SYS/MB/EUSB_DISK ..Targets: ..Properties: ..type.=.Flash.Mini-Disk ..fault_state.=.OK ..clear_fault_action.=.none) ..Commands: ..cd ..set ..show -> Use the Oracle ILOM faultmgmt shell or the fmadm faulty command to identify a faulty component. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 105: Remove The Eusb Drive

    Remove the eUSB Drive “Identify Faulted Components” on page Check the Fault class and Description fields for more information. If an eUSB drive is faulty, replace it. “Remove the eUSB Drive” on page 105. If you are unable to determine if an eUSB drive is faulty, seek further information. “Detecting and Managing Faults”...
  • Page 106: Install The Eusb Drive

    “Install the eUSB Drive” on page 106 ■ Install the eUSB Drive Prevent ESD damage. “Preparing for Service” on page If replacing an eUSB drive, remove the faulty drive. “Remove the eUSB Drive” on page 105. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 107 Install the eUSB Drive Press the new eUSB drive into the socket on the motherboard. Tighten the screw to secure the drive to the motherboard. Return the server to operation. “Returning a Server to Operation” on page 235. Related Information “Remove the eUSB Drive”...
  • Page 108 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 109: Servicing The Usb Board

    Servicing the USB Board The USB board provides USB 2.0 connectivity at the front of the chassis. See “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page Description Links Replace the faulty USB board. “Detecting and Managing Faults” on page 25 “Remove the USB Board”...
  • Page 110 If you are removing the USB board as part of another component's removal ■ or installation procedure, go to Step Remove the two screws securing the USB board to the chassis. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 111 Remove the USB Board Slide the USB board rearward off of the alignment pin and allow the USB board to float freely. Do not disconnect the cable from the USB board. Note - Review this information and complete these prerequisites in this order. See: “Remove the Filter”...
  • Page 112 “Component Service Task Reference” on page Related Information “Install the USB Board” on page 113 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 113: Install The Usb Board

    Install the USB Board Install the USB Board Installing the USB board is a cold-service operation. You must power off the server before installing the USB board. Consider your first step. If you are replacing the USB board, remove the faulty or obsolete USB board ■...
  • Page 114 Position the USB board to the location where it installs into the chassis. The USB connectors are forward and upward. Lower the USB board to the chassis, and slide the board forward over the alignment pin. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 115 Install the USB Board Compress the EMI shielding while you install and tighten the two screws. Consider your next step. If you installed the USB board as part of a replacement operation, go to Step ■ If you installed the USB board as part of another component's removal or ■...
  • Page 116 Install the USB Board “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 117: Servicing The Drive Backplane

    Servicing the Drive Backplane The drive backplane provides an interconnect for the drives and their controllers. The drive backplane is located at the rear of the drive cage. See “Identifying Components” on page Description Links Replace a faulty drive backplane. “Drive Backplane Configuration”...
  • Page 118: Determine If The Drive Backplane Is Faulty

    You must determine if the drive backplane is faulty before you replace it. Check to see if any Server Service Required LEDs are lit or flashing. “Front Panel Components (Service)” on page In Oracle ILOM, check the health of the storage system. -> show /System/Storage /System/Power...
  • Page 119: Remove The Drive Backplane

    Remove the Drive Backplane Use the Oracle ILOM faultmgmt shell to identify the faulty component. “Identify Faulted Components” on page Check the Fault class and Description fields for more information. If the drive backplane is faulty, replace it. “Remove the Drive Backplane” on page 119.
  • Page 120 Remove the Drive Backplane Loosen the five screws from the drive backplane. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 121 Remove the Drive Backplane Lift the drive backplane off of the alignment pins and out of the server. Set the drive backplane aside. Consider your next step. If you are replacing the drive backplane, install a new drive backplane. ■ “Install the Drive Backplane”...
  • Page 122: Install The Drive Backplane

    Position the drive backplane to where it will install into the server. The drive backplane aligns with the drive connectors down. The two alignment holes are on the left, and the single alignment hole is on the right. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 123 Install the Drive Backplane Tighten the five screws. If you installed the drive backplane as part of another component's service procedure, return to that procedure. “Component Service Task Reference” on page Complete these tasks in this order. See: “Secure the Drive Cage” on page 241 ■...
  • Page 124: Verify The Drive Backplane

    Verify that the installed drives are recognized. -> show /SYS/DBP /SYS/DBP Targets: HDD0 HDD1 HDD2 -> Related Information “Determine if the Drive Backplane Is Faulty” on page 118 ■ “Detecting and Managing Faults” on page 25 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 125: Servicing The Dvd Drive

    Servicing the DVD Drive The internal DVD drive is a SATA optical-storage device with DVD DL-RW capabilities. The DVD drive is located below the disk drives, at the front center of the server. See “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page Description Links Replace the faulty DVD drive.
  • Page 126 “Rotate the Drive Cage to the Service Position” on page Remove the filter. “Remove the Filter” on page Disconnect the HDD backplane cables. Pull the plunger on the DVD component, then remove the DVD component. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 127 Remove the DVD Drive Continue to pull the tab, so that the DVD drive slides out of the server. Set the DVD drive aside. Consider your next step. If you are replacing a faulty drive, install the new DVD drive. See “Install the DVD ■...
  • Page 128: Install The Dvd Drive

    Align the DVD drive to the location where it installs into the server. The DVD drive is oriented with the tab at the right front. Slide the DVD drive into the server. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 129 Install the DVD Drive Press on the right side of the DVD drive to firmly seat it into the slot. Push the tab in under the DVD drive. If you installed the DVD drive as part of another component's removal or installation procedure, return to that procedure.
  • Page 130 Install the DVD Drive Related Information “Remove the DVD Drive” on page 125 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 131: Servicing Power Supplies

    Servicing Power Supplies The power supplies apply AC or DC facility power for use in the server chassis. The power supplies are configured for redundancy and are stacked at the rear left of the server. See “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page Typically servers are ordered and installed specifically for either AC or DC power-based Note - systems.
  • Page 132: Power Supply Leds

    You must determine which power supply is faulty before you replace it. Check to see if any System Service Required LEDs are lit or flashing. “Front Panel Components (Service)” on page Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 133 Locate a Faulty Power Supply Visually inspect the power supplies to see if any of their status LEDs are lit or flashing. “Power Supply LEDs” on page 132. In Oracle ILOM, check the health of the power system. -> show /System/Power /System/Power Targets: Properties:...
  • Page 134: Remove A Power Supply

    If a power supply is faulty, you will see /SYS/PSx under the Value heading, where x is 0 ■ (lower power supply) or 1 (upper power supply). Use the Oracle ILOM faultmgmt shell to identify the faulty component. “Identify Faulted Components” on page Check the Fault class and Description fields for more information.
  • Page 135 Remove a Power Supply Disconnect the power: For AC power supply, disconnect the power cord from the server's power supply. ■ For DC power supply, turn off the main power circuit breaker to the server's faulty power ■ supply unit. Do not proceed with these instructions until you are sure that there is no voltage Caution - present on the DC cords and their power source.
  • Page 136 “Component Service Task Reference” on page Related Information “Locate a Faulty Power Supply” on page 132 ■ “Install a Power Supply” on page 137 ■ “Preparing for Service” on page 43 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 137: Install A Power Supply

    Install a Power Supply “Returning a Server to Operation” on page 235 ■ Install a Power Supply Installing a power supply is a hot-swap operation. You do not need to power off the server before installing the power supply. If you are replacing a faulty power supply, remove the faulty component. “Remove a Power Supply”...
  • Page 138: Verify A Power Supply

    After you install a power supply, you can verify its functionality. Access Oracle ILOM. “Log In to Oracle ILOM (Service)” on page Reset the power supply. -> set /SYS/PSx clear_fault_action=true Are you sure you want to clear /SYS/PS0 (y/n)? y Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 139 Verify a Power Supply Set 'clear_fault_action' to 'true' -> where x is 0 (lower power supply) or 1 (upper power supply). Verify that the power supply is no longer considered faulty, then return to this procedure. “Locate a Faulty Power Supply” on page 132.
  • Page 140 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 141: Servicing The Pdb

    Servicing the PDB The PDB is an interconnect between the power supplies and the motherboard. The PDB is located forward of the power supplies, under the PSU duct. See “Identifying Components” on page Description Links Replace a faulty PDB. “Determine if the PDB Is Faulty” on page 141 “Remove the PDB”...
  • Page 142 ■ Reference” on page 47 to identify which component is faulty. Use the Oracle ILOM faultmgmt shell to identify the faulty component. “Identify Faulted Components” on page Check the Fault class and Description fields for more information. If the PDB is faulty, replace it.
  • Page 143: Remove The Pdb

    Remove the PDB Remove the PDB Removing the PDB is a cold-service operation. You must power off the server before you remove the PDB. Prepare for service. “Preparing for Service” on page Review this information and complete these prerequisites in this order. See: “Remove a Power Supply”...
  • Page 144 Remove the PDB Remove the four screws securing the PDB bus bars to the motherboard. Loosen the two captive screws securing the PDB to the server. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 145 Remove the PDB Grasp the two motherboard handles, and slide the motherboard forward off of the alignment pins. “Servicing the Motherboard” on page 225 for cautions. For this service procedure, you are not removing the motherboard. You are moving it slightly so that you can remove the PDB. Lift the PDB bus bars, and remove the PDB from the server.
  • Page 146: Install The Pdb

    Carefully insert the LED into the hole at the rear of the chassis. Place the bus bars into the channels, and align the PDB with two posts for the captive screws. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 147 Install the PDB Tighten the two captive screws. Install the four screws, securing the PDB bus bars to the motherboard. Servicing the PDB...
  • Page 148 “Install the Internal HBA PCIe Card” on page 183 ■ “Install a PCIe Card” on page 176 ■ “Install the Air Duct” on page 236 ■ “Install the PSU Duct” on page 240 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 149: Verify The Pdb

    Verify the PDB After you install the PDB, you can verify its functionality. Access Oracle ILOM. “Log In to Oracle ILOM (Service)” on page Reset the PDB. -> set /SYS/PDB clear_fault_action=true Are you sure you want to clear /SYS/PDB (y/n)? y Set 'clear_fault_action' to 'true' ->...
  • Page 150 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 151: Servicing Fan Modules

    Servicing Fan Modules These procedures require that you handle components that are sensitive to ESD, Caution - which can cause server components to fail. Fan modules are composed of redundant fan elements. This redundancy enables the fan module to continuously supply air flow, even if one fan element fails. The fan modules are located at the midsection of the server, behind the air duct.
  • Page 152: Locate A Faulty Fan Module

    “Component Service Task Reference” on page 47 to identify which component is faulty. Use the Oracle ILOM faultmgmt shell to identify the faulty component. “Identify Faulted Components” on page Check the Fault class and Description fields for more information. Within the Oracle ILOM interface, verify the fan module speeds.
  • Page 153: Remove A Fan Module

    Remove a Fan Module -> show /SYS/MB/FMx/Fy/TACH value /SYS/MB/FM0/F0/TACH Properties: value = 3100.000 RPM -> where: x is the fan module, 0 (left fan) to 4 (right fan). ■ y is the fan element, 0 (primary) or 1 (secondary). ■ If a fan module is faulty, write down which fan module is faulty, then replace it when the new one arrives.
  • Page 154 “Locate a Faulty Fan Module” on page 152 ■ “Install a Fan Module” on page 155 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 155: Install A Fan Module

    Install a Fan Module Install a Fan Module Installing a fan module is a cold-service operation. You must power off the server before installing the fan module. If not previously completed, perform the following: Prepare for service. “Preparing for Service” on page Power off the server that contains the fan module.
  • Page 156 “Remove a Fan Module” on page 153 ■ “Verify a Fan Module” on page 157 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 157: Verify A Fan Module

    Verify a Fan Module After you install a fan module, you can verify its functionality. Access Oracle ILOM. “Log In to Oracle ILOM (Service)” on page Reset the fan module. -> set /SYS/MB/FMx clear_fault_action=true Are you sure you want to clear /SYS/MB/FM0 (y/n)? y Set 'clear_fault_action' to 'true' ->...
  • Page 158 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 159: Servicing Dimms

    Servicing DIMMs The server supports a variety of DDR4 DIMM configurations that can include quad-rank (QR), dual-rank (DR), and single-rank (SR) DDR4 DIMMs. DIMMs provide RAM for the CPUs configured in the server. The DIMMs are located in slots on either side of the CPUs, at the center of the motherboard. See “Component Locations (Motherboard, Memory, and PCIe Cards)”...
  • Page 160: Understanding Dimm Layout And Population Rules

    DIMM Population Rules The DIMM configurations depend upon the CPU configuration. A single CPU can have a maximum of 8 DIMMS. A dual-CPU configuration can have a maximum of 16 DIMMS. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 161: Locate A Faulty Dimm

    Locate a Faulty DIMM When you add or remove DIMMs, follow these rules: The server supports 64-GB DDR4-2400 DIMMs, 32-GB DDR4-2400 DIMMs, and 16-GB ■ DDR4-2400 DIMMs. 4 DIMMs per CPU or 8 DIMMs per CPU. ■ Do not mix DIMM sizes. ■...
  • Page 162 DIMM fault LEDs Remove the faulty DIMM. “Remove a DIMM” on page 163. Related Information “Understanding DIMM Layout and Population Rules” on page 160 ■ “Install a DIMM” on page 163 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 163: Remove A Dimm

    Remove a DIMM Remove a DIMM To remove a DIMM, rotate both DIMM socket ejectors outward as far as they will go, then carefully lift the DIMM straight up to remove it from the socket. Replace each failed DIMM with either another DIMM of the same rank size (quad- rank, dual-rank, or single-rank) or leave the socket empty.
  • Page 164 Align the notch in the DIMM with the connector key in the connector socket. The notch ensures that the DIMM is oriented correctly. Push the DIMM into the connector until the ejector tabs lock the DIMM in place. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 165 (Optional) Use Oracle ILOM to clear server DDR4 DIMM faults. DDR4 DIMM faults are automatically cleared after a new DIMM has been installed. If you need to manually clear DDR4 DIMM faults, refer to the Oracle Integrated Lights Out Manager (ILOM) 3.2 Documentation Library at http://www.oracle.com/goto/ILOM/docs.
  • Page 166: Verify A Dimm

    Check if the host has been powered off. Allow approximately one minute before performing this step. Type the show /HOST command. When the host is powered off, the console displays status=Powered Off. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 167 Switch to the system console and type: # fmadm faulty If any faults are reported, refer to the diagnostics instructions described in “Detecting and Managing Faults” on page Switch to the Oracle ILOM command shell. Type: -> show faulty Target | Property...
  • Page 168 UUID, you are done with the verification process. Switch to the system console and type the fmadm repair command with the UUID. Use the same UUID that was displayed from the output of the Oracle ILOM show faulty command. For example, type:...
  • Page 169: Servicing Pcie Cards

    Servicing PCIe Cards PCIe cards provide additional I/O and other functionality. The PCIe cards install into the card slots located across the rear of the server. See “Component Locations (Motherboard, Memory, and PCIe Cards)” on page 16. Additionally, there is an internal HBA PCIe card. See “Servicing the Internal HBA PCIe Card”...
  • Page 170: Pcie Card Configurations

    EMI conformance for empty slots. Related Information “Remove a PCIe Card” on page 174 ■ “Install a PCIe Card” on page 176 ■ “Locate a Faulty PCIe Card” on page 172 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 171: I/O Root Complex Connections

    The pci@ values reported in the OpenBoot show-devs command output are paths in the I/O root complex topology. Single CPU I/O Root Complex Connections TABLE 1 Slot CPU IOS Slot Path Oracle ILOM Target /pci@300/pci@1/pci@0/pci@a /SYS/MB/PCIE1 /pci@300/pci@1/pci@0/pci@11 /SYS/MB/PCIE2 /pci@300/pci@1/pci@0/pci@12 /SYS/MB/PCIE3...
  • Page 172: Pcie Device Nac Names

    ■ Locate a Faulty PCIe Card You must determine which PCIe card is faulty before you replace it. Check to see if any Server Service Required LEDs are lit or flashing. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 173 ■ Reference” on page 47 to identify which component is faulty. Use the Oracle ILOM faultmgmt shell to identify the faulty component. “Identify Faulted Components” on page Check the Fault class and Description fields for more information. If a PCIe card is faulty, replace it.
  • Page 174: Remove A Pcie Card

    Determine which PCIe card to remove. “Locate a Faulty PCIe Card” on page 172. Prepare for service. “Preparing for Service” on page Remove the server to obtain access to internal components. “Accessing Internal Components” on page Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 175 Remove a PCIe Card Swing the retainer to its fully open position, and lift the PCIe card or filler out of the socket. Set the PCIe card or filler aside. Repeat from Step 4 for any additional PCIe cards or fillers to be removed. Consider your next step.
  • Page 176: Install A Pcie Card

    If not already done, prepare for service. “Preparing for Service” on page Position the PCIe card at the slot where it will be installed. Press the PCIe card into the socket. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 177: Verify A Pcie Card

    Verify a PCIe Card After you install a PCIe card, you can verify its functionality. Access Oracle ILOM. “Log In to Oracle ILOM (Service)” on page Reset the PCIe card. -> set /SYS/MB/PCIEy clear_fault_action=true Are you sure you want to clear /SYS/MB/PCIE1 (y/n)? y...
  • Page 178: Netra Sparc S7-2 Server Service Manual • February

    “Locate a Faulty PCIe Card” on page 172. Related Information “Install a PCIe Card” on page 176 ■ “PCIe Card Configurations” on page 170 ■ “Locate a Faulty PCIe Card” on page 172 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 179: Servicing The Internal Hba Pcie Card

    Servicing the Internal HBA PCIe Card The internal HBA PCIe card shows as slot 7 in most firmware, software, and device tree nomenclature. These topics assist you when servicing the internal HBA card. Description Links Replace a faulty HBA card. “Detecting and Managing Faults”...
  • Page 180 Remove the Internal HBA PCIe Card “Preparing for Service” on page Locate the internal HBA card. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 181 Remove the Internal HBA PCIe Card Using a No. 1 flat-head screwdriver, remove the bracket screw, taking care not to strip it, then carefully lift the card out of its slot. Servicing the Internal HBA PCIe Card...
  • Page 182 Disconnect the SAS cables from the card, then place the card on an antistatic mat. If you are replacing the card, use a No. 2 Philips screwdriver to remove the special fitted bracket from the faulty card. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 183: Install The Internal Hba Pcie Card

    Install the Internal HBA PCIe Card You must install the special fitted bracket on the replacement card. Set aside the bracket until you are ready to install the replacement card. Related Information “Identifying Components” on page 13 ■ “Preparing for Service” on page 43 ■...
  • Page 184 Using a No. 2 Philips screwdriver, remove the standard HBA PCIe bracket that shipped with the replacement card. Install the special fitted bracket that was removed in “Remove the Internal HBA PCIe Card” on page 179. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 185 Install the Internal HBA PCIe Card Take care not to overtighten the screws, which could stip or cause the card to crack. Caution - Connect the SAS cables to the HBA card. Servicing the Internal HBA PCIe Card...
  • Page 186 Install the Internal HBA PCIe Card Cables have designations for top and bottom orientation. Tip - Insert the card connector into the bottom connector. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 187: Verify The Internal Hba Pcie Card

    ■ Verify the Internal HBA PCIe Card After you install the internal HBA PCIe card, you can verify its functionality. Access Oracle ILOM. “Log In to Oracle ILOM (Service)” on page Reset the card. Servicing the Internal HBA PCIe Card...
  • Page 188 “Remove the Internal HBA PCIe Card” on page 179 ■ “Install the Internal HBA PCIe Card” on page 183 ■ “PCIe Card Configurations” on page 170 ■ “Locate a Faulty PCIe Card” on page 172 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 189: Servicing The Battery

    “Returning a Server to Operation” on page 235 ■ Remove the Battery Removing the battery is a cold-service operation. You must power off the server before you remove the battery. Back up the Oracle ILOM variables. http://docs.oracle.com/cd/E19860-01/E21549/z40015841018582.html#scrolltoc Servicing the Battery...
  • Page 190 “Component Service Task Reference” on page 47 for assistance. Related Information “Install the Battery” on page 191 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 191: Install The Battery

    Finish the installation procedure. “Returning a Server to Operation” on page 235. Set the date and time on SP and Host OS. Restore the Oracle ILOM variables. http://docs.oracle.com/cd/E19860-01/E21549/z40015841018582.html#scrolltoc Related Information “Remove the Battery” on page 189 ■ “Preparing for Service” on page 43 ■...
  • Page 192 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 193: Servicing The Cables

    Servicing the Cables The cables deliver power to and conduct signals between hardware components. The cables are routed throughout the server. See “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page The system supplies power to the cables even when the server is powered off. Caution - To avoid personal injury or damage to the server, you must disconnect power cords before servicing the cables.
  • Page 194: Cable Configurations

    This illustration identifies cables routed throughout the server interior. Description Links PDB signal cable “Servicing the PDB Signal Cable” on page 203 USB cable “Servicing the eUSB Drive” on page 103 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 195: Servicing The Sas Drive Signal Cable

    Servicing the SAS Drive Signal Cable Description Links Drive power cable “Servicing the Drive Power Cable” on page 199 SAS drive signal cable (SAS 0-3) “Servicing the SAS Drive Signal Cable” on page 195 “Servicing HBA SAS Cables” on page 211 Drive backplane data cable “Servicing the Drive Backplane”...
  • Page 196: Remove The Sas Drive Signal Cable

    If you are replacing a cable, install the new cable. ■ “Install the SAS Drive Signal Cable” on page 197. If you removed a cable as part of another component's removal or ■ installation procedure, return to that procedure. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 197: Install The Sas Drive Signal Cable

    Install the SAS Drive Signal Cable “Component Service Task Reference” on page Related Information “Install the SAS Drive Signal Cable” on page 197 ■ “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page 14 ■ “Component Locations (Motherboard, Memory, and PCIe Cards)” on page 16 ■...
  • Page 198 Ensure that the cable pass through is seated all the way towards the HBA card. Make sure that the cable pass through remains seated on all four corners. Connect the cable to the HBA card in slot 7. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 199: Servicing The Drive Power Cable

    Servicing the Drive Power Cable Route the cable to the SAS drive signal cable connector on the drive backplane. Install the air duct. “Install the Air Duct” on page 236. Install the fan tray and all fan modules. “Install the Fan Tray” on page 244.
  • Page 200: Remove The Drive Power Cable

    “Remove the Fan Tray” on page 69 ■ Disconnect the drive power cable from the drive backplane. “Cable Configurations” on page 194. Release the cable from the cable clamp. If applicable, disconnect the cable from the motherboard. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 201 Remove the Drive Power Cable If you have not already removed the fan modules and tray, you will need to before disconnecting the cable from the motherboard. See Step Set the cable aside. Consider your next step. If you are replacing a cable, install the new cable. ■...
  • Page 202: Install The Drive Power Cable

    If you removed the fan modules and tray, complete these prerequisites in this order. See: “Install the Fan Tray” on page 244 ■ “Install a Fan Module” on page 155 ■ Install all fan modules. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 203: Servicing The Pdb Signal Cable

    Servicing the PDB Signal Cable Connect the drive power cable to the drive backplane. “Cable Configurations” on page 194. If you installed a cable as part of another component's removal or installation procedure, return to that procedure. “Component Service Task Reference” on page Finish the installation procedure.
  • Page 204: Remove The Pdb Signal Cable

    “Remove the Fan Tray” on page 69 ■ “Rotate the Drive Cage to the Service Position” on page ■ “Remove the Air Duct” on page 75 ■ “Remove the PSU Duct” on page 74 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 205 Remove the PDB Signal Cable Disconnect the cable from the PDB and the motherboard. Set the cable aside. Consider your next step. If you are replacing a cable, install the new cable. ■ “Install the PDB Signal Cable” on page 206.
  • Page 206: Install The Pdb Signal Cable

    If you installed a cable as part of another component's removal or installation procedure, return to that procedure. “Component Service Task Reference” on page 47 for assistance. Finish the installation procedure. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 207: Servicing The Nvme Cables

    Install a cable as part of another component's “Install NVMe Cables” on page 209 service operation. Related Information Oracle 1.6TB NVMe SSD Documentation Library ■ “Identifying Components” on page 13 ■ “Detecting and Managing Faults” on page 25 ■...
  • Page 208: Remove Nvme Cables

    Press each latch, then pull out to disengage the cable from each connector. Remove the SAS cables from the backplane. “Remove the SAS Drive Signal Cable” on page 196 “Remove HBA SAS Cables” on page 211. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 209: Install Nvme Cables

    Carefully remove the NVMe cable bundle from the server. Be careful not to snag the cables on the server components. Related Information Oracle 1.6TB NVMe SSD Documentation Library ■ “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page 14 ■...
  • Page 210 “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page 14 ■ “Component Locations (Motherboard, Memory, and PCIe Cards)” on page 16 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 211: Servicing Hba Sas Cables

    Servicing HBA SAS Cables Servicing HBA SAS Cables These topics describe how to remove and install the HBA SAS cables. Description Links Replace a faulty cable. “Detecting and Managing Faults” on page 25 “Remove HBA SAS Cables” on page 211 “Install HBA SAS Cables”...
  • Page 212 ■ “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page 14 ■ “Component Locations (Motherboard, Memory, and PCIe Cards)” on page 16 ■ “Preparing for Service” on page 43 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 213: Install Hba Sas Cables

    Install HBA SAS Cables “Returning a Server to Operation” on page 235 ■ Install HBA SAS Cables Replacing the cable assembly is a cold-service procedure that must be performed by qualified service personnel. The server must be completely powered down before performing this procedure.
  • Page 214 “Remove HBA SAS Cables” on page 211 ■ “Component Locations (Storage, Power, NVMe, and Fan Modules)” on page 14 ■ “Component Locations (Motherboard, Memory, and PCIe Cards)” on page 16 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 215 Install HBA SAS Cables “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Servicing the Cables...
  • Page 216 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 217: Servicing The Led Board

    Servicing the LED Board The LED board is the heart of the LED assembly. The board provides LED status indicators of the server and other components. The LED board is located inside the LED assembly at the left front of the server. See “Component Locations (Storage, Power, NVMe, and Fan Modules)”...
  • Page 218: Remove The Led Board And Cable

    “Remove the Filter” on page 79 ■ “Rotate the Drive Cage to the Service Position” on page 71 ■ “Remove the PSU Duct” on page 74 ■ “Remove the Air Duct” on page 75 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 219 Remove the LED Board and Cable Disconnect the LED cable from the LED assembly. Remove the two screws securing the LED assembly to the server (requires a small Phillips screwdriver). Servicing the LED Board...
  • Page 220 “Determine if the LED Board Is Faulty” on page 217 ■ “Install the LED Board and Cable” on page 221 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 221: Install The Led Board And Cable

    Install the LED Board and Cable Install the LED Board and Cable Installing the LED board is a cold-service operation. You must power off the server before installing the LED board. Connect the LED cable to the LED assembly. Set the LED board into the LED assembly. Install and tighten the two screws.
  • Page 222 Position the LED assembly over the flange, on the left of the server. Install and tighten the two screws. Route the cable into the cable clamp and against the server wall. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 223 Install the LED Board and Cable Connect the LED cable to the LED assembly. If you installed the LED board as part of another component's removal or installation procedure, return to that procedure. “Component Service Task Reference” on page 47 for assistance.
  • Page 224: Verify The Led Board

    “Install the LED Board and Cable” on page 221 ■ “Determine if the LED Board Is Faulty” on page 217 ■ “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 225: Servicing The Motherboard

    The motherboard is located on a tray at the bottom of the server. See “Component Locations (Motherboard, Memory, and PCIe Cards)” on page The motherboard should be serviced only by an Oracle qualified service technician. Caution - Ensure that all power is removed from the server before removing or installing the Caution - motherboard.
  • Page 226: Determine If The Motherboard Is Faulty

    You must determine if the motherboard is faulty before you replace it. Check to see if any Server Service Required LEDs are lit or flashing. “Front Panel Components (Service)” on page In Oracle ILOM, check the health of the system processors. -> show /System/Processors /System/Processors...
  • Page 227 “Component Service Task Reference” on page 47 to identify which component is faulty. Use the Oracle ILOM faultmgmt shell to identify a faulty component. “Identify Faulted Components” on page Check the Fault class and Description fields for more information. If the motherboard is faulty, replace it.
  • Page 228: Remove The Motherboard

    “Remove the PSU Duct” on page 74 ■ “Remove the Air Duct” on page 75 ■ “Remove the PDB” on page 143 ■ “Remove a PCIe Card” on page 174 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 229 Remove the Motherboard Disconnect all remaining cables from the motherboard, and move them out of the way. Remove the right thumb screw bracket. Remove the four bus bar screws. Fully loosen the two captive screws at the front of the motherboard. As you are removing the motherboard, take extra care not to flex or dislodge the Caution - DIMMs.
  • Page 230 If you removed the motherboard as part of another component's service ■ procedure, return to that procedure. “Component Service Task Reference” on page Related Information “Install the Motherboard” on page 231 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 231: Install The Motherboard

    Install the Motherboard “Preparing for Service” on page 43 ■ “Returning a Server to Operation” on page 235 ■ Install the Motherboard Installing the motherboard is a cold-service operation. You must power off the server before installing the motherboard. Position the motherboard for installation into the server. The heatsinks are toward the front of the server, and the ports are at the rear.
  • Page 232 Tighten the captive screw. Install and tighten the four bus bar screws. Install the right thumb screw bracket. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 233 Complete these postrequisites in this order to finish the installation procedure. See: “Returning a Server to Operation” on page 235 ■ “Verify the Motherboard” on page 234 ■ Restore the Oracle ILOM variables. http://docs.oracle.com/cd/E19860-01/E21549/z40015841018582.html#scrolltoc Set the date and time. Related Information “Verify the Motherboard” on page 234 ■...
  • Page 234: Verify The Motherboard

    -> show /SYS/VPS value /SYS/VPS Properties: value = 159.175 Watts -> Related Information “Determine if the Motherboard Is Faulty” on page 226 ■ “Returning a Server to Operation” on page 235 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 235: Returning A Server To Operation

    Returning a Server to Operation These topics explain how to return a Netra SPARC S7-2 server from Oracle to operation after you perform service procedures. Step Task Link Install the air duct if you serviced these components: “Install the Air Duct” on page 236 ■...
  • Page 236: Install The Air Duct

    Move any loose cables to the gap between the DIMMs and the server walls. Ensure that all cables clear the air duct and other components. The space around the Note - NVMe cables is especially tight. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 237 Install the Air Duct Align the air duct to where it installs into the server. Lower the air duct onto the alignment pins. Route the cables through the cable ties on the air duct and cutouts in the air duct. Attach the cables to the air duct.
  • Page 238 Install the Air Duct Set the left (L) thumbscrew bracket over the alignment pins, and slide it backward. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 239 Install the Air Duct Tighten the thumbscrew. Install the PSU duct. “Install the PSU Duct” on page 240. Consider your next step. If you installed the air and PSU ducts as part of another component's service ■ procedure, return to that procedure. “Component Service Task Reference”...
  • Page 240: Install The Psu Duct

    Route the USB cable over the PSU duct to the USB board. Route the USB cable through the cutout in the air duct, and push the cable into the channel in the PSU duct. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 241: Secure The Drive Cage

    Secure the Drive Cage If you installed the PSU duct as part of another component's service procedure, return to that procedure. “Component Service Task Reference” on page 47 for assistance. Related Information “Remove the PSU Duct” on page 74 ■ “Install the Air Duct”...
  • Page 242 Secure the Drive Cage Do not damage the cables as you are closing the drive cage. Caution - Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 243 Secure the Drive Cage Tighten the four screws securing the drive cage to the server. Connect the cables to the drive backplane, and connect the cable attached to the USB board. These cables (2, 3, 4, and 6) are visible in “Cable Configurations”...
  • Page 244: Install The Fan Tray

    If necessary, rotate the tray 180 degrees to align. Slowly lower the fan tray into the server. Verify that the fan tray is properly seated, and the top surfaces of the fan tray are flush with the server. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 245 Install the Fan Tray Close the two fan tray locks. Install the fan modules. “Install a Fan Module” on page 155. Consider your next step. If you installed the fan tray as part of another component's service ■ procedure, return to that procedure. “Component Service Task Reference”...
  • Page 246: Install The Top Cover

    “Install the PSU Duct” on page 240 ■ “Secure the Drive Cage” on page 241 ■ “Install the Fan Tray” on page 244 ■ “Install a Fan Module” on page 155 ■ Install all fan modules. Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 247 Install the Top Cover Position the top cover on the server, with the front edge of the top cover 0.5 in. (13 mm) rearward of the front edge of the server. Slide the top cover forward into place. Returning a Server to Operation...
  • Page 248 “Connect AC Power Cords” on page 249. Related Information “Install the Fan Tray” on page 244 ■ “Remove the Top Cover” on page 67 ■ “Connect AC Power Cords” on page 249 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 249: Connect Ac Power Cords

    Power on the server. See one of these topics: “Power On the Server (Oracle ILOM)” on page 249 ■ “Power On the Server (Power Button)” on page 250 ■...
  • Page 250: Power On The Server (Power Button)

    “Power Off the Server (Power Button - Graceful)” on page 51 ■ “Power Off the Server (Emergency Shutdown)” on page 52 ■ “Front Panel Components (Service)” on page 17 ■ “Power On the Server (Oracle ILOM)” on page 249 ■ Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 251: Index

    Index installing HBA SAS cables, 213 installing NVMe, 209 accessing, installing SAS drive signal, 197 internal components, 55 locations, 14 adding NVMe, 207 DVD drive, 128 removing drive power, 200 fan modules, 155 removing HBA SAS, 211 filters, 82 removing NVMe, 208 PCIe cards, 176 removing SAS drive signal, 196 power supplies, 137...
  • Page 252: Netra Sparc S7-2 Server Service Manual • February

    Fan Module Fault LED, 31 verifying, 124 fan modules drive cage adding, 155 location, 16 installing, 155 raising, 71 locating faulty, 152 securing, 241 locations, 14 drive power cable, removing, 153 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 253 Index resetting, 157 servicing, 151 graceful shutdown, 50, 51 verifying, 157 fan tray installing, 244 removing, 69 HBA card fault message ID, 27 installing, 183 Fault Remind button removing, 179 location, 41 resetting, 187 operation, 41 servicing, 179 faults verifying, 187 checking for, 25, 27 HBA SAS cables detecting, 25...
  • Page 254 Locator LED Overtemperature LED, 33 front panel, 31 location, 48 rear panel, 33 log files PCIe viewing (Oracle ILOM), 36 card locations, 16 viewing (Oracle Solaris), 35 HBA card location, 16 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 255 Index PCIe card power-on self-test, see POST, 37 adding, 176 powering off a server configuration, 170 emergency shutdown, 52 installing, 176 Power button, 51 locating faulty, 172 preparing, 50 removing, 174 SP, 50 resetting, 177 powering on servicing, 169 server Power button, 250 verifying, 177 server SP, 249 PCIe cards...
  • Page 256 85 SP, powering on, 249 status LEDs, 86 start /SYS command, 249 schematic diagram, 21 stop /SYS command, 50 securing drive cage, 241 symbols in documentation, 44 server locating, 48 Netra SPARC S7-2 Server Service Manual • February 2017...
  • Page 257 124 fan modules, 157 HBA card, 187 LED board, 224 motherboard, 234 PCIe cards, 177 PDB, 149 power supplies, 138 SAS drives, 95 viewing message log files Oracle ILOM, 36 Oracle Solaris, 35 weight of server, 56, 63...
  • Page 258 Netra SPARC S7-2 Server Service Manual • February 2017...

Table of Contents