Page 1 Sun Server X4-8 Service Manual Part No: E40317-07 December 2015...
Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...
Page 5: Table Of Contents
Contents Using This Documentation ................ 11 About This Document .................. 15 Major Sections .................... 15 Service Notes .................... 17 Intended Audience .................. 17 Warning Label .................... 17 Server and Components Overview .............. 19 Server Overview ................... 19 Chassis Overview .................. 20 Chassis Front Components .............. 20 Chassis Internal Components .............. 21 Chassis Rear Components ............... 23 CPU Module (CMOD) Overview ..............
Page 6 Contents Internal USB Ports ................ 33 Server Subsystems .................. 34 System Management Subsystem ............... 34 Storage and IO Subsystem .............. 45 Chassis Cooling Subsystem .............. 47 Power Subsystem .................. 50 Server Block Diagram .................. 50 Troubleshooting and Diagnostics .............. 53 Troubleshooting Server Component Hardware Faults ........... 53 Troubleshooting Server Hardware Faults ........... 54 Troubleshooting and Diagnostic Information ..........
Page 7 Power Modes, Shutdowns, and Resets ............. 107 Managing the Locator Indicator .............. 109 ▼ Turn On the Locator Indicator Remotely (Oracle ILOM CLI) .... 109 ▼ Turn On the Locator Indicator Remotely (Oracle ILOM Web Interface) .. 110 ▼ Control the Locator Indicator Locally .......... 111 Servicing Components .................. 113 Servicing Fan Modules and Fan Frames ............
Page 8 Contents ▼ Replace a Failed DIMM .............. 142 ▼ Install a DIMM ................ 148 ▼ Remove a DIMM ................ 151 Memory and DIMM Reference .............. 154 ▼ Remove a Heatsink and Processor (FRU) .......... 157 ▼ Install a Heatsink and Processor (FRU) .......... 168 Servicing Storage Drives ................ 176 ▼...
Page 9 Contents Memory Configuration ................. 247 Advanced - USB Ports ................. 248 Advanced - Serial Port Console Redirection .......... 249 Advanced - Trusted Computing .............. 253 Advanced - Network Stack .............. 255 Advanced - Legacy iSCSI .............. 256 Advanced - BMC Network Configuration .......... 257 IO Screen ................... 260 Boot Screen ..................
Page 10 Sun Server X4-8 Service Manual • December 2015...
Page 11: Using This Documentation
(blade), and blade chassis are updated periodically. You can obtain the latest version in the following ways: Oracle System Assistant – This is a new factory-installed option for Sun Oracle x86 servers. ■ It has all the tools and drivers you need and resides on a USB drive installed in most servers.
Page 12: Documentation And Feedback
Link All Oracle products https://docs.oracle.com Sun Server X4-8 http://www.oracle.com/goto/X4-8/docs Oracle Integrated Lights Out Manager (ILOM). Refer to http://www.oracle.com/goto/ILOM/docs the documentation for your supported version of Oracle ILOM as listed in the Product Notes. Oracle Hardware Management Pack. Refer to the http://www.oracle.com/goto/ohmp/docs...
Page 13 Change History September 2014. Added warm service for CMOD components, updates for Linux Fault ■ Management Architecture (FMA), and added issues to Product Notes. February 2015. Technical corrections and editorial improvements. ■ December 2015: Technical updates. ■ Using This Documentation...
Page 14 Sun Server X4-8 Service Manual • December 2015...
Page 15: About This Document
About This Document This document contains service, maintenance, and component replacement procedures and information for the Oracle Sun Server X4-8. ® Major Sections The following table describes the major sections of this document. Section Description Link Important service information “Service Notes” on page 17 Server component and subsystem overviews “Server and Components Overview”...
Page 16 Sun Server X4-8 Service Manual • December 2015...
Page 17: Service Notes
Service Notes This section contains preliminary service information: Intended Audience This guide is intended for trained technicians and authorized service personnel who have been instructed on the hazards within the equipment and qualified to replace and install hardware. Warning Label The following warning label is visible from the front of the server when you remove a fan module.
Page 18 Sun Server X4-8 Service Manual • December 2015...
Page 19: Server And Components Overview
Server and Components Overview The following sections describe the server and its subsystems. Section Description Link List of server features “Server Overview” on page 19 Chassis front, internal, and back components “Chassis Overview” on page 20 Features and components of the CMOD “CPU Module (CMOD) Overview”...
Page 20: Chassis Overview
Chassis Overview Eight rear accessible storage drive (SAS2, SATA) bays. ■ Expandable IO: eight 16-lane and eight 8-lane PCIe Gen3 slots and one 4 lane PCIe Gen 2 ■ HBA slot. One Pilot 3 service processor (SP) with 256 MB DDR3 memory and 256 MB of flash ■...
Page 21: Chassis Internal Components
Chassis Overview For more information about the FMs and the chassis cooling subsystem, see “Chassis Cooling Subsystem” on page Two CPU module (CMOD) bays ■ CMODs are accessible from the front of the server, after removing the FMs and the fan frames.
Page 22 Chassis Overview Two CMOD bays that house four CMODs each. Removal and installation of the CMODs ■ requires warm or cold service. For information about the CMODs, see “CPU Module (CMOD) Overview” on page The mid-plane assembly, which provides an interconnect between the rear components and ■...
Page 23: Chassis Rear Components
Chassis Overview Chassis Rear Components The rear of the chassis contains: System Module (SMOD) ■ The SMOD is removable and has internal components that are not directly accessible from the rear of the server. For more information, see “System Module (SMOD)” on page Dual PCIe card carrier (DPCC) bay ■...
Page 24: Cpu Module (Cmod) Overview
CPU Module (CMOD) Overview CPU Module (CMOD) Overview CPU modules (CMODs) contain the processors (CPUs) and the system memory, and supply power to the fan modules and the DPCCs. CMODs are internal warm or cold-service components. To access the CMODs, you must remove the fan modules and the fan frames.
Page 25 CPU Module (CMOD) Overview The following illustration shows a server with a four-CMOD configuration and all eight fan modules and both fan frames removed, exposing the empty CMOD bay on the right. The four right-side fan modules are not powered; however, in a four-CMOD configuration, these fan modules must be installed.
Page 26 CPU Module (CMOD) Overview The following illustration shows a server with an eight (full) CMOD configuration. Call out 1 identifies the group of four CMODs installed on the left side of the server, and call out 2 identifies the second group of four CMODs installed on the right side of the server. Sun Server X4-8 Service Manual •...
Page 27: Cmod Population Rules
CPU Module (CMOD) Overview In both CMOD configurations, the system includes four power supplies, eight fan modules, and eight DPCCs. However, fan modules and DPCCs receive power from the CMODs, so in a four- CPU configuration, where CMODs are installed in slots 0-3, only fan modules 0-3 and DPCCs 0-3 are active.
Page 28: Cmod Layout
CPU Module (CMOD) Overview CMOD Layout Each CMOD contains the following components: Heatsink and processor assembly ■ 24 DIMM slots arranged in four groups of six ■ DIMM test circuit, which helps you locate failed DIMMs and verify a failed CPU ■...
Page 29: Cmod And Fan Module Power
System Module (SMOD) Call Out Description DIMM slots (24, four banks of six each) DIMM slot fault indicators (24, one for each slot) Heatsink and CPU assembly CPU fault indicator For component serviceability, locations, and designations, see “Component Serviceability, Locations, and Designations” on page CMOD and Fan Module Power Fan modules (FMs) get power from CMODs.
Page 30: Smod Overview
System Module (SMOD) SMOD Overview The SMOD contains: Externally-accessible: ■ Server storage drives (HDD/SSD) ■ IO ports and two external USB ports ■ Interally accessible: ■ Internal host bus adapter (HBA) card ■ SMOD motherboard ■ Two internal USB ports ■...
Page 31: Storage Drives
System Module (SMOD) Call Out Description Removal and installation levers (2) SMOD Storage Drives In the following illustration, call out 1 shows the location of the eight storage drive slots, which are on the SMOD and arranged in two rows of four each. For component serviceability, locations, and designations, see “Component Serviceability, Locations, and Designations”...
Page 32: Service Processor (Sp)
The system Pilot 3 service processor (SP) is located on the SMOD motherboard and is accessible locally and remotely through management ports on the front of the SMOD. The SP contains a version of Oracle ILOM, an embedded server management tool that can be updated using Oracle System Assistant. The SP is not removable.
Page 33: Internal Usb Ports
PCIe card riser slot. The ports are designated as P0 and P1. Unless you have opted out, port P0 has a factory-installed flash drive that contains Oracle System Assistant, a boot-capable server set-up, provisioning, and update tool. Port P0 can...
Page 34: Server Subsystems
Server Subsystems only be used to support Oracle System Assistant. It cannot be used to boot an OS or store files unrelated to Oracle System Assistant. Server Subsystems This section contains overviews of the server subsystems: “System Management Subsystem” on page 34 ■...
Page 35 Server Subsystems Locator indicator and button ■ When activated remotely, it helps you find the server in a rack or room of servers. For more information about managing the Locator indicator remotely and locally, see “Managing the Locator Indicator” on page 109.
Page 36: Cmod Service Action Required Indicators
Server Subsystems Call Out Description Locator indicator and button Service Action Required indicator Power OK indicator Power on and off button SP OK indicator Server over-temperature indicator Back Service Action Required indicator Row of CMOD fault indicators (0-7) CMOD Service Action Required Indicators The fault indicators for the CMODs are located on the front indicator module (FIM).
Page 37: Power Supply Unit (Psu) Indicators
Server Subsystems Power Supply Unit (PSU) Indicators Each power supply unit (PSU) has three indicators arranged in a single row and from left to right as follows: An amber Service Action Required indicator ■ This indicator lights steady on when the power supply is in a fault state. A green OK indicator ■...
Page 38: Fan Module (Fm) Indicators
Server Subsystems Call Out Description Service Action Required indicator (amber) Status OK indicator (green) AC OK indicator (green) Release lever Fan Module (FM) Indicators Each fan module (FM) has two indicators arranged in a single row and from left to right as follows: An amber Service Action Required indicator ■...
Page 39 Server Subsystems Call Out Description Service Action Required indicator (amber) Status OK indicator (green) Release button Storage Drive Unit Indicators Storage drives are installed in carriers. Each storage drive carrier has three indicators arranged in a single stacked row and from bottom to top as follows: A green OK/Status indicator ■...
Page 40: Back Indicator Panel
Server Subsystems The following illustration shows the front of the storage drive carrier and the storage drive indicators. Call Out Description OK indicator (green) Service Action Required indicator (amber) Ready to Remove indicator (blue) Back Indicator Panel The server has an indicator panel that allows you to manage the server and ascertain its state while servicing it from its back side.
Page 41 Server Subsystems Call Description Details Non-Maskable Interrupt Service personnel only. Do not press. (NMI) switch Host reset switch (recessed) This switch allows you to shut down the host. ■ For graceful shutdown, press and release. ■ For immediate shutdown, press and hold for at least five seconds. This button requires a stylus.
Page 42 Server Subsystems Call Description Details HBA Service Action Lights when the HBA requires service. Required indicator Dual PCIe Card Carrier (DPCC) Indicators Each DPCC has two indicator panels, one for each PCIe slot inside the server. Each panels contains a green OK indicator, an amber Service Action Required indicator, and a recessed pinhole switch.
Page 43: Switches And Buttons
Server Subsystems AC Power Inlet Indicators Each power inlet on the AC power block at the back of the server has an indicator panel. The panel has a single green OK indicator that turns on steady only when the power at the connector is sufficient for the power supply unit.
Page 44: Service Processor (Sp) Oracle Ilom
The server System Module (SMOD) contains a Pilot 3 service processor (SP) that runs Oracle ILOM. Oracle ILOM allows you to manage and monitor the server locally or remotely in full power or standby power modes. Local and remote interface and control connections to the SP are on the back of the server and include a RJ45 GigabitEthernet port (remote access) and an RJ45 serial connector and DB15 VGA connector (local access).
Page 45: Storage And Io Subsystem
OS installation and allows you to easily manage server updates. As an option, Oracle System Assistant is delivered on a USB storage drive that is factory-installed in the internal USB slot, P0. The drive is configured at the factory with a server-specific version of Oracle System Assistant.
Page 46 Server Subsystems 1 VGA DB-15 port ■ 2 USB 2.0 ports ■ 2 RJ45 Host GigabitEthernet ports ■ 1 RJ45 10/100/1000 Ethernet service processor (SP) port ■ 1 RJ45 RS-232 serial console port ■ 4 AC power inlets ■ Call Out Description Video DB-15 USB 2.0 port...
Page 47: Chassis Cooling Subsystem
Server Subsystems Dual PCIe Card Carrier (DPCC) In the following illustration, call out 1 shows the location of the dual PCIe card carriers (DPCCs). The eight DPCCs are directly accessible from the back of the server and are located below the SMOD. For component serviceability, locations, and designations, see “Component Serviceability, ■...
Page 48 Server Subsystems All CMOD processors have a heat sink. ■ Each drive bay contains a storage device or a drive slot filler. ■ Every DPCC is installed (regardless of whether it contains a card or not). ■ Both fan frames are populated with fan modules. ■...
Page 49 Server Subsystems Call Out Description Zone 0: Power supplies Cooling provided by power supply fans Zone 1: CMODS 0 and 1 Cooling provided by FMs 0 and 1 Zone 2: CMODs 2 and 3 Cooling provided by FMs 2 and 3 Zone 3: CMODs 4 and 5 Cooling provided by FMs 4 and 5 Zone 4: CMODs 6 and 7...
Page 50: Power Subsystem
Once the SP boots into standby power mode, full power mode is initiated by pressing and releasing the chassis front-panel Power button or by powering on the server remotely from Oracle ILOM. For more information about power modes, see “Power Modes, Shutdowns, and Resets”...
Page 51 Server Block Diagram Server and Components Overview...
Page 52 Sun Server X4-8 Service Manual • December 2015...
Page 53: Troubleshooting And Diagnostics
Information about attaching devices to the “Attaching Devices to the Server” on page 73 server to perform troubleshooting. Information about contacting Oracle support. “Getting Help” on page 75 Troubleshooting Server Component Hardware Faults This section contains maintenance-related information and procedures that you can use to troubleshoot and repair server hardware issues.
Page 54: Troubleshooting Server Hardware Faults
3. Prepare the server for service using Oracle ILOM. If you have determined that the hardware fault requires service (physical access to the server), use Oracle ILOM to power off the server, activate the Locate LED, and take the server offline.
Page 55 Note - Contact Oracle Service. 6. Clear the fault in Oracle ILOM. Depending on the component, you might need to clear the fault in Oracle ILOM. Generally, components that have a FRU ID clear the fault automatically. Related Information: “Troubleshoot Hardware Faults” on page 55 ■...
Page 56 Troubleshoot Hardware Faults Processors ■ Memory ■ Power ■ Cooling ■ Storage ■ Networking ■ I/O Modules ■ In the Status section of the summary screen, identify the server subsystem that requires service. In the above example, the Status screen shows that the Memory subsystem requires service. This indicates that a hardware component within the subsystem is in a fault state.
Page 57 Troubleshoot Hardware Faults The subsystem screen appears. The above example shows the Memory subsystem screen and indicates that DIMM 8 on CPU 0 has an uncorrectable ECC fault. To get more information, click one of the Open Problems links. The Open Problems screen provides detailed information, such as the time the event occurred, the component and subsystem name, and a description of the issue.
Page 58: Troubleshooting And Diagnostic Information
Troubleshoot Hardware Faults After servicing the component, you might need to clear the fault in Oracle ILOM. Refer Note - the service procedure for the component for more information. Troubleshooting and Diagnostic Information The following table lists diagnostic- and troubleshooting-related procedures and references that can assist you with resolving server issues.
Page 59 Troubleshoot Hardware Faults “PSU Failure” on page 61 ■ “Memory Failure” on page 61 ■ “CPU Failure” on page 61 ■ “Fan Module Failure” on page 61 ■ “SP Failure” on page 61 ■ “Front Panel Lamp Test” on page 62 ■...
Page 60 (no blink). Locate Indicator On When the Locate indicator is activated from Oracle ILOM or from the front panel (by pressing the Locate button), the white indicators on the front and back side of the server blink at the fast blink rate.
Page 61: Memory Failure
Troubleshoot Hardware Faults PSU Failure For a server with a PSU in a failed state, the server amber Service Action Required indicators (front and back) and the amber fault indicator on the PSU are on steady. The front and back green Power OK indicator and the green SP indicator are on steady.
Page 62: Indicator Blink Rates
Troubleshoot Hardware Faults For indicator blink rate information, see “Indicator Blink Rates” on page Front Panel Lamp Test To perform a lamp test of all front panel indicators, press the Locate button three times within a five second period. All the front and back indicators light up and remain on steady for 15 seconds (see “Unison Steady On”...
Page 63 Troubleshoot Hardware Faults Steady Off For the steady off state, an indicator is continually off (not lit) and does not blink. This indicates that a system is not operational, for example, no AC power (unlit green Power OK indicator) or a subsystem not in a fault state (unlit amber Service Action Required indicator).
Page 64 Troubleshoot Hardware Faults Fast Blink Rate For the fast blink rate, the indicator repeatedly blinks twice (on, off, on) during a one second interval (2 Hz). The fast blink rate indicates activity or data transfer. Single (Standby) Blink Rate For the single blink rate, the indicator repeatedly flashes once at the beginning of a three second interval.
Page 65 Troubleshoot Hardware Faults Slow Unison Blink Rate For the slow unison blink rate, the indicators on the component blink in unison for half a second during a one second interval (1 Hz). Typically, this is limited to three successive blinks. This confirms the successful insertion of a removable device (for example, a storage drive or blade) into a powered system (confirming the power connection).
Page 66 Troubleshoot Hardware Faults after three successive unison blinks (see “Slow Unison Blink Rate” on page 65) of all the component indicators. Unison Steady On For the unison steady on, all indicators are simultaneously on steady (see “Steady On” on page 62.
Page 67 Troubleshoot Hardware Faults Feedback Flash The indicator flashes on and off during periods of activity, commensurate with the activity, but the flashing does not exceed the 2 Hz fast blink rate (see, “Fast Blink Rate” on page 64). For example, this blink rate occurs during disk drive read and write activity and communication port transmit and receive activity.
Page 68: The Cmod Fault Remind Test Circuit
Troubleshoot Hardware Faults The CMOD Fault Remind Test Circuit The server CMODs have an internal test circuit, the DIMM and CPU Fault Remind Circuit. You can use the circuit to help you locate failed DIMMs and verify a failed CPU after you have removed the CMOD from the server.
Page 69: Troubleshooting Power Issues
Troubleshoot Hardware Faults Airflow Blockage The server cooling system uses fans to pull cool air in from the server front intake vents and exhaust warm air out the server back panel vents. If the front or back vents are blocked, the airflow through the server is disrupted and the cooling system fails to function properly causing the server internal temperature to rise.
Page 70: Troubleshooting With Diagnostic Tools
Troubleshooting With Diagnostic Tools AC Power Connection The AC power cords are the direct connection between the server power supplies and the power sources. The server power supplies need separate stable AC circuits. Insufficient voltage levels or fluctuations in power can cause server power problems. The power supplies are designed to operate at a particular voltage and within an acceptable range of voltage fluctuations (see “Server Specifications”...
Page 71: Diagnostic Tools
Diagnostic Tools The selection of diagnostic tools available for your server range in complexity from a comprehensive validation test suite (Oracle VTS) to a chronological event log (Oracle ILOM System Log). The selection of diagnostic tools also include standalone software packages, firmware-based tests, and hardware-based LED indicators.
Page 72: Diagnostic Tool Documentation
(SP) mode or full power possible if the prior to booting the mode. It is not OS SP serial port is Oracle ILOM SP and dependent. connected to a operating system. network-accessible Tests SP memory, terminal server.
Page 73: Attaching Devices To The Server
By default, the SP console (NET MGT) port sends serial port output from the server. Using Oracle ILOM, you can specify that the host console (COMM1) be assigned as owner of the server's serial port output. This feature is useful for Windows kernel debugging, as it enables you to view non-ASCII character traffic from the host console.
Page 74 “Assign Serial Port Output Using the Web Interface” on page 74 ■ Assign Serial Port Output Using the CLI Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example: ipadress ssh root@ where ipadress is the IP address of the server SP.
Page 75: Ethernet Port Device Naming
The following illustration explains the logical (operating system) and physical (BIOS) naming conventions used for each interface. These naming conventions might vary depending on conventions of your operating system and which devices are installed in the server. Port BIOS Oracle Solaris Linux Windows Net 1 0701 igb 1...
Page 76: Contacting Support
Getting Help “Contacting Support” on page 76 ■ “Locating the Chassis Serial Number” on page 76 ■ Contacting Support If the troubleshooting procedures in this chapter fail to solve your problem, use the following table to collect information that you might need to communicate to support personnel. System Configuration Information Needed Your Information Service contract number...
Page 77 ■ This sheet includes the serial number. From Oracle System Assistant, see the Summary screen. ■ From Oracle ILOM, enter the show/SYS command or go to the System Information tab in ■ the Oracle ILOM browser interface. Troubleshooting and Diagnostics...
Page 78 Sun Server X4-8 Service Manual • December 2015...
Page 79: Servicing The Server
Servicing the Server This section includes overview information for servicing the server, including serviceability requirements and static prevention procedures. Section Description Link Component serviceability requirements, “Component Serviceability, Locations, and locations and designations Designations” on page 79 Procedures for creating an ESD-safe work “Performing Electrostatic Discharge and Static Prevention space Measures”...
Page 80 A CRU or FRU designation is a serviceability requirement that refers to service qualifications. A component designated as a FRU needs to be serviced by a qualified Oracle Service person. This qualification is not required for servicing a CRU component.
Page 81: Component Locations
Component Serviceability, Locations, and Designations Component Locations The following illustration shows the location of the server's components. Call Out Description Call Out Description † AC power block Midplane ‡ Dual PCIe carrier card (DPCC) with Server chassis PCIe card Host bus adapter (HBA) card CPU module (CMOD) HBA battery Fan frame (2)
Page 82: Component Designations
Component Serviceability, Locations, and Designations Call Out Description Call Out Description Top cover Front indicator module (FIM) † The AC power block is not a removable component. ‡ The chassis is not a removable component. Component Designations These sections show the location and designation of CRU and FRU components: “Fan Module Designations”...
Page 83 Component Serviceability, Locations, and Designations Call Out Description FM 0 FM 1 FM 2 FM 3 FM 4 FM 5 FM 6 FM 7 The eight fan modules are contained in two separate side by side enclosures (frames). Each frame contains four FMs (two stacked rows of two FMs). The left side frame contains FM 0, FM1, FM2, and FM 3.
Page 84 Component Serviceability, Locations, and Designations Power Supply Slot Designations The four slots for the power supply units (PSUs) are directly accessible at the front of the server and are arranged in a single stacked row and designated from the bottom to the top as, PSU 0, PSU 1, PSU 2, and PSU 3.
Page 85 Component Serviceability, Locations, and Designations Call Out Description CMOD 0 CMOD 1 CMOD 2 CMOD 3 CMOD 4 CMOD 5 CMOD 6 CMOD 7 Memory Slot Designations Memory is installed on the CPU modules (CMODs). Each CMOD contains 24 DIMM slots.
Page 86 Component Serviceability, Locations, and Designations Call Out Description Slots D12–D17 Slots D18–D23 Slots D6–D11 Slots D0–D5 Storage Drive Slot Designations The eight storage drive slots are in the system module (SMOD) and directly accessible at the back of the server. Slots are arranged in two stacked rows of four slots and designated from right to left.
Page 87 Component Serviceability, Locations, and Designations Call Out Description Slot 0 Slot 1 Slot 2 Slot 3 Slot 4 Slot 5 Slot 6 Slot 7 DPCC and PCIe Card Slot Designations The eight dual PCIe card carrier (DPCC) slots are directly accessible at the back of the server and are arranged in a single row.
Page 88 Component Serviceability, Locations, and Designations DPCC 2 contains PCIe slots 5 and 6 ■ DPCC 3 contains PCIe slots 7 and 8 ■ DPCC 4 contains PCIe slots 9 and 10 ■ DPCC 5 contains PCIe slots 11 and 12 ■...
Page 89: Component Network Access Control (Nac) Names
Component Serviceability, Locations, and Designations AC Input Power Block The four AC power inputs are accessible at the back of the server and are arranged in a single stacked row. The inputs are designated from bottom to top (corresponding to the PSUs on the front side) as, (bottommost) AC 0, AC 1, AC 2, and AC 3.
Page 90: Performing Electrostatic Discharge And Static Prevention Measures
Performing Electrostatic Discharge and Static Prevention Measures Name Description /SYS/SMOD/DBP[0/1] Disk backplanes (dynamic FRUID) /SYS/FM[0-7] Fan modules (No FRUID) /SYS/HDD[0-7] Hard disk drives /SYS/SMOD/MB System module (SMOD) (dynamic FRUID) /SYS/SMOD/MB/NET[0/1] System host network interfaces (static FRUID) /SYS/SMOD/MB/CPLD CPLD on SMOD /SYS/SMOD/MB/SP Service processor (SP) module (dynamic FRUID) /SYS/SPNET[0/1]...
Page 91: Using An Anti-Static Mat
DIMMs, and CPUs. You can use the following items as anti-static mats: Anti-static bag used to wrap a replacement part ■ ESD mat (orderable from Oracle) ■ A disposable ESD mat (shipped with some optional system components) ■...
Page 92: Component Filler Panels And Non-Powered Components
This procedure uses the Oracle ILOM CLI interface. Before You Begin ■ Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example: ipadress ssh root@ where ipadress is the IP address of the server SP.
Page 93 ■ -u uuid – Show fault diagnosis events that match a specific universal unique identifier ■ (uuid). For command specifics, see the Oracle ILOM documentation at: http://docs.oracle.com/cd/ E37444_01/index.html Use fmadm to clear the fault. Clear the fault according to whether you want to use the acquit, repair, replaced, or repaired.
Page 94 Clear Hardware Fault Messages Close the Oracle ILOM session. Sun Server X4-8 Service Manual • December 2015...
Page 95: Preparing For Service
“Managing the Locator Indicator” on page 109 server Locator indicator. Prepare the Server for Hot Service The steps in this remote procedure use the Oracle ILOM web interface. However, the Note - procedure can also be performed remotely using the Oracle ILOM CLI interface (for more information, refer to the Oracle ILOM documentation).
Page 96: Prepare The Server For Warm Service
Prepare the Server for Warm Service Log in to the service processor Oracle ILOM web interface. Direct a web browser to Oracle ILOM using the IP address of the server SP and log in as root or a as user with administrator privileges. See Oracle X4 Series Servers Administration Guide.
Page 97 ILOM 3.2.18 or newer. Log in to the Oracle ILOM web interface. Direct a web browser to Oracle ILOM using the IP address of the server SP and log in as root or a as user with administrator privileges. See “Accessing Oracle ILOM”...
Page 98 Prepare the Server for Warm Service This action powers off the server to standby power mode. For more power off options, see “Powering Off the Server” on page 101. In the Actions section of the Summary screen, click the Locator Indicator Turn On button.
Page 99: Prepare The Server For Cold Service
Log in to the Oracle ILOM web interface. Direct a web browser to Oracle ILOM using the IP address of the server SP and log in as root or a as user with administrator privileges. See “Accessing Oracle ILOM” in Oracle X4 Series Servers Administration Guide.
Page 100 Prepare the Server for Cold Service In the Actions section of the Summary screen, click the Power State Turn Off button. This action powers off the server to standby power mode. For more power off options, see “Powering Off the Server” on page 101.
Page 101: Powering Off The Server
“Power Off, Immediate (Power Button)” on page 103 ■ “Power Off, Remote (Oracle ILOM CLI)” on page 104 ■ “Power Off, Remote (Oracle ILOM Web Interface)” on page 105 ■ “Remove Power” on page 106 ■ “Power Modes, Shutdowns, and Resets” on page 107 ■...
Page 102: Power Off, Graceful (Power Button)
Power Off, Graceful (Power Button) “Performing Electrostatic Discharge and Static Prevention Measures” on page 90 Next Steps ■ Power Off, Graceful (Power Button) This procedure is performed locally and requires physical access to the server front Note - panel. Use this procedure when you are at the server to perform a graceful power off of the server to standby power mode.
Page 103: Power Off, Immediate (Power Button)
Power Off, Immediate (Power Button) Power Off, Immediate (Power Button) This procedure is performed locally and requires physical access to the server front Note - panel. An immediate shutdown should be used in situations when you know that the loss of data is nonexistent or acceptable (for more information, see “Power Modes, Shutdowns, and Resets”...
Page 104: Power Off, Remote (Oracle Ilom Cli)
“Power Modes, Shutdowns, and Resets” on page 107 Before You Begin Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example:...
Page 105: Power Off, Remote (Oracle Ilom Web Interface)
Power Off, Remote (Oracle ILOM Web Interface) Power Off, Remote (Oracle ILOM Web Interface) You can use the Oracle ILOM web interface to remotely power off the server to standby power mode. See: “Power Modes, Shutdowns, and Resets” on page 107 Before You Begin Log in to the service processor Oracle ILOM web interface.
Page 106: Remove Power
Remove Power Oracle Integrated Lights Out Manager 3.2.2 Documentation Library at: ■ http://docs.oracle.com/cd/E37444_01/index.html Remove Power Powering the server from full power mode to standby power mode does not completely remove power from the server. If you need to completely remove power from the server to perform cold service or a cold reset or to place the server in a non-powered state, you must disconnect the AC power cables from the back of the server.
Page 107: Power Modes, Shutdowns, And Resets
Remove Power This action completely removes power from the server. If you are performing a cold reset, wait at least 60 seconds before connecting the AC power cables to the power supplies. For information about cold resets, see “Cold Reset” on page 109.
Page 108: Graceful Shutdown
You can also achieve full power mode by powering on the server from Oracle ILOM. Once the server is operating in full power mode, the Power OK and service processor (SP) indicators are on steady.
Page 109: Managing The Locator Indicator
For example, a warm reset might be required after a software or firmware update or when you want to launch Oracle System Assistant or the BIOS Setup Utility.
Page 110: Turn On The Locator Indicator Remotely (Oracle Ilom Web Interface)
Turn On the Locator Indicator Remotely (Oracle ILOM Web Interface) Log in as a user with root or administrator privileges. For example: ipadress ssh root@ where ipadress is the IP address of the server module SP. For more information, see “Accessing Oracle ILOM”...
Page 111: Control The Locator Indicator Locally
■ To turn on the Locator indicator, press the Locator indicator button. ■ Some Oracle ILOM security procedures require that you turn on the Locator indicator Note - locally, as part of a physical presence verification step. To perform a lamp test of all front panel indicators, press the Locator ■...
Page 112 Control the Locator Indicator Locally All of the front panel indicators light up and remain lit for 15-20 seconds. Sun Server X4-8 Service Manual • December 2015...
Page 113: Servicing Components
Servicing Components This section includes the following upgrade, removal, and installation procedures for customer- replaceable and field-replaceable components in the Sun Server X4-8: Section Description Link Remove and install power supplies (PSUs) “Servicing Power Supply Units (PSUs)” on page 122 Remove and install the font indicator panel “Servicing the Front Indicator Module (FIM)”...
Page 114 Remove a Fan Module hot-service components; however, accessing CMODs is a warm or cold-service procedure (for more information, see “Remove a CMOD” on page 133). For component serviceability, locations, and designations, see“Component Serviceability, Before You Begin ■ Locations, and Designations” on page Prepare the server for hot service.
Page 115 Remove a Fan Module Data Loss. Do not remove more than one fan module from a column while the system Caution - is in full power mode. This action removes power from the CMODs and causes an immediate shutdown. On an eight-CMOD system, this applies to all fan modules. On a four-CMOD system, this applies to the fan modules in the left-hand fan frame (CMODs 0-3).
Page 116: Install A Fan Module
Install a Fan Module Server over-temperature. The slot's air vane maintains system cooling by preventing a Caution - disruption of server airflow. Do not open the air vane when the system is running. “Remove a Fan Frame” on page 118 See Also ■...
Page 117 Install a Fan Module For component serviceability, locations, and designations, see“Component Serviceability, Before You Begin ■ Locations, and Designations” on page Align the fan module with the slot. Ensure the handle is positioned at the bottom of the slot with the green release button to the left and that the air vane for the slot swings freely.
Page 118: Remove A Fan Frame
Remove a Fan Frame Verify that the green Fan OK indicator on the fan module lights and is on steady. Remove a Fan Frame The server has two fan frames, which are accessible from the front of the server. Each frame contains four fans.
Page 119 Remove a Fan Frame The center of the fan frame is marked with green labels. The labels indicate where to Note - hold the frame when you want to install or remove it. Servicing Components...
Page 120: Install A Fan Frame
Install a Fan Frame To remove the fan frame, hold it by the green labels at the center of the frame and pull it out of the server. “Remove a CMOD” on page 133 Next Steps ■ Install a Fan Frame When installing a fan frame, handle it by the green tabs at the center of the frame.
Page 121 Install a Fan Frame For removal instructions, see “Remove a Fan Frame” on page 118. ■ Position the fan frame at the opening in the front of the server with the air vane hinges at the top. The center of the fan frame is marked with green labels. The labels indicate where to Note - grab the frame when you want to install or remove it.
Page 122: Servicing Power Supply Units (Psus)
Servicing Power Supply Units (PSUs) Servicing Power Supply Units (PSUs) This section contains information and procedures for servicing the power supply units (PSUs): “Remove a PSU” on page 122 ■ “Install a PSU” on page 125 ■ Remove a PSU Access this component directly from the front of the server.
Page 123 Remove a PSU To access, the FIM release latch, you need to remove the topmost PSU. Note - To unlock the power supply lever, squeeze together the two green release latches at the end of the lever. Servicing Components...
Page 124 Remove a PSU This action is accompanied by an click sound. To disengage the power supply from its internal connector, rotate the lever to the left. Pinch point. When operating the lever, keep your fingers clear of the hinged end of Caution - the lever.
Page 125: Install A Psu
Install a PSU To remove the power supply, use two hands to slowly slide it completely out of the server. “Install a PSU” on page 125 See Also ■ “Returning the Server to Operation” on page 229 ■ Install a PSU Access this component directly from the front of the server.
Page 126 Install a PSU Prepare the server for hot service. See “Prepare the Server for Hot Service” on page Alternatively, to prepare the server for cold service, see “Prepare the Server for Cold Service” on page Ensure that the AC power cord for the power supply slot is connected and secured.
Page 127 Install a PSU The pawl at the hinged end of the lever engages the sidewall of the server and provides the pivot point for the leverage necessary to draw the power supply into the slot and engage the internal connector. Pinch point.
Page 128: Servicing The Front Indicator Module (Fim)
Servicing the Front Indicator Module (FIM) The Service Action Required indicator lights when the component is in a fault state. “Returning the Server to Operation” on page 229 See Also ■ Servicing the Front Indicator Module (FIM) This section includes information and procedures for servicing the server front indicator module (FIM): “Remove the FIM”...
Page 129: Remove The Fim
Remove the FIM Remove the FIM Access this component directly from the front of the server. Remove the FIM when you need to replace it. For component serviceability, locations, and designations, see“Component Serviceability, ■ Before You Begin Locations, and Designations” on page Prepare the server for cold service.
Page 130: Install The Fim
Install the FIM To remove the FIM, press and hold the release latch and slide the FIM completely out of its slot. “Install the FIM” on page 130 Next Steps ■ Install the FIM Access this component directly from the front of the server. For component serviceability, locations, and designations, see“Component Serviceability, Before You Begin...
Page 131 Install the FIM Ensure that the open side (internal ribbon cable visible) of the FIM is facing upward. To install the FIM, slide it into the slot until it locks and is flush with the front of the server. Servicing Components...
Page 132: Servicing The Cpu Module (Cmod) Components
Servicing the CPU Module (CMOD) Components This locking action is accompanied by a click sound. Install power supply, PSU 3. See “Install a PSU” on page 125. Verify that the Power OK indicator on the PSU indicator panel turns on steady after power is supplied to the server and the server is in full power mode.
Page 133: Remove A Cmod
Before You Begin Locations, and Designations” on page Prepare the server for warm or cold service. For servers equipped with SW 1.0 and with versions of Oracle ILOM older than 3.2.4.18, ■ use cold service. See “Prepare the Server for Cold Service” on page For servers equipped with SW 1.1 and with Oracle ILOM 3.2.4.18 or newer, use...
Page 134 Remove a CMOD To unlock the CMOD, squeeze together the green tabs on the end of the CMOD lever. To disconnect the CMOD from the connector on the midplane, rotate the CMOD lever downward and away from the CMOD. Pinch point. Keep your fingers clear of the underside of the lever. Caution - The lever disconnects the CMOD from the midplane and its DPCC.
Page 135 Remove a CMOD Use the lever to slide the CMOD partially out of the server until you can grab it with both hands. Servicing Components...
Page 136: Remove And Install The Cmod Cover
Remove and Install the CMOD Cover To remove the CMOD, slide it completely out of the server. “Replace a Failed DIMM” on page 142 Next Steps ■ “Remove a Heatsink and Processor (FRU)” on page 157 ■ “Install a CMOD” on page 139 See Also ■...
Page 137 Remove and Install the CMOD Cover To remove the CMOD top cover, push the release button, slide the cover away from the front of the CMOD, and lift it off the CMOD. Servicing Components...
Page 138 Remove and Install the CMOD Cover Component damage. CMOD components are extremely sensitive to electrostatic Caution - discharge. Wear a wrist strap and use an anti-static wrist mat. Sun Server X4-8 Service Manual • December 2015...
Page 139: Install A Cmod
Install a CMOD To install the cover, position it over the CMOD chassis with the green button at the front. Set the cover on the chassis, leaving a gap of approximately one inch (25 mm) between the lead edge of the cover and the front of the CMOD. Ensure that the edges of the cover encapsulate the edges of the chassis, and that the pins in the cover are aligned with the slots in the chassis sidewall.
Page 140 Install a CMOD Ensure that the CMOD lever is in the fully-open position. Squeeze together the green tabs on the end of the lever. Rotate the lever downward and away from the CMOD. Position the CMOD in the slot. Sun Server X4-8 Service Manual • December 2015...
Page 141 Install a CMOD On the front-facing side, ensure that the hinge for the lever is at the bottom. Slide the CMOD into the slot until it stops. In this position, the pawl at the lever hinge is aligned with the slot in the server. To install the CMOD, rotate the lever upward until it locks into place and is flush with the front of the CMOD.
Page 142: Replace A Failed Dimm
Replace a Failed DIMM The action of rotating the lever upward draws the CMOD into the slot and engages the CMOD connector with the connector on the midplane. Install the fan frame. See “Install a Fan Frame” on page 120. Install the four fan modules.
Page 143 Replacing DIMMs. Tip - Prepare the server for warm or cold service. For servers equipped with SW 1.0 and with versions of Oracle ILOM older than 3.2.4.18, ■ use cold service. See “Prepare the Server for Cold Service” on page For servers equipped with SW 1.1 and with Oracle ILOM 3.2.4.18 or newer, use...
Page 144 Replace a Failed DIMM “Remove and Install the CMOD Cover” on page 136. Sun Server X4-8 Service Manual • December 2015...
Page 145 Replace a Failed DIMM To locate the failed DIMM, press and hold the Fault Remind button. Call Out Description Fault Remind button Power OK indicator DIMM slot fault indicator (one for each slot) Verify that the Fault Remind Power indicator is lit. The green LED lights to indicate that the circuit is operational.
Page 146 Replace a Failed DIMM This action extracts the DIMM from its connector. Remove the DIMM from the CMOD. To align the replacement DIMM in the slot, ensure that the notch on the DIMM connector edge lines up with the key in the DIMM slot. Sun Server X4-8 Service Manual •...
Page 147 Replace a Failed DIMM To install the DIMM in the slot, simultaneously press down on both edges of the DIMM, so the DIMM enters the slot evenly. This action forces the DIMM into the slot and causes the two slot levers to rise and lock the DIMM in the slot.
Page 148: Install A Dimm
“Remove a DIMM” on page 151 ■ Prepare the server for warm or cold service. For servers equipped with SW 1.0 and with versions of Oracle ILOM older than 3.2.4.18, ■ use cold service. See “Prepare the Server for Cold Service” on page For servers equipped with SW 1.1 and with Oracle ILOM 3.2.4.18 or newer, use...
Page 149 Install a DIMM Component damage. CMOD components are extremely sensitive to electrostatic Caution - discharge. Wear a wrist strap and use an anti-static wrist mat. Locate the DIMM slot. To align the DIMM in the slot, ensure that the notch on the DIMM connector lines up with the key in the DIMM slot.
Page 150 Install a DIMM This action forces the DIMM into the slot and causes the two slot levers to rise and lock the DIMM in the slot. Verify that the DIMM sits evenly in the slot and is locked. Both levers should be in their fully closed and vertical position. In this position the levers lock the DIMM in the slot.
Page 151: Remove A Dimm
Remove a DIMM Install the CMOD cover. See “Remove and Install the CMOD Cover” on page 136. “Install a CMOD” on page 139 Next Steps ■ Remove a DIMM Use this procedure to remove DIMMs for a memory upgrade or a configuration change or when you need to physically reset a DIMM in its slot (removal and installation).
Page 152 Remove a DIMM For servers equipped with SW 1.0 and with versions of Oracle ILOM older than 3.2.4.18, ■ use cold service. See “Prepare the Server for Cold Service” on page For servers equipped with SW 1.1 and with Oracle ILOM 3.2.4.18 or newer, use ■...
Page 153 Remove a DIMM Component damage. CMOD components are extremely sensitive to electrostatic Caution - discharge. Wear a wrist strap and use an anti-static wrist mat. Servicing Components...
Page 154: Memory And Dimm Reference
Remove a DIMM To locate the DIMM slot, use the DIMM designation information. To remove the failed DIMM from its slot, simultaneously rotate the two DIMM slot levers outward to their fully open position. This action extracts the DIMM from its connector. Remove the DIMM from the CMOD.
Page 155 Remove a DIMM memory channels per CMOD). Each channel supports 1-3 DIMMs and has three assigned DIMM slots. The following illustration shows the location of the memory buffers, the groups of DIMM slots, and the slots assigned to each channel. Call Out Description Memory buffers...
Page 156 Remove a DIMM Call Out Description Black slots with black levers Black slots with white levers White slots with white levers DIMM Rules The DIMM installation rule aims to maximize the memory bandwidth available by spreading the memory across all eight memory channels. When installing DIMMs, consider the following rules: All DIMMs in a system should be the same type and size.
Page 157: Remove A Heatsink And Processor (Fru)
Replacing a Heatsink and Tip - CPU. Prepare the server for warm or cold service. For servers equipped with SW 1.0 and with versions of Oracle ILOM older than 3.2.4.18, ■ use cold service. See “Prepare the Server for Cold Service” on page...
Page 158 Remove a Heatsink and Processor (FRU) For servers equipped with SW 1.1 and with Oracle ILOM 3.2.4.18 or newer, use ■ cold service or warm service. For warm service, see “Prepare the Server for Warm Service” on page Remove the CMOD from the server. See “Remove a CMOD”...
Page 159 Remove a Heatsink and Processor (FRU) In the following illustration, call out 1 shows the Fault Remind button, call out 2 shows the Charge Status indicator, and call out 3 shows the CPU fault indicator. For more information about the CMOD components, see “CMOD Layout”...
Page 160 Remove a Heatsink and Processor (FRU) Press down on the center of the heatsink and use a number 2 Phillips screwdriver to completely loosen the four spring-loaded screws. A thermal compound that has been applied to the top of the CPU to facilitate the transfer of heat to the heatsink also acts as an adhesive.
Page 161 Remove a Heatsink and Processor (FRU) The twisting action helps to break the seal created by the thermal compound. Remove the heatsink from the CMOD, taking care that you do not allow the thermal compound to contaminate other components. Servicing Components...
Page 162 Remove a Heatsink and Processor (FRU) A residual amount of compound remains on the bottom of the heatsink and on the top of the CPU. This compound must be removed before using the CPU replacement tool. An alcohol wipe is included with the replacement CPU. Use the alcohol wipe to completely remove the thermal compound from the top of the CPU and the bottom of the heatsink, taking care that you do not allow the thermal compound to contaminate other components.
Page 163 Remove a Heatsink and Processor (FRU) The levers are numbered by their required order of operation. Rotate the levers to their fully-open position. Servicing Components...
Page 164 Remove a Heatsink and Processor (FRU) When the second lever is in its fully-open position, the load plate is unlocked and can be opened. To open the load plate, lift the unhinged end to its fully-open position. Sun Server X4-8 Service Manual • December 2015...
Page 165 Remove a Heatsink and Processor (FRU) Component damage. The pins of the CPU socket can be easily damaged. Do not Caution - remove the CPU using your fingers. To remove the CPU, use the CPU replacement tool. To remove the CPU, use the CPU replacement tool: Ensure that you use the correct CPU replacement tool.
Page 166 Remove a Heatsink and Processor (FRU) On one corner of the tool, there is a label with a downward pointing triangle. Likewise, the CPU is marked with a triangle on one of its corners. This is a key that aids in correctly positioning the tool and the CPU with the CPU socket.
Page 167 Remove a Heatsink and Processor (FRU) To remove the CPU, lift the tool upward and out of the server. Turn the tool over, so the metal CPU contacts are facing upward and the topside of the tool is facing downward. Hold the CPU by its edges.
Page 168: Install A Heatsink And Processor (Fru)
Install a Heatsink and Processor (FRU) Remove the CPU from the tool. “Install a Heatsink and Processor (FRU)” on page 168 Next Steps ■ Install a Heatsink and Processor (FRU) “Remove a Heatsink and Processor (FRU)” on page 157. Before You Begin ■...
Page 169 Install a Heatsink and Processor (FRU) At the CPU socket, ensure that the CPU load plate and both load plate release levers are in their fully open position. To install a CPU, use the CPU replacement tool. Ensure that you use CPU replacement tool, part number 7080240. The part number is Note - printed on the side of the tool.
Page 170 Install a Heatsink and Processor (FRU) positioning the tool and the CPU with the CPU socket. The tool and the CPU are correctly positioned with the socket when all of the triangles are aligned. Turn the replacement tool upside down, noting the corner of the tool that is marked with a triangle (alignment key).
Page 171 Install a Heatsink and Processor (FRU) When the CPU is correctly positioned, there is no side-to-side movement of the CPU within the socket. To release the CPU from the tool, press the center button. This action is accompanied by a click sound as the tool opens and releases the CPU. Remove the tool.
Page 172 Install a Heatsink and Processor (FRU) Close the CPU load plate. Lower and lock the right side lever, ensuring that the lever is secured under its retaining clip and that the bend in the lever locks the cover plate. The right side lever must be closed first. Sun Server X4-8 Service Manual •...
Page 173 Install a Heatsink and Processor (FRU) Lower and lock the left side load plate lever, ensuring that it is secured under its retaining clip. To apply the thermal compound, dispense the contents of the syringe as a single dollop in the center on the top of the CPU. Do not spread the thermal compound.
Page 174 Install a Heatsink and Processor (FRU) Align the captive spring-loaded heatsink screws with the threaded standoffs on the motherboard. Set the heatsink on top of the CPU. Once the heatsink is in contact with the CPU, avoid extra movement of the heatsink. Sun Server X4-8 Service Manual •...
Page 175 Install a Heatsink and Processor (FRU) Use a number 2 Phillips screwdriver and alternately tighten each screw one- half turn until both screws are completely tightened. Ensure that all tools and debris are removed from the CMOD. Install the CMOD cover. See “Remove and Install the CMOD Cover”...
Page 176: Servicing Storage Drives
Servicing Storage Drives After restoring service to the server, clear any related component faults. For more details, Note - “Clear Hardware Fault Messages” on page “Install a CMOD” on page 139 Next Steps ■ Servicing Storage Drives “Remove a Storage Drive” on page 176 ■...
Page 177 Remove a Storage Drive For component serviceability, locations, and designations, see “Component Serviceability, Before You Begin ■ Locations, and Designations” on page For storage drive information, see “Storage Drive Reference” on page 182. ■ Prepare the server for hot service. See “Prepare the Server for Hot Service”...
Page 178 Remove a Storage Drive The spring-loaded handle pops open. Sun Server X4-8 Service Manual • December 2015...
Page 179: Install A Storage Drive
Install a Storage Drive To remove the HDD, rotate the handle to its fully-open position and pull the HDD out of its slot. Rotating the handle to its fully-open position disengages the drive from its internal connector. If you are not replacing the HDD, install an HDD filler panel. “Returning the Server to Operation”...
Page 180 Install a Storage Drive For component serviceability, locations, and designations, see “Component Serviceability, Before You Begin ■ Locations, and Designations” on page For storage drive information, see “Storage Drive Reference” on page 182. ■ Prepare the server for hot service. See “Prepare the Server for Hot Service”...
Page 181 Install a Storage Drive Align the drive with the vacant slot, so that the open handle is the right. Slide the drive into the slot push it inward until it is flush with the front of the SMOD. Servicing Components...
Page 182: Storage Drive Reference
Install a Storage Drive Rotate the handles to the closed position “Returning the Server to Operation” on page 229. See Also ■ Storage Drive Reference This section contains storage drive reference information, including storage drive slot population rules. Storage Drive Population Rules When populating the storage drive slots, use the following rules: Sun Server X4-8 Service Manual •...
Page 183: Servicing Pcie Cards And The Dual Pcie Card Carriers (Dpccs)
Servicing PCIe Cards and the Dual PCIe Card Carriers (DPCCs) 1. Every slot in the storage drive bay must contain either a storage drive or a a drive filler panel. 2. Sort disks by capacity and technology (HDD vs SSD) and install in this order: a.
Page 184 Remove a DPCC Identify the DPCC. Use a stylus to press the Attn buttons on the front of the DPCC (for button location, see “Dual PCIe Card Carrier (DPCC) Indicators” on page 42). The Attn buttons alert the system to a request to remove a PCIe card. When the system has acknowledged the request, it takes the device offline and lights both indicators for each slot.
Page 185 Remove a DPCC To unlock the DPCC lever, lift the release latch and pull the lever downward, away from the server. This action disengages the PCIe card IO connectors from the connectors on the back of the CMODs. Servicing Components...
Page 186: Remove A Pcie Card
Remove a PCIe Card To remove the DPCC, slide it out of the server. “Remove a PCIe Card” on page 186 Next Steps ■ Remove a PCIe Card PCIe cards are installed in pairs inside in Dual PCIe Card Carriers (DPCCs). To access a PCIe card, you must first remove its DPCC (see “Remove a DPCC”...
Page 187 Remove a PCIe Card Alternatively, to prepare the server for cold service, see “Prepare the Server for Cold Service” on page Identify the DPCC containing the PCIe card. Remove the DPCC. See “Remove a DPCC” on page 183. Orient the DPCC so that the hinge is to the left. To open the top of the DPCC, lift the release latch at the non-hinged end of the lid and rotate the lid upward and to the left.
Page 188: Install A Pcie Card
Install a PCIe Card To remove the card, pull it straight up and out of its connector. “Install a PCIe Card” on page 188 Next Steps ■ “Returning the Server to Operation” on page 229. See Also ■ Install a PCIe Card PCIe cards are installed in pairs inside in Dual PCIe Card Carriers (DPCCs).
Page 189: Prepare The Server For Hot Service. See Service" On Page 95. Alternatively, To Prepare The Server For Cold Service, See Service
Install a PCIe Card Prepare the server for hot service. See “Prepare the Server for Hot Service” on page Alternatively, to prepare the server for cold service, see “Prepare the Server for Cold Service” on page Identify the DPCC PCIe slot. If necessary, remove the DPCC.
Page 190 Install a PCIe Card This puts the component side of the card facing away from you. To install the card, align the edge connector with the slot in the DPCC and push the card downward into the slot. To close the top of the DPCC, rotate it to the right ensuring the clip on the edge of the top is secured over the unhinged edge of the DPCC.
Page 191: Install A Dpcc
Install a DPCC Pinch point. Keep fingers away from the underside of the top when closing it. Caution - Clear any related component faults. For more information see “Clear Hardware Fault Messages” on page “Install a DPCC” on page 191 ■...
Page 192 Install a DPCC Alternatively, to prepare the server for cold service, see “Prepare the Server for Cold Service” on page Ensure the top of the DPCC is closed and secured and the lever on the front of the DPCC is in its fully open position. Align the DPCC with the vacant slot.
Page 193: Replace A Dpcc
Replace a DPCC This action draws the DPCC inward engaging the connectors in the DPCC with the connectors on the server midplane. Use a stylus to press both ATTN buttons on the front of the DPCC. The buttons alert the system to a request to bring the devices online. When the system acknowledges the request, it turns on the indicators on the the DPCC.
Page 194: Pcie Card And Dpcc Reference
Replace a DPCC For component serviceability, locations, and designations, see “Component Serviceability, Before You Begin ■ Locations, and Designations” on page Remove the DPCC. See “Remove a DPCC” on page 183. Remove the PCIe cards. See “Remove a PCIe Card” on page 186.
Page 195: Servicing System Module (Smod) Components
Servicing System Module (SMOD) Components slots (right to left from the back of the server), are active. In an eight CMOD-configured server, all eight slots are active. DPCC Indicator Panel Two indicator panels are located on the front of the DPCC. Both panels include an OK indicator, a Service Action Required indicator, and two ATTN buttons.
Page 196 Remove the SMOD Access this component directly from the rear of the server. For component serviceability, locations, and designations, see “Component Serviceability, Before You Begin ■ Locations, and Designations” on page Obtain labels and a pen for labeling cables. ■ Prepare the server for cold service.
Page 197: Install The Smod
Install the SMOD To disengage the SMOD from the server midplane, simultaneously, rotate both handles downward to their fully-open position. This action disengages the connectors on the SMOD from the connectors on the server midplane. Physical harm or component damage. Do not use the SMOD handles to remove the Caution - SMOD from the server.
Page 198 Install the SMOD Perform this procedure after servicing internal SMOD components, such as the HBA, the internal USB ports, and the system battery. Access this component directly from the rear of the server. For component serviceability, locations, and designations, see “Component Serviceability, Before You Begin ■...
Page 199 Install the SMOD Align the SMOD in the slot. Slide the SMOD into the slot until it stops. This leaves the SMOD protruding slightly from the back of the server. Do not attempt push the SMOD inward beyond this point. To install the SMOD, simultaneously rotate both handles upward until they lock into place.
Page 200: Servicing The Host Bus Adapter (Hba) Card
Remove the HBA Card “Returning the Server to Operation” on page 229 Next Steps ■ Servicing the Host Bus Adapter (HBA) Card This section contains procedures for servicing the HBA card that is located inside the system module (SMOD): “Remove the HBA Card” on page 200 ■...
Page 201 Remove the HBA Card The HBA is located inside the SMOD and is accessible through the an upward-facing opening on the right side. In the following illustration, call out 2 shows the location of the HBA card and call out 3 shows the card locking lever (call out 1 shows the location of the USB flash drive). To unlock the HBA card, rotate the green release handle downward.
Page 202 Remove the HBA Card The handle is on the right (vertical) side of the SMOD. To access it, you might need to push it outward from the inside. To disconnect the HBA card from its connector on the SMOD motherboard, pull the card toward you.
Page 203 Remove the HBA Card Two cables with mini SAS4I connectors connect the HBA to the storage drive backplane. Carefully lift the card up, and pull it slightly away from the SMOD until the cable connectors are visible. Disconnect the cables from the card. Servicing Components...
Page 204 Remove the HBA Card Do not disconnect the cables from the SMOD. Note - Sun Server X4-8 Service Manual • December 2015...
Page 205 Install the HBA Card Remove the HBA card from the SMOD. “Install the HBA Card” on page 205 Next Steps ■ Install the HBA Card This is an internal component that is accessible from the rear of the server by removing the SMOD.
Page 206 Install the HBA Card Position the HBA card with the component side facing upward and the edge connector pointed away from you. With the SMOD positioned upside down and the back (connector) side facing you, orient the HBA card in the opening on the right. Ensure that the two backplane cables are routed under the support bracket on the bottom of the SMOD.
Page 207 Install the HBA Card To install the HBA card, push it into the slot. To lock the card, rotate the green locking lever upward. Servicing Components...
Page 208 Replace the HBA Battery Rotate the lever inward so it tucks inside the SMOD frame and does not extend outward. Install the storage drives. See “Install a Storage Drive” on page 179. Clear any related component faults. For more information see “Clear Hardware Fault Messages”...
Page 209: Servicing The Sas Cable
Replace the SAS Cable Remove the HBA card. See “Remove the HBA Card” on page 200. Set the HBA on the work space with the component side facing down. Use the screwdriver to remove and retain the three screws that secure the battery to the HBA card.
Page 210: Servicing The Internal Usb Flash Drives
Your server might come equipped with a server-specific version of Oracle System Assistant loaded on a USB flash drive and installed (at the factory) in USB port P0. To use Oracle System Sun Server X4-8 Service Manual • December 2015...
Page 211 Remove an Internal USB Flash Drive Assistant, the flash drive must be installed in port P0, and it must contain only files specific to Oracle System Assistant. For more in formation about Oracle System Assistant, see “Oracle System Assistant” on page For component serviceability, locations, and designations, see “Component Serviceability,...
Page 212 Install an Internal USB Drive Oracle System Assistant, if present, is installed in the upper slot (USB port 0) “Install the SMOD” on page 197 ■ Next Steps Install an Internal USB Drive This is an internal component that is accessible from the rear of the server by removing the SMOD.
Page 213: Replace The Real Time Clock (System) Battery
The USB flash drive ports are located inside the SMOD next to the HBA card. To install the USB drive, insert it into its slot. If you are installing Oracle System Assistant, place it in the upper slot (USB port 0). If you replaced the Oracle System Assistant USB flash drive, reinstall Oracle System Assistant on the new USB flash drive.
Page 214 Replace the Real Time Clock (System) Battery The RTC battery is located on the SMOD motherboard. Sun Server X4-8 Service Manual • December 2015...
Page 215 Replace the Real Time Clock (System) Battery To remove the battery, pull it up and out of its holder. To orient the replacement battery, ensure that the positive (+) side of the battery is facing the holder. To install the battery, set it in the holder and push it inward. Servicing Components...
Page 216: Replace The Midplane Assembly
Replace the Midplane Assembly The battery snaps into place. Ensure that the battery is properly seated in its holder. The battery must be square in the holder. If necessary, once the server is operational, access the BIOS Setup Utility to set the clock Note - “Install the SMOD”...
Page 217 Replace the Midplane Assembly This procedure requires that the server is removed from the rack. Removing all front-side and back-side components lessens the weight of the server. Use this procedure to replace a failed bus bar midplane assembly. This procedure requires a Phillips screwdriver. Before You Begin Prepare the server for cold service.
Page 218 Replace the Midplane Assembly The midplane assembly is located inside the server. In the following illustration, call out 1 shows the location of the midplane assembly. Remove the eight screws that secure the server to the rack at the front of the server.
Page 219 Replace the Midplane Assembly Loosen the 19 captive screws on the top access panel and remove the panel. Carefully remove and retain the protective black plastic insert that covers the top of the midplane assembly. Note the orientation of the insert with respect to the opening. The insert is fitted to the opening using tabs and flaps.
Page 220 Replace the Midplane Assembly Loosen the four captive screws that secure the left side (from the front) access panel and remove the panel. The opening behind the access panel provides access to five cables (four 20-pin PSU cables and one 8-pin cable for the AC power indicator LEDs) that are routed through the server and are connected to the back side of the midplane assembly.
Page 221 Replace the Midplane Assembly The following illustration shows a portion of the label. Reach into the side access opening and disconnect the five connectors from the back of the midplane assembly. To see the connectors, direct the light from a flashlight through the small opening in the Tip - top access just above the cable connect points.
Page 222 Replace the Midplane Assembly The following illustration shows the location and arrangement of the connectors on the back of the midplane. Sun Server X4-8 Service Manual • December 2015...
Page 223 Replace the Midplane Assembly Lift the midplane assembly out of the server chassis from the top access opening. Position the cables so the connectors are hanging outside of the server chassis's side access opening. The cables inside the chassis should lie flat, so they are not damaged during the installation of the replacement midplane assembly.
Page 224 Replace the Midplane Assembly Take care not to damage the cables and connectors when lowering the midplane assembly into the server. Connect the five cables to the connectors on the back of the midplane assembly. Ensure that the connectors are positioned correctly, so the key (protrusion) on the side of the connector is aligned with the notch in the connector on the midplane assembly.
Page 225 Replace the Midplane Assembly and visibility, first attach the cable labeled PS 0, then PS 2, followed by PS 1, and finally PS 3. Attach the cable for the AC power indicator board last. Position the side access cover at the access opening, ensuring that the four captive screws are aligned with the holes in the side of the chassis.
Page 226 Replace the Midplane Assembly To secure the cover to the chassis, tighten the 19 captive screws. Install the chassis in the rack. At the front of the server: Install the CMODs. See “Install a CMOD” on page 139. Your server might have four CMODs, or it might have eight. Install both fan frames.
Page 227 Replace the Midplane Assembly Install the four PSUs. See “Install a PSU” on page 125. At the rear of the server: Install the SMOD. See “Install the SMOD” on page 197. Install the DPCCs. See “Install a DPCC” on page 191.
Page 228 Sun Server X4-8 Service Manual • December 2015...
Page 229: Returning The Server To Operation
59). Verify that none of the server Service Action Required indicators on externally facing indicator panels are lit. After replacing some components, you must clear their fault indicators in Oracle ILOM. Note - For details, see “Clear Hardware Fault Messages” on page...
Page 230: Power On The Server
From the front of the server, press and immediately release the Power ■ button on the server front panel. From the Oracle ILOM web interface Summary (home) screen, click Power ■ From the Oracle ILOM command-line interface (CLI), type: ■...
Page 231: Bios Setup Utility
BIOS Setup Utility This section provides instructions for using the BIOS setup utility, which includes a menu- driven user interface used to change BIOS settings. It includes: “Access the BIOS Setup Utility” on page 231 ■ “BIOS Setup Utility Screens” on page 232 ■...
Page 232: Bios Setup Utility Screens
Configuration interface for plug-and-play (PnP) devices, virtualization, internal devices,and add-in cards. Boot Configuration interface for boot settings, including boot mode (Legacy or UEFI), Oracle System Assistant Configuration, and boot option priority. Exit Saves or discards changes. This section contains screen captures of BIOS Setup utility screens. To access the BIOS Setup utility, see “Access the BIOS Setup Utility”...
Page 233 BIOS Setup Utility Screens Main Setup Options Options Description Project Version (R/O) BIOS version. This string is a unique identifier used to reference a specific BIOS release. Format is XXYYZZPP, which indicates: XX - Unique project/platform code. YY - BIOS major release. ZZ - BIOS minor release.
Page 234 BIOS Setup Utility Screens Main Setup Options Options Description BMC Status (R/O) Normally "Healthy" BMC Firmware Revision The service processor firmware version. Example: 3.3.2.0 r85361 (R/O) Product Information (R/O) Product information. Product Name Product name. Example: Sun Server X4-8 Product Serial Number Product serial number.
Page 235 BIOS Setup Utility Screens Main Setup Options Options Description D6 – 32 GB D7 – 32 GB D8 – 32 GB D9 – 32 GB D10 – 32 GB D11 – Not present D12 – 32 GB D13 – Not present D14 –...
Page 236 BIOS Setup Utility Screens Sun Server X4-8 Service Manual • December 2015...
Page 237 BIOS Setup Utility Screens BIOS Setup Utility...
Page 238: Advanced Screen (Legacy)
BIOS Setup Utility Screens Advanced Screen (Legacy) The following sections show the sub-selections on the Advanced screen. Sun Server X4-8 Service Manual • December 2015...
Page 239: Advanced - Processor Configuration
Enabled When enabled, execute disable bit can prevent certain classes of malicious buffer overflow attacks when combined with a supporting OS (Oracle Solaris, Oracle VM, Windows Server, Red Hat Enterprise Linux, SUSE Linux Enterprise Server, and VMware ESXi). Hardware Prefetcher...
Page 240 BIOS Setup Utility Screens Advanced Setup Options Options Defaults Description Intel Virtualization Disabled/ Enabled Enabled When enabled, a Virtual Machine Manager Technology (VMM) can utilize the additional hardware capabilities provided by Intel Virtualization Technology. CPU Power Management Displays processor (CPU) information. Configuration BIOS provides C-states, P-states, and T- states support in order for the OS to manage...
Page 241 Defaults Description Internal Port 0 Disabled/ Enabled Enabled Enable or disable internal USB Port 0. By default, internal port 0 is reserved for Oracle System Assistant. Internal Port 1 Disabled/ Enabled Enabled Enable or disable internal USB Port 1. Serial Port Console...
Page 242 TPM. The TPM feature is used by the OS for proof that BIOS code has not been tampered with. For details on modifying TPM, refer to Oracle x86 Administration Guide for X4 Series Servers at: http://www.oracle.com/ goto/x86AdminDiag/docs...
Page 243 BIOS Setup Utility Screens Advanced Setup Options Options Defaults Description NET3 Commit Commit the current BMC network information. IPv4 Configuration (R/O) Current configuration of the IPv4 settings. Channel Number (R/O) Current channel number. IPv4 Assignment (R/O) Static/Dynamic Static View whether the service processor is assigned a static IPv4 address or assigned a dynamic IPv4 address using Dynamic Host Control Protocol (DHCP).
Page 244 BIOS Setup Utility Screens Advanced Setup Options Options Defaults Description IPv6 Gateway (R/O) Current IPv6 gateway address. Example: fe80::211:5dff:febe:5000/128 Dynamic IPv6 Address 1 – Current dynamic IPv6 address. Example: (R/O) fec0:a:8:b7:214:4fff:feca:5f7e/64 Refresh Select Refresh to update to the current settings. IPv6 State (R/O) Disabled/ Enabled View whether the IPv6 state is enabled or...
Page 245 BIOS Setup Utility Screens BIOS Setup Utility...
Page 246: Advanced - Cpu Power Management Configuration
BIOS Setup Utility Screens Advanced - CPU Power Management Configuration Sun Server X4-8 Service Manual • December 2015...
Page 247: Memory Configuration
BIOS Setup Utility Screens Memory Configuration BIOS Setup Utility...
Page 248: Advanced - Usb Ports
BIOS Setup Utility Screens Advanced - USB Ports Sun Server X4-8 Service Manual • December 2015...
Page 249: Advanced - Serial Port Console Redirection
BIOS Setup Utility Screens Advanced - Serial Port Console Redirection BIOS Setup Utility...
Page 250 BIOS Setup Utility Screens Sun Server X4-8 Service Manual • December 2015...
Page 251 BIOS Setup Utility Screens BIOS Setup Utility...
Page 252 BIOS Setup Utility Screens Sun Server X4-8 Service Manual • December 2015...
Page 253: Advanced - Trusted Computing
BIOS Setup Utility Screens Advanced - Trusted Computing BIOS Setup Utility...
Page 254 BIOS Setup Utility Screens Sun Server X4-8 Service Manual • December 2015...
Page 255: Advanced - Network Stack
BIOS Setup Utility Screens Advanced - Network Stack BIOS Setup Utility...
Page 256: Advanced - Legacy Iscsi
BIOS Setup Utility Screens Advanced - Legacy iSCSI Sun Server X4-8 Service Manual • December 2015...
Page 257: Advanced - Bmc Network Configuration
BIOS Setup Utility Screens Advanced - BMC Network Configuration BIOS Setup Utility...
Page 258 BIOS Setup Utility Screens Sun Server X4-8 Service Manual • December 2015...
Page 259 BIOS Setup Utility Screens BIOS Setup Utility...
Page 260: Io Screen
BIOS Setup Utility Screens IO Screen IO Setup Options Options Defaults Description PCI Subsystem Settings Configure PCI, PCI-X, and PCI Express settings. PCI 64 Bit Resources Disabled/Enabled Enabled Enable or disable 64-bit capable devices Allocation to be decoded in above 4G address space. This setting is available only if the system supports 64-bit decoding.
Page 261 BIOS Setup Utility Screens IO Setup Options Options Defaults Description resources are allocated to the device as normal. If set to disabled, I/O resources are not allocated to the device. Disabled/Enabled Disable If Alternate Routing ID (ARI) is supported by the hardware and set to enabled, devices are permitted to locate virtual functions (VFs) in function numbers 8 to 255 of the captured bus number, instead of normal...
Page 262 BIOS Setup Utility Screens IO Setup Options Options Defaults Description OpROM Enable Disabled/Enabled Enabled Enable or disable Option ROM for the internal host bus adapter (HBA) card. Sun Server X4-8 Service Manual • December 2015...
Page 263 BIOS Setup Utility Screens BIOS Setup Utility...
Page 264 BIOS Setup Utility Screens Sun Server X4-8 Service Manual • December 2015...
Page 265 BIOS Setup Utility Screens BIOS Setup Utility...
Page 266: Boot Screen
BIOS Setup Utility Screens Boot Screen The boot screen differs slightly depending on whether the server is in UEFI boot mode or in legacy boot mode. Option Default Description UEFI/BIOS Boot Mode Legacy Select Legacy or UEFI boot mode (UEFI boot mode shown above) Retry boot list Enabled If enabled, BIOS automatically retries to boot from the top of the...
Page 267 BIOS Setup Utility Screens Option Default Description OSA Configuration > OSA Enabled Open OSA Configuration screen and toggle OSA Internal Support Internal Support to enable or disable booting OSA from the internal USB port Boot Option Priority Order of Move items up and down the list to change the boot priority order in discovery by legacy boot mode.
Page 268 Sun Server X4-8 Service Manual • December 2015...
Page 269: Index
50 Service Action Required indicators, 36 slot designations, 84 Charge Status indicator, 68 clearing faults, 92 designations, components, 82 diagnosing hardware faults, 58 controlling the Locator indicator, 109, 111 diagnostic tools powering off, 104 Oracle ILOM, 71...
Page 270 Index Pc-Check, 71 faults U-Boot, 71 clearing, 92 DIMM filler panels, 92 installing, 148 fmadm tool, 92 overview, 24 front indicator module (FIM) reference, 154 installing, 130 removing, 151 location, 34 replacing, 142 removing, 129 slot designations, 85 full power mode, 107 slot location, 28 dual PCIe card carrier (DPCC) installing, 191...
Page 271 34 Service Action Required on-board test circuit, 68 back panel, 43 Oracle ILOM, 71 front panel, 34 Oracle System Assistant, 33, 45 Service Action Required Rear overview front panel, 34 back side components, 23 SMOD, 43 chassis, 20...
Page 272 Index static prevention anti-static mat, 91 removing anti-static wrist strap, 90 CMOD, 133 storage drive CMOD cover, 136 backplanes, 32 DIMM, 151 installing, 179 DPCC, 183 overview, 31 fan frame, 118 reference, 182 fan module, 113 removing, 176 FIM, 129 slot designations, 86 HBA, 200 support, product, 76...
Page 273 Index server, 53 U-Boot diagnostic tool, 71 USB flash drive (internal) installing, 212 removing, 210 USB ports internal, 33 warm service, preparing the server, 96 web interface controlling the Locator indicator, 110 powering off, 105...
Page 274 Sun Server X4-8 Service Manual • December 2015...

Oracle SUN X4-8 Service Manual

Table of Contents

Using this Documentation

About this Document

Service Notes

Server and Components Overview

Server Subsystems

Servicing the Server

Panel.

Servicing Components

Before You Begin for Component Serviceability, Locations, and Designations, See

Before You Begin for Component Serviceability, Locations, and Designations, See

Prepare the Server for Hot Service. See Service" on Page 95. Alternatively, to Prepare the Server for Cold Service, See Service

Returning the Server to Operation

BIOS Setup Utility

Index

Quick Links

Chapters

Troubleshooting

Related Manuals for Oracle SUN X4-8

Summary of Contents for Oracle SUN X4-8

Table of Contents