1. Manuals
  2. Brands
  3. Oracle Manuals
  4. Server
  5. X7-8
  6. Service manual

Oracle X7-8 Service Manual

Hide thumbs Also See for X7-8:
Table of Contents

Advertisement

Quick Links

Download this manual See also: Service Manual
Oracle
Server X7-8 Service Manual
®
Part No: E71936-01
October 2017

Advertisement

Table of Contents
loading

Related Manuals for Oracle X7-8

Summary of Contents for Oracle X7-8

  • Page 1 Oracle Server X7-8 Service Manual ® Part No: E71936-01 October 2017...
  • Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
  • Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...
  • Page 5 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
  • Page 6 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...

  • Page 7: Table Of Contents

    Contents Using This Documentation ................ 15 Product Documentation Library ...............  15 Feedback ...................... 15 About the Oracle Server X7-8 ................ 17 Product Description .................. 17 About Controls and Connectors ...............  19 Front Panel Components ................. 19 Back Panel Components .................  21 Identifying Components .................. 24 Illustrated Parts Breakdown .............. 24 Component Serviceability Requirements ............  26 Customer-Replaceable Units .............. 26 Field-Replaceable Units ................
  • Page 8 Contents ▼ Clear Hardware Fault Messages (Oracle ILOM) ........ 53 Managing Server Hardware Faults Through the Oracle ILOM Fault Management Shell .................  55 Troubleshooting Using a CMOD Fault Remind Test Circuit ...... 55 Troubleshooting System Cooling Issues ............. 55 Troubleshooting Power Issues .............. 57 Troubleshooting Using Diagnostic Tools ............ 58 Diagnostic Tools ...................
  • Page 9 ▼ Prepare the Server for Warm Service (Oracle ILOM Web Interface) .. 107 ▼ Prepare the Server for Cold Service (Oracle ILOM CLI) ...... 108 ▼ Prepare the Server for Cold Service (Oracle ILOM Web Interface) ...  110 Powering Down the Server ................ 111 ▼ Power Down the Server Gracefully (Oracle ILOM CLI) ...... 112 ▼...
  • Page 10 DIMM Operating Speeds .............. 188 DIMM Rank Classification Labels ............ 188 Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs .................. 188 ▼ Identify and Remove a Faulty DIMM .......... 189 ▼ Install a DIMM ................ 192 Oracle Server X7-8 Service Manual • October 2017...
  • Page 11 ▼ Access BIOS Setup Utility Menus .............  241 ▼ Navigate BIOS Setup Utility Menus .......... 242 Using UEFI BIOS .................. 244 Configuration Utilities for Add-In Cards .......... 244 Configure and Manage BIOS Using Oracle ILOM ........ 244 UEFI Secure Boot ................ 245 Trusted Execution Technology ...............  245 Common BIOS Setup Utility Tasks .............. 245 ▼...
  • Page 12 BIOS Boot Menu Selections ................ 290 BIOS Save and Exit Menu Selections .............. 292 Monitoring and Identifying Server Components .......... 295 Monitoring Component Health and Faults Using Oracle ILOM ...... 295 Monitoring System Components .............. 296 System Components (FRUs) Network Access Control (NAC) Names ....  297 System Indicators Network Access Control (NAC) Names ........ 298 System Sensors Network Access Control (NAC) Names ........
  • Page 13 Contents Index ........................  303...
  • Page 14 Oracle Server X7-8 Service Manual • October 2017...

  • Page 15: Using This Documentation

    Using This Documentation Overview – Describes how to troubleshoot and maintain the Oracle Server X7-8. ■ Audience – Technicians, system administrators, authorized service providers, and trained ■ hardware service personnel who have been instructed on the hazards within the equipment and are qualified to remove and replace hardware.
  • Page 16 Oracle Server X7-8 Service Manual • October 2017...

  • Page 17: About The Oracle Server X7-8

    Server X7-8 Installation Guide. Product Description Oracle Server X7-8 is an enterprise class 5 rack unit (5U) server. You can configure the server as one 4-socket server, two independent 4-socket servers, or one 8-socket server. The system supports the following components.
  • Page 18 ■ Oracle Integrated Lights Out Management (ILOM). Refer to the Oracle ILOM 4.0 Documentation Library at http://www.oracle.com/goto/ilom/docs ■ Oracle Hardware Management Pack, available with the Oracle Solaris OS or as a standalone product with other OS. Refer to the support matrix for specific information http://www.oracle.

  • Page 19: About Controls And Connectors

    About Controls and Connectors Feature System Component For updated operating system informaiton, refer to the Oracle Server X7-8 Product Notes at http:// www.oracle.com/goto/x7-8/docs For server specification information, see “Server Features and Components” in Oracle Server X7-8 Installation Guide. For component serviceability, locations, and designations, see “Identifying...
  • Page 20 Chassis rear Fault-Service Required LED: amber Rear Fault-Service Required LED: amber CMOD Fault-Service Required LEDs 0, 1, 2, 3: amber ■ SMOD1 System B controls and indicators: Locate Button/LED:white Fault-Service Required LED: amber Oracle Server X7-8 Service Manual • October 2017...

  • Page 21: Back Panel Components

    System A: CMODs 0-3; System B: CMODs 4-7. 4-socket mode: CMODs 0-3. 8-socket mode: CMODs 0-7 For component serviceability, locations, and designations, see “Identifying Components” on page Back Panel Components The following figure shows the Oracle Server X7-8 chassis back panel components: About the Oracle Server X7-8...
  • Page 22 (FRU)” on page 195 SMOD1 System B USB “System Module (SMOD) Overview” on page 34 The SMOD1 System B USB 3.0 port supports hot-plugging of devices. “Servicing System Module (SMOD) Components (FRU)” on page 195 Oracle Server X7-8 Service Manual • October 2017...
  • Page 23 SMOD0 System A SER MGT “System Module (SMOD) Overview” on page 34 Serial management port SER MGT uses an RJ-45 cable and terminal (or emulator) to provide access to the Oracle ILOM command-line interface “Servicing System Module (SMOD) Components (CLI). (FRU)” on page 195 SMOD0 System A USB “System Module (SMOD)

  • Page 24: Identifying Components

    SMOD0 System A: AC 3 (Top), AC 2 ; SMOD1 System B: AC 1, AC 0 “AC Power Block Inlet Indicators” on page 71 (bottom) The server does not provide video display ports on the SMODs. Use Oracle ILOM Note - rKVMS to display video.
  • Page 25 “Servicing CPU Module (CMOD) Components (FRU)” on page 160 Memory, front panel accessible “Servicing CPU Module (CMOD) Components (FRU)” on page 160 Fan frame (2), front panel accessible “Servicing Fan Modules (CRU) and Fan Frames (CRU)” on page 129 About the Oracle Server X7-8...

  • Page 26: Component Serviceability Requirements

    Warm service components can be serviced while the server is in Standby power mode. ■ You can remove and replace CMODs, DIMMs, and processors and heatsinks without disconnecting the back panel power cords or shutting down Oracle ILOM. Cold service components must be serviced when the server is completely powered off and ■...

  • Page 27: Field-Replaceable Units

    (FRU)” on page 160 Add or replace RDIMM or LRDIMM memory modules located in CMODs. Warm SMOD Cold-serviceable “Servicing System Module (SMOD) Components (FRU)” on page 195 Add or replace system module assemblies SMOD0 or SMOD1. About the Oracle Server X7-8...

  • Page 28: Cpu Module (Cmod) Overview

    Cold-serviceable “Servicing the Host Bus Adapter (HBA) card Card” on page 200 Located in SMODs, the Oracle Storage 12Gb SAS PCIe RAID HBA, Internal 16-Port manages SAS storage drives. Front indicator Contains push-button circuitry and LED indicators that are “Servicing the Front Indicator Module module (FIM) displayed on the chassis bezel.

  • Page 29: Cmod Components

    Fault Remind Test Circuit, which helps you locate failed DIMMs and verify a failed CPU ■ Fault Remind button ■ 12 DIMM slot fault indicators ■ 1 CPU fault indicator ■ The following illustration shows CMOD component locations. About the Oracle Server X7-8...

  • Page 30: Cmod Processor

    Eight CPU modules installed in slots 0 through 7 ■ 24 cores per-socket (224 total) ■ The Processor Heatsink Module (PHM) is a three part module that is installed above the socket assembly: Oracle Server X7-8 Service Manual • October 2017...

  • Page 31: Cmod Memory

    Processor, part of PHM Socket “Servicing Processors” on page 170. CMOD Memory The maximum system memory with DDR4-2666 64 GB LRDIMMs is: Four CMODs: 3 TB with 48x64 GB ■ Eight CMODs: 6 TB with 96x64 GB ■ About the Oracle Server X7-8...
  • Page 32 Channel A, Slot 0, DIMM 6 Channel A, Slot 1, DIMM 7 Channel B, Slot 0, DIMM 8 Channel B, Slot 1, DIMM 9 Channel C, Slot 0, DIMM 10 Channel C, Slot 1, DIMM 11 Oracle Server X7-8 Service Manual • October 2017...

  • Page 33: Cmod And Fan Module Power

    Fan modules (FMs) recieve power from CMODs. However, only CMODs in even-numbered slots supply power to fan modules. The following table shows which CMOD slots provide FM power. Four fan modules per SMOD are front panel accessible. About the Oracle Server X7-8...

  • Page 34: System Module (Smod) Overview

    One Internal PCIe slot for RAID storage HBA connectivity to drive bays. ■ This PCIe slot is populated by one PCIe Gen3 x8 HBA per SMOD (Oracle Storage 12Gb SAS PCIe RAID HBA, Internal 16-Port). Four ports in the card are used for SAS connectivity.
  • Page 35 2.5-inch, hot-swappable SAS3 hard disk drives (HDDs) or eight 2.5-inch SAS3 solid state drives (SSDs). Two SMODs are accessible from the back panel of the server. The following illustration shows SMODs and removal and installation levers with green lock release tabs. About the Oracle Server X7-8...

  • Page 36: Smod Components

    The following illustration shows an SMOD (system module) and associated components, including an Oracle Storage 12Gb SAS PCIe RAID HBA, Internal 16-Port card installed below the SMOD, two SAS cables that connect the HBA card to the server storage backplanes, and a cable that connects the energy storage module to the HBA card.
  • Page 37 System Module (SMOD) Overview Call Description SAS host bus adaptor (HBA): Oracle Storage 12Gb SAS PCIe RAID HBA, Internal 16-Port Energy storage module (ESM) Cable from HBA to ESM SMOD motherboard Storage Drive SMOD Midplane connectors (4) Four server storage drives 0-3 (HDD/SSD), back panel accessible External USB port, back panel accessible NET MGT ILOM service processor (SP) network management 10/100/1000BASE-T port.

  • Page 38: Smod Motherboard

    The system Emulex Pilot 4 service processor (SP) is located on the SMOD motherboard and is accessible locally and remotely through management ports on the front of the SMOD. The SP contains Oracle ILOM, an embedded server management tool. The SP is not removable.

  • Page 39: Server Storage Drives

    The following illustration shows the eight storage drive externally-accessible back panel bay locations, which are arranged in two rows of four per SMOD. Call Description SMOD0 System A storage drive 0 (HDD/SSD) SMOD0 System A storage drive 1 (HDD/SSD) SMOD0 System A storage drive 2 (HDD/SSD) About the Oracle Server X7-8...

  • Page 40: Server Chassis Overview

    “Chassis Back Panel Components” on page 43 ■ “Switches and Buttons Reference” on page 45 ■ The server chassis assembly contains front panel, back panel, and internal accessible components.The following figure shows the server chassis front panel (1). Oracle Server X7-8 Service Manual • October 2017...
  • Page 41 “CPU Module (CMOD) Overview” on page 28 ■ “System Module (SMOD) Overview” on page 34 ■ Chassis Features The Oracle Server X7-8 chassis features are: One 5U chassis with central mid-plane. ■ One Front Indicator Module (FIM) with controls and indicators. ■...
  • Page 42 CMODs. Servicing CMODs requires warm or cold Overview” on page service. “Servicing CPU Module (CMOD) Components (FRU)” on page 160 Chassis Front Panel Components The following figure shows the server chassis front panel accessible replaceable components. Oracle Server X7-8 Service Manual • October 2017...
  • Page 43 “Servicing Fan Modules (CRU) and Fan Frames (CRU)” on page 129 Server chassis “Server Chassis Overview” on page 40 The server chassis is not a removable component. Chassis Back Panel Components The following illustration shows the chassis back panel. About the Oracle Server X7-8...
  • Page 44 The AC power block has four AC power inlet “Power connectors, two for each SMOD. The power block Subsystem” on page 83 is not a removable component. “AC Power Block Inlet Indicators” on page 71 Oracle Server X7-8 Service Manual • October 2017...
  • Page 45 (CRU)” on page 148 (attention) buttons installing a DPCC that contains a PCIe card, press the button again. “Dual PCIe Card Carrier (DPCC) (two on each DPCC) Indicators” on page 70 “Back Panel Components” on page 21 About the Oracle Server X7-8...
  • Page 46 Oracle Server X7-8 Service Manual • October 2017...

  • Page 47: Troubleshooting And Diagnostics

    “Attaching Devices to the Server” on page 89 ■ “Getting Help” on page 94 ■ For more information about server troubleshooting and diagnostics, refer to the Oracle x86 Servers Diagnostics and Troubleshooting Guide for Servers With Oracle ILOM 4.0.x at http:// www.oracle.com/goto/x86admindiag/docs.

  • Page 48: Troubleshooting Server Hardware Faults

    When a server hardware fault event occurs, the system lights the Fault-Service Required LED and captures the event in the system event log (SEL). If you set up notifications through Oracle ILOM, you also receive an alert through the notification method you chose. When you become aware of a hardware fault, address it immediately.
  • Page 49 Log into the Oracle ILOM service processor from the Oracle ILOM Fault Management ■ Shell and issue the fmadm faulty command. The purpose of the Oracle ILOM Fault Management Shell is to help Oracle Service Caution - personnel diagnose system problems. Customers should not launch this shell or run fault management commands in the shell unless requested to do so by Oracle Service personnel.
  • Page 50 “Using Oracle ILOM” in Oracle Server X7-8 Installation Guide ■ Identify Hardware Faults (Oracle ILOM) Use this procedure to troubleshoot hardware faults with the Oracle ILOM web interface and, if necessary, prepare the server for service. Note - The screens and information in this procedure might differ from those for your server.
  • Page 51 Identify Hardware Faults (Oracle ILOM) The Status table lists components that require service. In the above example, the Status table shows that the Memory subsystem requires service. This indicates that a hardware component within the subsystem is in a fault state.
  • Page 52 Oracle Server X7-8 Product Notes Release 1.0 contains up-to-date information about the server, including hardware-related issues. To prepare the server for service, see “Preparing for Service” on page Oracle Server X7-8 Service Manual • October 2017...

  • Page 53: Clear Hardware Fault Messages (Oracle Ilom)

    Oracle Service personnel. Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example:...
  • Page 54 ■ -u uuid – Show fault diagnosis events that match a specific universal unique identifier ■ (uuid). For command specifics, see the Oracle ILOM documentation at: http://www.oracle.com/ goto/ilom/docs Type fmadm to clear the fault. Select acquit, repair, replaced, or repaired.

  • Page 55: Managing Server Hardware Faults Through The Oracle Ilom Fault Management Shell

    For more information about how to use the Oracle ILOM Fault Management Shell, see the Oracle ILOM User's Guide for System Monitoring and Diagnostics Firmware Release 4.0.x in the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at...
  • Page 56 ■ To reduce the risk related to component failure, power supplies and fan modules are installed in pairs to provide redundancy. Redundancy ensures that if one component in the pair fails, the other functioning component can continue to Oracle Server X7-8 Service Manual • October 2017...

  • Page 57: Troubleshooting Power Issues

    Clear Hardware Fault Messages (Oracle ILOM) Cooling Issue Description Action Prevention maintain the subsystem. For example, power supplies serve a dual function; they provide both power and airflow. If one power supply fails, the other functioning power supply can maintain both the power and the cooling subsystems.

  • Page 58: Troubleshooting Using Diagnostic Tools

    Diagnostic tools range in complexity from a comprehensive validation test suite (Oracle VTS) to a chronological event log (Oracle ILOM System Log). Tools include standalone software packages, firmware-based tests, and hardware-based LED status indicators.

  • Page 59: Troubleshooting Using Status Indicators

    Troubleshooting Using Status Indicators Diagnostic Tool Diagnostic Type Function Availability and Access Links View Oracle ILOM System Log. Oracle Hardware View System Log. Monitor Access either in Standby power http://www.oracle. Management Pack environmental conditions or Main power mode. OS com/goto/ohmp/docs and component functionality independent.

  • Page 60: Front Indicator Module (Fim) Panel

    8-socket: The FIM provides controls and indicators for System A (SMOD0) and System B ■ CMODs 4-7. Other System B (SMOD1) buttons and indicators are not operational. The following figure shows FIM buttons and indicators. Oracle Server X7-8 Service Manual • October 2017...
  • Page 61 Indicates the location of the SMOD System A in the server: SMOD0 System A) ■ Off – Server is operating normally. ■ Fast blink – Use Oracle ILOM to activate this LED to enable you to locate a system quickly and easily. White On when SMOD0 System A Locate Button on the server is pressed.
  • Page 62 Indicates the SMOD1 System B location in the server when pressed. System B ■ Off – Server is operating normally, ■ Fast blink – Use Oracle ILOM to activate this LED to enable you to locate a system quicklly and easily. White “Managing the Locate Button/LED”...

  • Page 63: Fan Module (Fm) Indicators

    238. SP OK SMOD1 System B Indicates when SMOD1 System B SP Service Processor (SP) is booting: ■ Flashing – SP is booting. ■ Steady On – Oracle ILOM is operational. Green “System Module (SMOD) Indicators” on page 65 “Troubleshooting Using Status Indicators”...

  • Page 64: Power Supply (Ps) Indicators

    Each power supply (PS) has three indicators arranged in a single row from left to right. Power supplies for System A are PS2 and PS3. Power supplies for System B are PS0 and PS1. Oracle Server X7-8 Service Manual • October 2017...

  • Page 65: System Module (Smod) Indicators

    ■ Off – Power supply is operating normally, Required ■ Fast blink – Use Oracle ILOM to activate this LED to enable you to locate a power supply quickly and easily. ■ Steady On –Lights steady on when the power supply is in a fault state.
  • Page 66 Oracle ILOM tasks. ■ Off – Server is operating normally, White ■ Fast blink – Use Oracle ILOM to activate this LED to enable you to locate a system quicklly and easily. “Managing the Locate Button/LED” on page 120.
  • Page 67 SMOD System OK Indicates the operational state of the SMOD: ■ Off – AC power is not present or the Oracle ILOM boot is not complete. ■ Flashing – SMOD is booting. ■ Steady On – OS has booted, power is on and chassis SMOD is running.
  • Page 68 (GbE) RJ-45 NET 3 port is active. Indicates a live network. Top right ■ Off– No activity. No link. Not operational. Bi-colored: ■ FLASHING – Packet activity. Blinks with network traffic. Amber/ Green NET 3 Link speed LED: Top right Bi-colored: Amber/Green Oracle Server X7-8 Service Manual • October 2017...

  • Page 69: Storage Drive Indicators

    OK/Activity LED Indicates the operational state of the storage drive: ■ Off – AC power is not present or the Oracle ILOM boot is not complete. ■ Flashing – Blinks to show storage drive activity. Storage drive indicators blink rates vary by activity. See “Status Indicator Blink Rates”...

  • Page 70: Dual Pcie Card Carrier (Dpcc) Indicators

    PCIe card, press the ATTN button again. Call Status LED Icon and Description Color ATTN ATTN Attention (ATTN) DPCC Recessed pinhole button Fault-Service Required/ DPCC Fault-Service Required Locate LED Indicates a fault state in DPCC: Oracle Server X7-8 Service Manual • October 2017...

  • Page 71: Ac Power Block Inlet Indicators

    ■ Steady On – A fault is present in chassis SMOD0 System A. DPCC Locate LED ■ Off – DPCC is operating normally, ■ Fast blink – Use Oracle ILOM to activate this LED to enable you to locate a DPCC quickly and easily. DPCC OK indicator Indicates the operational state of DPCC: ■...

  • Page 72: About Controls And Connectors

    Do not attach power cables to the power supplies until you finish connecting the data cables to the server. The server goes into Standby power mode, and the Oracle ILOM service processor initializes when the AC power cables are connected to the power source. System messages might be lost after 60 seconds if the server is not connected to a terminal, PC, or workstation.
  • Page 73 Troubleshooting Using Status Indicators Front Panel Lamp Test ■ For the error state scenarios described below, the OK indicator state depends on presence Note - of redundant components and the severity of the fault. Server Boot Process and Normal Operating State Indicators A normal server boot process involves System A (SMOD0) or System B (SMOD1) service processor SP OK indicator and System OK indicator.
  • Page 74 FIM and back panel SMOD0 and SMOD1. When the Locate Button/LED is on, the LED blinks at the fast blink rate. You can turn the Locate Button/LED off remotely from Oracle ILOM, or by pressing a Locate button. The buttons on the server front and back allow you to manage System A (SMOD0) and System B (SMOD1) Locate Buttons/LED indicators locally.
  • Page 75 Troubleshooting Using Status Indicators Call System Activity System A ■ Single 4 socket: The FIM Locate Button/LED indicator provides controls and indicators for System A SMOD0 (SMOD0) only. ■ Dual 4 socket: The FIM Locate Button/LED indicator provides separate controls and indicators for System A (SMOD0) and System B (SMOD1).
  • Page 76 This section shows the location of the back panel pinhole switches. Call Button Icon Description Non-maskable Interrupt (NMI) Do not press. This button is used by Oracle Service personnel only and button (recessed) SMOD0 requires a stylus. Oracle Server X7-8 Service Manual • October 2017...

  • Page 77: Status Indicator Blink Rates

    Performs an immediate System A (SMOD0) host reboot and requires a stylus. SMOD0 Non-maskable Interrupt (NMI) Do not press. This button is used by Oracle Service personnel only and button (recessed) SMOD1 requires a stylus. SP Reset button (recessed) SMOD1 Performs an immediate System B (SMOD1) SP reboot and requires a stylus.
  • Page 78 (1 Hz) and turns off for half a second. The slow blink rate indicates an on-going activity. For example, device rebuilding, booting, or in transition from one mode to another. Oracle Server X7-8 Service Manual • October 2017...
  • Page 79 Troubleshooting Using Status Indicators Fast Blink Rate For the fast blink rate, the indicator repeatedly blinks twice (on, off, on) during a one second interval (2 Hz). The fast blink rate indicates activity or data transfer. Single (Standby) Blink Rate For the single blink rate, the indicator repeatedly flashes once at the beginning of a three second interval.
  • Page 80 1 Hz. This indicates that a component has an incorrect version or mismatch (for example, a power supply with a lower rating than the one specified). The blink rate is also used for an unsupported component, or a component in an unsupported slot. Oracle Server X7-8 Service Manual • October 2017...

  • Page 81: Troubleshooting Server Subsystems

    Troubleshooting Server Subsystems Feedback Flash The indicator flashes on and off during periods of activity, commensurate with the activity, but the flashing does not exceed the 2 Hz fast blink rate (see, “Fast Blink Rate” on page 79). For example, this blink rate occurs during disk drive read and write activity and communication port transmit and receive activity.

  • Page 82: Processor Subsystem

    “Identifying Components” on page Processor Subsystem Use the Oracle Integrated Lights Out Manager (ILOM) Processors page to view the health of the CPUs installed on the CMODs. The server processor subsystem consists of the following: On-demand configuration for one 4-socket server, two independent 4-socket servers, or one 8- socket server.

  • Page 83: Memory Subsystem

    Intel 8160 processor, 24-core, 2,1-GHz, 150W (4-socket servers or 8-socket server) ■ Memory Subsystem Use the Oracle Integrated Lights Out Manager (ILOM) Memory page to view the health of the DIMMs installed on your system. The server memory subsystem consists of the following: Memory: Up to 48 (4-socket) or up to 96 (8-socket) DDR4 RDIMM slots.

  • Page 84: Cooling Subsystem

    118. Cooling Subsystem Use the Oracle Integrated Lights Out Manager (ILOM) Cooling page to view the health and number of fans installed in your system. Additionally, you can view the server inlet and exhaust temperatures. Review the Fans table for details about the health and location of individual fans.
  • Page 85 Troubleshooting Server Subsystems concentrated through the power supplies (PSs) and is provided by the internal PS fan modules. In a 4 socket configuration, zones 1 and 2 operate independently from zones 3 and 4. The fan modules (FM0- FM7) provide the airflow for cooling zones 1-4. Each zone has a pair of dedicated FMs: Zone 1 airflow cooling is concentrated on the CPU modules (CMODs) CMOD0 and ■...

  • Page 86: Storage Subsystem

    Frames (CRU)” on page 129. Storage Subsystem Use the Oracle Integrated Lights Out Manager (ILOM) Storage page to view tables listing health and inventory information for storage devices detected on your server. Oracle Server X7-8 Service Manual • October 2017...

  • Page 87: Networking Subsystem

    Volumes ■ Expanders ■ Networking Subsystem Use the Oracle Integrated Lights Out Manager (ILOM) Networking page to view networking information, including Ethernet Controllers and Infiniband Controllers. The server networking subsystem consists of the following: Ethernet Controllers ■ SMOD0 System A NET 0-3 1/10 GbE Network ports labeled NET0, NET1, NET2, and...

  • Page 88: Pci Devices Subsystem

    “Back Panel Connector Locations” on page PCI Devices Subsystem Use the Oracle Integrated Lights Out Manager (ILOM) PCI Devices page to view inventory properties for the PCIe add-in cards and the built-in devices that are detected on your server. To view the inventory properties for the devices shown on the PCI Devices page, follow these steps: Click the link at the top of the page for the appropriate PCI device.

  • Page 89: Attaching Devices To The Server

    Attaching Devices to the Server On-board devices: Internal HBAs (SAS controllers) in SMODs ■ Dual PCIe Card Carrier (DPCC) In the following figure, callout 1 shows the location of the dual PCIe card carrier (DPCC) bays. The eight DPCCs are directly accessible from the server back panel and are located below the SMOD.

  • Page 90: Attach Devices To The Server

    Connect an Ethernet cable to the Gigabit Ethernet (NET) connectors as needed for OS support. To connect to Oracle ILOM over the network, connect an Ethernet cable to the Ethernet port labeled NET MGT. To access the Oracle ILOM command-line interface (CLI) locally using the management port, connect a serial null modem cable to the RJ-45 serial port labeled SER MGT.
  • Page 91 Attach Devices to the Server Callout Description System/SMOD Available On Net management port (NET MGT) System B –SMOD1 Dual 4-socket systems only Serial management port (SER MGT) System B –SMOD1 Dual 4-socket systems only USB 3.0 port System B –SMOD1 Dual 4-socket systems only ■...

  • Page 92: Configuring Serial Port Sharing

    200-240 VAC only. Configuring Serial Port Sharing By default, the NET MGT serial port connects to the SP console. Using Oracle ILOM, you can configure the NET MGT serial port to connect to the host console instead. This feature is useful for Windows kernel debugging, as it enables you to view non-ASCII character traffic from the host console.

  • Page 93: Ethernet Device Naming

    Connect a serial host to the server. Assign Serial Port Output (Oracle ILOM Web Interface) Log in to the SP Oracle ILOM web interface. To log in, open a web browser and direct it using the IP address of the server SP.

  • Page 94: Getting Help

    Email address and phone number for you and a secondary contact Street address where the system is located Superuser password Summary of the problem and the work being done when the problem occurred Oracle Server X7-8 Service Manual • October 2017...

  • Page 95: Locating The Chassis Serial Number

    Oracle Auto Service Requests (ASR) is a feature available to customers having Oracle Premier Support and is provided to those customers at no additional cost. Oracle ASR is the fastest way to restore system availability if a hardware fault occurs. Oracle ASR software is secure and customer installable, with the software and documentation downloadable from My Oracle Support at https://support.oracle.com.
  • Page 96 Auto Service Requests For more information about Oracle ASR, go to: http://www.oracle.com/us/support/auto- service-request/index.html. Oracle Server X7-8 Service Manual • October 2017...

  • Page 97: Preparing For Service

    Setting up for hot service “Prepare the Server for Hot Service (Oracle ILOM CLI)” on page 103 “Prepare the Server for Hot Service (Oracle ILOM Web Interface)” on page 104 Setting up for warm service “Prepare the Server for Warm Service (Oracle ILOM CLI)”...

  • Page 98: Performing Electrostatic Discharge And Static Prevention Measures

    Safety Symbols The following symbols might appear in this document. Note their meanings. Risk of personal injury or equipment damage. To avoid personal injury or Caution - equipment damage, follow the instructions. Oracle Server X7-8 Service Manual • October 2017...

  • Page 99: Warning Label

    ■ FRU Key Identity Properties (KIP) Automated Update Oracle ILOM includes a key identity properties (KIP) auto-update feature that ensures product information that is used for service entitlement and warranty coverage is accurately maintained by the server at all times, including during hardware replacement activities.

  • Page 100: Required Tools And Equipment

    ■ When a server FRU that contains the KIP is removed and a replacement component is installed, the KIP of the replacement component is programmed by Oracle ILOM to contain the same KIP as the other two components. Only one of the quorum members can be replaced at a time. Automated updates can only Note - be completed when two of the three quorum members contain matching key identity properties.

  • Page 101: Preparing The Server For Component Replacement

    “Prepare the Server for Hot Service (Oracle ILOM CLI)” on page 103 ■ “Prepare the Server for Hot Service (Oracle ILOM Web Interface)” on page 104 ■ “Prepare the Server for Warm Service (Oracle ILOM CLI)” on page 105 ■...
  • Page 102 Dual PCIe Card Carriers (DPCCs) “Servicing PCIe Cards and Carriers ■ (CRU)” on page 148 “Prepare the Server for Hot Service (Oracle ILOM CLI)” on page 103 “Prepare the Server for Hot Service (Oracle ILOM Web Interface)” on page 104.

  • Page 103: Prepare The Server For Hot Service (Oracle Ilom Cli)

    Main power mode. For more information about component serviceability, see “Component Serviceability Requirements” on page Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example: ipaddress ssh root@ where ipaddress is the IP address of the server module SP.

  • Page 104: Prepare The Server For Hot Service (Oracle Ilom Web Interface)

    Serviceability Requirements” on page Log in to the service processor Oracle ILOM web interface. Direct a web browser to Oracle ILOM using the IP address of the server SP and log in as root or a as user with administrator privileges. See “Accessing Oracle ILOM”...

  • Page 105: Prepare The Server For Warm Service (Oracle Ilom Cli)

    AC power cords or shutting down Oracle ILOM. When Oracle ILOM detects that two fan modules in a single cooling zone (a vertical column) have been removed, the SP removes power from the CMODs, allowing you to service CMODs and their subcomponents without removing the power cords.
  • Page 106 This procedure is performed locally and requires physical access to the server front Note - panel. Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example: ipaddress ssh root@ where ipaddress is the IP address of the server module SP.

  • Page 107: Prepare The Server For Warm Service (Oracle Ilom Web Interface)

    Log in to the service processor Oracle ILOM web interface. Direct a web browser to Oracle ILOM using the IP address of the server SP and log in as root or a as user with administrator privileges. See “Accessing Oracle ILOM” in Oracle Server X7-8 Installation Guide.

  • Page 108: Prepare The Server For Cold Service (Oracle Ilom Cli)

    Prepare the Server for Cold Service (Oracle ILOM CLI) Power down the server. In the Actions section of the Summary Information page, click the Power State Turn Off button. This action powers off the server to Standby power mode. For more power off options, see “Powering Down the Server”...
  • Page 109 This procedure is performed locally and requires physical access to the server front and back panels. Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example:...

  • Page 110: Prepare The Server For Cold Service (Oracle Ilom Web Interface)

    Log in to the service processor Oracle ILOM web interface. Direct a web browser to Oracle ILOM using the IP address of the server SP and log in as root or a as user with administrator privileges. See “Accessing Oracle ILOM” in Oracle Server X7-8 Installation Guide.

  • Page 111: Powering Down The Server

    Performing a CLI)” on page 112 graceful shutdown ensures that the system is ■ “Power Down the Server Gracefully (Oracle ILOM Web ready for restart. Interface)” on page 113 ■ “Power Down the Server Gracefully” on page 114 If the server is not responding, or you must ■...

  • Page 112: Power Down The Server Gracefully (Oracle Ilom Cli)

    At the Oracle ILOM prompt, shut down the operating system: -> stop /System If the system is running the Oracle Solaris OS, refer to the Oracle Solaris system administration documentation for additional information. Disconnect the power and cables from the server.

  • Page 113: Power Down The Server Gracefully (Oracle Ilom Web Interface)

    Power Down the Server Gracefully (Oracle ILOM Web Interface) When you power down the server using Oracle ILOM, the server enters Standby Caution - power mode. Power is still directed to the service processor remote management subsystem and power supply fans. To completely power off the server, you must disconnect the power cords from the power supplies.

  • Page 114: Power Down The Server Gracefully

    Disconnect the power cords and data cables from the server. “Remove Power” on page 119. When you power down the server using Oracle ILOM, the server enters Standby Caution - power mode. Power is still directed to the service processor remote management subsystem and power supply fans.

  • Page 115: Power Down The Server For Immediate Shutdown (Oracle Ilom Cli)

    Log in to the Oracle ILOM command-line interface (CLI) using an Administrator account. Oracle ILOM displays the default command prompt (->), indicating that you have successfully logged in to Oracle ILOM. From the CLI prompt, type the following command: ->...

  • Page 116: Power Down The Server For Immediate Shutdown (Oracle Ilom Web Interface)

    Disconnect the power and data cables from the server. “Remove Power” on page 119. When you power down the server using Oracle ILOM, the server enters Standby Caution - power mode. Power is still directed to the service processor remote management subsystem and power supply fans.

  • Page 117: Power Off The Server Using The Server Os

    Related Information “Controls and Indicators” on page 72 ■ “Power Down the Server for Immediate Shutdown (Oracle ILOM CLI)” on page 115 ■ “Power Down the Server for Immediate Shutdown (Oracle ILOM CLI)” on page 115 ■...

  • Page 118: Power Control, Shutdown, And Reset States

    The Power OK and SP OK indicators are steady on. To enter Main power mode, press the On/Standby button on the server front panel when the server is in Standby power mode. You can also enter Main power mode by powering on the server from Oracle ILOM.

  • Page 119: Remove Power

    Remove Power Remove Power Use this procedure to completely remove power from the server. Changing the server from Main power mode to Standby power mode does not completely remove power from the server. If you need to completely remove power from the server to perform cold service or a cold reset or to place the server in a non-powered state, you must disconnect the AC power cables from the back of the server.

  • Page 120: Managing The Locate Button/Led

    Before going to the server, you can activate the server Locate Button/LED to help you identify the server in the rack. Open an SSH session and at the command line log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example:...

  • Page 121: Turn On The Locate Button/Led Remotely (Oracle Ilom Web Interface)

    Turn On the Locate Button/LED Remotely (Oracle ILOM Web Interface) locator_indicator = Off The value locator_indicator shows the status as either On or Off. Turn On the Locate Button/LED Remotely (Oracle ILOM Web Interface) Before going to the server, you can activate the server Locate Button/LED indicator to help you identify the server in the rack.

  • Page 122: Component Filler Panels And Non-Powered Components

    Button/LED button. To turn on the Locator indicator, press the Locate Button/LED button. ■ Some Oracle ILOM security procedures require that you turn on the Locate Button/LED Note - indicator locally, as part of a physical presence verification step. To perform a lamp test of all front panel indicators, press the Locate Button/ ■...

  • Page 123: Servicing Components

    Servicing Components This section includes the following removal and installation procedures for customer- replaceable and field-replaceable components in the Oracle Server X7-8. Section Description Link Remove and install server storage drives. “Servicing Storage Drives (CRU)” on page 123 Remove and install fan modules (FM).

  • Page 124: Storage Drive Locations And Numbering

    Slots are arranged in two stacked rows of four slots and designated from right to left. Call Out Description HDD 0 SMOD0 HDD 1 SMOD0 HDD 2 SMOD0 HDD 3 SMOD0 Oracle Server X7-8 Service Manual • October 2017...

  • Page 125: Remove A Storage Drive

    Remove a Storage Drive Call Out Description HDD 0 SMOD1 HDD 1 SMOD1 HDD 2 SMOD1 HDD 3 SMOD1 Storage Drive Population Rules When populating the storage drive slots, use the following rules: 1. Every slot in the storage drive bay must contain either a storage drive or a drive filler panel. 2.
  • Page 126 To remove the drive, rotate the handle to its fully open position and pull the drive out of its slot. Rotating the handle to its fully open position disengages the drive from its internal connector. Consider your next steps: Oracle Server X7-8 Service Manual • October 2017...

  • Page 127: Install A Storage Drive

    Install a Storage Drive If you are replacing the drive, continue to “Install a Storage Drive” on page 127. ■ If you are not replacing the drive, install a filler panel. Install a filler panel in the empty ■ drive slot to maintain proper airflow. Perform administrative tasks to configure the server to operate without the drive.
  • Page 128 Rotate the handle to the closed position. Continue pushing the handle until the drive is flush with the front of the SMOD. Perform administrative procedures to reconfigure the drive. Oracle Server X7-8 Service Manual • October 2017...

  • Page 129: Servicing Fan Modules (Cru) And Fan Frames (Cru)

    Servicing Fan Modules (CRU) and Fan Frames (CRU) The procedures that you perform at this point depend on how your data is configured. You might need to partition the drive, create file systems, load data from backups, or have the drive updated from a RAID configuration.
  • Page 130 FMs. For example, FMs 0 and 1 provide cooling for CMODs 0 and 1, and FMs 6 and 7 provide cooling for CMODs 6 and 7. For CMOD designations, see “CPU Module (CMOD) Overview” on page Oracle Server X7-8 Service Manual • October 2017...

  • Page 131: Remove A Fan Module

    Remove a Fan Module Remove a Fan Module Remove fan modules (FMs) to replace a failed FM, or to access CMODs. Prepare the server for service. Choose one of the following methods: Prepare the server for hot service. ■ FMs are hot-service components. Access CMODs behind the FMs using a hot-service procedure.
  • Page 132 On an eight-CMOD system, this applies to all fan modules. On a four-CMOD system, this applies to the fan modules in the left-side fan frame. To remove the fan module, pull it out of the slot. Oracle Server X7-8 Service Manual • October 2017...

  • Page 133: Install A Fan Module

    Install a Fan Module Electrical hazard. During a hot-service procedure, voltage is present. Do not reach Caution - into the vacant fan module slot with your hand or any object. Do not touch the exposed CMOD fan module power connector. When the fan is removed from the slot, a hinged air vane drops down to close the slot.
  • Page 134 Ensure that the connector on the CMOD and the connector on the fan module are aligned correctly. To install the fan module, slide it into the slot until it stops and gently push it inward until the fan module locks into place. Oracle Server X7-8 Service Manual • October 2017...
  • Page 135 Install a Fan Module The locking action is accompanied by a click sound. Verify that the green Fan OK indicator on the fan module lights and is steady on. Servicing Components...

  • Page 136: Remove A Fan Frame

    Remove the fans associated with the fan frame. To remove the fan frame, hold it by the green labels at the center of the frame and pull it out of the server. Oracle Server X7-8 Service Manual • October 2017...

  • Page 137: Install A Fan Frame

    Install a Fan Frame The center of the fan frame is marked with green labels. The labels indicate where to hold the frame when you want to install or remove it. Related Information “Remove a CMOD” on page 162 ■ Install a Fan Frame When installing a fan frame, handle it by the green labels at the center of the frame.

  • Page 138: Servicing Power Supplies (Cru)

    This section describes how to service power supplies (PS). Power supplies are customer- replaceable units (CRUs) that do not require you to power off the server. For more information about CRUs, see “Illustrated Parts Breakdown” on page 24 “Customer-Replaceable Units” on page Oracle Server X7-8 Service Manual • October 2017...

  • Page 139: Power Supply Overview

    Servicing Power Supplies (CRU) The power supplies are located at the front of the server. See the following procedures: “Power Supply Overview” on page 139 ■ “Remove a Power Supply” on page 141 ■ “Install a Power Supply” on page 144 ■...

  • Page 140: Power Supply Slot Locations And Numbering

    AC inputs are designated AC 0, AC 1, AC 2, and AC 3. The designations match the corresponding power supplies. The AC power block is not a removable component. The following illustration shows the location and designation of the inputs on the AC power block. Oracle Server X7-8 Service Manual • October 2017...

  • Page 141: Remove A Power Supply

    Remove a Power Supply Call Out Description AC3 System A (SMOD0) AC2 System A (SMOD0) AC1 System B (SMOD1) AC0 System B (SMOD1) Remove a Power Supply You might need to remove power supplies to replace a PS or to access the release latch for the front indicator module (FIM).
  • Page 142 Indicates the location of the power supply in the server: ■ Off – Power supply is operating normally, ■ Fast blink – Use Oracle ILOM to activate this Amber LED to enable you to locate a power supply Locate LED quickly and easily.
  • Page 143 Remove a Power Supply Call Status LED or Button Icon and Description Color ■ Steady On – PS is connected to a properly rated AC power source. Ejector lever None Used to release the power supply from the chassis To access the FIM release latch, remove the top power supply (PS3). Note - To unlock the power supply lever, squeeze together the two green release latches at the end of the lever (1).

  • Page 144: Install A Power Supply

    Prepare the server for service. Choose one of the following methods: Prepare the server for hot service. ■ Prepare the server for warm service. ■ Prepare the server for cold service. ■ “Preparing the Server for Component Replacement” on page 101. Oracle Server X7-8 Service Manual • October 2017...
  • Page 145 Install a Power Supply Ensure that the AC power cord for the power supply slot is connected and secured. The power cord connects at the back of the server. Open the power supply lever. Squeeze together the two green release latches at the end of the lever and rotate the lever to the left.
  • Page 146 Pinch point. Keep your fingers clear of the backside of the lever. Caution - Verify that the green Power OK indicator on the power supply indicator panel turns steady on and that the amber Fault-Service Required LED is not lit. Oracle Server X7-8 Service Manual • October 2017...
  • Page 147 Indicates the location of the power supply in the server: ■ Off – Power supply is operating normally, ■ Fast blink – Use Oracle ILOM to activate this Amber LED to enable you to locate a power supply Locate LED quickly and easily.

  • Page 148: Servicing Pcie Cards And Carriers (Cru)

    Customers should not use the procedures in this section to service the Oracle Storage Caution - 12 Gb SAS PCIe RAID HBA, Internal card that is located in SMODs. The Oracle Storage 12 Gb SAS PCIe RAID HBA, Internal cards are field-replaceable units (FRUs) and should be serviced only by authorized Oracle Service personnel.

  • Page 149: Pcie Card And Dpcc Overview

    Servicing PCIe Cards and Carriers (CRU) For a complete list of supported PCIe cards, refer to the Oracle Server X7-8 Product Note - Notes at http://www.oracle.com/goto/x7-8/docs. The server PCIe cards are housed in pairs inside card carriers called DPCCs (dual PCIe card carriers).
  • Page 150 The server contains nine low-profile PCIe slots, eight Gen 3 DPCC slots accessible at the back of the server and one Gen 2 slot, which is located internally (and not directly accessible) Oracle Server X7-8 Service Manual • October 2017...

  • Page 151: Remove A Dpcc

    Remove a DPCC on the system module (SMOD). This internal slot is used for server HBA and provides SAS connectivity to the server storage drives. Dual PCIe Card Carriers (DPCCs) The server contains eight hot-service PCIe Gen 3 DPCCs. Each DPCC has two low-profile PCIe Gen 3 slots, an 8-lane slot and a 16-lane slot.
  • Page 152 If only a single PCIe card is present, press only the corresponding ATTN button. For Note - button locations, see “Dual PCIe Card Carrier (DPCC) Indicators” on page To unlock the DPCC lever, lift the release latch and pull the lever downward, away from the server. Oracle Server X7-8 Service Manual • October 2017...

  • Page 153: Remove A Pcie Card

    Remove a PCIe Card This action disengages the PCIe card IO connectors from the connectors on the back of the CMODs. To remove the DPCC, slide the carrier out of the server. Related Information “Remove a PCIe Card” on page 153 ■...
  • Page 154 Orient the DPCC so that the hinge is to the left. To open the top of the DPCC, lift the release latch at the non-hinged end of the lid and rotate the lid upward. Oracle Server X7-8 Service Manual • October 2017...

  • Page 155: Install A Pcie Card

    Install a PCIe Card To remove the card, pull it straight up and out of its connector. Related Information “Install a PCIe Card” on page 155 ■ “Returning the Server to Operation” on page 237 ■ Install a PCIe Card To access a PCIe card, you must first remove its DPCC (see “Remove a DPCC”...
  • Page 156 Ensure that the DPCC top cover is open. The top of the DPCC is hinged at one end. To open, lift the tab on the non-hinged end. Oracle Server X7-8 Service Manual • October 2017...
  • Page 157 Install a PCIe Card Orient the PCIe card with the edge (or bus) connector facing down and the IO (or cable connector) facing to the left. To install the card, align the edge connector with the slot in the DPCC and push the card down into the slot.

  • Page 158: Install A Dpcc

    Ensure the top of the DPCC is closed and secured and the lever on the front of the DPCC is in its fully open position. Align the DPCC with the vacant slot. Oracle Server X7-8 Service Manual • October 2017...
  • Page 159 Install a DPCC The connector (back) side of the DPCC faces inward toward the server. Slide the DPCC into the slot until it stops (1). This leaves the DPCC protruding slightly from the back of the server. Do not attempt push the DPCC inward beyond this point.

  • Page 160: Servicing Cpu Module (Cmod) Components (Fru)

    ■ “Install a CMOD” on page 167 ■ “Servicing DIMMs” on page 182 ■ CMODs should be removed and replaced only by authorized Oracle Service Caution - personnel. Component damage. CMOD components are extremely sensitive to electrostatic Caution - discharge. To protect components from damage, always use an anti static mat and wrist strap.

  • Page 161: Cmod Population Rules

    CMOD 7, SMOD1 System B CMOD Population Rules The Oracle Server X7-8 supports four and eight CMOD configurations. Each CMOD supports a single socket containing a single processor. Each CMOD contains one Intel Xeon vx processor 28-core (shelf 4) processor.

  • Page 162: Remove A Cmod

    All eight fan modules (FMs) must be installed and all FMs are active. ■ Both fan frames must be installed. ■ During Oracle Server X7-8 reconfiguration, administrators will need to manually clear Note - all existing faults before an 4-socket to 8-socket mode change. Remove a CMOD You need to remove the CMOD to service it or its internal components.
  • Page 163 Remove a CMOD If you know the group, then you know which group of four fan modules to remove from Tip - the front-panel. Remove the fan modules. See “Remove a Fan Module” on page 131. Remove the fan frame. See “Remove a Fan Frame”...

  • Page 164: Remove The Cmod Cover

    “Install a CMOD” on page 167 ■ Remove the CMOD Cover When removing or installing the CMOD cover, always maintain component serviceability requirements with regard to static protection. “Remove a CMOD” on page 162 Oracle Server X7-8 Service Manual • October 2017...
  • Page 165 Remove the CMOD Cover Attach an antistatic wrist strap to your wrist and then to a chassis ground. “Performing Electrostatic Discharge and Static Prevention Measures” on page Remove the CMOD top cover. To remove the CMOD top cover, push the release button, slide the CMOD cover toward the back of the CMOD.

  • Page 166: Install The Cmod Cover

    CMOD. Ensure that the edges of the cover encapsulate the edges of the chassis, and that the pins in the cover are aligned with the slots in the chassis sidewall. Oracle Server X7-8 Service Manual • October 2017...

  • Page 167: Install A Cmod

    Install a CMOD Slide the cover toward the front of the CMOD until it locks into place. This action is accompanied by a click sound. Install a CMOD Use this procedure to install a CMOD after replacing it or after servicing its internal components.
  • Page 168 Install a CMOD Position the CMOD in the slot. The CMOD is heavy. Be prepared to hold it firmly when it is clear of the slot. Caution - Oracle Server X7-8 Service Manual • October 2017...
  • Page 169 Install a CMOD On the front-facing side, ensure that the hinge for the lever is at the bottom. Slide the CMOD into the slot until it stops. In this position, the pawl at the lever hinge is aligned with the slot in the server. To install the CMOD, rotate the lever up until it locks into place and is flush with the front of the CMOD.

  • Page 170: Servicing Processors

    “Field-Replaceable Units” on page Ensure that all power is removed from the server before removing or installing a Caution - processor. You must disconnect the power cables from the system before performing these procedures. Oracle Server X7-8 Service Manual • October 2017...
  • Page 171 Identify and Remove a Faulty Processor Processors should be removed and replaced only by authorized Oracle Service Caution - personnel. This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge. This sensitivity can cause the component to fail. To avoid damage, ensure that you follow electrostatic discharge safety measures and antistatic practices.
  • Page 172 If the processor fault LED is off, then the processor is operating properly. ■ If the processor fault LED is on (amber), then the processor is faulty and must be replaced. ■ Callout Description Fault Remind button Fault Remind LED Processor 0 fault LED Oracle Server X7-8 Service Manual • October 2017...
  • Page 173 Identify and Remove a Faulty Processor Using a Torx T30 screwdriver, loosen the four captive nuts that secure the processor-heatsink module to the socket: fully loosen nut 4, then 3, then 2, then 1. [1] Lift the processor-heatsink module from the socket [2]. Always hold the processor-heatsink module along the axis of the fins to prevent damage.
  • Page 174 Flip over the processor-heatsink module, place it on a flat surface, and locate the thermal interface material (TIM) breaker slot. While holding down the processor-heatsink module by the edges, insert a flat blade screwdriver into the TIM breaker slot. Oracle Server X7-8 Service Manual • October 2017...
  • Page 175 Identify and Remove a Faulty Processor The blade of the screwdriver goes into the slot between the heatsink and processor carrier, not between the processor and processor carrier. Using a rocking motion, gently pry the corner of the processor carrier away from the heatsink.
  • Page 176 Also, be careful not to get the grease on your fingers, as this could result in contamination of components. Related Information “Install a Processor” on page 177 ■ Oracle Server X7-8 Service Manual • October 2017...

  • Page 177: Install A Processor

    Install a Processor Install a Processor Be careful not to touch the processor socket pins. The processor socket pins are very Caution - fragile. A light touch can bend the processor socket pins beyond repair. Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis.
  • Page 178 The processor carrier has latching posts at each corner: two that insert into heatsink holes Note - and two that attach to the edge of the heatsink. Callout Description Pin 1 indicator Oracle Server X7-8 Service Manual • October 2017...
  • Page 179 Install a Processor Lift the processor-heatsink module out of the packaging tray. Align the processor-heatsink module to the processor socket bolster plate on the motherboard, matching the pin 1 location (a triangle indicator). Callout Description Pin 1 indicator Place the processor-heatsink module on the socket on the motherboard. Servicing Components...
  • Page 180 1 and 2. Then fully tighten nuts 3 and 4 [2]. As you tighten nuts 3 and 4, some resistance occurs as the bolster leaf spring rises and comes in contact with the heatsink. Oracle Server X7-8 Service Manual • October 2017...
  • Page 181 Refer to the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at for more information about the following steps. http://www.oracle.com/goto/ilom/docs To show server faults, log in to the server as root using the Oracle ILOM CLI, and type the following command to list all known faults on the server: ->...

  • Page 182: Servicing Dimms

    Are you sure you want to clear /SYS/MB/P0 (y/n)? y Set ‘clear_fault_action’ to ‘true’ Alternatively, to clear all known faults in the server, log into the Oracle Solaris OS and issue the fmadm repair command, or log into the Oracle ILOM service processor from the Oracle ILOM Fault Management Shell and issue the fmadm repair command.

  • Page 183: Dimm And Processor Physical Layout

    Install a Processor The following topics and procedures provide information to assist you when replacing a DIMM or upgrading DIMMs: “DIMM and Processor Physical Layout” on page 183 ■ “DIMM Population Scenarios” on page 184 “DIMM Population Rules” on page 185 “DIMM Rank Classification Labels”...

  • Page 184: Dimm Population Scenarios

    You have purchased new DIMMs and you want to use them to upgrade the server's memory. ■ In this scenario, you should adhere to DIMM population rules and follow the recommended DIMM population order for optimal system performance. Oracle Server X7-8 Service Manual • October 2017...

  • Page 185: Dimm Population Rules

    Install a Processor Related Information “DIMM and Processor Physical Layout” on page 183 ■ “DIMM Population Scenarios” on page 184 ■ “DIMM Population Rules” on page 185 ■ “DIMM Operating Speeds” on page 188 ■ “DIMM Rank Classification Labels” on page 188 ■...
  • Page 186 Channel B, Slot 0, DIMM 8 Channel B, Slot 1, DIMM 9 Channel C, Slot 0, DIMM 10 Channel C, Slot 1, DIMM 11 DIMM Slot Population Order The DIMM slot population order is as follows: Oracle Server X7-8 Service Manual • October 2017...
  • Page 187 Install a Processor Always populate the DIMM slot furthest from the memory buffer first. Note - 1. Installation Order DIMM: 1 D7 2 D4, 3 D9, 4 D2 5 D11 6 D0, 7 D6, 8 D5, 9 D8, 10 D3, 11 D10, 12 D1 2.

  • Page 188: Dimm Operating Speeds

    Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs When a single DIMM is marked as failed by Oracle ILOM (for example, fault.memory. intel.dimm.training-failed is listed in the service processor Event Log), BIOS might disable the entire memory channel that contains the failed DIMM, up to two DIMMs. As a result, none of the memory installed in the disabled channel will be available to the operating Oracle Server X7-8 Service Manual •...

  • Page 189: Identify And Remove A Faulty Dimm

    Therefore, you can correctly identify the failed DIMM using the lit LED. Identify and Remove a Faulty DIMM Use Oracle ILOM to identify the location of the failed DIMM and obtain CMOD designation information. “Troubleshooting Server Hardware Faults” on page Prepare the server for service.
  • Page 190 With the Fault Remind button pressed, look for a lit DIMM fault LED indicator [3]. Twelve DIMM fault LED indicators are located next to the DIMM slots. Rotate both DIMM socket ejectors outward as far as they will go. Oracle Server X7-8 Service Manual • October 2017...
  • Page 191 Identify and Remove a Faulty DIMM The DIMM is partially ejected from the socket. This action extracts the DIMM from its connector. Remove the faulty DIMM from the CMOD. Carefully lift the DIMM straight up to remove it from the socket. Replace each faulty DIMM with either another DIMM of the same rank size (quadrank or dual-rank) or leave the socket empty.

  • Page 192: Install A Dimm

    Remove DIMMs. See “Identify and Remove a Faulty DIMM” on page 189. ■ If you are changing or adding DIMMs as part of an upgrade, ignore the fault Note - identification instructions. Oracle Server X7-8 Service Manual • October 2017...
  • Page 193 Install a DIMM Locate the DIMM slot. Install a DIMM. Ensure that the ejector tabs are in the open position. Align the notch in the replacement DIMM with the connector key in the connector socket. The notch ensures that the DIMM is oriented correctly. To align the DIMM in the slot, ensure that the notch on the DIMM connector lines up with the key in the DIMM slot.

  • Page 194: Oracle Server X7-8 Service Manual • October

    (Optional) Use Oracle ILOM to clear server DDR4 DIMM faults. DDR4 DIMM faults are automatically cleared after a new DIMM has been installed. If you need to manually clear DDR4 DIMM faults, refer to the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at http://www.oracle.com/goto/ilom/docs.

  • Page 195: Servicing System Module (Smod) Components (Fru)

    “System Module (SMOD) Overview” on page SMOD Population Rules The Oracle Server X7-8 supports two installed SMODs. Both SMOD0 System A and SMOD1 System B are accessable from the back panel. “System Module (SMOD) Overview” on page Remove an SMOD Perform this procedure to access internal SMOD components, such as the HBA card, the internal USB ports, the ESM, and the system battery.
  • Page 196 This action disengages the connectors on the SMOD from the connectors on the server midplane. Physical harm or component damage. Do not use the SMOD handles to remove the Caution - SMOD from the server. Oracle Server X7-8 Service Manual • October 2017...

  • Page 197: Install An Smod

    Install an SMOD To remove the SMOD, hold the SMOD by its sides and slide it out of the server. The SMOD is heavy. Be prepared to hold it firmly when it is clear of the slot. Caution - Related Information “Install an SMOD”...
  • Page 198 Orient the SMOD with the handles facing away from the server and the connectors facing toward the open slot in the server. The SMOD is heavy. Be prepared to hold it firmly when it is clear of the slot. Caution - Oracle Server X7-8 Service Manual • October 2017...
  • Page 199 Install an SMOD Align the SMOD in the slot. Slide the SMOD into the slot until it stops. This leaves the SMOD protruding slightly from the back of the server. Do not attempt push the SMOD in beyond this point. To install the SMOD, simultaneously rotate both handles up until they lock into place.

  • Page 200: Servicing The Host Bus Adapter (Hba) Card

    Remove the HBA Card Servicing the Host Bus Adapter (HBA) Card This section contains procedures for servicing the HBA card (Oracle Storage 12 Gb SAS PCIe RAID Host Bus Adapter, Internal 16-Port) that is located inside the system module (SMOD): “Remove the HBA Card”...
  • Page 201 Remove the HBA Card Disconnect the energy storage module (ESM) extension cable from the HBA. Rotate the thumbscrew that secures the green release handle, then pull the handle out and down to unlock the HBA card. Servicing Components...
  • Page 202 To disconnect the HBA card from its connector on the SMOD motherboard, pull the card toward you just far enough so that you can access the SAS cables. The two storage drive backplane cables are still attached to the card. Note - Oracle Server X7-8 Service Manual • October 2017...
  • Page 203 Install the HBA Card Two cables with mini SAS connectors connect the HBA to the storage drive backplane. Disconnect the SAS cables from the HBA card. Do not disconnect the cables from the SMOD. Note - Remove the HBA card from the SMOD. Related Information “Install the HBA Card”...
  • Page 204 Align the connector on the HBA card with the PCIe slot on the SMOD motherboard and then push the HBA card into the slot [2]. Lock the card and secure the thumbscrew (3). To lock the card, rotate the green locking lever up. Oracle Server X7-8 Service Manual • October 2017...
  • Page 205 Prepare the server for operation. See “Returning the Server to Operation” on page 237. Clear any related component faults. For more information see “Clear Hardware Fault Messages (Oracle ILOM)” on page Related Information “Install an SMOD” on page 197 ■ Servicing Components...

  • Page 206: Servicing The Energy Storage Module And Cables

    “Remove an SMOD” on page 195. Turn the SMOD upside down on a flat surface with the back side facing toward you. The ESM is located between the two disk drive enclosures. Oracle Server X7-8 Service Manual • October 2017...
  • Page 207 Replace the Energy Storage Module Disconnect the ESM connector from the ESM extension cable [1]. Remove the ESM [2] by lifting it out of position. The ESM is pushed to the back, through the cage and then pulled the rest of the way out of position.
  • Page 208 “Preparing the Server for Component Replacement” on page 101. Remove the SMOD. See “Remove an SMOD” on page 195. Rotate the SMOD 180 degrees so the back (connector) side is facing toward you. Oracle Server X7-8 Service Manual • October 2017...
  • Page 209 Replace the ESM Extension Cable Disconnect the Energy Storage Module (ESM) cable from the ESM extension cable [1]. Slide the cable out of the slot [2]. Turn the SMOD over and locate the HBA. The connector (back) side of the SMOD should still be facing you. Servicing Components...
  • Page 210 Route the new ESM extension cable from the HBA, under the support beams, through the clips [2], and through the slot [3]. Turn the SMOD over. Connect the ESM extension cable to the connector on the ESM. Oracle Server X7-8 Service Manual • October 2017...

  • Page 211: Servicing The Sas Cable

    Replace the ESM Extension Cable The connector on the ESM is at the end of a cable that dangles about four inches out of the ESM body. Inspect the cable to make sure that it is routed correctly and connected to the ESM and the HBA.
  • Page 212 Ensure that the connectors are routed under the support bracket. Install the HBA card. See “Install the HBA Card” on page 203. Install the SMOD. See “Install an SMOD” on page 197. Oracle Server X7-8 Service Manual • October 2017...

  • Page 213: Servicing The Internal Usb Flash Drives

    Remove an Internal USB Flash Drive Prepare the server for operation. See “Returning the Server to Operation” on page 237. Related Information “Install an SMOD” on page 197 ■ Servicing the Internal USB Flash Drives This section contains procedures for accessing and servicing a USB flash drive installed in the SMOD internal USB ports.
  • Page 214 This is a cold-service component. Power down the system and disconnect the AC power cables from the server before performing this procedure. “Preparing the Server for Component Replacement” on page 101. Remove the SMOD. See “Remove an SMOD” on page 195. Oracle Server X7-8 Service Manual • October 2017...
  • Page 215 Install an Internal USB Drive Set the SMOD on a flat surface with the front side facing toward you. Close the SMOD handles. Rotate the SMOD 180 degrees so the back (connector) side is facing toward you. Turn the SMOD upside down and locate the HBA card. The connector (back) side of the SMOD should still be facing you.

  • Page 216: Replace The System Battery

    Set the SMOD on a flat surface with the back side facing toward you. The system battery is located on the SMOD motherboard. To remove the battery, pull it up and out of its holder. Oracle Server X7-8 Service Manual • October 2017...
  • Page 217 Replace the System Battery Tilt the battery out, away from wall, and then lift the battery up. To orient the replacement battery, ensure that the positive (+) side of the battery is facing toward the outside of the SMOD. Make sure the positive pole (+) is facing toward the inside of the SMOD. Servicing Components...

  • Page 218: Servicing The Front Indicator Module (Fru)

    If necessary, once the server is operational, access the BIOS Setup Utility to set the clock. Related Information “Install an SMOD” on page 197 ■ Servicing the Front Indicator Module (FRU) This section includes information and procedures for servicing the server front indicator module (FIM): Oracle Server X7-8 Service Manual • October 2017...

  • Page 219: Remove The Fim

    Remove the FIM “Remove the FIM” on page 219 ■ “Install the FIM” on page 221 ■ FIMs should be removed and replaced only by authorized Oracle Service personnel. Caution - For component serviceability, locations, and designations, see “Identifying Components” on page Remove the FIM Access this component directly from the front of the server.
  • Page 220 Remove the FIM To unlock the FIM, reach into the vacant power supply slot, locate the release latch on the underside of the FIM, and push the latch up. Oracle Server X7-8 Service Manual • October 2017...

  • Page 221: Install The Fim

    Install the FIM To remove the FIM, press and hold the release latch and slide the FIM completely out of its slot. Related Information “Install the FIM” on page 221 ■ Install the FIM Position the connector end of the FIM at the opening of the slot. Access this component directly from the front of the server.
  • Page 222 Ensure that the open side (internal ribbon cable visible) of the FIM is facing up. To install the FIM, slide it into the slot until it locks and is flush with the front of the server. Oracle Server X7-8 Service Manual • October 2017...

  • Page 223: Upgrade The Server From Four To Eight Cmods (Fru)

    Main power mode. Clear any related component faults. Related Information “Clear Hardware Fault Messages (Oracle ILOM)” on page 53 ■ Upgrade the Server from Four to Eight CMODs (FRU) If you have a server configured with four CMODs, you can expand the server's processing capabilities by upgrading the server configuration to eight CMODs.
  • Page 224 “Remove a Fan Frame” on page 136. In a four-CPU configuration, the four CMOD slots on the right side of the server are vacant. Call Out Description Four CMODs installed in left bay Empty right-side bay Oracle Server X7-8 Service Manual • October 2017...
  • Page 225 Upgrade the Server from Four to Eight CMODs (FRU) Open each new CMOD and ensure that the DIMMs are configured correctly and properly seated in their slots: Caution - Component damage. CMOD components are extremely sensitive to electrostatic discharge. Wear a wrist strap and use an anti-static wrist mat. Remove the CMOD cover.

  • Page 226: Replace The Midplane Assembly

    Remove all CMODs. See “Remove a CMOD” on page 162. Remove four power supplies, PS0-3. See “Remove a Power Supply” on page 141. Remove the FIM. See “Remove the FIM” on page 219. Oracle Server X7-8 Service Manual • October 2017...
  • Page 227 Replace the Midplane Assembly Remove the server back panel accessible components. Remove any cables attached to the back of the server. Before removing cables, label each one, noting its connection point. Remove the SMODs. See “Remove an SMOD” on page 195.
  • Page 228 Carefully remove and retain the protective black plastic insert that covers the top of the midplane assembly. Note the orientation of the insert with respect to the opening. The insert is fitted to the opening using tabs and flaps. Oracle Server X7-8 Service Manual • October 2017...
  • Page 229 Replace the Midplane Assembly Loosen the four captive screws that secure the left side (from the front) access panel and remove the panel. The opening behind the access panel provides access to five cables (four 20-pin PS cables and one 8-pin cable for the AC power indicator LEDs) that are routed through the server and are connected to the backside of the midplane assembly.
  • Page 230 Replace the Midplane Assembly The following illustration shows a portion of the label. The following illustration shows the label. Oracle Server X7-8 Service Manual • October 2017...
  • Page 231 Replace the Midplane Assembly Reach into the side access opening and disconnect the five connectors from the back of the midplane assembly. Tip - To see the connectors, direct the light from a flashlight through the small opening in the top access just above the cable connect points.
  • Page 232 Align and position the replacement midplane assembly in the opening in the top of the server. Carefully lower the midplane assembly into the server until the top of the assembly is flush with the top of the server. Oracle Server X7-8 Service Manual • October 2017...
  • Page 233 Replace the Midplane Assembly Take care not to damage the cables and connectors when lowering the midplane assembly into the server. Connect the five cables to the connectors on the back of the midplane assembly. Ensure that the connectors are positioned correctly, so the key (protrusion) on the side of the connector is aligned with the notch in the connector on the midplane assembly.
  • Page 234 PS 0, then PS 2, followed by PS 1, and finally PS 3. Attach the cable for the AC power indicator board last. The following illustration shows the label. Oracle Server X7-8 Service Manual • October 2017...
  • Page 235 Replace the Midplane Assembly Position the side access cover at the access opening, ensuring that the four captive screws are aligned with the holes in the side of the chassis. To secure the access cover to the chassis, tighten the four captive screws. Install the black plastic insert over the top of the midplane assembly.
  • Page 236 Prepare the server for operation. See “Returning the Server to Operation” on page 237. Update the TLI FRUPROM data containers. Service needs to manually reprogram the FRU containers into FRUPROM0 and FRUPROM1. Oracle Server X7-8 Service Manual • October 2017...

  • Page 237: Returning The Server To Operation

    Returning the Server to Operation After replacing components inside of the server, perform the procedures in the following sections. This section describes how to return the server to service after performing cold service. Description Link Steps for returning the server to operation “Prepare the Server for Operation”...

  • Page 238: Power On The Server

    Verify that none of the server Service Action Required indicators on externally facing indicator panels are lit. Note - After replacing some components, you must clear the fault in Oracle ILOM to clear fault indicators. For details, see “Clear Hardware Fault Messages (Oracle ILOM)” on page Power on the server.

  • Page 239: Setting Up Bios Configuration Parameters

    Manage the BIOS Configuration The BIOS configuration parameters on an Oracle x86 server are manageable from the BIOS Setup Utility and Oracle ILOM. For information about using these tools to manage the BIOS configuration, refer to: Oracle ILOM – “Maintaining x86 BIOS Configuration Parameters” in the Oracle ILOM ■...

  • Page 240: Bios Setup Utility Menus

    BIOS supports the mapping of function keys to Control key sequences when serial redirection is enabled. The following table provides a description of the function key to Control key sequence mappings. Oracle Server X7-8 Service Manual • October 2017...

  • Page 241: Access Bios Setup Utility Menus

    Use a terminal (or terminal emulator connected to a computer) through the serial port on the ■ back panel of the server. Connect to the server using the Oracle ILOM Remote System Console Plus application. ■ Reset or power on the server.

  • Page 242: Navigate Bios Setup Utility Menus

    For further instructions on how to navigate and change settings in the BIOS Setup Utility, refer to the online information provided on the menu. Access the BIOS Setup Utility. Oracle Server X7-8 Service Manual • October 2017...
  • Page 243 After modifying any BIOS settings, the subsequent reboot might take longer than a Note - typical reboot where no settings were modified. The additional delay is required to ensure that changes to the BIOS settings are synchronized with Oracle ILOM. Related Information “BIOS Key Mappings” on page 240 ■...

  • Page 244: Using Uefi Bios

    BIOS Advanced Menu as part of the standard BIOS Setup Utility screens. For example, if the Oracle Storage 12 Gb SAS PCIe RAID HBA, Internal card is installed in the server, the configuration utility for the HBA appears as a menu selection.

  • Page 245: Uefi Secure Boot

    Common BIOS Setup Utility Tasks UEFI Secure Boot Oracle Server X7-8 UEFI BIOS supports UEFI Secure Boot. UEFI Secure Boot defines how platform firmware can authenticate a digitally signed UEFI image, such as an operating system loader or a UEFI driver.

  • Page 246: Verify Bios Factory Default Settings

    ■ power off the server, and then press the On/Standby button again to power on the server. From the Oracle ILOM web interface, click Host Management → Power Control and ■ select Reset from the Select Action list. Click Save, and then click OK.

  • Page 247: Select A Temporary Boot Device

    ■ power off the server, and then press the On/Standby button again to power on the server. From the Oracle ILOM web interface, click Host Management → Power Control and ■ select Reset from the Select Action list. Click Save, and then click OK From the Oracle ILOM CLI, type ■...

  • Page 248: Configure Tpm Support

    If you intend to use the Trusted Platform Module (TPM) feature set, you must configure the server to support this feature. TPM support is enabled by default on Oracle Server X7-8. Perform the procedure in this section to disable or enable TPM support.
  • Page 249 Configure TPM Support TPM enables you to administer the TPM security hardware in your server. For additional Note - information about implementing this feature, refer to the Windows Trusted Platform Module Management documentation provided by your operating system or third-party software vendor. Access the BIOS Setup Utility menus.

  • Page 250: Configure Uefi Driver Settings

    Microsoft's Windows Trusted Platform Module Management documentation ■ Configure UEFI Driver Settings Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 241. In the BIOS Setup Utility menus, navigate to the IO Menu. Oracle Server X7-8 Service Manual • October 2017...
  • Page 251 Configure UEFI Driver Settings On the IO Menu screen, select either Internal Devices or Add In Cards and press Enter to display the internal device or add-in card slot for which you want to enable or disable the PCI-E UEFI Driver. Setting Up BIOS Configuration Parameters...
  • Page 252 Press the F10 key to save the changes and exit the BIOS Setup Utility. Related Information “Accessing the BIOS Setup Utility” on page 239 ■ “BIOS Setup Utility Menu Options” on page 269 ■ “Exit BIOS Setup Utility” on page 267 ■ Oracle Server X7-8 Service Manual • October 2017...

  • Page 253: Configure I/O Resource Allocation

    Configure I/O Resource Allocation Configure I/O Resource Allocation Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 241. In the BIOS Setup Utility menus, navigate to the IO Menu. Setting Up BIOS Configuration Parameters...

  • Page 254: Card Slots

    Configure I/O Resource Allocation On the IO Menu screen, select Add In Cards and press Enter to display the add-in card slots. Oracle Server X7-8 Service Manual • October 2017...
  • Page 255 Configure I/O Resource Allocation On the Add In Cards screen, select the slot in which you want to configure the card and press Enter. On the IO resource allocation screen for that card, select IO Enable and press Enter. Do one of the following: ■...

  • Page 256: Configure Uefi Secure Boot

    Configure UEFI Secure Boot Configure UEFI Secure Boot Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 241. On the Main Menu screen, select Security and press Enter. Oracle Server X7-8 Service Manual • October 2017...
  • Page 257 Configure UEFI Secure Boot On the Security Settings screen, select Secure Boot and press Enter. On the Secure Boot screen, select Secure Boot and press Enter. Do one of the following: ■ Select Enabled to enable UEFI Secure Boot. Continue with the next step to manage policy variables.
  • Page 258 Enter. Do one of the following: ■ Select Enabled to allow the provisioning of factory default Secure Boot keys when the system is in Setup Mode. When enabled, you can select Install Oracle Server X7-8 Service Manual • October 2017...
  • Page 259 Configure UEFI Secure Boot Factory Default Keys to force the system to User Mode and install all the factory default Secure Boot keys. ■ Select Disabled to disable the provisioning of factory default Secure Boot keys. When disabled, you can select Delete all Secure Boot Variables to Setting Up BIOS Configuration Parameters...
  • Page 260 Configure UEFI Secure Boot remove all Secure Boot keys from the system. Selecting this option also resets the system to Setup Mode. Oracle Server X7-8 Service Manual • October 2017...
  • Page 261 Configure UEFI Secure Boot If you want to enroll an EFI image, select Enroll Efi Image and press Enter. Setting Up BIOS Configuration Parameters...
  • Page 262 Configure UEFI Secure Boot On the Select a File System screen, Scroll through the list and select the file system that contains the EFI file and press Enter. Oracle Server X7-8 Service Manual • October 2017...
  • Page 263 Configure UEFI Secure Boot On the Select File screen, scroll through the list and select the EFI file (or another available file) and press Enter. On the next Select File screen, scroll through the list and select the image file that you want to run in Secure Boot mode and press Enter. Setting Up BIOS Configuration Parameters...
  • Page 264 “Accessing the BIOS Setup Utility” on page 239 ■ “BIOS Setup Utility Menu Options” on page 269 ■ “UEFI Secure Boot” on page 245 ■ “Exit BIOS Setup Utility” on page 267 ■ Oracle Server X7-8 Service Manual • October 2017...

  • Page 265: Configure Trusted Execution Technology

    Configure Trusted Execution Technology Configure Trusted Execution Technology The Trusted Platform Module (TPM) feature must be enabled on your server before enabling Trusted Execution Technology (TXT). See “Configure TPM Support” on page 248. Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 241.
  • Page 266 “BIOS Setup Utility Menu Options” on page 269 ■ “Trusted Execution Technology” on page 245 ■ “Configure Trusted Execution Technology” on page 265 ■ “Exit BIOS Setup Utility” on page 267 ■ Oracle Server X7-8 Service Manual • October 2017...

  • Page 267: Exit Bios Setup Utility

    After modifying any BIOS settings, the subsequent reboot might take longer than a Note - typical reboot where no settings were modified. The additional delay is required to ensure that changes to the BIOS settings are synchronized with Oracle ILOM. Related Information “Accessing the BIOS Setup Utility” on page 239 ■...
  • Page 268 Oracle Server X7-8 Service Manual • October 2017...

  • Page 269: Bios Setup Utility Menu Options

    This section includes screens of the main menus in the BIOS Setup Utility for Oracle Server X7-8. Following the screen for each menu is a table of the options available from that menu. “BIOS Main Menu Selections” on page 269 ■...
  • Page 270 ■ YY - BIOS major release. ■ ZZ - BIOS minor release. ■ PP - Build number. Example: 42.01.04.01 System Date Current date is displayed. You can change the date setting. Example: [Thu 06/20/2017] Oracle Server X7-8 Service Manual • October 2017...
  • Page 271 Example: 4.0.0.0 r115197 PRODUCT INFORMATION Product information is displayed. (R/O) Product Name Product name is displayed. Example: Oracle Server X7-8 Product Serial Number Product serial number is displayed. Example: 1134FML00V Board Serial Number Board serial number is displayed. Example: 489089M+1637E2002E...
  • Page 272 Configure the security settings. Enable Intel TXT Disable/ Disabled Enables Intel TXT. Enable HDD Security Configuration Set User Password Set an HDD user password for the selected drive. Secure Boot Customize Secure Boot settings. Oracle Server X7-8 Service Manual • October 2017...
  • Page 273 BIOS Main Menu Selections Setup Options Options Defaults Description Attempt Secure Boot Disabled/Enabled Disabled Secure Boot is activated when Platform Key (PK) is enrolled, System mode is User/Deployed, and CSM function is disabled. Key Management Enables expert users to modify Secure Boot Policy variables without full authentication.

  • Page 274: Bios Advanced Menu Selections

    “BIOS Advanced Menu Serial Port Console Redirection Options” on page 278 ■ “BIOS Advanced Menu Network Stack Configuration Options” on page 280 ■ “BIOS Advanced Menu NVMe Configuration Options” on page 281 ■ Oracle Server X7-8 Service Manual • October 2017...

  • Page 275: Bios Advanced Menu Iscsi Configuration Options

    BIOS Advanced Menu Selections “BIOS Advanced Menu Primary Video Selection Options” on page 281 ■ “BIOS Advanced Menu Trusted Computing 2.0 Options” on page 281 ■ “BIOS Advanced Menu Processor Configuration Options” on page 282 ■ “BIOS Advanced Menu Memory Configuration Options” on page 283 ■...
  • Page 276 The secret length range is 12 to 16 bytes. Delete Attempts Use to delete one or more attempts. Change Attempt Order Use to change the order of attempts. Use arrow keys to Oracle Server X7-8 Service Manual • October 2017...

  • Page 277: Bios Advanced Menu Gigabit Network Connection Options

    BIOS Advanced Menu Selections Setup Options Options Defaults Description select the attempt, then press plus or minus (+/-) keys to move the attempt up/down in the attempt order list. BIOS Advanced Menu Gigabit Network Connection Options The following table describes the BIOS Advanced Menu Gigabit network connection options. Setup Options Options Defaults...

  • Page 278: Bios Advanced Menu Driver Health Options

    AVAGO EFI SAS Driver (R/O) Healthy Lists the health status of drivers/ controllers. BIOS Advanced Menu Serial Port Console Redirection Options The following table describes the BIOS Advanced Menu serial port console redirection options. Oracle Server X7-8 Service Manual • October 2017...
  • Page 279 BIOS Advanced Menu Selections Setup Options Options Defaults Description EMS Console Redirection Disabled/Enabled Disabled Use this option to enable or disable console redirection for Windows Emergency Management Service (EMS) administration. Console Redirection Disabled/Enabled Enabled Use this option to enable or disable console redirection.

  • Page 280: Bios Advanced Menu Network Stack Configuration Options

    Boot support. If disable, the IPv6 PXE Boot Option will not be created. Ipv6 HTTP Support Disabled/Enabled Disabled Enable or disable IPv6 HTTP Boot support. If disable, the IPv6 HTTP Boot Option will not be created. Oracle Server X7-8 Service Manual • October 2017...

  • Page 281: Bios Advanced Menu Nvme Configuration Options

    BIOS Advanced Menu Selections Setup Options Options Defaults Description PXE boot wait time Wait time to press ESC key to abort the PXE boot. Media detect count Number of times the presence of media will be checked. BIOS Advanced Menu NVMe Configuration Options The following table describes the BIOS Advanced Menu NVMe configuration options.

  • Page 282: Bios Advanced Menu Processor Configuration Options

    TPM 20 InterfaceType (R/O) Displays the TPM 20 interface type. Device Select (R/O) Displays the TPM device. BIOS Advanced Menu Processor Configuration Options The following table describes the BIOS Advanced Menu processor configuration options. Oracle Server X7-8 Service Manual • October 2017...

  • Page 283: Bios Advanced Menu Memory Configuration Options

    BIOS Advanced Menu Selections Setup Options Options Defaults Description Hyper-threading ALL Disabled/Enabled Enabled Use to enable Hyper Threading. When enabled, two threads are available per enabled core. When disabled, only one thread per enabled core is available. Active Processor Cores A minimum of one up to the The number of cores to enable in maximum number of cores...

  • Page 284: Bios Advanced Menu Cpu Power Management Configuration Options

    Enable/disable Package C State limit. Energy Performance Performance Balanced Performance Use this option to select the Energy Performance mode. Balanced Performance Balanced Energy Energy Efficiency Uncore Frequency Scaling Enabled/Disabled Disabled Enable/disable Uncore Frequency Scaling (USF). Oracle Server X7-8 Service Manual • October 2017...

  • Page 285: Bios Advanced Menu Usb Ports Options

    BIOS Advanced Menu Selections BIOS Advanced Menu USB Ports Options The following table describes the BIOS Advanced Menu USB ports options. Setup Options Options Defaults Description EHCI Hand-off Disabled/Enabled Disabled Enable or disable Enhanced Host Controller Interface (EHCI) hand-off support. This is a workaround for operating systems without EHCI hand-off support.

  • Page 286: Bios Io Menu Selections

    “BIOS Save and Exit Menu Selections” on page 292 ■ BIOS IO Menu Selections This section includes a screen of the BIOS IO Menu. The options that are available from the IO Menu are described in the sections that follow. Oracle Server X7-8 Service Manual • October 2017...

  • Page 287: Bios Io Menu Pci Subsystem Settings Options

    BIOS IO Menu Selections The following sections describe the BIOS IO Menu options. “BIOS IO Menu PCI Subsystem Settings Options” on page 287 ■ “BIOS IO Menu IO Virtualization Options” on page 288 ■ “BIOS IO Menu IOAT Configuration Options” on page 289 ■...

  • Page 288: Bios Io Menu Io Virtualization Options

    SR- IOV capable are configured to support SR-IOV and I/O resources are allocated to the device as normal. If set to disabled, I/O resources are not allocated to the device. Oracle Server X7-8 Service Manual • October 2017...

  • Page 289: Bios Io Menu Ioat Configuration Options

    BIOS IO Menu Selections Setup Options Options Defaults Description Disabled/Enabled Enabled If Alternate Routing ID (ARI) is supported by the hardware and set to enabled, devices are permitted to locate virtual functions (VFs) in function numbers 8 to 255 of the captured bus number, instead of normal function numbers 0 to 7.

  • Page 290: Bios Io Menu Add-In Cards Options

    “BIOS Save and Exit Menu Selections” on page 292 ■ BIOS Boot Menu Selections This section includes a screen of the BIOS Boot Menu. The options that are available from the Boot Menu are described in the table that follows. Oracle Server X7-8 Service Manual • October 2017...
  • Page 291 BIOS Boot Menu Selections Setup Options Options Defaults Description Retry Boot List Disabled/Enabled Enabled Automatically retries Boot List when all devices have failed. Network Boot Retry Disabled/Enabled/Boot Enabled If enabled, BIOS automatically retries List the PXE list present in the system when all PXE attempts have failed.

  • Page 292: Bios Save And Exit Menu Selections

    Save Changes and Exit Save changes and exit the BIOS Setup Utility. Discard Changes and Exit Exit the BIOS Setup Utility without saving changes. Discard Changes Discard any changes made to the setup options. Oracle Server X7-8 Service Manual • October 2017...
  • Page 293 BIOS Save and Exit Menu Selections Setup Options Description Restore Defaults Restore/load the optimal default values for all of the setup options. Related Information “BIOS Main Menu Selections” on page 269 ■ “BIOS Advanced Menu Selections” on page 274 ■ “BIOS IO Menu Selections”...
  • Page 294 Oracle Server X7-8 Service Manual • October 2017...

  • Page 295: Monitoring And Identifying Server Components

    (CLI), you can collect system-specific information about the server, determine the health state of discrete components, and view any open problems on the server. Oracle ILOM automatically detects system hardware faults and environmental conditions on the server. If a problem occurs on the server, Oracle ILOM will automatically do the following: Illuminate the Service Required status indicator (LED) on the server front and back panels.

  • Page 296: Monitoring System Components

    Values – Defines the states of the sensor, indicator, or FRU entity, and any specific units or ■ values that are expected, if applicable. Some component names are hidden in the Oracle ILOM user interfaces. These names Note - are marked as hidden in the tables. See the ILOM 4.0 Documentation Library at http://www.

  • Page 297: System Components (Frus) Network Access Control (Nac) Names

    Monitoring System Components System Components (FRUs) Network Access Control (NAC) Names This table lists and describes the System Components (FRUs) NAC names, and identifies the IPMI type and values. Name (8-Socket 1x8) Name (Dual 4-Socket 2x4- Name (Dual 4-Socket 2x4- Description A Side) B Side)

  • Page 298: System Indicators Network Access Control (Nac) Names

    Color: Amber Location: FIM Front Panel On: System temperature fault. Off: No system temperature fault. /SYS/REAR_FAULT (A- /SYS/REAR_FAULT /SYS/ System Rear Fault Color: Amber Side; B-side disabled) REAR_FAULT Location: FIM Front Panel On: Oracle Server X7-8 Service Manual • October 2017...
  • Page 299 System Indicators Network Access Control (NAC) Names Name (1x8) Name (2x4-A Side) Name (2x4-B Description Side) Rear FRU have a fault. Off: Rear FRUs have no fault. /SYS/SMOD0/MB/SP/OK /SYS/SMOD0/MB/SP/OK /SYS/SMOD1/ SP OK Color: Green Location: (A-Side; B-side disabled) MB/SP/OK FIM Front Panel and SMOD rear panel On: SP is normal.

  • Page 300: System Sensors Network Access Control (Nac) Names

    Threshold Chassis ambient temperature Degree in C /SYS/HOST_ERR /SYS/HOST_ERR /SYS/HOST_ERR Discrete Host fault sensor 01h: No Fault 02h: Fault /SYS/FM[0-7]/PRSNT /SYS/FM[0-3]/PRSNT /SYS/FM[4-7]/ Discrete Fan module presence TBD PRSNT 01h: Absent 02h: Present Oracle Server X7-8 Service Manual • October 2017...
  • Page 301 System Sensors Network Access Control (NAC) Names Name (1x8) Name (2x4-A Side) Name (2x4-B Side) Description /SYS/FM[0-7]/F[0/1]/ /SYS/FM[0-3]/F[0/1]/ /SYS/FM[4-7]/ Fan speed. RPM TACH TACHThreshold F[0/1]/TACH /SYS/DPCC[0-7]/PRSNT /SYS/DPCC[0-3]/ /SYS/DPCC[4-7]/ Discrete DPCC Carrier presence. PRSNT PRSNT 01h: Absent 02h: Present /SYS/DPCC[0-7]/PRSNT /SYS/DPCC[0-3]/ /SYS/DPCC[4-7]/ Discrete DPCC Carrier presence.

  • Page 302: Oracle Server X7-8 Service Manual • October

    Threshold PS inlet temperature Volts T_AMB /SYS/PS[0-3]/V_12V /SYS/PS[2-3]/V_12V /SYS/PS[0-1]/V_12V Threshold PS main output voltage Volts /SYS/PS[0-3]/ /SYS/PS[2-3]/ /SYS/PS[0-1]/ Threshold PS standby output voltage V_12V_STBY V_12V_STBY V_12V_STBY Volts /SYS/PS[0-3]/V_IN /SYS/PS[2-3]/V_IN /SYS/PS[0-1]/V_IN Threshold PS input voltage Volts Oracle Server X7-8 Service Manual • October 2017...
  • Page 303 27 cold service, preparing the server battery (CR 2032) Oracle ILOM CLI, 108 system, replacing, 216 Oracle ILOM Web Interface, 110 BIOS command-line interface (CLI) See CLI configuring serial port sharing, 92 complete power removal, 111, 118, 119 Ethernet ports booting priority, 93...
  • Page 304 189 clearing, 53 supported configurations, 185 fmadm tool, 53 disk drive backplanes front indicator module (FIM) description, 27 installing, 221 dual PCIe card carrier (DPCC) location, 60 installing, 158 removing, 219 Oracle Server X7-8 Service Manual • October 2017...
  • Page 305 45 SMOD, 197 hot service, preparing the server storage drive, 127 Oracle ILOM CLI, 103 USB flash drive (internal), 214 Oracle ILOM Web Interface, 104 installing components processors, 177 Internal USB flash drives description, 27 illustrated parts breakdown, 24...
  • Page 306 FIM, 219 button, 114, 116 HBA, 200 modes, shutdowns, and resets, 118 PCIe card, 153 removal, 111 power, completely, 111, 118, 119 subsystem, 83 PS, 141 power down server SMOD, 195 Oracle Server X7-8 Service Manual • October 2017...
  • Page 307 Index storage drive, 125 gracefully, using Oracle ILOM CLI, 112 USB flash drive, 213 gracefully, using Oracle ILOM web interface, 113 removing components gracefully, using the Power button, 114 DIMMs, 189 immediately, using Oracle ILOM CLI, 115 processors, 171 immediately, using Oracle ILOM web...
  • Page 308 250 UEFI Secure Boot description, 245 enabling and disabling, 256 upgrading the server, 223 USB flash drive (internal) installing, 214 removing, 213 USB ports, internal, 38 warm service, preparing the server Oracle Server X7-8 Service Manual • October 2017...

Table of Contents