Page 1 Oracle Server X7-2 Service Manual ® Part No: E72445-03 October 2017...
Page 3 Oracle. Oracle Corporation and its affiliates will not be responsible for any loss, costs, or damages incurred due to your access to or use of third-party content, products, or services, except as set forth in an applicable agreement between you and Oracle.
Page 4 Oracle Corporation et ses affiliés déclinent toute responsabilité ou garantie expresse quant aux contenus, produits ou services émanant de tiers, sauf mention contraire stipulée dans un contrat entre vous et Oracle. En aucun cas, Oracle Corporation et ses affiliés ne sauraient être tenus pour responsables des pertes subies, des coûts occasionnés ou des dommages causés par l'accès à...
Page 5: Table Of Contents
Troubleshooting and Diagnostic Information .......... 27 Troubleshooting Using the Server Front and Back Panel Status Indicators .. 28 Troubleshooting System Cooling Issues ............. 34 Troubleshooting Power Issues .............. 35 Managing Server Hardware Faults Through the Oracle ILOM Fault Management Shell ................. 37 Troubleshooting With Diagnostic Tools ............. 37 Diagnostic Tools ................... 38 Diagnostic Tool Documentation ...............
Page 6 Removing and Replacing a Storage Drive ............ 67 ▼ Remove a Storage Drive .............. 67 ▼ Install a Storage Drive .............. 70 Removing and Replacing an NVMe Storage Drive Using Oracle Solaris .... 71 ▼ Unmount an NVMe Storage Drive ............ 71 ▼ Remove an NVMe Storage Drive ............ 72 ▼...
Page 7 Contents Removing and Replacing an NVMe Storage Drive Using Oracle Linux .... 74 ▼ Unmount an NVMe Storage Drive ............ 74 ▼ Remove an NVMe Storage Drive ............ 76 ▼ Verify Removal of an NVMe Storage Drive .......... 76 ▼ Install an NVMe Storage Drive ............ 77 ▼...
Page 8 ▼ Install the Battery ................... 134 Servicing Processors (FRU) ................ 137 ▼ Identify and Remove a Faulty Processor ............. 138 ▼ Install a Processor .................. 144 Servicing the Disk Backplane (FRU) ............... 151 ▼ Remove the Disk Backplane .............. 151 Oracle Server X7-2 Service Manual • October 2017...
Page 9 Contents ▼ Install the Disk Backplane ............... 155 Servicing the Front Indicator Module (FRU) ............ 157 ▼ Remove the Front Indicator Module ............ 157 ▼ Install the Front Indicator Module ............. 159 Servicing the Temperature Sensor (FRU) ............ 163 ▼ Remove the Temperature Sensor ............... 163 ▼ Install the Temperature Sensor .............. 166 Servicing the Internal HBA Card and HBA Super Capacitor (FRU) ....
Page 10 ▼ Configure TPM Support .............. 232 ▼ Configure UEFI Driver Settings ............ 234 ▼ Configure I/O Resource Allocation ............ 237 ▼ Configure UEFI Secure Boot ............ 240 ▼ Configure Trusted Execution Technology .......... 249 ▼ Exit BIOS Setup Utility .............. 251 Oracle Server X7-2 Service Manual • October 2017...
Page 11 BIOS Advanced Menu Selections .............. 258 BIOS Advanced Menu iSCSI Configuration Options ........ 259 BIOS Advanced Menu Gigabit Network Connection Options ....... 261 BIOS Advanced Menu Oracle Dual Port 10Gb/25Gb SFP28 Ethernet Controller Options ................ 262 BIOS Advanced Menu Driver Health Options ........... 264 BIOS Advanced Menu Serial Port Console Redirection Options .... 265 BIOS Advanced Menu Network Stack Options .........
Page 12 Hard Disk Drive Components .............. 293 Identifying SNMP Trap Messages .............. 294 Environmental Events ................... 295 Hard Disk Drive Events ................ 296 Power Events .................... 297 Fan Events .................... 302 Memory Events ................... 303 Entity Presence Events ................. 304 Index ........................ 307 Oracle Server X7-2 Service Manual • October 2017...
Page 13: Using This Documentation
Using This Documentation Overview – Describes how to troubleshoot and maintain the Oracle Server X7-2. ■ Audience – Technicians, system administrators, authorized service providers, and trained ■ hardware service personnel who have been instructed on the hazards within the equipment and are qualified to remove and replace hardware.
Page 14 Oracle Server X7-2 Service Manual • October 2017...
Page 15: About The Oracle Server X7-2
“Getting Firmware and Software” in Oracle Servers X7-2 and X7-2L Installation Guide. Product Description The Oracle Server X7-2 is an enterprise-class, one rack unit (1U) server. It supports the following components: Up to two Intel processors. Processors with the following capabilities are supported: ■...
Page 16: About Controls And Connectors
Two internal SATA M.2 flash SSDs ■ Two hot-pluggable, redundant 1200W power supplies. ■ An on-board Oracle Integrated Lights Out Manager (Oracle ILOM) service processor (SP) ■ based on the ASPEED Pilot 4 chip. About Controls and Connectors The following sections describe the controls, indicators, connectors, and drives located on the front and back panels.
Page 17 DO NOT SERVICE LED: white Storage drive 0 HDD/SSD/NVMe Storage drive 1 HDD/SSD/NVMe Storage drive 2 HDD/SSD/NVMe Storage drive 3 HDD/SSD/NVMe Storage drive 4 HDD/SSD/NVMe Storage drive 5 HDD/SSD/NVMe Storage drive 6 HDD/SSD/NVMe Storage drive 7 HDD/SSD/NVMe About the Oracle Server X7-2...
Page 18: Back Panel Components And Cable Connections
■ “About System Components” on page 19 ■ Back Panel Components and Cable Connections The following figure shows the Oracle Server X7-2 back panel and the location of power supplies, status indicators (LEDs), connectors, and PCIe slots. Call Out Description Power Supply (PS) 0 Power Supply (PS) 0 status indicators: Fault-Service Required LED: amber;...
Page 19: About System Components
These sections describe the components of the server: “Illustrated Parts Breakdown” on page 19 ■ “Customer-Replaceable Units” on page 21 ■ “Field-Replaceable Units” on page 22 ■ Illustrated Parts Breakdown The following figure identifies the major components of the server. About the Oracle Server X7-2...
Page 20 Callout Description Eight storage drives Front LED indicator module Disk backplane Super capacitor (Energy storage module for the Oracle Storage 12 Gb SAS PCIe RAID HBA, Internal card in PCIe slot 4.) Fan modules Motherboard Processors and heatsinks (Single-processor systems contain only a single processor in socket P0; socket P1 contains a cover to protect processor socket pins.)
Page 21: Customer-Replaceable Units
“Servicing PCIe Cards functionality of the server. (CRU)” on page 121 Note - The Oracle Storage 12 Gb SAS PCIe RAID HBA, Internal card is a field replaceable unit (FRU) and should only be serviced by authorized Oracle Service personnel.
Page 22: Field-Replaceable Units
“Servicing Processors heatsink (FRU)” on page 137 Oracle Storage 12 Located in internal PCIe slot 4, the Oracle Storage “Servicing the Internal HBA Gb SAS PCIe RAID 12 Gb SAS PCIe RAID HBA, Internal card manages Card and HBA Super Capacitor HBA, Internal card SAS storage drives.
Page 23: Troubleshooting And Diagnostics
When a server hardware fault event occurs, the system lights the Fault-Service Required LED and captures the event in the system event log (SEL). If you set up notifications through Oracle ILOM, you also receive an alert through the notification method you chose. When you become aware of a hardware fault, address it immediately.
Page 24 Oracle Service personnel. Contact Oracle Service. 6. Clear the fault in Oracle ILOM. Depending on the component, you might need to clear the fault in Oracle ILOM. Generally, components that have a FRU ID clear the fault automatically. Related Information: “Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface”...
Page 25 This procedure uses the basic troubleshooting steps described in “Basic Troubleshooting Process” on page Use this procedure to troubleshoot hardware faults using the Oracle ILOM web interface and, if necessary, prepare the server for service. This procedure provides one basic approach to troubleshooting hardware faults. It uses Note - the Oracle ILOM web interface.
Page 26 Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface In the following example, the Status page shows that the Processor subsystem requires service, which indicates that a hardware component in the subsystem is in a fault state. To identify the component, click the Processors in the Status section.
Page 27: Troubleshooting And Diagnostic Information
To prepare the server for service, see “Preparing for Service” on page After servicing the component, you might need to clear the fault in Oracle ILOM. For more information, refer to the service procedure for the component. Service the component.
Page 28: Troubleshooting Using The Server Front And Back Panel Status Indicators
2. After a few minutes, the main System OK LED slowly flashes the standby blink pattern (0.1 seconds on, 2.9 seconds off), indicating that the SP (and Oracle ILOM) is ready for use. In Standby power mode, the server is not initialized or fully powered on at this point.
Page 29: Server System-Level Status Indicators
System OK Green Indicates the operational state of the chassis. ■ OFF – AC power is not present or the Oracle ILOM boot is not complete. ■ STANDBY BLINK – Standby power is on, but the chassis power is off and the Oracle ILOM SP is running.
Page 30: Server Fan Status Indicators
Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface Status Indicator Icon Color State and Meaning Name host is booting the operating system (OS), or the server host is running the OS. SP OK Green Indicates the state of the service processor.
Page 31: Storage Drive Status Indicators
Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface Status Indicator Icon Color State and Meaning Name Fan Status Amber ■ Off – The fan module is correctly installed and operating within specification. ■ Amber – The fan module is faulty. The front TOP...
Page 32: Network Management Port Status Indicators
Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface Status Indicator Icon Color State and Meaning Name ■ STEADY ON – Normal operation. Input AC power and DC output voltage are within specification. Fault-Service Amber ■ OFF – Normal operation. No service action is Required required.
Page 33: Motherboard Status Indicators
■ Each of the 24 DIMM sockets on the motherboard has an amber fault status indicator Indicators (LED) associated with it. ■ If Oracle ILOM determines that a DIMM is faulty, pressing the Fault Remind button on the motherboard I/O card signals the service processor to light the fault LED associated with the failed DIMM.
Page 34: Troubleshooting System Cooling Issues
Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface Status Indicator Description ■ For more information on the fault remind status indicator and the location of the Fault Remind button, see “Using the Server Fault Remind Button” on page 104.
Page 35: Troubleshooting Power Issues
Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface Cooling Issue Description Action Prevention If these components are filler panel. Ensure that the not installed correctly, the server top cover is in place and airflow inside the server can sits flat and snug on top of the become chaotic and non- server.
Page 36 Troubleshoot Hardware Faults Using the Oracle ILOM Web Interface Power Issue Description Action Prevention AC Power The AC power cords are the Verify that both AC power Use the AC power cord Velcro Connection direct connection between the cords are connected to the...
Page 37: Managing Server Hardware Faults Through The Oracle Ilom Fault Management Shell
The Oracle ILOM Fault Management Shell enables Oracle Service personnel to view and manage fault activity on managed servers and other types of devices. For more information about how to use the Oracle ILOM Fault Management Shell, see the Oracle ILOM User's Guide for System Monitoring and Diagnostics Firmware Release 4.0.x in the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at...
Page 38: Diagnostic Tools
Diagnostic Tools The selection of diagnostic tools available for your server range in complexity from a comprehensive validation test suite (Oracle VTS) to a chronological event log (Oracle ILOM System Log). The selection of diagnostic tools also includes standalone software packages, firmware-based tests, and hardware-based LED indicators.
Page 39: Diagnostic Tool Documentation
Location Oracle ILOM Oracle Integrated Lights Out http://www.oracle.com/goto/ Manager 4.0 Documentation Library ilom/docs UEFI Diagnostics or HWdiag Oracle x86 Servers Diagnostics and http://www.oracle.com/goto/ Troubleshooting Guide for Servers x86admindiag/docs With Oracle ILOM 4.0.x System indicators and sensors This document “Troubleshooting Using the Server Front and Back Panel Status Indicators”...
Page 40: Attach Devices To The Server
Connect an Ethernet cable to the Gigabit Ethernet (NET) connector as needed for OS support. “Back Panel Connector Locations” on page To connect to the service processor's Oracle ILOM over the network, connect an Ethernet cable to the Ethernet port labeled NET MGT. “Back Panel Connector Locations” on page To access the Oracle ILOM command-line interface (CLI) locally, connect a serial null modem cable to the RJ-45 serial port labeled SER MGT.
Page 41 Network management port (NET MGT) The service processor NET MGT port is the optional connection to the Oracle ILOM service processor. The NET MGT port is configured by default to use Dynamic Host Configuration Protocol (DHCP). The service processor NET MGT port uses an RJ-45 cable for a 10/100/1000BASE-T connection.
Page 42: Configuring Serial Port Sharing
By default, the SP console (SER MGT) port sends serial port output from the server. Using Oracle ILOM, you can specify that the host console (COM1) be assigned as owner of the server serial port output. This feature is useful for Windows kernel debugging, as it enables you to view non-ASCII character traffic from the host console.
Page 43 Assign Serial Port Output Using the Oracle ILOM CLI Assign Serial Port Output Using the Oracle ILOM CLI Open an SSH session, and at the command line, log in to the SP Oracle ILOM CLI. Log in as a user with root or administrator privileges. For example:...
Page 44: Server Operating System Names For The Nvme Storage Drives
Assign Serial Port Output Using the Oracle ILOM Web Interface Click Save for the changes to take effect. Connect a serial host to the server. Server Operating System Names for the NVMe Storage Drives If NVMe storage drives are installed in the server front panel, they are labeled NVMe0 through NVMe7.
Page 45: Back Panel Pinhole Switches
Assign Serial Port Output Using the Oracle ILOM Web Interface You can change the boot priority using the Boot Device Priority screen available in the Note - Boot menu of the BIOS Setup Utility. 1. NET 0 2. NET 1 3.
Page 46: Getting Help
“Locating the Chassis Serial Number” on page 47 ■ Contacting Support If the troubleshooting procedures in this chapter fail to solve your problem, use the following table to collect information that you might need to communicate to support personnel. Oracle Server X7-2 Service Manual • October 2017...
Page 47: Locating The Chassis Serial Number
Getting Help System Configuration Your Information Information Needed Service contract number System model Operating environment System serial number Peripherals attached to the system Email address and phone number for you and a secondary contact Street address where the system is located Superuser password Summary of the problem and...
Page 48: Auto Service Requests
Oracle Auto Service Requests (ASR) is a feature available to customers having Oracle Premier Support and is provided to those customers at no additional cost. Oracle ASR is the fastest way to restore system availability if a hardware fault occurs. Oracle ASR software is secure and customer installable, with the software and documentation downloadable from My Oracle Support at https://support.oracle.com.
Page 49: Preparing For Service
Follow all standard cautions, warnings, and instructions marked on the equipment and ■ described in the Oracle Server X7-2 Safety and Compliance Guide and in the printed Important Safety Information for Oracle's Hardware Systems. Ensure that the voltage and frequency of your power source match the voltage and ■...
Page 50: Safety Symbols
Use an antistatic wrist strap. ■ Wear an antistatic wrist strap when handling components such as drive assemblies, boards, or cards. When servicing or removing server components, disconnect the power cords from Oracle Server X7-2 Service Manual • October 2017...
Page 51: Fru Key Identity Properties (Kip) Automated Update
■ FRU Key Identity Properties (KIP) Automated Update Oracle ILOM includes a key identity properties (KIP) auto-update feature that ensures product information that is used for service entitlement and warranty coverage is accurately maintained by the server at all times, including during hardware replacement activities.
Page 52: Required Tools
■ When a server FRU that contains the KIP is removed and a replacement component is installed, the KIP of the replacement component is programmed by Oracle ILOM to contain the same KIP as the other two components. Only one of the quorum members can be replaced at a time. Automated updates can only Note - be completed when two of the three quorum members contain matching key identity properties.
Page 53: Powering Down The Server
Shutdown” on page 56 ■ “Use the Oracle ILOM CLI for Immediate Shutdown” on page 57 ■ “Use the Oracle ILOM Web Interface for Immediate Shutdown” on page 58 Related Information “Power On the Server” on page 214 ■ Preparing for Service...
Page 54: Power Down Server Gracefully Using The Oracle Ilom Cli
Depending on the nature of the problem, you might want to view the system status or the log files or run diagnostics before you shut down the system. For more information, see the Oracle ILOM 4.0 Documentation Library at http://www.oracle.com/goto/ilom/docs.
Page 55 Depending on the nature of the problem, you might want to view the system status or the log files or run diagnostics before you shut down the system. For more information, see the Oracle ILOM 4.0 Documentation Library at http://www.oracle.com/goto/ilom/docs.
Page 56 “Server System-Level Status Indicators” on page 29 ■ “Power Down Server Gracefully Using the Oracle ILOM CLI” on page 54 ■ “Power Down Server Gracefully Using the Oracle ILOM Web Interface” on page 55 ■ “Use the On/Standby Button for Immediate Shutdown” on page 56 ■...
Page 57: Use The Oracle Ilom Cli For Immediate Shutdown
■ “Power Down Server Gracefully Using the Oracle ILOM CLI” on page 54 ■ “Power Down Server Gracefully Using the Oracle ILOM Web Interface” on page 55 ■ “Power Down Server Gracefully Using the On/Standby Button” on page 56 ■...
Page 58: Disconnect Cables From The Server
Related Information “Use the On/Standby Button for Immediate Shutdown” on page 56 ■ “Use the Oracle ILOM Web Interface for Immediate Shutdown” on page 58 ■ Use the Oracle ILOM Web Interface for Immediate Shutdown An immediate power down might corrupt system data, so only use this procedure to Caution - power down the server after attempting the graceful power down procedure.
Page 59: Extend The Server To The Maintenance Position
Extend the Server to the Maintenance Position Power down the server. “Powering Down the Server” on page Disconnect the power cords from the rear of the server. Disconnect all data cables from the rear of the server. Related Information “Back Panel Components and Cable Connections” on page 18 ■...
Page 60 Extend the Server to the Maintenance Position Refer to “Stabilize the Rack” in Oracle Servers X7-2 and X7-2L Installation Guide. Verify that no cables will be damaged or will interfere when the server is extended. Although the cable management arm (CMA) that is supplied with the server is hinged to accommodate extending the server, you should ensure that all cables and cords are capable of extending.
Page 61: Remove The Server From The Rack
Disconnect all the cables and power cords from the server. Remove the cable management arm (CMA). Refer to “Remove the Cable Management Arm” in Oracle Servers X7-2 and X7-2L Installation Guide. Extend the server to the maintenance position. “Extend the Server to the Maintenance Position” on page From the front of the server, pull the green slide-rail release tabs toward the front of the server, and pull the server out of the rack until it is free of the rack rails.
Page 62: Remove The Server Top Cover
Ensure that the AC power cords are disconnected from the server power supplies. Fan modules are hot-pluggable and do not require AC power cables to be disconnected Note - from the server power supplies. Oracle Server X7-2 Service Manual • October 2017...
Page 63 Remove the Server Top Cover If the release button latch is in the locked position, use a Torx T10 screwdriver to turn the release button latch clockwise to the unlocked position. Unlatch the top cover [1]. Lift up on the release button on top of the server cover. Lifting the release button causes the server cover to slide toward the rear of the chassis for easy removal.
Page 64 Remove the Server Top Cover Related Information “Take Antistatic Measures” on page 61 ■ “Install the Server Top Cover” on page 210 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 65: Servicing Storage Drives (Cru)
“Storage Drive Locations and Numbering” on page 66 ■ “Removing and Replacing a Storage Drive” on page 67 ■ “Removing and Replacing an NVMe Storage Drive Using Oracle Solaris” on page 71 ■ “Removing and Replacing an NVMe Storage Drive Using Oracle Linux” on page 74 ■...
Page 66: Storage Drive Failure And Raid
“Storage Drive Status Indicators” on page 31 ■ “Removing and Replacing a Storage Drive” on page 67 ■ “Removing and Replacing an NVMe Storage Drive Using Oracle Solaris” on page 71 ■ “Removing and Replacing an NVMe Storage Drive Using Oracle Linux” on page 74 ■...
Page 67: Removing And Replacing A Storage Drive
Removing and Replacing a Storage Drive Callout Description Storage drive 0 HDD/SSD/NVMe Storage drive 1 HDD/SSD/NVMe Storage drive 2 HDD/SSD/NVMe Storage drive 3 HDD/SSD/NVMe Storage drive 4 HDD/SSD/NVMe Storage drive 5 HDD/SSD/NVMe Storage drive 6 HDD/SSD/NVMe Storage drive 7 HDD/SSD/NVMe The NVMe storage drives are labeled NVMe0 through NVMe7;...
Page 68: Operating System
NVMe storage drives are supported only on servers that are running Oracle Solaris, Note - Oracle Linux, Oracle VM, or Microsoft Windows Server. Servers that are running Red Hat Enterprise Linux do not support NVMe drives. “Removing and Replacing an NVMe Storage Drive Using Oracle ■...
Page 69 Remove a Storage Drive On the drive that you plan to remove, push the latch release button to open the drive latch [1]. The latch is not an ejector. Do not open the latch too far to the right. Doing so can Caution - damage the latch.
Page 70: Install A Storage Drive
“Storage Drive Status Indicators” on page 31 ■ “Storage Drives Hot-Plug Conditions” on page 65 ■ “Storage Drive Failure and RAID” on page 66 ■ “Remove a Storage Drive” on page 67 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 71: Removing And Replacing An Nvme Storage Drive Using Oracle Solaris
“Power On an NVMe Storage Drive and Attach a Device Driver” on page 73 ■ Unmount an NVMe Storage Drive Log in to Oracle Solaris that is running on the server. To find the NVMe drive slot number, type: hotplug list –lc...
Page 72: Remove An Nvme Storage Drive
The following output appears for the NVMe drive that you removed: # hotplug list –lc Connection State Description Path --------------------------------------------------------------------------------------- Slot100 EMPTY PCIe-Native /pci@13,0/pci8086,2030@0/pci111d,80b5@0/pci111d,80b5@5 Install an NVMe Storage Drive Perform this procedure to physically install an NVMe storage drive into the server. Oracle Server X7-2 Service Manual • October 2017...
Page 73: Power On An Nvme Storage Drive And Attach A Device Driver
Power On an NVMe Storage Drive and Attach a Device Driver After you physically remove an NVMe storage drive from the server, wait at least 10 Note - seconds before installing a replacement drive. Remove the replacement drive from its packaging and place the drive on an antistatic mat.
Page 74: Removing And Replacing An Nvme Storage Drive Using Oracle Linux
“Verify Operation of an NVMe Storage Drive” on page 78 ■ Unmount an NVMe Storage Drive Log in to Oracle Linux that is running on the server. Remove the NVMe storage device path. To find the PCIe addresses (Bus Device Function), type: find /sys/devices |egrep ‘nvme[0-9][0-9]?$’...
Page 75 Unmount an NVMe Storage Drive egrep –H ‘.*’ /sys/bus/pci/slots/*/address This commands returns output similar to the following: /sys/bus/pci/slots/10/address:0000:b8:00 /sys/bus/pci/slots/11/address:0000:b6:00 /sys/bus/pci/slots/12/address:0000:b2:00 (instance nvme0, pcie slot 12, drive label nvme2) /sys/bus/pci/slots/13/address:0000:b4:00 (instance nvme1, pcie slot 13, drive label nvme3) In the above output, the bus addresses for the corresponding NVMe instances are highlighted in bold text.
Page 76: Remove An Nvme Storage Drive
To check the NVMe drive enumeration to verify that the NVMe drive has been removed, type: lspci -nnd :0953 View the command output and verify that the entry for the slot number that was disabled no longer appears. Oracle Server X7-2 Service Manual • October 2017...
Page 77: Install An Nvme Storage Drive
Install an NVMe Storage Drive This commands returns output similar to the following: b2:00.0 Non-Volatile memory controller [0108]: Intel Corporation Device [8086:0953] (rev 01) b6:00.0 Non-Volatile memory controller [0108]: Intel Corporation Device [8086:0953] (rev 01) b8:00.0 Non-Volatile memory controller [0108]: Intel Corporation Device [8086:0953] (rev 01) Install an NVMe Storage Drive Perform this procedure to physically install an NVMe storage drive into the server.
Page 78: Verify Operation Of An Nvme Storage Drive
The following sections describe how to remove and replace an NVMe storage drive on a server that is running the Microsoft Windows Server operating system. NVMe storage drive hot plug is not supported for an Oracle Server X7-2 running Note - Microsoft Windows Server.
Page 79: Install An Nvme Storage Drive
Install an NVMe Storage Drive “Remove a Storage Drive” on page Grasp the latch and pull the drive out of the drive slot. Consider your next steps: If you are replacing the drive, continue to “Install an NVMe Storage Drive” on page ■...
Page 80 Install an NVMe Storage Drive “Storage Drive Failure and RAID” on page 66 ■ “Storage Drive Locations and Numbering” on page 66 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 81: Servicing Fan Modules (Cru)
Oracle ILOM. Even if only one fan motor is faulted within the fan module, the Oracle ILOM service processor detects that four fan motors have failed to spin while the fan module is removed.
Page 82 Remove the faulty fan module. Using your thumb and forefinger, grasp the fan module in the finger recesses located in the plastic between the fans. Lift the fan module straight up and out of the chassis. Oracle Server X7-2 Service Manual • October 2017...
Page 83 Remove a Fan Module When removing a fan module, do not rock it back and forth. Rocking a fan module Caution - can cause damage to the motherboard connectors. Set the fan module aside. Do not service any other components in the fan compartment unless the system is Caution - shut down and the power cords are removed.
Page 84: Install A Fan Module
Required LEDs on the front and back of the server are extinguished. “Troubleshooting Using the Server Front and Back Panel Status Indicators” on page 28 more information about identifying and interpreting system indicators. Oracle Server X7-2 Service Manual • October 2017...
Page 85 Install a Fan Module Consider your next step: If you installed the fan module as part of another procedure, return to that procedure. ■ Otherwise, return the server to operation. See “Returning the Server to ■ Operation” on page 209. Related Information “Remove a Fan Module”...
Page 86 Oracle Server X7-2 Service Manual • October 2017...
Page 87: Servicing Power Supplies (Cru)
Servicing Power Supplies (CRU) This section describes how to service power supplies. Power supplies are customer-replaceable units (CRUs) that do not require you to power off the server. For more information about CRUs, “Illustrated Parts Breakdown” on page 19 “Customer-Replaceable Units” on page The power supplies are located at the back of the server.
Page 88: Remove A Power Supply
“Troubleshooting Using the Server Front and Back Panel Status Indicators” on page 28 ■ Remove a Power Supply Identify which power supply requires replacement. Callout Description Power supply 0 Power supply 1 Oracle Server X7-2 Service Manual • October 2017...
Page 89 (->) to identify a power supply failure. Alternatively, to list all known faults in the server, log in to the Oracle Solaris OS and issue the fmadm faulty command, or log in to the Oracle ILOM service processor from the Oracle ILOM Fault Management Shell and issue the fmadm faulty command.
Page 90: Install A Power Supply
Always replace a faulty power supply with a power supply of the same type (model). Caution - Remove the replacement power supply from its packaging and place it on an antistatic mat. Align the replacement power supply with the empty power supply slot [1]. Oracle Server X7-2 Service Manual • October 2017...
Page 91 Note - processor (SP) to propagate the key identity properties (KIP) data to the new power supply. For instructions on resetting the SP, refer to the Oracle Integrated Lights Out Manager (ILOM) 4.0 Configuration and Maintenance Guide Firmware Release 4.0.x at http://www.oracle.com/...
Page 92 Install a Power Supply “Remove a Power Supply” on page 88 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 93: Servicing An Internal Usb Flash Drive (Cru)
Servicing an Internal USB Flash Drive (CRU) This section describes how to service a USB flash drive. The USB flash drive is a customer- replaceable unit (CRU) that requires you to power off the server. For more information about CRUs, see “Illustrated Parts Breakdown”...
Page 94: Install An Internal Usb Flash Drive
Grasp the USB flash drive and pull it out of the internal USB port. Related Information “Remove an Internal USB Flash Drive” on page 93 ■ Install an Internal USB Flash Drive Unpack the replacement USB flash drive. Oracle Server X7-2 Service Manual • October 2017...
Page 95 Install an Internal USB Flash Drive Insert the USB flash drive into the internal USB port. Return the server to operation. Install the server top cover. “Install the Server Top Cover” on page 210. Return the server to the normal rack position. “Return the Server to the Normal Rack Position”...
Page 96 Oracle Server X7-2 Service Manual • October 2017...
Page 97: Servicing The Dimms (Cru)
“Illustrated Parts Breakdown” on page 19 “Customer-Replaceable Units” on page The Oracle Server X7-2 supports a variety of DDR4 DIMM configurations that can include quad-rank (QR) and dual-rank (DR) DDR4 DIMMs. These procedures require that you handle components that are sensitive to Caution - electrostatic discharge.
Page 98: Dimm And Processor Physical Layout
0 (P0) is on the left. In single-processor systems, the DIMM sockets associated with processor 1 (P1) are Note - nonfunctional and should not be populated with DIMMs. Related Information “DIMM Population Scenarios” on page 99 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 99: Dimm Population Scenarios
DIMM Population Scenarios “DIMM Population Rules” on page 99 ■ “Populating DIMMs for Optimal System Performance” on page 100 ■ “DIMM Operating Speeds” on page 103 ■ “DIMM Rank Classification Labels” on page 103 ■ “Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty ■...
Page 100: Populating Dimms For Optimal System Performance
In single-processor systems, install DIMMs only into DIMM sockets associated with processor 0 (P0). Starting with socket P0 D7, first fill the black sockets, and then fill the white sockets, as shown in the following figure. Oracle Server X7-2 Service Manual • October 2017...
Page 101 Populating DIMMs in Single-Processor Systems for Optimal System Performance The following table describes the proper order in which to populate DIMMs in a single- processor system using the numbered callouts in the above figure, and the DIMM socket labels (D0 through D11). Population Order Processor/DIMM Slot Populate black slots first in the following order:...
Page 102: Populating Dimms In Dual-Processor Systems For Optimal System Performance
D11). Population Order Processor/DIMM Slot Populate black slots first in the following order: 1. P0/D7 2. P1/D7 3. P0/D4 4. P1/D4 5. P0/D9 6. P0/D2 7. P1/D9 8. P1/D2 9. P0/D11 Oracle Server X7-2 Service Manual • October 2017...
Page 103: Dimm Operating Speeds
DIMM Operating Speeds Population Order Processor/DIMM Slot 10. P0/D0 11. P1/D11 12. P1/D0 After black slots have been populated, populate white 1. P0/D6 slots in the following order: 2. P1/D6 3. P0/D5 4. P1/D5 5. P0/D8 6. P0/D3 7. P1/D8 8.
Page 104: Dimms
Inconsistencies Between DIMM Fault Indicators and the BIOS Isolation of Faulty DIMMs When a single DIMM is marked as failed by Oracle ILOM (for example, fault.memory. intel.dimm.training-failed is listed in the service processor Event Log), BIOS might disable the entire memory channel that contains the failed DIMM, up to two DIMMs. As a result, none of the memory installed in the disabled channel will be available to the operating system.
Page 105: Identify And Remove The Failed Dimm
Identify and Remove the Failed DIMM Identify and Remove the Failed DIMM Prepare the server for service. Power off the server, and disconnect the power cords from the power supplies. “Powering Down the Server” on page Extend the server to the maintenance position. “Extend the Server to the Maintenance Position”...
Page 106 If the DIMM Fault LED is on (amber), then the DIMM is faulty and should be replaced [1]. ■ To remove the failed DIMM do the following: Rotate both DIMM socket ejectors outward as far as they will go. The DIMM is partially ejected from the socket. Oracle Server X7-2 Service Manual • October 2017...
Page 107: Install A Dimm
Install a DIMM Carefully lift the DIMM straight up to remove it from the socket. Replace each faulty DIMM with either another DIMM of the same rank size (quad- rank or dual-rank) or leave the socket empty. For DIMM replacement instructions, see “Install a DIMM”...
Page 108 Install the server top cover. “Install the Server Top Cover” on page 210. Return the server to the normal rack position. “Return the Server to the Normal Rack Position” on page 212. Oracle Server X7-2 Service Manual • October 2017...
Page 109 (Optional) Use Oracle ILOM to clear server DDR4 DIMM faults. DDR4 DIMM faults are automatically cleared after a new DIMM has been installed. If you need to manually clear DDR4 DIMM faults, refer to the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at http://www.oracle.com/goto/ilom/docs.
Page 110 Oracle Server X7-2 Service Manual • October 2017...
Page 111: Servicing Pcie Risers (Cru)
Servicing PCIe Risers (CRU) This section describes how to service PCIe risers. PCIe risers are customer-replaceable units (CRUs) that require you to power off the server. For more information about CRUs, see “Illustrated Parts Breakdown” on page 19 “Customer-Replaceable Units” on page PCIe cards in all slots are installed on vertical risers.
Page 112: Pcie Riser Location And Differences
PCIe riser with installed PCIe card in slot 2 PCIe riser with M.2 mezzanine and installed cards (2) in slots 3 and 4 (the internal HBA card is installed in slot 4 of this riser.) Oracle Server X7-2 Service Manual • October 2017...
Page 113: Remove A Pcie Riser From Pcie Slot 1 Or 2
Remove a PCIe Riser From PCIe Slot 1 or 2 Callout Description Note - This riser is different from the risers in slots 1 and Related Information “PCIe Slot Characteristics” on page 122 ■ Remove a PCIe Riser From PCIe Slot 1 or 2 PCIe slot 1 is nonfunctional in single-processor systems.
Page 114: Install A Pcie Riser Into Pcie Slot 1 Or 2
Note - attempt to install a PCIe riser from slot 1 or 2 into PCIe slots 3 and 4 and vice versa. Determine into which slot you will install the PCIe riser. Oracle Server X7-2 Service Manual • October 2017...
Page 115 Install a PCIe Riser Into PCIe Slot 1 or 2 Retrieve the PCIe riser and any PCIe cards attached to it. Raise the green-tabbed release lever on the PCIe riser to the open (up) position [1]. Gently press the riser into the motherboard connector until it is seated, and then press the green-tabbed release lever on the PCIe riser to the closed (down) position [1, 2].
Page 116: Remove The Pcie Riser From Pcie Slots 3 And 4
Use Oracle ILOM to clear the server PCIe riser fault. If the PCIe riser fault message in Oracle ILOM is not cleared under Open Problems, you must manually clear the fault in Oracle ILOM. For instructions for manually clearing a PCIe riser fault, see the procedure "Clear Faults for Undetected Replaced or Repaired...
Page 117 Remove the PCIe Riser From PCIe Slots 3 and 4 “Take Antistatic Measures” on page Remove the server top cover. “Remove the Server Top Cover” on page If there is a PCIe card installed in PCIe slot 3, disconnect any external or internal cables.
Page 118: Install The Pcie Riser Into Pcie Slots 3 And 4
[1]. Ensure that the rear bracket on the internal HBA card in PCIe slot 4 is connected to the slot in the server chassis side wall. Oracle Server X7-2 Service Manual • October 2017...
Page 119 Use Oracle ILOM to clear the server PCIe riser fault. If the PCIe riser fault message in Oracle ILOM is not cleared under Open Problems, you must manually clear the fault in Oracle ILOM. For instructions for manually clearing a PCIe riser fault, see the procedure "Clear Faults for Undetected Replaced or Repaired...
Page 120 Install the PCIe Riser Into PCIe Slots 3 and 4 “Remove a PCIe Card From PCIe Slot 3” on page 124 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 121: Servicing Pcie Cards (Cru)
Caution - PCIe cards. You must disconnect all power cables from the system before performing these procedures. For a complete list of supported PCIe cards, refer to the Oracle Server X7-2 Product Note - Notes at http://www.oracle.com/goto/x7-2/docs. This section covers the following topics and procedures: “PCIe Slot Characteristics”...
Page 122: Pcie Slot Characteristics
There are three external PCIe slots and one internal PCIe slot available in the Oracle Server X7-2. The external slots support optional, standard PCIe cards and are numbered 1, 2, and 3 from left to right when you view the server from the rear. The internal slot, which installs on the riser in PCIe slots 3 and 4, supports a required internal SAS controller HBA card.
Page 123: Install A Pcie Card In Pcie Slot 1 Or 2
Install a PCIe Card in PCIe Slot 1 or 2 Hold the riser in one hand and use your other hand to carefully pull the PCIe card connector out of the riser. Disconnect the rear bracket that is attached to the PCIe card from the rear of the PCIe riser.
Page 124: Remove A Pcie Card From Pcie Slot 3
“Remove the PCIe Riser From PCIe Slots 3 and 4” on page 116. Remove the PCIe card from the riser. Hold the riser in one hand and use your other hand to carefully remove the PCIe card connector from the riser. Oracle Server X7-2 Service Manual • October 2017...
Page 125: Install A Pcie Card In Pcie Slot 3
Install a PCIe Card in PCIe Slot 3 Disconnect the rear bracket attached to the PCIe card from the rear of the PCIe riser. Place the PCIe card on an antistatic mat. Whenever you remove a PCIe card, you should replace it with another PCIe card Caution - or a PCIe filler panel.
Page 126 Hold the riser in one hand and use your other hand to carefully insert the PCIe card connector into the riser. Install the PCIe riser. “Install the PCIe Riser Into PCIe Slots 3 and 4” on page 118. Oracle Server X7-2 Service Manual • October 2017...
Page 127: Servicing The Internal M.2 Flash Ssds (Cru)
Servicing the Internal M.2 Flash SSDs (CRU) This section describes how to service M.2 flash solid-state drives (SSDs). M.2 flash SSDs are customer-replaceable units (CRUs) that require you to power off the server. For more information about CRUs, see “Illustrated Parts Breakdown” on page 19 “Customer- Replaceable Units”...
Page 128 Place the M.2 mezzanine on an antistatic mat. If required, perform the procedures for removing the M.2 flash SSDs from the mezzanine. See “Remove an M.2 Flash SSD” on page 130. Related Information “Install an M.2 Mezzanine” on page 129 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 129: Install An M.2 Mezzanine
Install an M.2 Mezzanine Install an M.2 Mezzanine Unpack the replacement M.2 mezzanine and place it on an antistatic mat. If required, ensure that you have installed the M.2 flash SSDs on to the M.2 mezzanine before installing the mezzanine on to the PCIe riser. See “Install an M.2 Flash SSD”...
Page 130: Remove An M.2 Flash Ssd
Gently slide the M.2 flash SSD card rearward and out of the connector to disengage the SSD contacts from the mezzanine socket. Place the M.2 flash SSD on an antistatic mat. Oracle Server X7-2 Service Manual • October 2017...
Page 131: Install An M.2 Flash Ssd
Install an M.2 Flash SSD Repeat Step 2 through Step 4 to remove the second M.2 flash SSD from the opposite side of the M.2 mezzanine. Related Information “Install an M.2 Flash SSD” on page 131 ■ Install an M.2 Flash SSD The M.2 mezzanine contains two M.2 flash SSD sockets (labeled SSD0 and SSD1).
Page 132 Perform the steps to install the M.2 mezzanine with the replacement M.2 flash SSDs on to the PCIe riser. “Install an M.2 Mezzanine” on page 129. Related Information “Remove an M.2 Flash SSD” on page 130 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 133: Servicing The Battery (Cru)
Servicing the Battery (CRU) This section describes how to service the system battery. The system battery is a customer- replaceable unit (CRU) that requires you to power off the server. For more information about CRUs, see “Illustrated Parts Breakdown” on page 19 “Customer-Replaceable Units”...
Page 134: Install The Battery
To dislodge the battery from its retainer, gently push the top edge of the battery away from the retainer. Install the Battery Unpack the replacement battery. Press the new battery into the battery retainer. Return the server to operation. Oracle Server X7-2 Service Manual • October 2017...
Page 135 If the service processor is configured to synchronize with a network time server using Note - the Network Time Protocol (NTP), the Oracle ILOM clock will be reset as soon as the server is powered on and connected to the network; otherwise, proceed to the next step.
Page 136 Oracle Server X7-2 Service Manual • October 2017...
Page 137: Servicing Processors (Fru)
Caution - processor. You must disconnect the power cables from the system before performing these procedures. Processors must be removed and replaced only by authorized Oracle Service Caution - personnel. This procedure requires that you handle components that are sensitive to electrostatic Caution - discharge.
Page 138: Identify And Remove A Faulty Processor
This can happen if you press the Fault Remind button for a long time with fault LEDs lit, or if power was removed from the server for more than 15 minutes. The processor fault LED for the faulty processor lights. The processor fault LEDs are located next to the processors: Oracle Server X7-2 Service Manual • October 2017...
Page 139 Identify and Remove a Faulty Processor If the processor fault LED is off, then the processor is operating properly. ■ If the processor fault LED is on (amber), then the processor is faulty and must be replaced. ■ Callout Description Fault Remind button Fault Remind LED Processor 0 fault LED...
Page 140 4, then 3, then 2, then 1. [1] Lift the processor-heatsink module from the socket [2]. Always hold the processor-heatsink module along the axis of the fins to prevent damage. Separate the processor from the heatsink. Oracle Server X7-2 Service Manual • October 2017...
Page 141 Identify and Remove a Faulty Processor Flip over the processor-heatsink module, place it on a flat surface, and locate the thermal interface material (TIM) breaker slot. While holding down the processor-heatsink module by the edges, insert a flat blade screwdriver into the TIM breaker slot. Servicing Processors (FRU)
Page 142 The blade of the screwdriver goes into the slot between the heatsink and processor carrier, not between the processor and processor carrier. Using a rocking motion, gently pry the corner of the processor carrier away from the heatsink. Oracle Server X7-2 Service Manual • October 2017...
Page 143 Identify and Remove a Faulty Processor Remove the processor carrier with processor from the heatsink by prying or pinching the plastic latch tabs that attach the processor to the heatsink. A thin layer of thermal grease separates the heatsink and the processor. This grease Note - acts as an adhesive.
Page 144: Install A Processor
Distribute the thermal grease over the square heatsink-to-processor contact area using a flat-edged tool [2]. Ensure that you spread thermal grease evenly on the contact areas. Note - Install the new processor. Oracle Server X7-2 Service Manual • October 2017...
Page 145 Install a Processor Align the pin 1 indicators between the heatsink and processor carrier in the packaging tray, and place the heatsink (thermal side down) onto the processor carrier until it snaps in place and lies flat. The processor carrier has latching posts at each corner: two that insert into heatsink holes Note - and two that attach to the edge of the heatsink.
Page 146 Align the processor-heatsink module to the processor socket bolster plate on the motherboard, matching the pin 1 location (a triangle indicator). Callout Description Pin 1 indicator Place the processor-heatsink module on the socket on the motherboard. Oracle Server X7-2 Service Manual • October 2017...
Page 147 Install a Processor The socket bolster plate has alignment pins that go into holes on the processor-heatsink module to help center the module during installation. Ensure that the processor-heatsink module lies evenly on the bolster plate and that the captive screws align with the threaded socket posts [1]. Using a 12.0 in-lbs/ft (inch-pounds/foot) torque driver (part number 7352217) with a Torx T30 bit, tighten the processor-heatsink module to the socket.
Page 148 Refer to the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at for more information about the following steps. http://www.oracle.com/goto/ilom/docs To show server faults, log in to the server as root using the Oracle ILOM CLI, and type the following command to list all known faults on the server: ->...
Page 149 Are you sure you want to clear /SYS/MB/P0 (y/n)? y Set ‘clear_fault_action’ to ‘true’ Alternatively, to clear all known faults in the server, log into the Oracle Solaris OS and issue the fmadm repair command, or log into the Oracle ILOM service processor from the Oracle ILOM Fault Management Shell and issue the fmadm repair command.
Page 150 Oracle Server X7-2 Service Manual • October 2017...
Page 151: Servicing The Disk Backplane (Fru)
Ensure that all power is removed from the server before removing or installing the Caution - disk backplane. You must disconnect the power cables before performing this procedure. The disk backplane should be removed and replaced only by authorized Oracle Caution - Service personnel.
Page 152: Oracle Server X7-2 Service Manual • October
If you do remove the storage drives from the server, record their locations so that you can reinstall them in the same locations. Oracle Server X7-2 Service Manual • October 2017...
Page 153 Remove the Disk Backplane Disconnect the SAS cables or the NVMe cables (if present) from the disk backplane [1]. Disconnect the disk backplane data cable and the temperature sensor cable from the disk backplane [2]. Disconnect the disk backplane power cable from the disk backplane [3]. Servicing the Disk Backplane (FRU)
Page 154 Lift the backplane up and tilt it toward the rear of the server to free it from the hooks and right-side metal bracket, and lift it out of the server [5]. Place the disk backplane on an antistatic mat. Related Information “Install the Disk Backplane” on page 155 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 155: Install The Disk Backplane
Install the Disk Backplane Install the Disk Backplane Install the disk backplane into the server so that it engages the three metal hooks and also sits behind the metal tab located on the right-side chassis wall [1]. Servicing the Disk Backplane (FRU)
Page 156 214. Power on the server. “Power On the Server” on page 214. Verify that the System OK status indicator is steady on. Related Information “Remove the Disk Backplane” on page 151 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 157: Servicing The Front Indicator Module (Fru)
You must disconnect the power cables before performing this procedure. The front indicator module should be removed and replaced only by authorized Caution - Oracle Service personnel. Follow these procedures to remove and install the front indicator module (FIM). “Remove the Front Indicator Module” on page 157 ■...
Page 158 Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis. “Take Antistatic Measures” on page Using a Philips screwdriver, remove the two screws that secure the front indicator module (FIM) assembly to the server chassis [1]. Oracle Server X7-2 Service Manual • October 2017...
Page 159: Install The Front Indicator Module
Install the Front Indicator Module Carefully slide the FIM assembly toward the front of the server to remove it from the chassis [2]. Using a Phillips screwdriver, remove the two screws that secure the plastic temperature sensor housing to the FIM assembly, and then detach the housing from the FIM assembly [2].
Page 160 Install and tighten the two Phillips screws to secure the FIM assembly to the server chassis [3]. Return the server to operation. Return the server to the normal rack position. “Return the Server to the Normal Rack Position” on page 212. Oracle Server X7-2 Service Manual • October 2017...
Page 161 Install the Front Indicator Module Reconnect the data cables to the server and reconnect the power cords to the server power supplies. “Reconnect Data Cables and Power Cords” on page 214. Power on the server. “Power On the Server” on page 214.
Page 162 Oracle Server X7-2 Service Manual • October 2017...
Page 163: Servicing The Temperature Sensor (Fru)
Ensure that all power is removed from the server before removing or installing the Caution - temperature sensor. You must disconnect the power cables before performing this procedure. The temperature sensor should be removed and replaced only by authorized Oracle Caution - Service personnel.
Page 164 Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis. “Take Antistatic Measures” on page Remove the server top cover. “Remove the Server Top Cover” on page Disconnect the temperature sensor cable from the disk backplane. Oracle Server X7-2 Service Manual • October 2017...
Page 165 Remove the Temperature Sensor Using a Phillips screwdriver, remove the two screws that secure the front indicator module (FIM) assembly to the server chassis [1]. Carefully slide the FIM assembly toward the front of the server to remove it from the chassis [2].
Page 166: Install The Temperature Sensor
[2, 3]. Carefully insert the FIM assembly into the front panel of the server chassis [3]. Install and tighten the two Phillips screws to secure the FIM assembly to the server chassis [4]. Oracle Server X7-2 Service Manual • October 2017...
Page 167 Install the Temperature Sensor Reconnect the temperature sensor cable to the disk backplane. Return the server to operation. Install the server top cover. “Install the Server Top Cover” on page 210. Return the server to the normal rack position. “Return the Server to the Normal Rack Position” on page 212.
Page 168 Oracle Server X7-2 Service Manual • October 2017...
Page 169: Servicing The Internal Hba Card And Hba Super Capacitor (Fru)
Parts Breakdown” on page 19 “Field-Replaceable Units” on page For more information about the internal HBA card, refer to the Oracle Storage 12 Gb SAS PCIe RAID HBA Internal: 16 Port and 2 GB Memory Installation Guide For HBA Model 7116970 at http://docs.oracle.com/cd/E87591_01/index.html.
Page 170: Remove The Internal Hba Card And Hba Super Capacitor
Hold the riser in one hand and use your other hand to carefully remove the card from slot 4 of the riser. Disconnect the rear bracket attached to the PCIe card from the rear of the PCIe riser. Oracle Server X7-2 Service Manual • October 2017...
Page 171 Remove the Internal HBA Card and HBA Super Capacitor Disconnect the SAS cables and the super capacitor cable from the internal HBA card and place the card on an antistatic mat. If you are replacing the internal HBA card, use a No. 2 Philips screwdriver to remove the special fitted bracket from the HBA card.
Page 172 If you are removing and replacing only the internal HBA card, you do not need to Note - remove the HBA super capacitor. You can disconnect the HBA super capacitor cable from the internal HBA card and then remove the internal HBA card from the system. Oracle Server X7-2 Service Manual • October 2017...
Page 173: Install The Internal Hba Card And Hba Super Capacitor
Install the Internal HBA Card and HBA Super Capacitor (Optional) Disconnect the data cable from the disk backplane to allow easy access to the Note - super capacitor. Disconnect the super capacitor cable from the super capacitor and place the super capacitor on an antistatic mat [2].
Page 174 Internal HBA Card and HBA Super Capacitor” on page 170. Carefully guide the SAS cables and super capacitor cable that connect to the disk backplane and the super capacitor through the left-side cable trough. Oracle Server X7-2 Service Manual • October 2017...
Page 175 Install the Internal HBA Card and HBA Super Capacitor “Install the Internal HBA Cables” on page 182. If you did not remove the HBA super capacitor when removing the internal HBA card, Note - reconnect the HBA super capacitor cable to the internal HBA card. Install the super capacitor into the server.
Page 176 Install the Internal HBA Card and HBA Super Capacitor To ensure SAS cables are properly connected to the internal HBA card, see “Install the Internal HBA Cables” on page 182. Oracle Server X7-2 Service Manual • October 2017...
Page 177 Install the Internal HBA Card and HBA Super Capacitor Insert the internal HBA card connector into the bottom connector on the riser for PCIe slot 3 and 4. While inserting the HBA, ensure that rear bracket on the HBA card fits into the connector slot on the PCIe riser. Install the PCIe riser.
Page 178 Oracle Server X7-2 Service Manual • October 2017...
Page 179: Servicing The Internal Hba Cables
HBA SAS cable assembly. You must disconnect the power cables before performing this procedure. The HBA SAS cable assembly should be removed and replaced only by authorized Caution - Oracle Service personnel. This section covers the following procedures: “Remove the Internal HBA Cables” on page 179 ■...
Page 180 Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis. “Take Antistatic Measures” on page Remove the server top cover. “Remove the Server Top Cover” on page Oracle Server X7-2 Service Manual • October 2017...
Page 181 Remove the Internal HBA Cables Disconnect both SAS cables from the disk backplane by pressing the latch on the cable connector and then pulling out the connector [1, 2]. Disconnect the SAS cables and the super capacitor cable from the internal host bus adapter (HBA) card.
Page 182: Install The Internal Hba Cables
When attaching SAS cables, ensure that you match the numbers on the SAS cables with the SAS connectors on the disk backplane. Use the following table to ensure proper SAS connections between the disk backplane and the internal HBA card. Oracle Server X7-2 Service Manual • October 2017...
Page 183 Install the Internal HBA Cables HBA Connector Disk Backplane Storage Drives Connector SAS 0-3 0, 1, 2, and 3 SAS 4-7 4, 5, 6, and 7 Install the SAS cables into the disk backplane [1, 2]. To ensure proper connections, see the SAS cable connections table in Step Install the PCIe riser with the internal HBA card into PCIe slot 3 and 4.
Page 184 Oracle Server X7-2 Service Manual • October 2017...
Page 185: Servicing The Nvme Cables
Ensure that all power is removed from the server before removing or installing the Caution - NVMe cables. You must disconnect the power cables before performing this procedure. The NVMe cables should be removed and replaced only by authorized Oracle Caution - Service personnel.
Page 186 “Remove a Fan Module” on page Remove the mid-wall from the server chassis [1, 2]. Using a Torx T10 screwdriver, loosen the four green captive screws that secure the mid-wall to the server chassis. Oracle Server X7-2 Service Manual • October 2017...
Page 187 Remove the NVMe Cable Assembly Lift the mid-wall from the server chassis and set it aside. Disconnect each NVMe cable from the disk backplane by pressing the latch on the cable connector and then pulling out the connector [3]. Disconnect the NVMe cables from the motherboard NVMe connectors [3]. Servicing the NVMe Cables...
Page 188 Remove the NVMe Cable Assembly Carefully lift the NVMe cables from the center cable trough and remove them from the server [4]. Related Information “Install the NVMe Cable Assembly” on page 189 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 189: Install The Nvme Cable Assembly
Install the NVMe Cable Assembly Install the NVMe Cable Assembly Carefully install the NVMe cables through the center cable trough [1]. Connect the NVMe cables to the motherboard NVMe connectors [2]. Servicing the NVMe Cables...
Page 190 Install the server top cover. “Install the Server Top Cover” on page 210. Return the server to the normal rack position. “Return the Server to the Normal Rack Position” on page 212. Oracle Server X7-2 Service Manual • October 2017...
Page 191 Install the NVMe Cable Assembly Power on the server. “Power On the Server” on page 214. Verify that the System OK status indicator is steady on. Related Information “Remove the NVMe Cable Assembly” on page 185 ■ Servicing the NVMe Cables...
Page 192 Oracle Server X7-2 Service Manual • October 2017...
Page 193: Servicing Other Cables
You must disconnect the power cables before performing this procedure. The power, FIM, temperature sensor, and disk backplane data cables should be Caution - removed and replaced only by authorized Oracle Service personnel. This section covers the following procedures: “Remove the Power, FIM, Temperature Sensor, and Disk Backplane Data ■...
Page 194 Remove the disk backplane power cable. Disconnect the disk backplane power cable from the motherboard by pressing the release latch on the side of the cable connector and pulling out the connector [1]. Oracle Server X7-2 Service Manual • October 2017...
Page 195 Remove the Power, FIM, Temperature Sensor, and Disk Backplane Data Cables Disconnect the disk backplane power cable from the disk backplane by pressing the release latch on the side of the cable connector and pulling out the connector [2]. Servicing Other Cables...
Page 196: Cables
“Install the Power, FIM, Temperature Sensor, and Disk Backplane Data ■ Cables” on page 196 Install the Power, FIM, Temperature Sensor, and Disk Backplane Data Cables Install the disk backplane data cable. Oracle Server X7-2 Service Manual • October 2017...
Page 197 Install the Power, FIM, Temperature Sensor, and Disk Backplane Data Cables Connect the disk backplane data cable to the motherboard by opening both side latches and plugging the data cable connector into the motherboard connector [8]. The motherboard connector side latches will close, locking the disk backplane data cable connector in place.
Page 198 “Power On the Server” on page 214. Verify that the System OK status indicator is steady on. Related Information “Remove the Power, FIM, Temperature Sensor, and Disk Backplane Data ■ Cables” on page 194 Oracle Server X7-2 Service Manual • October 2017...
Page 199: Servicing The Motherboard (Fru)
Use the Oracle ILOM backup utility prior to removing the motherboard. This utility Caution - backs up the Oracle ILOM configuration of the service processor. For more information, see the Oracle ILOM 4.0 Documentation Library at http://www.oracle.com/goto/ilom/docs. Servicing the Motherboard (FRU)
Page 200 (KIP) data might be lost. When a server requires service, the KIP is used by Oracle to verify that the warranty on the server has not expired. For more information on KIP, see “FRU Key Identity Properties (KIP) Automated Update”...
Page 201 Remove the Motherboard Remove cables from the motherboard. Disconnect the disk backplane power cable from the motherboard by pressing in on the connector latch and then pulling out the cable connector [1]. Servicing the Motherboard (FRU)
Page 202 Remove the following reusable components from the motherboard and install them onto the replacement motherboard. USB flash drive ■ “Servicing an Internal USB Flash Drive (CRU)” on page DDR4 DIMMs ■ “Servicing the DIMMs (CRU)” on page Oracle Server X7-2 Service Manual • October 2017...
Page 203 Remove the Motherboard Install the DIMMs only in the sockets (connectors) that correspond to the sockets Note - from which they were removed. Performing a one-to-one replacement of the DIMMs significantly reduces the possibility that the DIMMs will be installed in the wrong slots. If you do not reinstall the DIMMs in the same sockets, server performance might suffer and some DIMMs might not be used by the server.
Page 204 Related Information “Customer-Replaceable Units” on page 21 ■ “Field-Replaceable Units” on page 22 ■ “Install the Motherboard” on page 205 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 205: Install The Motherboard
Install the Motherboard Install the Motherboard Attach an antistatic wrist strap to your wrist, and then to a metal area on the chassis. “Take Antistatic Measures” on page Insert the motherboard into the server chassis [1, 2]. Grasp the metal bracket located to the rear of the DIMMs and the finger grasp, and then tilt the front of the motherboard up slightly and push it into the opening in the rear of the server chassis.
Page 206 Ensure that the indicators, controls, and connectors on the rear of the motherboard fit correctly into the rear of the server chassis. Using a Torx T25 screwdriver, tighten the two green captive screws to secure the motherboard bracket/handle to the server chassis [2]. Oracle Server X7-2 Service Manual • October 2017...
Page 207 (KIP) data might be lost. When a server requires service, the KIP is used by Oracle to verify that the warranty on the server has not expired. For more information on KIP, “FRU Key Identity Properties (KIP) Automated Update” on page “Install a Power Supply”...
Page 208 PSN. Related Information “Customer-Replaceable Units” on page 21 ■ “Field-Replaceable Units” on page 22 ■ “Remove the Motherboard” on page 199 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 209: Returning The Server To Operation
Returning the Server to Operation After replacing components inside of the server, perform the procedures in the following sections: “Server Filler Panel Requirements” on page 209 ■ “Remove and Install Filler Panels” on page 209 ■ “Install the Server Top Cover” on page 210 ■...
Page 210: Install The Server Top Cover
If the cover is not fully down and flush with the chassis, slide the cover towards the back of the chassis to position the cover in the correct position. Gently slide the cover toward the front of the chassis until it latches into place with an audible click [2]. Oracle Server X7-2 Service Manual • October 2017...
Page 211: Remove Antistatic Measures
Remove Antistatic Measures As you slide the cover toward the front of the server, the release button on the top of the server automatically rotates downward to the closed position. Latch the top cover by pushing down on the button until it is flush with the cover and you hear an audible click. An audible click indicates that the cover is latched.
Page 212: Return The Server To The Normal Rack Position
Lift the server from the antistatic mat, and reinstall the server into the rack. Refer to “Installing the Server Into a Rack” in Oracle Servers X7-2 and X7-2L Installation Guide for the installation instructions specific to your rackmount kit.
Page 213 CMA. For installation instructions for the CMA, refer to “Install the Cable Management Arm (Optional)” in Oracle Servers X7-2 and X7-2L Installation Guide. If the cables are disconnected from the back of the server, that is, you disconnected the cables because you removed the server completely out of the rack, reconnect the cables.
Page 214: Reconnect Data Cables And Power Cords
Power on the server by performing one of the following actions: Press the On/Standby button on the front bezel. ■ Log in to the Oracle ILOM web interface, click Host Management → Power Control and ■ select Power On from the Select Action list.
Page 215 Power On the Server Log in to the Oracle ILOM command-line interface (CLI), and type the following command ■ at the Oracle ILOM prompt: -> start /System When the server is powered on and the power-on self-test (POST) code checkpoint tests have completed, the green System OK LED status indicator on the front panel of the server lights and remains lit.
Page 216 Oracle Server X7-2 Service Manual • October 2017...
Page 217: Identifying The Server Ports
Identifying the Server Ports This section describes the pinouts of the server connectors: “Gigabit Ethernet Ports” on page 217 ■ “Network Management Port” on page 219 ■ “Serial Management Port” on page 220 ■ “USB Ports” on page 221 ■ Gigabit Ethernet Ports The server has five auto-negotiating gigabit Ethernet (GbE) ports.
Page 218: Sfp+ 10/25Gbe Ports
Low selects reduced bandwidth Transmitter ground (VeeT) (RateSelect) When high, indicates received optical Transmit data (TD+) power below worst-case receiver sensitivity (LOS) Receiver ground (VeeR) Inverted transmit data (TD-) Receiver ground (VeeR) Transmitter ground (VeeT) Oracle Server X7-2 Service Manual • October 2017...
Page 219: Network Management Port
Network Management Port The server has one 10/100/1000BASE-T Ethernet management domain interface, labeled NET MGT. For information on configuring this port for managing the server with Oracle ILOM, refer to the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at http: //www.oracle.com/goto/ilom/docs.
Page 220: Serial Management Port
If you need to connect to the SER MGT port using a cable with either a DB-9 or a DB-25 connector, follow the pin descriptions in the tables to create a crossover adapter appropriate for your serial connection. Oracle Server X7-2 Service Manual • October 2017...
Page 221: Usb Ports
USB Ports RJ-45 to DB-9 Adapter Crossover Wiring Reference TABLE 8 Serial Port (RJ-45 Connector) DB-9 Adapter Signal Description Signal Description Signal Ground Signal Ground Signal Ground Signal Ground TABLE 9 RJ-45 to DB-25 Adapter Crossover Wiring Reference Serial Port (RJ-45 Connector) DB-25 Adapter Signal Description Signal Description...
Page 222 USB 3.0 TX+ Related Information “Back Panel Components and Cable Connections” on page 18 ■ “Disconnect Cables From the Server” on page 58 ■ “Reconnect Data Cables and Power Cords” on page 214 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 223: Setting Up Bios Configuration Parameters
“Common BIOS Setup Utility Tasks” on page 229 ■ If the PCIe riser fault message in Oracle ILOM is not cleared under Open Problems, you must manually clear the fault in Oracle ILOM. For instructions for manually clearing a PCIe riser fault, see the procedure "Clear Faults for Undetected Replaced or Repaired Hardware...
Page 224: Accessing The Bios Setup Utility
■ BIOS Key Mappings When viewing the BIOS output from a terminal using the serial console redirection feature, some terminals do not support function keys. BIOS supports the mapping of function keys Oracle Server X7-2 Service Manual • October 2017...
Page 225: Access Bios Setup Utility Menus
Use a terminal (or terminal emulator connected to a computer) through the serial port on the ■ back panel of the server. Connect to the server using the Oracle ILOM Remote System Console Plus application. ■ Reset or power on the server.
Page 226: Navigate Bios Setup Utility Menus
For further instructions on how to navigate and change settings in the BIOS Setup Utility, refer to the online information provided on the menu. Access the BIOS Setup Utility. “Access BIOS Setup Utility Menus” on page 225. Oracle Server X7-2 Service Manual • October 2017...
Page 227 After modifying any BIOS settings, the subsequent reboot might take longer than a Note - typical reboot where no settings were modified. The additional delay is required to ensure that changes to the BIOS settings are synchronized with Oracle ILOM. Related Information “BIOS Setup Utility Menus” on page 224 ■...
Page 228: Using Uefi Bios
In UEFI BIOS, the configuration screens for the add-in cards appear as menu items in the BIOS Advanced Menu as part of the standard BIOS Setup Utility screens. For example, if the Oracle Storage 12 Gb SAS PCIe RAID HBA, Internal card is installed in the server, the configuration utility for the HBA appears as a menu selection.
Page 229: Uefi Secure Boot
Common BIOS Setup Utility Tasks UEFI Secure Boot Oracle Server X7-2 UEFI BIOS supports UEFI Secure Boot. UEFI Secure Boot defines how platform firmware can authenticate a digitally signed UEFI image, such as an operating system loader or a UEFI driver.
Page 230: Verify Bios Factory Default Settings
■ power off the server, and then press the On/Standby button again to power on the server. From the Oracle ILOM web interface, click Host Management → Power Control and ■ select Reset from the Select Action list. Click Save, and then click OK.
Page 231: Select A Temporary Boot Device
■ power off the server, and then press the On/Standby button again to power on the server. From the Oracle ILOM web interface, click Host Management → Power Control and ■ select Reset from the Select Action list. Click Save, and then click OK From the Oracle ILOM CLI, type ■...
Page 232: Configure Tpm Support
Configure TPM Support The TMP feature set is enabled by default. If you wish to disable it, or to enable it after it has been disabled, perform the procedure in this section. Oracle Server X7-2 Service Manual • October 2017...
Page 233 Configure TPM Support TPM enables you to administer the TPM security hardware in your server. For additional Note - information about implementing this feature, refer to the Windows Trusted Platform Module Management documentation provided by your operating system or third-party software vendor. Access the BIOS Setup Utility menus.
Page 234: Configure Uefi Driver Settings
Microsoft's Windows Trusted Platform Module Management documentation ■ Configure UEFI Driver Settings Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 225. In the BIOS Setup Utility menus, navigate to the IO Menu. Oracle Server X7-2 Service Manual • October 2017...
Page 235 Configure UEFI Driver Settings On the IO Menu screen, select either Internal Devices or Add In Cards and press Enter to display the internal device or add-in card slot for which you want to enable or disable the PCI-E UEFI Driver. Setting Up BIOS Configuration Parameters...
Page 236 Press the F10 key to save the changes and exit the BIOS Setup Utility. Related Information “Access BIOS Setup Utility Menus” on page 225 ■ “BIOS Setup Utility Menus” on page 224 ■ “Exit BIOS Setup Utility” on page 251 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 237: Configure I/O Resource Allocation
Configure I/O Resource Allocation Configure I/O Resource Allocation Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 225. In the BIOS Setup Utility menus, navigate to the IO Menu. Setting Up BIOS Configuration Parameters...
Page 238: Card Slots
Configure I/O Resource Allocation On the IO Menu screen, select Add In Cards and press Enter to display the add-in card slots. Oracle Server X7-2 Service Manual • October 2017...
Page 239 Configure I/O Resource Allocation On the Add In Cards screen, select the slot in which you want to configure the card and press Enter. On the IO resource allocation screen for that card, select IO Enable and press Enter. Do one of the following: ■...
Page 240: Configure Uefi Secure Boot
Configure UEFI Secure Boot Configure UEFI Secure Boot Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 225. On the Main Menu screen, select Security and press Enter. Oracle Server X7-2 Service Manual • October 2017...
Page 241 Configure UEFI Secure Boot On the Security Settings screen, select Secure Boot and press Enter. On the Secure Boot screen, select Secure Boot and press Enter. Do one of the following: ■ Select Enabled to enable UEFI Secure Boot. Continue with the next step to manage policy variables.
Page 242 Enter. Do one of the following: ■ Select Enabled to allow the provisioning of factory default Secure Boot keys when the system is in Setup Mode. When enabled, you can select Install Oracle Server X7-2 Service Manual • October 2017...
Page 243 Configure UEFI Secure Boot Factory Default Keys to force the system to User Mode and install all the factory default Secure Boot keys. ■ Select Disabled to disable the provisioning of factory default Secure Boot keys. When disabled, you can select Delete all Secure Boot Variables to Setting Up BIOS Configuration Parameters...
Page 244 Configure UEFI Secure Boot remove all Secure Boot keys from the system. Selecting this option also resets the system to Setup Mode. Oracle Server X7-2 Service Manual • October 2017...
Page 245 Configure UEFI Secure Boot If you want to enroll an EFI image, select Enroll Efi Image and press Enter. Setting Up BIOS Configuration Parameters...
Page 246 Configure UEFI Secure Boot On the Select a File System screen, Scroll through the list and select the file system that contains the EFI file and press Enter. Oracle Server X7-2 Service Manual • October 2017...
Page 247 Configure UEFI Secure Boot On the Select File screen, scroll through the list and select the EFI file (or another available file) and press Enter. On the next Select File screen, scroll through the list and select the image file that you want to run in Secure Boot mode and press Enter. Setting Up BIOS Configuration Parameters...
Page 248 “Access BIOS Setup Utility Menus” on page 225 ■ “BIOS Setup Utility Menus” on page 224 ■ “UEFI Secure Boot” on page 229 ■ “Exit BIOS Setup Utility” on page 251 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 249: Configure Trusted Execution Technology
Configure Trusted Execution Technology Configure Trusted Execution Technology The Trusted Platform Module (TPM) feature must be enabled on your server before enabling Trusted Execution Technology (TXT). See “Configure TPM Support” on page 232. Access the BIOS Setup Utility menus. “Access BIOS Setup Utility Menus” on page 225.
Page 250 “Access BIOS Setup Utility Menus” on page 225 ■ “BIOS Setup Utility Menus” on page 224 ■ “Trusted Execution Technology” on page 229 ■ “Configure TPM Support” on page 232 ■ “Exit BIOS Setup Utility” on page 251 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 251: Exit Bios Setup Utility
After modifying any BIOS settings, the subsequent reboot might take longer than a Note - typical reboot where no settings were modified. The additional delay is required to ensure that changes to the BIOS settings are synchronized with Oracle ILOM. Related Information “Access BIOS Setup Utility Menus” on page 225 ■...
Page 252: Oracle Server X7-2 Service Manual • October
Oracle Server X7-2 Service Manual • October 2017...
Page 253: Bios Setup Utility Menu Options
This section includes screens of the main menus in the BIOS Setup Utility for Oracle Server X7-2. Following the screen for each menu is a table of the options available from that menu. “BIOS Main Menu Selections” on page 253 ■...
Page 254 Example: [Thu 06/20/2017] System Time Current time is displayed. You can change the time setting. Example: 13:38:27 UPI Link Speed (R/O) SLOW/ Intel UltraPath Interconnect (UPI) operational speed is displayed. The Oracle Server X7-2 Service Manual • October 2017...
Page 255 Example: 4.0.0.0 r115197 PRODUCT INFORMATION Product information is displayed. (R/O) Product Name Product name is displayed. Example: Oracle Server X7-2 Product Serial Number Product serial number is displayed. Example: 1134FML00V Board Serial Number Board serial number is displayed. Example: 489089M+1637E2002E...
Page 256 Secure Boot Customize Secure Boot settings. Attempt Secure Boot Disabled/Enabled Disabled Secure Boot is activated when Platform Key (PK) is enrolled, System mode is User/Deployed, and CSM function is disabled. Oracle Server X7-2 Service Manual • October 2017...
Page 257 BIOS Main Menu Selections Setup Options Options Defaults Description Key Management Enables expert users to modify Secure Boot Policy variables without full authentication. Provision Factory Defaults Disabled/Enabled Disabled Allows the provisioning of factory default Secure Boot keys when the system is in Setup Mode. Install Factory Default keys Yes/No Force system to User Mode and install...
Page 258: Bios Advanced Menu Selections
“BIOS Advanced Menu iSCSI Configuration Options” on page 259 ■ “BIOS Advanced Menu Gigabit Network Connection Options” on page 261 ■ “BIOS Advanced Menu Oracle Dual Port 10Gb/25Gb SFP28 Ethernet Controller ■ Options” on page 262 “BIOS Advanced Menu Driver Health Options” on page 264 ■...
Page 259: Bios Advanced Menu Iscsi Configuration Options
BIOS Advanced Menu Selections “BIOS Advanced Menu PCH SATA Configuration Options” on page 269 ■ “BIOS Advanced Menu Processor Configuration Options” on page 271 ■ “BIOS Advanced Menu Memory Configuration Options” on page 272 ■ “BIOS Advanced Menu CPU Power Management Configuration Options” on page 272 ■...
Page 260 Use to delete one or more attempts. Change Attempt Order Use to change the order of attempts. Use arrow keys to select the attempt, then press plus or minus (+/-) keys to move Oracle Server X7-2 Service Manual • October 2017...
Page 261: Bios Advanced Menu Gigabit Network Connection Options
BIOS Advanced Menu Selections Setup Options Options Defaults Description the attempt up/down in the attempt order list. BIOS Advanced Menu Gigabit Network Connection Options The following table describes the BIOS Advanced Menu Gigabit network connection options. Setup Options Options Defaults Description NIC configuration Use to configure the network...
Page 262: Bios Advanced Menu Oracle Dual Port 10Gb/25Gb Sfp28 Ethernet Controller Options
Lists the Virtual MAC address of the network interface controller (NIC). BIOS Advanced Menu Oracle Dual Port 10Gb/25Gb SFP28 Ethernet Controller Options The following table describes the BIOS Advanced Menu Oracle Dual Port 10Gb/25Gb SFP28 Ethernet controller options. Setup Options Options Defaults...
Page 263 BIOS Advanced Menu Selections Setup Options Options Defaults Description Operational Link Speed AutoNeg AutoNeg Configure the link speed setting to be used as the default link 1Gbps speed for the selected port. For dual port adapters, the adapter 10Gbps supports multiple combinations. 25Gbps Firmware Link Speed AutoNeg...
Page 264: Bios Advanced Menu Driver Health Options
Ethernet controller. Virtual MAC Address (R/O) Lists the virtual MAC address of the Ethernet controller. BIOS Advanced Menu Driver Health Options The following table describes the BIOS Advanced Menu driver health options. Oracle Server X7-2 Service Manual • October 2017...
Page 265: Bios Advanced Menu Serial Port Console Redirection Options
BIOS Advanced Menu Selections Depending on the devices that are populating your PCIe slots, you will see different Note - entries if the devices are publishing their driver health status. Setup Options Options Defaults Description Intel PRO/1000 PCI-E (R/O) Healthy Lists the health status of drivers/ controllers.
Page 266: Bios Advanced Menu Network Stack Options
'start' signal can be sent to restart the flow. Hardware flow control uses two wires to send start/stop signals. BIOS Advanced Menu Network Stack Options The following table lists the BIOS Advanced Menu Network Stack options. Oracle Server X7-2 Service Manual • October 2017...
Page 267: Bios Advanced Menu Nvme Configuration Options
BIOS Advanced Menu Selections Setup Options Options Defaults Description Network Stack Disabled/Enabled Enabled Enable or disable the UEFI network stack. Ipv4 PXE Support Disabled/Enabled Enabled Enable or disable IPv4 PXE Boot support. If disable, the IPv4 PXE Boot Option will not be created.
Page 268: Bios Advanced Menu Trusted Computing 2.0 Options
Use this option to enable or disable storage hierarchy. Endorsement Hierarchy Disabled/Enabled Use this option to enable or disable endorsement hierarchy. TPM 2.0 UEFI Spec Version (R/ Displays the TPM 2.0 UEFI spec version. Oracle Server X7-2 Service Manual • October 2017...
Page 269: Bios Advanced Menu Pch Sata Configuration Options
BIOS Advanced Menu Selections Setup Options Options Defaults Description Physical Presence Spec Version 1.2/1.3 Use this option to select the physical presence spec version. TPM 20 InterfaceType (R/O) Displays the TPM 20 interface type. Device Select (R/O) Displays the TPM device. BIOS Advanced Menu PCH SATA Configuration Options The following table describes the BIOS Advanced Menu PCH SATA configuration options.
Page 270 SATA topology for the SATA port. SATA Port 1, Port 2, Port 3, The same options as SATA Port 4, Port 5, Port 6, and Port Port 0 Software Reserve are 7 Software Reserve displayed Oracle Server X7-2 Service Manual • October 2017...
Page 271: Bios Advanced Menu Processor Configuration Options
BIOS Advanced Menu Selections BIOS Advanced Menu Processor Configuration Options The following table lists the BIOS Advanced Menu Processor Configuration options. Setup Options Options Defaults Description Hyper-threading ALL Disabled/Enabled Enabled Use to enable Hyper Threading. When enabled, two threads are available per enabled core. When disabled, only one thread per enabled core is available.
Page 272: Bios Advanced Menu Memory Configuration Options
C6 (ACPI C3) report to the operating system. Package C State limit Enabled/Disabled Enabled Enable/disable Package C State limit. Energy Performance Performance Balanced Performance Use this option to select the Energy Performance mode. Oracle Server X7-2 Service Manual • October 2017...
Page 273: Bios Advanced Menu Usb Ports Options
BIOS Advanced Menu Selections Setup Options Options Defaults Description Balanced Performance Balanced Energy Energy Efficiency Uncore Frequency Scaling Enabled/Disabled Disabled Enable/disable Uncore Frequency Scaling (USF). CPU Power Limit Enabled/Disabled Disabled Enable/disable CPU power limit. BIOS Advanced Menu USB Ports Options The following table lists the BIOS Advanced Menu USB Ports options.
Page 274: Bios Advanced Menu Disk Freeze Lock Settings Option
This section includes a screen of the BIOS IO Menu. The options that are available from the IO Menu are described in the table that follows. PCIe slot 1 is nonfunctional in single-processor systems. Note - Oracle Server X7-2 Service Manual • October 2017...
Page 275: Bios Io Menu Pci Subsystem Settings Options
BIOS IO Menu Selections The following tables describe the BIOS IO menu options. “BIOS IO Menu PCI Subsystem Settings Options” on page 275 ■ “BIOS IO Menu IO Virtualization Options” on page 276 ■ “BIOS IO Menu IOAT Configuration Options” on page 277 ■...
Page 276: Bios Io Menu Io Virtualization Options
(VFs) in function numbers 8 to 255 of the captured bus number, instead of normal function numbers 0 to 7. Oracle Server X7-2 Service Manual • October 2017...
Page 277: Bios Io Menu Ioat Configuration Options
BIOS IO Menu Selections BIOS IO Menu IOAT Configuration Options The following table describes the BIOS IO Menu IOAT Configuration Options. Setup Options Options Defaults Description Intel IOAT Disabled/Enabled Enabled Enable or disable Intel IOATdevices. DCA Support Disabled/Enabled Enabled Enable or disable direct cache access (DCA) support.
Page 278: Bios Io Menu Pcie Hardware Slot Configuration Options
“BIOS Exit Menu Selections” on page 280 ■ BIOS Boot Menu Selections This section includes a screen of the BIOS Boot Menu. The options that are available from the Boot Menu are described in the table that follows. Oracle Server X7-2 Service Manual • October 2017...
Page 279 BIOS Boot Menu Selections Setup Options Options Defaults Description Retry Boot List Disabled/Enabled Enabled Automatically retries Boot List when all devices have failed. Network Boot Retry Disabled/Enabled/Boot Enabled If enabled, BIOS automatically retries List the PXE list present in the system when all PXE attempts have failed.
Page 280: Bios Exit Menu Selections
Discard Changes Discard any changes made to the setup options. Restore Defaults Restore/load the optimal default values for all of the setup options. Related Information “BIOS Main Menu Selections” on page 253 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 281 BIOS Exit Menu Selections “BIOS Advanced Menu Selections” on page 258 ■ “BIOS IO Menu Selections” on page 274 ■ “BIOS Boot Menu Selections” on page 278 ■ BIOS Setup Utility Menu Options...
Page 282 Oracle Server X7-2 Service Manual • October 2017...
Page 283: Monitoring Components And Identifying Snmp Messages
(CLI), you can collect system-specific information about the server, determine the health state of discrete components, and view any open problems on the server. Oracle ILOM automatically detects system hardware faults and environmental conditions on the server. If a...
Page 284: Monitoring System Components
Some component names are hidden in the Oracle ILOM user interfaces. Further, as of Note - Oracle ILOM 3.2, the Oracle ILOM 3.0 legacy targets /SYS and /STORAGE have been replaced by /System. Even though these legacy targets might be hidden, you can still use them to issue commands.
Page 285: System Chassis Components
System OK LED Color: Green Location: Front and back panels Off: Power is off. Standby blink: Standby power is on; Oracle ILOM SP is running. Slow blink: Startup sequence initiated on host. On: Host is booting OS or running the OS.
Page 286 “Power Unit Components” on page 289 ■ “Processor Components” on page 290 ■ “System Motherboard Components” on page 291 ■ “System Firmware Components” on page 293 ■ “Hard Disk Drive Components” on page 293 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 287: Cooling Unit Components
Monitoring System Components Cooling Unit Components The system has four 40-mm fan modules with two fans in each module. The following table lists the system cooling unit components. Component Name (Oracle ILOM CLI IPMI Type Description Values (if applicable) Targets)
Page 288 “Power Unit Components” on page 289 ■ “Processor Components” on page 290 ■ “System Motherboard Components” on page 291 ■ “System Firmware Components” on page 293 ■ “Hard Disk Drive Components” on page 293 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 289: Memory Device Components
Monitoring System Components Memory Device Components The following table lists the memory device components. Component Name (Oracle ILOM CLI Targets) IPMI Type Description Values (if applicable) /SYS/MB/P[0-x]/D[0-11] Host CPU DIMM FRU /SYS/MB/P[0-x]/D[0-11]/PRSNT Discrete Host CPU DIMM is 01h-ENTITY_ABSENT sensor present.
Page 290: Processor Components
“System Motherboard Components” on page 291 ■ “System Firmware Components” on page 293 ■ “Hard Disk Drive Components” on page 293 ■ Processor Components The following table lists the processor (CPU) components. Oracle Server X7-2 Service Manual • October 2017...
Page 291: System Motherboard Components
Monitoring System Components Component Name (Oracle ILOM CLI IPMI Type Description Values (if applicable) Targets) /SYS/MB/P[0-x] Host CPU FRU /SYS/MB/P[0-x]/PRSNT Discrete sensor Host CPU is present. 01h-ENTITY_PRESENT 02h-ENTITY_ABSENT /SYS/MB/P[0-x]/SERVICE Indicator Host CPU Fault-Service Color: Amber Required LED Location: Motherboard Off: Normal On: Processor was diagnosed as faulty.
Page 292 “Disk Backplane Components” on page 287 ■ “Memory Device Components” on page 289 ■ “Power Unit Components” on page 289 ■ “Processor Components” on page 290 ■ “System Firmware Components” on page 293 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 293: System Firmware Components
“System Motherboard Components” on page 291 ■ “Hard Disk Drive Components” on page 293 ■ Hard Disk Drive Components The following table lists the hard disk drive (HDD) components. Component Name (Oracle ILOM CLI IPMI Type Description Values (if applicable) Targets) /SYS/DBP/HDD[0-x]...
Page 294: Identifying Snmp Trap Messages
It is possible to configure Oracle ILOM to generate Simple Network Management Protocol (SNMP) traps when hardware problems occur. For information about how to configure SNMP alert rule destinations to start receiving these traps, refer to the Oracle Integrated Lights Out Manager (ILOM) 4.0 Documentation Library at: http://www.oracle.com/goto/ilom/docs...
Page 295: Environmental Events
Environmental Events The tables in these sections list the set of SNMP traps that are generated from Oracle ILOM. “Environmental Events” on page 295 ■ “Hard Disk Drive Events” on page 296 ■ “Power Events” on page 297 ■ “Fan Events” on page 302 ■...
Page 296: Hard Disk Drive Events
SNMP Trap: sunHwTrapTempFatalThresholdDeasserted /SYS/T_AMB Oracle ILOM Event Message: Lower fatal threshold no longer exceeded Severity and Description: Informational; A temperature sensor has reported that its value has gone below an upper fatal threshold setting or above a lower fatal threshold setting.
Page 297: Power Events
The following table lists power events. Messages and Descriptions Component Name SNMP Trap: sunHwTrapPowerSupplyError /SYS/PS[0-1]/STATE Oracle ILOM Event Message: PS_PRESENCE ASSERT Severity and Description: Major; A power supply sensor has detected an error. SNMP Trap: sunHwTrapPowerSupplyOk /SYS/PS[0-1]/STATE Oracle ILOM Event Message: PS_PRESENCE DEASSERT Severity and Description: Major;...
Page 298 SNMP Trap: sunHwTrapPowerSupplyError /SYS/PS[0-1]/STATE Oracle ILOM Event Message: PS_CONFIG_ERROR ASSERT Severity and Description Major; A power supply sensor has detected an error. SNMP Trap: sunHwTrapPowerSupplyOk /SYS/PS[0-1]/STATE Oracle ILOM Event Message: PS_CONFIG_ERROR DEASSERT Oracle Server X7-2 Service Manual • October 2017...
Page 299 The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold. SNMP Trap: sunHwTrapSensorThresholdOk /SYS/VPS_FANS Oracle ILOM Event Message: Upper noncritical threshold no longer exceeded /SYS/PS[0-1]/P_IN Severity and Description: Informational; A sensor has reported that its value is in the normal /SYS/PS[0-1]/P_OUT operating range.
Page 300 SNMP Trap: sunHwTrapSensorCritThresholdDeasserted /SYS/PS[0-1]/P_IN Oracle ILOM Event Message: Lower critical threshold no longer exceeded /SYS/PS[0-1]/P_OUT Severity and Description: Informational; A power supply sensor has reported that its value has gone below an upper critical threshold setting or above a lower critical threshold setting.
Page 301 The sunHwTrapThresholdType object indicates whether the threshold was an upper or lower threshold. SNMP Trap: sunHwTrapVoltageOk /SYS/PS[0-1]/V_12V Oracle ILOM Event Message: Upper noncritical threshold no longer exceeded /SYS/PS[0-1]/V_12V_STBY Severity and Description: Informational; A voltage sensor has reported that its value is in the /SYS/PS[0-1]/V_IN normal operating range.
Page 302: Fan Events
SNMP Trap: sunHwTrapFanSpeedCritThresholdDeasserted /SYS/MB/FM[0-3]/F[0-x]/TACH Oracle ILOM Event Message: Lower critical threshold no longer exceeded Severity and Description: Informational; A fan speed sensor has reported that its value has gone below an upper critical threshold setting or above a lower critical threshold setting.
Page 303: Memory Events
Messages and Descriptions Component Name SNMP Trap: sunHwTrapMemoryFault /SYS/MB Oracle ILOM Event Message: event fault.cpu.intel.quickpath.link_slow "The Quickpath Interconnect (QPI) link is operating below normal speed." Severity and Description: Major; A memory component is suspected of causing a fault. SNMP Trap: sunHwTrapMemoryFaultCleared /SYS/MB Oracle ILOM Event Message: event fault.cpu.intel.quickpath.link_slow "The Quickpath...
Page 304: Entity Presence Events
“Cooling Unit Components” on page 287 ■ “Disk Backplane Components” on page 287 ■ “Memory Device Components” on page 289 ■ “Power Unit Components” on page 289 ■ “Processor Components” on page 290 ■ Oracle Server X7-2 Service Manual • October 2017...
Page 305 Entity Presence Events “System Motherboard Components” on page 291 ■ “Hard Disk Drive Components” on page 293 ■ Monitoring Components and Identifying SNMP Messages...
Page 306 Oracle Server X7-2 Service Manual • October 2017...
Page 307: Index
Index setup screens summary, 224 shortcut key sequences, 224 activity indicator, 29 TPM support, 232 add-in cards UEFI BIOS, 228 configuration utilities in UEFI BIOS, 228 board components, 285 Advanced BIOS screen, 258 boot device, selecting, 231 antistatic boot drive mat, 51 LEDs, 31 measures...
Page 308: Oracle Server X7-2 Service Manual • October
44 removing, 170 pinouts, 217 replacing, 169 Exit BIOS screen, 280 exploded view of server, 19 hot-plugging storage drives, 65 external cables, connecting, 40 illustrated parts breakdown, 19 fan modules installing Oracle Server X7-2 Service Manual • October 2017...
Page 309 NVMe cable assembly IO allocation installing, 189 enabling and disabling resources, 237 removing, 185 IO BIOS screen, 274 NVMe cables IPMI type, 284 description, 22 servicing, 185 latch release button storage drive, 69, 72, 76 Oracle Integrated Lights Out Manager (Oracle ILOM)
Page 310 194 standby power mode, 58 power supply, 88 power cable SAS cable assembly, 179 installing, 196 server from rack, 61 removing, 194 storage drive, 67 servicing, 193 temperature sensor cable, 194 Oracle Server X7-2 Service Manual • October 2017...
Page 311 81 gracefully, 53 replacing components gracefully using Oracle ILOM CLI, 54 HBA super capacitor, 169 gracefully using Oracle ILOM web interface, 55 internal HBA card, 169 gracefully using the On/Standby button, 56 processors, 137 immediately, 53 temperature sensor, 163...
Page 312 249 Trusted Platform Module (TPM) enabling and disabling, 232 UEFI driver enabling and disabling, 234 UEFI Secure Boot description, 229 enabling and disabling, 240 USB port pinout, 221 weight of server, 61 Oracle Server X7-2 Service Manual • October 2017...

Oracle X7-2 Service Manual

Table of Contents

Using this Documentation

About the Oracle Server X7-2

Troubleshooting and Diagnostics

Troubleshooting Using the Server Front and Back Panel Status Indicators

Preparing for Service

Table of Contents

Servicing Fan Modules (CRU)

Servicing Power Supplies (CRU)

Servicing an Internal USB Flash Drive (CRU)

Servicing the Dimms (Cru)

Servicing Pcie Risers (CRU)

Servicing Pcie Cards (CRU)

Servicing the Internal M.2 Flash Ssds (CRU)

Servicing the Battery (CRU)

Servicing Processors (FRU)

Servicing the Disk Backplane (FRU)

Servicing the Front Indicator Module (FRU)

Servicing the Temperature Sensor (FRU)

Servicing the Internal HBA Card and HBA Super Capacitor (FRU)

Servicing the Internal HBA Cables

Servicing the Nvme Cables

Servicing Other Cables

Servicing the Motherboard (FRU)

Returning the Server to Operation

Identifying the Server Ports

Setting up BIOS Configuration Parameters

BIOS Setup Utility Menu Options

Monitoring Components and Identifying SNMP Messages

Index

Quick Links

Chapters

Troubleshooting

Need help?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for Oracle X7-2

Summary of Contents for Oracle X7-2