Page 1 Oracle Communications EAGLE LNP Application Processor Alarms and Maintenance Release 10.1 E76220 Revision 1 July 2016...
Page 2 Oracle Corporation and its affiliates disclaim any liability for any damages caused by use of this software or hardware in dangerous applications.
Page 3: Table Of Contents
Scope and Audience..........................13 Documentation Admonishments.......................13 Manual Organization...........................14 My Oracle Support (MOS)........................14 Emergency Response...........................14 Related Specifications..........................15 Customer Training..........................15 Locate Product Documentation on the Oracle Help Center Site...........15 Chapter 2: Maintenance................17 Introduction............................18 Preventive Maintenance........................18 Daily Maintenance Procedures....................18 System Health Check Overview......................24 Health Check Outputs......................26 Running the System Health Check....................30...
Page 4 Decode Alarm Strings......................42 Determine Alarm Cause......................43 Chapter 5: Platform and Application Alarms.........45 Alarm Categories..........................46 MPS Alarm Recovery Procedures......................50 Critical Platform Alarms........................50 1000000000002000 - Uncorrectable ECC Memory Error.............50 1000000000008000 Server NTP Daemon lost NTP synchronization for extended time............................50 1000000000010000 Server's time has gone backwards.............50 Critical Application Alarms........................51 2000000000000001 - LSMS DB Maintenance Required............51 Major Platform Alarms........................51...
Page 5 3000000010000000 - DRBD block device can not be mounted...........73 3000000020000000 - DRBD block device is not being replicated to peer......73 3000000040000000 - DRBD peer needs intervention............73 3000020000000000 - Server NTP Daemon never synchronized.........73 Major Application Alarms........................74 4000000000000001 - Mate ELAP Unavailable...............74 4000000000000002 - RTDB Mate Unavailable..............74 4000000000000004 - Congestion.....................75 4000000000000008 - File System Full..................75...
Page 6 6000000000020000 - Automatic RTDB Backup is not configured........91 Chapter 6: Field Replaceable Units............92 Introduction............................93 Safety Information..........................93 E5-APP-B Card FRUs and Part Numbers..................93 Removing and Replacing E5-APP-B Cards..................94 Removing an E5-APP-B Card....................94 Replacing an E5-APP-B Card....................95 Removing and Replacing a Drive Module Assembly..............99 Removing a Drive Module Assembly.................101...
Page 7 Restarting the ELAP Software......................113 Rebooting the MPS..........................115 Glossary..........................117 E76220 Revision 1, July 2016...
Page 8 Figure 7: Login Window..........................30 Figure 8: Run Health Check..........................31 Figure 9: Displaying System Health Check on ELAP GUI................31 Figure 10: E5-APP-B Card LEDs........................35 Figure 11: Errors Displayed on ELAP GUI....................37 Figure 12: Viewing Alarm Details.........................37 Figure 13: Stop ELAP Software........................41 Figure 14: Stop ELAP Software - Success.....................41...
Page 9 Figure 25: Manage Logs and Backups......................80 Figure 26: Enable LSMS Connection Window.....................84 Figure 27: LSMS Connection Enabled......................84 Figure 28: E5-APP-B Card Eject Hardware Switch, UNLOCKED............94 Figure 29: E5-APP-B Card UNLOCKED.......................95 Figure 30: E5-APP-B Card UNLOCKED.......................97 Figure 31: E5-APP-B Card Inject Levers.......................98 Figure 32: E5-APP-B Card Inject Hardware Switch, LOCKED..............99...
Page 10 Figure 48: Start ELAP Software........................114 Figure 49: Start Software Completion Screen.....................115 Figure 50: Request Reboot of the MPS......................115 Figure 51: Confirm Requested Reboot the MPS..................116 Figure 52: Reboot Information........................116 E76220 Revision 1, July 2016...
Page 11 List of Tables Table 1: Admonishments..........................13 Table 2: System Health Check Operation.....................24 Table 3: E5-APP-B LED Table.........................36 Table 4: Platform and Application Alarms....................46 Table 5: Server Environmental Conditions....................68 Table 6: Server Environmental Conditions....................84 Table 7: Usernames............................109 E76220 Revision 1, July 2016...
Page 12: Chapter 1: Introduction
• Documentation Admonishments..13 • Manual Organization..14 • My Oracle Support (MOS)..14 • Emergency Response..14 • Related Specifications..15 • Customer Training..15 • Locate Product Documentation on the Oracle Help Center Site..15 E76220 Revision 1, July 2016...
Page 13: Overview
Introduction Overview This manual contains the information necessary for the maintenance of the E5-APP-B that supports the EAGLE LNP Application Processor (ELAP). Included are an overview of the E5-APP-B architecture and functions, routine operational procedures, preventative maintenance techniques, and corrective maintenance procedures.
Page 14: Manual Organization
A representative at Customer Access Support (CAS) can assist you with MOS registration. Call the CAS main number at 1-800-223-1711 (toll-free in the US), or call the Oracle Support hotline for your local country from the list at http://www.oracle.com/us/support/contact/index.html. When calling, make the selections in the sequence shown below on the Support telephone menu: 1.
Page 15: Related Specifications
Customer Training Oracle University offers training for service providers and enterprises. Visit our web site to view, and register for, Oracle Communications training: http://education.oracle.com/communication To obtain contact phone numbers for countries or regions, visit the Oracle University Education web site: www.oracle.com/education/contacts...
Page 16 Alarms and Maintenance Introduction The Communications Documentation page appears. Most products covered by these documentation sets will appear under the headings “Network Session Delivery and Control Infrastructure” or “Platforms.” 4. Click on your Product and then the Release Number. A list of the entire documentation set for the selected product and release appears. 5.
Page 17: Chapter 2: Maintenance
Chapter Maintenance This chapter provides maintenance information, Topics: problem detection description, and general recovery • Introduction..18 procedures for the E5-APP-B. • Preventive Maintenance..18 • System Health Check Overview..24 • Running the System Health Check..30 E76220 Revision 1, July 2016...
Page 18: Introduction
Alarms and Maintenance Maintenance Introduction This chapter provides preventive and corrective maintenance information. Customers perform a small number of daily preventive maintenance tasks. The ELAP application performs automatic monitoring and problem reporting. Detailed information about recovery procedures is contained in the remaining chapters of this manual. Preventive Maintenance This section describes the following recommended periodic maintenance: •...
Page 19: Figure 1: Backup The Rtdb
Alarms and Maintenance Maintenance Figure 1: Backup the RTDB 3. Click Backup RTDB. The window in Figure 2: Backup the RTDB Confirmation displays a request for confirmation. Figure 2: Backup the RTDB Confirmation 4. Click Confirm RTDB Backup. If the backup starts successfully, the following message will scroll through the GUI banner: Backup RTDB in progress.
Page 20: Figure 4: Start Elap Software - Success
Alarms and Maintenance Maintenance Figure 4: Start ELAP Software - Success Transferring RTDB Backup File Perform this procedure once each day. The estimated time required to complete this procedure depends on network bandwidth. File sizes can be several gigabytes for the database. 1.
Page 21: Figure 5: Automatic Rtdb Backup Menu Item
Alarms and Maintenance Maintenance Figure 5: Automatic RTDB Backup Menu Item Clicking Automatic RTDB Backup opens the page shown in Figure 6: Automatic RTDB Backup GUI Screen. E76220 Revision 1, July 2016...
Page 22: Figure 6: Automatic Rtdb Backup Gui Screen
Alarms and Maintenance Maintenance Figure 6: Automatic RTDB Backup GUI Screen The Backup Type field has five options: 1. Local 2. Mate 3. Local and Mate 4. Remote 5. None By default, backups shall be stored on both local and mate ELAP servers. If Automatic RTDB Backup is not configured, "None"...
Page 23 Alarms and Maintenance Maintenance • File path where the user can provide the subdirectories created within the directory "/var/TKLC/elap/free/backup/" Note: By default, Backup file is saved in the Default File path. • Option to delete old backups. When the user selects "yes," server will delete the old backups, except the latest number of backup files specified by the user in the "Specify the number of files to maintain"...
Page 24: System Health Check Overview
Alarms and Maintenance Maintenance System Health Check Overview The server runs a self-diagnostic utility program called syscheck to monitor itself. The system health check utility syscheck tests the server hardware and platform software. Checks and balances verify the health of the server and platform software for each test, and verify the presence of required application software.
Page 25 Alarms and Maintenance Maintenance System Check Function mounted and perform checks accordingly. Failures in the file system are reported if certain thresholds are exceeded, if the file system size is incorrect, or if the partition could not be found. Alarm thresholds are reported in a similar manner.
Page 26: Health Check Outputs
Alarms and Maintenance Maintenance Health Check Outputs System health check utility syscheck output can be either Normal (brief) or Verbose (more detailed), depending upon how syscheck was initiated. The following examples show Normal and Verbose output formats: Normal Output Running modules in class disk... Running modules in class hardware...
Page 27 Serial Mezzanine is OK. mezza: 1, CHIP: MEZZ mezz: Serial Mezzanine is OK. mezzb: 1, CHIP: MEZZ mezz: Server Serial Mezz Status OK. oemHW: Only Oracle servers support hwmgmt. psu: This hardware does not support power feed monitoring. psu: Will not run test.
Page 28 Alarms and Maintenance Maintenance sch311x-isa-0a70 voltage: Voltage is OK. Vccp: +1.04 V (min = +0.85 V, max = +1.35 V), CHIP: sch311x-isa-0a70 voltage: Voltage is OK. V3.3: +3.27 V (min = +3.13 V, max = +3.47 V), CHIP: sch311x-isa-0a70 voltage: Voltage is OK. V5: +4.97 V (min = +4.74 V, max = +5.26 V), CHIP: sch311x-isa-0a70 voltage: Voltage is OK.
Page 29 Alarms and Maintenance Maintenance run: Found 1 instance(s) of the tpdProvd process. run: Checking trpd... run: Found 1 instance(s) of the trpd process. run: Checking prov... run: Found 1 instance(s) of the prov process. run: Checking ebdad... run: Found 1 instance(s) of the ebdad process. run: Checking hsopd...
Page 30: Running The System Health Check
Alarms and Maintenance Maintenance Running the System Health Check The operator can run syscheck to obtain the operational platform status with one of the following procedures: • Running syscheck from the Command line • Running syscheck Through the ELAP GUI •...
Page 31: Running Syscheck Using The Syscheck Login
GUI. Instead, you can run syscheck from the syscheck login, and report the results to My Oracle Support (MOS). 1. Connect the Local Access Terminal to the server whose status you want to check (see...
Page 32 Alarms and Maintenance Maintenance 2. Log in as the syscheck user. Login: syscheck Password: syscheck The syscheck utility runs and its output is displayed to the screen. E76220 Revision 1, July 2016...
Page 33: Chapter 3: Problem Detection And Reporting
This chapter provides information about problem Topics: detection and reporting by the platform operating • Detecting and Reporting Problems..34 system and the ELAP application. • E5-APP-B Card LEDs..34 • Displaying Errors on ELAP GUI..37 • Unsolicited Alarm and Information Messages...38 E76220 Revision 1, July 2016...
Page 34: Detecting And Reporting Problems
Problems are detected and reported by the platform operating system and the ELAP application. The E5-APP-B card platform constantly monitors its operational status using the System Health Check utility syscheck. This utility can be initiated also by the user. For more details about syscheck, see System Health Check Overview.
Page 35 Alarms and Maintenance Problem Detection and Reporting The following light-emitting diode (LED) status indicators can be found on the E5-APP-B card: • One Server Status indicator (A) • Four E-Net link and Active LED status indicators (B) • Two drive module status indicators (C)
Page 36: Figure 10: E5-App-B Card Leds
Alarms and Maintenance Problem Detection and Reporting • One Card Eject status indicator (D) Figure 10: E5-APP-B Card LEDs Table 3: E5-APP-B LED Table LED Name HW/SW Controlled Description Server Status Solid Red - Server is halted Flashing Red - Server is booting...
Page 37: Displaying Errors On Elap Gui
Alarms and Maintenance Problem Detection and Reporting Displaying Errors on ELAP GUI If the ELAP application detects an application error or receives an alarm message from the platform layer, the ELAP application displays the error on the graphical user interface (GUI): •...
Page 38: Unsolicited Alarm And Information Messages
Alarms and Maintenance Problem Detection and Reporting Alarm values reported in Figure 12: Viewing Alarm Details may represent multiple alarms. To determine which alarms are indicated, perform Decode Alarm Strings. After determining which alarms are being reported, find the individual alarm numbers in Platform and Application Alarms.
Page 39: Chapter 4: Recovery Support
Chapter Recovery Support The information in this section describes the Topics: recommended backing up of the RTDB and presents • Recovering from Problems..40 additional recovery support procedures that may • Recovering From Alarms..42 be referred to by alarms recovery actions. E76220 Revision 1, July 2016...
Page 40: Recovering From Problems
For ELAP 8.0 or later, daily backups are created automatically. Use the following procedure to restore the RTDB from a previously prepared backup file. Caution: Contact My Oracle Support (MOS) before performing this procedure. 1. Contact My Oracle Support (MOS).
Page 41: Figure 13: Stop Elap Software
Alarms and Maintenance Recovery Support Figure 13: Stop ELAP Software After the software on the selected ELAP has stopped, the screen shown in Figure 14: Stop ELAP Software - Success is displayed. Figure 14: Stop ELAP Software - Success 6. Select RTDB>Maintenance>Restore RTDB. The screen shown in Figure 15: Restoring the RTDB is displayed.
Page 42: Recovering From Alarms
For assistance in deciding which alarm to resolve first or how to perform a recovery procedure, contact My Oracle Support (MOS). Evaluate the following problems to find the appropriate recovery procedure as follows: •...
Page 43: Determine Alarm Cause
Alarms and Maintenance Recovery Support Figure 17: Decode MPS Alarm Screen 4. Click the Decode button. The system returns information on the Alarm Category (Critical Application, Major Platform) and error text, as shown in Figure 18: Decoded MPS Alarm Information. Figure 18: Decoded MPS Alarm Information 5.
Page 44 FRU. • Refer to general procedures used in a number of alarm recovery procedures in Platform and Application Alarms 5. If the alarm persists after performing the appropriate procedure, call My Oracle Support (MOS). E76220 Revision 1, July 2016...
Page 45: Chapter 5: Platform And Application Alarms
Chapter Platform and Application Alarms This chapter provides recovery procedures for Topics: platform and application alarms related to the • Alarm Categories..46 E5-APP-B. • MPS Alarm Recovery Procedures..50 • Critical Platform Alarms..50 • Critical Application Alarms..51 • Major Platform Alarms..51 •...
Page 46: Alarm Categories
Alarms and Maintenance Platform and Application Alarms Alarm Categories This chapter describes recovery procedures to use when an alarm condition or other problem exists on the MPS system. For information about how and when alarm conditions are detected and reported, Detecting and Reporting Problems.
Page 47 Alarms and Maintenance Platform and Application Alarms Alarm Codes and Error Descriptor UAM Number 3000000000000020 - Server Platform Process Error 0372 3000000000000080 - Server Swap Space Shortage 0372 Failure 3000000000000100 - Server provisioning network 0372 error 3000000000000200 – Server Eagle Network A error 0372 3000000000000400 –...
Page 48 Alarms and Maintenance Platform and Application Alarms Alarm Codes and Error Descriptor UAM Number 4000000000000001 - Mate ELAP Unavailable 0373 4000000000000004 - Congestion 0373 4000000000000008 - File System Full 0373 4000000000000010 - Log Failure 0373 4000000000000040 - Fatal Software Error 0373 4000000000000080 - RTDB Corrupt 0373...
Page 49 Alarms and Maintenance Platform and Application Alarms Alarm Codes and Error Descriptor UAM Number 5000000000000100 - Server Core File Detected 0374 5000000000000200 - Server NTP Daemon Not 0374 Synchronized 5000000000000800 - Server Disk Self Test Warning 0374 5000000000001000 - Device Warning 0374 5000000000002000 - Device Interface Warning 0374...
Page 50: Mps Alarm Recovery Procedures
This alarm indicates that chipset has detected an uncorrectable (multiple-bit) memory error that the Error-Correcting Code (ECC) circuitry in the memory is unable to correct. Recovery Contact My Oracle Support (MOS) to request hardware replacement. 1000000000008000 Server NTP Daemon lost NTP synchronization for extended time Alarm Type: TPD...
Page 51: Critical Application Alarms
Description: This alarm indicates that a fan in the EAGLE fan tray in the EAGLE shelf where the E5-APP-B is "jacked in" is either failing or has failed completely. In either case, there is a danger of component failure due to overheating.
Page 52: 3000000000000002 - Server Internal Disk Error
Recovery 1. Run syscheck in Verbose mode. 2. Call My Oracle Support (MOS) and provide the system health check output. 3000000000000008 - Server Platform Error This alarm indicates a major platform error such as a corrupt system configuration or missing files, or indicates that syscheck itself is corrupt.
Page 53: 3000000000000020 - Server Platform Process Error
Alarm ID: TKSPLATMA93000000000000100 Recovery 1. Perform the following substeps to verify that the network configuration is correct. a) Log in as elapconfig on the E5-APP-B server. Enter option 1, Display Configuration, from the ELAP Configuration Menu. /-----ELAP Configuration Menu----------\ /----------------------------------------\...
Page 54 Alarms and Maintenance Platform and Application Alarms |----|-----------------------------------| 4 | Exchange Secure Shell Keys |----|-----------------------------------| 5 | Change Password |----|-----------------------------------| 6 | Platform Menu |----|-----------------------------------| 7 | Configure NTP Server |----|-----------------------------------| e | Exit \----------------------------------------/ Enter Choice: Output similar to the following is displayed. The network configuration information related to the provisioning network is highlighted in bold.
Page 55: 3000000000000200 Server Eagle Network A Error
5. If no other nodes on the local network are experiencing problems and the fault has been isolated to the server or the network administrator is unable to determine the exact origin of the problem, contact My Oracle Support (MOS). 3000000000000200 Server Eagle Network A error...
Page 56 Verify that no fault lights on the Ethenet hubs or switches are illuminated. 2. Perform the following substeps to verify that the network configuration is correct. a) Log in as elapconfig on the E5-APP-B server. Enter option 1, Display Configuration, from the ELAP Configuration Menu.
Page 57: 3000000000000400 Server Eagle Network B Error
5. Verify that the cable from eth01 to the switch tests positive with an Ethernet Line Tester. Replace any faulty cables. 6. If the problem persists, call My Oracle Support (MOS). 3000000000000400 Server Eagle Network B error Alarm Type: TPD Description: This alarm is generated by the MPS syscheck software package and is not part of the TPD distribution.
Page 58 Verify that no fault lights on the Ethernet hubs or switches are illuminated. 2. Perform the following substeps to verify that the network configuration is correct. a) Log in as elapconfig on the E5-APP-B server. Enter option 1, Display Configuration, from the ELAP Configuration Menu.
Page 59 Alarms and Maintenance Platform and Application Alarms |----|-----------------------------------| 4 | Exchange Secure Shell Keys |----|-----------------------------------| 5 | Change Password |----|-----------------------------------| 6 | Platform Menu |----|-----------------------------------| 7 | Configure NTP Server |----|-----------------------------------| 8 | Mate Disaster Recovery |----|-----------------------------------| e | Exit \----------------------------------------/ Enter Choice: Output similar to the following is displayed.
Page 60: 3000000000000800 Server Sync Network Error
1. Verify that both servers are booted up by ensuring that the POWER LEDs on both servers are illuminated green. 2. Perform the following substeps to verify that the network configuration is correct. a) Log in as elapconfig on the E5-APP-B server. Enter option 1, Display Configuration, from the ELAP Configuration Menu. /-----ELAP Configuration Menu----------\...
Page 61 Alarms and Maintenance Platform and Application Alarms /----------------------------------------\ 1 | Display Configuration |----|-----------------------------------| 2 | Configure Network Interfaces Menu | |----|-----------------------------------| 3 | Set Time Zone |----|-----------------------------------| 4 | Exchange Secure Shell Keys |----|-----------------------------------| 5 | Change Password |----|-----------------------------------| 6 | Platform Menu |----|-----------------------------------| 7 | Configure NTP Server |----|-----------------------------------|...
Page 62: 3000000000001000 - Server Disk Space Shortage Error
Figure 19: Manage Logs and Backups c) Click the checkbox of each file to be deleted, then click Delete Selected File(s). 4. Call My Oracle Support (MOS) for assistance. 3000000000002000 - Server Default Route Network Error This alarm indicates that the default network route of the server is experiencing a problem. Running syscheck in Verbose mode will provide information about which type of problem.
Page 63 Alarms and Maintenance Platform and Application Alarms Caution: When changing the network routing configuration of the server, verify that the modifications will not impact the method of connectivity for the current login session. The route information must be entered correctly and set to the correct values. Incorrectly modifying the routing configuration of the server may result in total loss of remote network access.
Page 64 Alarms and Maintenance Platform and Application Alarms This information is maintained by the customer network administrators. b) Log in to the MPS with user name elapconfig. The server designation at this site is displayed as well as hostname, hostid, Platform Version, Software Version, and the date.
Page 65: Figure 20: Enable Lsms Connection Window
Alarms and Maintenance Platform and Application Alarms d) Type Y and press Enter. e) If the LSMS Connection has not been previously disabled, the following prompt is displayed. Type Y and press Enter. The LSMS Connection is currently enabled. Do you want to disable it? [Y] This confirmation is displayed.
Page 66: Figure 21: Lsms Connection Enabled
4. Perform the following substeps to reboot the server if the syscheck Verbose output indicates the following error: An active route cannot be found for a configured default route, . . a) Log in as elapconfig on the E5-APP-B server. Enter option 6, Platform Menu, from the ELAP Configuration Menu. /-----ELAP Configuration Menu----------\...
Page 67: Figure 22: Enable Lsms Connection Window
Alarms and Maintenance Platform and Application Alarms |----|---------------------| 3 | MySQL Backup |----|---------------------| 4 | RTDB Backup |----|---------------------| e | Exit \--------------------------/ Enter Choice: Are you sure you want to reboot the MPS? Reboot MPS A, MPS B or BOTH? [BOTH]: Reboot local MPS...
Page 68: 3000000000004000 - Server Temperature Error
Alarms and Maintenance Platform and Application Alarms 5. Contact My Oracle Support (MOS) for further assistance. Provide the syscheck output collected in the previous steps. 3000000000004000 - Server Temperature Error Alarm Type: TPD Description: The internal temperature within the server is unacceptably high.
Page 69: 3000000000008000 - Server Mainboard Voltage Error
1. Locate the server supplied by the faulty power feed. Verify that all connections to the power supply units are connected securely. To determine where the cables connect to the servers, see the Power Connections and Cables page of the ELAP E5-APP-B Interconnect. 2. Run syscheck (see Running syscheck Through the ELAP GUI).
Page 70: 3000000000020000 - Server Disk Health Test Error
If the alarm is not cleared, go to Step 7. If the problem is not resolved, call My Oracle Support (MOS) for assistance. 3000000000020000 - Server Disk Health Test Error This alarm indicates that the hard drive has failed or failure is imminent.
Page 71: 3000000400000000 - Multipath Device Access Link Problem
Alarms and Maintenance Platform and Application Alarms No recovery necessary. If the condition persists, contact My Oracle Support (MOS) to request hardware replacement. 3000000400000000 - Multipath device access link problem Alarm Type: TPD Description: One or more "access paths" of a multipath device are failing or are not healthy, or the multipath device does not exist.
Page 72: 3000001000000000 - Half-Open Socket Limit
Severity: Major OID: tpdHalfOpenSocketLimit 1.3.6.1.4.1.323.5.3.18.3.1.2.37 Alarm ID: TKSPLATMA37 3000001000000000 Recovery Contact My Oracle Support (MOS). 3000002000000000 - Flash Program Failure Alarm Type: TPD Description: This alarm indicates there was an error while trying to update the firmware flash on the E5-APP-B cards.
Page 73: 3000000010000000 - Drbd Block Device Can Not Be Mounted
2. Determine if the keepalive interface is operating. 3. Determine if heartbeart is running (service TKLCha status). 4. Call My Oracle Support (MOS) for assistance. 3000000010000000 - DRBD block device can not be mounted This alarm indicates that DRBD is not functioning properly on the local server. The DRBD state (disk state, node state, or connection state) indicates a problem.
Page 74: Major Application Alarms
8. If the problem persists, run savelogs to gather system information for further troubleshooting (see Saving Logs Using the ELAP GUI), and contact My Oracle Support (MOS). 4000000000000002 - RTDB Mate Unavailable The local ELAP cannot use the direct link to the Standby for RTDB database synchronization.
Page 75: 4000000000000004 - Congestion
Saving Logs Using the ELAP GUI) and contact My Oracle Support (MOS). 4000000000000008 - File System Full This alarm indicates that the server file system is full. Recovery Call My Oracle Support (MOS) for assistance. E76220 Revision 1, July 2016...
Page 76: 4000000000000010 - Log Failure
4000000000000010 - Log Failure This alarm indicates that the system was unsuccessful in writing to at least one log file. Call My Oracle Support (MOS) for assistance. 4000000000000040 - Fatal Software Error A major software component on the ELAP has failed.
Page 77: 4000000000000800 - Transaction Log Full
You may be able to free up space by deleting unnecessary data in the database. The ELAP must be upgraded in order to add disk capacity. Recovery Contact My Oracle Support (MOS) for assistance. 4000000000002000 - RTDB Resynchronization In Progress This message indicates that the RTDB resynchronization is in progress.
Page 78: 4000000000800000 - Lvm Snapshot Detected That Is Too Full
LSMS audit which may last several hours. Recovery Contact My Oracle Support (MOS). 4000000000800000 - LVM Snapshot detected that is too full This alarm usually occurs when an LVM snapshot has remained in existence too long and has a higher full percentage than expected;...
Page 79: 4000000010000000 - An Instance Of Snapmon Already Running
• prov2snap • auditsnap • backupsnap Recovery Contact My Oracle Support (MOS) Minor Platform Alarms Minor platform alarms involve disk space, application processes, RAM, and configuration errors. 1000000000000001 Breaker panel feed unavailable Alarm Type: TPD Description: This alarm is generated by the MPS syscheck software package and is not part of the TPD distribution.
Page 80: 5000000000000002 - Server Application Process Error
Figure 25: Manage Logs and Backups c) Click the checkbox of each file to be deleted, then click Delete Selected File(s). 4. Call My Oracle Support (MOS) for assistance. 5000000000000002 - Server Application Process Error This alarm indicates that either the minimum number of instances for a required process are not currently running or too many instances of a required process are running.
Page 81: 5000000000000004 - Server Hardware Configuration Error
(refer to Application B Card Hardware and Installation Guide. Recovery 1. Run syscheck in verbose mode. 2. Call My Oracle Support (MOS) for assistance. 5000000000000008 - Server RAM Shortage Warning This alarm indicates one of two conditions: • Less memory than the expected amount is installed.
Page 82 Alarms and Maintenance Platform and Application Alarms Caution: When changing the server’s network routing configuration it is important to verify that the modifications will not impact the method of connectivity for the current login session. It is also crucial that this information not be entered incorrectly or set to improper values. Incorrectly modifying the server’s routing configuration may result in total loss of remote network access.
Page 83 Enter e again to return to the ELAP Configuration Menu. 2. Rerun syscheck. • If the alarm has not been cleared, contact My Oracle Support (MOS) for further assistance. Make the syscheck output available to them. This procedure is complete.
Page 84: 5000000000000080 Server Temperature Warning
Alarms and Maintenance Platform and Application Alarms Figure 26: Enable LSMS Connection Window c) Click the Enable LSMS Connection button. When the connection has been enabled, the workspace displays the information shown inFigure 27: LSMS Connection Enabled.sw Figure 27: LSMS Connection Enabled 5000000000000080 Server temperature warning Alarm Type: TPD Description: This alarm indicates that the internal temperature within the server is outside of the...
Page 85: 5000000000000100 - Server Core File Detected
6. Run syscheck to see if the alarm has cleared • If the alarm has been cleared, the problem is resolved. • If the alarm has not been cleared, contact My Oracle Support (MOS) and provide the system health check output.
Page 86: 5000000000000200 - Server Ntp Daemon Not Synchronized
1. Run syscheck in Verbose mode. (See Running the System Health Check.) 2. Call My Oracle Support (MOS) for assistance. 5000000000002000 - Device Interface Warning This alarm can be generated by either an SNMP trap or an IP bond error. If syscheck is configured to receive SNMP traps, this alarm indicates that a SNMP trap was received with the set state.
Page 87: 5000000000004000 - Server Reboot Watchdog Initiated
1. Run syscheck in Verbose mode. (See Running the System Health Check.) 2. Call My Oracle Support (MOS) for assistance. 5000000000004000 - Server Reboot Watchdog Initiated This alarm indicates that the server has been rebooted due to a hardware watchdog.
Page 88: 5000000000080000 - Ntp Offset Check Failure
Severity: Minor Alarm ID: TKSPLATMI20 Recovery Call My Oracle Support (MOS) for assistance. 5000000000100000 - NTP Stratum Check Failure This alarm indicates that NTP is syncing to a server, but the stratum level of the NTP server is outside the acceptable limit. The alarm message provides the stratum value of the NTP server and the stratum limit set for the system by the application.
Page 89: 5000000080000000 Half Open Socket Warning Limit
2. Run syscheck (see Running syscheck Using the syscheck Login) 3. Contact My Oracle Support (MOS) and provide the system health check output. 5000000000200000 - SAS Presence Sensor Missing This alarm indicates that the server drive sensor is not working.
Page 90: 5000000001000000 - Hp Disk Resync
1. Run syscheck in Verbose mode. 2. If the percent recovering is not updating, wait at least 5 minutes between subsequent runs of syscheck, then call My Oracle Support (MOS) with the syscheck output. 5000000400000000 NTP Source Server is not able to provide correct time This alarm indicates that an NTP server was not able to provide a good time.
Page 91: 6000000000000200 - Rtdb Backup Failed
This alarm indicates that the system was unable to complete an RTDB backup. Recovery Call My Oracle Support (MOS) for assistance. 6000000000000400 - Automatic RTDB Backup Failed This alarm indicates that the system was unable to complete an automatic RTDB backup.
Page 92: Chapter 6: Field Replaceable Units
Chapter Field Replaceable Units This chapter describes the components of an Topics: E5-APP-B card that can be replaced in the field and • Introduction..93 includes procedures for replacing each type of field • Safety Information..93 replaceable unit (FRU). • E5-APP-B Card FRUs and Part Numbers..93 •...
Page 93: Introduction
They are installed in an EAGLE shelf. Even with the advanced reliability of the E5-APP-B design, hardware failures may still occur. The E5-APP-B card is designed for easy maintenance when replacements are needed.
Page 94: Removing And Replacing E5-App-B Cards
Figure 28: E5-APP-B Card Eject Hardware Switch, UNLOCKED 2. WAIT for the E5-APP-B Eject Status LED to go from blinking red to a steady red. When the Eject Status LED is steady red, the E5-APP-B card is in shutdown state.
Page 95: Replacing An E5-App-B Card
4. While holding the I/E interlock and lever, pull the levers (2) away from the shelf until they are parallel to the floor. 5. Remove the E5-APP-B card from the EAGLE shelf. Replacing an E5-APP-B Card Procedure - Replace E5-APP-B card...
Page 96 1. While holding the I/E interlock and lever, pull the levers (2) away from the card until they are parallel to the floor. Figure 30: E5-APP-B Card UNLOCKED illustrates the angle of the interlocks and levers just before inserting E5-APP-B Card into the EAGLE shelf. E76220 Revision 1, July 2016...
Page 97: Figure 30: E5-App-B Card Unlocked
Alarms and Maintenance Field Replaceable Units Figure 30: E5-APP-B Card UNLOCKED 2. Insert the E5-APP-B card into the EAGLE shelf. E76220 Revision 1, July 2016...
Page 98: Figure 31: E5-App-B Card Inject Levers
4. Slide the E5-APP-B Ejector switch (4) down to the LOCKED position (see Figure 32: E5-APP-B Card Inject Hardware Switch, LOCKED). Note: When the Ejector switch goes from UNLOCKED to LOCKED, the E5-APP-B Eject Status LED blinks red as the E5-APP-B card goes online. E76220 Revision 1, July 2016...
Page 99: Removing And Replacing A Drive Module Assembly
Since there are two drive modules configured with RAID in an E5-APP-B card, if one becomes corrupt the other drive continues to function. No down time is required to replace a drive module as this procedure can be used on a setup that is up and running.
Page 100 Alarms and Maintenance Field Replaceable Units md1 : active raid1 sda3[0] sdb3[1] 262080 blocks super 1.0 [2/2] [UU] md3 : active raid1 sdb1[1] sda1[0] 442224640 blocks super 1.1 [2/2] [UU] bitmap: 1/4 pages [4KB], 65536KB chunk unused devices: <none> • On a system where one of the drive modules is healthy and one is corrupt, only the healthy drive module is displayed: sudo cat /proc/mdstat Personalities : [raid1]...
Page 101: Removing A Drive Module Assembly
Procedure - Remove Drive Module Assembly 1. Verify that the drive module is locked in position and in use. The switch lock release (C) is in the LOCKED position and the Status LED on the E5-APP-B card is OFF. Move the switch lock release (C) to the "released" position by pressing in the direction indicated.
Page 102: Figure 33: Drive Module Released
Alarms and Maintenance Field Replaceable Units Figure 33: Drive Module Released 2. Move drive module locking switch (D) from the LOCKED to the unlocked position and wait for Figure 34: Drive Module UNLOCKED Figure 35: the LED (B) to indicate a steady red state. See Drive Module Status, respectively.
Page 103: Figure 34: Drive Module Unlocked
Alarms and Maintenance Field Replaceable Units Figure 34: Drive Module UNLOCKED Caution: Removal of the drive prior to the LED indicating steady red could result in drive corruption. Figure 35: Drive Module Status 3. When the LED indicates a steady red, the drive module can be safely removed. 4.
Page 104: Replacing A Drive Module Assembly
Alarms and Maintenance Field Replaceable Units Figure 36: Drive Module Removal Replacing a Drive Module Assembly Procedure - Replace Drive Module Assembly 1. Slide a new drive(s) module into the drive slot on the card (see Figure 37: Drive Module Replacement).
Page 105: Figure 38: Drive Module Locked
Alarms and Maintenance Field Replaceable Units When drive module locking switch (D) is transitioned from unlocked to locked, the LED will flash Figure 38: Drive Module red to indicate the drive is locked and in process of coming online (see Locked).
Page 106 Alarms and Maintenance Field Replaceable Units md1 : active raid1 sda3[0] sdb3[1] 262080 blocks super 1.0 [2/2] [UU] md3 : active raid1 sdb1[1] sda1[0] 442224640 blocks super 1.1 [2/2] [UU] bitmap: 1/4 pages [4KB], 65536KB chunk unused devices: <none> E76220 Revision 1, July 2016...
Page 107: Appendix A: General Procedures
Appendix General Procedures This chapter includes general procedures for the Topics: E5-APP-B. • Introduction..108 • Accessing the ELAP GUI Interface..108 • Connecting to the Server Command Line..109 • Accessing the ELAP Text Interface..111 • Saving Logs Using the ELAP GUI..112 •...
Page 108: Introduction
Alarms and Maintenance General Procedures Introduction This chapter contains miscellaneous general procedures that are referred to within this manual. Accessing the ELAP GUI Interface ELAP employs a web-based user interface. It uses the typical client-server paradigm. The front end appears on an Internet browser. The back end operates on the platform. The front end is officially ®...
Page 109: Connecting To The Server Command Line
• Use a secure shell (ssh) utility to accessible ELAP server. Use command minicom mate to log on to the mate ELAP server's command line. • If access to the MPS server is not available through an IP network, connect to the E5-APP-B card via the serial port: For connecting the E5-APP-B A card, disconnect the console cable from the serial port on the E5-APP-B card's adapter.
Page 110: Connecting A Local Access Terminal To Server's Serial Port
1. Connect the workstation you will use as the Local Access Terminal to Serial port ttyS0 on the server (see Figure 40: E5-APP-B on ELAP Console Connectivity). Figure 40: E5-APP-B on ELAP Console Connectivity 2. Reconnect the original cables as shown in Figure 40: E5-APP-B on ELAP Console Connectivity.
Page 111: Accessing The Elap Text Interface
Alarms and Maintenance General Procedures Figure 41: Laptop Connection Settings 4. When the prompt appears on the Local Access Terminal, enter either of the following usernames and associated passwords: • To access the ELAP text interface, enter the ELAPconfig username and the password provided by your system administrator.
Page 112: Saving Logs Using The Elap Gui
Saving Logs Using the ELAP GUI During some corrective procedures, it may be necessary to provide Tekelec with information about the ELAP for help in clearing an alarm. These log files are used to aid My Oracle Support (MOS) when troubleshooting the ELAP.
Page 113: Figure 44: Deleting Captured Log Files
Alarms and Maintenance General Procedures 8. Click the checkboxes for the files you want to delete and then click the Delete Selected File(s) button. An example is shown in Figure 44: Deleting Captured Log Files. Figure 44: Deleting Captured Log Files When the log files have been deleted, the GUI displays confirmation, as shown in Figure 45: Delete Log Files...
Page 114: Figure 46: Stop Software Confirmation
Alarms and Maintenance General Procedures 3. From the elapmaint screen, select Process Control>Stop Software. The screen shown in Figure 46: Stop Software Confirmation appears: Figure 46: Stop Software Confirmation 4. On the Stop ELAP Software screen, make sure the checkbox is checked as shown in Figure 47: Stop Software Completion Screen.
Page 115: Figure 49: Start Software Completion Screen
Alarms and Maintenance General Procedures Figure 49: Start Software Completion Screen Rebooting the MPS This procedure is used when referenced by one of the procedures in Platform and Application Alarms. Caution: Perform this procedure only when directed to by one of the procedures in Platform and Application Alarms.
Page 116: Figure 51: Confirm Requested Reboot The Mps
ELAP. Refer to Commands User's Guide to interpret the output. 7. If the problem has not been resolved, contact My Oracle Support (MOS) for assistance. Have the system health check data available. 8. Return to the procedure that directed you to perform this procedure.
Page 117 EAGLE Application Processor (EPAP), Global System for Mobile Communications (GSM), EAGLE Local Number Portability (ELAP), and interface to Local Service Management System (LSMS). E5-APP-B The E5-APP-B card is a complete application server platform E76220 Revision 1, July 2016...
Page 118 Alarms and Maintenance Glossary designed to operate within a heavy duty EAGLE shelf. An E5-APP-B card consists of the card, a microprocessor, 8 GB RAM, and two removable drive modules with an operating system and an application, such as EPAP, loaded.
Page 119 Alarms and Maintenance Glossary manipulating screen data rather than being limited to character based commands. Intelligent Peripheral Internet Protocol - IP specifies the format of packets, also called datagrams, and the addressing scheme. The network layer for the TCP/IP protocol suite widely used on Ethernet networks, defined in STD 5, RFC 791.
Page 120 A signaling path from an LSP to an RSP using a specified Link Set. RTDB Real Time Database Secure Shell See SSH. Short Message Tekelec Platform Development The Oracle Communications Tekelec Platform (TPD) is a standard Linux-based operating system packaged and distributed E76220 Revision 1, July 2016...
Page 121 Alarms and Maintenance Glossary by Oracle. TPD provides value-added features for managing installations and upgrades, diagnostics, integration of 3rd party software (open and closed source), build tools, and server management tools. Unsolicited Alarm Message A message sent to a user interface...

Oracle E5-APP-B Alarms And Maintenance

Chapter 1: Introduction

Chapter 2: Maintenance

Chapter 3: Problem Detection and Reporting

Chapter 4: Recovery Support

Chapter 5: Platform and Application Alarms

Chapter 6: Field Replaceable Units

Appendix A: General Procedures

Quick Links

Need help?

Questions and answers

Related Manuals for Oracle E5-APP-B

Summary of Contents for Oracle E5-APP-B

Table of Contents