IBM Power System E850C Technical Overview And Introduction
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Server
  5. E850C
  6. Technical overview and introduction
IBM Power System E850C Technical Overview And Introduction

IBM Power System E850C Technical Overview And Introduction

Hide thumbs Also See for Power System E850C:
Table of Contents

Advertisement

Quick Links

Download this manual
Front cover
IBM Power System E850C
Technical Overview and Introduction
Alexandre Bicas Caldeira
Volker Haug
Redpaper

Advertisement

Table of Contents
loading

Related Manuals for IBM Power System E850C

Summary of Contents for IBM Power System E850C

  • Page 1 Front cover IBM Power System E850C Technical Overview and Introduction Alexandre Bicas Caldeira Volker Haug Redpaper...
  • Page 3 International Technical Support Organization IBM Power System E850C: Technical Overview and Introduction October 2016 REDP-5412-00...
  • Page 4 Note: Before using this information and the product it supports, read the information in “Notices” on page vii. First Edition (October 2016) This edition applies to the IBM Power System E850C (8408-44E) server. This document was created or updated on July 12, 2017. © Copyright International Business Machines Corporation 2016. All rights reserved.

  • Page 5: Table Of Contents

    1.8.2 IBM Solution Edition for Healthcare ........
  • Page 6 2.14.2 IBM AIX operating system ........
  • Page 7 2.15.1 IBM EnergyScale technology ........
  • Page 8 IBM Redbooks ........

  • Page 9: Notices

    This information was developed for products and services offered in the US. This material might be available from IBM in other languages. However, you may be required to own a copy of the product or product version in that language in order to access it.

  • Page 10: Trademarks

    IBM, the IBM logo, and ibm.com are trademarks or registered trademarks of International Business Machines Corporation, registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A current list of IBM trademarks is available on the web at “Copyright and trademark information” at http://www.ibm.com/legal/copytrade.shtml...

  • Page 11: Preface

    IT. However, finding the correct mix between traditional IT, private cloud, and public cloud can be a challenge. The new Power E850C server and IBM Cloud PowerVC manager can enable clients to accelerate the transformation of their IT infrastructure for cloud while providing tremendous flexibility during the transition.

  • Page 12: Authors

    Flexible capacity on demand Power to Cloud Services This publication is for professionals who want to acquire a better understanding of IBM Power Systems products. The intended audience includes the following roles: Clients Sales and marketing professionals Technical support professionals...

  • Page 13: Now You Can Become A Published Author, Too

    Your comments are important to us! We want our papers to be as helpful as possible. Send us your comments about this paper or other IBM Redbooks publications in one of the following ways: Use the online Contact us review Redbooks form found at: ibm.com/redbooks...

  • Page 14: Stay Connected To Ibm Redbooks

    Follow us on Twitter: http://twitter.com/ibmredbooks Look for us on LinkedIn: http://www.linkedin.com/groups?home=&gid=2130806 Explore new Redbooks publications, residencies, and workshops with the IBM Redbooks weekly newsletter: https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm Stay current on recent Redbooks publications with RSS Feeds: http://www.redbooks.ibm.com/rss.html IBM Power System E850C: Technical Overview and Introduction...

  • Page 15: Chapter 1. General Description

    It offers an improved 4-socket system that delivers faster POWER8 processors up to 4.22 GHz, with up to 4 TB of DDR4 memory, built-in IBM PowerVM virtualization, capacity on demand. It also integrates cloud management to help clients deploy scalable, mission-critical business applications in virtualized, private cloud infrastructures.

  • Page 16: Systems Overview

    Up to 1,536 SAS bays for disk/SSD with EXP24S I/O drawers The Power E850C server is a single enclosure server that uses IBM POWER8 processor technology. It can be configured with two, three, or four processor modules with one machine type-model (8408-44E).
  • Page 17 Redundant and spare internal cooling fans Hot plug Time of Day battery Highly resilient architecture for power regulators The Power E850C server supports the IBM Solution Editions for SAP HANA and IBM Solution Edition for Healthcare offerings. Figure 1-1 shows the Power E850C front view.

  • Page 18: Operating Environment

    Operating frequency 50 - 60 Hz +/- 3 Hz ac Maximum power consumption 3,850 Watts Maximum power source 3.90 kVA loading Maximum thermal output 13,140 BTU/hour Maximum altitude 3,050 m (10,000 ft.) IBM Power System E850C: Technical Overview and Introduction...

  • Page 19: Physical Package

    Environmental assessment: The IBM Systems Energy Estimator tool can provide more accurate information about power consumption and thermal output of systems based on a specific configuration, including adapters and I/O expansion drawers. The IBM Systems Energy Estimator tool can be accessed online at: http://www-912.ibm.com/see/EnergyEstimator...

  • Page 20: System Features

    Choice of three storage backplane features with different integrated SAS RAID controller options. All backplane options have eight SFF-3 SAS bays, four 1.8-inch SSD bays, and one DVD bay. All backplane options offer IBM Easy Tier® function for mixed HDD/SSD arrays: –...

  • Page 21: Minimum Configuration

    System unit I/O (integrated I/O): – HMC ports: Two 1 GbE RJ45. – USB ports: Four USB 3.0 (two front and two rear) for general use and USB 2.0 (rear) for limited use. – System (serial) port: One RJ45. Hot-plug, redundant power supplies: –...

  • Page 22: Power Supply Features

    The Dual Controller Disk Backplane with write cache supports RAID 0, 1, 5, 6, 10, 5T2, 6T2, and 10T2 (#EPVN). The pair of controllers handles all 12 integrated SAS bays and the DVD bay. IBM Power System E850C: Technical Overview and Introduction...

  • Page 23: Storage Backplane Integrated Easy Tier Function

    The Easy Tier function is provided with all three storage backplanes (#EPVN, #EPVP, #EPVQ). Conceptually, this function is like the Easy Tier function found in IBM Storage products such as the IBM System Storage DS8000®, IBM Storwize® V7000, and SAN Volume Controller.

  • Page 24: Pcie Gen3 I/O Expansion Drawer

    Table 1-3 shows PCIe adapters that are supported by the Power E850, either internally or in a PCIe Gen3 I/O expansion drawer. Table 1-3 Feature of PCIe adapters supported internally or in a PCIe Gen3 I/O expansion drawer Description Feature PCIe2 4-port 1 GbE Adapter 5899 IBM Power System E850C: Technical Overview and Introduction...
  • Page 25 Description Feature PCIe2 4-port 10 Gb + 1 GbE) SR+RJ45 Adapter EN0S PCIe2 4-port 10 Gb + 1 GbE) Copper SFP+RJ45 Adapter EN0U PCIe2 2-port 10/1 GbE BaseT RJ45 Adapter EN0W PCIe3 4-port 10 GbE SR Adapter EN15 PCIe3 4-port 10 GbE SFP+ Copper Adapter EN17 PCIe3 2-port 10 GbE NIC&RoCE SR Adapter EC2N...

  • Page 26: Exp24S Sff Gen2-Bay Drawer

    With AIX, Linux, and VIOS, you can order the EXP24S with four sets of six bays, two sets of 12 bays, or one set of 24 bays (mode 4, 2, or 1). Mode setting is done by IBM Manufacturing. If you need to change the mode after installation, ask your IBM support representative to see the following site: http://w3.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS5121...

  • Page 27: Build To Order

    The available IBM Solution Editions are described in the next sections. 1.8.1 IBM Power Systems Solution Editions for SAP HANA IBM POWER8 servers are the ideal platform for running your SAP S/4HANA environment whether on premises or in a hybrid cloud environment. Power Systems Solution Edition for SAP HANA offers a competitively priced POWER8 server that is preconfigured to support the deployment of SAP HANA, SAP's in-memory database.
  • Page 28 This product represents a continuation of IBM's long-standing partnership with SAP. Power Systems Solution Edition enables clients to start fast and, to use SAP's phrase, “run simple.” It also provides the capacity to manage growth and the flexibility to integrate new functions, which helps minimize risks that are associated with adopting new business technologies.

  • Page 29: Ibm Solution Edition For Healthcare

    1.9 Management options This section discusses the supported management interfaces for the servers. A Hardware Management Console (HMC) is required for managing the IBM Power E850C. It has a set of functions that are necessary to manage the system: Creating and maintaining a multiple-partition environment...
  • Page 30 The HMC could either be a hardware or a virtual appliance. Figure 1-7 shows the available configurations for a Power Systems HMCs infrastructure. Note: Virtualization on the IBM Power E850C is also supported by the Integrated Virtualization Manager (IVM). Multiple Power Systems servers can be managed by a single HMC. Each server can be connected to multiple HMC consoles to build extra resiliency into the management platform.

  • Page 31: System Racks

    The Power E850C server and its I/O drawers are designed to fit a standard 19-inch rack such as IBM features 7014-T00, 7014-T42, 7014-B42, 7965-94Y, #0551, and #0553. The Power E850C IBM manufacturing rack integration can be ordered with a 36U (7014-T00) or a 42U (7014-T42) rack. A same serial-number model upgrade MES is placed in either feature #0551 or #0553 rack.

  • Page 32: Ibm 7014 Model T00 Rack

    Installing in non-IBM racks: The client is responsible for ensuring that the installation of the server in the preferred rack or cabinet results in a configuration that is stable, serviceable, safe, and compatible with the server requirements for power, cooling, cable management, weight, and rail security.

  • Page 33: Ibm 7965 Model 94Y Rack

    24-inch floor tiles. The IBM 42U Slim Rack has a lockable perforated front steel door, providing ventilation, physical security, and visibility of indicator lights in the installed equipment within. In the rear, either a lockable perforated rear steel door (#EC02) or a lockable Rear Door Heat Exchanger (RDHX)(1164-95X) is used.
  • Page 34 RJ45 ports on the front of the PDU enable the client to monitor each receptacle’s electrical power usage and to remotely switch any receptacle on or off. The PDU is shipped with a generic PDU password. IBM strongly urges clients to change it upon installation. Feature #EPTN This feature is an intelligent, switched 200 - 240 volt ac PDU with twelve C13 receptacles on the front of the PDU.

  • Page 35: Rack-Mounting Rules

    #6657, #6658, and #6667. Two RJ45 ports on the front of the PDU enable the client to monitor each receptacle’s electrical power usage and to remotely switch any receptacle on or off. The PDU is shipped with a generic PDU password. IBM strongly urges clients to change it upon installation.
  • Page 36 IBM Power System E850C: Technical Overview and Introduction...

  • Page 37: Chapter 2. Architecture And Technical Overview

    Architecture and technical Chapter 2. overview This chapter describes the overall system architecture for the IBM Power System E850C (8408-44E). The bandwidths that are provided throughout the section are theoretical maximums that are used for reference. The speeds that are shown are at an individual component level. Multiple components and application implementation are key to achieving the best performance.

  • Page 38: Physical System Design

    A Power E850C server should be installed into a rack that has been certified and tested to support the system, such as the IBM 7014-T00 rack. The front of the system node contains the front fans (five) for the system. It also provides access to the internal storage bays, the operator panel, and the optional DVD-RAM drive.
  • Page 39 The rear of the system provides access to the internally installed PCIe cards, the service processor connections, and the power supply units. Figure 2-2 shows a rear view of the Power E850C server showing power supply detail. Figure 2-2 Rear view of the Power E850C server Chapter 2.

  • Page 40: Logical System Design

    The Power E850C can support up to one PCIe I/O expansion drawer per processor module. The following factors can influence the placement of PCIe cards in the Power E850C server: All PCIe slots in the system node are SR-IOV capable. IBM Power System E850C: Technical Overview and Introduction...
  • Page 41 All PCIe x16 slots in the system node are CAPI capable. At least one PCIe Ethernet adapter is required on the server by IBM to ensure proper manufacture and test of the server. One of the x8 PCIe slots is used for this required adapter, identified as the C11 slot.
  • Page 42 Figure 2-5 shows the logical design of the Power E850C server with three processor modules installed. Figure 2-5 Logical diagram for a Power E850C with three processor modules installed IBM Power System E850C: Technical Overview and Introduction...

  • Page 43: The Ibm Power8 Processor

    DDR3 or DDR4 memory. Each buffer chip also includes an L4 cache to reduce the latency of local memory accesses. For an in-depth discussion on the POWER8 processor, see the IBM Power System E850 Technical Overview and Introduction, REDP-5222 at: http://www.redbooks.ibm.com/abstracts/redp5222.html...

  • Page 44: Memory Subsystem

    Power Systems server running PowerVM as a hypervisor. A one-time, 60-day trial of Active Memory Expansion is available on each server to confirm the estimated results. You can request the trial activation code on the IBM Power Systems Capacity on Demand website: http://www.ibm.com/systems/power/hardware/cod To activate Active Memory Expansion on a Power E850C server, the chargeable feature code #4798 must be ordered, either as part of the initial system order or as an MES upgrade.

  • Page 45: Cdimm Design

    By adopting this architecture for the memory DIMMs, several decisions and processes regarding memory optimizations are run internally into the CDIMM. This technique saves bandwidth and allows for faster processor-to-memory communications. It also allows for a more robust RAS. For more information, see Chapter 4, “Reliability, availability, and serviceability” on page 101.
  • Page 46 At least 50% of the installed memory must be activated by using memory activation features. DDR4 memory modules cannot be mixed with DDR3. If a DDR4 feature is used, all the memory on the system must be DDR4. IBM Power System E850C: Technical Overview and Introduction...

  • Page 47: Cdimm Plugging Order

    2.5.3 CDIMM plugging order Each processor module has two memory controllers. Each of these memory controllers connects to four CDIMM slots within the system. The physical connections and location codes of the memory slots are shown in Figure 2-7. Processor Processor Processor Processor...
  • Page 48 Processor Module 0 Processor Module 1 Memory Controller 1 Memory Controller 0 Memory Controller 1 Memory Controller 0 C32 C33 C30 C31 C28 C29 C26 C27 C40 C41 C38 C39 C36 C37 C34 C35 IBM Power System E850C: Technical Overview and Introduction...

  • Page 49: Memory Activations

    Table 2-6 on page 34 shows the following pairs: First CDIMM pair is identical and plugged into P2-C16 and P2-C17 Second CDIMM pair is identical and plugged into P2-C24 and P2-C25 Third CDIMM pair is identical and plugged into P2-C32 and P2-C33 Fourth CDIMM pair is identical and plugged into P2-C40 and P2-C41 Fifth CDIMM pair is identical and plugged into P2-C12 and P2-C13 Sixth CDIMM pair is identical and plugged into P2-C20 and P2-C21...
  • Page 50 These figures are listed in Table 2-8. Table 2-8 Maximum theoretical memory bandwidths Processor modules Two processor Three processor Four processor installed modules installed modules installed modules installed Maximum theoretical 384 GBps 576 GBps 768 GBps memory bandwidth IBM Power System E850C: Technical Overview and Introduction...
  • Page 51 Server summaries The following tables summarize the cache and memory bandwidths for a number of different Power E850C server configurations. Table 2-9 shows the theoretical maximum bandwidths for two, three, or four installed 3.65 GHz (12 core) processor modules. Table 2-9 Theoretical maximum bandwidths for 3.65 GHz system configurations System bandwidth Power E850C Power E850C...

  • Page 52: Active Memory Mirroring

    It is possible to check whether the Active Memory Mirroring option is enabled and change its status through Hardware Management Console (HMC), under the Advanced tab on the System Properties window (Figure 2-8). Figure 2-8 System Properties panel on an HMC IBM Power System E850C: Technical Overview and Introduction...

  • Page 53: Memory Error Correction And Recovery

    After a failure on one of the CDIMMs containing hypervisor data occurs, all the server operations remain active and the flexible service processor (FSP) isolates the failing CDIMMs. Systems stay in the partially mirrored state until the failing CDIMM is replaced. Some components are not mirrored because they are not vital to the regular server operations and require a larger amount of memory to accommodate their data: Advanced Memory Sharing Pool...

  • Page 54: Capacity On Demand

    Total Cost of Ownership and Total Cost of Acquisition of the solution. IBM Power System E850C: Technical Overview and Introduction...

  • Page 55: Elastic Capacity On Demand

    Figure 2-9 shows a comparison between two scenarios: A fully activated system versus a system with CUoD resources being activated along with the project timeline. Projected requirement Core activations Core activations Initial requirement Core activations Core activations Core activations > Time >...
  • Page 56 A monitor that resides on the server records the usage activity. This usage data must be sent to IBM monthly. A bill is then generated based on the total amount of processor and memory resources used, in increments of processor and memory (1 GB) days.

  • Page 57: Utility Capacity On Demand

    For more information about registration, enablement, and usage of Elastic CoD, visit the following website: http://www.ibm.com/systems/power/hardware/cod HMC requirement: Elastic Capacity on Demand requires that an HMC is used for management of the Power E850C server.

  • Page 58: Software Licensing And Capacity On Demand

    Cluster Systems Management (CSM) IBM General Parallel File System (GPFS™) Other IBM Systems Software or operating systems might also be included in the activations. Linux operating systems licenses might already cover the additional capacity, dependent on the licensing metric used. Check with your distributor for more details.

  • Page 59: System Buses

    memory activations, and four licenses of PowerVM for Linux. This package is at a lower overall cost than ordering the same number of processor, memory, and PowerVM activations separately. However, the activated resources can only be used to run Linux server-based and VIO server-based workloads.

  • Page 60: Pcie Logical Connectivity

    12 PCIe Gen3 slots. All of the adapters that are connected to a Fan-Out module share the bandwidth of the single x16 slot in the server. For more information about the PCIe Gen3 I/O expansion drawer, see 2.11.1, “PCIe Gen3 I/O expansion drawer” on page 62. IBM Power System E850C: Technical Overview and Introduction...

  • Page 61: Internal I/O Connections

    Table 2-13 summarizes the maximum numbers of adapters and bandwidths for different configurations of the Power E850C server. Table 2-13 Maximum PCIe adapters and bandwidth supported on the Power E850C Processor Maximum PCIe PCIe slots in Maximum I/O Maximum PCIe Modules bandwidth server enclosure...

  • Page 62: System Ports

    These two pairs of lane wires are called a . A PCIe link can consist of multiple lanes. In such configurations, the IBM Power System E850C: Technical Overview and Introduction...

  • Page 63: Lan Adapters

    (that is, a x16 adapter cannot go in an x8 PCIe slot connector). IBM POWER8 processor-based servers can support two different form factors of PCIe adapters: PCIe low profile (LP) cards, which are not used with the Power E850C server.

  • Page 64: Graphics Accelerator Adapters

    PCIe3 SAS Tape/DVD Adapter Quad-port 6 Gb x8 AIX, Linux EJ1P 57B3 PCIe1 SAS Tape/DVD Dual-port 3Gb x8 Adapter AIX, Linux EJ14 57B1 PCIe3 12 GB Cache RAID PLUS SAS Adapter AIX, Linux Quad-port 6 Gb x8 IBM Power System E850C: Technical Overview and Introduction...

  • Page 65: Fibre Channel Adapter

    2.9.5 Fibre Channel adapter The Power E850C supports direct or SAN connection to devices that use Fibre Channel adapters. Table 2-19 summarizes the available Fibre Channel adapters, which all have LC connectors. If you are attaching a device or switch with an SC type fibre connector, an LC-SC 50 Micron Fibre Converter Cable (#2456) or an LC-SC 62.5 Micron Fibre Converter Cable (#2459) is required.

  • Page 66: Infiniband Host Channel Adapter

    Each link can support multiple transport services for reliability and multiple prioritized virtual communication channels. For more information about InfiniBand, see HPC Clusters Using InfiniBand on IBM Power Systems Servers, SG24-7767. A connection to supported InfiniBand switches is accomplished by using the QDR optical cables #3290 and #3293.

  • Page 67: Asynchronous And Usb Adapters

    Asynchronous PCIe adapters provide the connection of asynchronous EIA-232 or RS-422 devices. If you have a cluster configuration or high-availability configuration and plan to connect the IBM Power Systems using a serial connection, you can use the features that are listed in Table 2-22.

  • Page 68: Internal Storage

    The write-cache capability increases the speed of write operations by committing them to the write-cache flash memory first, and then writing to the disks attached to the controller. This IBM Power System E850C: Technical Overview and Introduction...
  • Page 69 configuration allows write activities to be committed in a shorter time, reducing the latency of the write operation. When the write cache is full, write operation latency reverts to the speed of writes on the attached disks. The write cache has a raw capacity of 1.8 GB, but uses advanced compression techniques to store up to 7.2 GB of writes at a time.

  • Page 70: Raid Protection For Internal Disks

    SFF or 1.8-inch bays in the system unit or in disk-only I/O drawers like the EXP24S. Although protecting drives is always recommended, AIX and Linux users can choose to leave a few or all drives unprotected at their own risk. IBM supports these configurations.

  • Page 71: Drive Protection Levels

    2.10.3 Drive protection levels The following are the different available levels of drive protection: Just a bunch of disks (JBOD) provides no drive protection. JBOD presents the drives as just a bunch of disks to the system. The failure of a single drive results in the loss of all data on that disk.

  • Page 72: Easy Tier

    Figure 2-14 shows a representation of an Easy Tier array. Figure 2-14 An Easy Tier array IBM Power System E850C: Technical Overview and Introduction...
  • Page 73 The Easy Tier configuration is accomplished through a standard operating system SAS adapter configuration utility. Figure 2-15 shows an example of tiered array creation for AIX. Figure 2-15 Array type selection panel on AIX RAID Manager Figure 2-16 shows a created tiered array for AIX. Figure 2-16 Tiered arrays (RAID 5T2, RAID 6T2, and RAID 10T2) example on AIX RAID Manager Chapter 2.

  • Page 74: Internal Disk Options

    ES2X 775 GB 5xx SSD eMLC4 1.8-inch bay ES4K 775 GB 4k SSD eMLC4 1.8-inch bay ES7K 387 GB SSD 5xx eMLC4 SFF-3 bay ES7P 775 GB SSD 5xx eMLC4 SFF-3 bay IBM Power System E850C: Technical Overview and Introduction...

  • Page 75: Media Drives

    Feature Code Capacity Type Placement ES8J 1.9 TB 4k block Read Intensive SSD SFF-3 bay ES8N 387 GB SSD 4k eMLC4 SFF-3 bay ES8Q 775 GB SSD 4k eMLC4 SFF-3 bay ES8V 1.55 TB SSD 4k eMLC4 SFF-3 bay ESD5 600 GB 10k RPM HDD SFF-3 bay...

  • Page 76: External I/O Subsystems

    The maximum number of PCIe Gen3 I/O drawers depends on the number of installed processor modules. Table 2-28 on page 63 lists the maximum PCIe Gen3 I/O drawer configurations for the Power E850C server. IBM Power System E850C: Technical Overview and Introduction...

  • Page 77: Pcie Gen3 I/O Expansion Drawer Optical Cabling

    2.11.2 PCIe Gen3 I/O expansion drawer optical cabling I/O drawers are connected to the adapters in the server with data transfer cables: 3.0 m Optical Cable Pair for PCIe3 Expansion Drawer (#ECC7)
  • Page 78 5. Repeat the preceding four steps for the other PCIe3 6-slot Fan Out module in the expansion drawer, if required. Figure 2-18 shows connector locations for the PCIe Gen3 I/O expansion drawer. Figure 2-18 Connector locations for the PCIe Gen3 I/O expansion drawer IBM Power System E850C: Technical Overview and Introduction...
  • Page 79 Figure 2-19 shows typical optical cable connections. Server I/O Expansion Drawer Optical cable adapter Fanout module Optical cables Optical cable adapter Fanout module Optical cables Figure 2-19 Typical optical cable connection General rules for the PCI Gen3 I/O expansion drawer configuration The PCIe3 optical cable adapter can be in any of the x16 PCIe Gen3 adapter slots in the Power E850C system node.
  • Page 80 Power E850 Left Fan-Out with two processor modules I/O Drawer Right Fan-Out Left Fan-Out I/O Drawer Right Fan-Out Figure 2-20 Example of a Power E850C and a maximum of two I/O drawers IBM Power System E850C: Technical Overview and Introduction...
  • Page 81 Figure 2-21 shows an example of a Power E850C with three processor modules and a maximum of three PCIe Gen3 I/O expansion drawers. Power E850 with three Left Fan-Out processor modules I/O Drawer Right Fan-Out Left Fan-Out I/O Drawer Right Fan-Out Left Fan-Out I/O Drawer Right Fan-Out...

  • Page 82: Pcie Gen3 I/O Expansion Drawer Spcn Cabling

    2.11.3 PCIe Gen3 I/O expansion drawer SPCN cabling There is no system power control network (SPCN) used to control and monitor the status of power and cooling within the I/O drawer. SPCN capabilities are integrated in the optical cables. IBM Power System E850C: Technical Overview and Introduction...

  • Page 83: External Disk Subsystems

    (#5886), and the EXP24 SCSI Disk Drawer (#5786) are not supported on the Power E850C server. IBM offers a 1U multimedia drawer that can hold one or more DVD drives, tape drives, or RDX docking stations. The 7226-1U3 is the most current offering. The earlier 7216-1U2 and 7214-1U2 are also supported.
  • Page 84 Figure 2-23 EXP24S front view with location codes and disk groups depending on its mode of operation Mode setting is done by IBM manufacturing. If you need to change the mode after installation, ask your IBM support representative to refer to the following site: http://w3.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/PRS5121...
  • Page 85 Figure 2-24 shows the mode stickers. Figure 2-24 Mode sticker locations at the rear of the 5887 disk drive enclosure The EXP24S SAS ports are attached to a SAS PCIe adapter or pair of adapters by using SAS YO or X cables. Cable length varies depending on the feature code. Calculate the proper length considering routing for proper airflow and ease of handling.
  • Page 86 600 GB 15 K RPM SAS SFF-2 4 K Block - 4096 Disk 1536 AIX, Linux Drive ESFT 1.8 TB 10 K RPM SAS SFF-2 Disk Drive 4 K Block - 1536 AIX, Linux 4096 IBM Power System E850C: Technical Overview and Introduction...
  • Page 87 “EXP24S common usage scenarios” on page 74. Not all possible scenarios are included. For more information about SAS cabling and cabling configurations, search for “Planning for serial-attached SCSI cables” in the IBM Knowledge Center, which can be accessed at: http://www.ibm.com/support/knowledgecenter/POWER8/p8hdx/POWER8welcome.htm...

  • Page 88: Exp24S Common Usage Scenarios

    PCIe SAS adapters (#5901). Note: Not all possible scenarios are included. See the “Planning for serial-attached SCSI cables” guide in the IBM Knowledge Center to see more supported scenarios. Scenario 1: Basic non-redundant connection This scenario assumes a single Virtual I/O Server with a single PCIe SAS adapter #5901 and an EXP24S set on mode 1, allowing for up to 24 disks to be attached to the server.
  • Page 89 Scenario 2: Basic redundant connection This scenario assumes a single Virtual I/O Server with two PCIe SAS adapters #5901 and an EXP24S set on mode 1. This configuration allows for up to 24 disks to be attached to the server. Figure 2-28 shows the connection diagram and components of the solution. SAS YO Cable GROUP 1 EXP24S –...
  • Page 90 Two SAS X cables 3 Gbps with proper length The ports that are used on the SAS adapters must be the same for both adapters of the pair. This scenario provides no SSD support. IBM Power System E850C: Technical Overview and Introduction...
  • Page 91 Scenario 4: Dual Virtual I/O Servers sharing two EXP24S This scenario assumes a dual Virtual I/O Server with two PCIe SAS adapters #5901 each and two EXP24S set on mode 2. This configuration allows for up to 24 disks to be attached to each Virtual I/O Server (2 per drawer).
  • Page 92 Four SAS X cables 3 Gbps with proper length This scenario provides no SSD support. Other scenarios For direct connection to logical partitions, different adapters, and cables, see “5887 disk drive enclosure” in the IBM Knowledge Center: http://www.ibm.com/support/knowledgecenter/POWER8/p8hdx/POWER8welcome.htm IBM Power System E850C: Technical Overview and Introduction...

  • Page 93: Ibm System Storage

    The following section highlights a few of the offerings. IBM Storwize family The IBM Storwize is part of the IBM Spectrum™ Virtualize family, and is the ideal solution to optimize the data architecture for business flexibility and data storage efficiency. Different models, such as the IBM Storwize V3700, IBM Storwize V5000, and IBM Storwize V7000, offer storage virtualization, IBM Real-time Compression, Easy Tier, and many more functions.

  • Page 94: Hardware Management Console

    Integrated Virtualization Manager (IVM), which provides some of the functions that are provided by the HMC. For more information about IVM, see Integrated Virtualization Manager for IBM Power Systems Servers, REDP-4061. An HMC is a dedicated appliance that allows administrators to configure and manage system resources on IBM Power Systems servers that use IBM POWER6, POWER6+ POWER7, POWER7+, and POWER8 processors and the PowerVM Hypervisor.

  • Page 95: Virtual Appliance Hmc

    HMC RAID 1 support There is a high availability feature available for the hardware appliance HMC. The 7042-CR9, by default, includes two HDDs with RAID 1 configured. RAID 1 is also offered on the 7042-CR6, 7042-CR7, 7042-CR8, and 7042-CR9 models (if the feature was removed from the initial order) as an MES upgrade option.

  • Page 96: Hmc Code Level

    FLRT identifies the correct HMC machine code for the selected system firmware level. Note: Access to firmware and machine code updates is conditional on entitlement and license validation in accordance with IBM policy and practice. IBM can verify entitlement through customer number, serial number electronic restrictions, or any other means or methods that are employed by IBM at its discretion.

  • Page 97: High Availability Hmc Configuration

    Figure 2-32 shows a simple network configuration to enable the connection from the HMC to the server and to allow for dynamic LPAR operations. For more information about HMC and the possible network connections, see IBM Power Systems HMC Implementation and Usage Guide, SG24-7491.

  • Page 98: Operating System Support

    I/O devices, PowerVM Live Partition Mobility, or PowerVM Active Memory Sharing. For details about the software available on IBM Power Systems, visit the IBM Power Systems Software™ website at: http://www.ibm.com/systems/power/software/index.html 2.14.1 Virtual I/O Server...

  • Page 99: Linux Operating Systems

    Linux operating system. Linux operating system licenses are ordered separately from the hardware. You can acquire Linux operating system licenses from IBM to be included with the POWER8 processor-based servers, or from other Linux distributors.

  • Page 100: Java Versions That Are Supported

    Java 8, Java 7, or Java 6. For more information, visit the following website: http://www.ibm.com/developerworks/java/jdk/aix/service.html 2.15 Energy management The Power E850C systems have features to help clients become more energy efficient. IBM EnergyScale™ technology enables advanced energy management features to conserve power dramatically and dynamically, and further improve energy efficiency. Intelligent Energy...
  • Page 101 Therefore, the IBM POWER Hypervisor™ can use nap mode as a general-purpose idle state. When the operating system detects that a processor thread is idle, it yields control of a hardware thread to the POWER Hypervisor.
  • Page 102 (nap or sleep) longer. EnergyScale for I/O IBM POWER8 processor-based systems automatically power off hot-pluggable PCI adapter slots that are empty or not being used. System firmware automatically scans all pluggable PCI slots at regular intervals, looking for those that meet the criteria for being not in use and powering them off.

  • Page 103: On Chip Controller

    To maintain the power dissipation of POWER7+ with its large increase in performance and bandwidth, POWER8 invested significantly in power management innovations. A new OCC that uses an embedded IBM PowerPC® core with 512 KB of SRAM runs real-time control firmware. It responds to workload variations by adjusting the per-core frequency and voltage based on data from activity, thermal, voltage, and current sensors.

  • Page 104: Energy Consumption Estimation

    2.15.3 Energy consumption estimation Often, for Power Systems, various energy-related values are important: Maximum power consumption and power source loading values These values are important for site planning and are described in the IBM Knowledge Center, found at the following website: http://www.ibm.com/support/knowledgecenter/POWER8/p8hdx/POWER8welcome.htm Search for type and model number and “server specifications”.

  • Page 105: Chapter 3. Private And Hybrid Cloud Features

    This chapter provides an overview of these software and services. This chapter includes the following sections: Private cloud software Hybrid cloud support Geographically Dispersed Resiliency for Power IBM Power to Cloud Rewards Program © Copyright IBM Corp. 2016. All rights reserved.

  • Page 106: Private Cloud Software

    Simplify Power Systems virtualization management Accelerate repeatable, error-free virtualization deployments IBM Cloud PowerVC Manager can manage AIX, IBM i, and Linux VMs running under PowerVM virtualization and Linux VMs running under PowerKVM virtualization. Because it is OpenStack based, it provides upward integration with hybrid cloud orchestration products, allowing Power Systems to take part in a heterogeneous private cloud infrastructure.

  • Page 107: Cloud-Based Hmc Apps As A Service

    Through these new apps, clients gain the capability to aggregate Power Systems performance, auditing, and inventory data from across their enterprise, removing the burden of manual collection and collation. These IBM-developed apps are hosted in a secure, multi-tenant cloud. They provide health scores, search and filtering, and threshold-based alerts that can be accessed through a secure portal from desktops or mobile devices.

  • Page 108: Open Source Cloud Automation And Configuration Tooling For Aix

    IBM Power Systems servers are well positioned to take advantage of key packages that were recently provided to enable cloud automation. This section lists several key packages.
  • Page 109 IBM is collaborating along with clients in this community to provide useful resources for using Chef with AIX systems. Chef-client for AIX is now enhanced with new recipes. The AIX cookbook can be reached at this URL: https://supermarket.chef.io/cookbooks/aix/ Yum stands for “Yellowdog Updater, Modified” and allows for automatic updates, package, and dependency management on RPM-based distributions.

  • Page 110: Hybrid Cloud Support

    3.2.1 Hybrid infrastructure management tools Power Systems OpenStack-based PowerVC management upwardly integrates into various third-party hybrid cloud orchestration products, including IBM Cloud Orchestrator, VMware vRealize, and others. Clients can simply manage both their private cloud VMs and their public cloud VMs from a single, integrated management tool.

  • Page 111: Securely Connect System Of Record Workloads To Cloud Native Applications

    IBM Power to Cloud services can help clients get started with these solutions and to design new applications that use IBM Bluemix®. This application enables clients to rapidly build, deploy, and manage their cloud applications, while being enhanced by a growing ecosystem of available services and runtime frameworks.

  • Page 112: Geographically Dispersed Resiliency For Power

    Faster (seconds to minutes) Slower (minutes) Cost Higher due to extra software needs Lower and labor Maintenance Each new VM requires a new cluster After the host is configured, new VMs are automatically covered IBM Power System E850C: Technical Overview and Introduction...

  • Page 113: Ibm Power To Cloud Rewards Program

    IBM Power Systems server including the Power E850C. IBM Power to Cloud Reward points can be used for a range of services that are focused on helping the transition from traditional IT platforms to private and hybrid cloud platforms. Power to Cloud Reward Program services offerings use the proven expertise of IBM Systems Lab Services consultants.
  • Page 114 IBM Power System E850C: Technical Overview and Introduction...

  • Page 115: Chapter 4. Reliability, Availability, And Serviceability

    Reliability, availability, and Chapter 4. serviceability This chapter provides information about IBM Power Systems reliability, availability, and serviceability (RAS) design and features. RAS has the following : Reliability Indicates how infrequently a defect or fault in a server occurs. Availability Indicates how infrequently the functioning of a system or application is affected by a fault or defect.

  • Page 116: Introduction

    One key differentiator of the IBM POWER8 processor-based servers running PowerVM is that they use all the advanced RAS characteristics of the POWER8 processor design through the whole portfolio, offering reliability and availability features that are often not seen in other servers.

  • Page 117: Ras Enhancements For Enterprise Servers

    The processor design now supports a spare data lane on each fabric bus, which is used to communicate between processor modules. A spare data lane can be substituted for a failing one dynamically during system operation. A POWER8 processor module has improved performance compared to POWER7+, including support of a maximum of 12 cores compared to a maximum of eight cores in POWER7+.

  • Page 118: Reliability

    4.2 Reliability The reliability of systems starts with components, devices, and subsystems that are highly reliable. On IBM POWER processor-based systems, this basic principle is expanded upon with a clear design for reliability architecture and methodology. A concentrated, systematic, and architecture-based approach is designed to improve overall system reliability with each successive generation of system offerings.

  • Page 119: Placement Of Components

    IBM uses stringent design criteria to select server grade components that are extensively tested and qualified to meet and exceed a minimum design life of seven years. By selecting higher reliability grade components, the frequency of all failures is lowered, and wear-out is not expected within the operating system life.

  • Page 120: Availability

    This design for availability begins with implementing an architecture for ED/FI. First-Failure data capture (FFDC) is the capability of IBM hardware and microcode to continuously monitor hardware functions. Within the processor and memory subsystem, detailed monitoring is done by circuits within the hardware components themselves. Fault information is gathered into fault isolation registers (FIRs) and reported to the appropriate components for handling.

  • Page 121: Processor Core/Cache Correctable Error Handling

    software layers. The software layers must then be responsible for determining how to minimize the impact of faults. The advanced RAS features that are built in to POWER8 processor-based systems handle certain “uncorrectable” errors in ways that minimize the impact of the faults. These features can even keep an entire system up and running after experiencing such a failure.

  • Page 122: Core Contained Checkstops And Other Powervm Error Recovery

    If data is owned by the hypervisor, the hypervisor might choose to terminate, resulting in a system-wide outage. IBM Power System E850C: Technical Overview and Introduction...

  • Page 123: Other Processor Chip Functions

    However, the exposure to such events is minimized because cache-lines can be deleted, which eliminates repetition of an uncorrectable fault that is in a particular cache-line. 4.3.8 Other processor chip functions Within a processor chip, there are other functions besides just processor cores. POWER8 processors have built-in accelerators that can be used as application resources to handle such functions as random number generation.

  • Page 124: Memory Protection

    For each such port, there are eight DRAM modules worth of data (64 bits) plus another DRAM module’s worth of error correction and other such data. There is also a spare DRAM module for each port that can be substituted for a failing port. IBM Power System E850C: Technical Overview and Introduction...

  • Page 125: I/O Subsystem Availability And Enhanced Error Handling

    Two ports are combined into an ECC word and supply 128 bits of data. The ECC that is deployed can correct the result of an entire DRAM module that is faulty. This is also known as Chipkill correction. Then, it can correct at least an additional bit within the ECC word. The additional spare DRAM modules are used so that when a DIMM experiences a Chipkill event within the DRAM modules under a port, the spare DRAM module can be substituted for a failing module.

  • Page 126: Remote Restart Capability

    Remote Restart can be enabled for applicable partitions through the HMC interface. 4.4 Availability impacts of a solution architecture A solution should not rely only on the hardware platform. Despite IBM Power Systems having superior RAS features to other comparable systems, design a redundant architecture for the application to allow for easier maintenance tasks and greater flexibility.

  • Page 127: Clustering

    4.4.1 Clustering IBM Power Systems running under PowerVM, AIX, and Linux support a number of different clustering solutions. These solutions are designed to meet requirements not only for application availability in regard to server outages, but also data center disaster management, reliable data backups, and so on.

  • Page 128: Powervm Live Partition Mobility

    Avoid unplanned downtime. With preventive failure management, if a server indicates a potential failure, you can move its logical partitions to another server before the failure occurs. Partition mobility can help avoid unplanned downtime. IBM Power System E850C: Technical Overview and Introduction...

  • Page 129: Serviceability

    You can migrate all the migration-capable AIX, IBM i, and Linux partitions from the source server to the destination server by running the following command from the HMC...

  • Page 130: Detecting Errors

    IBM service support representative (SSR), or an authorized warranty service provider. The serviceability features that are delivered in this system provide a highly efficient service environment by incorporating the following attributes: A design for customer setup (CSU), customer installable features (CIFs), and...

  • Page 131: Service Processor

    4.5.3 Service processor In POWER8 processor-based systems, the dedicated service processor is primarily responsible for fault analysis of processor and memory errors. The service processor is a microprocessor that is powered separately from the main instruction processing complex. In the Power E850C server, redundant connections to the service processor provide added reliability.

  • Page 132: Diagnosing

    Provide fault detection and problem isolation procedures. Support a remote connection ability that is used by the IBM Remote Support Center or IBM Designated Service. Provide interactive intelligence within the diagnostic tests with detailed online failure information while connected to IBM back-end systems.

  • Page 133: Reporting

    IBM. For HMC managed servers, the event is reported to the HMC, which can initiate the Call Home request to IBM. I/O devices can also include specific exercisers that can be started by the diagnostic facilities for problem re-creation (if required by service procedures).
  • Page 134 Call Home service request is initiated and the pertinent failure data with service parts information and part locations is sent to the IBM service organization. This information also contains the client contact information as defined in the IBM Electronic Service Agent (ESA) guided setup wizard.

  • Page 135: Notifying

    The data is formatted and prepared for transmission back to IBM either to assist the service support organization with preparing a service action plan for the service representative or for additional analysis.

  • Page 136: Locating And Servicing

    Call Home Call Home refers to an automatic or manual call from a customer location to an IBM Support structure with error log data, server status, and other service-related information. The Call Home feature starts procedures within the service organization so that the appropriate service action can begin.
  • Page 137 LEDs are only visible while the system is powered on or has standby power connected. IBM Knowledge Center IBM Knowledge Center provides you with a single information center where you can access product documentation for IBM systems hardware, operating systems, and server software.
  • Page 138 Concurrent maintenance The IBM POWER8 processor-based systems are designed with the understanding that certain components have higher intrinsic failure rates than others. These components include fans, power supplies, and physical storage devices. Other devices, such as I/O adapters, can become worn from repeated plugging and unplugging.

  • Page 139: Manageability

    This process helps ensure that the guided maintenance procedures are operating correctly. Clients can subscribe through the subscription services on the IBM Support Portal to obtain notifications about the latest updates that are available for service-related documentation. 4.6 Manageability Several functions and tools are available to help manage the Power E850C server.

  • Page 140: Service User Interfaces

    Both Ethernet ports have the following default IP address: – Service processor eth0 (HMC1 port) is configured as 169.254.2.147. – Service processor eth1 (HMC2 port) is configured as 169.254.3.147. IBM Power System E850C: Technical Overview and Introduction...
  • Page 141 The following functions are available through the service processor: Call Home ASMI Error information (error code, part number, and location codes) menu View of guarded components Limited repair procedures Generate dump LED Management menu Remote view of ASMI menus Firmware update through a USB key Advanced System Management Interface ASMI is the interface to the service processor that enables you to manage the operation of the server, such as auto-power restart.
  • Page 142 They can be booted in single-user mode (service mode), run in maintenance mode, or run concurrently (concurrent mode) with other applications. They have access to the AIX error log and the AIX configuration data. IBM Power System E850C: Technical Overview and Introduction...
  • Page 143 The following modes are available: Service mode This mode requires a service mode boot of the system and enables the checking of system devices and features. Service mode provides the most complete self-check of the system resources. All system resources, except the SCSI adapter and the disk drives that are used for paging, can be tested.

  • Page 144: Ibm Power Systems Firmware Maintenance

    With the HMC Version V8R8.1.0.0 and POWER8 processor-based servers, the firmware installations are restricted to entitled servers. The customer must be registered with IBM and entitled with a service contract. During the initial machine warranty period, the access key is already installed in the machine by manufacturing.
  • Page 145 (nondisruptive). With the introduction of CFM, IBM is increasing its clients’ opportunity to stay on a release level for longer periods. Clients who want maximum stability can defer until there is a compelling...
  • Page 146 If you use an HMC to manage the server, that interface can be used to view the levels of server firmware and power subsystem firmware that are installed, and those that are available to download and install. Each IBM Power Systems server has the following levels of server firmware and power subsystem firmware: Installed level This level of server firmware or power subsystem firmware is installed, and will be installed into memory after the managed system is powered off and then powered on.

  • Page 147: Concurrent Firmware Maintenance Improvements

    IBM transformed its delivery of hardware and software support services to help you achieve higher system availability. Electronic Services is a web-enabled solution that offers an exclusive enhancement to the service and support that is available for IBM servers at no additional charge. These services provide the opportunity for greater system availability with faster problem resolution and preemptive monitoring.
  • Page 148 Installation and use of ESA for problem reporting enables IBM to provide better support and service for your IBM server. To learn how Electronic Services can work for you, see the following website (an IBM ID is required): http://www.ibm.com/support/electronicsupport...
  • Page 149 For more information about how to use the power of IBM Electronic Services, contact your IBM SSR, or see the following website: http://www.ibm.com/support/electronicsupport...
  • Page 150 The following menu options are available when you select an event in the table: View Details Shows the details of this event. View Files Shows the files that are associated with this event. IBM Power System E850C: Technical Overview and Introduction...

  • Page 151: Selected Power8 Ras Capabilities By Operating System

    Approve Call Home Approves the Call Home of this event. This option is available only if the event is not approved already. The Help/Learn more function can be used to get more information about the other available windows for the Serviceable Event Manager. 4.7 Selected POWER8 RAS capabilities by operating system Table 4-2 provides a list of the Power Systems RAS capabilities by operating system.
  • Page 152 Operating system error reporting to HMC Service Focal Point application RMC secure error transmission subsystem Healthcheck scheduled operations with HMC Operator panel (real or virtual) Concurrent operator panel maintenance Redundant HMCs optional optional Automated server recovery/restart optional optional IBM Power System E850C: Technical Overview and Introduction...
  • Page 153 RAS feature Linux V7.2 TL1 SP1 RHEL 6.8 V7.1 TL3 SP5 RHEL 7.2 V6.1 TL9 SP5 SUSE Linux Enterprise Server 12 Ubuntu 16.04.01 Repair and Verify guided maintenance with HMC PowerVM Live Partition/Live Application Mobility with PowerVM Enterprise Edition Emergency power-off warning (EPOW) EPOW errors handling Chapter 4.
  • Page 154 IBM Power System E850C: Technical Overview and Introduction...

  • Page 155: Related Publications

    The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this paper. IBM Redbooks The following IBM Redbooks publications provide additional information about the topic in this document. Note that some publications referenced in this list might be available in softcopy only.

  • Page 156: Online Resources

    IBM Power Systems S822LC for Big Data server specifications http://www.ibm.com/systems/power/hardware/s822lc-big-data/index.html IBM Power System S822LC for Commercial Computing server specifications http://www.ibm.com/systems/power/hardware/s822lc-commercial/index.html IBM Power Systems S822LC for High Performance Computing server specifications http://www.ibm.com/systems/power/hardware/s822lc-hpc/index.html IBM Power Systems S824 server specifications http://www.ibm.com/systems/power/hardware/s824/index.html IBM Power Systems S824L server specifications: http://www.ibm.com/systems/power/hardware/s824l/index.html...

  • Page 157: Help From Ibm

    These websites are also relevant as further information sources: IBM Fix Central website http://www.ibm.com/support/fixcentral/ IBM Knowledge Center http://www.ibm.com/support/knowledgecenter/ IBM Power Systems website http://www.ibm.com/systems/power/ IBM Power Systems Hardware IBM Knowledge Center: http://www.ibm.com/support/knowledgecenter/api/redirect/powersys/v3r1m5/index.jsp IBM Storage website http://www.ibm.com/systems/storage/ IBM System Planning Tool website http://www.ibm.com/systems/support/tools/systemplanningtool/ IBM Systems Energy Estimator https://www-912.ibm.com/see/EnergyEstimator...
  • Page 158 IBM Power System E850C: Technical Overview and Introduction...
  • Page 160 Back cover REDP-5412-00 ISBN 0738455687 Printed in U.S.A ® ibm.com...

Table of Contents