IBM Power 780 Technical Overview And Introduction
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Server
  5. Power 780
  6. Technical overview and introduction

IBM Power 780 Technical Overview And Introduction

Hide thumbs Also See for Power 780:
Table of Contents

Advertisement

Quick Links

IBM Power 770 and 780
Technical Overview and Introduction
Features the 9117-MMD and 9179-MHD based on
the latest POWER7+ processor technology
Describes support of up to 20
LPARS per processor core
Discusses new I/O cards
and drawers
ibm.com/redbooks

Front cover

Redpaper
An Ding Chen
Dave Freeman
Breno Henrique Leitão

Advertisement

Table of Contents
loading

Related Manuals for IBM Power 780

Summary of Contents for IBM Power 780

  • Page 1: Front Cover

    Front cover IBM Power 770 and 780 Technical Overview and Introduction Features the 9117-MMD and 9179-MHD based on the latest POWER7+ processor technology Describes support of up to 20 LPARS per processor core Discusses new I/O cards and drawers An Ding Chen Dave Freeman Breno Henrique Leitão...
  • Page 3 International Technical Support Organization IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction February 2013 REDP-4924-00...
  • Page 4 First Edition (February 2013) This edition applies to the IBM Power 770 (9117-MMD) and Power 780 (9179-MHD) Power Systems servers.. © Copyright International Business Machines Corporation 2013. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule...

  • Page 5: Table Of Contents

    1.4.2 Power 780 system features ........
  • Page 6 2.1 The IBM POWER7+ processor ........
  • Page 7 2.14.1 IBM EnergyScale technology ........
  • Page 8 4.4.1 Service user interfaces ..........184 4.4.2 IBM Power Systems firmware maintenance ......189 4.4.3 Electronic Services and Electronic Service Agent .

  • Page 9: Notices

    IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.

  • Page 10: Trademarks

    Intel Corporation or its subsidiaries in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. LTO, Ultrium, the LTO Logo and the Ultrium logo are trademarks of HP, IBM Corp. and Quantum in the U.S. and other countries.

  • Page 11: Preface

    Independent software vendors This paper expands the current set of IBM Power Systems documentation by providing a desktop reference that offers a detailed technical description of the Power 770 and Power 780 systems. This paper does not replace the latest marketing materials and configuration tools. It is intended as an additional source of information that, together with existing sources, can be used to enhance your knowledge of IBM server solutions.

  • Page 12: The Team Who Wrote This Paper

    Storage systems for the last 10 years. Prior to this role, Dave was an IT Systems Engineer, providing presales technical support to IBM sales and IBM Business Partners in the small and medium business sector, primarily on IBM i (IBM AS/400®). He has a degree in Information Technology from the Polytechnic of Central London.

  • Page 13: Comments Welcome

    Find us on Facebook: http://www.facebook.com/IBMRedbooks Follow us on Twitter: http://twitter.com/ibmredbooks Look for us on LinkedIn: http://www.linkedin.com/groups?home=&gid=2130806 Explore new Redbooks publications, residencies, and workshops with the IBM Redbooks weekly newsletter: https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm Stay current on recent Redbooks publications with RSS Feeds: http://www.redbooks.ibm.com/rss.html Preface...
  • Page 14 IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 15: Chapter 1. General Description

    General description Chapter 1. The IBM Power 770 (9117-MMD) and IBM Power 780 servers (9179-MHD) use the latest POWER7+ processor technology that is designed to deliver unprecedented performance, scalability, reliability, and manageability for demanding commercial workloads. The innovative IBM Power 770 and Power 780 servers with POWER7+ processors are symmetric multiprocessing (SMP), rack-mounted servers.

  • Page 16: Systems Overview

    1.1 Systems overview You can find detailed information about the Power 770 and Power 780 systems within the following sections. 1.1.1 IBM Power 770 server The Power 770 processor card features 64-bit architecture designed with four single-chip module (SCM) POWER7+ processors. Each POWER7+ SCM enables up to either three or four active processor cores.

  • Page 17: Ibm Power 780 Server

    For the Power 780, each POWER7+ SCM processor is available at frequencies of 4.42 GHz with four cores, or 3.72 GHz with eight cores. The Power 780 server is available starting as low as four active cores for the 4-core SCM and eight active cores for the 8-core SCM. Built-in capacity on demand (CoD) functionality allows incremental activation of one core at a time, up to a maximum of 64 or 128 active cores.

  • Page 18: Operating Environment

    1.2 Operating environment Table 1-1 lists the operating environment specifications for the servers. Table 1-1 Operating environment for Power 770 and Power 780 (for one enclosure only) Description Operating Non-operating Temperature 5 - 35 degrees C 5 - 45 degrees C...

  • Page 19: Physical Package

    The IBM Systems Energy Estimator is a web-based tool for estimating power requirements for IBM Power Systems. You can use this tool to estimate typical power requirements (watts) for a specific system configuration under normal operating conditions: http://www-912.ibm.com/see/EnergyEstimator/ 1.3 Physical package Table 1-2 lists the physical dimensions of an individual enclosure.

  • Page 20: System Features

    1.4 System features Both Power 770 and Power 780 processor card features 64-bit architecture designed with four single-chip module (SCM) POWER7+ processors. 1.4.1 Power 770 system features The following features are available on the Power 770: A 4U 19-inch rack-mount system enclosure...

  • Page 21: Power 780 System Features

    The Power 770 operator interface controls, located on the front panel of the primary I/O drawer, consist of a power ON/OFF button with an IBM POWER® indicator, an LCD display for diagnostic feedback, a RESET button, and a disturbance or system attention LED.
  • Page 22 (maximum nine usable per system) Additional considerations: The Ethernet ports of the Integrated Multifunction Card cannot be used for an IBM i console. Separate Ethernet adapters that can be directly controlled by IBM i without the Virtual I/O server should be used for IBM i LAN consoles if desired. Alternatively, an HMC can also be used for an IBM i console.

  • Page 23: Minimum Features

    The Power 780 operator interface controls, located on the front panel of the primary I/O drawer, consist of a power ON/OFF button with a POWER indicator, an LCD display for diagnostic feedback, a RESET button, and a disturbance or system attention LED.
  • Page 24 The minimum activations ordered with all initial orders of memory features EM40, EM41, EM42, and EM44 must be 50% of their installed capacity. Table 1-4 shows the minimum system configuration for a Power 780 system. Table 1-4 Minimum features for Power 780 system...

  • Page 25: Power Supply Features

    The system requires one functional power supply in each CEC enclosure to remain operational. Each Power 770 or Power 780 server with two or more CEC enclosures must have one Power Control Cable (FC 6006 or similar) to connect the service interface card in the first enclosure to the service interface card in the second enclosure.

  • Page 26: Summary Of Processor Features

    Figure 1-3 shows the top view of the Power 770 and Power 780 system with four SCMs installed. The four POWER7+ SCMs and the system memory reside on a single processor card feature. Memory PCIe Slot #1 POWER7 PCIe Slot #2...
  • Page 27 Linux associated enablement code is entered into the system, you must report your on/off usage to IBM at least monthly. This information, used to compute your billing data, is then provided to your sales channel. The sales channel will place an order for a quantity of On/Off Processor Core Day Billing features and bill you.
  • Page 28 Linux associated enablement code is entered into the system, you must report your on/off usage to IBM at least monthly. This information, used to compute your billing data, is then provided to your sales channel. The sales channel will place an order for a quantity of On/Off Processor Core Day Billing features and the client will be charged.
  • Page 29 Table 1-6 summarizes the processor feature codes for the Power 780. Table 1-6 Summary of processor features for the Power 780 Feature Description code support EPH0 0 to 16-core 4.42 GHz POWER7+ processor card: 16-core 4.42 GHz POWER7+ CUoD processor card containing four IBM i 4-core processors.
  • Page 30 After the On/off Processor function is enabled in a system, you must Linux report your on/off usage to IBM at least monthly. This information, used to compute your billing data, is provided to your sales channel. The sales channel will place an order on your behalf for the quantity of this feature that matches your reported use.
  • Page 31 This feature can be ordered to enable your server for On/Off capacity Linux on demand. After it is enabled, you can request processors on a IBM i temporary basis. You must sign an On/Off Capacity on Demand contract before you order this feature.

  • Page 32: Memory Features

    Figure 1-4 Outline of POWER7+ processor connectivity to DDR3 DIMMs in Power 770 and Power 780 On each processor card for the Power 770 and Power 780 there is a total of 16 DDR3 memory DIMM slots to be connected. Each of the four SCMs on the card accesses four DIMM slots.
  • Page 33 The Power 770 and Power 780 have memory features in 32 GB, 64 GB, 128 GB, and 256 GB capacities. Table 1-7 summarizes the capacities of the memory features and highlights other characteristics. Table 1-7 Summary of memory features Feature...

  • Page 34: Disk And Media Features

    177 GB SFF-2 SSD with eMLC AIX, Linux 1995 177 GB SSD Module with eMLC AIX, Linux 1925 300 GB 10 K RPM SAS SFF-2 Disk Drive AIX, Linux IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 35 1752 900 GB 10 K RPM SAS SFF-2 Disk Drive AIX, Linux 1947 139 GB 15 K RPM SAS SFF-2 Disk Drive IBM i 1888 139 GB 15 K RPM SFF SAS Disk Drive IBM i 1787 177 GB SFF-1 SSD with eMLC...
  • Page 36 The Power 770 and Power 780 support both 2.5-inch and 3.5-inch SAS SFF hard disks. The 3.5-inch DASD hard disk can be attached to the Power 770 and Power 780 but must be located in a feature FC 5886 EXP12S I/O drawer, whereas 2.5-inch DASD hard files can be mounted either internally or in the EXP24S SFF Gen2-bay Drawer (FC 5887).

  • Page 37: I/O Drawers

    12X Expansion Drawers (FC 5796) and up to 16 12X I/O Drawer PCIe features (FC 5802 and FC 5877) can be attached. The Power 770 and the Power 780 servers support the following 12X attached I/O drawers, providing extensive capability to expand the overall server expandability and connectivity: Feature FC 5802 provides PCIe slots and SFF SAS disk slots.

  • Page 38: Exp12S Sas Drawer

    12X PCIe I/O Drawers, or vice versa. 1.6.5 EXP30 Ultra SSD I/O Drawer The enhanced EXP30 Ultra SSD I/O Drawer (FC EDR1) provides the IBM Power POWER7+ 770 and 780 up to 30 solid-state drives (SSD) in only 1U of rack space without any PCIe slots.

  • Page 39: Comparison Between Models

    Four 4-core SCMs running at 4.42 GHz Four 8-core SCMs running at 3.72 GHz Both of these Power 780 models are available starting as low as four active cores, and incrementing one core at a time through built-in CoD functions to a maximum of 64 active cores, with the 4.42 GHz processor or 128 active cores with the 3.72 GHz processor.

  • Page 40: Build To Order

    Any feature for which a feature conversion is used to obtain a new part must be returned to IBM also. You may keep and reuse any features from the CEC enclosures that were not involved in a feature conversion transaction.
  • Page 41 MT model that were not ordered through feature codes. Any feature for which a feature conversion is used to obtain a new part must be returned to IBM also. You may keep and reuse any features from the CEC enclosures that were not involved in a feature conversion transaction.

  • Page 42: Power 780

    The Power 770 and Power 780 support only the SAS DASD SFF hard disks, internally. The existing 3.5-inch DASD hard disks can be attached to Power 770 and Power 780, but must be located in an I/O drawer such as FC 5886.

  • Page 43: Ibm Sdmc

    LPARs per processor core; a core can now be partitioned in up to 20 LPARs (0.05 of a core). The IBM Power 770 and Power 780 are not supported by the Integrated Virtualization Manager (IVM). Several HMC models are supported to manage POWER7+ based systems. Two models (7042-CR6 and 7042-CR7) are available for ordering at the time of writing, but you can also use one of the withdrawn models listed in Table 1-14.

  • Page 44: System Racks

    I/O drawers can be ordered only with the 7014-T00, 7014-T42 or 7953-94Y racks. These are built to the 19-inch EIA standard. An existing 7014-T00, 7014-B42, 7014-S25, 7014-T42, FC 0551, FC 0553, or FC 0555 rack can be used for the Power 770 and Power 780 if sufficient space and power are available.

  • Page 45: Ibm 7014 Model T42 Rack

    Each horizontally mounted PDU occupies 1U of space in the rack, and therefore reduces the space available for mounting servers and other components. S25 or B25 rack: The Power 780 cannot be ordered with a S25 or B25 rack. 1.12.4 IBM 7953 model 94Y rack The 2.0-meter (79.3 inch) model 94Y rack has the following features:...

  • Page 46: Feature Code 0555 Rack

    7014-T42) in several aspects. Both provide 42U of vertical space, are 1100 mm deep, and have an interior rail-to-rail depth of 715 mm. However, the IBM 42U Slim Rack is 600 mm wide; the B42/T42 is 645 mm wide with side covers. For clients with 2-foot floor tiles, the extra 45 mm (1.77-inch) width of the enterprise rack can sometimes cause challenges when cutting...
  • Page 47 For PDU FC 7188 and FC 7109 when using power cord FC 6654, FC 6655, FC 6656, FC 6657, or FC 6658, each pair of PDUs can power up to two Power 770 and Power 780 CEC enclosures.

  • Page 48: Rack-Mounting Rules

    9117-MMA, trim kits FC 6263 or FC 6272 can be used for one drawer enclosures only. The design of the Power 770 and Power 780 is optimized for use in a 7014-T00, 7014-T42, -7014B42, -S25, FC 0551, or FC 0553 rack. Both the front cover and the processor flex cables occupy space on the front left side of an IBM 7014, FC 0551, and FC 0553 rack that might not be available in typical non-IBM racks.

  • Page 49: Useful Rack Additions

    The IBM System Storage 7216 Multi-Media Enclosure (Model 1U2) is designed to attach to the Power 770 and the Power 780 through a USB port on the server or through a PCIe SAS adapter. The 7216 has two bays to accommodate external tape, removable disk drive, or DVD-RAM drive options.
  • Page 50 A PCIe Dual-X4 SAS adapter (FC 5901) or a PCIe LP 2-x4-port SAS Adapter 3 Gb (FC 5278) must be installed in the Power 770 and Power 780 server to attach to a 7216 Model 1U2 Multi-Media Storage Enclosure. Attaching a 7216 to a Power 770 and Power 780 through the integrated SAS adapter is not supported.
  • Page 51 Figure 1-6 FC 7216 Multi-Media Enclosure In general, the 7216-1U2 is supported by the AIX, IBM i, and Linux operating systems. IBM i, from Version 7.1, now fully supports the internal 5.25 inch RDX SATA removable HDD docking station, including boot support (no VIOS support). This support provides a fast, robust, high-performance alternative to tape backup/restore devices.
  • Page 52 Flat panel display options The IBM 7316 Model TF3 is a rack-mountable flat panel console kit consisting of a 17-inch 337.9 mm x 270.3 mm flat panel color monitor, rack keyboard tray, IBM Travel Keyboard, support for IBM keyboard, video, mouse (KVM) switches, and language support. The IBM 7316-TF3 Flat Panel Console Kit offers the following features: Slim, sleek, lightweight monitor design that occupies only 1U (1.75 inches) in a 19-inch...

  • Page 53: Chapter 2. Architecture And Technical Overview

    POWER7+ processors. A fully-configured 4-drawer system has either 48 or 64 cores, depending on which processor is specified. The IBM Power 780 offers the same 4-socket CEC enclosure, populated with 4-core or 8-core POWER7+ processors. This architecture offers a maximum system configuration of 64 or 128 cores, depending on the processor option chosen.
  • Page 54 Figure 2-1 shows the logical system diagram of the 4-socket Power 770 and Power 780. B Buses B Buses DRAM DRAM DRAM DRAM WXZ Buses DRAM DRAM DRAM DRAM DRAM 8 SN DIMMs DRAM DRAM 8 SN DIMMs DRAM DRAM...

  • Page 55: The Ibm Power7+ Processor

    POWER7+ processor-based systems is one of system-wide balance in which the POWER7+ processor plays an important role. In many cases, IBM is innovative to achieve required levels of throughput and bandwidth. Areas of innovation for the POWER7+ processor and POWER7+ processor-based systems...

  • Page 56: Power7+ Processor Overview

    Figure 2-2 POWER7+ processor die with key areas indicated 2.1.1 POWER7+ processor overview The POWER7+ processor chip is fabricated with IBM 32 nm Silicon-On-Insulator (SOI) technology using copper interconnect, and implements an on-chip L3 cache using eDRAM. The POWER7+ processor chip is 567 mm and is built by using 2.1 billion components...

  • Page 57: Power7+ Processor Core

    256 KB/2 MB Maximum On-chip L3 cache core/chip 10 MB/80 MB DDR3 memory controllers SMP design-point 32 sockets with IBM POWER7+ processors Compatibility With prior generation of POWER processor 2.1.2 POWER7+ processor core Each POWER7+ processor core implements aggressive out-of-order (OoO) instruction execution to drive high efficiency in the use of available execution paths.

  • Page 58: Simultaneous Multithreading

    SMT4 mode enables the POWER7+ processor to maximize the throughput of the processor core by offering an increase in processor-core efficiency. SMT4 mode is the latest step in an evolution of multithreading technologies introduced by IBM. Figure 2-3 shows the evolution of simultaneous multithreading in the industry.

  • Page 59: Memory Access

    Figure 2-4 Overview of POWER7+ memory access structure 2.1.5 On-chip L3 cache innovation and Intelligent Cache A breakthrough in material engineering and microprocessor fabrication enabled IBM to implement the L3 cache in eDRAM and place it on the POWER7+ processor die. L3 cache is critical to a balanced design, as is the ability to provide good signaling between the L3 cache and other elements of the hierarchy, such as the L2 cache or SMP interconnect.
  • Page 60 The performance of eDRAM when implemented on-chip is similar to conventional SRAM but requires far less physical space. IBM on-chip eDRAM uses only a third of the components used in conventional SRAM, which has a minimum of six transistors to implement a 1-bit memory cell.

  • Page 61: Power7+ Processor And Intelligent Energy

    Sleep and nap mode Both Both Nap only a. Not supported on the Power 770 and Power 780 4-socket systems. b. For more information about sleep and nap modes, see 2.14.1, “IBM EnergyScale technology” on page 115. Chapter 2. Architecture and technical overview...

  • Page 62: Power7+ Processor Card

    2.2 POWER7+ processor card IBM Power 770 and Power 780 servers are modular systems that are built with one to four CEC enclosures. The processor and memory subsystem in each CEC enclosure is contained on a single processor card. The processor card contains four processor sockets and 16 fully buffered DDR3 memory DIMMs.

  • Page 63: Processor Interconnects

    On the Power 770 and Power 780 servers, each enclosure houses 16 DDR3 DIMM slots. The DIMM cards for the Power 770 and Power 780 are 96 mm tall, fully buffered, and placed in one of the 16 DIMM slots on the processor card.
  • Page 64 Unsupported: DDR2 memory (used in POWER6 processor-based systems) is not supported in POWER7+ processor-based systems. Figure 2-8 shows the physical memory DIMM topology for Power 770 and Power 780 with four P7+ single-chip-modules (SCMs). Regulator 1 Loc Code Conn Ref...
  • Page 65 The memory-placement rules are as follows: Plug sequence will always allow for memory mirroring (for example, no feature code needs to be specified for memory mirroring). The highlighted (green) cells in the following tables indicate the Active Memory Mirroring (AMM) base configuration. DIMMs must be installed by 4x DIMMs at a time, referred to as a DIMM-quad.
  • Page 66 Quads Q1 and Q2 must be identical to each other. Quads Q3 and Q4 must be identical to each other. Note: For maximum memory performance, the total memory capacity on each memory controller must be equivalent. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 67 Table 2-5 shows the optimal placement of each DIMM-quad within a three-enclosure system. must have Each enclosure at least two DIMM-quads installed. Table 2-5 Optimum DIMM-quad placement for a three-enclosure system Enclosure 1 CPU 1 CPU 3 CPU 4 CPU 2 Memory controller Memory Controller Memory controller...

  • Page 68: Memory Activation

    2.3.3 Memory activation The minimum amount of memory activation for the Power 770 and Power 780 servers is 50% of the installed memory. For example, the minimum amount of memory that can be installed is 8 x 8 GB, of which 32 GB will be active. On an exception basis, a request for price quotation (RPQ) may be requested so that memory activation may go down to 25% of the installed memory.

  • Page 69: Memory Throughput

    158.02 GBps Intra-node buses (four enclosures) 1075.2 GBps With an increase in frequency, the Power 780 running at 4.42 GHz generates higher cache bandwidth (Table 2-8). Table 2-8 Power 780 memory bandwidth estimates for POWER7+ cores running at 4.42 GHz...
  • Page 70 Translation control entities (TCEs), responsible for providing I/O buffers for the partition’s communications Memory used by the hypervisor to maintain partition configuration, I/O states, virtual I/O information, and partition state IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 71: Special Uncorrectable Error Handling

    It is possible to check whether the Active Memory Mirroring option is enabled and change its current status through HMC, under the Advanced Tab on the CEC Properties panel (Figure 2-10). Figure 2-10 CEC Properties panel on an HMC After a failure on one of the DIMMs containing hypervisor data occurs, all the server operations remain active and flexible service processor (FSP) will isolate the failing DIMMs.

  • Page 72: Capacity On Demand

    (MES only) must be ordered and the required contracts must be in place. If a Power 770 or Power 780 server uses the IBM i operating system in addition to any other supported operating system on the same server, the client must inform IBM which operating system caused the temporary On/Off CoD processor usage so that the correct feature can be used for billing.

  • Page 73: Utility Capacity On Demand (Utility Cod)

    Before requesting temporary capacity on a server, you must enable it for On/Off CoD. To do this, order an enablement feature and sign the required contracts. IBM will generate an enablement code, mail it to you, and post it on the web for you to retrieve and enter on the target server.

  • Page 74: Trial Capacity On Demand (Trial Cod)

    Utility CoD requires PowerVM Standard Edition or PowerVM Enterprise Edition to be active. If a Power 770 or Power 780 server uses the IBM i operating system in addition to any other supported operating system on the same server, the client must inform IBM which operating system caused the temporary Utility CoD processor usage so that the correct feature can be used for billing.
  • Page 75 The cables are also designed to allow the concurrent maintenance of the Power 770 or Power 780 in case the IBM service representative needs to extract a system enclosure from the rack. The design of the flexible cables allows each system enclosure to be disconnected without any impact on the other drawers.
  • Page 76 Figure 2-11 SMP cables installation Figure 2-12 and Figure 2-13 shows the changed SMP cabling for 2- and 3-drawer configurations. There is some overlap of the cables, so some are hidden from view. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 77 Figure 2-12 Three link 2-Drawer SMP cabling Figure 2-13 Two link 3-Drawer SMP cabling Chapter 2. Architecture and technical overview...
  • Page 78 7014-T42 rack. Both the front cover and the external processor fabric cables occupy space on the front left and right sides of an IBM 7014 rack; racks that are not from IBM might not offer the same room. When a Power 770 or Power 780 is configured with two or more system enclosures in a 7014-T42 or 7014-B42 rack, the CEC enclosures must be located in EIA 36 or below to allow space for the flex cables.
  • Page 79 The total width of the server, with cables installed, is 21 inches, as shown in Figure 2-15. Cable Drawer 1 – A Left Cable Drawer 4 – A Left Drawer 1 – B Right Drawer 2 – B Right Cable Drawer 2 –...
  • Page 80 In the rear of the rack, the FSP cables require only some room in the left side of the racks, as Figure 2-16 shows. Two Drawer Cable Three Drawer Cable Four Drawer Cable Figure 2-16 Rear view of rack with detail of FSP flex cables IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 81: System Bus

    This section provides additional information related to the internal buses. 2.6.1 I/O buses and GX++ card Each CEC enclosure of the Power 770 and Power 780 contains one POWER7+ processor card. Each processor card comprises 3-core, 4-core, or 8-core single-chip module POWER7+ processors, with different frequencies depending on the configuration, such as 4.228Ghz,...

  • Page 82: Internal I/O Subsystem

    Each CEC enclosure is equipped with an integrated multifunction card. This integrated card provides two USB ports, one serial port, and four Ethernet connectors for a processor enclosure and does not require a PCIe slot. When ordering a Power 770 or Power 780, you may select the following options:...

  • Page 83: Pci Adapters

    850 nm optic cable (multi-mode cable) and support up to 300 m cabling distances. The Power 770 and Power 780 each support one serial port in the rear of the system. This connector is a standard 9-pin male D-shell, and it supports the RS232 interface. Because the Power 770 and Power 780 are managed by an HMC, this serial port is always controlled by the operating system, and therefore is available in any system configuration.

  • Page 84: Ibm I Iop Adapters

    2.8.3 IBM i IOP adapters IBM i IOP adapters are not supported with the Power 770 and Power 780, which has the following results: Existing PCI adapters that require an IOP are affected. Existing I/O devices are affected, such as certain tape libraries or optical drive libraries, or any HVD SCSI device.
  • Page 85 Low Profile Full Height Full High Low Profile PCIe Slots Full High PCIe Slots  Power 710 / 730  Po wer 720 / 740 / 750 / 760 / 770 / 780 / 795  Power 720 / 740 ...

  • Page 86: Lan Adapters

    The tables indicate operating system support (AIX, IBM i, and Linux) for each of the adapters. 2.8.5 LAN adapters To connect a Power 770 and Power 780 to a local area network (LAN), you can use the integrated multifunction card, or a dedicated adapter. For more information, see 2.7.2, “System ports” on page 68.

  • Page 87: Graphics Accelerator Adapters

    IBM i 2.8.6 Graphics accelerator adapters The IBM Power 770 and Power 780 support up to eight graphics adapters (Table 2-14). They can be configured to operate in either 8-bit or 24-bit color modes. These adapters support both analog and digital monitors, and do not support hot-plug installation. The total number of graphics accelerator adapters in any one partition cannot exceed four.

  • Page 88: Scsi And Sas Adapters

    2.8.7 SCSI and SAS adapters The Power 770 and Power 780 do not support SCSI adapters and SCSI disks. SAS adapters are supported and Table 2-15 lists the available SAS adapters. Table 2-15 Available SCSI and SAS adapters Feature CCIN...

  • Page 89: Fibre Channel Adapter

    2.8.9 Fibre Channel adapter The IBM Power 770 and Power 780 servers support direct or SAN connection to devices that use Fibre Channel adapters. Table 2-17 summarizes the available Fibre Channel adapters. All of these adapters except FC 5735 have LC connectors. If you attach a device or switch with an SC type fiber connector, an LC-SC 50 Micron Fiber Converter Cable (FC 2456) or an LC-SC 62.5 Micron Fiber Converter Cable (FC 2459) is required.

  • Page 90: Fibre Channel Over Ethernet (Fcoe)

    InfiniBand (IB) is an open set of interconnect standards and specifications. The main IB specification is published by the InfiniBand Trade Association and is available at the following location: http://www.infinibandta.org/ IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 91: Asynchronous And Usb Adapters

    For more information about InfiniBand, read HPC Clusters Using InfiniBand on IBM Power Systems Servers, SG24-7767. IBM offers the GX++ 12X DDR Adapter that plugs into the system backplane (GX++ slot). There are two GX++ slots in each CEC enclosure. By attaching a 12X to 4X converter cable (FC 1828), an IB switch can be attached.

  • Page 92: Cryptographic Coprocessor

    One differential signal transmits in one direction. The other differential signal transmits in the opposite direction. Data can be transmitted in both directions simultaneously. The Power 770 and Power 780 CEC enclosures have an extremely flexible and powerful backplane for supporting hard disk drives (HDD) or solid-state drives (SSD). The six small form factor (SFF) bays can be configured in three ways to match your business needs.
  • Page 93 RAID 0 and RAID 10 are supported, and you can also mirror two sets of controller/drives using the operating system. Power 770 and Power 780, with more than one CEC enclosure, support enclosures with different internal storage configurations.
  • Page 94 (dual or triple). Thus, the Dual IOA Enablement card (FC 5662) is required if IBM i is to access any of the SAS bays in that CEC enclosure. AIX and Linux support configurations using two sets of three bays (3/3) or three sets of two bays (2/2/2) without the dual IOA enablement card.
  • Page 95 5662 components cables cables configuration CCIN 2BC2 Two-way split None None IBM i does not support backplane this combination. Connecting to an external disk enclosure is not supported. Three-way Dual x4 SAS Internal SAS AI cable IBM i does not support...

  • Page 96: Dual Split Backplane Mode

    Integrated SAS B Controller Port Expander Redriver 3 way split backplane pin = 1, drven = 0 Morris and Williams Assembly Front view Figure 2-20 Dual split backplane overview IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 97: Triple Split Backplane

    The PCI adapter that drives two of the six disks can be located in the same Power 770 (or Power 780) CEC enclosure as the disk drives or adapter, even in a different system enclosure or external I/O drawer.

  • Page 98: Dvd

    (VSES) for controlling the DVD LED and power. The VSES appears as a separate device to the device driver and operating systems (Figure 2-19 on page 80). IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 99: External I/O Subsystems

    2.10 External I/O subsystems This section describes the external 12X I/O subsystems that can be attached to the Power 770 and Power 780, listed as follows: PCI-DDR 12X Expansion Drawer (FC 5796) 12X I/O Drawer PCIe, small form factor (SFF) disk (FC 5802) 12X I/O Drawer PCIe, No Disk (FC 5877) Table 2-23 provides an overview of all the supported I/O drawers.

  • Page 100: I/O Drawer Pcie

    0.6 m (FC 1861) 1.5 m (FC 1862) 3.0 m (FC 1865) 8 m (FC 1864) The 12X SDR cables are not supported on this drawer. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 101: Dividing Sff Drive Bays In 12X I/O Drawer Pcie

    Figure 2-24 shows the front view of the 12X I/O Drawer PCIe (FC5802). Service card Port cards Disk drives Power cables Figure 2-24 Front view of the 12X I/O Drawer PCIe Figure 2-25 shows the rear view of the 12X I/O Drawer PCIe (FC 5802). 10 PCIe cards X2 SAS connectors Mode Switch...
  • Page 102 Figure 2-26 shows the configuration rule of disk bay partitioning in the PCIe 12X I/O drawer. There is no specific feature code for mode switch setting. Tools and CSP: The IBM System Planning Tool supports disk bay partitioning. Also, the IBM configuration tool accepts this configuration from IBM System Planning Tool and passes it through IBM manufacturing using the Customer Specified Placement (CSP) option.
  • Page 103 The location codes for the front and rear views of the FC 5802 I/O drawer are provided in Figure 2-27 and Figure 2-28. Figure 2-27 FC 5802 I/O drawer from view location codes Figure 2-28 FC 5802 I/O drawer rear view location codes Configuring the drawer FC 5802 disk drive subsystem The drawer SAS disk drive enclosure can hold up 18 disk drives.

  • Page 104: I/O Drawer Pcie And Pci-Ddr 12X Expansion Drawer 12X Cabling

    Each disk bay set can be attached to its own controller or adapter. The feature PCIe 12X I/O drawer has four SAS connections to drive bays. It connects to PCIe SAS adapters or controllers on the host systems. For detailed information about how to configure, see the IBM Power Systems Hardware Information Center: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/index.jsp 2.10.4 12X I/O Drawer PCIe and PCI-DDR 12X Expansion Drawer 12X cabling...
  • Page 105 General rule for the 12X I/O drawer configuration To optimize performance and distribute workload, use as many multiple GX++ buses as possible. Figure 2-30 shows several examples of a 12X I/O drawer configuration. PCIe PCIe PCIe PCIe One I/O Drawer Three I/O Drawers PCIe PCIe...

  • Page 106: I/O Drawer Pcie And Pci-Ddr 12X Expansion Drawer Spcn Cabling

    Enclosures: Only the first two CEC enclosures of a multi-CEC system are included in SPCN cabling with I/O expansion units. CEC enclosures number three and four are not connected. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 107: External Disk Subsystems

    Supported, but no longer orderable 2.11 External disk subsystems This section describes the following external disk subsystems that can be attached to the Power 770 and Power 780: EXP30 Ultra SSD I/O Drawer. (FC EDR1 CCIN 57C3) EXP12S SAS Expansion Drawer (FC 5886)
  • Page 108 (FC 5888). A maximum of two ESP30 drawers can be attached to the Power 750 and Power 760 running AIX and Linux operating systems. Drawer support with IBM i: At the time of writing, one EXP30 drawer only is supported when using the IBM i operating system.
  • Page 109 Power 770 PC Ie Gen2 8X ca ble FC 1914 Power 780 PC Ie Ge n2 8 X c able FC EDR1 E RM - C1 E RM - C2 PS U P SU T1 T2 FC 1914 Power 770...

  • Page 110: Exp12S Sas Expansion Drawer

    PCIe or PCI-X SAS adapters connected to the EXP12S Expansion Drawer through SAS cables. The SAS cable varies, depending on the adapter being used, the operating system being used, and the protection desired. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 111: Exp24S Sff Gen2-Bay Drawer

    Adding the optional 175 MB Cache RAID - Dual IOA Enablement Card (FC 5662) to the Power 770 and Power 780 causes the pair of embedded controllers in that processor enclosure to be configured as dual controllers, accessing all six SAS bays. Using the internal...
  • Page 112 The SAS cable varies, depending on the adapter being used, the operating system being used, and the protection that is needed. In addition to the existing SAS disks options, IBM offers the following disk models: 900 GB 10K RPM SAS HDD in Gen-2 Carrier for AIX and Linux (FC 1752)
  • Page 113 With IBM AIX and Linux the EXP24S can be ordered with four sets of six bays (mode 4), two sets of 12 bays (mode 2), or one set of 24 bays (mode 1). With IBM i, the EXP24S can be ordered as one set of 24 bays (mode 1).

  • Page 114: Totalstorage Exp24 Disk Drawer And Tower

    Single Bus Ultra320 SCSI Repeater Card or a Dual Bus Ultra320 SCSI Repeater Card, allowing a maximum of eight SCSI connections per TotalStorage EXP24. The IBM 7031 Model D24 (7031-D24) is an Expandable Disk Storage Enclosure that is a horizontal 4 EIA by 19-inch rack drawer for mounting in equipment racks.
  • Page 115 IBM System Storage N series The IBM System Storage N series is a network attached storage (NAS) solution. It provides the latest technology to customers to help them improve performance, virtualization manageability, and system efficiency at a reduced total cost of ownership. For more information about the hardware and software, see the following website: http://www.ibm.com/systems/storage/network...

  • Page 116: Hardware Management Console (Hmc)

    At the time of writing, the HMC must be running V7R7.6.0, It can also support up to 48 POWER7+ systems (non Power 590 and 595 models) or 32 IBM Power 590 and 595 servers. The total number of LPARs is changing to 2000 from 1024 only if you have V7R7.6.0 and the HMC is model 7042-CR6 or later.
  • Page 117 Support for customer replaceable unit is standard with the HMC. The customer has the option to upgrade this support level to IBM on-site support to be consistent with other Power Systems servers.

  • Page 118: Hmc Functional Overview

    The HMC gives systems administrators a tool for planning, virtualizing, deploying, and managing IBM Power System servers. With the introduction of HMC V7R760, the HMC can now manage IBM BladeCenter Power Blade servers. This management includes support for dual VIOS, live partition mobility between blades and rack servers, and management of both blades and rack servers from a single management console.

  • Page 119: Hmc Code

    Tool (FLRT) on or after the planned availability date for this product. FLRT will identify the correct HMC machine code for the selected system firmware level. http://www-933.ibm.com/support/fixcentral/ If a single HMC is attached to multiple servers, the HMC machine code level must be updated to the server with the most recent firmware level.

  • Page 120: Hmc Connectivity To The Power7+ Processor-Based Systems

    When IBM Systems Director is used to manage an HMC or if the HMC manages more than 254 partitions, the HMC should have 3 GB of RAM minimum and be CR3 model, or later, rack-mounted, or C06, or later, deskside.

  • Page 121: High Availability By Using The Hmc

    – Service processor Eth1 or HMC2 port is configured as 169.254.3.147 with netmask 255.255.255.0. For the second FSP of IBM Power 770 and Power 780, the default addresses are as follows: – Service processor Eth0 or HMC1 port is configured as 169.254.2.146 with netmask 255.255.255.0.
  • Page 122 Each HMC can be a DHCP server for its VLAN. Redundant service processor connectivity For the Power 770 and Power 780 with two or more CECs, two redundant service processors are installed in CEC enclosures 1 and 2. Redundant service processor function requires that each HMC must be attached to one Ethernet port in CEC enclosure 1 and one Ethernet port in CEC enclosure 2.
  • Page 123 Figure 2-39 shows a redundant HMC and redundant service processor connectivity configuration. LAN3 – Open network HMC1 HMC2 LAN1 – Hardware management network for first FSP ports (private) LAN 1 LAN 2 LAN2 – Hardware management network for second FSP ports (private), separate network hardware from LAN1 LAN3 - Open network for HMC access and...
  • Page 124 Ene t 2 Figure 2-40 Summary of HMC to FSP configuration option depending on number of CEC For details about redundant HMC, see Hardware Management Console V7 Handbook, SG24-7491. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 125: Hmc Code Level

    2.12.6 HMC code level The HMC code must be at V7R7.6.0 to support the Power 770 and Power 780 systems (MMD and MHD systems). In a dual HMC configuration, both systems must be at the same version and release of the HMC.

  • Page 126: Virtual I/O Server

    2.13.1 Virtual I/O Server The minimum required level of Virtual I/O Server for both the Power 770 and Power 780 is VIOS 2.2.2.0. Releasing VIOS 2.2.1.5 will also support both models. IBM regularly updates the Virtual I/O Server code. To find information about the latest updates, visit the Fix Central website: http://www-933.ibm.com/support/fixcentral/...

  • Page 127: Ibm I Operating System

    SMT4 and Active Memory Expansion. 2.13.3 IBM i operating system The IBM i operating system is supported on the Power 770 and Power 780 with the following minimum required levels: IBM i 7.1 TR5 or later; Virtual I/O Server requires IBM i 7.1 and VIOS support IBM i 6.1 with machine code 6.1.1 or later;...

  • Page 128: Java Versions That Are Supported

    2.13.6 Boosting performance and productivity with IBM compilers IBM XL C, XL C/C++, and XL Fortran compilers for AIX and for Linux use the latest POWER7+ processor architecture. Release after release, these compilers continue to help improve application performance and capability, exploiting architectural enhancements that are made available through the advancement of the POWER technology.

  • Page 129: Energy Management

    IBM XL compilers, your applications can use the most recent industry-leading optimization technology. For PL/I, it produces code that is intended to perform well across all hardware levels, including POWER7+ of AIX. IBM Rational® Development Studio for IBM i 7.1 provides programming languages for...
  • Page 130 Director Active Energy Manager (an IBM Systems Directors plug-in) for energy management and control. IBM EnergyScale makes use of power and thermal information collected from the system to implement policies that can lead to better performance or better energy utilization. IBM...
  • Page 131 System altitude can be set in IBM Director Active Energy Manager. If no altitude is set, the system will assume a default value of 350 meters above sea level.
  • Page 132 As with many of the features that are available in IBM Systems Director and Active Energy Manager, this function is scriptable and can be automated.

  • Page 133: Thermal Power Management Device (Tpmd) Card

    Server Power Down Partition Power Management The Power 770 and Power 780 systems implement all the EnergyScale capabilities listed in 2.14.1, “IBM EnergyScale technology” on page 115. 2.14.2 Thermal power management device (TPMD) card The TPMD card is a separate micro controller installed on some POWER6 processor-based systems, and on all POWER7 processor-based systems.
  • Page 134 IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 135: Chapter 3. Virtualization

    As you look for ways to maximize the return on your IT infrastructure investments, consolidating workloads becomes an attractive proposition. IBM Power Systems combined with PowerVM technology offer key capabilities that can help you consolidate and simplify your IT environment: Improve server utilization and sharing I/O resources to reduce total cost of ownership and make better use of IT assets.

  • Page 136: Power Hypervisor

    256 MB. Physical memory is assigned to partitions in increments of LMB. The POWER Hypervisor provides the following types of virtual I/O adapters: Virtual SCSI Virtual Ethernet Virtual Fibre Channel Virtual (TTY) console IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 137 The storage virtualization is accomplished using two paired adapters: A virtual SCSI server adapter A virtual SCSI client adapter A Virtual I/O Server partition or an IBM i partition can define virtual SCSI server adapters. client Other partitions are partitions.
  • Page 138 Depending on the system configuration, the operating system console can be provided by the Hardware Management Console virtual TTY, IVM virtual TTY, or from a terminal emulator that is connected to a system port. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 139: Power Processor Modes

    3.2 POWER processor modes Although, strictly speaking, not a virtualization feature, the POWER modes are described here because they affect various virtualization features. On Power System servers, partitions can be configured to run in several modes, including the following modes: POWER6 compatibility mode This execution mode is compatible with Version 2.05 of the Power Instruction Set Architecture (ISA).
  • Page 140 The selection of the mode is made on a per-partition basis, from the managed console, by editing the partition profile (Figure 3-2). Figure 3-2 Configuring partition profile compatibility mode from the managed console IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 141: Active Memory Expansion

    IBM Power 770 (FC 4791) IBM Power 780 (FC 4791) This feature enables memory expansion on the system. Using compression/decompression of memory content can effectively expand the maximum memory capacity, providing additional server workload capacity and performance.
  • Page 142 AIX 6.1 Technology Level 8 is required. The same feature in Linux is still not supported. Tests in IBM laboratories, using sample work loads, showed excellent results for many workloads in terms of memory expansion per additional CPU utilized. Other test workloads had more modest results.
  • Page 143 To help you do this study, a planning tool is included with AIX 6.1 Technology Level 4, allowing you to sample actual workloads and estimate how expandable the partition's memory is and how much CPU resource is needed. Any model Power System can run the planning tool. Figure 3-4 shows an example of the output that is returned by this planning tool.
  • Page 144 The key is specific to an individual server and is permanent. It cannot be moved to a separate server. This feature is ordered per server, independent of the number of partitions using memory expansion. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 145: Powervm

    3.4 PowerVM The PowerVM platform is the family of technologies, capabilities, and offerings that deliver industry-leading virtualization on the IBM Power Systems. It is the umbrella branding term for Power Systems Virtualization (Logical Partitioning, Micro-Partitioning, POWER Hypervisor, Virtual I/O Server, Live Partition Mobility, Workload Partitions, and more). As with Advanced Power Virtualization in the past, PowerVM is a combination of hardware enablement and value-added software.

  • Page 146: Powervm Editions

    It includes unique features like Active Memory Sharing and Live Partition Mobility. Table 3-3 lists the editions of PowerVM that are available on Power 770 and Power 780. Table 3-3 Availability of PowerVM per POWER7+ processor technology-based server model...
  • Page 147 POWER Hypervisor. The shared processor partitions are created and managed by the HMC. The IBM Power 770 supports up to 64 cores, and has the following maximums: Up to 64 dedicated partitions Up to 1000 micropartitions (maximum 20 micropartitions per physical active core)
  • Page 148 The Power 780 allows up to 128 cores in a single system, supporting the following maximums: Up to 128 dedicated partitions Up to 1000 micropartitions (maximum 20 micropartitions per physical active core) An important point is that the maximums stated are supported by the hardware, but the practical limits depend on application workload demands.

  • Page 149: Multiple Shared Processor Pools

    . The operating system (AIX, IBM i, or Linux) sees one physical processor as two or four logical processors if the simultaneous multithreading feature is on. It can be turned off and on dynamically while the operating system is executing (for AIX, use the smtctl command;...
  • Page 150 All Power Systems servers that support the multiple shared processor pools capability will have a minimum of one (the default) shared processor pool and up to a maximum of 64 shared processor pools. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 151 Default shared processor pool (SPP On any Power Systems server supporting multiple shared processor pools, a default shared processor pool is always automatically defined. The default shared processor pool has a pool identifier of zero (SPP-ID = 0) and can also be referred to as SPP .
  • Page 152 To redistribute unused processor capacity to uncapped micropartitions in multiple shared processor pools above the entitled pool capacity, the POWER Hypervisor uses a higher level of redistribution, Level IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 153 Level capacity resolution: When allocating additional processor capacity in excess of the entitled pool capacity of the shared processor pool, the POWER Hypervisor takes the all micropartitions in the system regardless of the uncapped weights of into account, Multiple shared processor pool structure Where there is unused processor capacity in under-utilized shared processor pools, the micropartitions within the shared processor pools cede the capacity to the POWER Hypervisor.

  • Page 154: Virtual I/O Server

    Virtual I/O Server (and IVM in case it is used) and is supported only in special Virtual I/O Server partitions. Three major virtual devices are supported by the Virtual I/O Server: Shared Ethernet Adapter Virtual SCSI Virtual Fibre Channel adapter IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 155 The Virtual Fibre Channel adapter is used with the NPIV feature, described in “N_Port ID Virtualization (NPIV)” on page 152. Shared Ethernet Adapter A Shared Ethernet Adapter (SEA) can be used to connect a physical Ethernet network to a virtual Ethernet network. The Shared Ethernet Adapter provides this access by connecting the internal hypervisor VLANs with the VLANs on the external switches.
  • Page 156 Ethernet adapter in the Virtual I/O Server. This leaves the SEA without the IP address, allowing for maintenance on the SEA without losing IP connectivity in case SEA failover is configured. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 157 Virtual SCSI Virtual SCSI is used to refer to a virtualized implementation of the SCSI protocol. Virtual SCSI is based on a client/server relationship. The Virtual I/O Server logical partition owns the physical resources and acts as a server or, in SCSI terms, a target device. The client logical partitions access the virtual SCSI backing storage devices provided by the Virtual I/O Server as clients.

  • Page 158: Powervm Live Partition Mobility

    For more information about the System Planning Tool, see 3.5, “System Planning Tool” on page 156. IBM Systems Director agent and a number of preinstalled IBM Tivoli® agents, such as the following examples: – Tivoli Identity Manager, to allow easy integration into an existing Tivoli Systems Management infrastructure –...
  • Page 159 The operating system running in the mobile partition has to be AIX or Linux. The Virtual I/O Server partition itself cannot be migrated. All versions of AIX and Linux supported on the IBM POWER7+ processor-based servers also support partition mobility.
  • Page 160 POWER7+ processor-based servers, and vice versa, allowing you to perform this maintenance with no application planned down time. For more information about Live Partition Mobility and how to implement it, see IBM PowerVM Live Partition Mobility, SG24-7460.

  • Page 161: Active Memory Sharing

    Active Memory Sharing is available only with the Enterprise version of PowerVM. The physical memory of an IBM Power System can be assigned to multiple partitions in either dedicated or shared mode. The system administrator has the capability to assign some physical memory to a partition and some physical memory to a pool that is shared by other partitions.
  • Page 162 Active Memory Sharing shared memory pool, increasing the system’s overall performance by avoiding paging. Deduplication can cause the hardware to incur fewer cache misses, which also leads to improved performance. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 163 Figure 3-14 shows the behavior of a system with Active Memory Deduplication enabled on its Active Memory Sharing shared memory pool. Duplicated pages from separate LPARs are stored only once, providing the Active Memory Sharing pool with more free memory. LPAR1 LPAR2 LPAR3...
  • Page 164 Enable and disable Active Memory Deduplication at an Active Memory Sharing pool level. Display deduplication metrics. Display and modify the deduplication table size. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 165: Dynamic Platform Optimizer

    RHEL 6.2 or later 3.4.8 Dynamic Platform Optimizer Dynamic Platform Optimizer (DPO, FC EB33) is an IBM PowerVM feature that helps the user to configure the logical partition memory and CPU affinity on the POWER7+ processor-based servers, thus, improve performance under some workload scenarios.
  • Page 166 PowerVM Migration from Physical to Virtual Storage, SG24-7825 IBM PowerVM Virtualization Managing and Monitoring, SG24-7590 Support: NPIV is supported in PowerVM Standard and Enterprise Editions on the IBM Power 770 and Power 780 servers. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 167: Operating System Support For Powervm

    3.4.9 Operating system support for PowerVM Table 3-5 summarizes the PowerVM features that are supported by the operating systems compatible with the POWER7+ processor-based servers. Table 3-5 Virtualization features supported by AIX, IBM i and Linux Feature IBM i IBM i...

  • Page 168: Linux Support

    Requires AIX 6.1 TL7 or later. g. Requires AIX 7.1 TL1 or later. h. Requires IBM i 7.1.4 or later. i. Requires IBM i 7.1 TR4 PTF group or later. You can access this link for more details: http://www-912.ibm.com/s_dir/SLKBase.nsf/1ac66549a21402188625680b0002037e/e1877ed7f3b0cfa8862579ec 0048e067?OpenDocument#_Section1 j.
  • Page 169 See the following sources of information: For information regarding Advance Toolchain, see the following website: http://www.ibm.com/developerworks/wikis/display/hpccentral/How+to+use+Advance+T oolchain+for+Linux+on+POWER See the University of Illinois Linux on Power Open Source Repository: http://ppclinux.ncsa.illinois.edu See the following release notes: –...

  • Page 170: System Planning Tool

    3.5 System Planning Tool The IBM System Planning Tool (SPT) helps you design systems to be partitioned with logical partitions. You can also plan for and design non-partitioned systems by using the SPT. The system plan resulting output of your design is called a , which is stored in a .sysplan file.

  • Page 171: Power Version 2.2 Enhancements

    DVD drive. The IBM PowerVM IBM Workload Partitions Manager™ for AIX, Version 2.2 has the following enhancements: When used with AIX 6.1 Technology Level 6, the following support applies: –...
  • Page 172 IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 173: Chapter 4. Continuous Availability And Manageability

    Serviceability: Indicates how well faults and their effect are communicated to users and services, and how efficiently and nondisruptively the faults are repaired. Each successive generation of IBM servers is designed to be more reliable than the previous server family. POWER7 and POWER7+ processor-based servers have features to support new levels of virtualization, help ease administrative burden, and increase system utilization.
  • Page 174 Several software-based availability features exist that are based on the benefits available when using AIX and IBM i as the operating system. Support of these features when using Linux can vary. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 175: Reliability

    L3 cache into the processor chip for a higher integration of parts. Parts selection also plays a critical role in overall system reliability. IBM uses three grades of components (1, 3, and 5), with grade 3 defined as the industry standard (“off-the-shelf”). As...

  • Page 176: Placement Of Components

    POWER7+ cores, which include redundant bits in L1-I, L1-D, and L2 caches, and in L2 and L3 directories Power 770 and Power 780 main memory DIMMs, which contain an extra DRAM chip for improved redundancy Power 770 and 780 redundant system clock and service processor for configurations with...

  • Page 177: Availability

    4.2 Availability The IBM hardware and microcode capability to continuously monitor execution of hardware functions is generally described as the process of first-failure data capture (FFDC). This process includes the strategy of predictive failure analysis, which refers to the ability to track intermittent correctable errors and to vary components offline before they reach the point of hard failure, causing a system outage, and without the need to re-create the problem.

  • Page 178: General Detection And Deallocation Of Failing Components

    On IBM systems prior to POWER6, this error caused a checkstop. Alternate processor retry Hard failures are more difficult, being permanent errors that are replicated each time that the instruction is repeated.

  • Page 179: Memory Protection

    64-byte ECC code This innovative ECC algorithm from IBM research allows a full 8-bit device-kill to be corrected dynamically. This ECC code mechanism works on DIMM pairs on a rank basis. (Depending on the size, a DIMM might have one, two, or four ranks.) With this ECC code, an entirely bad DRAM chip can be marked as bad (chip mark).
  • Page 180 ECC word Scattered memory chip bits across separate ECC words for Chipkill Figure 4-2 Chipkill in action with a spare memory DRAM chip on a Power 770 and Power 780 POWER7and POWER7+ memory subsystem The POWER7 and POWER7+ chip contains two memory controllers with four channels per memory controller.
  • Page 181 DIMMs per controller. Advanced memory buffer chips are exclusive to IBM and help to increase performance, acting as read/write buffers. On the Power 770 and Power 780, the advanced memory buffer chips are integrated into the DIMM that they support.

  • Page 182: Active Memory Mirroring For Hypervisor

    Active Memory Mirroring (AMM) for Hypervisor is a hardware and firmware function of Power 770 and Power 780 systems that provides the ability of the POWER7 and POWER7+ chip to create two copies of data in memory. Having two copies eliminates a system-wide outage because of an uncorrectable failure of a single DIMM in the main memory used by the hypervisor (also called System firmware).
  • Page 183 What memory is mirrored The following areas of memory are mirrored: Hypervisor data that is mirrored – Hardware page tables (HPTs) that are managed by the hypervisor on behalf of partitions to track the state of the memory pages assigned to the partition –...
  • Page 184 Mirrorable memory: This is the total amount of physical memory that can be mirrored, which is based on the DIMMs that are plugged Mirrored memory in use Available mirrored memory IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 185 Mirroring optimization Hypervisor mirroring requires specific memory locations. Those locations might be assign to other purposes (for LPAR memory, for example) because of memory’s management based on the logical memory block. To “reclaim” those memory locations, an Optimization Tool is available on the Advanced tab of the system properties (Figure 4-6).

  • Page 186: Cache Protection

    CEC, as mirroring state requires a CEC reboot to change. Hypervisor mirroring is disabled by default on the Power 770 server. On the Power 780 server, this feature is standard. There is no individual feature code in e-config. The mirroring is enabled by default on the server.

  • Page 187: Special Uncorrectable Error Handling

    4.2.6 Special uncorrectable error handling Although rare, an uncorrectable data error can occur in memory or a cache. IBM POWER7+ processor-based systems attempt to limit, to the least possible disruption, the impact of an uncorrectable error using a well-defined strategy that first considers the data source.
  • Page 188 ECC PCI-X to PCI-X PCIe Adapter Parity error PCI Bridge Enhanced Error Handling PCI-X PCI Bus Enhanced Error Adapter Handling I/O drawer concurrent add Figure 4-7 PCI-enhanced error handling IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 189: Power7 I/O Chip Freeze Behavior

    Serviceability includes system installation, system upgrades and downgrades (MES), and system maintenance and repair. The goal of the IBM Serviceability Team is to design and provide the most efficient system service environment that includes the following benefits: Easy access to service components, design for customer setup (CSU), customer installed...
  • Page 190 Availability The auto-restart (reboot) option, when enabled, can reboot the system automatically following an unrecoverable firmware error, firmware hang, hardware failure, or environmentally induced (AC power) failure. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 191 The auto-restart (reboot) option must be enabled from the Advanced System Management Interface (ASMI) or the Control (Operator) Panel. Figure 4-8 shows this option in the ASMI. Figure 4-8 ASMI Auto Power Restart setting panel Fault monitoring Built-in self-test (BIST) checks processor, cache, memory, and associated hardware that is required for proper booting of the operating system, when the system is powered on at the initial installation or after a hardware configuration change (for example, an upgrade).
  • Page 192 (FRU). This proactive diagnostic strategy is a significant improvement over the classic, less accurate reboot and diagnose service approaches. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 193 Figure 4-9 shows a schematic of a fault isolation register implementation. Error checkers Text Text Text Fault isolation register (FIR) Text Unique fingerprint of each Text captured error Text Text Text Text Text Text Text Service Text Processor L2 / L3 Text Text Log error...

  • Page 194: Diagnosing

    Boot time When an IBM Power Systems server powers up, the service processor initializes the system hardware. Boot-time diagnostic testing uses a multitier approach for system validation, starting with managed low-level diagnostics that are supplemented with system firmware initialization and configuration of I/O hardware, followed by OS-initiated software test routines.

  • Page 195: Reporting

    In the unlikely event that a system hardware or environmentally induced failure is diagnosed, IBM Power Systems servers report the error through a number of mechanisms. The analysis result is stored in system NVRAM. Error log analysis (ELA) can be used to display the failure cause and the physical location of the failing hardware.
  • Page 196 The data is formatted and prepared for transmission back to IBM either to assist the service support organization with preparing a service action plan for the service representative or for additional analysis.

  • Page 197: Notifying

    After a Power Systems server detects, diagnoses, and reports an error to an appropriate aggregation point, it then takes steps to notify the client, and if necessary the IBM support organization. Depending on the assessed severity of the error and support agreement, this client notification might range from a simple notification to having field service personnel automatically dispatched to the client site with the correct replacement part.

  • Page 198: Locating And Servicing

    (those that require the system to be turned off for removal or repair). Tool-less design: Selected IBM systems support tool-less or simple tool designs. These designs require no tools or require basic tools, such as flathead screw drivers to service the hardware components.
  • Page 199 In other cases, a client might be in the process of moving or redesigning a data center or planning a major upgrade. At times like these, flexibility is crucial. The IBM POWER7 and POWER7+ processor-based systems are designed for redundant or concurrently maintainable power, fans, physical storage, and I/O towers.
  • Page 200 (hot-node add) or adding more memory (memory upgrade) to an existing node. The additional Power 770 and Power 780 enclosure or memory can be ordered as a system upgrade (MES order) and added to the original system. The additional resources of the newly added CEC enclosure (node) or memory can then be assigned to existing OS partitions or new partitions as required.
  • Page 201 Concurrent Firmware Maintenance (CFM) option when concurrent service packs are available. CFM is the IBM term used to describe the IBM Power Systems firmware updates that can be partially or wholly concurrent or nondisruptive. With the introduction of CFM, IBM is significantly increasing a client’s opportunity to stay on a given release level for longer...

  • Page 202: Manageability

    The service processor checks the system for errors, ensuring that the connection to the management console for manageability purposes and accepting Advanced System Management Interface (ASMI) Secure Sockets Layer (SSL) network connections. The service IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 203 processor provides the ability to view and manage the machine-wide settings by using the ASMI, and enables complete system and partition management from the management console. With two CEC enclosures and more, there are two redundant FSP, one in each of the first CECs.
  • Page 204 The ASMI on an ASCII console is not available during several phases of system operation, such as the IPL and run time. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 205 By using the normal operational front view. By pulling it out to access the switches and viewing the LCD display. Figure 4-10 shows that the operator panel on a Power 770 and Power 780 is pulled out. Release Lever (slide left to release operator panel and pull out from chassis)
  • Page 206 Online diagnostics, when installed, are a part of the AIX or IBM i operating system on the disk or server. They can be booted in single-user mode (service mode), run in maintenance mode, or run concurrently (concurrent mode) with other applications. They have access to the AIX error log and the AIX configuration data.

  • Page 207: Ibm Power Systems Firmware Maintenance

    SPCN microcode, and the POWER Hypervisor. The firmware and microcode can be downloaded and installed from a management console, a running partition. Power 770 and Power 780 system must be managed by a hardware management console. IBM Power 770 and Power 780 system (9117-MMD and 9179-MHD) must be using firmware AM760 code level (or later supported code level).
  • Page 208 Figure 4-11 Support for Power servers web page Although the content under the Popular links section can change, click Firmware and HMC updates to go to the resources for keeping your system’s firmware current. IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...
  • Page 209 Each IBM Power Systems server has the following levels of server firmware and power subsystem firmware:...

  • Page 210: Electronic Services And Electronic Service Agent

    4.4.3 Electronic Services and Electronic Service Agent IBM transformed its delivery of hardware and software support services to help you achieve higher system availability. Electronic Services is a web-enabled solution that offers an exclusive, no-additional-charge enhancement to the service and support available for IBM servers.

  • Page 211: Power7+ Ras Features

    Service Agent for problem reporting enables IBM to provide better support and service for your IBM server. To learn how Electronic Services can work for you, visit the following site; an IBM ID is required: https://www.ibm.com/support/electronic/portal 4.5 POWER7+ RAS features...

  • Page 212: Pore In Power7+: Assisting Energy Management And Providing Ras Capabilities

    4.7 Operating system support for RAS features Table 4-2 gives an overview of features for continuous availability that are supported by the various operating systems running on the Power 770 and Power 780 systems. In the table, the word “Most” means most functions.
  • Page 213 IBM i RHEL RHEL SLES RAS feature PCI bus extended error detection PCI bus extended error recovery Most Most Most PCI-PCI bridge extended error handling Redundant RIO or 12x Channel link PCI card hot-swap Dynamic SP failover at run time...
  • Page 214 Concurrent operator panel maintenance Redundant management consoles Automated server recovery/restart High availability clustering support Repair and Verify Guided Maintenance Most Most Most Concurrent kernel update Concurrent Hot Add/Repair Maintenance IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 215: Related Publications

    The publications listed in this section are considered particularly suitable for a more detailed discussion of the topics covered in this paper. IBM Redbooks The following IBM Redbooks publications provide additional information about the topic in this document. Note that some publications referenced in this list might be available in softcopy only.

  • Page 216: Other Publications

    IBM Power 795 server Data Sheet http://public.dhe.ibm.com/common/ssi/ecm/en/pod03053usen/POD03053USEN.PDF Active Memory Expansion: Overview and Usage Guide http://public.dhe.ibm.com/common/ssi/ecm/en/pow03037usen/POW03037USEN.PDF Migration combinations of processor compatibility modes for active Partition Mobility http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7hc3/iphc3pcmco mbosact.htm Advance Toolchain for Linux website http://www.ibm.com/developerworks/wikis/display/hpccentral/How+to+use+Advance+ Toolchain+for+Linux+on+POWER IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 217: Online Resources

    Online resources These websites are also relevant as further information sources: IBM Power Systems Hardware Information Center http://publib.boulder.ibm.com/infocenter/systems/scope/hw/index.jsp IBM System Planning Tool website http://www.ibm.com/systems/support/tools/systemplanningtool/ IBM Fix Central website http://www.ibm.com/support/fixcentral/ Power Systems Capacity on Demand website http://www.ibm.com/systems/power/hardware/cod/ Support for IBM Systems website http://www.ibm.com/support/entry/portal/Overview?brandind=Hardware~Systems~Power...
  • Page 218 IBM Power 770 and 780 (9117-MMD, 9179-MHD) Technical Overview and Introduction...

  • Page 220: Back Cover

    IBM Power 770 (9117-MMD) and Power 780 (9179-MHD) servers that 9117-MMD and TECHNICAL support IBM AIX, IBM i, and Linux operating systems. The goal of this 9179-MHD based on SUPPORT paper is to introduce the major innovative Power 770 and 780 offerings...

This manual is also suitable for:

Power 770

Table of Contents