1. Manuals
  2. Brands
  3. IBM Manuals
  4. Server
  5. Power 570
  6. Technical overview and introduction

IBM Power 570 Technical Overview And Introduction

Hide thumbs
Table of Contents

Advertisement

Quick Links

Draft Document for Review May 28, 2009 2:58 pm
IBM Power 570
Technical Overview
and Introduction
Expandable modular design supporting advanced
mainframe class continuous availability
PowerVM virtualization including the
optional Enterprise edition
POWER6 processor efficiency
operating at state-of-the-art
throughput levels
ibm.com/redbooks

Front cover

Redpaper
REDP-4405-00
Giuliano Anselmi
YoungHoon Cho
Gregor Linzmeier
Marcos Quezada
John T Schmidt
Guido Somers

Advertisement

Table of Contents
loading

Related Manuals for IBM Power 570

Summary of Contents for IBM Power 570

  • Page 1: Front Cover

    Front cover Draft Document for Review May 28, 2009 2:58 pm REDP-4405-00 IBM Power 570 Technical Overview and Introduction Expandable modular design supporting advanced mainframe class continuous availability PowerVM virtualization including the optional Enterprise edition POWER6 processor efficiency operating at state-of-the-art...
  • Page 3 4405edno.fm Draft Document for Review September 2, 2008 5:05 pm International Technical Support Organization IBM Power 570 Technical Overview and Introduction October 2008 REDP-4405-00...
  • Page 4 First Edition (October 2008) This edition applies to the IBM Power 570 (9117-MMA). © Copyright International Business Machines Corporation 2008. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule...

  • Page 5: Table Of Contents

    2.2 IBM EnergyScale technology ........
  • Page 6 2.11 External disk subsystems ..........55 2.11.1 IBM System Storage EXP 12S (FC 5886) ......56 2.11.2 IBM TotalStorage EXP24 Expandable Storage .
  • Page 7 4.5.6 IBM System p firmware maintenance ....... . . 120...
  • Page 8 4405TOC.fm Draft Document for Review March 26, 2009 5:10 pm IBM Power 570 Technical Overview and Introduction...

  • Page 9: Notices

    IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.

  • Page 10: Trademarks

    UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, or service names may be trademarks or service marks of others. viii IBM Power 570 Technical Overview and Introduction...

  • Page 11: Preface

    This IBM® Redpaper is a comprehensive guide covering the IBM Power™ 570 server supporting AIX, IBM i, and Linux for Power operating systems. The goal of this paper is to introduce the major innovative Power 570 offerings and their prominent functions, including the following.

  • Page 12: Become A Published Author

    Draft Document for Review March 26, 2009 5:10 pm System p products. He is an IBM Certified Specialist in System p and AIX® 5L™. He provides second line support to field engineers with technical support on System p, and system management.

  • Page 13: Comments Welcome

    Clients. Your efforts will help increase product acceptance and customer satisfaction. As a bonus, you will develop a network of contacts in IBM development labs, and increase your productivity and marketability. Find out more about the residency program, browse the residency index, and apply online at: ibm.com/redbooks/residencies.html...
  • Page 14 4405pref.fm Draft Document for Review March 26, 2009 5:10 pm IBM Power 570 Technical Overview and Introduction...

  • Page 15: Chapter 1. General Description

    The Power 570 leverages your exisiting investments by supporting AIX, IBM i, and Linux for Power, and x86 Linux applications on a single server. It is available in 2-, 4-, 8-, 12-, and 16-core and 32-core configurations.
  • Page 16 Advanced POWER Virtualization (APV) Standard) and PowerVM Enterprise Edition (formerly APV Enterprise). PowerVM Standard Edition includes IBM Micro-Partitioning™ and Virtual I/O Server (VIOS) capabilities. Micro-partitions can be defined as small as 1/10th of a processor and be changed in increments as small as 1/100th of a processor. Up to 160 micro-partitions may be created on a 16-core 570 system.

  • Page 17: System Specifications

    793 mm (31.2 in.) front rack rail mounting surface to rear of Power Supply Weight 63.6 kg (140 lb.) To help ensure the installation and serviceability in non-IBM, industry-standard racks, review the vendor’s installation planning information for any product-specific installation requirements.

  • Page 18: System Features

    Up to 192 GB DDR2 memory per enclosure, 768 GB DDR2 max per system. Available memory features are 667 MHz, 533 MHz, or 400 MHz depending on memory density. Up to 6 SAS DASD disk drives per enclosure, 24 max per system. IBM Power 570 Technical Overview and Introduction...

  • Page 19: Processor Card Features

    4405ch01 General description.fm Draft Document for Review May 22, 2009 3:10 pm 6 PCI slots per enclosure: 4 PCIe, 2 PCI-X; 24 PCI per system: 16 PCIe, 8 PCI-X. Up to 2 GX+ adapters per enclosure; 8 per system One hot-plug slim-line media bay per enclosure, 4 max per system. The external processor fabric bus in this system is modular.

  • Page 20: Memory Features

    Trial CoD (standard) offers a one-time 2-core activation for 30 days. Capacity Backup (IBM i only) offers a 1 license entitlement to a backup system on a temparary basis.

  • Page 21: Disk And Media Features

    4405ch01 General description.fm Draft Document for Review May 22, 2009 3:10 pm Table 1-4 Memory feature codes Feature code Description 5692 0/2 GB DDR2 Memory (4X0.5 GB) DIMMs-667 MHz-POWER6 Memory 5693 0/4 GB DDR2 Memory (4X1 GB) DIMMs-667 MHz-POWER6 Memory 5694 0/8 GB DDR2 Memory (4X2 GB) DIMMs-667 MHz-POWER6 Memory 5695...

  • Page 22: I/O Drawers

    7862) are utilized. Two 7311 Model D11 I/O drawers fit side-by-side in the 4U enclosure (FC 7311) mounted in a 19-inch rack, such as the IBM 7014-T00 or 7014-T42. The 7311 Model D11 I/O drawer offers a modular growth path for systems with increasing I/O requirements.
  • Page 23 4405ch01 General description.fm Draft Document for Review May 22, 2009 3:10 pm optional feature (FC 6268). The 7311 Model D20 I/O drawer offers a modular growth path for systems with increasing I/O requirements. When fully configured with 20 attached 7311 Model D20 drawers, the combined system supports up to 148 PCI-X adapters, 16 PCIe adapters, and 264 hot-swappable disks.
  • Page 24 The 7314 Model G30 I/O Drawer is a rack-mountable expansion cabinet that can be attached to selected IBM System p host servers with IBM POWER6 technology. It is a half-rack width drawer that allows up to two G30 drawers to fit side-by-side in enclosure FC 7314 in the same 4 EIA units of vertical space in a 19-inch rack.
  • Page 25 4405ch01 General description.fm Draft Document for Review May 22, 2009 3:10 pm Dual-Port 12X Channel Interface adapter options: – short run: cables between this adapter and a host system may not exceed 3.0 Meters in length. Cables between two I/O drawers may not exceed 1.5 Meters if both I/O drawers include this short run adapter.

  • Page 26: Hardware Management Console Models

    The system is designed to be installed in a 7014-T00 or -T42 rack. The 7014 Model T00 and T42 are 19-inch racks for general use with IBM System p rack-mount servers. An existing T00 or T42 rack can be used if sufficient space and power are available. The system is not supported in the 7014-S25 or the S11.

  • Page 27: Ibm 7014 Model T00 Rack

    This information is then used by IBM Manufacturing to assemble the system components (drawers) in the rack according to the client’s request. If a system is to be installed in a non-IBM rack or cabinet, it must be ensured that the rack conforms to the EIA standard EIA-310-D (see 1.4.7, “OEM rack”...

  • Page 28: Ibm 7014 Model T42 Rack

    Four PDUs can be mounted vertically in the back of the T00 and T42 racks. See Figure 1-3 for the placement of the four vertically mounted PDUs. In the rear of the rack, two additional IBM Power 570 Technical Overview and Introduction...
  • Page 29 Figure 1-3 PDU placement and PDU view For detailed power cord requirements and power cord feature codes, see IBM System p5, eServer p5 and i5, and OpenPower Planning, SA38-0508. For an online copy, see the IBM Systems Hardware Information Center. You can find it at: http://publib.boulder.ibm.com/eserver/...

  • Page 30: Intelligent Power Distribution Unit (Ipdu)

    RJ45 Ethernet (LAN) connector Port to configure the iPDU through a LAN. Speed is 10/100 auto sensed. When a configured iPDU is selected the following dialog panel (as in IBM Systems Director) will appear as shown in Figure 1-4 on page 17.

  • Page 31: Rack-Mounting Rules

    The primary considerations that should be accounted for when mounting the system into a rack are: The Power 570 is designed to be placed at any location in the rack. For rack stability, it is advisable to start filling a rack from the bottom.

  • Page 32: Useful Rack Additions

    The design of the 570 is optimized for use in a 7014-T00 or -T42 rack. Both the front cover and the processor flex cables occupy space on the front left side of an IBM 7014 rack that may not be available in typical non-IBM racks.

  • Page 33: Oem Rack

    IBM PS/2 Travel Keyboards are supported on the 7316-TF3 for use in configurations where only PS/2 keyboard ports are available. The IBM 7316-TF3 Flat Panel Console Kit provides an option for the USB Travel Keyboards with UltraNav. The keyboard enables the 7316-TF3 to be connected to systems that do not have PS/2 keyboard ports.
  • Page 34 4405ch01 General description.fm Draft Document for Review May 22, 2009 3:10 pm Figure 1-5 Top view of non-IBM rack specification dimensions The vertical distance between the mounting holes must consist of sets of three holes spaced (from bottom to top) 15.9 mm (0.625 in.), 15.9 mm (0.625 in.), and 12.67 mm (0.5 in.) on center, making each three-hole set of vertical hole spacing 44.45 mm (1.75 in.)
  • Page 35 4405ch01 General description.fm Draft Document for Review May 22, 2009 3:10 pm Figure 1-7 Rack specification dimensions, bottom front view It might be necessary to supply additional hardware, such as fasteners, for use in some manufacturer’s racks. The system rack or cabinet must be capable of supporting an average load of 15.9 kg (35 lb.) of product weight per EIA unit.
  • Page 36 4405ch01 General description.fm Draft Document for Review May 22, 2009 3:10 pm IBM Power 570 Technical Overview and Introduction...

  • Page 37: Chapter 2. Architecture And Technical Overview

    Fabric Bus 8 Bytes each dir DIMM 2 (Processor DIMM Clock):1 DIMM DIMM Elastic Interface DIMM DIMM DIMM CPU planar DIMM SMP fabric bus cable connection Figure 2-1 570 logic data flow © Copyright IBM Corp. 2008. All rights reserved.

  • Page 38: The Power6 Processor

    POWER6 processor will first automatically retry the instruction. If the source of the error was truly transient, the instruction will succeed and the system will continue as before. On predecessor IBM systems, this error would have caused a checkstop.
  • Page 39 4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm POWER6 POWER6 POWER5 Alti Alti core core 1.9 GHz 4.2 GHz 1.9 GHz 4.2 GHz 32 MB 4 MB 4 MB Ctrl Fabric bus L3 cache controller Memory GX Bus...

  • Page 40: Decimal Floating Point

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm The POWER6 processor implements the 64-bit IBM Power Architecture® technology. Each POWER6 chip incorporates two dual-threaded Simultaneous Multithreading processor cores, a private 4 MB level 2 cache (L2) for each processor, a 36 MB L3 cache controller shared by...

  • Page 41: Altivec And Single Instruction, Multiple Data

    2.2 IBM EnergyScale technology IBM EnergyScale™ technology is featured on the IBM POWER6 processor-based systems. It provides functions to help the user understand and control IBM server power and cooling usage. In this section we will describe IBM EnergyScale features and hardware and software...

  • Page 42: Hardware And Software Requirements

    7014-S25, 7014-T00 and 7014-T42. b. Only supported if GX Dual Port RIO-2 Attach (FC 1800) is not present. The primary user interface for EnergyScale features on a POWER6 based system is IBM Systems Director Active Energy Manager™ running within IBM Director Table 2-2 on page 29 shows the ASMI, HMC and Active Energy Manager interface support.

  • Page 43: Processor Cards

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Table 2-2 EnergyScale function’s software interfaces EnergyScale ASMI Active Energy functions Manager Power Trending Power Saver Mode Schedule Power Saver Mode Operation Power Capping Schedule Power Capping Operation 2.3 Processor cards In the 570, the POWER6 processors, associated L3 cache chip, and memory DIMMs are...

  • Page 44: Processor Drawer Interconnect Cables

    Figure 2-4 Logical 570 building block connection 2.3.2 Processor clock rate The 570 system features base 2-core, 4-core, 8-core, 12-core, and 16-core configurations with the POWER6 processor running at 3.5 GHz, 4.2 GHz, and 4.7 GHz. IBM Power 570 Technical Overview and Introduction...

  • Page 45: Memory Subsystem

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Note: Any system made of more than one processor card must have all processor cards running at the same speed. To verify the processor characteristics on a system running at 4.2 GHz, use one of the following commands: lsattr -El procX Where X is the number of the processor, for example, proc0 is the first processor in the...

  • Page 46: Memory Placements Rules

    First quad includes J0A, J0B, J0C, and J0D memory slots Second quad includes J1A, J1B, J1C, and J1D memory slots Third quad includes J2A, J2B, J2C, and J2D memory slots See Figure 2-6 on page 33 to locate any available quad. IBM Power 570 Technical Overview and Introduction...

  • Page 47: Memory Consideration For Model Migration From P5 570 To 570

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm L3 cache POWER6 chip Figure 2-6 Memory DIMM slots for FC 5620, FC 5622, and FC 7380 In addition to the quad placement rules, minimum memory required depends from the number of processor-cores configured in the 570: 2 GB is the minimum memory required for a 2-core system 4 GB is the minimum memory required for a 4-core system...

  • Page 48: Oem Memory

    OEM memory, you could experience unexpected and unpredictable behavior, especially when the system is using Micro-Partitioning technology. All IBM memory is identified by an IBM logo and a white label that is printed with a barcode and an alphanumeric string, as illustrated in Figure 2-8 on page 35.

  • Page 49: Memory Throughput

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Figure 2-8 IBM memory certification label 2.4.5 Memory throughput The memory subsystem throughput is based on the speed of the memory. On processor, there are four memory channels, each with single 2 byte read and 1 byte write. Memory channels of POWER6 memory controller are connected to Memory buffers.

  • Page 50: Service Processor Bus

    Service interface card is required in every system drawer for signal distribution functions inside the system drawer. There is a unique SP cable for each drawer as Figure 2-9 on page 37 shows. IBM Power 570 Technical Overview and Introduction...

  • Page 51: Internal I/O Subsystem

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Figure 2-9 SP Flex™ cables FC 5657: 2-drawer SP cable FC 5658: 3-drawer SP cable FC 5660: 4-drawer SP cable. 2.6 Internal I/O subsystem The internal I/O subsystem resides on the system planar which supports a mixture of both PCIe and PCI-X slots.

  • Page 52: System Ports

    The use of the integrated system ports on a 570 is limited to serial connected TTY console functionality and IBM approved call-home modems. These system ports do not support other general serial connection uses, such as UPS, HACMP heartbeat, printers, mice, track balls, space balls, etc.

  • Page 53: Physical Ports And System Integration

    Each 570 enclosure can have unique Integrated Virtual Ethernet adapters, so a fully configured 570 server can be comprised of several different IVE feature codes. MES stands for Miscellaneous Equipment Shipment. It is the IBM process for IBM system upgrade Chapter 2. Architecture and technical overview...
  • Page 54 10 Gbps SR (short range) is designed to support short distances over deployed multi-mode fiber cabling, it has a range of between 26 m and 82 m depending on cable type. It also supports 300 m operation over new, 50 µm 2000 MHz·km multi-mode fiber (using 850 nm). IBM Power 570 Technical Overview and Introduction...

  • Page 55: Feature Code Port And Cable Support

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Figure 2-12 Integrated Virtual Ethernet adapter connection on System p 570 I/O system board 2.7.2 Feature code port and cable support All the IVE feature codes have different connectivity options and different cable support (see Figure 2-13).

  • Page 56: Ive Subsystem

    100 Mbps or 10 Mbps speeds share the same I/O pins and do not require additional hardware Category 5 cable, commonly known as Cat 5, is a twisted pair cable type designed for high signal integrity. Category 5 has been superseded by the Category 5e specification. IBM Power 570 Technical Overview and Introduction...

  • Page 57: Pci Adapters

    IBM offers PCIe adapter options for the 570, as well as PCI and PCI-extended (PCI-X) adapters. All adapters support Extended Error Handling (EEH). PCIe adapters use a different type of slot than PCI and PCI-X adapters.

  • Page 58: Lan Adapters

    If you are installing a new feature, ensure that you have the software required to support the new feature and determine whether there are any existing PTF prerequisites to install. To do this, use the IBM Prerequisite Web site at : http://www-912.ibm.com/e_dir/eServerPrereq.nsf 2.8.1 LAN adapters...

  • Page 59: Iscsi

    It can either be optimized in hardware for better performance on an iSCSI host bus adapter (such as FC 5713 and FC 5714 supported in IBM System p servers) or run in software over a standard Gigabit Ethernet network interface card.
  • Page 60 IBM iSCSI adapters iSCSI adapters in IBM System p systems provide the advantage of increased bandwidth through the hardware support of the iSCSI protocol. The 1 Gigabit iSCSI TOE (TCP/IP Offload Engine) PCI-X adapters support hardware encapsulation of SCSI commands and data into TCP and transports them over the Ethernet using IP packets.

  • Page 61: Fibre Channel Adapter

    If you have a cluster configuration or high-availability configuration and plan to connect the IBM System p servers using a serial connection, the use of the two system ports is not supported. You should use one of the features listed in Table 2-12 on page 48.

  • Page 62: Additional Support For Existing Pci Adapters

    “Asynchronous PCI adapters” on page 47. The list of all the supported PCI adapters, with the related support for additional external devices, is more extended. If you would like to use PCI adapters you already own, contact your IBM service representative to verify whether those adapters are supported.

  • Page 63: Split Backplane

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Feature Description 3651 + 5900 or 5909 A hardware feature that occupies PCIe slot P1C3 provides a mini SAS 4x connector to the rear bulkhead and allows all of the internal SAS drives to be controlled using an external SAS controller.

  • Page 64: External I/O Subsystems

    Draft Document for Review May 28, 2009 1:59 pm 2.10 External I/O subsystems This section describes the external I/O subsystems, which include the I/O drawers, the IBM System Storage™ EXP 12S SAS drawer, as well as the 7311-D11, 7311-D20, 7311-G30, 7031-D24, and 7031-T24 deskside tower.

  • Page 65: Consideration For 7311 Model D10 I/O Drawer

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm slots 1 to 6 are PCI-X slots that operate at 133 MHz and 3.3 V signaling. Figure 2-15 on page 51 shows a conceptual diagram of the 7311 Model D11 I/O drawer. P C I-X H o s t B rid g e R IO 2...

  • Page 66: 7311 Model D20 I/O Drawer

    Note: Any 6-packs and the related SCSI adapter can be assigned to a logical partition (for example, the two partitions can be two Virtual I/O server partitions). If one SCSI adapter is connected to both 6-packs, then both 6-packs can be assigned only to the same partition. IBM Power 570 Technical Overview and Introduction...

  • Page 67: 7311 Model D11 And Model D20 I/O Drawers And Rio-2 Cabling

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm 2.10.4 7311 Model D11 and Model D20 I/O drawers and RIO-2 cabling As described in 2.10, “External I/O subsystems” on page 50, we can connect up to four I/O drawers in the same loop, and up to 20 I/O drawers to the p5-570 system.

  • Page 68: 7311 I/O Drawer And Spcn Cabling

    7314-G30 can accommodate 6 blind swap adapter cassettes. Cassettes can be installed and removed without removing the drawer from the rack. The Figure 2-20 on page 55 shows the back view of the expansion unit. System Power Control Network IBM Power 570 Technical Overview and Introduction...

  • Page 69: External Disk Subsystems

    2.11 External disk subsystems The 570 has internal hot-swappable drives. When the AIX operating system is installed in a IBM System p server, the internal disks are usually used for the AIX rootvg volume group and Chapter 2. Architecture and technical overview...

  • Page 70: Ibm System Storage Exp 12S (Fc 5886)

    The SAS disks are front accessible, using the same disk carrier and 3.5 inch SAS disk drives as used in IBM POWER6 Power Systems. As a two unit, 19-inch rack-mountable disk enclosure supports 73 GB, 146 GB, and 300 GB hot-swappable SAS disk drives.

  • Page 71: Ibm Totalstorage Exp24 Expandable Storage

    Figure 2-22 Maximum attachment of EXP 12S on one adapter 2.11.2 IBM TotalStorage EXP24 Expandable Storage The IBM TotalStorage® EXP24 Expandable Storage disk enclosure, Model D24 or T24, can be purchased together with the 570 and will provide low-cost Ultra320 (LVD) SCSI disk storage.

  • Page 72: Ibm System Storage N3000, N5000 And N7000

    4 GB switched interfaces. In most cases, both the IBM TotalStorage DS4000 family and the IBM System p5 servers are connected to a storage area network (SAN). If only space for the rootvg is needed, the Model DS4100 is a good solution.

  • Page 73: Hardware Management Console

    The HMC 7042 Model CR4 is a 1U, 19-inch rack-mountable drawer that has two native 10/100/1000 Mbps Ethernet ports and two additional PCI slots. Note: The IBM 2-Port 10/100/1000 Base-TX Ethernet PCI-X Adapter (FC 5706) should be ordered to provide additional physical Ethernet connections.
  • Page 74 Functions performed by the HMC include: Creating and maintaining a multiple partition environment Displaying a virtual operating system session terminal for each partition Displaying a virtual operator panel of contents for each partition IBM Power 570 Technical Overview and Introduction...

  • Page 75: High Availability Using The Hmc

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Detecting, reporting, and storing changes in hardware conditions Powering managed systems on and off Acting as a service focal point Generating or importing System Plans The HMC provides both graphical and command line interface for all management tasks. Remote connection to the HMC using a web browser (as of HMC Version 7, previous versions required a special client program, called WebSM) or SSH are possible.

  • Page 76: Operating System Support

    Handbook, SG24-7491. 2.12.2 Operating System Support The POWER6-based IBM System 570 supports IBM AIX 5L Version 5.2, IBM AIX 5L Version 5.3, IBM AIX Version 6.1 and Linux distributions from SUSE and Red Hat. Note: For specific technical support details, please refer to the support for IBM Web site: http://www.ibm.com/systems/p/os...
  • Page 77 IBM AIX V6.1 IBM is making available a new version of AIX, AIX V6.1 which will include significant new capabilities for virtualization, security features, continuous availability features and manageability. AIX V6.1 is the first generally available version of AIX V6.
  • Page 78 The PowerVM features are supported in Version 2.6.9 and above of the Linux kernel. The commercially available latest distributions from Red Hat, Inc. (RHEL AS 5) and Novell SUSE Linux (SLES 10) support the IBM system p 64-bit architectures and are based on this 2.6 kernel series.

  • Page 79: Service Information

    Blue (IBM blue) or terra-cotta (orange) on a component indicates a touch point (for electronic parts) where you can grip the hardware to remove it from or to install it into the system, to open or to close a latch, and so on. IBM defines the touch point colors as follows: Blue...
  • Page 80 Support service representative Functions 50 through 99, which are available when you select Manual mode from Function 02, then select and enter the client service switch 1 (Function 25), followed by service switch 2 (Function 26). IBM Power 570 Technical Overview and Introduction...

  • Page 81: System Firmware

    4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Function 30 – CEC SP IP address and location Function 30 is one of the Extended control panel functions and is only available when Manual mode is selected. This function can be used to display the central electronic complex (CEC) Service Processor IP address and location segment.
  • Page 82 For the system firmware download site for the 570, go to: http://www14.software.ibm.com/webapp/set2/firmware/gjsn In the main area of the firmware download site, select the correct machine type and model. The 570 machine type and model is 9117-MMA (see Figure 2-27 on page 69) IBM Power 570 Technical Overview and Introduction...
  • Page 83 4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm Figure 2-27 IBM Microcode downloads site Receive server firmware fixes using an HMC If you use an HMC to manage your server and you periodically configure several partitions on the server, you need to download and install fixes for your server and power subsystem firmware.

  • Page 84: Service Processor

    Draft Document for Review May 28, 2009 1:59 pm For a detailed description of each task, select System p information, support, and troubleshooting → Fixes and upgrades → Getting fixes and upgrades from the IBM Systems Hardware Information Center Web site at: http://publib.boulder.ibm.com/infocenter/eserver/v1r3s/index.jsp?lang=en...

  • Page 85: Redundant Service Processor

    IP addresses or range. The ASMI can also be accessed using a terminal attached to the system service processor ports on the server, if the server is not HMC managed. The service processor and the ASMI are standard on all IBM System p servers.
  • Page 86 IP address. The Hardware Management Console is a system that controls managed systems, including IBM System p5 and p6 hardware, and logical partitions. To provide flexibility and availability, there are different ways to implement HMCs. Web-based System Manager Remote Client The Web-based System Manager Remote Client is an application that is usually installed on a PC and can be downloaded directly from an installed HMC.
  • Page 87 Web-based System Manager Remote Client allow you the flexibility to access your managed systems (including HMCs) from multiple locations using multiple HMCs. For more detailed information about the use of the HMC, refer to the IBM Systems Hardware Information Center.
  • Page 88 4405ch02 Architecture and technical overview.fm Draft Document for Review May 28, 2009 1:59 pm IBM Power 570 Technical Overview and Introduction...

  • Page 89: Chapter 3. Virtualization

    As you look for ways to maximize the return on your IT infrastructure investments, consolidating workloads becomes an attractive proposition. IBM Power Systems combined with PowerVM technology are designed to help you consolidate and simplify your IT environment. Key capabilities include: Improve server utilization and sharing I/O resources to reduce total cost of ownership and make better use of IT assets.

  • Page 90: Power Hypervisor

    512 MB for AIX, Red Hat, and Novell SUSE Linux. Physical memory is assigned to partitions in increments of Logical Memory Block (LMB). The POWER Hypervisor provides the following types of virtual I/O adapters: Virtual SCSI IBM Power 570 Technical Overview and Introduction...
  • Page 91 4405ch03 Virtualization.fm Draft Document for Review September 2, 2008 5:05 pm Virtual Ethernet Virtual (TTY) console Virtual SCSI The POWER Hypervisor provides a virtual SCSI mechanism for virtualization of storage devices (a special logical partition to install the Virtual I/O Server is required to use this feature, as described in 3.3.2, “Virtual I/O Server”...

  • Page 92: Logical Partitioning

    If the name of the desired shared processor pool is not available here, you must first configure the desired shared processor pool using the Shared Processor Pool Management window. Shared processor partitions use the default shared processor pool called DefaultPool by default. IBM Power 570 Technical Overview and Introduction...

  • Page 93: Processing Mode

    4405ch03 Virtualization.fm Draft Document for Review September 2, 2008 5:05 pm Select whether the partition will be able or not to access extra processing power to “fill up” its virtual processors above its capacity entitlement. Selecting either to capp or uncapp your partition.
  • Page 94 So, even with a virtual processor, the concept of logical processor exists and the number of logical processor depends whether the simultaneous multithreading is turned on or off. IBM Power 570 Technical Overview and Introduction...

  • Page 95: Powervm

    Up to 10 per core For more information about the different PowerVM editions please refer to PowerVM Virtualization on IBM System p Introduction and Configuration, SG24-7940. Note The 570 has to be managed with the Hardware Management Console. 3.3.2 Virtual I/O Server The Virtual I/O Server is part of all PowerVM Editions.

  • Page 96: Shared Ethernet Adapter

    Figure 3-3 on page 83 shows a configuration example of an SEA with one physical and two virtual Ethernet adapters. An SEA can include up to 16 virtual Ethernet adapters on the Virtual I/O Server that share the same physical access. IBM Power 570 Technical Overview and Introduction...
  • Page 97 Ethernet adapter in the Virtual I/O Server. This leaves the SEA without the IP address, allowing for maintenance on the SEA without losing IP connectivity in case SEA failover is configured. For a more detailed discussion about virtual networking, see: http://www.ibm.com/servers/aix/whitepapers/aix_vn.pdf Chapter 3. Virtualization...
  • Page 98 Virtual I/O Server. Each of the two client partitions is assigned one logical volume, which is then accessed through a virtual I/O adapter (VSCSI Client Adapter). Inside the partition, the disk is seen as a normal hdisk. Figure 3-4 Architectural view of virtual SCSI IBM Power 570 Technical Overview and Introduction...

  • Page 99: Powervm Lx86

    More on the System Planning Tool in section 3.4, “System Planning Tool” on page 91. IBM Systems Director and a number of preinstalled Tivoli® agents are included like Tivoli Identity Manager (TIM) in order to allow easy integration into an existing Tivoli Systems...
  • Page 100 PowerVM LX86 is supported under the VIOS Software Maintenance Agreement (SWMA). When using PowerVM Lx86 on an IBM System p POWER6 processor-based system only SLES 10 with SP1 and RHEL 4.5 are supported. Make sure the x86 version is the same as your Linux on POWER version. Do not try to use any other version because it is unlikely to work.

  • Page 101: Powervm Live Partition Mobility

    – SUSE Linux Enterprise Services 10 (SLES 10) Service Pack 1 or later Previous versions of AIX and Linux can participate in inactive partition mobility, if the operating systems support virtual devices and IBM System p POWER6 processor-based systems. Source and destination system requirements The source partition must be one that only has virtual devices.

  • Page 102: Powervm Aix 6 Workload Partitions

    During the migration, the HMC controls all phases of the process. For more information about Live Partition Mobility and how to implement it, refer to IBM System p Live Partition Mobility, SG24-7460.

  • Page 103: Powervm Aix 6 Workload Partition Manager

    Workload Partition Management in IBM AIX Version 6, SG24-7431. 3.3.6 PowerVM AIX 6 Workload Partition Manager IBM PowerVM AIX 6 Workload Partition Manager (WPAR Manager) is a platform management solution that provides a centralized point of control for managing workload partitions (WPARs) across a collection of managed systems running AIX.

  • Page 104: Operating System Support For Powervm

    Agents installed whether created by the WPAR Manager or through the command line interface (CLI) on the local system console Note: The IBM PowerVM Workload Partition Manager for AIX 6 is a separate, optional product as part of the IBM PowerVM suite (5765-WPM).

  • Page 105: System Planning Tool

    To create and deploy partitions on your system(s) automatically The SPT is the next generation of the IBM LPAR Validation Tool (LVT). It contains all the functions from the LVT, as well as significant functional enhancements, and is integrated with the IBM Systems Workload Estimator (WLE).
  • Page 106 .lvt and .xml plans and save them as .sysplan files. It is recommended that you take action prior to 03/31/2008. The SPT and its supporting documentation can be found on the IBM System Planning Tool site at: http://www.ibm.com/systems/support/tools/systemplanningtool/...

  • Page 107: Chapter 4. Continuous Availability And Manageability

    Chapter 4. manageability This chapter provides information about IBM Power Systems design features that help lower the total cost of ownership (TCO). The advanced IBM RAS (Reliability, Availability, and Service ability) technology allows the possibility to improve your architecture’s TCO by reducing unplanned down time.

  • Page 108: Placement Of Components

    Parts selection also plays a critical role in overall system reliability. IBM uses three grades of components, with grade 3 defined as industry standard (off-the-shelf). As shown in...

  • Page 109: Continuous Field Monitoring

    4.1.4 Continuous field monitoring Aided by the IBM First Failure Data Capture (FFDC) methodology and the associated error reporting strategy, commodity managers build an accurate profile of the types of failures that might occur, and initiate programs to enable corrective actions. The IBM support team also continually analyzes critical system faults, testing to determine if system firmware and maintenance procedures and tools are effectively handling and recording faults as designed.
  • Page 110 Dynamic processor deallocation enables automatic deconfiguration of processor cores when patterns of recoverable errors, for example correctable errors on processor caches, are detected. Dynamic processor deallocation prevents a recoverable error from escalating to an IBM Power 570 Technical Overview and Introduction...
  • Page 111 4405ch04 Continuous availability and manageability.fm Draft Document for Review September 2, 2008 5:05 pm unrecoverable system error, which might otherwise result in an unscheduled server outage. Dynamic processor deallocation relies upon the service processor’s ability to use FFDC-generated recoverable error information to notify the POWER Hypervisor when a processor core reaches its predefined error limit.
  • Page 112 Processor contained checkstop When all the above mechanisms fail in almost all cases (excepting the POWER Hypervisor) a termination will be contained to the single partition using the failing processor core. Figure 4-4 Processor instruction retry and Alternate processor recovery IBM Power 570 Technical Overview and Introduction...
  • Page 113 DIMM can be replaced. Redundant bit steering IBM systems use redundant bit steering to avoid situations where multiple single-bit errors align to create a multi-bit error. In the event that an IBM POWER6 processor-based system detects an abnormal number of errors on a bit line, it can dynamically steer the data stored at this bit line into one of a number of spare lines.
  • Page 114 DIMMs on DRAMs. Because it uses a daisychained memory access topology, this system can deconfigure a DIMM that encounters a DRAM fault, without deconfiguring the bus controller, even if the bus controller is contained on the DIMM. IBM Power 570 Technical Overview and Introduction...

  • Page 115: Special Uncorrectable Error Handling

    4405ch04 Continuous availability and manageability.fm Draft Document for Review September 2, 2008 5:05 pm Figure 4-6 Memory control hierarchy Memory deconfiguration Defective memory discovered at boot time is automatically switched off, unless it is already the minimum amount required to boot. If the Service Processor detects a memory fault at boot time, it marks the affected memory as bad so it is not to be used on subsequent reboots (Memory Persistent Deallocation).

  • Page 116: Cache Protection Mechanisms

    When six cache lines have been repaired, the L2 is marked for persistent deconfiguration on subsequent system reboots until it can be replaced. SLES 10 SP1 or later, and in RHEL 4.5 or later (including RHEL 5.1). IBM Power 570 Technical Overview and Introduction...

  • Page 117: Pci Error Recovery

    4.2.4 PCI Error Recovery IBM estimates that PCI adapters can account for a significant portion of the hardware based errors on a large server. While servers that rely on boot-time diagnostics can identify failing components to be replaced by hot-swap and reconfiguration, run time errors pose a more significant problem.

  • Page 118: Serviceability

    IBMs diverse System x™, System i™, System p, and high-end System z™ offerings. The goal of the IBM Serviceability Team is to design and provide the most efficient system service environment that incorporates: Easy access to service components...

  • Page 119: Detecting Errors

    4405ch04 Continuous availability and manageability.fm Draft Document for Review September 2, 2008 5:05 pm 4.3.1 Detecting errors The first and most crucial component of a solid serviceability strategy is the ability to accurately and effectively detect errors when they occur. While not all errors are a guaranteed threat to system availability, those that go undetected can cause problems because the system does not have the opportunity to evaluate and act if necessary.
  • Page 120 Error checking hardware ranges from parity error detection coupled with processor instruction retry and bus retry, to ECC correction on caches and system buses. All IBM hardware error checkers have distinct attributes: Continually monitoring system operations to detect potential calculation errors.

  • Page 121: Diagnosing Problems

    4.3.2 Diagnosing problems Using the extensive network of advanced and complementary error detection logic built directly into hardware, firmware, and operating systems, the IBM POWER6 processor-based Systems can perform considerable self diagnosis. Chapter 4. Continuous availability and manageability...
  • Page 122 Draft Document for Review September 2, 2008 5:05 pm Boot-time When an IBM POWER6 processor-based system powers up, the Service Processor initializes system hardware. Boot-time diagnostic testing uses a multi-tier approach for system validation, starting with managed low-level diagnostics supplemented with system firmware initialization and configuration of I/O hardware, followed by OS-initiated software test routines.

  • Page 123: Reporting Problems

    4405ch04 Continuous availability and manageability.fm Draft Document for Review September 2, 2008 5:05 pm 4.3.3 Reporting problems In the unlikely event of a system hardware or environmentally induced failure is diagnosed, POWER6 processor-based systems report the error through a number of mechanisms. This ensures that appropriate entities are aware that the system may be operating in an error state.

  • Page 124: Notifying The Appropriate Contacts

    In this event, it will be offloaded to the HMC upon reboot. Specific HMC information is included as part of the information that can optionally be sent to IBM support for analysis. If additional information relating to the dump is required, or if it becomes necessary to view the dump remotely, the HMC dump record will notify IBMs support center upon which HMC the dump is located.

  • Page 125: Locating And Repairing The Problem

    IBM problem management database At the IBM support center, historical problem data is entered into the IBM Service and Support Problem Management database. All of the information related to the error along with any service actions taken by the service representative are recorded for problem management by the support and development organizations.
  • Page 126 In other cases, a customer may be in the process of moving or redesigning a datacenter, or planning a major upgrade. At times like these, flexibility is crucial. The IBM POWER6 processor-based systems are designed for redundant or concurrently maintainable power, fans, physical storage, and I/O towers.

  • Page 127: Operating System Support For Ras Features

    Service documentation on the support for IBM System p The support for IBM System p Web site is an electronic information repository for POWER6 processor-based systems. This Web site also provides online training and educational material, as well as service documentation.
  • Page 128 Array recovery & Array persistent deallocation (spare bits in L1 & L2 cache; L1, L2, and L3 directory) Special uncorrectable error handling Fault Detection and Isolation Platform FFDC diagnostics I/O FFDC diagnostics Runtime diagnostics Limited Limited IBM Power 570 Technical Overview and Introduction...
  • Page 129 4405ch04 Continuous availability and manageability.fm Draft Document for Review September 2, 2008 5:05 pm RAS feature AIX V5.3 AIX V6.1 RHEL V5.1 SLES V10 Storage protection keys Dynamic trace Operating system FFDC Error log analysis Service processor support for BIST for logic &...

  • Page 130: Manageability

    DVD-ROM drive, and online diagnostics (available in AIX). Online diagnostics, when installed, are a part of the AIX operating system on the disk or server. They can be booted in single-user mode (service mode), run in maintenance IBM Power 570 Technical Overview and Introduction...

  • Page 131: Electronic Service Agent

    Electronic Service web portal, and used to improve problem determination and resolution between the customer and the IBM support team. As part of an increased focus to provide even better service to IBM customers, Electronic Service Agent tool configuration and activation comes standard with the system.
  • Page 132 The Electronic Services Web portal is a single Internet entry point that replaces the multiple entry points traditionally used to access IBM Internet services and support. This Web portal enables you to gain easier access to IBM resources for assistance in resolving technical problems.

  • Page 133: Manage Serviceable Events With The Hmc

    Premium Search: A search service using information gathered by Service Agents (this is a paid service that requires a special contract). For more information on how to utilize the power of IBM Electronic Services, visit the following Web site or contact an IBM Systems Services Representative.

  • Page 134: Ibm System P Firmware Maintenance

    Each IBM System p server has the following levels of server firmware and power subsystem firmware: Installed level – This is the level of server firmware or power subsystem firmware that has been installed and will be installed into memory after the managed system is powered off and powered on.

  • Page 135: Management Edition For Aix

    4.5.7 Management Edition for AIX IBM Management Edition for AIX (ME for AIX) is designed to provide robust monitoring and quick time to value by incorporating out-of-the box best practice solutions that were created by AIX and PowerVM Virtual I/O Server developers. These best practice solutions include...

  • Page 136: Ibm Director

    For information regarding the ME for AIX, visit the following link : http://www-03.ibm.com/systems/p/os/aix/sysmgmt/me/index.html 4.5.8 IBM Director IBM Director is an integrated, easy-to-use suite of tools that provide you with flexible system management capabilities to help realize maximum systems availability and lower IT costs. IBM Director provide below benefits :...
  • Page 137 CSM HA MS is designed to remove the management server as a single point of failure in the cluster. For information regarding the IBM Cluster Systems Management for AIX , HMC control, cluster building block servers, and cluster software available, visit the following links: Cluster 1600 http://www-03.ibm.com/systems/clusters/hardware/1600/index.html...
  • Page 138 4405ch04 Continuous availability and manageability.fm Draft Document for Review September 2, 2008 5:05 pm IBM Power 570 Technical Overview and Introduction...

  • Page 139: Related Publications

    For information about ordering these publications, see “How to get Redbooks” on page 126. Note that some of the documents referenced here may be available in softcopy only. PowerVM Virtualization on IBM System p Introduction and Configuration Forth Edition, SG24-7940...

  • Page 140: Online Resources

    You can search for, view, or download Redbooks, Redpapers, Technotes, draft publications and Additional materials, as well as order hardcopy Redbooks, at this Web site: ibm.com/redbooks Help from IBM IBM Support and downloads ibm.com/support IBM Global Services ibm.com/services IBM Power 570 Technical Overview and Introduction...
  • Page 142 INTERNATIONAL the IBM System p 570 UNIX® server. The goal of this design supporting TECHNICAL paper is to open the doors to the innovative IBM System p advanced mainframe SUPPORT 570. It introduces major hardware offerings and discusses class continuous ORGANIZATION their prominent functions.

Table of Contents