IBM OpenPower 720 Technical Overview And Introduction
IBM OpenPower 720 Technical Overview And Introduction

IBM OpenPower 720 Technical Overview And Introduction

Linux server
Table of Contents

Advertisement

Quick Links

IBM
Technical Overview
and Introduction
Deskside and rack-mount server for
managing e-business
Outstanding performance based on
POWER5 processor technology
From Web servers to
integrated cluster solutions
ibm.com/redbooks

Front cover

OpenPower 720
Redpaper
Giuliano Anselmi
Gregor Linzmeier
Wolfgang Seiwald
Philippe Vandamme
Scott Vetter

Advertisement

Table of Contents
loading

Summary of Contents for IBM OpenPower 720

  • Page 1: Front Cover

    Front cover OpenPower 720 Technical Overview and Introduction Deskside and rack-mount server for managing e-business Outstanding performance based on POWER5 processor technology From Web servers to integrated cluster solutions Giuliano Anselmi Gregor Linzmeier Wolfgang Seiwald Philippe Vandamme Scott Vetter Redpaper...
  • Page 3 International Technical Support Organization IBM Sserver OpenPower 720 Technical Overview and Introduction October 2004...
  • Page 4 Note: Before using this information and the product it supports, read the information in “Notices” on page v. Second Edition (October 2004) This edition applies to IBM Sserver OpenPower 720. © Copyright International Business Machines Corporation 2004. All rights reserved.
  • Page 5: Table Of Contents

    1.2.1 IBM eServer OpenPower 720 deskside ....... . . 4...
  • Page 6 How to get IBM Redbooks ........
  • Page 7: Notices

    IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
  • Page 8: Trademarks

    UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, and service names may be trademarks or service marks of others. OpenPower 720 Technical Overview and Introduction...
  • Page 9: Preface

    Sales Organization in Salzburg, Austria. He holds a Diplomingenieur degree in Telematik from the Technical University of Graz. The main focus of his work for IBM in the past five years has been in the areas of the IBM Sserver pSeries systems and the IBM AIX operating system.
  • Page 10: Become A Published Author

    IBM Germany Become a published author Join us for a two- to six-week residency program! Help write an IBM Redbook dealing with specific products or solutions, while getting hands-on experience with leading-edge technologies. You'll team with IBM technical professionals, Business Partners and/or customers.
  • Page 11: Chapter 1. General Description

    64-bit addressing to meet the demands of enterprise computing, such as large database applications. Included with the OpenPower 720 are five hot-plug PCI-X slots with Enhanced Error Handling (EEH), one embedded Ultra320 SCSI dual-channel controller, one 10/100/1000 Mbps integrated dual-port Ethernet controller, two service processor communications ports, two ©...
  • Page 12 Two media bays only accept slim line media devices, such as DVD-ROM or DVD-RAM, and one half-height bay is used for a tape drive. The OpenPower 720 also has I/O expansion capability using the RIO-2 bus, which allows attachment of the 7311 Model D20 I/O drawers.
  • Page 13: System Specifications

    British Thermal Unit 1.2 Physical package The following sections discuss the major physical attributes found on an OpenPower 720 in rack-mounted and deskside versions (Figure 1-1 on page 4), as shown in Table 1-2. The OpenPower 720 is a 4U, 19-inch rack-mounted system or deskside system depending on the feature code selected.
  • Page 14: Ibm Eserver Openpower 720 Deskside

    19-inch rack, thereby enabling efficient use of computer room floor space. If the IBM 7014-T42 rack is used to mount the OpenPower 720, it is possible to place up to 10 systems in an area of 644 mm (25.5 inches) x 1147 mm (45.2 inches).
  • Page 15: Minimum And Optional Features

    Figure 1-2 Detailed views of the OpenPower 720 rack-mount system 1.3 Minimum and optional features The OpenPower 720 system is based on a flexible, modular design, and it features: Up to two processor books using the POWER5 chip, for a 1-way, 2-way, or 4-way...
  • Page 16: Processor Card Features

    2-way, and 1.65 GHz 2-way cards that share 1.9 MB of L2 on chip cache and eight slots for memory DIMMS using DDR1 technology. 36 MB of L3 cache is available on the 2-way cards. Capacity on Demand (CoD) is not available on the OpenPower 720. For a list of available cards; see Table 1-3.
  • Page 17: Disk And Media Features

    For today’s administration tasks, an internal diskette drive is not state-of-the-art. In some situations, the external USB 1.44 MB diskette drive for OpenPower 720 systems (FC 2591) is helpful. This super-slim-line and lightweight USB V2 attached diskette drive takes its power requirements from the USB port.
  • Page 18: I/O Drawers

    1.3.5 I/O drawers The OpenPower 720 has five internal PCI-X slots, where four of them are long slots and one is a short slot. If more PCI-X slots are needed, especially well-suited to extend the number of LPARs and Micro-Partitions, up to eight Model 7311 Model D20 I/O drawers can be attached to the rack-mount OpenPower system.
  • Page 19: Hardware Management Console Models

    Reserved ports Rack indicator Figure 1-3 7311-D20 I/O drawer Note: The 7311 Model D20 I/O drawer is designed to be installed by an IBM service representative. I/O drawers and usable PCI slots Only the 7311 Model D20 I/O drawer is supported on an OpenPower 720 system. Depending on the system configuration, the maximum number of I/O drawers supported is different.
  • Page 20: Express Product Offerings

    HMC software required for POWER5 processor-based systems (FC 0961). To upgrade an existing POWER4 HMC: Order FC 0961 for your existing HMC. Please contact your IBM Sales Representative for help. Call you local IBM Service Center and order APAR MB00691.
  • Page 21 SKU Identifier will be printed on the packing list and on a label (readable and barcode) on the outside of the box. Also it will appear on invoices and billing statements. The SKU Identifier helps improve IBM Distributors’ inventory management. The SKU Identifier numbers for OpenPower Express configurations are listed in Table 1-7 above.
  • Page 22: System Racks

    The OpenPower 720 uses a 4U rack-mounted server drawer. If an OpenPower 720 system is to be installed in a non-IBM rack or cabinet, you should ensure that the rack conforms to the EIA standard EIA-310-D (see 1.5.6, “OEM rack” on page 16).
  • Page 23: Ibm Rs/6000 7014 Model T42 Enterprise Rack

    For detailed power cords requirements and power cord feature codes, see the publication IBM Eserver Planning Information, SA38-0508. An online copy can be found at Maps of pSeries books to the information center → Planning → Printable PDFs → Planning: http://publib16.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm...
  • Page 24: Rack-Mounting Rules For Openpower 720

    1.5.4 Rack-mounting rules for OpenPower 720 The primary rules that should be followed when mounting the OpenPower 720 into a rack are: The system is designed to be placed at any location in the rack. For rack stability, it is advisable to start filling a rack from the bottom.
  • Page 25: Additional Options For Rack

    DVD-RAM disk are as follows: up to 2.6 GB, 4.7 GB, 5.2 GB, and 9.4 GB Flat panel display options The IBM 7316-TF3 Flat Panel Console Kit can be installed in the system rack. This 1U console uses a 15-inch thin film transistor (TFT) LCD with a viewable area of 304.1 mm x 228.1 mm and a 1024 x 768 pels...
  • Page 26: Oem Rack

    HMC to the OpenPower 720 system it controls. 1.5.6 OEM rack The OpenPower 720 can be installed in a suitable OEM rack, provided that the rack conforms to the EIA-310-D standard. This standard is published by the Electrical Industries Alliance, and a summary of this standard is available in the publication Site and Hardware Planning Information, SA38-0508.
  • Page 27 Figure 1-5 shows the drawing specifications for OEM racks. Figure 1-5 Reference drawing for OEM rack specifications Chapter 1. General description...
  • Page 28 OpenPower 720 Technical Overview and Introduction...
  • Page 29: Chapter 2. Architecture And Technical Overview

    SMI-II SMI-II SMI-II SMI-II *DDR1 memory *DDR1 memory 4-pack disk drive backplane 4-pack disk drive backplane 2 (Proc Clk):1 8 Bytes each dir Elastic Intfc Figure 2-1 OpenPower 720 logic data flow © Copyright IBM Corp. 2004. All rights reserved.
  • Page 30: The Power5 Chip

    This architecture makes the chip appear as a 4-way symmetric multiprocessor to the operating system. The POWER5 processor core has been designed to support both enhanced simultaneous multi-threading (SMT) and single threaded (ST) operation modes. OpenPower 720 Technical Overview and Introduction...
  • Page 31: Simultaneous Multi-Threading

    2.1.1 Simultaneous multi-threading As a permanent requirement for performance improvements at the application level, simultaneous multi-threading (SMT) functionality is embedded in the POWER5 chip technology. Developers are familiar with process-level parallelism (multi-tasking) and thread-level parallelism (multi-threads). SMT is the next stage of processor saturation for throughput-oriented applications to introduce the method of instruction-level parallelism to support multiple pipelines to the processor.
  • Page 32: Power Chip Evolution

    2.1.4 CMOS, copper, and SOI technology IBM Systems and The POWER5 processor design is a result of a close collaboration between Technology Group IBM Microelectronics Technologies that enables IBM Sserver OpenPower systems to give customers improved performance, reduced power OpenPower 720 Technical Overview and Introduction...
  • Page 33: Processor Cards

    Access to memory behind another processor is accomplished through the fabric buses. The OpenPower 720 supports up to two processor cards (each card is a 2-way) or a single 1-way card. Each 2-way processor card has a single DCM containing a POWER5 processor chip and a 36 MB L3 module.
  • Page 34: Available Processor Speeds

    Figure 2-5 Processor card with DDR1 memory socket layout view 2.2.1 Available processor speeds The OpenPower 720 operates with a processor clock rate of 1.65 GHz for 2 and 4-way POWER5 processor-based systems and 1.5 GHz for 1 and 2-way systems.
  • Page 35: Memory Throughput

    OEM memory, you could experience unexpected and unpredictable behavior. All IBM memory is identified by an IBM logo and a white label printed with a barcode on top and an alphanumeric string on the bottom, created according to the rule reported in Figure 2-7.
  • Page 36: System Buses

    Figure 2-7 IBM memory certification label Sometimes OEM vendors put a label reporting the IBM memory part number but not the barcode or the alphanumeric string, or both on their DIMMs. In case of system failure caused by OEM memory installed in the system, the first thing to do is to replace the suspected memory with IBM memory and check whether the problem is corrected.
  • Page 37: Pci-X Slots And Adapters

    OpenPower 720 to a local area network (LAN). See the Table 2-1 for the list of additional LAN adapters available at the time of writing. IBM supports an installation with NIM using an Ethernet adapter (CHRP is the platform type).
  • Page 38: Scsi Adapters

    Enablement Card (FC 1976) is installed (see 2.7.3, “RAID options” on page 29). The OpenPower 720 supports a split 8-pack disk drive backplane that is designed for hot-pluggable disk drives. The disk drive backplane docks directly to the system planar. The virtual SCSI Enclosure Services (VSES) hot-plug control functions are provided by the Ultra320 SCSI controllers.
  • Page 39: Internal Scsi Disks

    VXA 80/160 GB tape (LVD) 2.7.2 Internal SCSI disks The OpenPower 720 can have up to eight disk drives plugged in the two 4-pack disk drives backplanes. The two 4-pack disk drives backplanes can accommodate the devices listed in Table 2-4 on page 29.
  • Page 40: External I/O Subsystem

    OpenPower 720 system. 2.8.1 I/O drawers As described in Chapter 1, “General description” on page 1, the OpenPower 720 system has five internal PCI-X slots, which is enough for average customer configurations. If more PCI-X slots are needed to dedicate more adapters to a partition or to increase the bandwidth of network adapters, up to eight 7311 model D20 I/O drawers can be added to the OpenPower 720 system.
  • Page 41: 7311 I/O Drawer's Rio-2 Cabling

    As described in the 2.8, “External I/O subsystem” on page 30, you can connect up to four I/O drawers in the same loop and up to eight I/O drawers to the OpenPower 720 system. Each RIO-2 port can operate at 1 GHz in bidirectional mode and is capable of passing data in each direction on each cycle of the port.
  • Page 42: 7311 Model D20 I/O Drawer Spcn Cabling

    OpenPower system to SPCN port 0 on the first I/O drawer. The loop is closed connecting the SPCN port 1 of the I/O drawer back to the port 1 of the OpenPower 720 system. If you have more than one I/O drawer, you continue the loop connecting the following drawer (or drawers) with the same rule.
  • Page 43: External Disk Subsystems

    OpenPower 720 supports. IBM 2104 Expandable Storage Plus The IBM 2104 Expandable Storage Plus Model DS4 is a low-cost 3U disk subsystem that supports up to 14 Ultra320 SCSI disks from 18.2 GB up to 146.8 GB, at the time this publication was written.
  • Page 44: Advanced Openpower Virtualization

    Fibre Channel adapter (FC 1977). Model 700 provides up to 64 bootable partitions. In most cases, both the FAStT Storage server and the OpenPower 720 or the 7311 Model D20 I/O drawers are connected to a storage area network (SAN). If only space for the rootvg is needed, the FAStT Model 100 is a good solution.
  • Page 45: Virtualization

    2.9.2 Virtualization As an optional feature of the OpenPower 720, logical partitions requiring dedicated resources may now be able to take advantage of a new technology that allows resources to be virtualized, allowing for a better overall balance of global system resources and their effective utilization.
  • Page 46 It is preferred that you use the Virtual I/O server in a partition with dedicated resources to help ensure stable performance. The two major functions that are provided from the Virtual I/O Server are described in the following sections. OpenPower 720 Technical Overview and Introduction...
  • Page 47: Service Processor

    SP hardware (Figure 2-13 on page 37). The OpenPower 720 uses the SP implementation. The key components include a FSP-Base (FSP-B) and an Extender chipset (FSP-E). FSP-B and FSP-E are implemented on a dedicated card.
  • Page 48: Service Processor Base

    Two service processor communications interfaces, accessible only though the service processor communications ports of OpenPower 720 on the rear side. At the time of writing, the System Management Interface (SMI) is usable if a connection is established to service processor communications port 1.
  • Page 49 to set flags that affect the operation of the system, according to the provided password, such as auto power restart, to view information about the system (such as the error log and VPD), network environment access setup, and to control the system power. You can start and shut down the system in addition to setting IPL options.
  • Page 50: Hardware Management Console

    – When the Partition Standby power-on is completed, the operator panel on the managed system displays LPAR..., indicating the managed system is ready for you to use the HMC to partition its resources and, possibly, activate them. OpenPower 720 Technical Overview and Introduction...
  • Page 51: Definitions Of Partitions

    – When a partition is activated, the HMC requires you to select the boot mode of the single partition. System Profile The System Profile option powers on the system according to a predefined set of profiles. The profiles are activated in the order in which they are shown in the system profile. Partition autostart This option powers on the managed system to partition standby mode and then activates all partitions that have been designated autostart.
  • Page 52: Hardware Requirements For Partitioning

    The default uncapped weight is 128. 2.11.7 System Management Service Either booting up a full partition system or a logical partition to System Management Services (SMS), the ASCII interface or the GUI are identical in contents and functionality. OpenPower 720 Technical Overview and Introduction...
  • Page 53: Boot Options

    NIM server. 2.11.8 Boot options The OpenPower 720 handles the boot process in a way that is similar to other IBM UNIX servers. The initial stage of the boot process is to establish that the machine has powered up correctly and the memory and CPUs are functioning correctly.
  • Page 54: Additional Boot Options

    4-pack DASD backplane the preferred boot device. See Figure 2-15 to locate all of the disk bays. Figure 2-15 Disk bays and SCSI addresses within a OpenPower 720 When SMS menus are available, the Select Boot Options menu can be used to view and set various options regarding the installation devices and boot devices: 1.
  • Page 55: Security

    Virtual Ethernet to accomplish that. 2.11.10 Security The OpenPower 720 system allows you to set two different types of passwords to limit the access to these systems. These are defined in the ASMI menus. This password is usually general ID password used by the system administrator.
  • Page 56 For the latest in IBM Linux news, subscribe to the Linux Line. See: https://www6.software.ibm.com/reg/linux/linuxline-i Many of the features described in this document are operating system dependant and may not be available on Linux. For more information, check: http://www.ibm.com/servers/eserver/pseries/linux/whitepapers/linux_pseries.html Linux support IBM only supports the Linux systems of customers with a SupportLine contract covering Linux.
  • Page 57: Chapter 3. Ras And Manageability

    RAS and manageability Chapter 3. The following sections provide more detailed information about IBM Sserver OpenPower design features that will help lower the total cost of ownership (TCO). © Copyright IBM Corp. 2004. All rights reserved.
  • Page 58: Reliability, Availability, And Serviceability

    3.1 Reliability, availability, and serviceability Excellent quality and reliability are inherent in all aspects of the IBM Sserver OpenPower design and manufacturing. The fundamental objective of the design approach is to minimize outages. The RAS features help to ensure that the system operates when required, performs reliably, and efficiently handles any failures that might occur.
  • Page 59: Permanent Monitoring

    For more information, see “Dynamic or persistent deallocation” on page 51. 3.1.3 Permanent monitoring The SP included in the OpenPower 720 provides a means to monitor the system even when the main processor is inoperable. See the following subsections for a more detailed description of monitoring functions in an OpenPower 720.
  • Page 60: Self-Healing

    ECC logic. This function is a hardware function on the memory controller chip and does not influence normal system memory performance. 3.1.5 N+1 redundancy The use of redundant parts allows the OpenPower 720 to remain operational with full resources: Redundant spare memory bits in L1, L2, L3, and main memory...
  • Page 61: Fault Masking

    I/O adapters or devices on that bus will be deconfigured. The OpenPower 720 supports PCI Extended Error Handling (EEH) if it is supported by the PCI-X adapter. In the past, PCI bus parity errors caused a global machine check interrupt, which eventually required a system reboot in order to continue.
  • Page 62: Serviceability

    Error indication and LED indicators The OpenPower 720 is designed for customer setup of the machine and for the subsequent addition of most hardware features. The OpenPower 720 also allows customers to replace service parts (Customer Replaceable Unit). To accomplish this, the system provides internal LED diagnostics that will identify parts that require service.
  • Page 63: Manageability

    Power subsystems PCI-X adapter cards 3.2 Manageability The functions and tools provided for IBM Sserver OpenPower systems are described in the next sections. 3.2.1 Service processor With system in power standby mode, or with an operating system in control of the machine, or controlling the related partition, the SP is working and checking the system for errors, ensuring the connection to the HMC for manageability purposes.
  • Page 64: Service Agent

    Figure 3-2 Advanced System Management main menu 3.2.2 Service Agent Service Agent is an application program that operates on an OpenPower, p5, pSeries or IBM RS/6000 computer and monitors them for hardware errors. It reports detected errors, assuming they meet certain criteria for criticality, to IBM for service with no customer intervention.
  • Page 65: Openpower Customer-Managed Microcode

    The OpenPower 720 is supported with the Cluster 1600 running CSM for AIX, V1.3.1. To attach a OpenPower 720 to a Cluster 1600, an HMC is required. One HMC can also control Chapter 3. RAS and manageability...
  • Page 66 OpenPower systems that are part of the cluster. If a OpenPower 720 is configured in partition mode (with physical or virtual resources) is part of the cluster, all partitions must be part of the cluster. (Check with your IBM support representative for the availability of this feature).
  • Page 67 The base security setup is all done automatically at install time. CSM Version 1.4 on AIX and Linux (planned 4Q04) The CSM V1.4 on Linux introduces an optional IBM CSM High Availability Management Server feature, designed to allow automated failover of the CSM management server to a backup management server.
  • Page 68 OpenPower 720 Technical Overview and Introduction...
  • Page 69: Related Publications

    IBM Sserver Hardware Management Console for pSeries Installation and Operations Guide, SA38-0590, provides information to operators and system administrators on how to use a IBM Hardware Management Console for pSeries (HMC) to manage a system. It also discusses the issues associated with logical partitioning planning and implementation.
  • Page 70: Online Resources

    IBM online sales manual http://www.ibmlink.ibm.com Linux for IBM Sserver pSeries http://www.ibm.com/servers/eserver/pseries/linux/ Microcode Discovery Service http://techsupport.services.ibm.com/server/aix.invscoutMDS POWER4 system micro architecture, comprehensively described in the IBM Journal of Research and Development, Vol 46 No.1 January 2002 http://www.research.ibm.com/journal/rd46-1.html SCSI T10 Technical Committee http://www.t10.org Silicon-on-insulator (SOI) technology http://www.ibm.com/chips/technology/technologies/soi/...
  • Page 71: Help From Ibm

    Help from IBM IBM Support and downloads ibm.com/support IBM Global Services ibm.com/services Related publications...
  • Page 72 OpenPower 720 Technical Overview and Introduction...
  • Page 74 Back cover ® OpenPower 720 Technical Overview and Introduction Redpaper Deskside and This document is a comprehensive guide covering the IBM INTERNATIONAL Sserver OpenPower 720 UNIX servers. We introduce major rack-mount server for TECHNICAL hardware offerings and discuss their prominent functions.

This manual is also suitable for:

Eserver openpower 720

Table of Contents