Front cover IBM Eserver OpenPower 710 Technical Overview and Introduction Finer system granulation using Micro-Partitioning technology to help lower TCO Outstanding performance based on IBM POWER5 processor technology From Web servers to integrated cluster solutions Dexter Charles Peter Jürß Redpaper...
Page 3
International Technical Support Organization IBM Sserver OpenPower 710 Technical Overview and Introduction June 2005...
IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
United States, other countries, or both. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Other company, product, and service names may be trademarks or service marks of others. IBM eServer OpenPower 710 Technical Overview and Introduction...
This Redpaper was produced by a team of specialists from around the world working at the International Technical Support Organization, Austin Center. Dexter Charles is an IBM Accredited IT Specialist with seven years in the IT industry. Dexter has worked four years as a pSeries® Specialist with Americas Techline, providing pre-sales technical support for IBM Eserver®...
IBM Germany Become a published author Join us for a two- to six-week residency program! Help write an IBM Redbook dealing with specific products or solutions, while getting hands-on experience with leading-edge technologies. You'll team with IBM technical professionals, Business Partners and/or clients.
IBM Cluster Systems Management (CSM) V1.4.1 for Linux on POWER is supported on the OpenPower 710 server. The OpenPower 710 server is backed by a three-year limited warranty. Check with your IBM representative for particular warranty availbility in your region.
Maximum thermal output 1622 BTU/hr (British Thermal Unit) 1.2 Physical package Table 1-2 lists the major physical attributes found on the OpenPower 710 server. Table 1-2 IBM eServer OpenPower 710 server physical packaging Dimension Height 89 mm (3.5 inches) Width...
Page 13
FC 7998 IBM Rack-mount Drawer Bezel FC 7999 OEM Rack-mount Drawer Bezel and Hardware The OpenPower 710 server can be installed in either IBM or OEM racks. There is only one adjustable rack-mount drawer rail kit available for both IBM and OEM racks: FC 7166 IBM/OEM Rack-mount Drawer Rail Kit It is possible to place up to 21 systems in an area of 644 mm (25.5 inches) x 1147 mm (45.2...
1.4 Minimum and optional features The IBM Eserver OpenPower 710 server is based on a flexible, modular design featuring: One-way and 2-way symmetric multiprocessor (SMP) design using one POWER5 chip packaged in a processor module soldered directly to the system planar...
Table 1-4 Advanced POWER Virtualization option Feature code Description 1965 POWER Hypervisor and Virtual I/O Server For a detailed discussion on logical partitioning and virtualization, please refer to “The POWER Hypervisor and Virtual I/O Server technologies” on page 26. 1.4.3 Memory features The minimum memory requirement for the OpenPower 710 server is 1 GB, and the maximum capacity is 32 GB.
Enterprise Resource Planning (ERP). Available solutions include: IBM Eserver OpenPower Network E-Mail Security Express Solution IBM Eserver OpenPower and IBM DB2® Universal Database for SAP Solution IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 17
SKU Identifier will be printed on the packing list and on a label (readable and barcode) on the outside of the box. Also, it will appear on invoices and billing statements. The SKU Identifier helps improve IBM distributors’ inventory management. The SKU Identifier numbers for OpenPower Express configurations are listed in Table 1-8 above.
IBM Sserver p5, OpenPower, and pSeries rack-based or rack drawer-based systems. The racks provide increased capacity, greater flexibility, and improved floor space utilization. If a IBM Sserver OpenPower system is to be installed in a non-IBM rack or cabinet, you must ensure that the rack conforms to the EIA standard EIA-310-D (see “OEM rack”...
For detailed power cord requirements and power cord feature codes, see the publication IBM Eserver Planning Information, SA38-0508. An online copy can be found at Maps of pSeries books to the information center → Planning → Printable PDFs → Planning: http://publib16.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm...
The maximum number of OpenPower 710 servers supported on a 60 amp service (PDU derated to 48 amps) is 12 per PDU. The Universal PDUs are compatible with previous IBM Eserver p5, OpenPower, and pSeries models. Figure 1-3 PDU placement and PDU view 1.6.4 Rack-mounting rules for OpenPower 710 server...
DVD-RAM disk are as follows: Up to 2.6 GB, 4.7 GB, 5.2 GB, and 9.4 GB. Flat panel display options The IBM 7316-TF3 Flat Panel Console Kit can be installed in the system rack. This 1U console uses a 15-inch thin film transistor (TFT) LCD with a viewable area of 304.1 mm x 228.1 mm and a 1024 x 768 pels...
(1.75 inches) apart on center). Rail-mounting holes must be 7.1 mm + 0.1 mm (0.28 inches + 0.004 inches) in diameter. See Figure 1-5 and Figure 1-6 for top and bottom front specification dimensions. IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 23
Figure 1-4 Top view of non-IBM rack specifications dimensions Figure 1-5 Rack specifications dimensions, top front view Figure 1-6 Rack specifications dimensions, bottom front view It might be necessary to supply additional hardware, such as fasteners, for use in some manufacturer’s racks.
Page 24
Note: The OEM rack must only support AC powered drawers. It is strongly recommended to use a power distribution unit (PDU) that meets the same specifications as IBM PDUs to supply rack power. Rack or cabinet power distribution devices(s) must meet the drawer power requirements, as well as that of any additional products that will be connected to the same power distribution device.
Either processor core can independently access each L2 controller. The L3 cache, with a capacity of 36 MB, operates as a backdoor with separate buses for reads and writes that operate at half processor speed. IBM eServer OpenPower 710 Technical Overview and Introduction...
32 cycles at most, further reducing switching power. The POWER5 chip uses this mode only when there is no ready task to run on either thread. IBM eServer OpenPower 710 Technical Overview and Introduction...
Figure 2-3 POWER5 processor core with DDR1 memory socket layout view 2.2.1 Available processor speeds At the time of writing, the IBM Sserver OpenPower 710 server operates at a processor clock rate of 1.65 GHz. 2.3 Memory subsystem The OpenPower 710 server offers pluggable DIMMs for memory. The system planar provides eight slots for up to eight pluggable DIMMs.
OEM memory, you could experience unexpected and unpredictable behavior, especially when the system is using Micro-Partitioning technology. All IBM memory is identified by an IBM logo and a white label printed with a barcode and an alphanumeric string, illustrated in Figure 2-5.
2.3.3 Memory throughput The memory subsystem throughput is based on the speed of the memory. An elastic interface, contained in the POWER5 chip, buffers reads and writes to and from memory and the processor. There are two SMIs, each with a single 8-byte read and 2-byte write DDR bus to the processor.
FC 5706 IBM 2-Port 10/100/1000 Base-TX Ethernet PCI-X Adapter. Table 2-2 provides a list of additional LAN adapters available at the time of writing. IBM supports an installation with Network Installation Manager (NIM) using Ethernet adapters (CHRP is the platform type).
2. Pull out the disk assembly a little bit from the original position. 3. Wait up to 20 seconds until the internal disk stops spinning. 4. Now you can safely remove the disk from the DASD backplane. IBM eServer OpenPower 710 Technical Overview and Introduction...
OpenPower 710 server. IBM 2104 Expandable Storage Plus The IBM 2104 Expandable Storage Plus Model DS4 is a low-cost 3U disk subsystem that supports up to 14 Ultra320 SCSI disks from 36.4 GB up to 300 GB, at the time this publication was written.
This requires an attached HMC with the proper level of software to control the system resources and an updated system firmware level to electronically isolate systems resources. Dynamic LPAR support varies by Linux distribution. IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 37
Note: Dynamic logical partitioning is supported by SUSE 9 and RHEL AS 4 or later. Changing memory attributes dynamically is not supported at the time of writing. Micro-Partitioning technology The OpenPower 710 POWER Hypervisor, when enabled, provides Micro-Partitioning virtualization technology. With Micro-Partitioning, a partition may be defined with a processor capacity as small as 10 processor units.
Page 38
The Virtual I/O Server software is only supported in Virtual I/O Server partitions. Figure 2-6 shows a view of Linux virtual partitions including the Virtual I/O Server. The figure also includes virtual SCSI and Ethernet connections and mixed operating system partitions. IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 39
Micro-Partitioning Micro-Partitioning Network Network 1 CPU 1 CPU 1 CPU 1 CPU Network Network Virtual I/O Virtual I/O Server Server Linux Linux External External storage storage Virtual Virtual Virtual Virtual SCSI SCSI Adapter Adapter Virtual Ethernet Virtual Ethernet Enabled POWER Hypervisor Enabled POWER Hypervisor Figure 2-6 Virtual partition organization view Since the Virtual I/O Server is an appliance, redundancy for physical devices attached to the...
HMC, as well as general network access. Note: It is recommended to use separate adapters for the management and the public LAN to protect access of your system’s management functions. IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 41
Each LPAR requires at least one physical processor if virtualization is not used. Based on this, the maximum number of dynamic LPARs per OpenPower 710 server is two without virtualization. With the use of the IBM Advanced POWER Virtualization, the number of partitions per processor is 10.
Page 42
For the OpenPower 710 server, additional disk space can be provided by using an external storage subsystem such as the IBM 2104 Expandable Storage Plus. For more detailed information of the available IBM disk subsystems, refer to “External disk subsystem” on page 25.
OpenPower 710 server for redundancy. For more details of the possible HMC network connections refer to Managing your server → Hardware Management Console → HMC Concepts → Types of HMC network connections at the IBM Sserver Hardware Information Center at: http://publib.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm...
POWER5 processor-based systems. To upgrade an existing POWER4 HMC: Order FC 0961 for your existing HMC. Contact your IBM Sales Representative for help. Call an IBM Service Center and order APAR MB00691. Order the CD online by selecting Version 4.4 machine code updates → Order CD →...
LVT.lvt output file. The server configuration must include the CSP FC 8453. This CSP feature code is selected on the Code tab in the IBM Configurator for e-business (eConfig) wizard. See Figure 2-8 on page 36 for a screen shot.
Note: Dynamic LPAR is not supported by Red Hat Enterprise Linux AS for POWER Version 3. Information on features and external devices supported by Linux on the OpenPower 710 server can be found at: http://www.ibm.com/servers/eserver/pseries/linux/ IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 47
Many of the features described in this document are operating system dependant and may not be available on Linux. For more information, see: http://www.ibm.com/servers/eserver/linux/power/whitepapers/linux_overview.html Note: IBM only supports the Linux systems of clients with a SupportLine contract covering Linux. Otherwise, the Linux distributor should be contacted for support. Cluster subscription offerings...
The sections below provide some additional service-related information. 2.9.1 Touch point colors Blue (IBM blue) or terra-cotta (orange) on a component indicates a touch point (for electronic parts) where you can grip the hardware to remove it from or install it into the system, open or close a latch, and so on.
Figure 2-9 OpenPower 710 server service position For more information see the documentation site: http://publib16.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm 2.9.3 Operator control panel The service processor provides an interface to the control panel, which is used to display system status and diagnostic information.
Page 50
Function 03 – Start IPL. Function 04 – Lamp test. Function 05 - Reserved. Function 06 - Reserved. Function 07 – SPCN functions. Function 08 – Fast power off. Functions 09 to 10 – Reserved. IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 51
6. Press Enter to select the firmware IPL mode and exit function 02. For more functions and information on the control panel refer to Service and support → Reference information → Service function → Control panel function at the IBM Sserver Hardware Information Center at: http://publib.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm...
When you remove the current level of firmware, you copy the firmware level that is currently installed on the permanent side from the permanent side to the temporary side. IBM eServer OpenPower 710 Technical Overview and Introduction...
Page 53
For a detailed description of firmware levels refer to the IBM Sserver Hardware Information Center → Service and support → Customer service and support → Getting fixes → Firmware (Licensed Internal Code) fixes → Concepts → Temporary and permanent side of the service processor at: http://publib.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm...
Web page: http://techsupport.services.ibm.com/server/lopdiags For a detailed description of each task go to the IBM Sserver Hardware Information Center → Service and support → Customer service and support → Getting fixes → Firmware (Licensed Internal Code) fixes → Scenarios: Firmware (Licensed Internal Code) fixes →...
Ethernet network. It can also be accessed using a terminal attached to a serial port on the server. The service processor and the ASMI are standard on all IBM Sserver i5, Sserver p5, and OpenPower servers.
Page 56
5. From the Service Utilities window, select the managed system you want to work with. 6. From the Selected menu on the Service Utilities window, select Launch ASM menu. For more detailed information about usage of ASMI please refer to the IBM Sserver Hardware Information Center.
Page 57
The remote HMC and the Web-based System Manager Remote Client allow you the flexibility to access your managed systems (including HMCs) from multiple locations using multiple HMCs. For more detailed information about usage of the HMC please refer to the IBM Sserver Hardware Information Center. http://publib.boulder.ibm.com/infocenter/eserver/v1r2s/en_US/index.htm?info/iphau/us ingsms.htm...
Page 58
HMC. The ASMI can be accessed during boot time. Use the ASMI to boot to an Open Firmware prompt. For more information on Open Firmware refer to Partitioning Implementations for IBM eServer p5 Servers, SG24-7039-02, at: http://www.redbooks.ibm.com/redpieces/abstracts/SG247039.html?Open...
Additional run-time availability actions, such as CPU vary off or L3 cache line delete, are also initiated. This RAS function is only available for a Linux operating system running the 2.6 kernel. IBM eServer OpenPower 710 Technical Overview and Introduction...
L1 and L2 caches and L2 and L3 directories on the POWER5 chip are manufactured with spare bits in their arrays that can be accessed via programmable steering logic to replace faulty bits in the respective arrays. This is analogous to the redundant bit-steering employed in main storage as a mechanism that is designed to help avoid physical repair, and is also implemented in POWER5 systems.
3.2.1 Service Agent The Service Agent is available at no additional charge. When installed on an IBM Sserver system, the Service Agent can enhance IBM's ability to provide the system with maintenance service.
Page 64
Myrinet switch—specifically SLES 8 systems, SLES 9 systems, and RHEL AS 3 systems. It can be used as a high-speed interconnect to cluster systems of IBM Eserver p5, pSeries, and OpenPower machines running Linux. Gigabit or 10/100 Ethernet connections can also be used.
Redpaper. IBM Redbooks For information on ordering these publications, see “How to get IBM Redbooks” on page 56. Note that some of the documents referenced here may be available in softcopy only. Partitioning Implementations for IBM Sserver p5 Servers, SG24-7039-02...
Information about Red Hat Enterprise Linux AS can be found at: http://www.redhat.com/software/rhel/details/ For the latest in IBM Linux news, subscribe to the Linux Line. See: https://www14.software.ibm.com/webapp/iwm/web/preLogin.do?source=linuxline Many of the features described in this document are operating system dependant and may not be available on Linux.
Back cover ® IBM Eserver OpenPower 710 Technical Overview and Introduction Redpaper Finer system This document is a comprehensive guide covering the IBM INTERNATIONAL Sserver OpenPower 710 server. We introduce major hardware granulation using TECHNICAL offerings and discuss their prominent functions.