1. Manuals
  2. Brands
  3. IBM Manuals
  4. Server
  5. PS700
  6. Technical overview and introduction

IBM BladeCenter PS700 Technical Overview And Introduction

Hide thumbs Also See for BladeCenter PS700:
Table of Contents

Advertisement

Quick Links

See also: Installer and User Manual
IBM BladeCenter PS700,
PS701, and PS702
Technical Overview and Introduction
Features the POWER7 processor providing
advanced multi-core technology
Details the follow-on to the
BladeCenter JS23 and JS43 servers
Includes product information
and features
ibm.com/redbooks

Front cover

Redpaper
David Watts
Kerry Anders
Berjis Patel

Advertisement

Table of Contents
loading

Related Manuals for IBM BladeCenter PS700

Summary of Contents for IBM BladeCenter PS700

  • Page 1: Front Cover

    Front cover IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction Features the POWER7 processor providing advanced multi-core technology Details the follow-on to the BladeCenter JS23 and JS43 servers Includes product information and features David Watts Kerry Anders Berjis Patel Redpaper ibm.com/redbooks...
  • Page 3 International Technical Support Organization IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction May 2010 REDP-4655-00...
  • Page 4 This edition applies to: IBM BladeCenter PS700, 8406-70Y IBM BladeCenter PS701, 8406-71Y IBM BladeCenter PS702, 8406-71Y + FC 8358 This document created or updated on July 6, 2012. © Copyright International Business Machines Corporation 2010. All rights reserved. Note to U.S. Government Users Restricted Rights -- Use, duplication or disclosure restricted by GSA ADP Schedule...

  • Page 5: Table Of Contents

    2.2 The IBM POWER7 processor ........
  • Page 6 2.10 External disk subsystems ..........68 2.10.1 IBM BladeCenter S Disk Storage Modules ......69 2.10.2 IBM System Storage .
  • Page 7 4.5.1 Service user interfaces ..........120 4.5.2 IBM Power Systems firmware maintenance ......122 4.5.3 Electronic Service Agent tool .
  • Page 8 IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 9: Notices

    IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.

  • Page 10: Trademarks

    IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the Web at http://www.ibm.com/legal/copytrade.shtml...

  • Page 11: Preface

    IBM BladeCenter and IBM System x® servers and associated client platforms. He has authored over 80 books, papers, and Web docs. He has worked for IBM both in the US and Australia since 1989. David is an IBM Certified IT Specialist and a member of the IT Specialist Certification Review Board.

  • Page 12: Now You Can Become A Published Author, Too

    Residencies run from two to six weeks in length, and you can participate either in person or as a remote resident working from your home base. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 13: Comments Welcome

    Find us on Facebook: http://www.facebook.com/IBMRedbooks Follow us on twitter: http://twitter.com/ibmredbooks Look for us on LinkedIn: http://www.linkedin.com/groups?home=&gid=2130806 Explore new Redbooks publications, residencies, and workshops with the IBM Redbooks weekly newsletter: https://www.redbooks.ibm.com/Redbooks.nsf/subscribe?OpenForm Stay current on recent Redbooks publications with RSS Feeds: http://www.redbooks.ibm.com/rss.html Preface...
  • Page 14 IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 15: Chapter 1. Introduction And General Description

    The POWER7 processor-based PS700, PS701, and PS702 blades support AIX, IBM i, and Linux operating systems. Their ability to coexist in the same chassis with other IBM BladeCenter blades servers enhances the ability to deliver rapid return of investment demanded by clients and businesses.

  • Page 16: Overview Of Ps700, Ps701, And Ps702 Blade Servers

    1.1 Overview of PS700, PS701, and PS702 blade servers Figure 1-1 shows the IBM BladeCenter PS700, PS701, and PS702 blade servers. Figure 1-1 The IBM BladeCenter PS702, BladeCenter PS701, and BladeCenter PS700 The PS700 blade server The PS700 Blade Server (8406-70Y) is a single socket, single wide 4-core 3.0 GHz POWER7 processor-based server.
  • Page 17 L2 cache per core and 4 MB L3 cache per core. The PS702 combines a single-wide base blade (PS701) and an expansion unit (feature 8358), referred to as double-wide blade, which occupies two adjacent slots in the IBM BladeCenter chassis. The PS702 blade server has 32 DDR3 memory DIMM slots. The industry standard VLP DDR3 memory DIMMs are either 4 GB or 8 GB running at 1066 MHz.

  • Page 18: Ibm Bladecenter Support

    BladeCenter chassis eliminates single points of failure in these areas. The following sections describe the BladeCenter chassis that support the PS700, PS701, and PS702 blades. For a comprehensive look at all aspects of BladeCenter products see the IBM Redbooks publication, IBM BladeCenter Products and Technology, SG24-7523, available from the following Web page: http://www.redbooks.ibm.com/abstracts/sg247523.html...
  • Page 19 14 for more information. BladeCenter E IBM designed the IBM BladeCenter E (machine type 8677) to be a highly modular chassis to accommodate a range of diverse business requirements. BladeCenter supports not only blade servers, but also a wide range of networking modules, including Gigabit Ethernet, Fibre Channel, and SAS for connectivity to the client’s existing network environment.
  • Page 20 BladeCenter E’s lower power consumption and Calibrated Vectored Cooling™ allow more servers to fit in a tight power or cooling environment. Figure 1-2 displays the front view of an IBM BladeCenter E. Figure 1-2 BladeCenter E front view Figure 1-3 displays the rear view of an IBM BladeCenter E.
  • Page 21 A light path diagnostic panel, and USB 2.0 port Support for UltraSlim enhanced SATA DVD-ROM and multi-burner drives IBM Systems Director and Tivoli® Provisioning Manager for OS Deployments for easy installation and management Energy-efficient design and innovative features to maximize productivity and reduce...
  • Page 22 Figure 1-4 BladeCenter H front view Figure 1-5 displays the rear view of an IBM BladeCenter H. Figure 1-5 BladeCenter H rear view The key features of IBM BladeCenter H chassis are as follows: A rack-optimized, 9 U modular design enclosure for up to 14 hot-swap blades...
  • Page 23 BladeCenter HT provides a solid foundation for next-generation networks (NGN) enabling service providers to become on demand providers. Coupled with technological expertise within the enterprise data center, IBM makes use of the industry know-how of key business partners to deliver added value within service provider networks.
  • Page 24 Figure 1-6 BladeCenter HT front view IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 25 Figure 1-7 shows the rear view of the BladeCenter HT. Figure 1-7 BladeCenter HT rear view BladeCenter HT delivers rich telecommunications features and functionality, including integrated servers, storage and networking, fault-tolerant features, optional hot swappable redundant DC or AC power supplies and cooling, and built-in system management resources. The result is a Network Equipment Building Systems (NEBS-3) and ETSI-compliant server platform optimized for next-generation networks.
  • Page 26 The IBM BladeCenter S is one of five chassis in the BladeCenter family. The BladeCenter S provides an easy IT solution to the small and medium office and to the distributed enterprise.
  • Page 27 Energy-efficient design and innovative features to maximize productivity and reduce power usage Help in protecting your IT investment through IBM BladeCenter family longevity, compatibility, and innovation leadership in blades Support for the latest generation of IBM BladeCenter blades, helping provide investment protection Chapter 1. Introduction and general description...

  • Page 28: Number Of Ps700, Ps701, And Ps702 Blades In A Chassis

    (memory, disk, expansion cards) for each supported BladeCenter chassis that can be installed with fully redundant power and without performance reduction. IBM blades that are based on processor types other than POWER7 might reduce these numbers. Table 1-3 PS700, PS701, and PS702 blades per chassis type...

  • Page 29: Physical Package

    IBM BladeCenter H Operating temperature – 10.0 to 35 °C (50 to 95 °F) at 0 to 914 m (0 to 3000 ft.) – 10.0 to 32 °C (50 to 90 °F) at 914 to 2,133 m (3000 to 7000 ft.) Relative humidity 8% to 80% Maximum altitude: 2,133 meters (7000 ft.)

  • Page 30: System Features

    1.5.9, “Disk features” on page 28 1.5.10, “Standard onboard features” on page 28 1.5.1 PS700 system features The BladeCenter PS700, model 8406-70Y, is shown in Figure 1-10 on page 17. The features of the server are as follows: Machine type and model number...
  • Page 31 POWER7 4-core Two disk drive processor bays Eight DIMMs CFFh CIOv sockets connector connector Figure 1-10 Top view of PS700 blade server Disk: – Two disk drive bays support one or two SAS HDD – Hardware mirroring RAID 0, RAID 1, and RAID 10 On-board integrated features: –...

  • Page 32: Ps701 System Features

    – 16 DIMM slots – Minimum capacity 8 GB, maximum capacity 128 GB – Industry standard VLP DDR3 DIMMs Disk – One disk drive bays supports one SAS HDD (hard disk drive). IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 33 On-board integrated features: – Service processor (SP) – Two 1 GB Ethernet ports (HEA) – SAS Controller – USB Controller which routes to the USB 2.0 port on the media tray. – 1 Serial over LAN (SOL) Console through SP Expansion Card I/O Options: –...

  • Page 34: Ps702 System Features

    32 DIMM sockets PS702 base (16 in each blade) blade PS702 expansion blade (FC 8358) Disk drive CIOv connector CFFh connector Figure 1-12 Top view of PS702 blade server IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 35: Minimum Features For The Power7 Processor-Based Blade Servers

    The features of the server are as follows: Machine type and model number 8406-71Y + FC 8358 Form factor Double-wide (60 mm) blade Processors: – Two-socket 16-core 64-bit POWER7 processor operating at a 3.0 GHz clock speed – Based on CMOS 12S 45 nm SOI (silicon-on-insulator) technology –...

  • Page 36: Power Supply Features

    Power consumption and heat load vary greatly by server configuration and use. Use the IBM Systems Energy Estimator to obtain a heat output estimate based on a specific configuration. The Estimator is available from the following Web page: http://www-912.ibm.com/see/EnergyEstimator...

  • Page 37: Memory Features

    POWER7 Intelligent Threads Technology enables workload optimization by selecting the most suitable threading mode (Single thread (per core) or Simultaneous Multi-thread 2 or 4 modes also called 2-SMT and 4-SMT). The Intelligent Threads Technology can provide improved application performance. In addition, POWER7 processors can maximize cache access to cores, improving performance, using Intelligent Cache technology POWER7 offers Intelligent Energy Management features that can dramatically and dynamically conserve power and further improve energy efficiency.

  • Page 38: I/O Features

    The QLogic 8 Gb Fibre Channel Expansion Card (CIOv) for IBM BladeCenter, feature #8242, enables high-speed access for IBM blade servers to connect to a Fibre Channel storage area network (SAN). When compared to the previous-generation 4 Gb adapters, the new adapter doubles the throughput speeds for Fibre Channel traffic.
  • Page 39 Support for Fibre Channel service (class 3) Support for switched fabric, point-to-point, and Fibre Channel Arbitrated Loop (FC-AL) connections For more information, see the IBM Redbooks at-a-glance guide at the following Web page: http://www.redbooks.ibm.com/abstracts/tips0695.html?Open Emulex 8 Gb Fibre Channel Expansion Card (CIOv) The Emulex 8 Gb Fibre Channel Expansion Card (CIOv) for IBM BladeCenter, feature #8240, enables high-performance connection to a SAN.
  • Page 40 SAS channels from the blade's onboard SAS controller to the SAS switches installed in the BladeCenter chassis. Tip: This card is also known as the SAS Connectivity Card (CIOv) for IBM BladeCenter. This card is installed into the CIOv slot of the supported blade server. It provides connections to SAS modules located in bays 3 and 4 of a supported BladeCenter chassis.
  • Page 41 Support for IPv4 and IPv6 Support for SAN boot over CEE, PXE boot, and iSCSI boot Support for Wake on LAN For more information, see the IBM Redbooks at-a-glance guide at the following Web page: http://www.redbooks.ibm.com/abstracts/tips0716.html?Open 4X InfiniBand DDR Expansion Card (CFFh)

  • Page 42: Disk Features

    CPU offload of transport operations End-to-end QoS and congestion control Hardware-based I/O virtualization TCP/UDP/IP stateless offload For more information, see the IBM Redbooks publication IBM BladeCenter Products and Technology, SG24-7523, available at the following Web page: http://www.redbooks.ibm.com/abstracts/sg247523.html?Open 1.5.9 Disk features The PS700 blade servers has two disk bays: In the first bay it can have one 2.5 inch SAS HDD...

  • Page 43: Supported Bladecenter I/O Modules

    For more information, see 2.8.1, “Server console access by SOL” on page 63. 1.6 Supported BladeCenter I/O modules With IBM BladeCenter, the switches and other I/O modules are installed in the chassis rather than as discrete devices installed in the rack.

  • Page 44: Ethernet Switch And Intelligent Pass Through Modules

    I/O switch module. However, I/O switch modules should be added in pairs to eliminate single points of failure. For the latest and most current information about blade, expansion card, switch module, and chassis compatibility and interoperability see the IBM BladeCenter Interoperability Guide at the following Web page: http://www.ibm.com/support/docview.wss?uid=psg1MIGR-5073016 1.6.1 Ethernet switch and intelligent pass through modules...

  • Page 45: Sas I/O Modules

    Part Feature Option description Number x type Network number Code of external ports layers 44W4404 1590 BNT 1/10 Gb Uplink Ethernet Switch Module 3 x 10 Gb Ethernet, Layer 2/3 6 x Gigabit Ethernet 44W4483 5452 Intelligent Copper Pass-thru Module 14 x Gigabit Ethernet 1.6.2 SAS I/O modules SAS I/O modules provide affordable storage connectivity for BladeCenter chassis using SAS...

  • Page 46: Converged Networking I/O Modules

    This card is a CFFh form factor with connections to BladeCenter H and HT I/O module bays 7 and 9. Table 1-13 shows the currently available I/O modules that are available to provide a FCoE solution. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 47: Infiniband Switch Module

    Description Number of Number Code external ports 46C7191 1639 BNT Virtual Fabric 10 Gb Switch Module for IBM BladeCenter 10 x 10 Gb SFP+ 46M6181 1641 10 Gb Ethernet Pass-Thru Module for BladeCenter 14 x 10 Gb SFP+ 46M6172 4799...

  • Page 48: Multi-Switch Interconnect Module For Bladecenter Ht

    35. The MSIM-HT has a reduced number of supported standard I/O modules compared to the MSIM. I/O module to MSIM-HT compatibility matrixes can be viewed at the following Web pages. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 49: Comparison Between Ps700, Ps701, Ps702, And 750 Models

    For the latest support information, see one of the following resources: ServerProven: http://www.ibm.com/servers/eserver/serverproven/compat/us/eserver.html BladeCenter Interoperability Guide http://www.ibm.com/support/docview.wss?uid=psg1MIGR-5073016 With PS700, PS701, and PS702 blades the QLogic Ethernet and 4 Gb FibreChannel Expansion Card (CFFh) requires a MSIM-HT in a BladeCenter HT chassis.

  • Page 50: Building To Order

    For a detailed comparison, see 2.5, “Technical comparison” on page 51. 1.8 Building to order You can perform a build to order configuration using the IBM Configurator for e-business (e-config) where you specify each configuration feature that you want on the system. You build on top of the base-required features.

  • Page 51: Chapter 2. Architecture And Technical Overview

    The topics covered are: 2.1, “Architecture” on page 38 2.2, “The IBM POWER7 processor” on page 38 2.3, “POWER7 processor-based blades” on page 46 2.4, “Memory subsystem” on page 46 2.5, “Technical comparison”...

  • Page 52: Architecture

    Figure 2-1 PS701 logical data flow 2.2 The IBM POWER7 processor The IBM POWER7 processor represents a leap forward in technology achievement and associated computing capability. The multi-core architecture of the POWER7 processor has been matched with innovation across a wide range of related technologies to deliver leading throughput, efficiency, scalability, and reliability, availability, and serviceability (RAS).

  • Page 53: Power7 Processor Overview

    IBM has been innovative to achieve required levels of throughput and bandwidth. Areas of innovation for the POWER7 processor and POWER7 processor-based systems include (but are not limited to) the following elements: On-chip L3 cache implemented in embedded dynamic random access memory (eDRAM)

  • Page 54: Power7 Processor Core

    The caches that are tightly coupled to each POWER7 processor core are as follows: Instruction cache: 32 KB Data cache: 32 KB L2 cache: 256 KB, implemented in fast SRAM IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 55: Simultaneous Multithreading

    SMT4 mode enables the POWER7 processor to maximize the throughput of the processor core by offering an increase in processor-core efficiency. SMT4 mode is the latest step in an evolution of multithreading technologies introduced by IBM. Figure 2-3 shows the evolution of simultaneous multithreading.

  • Page 56: Memory Access

    For a 6-core version, this typically means that 6 x 4 MB (24 MB) of L3 cache is available. Similarly, for a 4-core version, the L3 cache available is 16 MB. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 57: On-Chip L3 Cache Innovation And Intelligent Cache

    Figure 2-5 Outline of the POWER7 processor physical packaging 2.2.6 On-chip L3 cache innovation and intelligent cache A breakthrough in material engineering and microprocessor fabrication has enabled IBM to implement the L3 cache in eDRAM and place it on the POWER7 processor die. L3 cache is critical to a balanced design, as is the ability to provide good signalling between the L3 cache and other elements of the hierarchy such as the L2 cache or SMP interconnect.
  • Page 58 The performance of eDRAM when implemented on-chip is similar to conventional SRAM but requires far less physical space. IBM on-chip eDRAM uses only a third of the components used in conventional SRAM, which has a minimum of six transistors to implement a 1-bit memory cell.

  • Page 59: Power7 Processor And Intelligent Energy

    Intelligent energy features (such as EnergyScale™) work with the BladeCenter Advanced Management Module (AMM) and IBM Systems Director Active Energy Manager™ to optimize processor speed dynamically, based on thermal conditions and system use.

  • Page 60: Power7 Processor-Based Blades

    Note: DDR2 memory (used in POWER6 processor-based systems) is not supported in POWER7 processor-based systems. Figure 2-7 on page 47 show the PS701 physical memory DIMM topology. Figure 2-8 on page 47 shows the PS701 and PS702 base blade. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 61 P7 processor chip DIMM P1-C1 DIMM P1-C2 DIMM P1-C3 DIMM P1-C4 Buffer Buffer DIMM P1-C5 DIMM P1-C6 DIMM P1-C7 DIMM P1-C8 Figure 2-7 Memory DIMM topology for the PS700 P7 processor chip DIMM P1-C1 DIMM P1-C9 DIMM P1-C2 DIMM P1-C10 DIMM P1-C3 DIMM P1-C11 DIMM P1-C4...
  • Page 62 DIMMs installed (2, 4, 6, or 8). Table 2-4 PS700 DIMM placement rules DIMM socket: PS700 Number of DIMMs to install: P1-C1 P1-C2 P1-C3 P1-C4 P1-C5 P1-C6 P1-C7 P1-C8 IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 63 For the PS701, Table 2-5 shows the required placement of memory DIMMs depending on the number of DIMMs installed. Table 2-5 PS701 DIMM placement rules DIMM socket: PS701 Number of DIMMs to install: P1-C1 P1-C2 P1-C3 P1-C4 P1-C5 P1-C6 P1-C7 P1-C8 P1-C9 P1-C10...
  • Page 64 P1-C3 P1-C4 P1-C5 P1-C6 P1-C7 P1-C8 P1-C9 P1-C10 P1-C11 P1-C12 P1-C13 P1-C14 P1-C15 P1-C16 P2-C1 P2-C2 P2-C3 P2-C4 P2-C5 P2-C6 P2-C7 P2-C8 P2-C9 P2-C10 P2-C11 P2-C12 P2-C13 P2-C14 P2-C15 P2-C16 IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 65: Technical Comparison

    2.5 Technical comparison Table 2-7 shows a comparison of the technical aspects of the PS700, PS701, and PS702 blade compared to a Power 750 Express. Table 2-7 Comparison of technical characteristics between PS blades and the Power 750 Express Systems characteristic PS700 PS701 PS702...

  • Page 66: Internal I/O Subsystem

    PCI devices might not provide native EEH support. Expansion card form factors There are two PCIe card form factors supported on the PS700, PS701, and PS702 blades: CIOv CFFh IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 67 CIOv form factor A CIOv expansion card uses the PCI Express 2.0 x8 160 pin connector. A CIOv adapter requires compatible switch modules to be installed in bay 3 and bay 4 of the BladeCenter chassis. The CIOv card can be used in any BladeCenter that supports the PS700, PS701, and PS702 blades.
  • Page 68 P2 for the slots on the second planar. CFFh connector - P1-C20 CIOv connector - P1-C19 Figure 2-10 PS701 and PS702 base location codes for PCIe expansion cards IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 69 Figure 2-11 shows the locations of the PCIe CIOv and CFFh connectors for the PS702 expansion blade (feature code 8358) and the physical location codes. CFFh connector - P2-C20 CIOv connector - P2-C19 Figure 2-11 PS702 expansion blade location codes for PCIe expansion cards BladeCenter I/O topology There are no externally accessible ports on the PS700, PS701, and PS702 blades, All I/O is routed through a BladeCenter midplane to the I/O modules bays.
  • Page 70 I/O Bay 8 CFFh I/O Bay 9 I/O Bay 10 Legend Standard I/O bays connections High- speed I/O bays connections Bridge modules I/O bays connections Mid-Plane Figure 2-13 BladeCenter H I/O topology IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 71 Blade Server 12 Blade Serve r 1 On-Board 1GbE CIOv Expansion cards I/O Bay 7 CFFh I/O Bay 8 I/O Bay 9 Legend Standard I/O bays connections I/O Bay 10 High- speed I/O bays connections Bridge modules I/O bays connections Standard I/O bays inter-switch links High- speed I/O bays inter-switch links Mid-Plane...

  • Page 72: I/O Expansion Cards

    Fibre Channel and Ethernet. This network consolidation maintains the resiliency, efficiency, and seamlessness of the existing FC-based data center. Figure 2-16 on page 59 shows a configuration using BladeCenter FCoE components. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 73 Converged Network with 10Gb Ethernet Adapter ports Figure 2-16 FCoE connections in IBM BladeCenter For more information about FCoE, read An Introduction to Fibre Channel over Ethernet, and Fibre Channel over Convergence Enhanced Ethernet, REDP-4493, available from the following Web page: http://www.redbooks.ibm.com/abstracts/redp4493.html...

  • Page 74: Embedded Sas Controller

    For more information about InfiniBand, read HPC Clusters Using InfiniBand on IBM Power Systems Servers, SG24-7767, available from the following Web page: http://www.redbooks.ibm.com/abstracts/sg247767.html The 4X InfiniBand DDR Expansion Card is a 2 port CFFh form factor card and is only supported in a BladeCenter H chassis.

  • Page 75: Integrated Virtual Ethernet

    The BladeCenter Media Tray, depending on the BladeCenter chassis used, can contain up to two USB ports, one optical drive and system status LEDs. For information about the different media tray options available by BladeCenter model see IBM BladeCenter Products and Technology, SG24-7523 available from the following Web page: http://www.redbooks.ibm.com/abstracts/sg247523.html...

  • Page 76: Ive Subsystem

    IVE provides logical Ethernet ports that can communicate to logical partitions (LPARs) reducing the use of IBM POWER Hypervisor™. The design provides a logical connection for multiple LPARs to a physical port, allowing LPARs to access external networks through the HEA without using a Shared Ethernet Adapter (Ethernet bridge) through the Virtual I/O Server.

  • Page 77: Service Processor

    The IVE implementation on the PS700, PS701, and PS702 blades use a maximum rate of 1 Gbps and the HEA ports are integrated onto the base blades and expansion unit. The two physical ports on the PS700 and PS701 are associated to a single logical port group. The two additional physical ports on the PS702 expansion unit are associated to a second port group.
  • Page 78 Reduced cabling and without requiring a serial concentrator Standard Telnet interface, eliminating the requirement for special client software The IBM BladeCenter AMM CLI provides access to the text-console command prompt on each blade server through a SOL connection, enabling the blade servers to be managed from a remote location.

  • Page 79: Internal Storage

    For details about setting up SOL, see the BladeCenter Serial Over LAN Setup Guide, which can be found at the following Web page: http://www.ibm.com/support/docview.wss?uid=psg1MIGR-54666 This guide contains an example of how to establish a Telnet or SSH connection to the management module and then an SOL console.
  • Page 80 Switch Bay4 Bay3 Figure 2-20 PS700 SAS configuration PS701 and PS702 base SAS Controller CIOv S AS Card P1-D1 S AS Switch Switch Bay4 Bay3 Figure 2-21 PS701 SAS configuration IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 81 PS701 and PS702 base SAS Controller CIOv S AS Card P1-D1 SMP Connector PS702 expans ion unit only CIOv Card S AS P2-D1 Switch Switch Bay4 Bay3 Switch Switch B ay4 Bay3 Figure 2-22 PS702 SAS configuration Figure 2-23 show the physical locations and codes for the HDDs in the PS700 P1-D1 P1-D2 Figure 2-23 HDD location and physical location code PS700...

  • Page 82: Hardware Raid Function

    2.10 External disk subsystems This section describes the external disk subsystems, supported IBM System Storage family of products. For up-to-date compatibility information for Power blades and IBM Storage, go to the the Storage System Interoperability Center at the following link: http://ibm.com/systems/support/storage/config/ssic For N Series Storage compatibility with Power blades, go to: http://ibm.com/systems/storage/network/interophome.html...

  • Page 83: Ibm Bladecenter S Disk Storage Modules

    IBM System Storage DS3000 family The IBM System Storage DS3000 is an entry-level storage system designed to meet the availability and consolidation needs for a wide range of users. New features, including larger capacity 450 GB SAS drives, increased data protection features (such as RAID 6), and more FlashCopy®...
  • Page 84 IBM System Storage DS8700 The IBM System Storage DS8700 is the most advanced model in the IBM DS8000 lineup and introduces dual IBM POWER6 based controllers that usher in a new level of performance for the company’s flagship enterprise disk platform. The new DS8700 supports the most demanding business applications with its superior data throughput, unparalleled resiliency features and five-nines availability.

  • Page 85: Ivm

    Virtual I/O Server partition installed on the server to manage. See Table 2-9. For a complete description of the possibilities offered by IVM, see Integrated Virtualization Manager on IBM System p5, REDP-4061, available the following Web page: http://www.redbooks.ibm.com/abstracts/redp4061.html Table 2-9 Comparison of IVM and HMC...

  • Page 86: Operating System Support

    The PS700, PS701, and PS702 blades support the following operating system versions. Virtual I/O Server Virtual I/O Server 2.1.3.0 or later IBM regularly updates the Virtual I/O Server code. To find information about the latest updates, see the Virtual I/O Server at the following Web page: http://www14.software.ibm.com/webapp/set2/sas/f/vios/documentation/home.html...
  • Page 87 IBM i Virtual I/O Server is required to install IBM i in a LPAR on PS700, PS701, and PS702 blades and all I/O must be virtualized. IBM i 6.1 with i 6.1.1 machine code, or later IBM i 7.1 or later...

  • Page 88: Ibm Energyscale

    Supported virtualization features are listed in 3.3.8, “Supported PowerVM features by operating system” on page 98. 2.13 IBM EnergyScale IBM EnergyScale technology provides functions to help the user understand and dynamically optimize the processor performance versus processor power and system workload, to control IBM Power Systems power and cooling usage.
  • Page 89 Dynamic Power Saver Mode varies processor frequency and voltage based on the use of the POWER7 processors. The user must configure this setting from the BladeCenter AMM or IBM Director Active Energy Manager. Processor frequency and use are inversely proportional for most workloads, implying that as the frequency of a processor increases, its use decreases, given a constant workload.

  • Page 90: Energyscale Device

    The EnergyScale device dynamically optimizes the processor performance depending on processor power and system workload. The IBM POWER7 chip is a significant improvement in power and performance over the IBM POWER6 chip. POWER7 has more internal hardware, and power and thermal management...

  • Page 91: Chapter 3. Virtualization

    Virtualization Chapter 3. IBM Advance POWER Virtualization (PowerVM) is a feature use to consolidate workload to deliver cost savings and improve infrastructure responsiveness. As we look for ways to maximize the return on your IT infrastructure investments, consolidating workloads and increasing server use becomes an attractive proposition.

  • Page 92: Power Hypervisor

    IEEE VLAN compatible virtual switch, and virtual SCSI adapters, virtual Fibre Channel adapters, and virtual consoles. The POWER Hypervisor technology is integrated with all IBM POWER servers including the POWER7 processor-based blade servers. The hypervisor orchestrates and manages system virtualization, including creating logical partitions and dynamically moving resources across multiple operating environments.
  • Page 93 Server (VIOS). The storage virtualization is accomplished by pairing two adapters: a virtual SCSI server adapter on VIOS and a virtual SCSI client adapter on IBM i, Linux, or AIX partitions. The combination of Virtual SCSI and VIOS provides the opportunity to share physical disk adapters in a flexible and reliable manner.
  • Page 94 For more information about how virtual Fibre Channel is managed on IVM see the following Web page: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/index.jsp?topic=/arecu/ar ecukickoff.htm Figure 3-1 on page 81 depicts the connections between the client partition virtual Fibre Channel adapters and the external storage. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 95 Client Logical Client Logical Partition 2 Partition 1 Client Virtual Client Virtual Fiber Channel Fiber Channel Adapter Adapter VIRTUAL I/O SERVER Physical Fibre HYPERVISOR Channel Adapter Server Virtual Fiber Channel Adapter Server Virtual Fiber Channel Adapter Physical Disk 1 STORAGE AREA NETWORK Physical Disk 2 Figure 3-1 Connectivity between virtual Fibre Channels adapters and external SAN devices...

  • Page 96: Power Processor Modes

    Figure 3-2 shows how to choose the processor compatibility mode by editing the partition properties of a logical partition from the IVM. Figure 3-2 Configuring partition profile compatibility mode from IVM Table 3-2 on page 83 lists the differences between these modes. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 97: Powervm

    This edition is intended for evaluations, pilots, and proof of concepts, generally in single-server projects. This edition supports up to three partitions per system (VIOS, AIX, Linux, and IBM i) that share processors and I/O. It allows users to try out the Integrated Virtualization Manager (IVM) and the VIOS.
  • Page 98 Note: PowerVM Express Edition, PowerVM Standard Edition, and PowerVM Enterprise Edition are optional when running AIX or Linux. PowerVM Express Edition, PowerVM Standard Edition or PowerVM Enterprise Edition is required when running the IBM i operating system on the PS 700, PS701 and PS702 Blade Servers...

  • Page 99: Logical Partitions

    Dynamic logical partitioning LPAR was introduced with the POWER4™ processor-based product line and the IBM AIX Version 5.1 operating system. This technology offered the capability to divide a pSeries® system into multiple logical partitions, allowing each logical partition to run an operating environment on dedicated attached devices, such as processors, memory, and I/O components.
  • Page 100 This setting defines the processing mode of the logical partition. Figure 3-3 shows a diagram of the concepts discussed in the remaining sections. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 101 . The operating system (AIX, IBM i, or Linux) sees one physical processor as two or four logical processors if the simultaneous multithreading feature is on. It can be turned off and on dynamically as the operating system is executing (for AIX, use the smtctl command, and for Linux, use the ppc64_cpu command).

  • Page 102: Vios

    The VIOS supports OpenSSH for secure remote logins. It also provides a firewall for limiting access by ports, network services, and IP addresses. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 103 Figure 3-5 shows an overview of a VIOS configuration. Virtual I/O Server Virtual I/O Client 1 Hypervisor Shared Ethernet External Virtual Ethernet Adapter Network Adapter Virtual SCSI Physical Virtual Ethernet Adapter Ethernet Adapter Adapter Physical Disk Virtual I/O Client 2 Physical Disk Virtual SCSI Adapter...
  • Page 104 Note: An SEA does not need to have an IP address configured to perform the Ethernet bridging functionality. Configuring an IP address is required to access the IVM. For a more detailed discussion about virtual networking, see the following Web page: http://www.ibm.com/servers/aix/whitepapers/aix_vn.pdf IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 105 As discussed earlier Virtual SCSI is provided by the POWER Hypervisor and allows secure communication between Client partition (AIX, Linux, or IBM i) and the VIOS. The VIOS logical partition owns the physical resources and acts as server or, in SCSI terms, target device. The client logical partitions access the virtual SCSI backing storage devices provided by the VIOS as clients.

  • Page 106: Powervm Lx86

    Director Family is a suite of products consisting of a no-charge base and for-a-fee extensions. Software support is optionally available for a fee. Using IBM Systems Director and IVM, Power Systems clients can perform basic monitoring and management of their virtualized and non-virtualized environments from a single console view.

  • Page 107: Powervm Live Partition Mobility

    PowerVM Enterprise Edition. More information about PowerVM Lx86 can be found at the following Web page: http://www.ibm.com/systems/power/software/virtualization/editions/lx86/ Note: IBM plans for PowerVM Lx86 to support POWER7 systems in second quarter 2010. 3.3.5 PowerVM Live Partition Mobility PowerVM Live Partition Mobility allows you to move a running logical partition, including its operating system and running applications, from one system to another without disrupting the infrastructure services.The migration operation takes just a few seconds and maintains...
  • Page 108 Mobility” Web page offers presentations of the supported migrations: http://publib.boulder.ibm.com/infocenter/powersys/v3r1m5/topic/p7hc3/iphc3pcmco mbosact.htm For more information about Live Partition Mobility and how to implement it, see IBM PowerVM Live Partition Mobility, SG24-7460, available from the following Web page: http://www.redbooks.ibm.com/abstracts/sg247460.html IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 109: Active Memory Sharing

    IBM Power Systems, allowing multiple partitions to share a common pool of physical memory. The physical memory of an IBM POWER6 or POWER7 System can be assigned to multiple partitions either in a dedicated or in a shared mode. The system administrator has the capability to assign physical memory to a partition and physical memory to a pool that is shared by other partitions.

  • Page 110: N_Port Id Virtualization (Npiv)

    System requirements for Active Memory Sharing To use the Active Memory Sharing feature of IBM PowerVM, the following minimum system requirements for Power7 processor based blade servers must be met: Enterprise PowerVM Edition activation Virtual I/O Server Version 2.1.3 IBM i 6.1.1 and IBM 7.1 AIX 6.1 TL 4...
  • Page 111 Requires Firmware level 7.10.1.4 or later d. Requires the latest firmware on the Emulex CIOv adapter Table 3-6 shows NPIV compatibility matrix for IBM i clients with feature codes Table 3-6 NPIV Compatibility Matrix for IBM i Client Expansion Card on the blade servers...

  • Page 112: Supported Powervm Features By Operating System

    IBM PowerVM Virtualization Managing and Monitoring, SG24-7590 http://www.redbooks.ibm.com/abstracts/sg247590.html NPIV is supported in PowerVM Express, Standard, and Enterprise Editions on the IBM POWER7 processor-based systems. 3.3.8 Supported PowerVM features by operating system Table 3-7 summarizes the PowerVM features that are supported by the operating systems and that are compatible with the POWER7 processor-based blade servers.

  • Page 113: Chapter 4. Continuous Availability And Manageability

    This chapter provides information about IBM reliability, availability, and serviceability (RAS) design and features. This set of technologies, implemented on IBM Power Systems servers, provides the possibility to improve your architecture’s total cost of ownership (TCO) by reducing unplanned down time.

  • Page 114: Introduction

    This chapter includes a manageability section describing the means to successfully manage your systems. Several software-based availability features exist that are based on the benefits available when using AIX and IBM i as the operating system. Support of these features when using Linux varies. 4.2 Reliability Highly reliable systems are built with highly reliable components.

  • Page 115: Designed For Reliability

    PDU to independent power sources. 4.3 Availability The IBM hardware and microcode ability to monitor execution of hardware functions is generally described as the process of first-failure data capture (FFDC). This process includes predictive failure analysis. Predictive failure analysis refers to the ability to track intermittent correctable errors and to vary components off-line before they reach the point of hard failure (causing a system outage) and without the need to recreate the problem.

  • Page 116: Partition Availability Priority

    Note: POWER7 processor-based servers are independent of the operating system for error detection and fault isolation within the central electronics complex. Throughout this chapter, we describe IBM POWER technology’s capabilities that are focused on keeping a system environment up and running. For a specific set of functions that are focused on detecting errors before they become serious enough to stop computing work, see 4.4.1, “Detecting”...

  • Page 117: General Detection And Deallocation Of Failing Components

    POWER7 processor automatically retries the instruction. If the source of the error was truly transient, the instruction succeeds and the system continues as before. On IBM systems prior to POWER6, this error would have caused a checkstop. Alternate processor retry Hard failures are more difficult, being permanent errors that are replicated each time the instruction is repeated.

  • Page 118: Memory Protection

    64-byte ECC code This innovative ECC algorithm from IBM research allows a full 8-bit device kill to be corrected dynamically. This ECC code mechanism works across DIMM pairs on a rank basis. (Depending on the size, a DIMM might have one, two, or four ranks.) With this ECC code, an entirely bad DRAM chip can be marked as bad (chip mark).
  • Page 119 The bus transferring data between the processor and the memory uses CRC error detection with a failed operation retry mechanism and the ability to retune bus parameters dynamically when a fault occurs. In addition, the memory bus has spare capacity to substitute a spare data bit-line that is determined to be faulty.
  • Page 120 IBM AIX and the IBM i operating systems, as well as for memory pages owned by the POWER Hypervisor. If a memory address experiences an uncorrectable or repeated correctable single cell error, the service processor sends the memory page address to the POWER Hypervisor to be marked for deallocation.

  • Page 121: Cache Protection

    If an uncorrectable error in memory is discovered, the logical memory block that is associated with the address with the uncorrectable error is marked for deallocation by the POWER Hypervisor. This deallocation takes effect on a partition reboot if the logical memory block is assigned to an active partition at the time of the fault.

  • Page 122: Special Uncorrectable Error Handling

    4.3.5 Special uncorrectable error handling Although rare, an uncorrectable data error can occur in memory or a cache. IBM POWER processor-based systems attempt to limit, to the least possible disruption, the impact of an uncorrectable error using a well-defined strategy that first considers the data source.

  • Page 123: Serviceability

    IBM Systems offerings. Serviceability includes system installation, system upgrades and downgrades (MES), and system maintenance and repair. The goal of the IBM Serviceability Team is to design and provide the most efficient system service environment. Such an environment includes the...

  • Page 124: Detecting

    Hypervisor firmware has lost control. Likewise, the POWER Hypervisor can request a service processor repair action if necessary. Availability The auto-restart (reboot) option, when enabled by the BladeCenter AMM, can reboot the system automatically following AC power failure. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 125 Error checking hardware ranges from parity error detection coupled with processor instruction retry and bus retry, to ECC correction on caches and system buses. All IBM hardware error checkers have distinct attributes: Continual monitoring of system operations to detect potential calculation errors.

  • Page 126: Diagnosing

    4.4.2 Diagnosing Using the extensive network of advanced and complementary error detection logic built directly into hardware, firmware, and operating systems, the IBM Power Systems servers can perform considerable self-diagnosis. Boot time When an IBM Power Systems server powers up, the service processor initializes system hardware.

  • Page 127: Reporting

    In the unlikely event that a system hardware or environmentally induced failure is diagnosed, IBM Power Systems servers report the error through a number of mechanisms. The analysis result is stored in system NVRAM. Error log analysis (ELA) can be used to display the failure cause and the physical location of the failing hardware.
  • Page 128 IBM Service organization. Customer contact information and specific system-related data (such as the machine type, model, and serial number), along with error log data related to the failure, is sent to IBM Service. Error logging and analysis...
  • Page 129 The data is formatted and prepared for transmission back to IBM to assist with preparing a service action plan for the service representative or for additional analysis.

  • Page 130: Notifying The Client

    When an event is important enough to report, but does not indicate the need for a repair action or the need to call IBM service and support, it is classified as Client Notify. Clients are notified because these events might be of interest to an administrator. The event might be a symptom of an expected systemic change, such as a network reconfiguration or failover testing of redundant power or cooling systems.

  • Page 131: Locating And Servicing Parts Requiring Service

    (Those that require the system to be turned off for removal or repair.) Tool-less design Selected IBM systems support tool-less or simple tool designs. These designs require no tools or simple tools such as flathead screwdrivers to service the hardware components.
  • Page 132 LEDs, and can also guide the servicer directly to the component by signaling (turning on solid) the system fault LED, enclosure fault LED, and the component FRU fault LED. After the repair, the LEDs shut off if the problem is fixed. IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 133 Service labels Service providers use these labels to assist them in performing maintenance actions. Service labels are found in various formats and positions, and are intended to transmit readily available information to the servicer during the repair process. The following list details several of these service labels and the purpose of each: Location diagrams are strategically located on the system hardware, relating information regarding the placement of hardware components.

  • Page 134: Manageability

    Firmware updates for the AMM, I/O modules, and blades can be obtained from the IBM Fix Central web page: http://www.ibm.com/support/fixcentral/ Repair and verify system Repair and verify (R&V) is a system used to guide a service provider through the process of repairing a system and verifying that the problem has been repaired.
  • Page 135 Service processor The service processor is a controller running its own operating system. It is a component on the blade planar. The service processor operating system has specific programs and device drivers for the service processor hardware. The host interface is a processor support interface connected to the POWER processor.

  • Page 136: Ibm Power Systems Firmware Maintenance

    AMM. 4.5.2 IBM Power Systems firmware maintenance The IBM Power Systems Client-Managed Microcode is a methodology that enables you to manage and install microcode updates on Power Systems and associated I/O adapters. The system firmware consists of service processor microcode, Open Firmware microcode, SPCN microcode, and the POWER Hypervisor.
  • Page 137 The current running level and boot side (A or B) of the firmware can be displayed from the AMM. The running, temporary, and permanent firmware version levels can be obtained by used of the lsfware command on the VIOS. Each IBM Power Systems server has the following levels of server firmware and power subsystem firmware: Installed level This is the level of server firmware or power subsystem firmware that has been installed and is installed into memory after the managed system is powered off and powered on.

  • Page 138: Electronic Service Agent Tool

    IBM support on a user-definable time table. The tool is available on VIOS, AIX, IBM i, and Linux operating systems. This tool tracks and captures service information, hardware error logs, and performance information. It automatically reports hardware error information to IBM support as long as the system is under an IBM maintenance agreement or within the IBM warranty period.

  • Page 139: Bladecenter Service Advisor

    AMM. After being configured and activated, a service event on the BladeCenter chassis can be reported to IBM Service & Support, or to a FTP/TFTP server, or to both. IBM BladeCenter Service Advisor is built from the IBM Electronic Service Agent offering.
  • Page 140 After gathering the information, the service advisor automatically initiates a call to IBM. Upon receipt of the information, IBM returns a service request ID, which is placed in the call home activity log. Figure 4-8 shows BladeCenter Service Advisor enabled to send alerts to both IBM Support and a FTP/TFTP server.
  • Page 141 On the Event Log page of the advanced management module Web interface, you can select the Display Call Home Flag checkbox. If you select the checkbox, events are marked with a C for call home events and an N for events that are not called home. In addition, you can filter the event log view based on this setting.
  • Page 142 IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 143: Abbreviations And Acronyms

    Lightweight Directory Access error log analysis Protocol Electronic Service Agent light emitting diode ETSI European Telecommunications Logical Memory Block Standard Industry LPAR logical partitions Fibre Channel Live Partition Mobility FC-AL Fibre Channel-arbitrated loop © Copyright IBM Corp. 2010. All rights reserved.
  • Page 144 Serial Attached SCSI SATA Serial ATA Supply Chain Management SCSI Small Computer System Interface Shared Ethernet Adapter soft error small form-factor pluggable Segment Lookaside Buffer SLES SUSE Linux Enterprise Server symmetric multiprocessing IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...

  • Page 145: Related Publications

    Integrated Virtualization Manager on IBM System p5, REDP-4061 PowerVM Migration from Physical to Virtual Storage, SG24-7825 PowerVM Virtualization Active Memory Sharing, REDP-4470 PowerVM Virtualization on IBM System p: Introduction and Configuration Fourth Edition, SG24-7940 Other publications These publications are also relevant as further information sources, available from http://http://ibm.com/systems/support...

  • Page 146: Online Resources

    You can search for, view, or download Redbooks, Redpapers, Technotes, draft publications and Additional materials, as well as order hardcopy Redbooks publications, at this Web site: ibm.com/redbooks Help from IBM IBM Support and downloads ibm.com/support IBM Global Services ibm.com/services IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction...
  • Page 148 IBM BladeCenter PS700, PS701, and PS702 Technical Overview and Introduction Redpaper ™ Features the POWER7 The IBM BladeCenter PS700, PS701, and PS702 are premier blades for INTERNATIONAL 64-bit applications. They are designed to minimize complexity, processor providing TECHNICAL improve efficiency, automate processes, reduce energy consumption,...

This manual is also suitable for:

Bladecenter ps701Bladecenter ps702

Table of Contents