Download Print this page

IBM eServer i5 Manual

Iseries, myseries
Hide thumbs Also See for eServer i5:

Advertisement

Quick Links

iSeries. mySeries.
Common Europe Luxembourg
Introducing IBM eServer i5 & i5/OS
LPAR i5 "Up-to-Date" :
Logical Partitions on the IBM Power5
by Eddy PASTEGER
iSeries. mySeries.
1
2

Advertisement

loading

Summary of Contents for IBM eServer i5

  • Page 1 Common Europe Luxembourg Introducing IBM eServer i5 & i5/OS LPAR i5 “Up-to-Date” : Logical Partitions on the IBM Power5 by Eddy PASTEGER iSeries. mySeries.
  • Page 2 Logical Partitions on the IBM Power5 Introduction iSeries. mySeries. Introduction Objectives Understand the LPAR functionality as implemented on the IBM Power5 servers Understand planning considerations and system requirements Warning This presentation is built on functionalities available on i5 models 5xx running i5/OS V5R3 iSeries. mySeries.
  • Page 3 Logical Partitioning on the IBM Power5 Agenda Chapter 1. Architecture Chapter 2. Resources Management Concepts Chapter 3. LPAR-Capable i5 Models Chapter 4. Planning Chapter 5. Hardware Management Console Chapter 6. Virtual Partition Manager iSeries. mySeries. iSeries. mySeries. Logical Partitions on the IBM Power5 Architecture iSeries.
  • Page 4 Processor Complex Storage Subsystem NVRAM Permanent Temporary The Service Processor Standard built-in, independent component of every eServer i5 or p5 Own processor, memory and boot code NVRAM stores the “firmware” and the LPAR configuration iSeries. mySeries. Architecture Service Processor Main...
  • Page 5 Previously part of the System Licensed Internal Code (SLIC) Known as “Partition Licensed Internal Code (PLIC)” PLIC is enhanced to be used with the eServer i5 hardware Power Hypervisor is independent from any operating system There is no longer the concept of a “Primary Partition”...
  • Page 6 SLIC Power Hypervisor Hardware Starting an i5/OS partition Hypervisor will operates a “virtual service processor” to load and start SLIC SLIC is changed to interface with the new Power Hypervisor TIMI and all the layers above are still in place...
  • Page 7 Architecture i5/OS Linux TIMI Open Open Firmware Firmware SLIC RTAS RTAS Power Hypervisor Hardware Starting a LINUX or AIX partition Hypervisor will operates ... Open Firmware contains boot-time drivers and the boot manager RTAS is a service that passes platform-dependent system calls to the Hypervisor Other is characteristic to the guest operating system E.g.
  • Page 8 Logical Partitions on the IBM Power5 Resources Management Concepts iSeries. mySeries. Resources Management Concepts What is “logical partitioning” ? The ability to make a single server run as if it were many independent systems Each logical system is called a “Partition”...
  • Page 9 Logical Partitions on the IBM Power5 Resources Management Concepts Processor iSeries. mySeries. Resources Management Concepts Processor Concepts Dedicated vs. Shared Processors Virtual Processors Capped vs. Uncapped Processors Considerations about LPAR and SMT iSeries. mySeries.
  • Page 10 Processor Concepts Processor Concepts Dedicated Shared Inactive Physical Processors iSeries. mySeries. Processor Concepts Dedicated Processors A “dedicated processor” refers to a whole processor that is dedicated to a single partition One or more processors can be dedicated to a partition The most simple way to distribute processors among logical partitions Rules &...
  • Page 11 Processor Concepts Shared Processors A “shared processor” allows to assign partial processors to a partition Physical processors lives in a “shared processor pool” By default, any unassigned processor is a member of the shared processor pool iSeries. mySeries. Processor Concepts Shared Processors 10 milliseconds 20 milliseconds of...
  • Page 12 Processor Concepts Shared Processors 10 milliseconds 20 milliseconds of processor time iSeries. mySeries. Processor Concepts Shared Processors Rules & requirements : A processing unit (PU) represents the cycles of a single processor At least 0.10 PU (1 millisecond) Granularity of movements : 0.01 PU Processor moves are dynamic, without any IPL within the configured ranges Unallocated PU are not used iSeries.
  • Page 13 Processor Concepts Potential Shared Processors Penalty Increase the possibility that job’s won’t complete, and : Have to be re-dispatched, and potentially have to reload cache Increase the chance of a cache miss Reduce the chance for processor/memory affinity Increase the Power Hypervisor work : Tracking each partition use of its allocated milliseconds iSeries.
  • Page 14 Processor Concepts Virtual Processors 10 milliseconds 20 milliseconds of processor time iSeries. mySeries. Processor Concepts Virtual Processors 10 milliseconds 20 milliseconds of processor time iSeries. mySeries.
  • Page 15 Processor Concepts Virtual Processors Rules & requirements : It is possible to allocate more virtual processors than there are in the shared processor pool The actual number of processor in the shared processor pool is a “floating” number A single physical processor can report in the system as a n-ways You cannot allocate less than 0.10 PU per virtual processor Example : requesting 0.20 PU to run on 4 VCPU means 0.20 / 4 = 0.05 <...
  • Page 16 Shared uncapped will allow use of excess capacity of the processor, but ... Setting virtual processor number too low will limit uncapped usage Setting virtual processor number too high will degrade performance What does IBM recommends ? It depends ... What do I recommend ? Keep things simple ! iSeries.
  • Page 17 Hypervisor only deals with physical processors Each operating system can use the physical processor as its needs SMT can be used or not ... according partition’s operating system configuration For i5/OS, refer to system value QPRCMLTTSK iSeries. mySeries. iSeries. mySeries.
  • Page 18 Main Storage Concepts Memory Allocation Facts Power4 Hypervisor allowed memory manipulation at the single megabyte (1MB) level Memory in the Power5 machines cannot be manipulated that finely : Memory must be assigned or moved in blocks Theses blocks are called “Logical Memory Blocks (LMB)” or “Memory Regions” About those “Memory Regions”...
  • Page 19 Main Storage Concepts Memory Allocation Facts A “Hardware Page Table (HPT)” is needed to manage memory Power4 Hypervisor reserved HPT within partition memory Power5 Hypervisor allocates HPT separately from partition memory Size of the HPT depends of the maximum memory amount the partition can receive Basic calculation : maximum memory divided by 64, rounded up to next power of 2 A partition can allocates a maximum of 12 GB (12288 MB) HPT size will be 12288 / 64 = 192 ...
  • Page 20 But there is no guarantee that the best configuration can be maintained A full system restart (hypervisor) may be needed to return system in its optimal configuration ! iSeries. mySeries. iSeries. mySeries. Logical Partitions on the IBM Power5 Resources Management Concepts I/O Subsystem iSeries. mySeries.
  • Page 21 I/O Concepts I/O Facts I/O allocations are done at slot level A single slot can be allocated I/O structure must be understood for proper configuration ! iSeries. mySeries. I/O Concepts Hierarchy of Microprocessors Main Power5 Storage System Main Storage Bus HSL Loop iSeries.
  • Page 22 I/O Concepts Hierarchy of Microprocessors HSL Loop PCI-X Bus Bridge iSeries. mySeries. I/O Concepts I/O Facts I/O allocations are done at slot level A single slot can be allocated BUS/IOP/IOA requirements must be met ! Allocate a slot as “desired” If the resource is available at allocation, then grab it Otherwise continue to activate anyway Allocate a slot as “required”...
  • Page 23 I/O Concepts IOP-Less IOAs iSeries. mySeries. I/O Concepts I/O Facts Once allocated, some I/O resources needs to be identified Load-Source Unit resource Tells the hypervisor which IOA drives the LSU This is mandatory Alternate-IPL resource Tells the hypervisor which IOA drives the alternate IPL device This is optional Console resource Tells the hypervisor which IOA drives the console resource...
  • Page 24 Logical Partitions on the IBM Power5 Resources Management Concepts Virtual I/O iSeries. mySeries. Virtual I/O Concepts Virtual I/O Facts Each partition has virtual I/O slots The number of slots is configurable The more virtual slots you configure, the more the hypervisor will need memory !
  • Page 25 Virtual I/O Concepts Partition Virtual Bus Virtual Slot Virtual Slot Virtual Slot Virtual Slot Virtual Virtual Virtual Virtual Virtual Virtual Virtual Serial Ethernet SCSI Power Hypervisor iSeries. mySeries. Virtual I/O Concepts Virtual I/O Facts What is dynamic As for physical I/O adapters, virtual I/O adapters can be dynamically added, changed or removed Unlike physical I/O slots, virtual I/O slots cannot be moved from one partition to another What is not dynamic Changing the number of slots requires a partition deactivation and reactivation...
  • Page 26 A virtual network cannot be “tapped” or “sniffed” Parameters Slot number Network number : up to 4096 virtual networks ! Who can participate to a Virtual LAN ? Any i5/OS partition Any Linux partition Any AIX 5L v5.3 partition iSeries. mySeries.
  • Page 27: Virtual Ethernet

    Selected remote partition Connection information for the client : where to connect ... Which partition Which slot Who can be SCSI server ? Any i5/OS partition Who can be SCSI client Any Linux partition Any AIX 5L v5.3 partition iSeries. mySeries.
  • Page 28 Virtual I/O Concepts Virtual SCSI SCSI SCSI Power Hypervisor Server Client iSeries. mySeries. Virtual I/O Concepts Virtual OptiConnect What is OptiConnect ? Stands for OPTImized CONNECTion Provides very high performance communications between systems Works at HSL bus speed : 2 GB/s (20 Gbps) ! Also known as “HSL OptiConnect”...
  • Page 29 Logical Partitions on the IBM Power5 Dynamic LPAR ! iSeries. mySeries. Dynamic LPAR What is called “Dynamic Logical Partitioning” The ability to add, move or remove resources without system disruption iSeries. mySeries.
  • Page 30 Dynamic LPAR What can be changed dynamically ! Processors Within established minimum and maximum Configuration maintained in the partition profile Changes to minimum or maximum requires partition deactivation an reactivation Granularity of moves Dedicated processors : 1 processor Shared processors : 0.01 processing unit (PU) per virtual processor ! Virtual processors : 1 virtual processor A processor move implies : Deallocation of processor or processor time...
  • Page 31 What can be changed dynamically ! I/O Slots Only “desired” slots can be moved ! Remember i5/OS still needs IOPs An IOP without IOA is functional but not very useful An IOA without IOP is nothing BUS/IOP/IOA requirements must be kept ! Remember “IOP-less”...
  • Page 32 Changes to the desired/required status of a slot requires partition deactivation an reactivation Changes to the number of virtual slots requires partition deactivation and reactivation Granularity of moves One slot iSeries. mySeries. iSeries. mySeries. Logical Partitions on the IBM Power5 LPAR-Capable Server Models iSeries. mySeries.
  • Page 33 Processing units available : 2.00 Maximum partitions : 20 iSeries. mySeries. IBM eServer i5/550 Model i5/550 - CoD from 3300 to 12000 CPW Minimal Configuration Processor : 2-Ways Power5, 1.65GHz, L1+L2+L3 Cache ! one i5/OS license ! Processing units available : 2.0...
  • Page 34 IBM eServer i5/570 Model i5/570 - CoD from 3300 to 44700 CPW Minimal Configuration Processor : 1-Ways Power5, 1.65GHz, L1+L2+L3 Cache Processing units available : 1.0 Maximum partitions : 10 Maximal Configuration Processor : 16-Ways Power5, 1.65GHz, L1+L2+L3 Cache Processing units available : 16.0 Maximum partitions : 160 iSeries.
  • Page 35 Logical Partitions on the IBM Power5 Planning iSeries. mySeries. Planning Think ... Understand eServer i5 capabilities Review previous chapters ... System Builder ! Understand Operating System requirements i5/OS Linux iSeries. mySeries.
  • Page 36 Commonly represents +/- 330 CPW At least 256 MB of main storage Just enough to load and start SLIC & i5/OS ... plan a few bit more to open a session ! One direct-attach (internal) disk unit (LSU) Minimum size : 8.58 GB...
  • Page 37 Workload composed by CPU and I/O operations rPerf Relative Performance Derived from multiple “standard” benchmarks TPC : Technical Publication Center SPEC : System Performance Evaluation Center Other IBM internal workloads Does not simulate I/O operations iSeries. mySeries. Planning About Linux and AIX ... eServer model...
  • Page 38 Planning Requirements for Linux/AIX 5L v5.3 Are mandatory : At least 0.10 processing unit Some memory ... depending on the applications you’ll have to run ! One disk unit ... Physical or ... virtual ! One console Can be a HMC thru virtual serial port One alternate boot device CD or DVD ...
  • Page 39 Planning Requirements for AIX 5L v5.2 REMEMBER : this version of AIX does NOT SUPPORT “virtual things” ! Virtual processors cannot be used ... Memory cannot be dynamically assigned ... No virtual networks, nor virtual storage can be used Virtual console can be used ! Are mandatory : At least 1 dedicated processor Some memory ...
  • Page 40 At this time, Linux/AIX partitions does not handle any IOA with an IOP placed in an upstream position on the same bus ! This means that you cannot share a bus between a Linux/AIX partition and an i5/OS partition This means that you cannot switch a device between a Linux/AIX partition and an i5/OS partition...
  • Page 41 Determine which component may/will be reused Build a new system Validate the new system Use LPAR Validater Tool Call IBM or a Business Partner Consider to upgrade existing system to supported OS version/release Consider EVERY partition ! Upgrades to i5/OS V5R3 ...
  • Page 42 Start or reload If disk were moved ... just start ! Else ... just reload ! Validate your new system ... and ... enjoy it ! iSeries. mySeries. iSeries. mySeries. Logical Partitions on the IBM Power5 Hardware Management Console iSeries. mySeries.
  • Page 43: Hardware Management Console

    LAN : 2x 1000/100/10 Mbps ethernet DVD-RAM : 1x FDD : 1x “Cleaned” Linux with HMC application (GUI) Connects to i5 and p5 servers Using dedicated HMC ports Up to 64 partitions on 16 servers Packaging Desktop version : 7310-C03 Rack version : 7310-CR3 iSeries.
  • Page 44 Logical Partitions on the IBM Power5 Hardware Management Console Connecting HMC iSeries. mySeries. Hardware Management Console Service & Support HMC1 HMC2 LAN1 LAN2 ETH0 ETH1 Ethernet Ports Private LAN Open LAN Auto-MDIX ports Medium Dependent Interface Crossover iSeries. mySeries.
  • Page 45 Hardware Management Console Service & Support HMC1 HMC2 LAN1 LAN2 ETH0 ETH1 Simple HMC connection iSeries. mySeries. Hardware Management Console Service & ETH0 ETH1 Support HMC1 HMC2 LAN1 LAN2 ETH0 ETH1 Cloning HMC configuration System profiles and partition profiles are stored in SP’s NVRAM When SP detects that a redundant HMC is connected : SP copies NVRAM configuration to the new HMC iSeries.
  • Page 46 Hardware Management Console Redundant HMC configuration considerations Both HMCs can be used concurrently Both are fully active and accessible at all times Both enabling you to perform management tasks at any time SP provides a lock-mechanism to allow operations in a parallel environment When one HMC issues an order, the other HMC is temporarily “locked-out”...
  • Page 47 Hardware Management Console Private indirect networking Service Service & & ETH0 ETH1 Support Support HMC1 HMC1 HMC2 HMC2 LAN1 LAN1 LAN2 LAN2 ETH0 ETH0 ETH1 ETH1 HMC1 HMC2 LAN1 LAN2 Private LAN iSeries. mySeries. Hardware Management Console Private and open networking Service Service &...
  • Page 48 Hardware Management Console Working with HMC in open networks Internet iSeries. mySeries. iSeries. mySeries. Logical Partitions on the IBM Power5 Hardware Management Console HMC Functionalities iSeries. mySeries.
  • Page 49 System profiles iSeries. mySeries. Hardware Management Console HMC Code Update Gets and install HMC version, releases and hot fixes Via removable media, local FTP server or internet (IBM service FTP server) Backups Critical console data vs. upgrade data iSeries. mySeries.
  • Page 50 Licensed Internal Code Updates Manages managed systems’ firmware Installed (Temporary), activated and Accepted (Permanent) iSeries. mySeries. Hardware Management Console HMC Users Define users Define roles iSeries. mySeries.
  • Page 51 Hardware Management Console HMC Configuration All HMC parameters Date, time, network, ... iSeries. mySeries. Hardware Management Console Service Agent Configuration Notify problems Kind of problems : “all” or “home-call” To the user : via SMTP To the service : via PSTN, VPN or another HMC iSeries.
  • Page 52 Hardware Management Console Remote Support Connectivity : outbound and inbound Via SMTP or VPN iSeries. mySeries. Hardware Management Console Service Focal Point Manage reported events and errors Concurrent maintenance Service utilities Access to control panel service functions (e.g. Function 21 - Request DST) iSeries.
  • Page 53 One more thing ... iSeries. mySeries. iSeries. mySeries. Logical Partitions on the IBM Power5 Virtual Partition Manager iSeries. mySeries.
  • Page 54 Minimum level is SF230_113, via PTF MH00265 Maximum 4 Linux partitions I/O for all linux partition must be managed by a single i5/OS instance Only a single i5/OS instance can exist Linux must use virtual I/O to access disk, tape, DVD, ethernet...
  • Page 55 Virtual Partition Manager Planning for VPM ... Automatic processor balancing between i5/OS and Linux partition is supported Thru uncapped shared processor Dynamic movements of resources (processor, memory and I/O) is not supported Partition must be restarted for the changes to take effects...
  • Page 56 Questions & Answers iSeries. mySeries. iSeries. mySeries. Logical Partitions on the IBML Power5 Bibliography iSeries. mySeries.
  • Page 57 Front cover Logical Partitions on the IBM PowerPC he IBM PowerPC A Guide to Working with LPAR on Power5 i5 Servers Understand the new logical partitions for IBM Power5 architecture Learn how to install, configure, and manage LPAR with the latest HMC...
  • Page 58 Bibliography IBM Eserver i5, iSeries, and AS/400e System Builder IBM i5/OS Version 5 Release 3 October 2004 The authoritative source for current Eserver i5 and iSeries models Facts, rules, and placement for Eserver i5 and iSeries features...
  • Page 59: Contact Information

    Thank You ! iSeries. mySeries. Contact Information REAL Solutions S.A. Rue d’Eich, 33 L-1461 Luxembourg Eddy Pasteger System Engineer Manager iSeries Certified Solutions Expert Voice : (+352) 43 65 22 1 Fax : (+352) 42 26 38 E-mail : eddy.pasteger@real.lu iSeries.

This manual is also suitable for:

Eserver i5os