HP Cluster Platform Introduction v2010 Installation Manual
HP Cluster Platform Introduction v2010 Installation Manual

HP Cluster Platform Introduction v2010 Installation Manual

Microsoft windows hpc server 2008 installation guide
Hide thumbs Also See for Cluster Platform Introduction v2010:

Advertisement

Quick Links

Microsoft Windows HPC Server 2008

Installation Guide

HP Part Number: A-HPCS08- 1 B
Published: June 2009

Advertisement

Table of Contents
loading

Summary of Contents for HP Cluster Platform Introduction v2010

  • Page 1: Installation Guide

    Microsoft Windows HPC Server 2008 Installation Guide HP Part Number: A-HPCS08- 1 B Published: June 2009...
  • Page 2 © Copyright 200( Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.
  • Page 3: Table Of Contents

    Table of Contents About This Document......................7 Intended Audience..........................7 How to Read This Document.........................7 Typographic Conventions........................7 Related Information..........................8 Structure of This Document........................8 Documentation Updates.........................9 HP Encourages Your Comments......................9 1 What's in This Version....................11 1.1 About This Product.........................11 1.2 Benefits and Features........................11 2 Supported Configurations...................13 2.1 Configuration Constraints.......................13 2.1.1 Maximum System Limits......................13...
  • Page 4 8 Licensing........................61 9 Troubleshooting......................63 9.1 Network Configuration Issues......................63 9.2 Provisioning Issues..........................63 9.3 Diagnostics Fail..........................64 9.4 InfiniBand............................64 10 Technical Support......................65 10.1 Before You Contact HP........................65 10.2 HP Contact Information........................65 10.3 HP Customer Support........................65 A Promoting the Head Node to Domain Controller............67 Glossary..........................69 Index..........................71 Table of Contents...
  • Page 5 List of Figures Topology 1.............................14 Topology 2.............................14 Topology 3.............................14 Topology 4.............................15 Topology 5.............................15 Two-Network Topology........................15 Three-Network Topology......................16...
  • Page 7: About This Document

    About This Document This manual describes the implementation of the Microsoft® Windows® HPC Server 2008 (HPCS) operating system on HP Cluster Platform models, including HP Cluster Platform Express. Intended Audience This document is intended for the person who installs, administers, and troubleshoots servers and storage systems.
  • Page 8: Related Information

    The preceding element can be repeated an arbitrary number of times. Indicates the continuation of a code example. Separates items in a list of choices. WARNING A warning calls attention to important information that if not understood or followed will result in personal injury or nonrecoverable system problems.
  • Page 9: Documentation Updates

    Chapter 9 Troubleshooting. Chapter 10 Technical support. Documentation Updates Documentation updates (if applicable) are provided at http://docs.hp.com. Use the release date of a document to determine if you have the latest version. HP Encourages Your Comments HP encourages your comments concerning this document. HP is committed to providing documentation that meets your needs.
  • Page 11: What's In This Version

    1 What's in This Version 1.1 About This Product Windows HPC Server 2008 (HPCS) provides a high-performance computing platform that supports an integrated software stack, which includes the operating system, job scheduler, and management tools. 1.2 Benefits and Features HPCS provides enhanced monitoring, system health, and reporting with built-in diagnostic tools to create and manage groups of resources and failover options.
  • Page 13: Supported Configurations

    2 Supported Configurations 2.1 Configuration Constraints The configuration of an HP Cluster Platform is flexible, so that it can support several different operating environments. To support HPCS, a cluster must have the following specific characteristics: • The cluster consists of a single head node and a number of compute nodes. •...
  • Page 14: Topology 1

    Figure 2-1 shows a head node on a public and private network with compute nodes on the private network only. This topology is referred to as Two-Network Topology and is supported by HP Cluster Platform and HP Cluster Platform Express. See Figure 2-6 (page 15).
  • Page 15: Topology 4

    Figure 2-4 Topology 4 Figure 2-5 shows all nodes on a public network only. Figure 2-5 Topology 5 Only two of the five topologies previously shown map to HP Cluster Platform topologies. Figure 2-6 shows the simplest topology, based on in-band (shared) use of the HP ProCurve switch as the MPI fabric.
  • Page 16: Three-Network Topology

    Connection to the server management interface, a dedicated hardware interface that listens for, and executes commands received through the Ethernet network. This card is also known as the management processor (MP), or integrated lights-out (iLO) card, depending on the model of server. Where supported by the operating environment, this connection is used for server hardware management functions, such as power-off or boot.
  • Page 17: Host Channel Adapters And Firmware

    InfiniBand MPI network, if present Gigabit Ethernet system interconnect, if present Gigabit Ethernet switch for cluster administrative network, if present InfiniBand system interconnect, if present 2.4 Host Channel Adapters and Firmware Every node that is part of the high-speed InfiniBand fabric requires a host channel adapter (HCA) installed in its PCI bus.
  • Page 19: Cabling Your Hp Cluster Platform For Hpcs

    3 Cabling Your HP Cluster Platform for HPCS For HPCS to install and operate correctly, the GigE network must be cabled properly. The head node must have two connections; one NIC connected to an enterprise (public) connection, and the other NIC connected to an isolated (private) network infastructure. All compute nodes must have the same NIC (NIC1 or NIC2) connected to the same isolated (private) network which includes the head node private NIC.
  • Page 20: Certificate Of Authenticity (Coa)

    Perform any hardware post-installation verification procedures to ensure that all cabling is functioning. Gigabit Ethernet clusters have no specific post-installation verification procedures, other than those documented in the HP ProCurve hardware documentation shipped with your cluster. Proceed to install or configure the HPCS operating environment, as described in Chapter 4 (page 21).
  • Page 21: Installing Hpcs On A Compute Cluster

    4 Installing HPCS on a Compute Cluster This chapter provides instructions for installing HPCS on various cluster configurations. 4.1 Cluster Installation Overview You must perform several basic steps to complete the installation of your cluster. However, because of the various HPCS purchase options from HP, these steps might vary slightly for each scenario.
  • Page 22 The bottom section contains options to join a Domain or Workgroup. The Workgroup option is currently selected. Select Domain and join the cluster to a domain. NOTE: If you do not have a domain to join, promote the head node to a domain controller and proceed to step 11.
  • Page 23 To start the HPCS installation, click Next. Accept the license terms agreement and click Next. Select Create a new HPC cluster by creating a head node, and click Next. Select the default Create a new database, and click Next. Select the default locations for the HPC database files, and click Next. 4.2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express...
  • Page 24 The next screen prompts you to apply Microsoft updates. IMPORTANT: It is important to apply Microsoft updates to the cluster. Verify that your node can retrieve the desired updates before selecting Yes. If you do not select Yes to updates at this time, you must run Windows Updates at a later time. If you have your domain setup for new nodes to retrieve and apply updates through utilities such as WSUS, or if your node has access to the internet with the ability to apply updates without setting items like a proxy server, select Yes.
  • Page 25 After the HPC Pack 2008 is installed, the cluster preconfigured information appears in the command window. Let this complete. This process takes an average of 10 to 15 minutes. 4.2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express...
  • Page 26 After the preconfiguration information is loaded, the HPC Console automatically displays. In the To-do List window, Configure your network should have a green check by it. If this is not checked: • The preconfigured network settings are incorrect. • Select Configure your network and make corrections. For additional information, see step 10 in “Installing HPCS from CD”.
  • Page 27 If any of the four configuration steps are not checked, select the step and complete the configuration. For more information on cluster configuration, see “Installing HPCS from CD” (page 30) , or refer to the Microsoft HPC Pack 2008 documentation. The head node configuration is complete.
  • Page 28 The cluster compute nodes should be listed in a provisioning state. If they are in an unknown state: • Select Add nodes on the right. • Select Deploy compute nodes from bare metal using an Operating System Image, and click Next. •...
  • Page 29 After the node has completed provisioning, it displays as offline. Right-click the node or nodes, and select Bring Online. 4.2 Installation Procedure When HPCS is Preinstalled on HP Cluster Platform and HP Cluster Platform Express...
  • Page 30: Installing Hpcs From Cd

    If a node fails to provision, choose either option: • Check the provisioning log for the node. This log displays error messages. • Bring up the compute node console, watch the node PXE boot, contact the head node, download the image, and start the OS install. If either of these steps fail, check the error messages to resolve the issue and re-provision the failed node.
  • Page 31 Join the head node to an existing enterprise domain. If you cannot join an exisiting domain, promote the head node to a domain controller. For information on promoting your server to a domain controller, see Appendix A (page 67) Install HPC 2008. Run setup.exe.
  • Page 32 Create New Database instance, and accept defaults. If you have a Windows Server Update Service (WSUS) setup for your active directory, or your servers do not need a Proxy server to directly access Microsoft websites, you can save some time by having updates installed. But if you do not, click I don't want to use Microsoft Update.
  • Page 33 In Install Required Components, click Install. The installation starts. 4.3 Installing HPCS from CD...
  • Page 34 After the cluster is installed, start the console by clicking Finish. Installing HPCS on a Compute Cluster...
  • Page 35 The To-do list window appears. You must complete each of the four configuration steps. Begin with Configure your network. Select the desired network topology for your cluster. For HP Cluster Platform configured hardware, select Compute nodes isolated on a private network. For clusters with InfiniBand, select Compute nodes isolated on private and application networks.
  • Page 36 Click Next. Select the appropriate ethernet network adapter for the public connection. Click Next. Select the appropriate ethernet network adapter for the private connection. Click Next. You are prompted to provide private network IP configuration parameters. You can select your own IP ranges, but HP recommends that you accept the defaults. HP also recommends that you select NAT and DHCP.
  • Page 37 For more information on configuring and troubleshooting IB network connections, see the documentation at: http://www.docs.hp.com/en/highperfcomp.html. Click Next. Configure your firewall settings. Typically, you select the defaults. Public is firewalled, private is not. We recommend you do not firewall your private network. 4.3 Installing HPCS from CD...
  • Page 38 Click Next. After making all your network selections, review your selections. After verifying your selections, click Configure. This takes several minutes to complete. Installing HPCS on a Compute Cluster...
  • Page 39 In the To-do List, select Provide installation credentials. Enter the credentials for a domain user who has permissions to create new nodes in the active directory. (Many enterprises also use a special account with restricted privileges for this purpose. Use the appropriate account for your domain.) Add the user to the cluster user list.
  • Page 40 Click Next. This image is found on the Windows HPC 2008 Edition OEM disk. Select the first option Create a new operating system image and locate the setup.exe on the OEM DVD. Include a name for the image. Installing HPCS on a Compute Cluster...
  • Page 41 Click OK. After the image is added, select the appropriate OS image. If you are using an OEM image with new HP hardware, you do not need to enter a key. The key is automatically encoded into the image. If you are using older hardware, or are using a non-OEM image, you can enter your OS key.
  • Page 42 The local administrator password can be automatically generated or manually set. HP recommends automatically generated passwords. If you have your WSUS server setup, or if your nodes have access to the internet, you can select to include Windows updates . You can also add additional hot-fixes to the installation if you wish.
  • Page 43 Review the settings, and create the template. Click Create. After the template is created, all the To-do List items have green checks. 4.3 Installing HPCS from CD...
  • Page 44 To finish the configuration and start provisioning nodes, go to the Configuration tab, and select Images. Installing HPCS on a Compute Cluster...
  • Page 45 Select Manage Drivers, and add the multi-function NIC drives from the ProLiant Support Pack (PSP) for DL3xx, DL5xx and blXXX. For DL1xx, download the appropriate NIC driver for your hardware, and add this driver to the NIC. IMPORTANT: The WinPE environment for Windows 2008 does not contain drivers for virtual bus drivers.
  • Page 46 If you view this and the test All Services Running is the only failure, this is a false error. The HPC services did not start before the diagnostic tests started to run. To clear the error, on the diagnostic tab, select the head node, right click on the error, and select Clear Alert. Installing HPCS on a Compute Cluster...
  • Page 47 Rerun the diagnostic tests if you wish. To start provisioning compute nodes, return to the Node Management tab, and select Add Nodes. Select Deploy compute nodes from bare metal using an operating system image. Click Next. 4.3 Installing HPCS from CD...
  • Page 48 Select the template you want to apply to the compute nodes. You cannot continue until at least one compute node is PXE booted and starts provisioning. Power on at least one of the compute nodes, or all of the compute nodes, and wait for them to display in the Select New Nodes window.
  • Page 49 NOTE: Compute nodes should arrive with no data on the hard drive. In this state, the nodes will automatically PXE boot when they are powered up. If your hard drive contains a partition or data, it may attempt to boot from the hard drive. If this occurs, wipe the hard drive clean by deleting all disk partitions, or manually select PXE boot at node startup time.
  • Page 50 To monitor the provisioning progress, go to the Node Management Console, highlight the node you want to monitor, and select the Provisioning Log tab at the bottom of the screen. This provisioning progress displays, and shows any errors. Installing HPCS on a Compute Cluster...
  • Page 51 Provisioning might take approximately an hour. It might take longer if a large number of nodes are being provisioned at the same time without multi-cast being enabled. After the nodes are provisioned, you can see all the nodes in the node list. Your cluster is ready for use.
  • Page 53: Post-Installation Tasks

    5 Post-Installation Tasks This chapter provides information about various tasks that might be necessary after installation. 5.1 Altering Regional Settings If the server is not operating under the default regional settings, alter the regional settings. The regional settings control the keyboard language and set the local format for sorting and displaying time, date, numbers, and currency for a specified region.
  • Page 54: Configuring Array Controllers

    Click Install to install the currently selected components. The HP Management Agents install using the password you have set. 5.3 Configuring Array Controllers If an array controller has been purchased with the server, run the online ACU to set up the remaining physical drives for use.
  • Page 55: Installing The Network Teaming And Configuration Utility

    Click Next to accept the drive letter assigned by default at the Assign Drive Letter or Path screen. The Format Partition screen appears. To format the drive, select the appropriate file system format (the default selection is NTFS) and the Allocation Unit Size, and then either enter the Volume Label or accept the default label.
  • Page 57: Hp-Mpi For Windows

    6 HP-MPI for Windows HPCS supports HP-MPI for Windows. You must purchase HP-MPI for Windows software and licenses. Install the software locally on each node in your cluster or use the Run command feature of the Compute Cluster Administrator to remotely install it. For more information, see the HP-MPI website: http://www.hp.com/go/mpi...
  • Page 59: Upgrading

    7 Upgrading 7.1 Upgrading or Modifying Clusters Factory-integrated clusters are not designed for field upgrades using preinstalled servers, (otherwise known as HPCS standalone servers). To find out whether an upgrade is available for your cluster, contact your HP sales and service representative, or authorized HP reseller. CAUTION: Never add components to an HP Cluster Platform rack, even if available space exists in the rack.
  • Page 61: Licensing

    8 Licensing Operating System Activation: If this product was purchased directly from HP, this product is pre-activated. HP has configured the operating system so customer activation is not required. If this product was purchased from your local authorized reseller, you have 60 days from the installation of the product to complete product activation, either online or by phone directly with Microsoft.
  • Page 63: Troubleshooting

    9 Troubleshooting This section covers various areas where problems might occur and offers suggestions for troubleshooting and fixing the issues. 9.1 Network Configuration Issues Cluster configuration problems are often related to improper network configuration. Some areas to check are: • Active Directory—The head node and each compute node must be members of the same domain before the Compute Cluster Pack is installed.
  • Page 64: Diagnostics Fail

    • The compute node fails to copy the operating system from the WDS server. When the compute node starts the WinPE environment, a command window displays. You should see it add any drivers (if you injected drivers into the OS), then start the provisioning. One of the early steps is copying the OS image to the compute node.
  • Page 65: Technical Support

    10 Technical Support 10.1 Before You Contact HP Be sure to have the following information available before you call HP: • Technical support registration number (if applicable) • Product serial number • Product model name and number • Applicable error messages •...
  • Page 67: A Promoting The Head Node To Domain Controller

    A Promoting the Head Node to Domain Controller The HPCS software requires the nodes to be a member of a Windows Active Directory (AD). To install AD, a domain controller is needed to manage the AD. If you do not have an AD which you can join, you must promote your head node to a domain controller.
  • Page 69: Glossary

    Glossary AMD Opteron The ProLiant DL series servers used in the CP4000 platform employ the AMD Opteron 32/64-bit CPU. Application program interface. BIOS Basic Input/Output System. Cluster A set of servers joined together using various interconnect technologies to form a supercomputer. Command-Line Administrators can use the CLI to automate job, job queue, and node operations.
  • Page 70 InfiniBand An interconnect protocol and connection type supported by interconnect technology from Voltaire that complies with the specification defined by the InfiniBand trade group. Interconnect A module containing one or more interconnects. Building Block (IBB) Job Scheduler The Job Scheduler service runs on the head node and is responsible for job submission, queue management, resource allocation, and job execution.
  • Page 71: Index

    Index about this document, 7 HCA, 17 administrative network, 13 head node, 15, 16 AMD Opteron, 13 host channel adapter, 17 array controllers, 54 HP Cluster Platform audience, 7 website, 8 HP-MPI, 57 cable labels, 19 iLO, 16 cabling rules, 19 in-band, 13, 15 Certificate of authenticity, 20 InfiniBand, 13, 16...
  • Page 72 network upgrades, 59 administrative, 13 upgrading, 59 console, 13 in-band, 13 local, 15, 16 website management, 16 HP Cluster Platform, 8 network configuration, 63 login, Voltaire, 8 network protocols, 55 reader feedback, 9 network topology Windows cluster three networks, 16 cabling rules, 19 two networks, 15 supported topologies, 13...

This manual is also suitable for:

Cluster platformCluster platform express

Table of Contents