1. Manuals
  2. Brands
  3. HP Manuals
  4. Server
  5. Cluster Platform Express v2010
  6. Overview

HP Cluster Platform Express v2010 Overview

Workgroup system and cluster platform express overview and hardware installation guide
Hide thumbs Also See for Cluster Platform Express v2010:
Table of Contents

Advertisement

Quick Links

Download this manual
HP Cluster Platform Workgroup System
and Cluster Platform Express
Overview and Hardware Installation Guide
HP Part Number: A-CPCPE- 1 E
Published: February 2009

Advertisement

Table of Contents
loading

Related Manuals for HP Cluster Platform Express v2010

Summary of Contents for HP Cluster Platform Express v2010

  • Page 1 HP Cluster Platform Workgroup System and Cluster Platform Express Overview and Hardware Installation Guide HP Part Number: A-CPCPE- 1 E Published: February 2009...
  • Page 2 © Copyright 2009 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice. The only warranties for HP products and services are set forth in the express warranty statements accompanying such products and services. Nothing herein should be construed as constituting an additional warranty. HP shall not be liable for technical or editorial errors or omissions contained herein.

  • Page 3: Table Of Contents

    Table of Contents About This Document......................9 Intended Audience..........................9 Document Organization.........................9 Typographic Conventions........................10 Related Information..........................10 HP Encourages Your Comments......................10 1 Cluster Platform Express Overview................11 1.1 Cluster Platform Workgroup System....................11 1.2 CPE BladeSystem with c7000 Enclosure..................12 1.3 CPE with Rack-Mountable Servers....................12 1.4 CPE Architecture Overview......................12 1.4.1 Basic Components Used in CPE....................13 1.4.2 Power Distribution Units Used in CPE Configurations............14 1.4.3 Power Strips..........................16...
  • Page 4 3 CPE BladeSystem with c7000 Enclosure Configurations.........43 3.1 CPE c7000 Configuration Examples....................43 3.1.1 Server Blade Configuration Example with Three Enclosures in a 42U Rack......44 3.1.2 Server Blade Configuration Example with Two Enclosures in a 42U Rack......46 3.1.3 Server Blade Configuration Example with One Enclosure in a 42U Rack......47 3.1.4 Server Blade Configuration with Two Enclosures in a 22U Rack...........48 3.1.5 Server Blade Configuration with One Enclosure in a 22U Rack..........48 3.2 Site Preparation Guidelines for CPE BladeSystem with c7000 Enclosure........49...
  • Page 5 D.6 Administrative/Console Wiring Tables for Three c7000 Enclosures with Double-Density Server Blades and the InfiniBand Fabric......................84 D.7 One c7000 Enclosure with Single-Density Blades and an HP 4x DDR InfiniBand Switch Module..............................86 D.8 InfiniBand Wiring Table for Two c7000 Enclosures with Single-Density Blades (Without an External InfiniBand Switch)........................88 D.9 InfiniBand Wiring Table for Two or Three c7000 Enclosures with Single-Density Blades and an External InfiniBand Switch........................89...
  • Page 6 F.2.3 Using Two ISR 9024 Interconnects to Support 25-32 Nodes..........123 Index..........................125 Table of Contents...
  • Page 7 List of Figures Zero-U Mounted Power Distribution Unit..................14 Zero-U Mounted Power Distribution Unit for c7000 Configurations...........15 42U Power Strip Installation in a 42U Cabinet................17 42U Power Strip Installation......................18 HP GbE2c Blade Switch.........................19 Example InfiniBand Cable Routing for CPE BladeSystem with c7000 Enclosure Configurations..........................21 HP 4X DDR InfiniBand Switch Module..................22 HP BLc 4X DDR InfiniBand Gen2 Switch..................22...
  • Page 8 List of Tables PDUs Per Rack..........................16 HP GbE2c Ethernet Blade Switch for c-Class BladeSystem User and Service Documentation..20 Rack-Mountable Server Control Nodes..................25 CPE Documentation for Supported Components.................35 Wiring Table Key...........................61 CP Workgroup System with Either Single-Density or Double-Density Server Blades and Single c7000 Enclosure with Standard-Density Server Blades..............70 One c7000 Enclosure with an External InfiniBand Switch, an External Control Node, and with Double-Density Server Blades Only (IMB1)..................79...

  • Page 9: About This Document

    About This Document This document provides overview and hardware installation information for the following HP Cluster Platform Express (CPE) configurations: • HP Cluster Platform Workgroup System with HP BladeSystem c3000 Enclosure • CPE BladeSystem with c7000 Enclosure • CPE with rack-mountable servers CPE configurations are easy-to-order, preconfigured, single-rack cluster solutions supporting either InfiniBand or Gigabit Ethernet system interconnects.

  • Page 10: Typographic Conventions

    Typographic Conventions This document uses the following typographic conventions: Reader Notes NOTE: Content of the note. Notes provide additional information, supplementing the adjoining content or emphasizing points of information. Reader Warnings WARNING! Content of the warning. A warning calls attention to important information that if not understood or followed will result in personal injury or nonrecoverable system problems.

  • Page 11: Cluster Platform Express Overview

    1 Cluster Platform Express Overview HP Cluster Platform Express (CPE) systems are delivered to you factory assembled and ready for deployment. They are available with a choice of pre-installed software for cluster management. The extensive array of software development tools and applications featured in the Unified Cluster Portfolio are supported on Cluster Platform Express solutions, which follow the same design and quality standards established for HP Cluster Platform solutions.

  • Page 12: Cpe Bladesystem With C7000 Enclosure

    1.2 CPE BladeSystem with c7000 Enclosure CPE BladeSystem configurations use integrated c7000 enclosures that can hold up to 16 half-height servers in each enclosure. The c7000 enclosures are configured in a 42U or 22U HP 10000 Series rack, as shown in the following table: Number of c7000 42U Cabinet (number of server blades) 22U Cabinet (number of servers)

  • Page 13: Basic Components Used In Cpe

    • An overview of the power strips used in CPE (see Section 1.4.3) • An overview of the networks used in CPE (see Section 1.4.4) • External control nodes used in CPE BladeSystems (see Section 1.4.5) • Examples of making connections to an external network (see Section 1.4.6) •...

  • Page 14: Power Distribution Units Used In Cpe Configurations

    nodes to the folding keyboard and screen (TFT7600 KVM). These connections let you log on to the nodes and perform system and job management tasks from the local system console. See the HP Cluster Platform Core Components Overview for more information. •...

  • Page 15: Zero-U Mounted Power Distribution Unit For C7000 Configurations

    The following list describes the callouts shown in Figure 1-1: Installation screws and cage nuts secure the PDU to the side of the rack column, adjacent to the rack's side panels for servicing. The rack's front left column. Main inlet power cable, connected to the site power supply. Outlet power cables (up to 4) which connect to the power strips (see Figure 1-3).

  • Page 16: Power Strips

    Table 1-1 PDUs Per Rack Number of Power Supplies Installed in the CPE Configuration c-Class Enclosure or Rack Components Number of 0U Mounted PDUs Required CP Workgroup System The c3000 enclosure is configured with up Up to two 24A PDUs are necessary to four power supplies.

  • Page 17: Power Strips Used In Older Cpe Systems

    Figure 1-3 42U Power Strip Installation in a 42U Cabinet Figure 1-3 shows the following PDU installation features: The first power strip is located in the ninth hole from the bottom of the rack. The second power strip is located in the fifth hole from the top of the first power strip. The third power strip is located in the third hole from the center of the cabinet rail.

  • Page 18: Fast-Ethernet Network Switches And The Optional Infiniband Network

    Figure 1-4 42U Power Strip Installation The following list describes the callouts shown in Figure 1-4: M5 screw attached to power strip. M5 screw attached to cable management bracket. Power strip mounting plate. Bracket attaching the power strip to the power strip mounting plate. Power strip mounting plate.

  • Page 19: Fast-Ethernet Switches

    1.4.4.1 Fast-Ethernet Switches The Fast-Ethernet network, which is documented in the HP Cluster Platform Gigabit Ethernet Interconnect Guide, is used for administrative and console networking in CPE solutions. You can also use the switches for MPI applications. Cluster management on server blade configurations is supported over an administration network with both console and operating-system level management branches.

  • Page 20: Infiniband High-Speed Interconnects

    For user and service information for the HP GbE2c blade switch, see Table 1-2. Table 1-2 HP GbE2c Ethernet Blade Switch for c-Class BladeSystem User and Service Documentation Document Title Location GbE2c Ethernet Blade Switch for HP http://bizsupport.austin.hp.com/bc/docs/support/SupportManual/c00700745/ c-Class Quick Setup Instructions c00700745.pdf HP GbE2c Ethernet Blade Switch for http://bizsupport.austin.hp.com/bc/docs/support/SupportManual/c00701973/...

  • Page 21: Example Infiniband Cable Routing For Cpe Bladesystem With C7000 Enclosure Configurations

    Figure 1-6 Example InfiniBand Cable Routing for CPE BladeSystem with c7000 Enclosure Configurations The following list describes the callouts in Figure 1-6: c-Class enclosure in the bottom of a cabinet. Second c-Class enclosure in a cabinet (there is a maximum of three enclosures in a 42U rack). c-Class cable management bracket.

  • Page 22: Hp 4X Ddr Infiniband Switch Module

    Figure 1-7 HP 4X DDR InfiniBand Switch Module Note: When the 4X DDR InfiniBand switch module is used in a CP Workgroup System, it is installed in module bays 3 and 4 of the HP BladeSystem c3000 enclosure. Figure 1-8 shows the new HP BLc 4X DDR InfiniBand Gen2 Switch being installed in an HP BladeSystem c7000 enclosure.

  • Page 23: Cable Management Plate

    Note: The HP BLc 4X DDR InfiniBand Gen 2 Switch is not currently supported in HP BladeSystem c3000 enclosures. For more information, contact your HP representative. Figure 1-9 provides and example of the InfiniBand cable management in CPE rack-mountable server configurations. Note the InfiniBand cables running from a Voltaire ISR 9024D, 24-port interconnect to each rack-mounted server in the rack.

  • Page 24: Cabling Guidelines

    Figure 1-10 Cable Management Plate The following list describes the callouts in Figure 1-10: Fabric cable management strap with a metal ring and a hook-and-loop closure to secure the cable bundles. Single screw attaching the strap to the plate, enabling you to change to a longer length strap for larger cable bundles.

  • Page 25: Identifying Node Port And Pci Slot Assignments

    Table 1-3 Rack-Mountable Server Control Nodes HP ProLiant DLxxx Gx with Opteron Processors HP ProLiant DLxxx Gx with Xeon Processors DL145 Gx DL140 Gx DL165 Gx DL160 Gx DL385 Gx DL380 Gx Note: Rack-mountable control nodes are referred to as external control nodes and are considered an option for BladeSystem configurations.

  • Page 26: Connecting To An External Network

    Embedded network interface card NIC 2, RJ-45 port which is optionally connected by a CAT5e cable to the local network (LAN). Embedded network interface, connected by a CAT5e cable to the HP ProCurve administrative network switch. This connection enables cluster management tasks such as job submission and monitoring.

  • Page 27: Cpe Workgroup System With Double-Density Server Blades

    Figure 1-12 CP Workgroup System Configuration with Single-Density Server Blade Control Node The following list describes the callouts in Figure 1-12: HP GbE2c switch Connection from the Onboard Administrator's iLO port to the HP GbE2c port 22 Optional connection from a server blade control node through an HP GbE2c external port to an external campus network.

  • Page 28: Cpe Bladesystem Configurations With An External Control Node

    Note: In all configurations with a server blade as the control node, NIC2 of the server blades installed in the same enclosure as the control node will also be connected to the switch used to provide external connectivity. Cluster management software or the system administrator for the cluster must determine what steps are necessary to provide appropriate connectivity to the external network.

  • Page 29: Cpe Bladesystem Configurations With A Rack-Mountable Server Control Node

    Figure 1-14 CPE BladeSystem Configurations with a Rack-Mountable Server Control Node The following list describes the callouts in Figure 1-14: Four connections from an HP GbE2c switch installed in Interconnect Module Bay 1 (IMB1) of the first HP BladeSystem c7000 enclosure to an HP ProCurve 2824 switch (see the following note) HP ProCurve 2824 switch Four connections from an HP GbE2c switch installed in Interconnect Module Bay 1 (IMB1)

  • Page 30: Cpe Bladesystem Configurations With Double-Density Server Blades And An External Control Node

    10. Connection from the OA's external link to an administrative switch (HP ProCurve 2824 switch) 11. Optional connection from the control node's NIC2 port to an external network (such as a campus network) 12. Optional connection from the control node's iLO port to either an administrative switch or to an external network (such as a campus network) Note: Only one connection from each HP GbE2c switch to the HP ProCurve 2824 switch is required if...

  • Page 31: Cpe Bladesystem Configurations With A Single-Density Server Blade Control Node

    Four connections from an HP GbE2c switch installed in Interconnect Module Bay 1 (IMB1) of the first HP BladeSystem c7000 enclosure to an HP ProCurve 2824 switch (see the following note) HP ProCurve 2824 switch Four connections from an HP GbE2c switch installed in Interconnect Module Bay 1 (IMB1) of the second HP BladeSystem c7000 enclosure to an HP ProCurve 2824 switch (see note below) HP GbE2c Gigabit Ethernet switch installed in IMB1 of the first HP BladeSystem c7000...

  • Page 32: Cpe Bladesystem (C7000) Configurations With A Single-Density Server Blade Control Node

    Figure 1-16 CPE BladeSystem (c7000) Configurations with a Single-Density Server Blade Control Node The following list describes the callouts in Figure 1-16: Four connections from an HP GbE2c switch installed in Interconnect Module Bay 1 (IMB1) of the first HP BladeSystem c7000 enclosure to an HP ProCurve 2824 switch (see the following note) HP ProCurve 2824 switch Four connections from an HP GbE2c switch installed in Interconnect Module Bay 1 (IMB1)

  • Page 33: Cpe Bladesystem Configurations With Double-Density Server Blade Control Node

    Note: Only one connection from each HP GbE2c switch to the HP ProCurve 2824 switch is required if the optional InfiniBand network is present. 1.4.6.6 CPE BladeSystem Configurations with Double-Density Server Blade Control Node Figure 1-17 shows a connections to an external network for configurations of c7000 enclosures with a double-density server blade control node.

  • Page 34: Cpe With Rack-Mountable Servers

    HP GbE2c switch installed in IMB1 of the second HP BladeSystem c7000 enclosure HP GbE2c switch installed in IMB1 of the first HP BladeSystem c7000 enclosure HP GbE2c switch installed in IMB3 of the first HP BladeSystem c7000 enclosure (omit if an external network connection is not necessary) Four connections from an HP GbE2c switch installed in IMB2 of the second HP BladeSystem c7000 enclosure to an HP ProCurve 2824 switch (see the following note)

  • Page 35: Cpe Documentation For Supported Components

    documentation for each unique component in the cluster (such as an HP 10000 Series Rack, DLxxx Gx server, or Ethernet switch) are supplied with your shipment. Table 1-4 CPE Documentation for Supported Components Component Document Note PDU and power distribution bars HP Cluster Platform Core Components Safety information.

  • Page 36: Documentation Resources, Updates And Release Notes

    Table 1-4 CPE Documentation for Supported Components (continued) Component Document Note c-Class cable management bracket HP BladeSystem c-Class Enclosure Cable Installation and usage (used for the two c-Class Management Bracket Installation Guide information for c-Class InfiniBand switch modules with (436670-doc) cable management.

  • Page 37: Cluster Platform Workgroup System

    2 Cluster Platform Workgroup System The CP Workgroup System is comprised of a single-cabinet cluster containing a variety of components and a c3000 enclosure to meet the following specifications: • A single rack in a 22U configuration • An optional rack-mount (1U or 2U) control node (some restrictions apply) •...

  • Page 38: Cabinet With A C3000 Enclosure And An External Control Node

    Note: Appendix B for the configuration diagrams and the cabling tables for CP Workgroup System. 2.1.1 22U Cabinet with a c3000 Enclosure and an External Control Node Figure 2-1 shows a typical CP Workgroup System with one HP BladeSystem c3000 Enclosure in a 22U rack with an external control node.

  • Page 39: Site Preparation Guidelines For Cp Workgroup System

    Figure 2-2 CP Workgroup System in a 22U Rack Without an External Control Node Figure 2-2 shows the following cluster components: HP 10000 Series 22U rack. Filler panels to close up reserved space on the front of the rack. The HP BladeSystem c3000 enclosure Filler panels to close up reserved space on the front of the rack.

  • Page 40: Unpacking And Removing Cpe Systems From A Shock Pallet

    Note: The HP BladeSystem c3000 enclosure is not documented in the HP BladeSystem Site Planning Guide. However, the site preparation procedures for CP Workgroup System are similar to the site preparation procedures as currently described in the HP BladeSystem Site Planning Guide and the HP Cluster Platform Site Preparation Guide.

  • Page 41: Post-Installation And Diagnostics

    2.5 Post-Installation and Diagnostics CP Workgroup System uses the Insight Management interface to troubleshoot failures. For more information, see the HP BladeSystem c3000 Enclosure and c3000 Tower Enclosure Maintenance and Service Guide: http://h20000.www2.hp.com/bc/docs/support/SupportManual/c01126895/c01126895.pdf For more information on post-installation and diagnostics, see the HP BladeSystem c-Class Enclosure Troubleshooting Guide: http://h20000.www2.hp.com/bc/docs/support/SupportManual/c01215727/c01215727.pdf 2.6 Setting Up Local Networks...

  • Page 43: Cpe Bladesystem With C7000 Enclosure Configurations

    3 CPE BladeSystem with c7000 Enclosure Configurations Cluster Platform Express (CPE) BladeSystem with c7000 enclosure configurations are comprised of a single-cabinet cluster containing a variety of components and c7000 enclosures to meet the following specifications: • A single rack (22U or 42U, depending on the configuration) •...

  • Page 44: Server Blade Configuration Example With Three Enclosures In A 42U Rack

    Note: At this time, HP does not plan to support joining Cluster Platform Express for BladeSystem configurations to adjacent cabinets due to potential service issues with the 0U (side-mounted) PDUs. The following sections show CPE c7000 enclosure configuration examples in 42U and 22U cabinets: •...

  • Page 45: Server Blade Configuration Example With Three Enclosures In A 42U Rack

    Figure 3-1 Server Blade Configuration Example with Three Enclosures in a 42U Rack Figure 3-1 shows the following cluster components: HP 10000 Series 42U rack. Filler panels to close up any unused space on the front of the rack. An HP c7000 enclosure with 16 half-height blades (BL460c or BL465c servers). There are three c7000 enclosures in this configuration with a total of 48 half-height server blades.

  • Page 46: Server Blade Configuration Example With Two Enclosures In A 42U Rack

    3.1.2 Server Blade Configuration Example with Two Enclosures in a 42U Rack Figure 3-2 shows a typical CPE BladeSystem with c7000 server blade solution with two enclosures in a 42U rack. Some of the components shown in this figure might be optional, or they might be installed in a different location or orientation with respect to the front and rear of the rack.

  • Page 47: Server Blade Configuration Example With One Enclosure In A 42U Rack

    3.1.3 Server Blade Configuration Example with One Enclosure in a 42U Rack Figure 3-3 shows a typical CPE BladeSystem with c7000 enclosure solution with one enclosure in a 42U rack. Some of the components shown in this figure might be optional, or they might be installed in a different location or orientation with respect to the front and rear of the rack.

  • Page 48: Server Blade Configuration With Two Enclosures In A 22U Rack

    Note: The configurations with one c7000 enclosure with an InfiniBand interconnect might not have an external control node. If your configuration does not have an external control node, one of the server blades in the enclosure is designated as the control node. 3.1.4 Server Blade Configuration with Two Enclosures in a 22U Rack Figure 3-4 shows a typical CPE BladeSystem with c7000 enclosure solution with two c7000...

  • Page 49: Site Preparation Guidelines For Cpe Bladesystem With C7000 Enclosure

    Figure 3-5 Server Blade Configuration with One Enclosure in a 22U Rack Figure 3-5 shows the following cluster components: HP 10000 Series rack. One TFT7600 rackmount keyboard and monitor. This unit combines a full 17-inch WXGA+ monitor and keyboard with touch pad in a 1U format. HP ProLiant DL14x Gx control node.

  • Page 50: Installation And Start-Up

    Note: The instructions to remove a rack from a shock pallet are also printed on the side of the cardboard packaging. 3.4 Installation and Start-up To prepare for powering on the cluster, see the component documentation for your model of DLxxx-series server, HP ProCurve switch, and optional cluster components.

  • Page 51: Post-Installation And Diagnostics

    http://h20000.www2.hp.com/bc/docs/support/SupportManual/c00702815/c00702815.pdf 3.5 Post-Installation and Diagnostics CPE BladeSystem with c7000 enclosure configurations use the Insight Management interface to troubleshoot failures. See the HP BladeSystem c7000 Enclosure Maintenance and Service Guide: http://bizsupport.austin.hp.com/bc/docs/support/SupportManual/c00714237/c00714237.pdf For more information on post-installation and diagnostics, see the HP BladeSystem c-Class Enclosure Troubleshooting Guide: http://bizsupport.austin.hp.com/bc/docs/support/SupportManual/c01215727/c01215727.pdf Also see the HP ProLiant Servers Troubleshooting Guide:...

  • Page 52: Server Blade Access Through A Local Kvm

    Figure 3-6 Server Blade Access Through a Local KVM The following components are shown in Figure 3-6: Monitor Keyboard Mouse Local I/O cable connected to the control node server blade Half-height server blade c-Class enclosure You will also need a local I/O cable to connect to the server blade, as shown in Figure 3-7.

  • Page 53: Local I/O Cable

    Figure 3-7 Local I/O Cable The I/O cable connections shown in Figure 3-7 are: Server blade connector Serial port USB ports (2) Video port 3.7 Operating System Information...

  • Page 55: Cpe With Rack-Mountable Servers

    4 CPE with Rack-Mountable Servers HP Cluster Platform Express rack-mountable configurations are built around a system interconnect that might be an HP ProCurve Gigabit Ethernet or a 24-port InfiniBand interconnect. Chapter 4 discusses the following topics: • CPE with rack-mountable servers — 42U rack configuration (see Section 4.1) •...

  • Page 56: Cpe With Rack-Mountable Servers - 22U Rack Configuration

    Figure 4-1 shows the following cluster components: Cable management harness. DLxx control node. A 24-port HP ProCurve Ethernet switch, providing the cluster's administrative and console management networks. In Gigabit Ethernet clusters, such switches also provide the high-speed message-passing interface (MPI) network. Keyboard, video, and mouse (KVM) unit.

  • Page 57: Typical 22U Cpe With Rack-Mountable Servers Configuration

    Figure 4-2 Typical 22U CPE with Rack-Mountable Servers Configuration PCI-X ProLiant DL380 G4 SCSI Port 1 Mouse Serial A Video Keybd DL140 G2 LO100i DL140 G2 LO100i DL140 G2 LO100i DL140 G2 LO100i DL140 G2 LO100i DL140 G2 LO100i DL140 G2 LO100i DL140 G2 LO100i...

  • Page 58: Site Preparation

    • PDUs, and power strips • Keyboard, video, mouse (KVM) and console switch 4.3 Site Preparation Site preparation tasks are generally performed before delivery of your HP CPE system. For information to prepare your site for a CPE with rack-mountable servers, see the HP Cluster Platform Site Preparation Guide: http://www.docs.hp.com/en/A-CPSPG-1D/A-CPSPG-1D.pdf 4.4 Unpacking and Removing From a Shock Pallet...

  • Page 59: Operating System Information

    4.8 Operating System Information CPE systems come with the operating system software factory installed. Software options include Red Hat and SUSE Linux distributions, as well as HP's message passing library, HP-MPI. For Windows environments, clusters are available with Microsoft Windows Server (Microsoft Windows Compute Cluster Server was used in older HP CPE Microsoft Windows based systems).

  • Page 61: A Port Labeling Syntax

    A Port Labeling Syntax This appendix provides the port labeling syntax for all of the cabling tables provided in this document. Table A-1 provides the wiring table syntax for CPE configurations. Table A-1 Wiring Table Key Label String Description Admin Identifies a component in the Admin network Ethernet Switch number x InfiniBand...

  • Page 63: B Cp Workgroup System Configuration Diagrams And Cabling Tables

    B CP Workgroup System Configuration Diagrams and Cabling Tables This appendix describes the following topics: • Example configuration diagrams (see Section B.1) • CP Workgroup System cabling tables (see Section B.2) B.1 Example Configuration Diagrams This section includes the following CP Workgroup System configuration examples: •...

  • Page 64: Cp Workgroup System With An External Control Node

    DVD drive Compute node 6 Compute node 5 10. Compute node 4 11. Administrative network and system interconnect (GigE only) 12. iLO access 13. Onboard Administrator 14. LAN or direct connect 15. External File Sharing (CIFS, NFS) 16. Clients (such as HP PCs or workstations) 17.

  • Page 65: Cp Workgroup System With Direct Attached Storage Blade Sb40C

    Compute node 1 Compute node 8 Compute node 7 System interconnect and Administrative network Compute node 6 10. Compute node 5 11. iLO access 12. Administrative network and system interconnect 13. External File Sharing (CIFS, NFS) 14. LAN or direct connect 15.

  • Page 66: Cp Workgroup System With An Sb40C Storage Blade

    Note: Compute nodes cannot be attached to the SB40c storage blade. Figure B-3 CP Workgroup System with an SB40c Storage Blade The following list describes the callouts in Figure B-3: c3000 enclosure Compute node 2 Compute node 1 SB40c storage blade Control node Compute node 6 DVD drive installed in the external control node...

  • Page 67: Cp Workgroup System With An Optional Infiniband Interconnect

    B.1.4 CP Workgroup System with an Optional InfiniBand Interconnect Figure B-4 shows a CP Workgroup System with an optional InfiniBand interconnect. Figure B-4 CP Workgroup System with an Optional InfiniBand Interconnect The following list describes the callouts in Figure B-4: c3000 enclosure Compute node 3 Compute node 2...

  • Page 68: C3000 Configuration Without The Infiniband Interconnect Connected To The External Control

    Note: It is possible to provide InfiniBand connections without using an external InfiniBand interconnect. However, at the time of this release, these configurations are not supported in a Microsoft Windows environment. Currently, if you plan to use a Microsoft Windows environment, the configuration requires an external InfiniBand interconnect for fabric management.

  • Page 69: Cp Workgroup System Cabling Tables

    Figure B-6 c3000 Configuration with External Control Node Connection to the InfiniBand Interconnect The following list describes the callouts shown in Figure B-6: Connection from the HP 4X DDR InfiniBand Switch to the Control Node InfiniBand HCA HP GbE2c switch Connection from the HP GbE2c to the control node's NIC1 port Connection to HP GbE2c (IMB1) from the OA external link port Optional connection to an external network (for example, a campus network)

  • Page 70: Hp Bladesystem C3000 And C7000 Network Cabling Tables

    Note: Section B.2.1 also provides the administrative network wiring for a single c7000 enclosure with standard-density server blades. B.2.1 HP BladeSystem c3000 and c7000 Network Cabling Tables Table B-1 CP Workgroup System with Either Single-Density or Double-Density Server Blades and Single c7000 Enclosure with Standard-Density Server Blades Origin Label...
  • Page 71 From Label Label Comment Enclosure 1 Interconnect Module 3/4 Port 7 E1-IMB3-P7 Enclosure 1 Interconnect Control Node InfiniBand Control-P1 Module 3/4 Port 8 E1-IMB3-P8 Optional External InfinBand Switch Wiring From Label Label Comment Only present if using a managed Enclosure 1 Interconnect 24-port switch for Subnet IB 24 Port Switch Port 1 IB-SW1-P1...

  • Page 73: Configurations

    C Configuring a VLAN for the Administrative Network for c3000 BladeSystem Configurations If a c3000-based configuration is connected to an external network, both the Administrative/Console network and the external network are connected to the same switch. Although IP addressing and subnetting may be used to separate these networks, the default settings of the HP GbE2C Ethernet switch will transmit broadcast traffic between the Administrative/Console network and the external network.

  • Page 75: D Cabling Tables For Cpe Bladesystem, With C7000 Enclosure Configurations

    D Cabling Tables for CPE BladeSystem, with c7000 Enclosure Configurations This appendix provides cabling examples and tables for CPE BladeSystem with c7000 Enclosure configurations: Network Description Section Number Cabling examples for CPE BladeSystem with one or more c7000 Section D.1 enclosures Wiring tables for one c7000 enclosure with single-density server Section B.2.1...

  • Page 76: Cabling Examples

    Network Description Section Number Wiring table for one c7000 enclosure with single-density server Section D.13 blades and the HP BLc 4x DDR InfiniBand Gen2 Switch Wiring table for two c7000 enclosures with single-density server Section D.14 blades and the HP BLx 4X DDR IB Gen2 Switch and no external InfiniBand switch Wiring table for two or three c7000 enclosures with Section D.15...

  • Page 77: Cabling Configuration For One C-Class Enclosure

    Figure D-1 Cabling Configuration for One c-Class Enclosure R e m o v e m a n a g e m e n t m o d u l e s b e f o r e e j e c t i n g s l e e v e The following list describes the callouts in Figure D-1:...

  • Page 78: Cabling Configuration For Two Or More C-Class Enclosures

    Figure D-2 Cabling Configuration for Two or More c-Class Enclosures R e m o v e m a n a g e m e n t m o d u l e s b e f o r e e j e c t i n g s l e e v e The following list describes the callouts in Figure D-2:...

  • Page 79: Administrative/Console Wiring Tables For One C7000 Enclosure With Double-Density Server Blades

    D.2 Administrative/Console Wiring Tables for One c7000 Enclosure with Double-Density Server Blades The following table provides the Administrative and Console wiring scheme for one c7000 enclosure with double-density server blades. Connections for the external control node and external InfiniBand switch are omitted if those components are not part of the configuration. Note: For the port labeling syntax for all of the cabling tables in this appendix, see Table...
  • Page 80 Table D-3 Administrative/Console Wiring Tables for Configurations with Two or Three c7000 Enclosures with Single-Density Server Blades (continued) Origin Label Destination Label Comment ProCurve 2824 Admin-ES1-P3 Enclosure 1, IMB1, E1-IMB1-P23 Only present if interconnect is GigE Port 3 Port 23 ProCurve 2824 Admin-ES1-P4 Enclosure 1, IMB1,...

  • Page 81: Administrative/Console Wiring Tables For Two C7000 Enclosures With Double-Density Server Blades

    D.4 Administrative/Console Wiring Tables for Two c7000 Enclosures with Double-Density Server Blades The following table provides the Administrative/Console wiring scheme for two c7000 enclosures with double-density server blades. Connections for the external control node and external InfiniBand switches are omitted if those components are not specified in the configuration. Table D-4 Administrative/Console Wiring Tables for Configurations with Two c7000 Enclosures with Double-Density Server Blades Origin...

  • Page 82: Administrative/Console Wiring Tables For Three C7000 Enclosures With Double-Density Server Blades

    Table D-4 Administrative/Console Wiring Tables for Configurations with Two c7000 Enclosures with Double-Density Server Blades (continued) Origin Label Destination Label Comment ProCurve 2824 Admin-ES1-P20 Enclosure 2 OA1 E3-OA1-iLO Port 20 OA/iLO ProCurve 2824 Admin-ES1-P21 Enclosure 1 OA1 E3-OA1-iLO Port 21 OA/iLO ProCurve 2824 Admin-ES1-P22...
  • Page 83 From Label Label Comment ProCurve 2848 Not Connected Port 11 ProCurve 2848 Not Connected Port 12 Enclosure 3 ProCurve 2848 Admin-ES1-P13 Interconnect Module E3-IMB1-P21 Port 13 1 Port 21 Enclosure 3 ProCurve 2848 Admin-ES1-P14 Interconnect Module E3-IMB1-P22 Port 14 1 Port 22 Enclosure 3 ProCurve 2848 Admin-ES1-P15...

  • Page 84: Blades And The Infiniband Fabric

    From Label Label Comment Enclosure 2 ProCurve 2848 Admin-ES1-P30 Interconnect Module E2-IMB2-P24 Port 30 2 Port 24 ProCurve 2848 Not Connected Port 31 ProCurve 2848 Not Connected Port 32 ProCurve 2848 Not Connected Port 33 Enclosure 3 ProCurve 2848 Admin-ES1-P34 Interconnect Module E3-IMB2-P21 Port 34...
  • Page 85 the interconnect. Connections for the external control node and external InfiniBand switches are omitted if those components are not specified in the configuration. From Label Label Comment Enclosure 1 ProCurve 2824 Admin-ES1-P1 Interconnect Module E1-IMB1-P21 Port 1 1 Port 21 Enclosure 2 ProCurve 2824 Admin-ES1-P2...

  • Page 86: D.7 One C7000 Enclosure With Single-Density Blades And An Hp 4X Ddr Infiniband Switch Module

    From Label Label Comment ProCurve 2824 Enclosure 1 OA1 Admin-ES1-P21 E1-OA1-ILO Port 21 OA/ILO ProCurve 2824 Optional External Only Ppresent if control node is not Admin-ES1-P22 Control- NIC1 Port 22 Control Node NIC1 a server blade Only used when an external ProCurve 2824 InfiniBand Switch 1 Admin-ES1-P23...
  • Page 87 From Label Label Comment Enclosure 1 Interconnect E1-IMB5-P7 Module 5/6 Port Enclosure 1 Interconnect Control node E1-IMB5-P8 Control-P1 Module 5/6 Port InfiniBand HCA External InfiniBand Switch Wiring From Label Label Comment Only present if using a managed Enclosure 1 IB 24 Port Switch 24-port InfiniBand switch for Subnet IB-SW1-P1 Interconnect Module...

  • Page 88: D.8 Infiniband Wiring Table For Two C7000 Enclosures With Single-Density Blades (Without An External Infiniband Switch)

    From Label Label Comment IB 24 Port Switch Port 18 IB-SW1-P18 IB 24 Port Switch Port 19 IB-SW1-P19 IB 24 Port Switch Port 20 IB-SW1-P20 IB 24 Port Switch Port 21 IB-SW1-P21 IB 24 Port Switch Port 22 IB-SW1-P22 IB 24 Port Switch Port 23 IB-SW1-P23 IB 24 Port Switch...

  • Page 89: D.9 Infiniband Wiring Table For Two Or Three C7000 Enclosures With Single-Density Blades And An External Infiniband Switch

    From Label Label Comments Used if there is no rack-mount Enclosure 2 Interconnect control node connected to the Enclosure 1 Module 5/6 Port 8 E2-IMB5-P8 InfiniBand fabric Interconnect E1-IMB5-P8 Only used if the control node is a Module 5/6 Port 8 Control node InfiniBand Control-P1 rack-mountable server connected...

  • Page 90: D.10 One C7000 Enclosure With Double-Density Server Blades, The Hp 4X Ddr Infiniband Switch Module And Without An External Infiniband Switch

    From Label Label Comments IB 24 Port Switch Enclosure 2 Interconnect Port 14 IB-SW1-P14 Module 5/6 Port 6 E2-IMB5-P6 IB 24 Port Switch Enclosure 2 Interconnect Port 15 IB-SW1-P15 Module 5/6 Port 7 E2-IMB5-P7 IB 24 Port Switch Enclosure 2 Interconnect Port 16 IB-SW1-P16 Module 5/6 Port 8...

  • Page 91: D.11 One C7000 Enclosure With Double-Density Server Blades, The Hp 4X Ddr Infiniband Switch Module, And An External Infiniband Switch

    From Label Label Comment Enclosure 1 Interconnect Enclosure 1 Interconnect Module 5/6 Port 5 E1-IMB5-P5 Module 7/8 Port 5 E1-IMB7-P5 Enclosure 1 Interconnect Enclosure 1 Interconnect Module 5/6 Port 6 E1-IMB5-P6 Module 7/8 Port 6 E1-IMB7-P6 Enclosure 1 Interconnect Enclosure 1 Interconnect Module 5/6 Port 7 E1-IMB5-P7 Module 7/8 Port 7...

  • Page 92: Infiniband Switch Module

    From Label Label Comment IB 24 Port Switch Enclosure 1 Interconnect Port 13 IB-SW1-P13 Module 7/8 Port 5 E1-IMB7-P5 IB 24 Port Switch Enclosure 1 Interconnect Port 14 IB-SW1-P14 Module 7/8 Port 6 E1-IMB7-P6 IB 24 Port Switch Enclosure 1 Interconnect Port 15 IB-SW1-P15 Module 7/8 Port 7...
  • Page 93 From Label Label Comment IB Switch 1 24 Port Enclosure 1 Interconnect IB-SW1-P4 E1-IMB5-P4 Switch Port 4 Module 5/6 Port 4 IB Switch 1 24 Port Enclosure 1 Interconnect IB-SW1-P5 E1-IMB7-P1 Switch Port 5 Module 7/8 Port 1 IB Switch 1 24 Port Enclosure 1 Interconnect IB-SW1-P6 E1-IMB7-P2...
  • Page 94 Wiring for Second External InfiniBand Switch From Label Label Comment IB Switch 2 24 Port Enclosure 1 Interconnect IB-SW2-P1 E1-IMB5-P5 Switch Port 1 Module 5/6 Port 5 IB Switch 2 24 Port Enclosure 1 Interconnect IB-SW2-P2 E1-IMB5-P6 Switch Port 2 Module 5/6 Port 6 IB Switch 2 24 Port Enclosure 1 Interconnect...

  • Page 95: D.13 One C7000 Enclosure With Single-Density Server Blades And The Hp Blc 4X Ddr Infiniband Gen2 Switch

    From Label Label Comment IB Switch 2 24 Port Enclosure 3 Interconnect IB-SW2-P22 E3-IMB7-P6 Switch Port 22 Module 7/8 Port 6 IB Switch 2 24 Port Enclosure 3 Interconnect IB-SW2-P23 E3-IMB7-P7 Switch Port 23 Module 7/8 Port 7 IB Switch 2 24 Port Enclosure 3 Interconnect IB-SW2-P24 E3-IMB7-P8...
  • Page 96 From Label Label Comment Enclosure 1 Interconnect Module 5/6 Port 12 Enclosure 1 Interconnect Module 5/6 Port 13 Enclosure 1 Interconnect Module 5/6 Port 14 Enclosure 1 Interconnect Module 5/6 Port 15 Enclosure 1 Interconnect Module 5/6 Port 16 Wiring for One c7000 Enclosure with Single-Density Server Blades, the HP BLc 4X DDR InfiniBand Gen2 Switch, and an External InfiniBand Switch From Label...

  • Page 97: D.14 Wiring For Two C7000 Enclosures With Single-Density Server Blades And The Hp Blc 4X Ddr Infiniband Gen2 Switch (Without An External Infiniband Switch)

    From Label Label Comment IB 24 Port Switch Port 14 IB-SW1-P14 N / A N / A IB 24 Port Switch Port 15 IB-SW1-P15 N / A N / A IB 24 Port Switch Port 16 IB-SW1-P16 N / A N / A IB 24 Port Switch Port 17...

  • Page 98: D.15 Wiring For Two Or Three C7000S With Single-Density Server Blades And Using The Hp Blc 4X Ddr Infiniband Gen2 Switch

    From Label Label Comments Enclosure 1 Enclosure 2 Interconnect Interconnect E1-IMB5-P5 Module 5/6 Port 5 Module 5/6 Port 5 E2-IMB5-P5 Enclosure 1 Enclosure 2 Interconnect Interconnect E1-IMB5-P6 Module 5/6 Port 6 Module 5/6 Port 6 E2-IMB5-P6 Enclosure 1 Enclosure 2 Interconnect Interconnect E1-IMB5-P7 Module 5/6 Port 7...
  • Page 99 Note: For one c7000 enclosure wiring tables, see Section D.13. Wiring for the First External InfiniBand Switch (IB-SW1) From Label Label Comment IB Switch 1 24 Port Enclosure 1 Interconnect Switch Port 1 IB-SW1-P1 Module 5/6 Port 1 E1-IMB5-P1 IB Switch 1 24 Port Enclosure 1 Interconnect Switch Port 2 IB-SW1-P2...

  • Page 100: Node

    From Label Label Comment IB Switch 1 24 Port Enclosure 3 Interconnect Switch Port 21 IB-SW1-P21 Module 5/6 Port 5 E3-IMB5-P5 IB Switch 1 24 Port Enclosure 3 Interconnect Switch Port 22 IB-SW1-P22 Module 5/6 Port 6 E3-IMB5-P6 IB Switch 1 24 Port Enclosure 3 Interconnect Switch Port 23 IB-SW1-P23...

  • Page 101: D.16 One C7000 Enclosure With Double-Density Server Blades And The Hp Blc 4X Ddr Infiniband Gen2 Switch (No External Infiniband Switch)

    From Label Label Comment IB Switch 2 24 Port Enclosure 2 Interconnect Switch Port 16 IB-SW2-P16 Module 5/6 Port 16 E2-IMB5-P16 IB Switch 2 24 Port Enclosure 3 Interconnect Switch Port 17 IB-SW2-P17 Module 5/6 Port 9 E3-IMB5-P9 IB Switch 2 24 Port Enclosure 3 Interconnect Switch Port 18 IB-SW2-P18...

  • Page 102: Switch And External Infiniband Switches

    From Label Label Comment Enclosure 1 Interconnect Enclosure 1 Interconnect Module 5/6 Port 6 E1-IMB5-P6 Module 7/8 Port 6 E1-IMB7-P6 Enclosure 1 Interconnect Enclosure 1 Interconnect Module 5/6 Port 7 E1-IMB5-P7 Module 7/8 Port 7 E1-IMB7-P7 Enclosure 1 Interconnect Enclosure 1 Interconnect Module 5/6 Port 8 E1-IMB5-P8 Module 7/8 Port 8...
  • Page 103 Wiring Table for the First InfiniBand Switch (IB-SW1) From Label Label Comment IB 24 Port Switch 1 Enclosure 1 Interconnect Port 1 IB-SW1-P1 Module 5/6 Port 1 E1-IMB5-P1 IB 24 Port Switch 1 Enclosure 1 Interconnect Port 2 IB-SW1-P2 Module 5/6 Port 2 E1-IMB5-P2 IB 24 Port Switch 1 Enclosure 1 Interconnect...
  • Page 104 From Label Label Comment IB 24 Port Switch 1 Port 23 IB-SW1-P23 Only used if the control node is IB 24 Port Switch 1 Control node InfiniBand IB-SW1-P24 Control-P1 a rack-mount server connected Port 24 to the InfiniBand fabric Wiring table for the Second InfiniBand Switch (IB-SW2) From Label Label...

  • Page 105: D.18 Wiring For A Configuration Of Two Or Three C7000 Enclosures With Double-Density Server Blades Using The Hp Blc 4X Ddr Infiniband Gen2 Switch And External Infiniband Switches

    From Label Label Comment IB 24 Port Switch 2 Port 20 IB-SW2-P20 IB 24 Port Switch 2 Port 21 IB-SW2-P21 IB 24 Port Switch 2 Port 22 IB-SW2-P22 IB 24 Port Switch 2 Port 23 IB-SW2-P23 Only used if the control node is IB 24 Port Switch 2 Control node InfiniBand IB-SW2-P24...
  • Page 106 From Label Label Comment IB Switch 1 24 Port Enclosure 2 Interconnect Switch Port 11 IB-SW1-P11 Module 5/6 Port 3 E2-IMB5-P3 IB Switch 1 24 Port Enclosure 2 Interconnect Switch Port 12 IB-SW1-P12 Module 5/6 Port 4 E2-IMB5-P4 IB Switch 1 24 Port Enclosure 2 Interconnect Switch Port 13 IB-SW1-P13...
  • Page 107 From Label Label Comment IB Switch 2 24 Port Enclosure 1 Interconnect Switch Port 8 IB-SW2-P8 Module 7/8 Port 8 E1-IMB7-P8 IB Switch 2 24 Port Enclosure 2 Interconnect Switch Port 9 IB-SW2-P9 Module 5/6 Port 5 E2-IMB5-P5 IB Switch 2 24 Port Enclosure 2 Interconnect Switch Port 10 IB-SW2-P10...
  • Page 108 From Label Label Comment IB Switch 3 24 Port Enclosure 1 Interconnect Switch Port 5 IB-SW3-P5 Module 7/8 Port 9 E1-IMB7-P9 IB Switch 3 24 Port Enclosure 1 Interconnect Switch Port 6 IB-SW3-P6 Module 7/8 Port 10 E1-IMB7-P10 IB Switch 3 24 Port Enclosure 1 Interconnect Switch Port 7 IB-SW3-P7...
  • Page 109 Wiring Table for the Fourth InfiniBand Switch (IB-SW4) From Label Label Comment IB Switch 4 24 Port Enclosure 1 Interconnect Switch Port 1 IB-SW4-P1 Module 5/6 Port 13 E1-IMB5-P13 IB Switch 4 24 Port Enclosure 1 Interconnect Switch Port 2 IB-SW4-P2 Module 5/6 Port 14 E1-IMB5-P14...
  • Page 110 From Label Label Comment IB Switch 4 24 Port Enclosure 3 Interconnect Switch Port 22 IB-SW4-P22 Module 7/8 Port 14 E3-IMB7-P14 IB Switch 4 24 Port Enclosure 3 Interconnect Switch Port 23 IB-SW4-P23 Module 7/8 Port 15 E3-IMB7-P15 IB Switch 4 24 Port Enclosure 3 Interconnect Switch Port 24 IB-SW4-P24...

  • Page 111: E Configuration Rules For Cpe Bladesystems

    E Configuration Rules for CPE BladeSystems This appendix provides the configuration and power distribution rules for CPE BladeSystem configurations. The following sections discuss: • CP Workgroup System device and interconnect bays (see Section E.1) • CP Workgroup System fan bays (see Section E.2) •...

  • Page 112: E.4 Cpe With C7000 Enclosure Configuration Device And Interconnect Bay Rules

    second, additional power strip is required for configurations that have an externally managed InfiniBand switch. CPE Configuration International North America CP Workgroup System basic One 32A PDU One 24A PDU CP Workgroup System with external One 32A PDU Two 24A PDUs control node and TFT7600 CP Workgroup System with SB40c One 32A PDU...

  • Page 113: E.5 Cpe With C7000 Fan Bay Rules

    The following table summarizes the use of the interconnect module bays for c7000 enclosures in HP Cluster Platform Express BladeSystem configurations with double-density server blades. Interconnect Module Bay 1 Interconnect Module Bay 2 HP GbE2c Module HP GbE2c Module Interconnect Module Bay 3 Interconnect Module Bay 4 Optional HP GbE2c Module (for external network) Not used...

  • Page 114: C7000 Psus

    Figure E-1 c7000 PSUs HP Cluster Platform Express supports high-voltage power connections (200V-240V). Power requirements can be met by using up to eight single phase PDU’s per enclosure as shown in the table below. PDU’s will be mounted in 0U positions. Number of Enclosures International US/Japan...

  • Page 115: F Cabling Tables For Rack-Mountable Servers

    F Cabling Tables for Rack-Mountable Servers This appendix provides the following cabling tables: • Ethernet and Gigabit Ethernet network cabling tables for rack-mountable servers (see Section F.1). • InfiniBand cabling tables for rack-mountable servers (see Section F.2). F.1 Ethernet and Gigabit Ethernet Network Cabling Tables This section provides the console and administrative network cabling tables for rack-mountable servers: •...

  • Page 116: F.1.2 In-Band Network Switch Administrative Network For 1-20 Nodes Using The Procurve 2824 Gigabit Ethernet Switch

    From Label Label Cable ProCurve 2824 Port 13 Admin-ES1-P13 Enclosure 3 Interconnect E3-IMB1-P21 Module 1 Port 21 ProCurve 2824 Port 14 Admin-ES1-P14 Enclosure 3 Interconnect E3-IMB1-P22 Only present if Module 1 Port 22 interconnect is GigE ProCurve 2824 Port 15 Admin-ES1-P15 Enclosure 3 Interconnect E3-IMB1-P23...

  • Page 117: F.1.3 In-Band Network Switch Administrative Network For 21-32 Nodes Using The Procurve 2848 Gigabit Ethernet Switch

    From Label Label Cable ProCurve 2824 Port 15 Admin-ES1-P15 Embedded NIC1 (eth0) in Node 07 Server07-NIC1 C7533A ProCurve 2824 Port 16 Admin-ES1-P16 Embedded NIC1 (eth0) in Node 06 Server06-NIC1 C7533A ProCurve 2824 Port 17 Admin-ES1-P17 Embedded NIC1 (eth0) in Node 05 Server05-NIC1 C7533A ProCurve 2824 Port 18...
  • Page 118 From Label Label Cable ProCurve 2848 Port 21 Admin-ES1-P21 Embedded NIC1 (eth0) in Node 17 Server17-NIC1 C7533A ProCurve 2848 Port 22 Admin-ES1-P22 Embedded NIC1 (eth0) in Node 16 Server16-NIC1 C7533A ProCurve 2848 Port 23 Not connected ProCurve 2848 Port 24 Not connected ProCurve 2848 Port 25 Admin-ES1-P25...

  • Page 119: F.1.4 In-Band Network Switch Administrative Network For 1-20 Nodes Using The Procurve 2626 Gigabit Ethernet Switch

    F.1.4 In-Band Network Switch Administrative Network for 1-20 Nodes Using the ProCurve 2626 Gigabit Ethernet Switch The following table shows the in-band network switch console network for 1-20 nodes, using the ProCurve 2626 Gigabit Ethernet network switch: From Label Label Cable ProCurve 2626 Port 1 Consol-ES1-P01...

  • Page 120: F.1.5 In-Band Network Switch Administrative Network For 21-32 Nodes Using The Procurve 2650 Gigabit Ethernet Switch

    F.1.5 In-Band Network Switch Administrative Network for 21-32 Nodes Using the ProCurve 2650 Gigabit Ethernet Switch The following table shows the in-band network switch console network for 21-32 nodes, using the ProCurve 2650 Gigabit Ethernet network switch: From Label Label Cable ProCurve 2650 Port 1 Not connected...

  • Page 121: F.2 Infiniband Cabling Tables For Rack-Mountable Servers

    From Label Label Cable ProCurve 2650 Port 34 Consol-ES1-P34 Embedded MP in Node 06 Server06-MP C7533A ProCurve 2650 Port 35 Not connected ProCurve 2650 Port 36 Not connected ProCurve 2650 Port 37 Consol-ES1-P37 Embedded MP in Node 05 Server05-MP C7533A ProCurve 2650 Port 38 Consol-ES1-P38 Embedded MP in Node 04...

  • Page 122: F.2.2 Using A Single Isr 9024 Interconnect To Support Up To 24 Nodes

    If more than one interconnect is present, they are joined together in a federated configuration. A typical cabling example of the federated cabling for two interconnects is shown in the following table: Downlink Ports Uplink Ports 9 – 12 21 – 24 In the cable labels, or cabling tables, you will see that both the origin and the destination for these federated link cables is an ISR 9024 port, such as IB-SW1-P24 to IB-SW2-P24.
  • Page 123 F.2.3 Using Two ISR 9024 Interconnects to Support 25-32 Nodes The following table shows the links for a cluster using two ISR 9024 interconnects, and supporting up to 25-32 nodes, back-to-back 2:1: Origin Destination Secondary Destination IB-SW1-P01 Server31-IB-P0 Server32-IB-P0 IB-SW1-P02 Server30-IB-P0 Server31-IB-P0 IB-SW1-P03...
  • Page 124 Origin Primary Destination Secondary Destination IB-SW2-P10 IB-SW1-P10 IB-SW2-P11 IB-SW1-P11 IB-SW2-P12 IB-SW1-P12 IB-SW2-P13 Server7-IB-P0 Server8-IB-P0 IB-SW2-P14 Server6-IB-P0 Server7-IB-P0 IB-SW2-P15 Server5-IB-P0 Server6-IB-P0 IB-SW2-P16 Server4-IB-P0 Server5-IB-P0 IB-SW2-P17 Server3-IB-P0 Server4-IB-P0 IB-SW2-P18 Server2-IB-P0 Server3-IB-P0 IB-SW2-P19 Server1-IB-P0 Server2-IB-P0 IB-SW2-P20 Control-IB-P0 Server1-IB-P0 IB-SW2-P21 IB-SW1-P20 IB-SW2-P22 IB-SW1-P21 IB-SW2-P23 IB-SW1-P22 IB-SW2-P24 IB-SW1-P23...
  • Page 125 Index Symbols 22U cabinet configuration c-Class enclosure BladeSystem, 43 22U example with one c3000 enclosure, 38 rack-mountable servers, 56 22U example with one c3000 enclosure without external 22U configuration example control node, 38 BladeSystem with c3000 enclosure, 38 22U example with one enclosure, 48 BladeSystem with one enclosure, 48 22U example with two enclosures, 48 BladeSystem with two enclosures, 48...
  • Page 126 configurations, 9 related information, 10 console, 25 documentation control n ode, 57 site preparation, 58 control node, 56 updates and release notes, 36 cooling, 56, 57 downlink, 122 Ethernet switches, 56, 57 example configuration, 56 optical media, 14 KVM, 56, 57 rack-mountable components, 55 testing, 58 enclosure...
  • Page 127 KVM console switch, 56 LEDs, 50, 58 power distribution unit BladeSystem requirements, 113 LAN, 26 c3000 BladeSystem requirements, 111 (see also local area network) power requirements c-Class enclosures, 114 link state, 24 power strip installation power, 50, 58 BladeSystem configurations, 16 legal notices and trademarks, 2 rack-mountable, 17 link, 25...
  • Page 128 operating system, 41, 51, 59 software management accessing server with KVM, 51 BladeSystem requirements, 51 Start-up (see installation) straps, 23 switch console, 13 ethernet, 56, 57 KVM, 56, 57 syntax wiring, 61 tables Ethernet cabling, 76, 116, 119 InfiniBand cabling, 122 testing, 58 TFT7600, 25 thermal, 56, 57...
  • Page 130 *A-CPCPE-1E* Printed in the US...

This manual is also suitable for:

Cluster platform workgroup systemCluster platform express

Table of Contents