About This Document This document covers the HP Integrity rx8640 and the HP 9000 rp8440 Server systems. This document does not describe system software or partition configuration in any detail. For detailed information concerning those topics, refer to the HP System Partitions Guide: Administration for nPartitions.
Intended Audience This document is intended to be used by customer engineers assigned to support the HP Integrity rx8640 and HP 9000 rp8440 servers. Publishing History The following publishing history identifies the editions and release dates of this document. Updates are made to this document on an unscheduled, as needed, basis.
Diagnostics and Event Monitoring: Hardware Support Tools Complete information about HP hardware support tools, including online and offline diagnostics and event monitoring tools, is at the http://docs.hp.com/hpux/diag/ Web site. This site has manuals, tutorials, FAQs, and other reference material.
Page 13
A caution provides information required to avoid losing data or avoid losing system functionality. NOTE A note highlights useful information such as restrictions, recommendations, or important details about HP product features. • Commands and options are represented using this font. •...
HP Encourages Your Comments Hewlett-Packard welcomes your feedback on this publication. Please address your comments to edit@presskit.rsn.hp.com and note that you will not receive an immediate reply. All comments are appreciated.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview The HP Integrity rx8640 server and the HP 9000 rp8440 server are members of the HP business-critical computing platform family of mid-range, mid-volume servers, positioned between the HP Integrity rx7640, HP 9000 rp7440 and HP Integrity Superdome servers.
Page 16
HP Integrity rx8640 and HP 9000 rp8440 Server Overview IMPORTANT The HP Integrity rx8640 and the HP 9000 rp8440 servers are both sx2000-based systems and share common hardware and technology throughout. The server is a 17U high, 16-socket symmetric multiprocessor (SMP) rack-mount or standalone server.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Detailed Server Description The following section provides detailed intormation about the server components. Figure 1-1 16-Socket Server Block Diagram Cell Board Cell Board Cell Board Cell Board memory...
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Dimensions and Components The following section describes server dimensions and components. Figure 1-2 Server (Front View With Bezel) Chapter 1...
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Figure 1-3 Server (Front View Without Bezel) Removable Media Power Drives Switch Hard Disk PCI Power Drives Supplies Front OLR Fans Bulk Power Supplies The server has the following dimensions: •...
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Figure 1-4 Server (Rear View) PCI OLR Fans PCI I/O Card Section Core I/O Cards Rear OLR Fans AC Power Receptacles Access the PCI-X I/O card section, located toward the rear by removing the top cover.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Front Panel Front Panel Indicators and Controls The front panel, located on the front of the server, includes the power switch. Refer to Figure 1-5. Enclosure Status LEDs The following status LEDs are on the front panel: •...
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Cell Board The cell board, illustrated in Figure 1-6, contains the processors, main memory, and the CC application specific integrated circuit (ASIC) which interfaces the processors and memory with the I/O. The CC is the heart of the cell board, providing a crossbar connection that enables communication with other cell boards in the system.
Page 23
See Figure 1-7 on page 24 for the locations on the cell board for installing processor modules. Unlike previous HP cell based systems, the server cell board does not require that a NOTE termination module be installed at the end of an unused FSB. System firmware is allowed to disable an unused FSB in the CC.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Table 1-1 Cell Board CPU Module Load Order Number of CPU Socket 2 Socket 3 Socket 1 Socket 0 Modules Installed Empty slot Empty slot Empty slot CPU installed...
CPU 0 DIMMs The memory DIMMs used by the server are custom designed by HP. Each DIMM contains DDR-II SDRAM memory that operates at 533 MT/s. Industry standard DIMM modules do not support the high availability and shared memory features of the server. Therefore, industry standard DIMM modules are not supported.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Table 1-3 DIMM Load Order Number of DIMMs DIMM Location Action Taken Quad Location Installed on Cell Board 2 DIMMs = 1 rank Install first 0A and 0B...
Page 28
A server complex can contain one or more nPartitions, enabling the hardware to function as a single system or as multiple systems. Partition configuration information is available on the Web at: NOTE http://docs.hp.com Refer to HP System Partitions Guide: Administration for nPartitions for details. Chapter 1...
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Internal Disk Devices Figure 1-10 shows the top internal disk drives connect to cell 0 through the core I/O for cell 0, in a server cabinet. The bottom internal disk drives connect to cell 1 through the core I/O for cell 1.
Page 30
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Table 1-5 Hard Disk Drive Path (Continued) Hard Drive Path Slot 2 drive 1/0/0/2/0.6.0 Slot 3 drive 1/0/0/3/0.6.0 Chapter 1...
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description System Backplane The system backplane board contains the following components: • Two crossbar chips (XBC) • Clock generation logic • Preset generation logic • Power regulators • Two local bus adapter (LBA) chips that create internal PCI buses for communicating with the core I/O card.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description The two LBA PCI bus controllers on the system backplane create the PCI bus for the core I/O cards. You must shut down the partition for the core I/O card before removing the card.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description SBA link protocol into “ropes.” A rope is defined as a high-speed, point-to-point data bus. The SBA can support up to 16 of these high-speed bidirectional rope links for a total aggregate bandwidth of approximately 11.5 GB/s.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description IMPORTANT Always refer to the PCI card’s manufacturer for the specific PCI card performance specifications. PCI, PCI-X mode 1, and PCI-X mode 2 cards are supported at different clock speeds.
HP Integrity rx8640 and HP 9000 rp8440 Server Overview Detailed Server Description Core I/O Card Up to two core I/O cards can be plugged into the server. Two core I/O cards enable two I/O partitions to exist in the server. The server can have up to two partitions. When a Server Expansion Unit with two core I/O cards is attached to the server, two additional partitions can be configured.
Installing the System Inspect shipping containers when the equipment arrives at the site. Check equipment after the packing has been removed. This chapter discusses how to receive, inspect and install the server. Chapter 2...
On a pallet with a wheel kit for installation as a standalone server HP shipping containers are designed to protect their contents under normal shipping conditions. A tilt indicator is installed on each carton shipped. The tilt indicator has two windows, and each window under normal conditions will show four beads present.
Installing the System Receiving and Inspecting the Server Cabinet Step 2. Lift the cardboard top cap from the shipping box. Refer to Figure 2-1, Figure 2-1 Removing the Polystraps and Cardboard Step 3. Remove the corrugated wrap from the pallet. Step 4.
Installing the System Receiving and Inspecting the Server Cabinet Figure 2-2 shows one ramp attached to the pallet on either side of the cabinet with NOTE each ramp secured to the pallet using two bolts. In an alternate configuration, the ramps are secured together on one side of the cabinet with one bolt.
Installing the System Receiving and Inspecting the Server Cabinet Step 6. Remove the six bolts from the base that attaches the rack to the pallet. Figure 2-3 Preparing to Roll Off the Pallet WARNING Be sure that the leveling feet on the rack are raised before you roll the rack down the ramp, and any time you roll the rack on the casters.
Installing the System Receiving and Inspecting the Server Cabinet Securing the Cabinet When in position, secure and stabilize the cabinet using the leveling feet at the corners of the base (Figure 2-4). Install the anti-tip mechanisms on the bottom front and rear of the rack. Figure 2-4 Securing the Cabinet Chapter 2...
A6093A-11. This is the same accessory kit used for the HP 9000 rp8400 server. Rack-Mount System Installation Information is available to help with rack-mounting the server. This list is intended to guide the HP Installation Specialist to the documentation that has been written by the Rack and Power team.
Use this procedure only if no HP approved lift is available. CAUTION This procedure must only be performed by four qualified HP Service Personnel utilizing proper lifting techniques and procedures. Step 1. Follow the instructions on the outside of the service packaging to remove the banding and cardboard top from the server pallet.
25 lb/12 kg. The ability to break the lifter down makes it easy to transport from the office to the car and then to the customer site. Documentation for the RonI lifter has been written by RonI and is available on the HP Cybrary: http://cybrary.inet.cpqcorp.net/ARCHIVE/PUBS/USERS/LIFTOFLEX-17000.pdf. Complete details on how to assemble the lifter, troubleshoot the lifter, and maintain the lifter are provided by RonI.
Installing the System Using the RonI Model 17000 SP 400 Lifting Device Step 3. Insert the lifter forks between the cushions (Figure 2-5). Figure 2-5 Positioning the Lifter to the Pallet Position the Lifter Forks at These Insertion Points Step 4. Carefully roll the lift forward until it is fully positioned against the side of the server. Chapter 2...
Step 6. Carefully roll the lifter and server away from the pallet. Do not raise the server any higher than necessary when moving it over to the rack. Step 7. Follow the HP J1528B Rack Integration Kit Installation Guide to complete these steps: •...
Installing the Wheel Kit Compare the packing list (Table 2-1) with the contents of the wheel kit before beginning the installation. For a more updated list of part numbers, go to the HP Part Surfer web site at: http://www.partsurfer.hp.com. Table 2-1...
Installing the System Installing the Wheel Kit Use the following procedure to install the wheel kit. Step 1. Cut and remove the polystrap bands securing the server to the pallet. Step 2. Lift the carton top from the cardboard tray resting on the pallet. Step 3.
Installing the System Installing the Wheel Kit Step 5. Remove the front cushion only (Figure 2-8). Do not remove any other cushions until further instructed. Figure 2-8Removing Cushion from Front Edge of Server Rear Cushion Side Cushion Front Cushion Step 6. Open the wheel kit box and locate the two front casters. The front casters are shorter in length than the two rear casters.
Installing the System Installing the Wheel Kit Step 7. Remove two of the eight screws from the plastic pouch. Attach one wheel caster to the front of the server (Figure 2-9). Figure 2-9Attaching a Caster Wheel to the Server Front Casters Step 8.
Installing the System Installing the Wheel Kit Step 12. The ramp has two ppredrilled holes (Figure 2-10). Attach the ramp to the edge of the pallet using the two screws taped to the ramp. Figure 2-10Attaching the Ramp to the Pallet Pre-drilled holes Chapter 2...
Installing the System Installing the Wheel Kit Step 13. Remove the two side cushions from the server, (Figure 2-11) and unfold the cardboard tray so that it lays flat on the pallet. Figure 2-11Removing Side Cushion from Server Side Cushion Ramp Step 14.
Installing the System Installing the Wheel Kit Step 16. Insert the slot on the caster cover into the front caster (Figure 2-12). Secure the caster cover to the server by tightening the captive screw on the cover at the rear of the server. Repeat for the second caster cover.
Installing the System Installing the Wheel Kit Step 17. Snap the bezel cover into place on the front of the server. Figure 2-13 shows the server cabinet with the wheel kit installed. Figure 2-13Completed Wheel Kit Installation Attached Caster Cover Chapter 2...
Installing the System Installing the Top and Side Covers Installing the Top and Side Covers This section describes the procedures for installing the top and side server covers. NOTE You may be need to remove existing top and side covers installed on the server before installing the covers shipped with the wheel kit.
Installing the System Installing the Top and Side Covers Step 5. Place the cover in a safe location. Figure 2-15 Top Cover Detail Retaining Screws Installing the Top Cover The following section describes the procedure for installing the top cover. Step 1.
Installing the System Installing the Top and Side Covers Step 2. Loosen the blue retaining screw securing the cover to the chassis (Figure 2-16). Figure 2-16 Side Cover Detail Retaining Screw Step 3. Slide the cover from the chassis toward the rear of the system. Step 4.
Documentation for installation will accompany the PDU. The documentation can also be found at the external Rack Solutions Web site at: http://www.hp.com/racksolutions This PDU might be referred to as a Relocatable Power Tap outside HP. The PDU installation kit contains the following: •...
The disk drives are located in the front of the chassis (Figure 2-17). The hard disk drives are hot-plug drives. A list of replacement disk drives for the server is in Appendix A of the HP Service Guide. The list contains both removable media disk drives and hard disk drives.
Installing the System Installing Additional Cards and Storage Step 3. Press the front locking latch to secure the disk drive in the chassis. Step 4. If the server OS is running, spin up the disk by entering one of the following commands: #diskinfo -v /dev/rdsk/cxtxdx #ioscan -f Removable Media Drive Installation...
Page 62
Installing the System Installing Additional Cards and Storage Step 6. Latch the front locking tab to secure the drive in the chassis. Chapter 2...
The rx8640 server supports a number of PCI and PCI-X I/O cards. Table 2-2 lists the cards currently supported on the server. For a more updated list of part numbers, go to the HP Part Surfer web site at: http://www.partsurfer.hp.com.
Page 64
Installing the System Installing Additional Cards and Storage Table 2-2 HP Integrity rx8640 Server PCI-X I/O Cards (Continued) HP-UX ® ® Part Number Card Description Windows Linux 11i V2 AB286C PCI-X 2-Port 4X InfiniBand HCA (HPC)-RoHS AB287A 10 GbE - Fiber (PCI-X 133)
Channel is NOT supported. 2. Boot support is limited to OS installation, updating, and repairing media. HP 9000 rp8440 Supported PCI/PCI-X I/O Cards Table 2-3 lists the PCI/PCI-X cards supported in the rp8440 server. Several cards lose boot functionality when upgrading the server. The customer must use another I/O card to retain boot functionality if the customer’s card is not supported in the server.
Page 66
Installing the System Installing Additional Cards and Storage Table 2-3 HP 9000 rp8440 Server PCI-X I/O Cards (Continued) HP-UX Part Number Card Description 11i V1 PCI-X 1000b-T GigE/2G FC Combo A9784A 2-port Smart Array 6402 (U320) A9890A 4-port Smart Array 6402 (U320)
Interface Card OL* Support Guide. Downloading Drivers The following website contains technical support for a wide range of HP Integrity servers, including the capture of the latest drivers required for various hardware components. Refer to this site regarding necessary drivers for supported PCI cards.
Installing the System Installing Additional Cards and Storage This procedure describes how to perform an online addition of a PCI card using the attention button for cards whose drivers support online addition or replacement (OLAR). The attention button is also referred to as the doorbell.
The A6869B VGA/USB PCI card can be installed into any slot in a PCI/PCI-X backplane. IMPORTANT If you are installing the A6869B in HP servers based on the sx1000 chipset, such as HP Superdome, rx7620 or rx8620, the system firmware must be updated to a minimum revision of 3.88.
Installing the System Installing Additional Cards and Storage Figure 2-20 PCI/PCI-X Card Location PCI/PCI-X Cards IMPORTANT Some PCI I/O cards, such as the A6869B VGA/USB PCI card, cannot be added or replaced online (while Windows remains running). For these cards, you must shut down Windows on the nPartition before performing the card replacement or addition.
Page 71
* Ensure system FW supports the VGA/USB PCI card. * Ensure graphics resolution is compatible and set correctly. Reference URL There are many features available for HP Servers at this website including links to download Windows Drivers. HP Servers Technical Support http://www.hp.com/support/itaniumservers...
Installing the System System Console Selection System Console Selection Each operating system requires that the correct console type be selected from the firmware selection menu. The following section describes how to determine the correct console device. If an operating system is being installed or the system configuration is being changed the system console setting must be checked to ensure it matches the hardware and OS.
Vt100, Vt100+, VtUtf8) and deselect everything else. If you choose either a system or MP serial port HP recommends that you use a vt100+ capable terminal device.
Installing the System Cabling and Powering On the Server Cabling and Powering On the Server After the system has been unpacked and moved into position, it must be connected to a source of AC power. The AC power must be checked for the proper voltage before the system is powered up. This chapter describes these activities.
Installing the System Cabling and Powering On the Server Table 2-4 provides single phase voltage measurement examples specific to the geographic region where these measurements are taken. Table 2-4 Single Phase Voltage Examples Japan North America Europe L1 to L2 210 V 208 V or 240 V 230 V...
Installing the System Cabling and Powering On the Server 2. Insert the probe into the ground pin for A0. 3. Insert the other probe into the ground pin for A1. 4. Verify that the measurement is between 0-5 V AC. If the measurement is 5 V or greater, escalate the situation.
Page 77
Installing the System Cabling and Powering On the Server SHOCK HAZARD WARNING Risk of shock hazard while testing primary power. Use properly insulated probes. Be sure to replace access cover when finished testing primary power. Step 1. Measure the voltage between A0 and A1 as follows: 1.
NOTE information on connecting the server and checking the UPS output voltage. UPS user documentation is shipped with the UPS. Documentation is also available at: http://www.hp.com/racksolutions Step 1. Verify that site power is Step 2. Open the site circuit breakers.
Installing the System Cabling and Powering On the Server Do not set site AC circuit breakers serving the processor cabinets to WARNING before verifying that the cabinet has been wired into the site AC power supply correctly. Failure to do so can result in injury to personnel or damage to equipment when AC power is applied to the cabinet.
Installing the System Cabling and Powering On the Server • B1 input provides power to BPS 3, BPS 4, and BPS 5 For information on how input power cords supply power to each BPS, refer to Figure 2-27. Figure 2-27 Distribution of Input Power for Each Bulk Power Supply WARNING Voltage is present at various locations within the server whenever a power source is...
Installing the System Cabling and Powering On the Server A minimum of two BPS are required to bring up a single cell board installed in the server. There is no N+1 capability in this case. Refer to Table 2-5 for configurations of multiple cell boards using N+1. Table 2-5 BPS-to-Cell Board Configuration to Maintain N+1 Number of Cell...
Installing the System Cabling and Powering On the Server Installing The Line Cord Anchor (rack mounted servers) The line cord anchor is attached to the rear of the server when rack mounted. It provides a method to secure the line cords to the server preventing accidental removal of the cords from the server. Four Cell Server Installation (rp8400, rp8420, rp8440, rx8620, rx8640) There are pre-drilled holes and pre-installed captive nuts in the server chassis.
Installing the System Cabling and Powering On the Server 4. Use the supplied Velcro straps to attach the cords to the anchor. Refer to Figure 2-29, “Line Cord Anchor and Velcro straps,” Figure 2-29 Line Cord Anchor and Velcro straps Velcro Straps Chapter 2...
MP Core I/O Connections Each HP server has at least one core I/O card installed. Each core I/O card has a management processor (MP). If two core I/O cards are installed, this allows for two partitions to be configured or enables core I/O redundancy in a single partition configuration.
Page 85
Step 5. Click OK to close the Connection Setup window. Step 6. Pull down the Setup menu and select Terminal (under the Emulation tab). Step 7. Select the VT100 HP terminal type. Step 8. Click Apply. This option is not highlighted if the terminal type you want is already selected.
Installing the System Cabling and Powering On the Server Step 1. Connect one end of a null modem cable (9-pin to 9-pin) (Part Number 5182-4794) to the RS-232 Local port on the core I/O card (the DB9 connector located at the bottom of the core I/O card). Refer to Figure 2-30.
Installing the System Cabling and Powering On the Server Before powering up the server cabinet for the first time: Step 1. Verify that the AC voltage at the input source is within specifications for each server cabinet being installed. Step 2. If not already done, power on the serial display device. The preferred tool is the CE Tool running Reflection 1.
Installing the System Cabling and Powering On the Server Figure 2-32 BPS LED Location BPS LED Location Step 3. Log in to the MP: 1. Enter Admin at the login prompt. (This term is case-sensitive.) It takes a few moments for the MP> prompt to appear. If the MP> prompt does not appear, verify that the laptop serial device settings are correct: 8 bits, no parity, 9600 baud, and None for both Receive and Transmit.
Installing the System Cabling and Powering On the Server The MP Main Menu is displayed: Figure 2-33 MP Main Menu Configuring LAN Information for the MP This section describes how to set and verify the server management processor (MP) LAN port information. LAN information includes the MP network name, the MP IP address, the subnet mask, and gateway address.
This is the host name for the MP customer LAN. The name can be up to 64 characters long and can include alpha numerics, -dash (-), under score (_), period (.), or a space ( ). HP recommends that the name be a derivative of the complex name, for example, Acme.com_MP.
NOTE The MP has a separate LAN port from the system LAN port. It requires a separate LAN drop, IP address, and networking information from that of the port used by HP-UX. Before starting this procedure, gather the following information: •...
Installing the System Cabling and Powering On the Server Step 4. Type sa at the MP:CM> prompt to display and set MP remote access. Figure 2-36 Example sa Command Step 5. Launch a Web browser on the same subnet using the IP address for the MP LAN port. Step 6.
Installing the System Cabling and Powering On the Server Step 7. Select the emulation type you want to use. Step 8. Log in to the MP when the login window appears. Access to the MP via a Web browser is now possible. Verifying the Presence of the Cell Boards To perform this activity, either connect to the management processor (MP) over the customer console or connect the CE Tool (laptop) to the RS-232 Local port on the MP.
If you are using a LAN crossover cable with the laptop, review server activity for each partition configured while the server powers on and boots. You can open Windows for the complex and for each partition. HP recommends that at least two windows be opened: Step 1.
Page 95
Installing the System Cabling and Powering On the Server 1. Open a separate Reflection window and connect to the MP. 2. From the MP Main Menu, select the VFP command with the s option. Step 2. A window showing activity for a single partition. To display activity for each partition as it powers on: Step 1.
Page 96
Once the parameters have been verified, enter x to return to the EFI Main Menu. Booting HP-UX Using the EFI Shell If the Instant Ignition was ordered, HP-UX will have been installed in the factory at the Primary Path address. If HP-UX is at a path other than the Primary Path, do the following: Step 1.
CPUs actually purchased. These Instant Capacity CPUs reside in the purchased system, but they belong to HP and therefore are HP assets. A nominal “Right-To-Access Fee” is paid to HP for each Instant Capacity processor in the system. At any time, any number of Instant Capacity CPUs can be “activated.”...
Installing the System Cabling and Powering On the Server Table 2-6 Factory-Integrated Installation Checklist Procedure In-process Completed Initials Comments Initials Comments Obtain LAN information Verify site preparation Site grounding verified Power requirements verified Check inventory Inspect shipping containers for damage Unpack cabinet Allow proper clearance Cut polystrap bands...
Page 99
Installing the System Cabling and Powering On the Server Table 2-6 Factory-Integrated Installation Checklist (Continued) (Continued) Procedure In-process Completed Adjust leveling feet Install anti tip plates Inspect cables for proper installation Set up CE tool and connect to Remote RS-232 port on MP Apply power to cabinet (Housekeeping) Check power to BPSs...
Page 100
Installing the System Cabling and Powering On the Server Table 2-6 Factory-Integrated Installation Checklist (Continued) (Continued) Procedure In-process Completed Set up network services (if required) Enable Instant Capacity (if available) Final inspection of circuit boards Final inspection of cabling Area cleaned and debris and packing materials disposed of Tools accounted for Parts and other items...
Index ac power housekeeping power input voltage check AC power inputs I/O Subsystem iCOD definition email requirements initial observations ASIC interval one interval three interval two inspecting for damage backplane installation mass storage checklist system warranty BPS (Bulk Power Supply) IP address Bulk Power Supplies default...
Page 102
Index password Processor Dependent Code power applying cabinet cabinet switch housekeeping plugs requirement sources power supplies processor service Processor Dependent Code processors pwrgrd (Power Grid) command rank Reflection 1 serial display device connecting recommended windows setting parameters server block diagram front panel service processor Standby power LED...
Need help?
Do you have a question about the Integrity rx8640 and is the answer not in the manual?
Questions and answers