IBM System Cluster 1350 Installation And Service Manual
  1. Manuals
  2. Brands
  3. IBM Manuals
  4. Network Hardware
  5. System Cluster 1350
  6. Installation and service manual

IBM System Cluster 1350 Installation And Service Manual

Hide thumbs Also See for System Cluster 1350:
Table of Contents

Advertisement

Quick Links

Download this manual
IBM System Cluster 1350
Installation and Service Guide

Advertisement

Table of Contents
loading

Related Manuals for IBM System Cluster 1350

Summary of Contents for IBM System Cluster 1350

  • Page 1 IBM System Cluster 1350 Installation and Service Guide...
  • Page 3 IBM System Cluster 1350 Installation and Service Guide...
  • Page 4 Note: Before using this information and the product it supports, read the general information in “Safety” on page v and Appendix C, “Notices,” on page 35. Fourteenth edition, May 2007 © Copyright International Business Machines Corporation 2007. All rights reserved. US Government Users Restricted Rights – Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.

  • Page 5: Table Of Contents

    Installing cables and checking connections in the expansion cabinets . . 23 Installing cables and checking connections in the primary cabinet . . 24 Turning on the power to the expansion cabinets . . 24 © Copyright IBM Corp. 2007...
  • Page 6 Japanese Voluntary Control Council for Interference (VCCI) statement . . 40 Appendix D. Declaration of IBM product noise emission values ... 41 Appendix E. International License Agreement for Non-Warranted Programs ..43 Part 1 - General Terms .

  • Page 7: Safety

    Safety For general information concerning safety, refer to Electrical Safety for IBM Customer ® Engineers, S229-8124. For a copy of the publication, contact your IBM account representative or the IBM branch office serving your locality. Enterprise rack safety information: Read the safety notices in the manual provided with the Enterprise rack before beginning work.
  • Page 8 IBM Safety Information book that comes with your server. For example, if a caution statement begins with a number 1, translations for that caution statement appear in the IBM Safety Information book under statement 1. Be sure to read all caution and danger statements in this documentation before performing the instructions.
  • Page 9 Statement 1: DANGER Electrical current from power, telephone, and communication cables is hazardous. To avoid a shock hazard: v Do not connect or disconnect any cables or perform installation, maintenance, or reconfiguration of this product during an electrical storm. v Connect all power cords to a properly wired and grounded electrical outlet. v Connect to properly wired outlets any equipment that will be attached to this product.
  • Page 10 If you install a strain-relief bracket option over the end of the power cord that is connected to the device, you must connect the other end of the power cord to an easily accessible power source. viii IBM System Cluster 1350 Installation and Service Guide...
  • Page 11 Statement 7: CAUTION: If the device has doors, be sure to remove or secure the doors before moving or lifting the device to avoid personal injury. The doors will not support the weight of the device. Statement 8: CAUTION: Never remove the cover on a power supply or any part that has the following label attached.
  • Page 12 Statement 16: CAUTION: Some accessory or option board outputs exceed Class 2 or limited power source limits and must be installed with appropriate interconnecting cabling in accordance with the national electric code. IBM System Cluster 1350 Installation and Service Guide...
  • Page 13 Statement 19: CAUTION: The power-control button on the device does not turn off the electrical current supplied to the device. The device also might have more than one connection to dc power. To remove all electrical current from the device, ensure that all connections to dc power are disconnected at the dc power input terminals.
  • Page 14 Pack the rack cabinet in the original packaging material, or equivalent. Also, lower the leveling pads to raise the casters off of the pallet and bolt the rack cabinet to the pallet. IBM System Cluster 1350 Installation and Service Guide...

  • Page 15: Handling Static-Sensitive Devices

    DANGER v Do not extend more than one sliding device at a time. v The maximum allowable weight for devices on slide rails is 80 kg (176 lb.). Do not install sliding devices that exceed this weight. v Always lower the leveling pads on the rack cabinet. v Always install stabilizer brackets on the rack cabinet.

  • Page 16: Notices And Statements Used In This Document

    Notices and statements used in this document The caution and danger statements that appear in this document are also in the multilingual Safety Information document on the IBM BladeCenter Documentation CD. Each statement is numbered for reference to the corresponding statement in the Safety Information document.

  • Page 17: Chapter 1. System Overview

    Chapter 1. System overview ® This chapter provides an overview of the IBM System Cluster 1350 software components, hardware components, and related documentation. The Cluster 1350 uses two types of cabinets: primary and expansion. A cabinet is called primary if it contains the management node and console monitor. An expansion cabinet can contain storage nodes or mass-storage devices as well as computing nodes, called cluster nodes;...
  • Page 18 1-U blank Cluster Nodes System x3550 Management Node System x3650 KVM switch Monitor 1-U blank 1-U blank 1 Gigabit Ethernet switch Serial Terminal Servers 1-U blank Gigabit Ethernet switch Cluster Nodes System x3550 IBM System Cluster 1350 Installation and Service Guide...
  • Page 19 The following figure shows how the node numbering scheme maps to other expansion cabinets..... blank blank blank blank blank blank blank blank blank blank Cluster blank nodes System x3550 1-U blank Serial Terminal Server 1-U blank Cluster Nodes System x3550 Chapter 1.

  • Page 20: Cluster Components

    This section describes the components in the Cluster 1350. Cluster components include: v Cluster nodes v Management node v Storage nodes v Storage servers v Storage expansion units v Fibre Channel adapters, switches, and expansion cards v Hard disk drives IBM System Cluster 1350 Installation and Service Guide...

  • Page 21: Cluster Nodes

    Linux. v IBM System x3650 server v IBM System x3655 server You can also use a 326m server or the IBM BladeCenter Advanced Management Module as the management node in a cluster environment running a 64-bit Linux operating system.

  • Page 22: Storage Servers

    Hard disk drives The cluster supports the following hard disk drives: v IBM Fibre Channel 73.4 GB disk drive module (10 000 rpm) v IBM Fibre Channel 146.8 GB disk drive module (10 000 rpm) v IBM Fibre Channel 300 GB disk drive module (10 000 rpm) v IBM Fibre Channel 36.4 GB disk drive module (15 000 rpm)

  • Page 23: Transceivers

    Small Form Factor (SFF) 36 GB SAS hard disk drive (2.5 inches) v SFF 146 GB SAS hard disk drive (2.5 inches) v IBM 300 GB SAS hard disk drive (3.5 inches and 15 000 rpm) v IBM 500 GB SATA hot-swap hard disk drive (3.5 inches and 7200 rpm) v IBM 750 GB SATA hot-swap hard disk drive (3.5 inches and 7200 rpm)

  • Page 24: Kvm Switches

    Note: The Force 10 E1200 Terascale DC chassis bundle and the Force 10 5-Slot AC rectifier chassis is installed by an IBM service representative but the customer is required to have a licensed electrician available to make the initial connection and service connections of these devices.

  • Page 25: 10 Gigabit Ethernet Switches

    Nortel L2/L3 Copper Gigabit Ethernet Switch Module for IBM BladeCenter 10 Gigabit Ethernet switches The Cluster 1350 uses the following switches: v SMC 8708L2 Tiger IV (8-port) 10 Gb Ethernet Switch Module for IBM BladeCenter v Nortel High-Speed 10 Gb Ethernet Switch Module for IBM BladeCenter...
  • Page 26 Myrinet 14-U, 20-slot spine enclosure v Myricom 14-U, 10 Gb CLOS switch bundle (128-ports) v Myricom 14-U, 10 Gb Leaf switch bundle v M3-4SW32-16Q line card (16-ports quad) v M3-THRU-16Q (spine thru module) IBM System Cluster 1350 Installation and Service Guide...

  • Page 27: Myrinet Bladecenter Connectivity

    These updates are available from the IBM Web site at http://www.ibm.com/systems/support/. To remove and configure a cluster component, see the documentation that comes with the component.
  • Page 28 IBM System Cluster 1350 Installation and Service Guide...

  • Page 29: Chapter 2. Cabinet Placement And Intercabinet Cabling

    An aisle width of 122 cm (48 inches) might be more appropriate if you want to make sure that you have enough room to move the rack to gain access to the sides for servicing the PDUs. © Copyright IBM Corp. 2007...
  • Page 30 See “Installing a stability kit” on page 16 for information about installing the stability kit that comes with each cabinet. See “Engaging the side stabilizers” on page 16 for information about engaging the side stabilizers. IBM System Cluster 1350 Installation and Service Guide...

  • Page 31: Types Of Intercabinet Cabling

    See the packing slip and the cabinet labels to verify that all cabinets are in their correct locations. v If you have purchased an IBM Rear Door Heat eXchanger, make sure that you have prepared the installation area with the proper fluid access, fluid connections, and fluid drainage.

  • Page 32: Installing A Stability Kit

    Installing a stability kit A stability kit (IBM part number 31L8305), containing one stability kit, is included with the 1410 rack. Install the stability kit when the rack is at the final installation location. Figure 3 shows the attachment of the stability kit.
  • Page 33 distances in all four directions indicate the area around the rack (minus covers) necessary to distribute the weight beyond the perimeter of the rack. Weight-distribution areas must not overlap with adjacent computer equipment weight-distribution areas. You must also take into consideration the additional weight of the cables.

  • Page 34: Preparing A Rear Door Heat Exchanger

    Preparing a Rear Door Heat eXchanger If you purchased an IBM Rear Door Heat eXchanger with your Cluster 1350, it is attached to the rack unit by an IBM service representative during the hardware installation. After a door is installed, the customer is responsible for filling the fluid, draining the fluid, and connecting or disconnecting the plumbing connections when the unit arrives or is replaced by an IBM service representative.

  • Page 35: Chapter 3. Cabling The Cluster 1350

    Myrinet switch (2 Gb or 4 Gb) for communication with cluster and storage nodes. The following options are available for the secondary cluster VLAN: v 10/100/1000 Ethernet connection v 2 Gb or 4 Gb Myrinet connection © Copyright IBM Corp. 2007...

  • Page 36: Connecting The Cables

    The Myrinet high-speed switch provides an optional 2 Gb optical network for communications between cluster nodes and storage nodes. 10/100/1000 Ethernet cabling The 10/100/1000 Ethernet switch provides an optional 10/100/1000 network for communications between cluster nodes and storage nodes. IBM System Cluster 1350 Installation and Service Guide...

  • Page 37: Fibre-Channel Cabling

    Fibre-channel cabling Fibre channel is used to connect storage nodes to storage servers and to connect storage servers to storage expansion units. KVM cabling The KVM switch allows a maximum of eight connections. Use the following guidelines for cabling the KVM switch: v Use the information on each end of each cable to create a site map.

  • Page 38: Voltaire Infiniband Switch Router Cabling

    This identifies the replacement cable as belonging to this harness. 6. Label the replacement cable so it is clearly identified as a replacement. IBM System Cluster 1350 Installation and Service Guide...

  • Page 39: Chapter 4. Checking The Cluster 1350 Cabling Process

    Chapter 4. Checking the Cluster 1350 cabling process The IBM System Cluster 1350 comes without an operating system installed unless the option is purchased that includes a preloaded operating system. An IBM customer service representative (CSR) performs the hardware cabling process then the customer performs the operating system and device software installation unless a service contract is purchased that includes the software installation.

  • Page 40: Installing Cables And Checking Connections In The Primary Cabinet

    POST with no errors. During the startup process make sure that the PXE boot agent utility program attempts to run. If it does not, press F1 to start the Configuration/Setup utility program and add Network as IBM System Cluster 1350 Installation and Service Guide...

  • Page 41: Verifying The Hardware Installation

    You can also use LCIT to help you locate nodes that do not start as expected. For more information about using LCIT, see the User’s Guide that is located on the CD-ROM that comes with your system and located at http://www.ibm.com/ systems/support/...

  • Page 42: Related Topics

    Related topics See Appendix A, “Error and event logs,” on page 29. IBM System Cluster 1350 Installation and Service Guide...

  • Page 43: Chapter 5. Accessing The Cluster From A Remote Location

    For the terminal server network, the output includes the console server host name and the console port number to which the node is © Copyright IBM Corp. 2007...

  • Page 44: Related Topics

    To display the management server, at any node console prompt, type: mgmtsvr Related topics v Chapter 4, “Checking the Cluster 1350 cabling process,” on page 23 v Appendix A, “Error and event logs,” on page 29 IBM System Cluster 1350 Installation and Service Guide...

  • Page 45: Appendix A. Error And Event Logs

    You can view the Linux Cluster Installation Tool (LCIT) event log through a local or remote console or terminal window: 1. Open a console window on the management node. 2. From the root directory, type: tail -f /var/log/messages. © Copyright IBM Corp. 2007...
  • Page 46 IBM System Cluster 1350 Installation and Service Guide...

  • Page 47: Appendix B. Getting Help And Technical Assistance

    If you need help, service, or technical assistance or just want more information about IBM products, you will find a wide variety of sources available from IBM to assist you. This appendix contains information about where to go for additional information about IBM System Cluster 1350 and what to do if you experience a problem with it.

  • Page 48: Using The Documentation

    IBM Publications Ordering System at http://www.ibm.com/shop/publications/order/. Getting help and information from the World Wide Web On the World Wide Web, the IBM Web site has up-to-date information about IBM ™ systems, optional devices, services, and support. The address for IBM System x ®...

  • Page 49: Ibm Taiwan Product Service

    7 days a week. In the U.K., these services are available Monday through Friday, from 9 a.m. to 6 p.m. IBM Taiwan product service IBM Taiwan product service contact information: IBM Taiwan Corporation 3F, No 7, Song Ren Rd. Taipei, Taiwan Telephone: 0800-016-888 Appendix B.
  • Page 50 IBM System Cluster 1350 Installation and Service Guide...

  • Page 51: Appendix C. Notices

    Web sites. The materials at those Web sites are not part of the materials for this IBM product, and use of those Web sites is at your own risk.

  • Page 52: Important Notes

    When referring to processor storage, real and virtual storage, or channel volume, KB stands for approximately 1000 bytes, MB stands for approximately 1 000 000 bytes, and GB stands for approximately 1 000 000 000 bytes. IBM System Cluster 1350 Installation and Service Guide...

  • Page 53: Product Recycling And Disposal

    IBM makes no representations or warranties with respect to non-IBM products. Support (if any) for the non-IBM products is provided by the third party, not IBM. Some software may differ from its retail version (if available), and may not include user manuals or all program functionality.

  • Page 54: Electronic Emission Notices

    Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment.

  • Page 55: Industry Canada Class A Emission Compliance Statement

    IBM cannot accept responsibility for any failure to satisfy the protection requirements resulting from a nonrecommended modification of the product, including the fitting of non-IBM option cards. This product has been tested and found to comply with the limits for Class A Information Technology Equipment according to CISPR 22/European Standard EN 55022.

  • Page 56: Chinese Class A Warning Statement

    Chinese Class A warning statement Japanese Voluntary Control Council for Interference (VCCI) statement IBM System Cluster 1350 Installation and Service Guide...

  • Page 57: Appendix D. Declaration Of Ibm Product Noise Emission Values

    Appendix D. Declaration of IBM product noise emission values General noise emission values for the Cluster 1350 are shown in Table 3. Table 3. General noise emission values for the Cluster 1350 Declaration of IBM product noise emission values Product...
  • Page 58 IBM System Cluster 1350 Installation and Service Guide...

  • Page 59: Appendix E. International License Agreement For Non-Warranted Programs

    License Information and is the complete agreement regarding the use of this Program, and replaces any prior oral or written communications between you and IBM. The terms of Part 2 and License Information may replace or modify those of Part 1.
  • Page 60 Proof of Entitlement. Charges are based on extent of use authorized. If you wish to increase the extent of use, notify IBM or its reseller and pay any applicable charges. IBM does not give refunds or credits for charges already due or paid.

  • Page 61: Part 2 - Country-Unique Terms

    Limitation of Liability (Section 5): The following paragraph is added to this Section: Where IBM is in breach of a condition or warranty implied by the Trade Practices Act 1974, IBM’s liability is limited to the repair or replacement of the goods, or the supply of equivalent goods.
  • Page 62 Section at the end of the first paragraph: The limitation of liability will not apply to any breach of IBM’s obligations implied by Section 12 of the Sale of Goods Act 1979 or Section 2 of the Supply of Goods and Services Act 1982.

  • Page 63: Index

    Myrinet switch and line cards 9 terminal server 9 cluster management 27 cluster node cluster components 5 IBM Rear Door Heat eXchanger 15 color-coded Ethernet cables 15 IBM Support Line 32 console, description 7 InfiniBand host channel adapters 8...
  • Page 64 Myrinet CLOS 256 switch 14 placing the cabinets, guidelines 15 power distribution unit 11 primary cabinet connections 24 primary cabinets, turning the power on 24 primary cluster VLAN, description 19 IBM System Cluster 1350 Installation and Service Guide...
  • Page 66 Part Number: 44R5023 Printed in USA (1P) P/N: 44R5023...

This manual is also suitable for:

Cluster 1350

Table of Contents