IBM 24R9718 IB User Manual
IBM 24R9718 IB User Manual

IBM 24R9718 IB User Manual

Ib switch module for ibm eserver bladecenter
Table of Contents

Advertisement

Quick Links

IB Switch Module for IBM eServer BladeCenter
User Guide
Release 2.2.0 Update 2
10-00092-02-A0 IBM Part number: 24R9718
Part Number:

Advertisement

Table of Contents
loading

Summary of Contents for IBM 24R9718 IB

  • Page 1 IB Switch Module for IBM eServer BladeCenter User Guide Release 2.2.0 Update 2 10-00092-02-A0 IBM Part number: 24R9718 Part Number:...
  • Page 2 Copyright © 2004 Topspin Communications, Inc. All rights reserved. The Topspin Switched Computing System, Topspin Host Channel Adapter, Topspin Element Manager, and collateral software programs and documentation are subject to and made available only pursuant to the license agreement signed by you and Topspin, Communications, Inc. (or if no signed license agreement exists, the license agreement included with your original media) and may only be used in accordance with the terms of that agreement.
  • Page 3: Important Notice

    "What this Warranty Does not Cover" of the SOLW. All references to "Machine" in the SOLW apply to this product (except for its firmware or accompanying software) for purposes of the warranty. References to "IBM's Official Published Specifications"...
  • Page 5: Table Of Contents

    What this Warranty Covers... xv What this Warranty Does not Cover... xvi How to Obtain Warranty Service... xvi What IBM Will Do to Correct Problems ... xvi Exchange of a Machine or Part... xvii Your Additional Responsibilities... xvii Limitation of Liability ... xvii Governing Law ...
  • Page 6 Japanese Voluntary Control Council for Interference (VCCI) statement... xxxvi WEEE Notice ... xxxvii Safety ... xxxix 1: About the Server Switch Module... 1 Introduction...1 Server Switch Module and HCA Expansion Cards ... 2 Topologies ...2 Single-Switch Topology ... 2 Dual-Switch Topology... 2 Management...3 LEDs ...3...
  • Page 7 2: Getting Started ... 5 Install the Server Switch Module...5 Configure the Server Switch Module ...5 Change the Default Password ... 6 Configure the System Clock ... 7 Connect Beyond BladeCenter...8 Connecting InfiniBand Cables... 10 3: Specifications and Compliance ... 13 Safety Certifications ...13...
  • Page 8 viii...
  • Page 9: Regulatory Notices

    CAUTION: Always ground yourself before touching any internal IB Switch Module component to avoid damage from electrostatic discharge (ESD). CAUTION: The IB Switch Module contains lithium batteries. Do not attempt to replace or discard these batteries. The batteries may only be serviced by Topspin service personnel.
  • Page 10: General Cautions

    Place cables appropriately so that they do not obstruct any egress within the data center and they do not block any ventilation inlets or outlets. IBM Support Contact Information For technical support, refer to the following Web site: http://www.ibm.com/support To contact technical support, send email to support@ibm.com or refer to one of the telephone numbers below.
  • Page 11: Before You Call

    To obtain warranty service contact IBM or your IBM reseller. In Canada or the United States, call 1-800-IBM-SERV (426-7378). In the EU countries, see the telephone numbers in Table iii-1: EU Country Telephone List Austria -- 43-1-24592-5901 Belgium -- 02-718-4339...
  • Page 12: Topspin Contact Information

    • (Linux only) Run the dmesg command on your Linux host and provide the output. Example # dmesg 0a 000 00 0b 000 00 0c 00F 0F 0d 00F 0F 0e 00F 0F 0f 00F 0F 10 00F 0F 11 000 00 12 00F 0F 13 00F 0F 14 000 00...
  • Page 13 Table iii-2: Contact Information (Continued) Telephone, Corporate Headquarters Telephone, Technical Support Email, Technical Support Web site, Support (866) TOPSPIN or (650) 316-3300 (650) 316-3269 (800) 499-1473 support@ibm.com (contact IBM first) support@topspin.com http://www.ibm.com/support (contact IBM first) http://support.topspin.com xiii...
  • Page 15: Ibm Statement Of Limited Warranty Z125-4753-08

    Many features, conversions, or upgrades involve the removal of parts and their return to IBM. A part that replaces a removed part will assume the warranty service status of the removed part. Unless IBM specifies otherwise, these warranties apply only in the country or region in which you purchased the Machine.
  • Page 16: What This Warranty Does Not Cover

    If the Machine does not function as warranted during the warranty period, contact IBM or your reseller to obtain warranty service. If you do not register the Machine with IBM, you may be required to present proof of purchase as evidence of your entitlement to warranty service.
  • Page 17: Exchange Of A Machine Or Part

    Personal Data. Limitation of Liability IBM is responsible for loss of, or damage to, your Machine only while it is 1) in IBM's possession or 2) in transit in those cases where IBM is responsible for the transportation charges.
  • Page 18: Governing Law

    WARRANTY LASTS, SO THE ABOVE LIMITATION MAY NOT APPLY TO YOU. Governing Law Both you and IBM consent to the application of the laws of the country in which you acquired the Machine to govern, interpret, and enforce all of your and IBM's rights, duties, and obligations arising from, or relating in any manner to, the subject matter of this Statement of Limited Warranty, without regard to conflict of law principles.
  • Page 19: North America

    Limitation of Liability: The following is added at the end of this section: In accordance with Article 1328 of the Peruvian Civil Code the limitations and exclusions specified in this section will not apply to damages caused by IBM's willful misconduct (“dolo”) or gross negligence (“culpa inexcusable”).
  • Page 20: Asia Pacific

    Limitation of Liability: The following is added to this section: Where IBM is in breach of a condition or warranty implied by the Trade Practices Act 1974 or other similar legislation, IBM's liability is limited to the repair or replacement of the goods or the supply of equivalent goods.
  • Page 21 IBM's negligence; and as to any other actual damage arising in any situation involving nonperformance by IBM pursuant to, or in any way related to the subject of this Statement of Limited Warranty, the charge paid by you for the individual Machine that is the subject of the claim.
  • Page 22: Europe, Middle East, Africa (Emea)

    Guarantees Act 1993 will not apply in respect of any goods which IBM provides, if you require the goods for the purposes of a business as defined in that Act. Limitation of Liability: The following is added to this section: Where Machines are not acquired for the purposes of a business as defined in the Consumer Guarantees Act 1993, the limitations in this section are subject to the limitations in that Act.
  • Page 23 If you purchase a Machine in one of the Western European countries, as defined above, you may obtain warranty service for that Machine in any of those countries from either (1) an IBM reseller approved to perform warranty service or (2) from IBM, provided the Machine has been announced and made available by IBM in the country in which you wish to obtain service.
  • Page 24: European Union (Eu)

    Machines have been announced and made available in such countries. How to Obtain Warranty Service: The following is added to this section: To obtain warranty service from IBM in EU countries, see the telephone listing in Part 3 - Warranty Information.
  • Page 25: The Following Terms Apply To The Country Specified

    Except as otherwise provided by mandatory law: IBM's liability for any damages and losses that may arise as a consequence of the fulfillment of its obligations under or in connection with this Statement of Limited Warranty or due to any other...
  • Page 26 Limitation of Liability: The following replaces item 2 in this section: as to any other actual direct damages, IBM's liability will be limited to the total amount you paid for the Machine that is the subject of the claim. For purposes of this item, the term “Machine” includes Machine Code and Licensed Internal Code (“LIC”).
  • Page 27 IBM in connection with, or in relation to, the subject matter of this Statement of Limited Warranty in respect of which IBM is legally liable to you, whether in contract or tort. A number of Defaults which together result in, or contribute to, substantially the same loss or damage will be treated as one Default occurring on the date of occurrence of the last such Default.
  • Page 28: Part 3 - Warranty Information

    IBM's entire liability to you for actual damages arising in all situations involving nonperformance by IBM in respect of the subject matter of this Statement of Warranty will be limited to the charge paid by you for the individual Machine that is the subject of your claim from IBM.
  • Page 29: Types Of Warranty Service

    NOTE: “Region” means either Hong Kong or Macau Special Administrative Region of China. A warranty period of 3 years on parts and 1 year on labor means that IBM provides warranty service without charge for: parts and labor during the first year of the warranty period; and parts only, on an exchange basis, in the second and third years of the warranty period.
  • Page 30: Eu Country Telephone List

    Phone numbers are subject to change without notice. For the warranty service contact telephone number in a country subsequently added to the EU and not yet reflected in the list below, contact IBM in that country or visit the website above for a current telephone listing.
  • Page 31: Notices

    Consult your local IBM representative for information on the products and services currently available in your area. Any reference to an IBM product, program, or service is not intended to state or imply that only that IBM product, program, or service may be used. Any functionally equivalent product, program, or service that does not infringe any IBM intellectual property right may be used instead.
  • Page 32: Edition Notice

    Web sites. The materials at those Web sites are not part of the materials for this IBM product, and use of those Web sites is at your own risk. IBM may use or distribute any of the information you supply in any way it believes appropriate without incurring any obligation to you.
  • Page 33: Important Notes

    In the United States, IBM has established a collection process for reuse, recycling, or proper disposal of used IBM sealed lead acid, nickel cadmium, nickel metal hydride, and battery packs from IBM...
  • Page 34: Electronic Emission Notices

    Properly shielded and grounded cables and connectors must be used in order to meet FCC emission limits. IBM is not responsible for any radio or television interference caused by using other than recommended cables and connectors or by unauthorized changes or modifications to this equipment.
  • Page 35: Australia And New Zealand Class A Statement

    This product is in conformity with the protection requirements of EU Council Directive 89/336/EEC on the approximation of the laws of the Member States relating to electromagnetic compatibility. IBM cannot accept responsibility for any failure to satisfy the protection requirements resulting from a nonrecommended modification of the product, including the fitting of non-IBM option cards.
  • Page 36: Japanese Voluntary Control Council For Interference (Vcci) Statement

    xxxvi Japanese Voluntary Control Council for Interference (VCCI) statement...
  • Page 37: Weee Notice

    WEEE Notice NOTE: This mark applies only to countries within the European Union (EU) and Norway. This appliance is labelled in accordance with European Directive 2002/96/EC concerning waste electrical and electronic equipment (WEEE). The Directive determines the framework for the return and recycling of used appliances as applicable throughout the European Union.
  • Page 38 xxxviii...
  • Page 39: Safety

    Safety...
  • Page 42 xlii...
  • Page 43 xliii...
  • Page 44 xliv...
  • Page 45: 1: About The Server Switch Module

    The Topspin IB Switch Module for IBM eServer BladeCenter (hereafter “Server Switch Module”) adds InfiniBand (IB) switching capability to hosts in your IBM BladeCenter chassis. When you add one or two Server Switch Modules to your BladeCenter chassis and add HCA expansion cards to your BladeCenter hosts, your hosts can communicate to one another over IB within the chassis.
  • Page 46: Server Switch Module And Hca Expansion Cards

    Each Server Switch Module includes 14 1x ports to the backplane and 4 4x ports (in the form of 1 4x connector and 1 12x connector) on the front panel. (In the case of the BladeCenter T, the internal ports beyond the first 8 appear in the CLI but do not function.) The Server Switch Module provides fully...
  • Page 47: Management

    • APIs (via SNMP) For instructions that detail how to configure your Server Switch Module with the CLI, refer to the Command Line Interface Reference Guide. For instructions that detail how to configure your Server Switch Module with Chassis Manager, refer to the Chassis Manager User Guide. For instructions that detail how to configure your Server Switch Module with Element Manager, refer to the InfiniBand User Guide.
  • Page 48: Server Switch Module Status Leds

    In all user interfaces, however, the port numbers begin at 15. Ports 1 through 14 function internally, then ports 15 - 18 connect the Server Switch Module to external devices. Connector 1 maps to port 15, connector 2 to port 16, and so on.
  • Page 49: 2: Getting Started

    To install the Topspin Server Switch Module, perform the following steps: Ground yourself appropriately. Choose a bay into which you want to install the Server Switch Module. You must install the module in bay 3 or bay 4. Refer to your BladeCenter unit documentation for standard hardware module installation instructions.
  • Page 50: Change The Default Password

    Enter an IP address, in the IP address field of the New Static IP Configuration section, for the Server Switch Module. NOTE: The IP address of the Server Switch Module must fall in the same subnet as the modules in the other bays.
  • Page 51: Configure The System Clock

    Configure the System Clock Configure your system clock immediately so that all system messages include accurate timestamps. You can configure the clock setting on the on-board Server Switch clock or you can synchronize your Server Switch to a network time protocol (NTP) server.
  • Page 52: Connect Beyond Bladecenter

    To extend your InfiniBand fabric beyond your BladeCenter cluster, you must configure the priority of the subnet manager (SM) on your Server Switch Module(s), then connect one or more of the external interfaces on your Server Switch Module(s) to an outside InfiniBand fabric.
  • Page 53 Example IBM BladeCenter(config)# ib sm subnet-prefix fe:80:00:00:00:00:00:00 priority 1 After you configure your subnet manager priority, connect your Server Switch Module to the outside IB fabric. By default, the external interfaces on your Server Switch Module auto-negotiate speed with the fabric.
  • Page 54: Connecting Infiniband Cables

    Connecting InfiniBand Cables To plug in an InfiniBand cable, push the connector into the interface until you hear/feel a click (Figure 2-1). Figure 2-1: Connecting InfiniBand Cables...
  • Page 55 To remove a cable with a pull connector, grasp the connector with one hand and push it toward the port, then pull the latch away from the port with your other hand and gently wiggle the connector away from the port. 1.
  • Page 57: 3: Specifications And Compliance

    This chapter details the Server Switch Module specifications and compliance certifications. Safety Certifications The Topspin Server Switch Module, model 99-00045-XX, is an UL Listed Accessory in accordance with the UL Standard for Safety for Information Technology and Telecommunications Equipment, UL 60950-1.
  • Page 58: Electrical Requirements

    equipment in a residential area is likely to cause harmful interference in which case the user will be required to correct the interference at his own expense. Table 3-2: EMC/EMI Certifications Certification FCC: Title 47 CFR 47 Part 15, Subpart B, Class A ICES-003 Issue 2 CE: EN55022:1998 and EN55024:1998 VCCI: V3/2000.04, Class A...
  • Page 59 Index about the server switch module cable connection ...10 change the default password ...6 clock, setting ...7 configuration, initial ...5 configuring the server switch module connect IB cables ...10 connect to Topspin IB networks HCA expansion cards, about ...2 I/O module management ...6...

This manual is also suitable for:

24r9718

Table of Contents