Page 1 IB Switch 9P Administration ™ Guide Sun Microsystems, Inc. www.sun.com Part No. 819-7247-10 October 2006, Revision A Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
Page 2 Copyright 2006 Sun Microsystems, Inc., 4150 Network Circle, Santa Clara, Californie 95054, Etats-Unis. Tous droits réservés. Sun Microsystems, Inc. a les droits de propriété intellectuels relatants à la technologie qui est décrit dans ce document. En particulier, et sans la limitation, ces droits de propriété...
Page 3: Table Of Contents
Contents Introduction 1 Switch Description 1 Hardware and Software Requirements 4 Key Features 4 Initial Configuration 5 Initial Set Up 5 Accessing the Command-Line Interface 7 ▼ To Access the CLI 7 Event and Message Logs 9 System Log Proxy 9 ▼...
Page 4 To Use the showbp Command 31 ▼ To Use the showdate Command 32 ▼ To Use the showenvironment Command 32 ▼ To Use the showfru Command 35 ▼ To Use the showib Command 38 Sun IB Switch 9P Administration Guide • October 2006...
Page 5 ▼ To Use the showlocator Command 40 ▼ To Use the showlogs Command 41 showlogs Command Options 43 ▼ To Use the showplatform Command 44 showplatform Command Options 45 ▼ To Use the showsc Command 45 ▼ To Use the showusers Command 46 ▼...
Page 6 To Upgrade the Switch Firmware 82 Blueprints 85 The Blueprint Concept 85 Setting Up a Blueprint 87 9-Node Blueprint 87 12-Node Blueprint 88 18-Node Blueprint 88 none Blueprint 89 unmanaged Blueprint 90 Changing Configurations 91 Sun IB Switch 9P Administration Guide • October 2006...
Page 7 Usage Error Messages 65 CLI Messages 66 Additional Important Messages 68 General Error Messages 69 FRU Error Messages 71 Pin Descriptions for the RJ-45-to-DB-25 Serial Converter Cable 73 Switch Architecture 74 Sun Microsystems, Inc. www.sun.com Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
Page 8 System Management 75 High Availability 75 LED Descriptions 76 Power Requirements 76 Environmental Specifications 77 Sun Microsystems, Inc. www.sun.com Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
Page 9: Declaration Of Conformity
Dennis P. Symanski DATE Pamela J. Dullaghan DATE Manager, Compliance Engineering Quality Program Manager Sun Microsystems, Inc. Sun Microsystems Scotland, Limited 4150 Network Circle, MPK15-102 Springfield, Linlithgow Santa Clara, CA 95054 U.S.A. West Lothian, EH49 7LR Tel: 650-786-3255 Scotland, United Kingdom...
Page 10 Sun IB Switch 9P Administration Guide • October 2006...
Page 11: Regulatory Compliance Statements
Operation of this equipment in a residential area is likely to cause harmful interference, in which case the user will be required to correct the interference at his own expense. Modifications: Any modiﬁcations made to this device that are not approved by Sun Microsystems, Inc. may void the authority granted to the user by the FCC to operate this equipment.
Page 12 ICES-003 Class B Notice - Avis NMB-003, Classe B This Class B digital apparatus complies with Canadian ICES-003. Cet appareil numérique de la classe B est conforme à la norme NMB-003 du Canada. Sun IB Switch 9P Administration Guide • October 2006...
Page 13: Bsmi Class A Notice
BSMI Class A Notice The following statement is applicable to products shipped to Taiwan and marked as Class A on the product compliance label. CCC Class A Notice The following statement is applicable to products shipped to China and marked with “Class A” on the product’s compliance label.
Page 14 Sun IB Switch 9P Administration Guide • October 2006...
Page 15: Safety Precautions
Do not make mechanical or electrical modifications to the the equipment’s electrical rating label. equipment. Sun Microsystems is not responsible for Never push objects of any kind through openings in ■ regulatory compliance of a modified Sun product.
Page 16 Do not connect the power cord when the power supply has been removed from the system chassis. Sun IB Switch 9P Administration Guide • October 2006...
Page 17 Rack System Warning CD and DVD Devices The following warnings apply to Racks and Rack Mounted The following caution applies to CD, DVD, and other systems. optical devices. Caution – For safety, equipment should Caution – Use of controls, adjustments, or the always be loaded from the bottom up.
Page 18 70 db(A). plusieurs cordons d'alimentation hors tension, il est nécessaire de débrancher tous les Conformité SELV cordons d'alimentation. Le niveau de sécurité des connexions E/S est conforme aux normes SELV. xviii Sun IB Switch 9P Administration Guide • October 2006...
Page 19 Mise en garde relative aux batteries Attention – Afin d'éviter que le rack ne penche pendant l'installation du matériel, tirez Attention – Les batteries risquent d’exploser la barre anti-basculement du rack. en cas de manipulation maladroite ou de remplacement incorrect. Pour les systèmes dont les batteries sont remplaçables, effectuez Attention –...
Page 20 Lautstärke dieses Produkts weniger als 70 dB(A). Achtung – Gefährliche Spannungen. Befolgen Sie die Anweisungen, um Stromschläge und Verletzungen zu vermeiden. SELV-Konformität Der Sicherheitsstatus der E/A-Verbindungen entspricht den SELV-Anforderungen. Sun IB Switch 9P Administration Guide • October 2006...
Page 21 Anschluss des Netzkabels Warnung bezüglich Batterien Achtung – Sun-Geräte sind für Achtung – Bei unsachgemäßer Handhabung Stromversorgungssysteme mit einem oder nicht fachgerechtem Austausch der geerdeten neutralen Leiter (geerdeter Batterien besteht Explosionsgefahr. Verwen- Rückleiter bei gleichstrombetriebenen den Sie bei Systemen mit austauschbaren Geräten) ausgelegt.
Page 22 Geräte: personales, siga las instrucciones. Achtung – Die hier nicht aufgeführte Verwendung von Steuerelementen, Anpassungen oder Ausführung von Vorgängen kann eine gefährliche Strahlenbelastung verursachen. xxii Sun IB Switch 9P Administration Guide • October 2006...
Page 23 Precaución – No todos los cables de alimentación tienen la misma clasificación No realice modificaciones de tipo mecánico ni eléctrico en el equipo. Sun Microsystems no se hace responsable del eléctrica. Los alargadores de uso doméstico no cuentan con protección frente a sobrecargas y cumplimiento de normativas en caso de que un producto no están diseñados para su utilización con...
Page 24 Sun que no tengan colocada la Class 1 Laser Product cubierta. De lo contrario, puede sufrir lesiones Luokan 1 Laserlaite personales y ocasionar daños en el sistema. Klasse 1 Laser Apparat Laser Klasse 1 xxiv Sun IB Switch 9P Administration Guide • October 2006...
Page 25 Dispositivos de CD y DVD La siguiente medida se aplica a los dispositivos de CD y DVD, así como a otros dispositivos ópticos: Precaución – La utilización de controles, ajustes o procedimientos distintos a los aquí especificados puede dar lugar a niveles de radiación peligrosos.
Page 26 Sun IB Switch 9P Administration Guide • October 2006...
Page 27: How This Book Is Organized
Preface This Sun™ IB Switch 9P Administration Guide describes how to configure the Sun IB switch. This book is intended for experienced network administrators who have a working knowledge of local area network operations and familiarity with InfiniBand technology. Before You Read This Book To fully use the information in this document, you must first install the Sun IB switch, using the Sun™...
Page 28: Typographic Conventions
Sun Dual Port 4x IB Host Channel Adapter PCI-X Installation 819-1280 and User’s Guide Addendum Sun Dual Port 4x IB Host Channel Adapter PCI-X Release 819-1281 Notes Addendum Sun IB Switch 9P Release Notes 819-7248 xxviii Sun IB Switch 9P Administration Guide • October 2006...
Page 29 Sun is interested in improving its documentation and welcomes your comments and suggestions. You can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your document with your feedback: Sun IB Switch 9P Administration Guide, part number 819-0502-11 Preface xxix...
Page 30 Sun IB Switch 9P Administration Guide • October 2006...
Page 31: Introduction
C H A P T E R Introduction This chapter provides an overview of the Sun IB switch hardware and software, including the hardware and software requirements for using the switch. This chapter includes the following sections: “Switch Description” on page 1 ■...
Page 32: Front Panel Leds For The Sun Nine-Port Infiniband Switch
PSU and fan module Green AC on Green DC on Amber Fault—the PSU requires attention Blue Ready-to-remove Front panel status LEDs PSU and fan module LEDs Front Panel LEDs FIGURE 1-1 Sun IB Switch 9P Administration Guide • October 2006...
Page 33: Rear Display Leds For The Sun Nine-Port Infiniband Switch
Rear LED Displays Three sets of LEDs are displayed on the rear of the Sun IB switch. describes TABLE 1-2 the meaning of each LED. shows the location of the LEDs. FIGURE 1-2 Rear Display LEDs for the Sun Nine-Port InfiniBand Switch TABLE 1-2 Location Color...
Page 34: Hardware And Software Requirements
True non-blocking switch fabric with aggregate bandwidth of 540Gbps ■ All removable modules are hot-swappable ■ Intelligent switch with embedded Sun Advanced Lights Out Management ■ (ALOM) system controller and integrated InfiniBand management Sun IB Switch 9P Administration Guide • October 2006...
Page 35: Initial Configuration
C H A P T E R Initial Configuration This chapter describes how to set up and boot the switch and how to access the command-line interfaces (CLI). This chapter contains the following sections: “Initial Set Up” on page 5“ ■...
Page 36 The system boots. When the system is booted, it asks for a username. 5. Log in with the username admin: Sun Advanced Lights Out Manager for Sun IB Switch 9P Copyright 2003-2005 Sun Microsystems, Inc. All Rights Reserved. username: admin Password: sc>...
Page 37: Accessing The Command-Line Interface
▼ To Access the CLI 1. Log in as admin and enter in the password you just set up: Sun Advanced Lights Out Manager for Sun IB Switch 9P Copyright 2003-2005 Sun Microsystems, Inc. All Rights Reserved. ALOM-B 1.2 username: admin password: 2.
Page 38 CLI commands. 4. Install and set up the system log (syslog) proxy. “Installing and Setting Up the System Log Proxy” on page 9 for instructions. Sun IB Switch 9P Administration Guide • October 2006...
Page 39: Event And Message Logs
Event and Message Logs The Sun IB switch provides the following types of logs and related messages: Errors and important state changes related to a specific FRU are logged as part of ■ the dynamic FRU information in non-volatile memory on the FRU itself. (This helps in diagnosing problems associated with FRUs being returned to Sun.) Local system events are logged to the ALOM non-volatile event log and ■...
Page 40: To Install The System Log Proxy
The proxy receives messages from the switch and transfers them to the Solaris host syslog API for further processing, depending on the configuration of /etc/syslog.conf file. Then the proxy logs the message in an appropriate Sun IB Switch 9P Administration Guide • October 2006...
Page 41 system log, writes it to the system console, forwards it to a list of users, or forwards it to syslogd on another host over the network. Default user LOG_ALERT is used to add the syslog messages in the /var/adm/messages file on the host. 3.
Page 42: To Remove The Proxy
To Remove the Proxy 1. Check to ensure that the proxy is running: ps -ef | grep syslog 2. Stop the proxy: $ /opt/SUNWsibs9p/bin/start_syslog -d /opt/SUNWsibs9p/bin stop 3. Remove the proxy: $ pkgrm SUNWsibs9p Sun IB Switch 9P Administration Guide • October 2006...
Page 43: Command-Line Reference
C H A P T E R Command-Line Reference This chapter describes how to use the command-line interface (CLI). This chapter contains the following sections: “Overview of the Command Shell” on page 13 ■ “CLI Shell Commands” on page 14 ■...
Page 44: Cli Shell Commands
“userperm” on page 49 userperm Displays the history of all events logged in the “showlogs” on page 40 showlogs ALOM event buffer. Displays the environmental status of the switch “showenvironment” on showenvironment page 32 Sun IB Switch 9P Administration Guide • October 2006...
Page 45: Descriptions Of Cli Commands
List of CLI Shell Commands by Function (Continued) TABLE 3-1 CLI Command Summary Description Full Description Updates the ALOM firmware. This command “flashupdate” on page 15 flashupdate downloads main and bootmonitor firmware images to ALOM. Removes the main power from the PSU. “poweroff”...
Page 46: To Use The Flashupdate Command
/tftp/X3152A_1.0.0.flash or /tftp/ibswitch-sc.flash. Displays verbose output. This option provides detailed information about the progress of the download process as it occurs. Sun IB Switch 9P Administration Guide • October 2006...
Page 47: To Use The Help Command
help Use the help command to display a list of all ALOM commands and the syntax for each. ▼ To Use the help Command Note – You do not need user permissions to use this command. ● Do one of the following: To display help for all available commands, at the sc>...
Page 48 To display help for a specific command, at the sc> prompt type help and the ■ name of the command: sc> help command-name where command-name is the name of the specific command. For example: sc> help poweron poweron [-F] {frulist} sc> Sun IB Switch 9P Administration Guide • October 2006...
Page 49: To Use The Logout Command
logout Use the logout command to end your session and close your serial or Telnet connection. ▼ To Use the logout Command Note – You do not need user permissions to use this command. ● At the sc> prompt, type the following command: sc>...
Page 50: Password Restrictions
● At the sc> prompt, type the following command: sc> poweroff PS0 Are you sure you want to power off FRU PS0 (y/n)?: y PS0: Powered off. sc> Sun IB Switch 9P Administration Guide • October 2006...
Page 51: Poweroff Command Options
poweroff Command Options The poweroff command uses the following options. See “Entering Command Options” on page poweroff Command Options TABLE 3-3 Option Description Proceeds without prompting the following confirmation question: Are you sure you want to power off FRU PS{0|1} (y/n)? Forces the poweroff regardless of the presence/availability of the other PSU.
Page 52: Poweron Command Option
To Use the removefru Command ● At the sc> prompt, type the following command: sc> removefru fru where fru is the name of the FRU or CRU you want to prepare for removal. Sun IB Switch 9P Administration Guide • October 2006...
Page 53: Removefru Command Option
For example, to prepare power supply 0 for removal, type: sc> removefru PS0 Are you sure you want to remove PS0 (y/n)?: y Mar 03 22:10:22: CRITICAL: PS0 removed - replace within 10 minutes of removal Caution – Removing one of the PSUs leaves the switch without a failover power supply.
Page 54: Resetsc Command Options
Use the setbp command to set a Blueprint of the switch. The switch is shipped with Blueprint set to a managed single switch configuration using the IP address of the switch as basic for the subnet prefix. See Appendix D for more information about Blueprints. Sun IB Switch 9P Administration Guide • October 2006...
Page 55: To Use The Setbp Command
▼ To Use the setbp Command 1. At the sc> prompt, type the following command: sc> setbp option shows a sample of the setbp command for a 9-node CODE EXAMPLE 3-1 configuration. Sample of the setbp Command for 9 Nodes CODE EXAMPLE 3-1 sc>...
Page 56: Setbp Command Options
Use the setdate command to set the current date and time to that of your local site. sc> setdate Usage: setdate [mmdd]HHMM[.SS] | mmddHHMM[cc]yy[.SS] sc> ▼ To Use the setdate Command ● At the sc> prompt, type the following command: sc> setdate mmddHHMMccyy.SS Sun IB Switch 9P Administration Guide • October 2006...
Page 57: Setdate Command Options
This command accepts settings for the month, day, hour, minute, century, year, and second. If you omit the month, day, and year, ALOM applies the current values as defaults. You can also omit the century value and the value for seconds in the time. Note –...
Page 58: To Use The Setdefaults Command
The setdefaults command uses the following option. setdefaults Command Options TABLE 3-8 Option Description Proceeds without first asking the confirmation question: Are you sure you want to reset the SC configuration? Sun IB Switch 9P Administration Guide • October 2006...
Page 59: To Use The Setlocator Command
setlocator Use the setlocator command to turn the switch’s Locator LED on or off. ▼ To Use the setlocator Command Note – You do not need user permissions to use this command. ● At the sc> prompt, type the following command: sc>...
Page 60 Should the SC network interface be enabled [y]? 3. To exit the command, do one of the following: To exit and save the changes you made, type Ctrl-Z. ■ To exit without saving any changes, type Ctrl-C. ■ Sun IB Switch 9P Administration Guide • October 2006...
Page 61: To Use The Showbp Command
showbp Use the showbp command to get the running and stored Blueprint which is set to the switch (and the remote switch if using the -r option) See Appendix D for more information about Blueprints. ▼ To Use the showbp Command At the sc>...
Page 62: To Use The Showdate Command
▼ To Use the showenvironment Command Note – You do not need user permissions to use this command. ● At the sc> prompt, type the following command: sc> showenvironment Sun IB Switch 9P Administration Guide • October 2006...
Page 63 The following example shows sample output when no options are specified. Sample Output of showenvironment Command CODE EXAMPLE 3-5 sc> showenvironment ============ Environmental Status ============ System Temperatures (Celsius) Current Status ---------------------------------------------------------------- SSC0 /TSensor/ambient SSC0 /TSensor/assp SSC0 /TSensor/air /TSensor/ambient /TSensor/Ext1 /TSensor/Ext2 /TSensor/ambient /TSensor/Ext1 /TSensor/Ext2...
Page 64 /VSensor/PS/main/3V3 3.32 02.96/03.62 /VSensor/V1anode 12.48 10.19/13.81 /VSensor/V1catode 12.36 09.95/13.51 /VSensor/PS/main/3V3 3.32 02.96/03.62 System Fans (RPM) Current Status Warning ------------------------------------------------------------------------------ /Tacho/Fan0 10546 5000 /Tacho/Fan1 9782 5000 /Tacho/Fan0 10546 5000 /Tacho/Fan1 10887 5000 Sun IB Switch 9P Administration Guide • October 2006...
Page 65: To Use The Showfru Command
showfru Use the showfru command to display the contents of all FRU PROMs (field- replaceable units with programmable read-only memory) in the switch. ▼ To Use the showfru Command Note – You do not need user permission to use this command. ●...
Page 66 /Status_EventsR/UNIX_Timestamp32[3]: Mon Feb 14 21:50:27 UTC 2005 /Status_EventsR/Old_Status[3]: 0x0 /Status_EventsR/New_Status[3]: 0x0 /Status_EventsR/Initiator[3]: SCAPP /Status_EventsR/Component[3]: 0x0 /Status_EventsR/Event_Code[3]: /Status_EventsR/Message[3]: PS0: DC output fault recovered. /Soft_ErrorsR(0 iterations) SEGMENT: PE SEGMENT: PS /Power_SummaryR/UNIX_Timestamp32: Thu Mar 03 20:40:35 UTC 2005 Sun IB Switch 9P Administration Guide • October 2006...
Page 67 Sample of the showfru Command (Continued) CODE EXAMPLE 3-7 /Power_SummaryR/Total_Time_On: 29992 /Power_SummaryR/Total_Power_Ons: 38 /Power_SummaryR/Total_Power_Offs: 0 SEGMENT: TH /Temperature_HistoryR/UNIX_Timestamp32: Thu Mar 03 21:40:45 UTC 2005 /Temperature_HistoryR/Sensor: 0x0 /Temperature_HistoryR/Lowest: 19 /Temperature_HistoryR/Highest: 24 /Temperature_HistoryR/Latest: 20 /Temperature_HistoryR/Histogram(10 iterations) /Temperature_HistoryR/Histogram[0]: 0 /Temperature_HistoryR/Histogram[1]: 524 /Temperature_HistoryR/Histogram[2]: 0 /Temperature_HistoryR/Histogram[3]: 0 /Temperature_HistoryR/Histogram[4]: 0 /Temperature_HistoryR/Histogram[5]: 0...
Page 68: To Use The Showib Command
= 0x0000000000000000 Switch connector 1: PortPhysicalState = LinkUp LinkWidthActive = 4X PortXmitPkts = 0x0000000000000717 PortRcvPkts = 0x0000000000000718 Switch connector 2: PortPhysicalState = Polling LinkWidthActive = 12X PortXmitPkts = 0x0000000000000000 PortRcvPkts = 0x0000000000000000 Sun IB Switch 9P Administration Guide • October 2006...
Page 69: Showib Command Options
Sample Output for showib Command CODE EXAMPLE 3-8 Switch connector 3: PortPhysicalState = LinkUp LinkWidthActive = 4X PortXmitPkts = 0x0000000000000717 PortRcvPkts = 0x0000000000000718 Switch connector 4: PortPhysicalState = Polling LinkWidthActive = unknown PortXmitPkts = 0x0000000000000000 PortRcvPkts = 0x0000000000000000 Switch connector 5: PortPhysicalState = LinkUp LinkWidthActive...
Page 70: To Use The Showlocator Command
Where date signifies the time at which the event occurred, as recorded by ALOM, severity is the seriousness of the event, FRU says where the event occurred (on PS0, PS1 or SSC0), and message is a short description of the event. Sun IB Switch 9P Administration Guide • October 2006...
Page 71: To Use The Showlogs Command
If you use the showlogs command without any option, ALOM displays the last 20 lines of the event log. ▼ To Use the showlogs Command Note – You do not need user permissions to use this command. ● At the sc> prompt, type the following command: sc>...
Page 72 Jan 01 00:00:06: MINOR: SSC0: Service Required LED state changed to OFF. Jan 01 00:00:06: MINOR: SSC0: Locator LED state changed to OFF. Jan 01 00:00:03: MINOR: SSC0: Environmental monitoring enabled. Sun IB Switch 9P Administration Guide • October 2006...
Page 73: Showlogs Command Options
Sample of showlogs command for SSC0 CODE EXAMPLE 3-10 Jan 01 00:00:06: MINOR: SSC0: Active LED state changed to ON. Jan 01 00:00:06: MINOR: SSC0: Service Required LED state changed to OFF. Jan 01 00:00:06: MINOR: SSC0: Locator LED state changed to OFF. Jan 01 00:01:58: MAJOR: Factory commands Enabled Jan 01 00:00:03: MINOR: SSC0: Environmental monitoring enabled.
Page 74: To Use The Showplatform Command
At the sc> prompt, type showplatform. The switch returns information similar to the following: sc> showplatform Status Type -------- ------------- -------------------- SSC0 Sun IB Switch 9P POWER SUPPLY, A188 POWER SUPPLY, A188 Sun IB Switch 9P Administration Guide • October 2006...
Page 75: Showplatform Command Options
Using the -v option returns information similar to the following: sc> showplatform -v Status Type Part No. Serial No. -------- ------------- -------------------- -------- -------- SSC0 Sun IB Switch 9P 5957467 000011 POWER SUPPLY, A188 3001650 000031 POWER SUPPLY, A188 3001650 000044 Domain Status MAC Address...
Page 76: To Use The Showusers Command
To display the switch configuration information, type the following command at ■ the sc> prompt: sc> showsc Sun Advanced Lights Out Manager for Sun IB Switch 9P Copyright 2003-2005 Sun Microsystems, Inc. All Rights Reserved. ALOM-B 1.2 Release: 0.3.19, Created: 2005.02.24.09.27 (astec_debug) for Astec PSU...
Page 77: To Use The Useradd Command
The system displays user information similar to the following example: sc> showusers username connection login time IP address -------- ---------- ---------- ---------- admin net-1 Mar 03 16:42 UTC 129.149.2.17 admin net-2 Mar 03 22:04 UTC 129.150.25.245 Note – The switch allows a maximum of four Telnet sessions and one serial session for all users, at any time.
Page 78: To Use The Userdel Command
Note – You must have u level user permission to use this command. See “userperm” on page 49 for information on setting user permissions. ● At the sc> prompt, type the following command: sc> userpassword username Sun IB Switch 9P Administration Guide • October 2006...
Page 79: Password Restrictions
where username is the name of the user account for which you want to change the password. When you use this command, ALOM does not prompt you for the existing password. For example: sc> userpassword msmith New password: Re-enter new password: sc>...
Page 80: Permission Levels
Sun IB Switch 9P Administration Guide • October 2006...
Page 81: To Use The Usershow Command
For example, to assign c and r user permissions to user msmith, type the following at the ALOM command prompt: sc> userperm msmith cr To see a user’s permission levels, use the usershow command. A user with read-only permission can use only the following commands: help ■...
Page 82 Mike is the specified user in the following example. For example: sc> usershow mike username permissions password? -------- ----------- --------- mike auc- Assigned Sun IB Switch 9P Administration Guide • October 2006...
Page 83: Troubleshooting
A P P E N D I X Troubleshooting This chapter consists of tables of the most common issues you might experience with error messages you see and troubleshooting suggestions. It contains the following sections: “Diagnosing Switch Indicators” on page 53 ■...
Page 84: Diagnosing Port Connections
Jan 01 00:00:14: MINOR: SSC0: Locator LED state changed to OFF. Jan 01 00:00:31: MAJOR: Factory commands Enabled Jan 01 00:00:03: MINOR: SSC0: Environmental monitoring enabled. Jan 01 00:00:06: MINOR: SSC0: Active LED state changed to ON. Sun IB Switch 9P Administration Guide • October 2006...
Page 85 Sample Output of showlogs Command (Continued) CODE EXAMPLE A-1 Jan 01 00:00:06: MINOR: SSC0: Service Required LED state changed to OFF. Jan 01 00:00:06: MINOR: SSC0: Locator LED state changed to OFF. Jan 01 00:00:03: MINOR: SSC0: Environmental monitoring enabled. Jan 01 00:00:06: MINOR: SSC0: Active LED state changed to ON.
Page 86 3. Make a list of the commands or circumstances that led to the fault. 4. Make a list of any error messages displayed. 5. Contact customer service. Sun IB Switch 9P Administration Guide • October 2006...
Page 87: System Log Messages
System Log Messages If the SUNWsibs9p package is installed and set up for the switch, event messages from the switch will occur on the host (See “System Log Proxy” on page 9). Some messages are informational, others represent errors. The messages can be divided into two categories: messages from the switch platform itself ( TABLE A-1 ) and messages from the InfiniBand management software (...
Page 88: System Log Informational Messages From The Platform
The init of the platform has started. Platform Sun IB Switch 9 port platform init started The switch was rebooted by the watchdog due to a hang of Platform Last reset was done by WDOG the system. Sun IB Switch 9P Administration Guide • October 2006...
Page 89: Syslog Messages
The InfiniBand (IB) management software is responsible for setting up and controlling all the IB devices that are connected together. The events reported by this software can therefore be for some other device than the switch where the software is running. In InfiniBand a port on a IB device (switch or channel adapter card) is uniquely identified by a value called PortGUID.
Page 90 Information The system image GUID of IB port IBSRM_EVENT_PORT_SYS_IMG_GUID_CHA NGED, port_GUID = port-GUID, identified by sys_im_GUID = system-image-GUID port-GUID has changed to system-image- GUID Sun IB Switch 9P Administration Guide • October 2006...
Page 91 Syslog Messages (Continued) TABLE A-3 Message Severity Description The IB port destination-port-GUID has IBSRM_EVENT_PORT_BAD_MKEY, src Warning GUID = source-port-GUID, received a package from source-port- dest GUID = destination-port-GUID, GUID that has a bad MKey value. attr_ID = attribute-ID, attribute-ID and method describe the type method = method of packet received.
Page 92 The multicast group identified by IBSRM_EVENT_MCG_DELETED, mclid = mc-lid-value multicast lid mc-LID-value has been deleted. The master SM in the IB subnet is IBSRM_EVENT_SM_BECAME_MASTER, Information sm_GUID = GUID-value running behind the port identified by GUID-value. Sun IB Switch 9P Administration Guide • October 2006...
Page 93 Syslog Messages (Continued) TABLE A-3 Message Severity Description The IB subnet that the local switch IBSRM_EVENT_MISC_EMPTY_SUBNET, Information local GUID GUID-value GUID-value is part of is currently empty. (No hosts are connected or yet done booting.) The IB management software running IBSRM_EVENT_MISC_BAILOUT, reason Error = reason, file source-file, line source-...
Page 94: Troubleshooting Alom Problems
Ethernet cable is properly attached and the switch can be reached using ping and telnet. You can perform Specific user permissions are required to perform functions. Check your permission some ALOM level. functions, but not others Sun IB Switch 9P Administration Guide • October 2006...
Page 95: Alom Shell Error Messages
ALOM Shell Error Messages This section contains information about certain types of error messages you might see when using the ALOM command shell: “Usage Errors” on page 65 ■ “Additional Important Messages” on page 68 ■ “General Errors” on page 69 ■...
Page 96: Cli Messages
Error: username is in use. Cannot remove The user does not have sufficient permissions for the attempted operation. Error: delete of user username failed The user does not have sufficient permissions for the attempted operation. Sun IB Switch 9P Administration Guide • October 2006...
Page 97 CLI Messages (Continued) TABLE A-6 Message Description The default user admin has no permissions right after Initial state for user admin has no the switch is shipped. A password has to be assigned permissions: enter ’password’ to set to it. password and enable full permissions.
Page 98: Additional Important Messages
Cautionary prompt to ensure you are not removing all Are you sure you want to remove all permissions accidently. permissions for user %s (y/n) ? The system must be reset (using resetsc) for the new image to be loaded Sun IB Switch 9P Administration Guide • October 2006...
Page 99: General Errors
Additional Important Messages (Continued) TABLE A-7 Message Description poweroff confirmation. Are you sure you want to power off FRU %s (y/n)?: No messages are in the event log. Event log is empty. removefru confirmation. Are you sure you want to remove %s (y/n)?: Restore factory defaults confirmation.
Page 100 Login attempt failed. This message appears at the login Invalid login prompt. You entered an invalid password with the userpassword Invalid password command. Invalid permission: permission You entered an invalid user permission. Sun IB Switch 9P Administration Guide • October 2006...
Page 101: Fru Errors
General Error Messages (Continued) TABLE A-8 Error Message Command/Description The two entries for a new password did not match. Enter Passwords don’t match the password again. You attempted to execute a shell command for which you Permission denied do not have the proper user permission level. You entered an incorrect password.
Page 102 Sun IB Switch 9P Administration Guide • October 2006...
Page 103: Specifications
A P P E N D I X Specifications This appendix provides the technical specifications for the Sun IB switch. It contains the following sections: “Interface Signals” on page 73 ■ “Switch Architecture” on page 74 ■ “System Management” on page 75 ■...
Page 104: Switch Architecture
9 12x/4x IB compliant CU ports Distance 10m with 24 AWG Performance 540Gbps bidirectional bandwidth 86nsec port-to-port latency 92% switching efficiency System controllers ALOM 1.2 Management ports 10/100 Ethernet port (RJ-45) Serial port (RJ-45) Sun IB Switch 9P Administration Guide • October 2006...
Page 105: System Management
System Management System Management TABLE B-3 Feature Description Operating system VxWorks Remote management In-band and out-of-band (10/100 Ethernet and serial) Protocols CLI through Telnet, RS-232 System controllers ALOM 1.2 High Availability High Availability TABLE B-4 Component Description PSU and cooling Redundant hot-swap PSU and fan modules Chassis power Dual AC inlets...
Page 106: Led Descriptions
Amber (Fault) Blue (Ready-to-remove) IB ports Green (Operational/Link activity) Amber (Attention/Locate) Power Requirements Power Requirements TABLE B-6 Specification Measurement Operating voltage 90-264 VAC Frequency range 47-63 Hz Maximum power consumption 60 Watts Sun IB Switch 9P Administration Guide • October 2006...
Page 107: Environmental Specifications
Environmental Specifications Environmental Specifications TABLE B-7 Specification Measurement Operating temperature +5˚ to -40˚ Humidity 10% to 90% Cooling: static pressure Front to back Appendix B Specifications...
Page 108 Sun IB Switch 9P Administration Guide • October 2006...
Page 109: Updating The Firmware
A P P E N D I X Updating the Firmware From time to time, the firmware for the Sun IB switch might need to be updated. This appendix provides instructions for setting up a TFTP server and using the flashupdate command to update the firmware.
Page 110 Change directory to a temporary directory: # cd /tmp d. Use TFTP to get the file from the tftpboot directory: # tftp localhost tftp> get filename Received xxx bytes in x.x seconds tftp> Sun IB Switch 9P Administration Guide • October 2006...
Page 111: Installing Firmware Images From The Tftp Server
Note – Note that TFTP is not the same as FTP. It does not display the same error messages as FTP, and you cannot use the cd or ls commands (or indeed most other commands) that FTP allows you to use. Installing Firmware Images From the TFTP Server The procedures for upgrading firmware on the switch involve using TFTP.
Page 112: To Upgrade The Switch Firmware
To Upgrade the Switch Firmware ▼ 1. Check the current version of the firmware: sc> showsc Sun Advanced Lights Out Manager for Sun IB Switch 9P Copyright 2003-2005 Sun Microsystems, Inc. All Rights Reserved. ALOM-B 1.2 Release: 0.3.19, Created: 2005.02.24.09.27 (astec_debug) for Astec PSU...
Page 113 2. Update the firmware: sc> flashupdate -s ipaddress -f /tftpboot/ibswitch-sc.flash Warning: Are you sure you want to flashupdate the SSC0/SC flash image (y/n)? y SSC0/SC: Preparing to flashupdate. flashupdate: verifying image, please wait flashupdate: erasing segment 0 programming address ffb80000 flashupdate: erasing segment 1 programming address ffb8fff0 flashupdate: erasing segment 2 programming address ffb9fff5 flashupdate: erasing segment 3 programming address ffbafffa...
Page 114 Sun IB Switch 9P Administration Guide • October 2006...
Page 115: Blueprints
IB network. In addition, it also defines the maximum number of nodes in the topology. In the initial release of the Sun IB switch 9p product, only a single predefined configuration was supported (that is, a single switch with up to 9 ports connected to host channel adapters).
Page 116 ID. To avoid this problem, the default IP address can not be used on both switches, independently of whether the Ethernet port is in use on any of the switches. Sun IB Switch 9P Administration Guide • October 2006...
Page 117: Setting Up A Blueprint
Setting Up a Blueprint The currently supported blueprints have the following options: 9 node, 12 node, 18 node, none, or unmanaged. Use the setbp command to set up the blueprint of the switch (see “setbp” on page 24) Each of these blueprints is described in the following sections.
Page 118: 12-Node Blueprint
In this topology three switches connect to a maximum of six HCAs while the three remaining ports can be connected to the fourth switch. The fourth switch can then only connect to the other switches through three connections to each. Sun IB Switch 9P Administration Guide • October 2006...
Page 119: None Blueprint
The switch that only connects to other switches is denoted as the top switch and will always be the master management node. The other switches are denoted bottom switch. These terms are used when the blueprint settings are displayed through the showbp command.
Page 120: Unmanaged Blueprint
Use Ctrl-z to exit & save. Use Ctrl-c to abort. Should this switch run IB management software [y/n]: n The new blueprint setting is saved The system must be reset (using resetsc) for the new setting to become active sc> Sun IB Switch 9P Administration Guide • October 2006...
Page 121: Changing Configurations
Changing Configurations You can change from one configuration (blueprint) to another without re-configuring the hosts by ensuring that the IB subnet prefix is maintained when changing from one configuration to another. However, changing the blueprint on a switch cannot be done without re-booting the switch.
Page 122 Similarly, if an operational host is disconnected from one subnet and then connected to another subnet, then it will have to be re-configured to become operational on the new subnet. Sun IB Switch 9P Administration Guide • October 2006...
Page 123 Index adding user accounts, 47 blueprint changing conﬁguration, 91 alarm status, 32 setting, 24 ALOM commands blueprint concept, 85 flashupdate, 15 help, 17 blueprint option logout, 19 12-node, 88 password, 19 18-node, 88 poweroff, 20 9-node, 87 poweron, 21 none, 89 removefru, 22 unmanaged, 90 setbp, 24...
Page 124 64 list reset, hard, 23 ALOM error messages, 65 to 71 setbpsetbp command, 24 locator LED, 29 setdate command, 26 status, 40 setdefaults command, 28 turning on/off, 29 setlocator command, 29 Sun IB Switch 9P Administration Guide • October 2006...
Page 125 setting user permissions, 49 viewing blueprints, 31 setting blueprint of a switch, 24 voltage status, 32 setupsc command, 29 show FRU status, 35 showbp command, 31 showdate command, 32 showenvironment command, 32 showfru command, 35 showing current date, 32 users, 51 showlocator command, 40 showlogs command, 40 showplatform command, 44...
Page 126 Sun IB Switch 9P Administration Guide • October 2006...

Sun Microsystems IB Switch 9P Administration Manual

Introduction

Initial Configuration

Command-Line Reference

Troubleshooting

Specifications

Updating the Firmware

Blueprints

Quick Links

Troubleshooting

Need help?

Questions and answers

Related Manuals for Sun Microsystems IB Switch 9P

Summary of Contents for Sun Microsystems IB Switch 9P

Table of Contents