Page 1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide Corporate Headquarters Cisco Systems, Inc. 170 West Tasman Drive San Jose, CA 95134-1706 http://www.cisco.com Tel: 408 526-4000 800 553-NETS (6387) Fax: 408 526-4100 Text Part Number: OL-8787-04...
Page 2 OR ITS SUPPLIERS HAVE BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. CCVP, the Cisco Logo, and the Cisco Square Bridge logo are trademarks of Cisco Systems, Inc.; Changing the Way We Work, Live, Play, and Learn is a service mark of Cisco Systems, Inc.;...
Page 3: Table Of Contents
SFS 7012 Feature Set Strategic Benefits Key Design Features SFS 7012 Product Specifications Mechanical/Thermal/Power Specifications Thermal Management Features Power Design Features Switch Characteristics Chassis Viewer Software Chassis Viewer Functionality Subnet Manager Subnet Management Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 4 Updating Management Spine IP Addresses in a Redundant Management Configuration SFS 7012 Component LEDs SFS 7012 Leaf and Spine Module LEDs Accessing On-line Help Shutdown Procedures Rebooting Components from Chassis Viewer Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 5 System Information Tab Modifying Switch Component Information Configuration and Monitoring Features Chassis View Menu Logging Set Level Reset Log Levels Firmware Update SNMP Target Configuration Filter Status Setting Community Strings Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 6 A P P E N D I X Overview Commands and Functional Groups Online Help Keyboard Shortcuts Accessing the CLI Groups and Commands General Firmware IbSwitchInfo Chassis KeyManagement TimeManagement SNMP Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 7 OOB Ethernet RJ45 Port Problem SFS 7012 Leaf Module IB Ports Problem Troubleshooting Scenarios InfiniBand Invalid IP Address entered for SWC via Console Port Bad IB Cable Improperly Seated IB Cable Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 8 Contents Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 9: New And Changed Information
New and Changed Information The Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide applies to the SFS 7012 Release 3.1 or later. Table 1 lists the new and changed features available with each supported SFS 7012 release. Table 1...
Page 10 Table 1 Documented Features for the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide (continued) Changed in Feature Description Release Where Documented Redundant Added redundant management information. 3.3 Installing the Spine Management and Leaf Modules, page 2-26 Updating Management Spine IP...
Page 11: Preface
Preface This preface describes the audience, organization, and conventions of the Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide . It also provides information on how to obtain related documentation. Audience The intended audience for this document are network administrators responsible for configuring and operating network equipment.
Page 12: Conventions
Compliance and Safety Information document that accompanied this device. Related Documentation The documentation set for the SFS 7012 includes the following documents: Regulatory Compliance and Safety Information for the Cisco SFS 7012 and SFS 7024 • • Cisco SFS 7012 InfiniBand Server Switch Release Notes for Cisco Releases Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide •...
Page 13: Product Documentation Dvd
The Product Documentation DVD is a library of technical product documentation on a portable medium. The DVD enables you to access installation, configuration, and command guides for Cisco hardware and software products. With the DVD, you have access to the HTML documentation and some of the PDF files found on the Cisco website at this URL: http://www.cisco.com/univercd/home/home.htm...
Page 14: Reporting Security Problems In Cisco Products
Modifications to or updates about Cisco products are announced in Cisco Product Alerts and Cisco Field Notices. You can receive Cisco Product Alerts and Cisco Field Notices by using the Product Alert Tool on Cisco.com. This tool enables you to create a profile and choose those products for which you want to receive information.
Page 15: Obtaining Technical Assistance
Use the Cisco Product Identification Tool to locate your product serial number before submitting a Note request for service online or by phone. You can access this tool from the Cisco Technical Support & Documentation website by clicking the Tools & Resources link, clicking the All Tools (A-Z) tab, and then choosing Cisco Product Identification Tool from the alphabetical list.
Page 16: Submitting A Service Request
Cisco engineer. The TAC Service Request Tool is located at this URL: http://www.cisco.com/techsupport/servicerequest For S1 or S2 service requests, or if you do not have Internet access, contact the Cisco TAC by telephone. (S1 or S2 service requests are those in which your production network is down or severely degraded.) Cisco engineers are assigned immediately to S1 and S2 service requests to help keep your business operations running smoothly.
Page 17 Cisco products that are sold through channel partners. It is updated twice a year and includes the latest Cisco channel product offerings. To order and find out more about the Cisco Product Quick Reference Guide, go to this URL: http://www.cisco.com/go/guide...
Page 18 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 19: Chapter 1 Product Overview
C H A P T E R Product Overview The Cisco SFS 7012™ is an industry leading modular system used for creating large, single-system Grid/Cluster server fabrics, or as a building block for larger fabrics. The SFS 7012 is designed to maximize performance, streamline operations, and ensure uptime by providing full hardware and software reliability, availability, and serviceability (RAS) features.
Page 20: Sfs 7012 Product Specifications
12V bulk power • Status indicators • • Two (2) independent AC input lines Switch Characteristics • 7U form factor • Full module enclosure • Available power (all copper): 745 Watts max Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 21: Chassis Viewer Software
Configure the OOB LAN IP address • Manage and monitor log files, including: • Set debug levels determining the amount of information to be logged – Reset the logs – Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 22 Chapter – Perform maintenance tasks Manage firmware updates, including uploading new firmware and setting the active version. – Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 23: Subnet Manager
Management Agents are implemented on all nodes within the InfiniBand fabric. These nodes include IB-capable switches, routers, and channel adapters. Each node implements a Subnet Management Agent. Within the SFS 7012 Switch, a Subnet Management Agent (SMA) is implemented within its firmware. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 24: Infiniband General Services Managers And Agents
The BM and BMA exchange messages relating to items such as temperature monitoring and hardware control to manage hardware on the fabric. The Performance Manager (PM) and Performance Management Agent (PMA) • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 25: Snmp Support
Switch-sourced MIBs: MIBs from the CMU of the SFS 7012 provide status information regarding • the physical environment of the switch. Additionally, the CMU MIBs provide status and activity information for all line cards residing in the switch. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 26 Chapter Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 27: Chapter Installation
C H A P T E R Installation This chapter describes how to install the Cisco SFS 7012™ and its components, and it includes the following information: • Planning the Installation, page 2-15 Installation Tasks, page 2-22 • Hot Swapping Components, page 2-39 •...
Page 28: Statement 1019-Main Disconnecting Device
Ausschaltvorrichtung dient. Avvertenza Il gruppo spina-presa deve essere sempre accessibile, poiché viene utilizzato come dispositivo di scollegamento principale. Advarsel Kombinasjonen støpsel/uttak må alltid være tilgjengelig ettersom den fungerer som hovedfrakoplingsenhet. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 29: Statement 1045-Short-Circuit Protection
Effettuare l’installazione rispettando le Norme CEI pertinenti. Advarsel Dette produktet krever beskyttelse mot kortslutninger (overspenninger) som en del av installasjonen. Bare installer utstyret i henhold til nasjonale og lokale krav til ledningsnett. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 30 Advarsel Dette produkt kræver beskyttelse mod kortslutning (overstrøm). Dette skal være en del elinstallationen i bygningen. Installation skal ske i overensstemmelse med nationale og lokale ledningsregler. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 31: Statement 1074-Comply With Local And National Electrical Codes
A instalação do equipamento tem de estar em conformidade com os códigos eléctricos locais e nacionais. ¡Advertencia! La instalación del equipo debe cumplir con las normativas de electricidad locales y nacionales. Varning! Installation av utrustningen måste ske i enlighet med gällande elinstallationsföreskrifter. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 32: Statement 1075-Hazardous Voltage Or Energy Present On Dc Power Terminals
Os terminais de corrente contínua podem fornecer tensão ou energia perigosa. Volte a colocar a tampa, sempre que os terminais não estiverem a ser utilizados. Certifique-se de que os condutores sem isolamento não estão acessíveis, quando a tampa estiver colocada. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 33: Planning The Installation
Cabinet doors must not impede the front-to-back air flow. Power supplies use the air inside the chassis and exhaust out the front of the chassis. Humidity 5% to 85% relative humidity (noncondensing). Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 34: Rack Specifications And Recommendations
90-degree bend. In other words, this number includes the 2" connector stand-off from the panel surface. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 35: Power Requirements
Transition time (the time necessary for the UPS to transfer from utility power to full-load battery • power). The longest potential time period the UPS might be required to supply backup power. • Whether or not the UPS unit also provides online protection. • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 36: Installation Tasks Checklist
Tips and reminders to maximize the use of the equipment. – Potential for damage to system equipment. Damage to the system caused by the user may have potential Caution warranty implications. Potential for personal injury. Warning Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 37 When transporting an ESD sensitive component, first place it in an antistatic container or packaging. Caution Electrical Safety Precautions Warning Do not work alone when working with high voltage components. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 38: Tools And Equipment Required
The unit exhibits a distinct change in performance, indicating a need for service. – Tools and Equipment Required An ESD wrist strap • A #2 Phillips screwdriver • • Pen (felt-tip) to mark the mounting holes Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 39: Check The Installation Site
Step 3 Verify that the equipment serial numbers match those on the packing slip. Step 4 Resolve any issues with incorrect serial numbers or missing/incorrect parts before installing the equipment. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 40: Installation Tasks
The front flange (chassis fan side) of the rail has 3 holes. The back flange of the rail (chassis leaf module Note side) has two holes, which correspond to the bottom two holes on the front flange. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 41 Figure 5 Rail Front Flange Install 2 screws to top and bottom holes Install the second rail on the other side of the rack by repeating steps 1 through 3. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 42: Rack-Mount The Switch
Install 1 screw into bottom hole on each rail Step 5 On each side of the chassis, install a screw and caged nut into the holes above and below the handle. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 43: Installing The Switch Face Plate
Install the heyclip to the rail assembly. Step 7 If applicable, reinstall the chassis fascia(s). Step 8 Installing the Switch Face Plate To install the switch face plate(s): Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 44: Removing A Module Or Blank
Spine Modules — It is recommended that the spine module(s) be installed into: Slot 1 for managed. For redundant management, populate slots 1 and 2 with management-capable – spines. Slot 3 for unmanaged. – Refer to Figure 2-9 below: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 45: Connect Equipment To The Ports And Power On The System
It is important to understand the slot numbering for the leaf modules and spine modules (and the corresponding spine RJ-45 ports). It is also important to understand the slot numbering for the fans and power supplies (and the corresponding AC power inlets for the power supplies). Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 46 Doing this prevents all of the rotational forces from acting right at the connector terminations. It is important to provide strain relief for the IB cable connector. Caution Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 47: Bringing Up The System For The First Time
Bringing Up the System For the First Time Start-up Procedures Power up the SFS 7012. Step 1 Step 2 From its flash image on the CMU spine module, the switch begins its boot process. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 48: Changing The Sfs 7012 Ip Address And Default Gateway Via The Cli
8 data bits – no parity bits – 1 stop bit – 56K baud – Use VT100 emulation. – Flow control = XON/XOFF – Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 49: Updating Management Spine Ip Addresses In A Redundant Management Configuration
Gives the user the ability to ping each management spine separately. • If the IP addresses are not unique, collisions will occur, causing IP operations to fail. • To update the IP address on managed spine, do the following: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 50 Mounted flash file system on device /rfa1. (size=2097152 bytes) Unified Boot Manager [1] image1 [2] image2 CPU: Broadcom BCM1125 VxWorks Version: 5.4 [boot]: Unified Boot Manager For The T3 Platform. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 51 = 7012 Boot Image Information: Product = SFS7012 = t3 Version = 3.3.0.0.4 Compressed Image Size = 3616523 bytes = 46086777be1b5bae45140a440425b915 vxWorks Image Type = loadable Computed md5 = 46086777be1b5bae45140a440425b915 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 52: Sfs 7012 Component Leds
• The system ambient temperature exceeded 60 degrees C. • No functional fan trays are present. No functional spines are present. • No functional leaves are present. • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 53: Sfs 7012 Leaf And Spine Module Leds
IB link status LED that provide the following indications: On - the logical link is up (port is in the Active state). • Slow Blink - the physical link is up (port is in the Initialization state). • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 54 Green indicates that the switch is capable of running at DDR speeds. – Off indicates that the switch is not capable of running at DDR speeds (i.e., SDR only). – Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 55: Accessing On-Line Help
Figure 2-15 Chassis Viewer Online Help Button(s) The on-line help screens contain topical information with textual references to more detailed information within the documentation. A sample on-line help screen is shown in Figure 2-16: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 56: Shutdown Procedures
This is accomplished through the CLI of the master spine. Access the master spine CLI via Telnet, SSH, or through the SFS 7012 RS232 serial ports. Step 1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 57: Hot Swapping Components
Pull the handles out to extend them. Slide the module into the appropriate slot of the chassis until it Step 3 makes contact with the backplane. As the module seats in the chassis, the handles will begin to close. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 58: Hot Swapping The Fan Unit
Place the unit into the slot. Slowly slide the power supply in until it engages into the connector. Step 6 Step 7 Using the panel screw, push up to re-engage the unit. Step 8 Tighten the captive panel screw. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 59: Chapter 3 Operations And Administration
C H A P T E R Operations and Administration This chapter describes how to administer and configure the Cisco SFS 7012™ and its components, and it includes the following information: • Logging, page 3-53 Firmware Update, page 3-58 •...
Page 60: Home Page
The ? (HELP) button displays online help. Each help screen gives the user a high-level, topic-specific description. Support Button Figure 3-3 Support Button The Support button displays key contact information for support, displayed in the following window: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 61: Displaying The Leaf And Spine Module Views
Mouse over the leaf module to display. The edges of the leaf module are highlighted green as shown in Step 1 Figure 3-5 below: Figure 3-5 Leaf Module Mouseover Left click the mouse. The leaf module view will be displayed. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 62: Spine Module View
Left click the mouse. The spine module view will be displayed. Figure 3-8 Spine Module View Leaf and Spine Module Component Details Area The Component Details Area contains three areas. Details Header • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 63: Leaf And Spine Details Header
Saves any user edits within the white fields to flash memory. Refresh: Refreshes all fields in the information areas. Displaying the Chassis View There are two ways to display the chassis view for the SFS 7012: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 64 The second way is to mouse over the outer region of the spine module view. The edges of the chassis are Step 2 highlighted green as shown in Figure 3-12 below: Figure 3-12 Spine Module Chassis Mouseover Left click the mouse. The chassis view will be displayed. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 65: Chassis View Component Details Area
View Log • Figure 3-14 Chassis Details Header Rebooting Components from Chassis Viewer From the Chassis Details header, click Reboot. A screen similar to the following is displayed. Step 1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 66 -n reboots just the management card of the slave spine (in a non-disruptive manner). Note If accessing the CLI through Telnet or SSH, the user will need to reconnect to the CLI following the reboot. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 67: Chassis View Component Information Area
The LEDs and Sensors tab displays: • Switch component LED information for chassis status, chassis SMA, fan and power supplies. Slot-based temperature and AC-power sensor data for the internal switching complex. • Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 68 If the IB Node Description field has been changed since the last reboot of either spine, the next Note reboot will be treated as disruptive. System Uptime The elapsed time since the last time switch was re-initialized. System Contact Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 69 The Power tab displays switch power supply information. This information includes the following items: Description A description of the component, assigned by an administrator. Status Displays the status of the component. Part Num Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 70: Modifying Switch Component Information
In the text boxes, enter information which is applicable to the existing network environment. Step 3 To save, click the Apply button at the bottom of the screen. Step 4 Figure 3-18 System Information Area Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 71: Configuration And Monitoring Features
The Chassis View Menu allows the user to execute all configuration and operation tasks available for the SFS 7012 switch. Logging The Logging submenu allows the user to set and reset levels for the message log file. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 72: Set Level
– From this screen, the user can change any of the log level settings for a specific software module by clicking on the Configure hyperlink, which displays a configuration screen: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 73 INFO: Informational messages that occur during a system or component boot. The user does not need to take any action. – PERIODIC: An informational message containing periodic statistics. The user does not need to take action. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 74 Chapter Debug message levels 1 through 5: Debug messages are for supplier and/or Cisco engineering use and are not necessarily indicative of actions that an end user may need to take. – DEBUG1 – Messages that describe the states of connections and links.
Page 75: Reset Log Levels
Figure 3-26 Reset Levels Button To reset the logging levels: From the menu, select Logging. Step 1 Click Logging. Step 2 Click Reset Levels. The Reset Levels window is displayed: Step 3 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 76: Firmware Update
Step 6 Step 7 Click the Update Firmware button. Before using the Browse... button, make certain that the browser can connect to the server where the Note firmware files reside. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 77: Snmp
Figure 3-31 Target MIB Configuration Button To display the Target Configuration window: From the menu, select SNMP. Step 1 Select Target Configuration. Step 2 The SNMP Target Configuration window is displayed: Step 3 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 78 Specifies the IP address and port in hex, separated by colons. The first eight values make up the IP address, the last 4 make up the port number. For example, specify 0xc0:a8:00:65:00:a2 for 192.168.0.101 Port: 162. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 79 Specifies a mapping to an entry in the SNMP Target Parameters table, determining the version of SNMP to use. MP Model • The Message Processing Model to be used when generating SNMP messages for entry. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 80: Filter Status
Filter Status The SNMP Filter Status screen allows the user to view parameters for rfc2273 (SNMP-NOTIFICATION-MIB). Figure 3-33 Filter Status Button To view SNMP filter status: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 81: Setting Community Strings
Read/Write Community Name • Figure 3-35 Set Community Strings Button To set the Community Strings: Click SNMP Step 1 Click Set Community Strings. The Set Community Strings screen is displayed. Step 2 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 82: Chassis Traps
Click Trap Control. The Chassis Trap Control screen is displayed. Step 3 Figure 3-38 Chassis Trap Control Screen Select or deselect the desired trap(s). Step 4 To generate an immediate trap, click the applicable Gen Trap button. Note Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 83 This trap indicates, that the bulk power used by a module has failed within the chassis. icsChassisTrapModuleReboot This trap indicates that the chassis is in the process of rebooting. Power Group icsChassisTrapPowerSupplyNotResponding Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 84 This trap indicates that a fan has failed and is not operational. icsChassisTrapFanTrayEEPROMReadFailure This trap indicates, that an error condition was encountered when reading the EEPROM of the fan tray. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 85: Sfs 7012 Port Statistics
A = Spine module switch chip A B = Spine module switch chip B Example: S2AL08 is the ISL between spine module 2, switch chip A and leaf module 8. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 86: Port Statistics Field Descriptions
The supported link speed of the port. This could be 2.5Gbps (SDR), 5.0Gbps (DDR) or both. InfiniBand Statistics: Transmit 32 Bit Words: The number of 32-bit data words transmitted by the port, not including flow control and VCRC data. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 87 Raw Violations Inbound: Number of times raw inbound packet discarded. Raw Violations Outbound: Number of times raw outbound packet was discarded. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 88: Leaf And Spine Module Ib Port Statistics
Select a spine module. The spine module view is displayed. From the Spine Port Stats menu, select IB Port Stats. Step 2 Figure 3-43 Spine Port Stats Menu The spine port statistics window is displayed: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 89: Set Field Thresholds
Figure 3-45 Set Field Thresholds To change error reporting thresholds, do the following: Click on Port Stats. Step 1 Click on Set Field Thresholds. The Set Field Thresholds screen is displayed: Step 2 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 90 The threshold for the number of 32-bit data words received by the port. portXmitPktsThresh The threshold for the number of data packets transmitted by the port. portRecvPktsThresh The threshold for the number of data packets received by the port. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 91: Time Service
The threshold for the number of excessive buffer overrun errors on the port. Time Service The System Time Information screen allows the user to set the system time using either network time protocol (NTP) or manual overrides. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 92 Enter the IP address for the NTP server. Step 2 Step 3 To save, click on Apply. Figure 3-49 Time Service - NTP Setup To manually set the system time: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 93 Date will always be the 1st Sunday in April. However, the Daylight Saving Time End Date will vary between the 4th and 5th Sunday of October. Be certain to check a calendar when setting this parameter. Following are upcoming DST end dates: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 94: Configuring The Switch Oob Ip Address
OOB management port to an external network. To configure the Switch default gateway IP address: From the OOB LAN IP submenu, click Set Default Gateway IP. Step 1 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 95 Figure 3-55 Set Default Gateway IP Window Type in the correct switch default gateway IP address. Step 3 Click Apply. Step 4 A reboot is required to activate the new gateway IP address. Note Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 96: Spine View Menu
The Logging submenu allows the user to view, set levels, reset levels, and purge the message log file. Figure 3-57 Logging Submenu Viewing the Log The View Log button allows the user to view the message log. Figure 3-58 View Log Button To view the message log: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 97: Purging The Log
The Purge Log button purges the RAM, clearing the log file(s). Figure 3-60 Purge Log Button To purge the log: From the menu, click Logging. Step 1 Click Purge Log. The Purge Log confirmation window is displayed Step 2 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 98: Select Boot Image
Step 2 Click Apply. License Keys; Key Administration The License Key submenu allows the user to activate and deactivate feature functionality that is sold as an add-on to the SFS 7012. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 99: Adding A New License Key
Figure 3-67 License Key Submenu Click on Key Administration. The Key Management window is displayed. Step 2 Step 3 To delete a license key, click the Delete button. The system prompts with the following: Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 100 Chapter Figure 3-68 License Key Delete Prompt Step 4 Click OK to delete. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 101: Appendix
• Power Factor 0.95 • Two IEC 320 connectors for independent AC inputs Certification Marks • UL, CSA, CE, VCCI, GS, FCC Class B, IC Class B, ICES - 003 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 102 Appendix Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 103: Appendix
• Overview This section details the usage of the Command Line Interface (CLI) feature for the Cisco SFS 7012™. The CLI allows the user to perform remote configuration and management tasks, which in many respects mirrors the functionality of the Chassis Viewer GUI.
Page 104: Commands And Functional Groups
Snmp: Provides commands for configuring SNMP trap destinations and security parameters required to access the SFS 7012 from an SNMP manager. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 105: Online Help
Telnet to the IP address of the SFS 7012 (the default IP address is 192.168.100.9) with the following Step 1 command: open <IP ADDRESS> The system prompts for a username. The CLI has the following default user names: Step 2 Operator access: operator – Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 106: Groups And Commands
Exit the CLI user Change user accounts passwd Change user accounts password loginMode Change the login authentication mode showLastScpRetCode Display the return code from the last SCP Firmware Push Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 107 Use smShowLids smGetPriority Use smShowPriority smDumpGroups Use smShowGroups smDumpServices Use smShowServices smDumpSubscriptions Use smShowSubscriptions smDisplayMasterLMC Use smShowMasterLMC smDisplaySmMasterLid Use smShowMasterLid smDumpLidMap Use smShowLidMap smDisplayMaxLid Use smShowMaxLid smDisplaySMParms Use smShowSMParms ismTune Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 108: Ibswitchinfo
DESCR: "SFS 7012/7024 Fan Tray" PID: 74-4323-01, VID: N/A, SN: N/A NAME: "Fan Tray 4", DESCR: "SFS 7012/7024 Fan Tray" PID: 74-4323-01, VID: N/A, SN: N/A Total devices found: 9 Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 109: Chassis
Displays the default gateway IP address setDefaultRoute Change the default gateway IP address arpShow Displays the link level adress resolution protocol (ARP) table hostShow Displays the host name table Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 110: Firmware
Configure the syslog host address logShowConfig Display the current log configuration KeyManagement showKeys Display the list of installed license keys addKey Install a license key removeKey Remove a license key Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 111: Timemanagement
Configure the daylight savings time settings SNMP snmpCommunityConf Configure the SNMP community strings snmpTargetAddr Configure the SNMP trap targets snmpTargetParams Access the snmpTargetParamsTable snmpNotifyProfile Access the snmpNotifyFilterProfileTable snmpNotifyFilter Access the snmpNotifyFilterTable snmpNotify Access the snmpNotifyTable Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 112 Capture miscellaneous information. This includes information such as license keys, memory test, time zone, and time Daylight Saving Time (DST) captureSnmp Capture SNMP information captureShell Capture shell command information Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 113: Hardware Checks
A P P E N D I X Troubleshooting This appendix describes how to troubleshoot the Cisco SFS 7012™, and it includes the following information: • Hardware Checks, page C-95 Troubleshooting Scenarios, page C-97 • Hardware Checks Switch Problem The Switch has no power Ensure that the power cord(s) is attached to the Switch and the power outlet.
Page 114: Problem
LED may be bad if IB Link (A and B) LEDs are lit, and the ATTN and/or STAT is not. Bad IB Cable If the QUAL LED is not lit: Test with a known good IB cable. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 115: Troubleshooting Scenarios
Possibly an improperly seated IB cable(s). Ensure that there is a Blue LED illuminated on the switch. Make sure that all devices (nodes) can be seen in your Subnet Manager window. Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...
Page 116 Appendix Cisco SFS 7012 InfiniBand Server Switch Hardware Users Guide OL-8787-04...

This manual is also suitable for:

Sfs 7012

Cisco SFS-7012 - SFS InfiniBand Server Switch 7012 Hardware User's Manual

New and Changed Information

Preface

Chapter 1 Product Overview

Chapter Installation

Chapter 3 Operations and Administration

Appendix

Technical Specifications

Appendix

Command Line Interface

Quick Links

Related Manuals for Cisco SFS-7012 - SFS InfiniBand Server Switch 7012

Summary of Contents for Cisco SFS-7012 - SFS InfiniBand Server Switch 7012

This manual is also suitable for:

Table of Contents