Sun Microsystems Netra CP3060 User Manual
  1. Manuals
  2. Brands
  3. Sun Microsystems Manuals
  4. Server
  5. Netra CP3060
  6. User manual
Sun Microsystems Netra CP3060 User Manual

Sun Microsystems Netra CP3060 User Manual

Blade server
Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual
Sun Netra
CP3060 Blade Server
™
User's Guide
Sun Microsystems, Inc.
www.sun.com
Part No. 819-4967-11
April 2009, Revision A
Submit comments about this document at: http://www.sun.com/hwdocs/feedback

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Netra CP3060 and is the answer not in the manual?

Questions and answers

Related Manuals for Sun Microsystems Netra CP3060

Summary of Contents for Sun Microsystems Netra CP3060

  • Page 1 Sun Netra CP3060 Blade Server ™ User’s Guide Sun Microsystems, Inc. www.sun.com Part No. 819-4967-11 April 2009, Revision A Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
  • Page 2 Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd. Sun, Sun Microsystems, le logo Sun, Netra, Sun Ray, le logo Netra et le logo Solaris sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc., ou ses filiales, aux Etats-Unis et dans d’autres pays.

  • Page 3: Table Of Contents

    Contents Preface xi Introduction to the Sun Netra CP3060 Blade Server 1–1 Overview of the Sun Netra CP3060 Blade Server 1–1 Features of the Sun Netra CP3060 Blade Server 1–2 Sun Netra CP3060 Blade Server System Configurations 1–7 1.3.1 AMC Modules 1–8 1.3.2...
  • Page 4 Installation of Optional Compact Flash Card 2–9 2.4.3 Configuring Rear Transition Module Hardware 2–11 Installing the Sun Netra CP3060 Blade Server 2–11 2.5.1 Installing the Sun Netra CP3060 Blade Server With a Rear Transition Module 2–11 2.5.1.1 Installing a Rear Transition Module 2–12 2.5.2 Installing the Sun Netra CP3060 Blade Server 2–15...
  • Page 5 To Enable Automatic System Recovery 4–14 4.5.1.2 To Disable Automatic System Recovery 4–15 Hot-Swap Information 4–15 4.6.1 Hot-Swapping the Sun Netra CP3060 Blade Server 4–15 4.6.1.1 Hot-Swap LED 4–16 Network Device Aliases 4–17 Retrieving Device Information 4–17 Mandatory /etc/system File Entry 4–20 ▼...
  • Page 6 MPC Bus External Devices 5–18 5.1.5.2 Field-Programmable Gate Array 5–18 5.1.5.3 XBus External devices 5–19 5.1.6 Intelligent Platform Management Controller 5–19 5.1.6.1 Intelligent Platform Management Bus 5–19 5.1.6.2 Interface to the MPC 5–19 Netra CP3060 Board User’s Guide • April 2009...
  • Page 7 5.1.6.3 IPMB-L Interface 5–20 5.1.6.4 ATCA Hot-Swap Latch 5–20 5.1.6.5 LEDs 5–20 5.1.6.6 Power Control 5–20 5.1.6.7 Extended Interface E-keying Control 5–21 5.1.6.8 C Architecture 5–21 5.1.6.9 C Device Address Map 5–22 5.1.6.10 System Monitor and Thresholds 5–24 Power-on Sequence 5–26 Power 5–27 5.3.1 Power Input 5–27...
  • Page 8 Data Transport Connector (Zone 2) A–9 A.4.6 RTM Connector (Zone 3) A–11 A.4.7 TOD Clock Battery Holder A–14 B. Sun OEM IPMI Commands B–1 Get Version Command B–2 Get RTM Status Command B–3 Index Index–1 viii Netra CP3060 Board User’s Guide • April 2009...
  • Page 9 Sun Netra CP3060 Blade Server in an ATCA Shelf Enclosure 1–8 FIGURE 1-4 Sun Netra CP3060 Rear Transition Module 1–9 FIGURE 1-5 Relationship of the Sun Netra CP3060 Blade Server, Midplane, and RTM 1–10 FIGURE 1-6 Sun Netra CP3060 Blade Server Barcode Labeling 1–14 FIGURE 2-1 DDR-2 DIMM Memory Locations 2–6...
  • Page 10 Ethernet RJ-45 Connector A–4 FIGURE A-3 Front Panel Serial Port Diagram A–5 FIGURE A-4 Power Distribution Connector (Zone 1) P10 A–8 FIGURE A-5 Zone 2 Connectors A–10 FIGURE A-6 Zone 3 Connectors A–12 Netra CP3060 Board User’s Guide • April 2009...

  • Page 11: Preface

    The Sun Netra CP3060 Blade Server User’s Guide provides information about features, installation, configuration, functional hardware components, and physical properties of this blade server. The Sun Netra CP3060 Blade Server User’s Guide is written for system integration engineers, field applications and service engineers, and others involved in the integration of these blade servers into systems.
  • Page 12 ■ Solaris™ Operating System documentation, which is at: ■ http://docs.sun.com Shell Prompts Shell Prompt C shell machine-name% C shell superuser machine-name# Bourne shell and Korn shell Bourne shell and Korn shell superuser Netra CP3060 Board User’s Guide • April 2009...

  • Page 13: Typographic Conventions

    To delete a file, type rm filename. * The settings on your browser might differ from these settings. Related Documentation For additional information about the Sun Netra CP3060 blade server and the Sun Netra CP3060 rear transition module (RTM), refer to the following documents. Title...

  • Page 14: Sun Welcomes Your Comments

    You can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your document with your feedback: Sun Netra CP3060 Blade Server User’s Guide, part number 819-4967-11 Netra CP3060 Board User’s Guide • April 2009...

  • Page 15: Introduction To The Sun Netra Cp3060 Blade Server

    Introduction to the Sun Netra CP3060 Blade Server This chapter contains the following sections: Section 1.2, “Features of the Sun Netra CP3060 Blade Server” on page 1-2 ■ Section 1.3, “Sun Netra CP3060 Blade Server System Configurations” on page 1-7 ■...

  • Page 16: Features Of The Sun Netra Cp3060 Blade Server

    Features of the Sun Netra CP3060 Blade Server The Sun Netra CP3060 blade server provides two 1000BASE-T Ethernet interfaces for the Base interface (a requirement of PICMG 3.0) and two serializer, deserializer (SERDES) gigabit Ethernet interfaces (PICMG 3.1) for the Extended interface. The Base interface is used as the control interface and the Extended interface can be used for data traffic.
  • Page 17 ■ Management (IPM) controller, providing a redundant IPMI channel to communicate with the ATCA shelf manager Rear I/O access using a compatible Sun Netra CP3060 rear transition module ■ (RTM) Maximum power consumption: 200 watts (including Sun Netra CP3060 RTM) ■...

  • Page 18: Figure 1-1 Sun Netra Cp3060 Blade Server Front Panel

    7 - OK LED (green) 3 - Ethernet port A (RJ-45) 8 - Hot-Swap LED (blue) 4 - Ethernet port B (RJ-45) 9 - Hot-Swap switch and bottom latch 5 - Serial port (RJ-45, ttya) Netra CP3060 Board User’s Guide • April 2009...
  • Page 19 Sun Netra CP3060 Blade Server (Top View) FIGURE 1-2 Compact AMC slot Flash connector enclosure AMC HDD (optional) Zone 3 connectors Processor (under heat sinks) Zone 2 connectors Zone 1 power connector DIMMs DIMMs Chapter 1 Introduction to the Sun Netra CP3060 Blade Server...
  • Page 20 TABLE 1-1 Feature Summary for the Sun Netra CP3060 Blade Server TABLE 1-1 Feature Description • One UltraSPARC T1 processor (4, 6, or 8 core) • CPU core speed: 1.0 GHz Memory • Eight DDR-2 240-pin Very Low Profile (VLP) DIMMs, buffered, registered •...

  • Page 21: Sun Netra Cp3060 Blade Server System Configurations

    The shields for all shielded cables must be terminated on both ends. Sun Netra CP3060 Blade Server System Configurations Sun Netra CP3060 blade servers can be installed in an ATCA shelf (or chassis), shown in . The blade servers can be deployed in various electrical FIGURE 1-3 configurations to suit each end-user requirement.

  • Page 22: Amc Modules

    Diskless client that boots through network from a remote server 1.3.1 AMC Modules The Sun Netra CP3060 blade server has one AMC slot to provide additional I/O to the front panel. The AMC slot supports AMC-compatible SATA disk drives and PCI-E cards. See Section A.4.2, “AMC Connector ”...
  • Page 23 Zone 3 connectors Ethernet port Serial port shows the physical relationship between the blade server, the rear FIGURE 1-5 transition module, and the midplane in a typical ATCA system. Chapter 1 Introduction to the Sun Netra CP3060 Blade Server...

  • Page 24: Figure 1-5 Relationship Of The Sun Netra Cp3060 Blade Server, Midplane, And Rtm

    (installed from front) ATCA chassis midplane Note – When the RTM is used with the Sun Netra CP3060 blade server, shielded cables are required for serial I/O ports. Unshielded cables can be used on Ethernet ports to satisfy EMI compliance standards. The shields for all shielded cables must be terminated on both ends.

  • Page 25: Hot-Swap Support

    The serial port can be used on either the Sun Netra CP3060 blade server or Sun Netra CP3060 RTM, but both ports cannot be used at the same time. If the serial port on Sun Netra CP3060 blade server is used, the serial port on the Sun Netra CP3060 RTM should not be used and vise versa.

  • Page 26: Hardware Requirements

    Serial terminal or terminal emulation for console output. ■ Cables for terminal and network connections. ■ The Sun Netra CP3060 RTM and the AMC disks and PCI-E cards are optional. ■ lists ATCA and other minimum requirements met by the Sun Netra CP3060 TABLE 1-3 blade server.

  • Page 27: Technical Support And Warranty

    Solution Center nearest you by visiting our web site: http://www.sun.com/service/contacting/solution.html When you call Sun Services, be sure to indicate if the Sun Netra CP3060 blade server was purchased separately and is not associated with a system. Have the proper blade server identification information ready. Be prepared to give the representative...

  • Page 28: Figure 1-6 Sun Netra Cp3060 Blade Server Barcode Labeling

    Memory configuration Note – You might find the labels shown in on other locations on your FIGURE 1-6 blade server. Your particular blade server configuration might also appear different from the illustration. 1-14 Netra CP3060 Board User’s Guide • April 2009...

  • Page 29: Hardware Installation

    Refer to Important Safety Information for Sun Hardware Systems (816-7190) for general safety information. Read the safety statements specific to the Sun Netra CP3060 blade server carefully before you install or remove any part of the system. Caution – Depending on the particular chassis design, operations with open equipment enclosures can expose the installer to hazardous voltages with a consequent danger of electric shock.

  • Page 30: Materials And Tools Required

    The minimum tools required to perform installation are: Phillips screwdrivers, No. 1, No. 2 (optional) ■ Antistatic wrist strap ■ Terminal console ■ Section 1.5.1, “Hardware Requirements” on page 1-12 for information on hardware requirements. Netra CP3060 Board User’s Guide • April 2009...

  • Page 31: Preparing For The Installation

    Facility power loading specifications can support the rack or enclosure ■ requirements. Your enclosure specifications support the cooling airflow requirements. The Sun ■ Netra CP3060 blade server fits a standard ATCA shelf or chassis. If your installation requirements are different, contact your field application engineer. Chapter 2 Hardware Installation...

  • Page 32: Determining Local Network Ip Addresses And Host Names

    Server Hardware” on page 2-5 before installing the blade server. The procedure to set up and configure a Sun Netra CP3060 blade server in a system includes the following steps: 1. Configure the blade server’s physical hardware. For example, install memory or Compact Flash, as necessary.

  • Page 33: Configuring The Blade Server Hardware

    Sun Netra CP3060 blade server into the chassis. 2.4.1 Installation of DDR-2 DIMM Memory Modules The Sun Netra CP3060 blade server supports a total of 8 DIMMs and a maximum memory capacity of 16 Gbytes (using eight 2-Gbyte DIMMs). shows the FIGURE 2-1 location of the DIMMs.

  • Page 34: Figure 2-1 Ddr-2 Dimm Memory Locations

    DIMM12 DIMM13 DIMM8 DIMM9 (Channel 0) (Channel 1) (Channel 3) (Channel 2) Note: Channels 1 and 2 are used in four DIMM configurations. Channels 0 and 3 are only used in eight DIMM configurations. Netra CP3060 Board User’s Guide • April 2009...

  • Page 35: Installing A Ddr-2 Dimm Memory Module

    The following procedure provides a general guide for installing additional memory. However, for directions on the installation process of the memory DDR-2 DIMMs on the Sun Netra CP3060 blade server, refer to the documentation that shipped with the memory module.

  • Page 36: Removing A Ddr-2 Dimm Memory Module

    2.4.1.2 Removing a DDR-2 DIMM Memory Module You might need to remove a DDR-2 DIMM module from the Sun Netra CP3060 blade server if you are returning the DDR-2 DIMM module or the blade server for service, or if you are replacing a module with another DDR-2 DIMM module.

  • Page 37: Installation Of Optional Compact Flash Card

    Caution – Always wear a grounded antistatic wrist strap when handling modules. 2. Place the Sun Netra CP3060 blade server on an antistatic mat, or on the blade server’s antistatic bag if you do not have a mat available. 3. For the DDR-2 DIMM you wish to remove, simultaneously pull both DDR-2 DIMM retainer clips outward from the slot.

  • Page 38: Configuring Rear Transition Module Hardware

    2.4.3 Configuring Rear Transition Module Hardware If you are using the Sun Netra CP3060 RTM, refer to the Sun Netra CP3060 Rear Transition Module User’s Guide (819-6689). You can also refer to the Sun Netra CP3060 RTM manual for detailed connector pin assignments.

  • Page 39: Installing The Sun Netra Cp3060 Blade Server

    Installing the Sun Netra CP3060 Blade Server If you are installing the Sun Netra CP3060 blade server with the RTM, first install the RTM at the rear of the server. Then install the node card in the front of the server.

  • Page 40: Installing A Rear Transition Module

    RTMs must be installed inline behind the accompanying node blade server. For example, if the accompanying node blade server is installed in slot 3, its RTM must be installed at the back of the system in slot 3. See FIGURE 2-5 2-12 Netra CP3060 Board User’s Guide • April 2009...

  • Page 41: Figure 2-6 Rtm Injector/Ejector Latch And Locking Screw

    3. Remove the slot filler panel from the selected node blade server slot, if necessary. 4. Get the RTM from the shipping kit. 5. Perform any card-specific hardware procedures, if necessary. Refer to the documentation that you received with the card for more information. 6.

  • Page 42: Installing The Sun Netra Cp3060 Blade Server

    Installing the Sun Netra CP3060 Blade Server 1. If you have installed a Sun Netra CP3060 RTM, go to the front of the system and locate the card slot where you installed the RTM at the rear of the system.

  • Page 43: Figure 2-7 Installing Node Blade Server Into Chassis Slot

    Installing Node Blade Server Into Chassis Slot FIGURE 2-7 6. Taking care to keep the blade server aligned in the guides, slide the blade server in until the injector/ejector latches engage the card cage. 7. Push the blade server slightly into the midplane connectors, and then close the latches to seat the blade server in the connectors ( FIGURE 2-8 When the lower latch is closed, the blue Hot-Swap LED blinks while the blade...

  • Page 44: Connecting External I/O Cables

    Ethernet cable is connected to a suitable 10/100/1000BASE-T switch and the other end to one of the Ethernet ports on the Sun Netra CP3060 blade server. Both Ethernet ports A and B are available on the Sun Netra CP3060 blade server front panel.

  • Page 45: Installation Of Optional Amc Modules

    RJ-45 serial port on the Sun Netra CP3060 blade server’s front panel. Note – A serial port is also provided on the Sun Netra CP3060 RTM. Either the serial port on the Sun Netra CP3060 blade server or the serial port on Sun Netra CP3060 RTM can be used, but only one of the ports should be used at one time.

  • Page 46: Installing An Optional Amc Module

    Installing an Optional AMC Module Note – The following procedure provides a general set of instructions for installing AMC modules on the Sun Netra CP3060 blade server. Refer to the AMC module manufacturer’s documentation for specific instructions on installing these devices.

  • Page 47: Figure 2-10 Inserting Amc Module Into Amc Connector

    Caution – Do not use excessive force when installing the AMC module into the slot. You might damage the AMC connector on the Sun Netra CP3060 blade server, causing permanent damage to the AMC module or the blade server. If the AMC module does not seat properly when you apply even pressure, remove the AMC module and carefully reinstall it.
  • Page 48 2-20 Netra CP3060 Board User’s Guide • April 2009...
  • Page 49 Chapter 2 Hardware Installation 2-21...

  • Page 50: Software Installation

    Section 3.5, “Downloading and Installing SunVTS Software” on page 3-7 ■ Operating Systems and Patches The Sun Netra CP3060 blade server supports the Solaris 10 6/06 OS and subsequent compatible versions, with supported Netra patches. The Solaris OS software can be downloaded from the Sun download center at: http://www.sun.com/download...

  • Page 51: Firmware Updates

    The Sun Netra CP3060 firmware updates can be downloaded from the Sun download center at: http://www.sun.com/download Note – For information on firmware updates, refer to the Sun Netra CP3060 Blade Server Product Notes (819-4966) which are available online at http://www.sun.com/documentation.

  • Page 52: Installing Diskless Clients

    2. Check the /etc/system file to see if the mandatory line is present. TABLE 3-1 # more /etc/system *ident "@(#)system 1.18 05/06/27 SMI" /* SVR4 1.5 */ * SYSTEM SPECIFICATION FILE set pcie:pcie_aer_ce_mask=0x1 3. If the entry is not there, add it. Use an editor to edit the /etc/system file and add the entry.
  • Page 53 # ./smosservice add -u root -p root_password -- -x mediapath=/export/install -x platform=sparc.sun4v.Solaris_10 -x cluster=SUNWCXall -x locale=en_US Where: root_password = root_password ■ image_directory = /export/install ■ locale = en_US ■ n = 10 (for Solaris 10) ■ Netra CP3060 Board User’s Guide • April 2009...

  • Page 54: Adding A Diskless Client

    4. Download and install additional patches. Refer to the Sun Netra CP3060 Blade Server Product Notes (819-4966) for the latest information on the patches available for the Sun Netra CP3060 blade server. The document can be downloaded from the following web site: http://www.sun.com/documentation...
  • Page 55 ■ host_name = client_host ■ n = 10 (for Solaris 10) ■ swap_size = 128 ■ time_zone = US/Pacific ■ locale = en_US ■ name_service = NIS ■ name_server = nameserver_host ■ Netra CP3060 Board User’s Guide • April 2009...

  • Page 56: Downloading And Installing Sunvts Software

    You must type your superuser password again after typing this command. The installation process should take roughly 5 minutes per client and about 15-30 minutes for the operating environment service to install; however, no progress is displayed on screen while the process is running. Do not cancel or kill the process until the process has successfully completed.
  • Page 57 Note – For security reasons, only a superuser is permitted to run SunVTS software. Installation and starting instructions are included with the software when it is downloaded. Netra CP3060 Board User’s Guide • April 2009...

  • Page 58: Firmware And Blade Server Management

    5-19—which controls the system management, hot-swap control, and some blade server hardware. The IPMC configuration is controlled by separate firmware. The Sun Netra CP3060 blade server boots from the 4-Mbyte system flash PROM device that includes the power-on self-test (POST) and OpenBoot™ firmware.

  • Page 59: Power-On Self-Test Diagnostics

    • SDRAM address line test • SDARM cell integrity Test • MOVing inversions memory test 3. POST Image Tests • POST PROM checksum test • POST memory checksum test 4. ECC Error Test Netra CP3060 Board User’s Guide • April 2009...

  • Page 60: Post Diagnostic And Error Message Format

    5. XBUS SRAM Test 6. JBus-to-PCIE Bridge Tests: • Internal registers test JBus interrupts • JBus interrupts • PCI-E MSI Interrupts test • PLX Interconnect test • PCI DMA tests • JBus-to-PCI-E loop-back test 7. PCIE Tests: • Verify PCI-E Bus configuration •...

  • Page 61: Getting To The Ok Prompt

    Solaris system administration documentation. Manual system reset Setting the OBP auto-boot variable to false causes the system to stop at the ok? prompt the next time the blade server is reset. Netra CP3060 Board User’s Guide • April 2009...

  • Page 62: Auto-Boot Options

    An automatic boot is generally not acceptable for booting a system in a degraded state. Therefore, the Sun Netra CP3060 server OpenBoot firmware provides a second setting, auto-boot-on-error?. This setting controls whether the system will attempt a degraded boot when a subsystem failure is detected.

  • Page 63: Probe-Ide Command

    The show-devs command lists the hardware device paths for each device in the firmware device tree. shows some sample output. CODE EXAMPLE 4-2 show-devs Command Output CODE EXAMPLE 4-2 {o} ok show-devs /pci@7c0 /pci@780 /cpu@17 Netra CP3060 Board User’s Guide • April 2009...
  • Page 64 show-devs Command Output (Continued) CODE EXAMPLE 4-2 /cpu@16 /cpu@15 /cpu@14 /cpu@13 /cpu@12 /cpu@11 /cpu@10 /cpu@f /cpu@e /cpu@d /cpu@c /cpu@b /cpu@a /cpu@9 /cpu@8 /cpu@7 /cpu@6 /cpu@5 /cpu@4 /cpu@3 /cpu@2 /cpu@1 /cpu@0 /virtual-devices@100 /virtual-memory /memory@m0,800000 /aliases /options /openprom /chosen /packages /pci@7c0/network@0,1 /pci@7c0/network@0 /pci@780/pci@0 /pci@780/pci@0/pci@9 /pci@780/pci@0/pci@8...

  • Page 65: Checking Network Using Watch-Net And Watch-Net-All Commands

    Good packets received by the system are indicated by a period (.). Errors such as the framing error and the cyclic redundancy check (CRC) error are indicated with an X and an associated error description. Netra CP3060 Board User’s Guide • April 2009...

  • Page 66: Openboot Configuration Variables

    ● To start the watch-net diagnostic test, type the watch-net command at the ok prompt. {0} ok watch-net Internal loopback test -- succeeded. Link is -- up Looking for Ethernet Packets. ‘.’ is a Good Packet. ‘X’ is a Bad Packet. Type any key to stop.........
  • Page 67 Action following a boot command. boot-command boot variable-name File from which to boot if diag-switch? is boot-file none false. variable-name Device(s) from which to boot if boot-device disk net diag-switch? is false. 4-10 Netra CP3060 Board User’s Guide • April 2009...
  • Page 68 OpenBoot Configuration Variables (Continued) TABLE 4-3 Variable Possible Values Default Value Description If true, execute commands in NVRAMRC use-nvramrc? true, false false during server startup. variable-name Command script to execute if nvramrc none use-nvramrc? is true. Firmware security level. security-mode none, command, none full...

  • Page 69: Viewing And Setting Openboot Configuration Variables

    If only nonfatal errors are detected by POST or OpenBoot firmware, the system ■ attempts to boot if auto-boot? is true and auto-boot-on-error? is true. Nonfatal errors include the following: 4-12 Netra CP3060 Board User’s Guide • April 2009...

  • Page 70: Automatic System Recovery

    SATA subsystem failure. In this case, a working alternate path to the boot disk ■ is required. Ethernet interface failure. ■ Serial interface failure. ■ Memory failure. Given a failed DIMM, the firmware will unconfigure the entire ■ logical bank associated with the failed module. Another nonfailing logical bank must be present in the system for the system to attempt a degraded boot.

  • Page 71: Enabling And Disabling Automatic System Recovery

    2. To cause the parameter changes to take effect, type: TABLE 4-6 ok reset-all The system permanently stores the parameter changes and boots automatically when the OpenBoot configuration variable auto-boot? is set to true (its default value). 4-14 Netra CP3060 Board User’s Guide • April 2009...

  • Page 72: To Disable Automatic System Recovery

    4.6.1 Hot-Swapping the Sun Netra CP3060 Blade Server If the Solaris OS is running on a Sun Netra CP3060 blade server and you open the blade server’s latches, you see a message that the operating system will shut down in one minute. When the blue LED on the blade server lights steadily, you can safely remove the blade server.

  • Page 73: Hot-Swap Led

    4.6.1.1 Hot-Swap LED The blue Hot-Swap LED, located on the front panel of the Sun Netra CP3060 blade server ( ), blinks when a hot-swap is initiated, and lights steadily when the FIGURE 1-1 blade server is ready to be removed from the system.

  • Page 74: Network Device Aliases

    TABLE 4-8 Solaris OS device names, and associated ports for the Sun Netra CP3060 blade server. The devalias command can be used to display the device aliases. Network Device Aliases...
  • Page 75 CPU (fru) :FRUType FRU type bridge/fhs The prtpicl -v command shows the condition of all devices in the PICL tree. Sample output from the prtpicl command on the Sun Netra CP3060 blade server is shown in CODE EXAMPLE 4-3 prtpicl Command Output...
  • Page 76 prtpicl Command Output (Continued) CODE EXAMPLE 4-3 cpu (cpu, 5a0000020c) cpu (cpu, 5a0000021a) cpu (cpu, 5a00000228) cpu (cpu, 5a00000236) cpu (cpu, 5a00000244) cpu (cpu, 5a00000252) cpu (cpu, 5a00000260) cpu (cpu, 5a0000026e) cpu (cpu, 5a0000027c) cpu (cpu, 5a0000028a) cpu (cpu, 5a00000298) cpu (cpu, 5a000002a6) cpu (cpu, 5a000002b4) cpu (cpu, 5a000002c2)

  • Page 77: Mandatory /Etc/System File Entry

    2. Check the /etc/system file to see if the mandatory line is present. TABLE 4-10 # more /etc/system *ident "@(#)system 1.18 05/06/27 SMI" /* SVR4 1.5 */ * SYSTEM SPECIFICATION FILE set pcie:pcie_aer_ce_mask=0x1 4-20 Netra CP3060 Board User’s Guide • April 2009...
  • Page 78 3. If the entry is not there, add it. Use an editor to edit the /etc/system file and add the entry. 4. Reboot the server. Chapter 4 Firmware and Blade Server Management 4-21...
  • Page 79 4-22 Netra CP3060 Board User’s Guide • April 2009...

  • Page 80: Hardware And Functional Descriptions

    ■ Hardware Architecture The Sun Netra CP3060 blade server is an ATCA node blade server based on the UltraSPARC T1 processor. It is hot-swappable to an ATCA midplane and supports two 1000BASE-T Ethernet interfaces as Base interface and two 1000 SERDES Ethernet interfaces as Extended interface to support redundant Dual Star topology.
  • Page 81 Standby power is generated separately from −48V and provided for hardware management circuitry. The BMR-H8S IPMC subsystem and the FPGA are powered from standby power. is a block diagram of the Sun Netra CP3060 blade server. FIGURE 5-1 Netra CP3060 Board User’s Guide • April 2009...
  • Page 82 Block Diagram FIGURE 5-1 DDR2 DDR2 DDR2 DDR2 (64MB) DDR2 DDR2 DDR2 DDR2 Flash (16MB) OBP Flash (4MB) SDRAM (64MB) XBus MPCBus FPGA MPC885 UltraSPARC T1 JBus JBus-to-PCI-E bridge Serial Port (RJ-45) (Leaf A) (Leaf B) PCI-E switch SATA GBE NIC GBE NIC Southbridge 8-port switch...

  • Page 83: Ultrasparc T1 Processor

    5.1.1.1 Overview The UltraSPARC T1 multicore processor is the basis of the Sun Netra CP3060 blade server. The UltraSPARC T1 processor is based on chip multithreading (CMT) technology that is optimized for highly threaded transactional processing. The UltraSPARC T1 processor improves throughput while using less power and dissipating less heat than conventional processor designs.

  • Page 84: Cores And Cache

    Multithreaded pipe Instruction cache SPARC SPARC SPARC SPARC SPARC SPARC SPARC SPARC core core core core core core core core Integer pipeline Crossbar Data cache Shared L2 cache DRAM DRAM DRAM DRAM UltraSPARC T1 Multicore Processor Block Diagram FIGURE 5-2 5.1.1.2 Cores and Cache Each of the 8 SPARC cores has support for 4 threads, for a total of 32 threads.

  • Page 85: Memory Controller

    5.1.1.7 UltraSPARC T1 Processor Speed The UltraSPARC T1 processor supports a core frequency of 1 GHz. The maximum supported JBus speed is 200 MHz and maximum supported DDR-2 speed is 200 MHz. Netra CP3060 Board User’s Guide • April 2009...

  • Page 86: Ddr-2 Memory Subsystem

    The processor’s core speed, JBus, and DDR-2 speeds in the Sun Netra CP3060 blade server depend upon total blade server power budget, which shall not exceed 200W as per the PICMG 3.0 R1.0 specification. 5.1.2 DDR-2 Memory Subsystem The Sun Netra CP3060 blade server uses industry-standard DDR-2 VLP (0.72-inch) DIMMs.

  • Page 87: Memory Subsystem Ras Features

    FRU data. Plans are being made to use this 128 bytes for dynamic FRU data, such as soft error rate information. The Sun Netra CP3060 blade server also supports the Chip-kill detect ECC scheme, allowing the detection of up to 4 bits in error, as long as they are not in the same DRAM.

  • Page 88: Serial Presence Detect

    5.1.2.3 Serial Presence Detect The Sun Netra CP3060 blade server supports autoconfiguration using serial presence detect (SPD). The DIMMs have small EEPROM devices that store their configuration data according to the SPD format. MPC/vBSC reads this data via the I management bus, and writes the data into the OpenBoot PROM.

  • Page 89: Jbus-To-Pci-E Bridge

    The Leaf A 4x PCI-E interface on the JBus-to-PCI-E bridge connects to the Extended Fabric NIC. The interface meets the PCI-E 1.0a specification and is completely autonomous from the second PCI-E interface on the JBus-to-PCI-E bridge. (That is, they are not electrically connected). 5-10 Netra CP3060 Board User’s Guide • April 2009...

  • Page 90: Pci-E Switch

    The eight ports on the PCI-E switch are highly configurable, allowing for lane widths from x1 up to x16. The Sun Netra CP3060 blade server only uses lane widths of x4 and x8, which are hard coded using strapping resistors on the port_config pins.

  • Page 91: Ethernet Switch

    The Ethernet switch provides Base Interface connectivity to the MPC885. 5.1.4.5 AMC Slot The Sun Netra CP3060 blade server provides one AMC slot, Extended Full Height Single Width Card, used for PCI-E x8 expansion. In addition, a dual SATA channel from the Southbridge are wired to the AMC slot.
  • Page 92 AMC Connectivity to RTM Port 12-20 (8 differential signal pairs - total of 32 signals) on each AMC slot connector is wired to the Zone 3 RTM connector for AMC generated I/O. AMC Power and Management AMC require two power rails: 3.3V management power ■...
  • Page 93 MMC in the module sends a module hot-swap (Module Handle Opened) event to the IPMC. If the ShMC permits blade server removal, the IPMC asserts the HP_BUTTON# input pin to the PCI-E switch hot-plug controller, which 5-14 Netra CP3060 Board User’s Guide • April 2009...

  • Page 94: Southbridge

    LED, then turns off payload power, and finally turns off management power. Clock Synchronization The Sun Netra CP3060 blade server routes the clock synchronization signals from the midplane (CLK1A/1B, CLK2A/2B) to the AMC slot connector CLK1 and CLK2 pins. The control of which clock signal (CLK1A or CLK1B and CLK2A or CLK2B) is routed to the corresponding CLK1 and CLK2 pins is handled by IPMC.
  • Page 95 Sun Netra CP3060 blade server’s system architecture. Relative to the PCI-E interconnect, the Sun Netra CP3060 blade server uses a 4x link to access the M1575. The major functional blocks used are listed below and described in the paragraphs which follow: UltraDMA IDE controller –...

  • Page 96: Service Processor Mpc885

    The Sun Netra CP3060 blade server includes a MPC885 service processor subsystem used for LDOM configuration and Hypervisor interaction, host system reset, and boot support. The Sun Netra CP3060 blade server uses the MPC885 to run the vBSC firmware (on VxWorks). A block diagram of the subsystem is shown in...

  • Page 97: Xbus External Devices

    Intelligent Platform Management Controller The Renesas H8S/2166 provides the IPM controller (IPMC) function on the Sun Netra CP3060 blade server. The IPMC provides PICMG 3.0 board management functionality, and it interfaces to the host CPU through a serial interface. The IPMC subsystem is powered from the standby power.

  • Page 98: Intelligent Platform Management Bus

    MPC. When shutdown is complete, MPC signals this to IPMC through a status bit in the FPGA. 5.1.6.5 LEDs The Sun Netra CP3060 blade server supports three LEDs compliant with ATCA specification: Green LED – Healthy status ■ Amber LED – Fault condition ■...

  • Page 99: Power Control

    I C architecture. The subsequent subsections FIGURE 5-6 contain a description of the I C Devices and Address map. The MPC has default access to the MPC_RUN_I2C bus.. 5-20 Netra CP3060 Board User’s Guide • April 2009...

  • Page 100: Figure 5-6 I 2 C Block Diagram

    C Block Diagram FIGURE 5-6 PPC_RUN_I CPU_VCore SMM150 DIMM0_0 (x50) (xA0) DIMM0_1 CY28401 (xA2) (xDC) DIMM1_0 DS1338 (xA4) (xD0) C_DDRL DIMM1_1 OBP/HV (xA6) (xA4) DIMM2_0 SP NVRAM (xA8) (xA2) DIMM2_1 SUN FRU ID (xAA) (xA8) FRU_I SCC MAC DIMM3_0 (xA6) (xAC) C_DDRL RTM_I...

  • Page 101: C Device Address Map

    Channel 0 DIMM0 or else H8 0xA4 DDRL_I2C Channel 0 DIMM1 0xA8 DDRL_I2C Channel 1 DIMM0 0xAC Channel 1 DIMM1 DDRL_I2C 0xA0 DDRR_I2C Channel 2 DIMM0 0xA4 DDRR_I2C Channel 2 DIMM1 5-22 Netra CP3060 Board User’s Guide • April 2009...

  • Page 102: System Monitor And Thresholds

    C Address Map (Continued) TABLE 5-3 Standby Address Location Powered C Segment Accessed by: Function 0xA8 DDRR_I2C Channel 3 DIMM0 0xAC DDRR_I2C Channel 3 DIMM1 0x72 No (Yes, IPMI bus to AMC module IMPI_L management power) A few items are worth noting in the I C address map shown above.
  • Page 103 The ADM1026 also monitors the CPU die (or junction) temperatures of the CPU on the Sun Netra CP3060 blade server. The ADM1206 and H8 firmware reports a minor, major, or critical alarm when the temperature of either CPU goes beyond the 5-24 Netra CP3060 Board User’s Guide •...

  • Page 104: Power-On Sequence

    Power-on Sequence The following list describes the power-on sequence: 1. Sun Netra CP3060 blade server installed into a midplane slot in ATCA shelf 2. Aux power applied to IPMC and the FPGA 3. IPMC enables front-end DC/DC (48V 12V converter) –...

  • Page 105: Power

    9. SYSTEM_POK to JBus-to-PCI-E bridge F_PWR_GOOD is released (causes CPU hard reset), and vBSC commences with host reset sequence. Power The following list provides an overview of the Sun Netra CP3060 blade server power rails: Sun Netra CP3060 blade server derives dual −48V power from the ATCA ■...

  • Page 106: Atca Power Module (-48V To 12V)

    Operating Input Voltage: −36V to −72V ■ 5.3.4 On-Board DC/DC Regulators The Sun Netra CP3060 blade server uses its own designed DC/DC SIP modules for generating other onboard power. All the voltages are generated from +12V input power. 5.3.5 TOD Clock Battery The TOD clock battery must be type CR 1225, with a minimum of 4ma abnormal charging current rating (for example;...
  • Page 107 5-28 Netra CP3060 Board User’s Guide • April 2009...

  • Page 108: Physical Characteristics

    Section A.4, “Connectors and Pinout” on page A-3 ■ Form Factor The Sun Netra CP3060 blade server is a standard 8U form factor, a single-slot-wide. It complies with the board mechanical dimensions required by the PICMG 3.0 R1.0 Specification: 322.25 mm x 280 mm (length x width) ■...

  • Page 109: Front Panel

    Ethernet port battery connectors (hidden) Serial port connector Zone 2 connectors Zone 1 connector Front Panel The single-slot-wide, 8U front panel was designed to meet PICMG 3.0 R 1.0 and other specifications. Netra CP3060 Board User’s Guide • April 2009...

  • Page 110: Visual Indicators

    A.3.1 Visual Indicators The Sun Netra CP3060 blade server has the following indicators on the front panel: Green LED – Blade Server’s healthy status or user programmable (ACTIVE). ■ Amber LED – Blade Server’s fault condition (FAULT). ■ Blue LED – Indicates safe removal (hot-swap activity).

  • Page 111: Ethernet Ports

    (BI_DC−) TXD− (BI_DA−) RXD− (BI_DB−) RXD+ (BI_DB+) not used (BI_DD+) not used (BI_DC+) not used (BI_DD−) A.4.1.2 Serial Port contains the connector pin assignments for the front panel serial port. FIGURE A-3 Netra CP3060 Board User’s Guide • April 2009...

  • Page 112: Amc Connector

    Signal Name A.4.2 AMC Connector The Sun Netra CP3060 blade server provides a B+ style 170-pin connector. The pinout of the AMC slot is provided in TABLE A-3 The signals denoted RTM are wired to the Zone 3 RTM connector. (These are port ■...
  • Page 113 RTM_TXx5_P I2C_AMCCONN_SDA PCIE_RX6_P RTM_RX5_N PCIE_RX3_N PCIE_TX6_N RTM_RX5_P PCIE_RX3_P PCIE_TX6_P RTM_TX6_N PCIE_TX3_N PCIE_RX7_N RTM_TX6_P PCIE_TX3_P PCIE_RX7_P RTM_RX6_N PCIE_RX2_N PCIE_TX7_N RTM_RX6_P PCIE_RX2_P PCIE_TX7_P RTM_TX7_N PCIE_TX2_N RTM_TX0_N RTM_TX7_P PCIE_TX2_P RTM_TX0_P RTM_RX7_N RTM_RX0_N RTM_RX7_P I2C_AMCCONN_SCL RTM_RX0_P Netra CP3060 Board User’s Guide • April 2009...

  • Page 114: Compact Flash Connector

    The Compact Flash connector is a type I/II connector. A.4.4 Midplane Power Connector (Zone 1) The Sun Netra CP3060 blade server uses a Zone 1 power connector. It provides support for the following signals: Two −48 volt DC power feeds (four signals each; eight signals total) ■...
  • Page 115 HA6 Hardware Address Bit 6 HA7/P HA7/P Hardware Address Bit 7(Odd Parity Bit) SCL_A IPMB Clock, Port A SDA_A IPMB Data, Port A SCL_B IPMB Clock, Port B SDA_B IPMB Data, Port B Unused Unused Netra CP3060 Board User’s Guide • April 2009...

  • Page 116: Data Transport Connector (Zone 2

    Power Distribution Connector Pin Assignments (Continued) TABLE A-4 Pin Number Name Description Unused Unused Unused Unused Unused Unused SHELF_GND Shelf Ground LOGIC_GND Logic Ground ENABLE_B Enable B VRTN_A Voltage Return A VRTN_B Voltage Return B −48V Early A EARLY_A EARLY_B –48V Early B ENABLE_A Enable A...
  • Page 117 GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ Z2A_TR0_P Z2A_TR0_N Z2A_TR1_P Z2A_TR1_N Z2A_TR2_P Z2A_TR2_N Z2A_TR3_P Z2A_TR3_N GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ GBE_BASE_ Z2B_TR0_P Z2B_TR0_N Z2B_TR1_P Z2B_TR1_N Z2B_TR2_P Z2B_TR2_N Z2B_TR3_P Z2B_TR3_N A-10 Netra CP3060 Board User’s Guide • April 2009...

  • Page 118: Rtm Connector (Zone 3

    Clk2B_n A.4.6 RTM Connector (Zone 3) The Sun Netra CP3060 blade server provides all the I/O connections for rear access through the Zone 3 RTM connector. The connector view and the pinouts for the Zone 3 connectors are shown in...

  • Page 119: Figure A-6 Zone 3 Connectors

    PCIE_Tx7_n PCIE_Rx7_p PCIE_Rx7_n PCIE_Tx6_p PCIE_Tx6_n PCIE_Rx6_p PCIE_Rx6_n PCIE_Tx5_p PCIE_Tx5_n PCIE_Rx5_p PCIE_Rx5_n PCIE_Tx4_p PCIE_Tx4_n PCIE_Rx4_p PCIE_Rx4_n PCIE_Tx3_p PCIE_Tx3_n PCIE_Rx3_p PCIE_Rx3_n PCIE_Tx2_p PCIE_Tx2_n PCIE_Rx2_p PCIE_Rx2_n PCIE_Tx1_p PCIE_Tx1_n PCIE_Rx1_p PCIE_Rx1_n PCIE_Tx0_p PCIE_Tx0_n PCIE_Rx0_p PCIE_Rx0_n A-12 Netra CP3060 Board User’s Guide • April 2009...
  • Page 120 gives the Zone 3 J10201 connector pin assignments. TABLE A-8 Zone 3 J10201 Connector Pin Assignments TABLE A-8 AMC0_IO1 AMC0_IO2 AMC0_IO3 AMC0_IO4 AMC0_IO5 AMC0_IO6 AMC0_IO7 AMC0_IO8 AMC0_IO9 AMC0_IO10 AMC0_IO11 AMC0_IO12 AMC0_IO24 AMC0_IO23 AMC0_IO22 AMC0_IO21 AMC0_IO20 AMC0_IO19 AMC0_IO18 AMC0_IO17 AMC0_IO16 AMC0_IO15 AMC0_IO14 AMC0_IO13 AMC0_IO36...

  • Page 121: Tod Clock Battery Holder

    Caution – Risk of explosion if battery is replaced by an incorrect type. Dispose of batteries properly in accordance with manufacturer’s instructions and local regulations. To install the battery, slide the battery into the holder with the side labeled “+ “ facing up. A-14 Netra CP3060 Board User’s Guide • April 2009...
  • Page 122 Section B.2, “Get RTM Status Command” on page B-3 ■ The commands described in this appendix are specific to Sun Netra CP3060 blade server designed by Sun Microsystems. The Internet Assigned Numbers Authority (IANA) number assigned to Sun Microsystems is 42.

  • Page 123: Get Version Command

    Reserved for future use (ignore) Example (Terminal Mode): [B8 00 80 00 00 2A] <-------Request [BC 00 80 00 00 00 2A 02 02 00 00 00 00] <----Response The IPMC version is read as: ■ Netra CP3060 Board User’s Guide • April 2009...

  • Page 124: Get Rtm Status Command

    lower nibble of REV1 . high nibble of REV2 . low nibble of REV2 In the preceding example, the IPMC version is 2.0.0. The CPLD version is read as: ■ -> lower nibble of CPLD version byte In the example, the CPLD version is 2. Get RTM Status Command Get RTM Status can be used to detect the presence of a rear transition module (RTM) in the system.
  • Page 125 Example (Terminal Mode): [B8 00 88 00 00 2A] <------Request [BC 00 88 00 00 00 2A 01] <------Response Netra CP3060 Board User’s Guide • April 2009...

  • Page 126: Index

    Index POST, 4-2 SunVTS software, 3-7 DIMM memory module devices, 1-8 described, 2-5 installing, 2-18 installing, 2-7 AMC I/O, 1-6 removing, 2-8 auto-boot (OpenBoot configuration variable), 4-5 requirements, 2-5 automatic system recovery (ASR) disabling, 4-15 enabling, 4-14 electric shock caution, 2-1 error handling, summary, 4-9 Ethernet barcode labels, locating, 1-13...
  • Page 127 5-26 preparation installation, 2-3 hot-swap, 4-16 probe-ide command (OpenBoot), 4-6 LEDs PROM contents, 4-1 Active, A-3 Fault, A-3 front panel, A-3 rear transition module, features, 1-8 hot swap, A-3 Index-2 Netra CP3060 Board User’s Guide • April 2009...
  • Page 128 removing DDR-2 DIMM module, 2-8 requirements hardware, 1-12 safety, 2-1 software, 1-6, 1-12 reset manual system, 4-4 scenarios, 4-9 RJ-45 Ethernet, A-4 RTM (rear transition module), 1-8 serial number, locating, 1-13 port, A-4 show-devs command, OpenBoot, 4-6 shutdown (Solaris command), 4-4 software hot-swap information, 4-15...
  • Page 129 Index-4 Netra CP3060 Board User’s Guide • April 2009...

Table of Contents