Summary of Contents for Sun Microsystems Sun Netra CP3260
Page 1
Sun Netra CP3260 Blade Server ™ User’s Guide Sun Microsystems, Inc. www.sun.com Part No. 820-0457-11 April 2009, Revision 01 Submit comments about this document at: http://www.sun.com/hwdocs/feedback...
Page 2
Etats-Unis et dans d’autres pays et licenciée exclusivement par X/Open Company, Ltd. Sun, Sun Microsystems, le logo Sun, Netra, Sun Ray, le logo Netra et le logo Solaris sont des marques de fabrique ou des marques déposées de Sun Microsystems, Inc.
Contents Preface xiii Introduction 1–1 Overview 1–1 Features 1–2 System Configurations 1–8 Advanced Rear Transition Modules 1–11 Hot-Swap Support 1–14 System Requirements and Options 1–14 1.6.1 Hardware Requirements and Options 1–14 1.6.2 Software Requirements 1–15 Technical Support and Warranty 1–15 1.7.1 Part Number, Serial Number, and Revision Number Identification 1–16...
Page 4
Installation Procedure Summary 2–4 Configuring On-Board Hardware 2–5 2.5.1 Adding or Replacing FB-DIMM Memory Modules 2–5 2.5.1.1 To Remove FB-DIMM Memory Modules 2–10 2.5.1.2 To Install FB-DIMM Memory Modules 2–11 2.5.2 Adding or Replacing Compact Flash Card 2–13 2.5.3 Adding or Replacing TOD Clock Battery 2–14 Installing an Advanced Rear Transition Module (Optional) 2–18 Installing the Netra CP3260 Blade Server 2–21 Connecting External I/O Cables 2–23...
Page 5
OpenBoot Firmware 4–4 4.3.1 Getting to the ok Prompt 4–5 4.3.2 Auto-Boot Options 4–6 4.3.3 OpenBoot Commands 4–6 4.3.3.1 probe-scsi and probe-scsi-all Commands 4–7 4.3.3.2 probe-ide Command 4–8 4.3.3.3 show-devs Command 4–8 4.3.3.4 Using watch-net and watch-net-all Commands to Check the Network 4–11 4.3.4 OpenBoot Configuration Variables 4–12 4.3.4.1...
Page 7
5.2.8.4 ATCA Hot-Swap Latch 5–14 5.2.8.5 LEDs 5–15 5.2.8.6 Power Control 5–15 5.2.8.7 System Monitor (ADM1026) and Thresholds 5–15 5.2.8.8 FRUID PROMs 5–17 5.2.9 I/O Subsystem Resets 5–17 5.2.10 ATCA Power Module (−48V to 12V) 5–18 5.2.11 TOD Clock Battery 5–18 A.
Page 8
Solaris OS Graceful Shutdown Commands B–4 Send Sensor State Command B–5 Index Index–1 viii Netra CP3260 Blade Server User’s Guide • April 2009...
Page 9
Figures FIGURE 1-1 Netra CP3260 Blade Server Front Panel 1–4 FIGURE 1-2 Netra CP3260 Blade Server (Top View) 1–5 FIGURE 1-3 Netra CP3260 Blade Server in an ATCA Shelf Enclosure 1–9 FIGURE 1-4 Netra CP3260 Blade Server, Midplane, and Netra CP32x0 ARTM 1–12 FIGURE 1-5 Netra CP3260 Blade Server Barcode Labeling 1–17 FIGURE 2-1...
Page 10
FIGURE A-5 Power Distribution Connector (Zone 1) P10 A–7 FIGURE A-6 Zone 2 Connectors A–9 FIGURE A-7 Zone 3 Signal Connectors A–10 FIGURE A-8 Zone 3 Power Connector A–12 FIGURE A-9 TOD Battery Location A–14 Netra CP3260 Blade Server User’s Guide • April 2009...
Page 11
Tables TABLE 1-1 Netra CP3260 Blade Server Feature Summary 1–2 TABLE 1-2 I/O Configurations 1–13 TABLE 2-1 Ethernet Device Names 2–24 TABLE 3-1 Local Network Information 3–7 TABLE 4-1 Ways of Accessing the ok Prompt 4–5 TABLE 4-2 OpenBoot Configuration Variables 4–12 TABLE 4-3 Network Device Aliases 4–18 TABLE 4-4...
Page 12
TABLE B-1 Get Version Command Data Bytes B–2 TABLE B-2 Get RTM Status Command Data Bytes B–3 TABLE 1 Solaris OS Graceful Shutdown Parameters in /etc/fsmd.conf B–4 TABLE B-3 Send Sensor State Command Data Bytes B–5 Netra CP3260 Blade Server User’s Guide • April 2009...
The Sun Netra CP3260 Blade Server User’s Guide provides information about features, installation, configuration, functional hardware components, and physical properties of this blade server. The Sun Netra CP3260 Blade Server User’s Guide is written for system integration engineers, field applications and service engineers, and others involved in the integration of these blade servers into systems.
Page 14
Solaris™ Operating System documentation, which is at: ■ http://docs.sun.com/app/docs/prod/solaris Shell Prompts Shell Prompt C shell machine-name% C shell superuser machine-name# Bourne shell and Korn shell Bourne shell and Korn shell superuser Sun Netra CP3260 Blade Server User’s Guide • April 2009...
Typographic Conventions Typeface Meaning Examples The names of commands, files, Edit your.login file. AaBbCc123 and directories; on-screen Use ls -a to list all files. computer output % You have mail. What you type, when contrasted AaBbCc123 with on-screen computer output Password: AaBbCc123 Book titles, new words or terms,...
Page 16
Sun is not responsible for the availability of third-party web sites mentioned in this document. Sun does not endorse and is not responsible or liable for any content, advertising, products, or other materials that are available on or through such sites Sun Netra CP3260 Blade Server User’s Guide • April 2009...
Sun is interested in improving its documentation and welcomes your comments and suggestions. You can submit your comments by going to: http://www.sun.com/hwdocs/feedback Please include the title and part number of your document with your feedback: Sun Netra CP3260 Blade Server User’s Guide, part number 820-0457-11 Preface xvii...
Page 18
Sun Netra CP3260 Blade Server User’s Guide • April 2009...
1-C H A P T E C H A P T E R Introduction This chapter contains the following sections: Section 1.1, “Overview” on page 1-1 ■ Section 1.2, “Features” on page 1-2 ■ Section 1.3, “System Configurations” on page 1-8 ■...
Elimination of PCI connectivity between the blade servers in the system and ■ reallocation of connectivity to serial interconnects, eliminating single points of failure Mandatory use of Intelligent Platform Management Interface (IPMI) management ■ interfaces Flexible user I/O ■ Power and thermal management guidelines enforced by the management ■...
Page 21
Netra CP3260 Blade Server Feature Summary TABLE 1-1 Feature Description PICMG • Single-wide ATCA module compliance • ATCA 8U form factor • Single-wide ATCA module • 6-HP slot width • PICMG 3.0 R1.0 • PICMG 3.1 R1.0 Node board Functions as a CPU node board with the Solaris operating system and support software packages Operating...
Page 24
⑤ ④ ③ ② ① ⑦ Netra CP3260 Blade Server User’s Guide • April 2009...
Page 25
Figure Legend Top latch Out of Service LED (yellow) Ethernet management port (RJ-45) OK LED (green) Dual USB Ports (USB 2.0) Serial (console) port (RJ-45, ttya) Hot-Swap LED (blue) Hot-Swap switch and bottom latch Figure Legend Zone 1 power connector Zone 2 signal connectors Zone 3 RTM signal connectors Zone 3 ARTM power connector...
Figure Legend Compact Flash connector UltraSPARC T2 processor (under heat sink) FB-DIMMs System Configurations Netra CP3260 blade servers can be installed in an ATCA shelf (or chassis), as shown . The blade servers can be deployed in various electrical configurations FIGURE 1-3 to suit each end-user requirement.
Netra CP3260 Blade Server in an ATCA Shelf Enclosure FIGURE 1-3 Chapter 1 Introduction...
Page 28
① ② ③ ④ Ethernet ⑤ ⑥ ⑦ kless client that boots through network from a remote server 1-10 Netra CP3260 Blade Server User’s Guide • April 2009...
Sun Netra CP32X0 Advanced RTM (installed from rear) Serial connection Console terminal Ethernet connection (RJ-45) Sun Netra CP3260 blade server (installed from front) Netra CT 900 server ATCA shelf Advanced Rear Transition Modules An optional Sun Netra CP32X0 Advanced Rear Transition Module (ARTM) can be...
Figure Legend Sun Netra CP3260 blade server Sun Netra CP32X0 ARTM ATCA chassis midplane Note – When a Netra CP32x0 ARTM is used with the Netra CP3260 blade server, shielded cables are required for serial I/O ports. Unshielded cables can be used on Ethernet ports to satisfy EMI compliance standards.
Hot-Swap Support There are three hot-swap models described in the PICMG ATCA specification: basic hot-swap, full hot-swap, and high-availability (HA) hot-swap. Refer to the PICMG ATCA Specification, which provides a detailed description of this subject. The Netra CP3260 blade server supports basic hot-swap. The hot-swap process uses hardware connection control to disconnect and connect the hardware in an orderly sequence.
Serial terminal or terminal emulation for console output. ■ Cables for terminal and network connections. ■ Optional AMC disks and PCI-E cards. ■ The following are ATCA and other minimum requirements met by the Netra CP3260 blade server. ATCA system enclosure for 8U boards (includes chassis, midplane, power supply) ■...
1.7.1 Part Number, Serial Number, and Revision Number Identification The Netra CP3260 blade server part number, serial number, and revision can be found on labels located on the card ( ). The Sun barcode labels provide the FIGURE 1-5 following information: SunSN –...
Netra CP3260 Blade Server Barcode Labeling FIGURE 1-5 Note – You might find the labels shown in on other locations on your FIGURE 1-5 blade server. Your particular blade server configuration might also appear different than the illustration. Chapter 1 Introduction 1-17...
Page 36
1-18 Netra CP3260 Blade Server User’s Guide • April 2009...
2-C H A P T E C H A P T E R Hardware Installation This chapter describes the hardware installation procedures for the Netra CP3260 blade server, and contains the following sections: Section 2.1, “Equipment and Operator Safety” on page 2-1 ■...
Page 38
The installer must be familiar with commonly accepted procedures for integrating electronic systems and with the general practice of Sun systems integration and administration. Although parts of these systems are designed for hot-swap operation, other components must not be subjected to such stresses. Work with power connected to a chassis only when necessary, and follow these installation procedures to avoid equipment damage.
Materials and Tools Required This section provides information on the materials and tools required to perform installation. The minimum tools required to perform installation are: Phillips screwdrivers, No. 1, No. 2 (optional) ■ Antistatic wrist strap ■ Terminal console ■ Section 1.6.1, “Hardware Requirements and Options”...
Facility power loading specifications can support the rack or enclosure ■ requirements. Your enclosure specifications support the cooling airflow requirements. The Netra ■ CP3260 blade server fits a standard ATCA shelf or chassis. If your installation requirements are different, contact your field application engineer. Installation Procedure Summary The procedure in this section summarizes the Netra CP3260 blade server installation at a high level.
Configuring On-Board Hardware This section provides the procedures for adding or replacing the on-board hardware components such as memory modules, a Compact Flash card, and the time-of day (TOD) battery. Read and perform the procedures, as necessary, before installing the Netra CP3260 blade server into the chassis.
2.5.1.1 To Remove FB-DIMM Memory Modules You might need to remove a FB-DIMM module from the Netra CP3260 blade server if you are returning the FB-DIMM module or the blade server for service, or if you are replacing a module with another FB-DIMM module. Note –...
Removing an FB-DIMM Memory Module FIGURE 2-2 6. If you are replacing the module you removed with a new FB-DIMM, install it as described in Section 2.5.1.2, “To Install FB-DIMM Memory Modules” on page 2-11. 2.5.1.2 To Install FB-DIMM Memory Modules The following procedure provides a general guide for installing additional memory.
1. Locate the FB-DIMM connectors on the Netra CP3260 blade server. Select the connectors where you will install the memory module ( ). If FIGURE 2-1 you need to replace an existing memory module with a new module, see Section 2.5.1.1, “To Remove FB-DIMM Memory Modules” on page 2-10 instructions on removing the FB-DIMM module.
4. Press the top edge of the FB-DIMM toward the blade server until the retainer ➋ clips click into place (see FIGURE 2-3 The small retainer clips on each side of the FB-DIMM slot click into place in the notches on the sides of the FB-DIMM. 2.5.2 Adding or Replacing Compact Flash Card You can install an optional Sun Compact Flash card on the Netra CP3260 blade...
Compact Flash Card Location FIGURE 2-4 ① Figure Legend Compact Flash connector 2.5.3 Adding or Replacing TOD Clock Battery shows the location of the TOD clock battery and holder. FIGURE 2-5 The optional TOD battery must be type CR1632, with a minimum of 4ma abnormal charging current rating (for example;...
Page 51
Caution – Risk of explosion if the battery is replaced by an incorrect type. Dispose of batteries properly in accordance with manufacturer’s instructions and local regulations. To install the battery, perform the following steps: 1. Remove the FB-DIMM closest to the front panel. To do this, see Section 2.5.1.1, “To Remove FB-DIMM Memory Modules”...
Figure Legend TOD battery location Remove this FB-DIMM for access to battery TOD clock battery location with FB-DIMM removed Installing an Advanced Rear Transition Module (Optional) For rear I/O access, a compatible RTM must be used with the Netra CP3260 blade server.
Page 55
Installing a Netra CP32X0 ARTM FIGURE 2-6 ② ① ③ Figure Legend Netra CP3260 blade server Netra CP32X0 ARTM ATCA chassis midplane Chapter 2 Hardware Installation 2-19...
Installing the Netra CP3260 Blade Server Caution – The Netra CT 900 server fan tray upgrade kit (594-4953) must be installed in the chassis before the Netra CP3260 blade server is installed. This fan tray upgrade is required to provide adequate cooling and to prevent the system from overheating or shutting down due to an over-temperature condition that can occur with the older fan trays.
Installing Blade Server Into Chassis Slot FIGURE 2-7 6. Push the blade server slightly into the midplane connectors, and then close the latches to seat the blade server in the connectors ( FIGURE 2-8 7. When the lower latch is closed, the blue Hot-Swap LED blinks while the blade server is initializing.
Netra CP3260 Blade Server Latches and Locking Screws FIGURE 2-8 Connecting External I/O Cables External I/O cables are connected to the Netra CP3260 blade server, or to the Netra CP32x0 ARTM when a rear transition module is used. 2-22 Netra CP3260 Blade Server User’s Guide • April 2009...
Note – Shielded cables are required for serial I/O ports. Unshielded cables can be used on Ethernet ports to satisfy EMI compliance standards. The shields for all shielded cables must be terminated on both ends. Information on connecting each of these cables follows: For Ethernet connections, category 5e or better network cable is required.
Hot-Swapping the Netra CP3260 Blade Server The Netra CP3260 blade server supports hot-swapping at the blade server level. Note – Before hot-swapping the blade server, the system administrator should gracefully shutdown the applications and operating system, and deactivate the blade server. After the blade server is replaced, the system administrator should activate the new blade server.
■ Operating Systems and Patches The Sun Netra CP3260 blade server uses the Solaris 10 8/07 OS and subsequent compatible versions, with associated patches. Refer to the Netra CP3260 Blade Server Product Notes (820-0455) for the Solaris OS version and the patches and patch installation procedures.
Depending the blade server’s hardware configuration, the Sun Netra CP3260 blade server can be used as a diskless client with the Solaris OS installed on a boot server (see Section 3.3, “Installing as a Diskless Clients” on page 3-4. The OS can also be downloaded to a boot device like the Netra CP32x0 SAS Storage ARTM, Dual HD, or an optional Compact Flash.
Page 65
Zone 2 and Zone 3 Connectivity: First NIU Port (nxge0) to Zone 2 CODE EXAMPLE 3-3 (at 10Gbps Speed) and the Second NIU Port (nxge1) to Zone3 name = "SUNW,niusl" parent = "/niu@80" unit-address = "0" phy-type = "xgsd"; name = "SUNW,niusl" parent = "/niu@80" unit-address = "1" phy-type = "xgf";...
Installing as a Diskless Clients The following procedures describe how to create a boot server for diskless clients and how to add new diskless clients to the patched boot server. For additional instructions on installing diskless clients, refer to the appropriate Solaris Documentation Collection at the Sun Documentation web site at: http://docs.sun.com/app/docs/prod/solaris You must have a superuser password on your diskless server to perform the tasks in...
4. Download and install additional patches. Refer to the Netra CP3260 Blade Server Product Notes (820-0455) for the latest information on the patches available for the Sun Netra CP3260 blade server. The document can be downloaded from the following web site: http://docs.sun.com/app/docs/prod/netra.brds...
Page 68
4. Change directories to the /usr/sadm/bin directory. # cd /usr/sadm/bin 5. Set up the diskless clients. For each diskless client, type the following command as superuser: # ./smdiskless add -- -i ip_address -e ethernet_address -n host_name \ -x os=sparc.sun4v.Solaris_n -x root=/export/root/host_name \ -x swap=/export/swap/host_name -x swapsize=swap_size -x tz=time_zone \ -x locale=locale -x ns=name_service -x nameserver=name_server Where:...
time_zone = US/Pacific ■ locale = en_US ■ name_service = NIS ■ name_server = nameserver_host ■ \ (backslash) is a line continuation character indicating that the command is ■ continued on the next line. You must type your superuser password again after typing this command. The installation process should take roughly 5 minutes per client and about 15-30 minutes for the operating environment service to install;...
The Fabric interface on the Sun Netra CP3260 blade server is capable of operating at either 1 Gbps or 10 Gbps. The Sun Netra CP3260 can be used in the Netra CT 900 server with either the Sun Netra CP3240 10-GbE switch board or the Sun Netra CP3140 1-GbE switch board.
Downloading and Installing SunVTS Software Sun Validation Test Suite (SunVTS™) software is a comprehensive suite that tests and validates the Sun Netra CP3260 blade server by verifying the configuration and function of most hardware controllers and devices on the blade server. Chapter 3...
Formatting the Optional Compact Flash Card The Compact Flash card is an USB removable media device on the Sun Netra CP3260 blade server. Therefore, the Solaris OS rmformat utility must be used to format the device. The Solaris OS also provides a removable media framework for use with this type of device.
4-C H A P T E C H A P T E R Firmware and Blade Server Management This chapter contains the following sections: Section 4.1, “System Firmware” on page 4-2 ■ Section 4.2, “Power-On Self-Test Diagnostics” on page 4-3 ■...
The Netra CP3260 blade server boots from the 4-Mbyte system flash PROM device that includes the power-on self-test (POST) and OpenBoot™ firmware. A systems firmware progress sensor (SFPS) is available on the Sun Netra CP3260 blade server. The purpose of the sensor is to model the firmware running on the payload and provide various states to the external management software (ShMM on Netra CT 900 servers).
Power-On Self-Test Diagnostics Power-on self-test (POST) is a firmware program that helps determine whether a portion of the system has failed. POST verifies the core functionality of the system, including the CPU modules, motherboard, memory, and some on-board I/O devices. The software then generates messages that can be useful in determining the nature of a hardware failure.
4.2.2 POST Diagnostic and Error Message Format POST diagnostic and error messages are displayed on a console. The format of the these messages is the following: Core-ID:Strand-ID ERROR: TEST = test-name Core-ID:Strand-ID H/W under test = description Core-ID:Strand-ID Repair Instruction Core-ID:Strand-ID MSG = error-message-body Core-ID:Strand-ID END_ERROR The following is an example of a POST error message...
When the operating system crashes, the system reverts to OpenBoot firmware ■ control. During the boot process, when there is a serious hardware problem that prevents ■ the operating system from running, the system reverts to OpenBoot firmware control. When a serious hardware problem develops while the system is running, the ■...
4.3.2 Auto-Boot Options The system firmware stores a configuration variable called auto-boot?, which controls whether the firmware will automatically boot the operating system after each reset. The default setting for Sun platforms is true. Normally, if a system fails power-on diagnostics, auto-boot? is ignored and the system does not boot unless an operator boots the system manually.
4.3.3.1 probe-scsi and probe-scsi-all Commands The probe-scsi and probe-scsi-all commands diagnose problems with the SCSI devices. Caution – If you used the halt command or the Stop-A key sequence to reach the ok prompt, issuing the probe-scsi or probe-scsi-all command can hang the system.
4.3.3.2 probe-ide Command The probe-ide command communicates with all Integrated Drive Electronics (IDE) devices connected to the IDE bus. This is the internal system bus for media devices such as the DVD drive. Caution – If you used the halt command or the Stop-A key sequence to reach the ok prompt, issuing the probe-ide command can hang the system.
Command Output show-devs CODE EXAMPLE 4-3 /virtual-devices@100/channel-devices@200 /virtual-devices@100/channel-devices@200/virtual-channel-client@1 /virtual-devices@100/channel-devices@200/virtual-channel@0 /virtual-devices@100/channel-devices@200/virtual-channel-client@2 /virtual-devices@100/channel-devices@200/virtual-channel@3 /openprom/client-services /packages/obp-tftp /packages/kbd-translator /packages/SUNW,asr /packages/dropins /packages/terminal-emulator /packages/disk-label /packages/deblocker /packages/SUNW,builtin-drivers 4.3.3.4 Using watch-net and watch-net-all Commands to Check the Network The watch-net diagnostics test monitors Ethernet packets on the primary network interface.
/pci@0/pci@0/pci@1/network@0 1000 Mbps full duplex Link up Looking for Ethernet Packets. ’.’ is a Good Packet. ’X’ is a Bad Packet. Type any key to stop..{0} ok 4.3.4 OpenBoot Configuration Variables The OpenBoot configuration variables are stored in the OBP flash PROM and determine how and when OpenBoot tests are performed.
Page 85
OpenBoot Configuration Variables TABLE 4-2 Variable Possible Values Default Value Description Specifies recovery action after an error reset. error-reset-recovery boot, none, boot Default is boot sync none – • No recovery action. boot – • System attempts to boot. sync – •...
OpenBoot Configuration Variables TABLE 4-2 Variable Possible Values Default Value Description variable-name Firmware security password if security-password none security-mode is not none (never displayed). Do not set this directly. Serial management port (baud rate, bits, ttya-mode 9600,8,n,1,- 9600,8,n,1,- parity, stop, handshake). The serial management port only works at the default values.
boot-device disk net disk net use-nvramrc? false false error-reset-recovery boot boot {0} ok To set or change the value of an OpenBoot configuration variable, use the setenv ■ command: {0} ok setenv error-reset-recovery none error-reset-recovery = none To set OpenBoot configuration variables that accept multiple keywords, separate ■...
Any CPU failed ■ All logical memory banks failed ■ Flash RAM cyclical redundancy check (CRC) failure ■ Critical field-replaceable unit (FRU) PROM configuration data failure ■ Critical application-specific integrated circuit (ASIC) failure ■ Automatic System Recovery Automatic system recovery (ASR) consists of self-test features and an autoconfiguration capability to detect failed hardware components and unconfigure them.
4.5.1 Enabling and Disabling Automatic System Recovery The automatic system recovery (ASR) feature is not activated until you enable it. Enabling ASR requires changing configuration variables in OpenBoot. 4.5.1.1 To Enable Automatic System Recovery 1. At the ok prompt, type: ok setenv auto-boot true ok setenv auto-boot-on-error? true 2.
After you disable the automatic system recovery (ASR) feature, it is not activated again until you re-enable it. Network Device Aliases A device alias is a shorthand representation of a device path. The Solaris OS provides some predefined device aliases for the network devices so that you do not need to type the full device path name.
Retrieving Device Information You can use the Solaris platform information and control library (PICL) framework for obtaining the state and condition of the Netra CP3260 blade server. The PICL framework provides information about the system configuration that it maintains in the PICL tree. Within this PICL tree is a subtree named frutree, which represents the hierarchy of system field-replaceable units (FRUs) with respect to a root node in the tree called chassis.
Page 92
Command Output prtpicl CODE EXAMPLE 4-4 virtual-channel-client (obp-device, 6f0000011d) n2cp (obp-device, 6f00000127) ncp (obp-device, 6f00000134) random-number-generator (obp-device, 6f00000141) flashprom (flashprom, 6f0000014d) console (serial, 6f00000154) rtc (obp-device, 6f00000161) cpu (cpu, 6f00000169) cpu (cpu, 6f00000177) cpu (cpu, 6f00000185) cpu (cpu, 6f00000193) cpu (cpu, 6f000001a1) cpu (cpu, 6f000001af) cpu (cpu, 6f000001bd) cpu (cpu, 6f000001cb)
Page 93
Command Output prtpicl CODE EXAMPLE 4-4 cpu (cpu, 6f00000399) cpu (cpu, 6f000003a7) cpu (cpu, 6f000003b5) cpu (cpu, 6f000003c3) cpu (cpu, 6f000003d1) cpu (cpu, 6f000003df) cpu (cpu, 6f000003ed) cpu (cpu, 6f000003fb) cpu (cpu, 6f00000409) cpu (cpu, 6f00000417) cpu (cpu, 6f00000425) cpu (cpu, 6f00000433) cpu (cpu, 6f00000441) cpu (cpu, 6f0000044f) cpu (cpu, 6f0000045d)
MUX configuration is persistent across blade server activations and deactivations. Customers who use Sun Netra CP3260 blade servers in a third-party chassis, which does not have the Netra CT 900 chassis ShMM management software implemented, can save MUX configurations in a configuration file or in a persistent storage managed by system management software.
Page 100
Be aware of the following possible issues when multiplexing zones: MUX and payload driver configuration could go out of sync, requiring a system ■ administrator to make sure they are set to the same configuration. Midplane FRUID record could be corrupted when updating with the MUX ■...
C H A P T E R Hardware Functional Descriptions This chapter contains the following sections: Section 5.1, “Hardware Architecture” on page 5-1 ■ Section 5.2, “Hardware Modules” on page 5-4 ■ Hardware Architecture The Netra CP3260 blade server is an ATCA node board based on the UltraSPARC T2 processor.
There are four on-chip memory controllers that interface directly to FB-DIMM memory and include eight FB-DIMM slots (one per channel, or two per memory controller). In addition, there are an on-chip PCI-Express I/O interface and two 10-Gb Ethernet ports. The UltraSPARC T2 processor is a highly integrated processor that implements the 64-bit SPARC V9 architecture.
5.1.6 ARTM Support ARTM support is routed to the ARTM through the Zone 3 connectors. Typical ARTM support includes: One RS-232 serial console port ■ One 10/100/100BASE-T Ethernet management port ■ Because Netra CP32x0 Advanced RTMs (ARTM) provide additional functionality, the following interfaces are also routed to the ARTM.
5.2.1.2 Cores The UltraSPARC T2 processor provides 8 physical SPARC processor cores and each physical core is capable of supporting 8 threads for a total of 64 threads. 5.2.1.3 L2 Cache The UltraSPARC T2 provides a total of 4 Mbytes of L2 cache banked 8 ways. 5.2.1.4 Memory Controller The UltraSPARC T2 supports 4 FB-DIMM memory controllers, each controller...
The XAUI interface is the Fabric interface to the ATCA midplane. The XAUI interface is routed to the Zone 2 connector on the midplane (see Section A.4, “Connectors and Pinout” on page A-3 for details on board connector pinout assignments. 5.2.2 Memory Subsystem The heart of the Memory subsystem is the FB-DIMM memory.
5.2.3.1 PCI Express Switch The Netra CP3260 uses the PLX PCI switch that encompasses a 32-lane PCI Express switch with six configurable ports (x1, x2, x4, x8, x16). 5.2.3.2 Base Interface The Netra CP3260 provides dual redundant 10/100/1000BASE-T Ethernet links to connect to the midplane Base interface channels.
5.2.4 Other ARTM Interfaces In addition to the AMC-type interface to the ARTM, additional interfaces are routed to the ARTM to provide for rear access to the Netra CP3260 I/O. 5.2.4.1 Serial Ports The console port from the PPC is routed to the ARTM for rear access. When a serial device is connected into the ARTM’s serial port, the console data is output to that port.
Note – A serial port is also provided on the Netra CP32x0 ARTM. You can use either the serial port on the front panel or the serial port on Netra CP32x0 ARTM, but only one of the ports should be used at one time. 5.2.5.3 Dual USB Ports Dual USB ports are 2.0 compliant and routed from the USB hub to the front panel.
H8 interface providing IPMC support. ■ MPC interface. ■ SSI Interface (UltraSPARC T2). ■ BUS Interface and Arbiter (Round Robin). ■ Bus Clock Control ■ Power sequence control of DC/DCs on board. ■ Interrupts. ■ Data Channel/Fast Mailbox Control. ■ The FPGA configuration is performed after an FPGA reset when the configuration is downloaded from the PROM.
Environmental monitoring ■ Access to all environmental I C devices ■ Access to all I C devices when MPC is reset ■ 5.2.8.1 Intelligent Platform Management Bus The BMR-H8S provides dual buffered Intelligent Platform Management Bus (IPMB) interfaces to the IPMB-0 bus on the PICMG 3.0 midplane. The I C channels on the H8S are connected the IPMB-A and IPMB-B through the I C buffers.
5.2.8.5 LEDs The Netra CP3260 blade server supports three LEDs compliant with ATCA specification: Green LED – Healthy status ■ Amber LED – Fault condition ■ Blue LED – Indicates that blade server is safe for removal when on and hot ■...
5.2.8.8 FRUID PROMs There are two FRUID PROMs on the Sun Netra CP3260 and both are 64-Kbyte SEEPROMs. One contains Sun FRU information and the other contains IPMI FRU information. Each device stores static information, such as the part number and manufacturing date, and dynamic data that can be updated by the host system, such as operational statistics and failure information.
A reset mask register is provided in the FPGA to allow the masking of resets to individual I/O components. For example, a PEX_RESET_L reset from the UltraSPARC T2 processor resets only those I/O subcomponents not masked by the reset mask register. 5.2.10 ATCA Power Module (−48V to 12V) The Netra CP3260 blade server uses the Artesyn ATCA power module solution.
A P P E N D I X Physical Characteristics Specifications for the Netra CP3260 blade server are provided in the following sections: Section A.1, “Form Factor” on page A-1 ■ Section A.2, “Layout” on page A-1 ■ Section A.3, “Front Panel” on page A-3 ■...
Netra CP3260 Blade Server Layout FIGURE A-1 ④ ⑧ ① ⑦ ② ③ ⑥ ⑤ Figure Legend Ethernet port connector (RJ-45) Zone 1 power connector Dual USB port connector (USB 2.0) Zone 2 I/O connectors Serial port connector Zone 3 RTM I/O connectors Compact flash connector Zone 3 RTM power connector Netra CP3260 Blade Server User’s Guide •...
Front Panel The single-slot-wide, 8U front panel was designed to meet PICMG 3.0 R 1.0 and other specifications. A.3.1 Visual Indicators The Netra CP3260 blade server has the following indicators on the front panel: Green LED – Board’s healthy status or user programmable (ACTIVE). ■...
A.4.1.1 Ethernet Port The Ethernet connector is a RJ-45 connector. The controller autonegotiates to either 10BASE-T, 100BASE-T, or 1000BASE-T. The Ethernet connector pin numbering is shown in FIGURE A-2 Ethernet RJ-45 Connector FIGURE A-2 < > 1 2 3 4 5 6 7 8 Link LED (green) Activity LED (yellow) shows the Ethernet connector pin assignments.
Dual USB Connector FIGURE A-3 For USB connector signals, see TABLE A-2 USB Connector Pin Assignments TABLE A-2 Signal Description Signal Description +5 V (fused) +5 V (fused) USB2− USB3− USB2+ USB3+ Ground Ground A.4.1.3 Serial Port contains the connector pin assignments for the front panel serial port. FIGURE A-4 Appendix A Physical Characteristics...
Front Panel Serial Port Diagram FIGURE A-4 I0I0I 1 2 3 4 5 6 7 8 shows the serial port connector pin assignments. TABLE A-3 RJ-45 Serial Port Connector Pinouts TABLE A-3 Signal Signal Name Function Name Function Request To Send Ground Data Terminal Ready 6 Receive Data...
shows the pin assignments. FIGURE A-5 Power Distribution Connector (Zone 1) P10 FIGURE A-5 lists the power connector pin assignments. TABLE A-4 Power Distribution Connector Pin Assignments TABLE A-4 Pin Number Name Description Reserved Reserved Reserved Reserved Reserved Reserved Reserved Reserved HA0 Hardware Address Bit 0 HA1 Hardware Address Bit 1...
Power Distribution Connector Pin Assignments (Continued) TABLE A-4 Pin Number Name Description Unused Unused Unused Unused Unused Unused Unused Unused SHELF_GND Shelf Ground LOGIC_GND Logic Ground ENABLE_B Enable B VRTN_A Voltage Return A VRTN_B Voltage Return B −48V Early A EARLY_A EARLY_B –48V Early B...
Zone 2 J20 Connector Pin Assignments (Continued) TABLE A-6 For information about multiplexing to Zone 2 or Zone 3, see Section 4.8, “Multiplexing to Zones 2 and 3” on page 4-27. A.4.5 Sun Netra ARTM Connectors (Zone 3) The Netra CP3260 blade server provides all the I/O and power connections for rear access through the Zone 3 RTM connectors.
Zone 3 Power Connector Pin Assignments TABLE A-10 w Pin 1 Pin 2 Pin 3 Pin 4 Pin 5 Pin 6 A Logic_GND Logic_GND Logic_GND Shelf_GND Shelf_GND Shelf_GND +3.3V_STBY_RTM +3.3V_STBY_RTM +3.3V_STBY_RTM B Logic_GND Logic_GND Logic_GND I2C_RTMCONN_SCL I2C_RTMCONN_SCL I2C_RTMCONN_SCL I2C_RTMCONN_SDA I2C_RTMCONN_SDA I2C_RTMCONN_SDA D +12V_RTM +12V_RTM +12V_RTM...
Page 132
TOD Battery Location FIGURE A-9 ① ② Figure Legend TOD battery location TOD clock battery location with FB-DIMM removed A-14 Netra CP3260 Blade Server User’s Guide • April 2009...
Section B.4, “Send Sensor State Command” on page B-5 ■ The commands described in this appendix are specific to Netra CP3260 blade server designed by Sun Microsystems. The Internet Assigned Numbers Authority (IANA) number assigned to Sun Microsystems is 42. Refer to for more http://www.iana.org/assignments/enterprise-numbers...
Get Version Command Get Version returns the IPM controller (IPMC) firmware version and Standby CPLD version. Bytes 8, 9, and A are reserved for future use. Command NetFn Opcode Reference Version 0x2E (OEM) 0x80 Get Version Command Data Bytes TABLE B-1 Type Byte Data Field...
Example (Terminal Mode): [B8 00 80 00 00 2A] <-------Request [BC 00 80 00 00 00 2A 02 02 00 00 00 00] <----Response The IPMC version is read as: ■ lower nibble of REV1 . high nibble of REV2 . low nibble of REV2 In the preceding example, the IPMC version is 2.0.0.
Page 136
SUNWctfsm is the Solaris FSM for ATCA graceful shutdown and reboot. For installation and requirements, refer the README file included in the release package and the Sun Netra CP3260 Blade Server Product Notes (820-0455). The commands and parameters are described in the following table.
Page 137
Note – As of the R3U2 release, Netra CP3260 sysfw 7.2.1 has graceful shutdown support. Note – To use the graceful shutdown effectively, users must determine a component’s shutdown time “cost,” which depends on hardware, software, and configuration. For example, the default 120 seconds could be too short for a Sun Netra CP3260 blade server with a heavy I/O configuration.
Page 138
Send Sensor State Command Data Bytes (Continued) TABLE B-3 Type Byte Data Field Byte4 Sensor type byte Indicates event class or type of sensor that generates specification the event message. (Refer to IPMI sensor type codes.) Byte5 Sensor # (optional); Write to 0 Unique number representing the sensor within the management controller that generates the event message.
Page 139
Send Sensor State Command Data Bytes (Continued) TABLE B-3 Type Byte Data Field Byte12 Reserved for future use. (Write zero) Response data Byte1 Completion code: 00 = OK C1 = Command not supported CC = Invalid data in request specification (Refer to IPMI for more completion codes)
Page 140
Netra CP3260 Blade Server User’s Guide • April 2009...
Page 144
Solaris commands World Wide Name (probe-scsi), 4-7 init, 4-5 shutdown, 4-5 SPARC, 5-2 XAUI, 5-1, 5-8, 5-9 subsystems, 5-1 XAUI ports, 5-8 CPU and memory, 5-1 I/O, 5-1 IPMI, 5-1 power, 5-1 service processor, 5-1 Sun Download Center (SDLC), 3-1 Sun OEM IPMI commands Get RTM Status, B-3 Sun Services, 1-15...
Need help?
Do you have a question about the Sun Netra CP3260 and is the answer not in the manual?
Questions and answers