Making changes or modifications to the ATCA-9405 hardware without the explicit consent of Artesyn Embedded Technologies could invalidate the user’s authority to operate this equipment.
Page 4
These interfaces are designed for use as intra-building interfaces only (Type 2 or Type 4 ports as described in GR-1089-CORE, Issue 4) and require isolation from the exposed OSP cabling. The addition of Primary Protectors is not sufficient protection in order to connect these interfaces metallically to OSP wiring. ATCA-9405 Installation and Use (6806800M71L)
Sicherheitshinweise on page 27, provides the German translation of the Safety Notes. Chapter 1, Introduction, on page 33, provides an overview of the ATCA-9405 board. Chapter 2, Setup, on page 41, describes the ATCA-9405 board dimensions, power ...
Page 16
Intelligent Platform Management Controller IPMI Intelligent Platform Management Interface JTAG Joint Test Action Group (test interface for digital logic circuits) Keyboard Style Controller Level 2 LCCB Line Card Clock Building Block Low Pin Count Medium Access Controller ATCA-9405 Installation and Use (6806800M71L)
Page 17
Synchronous Dynamic Random Access Memory SECDED Single Error Correction Double Error Detection SELV Safety Extra Low Voltage SerDes Serializer/Deserializer SGMII Serial Gigabit Media Independent Interface Symmetric Multi-Processors Service Processor Serial Presence Detect TCAM Ternary Content Addressable Memory ATCA-9405 Installation and Use (6806800M71L)
Page 18
File > Exit Notation for selecting a submenu <text> Notation for variables and keys [text] Notation for software buttons to click on the screen and parameter description Repeated item for example node 1, node 2, ..., node ATCA-9405 Installation and Use (6806800M71L)
Page 19
Indicates a hazardous situation which, if not avoided, may result in minor or moderate injury Indicates a property damage message No danger encountered. Pay attention to important information ATCA-9405 Installation and Use (6806800M71L)
Page 20
Establishing a Telnet Session on page 150, and IPMI command examples in Set Serial Output Command on page 156. 6806800M71D December, 2012 GA version 6806800M71C June, 2012 EA version 6806800M71B November 2011 DA version 6806800M71A September 2011 Preliminary copy ATCA-9405 Installation and Use (6806800M71L)
This equipment generates, uses, and can radiate radio frequency energy and, if not installed and used in accordance with the instruction manual, may cause harmful interference to radio communications. ATCA-9405 Installation and Use (6806800M71L)
Page 22
1 power pins. Damage of the Product Incorrect installation of the product can cause damage of the product, Only use handles when installing/removing the product to avoid damage/deformation to the face plate and/or PCB. ATCA-9405 Installation and Use (6806800M71L)
Page 23
Operating the board without forced air cooling may lead to board overheating and thus board damage. When operating the board, make sure that forced air cooling is available in the shelf. Injuries or Short Circuits Board or power supply ATCA-9405 Installation and Use (6806800M71L)
Page 24
Check the total power consumption of all components installed (see the technical specification of the respective components). Ensure that any individual output current of any source stays within its acceptable limits (see the technical specification of the respective source). ATCA-9405 Installation and Use (6806800M71L)
Page 25
Lithium battery as is installed and make sure the battery is installed as described in this manual. Environment Always dispose of used products according to your country’s legislation and manufacturer’s instructions. ATCA-9405 Installation and Use (6806800M71L)
Page 26
Safety Notes ATCA-9405 Installation and Use (6806800M71L)
Installieren Sie keine Ersatzteile oder führen Sie keine unerlaubten Veränderungen am Produkt durch, sonst verfällt die Garantie. Wenden Sie sich für Wartung oder Reparatur bitte an die für Sie zuständige Geschäftsstelle von Artesyn Embedded Technologies. So stellen Sie sicher, dass alle sicherheitsrelevanten Aspekte beachtet werden. ATCA-9405 Installation and Use (6806800M71L)
Page 28
Bevor Sie das Board in einem System installieren, überprüfen Sie, ob die im Kapitel "Board Exchange" aufgeführten Anforderungen erfüllt werden. Bereich mit eingeschränktem Zugang - Installieren Sie das Board in ein System nur in Bereichen mit eingeschränktem Zugang. ATCA-9405 Installation and Use (6806800M71L)
Page 29
Typ 2 oder Typ 4 definiert (wie in GR-1089-Core beschrieben) und erfordern eine Isolation zu Leitungen außerhalb des Gebäudes. Die Gebäude-internen Schnittstellen dürfen keine elektrisch leitende Verbindung zu Leitungen außerhalb des Gebäudes haben. Ein ATCA-9405 Installation and Use (6806800M71L)
Page 30
Availability unterstützt, installieren bzw. herausziehen, wird das Board beschädigt und es gehen Daten verloren. Installieren/entfernen Sie das Board nur im laufenden Betrieb, wenn das System Hot Swap oder High-Availability unterstützt und wenn die Systembeschreibung dies ausdrücklich erlaubt. ATCA-9405 Installation and Use (6806800M71L)
Page 31
Batterie Beschädigung des Blades Ein unsachgemäßer Einbau der Batterie kann gefährliche Explosionen und Beschädigungen des Blades zur Folge haben. Verwenden Sie deshalb nur den Batterietyp, der auch bereits eingesetzt wurde und befolgen Sie die Installationsanleitung. ATCA-9405 Installation and Use (6806800M71L)
Page 32
Sicherheitshinweise Umweltschutz Entsorgen Sie alte Batterien und/oder Produkte stets gemäß der in Ihrem Land gültigen Gesetzgebung und den Empfehlungen des Herstellers. ATCA-9405 Installation and Use (6806800M71L)
Cavium Simple Executives, and run fast path packet processing software for time-critical applications. The ATCA-9405 supports for up to 162 Gigabit Ethernet (GbE) I/O bandwidth and a redundant 40GbE fabric. It allows the design of compact application systems for the upcoming new IP data infrastructure.The ATCA-9405 represents a performance and...
Page 34
Introduction Dual 1G Ethernet base interface Support for Wind River PNE 4.x OS, Cavium SDK, and 6WIND 6WINDGate ATCA-9405 Installation and Use (6806800M71L)
Introduction Functional Overview The following block diagram provides a functional overview of the ATCA-9405. Figure 1-1 General System Block Diagram ATCA-9405 Installation and Use (6806800M71L)
Introduction Additional Information This section lists the regulatory certifications of ATCA-9405 hardware and briefly discusses the terminology and notation conventions used in this manual. Mean time between failures (MTBF) has been calculated at 439,924 hours using the Telcordia SR-332, Issue 1 (Reliability Prediction for Electronic Equipment), method 2 at 30°C.
Page 37
(RoHS) DIRECTIVE 2002/96/EC OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL on waste electrical and electronic equipment (WEEE) Interoperability Designed to operate within a CP-TA B.4 system environment at full performance ATCA-9405 Installation and Use (6806800M71L)
1.3.2 RoHS Compliance The ATCA-9405 is compliant with the European Union’s RoHS (Restriction of use of Hazardous Substances) directive created to limit harm to the environment and human health by restricting the use of harmful substances in electrical and electronic equipment. Effective July...
Introduction Product Identification Figure 1-2 Serial Number and Product ID SERIAL Assy Rev NUMBER Serial Number Label COO Label Assembly Revision On R1.0 prototypes, only the Serial Number label is available. ATCA-9405 Installation and Use (6806800M71L)
Page 40
Introduction ATCA-9405 Installation and Use (6806800M71L)
Unless you ground yourself properly, static charges can accumulate in your body and cause ESD damage when you touch the board. Use proper static protection and handle ATCA-9405 boards only when absolutely necessary. Always wear a wrist strap to ground your body before touching a board. Keep your body grounded while handling the board.
Setup ATCA-9405 Circuit Board The ATCA-9405 circuit board is an ATCA blade assembly and complies with the PICMG 3.0 ATCA mechanical specification. It uses a 16-layer printed circuit board with the following dimensions: Table 2-1 Circuit Board Dimensions Width Depth...
For these interfaces, the maximum cable length should not exceed more than 3m. 2.3.1 Switch Settings All mechanical switches are OFF in their default configuration. Switch OFF means high level for the connected signal and switch ON means low level for the connected signal. ATCA-9405 Installation and Use (6806800M71L)
Setup The switches are placed on component side 1. The Figure 2-2 Figure 2-3 show the switch locations on the board. Figure 2-2 Switch Location with Heat Sink SW1 and SW2 ATCA-9405 Installation and Use (6806800M71L)
Boot from TSOP SPI Flash This switch overrides selection done via SW1-1 and SW1-2. OFF = Boot from SPI Boot Flash (TSOP devices) ON = Boot from SPI Debug Header SW1-4 Reserved Do not change ATCA-9405 Installation and Use (6806800M71L)
OFF = SP controlled PP1 power enable ON = Manual PP1 power enable SW4-2 Manual Power Enable for Packet Processor 2 Software controlled (SP) power enable for PP2 OFF = SP controlled PP2 power enable ON = Manual PP2 power enable ATCA-9405 Installation and Use (6806800M71L)
Page 47
Reserved (SW3-3 = ON) Do not change SW4-4 IPMC Console Output Selection IPMC Console Output via debugging header OFF = IPMC console output via debug connector ON = IPMC console output via front panel connector ATCA-9405 Installation and Use (6806800M71L)
Setup 2.3.2 Safety Critical Hot Spots The following figure shows the critical hot spots on the ATCA-9405 board. Figure 2-4 Location of the Hot Spots Temperature Spot 1 (on Power Entry Module) = 110°C (max) exact location: on top of upper transformer...
Signal VCC_USB Ethernet Ports 2.3.3.1.2 Two shielded RJ45 connectors with integrated transformers for 10/100/1000Base-T Ethernet are available at the front panel. Table 2-8 Ethernet Connector Pin-out Signal BI_DA+ BI_DA- BI_DB+ BI_DC+ BI_DC- BI_DB- BI_DD+ BI_DD- ATCA-9405 Installation and Use (6806800M71L)
Setup Serial Console Ports 2.3.3.1.3 Three shielded RJ45 connectors (with Cisco style pin-out) for serial consoles are available at the front panel. Table 2-9 Serial Console Connector Pin-out (Cisco Style) Signal RTS# CTS# ATCA-9405 Installation and Use (6806800M71L)
Setup On-board Connectors 2.3.3.2 The following figure shows the location of eUSB Drive Connector (P6) on ATCA-9405. Figure 2-5 Location of On-board Connectors ATCA-9405 Installation and Use (6806800M71L)
Setup eUSB Drive Connector 2.3.3.2.1 ATCA-9405 provides one 2x5 pin header and a mounting hole for eUSB drives like Smart Modular Z-U130. Table 2-10 eUSB Drive Connector Pin-out Signal ATCA-9405 Installation and Use (6806800M71L)
The AdvancedTCA backplane connectors reside in three zones, 1 to 3 as specified by the AdvancedTCA standard and are called P10, P20 and 23, and P30, P31, and 32. The pinouts of all these connectors are given in this section. Figure 2-6 Location of AdvancedTCA Connectors ATCA-9405 Installation and Use (6806800M71L)
Setup 2.3.3.3.2 Zone 1 Connector The Zone 1 connector is used to deliver power from the ATCA back plane to the ATCA-9405 baseboard. The pin out for this connector is defined by the ATCA specifications. The ATCA-9405 does not implement Metallic Test or Ringing Generator Circuitry and therefore does not use pins 17 through 24.
P20 through P24 as per the ATCA specifications. The ATCA-9405 is a node board and uses only two of the five connectors P20 and P23. P20 is used to support clock synchronization interface and update channels and P23 is used to support the base and fabric channels.
Setup 2.3.3.3.4 Zone 3 Connector ATCA-9405 provides three connectors P30, P31, and P32 for connection to the RTM. Table 2-14 Zone 3 Connector P30 Pin Assignments Table 2-15 Zone 3 Connector P31 Pin Assignments ATCA-9405 Installation and Use (6806800M71L)
2.3.4 Debugging Headers The following debugging headers are provided on the ATCA-9405 board. Debugging headers are only used internally and may be removed later for cost reduction reasons. For more information regarding location and usage of debugging headers, please contact sales/marketing team.
2.3.4.2 COP Header A 16-pin header is provided for access to P2020 COP interface. The pin assignment is shown below. Table 2-19 COP Header Pin Assignment Signal Signal QACK SRESET# TRST# RUNSTOP HRESET# Target Power ATCA-9405 Installation and Use (6806800M71L)
Table 2-20 EJTAG Header Pin Assignment Signal Signal TRST# UART1_RXD RESET# UART1_TXD Target Power The standard EJTAG connector has only 14 pins, so do not connect to pin 15 and 16. ATCA-9405 Installation and Use (6806800M71L)
Setup ATCA-9405 Setup Following items are required to setup and check the operation of ATCA-9405: ATCA chassis and power supply Console cables for EIA-232 ports (Cisco style pin out) Computer terminal Save the antistatic bag and box for future shipping or storage.
Exception in the US and Canada -39 VDC to -60 VDC The exact power requirements for the ATCA-9405 circuit board depends upon the specific configuration of the board, including the CPU frequency and amount of memory installed on the board.
Page 63
Random 20-200 Hz at -3 m/Sec2 Shock Half-sine, 11 m/Sec, 30 mSec/sec2 Blade level packaging Half-sine, 6 mSec at 180 m/Sec2 Free fall 1,200 mm/all edges and corners 1.0 m (packaged) 100 mm (unpacked) Figure 2-8 Air Flow Graph ATCA-9405 Installation and Use (6806800M71L)
The ATCA-9405 Rear Transition Module (RTM) has its own Hot Swap LED and switch, and it can be Hot Swapped in/out independently of the face plate. If the face plate is not present, then the RTM will not be powered.
Page 65
Removing a board 1. Pull out the handle (tab) on the ATCA-9405 front panel at one click. A short blink indicates that the board is requesting permission for extraction. 2. Remove the board when the blue LED on the front panel is on (no payload power).
List the items that you are returning and the board serial number, plus your purchase order number and billing information if your ATCA-9405 hardware is out of warranty. Contact our Test and Repair Services Department for any warranty questions. If you return the board, be sure to enclose it in an antistatic bag, such as the one in which it was originally shipped.
Packet Processor Overview Two independent Packet Processor Units are implemented on ATCA-9405. Each unit includes the Packet Processor with DDR3 memory, boot flash, Ethernet interfaces, USB interfaces, serial interfaces, power supply, and the connections to the blade infrastructure. The main functions...
Note: Note that the 1.5 GHz version of the processor may not be used on ATCA-9405 because of thermal and electrical limitations. Tradeoff with regard to core count and memory size is needed to enable usage of 1.5 GHz processor.
System Memory 3.4.1 Memory Interface All four CN6880 memory controllers are used on ATCA-9405. Each memory controller provides a 72-bit (64-bit data plus 8-bit for ECC) wide DDR3 interface channel that connects with a single DDR3 DIMM socket. Two physical memory banks (chip select signals) are implemented per DIMM socket to allow use of single-rank and dual-rank DIMM modules.
3.4.3 Memory Modules ATCA-9405 requires VLP DDR3 DIMM modules in order to fit within the maximum component height profile of an ATCA blade. Installed module height must not exceed 21.33 mm above PCB surface. The CN6880 DIMM module requirements are listed below.
General Purpose Input/Output (GPIO) pins. Octeon U-Boot The two Octeon-II packet processors on the ATCA-9405 do not have a boot flash device. They are started using the oct-remote-boot command from the Octeon SDK via the PCI bus from the Freescale P2020 Service Processor.
RXAUI, Interlaken, or PCIe interfaces. Internally CN6880 supports five SerDes quad-lane modules (QLMs) for a total of 20 SerDes lanes. For the default configuration of ATCA-9405 (where the Packet Processors are interconnected via Interlaken Interface), one PCI Express, one Interlaken, two DXAUI and two RXAUI interfaces are provided.
On ATCA-9405, PCIe Interface 0 (using QLM3 SerDes module) is configured to x1 link width and is connected to the PLX PEX8608 switch. For more details regarding PCIe infrastructure, refer Service Infrastructure on page 109.
MII MAC or an RGMIII MAC. The MII links are fully compliant with the IEEE 802.3 specifications, and the RGMII links are fully compliant with the HP RGMII 1.3 specifications. On ATCA-9405 two DXAUI, two RXAUI, and one RGMII interface are implemented. 3.8.1 Front Panel Interface The RGMII interface is connected to a 10/100/1000Base-T port at the front panel.
The Interlaken interface unit supports SerDes lanes running at up to 6.25 Gbps, two links/interfaces, and x8, x4, x2, and x1 configurations. On ATCA-9405 the Interlaken interface (using QLM1 SerDes module) is used for interconnection between the two Packet Processors (when ATCA-9405-ILK-MODULE is assembled).
PP2_GPIO5 PP2_ETH_INT_N 88E1512 PHY Interrupt PP2_GPIO1 3.15 Power Supply ATCA-9405 supports software controlled power-down and power-on sequence for the two Packet Processor units as described in Hot Plug Support on page 110. 3.16 Cooling A passive heat sink is mounted on top of the CN6880 package. The heat sink is designed to withstand shock and vibration tests according to the environmental conditions.
Ethernet Switch, the PEX8608 PCIe Switch, and the RTM. The SP also takes the root complex role for the complete PCIe infrastructure on the blade and RTM. The main functions of the SP are shown in the Figure 4-1 on page Figure 4-1 Service Processor Unit Overview ATCA-9405 Installation and Use (6806800M71L)
Service Processor P2020 Processor A Freescale P2020 QorIQ Communication Processor is used on ATCA-9405 as the on-board SP. The processor is manufactured in 45nm process technology and combines dual Power Architecture™ e500v2 processor cores with system logic required for networking, wireless infrastructure, and telecommunications applications.
The socket is keyed for DDR3 DIMM modules using 1.5V supply voltage. 4.4.3 Memory Modules ATCA-9405 requires VLP DDR3 DIMM modules in order to fit within the maximum component height profile of an ATCA blade. Installed module height must not exceed 21.33 mm above PCB surface.
CPU. For persistent memory support on ATCA-9405, a dedicated register is implemented in the Glue Logic FPGA to enable or disable persistent memory by software. If persistent memory is enabled, the contents of the main memory stay unchanged after any applied reset, except power-up reset.
The content of the NVRAM (an I2C EEPROM), or (if the NVRAMs CRC is invalid) a set of compiled-in defaults The content of the IPMI boot parameter storage Dynamic variables set during the boot-up phase Variables set by the user via the U-Boot shell ATCA-9405 Installation and Use (6806800M71L)
The time (UNIX time) when the blade has started. If this variable is set to "-1" then the RTC does not run at startup physical_slot The physical slot number where the blade is mounted logical_slot The logical slot number where the blade is mounted ATCA-9405 Installation and Use (6806800M71L)
A sequence of commands executed to boot the operating system (via auto boot or the boot command). bootargs undefined Arguments for the operating system (that is, the linux kernel command line or the VxWorks boot parameters). ATCA-9405 Installation and Use (6806800M71L)
160. Programming a firmware image requires that the image is present as.fri file. The firmware update command will verify that the contents of the FRI file are suitable to be programmed into the selected device. ATCA-9405 Installation and Use (6806800M71L)
Service Processor 4.5.6 Application/OS Boot The default boot device of the ATCA-9405 is the internal USB disk. 4.5.6.1 Default Boot Sequences Various default boot sequences are stored in environment variables. These variables can be executed as script using the run command (for example, run nfsboot).
The eLBC supports ratios of 4, 8, and 16 between the faster internal CCB clock and slower external bus clock. The selected divider for ATCA-9405 is 16, resulting in a local bus frequency of 31 MHz at a platform frequency of 500 MHz (1000 MHz processor).
The ports can be configured for x1, x2, or x4 link widths. On ATCA-9405, PCIe Port 1 (SerDes Lane 0) is configured to x1 link width and is connected to the PLX PEX8608 switch. P2020 acts as root complex and is responsible for blade control and monitoring as well as PCIe hot plug handling.
CRC generation and checking, RMON statistics, jumbo frames, TCP/IP acceleration and QoS features, VLAN insertion and deletion and MAC address recognition. On ATCA-9405, eTSEC1 is configured to RGMII mode while eTSEC2 and eTSEC3 are configured to SGMII mode. The corresponding strapping is listed in the table below.
SPI Flash specification. 4.10.2 Boot Flash Selection For crisis recovery, Boot Flash 1 (default) and Boot Flash 2 (recovery) can be exchanged under IPMC software control through logic implemented in the FPGA. ATCA-9405 Installation and Use (6806800M71L)
USB port 2 is connected to an on-board eUSB Flash Drive. 4.11.1 USB Connector One standard USB type A connector is provided at the face plate for USB access to the SP. For connector pin out details, refer to USB Port on page ATCA-9405 Installation and Use (6806800M71L)
Service Processor 4.11.2 e-USB Flash Drive ATCA-9405 provides a factory option for eUSB Flash Drives. The Flash Drive can be used for local mass storage, persistent user data storage or booting of operating system and user images. A low profile 2mm eUSB header on the board is connected to the P2020 to support eUSB modules from various vendors.
16-pin COP header to support a processor emulator for board debug. For connector pin out details, refer to Connector Pin Assignment. 4.15 Interrupts The Service Processor is responsible for handling of infrastructure related interrupts. ATCA-9405 Installation and Use (6806800M71L)
A passive heat sink is mounted on top of the P2020 package. The heat sink is designed to withstand shock and vibration tests according to the environmental considerations. The heat sink keeps the processor die temperature below the maximum rating of 125°C under any conditions listed in Environmental Considerations on page ATCA-9405 Installation and Use (6806800M71L)
Page 96
Service Processor ATCA-9405 Installation and Use (6806800M71L)
Ethernet Infrastructure Overview The Ethernet infrastructure on ATCA-9405 provides switching between any on-board Ethernet port, the ATCA base and fabric interface, and the Ethernet ports provided through RTM. Separate networks for control and data planes are implemented using VLAN and port based filters, inside the Ethernet switch device.
Ethernet Infrastructure Figure 5-1 Ethernet Infrastructure Double data rate XAUI (DXAUI) is 20Gbps interface between Marvell Switch and Cavium CPU, using four SerDes lanes running at 6.25Gbps. ATCA-9405 Installation and Use (6806800M71L)
Ethernet Infrastructure Ethernet Switch The Ethernet switching device used on ATCA-9405 is Marvell 98CX8234, a highly integrated 32-Port 10 Gigabit Ethernet L2+ Packet Processor with 40 Gigabit Ethernet Uplinks. ® The 98CX8234 is a member of the Prestera -CX family that addresses bandwidth demand, high density 10G solutions, and support for future 40G upgradability.
(clock synchronization, interface arbitration). The primary use of the TWSI interface is for switch initialization after reset, when the TWSI operates as a master for serial ROM initialization of the switch. On ATCA-9405, the TWSI interface is not used and switch is fully configured via Switch Management Interface.
0x08 – 0x0B The four Slave SMI Interfaces (CPU_SMI) for host access to all address mapped entities in the Switch are not used on ATCA-9405. The PCI Express interface is used instead. Base Interface The redundant (dual) ATCA base interface is provided by the Ethernet Switch. The physical 1000Base-T interface (according to PICMG3.0) is implemented using one Marvell 88E1322...
The Microcontroller converts the incoming UART ports from Glue Logic FPGA into an Ethernet interface, which is connected to the Ethernet Switch. For the connection between Microcontroller and Switch, Marvell 88E1512, Gigabit Ethernet Transceiver in 100Base-T mode is used. ATCA-9405 Installation and Use (6806800M71L)
Ethernet Infrastructure The Ethernet Switch is configured at power up via serial EEPROM (refer Two-Wire Serial Interface on page 102) and therefore supports immediate serial redirection after power up. Figure 5-7 Serial Redirection ATCA-9405 Installation and Use (6806800M71L)
Port configuration is a part of the PEX8608 initialization process that starts upon exiting from the fundamental reset through PEX_PERST# reset input. The configuration of upstream port, port width, and other hardware modes are initially set by hardware strapping signals. ATCA-9405 Installation and Use (6806800M71L)
The SP has the role of PCIe root complex, thus Port 0 is configured as default upstream port. Hot Plug Support ATCA-9405 supports software controlled power-down and power-on sequence for the two PP units including memory, Gigabit Ethernet PHY, TCAM module, and all external interfaces. This is used to reduce power consumption of the blade, when application does not need full computing performance of both PPs.
The application running on the SP is responsible for interaction with the SHPC and the additional logic in the Power CPLD and Glue Logic FPGA. The two I/O Expanders are implemented in the Glue Logic FPGA. ATCA-9405 Installation and Use (6806800M71L)
LED blinkingLane is enabled, 2.5 GT/s Table 6-2 Lane Mapping Ethernet Switch Port Group 3 Ethernet Switch Port Group 1 Packet Processor 1 Ethernet Switch Port Group 4 Ethernet Switch Port Group 2 Packet Processor 1 Service Processor ATCA-9405 Installation and Use (6806800M71L)
Chapter 7 Mezzanine Module Overview ATCA-9405 provides a flexible mezzanine module based design approach to design and plug in various modules that support or add features for the Packet Processors units. Following are the examples: Module with TCAM processor to offload the Packet Processors.
Mezzanine Module The following block diagram shows ATCA-9405 with TCAM Module plugged. Figure 7-1 Block Diagram with TCAM Module ATCA-9405 Installation and Use (6806800M71L)
Mezzanine Module The following figure shows ATCA-9405 with PCI-Express module. Figure 7-2 Block Diagram with PCI-Express Module ATCA-9405 Installation and Use (6806800M71L)
Page 118
Mezzanine Module TCAM and PCI-Express module are optional items. Contact sales/marketing team, if you require a mezzanine module. ATCA-9405 Installation and Use (6806800M71L)
Chapter 8 Intelligent Peripheral Management Controller Overview The ATCA-9405 provides an intelligent hardware management system, as defined in the AdvancedTCA® Base Specification (PICMG® 3.0; AMC.0). This system incorporates two IPMI controllers: An Intelligent Platform Management Controller (IPMC) based on the BMR-H8S-AMCc®...
Page 120
The Power CPLD controls the enabling and monitoring of power good signals from all on-board power converters. The functional block diagram of the ATCA-9405 IPMC/MMC system is shown in Figure 8-1 on page 121.
The IPMC implements a number of subsidiary threads in addition, to serve RTM module discovery and e-keying management. ATCA-9405 Installation and Use (6806800M71L)
HPM.1 Components All embedded software images are upgraded via HPM.1 protocol. The following are the HPM.1 components: IPMI bootloader IPMI firmware IPMI FRU information U-boot firmware Field Programmable Gate Array (FPGA) ATCA-9405 Installation and Use (6806800M71L)
IPMI F/W firmware without backup command IPMI FRU supported IPMI F/I information without backup command U-Boot supported PYLD F/W firmware without backup command FPGA yes (even supported PYLD FPGA power without backup cycle) command ATCA-9405 Installation and Use (6806800M71L)
Note: Manual rollback to the old working image is not possible. Rollback means switching to the golden version. A payload cold reset is not enough to execute a new FPGA component. In this case, a power cycle is required. ATCA-9405 Installation and Use (6806800M71L)
The IPMI controller can be upgraded via KCS or IPMB interface. To ensure that the payload is not interrupted during IPMI firmware upgrade, the IPMI controller stores all operational information, such as e-keying, hot-swap state, last events to be queued, graceful shutdown timeout, latest pin settings, and so on in non-volatile storage. ATCA-9405 Installation and Use (6806800M71L)
: IPMI F/W Firmware Version : 2.0.00000002 BANK : D - Operational Firmware Name : IPMI B/L Firmware Version : 2.0.00000002 BANK : G - Operational Firmware Name : IPMI F/I Firmware Version : 0.0.00000000 ATCA-9405 Installation and Use (6806800M71L)
: 1.0.0000000A ********************[[[[[ REPORT END ]]]]]******************** Sensors This section describes the analog and discrete Sensors available at the ATCA-9405. Table 8-2 on page 128, lists the sensor identification numbers and information regarding the sensor type, name, supported thresholds, assertion and deassertion information, and a brief description of the sensor purpose.
Page 129
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm HS_ARTM Hot Swap Sensor- [7:4] = Cause...
Page 130
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm 1.0V Voltage Threshold reading threshold...
Page 131
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm Boot Err Boot Error Sensor-...
Page 132
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm PP #0 Temp Threshold reading...
Page 133
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm -48v Current Threshold reading threshold...
Page 134
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm CPLD Sensor- 0x0: 12V Power Good...
Page 135
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm CPLD Sensor- 0x0: RTM Power...
Intelligent Peripheral Management Controller Table 8-2 ATCA-9405 Specific Sensors (continued) Event/ Event Event Reading Data Event Data Event Data Threshold/ Assertion Sensor Name Sensor Type Type Byte 1 Byte 2 Byte 3 Description Deassertion Rearm Fw Prog System Sensor- See IPMI Spec...
0: Holdup Cap is not connected to -48V 1: Holdup Cap is connected to -48V Out Bit 3 Reserved Bit 2 Alarm Signal State 0: Primary side Alarm is not set 1: Primary side Alarm is set ATCA-9405 Installation and Use (6806800M71L)
48V Feed A Power Entry Module 48V Feed B Current Holdup Temp Status 0x92 IPMC private Front blade Temperature Switch LM75 0x96 IPMC private Front blade Temperature P2020 LM75 0x9C IPMC private Front blade Temperature outlet LM75 ATCA-9405 Installation and Use (6806800M71L)
Page 139
Temperature of PP1 DIMM 0xA4 IPMC private2 Front blade Temperature of PP1 DIMM 0xA6 IPMC private2 Front blade Temperature of PP1 DIMM 0x90 Temperature Inlet LM75 0x92 Temperature Outlet LM75 0x94 Temperature P220 CPU MAX1617 ATCA-9405 Installation and Use (6806800M71L)
Performance Lags. If POST fails, the POST sensor generates an event to the SEL with the Performance Met/Performance Lag offsets. To obtain results of POST, the IPMC supports the IPMI standard command Get Self Test Results with OEM extensions. This IPMI command can be run at anytime. ATCA-9405 Installation and Use (6806800M71L)
Intelligent Peripheral Management Controller FRU Inventory The ATCA-9405 implements two intelligent FRUs (IPMC and MMC). Every FRU provides its own FRU information (serial, part, MAC addresses). leDepending on the presence of a module, you can know whether FRU information is visible or not.
M > 1: this descriptor specifies a pool of MAC addresses with M count MAC Address. (Canonical form, the LSB (least significant bit) first. Table 8-8 Interface Type Assignments Interface type Description ATCA Base Interface ATCA Base Interface Front/Rear Panel ATCA-9405 Installation and Use (6806800M71L)
3 x 2 CN6880 to the switch 1 x 2 CN6880 to the front Reset and Power Domains The ATCA-9405 provides the following FRU instances: FRU #0: front board management and switch FRU #1: RTM Each FRU instance can be reset separately. Each FRU instance is implemented as a managed FRU having its own hot-swap state machine and FRU information.
Intelligent Peripheral Management Controller Power Management The ATCA-9405 provides three power levels to be selected by the ShMM. The IPMC selects the Cavium core frequency of both processors to manage blade power consumption. At Power Level 1, both processors are configured for 800MHz only, at power level 2, both processors run at 1000MHz, and at power level 3, both processors run at their maximum speed.
Thus, they can be easily enhanced and there are no dependencies between different versions of IPMC firmware and payload firmware. The IPMC provides a set of boot configuration parameters and the payload firmware initializes those parameters. Figure 8-4 IPMC Boot Parameter Storage Configuration Flow ATCA-9405 Installation and Use (6806800M71L)
LUN2 message to payload interface. If the payload application has registered to these commands via OpenIPMI library, it gets informed and can take all necessary actions before the payload is gracefully rebooted/shut- down. ATCA-9405 Installation and Use (6806800M71L)
8.12 Serial Line Selection All payload serial interfaces (COM #0 of PP #0, PP #1, SP) of the ATCA-9405 can be redirected to the terminal server. It is even possible to redirect two serial interfaces to the terminal server in parallel.
Intelligent Peripheral Management Controller There is a combined board serial line selection available. The serial line selection is implemented via OEM IPMI command. Figure 8-5 IPMC Serial Line Selection ATCA-9405 Installation and Use (6806800M71L)
By default, the serial line selection selects the front-panel connectors after power-up. 8.13 Built-in Terminal Server The ATCA-9405 provides a built-in Terminal Server (TS) based on the embedded controller MCF5223X ColdFire from Freescale. All serial payload data can be accessed via the Terminal Server.
-k "0 <ipmb slot> 0 c 22 5 C0 0 0" smi 0 8.13.2 Establishing a Telnet Session SOL client is not required to establish a serial connection to the ATCA-9405 payload serial line via network Base Interface #1 or #2. The Telnet Session (TS) can be configured very easily via IPMI commands.
Page 151
Bit-rate 6 = 9600baud, 7 =19.2kbaud, 8=38.4kbaud 7. To set the SOL_ENABLE flag, execute the following commands: ipmicmd -k "0 <ipmb slot> 0 c 21 5 1 1 smi 0 Telnet session is not possible without enabling the SOL. ATCA-9405 Installation and Use (6806800M71L)
SP firmware (U-Boot) must disable or reset the BMC Watchdog within 30 seconds of payload activation. If there is a failure in disabling or resetting the BMC Watchdog, then the IPMC performs a payload reset. ATCA-9405 Installation and Use (6806800M71L)
The Renesas H8S provides support for Low Pin Count (LPC)/KCS in hardware. KCS is defined by the IPMI 1.5 Specification. 8.16 Payload Boot Bank Selection The ATCA-9405 provides redundant payload boot flashes for crisis recovery. The IPMC manages from which boot bank the payload should boot from. ATCA-9405 Installation and Use (6806800M71L)
The IPMI command Set System Boot Options together with the parameter #98 is used to specify the timeout for Graceful Shutdown. The value of the graceful shutdown timeout is specified for both CPUs. By default, this value is set to 10 sec. ATCA-9405 Installation and Use (6806800M71L)
8.19 Local System Event Log The ATCA-9405 IPMC supports a local System Event Log (SEL). The local SEL size is configured to hold 1K entries in a circular FIFO buffer. Once the circular buffer is full, the next SEL entry overwrites the oldest SEL entry in the buffer.
Enterprise Number. A value of CDh is used. 2nd byte of Artesyn Embedded Technologies IANA Enterprise Number. A value of 65h is used. MSB of Artesyn Embedded Technologies IANA Enterprise Number. A value of 00h is used. ATCA-9405 Installation and Use (6806800M71L)
Table 8-14 Serial Output Selector Assignments Serial Output Source Serial Output Selector Payload serial interface PP #0 Payload serial interface PP #1 IPMC serial interface 1 Reserved Payload serial interface SP reserved 05h - ffh ATCA-9405 Installation and Use (6806800M71L)
Page 158
-k "0 <ipmb slot> 0 2e 15 cd 65 0 3 0 0" smi 0 To set the serial COM #0 of PP #1 to the terminal server #1: ipmicmd -k "0 <ipmb slot> 0 2e 15 cd 65 0 3 1 1" smi 0 ATCA-9405 Installation and Use (6806800M71L)
2nd byte of Artesyn Embedded Technologies IANA Enterprise Number. A value of 65h is used. MSB of Artesyn Embedded Technologies IANA Enterprise Number. A value of 00h is used. Serial output selector. For more information, see Table 8-14 on page 157. ATCA-9405 Installation and Use (6806800M71L)
LSB of Artesyn Embedded Technologies IANA Enterprise Number. A value of CDh is used. 2nd byte of Artesyn Embedded Technologies IANA Enterprise Number. A value of 65h is used. MSB of Artesyn Embedded Technologies IANA Enterprise Number. A value of 00h is used. ATCA-9405 Installation and Use (6806800M71L)
Intelligent Peripheral Management Controller Table 8-17 on page 161, provides the feature set supported with ATCA-9405. Table 8-17 Feature Selector Assignments Feature Selector Description FAILSAFE Function Enable/Disable Select FPGA flash 8.21.4 Get Feature Configuration This command is used to retrieve the IPMI feature set being configured.
3. In the Search text box, type the product name and click GO. Table A-1 Artesyn Embedded Technologies - Embedded Computing Publications Document Title Publication Number ARTM-9405 Installation and Use 6806800N04 ATCA-9405 Quick Start Guide 6806800N10 ATCA-9405 Installation and Use (6806800M71L)
Page 164
Related Documentation ATCA-9405 Installation and Use (6806800M71L)
Need help?
Do you have a question about the ATCA-9405 and is the answer not in the manual?
Questions and answers