Page 4
Power Supply ................3 - 30 3.3.5 Reset .................... 3 - 30 3.3.6 Front Plate Elements ..............3 - 31 Chapter Software Description ................... 4 - 2 4.1 Supported RFCs ..................4 - 2 4.1.1 Management ................... 4 - 2 Page iv AT8902M User Guide...
Page 5
4.5 Firmware Administration ............... 4 - 17 4.5.1 Startup Configurations ..............4 - 18 4.5.2 Updating Firmware ............... 4 - 19 4.5.3 Updating IPMI ................4 - 22 Appendix A. Getting Help ....................A - 2 Page v AT8902M User Guide...
Page 6
Fabric Uplink (J40/J41) LEDs Signification..........3- 25 3-23 XFP Connector Pin Assignment ............... 3- 28 3-24 Fabric Interface 10GbE Port Mapping ............3- 30 3-25 Power Consumption................... 3- 31 3-26 ATCA LEDs Signification ................3- 33 Page vi AT8902M User Guide...
Page 7
POST Boot Steps..................4- 9 AT8904M sensors ..................4- 11 Additional AT8904M sensors (Mezzanine) ..........4- 13 LED state ....................4- 15 OOS LED state ..................4- 15 Health LED state..................4- 16 FLASH Partition Scheme (64MB) .............. 4- 17 Page vii AT8902M User Guide...
Page 8
Block Diagram AMC GbE Cross-connect via update channels ....3 - 8 AT8904M Front Panel ................3 - 19 Backplane Switch LEDs Signification ............3 - 20 AM4310 Block Diagram ................3 - 26 AM4310 Front Plate ................. 3 - 31 Page viii AT8902M User Guide...
Kontron AG reserves the right to change, modify, or improve this document or the product de- scribed herein, as seen fit by Kontron AG without further notice.
However, the life expectancy of your product can be drastically reduced by im- proper treatment during unpacking and installation. Therefore, in the interest of your own safety and of the correct operation of your new Kontron product, you are requested to conform with the following guidelines.
ROM devices, jumper settings etc. If the product contains batteries for RTC or memory back-up, ensure that the board is not placed on conductive surfaces, including anti-static plas- tics or sponges. They can cause short circuits and damage the batteries or conductive circuits on the board. Page xi AT8902M User Guide...
Preface General Instructions on Usage In order to maintain Kontron’s product warranty, this product must not be altered or modified in any way. Changes or modifications to the device, which are not explicitly approved by Kontron AG and described in this manual or received from Kontron’s Technical Support as a special handling instruction, will void your warranty.
As a result, the products are sold “as is,” and the responsibility to ensure their suit- ability for any given task remains that of the purchaser. In no event will Kontron be liable for direct, indirect or consequential damages resulting from the use of our hardware or software products, or documentation, even if Kontron were advised of the possibility of such claims prior to the purchase of the product or during any period since the date of its purchase.
Advanced Switching on the Fabric Interface. Management The AT8902M is managed either in-band or out of band via 10/100 Ethernet or RS232 man- agement ports. The comprehensive set of supported protocols rounds out the feature set of Kontrons' second generation AdvancedTCA Hub Board.
• Out of band via Ethernet or RS232 • IPMI version 1.5 • Ethernet/Bridging protocols include • Link aggregation (802.3ad) • VLANs (802.1Q) • Spanning tree (802.1D, 802.1w) • QoS (802.1p) • Flow control (802.3x) • GVRP, GMRP Page 1 - 3 AT8902M User Guide...
AT8901 Full-size none AT8902 Full-size Gigabit Ethernet The AT8902M base board and the Gigabit Ethernet fabric mezzanine are described in Chapter 3. The Base Interface switch can be one of the following: Table 1-2: Base Interface Options Base Switch AT8902M Flavour...
AT8902M Introduction Technical Specification Table 1-4: AT8902M Main Specifications AT8902M SPECIFICATIONS • PowerPC IBM PPC 405 IBM PowerPC 405 32-bit RISC processor core operating up to 400MHz with ® 16KB I- and D-caches GPr 400MHz • PC-133 synchronus DRAM (SDRAM) interface •...
Page 20
AT8902M Introduction Table 1-4: AT8902M Main Specifications (Continued) AT8902M SPECIFICATIONS • Broadcom 5650x/5630x 24 10/100/1000 Mbps Ethernet ports GbE Switch • Fifth generation of StrataSwitch and StrataXGS product line • Line-rate switching for all packet sizes and conditions • On-chip data packet memory and table memory •...
Page 21
AT8902M Introduction Table 1-4: AT8902M Main Specifications (Continued) AT8902M SPECIFICATIONS • Mechanical 8U form factor mechanically compliant to PICMG 3.0 • Single Slot (6HP) • 2 standard mid-size/single width AMC Slots • 280 mm x 322 mm (11.024“ x 12.677“) •...
Page 22
AT8902M Introduction Table 1-4: AT8902M Main Specifications (Continued) AT8902M SPECIFICATIONS Safety Designed to meet or exceed the following: • UL 60950, 3rd edition • EN 60950 • LVD 73/23/EEC • Denan Law Designed to meet or exceed the following: •...
Operating: 1.0G, 5-500Hz each axis • Non-operating: 0.5G, 5-50Hz; 3.0G, 50-500Hz each axis Shock Designed to meet or exceed the following: • DIN/IEC 60068-2-27 • Bellcore GR-63, Section 4.3 • 30G, half-sine 11ms, each axis Page 1 - 10 AT8902M User Guide...
Page 24
• XFP LEDs: • 2 LEDS (Link for each XFP) • Board Management Based on IPMI 1.5 • FRU Management • Sensors (Voltage, Temperature) • Status and Alerting • Hot Swap and Fabric Page 1 - 11 AT8902M User Guide...
AT8902M Introduction Software Support The following table contains information related to software supported by the AT8902M. Table 1-6: AT8902M Software Specification AT8902M SPECIFICATIONS • General Reliable field upgrades for all software components • Dual boot images with roll-back capability •...
Page 26
AT8902M Introduction Table 1-6: AT8902M Software Specification (Continued) AT8902M SPECIFICATIONS • CoS (Class of Service ) • DifffServ (Differentiated Services) • ACL (Access Control List) • Applications NTP client for retrieving accurate time and date information • DHCP server •...
Page 27
AT8902M Introduction Table 1-6: AT8902M Software Specification (Continued) AT8902M SPECIFICATIONS Bootloader u-boot Version 1.1.2 • POST • multi image support • loadable bootimage via network (bootp/tftp) • reliable field upgradable • H/W protected • KCS interface to IPMC • serial console support •...
Installation Installation The AT8902M has been designed for easy installation. However, the following standard pre- cautions, installation procedures, and general information must be observed to ensure proper installation and to preclude damage to the board, other system components, or injury to per- sonnel.
AT8902M Installation AT8902M Initial Installation Procedures The following procedures are applicable only for the initial installation of the AT8902M in a sys- tem. Procedures for standard removal and hot swap operations are found in their respective chapters. To perform an initial installation of the AT8902M in a system proceed as follows: 1.
OFF at the end of the hot swap sequence. Software Installation The AT8902M comes as a pre-installed system with all necessary OS, Filesystem, drivers and applications factory-installed with default configurations. Updating the Software with new Operating System or applications or new versions is provided by a dedicated update mechanism, which is described in Chapter 4.
Page 32
IP settings. The corresponding procedure is described in the following. User input is printed in bold letters. 1. Connect to serial port on AT8902M front plate using the adapter described in Chapter 3, section 3.1.
Page 33
To access the CLI via Fast Ethernet management port, open a telnet connection to the config- ured IP address, port 23. For additional information on the system configuration, refer to documentation “AT8901/02/ 04M CLI Reference Manual“. Page 2 - 6 AT8902M User Guide...
Also described is the AM4310 10GbE Uplink AMC which is available as an optional accessory. Base Board The AT8902M is a PICMG 3.0 and 3.1 compliant Hub Board for AdvancedTCA shelves. It pro- vides a base interface and a fabric interface (with the mezzanine), suitable for dual-star and full-mesh configurations in 14 and 16 slot systems.
0. The default setting of the PHY is to operate in auto-negotiation enabled mode, 10/100, Full or Half duplex. The PHY drives the two LEDs of the RJ 45 Connector, buffered by the CPLD. The connection is established with a straight through Ethernet cable. Page 3 - 3 AT8902M User Guide...
The Flashes are connected to the 32 bit peripheral data bus. The PowerPC 405 GPr accesses the Flashes with CS0#. The sector containing the bootloader code is write protected. The pro- tection can be disabled by setting jumper FWPD. Page 3 - 4 AT8902M User Guide...
DB9 Pin DB9 Female Number Number Request To Send Data Terminal Ready Transmit Ground Ground Receive Data Set Ready Front View Front View Clear To Send Ring Indicator (Not used) Carrier Detect (Not used) Page 3 - 5 AT8902M User Guide...
Green Green Yellow Yellow Table 3-8: Base Uplink (J39/J38) LEDs Signification Speed LED (yellow) 10BASE-T BLINK 100BASE-TX 1000BASE-T Status LED (green) Link Down Link Up and no activity BLINK Link Up and activity Page 3 - 7 AT8902M User Guide...
LVDS transmitter lines. Figure 3-2: Block Diagram AMC GbE Cross-connect via update channels The block diagram shows one solution for the AMC GbE support channels with a PrAMC as System Controller. Page 3 - 8 AT8902M User Guide...
The main board provides connection for the mezzanine board allowing various technologies for the backplane fabric interface and AMC fabric interfaces. The GbE option of the AT8902M provided by the mezzanine is described in section 3.2. The connection interface to the mezzanine consists of three 220 pin high speed connectors.
Extended Extended Extended Extended Extended RTM, AMC_B2_P17 Extended RTM, AMC_B2_P18 Extended RTM, AMC_B2_P19 Extended RTM, AMC_B2_P20 TCLKA Clock From backplane CLK3A TCLKB Clock To backplane CLK2A or CLK2B TCLKC Clock- From backplane CLK3B Page 3 - 10 AT8902M User Guide...
Page 44
Example Configurations • PrAMC and storage AMC The preferred PrAMC (e.g. Kontron AM4002) slot is B1, the storage AMC (e.g. Kontron AM4500 SATA AMC) should be placed in B2. This ensures optimal airflow and cooling as well as the possibility to make use of the GbE support channel feature connecting the PrAMC to the base switch of the neighbouring AT8902.
• AM4310 The 10GbE Uplink AMC AM4310 connects two XAUI interfaces to the fabric switch. De- pending on the fabric mezzanine option of the AT8902M, either both AMC slots provide two XAUI interfaces, or only B2, or none (see chapter 3.2.1).
(AMC_B1_P13 to AMC_B1_P20 and AMC_B2_P17 to AMC_B2_P20). One SATA/FC inter- face for mass storage from each AMC Slot is implemented (STOR0 and STOR1). Also an I2C IPMI connection is implemented for an intelligent RTM. Page 3 - 13 AT8902M User Guide...
Table 3-14: Power Connector (P10) Signal Signal N.C. N.C. N.C. N.C. SCL_A SDA_A SCL_B SDA_B MT1_TIP(N.C.) MT2_TIP(N.C.) RING_A(N.C.) RING_B(N.C.) MT1_RING(N. MT2_RING(N. RRTN_A(N.C.) RRTN_B(N.C.) SHELF_GND LOGIC_GND ENABLE_B VRTN_A VRTN_B EARLY_A EARLY_B ENABLE_A -48V_A -48V_B Page 3 - 15 AT8902M User Guide...
Page 49
The RTM has its own power supply. The 12V payload power is generated by a hot swap con- troller and for the management power a current limit switch is used. The maximum power dis- sipation for an RTM is 10W. For further details please refer the PICMG 3.0 standard. Page 3 - 16 AT8902M User Guide...
3.1.8.6 Optional Chassis to Logic Ground Connection According to NEBS requirement R9-14 of GR-1089-CORE issue 3, the AT8902M provides a connection between chassis and logic ground. It is made up of a screw that connects the PCB to the bottom sheet.
Page 51
IPMC1 - AMC IPMI Override ShMC Bypass • Normal Operation JTAG_AMC - AMC JTAG Integration Included in JTAG Chain • Excluded from JTAG Chain JTAG_IPMC - IPMC JTAG Restrict JTAG to IPMC • Normal JTAG Operation Page 3 - 18 AT8902M User Guide...
The LED push button toggles between the display of the base interface's and the fabric inter- face's links. User LEDs 2 (base IF) and 4 (fabric IF) indicate which interface's links' status and activity are currently displayed by the 16 STAT/ACT LEDs. Page 3 - 20 AT8902M User Guide...
This section describes the board specific items of the fabric mezzanine module. The mezzanine is a PICMG 3.1 compliant module for the AT8902M AdvancedTCA Hub Board from Kontron. It provides a fabric interface switch with 24 GbE ports and zero, two or four 10GbE uplinks.
Green Green Yellow Yellow Table 3-22: Fabric Uplink (J40/J41) LEDs Signification Speed LED (yellow) 10BASE-T BLINK 100BASE-TX 1000BASE-T Status LED (green) Link Down Link Up and no activity BLINK Link Up and activity Page 3 - 24 AT8902M User Guide...
Page 58
12V payload power are also supplied by the base board. They are used to derive the 3V3, 2V5 and the 1V25 power supply for the mezzanine module payload. Maximum power consumption of the fabric mezzanine module is 25W. Page 3 - 25 AT8902M User Guide...
The AM4310 is a PICMG AMC.0 R1.0 ECN002 compliant Advanced Mezzanine Card module with two 10 Gigabit Ethernet ports. It is designed for operation with the AT8902M ATCA hub blade to equip it with up to four high speed chassis interlink ports.
Not connected TX_DIS Transmitter Disable; Turns off transmitter laser output VCC5 +5V Power Supply Module Ground VCC3 +3.3V Power Supply VCC3 +3.3V Power Supply I²C Serial Interface Clock I²C Serial Interface Data Line Page 3 - 27 AT8902M User Guide...
Page 61
XFP1 and AMC channels 8 to 11 to the transceiver XAUI port for XFP2. The user definable channel 12 contains the MDIO control connection between the fabric switch and the AMC’s XAUI to XFI transceivers. Page 3 - 28 AT8902M User Guide...
Page 62
AT8902M Hardware Description The AT8902M provides up to four 10GbE uplinks connected to the fabric switch. The following table shows the available connection, depending on the fabric mezzanine options. Table 3-24: Fabric Interface 10GbE Port Maping Supported by fabric CLI ID...
AMC is enabled by the base board, the IPMI reset is released. The reset-signals for the PHY devices are released by the MMC after the AMC is activated by the shelf manager and all payload voltages are ok. Page 3 - 30 AT8902M User Guide...
Front Plate Elements Figure 3-6: AM4310 Front Plate LED2: Healthy LED1: Out of Service XFP1 Link LED XFP1 Cage XFP 2 Cage XFP2 Link LED LED 0: Ready for Hot Swap Module Handle Page 3 - 31 AT8902M User Guide...
XFP1 Link LED Green Data link established on XFP1 XFP2 Link LED Green Data link established on XFP2 Module Handle To activate the AMC payload and for extracting the module. Page 3 - 32 AT8902M User Guide...
AT8902M Software Description Software Description Software on the AT8902M includes the following parts: • Bootloader • OS (rootFS, kernel) • Application SW • IPMI FW The Software accomplishes operation of the switching hardware and is therefore also refer- enced as firmware. It is preinstalled on the system and can only be updated by a dedicated update procedure.
Page 68
• Draft-ietf-secsh-architecture-14 - SSH Protocol Architecture • Draft-ietf-secsh-publickeyfile-03 - SECSH Public Key File Format • Draft-ietf-secsh-dh-group-exchange-04 - Diffie-Hellman Group exchange for the SSH Transport Layer Protocol • Configurable Management VLAN ID • Industry Standard CLI Page 4 - 3 AT8902M User Guide...
• RFC 3260 - New Terminology and Clarifications for DiffServ Supported MIBs The Software supports the following MIBs. 4.2.1 Enterprise MIB • Support for all managed objects not contained in standards based MIBs. Page 4 - 6 AT8902M User Guide...
• RFC 3289 - DIFFSERV-MIB & DIFFSERV-DCSP-TC MIBs Bootloader On the AT8902M Hub Board, the bootloader ‘u-boot‘ (universal bootloader) is used. The boot- loader initializes the main components of the board like CPU, SDRAM, serial lines etc. for op- eration. After this, kernel and application are started from flash.
In this case, a management instance can read the last postcode written via the IPMC and thus determine where the fatal error has occurred. Page 4 - 8 AT8902M User Guide...
The FUM keeps two IPMC Firmware code images in two external SEEPROM memories. If a failure occurs during firmware upgrade, the FUM will auto- matically rollback to the last known working IPMC firmware image. Page 4 - 10 AT8902M User Guide...
IPMI v1.5 to merge the AMC hot swap sensor with the AT8902M sensors population. AMC hot swap events indicated by this sensor are passed to the ShMC. Additionally, the IPMC updates the sensor population change indicator timestamp ac- cessible through the Get Device SDR Info command to remain compliant to IPMI v1.5.
Page 77
AT8902M Software Description Table 4-3: AT8902M sensors (continued) Scanning Enabled Under IPMI Sensor Name Unit Health LED/Sensor Power State Icc 3.3vSus FRU0 Amps On/Off Exceeds critical threshold Vcc 3.3vSus FRU0 Volts On/Off Exceeds critical threshold Icc 3.3v FRU0 Amps Exceeds critical threshold Vcc 3.3v FRU0...
Page 78
IPMB bus. In the event of any link state change, the events are written to the AT8902M SEL. The IPMC monitors the bus for any link failure and iso- lates itself from the bus if it detects that it is causing errors on the bus. Events are sent to signal the failure of a bus or, conversely, the recovery of a bus.
AT8902M Software Description 4.4.1.6 Health Error The Health Error is asserted if one of the sensors in Table 4-3: (AT8902M sensors) and Table 4-4: (Additional AT8902M sensors (Mezzanine)) matches the Health LED/Sensor condition. 4.4.2 Field Replaceable Unit (FRU) Information 4.4.2.1...
Level ‘0‘ has been received while in M2 or M3 state As per AMC.0, if the AMC current draw requirements exceed AMC.0 carrier power budget, the AT8902M will keep the AMC in M1 state with the blue Hot Swap LED in the ON state. Page 4 - 15...
4.4.6 Hot Swap Process The AT8902M Hub Board has the ability to be hot-swapped in and out of a chassis. The on- board IPMC manages the power-up and power-down transitions. In addition to captive retaining screws, the Hub Board has two ejector mechanisms to provide a positive cam action;...
Software Description Firmware Administration A running AT8902M system requires – after the bootloader has passed control to the kernel – the kernel itself, the root file system (initrd), the FASTPATH switching application and a config- uration file for base and fabric switch. These software components, together with the IPMC im- age, make up the AT8902M firmware.
Each combination of these compo- nents can be used as a startup configuration, though they must be compatible to each other. Please always follow Kontron documentation for all your upgrades. Software versions provided with an official release are known to work together.
B kernel and root file system. The active system is either system A or system B, the factory default serves as a backup in case an upgrade of either system A or B fails. See the flash partition scheme shown above for more detail. Page 4 - 19 AT8902M User Guide...
Page 85
5. Restart the board. 6. Activate the new startup configuration permanently A software release for the AT8902M consists of three software packages for kernel, initrd and application software. The packages are tar archives containing an image of the software and a MD5 checksum file for consistency check.
Page 86
This way, a failsafe upgrade of the AT8902M software is possible. To restart the board with the new startup configuration, the CLI command ‘reload’ is used:...
(Base Fabric) #download ipmifw tftp://192.168.50.5/ipmi.pkg Flashing a new IPMI firmware will disable the IPMI Controller for some minutes. Are you sure to update the IPMI firmware? (y/n)y (Base Fabric) # Page 4 - 22 AT8902M User Guide...
AT8902M Getting Help Appendix Getting Help Page A - 1 AT8902M User Guide...
Page 89
Tel.: +49 (0) 8341 803 333 Fax: (450) 437-8053 Fax: +49 (0) 8341 803 339 If you have any questions about Kontron, our products, or services, visit our Web site at: www.kontron.com You also can contact us by E-mail at: North America: support@ca.kontron.com...
Page 90
3. Fax it to us at: North America (450) 437-0304, EMEA +49 (0) 8341 803 339 • E-mail 1. Send us an e-mail at: RMA@ca.kontron.com in North America or at: orderprocess- ing@kontron-modular.com in EMEA. In the e-mail, you must include your name, your company name, your address, your city, your postal/zip code, your phone number, and your e-mail.
Page 91
• Clearly write or mark the RMA number on the outside of the package you are returning. • Ship prepaid. We take care of insuring incoming units. North America EMEA Kontron Canada, Inc. Kontron Modular Computers GmbH 616 Curé Boivin Sudetenstrasse 7 Boisbriand, Québec 87600 Kaufbeuren...
Page 92
Number: Fax Number: ________________________ E-Mail: _______________________ P.O. # Serial Number Failure or Problem Description (if not under warranty) Fax this form to Kontron’s Technical Support department in North America at (450) 437-0304 or in EMEA at +49 (0)8341 803 339...