ADLINK Technology aTCA-3430 User Manual

10gbe advancedtca fabric interface switch
Table of Contents

Advertisement

Quick Links

Advance Technologies; Automate the World.
aTCA-3430
10GbE AdvancedTCA
Fabric Interface Switch
User's Manual
Manual Revision:
Revision Date:
Part Number:
0.20 preliminary
Dec. 30, 2014
50-1G039-1000
1

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the aTCA-3430 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Summary of Contents for ADLINK Technology aTCA-3430

  • Page 1 10GbE AdvancedTCA Fabric Interface Switch User's Manual Manual Revision: 0.20 preliminary Dec. 30, 2014 Revision Date: Part Number: 50-1G039-1000 Advance Technologies; Automate the World.
  • Page 2 User's Manual Revision History Date Description 0.10 2014/12/27 Preliminary release 0.20 2014/12/30 Update switch info, 10GbE port switching diagram...
  • Page 3: Preface

    User's Manual Preface Copyright 2014 ADLINK Technology, Inc. This document contains proprietary information protected by copyright. All rights are reserved. No part of this manual may be reproduced by any mechanical, electronic, or other means in any form without prior written permission of the manufacturer.
  • Page 4: Table Of Contents

    DIP Switches..........................21 Programmable Devices......................... 22 4.2.2 Connecting to the Blade ......................23 Connecting to the aTCA-3430 via COM port ................23 Connecting to the aTCA-3430 remotely ..................25 Boot into CLI for Base Switch Management ................. 26 Boot into CLI for Fabric Switch Management ................27 5.
  • Page 5 User's Manual 8.1.1 Boot Image Redundancy ......................38 U-Boot Redundancy........................38 8.1.2 LMP SDK/BSP Porting (U-Boot file system) ................40 8.1.3 Device Drivers ........................40 8.1.4 LMP State Machines....................... 42 8.1.5 Boot Sequence ........................43 8.1.6 Non-volatile Memory Mapping....................44 Switch Subsystem........................
  • Page 6 Figure 9. U-Boot Redundancy Flow ............................ 39 Figure 10. LMP SDK/BSP Porting ............................40 Figure 11. LMP State Machine ............................42 Figure 12. aTCA-3430 Boot Sequence ..........................43 Figure 13. Broadcom SDK Porting ............................45 Figure 14. aTCA-3430 Software Overview.......................... 58 Figure 15.
  • Page 7: Abbreviations

    User's Manual Abbreviations Term Description ASIC Application Specific Integrated Circuit ATCA Advanced Telecom Computing Architecture ATCA Base Interface on Zone-2 connectors to connect to the dual hubs, 4 differential pairs Base Interface per Base Channel. Blade A printed circuit board assembly that plugs into a chassis...
  • Page 8 User's Manual Term Description SGMII Serial Gigabit Medium Independent Interface Serial Over LAN QSFP+ Quad Small Form Pluggable Plus (40G interface) UART Universal Asynchronous Receiver-Transmitter Very Low Profile, DRAM Module Form Factor Spec XAUI 10 Gigabit (X) Attachment Unit Interface, having 4 lanes@3.125Gbps...
  • Page 9: Overview

    In addition to a Fabric switch, the aTCA-3430 also incorporates a Base switch to provide PICMG 3.0 Gigabit Ethernet backplane connectivity. The Base switch provides up to 13 ports of node slot connectivity to support both 6 and 14-slot chassis in addition to 8 ports of front I/O, with 6 ports supporting 1GbE and 2 ports supporting 10GbE.
  • Page 10: Functional Block Diagram

    Figure 1. aTCA-3430 Block Diagram 1.3 Package Contents The aTCA-3430 is shipped with the components listed below. If any of the items in the contents list are missing or damaged, retain the shipping carton and packing material and contact the dealer for inspection.
  • Page 11: Features And Specifications

    Load balancing based on L2, L3, L4 switching protocol, routing etc. ACLs up to 7-tuple matching Layer 2-4 fields IP packet forwarding of IPv4, IPv6 and IP multicast VLAN, STP, link aggregation etc. Additional protocols are available upon request Table 1: aTCA-3430 Specifications...
  • Page 12: External Interfaces

    User's Manual 3. External Interfaces 3.1 Front Panel The face plate of the main blade has the following components: LED-OOS: Out Of Service indicator LED-Power Good: Power indicator LED-Health: Health indicator LED-HS: Hot-Swap indicator LED-Fabric Interface: Fabric Interface Link & Activity indicator LED-Base Interface: Base Interface Link &...
  • Page 13: Usb Port

    User's Manual Description Table 2. Serial Console Port Pinout Item Value Baud rate 115200 Data 8-bit Parity None Stop bit 1-bit Flow control None Table 3. Serial Console Port Configuration Values 3.2.2 USB Port A single USB port is available on the face plate, which is connected to the LMP. The P2040 supports 2x USB compliant to USB specification Rev 2.0.
  • Page 14: Service Ports

    User's Manual 3.2.4 Service Ports Traffic service ports are provided with RJ-45 and SFP+ outlets. Either a fiber optic cable or a copper cable with a mating SFP+ connector can be used to connect the blade with remote blades or appliances. The SFP+ ports support IEEE 802.3ae (Clause 52) and IEEE 802.3aq (Clause 68).
  • Page 15: Zone 2 Backplane Interfaces

    Ethernet switch in the blade. Through the switch, the Base Interface traffic goes to the LMP for necessary processing. The Fabric Interface on the aTCA-3430 blade can connect to up to thirteen boards in the chassis. The thirteen Fabric Interface ports are connected to the high capacity onboard Ethernet switch, where the port speed is configurable to 1Gbps/10Gbps in the form of 4 SerDes lanes at 2.5Gbps each or 1...
  • Page 16: Getting Started

    4.1 Safety Requirements The following safety precautions must be observed when installing or operating the aTCA-3430. ADLINK assumes no responsibility for any damage resulting from failure to comply with these requirements.
  • Page 17: Quick Start

    User's Manual 4.2 Quick Start 4.2.1 Hardware Configuration Setting For normal operation, it is not recommended to change any onboard hardware configuration settings, but there are some options on the board for those want to investigate more flexibility for testing. Figure 2 illustrates the locations of the configurable components.
  • Page 18: Headers And Jumpers

    User's Manual Headers and Jumpers • Ground Connection (JP3): This header is used to short GND and GND_SHELF on the board. The default setting is Pin 1 and Pin 2 shorted. GND_SHELF BC892 C1000P2KV6MX7 PH-1*3-2D54-D-ST-ML-6/3 Figure 3. Ground Header Schematic (JP3)
  • Page 19: Table 7. Xaui_Sel Status Settings (Jp5)

    User's Manual Description BCM56842 connects to BCM56334 (HiGig) BCM56842 connects to aDB3710 (BCM8706) Table 7. XAUI_SEL Status Settings (JP5) • IPMC JTAGSEL Mode (JP8): This header is used to select either FPGA Fabric TAP or Cortex-M3 JTAG debug. The default setting is FPGA Fabric TAP.
  • Page 20: Figure 6. Ipmc Jtag Header Schematic (Jp9)

    User's Manual • IPMC JTAG (JP9): This header is used to program the IPMC bit file using a JTAG cable. P3V3_PRE R861 10KR2F R868 R873 R862 10KR2F IPMC_JTAG_TCK IPMC_JTAG_TDO IPMC_JTAG_TMS VJTAG VPUMP IPMC_JTAG_nTRST IPMC_JTAG_TDI PH-2*5-2D54-D-ST-ML-6/3-JVE 1KR2F Figure 6. IPMC JTAG Header Schematic (JP9) •...
  • Page 21: Dip Switches

    User's Manual DIP Switches • SW1: SW1 is used to switch between SPI flash boot and SD card boot. The default setting is SPI flash boot. SW No. Mode Setting SPI Flash SD Card Table 9. SPI Flash or SD Card Selection (SW1) •...
  • Page 22: Programmable Devices

    User's Manual • SW3: This is a multi-function switch. Pin 1 is used to select Shelf Mode or Stand Alone Mode. Pin 2 is used to select between boot from SPI Flash 0 or boot from SPI Flash 1. Pin 3 is used to select compliance to PICMG 3.0 or PICMG 3.1.
  • Page 23: Connecting To The Blade

    4.2.2 Connecting to the Blade Connecting to the aTCA-3430 via COM port Step 1 Turn on the aTCA-3430. Connect the USB port of a laptop/PC to the LMP via the front panel COM port (RJ-45) on the aTCA-3430 using an RJ-45-to-USB adapter. COM port Step 2 Start a terminal emulator application (e.g.
  • Page 24 User's Manual Step 4 Set the IP address of eth0, for example: root@aTCA-3430:~# ifconfig eth0 172.20.5.162 netmask 255.255.255.0...
  • Page 25: Connecting To The Atca-3430 Remotely

    “Connecting to the aTCA-3430 via COM port”. Step 1 Turn on the aTCA-3430. Step 2 Connect the Ethernet port of a laptop/PC to the LMP Mgmt port on the front panel of the aTCA-3430 using an Ethernet cable. LMP Mgmt port Step 3 Start a terminal-emulator application (e.g.
  • Page 26: Boot Into Cli For Base Switch Management

    User: root Password: (no password) Boot into CLI for Base Switch Management BCM SDK will start automatically when the aTCA-3430 boots up. The user can boot into CLI for Base switch management as follows: 1. Login to the LMP OS.
  • Page 27: Boot Into Cli For Fabric Switch Management

    User's Manual Boot into CLI for Fabric Switch Management BCM SDK will start automatically when the aTCA-3430 boots up. The user can boot into CLI for Fabric switch management as follows: Boot into CLI for Base switch management firstly, please refer to “Boot into CLI for Base Switch Management”...
  • Page 28: Software Setup/Update/Recovery

    5.1 U-Boot Installation 5.1.1 Building U-Boot When there is no U-Boot on the aTCA-3430, perform the following actions 1. Plug in an SD card into a Linux PC (for example, the SD card is recognized as “/dev/sde”). 2. Run “sudo dd if=U-Boot.bin of=/dev/sde bs=512 seek=8 count=1300” to write a U-Boot image onto the SD card.
  • Page 29: Bsp/Embedded Linux/Bcm Sdk Installation

    User's Manual 5.2 BSP/Embedded Linux/BCM SDK Installation The steps for BSP installation and update are the same. Please perform the following actions: => mac port 2 => mac 0 00:30:64:22:22:12 => mac 1 00:31:64:22:11:23 => mac save Programming passed.
  • Page 30 User's Manual [root@dell-3 ~]# service xinetd restart [root@dell-3 ~]# ls /home/work/ATCA_3430/target/boot aTCA-3430.dtb rootfs.ext2.gz.uboot vendor-drops.tgz fsl_fman_ucode_P2040_106_1_4.bin.ucode u-boot.bin fsl-image-full-rootfs.tar.gz uImage Boot into U-Boot: => setenv ipaddr <board_ip> => setenv serverip <server_ip> => run initrd Update U-Boot/BSP/BCM-SDK by executing /sbin/mmcsd_lmp-installer. Change the IP address and TFTP server IP to those of your actual environment: root@ p2040rdb:~# /sbin/mmcsd_lmp-installer all <board_ip>...
  • Page 31: Redundant Lmp Firmware & Boot

    User's Manual 5.3 Redundant LMP Firmware & Boot The U-Boot image is stored in SPI flash memory. On the aTCA-3430, the LMP has two such U-Boot flash memories (primary and redundant). 5.3.1 Boot Auto-Switch The user can enable the boot auto-switch function to U-Boot to automatically switch to the redundant flash when the primary flash memory fails.
  • Page 32: Ipmi Firmware Update Procedure

    Perform the following steps to update the IPMC firmware: Step 1: Prepare an external host PC with Linux OS and connect it to the serial port on the aTCA-3430 via the COM port (USB Mini-B on the front panel). Put the IPMItool utility and new firmware image on the host PC.
  • Page 33: Table 13. Firmware Image And File Name

    Perform the following steps to update firmware: Step1: Prepare an external host PC with Linux OS and connect it to the target aTCA-3430 via Base Interface. Put the IPMItool utility and the new firmware image on the host PC. Enter the following command: [root@localhost 3430]# ./ipmitool –I lan –H 172.17.172.134 hpm upgrade hpm1fw.img...
  • Page 34: Configuring And Managing The Fabric Switch

    User's Manual 6. Configuring and Managing the Fabric Switch Refer to the “BMC SMB Quick Start Guide” for detailed information. To receive a copy of this document, please contact your ADLINK representative.
  • Page 35: Advanced Operation

    User's Manual 7. Advanced Operation 7.1 Switching I/O between Front Panel and Base Switch The Fabric Switch (BCM56842) connects to SFP+ ports on the front panel by default. One 10GbE port can be switched to the Base Switch (BCM56334). Refer to the red square in Figure 8 below.
  • Page 36: Switch Uart Serial Port Between Front Panel And Ipmc

    13 5f 00 01 Switch one 10GbE port of the BCM56842 to the Base Switch (BCM56334) and check the status. root@aTCA-3430:~# ipmitool raw 0x2e 0x70 0x13 0x5f 0x00 0x00 13 5f 00 root@aTCA-3430:~# ipmitool raw 0x2e 0x71 0x13 0x5f 0x00 13 5f 00 00 Set the BCM56842 to default status.
  • Page 37 User's Manual The UART serial port connects to the IPMC in debug mode (SW2-3 ON, SW2-4 ON).
  • Page 38: Architecture Overview

    The aTCA-3430 supports LMP U-Boot image redundancy U-Boot Redundancy The U-Boot image is stored in an SPI flash memory. On the aTCA-3430, the LMP has two such U-Boot flash memories: primary and redundant. The U-Boot Redundancy Flow is shown in Figure 9 below.
  • Page 39: Table 14. Lmp U-Boot Boot-Up Failover Actions

    User's Manual Figure 9. U-Boot Redundancy Flow The actions for each step are described in Table 14 Domain Name Description Sets LMP SPI CS0. (SPI_FLASH1 or SPI_FLASH2) In IPMC Setup BootSel Standalone mode, irrespective of IPMC configuration, user can select IPMC BootSel using H/W switch.
  • Page 40: Lmp Sdk/Bsp Porting (U-Boot File System)

    Note: The details for the Freescale SDK installation and operation are found in ~/documents after ISO installation. Figure 10. LMP SDK/BSP Porting 8.1.3 Device Drivers The device drivers provide accessibility to the devices on the aTCA-3430 blade. The vendor’s drivers are ported to the blade environment with necessary changes. Device Description...
  • Page 41: Table 15. Summary Of Devices And Access

    User's Manual Device Description Host Program Remark Ethernet port of LMP mac addresses for LMP_EEPROM adlk-eeprom ADLINK M24256 LMP-SDK Real Time Clock date, hwclock (Linux standard DS1388 utilities) LMP-SDK power control for MAX5820 PWR_CTRL i2cget, i2cset... (Linux standard FABRIC_SWITCH...
  • Page 42: Lmp State Machines

    Waits for a User command input. Disables the BMC watchdog. BOOTING_OS Triggers the OS booting. Performs the LMP services. aTCA-3430 board management services include the following: IN_SERVICE - ipmievd: IPMI message processing daemon Other services defines by a user can be included. IN_TESTING Performs testing Table 16.
  • Page 43: Boot Sequence

    The boot sequence of devices with a CPU core is illustrated in Figure 12. The IPMC is responsible for initiation of the booting sequence. The states in the boot sequence are summarized in Table18 . Figure 12. aTCA-3430 Boot Sequence...
  • Page 44: Non-Volatile Memory Mapping

    Refer to Figure 4-2 LMP OS booting flow Table 18. Boot Sequence State Descriptions 8.1.6 Non-volatile Memory Mapping The aTCA-3430 provides various non-volatile memories (NVM) to store software images and log system events for different purposes. The memory map for the devices is shown in Table 19.
  • Page 45: Switch Subsystem

    User's Manual 8.2 Switch Subsystem The switch subsystem includes Broadcom driver/SDK porting, and ADLINK switch software running over the Broadcom SDK. The ADLINK Switch Manager software includes all Layer 2 and Layer 3 switching functions. The Fabric & Base Switch (BCM56842/56846/56334) can also be paired with the ADLINK Switch Manager software for management.
  • Page 46: Pmi Subsystem

    IPMI session over the network with RMCP+ protocol. The aTCA-3430 supports SOL on the Base Interface which is powered by the BCM56334 Gigabit Ethernet Switch. The BCM56334 Gigabit Ethernet Switch is connected to the IPMC (Smart Fusion A2F500) via the NC- SI interface, which provides remote management capability before the payload power is authorized.
  • Page 47 User's Manual Item Sensor Name Sensor Address Description +3.3V (0x5) Voltage Sensor Upper Non-Recoverable Threshold = 3.63 Volts Upper Critical Threshold = 3.56 Volts Upper Non-Critical Threshold = 3.5 Volts Lower Non-Critical Threshold = 3.1 Volts Lower Critical Threshold = 3.04 Volts Lower Non-Recoverable Threshold = 2.97 Volts...
  • Page 48 User's Manual Item Sensor Name Sensor Address Description Upper Non-Critical Threshold = 1.08 Volts Upper Critical Threshold = 1.06 Volts Lower Critical Threshold = 0.94 Volts Lower Non-Critical Threshold = 0.92 Volts Lower Non-Recoverable Threshold = 0.9 Volts (15) VDD +1.2V...
  • Page 49: Sensor Reading (Fru Hot Swap Sensor)

    User's Manual Sensor Reading (FRU Hot Swap Sensor) Byte Data Field Request data Sensor Number (FFh = reserved) Response data Completion Code Sensor Reading. [7:0] - Not used. Write as 00h. Standard IPMI byte (See “Get Sensor Reading” in IPMI specification):...
  • Page 50: Watchdog Timer Sensor

    User's Manual Byte Data Field 1h = Unable to drive clock HI 2h = Unable to drive data HI 3h = Unable to drive clock LO 4h = Unable to drive data LO 5h = Clock low timeout 6h = Under test (the IPM Controller is attempting to determine if it is causing a bus hang).
  • Page 51: Version Change Sensor

    User's Manual Sensor Type Sensor Sensor Event Type Code Specific Offset 2h = BIOS/POST 3h = OS Load 4h = SMS/OS 5h = OEM Fh = unspecified all other = reserved Version Change Sensor Sensor Type Sensor Sensor Event...
  • Page 52: Get Sensor Reading Command

    User's Manual Sensor Type Sensor Sensor Event Type Code Specific Offset component on the board/FRU that is not tracked as a FRU) 14h board/FRU replaced with equivalent version 15h board/FRU replaced with newer version 16h board/FRU replaced with older version 17h board/FRU intelligent configuration change (e.g.
  • Page 53: Fru Information

    User's Manual Byte Data field [6] - 1b = state 14 asserted [5] - 1b = state 13 asserted [4] - 1b = state 12 asserted [3] - 1b = state 11 asserted [2] - 1b = state 10 asserted...
  • Page 54: Board E-Key Information

    User's Manual Board E-key Information The board E-keying information is compatible with PICMG 3.0 R3.0 and PICMG 3.1 R2.0. Base Channel of Board Point-to-Point Connectivity: Field Field Data Link Descriptor 00001101h ~ 0000110Eh Link Grouping ID (Bits 31-24) 00h: Single-channel link...
  • Page 55 User's Manual Field Field Data Link Type Extension (Bits 23-20) 1h: Fixed 10GBASE-BX4 (XAUI) Link Class (bits 19-16) 0h: Basic signaling Link Class Link Type (Bits 15-12) 2h: PICMG 3.1 Ethernet Fabric Interface Link Designator (Bits 11-0) F41h ~ F4Dh: Fabric Interface, Channel 1 ~ Channel 13, Port 0, 1, 2, 3...
  • Page 56: Ipmi Commands

    User's Manual 8.3.5 IPMI Commands The following table presents all the commands which are supported by the aTCA-3430 through different interfaces and compatible with IPMI v1.5 and PICMG 3.0 R2.0 ECN001. There are two interfaces implemented with IPMI command support: (1) PI: Payload serial interface; (2) IPMB0: IPMBA & IPMBB.
  • Page 57 User's Manual Sensor Device Commands (cont'd) Rearm Sensor Events ● ● Get Sensor Event Status ● ● Get Sensor Reading ● ● FRU Device Commands Get FRU Inventory Area Info ● ● Read FRU Data ● ● Write FRU Data ●...
  • Page 58: Software Component Overview

    This chapter describes the top level of software design of the aTCA-3430. The aTCA-3430 software can be logically divided into four subsystems as shown in Figure 14. This chapter will cover the IPMI subsystem, LMP subsystem, and switch subsystem. The remaining subsystem is the customer software, which can be a user add-on L2/L3 stack, or the upper level user interface/application.
  • Page 59: Lmp Subsystem

    SDK only. The kernel mode BCM-SDK, where most of the functionalities are included in the kernel with bcm.user for a simple user interface, is not supported on the aTCA-3430. Under default settings, the system will boot to the BCM SDK shell.
  • Page 60: Packetmanager

    User's Manual Figure 16. Broadcom SDK Function Blocks 9.4 PacketManager ADLINK PacketManager is designed to support ADLINK hardware platforms, boosting packet processing performance on all platforms, including AdvancedTCA and CompactPCI. PacketManager features are divided into those for the control plane and the data plane. The control plane runs on the switch chipset, such as Broadcom’s BCMxxxxx series.
  • Page 61: Safety

    User's Manual Safety 1. Please read these safety instructions carefully. 2. Please keep this User‘s Manual for future reference. 3. When installing/mounting or uninstalling/removing equipment, turn off power and unplug any power cords/cables. Use a moist towel or cloth for cleaning.
  • Page 62: Consignes De Sécurité

    User's Manual Consignes de Sécurité 1. Veuillez lire attentivement ces consignes de sécurité. 2. Veuillez garder ce manuel de l’utilisateur pour référence ultérieure. 3. Une entrée de courant est fournie pour l’entretien de l’appareil débranché. Débrancher l’appareil des prises de courant et utiliser cette entrée de courant avant entretien ou nettoyage. Utilisez un tissu humide ou un chiffon pour le nettoyage.
  • Page 63: Getting Service

    Tel: +49-621-43214-0 Fax: +49-621 43214-30 Email: emea@adlinktech.com ADLINK Technology, Inc. (French Liaison Office) Address: 6 allée de Londres, Immeuble Ceylan 91940 Les Ulis, France Tel: +33 (0) 1 60 12 35 66 Fax: +33 (0) 1 60 12 35 66 Email: france@adlinktech.com...
  • Page 64 Singapore 349584 Tel: +65-6844-2261 Fax: +65-6844-2263 Email: singapore@adlinktech.com ADLINK Technology Singapore Pte. Ltd. (Indian Liaison Office) Address: #50-56, First Floor, Spearhead Towers Margosa Main Road (between 16th/17th Cross) Malleswaram, Bangalore - 560 055, India Tel: +91-80-65605817, +91-80-42246107 Fax: +91-80- 23464606 Email: india@adlinktech.com...

Table of Contents