Page 15
Power Requirements ............49 Table 2-4. Power Consumption of ATCA-7540 with and without RTM ......50 Table 2-5.
Page 16
OS IPMC Watchdog Timeout Register ..........142 ATCA-7540 Installation and Use (6806871A01A)
Page 17
Telecom Clock Monitor Frequency/Period Register ....... . 166 ATCA-7540 Installation and Use (6806871A01A)
Page 18
Supported Global IPMI Commands ..........229 ATCA-7540 Installation and Use (6806871A01A)
Page 19
Get Payload Communication Time-Out Command Description ..... 268 Table 8-39. Set Payload Communication Time-Out Command Description ..... 268 ATCA-7540 Installation and Use (6806871A01A)
Page 20
Related Specifications ............321 ATCA-7540 Installation and Use (6806871A01A)
Supported IPMI Commands on page 229 lists all supported IPMI commands. IPMI Feature Set on page 277 provides information about controlling the blade via IPMI. Related Documentation on page 321 provides links to further blade-related documentation. ATCA-7540 Installation and Use (6806871A01A)
Page 22
Direct Media Interface eNVM Embedded Non-Volatile Memory Error-Correction Code EEPROM Electrically Erasable Programmable Read-only Memory Electromagnetic Compatibility Elektromagnetische Vertraeglichkeit Electrostatic Discharge ETSI European Telecommunications Standards Institute FUF Command-line Utility FPGA Field-Programmable Gate Array Field Replaceable Unit ATCA-7540 Installation and Use (6806871A01A)
Page 23
Keyboard Controller Style Local Area Network Light-emitting Diode Land Grid Array Low Pin Count Media Access Control Management Engine Module Management Controller NCSI Network Controller Sideband Interface NEBS Network Equipment Building System Network Interface Controller Non-maskable Interrupt ATCA-7540 Installation and Use (6806871A01A)
Page 24
Quad Small Form-factor Pluggable Reliability, Availability and Serviceability RMCP Remote Management Control Protocol RDIMM Registered Dual Inline Memory Module Real Time Clock Rear Transition Module Serial Attached SCSI SATA Serial ATA SCSI Small Computer System Interface ATCA-7540 Installation and Use (6806871A01A)
Page 25
Serial Presence Detect Serial Peripheral Interface Spread Spectrum Clocking Solid State Device Trusted Platform Module UART Universal Asynchronous Receiver-Transmitter UEFI Unified Extensible Firmware Interface Ultra Path Interconnect Universal Serial Bus Very Low Profile Video Graphics Adapter ATCA-7540 Installation and Use (6806871A01A)
Page 26
Ranges, for example: 0..4 means one of the integers 0,1,2,3, and 4 (used in registers) Logical OR Indicates a hazardous situation which, if not avoided, could result in death or serious injury ATCA-7540 Installation and Use (6806871A01A)
No danger encountered. Pay attention to important information. Helpful information and tips. Summary of Changes This manual has been revised and replaces all prior editions. Part Number Publication Date Description 6806871A01A December 2018 Initial Version ATCA-7540 Installation and Use (6806871A01A)
Page 28
About this Manual ATCA-7540 Installation and Use (6806871A01A)
The product conducts, radiates and uses radio frequency energy and, if not installed properly and used in accordance with this user documentation, may cause harmful interference to radio communications. ATCA-7540 Installation and Use (6806871A01A)
Page 30
ESD-safe environment. Hold the product by its edges and do not touch any components or circuits. Data Loss Wait until the blue LED is permanently illuminated before removing the blade. Removing the blade with the blue LED still blinking causes data loss. ATCA-7540 Installation and Use (6806871A01A)
Page 31
Overheating and Product Damage When operating the product, make sure that forced air cooling is available in the shelf or the enclosure. Operating the product without forced air cooling may lead to overheating and product damage. ATCA-7540 Installation and Use (6806871A01A)
Check and change the setting of any switch not marked Reserved before installing the blade. Blade Damage Check and change switch settings before you install the blade. Setting/resetting the switches during operation can cause blade damage. ATCA-7540 Installation and Use (6806871A01A)
Page 33
Always use the same type of lithium battery as is installed and make sure the battery is installed as described in the manual. Environment Improper disposal of used products may harm the environment. Always dispose of used products according to your country’s legislation and manufacturer’s instructions. ATCA-7540 Installation and Use (6806871A01A)
Page 34
Safety Notes ATCA-7540 Installation and Use (6806871A01A)
Aspekte beachtet werden. Das Produkt wurde in einem Artesyn Standardsystem getestet. Es erfüllt die für digitale Geräte der Klasse A gültigen Grenzwerte in einem solchen System gemäß den FCC-Richtlinien Abschnitt 15 bzw. EN 55032 Klasse A. ATCA-7540 Installation and Use (6806871A01A)
Page 36
Umfeld verwendet wird, können Funkstörungen auftreten. Wenn solche Probleme auftreten, muss der Benutzer möglicherweise Korrekturmaßnahmen ergreifen. HINWEIS: Dieses Produkt wurde mit deaktivierter „Spread Spectrum Clock” (SSC) Funktion getestet und ausgeliefert. Artesyn garantiert nicht für die Funktion oder EMV Anforderungen mit aktiviertem SSC. ATCA-7540 Installation and Use (6806871A01A)
Page 37
Absicherung, um die Gebäude-internen Schnittstellen mit Leitungen außerhalb des Gebäudes zu verbinden. Die Gebäude-internen Schnittstellen ("intra-building ports" per GR-1089-CORE) der Geräte oder Baugruppen müssen abgeschirmte Gebäude-interne Verkabelungen verwenden, die an beiden Enden geerdet ist. ATCA-7540 Installation and Use (6806871A01A)
Page 38
Eingangsleitungen A und B verursachen. In diesem Fall ist Leitung A immer noch unter Spannung, auch wenn sie vom Versorgungskreislauf getrennt ist (und umgekehrt). Um Schäden oder Verletzungen zu vermeiden, überprüfen Sie vor dem Fortsetzen Ihrer Arbeit immer, dass keine Spannung an der Leitung anliegt. ATCA-7540 Installation and Use (6806871A01A)
Page 39
Laserstrahlung (oder beides) erzeugt und für die Augen schädlich sein kann. Suchen Sie zusätzliche Informationen (Leistung, Wellenlänge, Sichtbarkeit, Impulsdauer, anwendbare Normen), bevor Sie Geräte warten. Blicken Sie niemals mit einem optischen Gerät auf das Lasergeräte. ATCA-7540 Installation and Use (6806871A01A)
Page 40
Verwenden Sie deshalb nur den Batterietyp, der auch bereits eingesetzt wurde und befolgen Sie die Installationsanleitung. Umweltschutz Unsachgemäße Entsorgung von gebrauchten Produkten kann die Umwelt schädigen. Entsorgen Sie gebrauchte Produkte stets gemäß der in Ihrem Land gültigen Gesetzgebung und den Empfehlungen des Herstellers. ATCA-7540 Installation and Use (6806871A01A)
Introduction ATCA-7540 Blade Features The ATCA-7540 is a high-performance ATCA compliant single board computer designed for demanding storage and processing applications. The main features of the ATCA-7540 blade are as follows: Designed for NEBS and ETSI compliance (configuration dependent) ...
4.0 kg (ATCA-7540-0GB) Estimated Mean Time Between Failures (MTBF) Per Telcordia SR-332, Issue 4, for a ground benign 40 °C ambient environment, the ATCA-7540 MTBF is 362,000 hours at 60% confidence level. This does not include the RDIMM or M.2 modules.
Introduction Product Identification The following figure shows the location of the serial number label. Figure 1-1. Serial Number Location Serial Number ATCA-7540 Installation and Use (6806871A01A)
16 GB DDR4-2400 VLP memory module NVME-M.2-1TB 1TB NVME M.2 media RTM-ATCA-7360-L RTM with 2x GbE ports, 2x SAS ports, and 1x HDD carrier kit RTM-ATCA-736x-DD RTM with 2x GbE ports, and 2x slot for HDD carrier kits ATCA-7540 Installation and Use (6806871A01A)
Artesyn Contact Center at RMASupport.ec@Artesyn.com. Environmental and Power Requirements In order to meet the environmental requirements, the blade has to be tested in the system in which it is to be installed. ATCA-7540 Installation and Use (6806871A01A)
Blade Overheating and Blade Damage Operating the blade without forced air cooling may lead to blade overheating and thus blade damage. When operating the blade, make sure that forced air cooling is available in the shelf. ATCA-7540 Installation and Use (6806871A01A)
Page 47
Telcordia GR-63-core) 2-2) Random 5-20 Hz at 1 m Random 20-200 Hz at 3 m 984 feet to 9842 feet 984 feet to 9842 feet Altitude (—300 m to +3,000 m) (—300 m to +3,000 m) ATCA-7540 Installation and Use (6806871A01A)
Page 48
Temperature Spot 1: On the PIM (U45 located on top of the transformer). Maximum up to F (90 Temperature Spot 2: On the 48 V/12 V DC/DC (U193 located on the PCB, next to the transformer). Maximum up to 257 F (125 ATCA-7540 Installation and Use (6806871A01A)
Characteristic Value Rated Voltage -48 VDC to -60 VDC Exception in the US and Canada -48 VDC Operating Voltage -39 VDC to -72 VDC Exception in the US and Canada -39 VDC to -60 VDC ATCA-7540 Installation and Use (6806871A01A)
Page 50
The following table provides information about the typical and maximum power consumption of ATCA-7540 variants equipped with RDIMMs, SSDs, and RTM-ATCA-7360-L or RTM-ATCA- 736x-DD. The table also contains power consumption details of the blade without any rear transition module (RTM).
RTM 12V Power Intel i350 POWERVILLE CPU0 FORTVILLE CPU1 48V to 12V DCDC ATCA PIM Battery J5J5 DIMM M J8J2 DIMM J Serial Number J6J2 DIMM L J9J1 DIMM H J6J4 DIMM K J9J3 DIMM G ATCA-7540 Installation and Use (6806871A01A)
Reserved. Connected to FPGA. Reserved SW100.3 Reserved. Connected to FPGA. Reserved RTM Power Control RTM power is SW100.4 OFF = RTM power is controlled by IPMC controlled by IPMC ON = RTM power is forced on ATCA-7540 Installation and Use (6806871A01A)
Page 53
Normal BIOS output SW3.3 on serial console ON = Display BIOS POST codes on serial console Use current BIOS OFF = Use current BIOS configuration settings configuration SW3.4 ON = Load default BIOS configuration settings settings ATCA-7540 Installation and Use (6806871A01A)
The corresponding installation/removal procedures are described in this section. For the location of the RDIMM memory modules, see Figure 2-2. ATCA-7540 Blade Layout on page Each processor provides six memory channels with one RDIMM socket each. The RDIMMs can be installed in any order but at least one RDIMM must be installed on CPU#0.
Page 55
0x0b. The only known RDIMM with this configuration is Micron 16GB 2Rx4 PC4-2133 VLP RDIMM module, part number MTA36ADS2G72PZ-2G1A1JG. Do not use this Micron RDIMM or any RDIMM with the referenced register manufacturer ID and revision. ATCA-7540 Installation and Use (6806871A01A)
2. Open the locks of socket at both sides. The memory module is automatically lifted up. 3. Remove the module from the socket. 4. Repeat the steps 2 to 3 in order to remove further memory modules. ATCA-7540 Installation and Use (6806871A01A)
2.5.2 M.2 NVMe or SATA Modules ATCA-7540 provides a modular solution for up to two M.2 NVMe or SATA modules. An M.2 riser card provides two M.2 sockets with Type 3 pinout and keying. Each socket will support the installation of an NVMe or SATA M.2 SSD module. The SSD modules may be Type 2280 (80 mm) or Type 22110 (110 mm) modules.
2. Prior to installing the blade into the slot, slide the top and bottom latches into the handle release position and pull the handles outward to unlatch the handles from the faceplate. Do not pull the handles fully outward. ATCA-7540 Installation and Use (6806871A01A)
Page 59
Continue to push the blade gently until the blade connectors engage. 5. Fully insert the blade and turn the handle towards the faceplate. The latch automatically slides inwards and locks the handle. ATCA-7540 Installation and Use (6806871A01A)
Page 60
If an RTM is connected to the front blade, it is recommended that the RTM be installed and secured first before installing the front blade. Make sure that the handles of both the RTM and the front blade are closed in order to power up the blade’s payload. ATCA-7540 Installation and Use (6806871A01A)
LED starts blinking indicates that the blade power-down process is ongoing. 2. Wait until the blue LED is illuminated permanently. If the LED continues to blink, it may indicate that the upper layer software has rejected the blade extraction request. ATCA-7540 Installation and Use (6806871A01A)
5. Remove the blade from the shelf. Replacing the Battery Some blade variants contain an on-board battery. Its location is shown in the following figure. A batteryless variant based on SUPERCAP is available on demand. ATCA-7540 Installation and Use (6806871A01A)
Page 63
Hardware Preparation and Installation Figure 2-4. Location of On-board Battery Battery ATCA-7540 Installation and Use (6806871A01A)
Page 64
If installing another battery type other than what is mounted at blade delivery may cause data loss. This is because other battery types may be specified for other environments or may have a shorter lifespan. Only use the same type of CR2032 lithium battery as is already installed. ATCA-7540 Installation and Use (6806871A01A)
Page 65
2. Install the new CR2032 lithium battery following the "positive" and "negative" signs. NOTICE Environmental Damage Improper disposal of used products may harm the environment. Always dispose of used products according to your country’s legislation and manufacturer’s instructions. ATCA-7540 Installation and Use (6806871A01A)
Page 66
Hardware Preparation and Installation ATCA-7540 Installation and Use (6806871A01A)
Chapter 3 Controls, Indicators, and Connectors Faceplate The following figure illustrates the connectors, keys, and LEDs available on the ATCA-7540 faceplate. Figure 3-1. Faceplate USER LEDS U1, U2, U3 HANDLE PICMG LEDs SFP+ USB 3.0 ETH BLUE LED HANDLE 3.1.1...
The blade provides one faceplate reset button. When the reset button is pressed, a hard reset is triggered and all the attached on-board devices are reset. The reset button can be disabled via switch SW2.4. See Table 2-6 on page 53. You cannot reset the IPMC via this button. ATCA-7540 Installation and Use (6806871A01A)
Port 0 from the Platform Controller Hub (PCH) 10 GbE controller is routed to a front panel SFP+ site. The ATCA-7540 provides an SFP+ 20-pin host connector as defined in the SFF-8431 Enhanced Small Form Factor Pluggable Module specification. See the following table for the pinout.
This will support system installations that favor serial console access from the rear of the chassis. The pinout of the serial interface connector is shown below. Figure 3-3. Serial Interface Connector Pinout ATCA-7540 Installation and Use (6806871A01A)
USB 3.0 Tx Data - USB 3.0 Tx Data + Attaching a device to the front panel USB port that exceeds the maximum USB current rating of 500 mA per port will result in the ATCA-7540 protecting itself through a port shutdown. On-board Connectors The blade provides the M.2 SSD module carrier connector on board.
Page 72
Figure 3-4. Location of M.2 Riser Card M.2 Riser Card The M.2 riser card board connector is a Samtec 80 pin 0.5 mm pitch ERM5-040 high speed header. The pinout is provided in the following table. ATCA-7540 Installation and Use (6806871A01A)
Page 73
Function 3.3 V 3.3 V PCIE_NGFF1_RX0_P NGFF1_REFCLK_P PCIE_NGFF1_RX0_N NGFF1_REFCLK_N PCIE_PORT2B_RX1_P PCIE_NGFF1_TX0_P PCIE_PORT2B_RX1_N PCIE_NGFF1_TX0_N PCIE_PORT2B_TX2_P PCIE_PORT2B_TX1_P PCIE_PORT2B_TX2_N PCIE_PORT2B_TX1_N 3.3 V NGFF0_REFCLK_P NGFF0_CLKREQ_L NGFF0_REFCLK_N PCIE_RST_NGFF_L NVME0_PEDET PCIE_NGFF0_TX0_P SMB_NGFF_DATA PCIE_NGFF0_TX0_N SMB_NGFF_CLK NGFF0_DEVSLP PCIE_NGFF0_RX0_P 3.3 V PCIE_NGFF0_RX0_N PCIE_PORT2B_TX3_P PCIE_PORT2A_TX1_P ATCA-7540 Installation and Use (6806871A01A)
Page 74
PCIE_PORT2A_TX1_N PCIE_PORT2B_RX3_P PCIE_PORT2A_RX1_P PCIE_PORT2B_RX3_N PCIE_PORT2A_RX1_N PCIE_PORT2B_RX2_P PCIE_PORT2A_TX2_P PCIE_PORT2B_RX2_N PCIE_PORT2A_TX2_N NGFF1_DEVSLP PCIE_PORT2A_RX2_P CLK_33K_SUSCLK PCIE_PORT2A_RX2_N 3.3 V 3.3 V PCIE_PORT2A_TX3_P 3.3 V PCIE_PORT2A_TX3_N 3.3 V NGFF1_CLKREQ_L PCIE_PORT2A_RX3_P NVME1_PEDET PCIE_PORT2A_RX3_N 3.3 V 3.3 V 3.3 V 3.3 V ATCA-7540 Installation and Use (6806871A01A)
The AdvancedTCA backplane connectors reside in Zones 1 to 3 as specified by the ATCA standard, and are called P10, P20 and P23, P30, P31, P32 and P3333. The pinouts of all these connectors are provided in this section. Figure 3-5. Location of AdvancedTCA Connectors ATCA-7540 Installation and Use (6806871A01A)
Page 76
P10 Backplane Connector Pinout Zone 2 contains two connectors: P20 and P23. They carry the following types of signals: Telecom clock signals (CLKx_) Base interface signals (BASE_) Fabric interface signal (FAB_) SAS update channel ATCA-7540 Installation and Use (6806871A01A)
Page 77
UC_P4_RX_P UC_P4_TX_P UC_P2_RX_N UC_P2_TX_P UC_P2_TX_N UC_P2_RX_P UC_P0_TX_P UC_P0_TX_N UC_P0_RX_N UC_P0_RX_P n.c. Figure 3-8. P20 Backplane Connector Pinout - Rows E to H CLK2A_P CLK2A_N CLK2B_P CLK2B_N UC_P3_TX_P UC_P3_TX_N UC_P3_RX_P UC_P3_RX_N UC_P1_TX_P UC_P1_TX_N UC_P1_RX_P UC_P1_RX_N n.c. ATCA-7540 Installation and Use (6806871A01A)
Page 78
Zone 3 contains three connectors: P30, P31, and P32. They are used to connect an RTM to the blade and carry the following signals: Serial (RS-232_x_yyyy) Serial ATA (SATAx_yyy) USB (USBxy) ATCA-7540 Installation and Use (6806871A01A)
Page 79
Figure 3-12. P30 Backplane Connector Pinout - Rows E to H RTM_PS1_L RTM_POWERGOOD SAS3_TX_P SAS3_RX_P SAS3_TX_N SAS3_RX_M SAS1_TX_P SAS1_RX_P SAS1_TX_N SAS1_RX_N SATA_P3_TX_P SATA_P3_TX_N SATA_P3_RX_P SATA_P3_RX_N PCIE_P10_RX1_N PCIE_P10_RX1_P PCIE_P10_TX1_P PCIE_P10_TX1_N PCIE_P10_RX3_N PCIE_P10_RX3_P PCIE_P10_TX3_P PCIE_P10_TX3_N SPI_CLK SPI_CLK RST_KEY_L RST_OUT_L PS0_L EN_L _I2C_DAT I2C_CLK ATCA-7540 Installation and Use (6806871A01A)
Page 82
The 12 V RTM power pins provided through P30 and P32 can safely power RTMs up to 50 Watts. The ATCA-7540 blade has another 12 V RTM power connector, P333, which is used to provide additional 12 V power to RTMs. With the addition of the P333 connector, the ATCA-7540 can power RTMs up to 100 Watts.
Chapter 4 Functional Description Block Diagram The block diagram shows how the devices work together and the data paths used. Figure 4-1. ATCA-7540 Block Diagram ATCA-7540 Installation and Use (6806871A01A)
The processors have a Direct Media Interface (DMI) link for communication between the CPUs and the PCH. The ATCA-7540 blade has one DMI link between CPU0 and the PCH. It is four-lane link running at PCIe 3.0 speed. The DMI port on CPU1 is not used.
SPI/ESPI interface (used in SPI mode) LPC bus interface SMBus interface Management engine Platform clocking support for CPU and PCIe clocks ® Optional PCH SKU with Intel QuickAssist Technology ATCA-7540 Installation and Use (6806871A01A)
Recovery BIOS Flash (SPI 1) The flash is allocated for storing the binary code of the BIOS. The ATCA-7540 boots from the primary flash SPI 0 under normal circumstances. If booting BIOS from primary flash SPI 0 fails, a hardware mechanism automatically changes the flash device select logic to boot from the recovery flash SPI 1.
Storage Controller The ATCA-7540 uses three SATA ports from the PCH. Two of the SATA ports are routed to the M.2 riser providing support for M.2 SATA modules. The third SATA port is routed to the RTM Zone 3 connector to support SATA on RTMs.
Page 88
SAS2 3 P20 E3-H3 Zone 2 MAX4952 MAX4952 Zone 3 Zone 3 Update Channel Port 4 P20 A2-D2 SAS3 SAS3 Zone 2 MAX4952 MAX4952 Node Slot Node Slot Ctrl Ctrl Front Front Board BackPlane Board ATCA-7540 Installation and Use (6806871A01A)
The heat sink fixture withstands shock and vibration tests. BIOS ATCA-7540 provides a BIOS firmware that is stored in flash memory. It can be updated remotely via Ethernet or locally via operating system. Along with the BIOS and BIOS Setup program, the flash memory contains POST and Plug and Play support.
Functional Description 4.10.1 I²C Bus ATCA-7540 contains the IPMC Master-Only I²C Bus. This bus is connected to FRU and SEL EEPROMs, CPU Processor Information ROMs, temperature sensors, and GPIO devices. Figure 4-3. Master-Only I²C Bus Architecture ADT7461 Fortville and Board...
24C512 4.10.3 System Event Log EEPROM ATCA-7540 contains a 64K Byte System Event Log (SEL) PROM. The EEPROM has an I²C interface and is connected to the on-board Private I²C interface of IPMC building block. The IDROM is assigned to I²C address 0xA2.
Ethernet controller filters packets based on either MAC address, RMCP port number, or IP address and forwards them to the serial redirection over the sideband interface. Client software like openIPMI is required to enable SOL and to communicate with the SOL based serial console. ATCA-7540 Installation and Use (6806871A01A)
4.15 Faceplate Serial Interfaces The ATCA-7540 has two serial interfaces. They are fully compliant to industry standard 16550 asynchronous communication controllers. The two serial line interfaces #1 and #2 are integrated in the FPGA, which distributes them to either faceplate, RTM, or IPMC for SOL. The serial line interfaces support baud rates up to 115200 kbps through a programmable baud rate generator.
The IPMC Debug Console RS-232 interface connection is normally routed to a 3-pin on-board header (P9). The IPMC Debug monitor terminal output can also be routed to the faceplate. The IPMC Debug Console is also available when the ATCA-7540 payload is powered off. Table 4-3.
TPM provides the ability for a computing system to run applications more securely, allows secured remote access, performs electronic transactions, and communication more safely. The ATCA-7540 provides an on-board Infineon SLB9635TT1.2 FW3.16 TPM controller connected to the LPC bus of PCH. This advanced Infineon controller guarantees that the ATCA-7540 is fully compliant to TPM 1.2 specification.
4.19 System Clocks The ATCA-7540 blade provides the system clocks using the PCH operating in a hybrid clock mode. Most of the clocks are provided directly by the PCH. A 9ZXL0651 clock buffer or equivalent is added to provide the 100 MHz PCIe clocks to some of the PCIe devices. Various crystals and crystal oscillators are also used.
Page 97
RDIMM B RDIMM C PCA9617 DDR012 SMB CPU0 RDIMM D RDIMM E RDIMM F DDR345 SMB PCA9617 RDIMM G RDIMM H RDIMM J PCA9617 DDR012 SMB CPU1 RDIMM K RDIMM L RDIMM M DDR345 SMB PCA9617 ATCA-7540 Installation and Use (6806871A01A)
Page 98
LM75 ATCA-7540 IPMC Sensor Outlet LM75 ATCA-7540 Temp 48 V Power Interface PIM4328 ATCA-7540 Sensor Clock buffer IDT ZXL0651 ATCA-7540 Accelerometer MMA8451 ATCA-7540 C Switch PCA9545 ATCA-7540 PCIe Redriver 80PCI810 ATCA-7540 PCH (selected by PCA9545) ATCA-7540 Installation and Use (6806871A01A)
PCIe). In the following figure, the notation is provided in Bx:Dy:Fz format. B represents PCIe bus number (value of type Hexadecimal) D represents PCIe device (value of type Hexadecimal) F represents Function ATCA-7540 Installation and Use (6806871A01A)
Page 100
Functional Description The following figure provides an overview of ATCA-7540 PCIe bus structure. Figure 4-5. PCIe Bus Structure Fabric-IF M.2 NVMe0 M.2 NVMe1 Intel XL710 B3b:D0:F0 B3c:D0:F0 B3d:D0:F0-F1 CPU#0 Intel Xeon PCIe Root PCIe Root PCIe Root Skylake DMI2...
IPMC I²C interface 5.1.1 Register Decoding The FPGA registers can be accessed from the host or the IPMC. For the host access, the low pin count (LPC) bus interface is used. The IPMC uses an I²C interface. ATCA-7540 Installation and Use (6806871A01A)
COM1 or COM2 (only when enabled during Super IO configuration) are decoded by the LPC core. 5.1.1.1.2 LPC Memory Decoding The LPC interface never responds to LPC memory accesses. 5.1.1.1.3 LPC Firmware Decoding The LPC interface never responds to LPC firmware accesses. ATCA-7540 Installation and Use (6806871A01A)
After an LPC Reset (PCH_PLTRST_ is asserted) or “Power On Reset” the Super IO is in the Run Mode with the UARTs disabled. They may be configured using the LPC I/O Address Range (INDEX and DATA) by placing the Super IO into Configuration Mode. ATCA-7540 Installation and Use (6806871A01A)
The desired configuration registers are accessed in two steps: 1. Write the index of the Logical Device Number Configuration Register (i.e., 07) to the INDEX PORT and then write the number of the desired logical device to the DATA PORT. ATCA-7540 Installation and Use (6806871A01A)
Global Configuration Register Summary Index Address Description 0x07 Super IO Logical Device Number 0x20 Super IO Device ID 0x21 Super IO Device Revision 0x28 Super IO LPC Control 0x29 Super IO SERIRQ and Pre-divide Control ATCA-7540 Installation and Use (6806871A01A)
Page 106
LPC: r Table 5-13. Global Super IO SERIRQ and Pre-divide Control Register Index Address: 0x29 Description Default Access SERIRQ Enable: 0: disabled. Serial interrupts disabled. LPC: r/w 1: enabled. Logical devices participate in interrupt generations. ATCA-7540 Installation and Use (6806871A01A)
Page 107
Configuration state. Table 5-14. Logical Device Configuration Register Summary Index Address Description 0x30 Enable 0x60 Base I/O Address MSB 0x61 Base I/O Address LSB 0x70 Primary Interrupt Select 0x74 Reserved 0x75 Reserved 0xF0 Reserved ATCA-7540 Installation and Use (6806871A01A)
Page 108
Register 0x61is 0xF8. The following table contains the Common Decode Ranges: Table 5-18. Logical Device Common Decode Ranges I/O Address Range Description 0x3F8 - 0x3FF COM1 0x2F8 - 0x2FF COM2 0x2E8 - 0x2EF COM3 0x3E8 - 0x3EF COM4 ATCA-7540 Installation and Use (6806871A01A)
Page 109
Receiver Line Error Condition, Transmit Data Request, Receiver Data Available or Receiver Time Out) and setting the OUT2 bit in the MCR. Table 5-20. Logical Device 0x74 Reserved Register Index Address: 0x74 Description Default Access Reserved 0x04 LPC: r ATCA-7540 Installation and Use (6806871A01A)
Transmitter Holding (THR). Write Only. Base + 1 Interrupt Enable Register (IER) Base + 2 Interrupt Identification Register (IIR). Read Only. Base + 2 FIFO Control Register (FCR). Write Only. Base + 3 Line Control Register (LCR) ATCA-7540 Installation and Use (6806871A01A)
(TDRQ) bit in the Line Status Register is set to one. Table 5-25. Transmitter Holding Register (THR) if DLAB=0 LPC I/O Address: Base Description Default Access Transmitter Holding register (THR) Undef. LPC: w ATCA-7540 Installation and Use (6806871A01A)
Page 112
Receiver line status interrupt enable/disable: 1: receiver line status interrupt enabled LPC: r/w 0: receiver line status interrupt disabled Modem status interrupt enable/disable: 1: modem status interrupt enabled LPC: r/w 0: modem status interrupt disabled Reserved LPC: r ATCA-7540 Installation and Use (6806871A01A)
Page 113
10: Receiver data available LPC: r 01: Transmitter holding register empty 00: Modem status Time Out Detected: 0: No time out interrupt is pending LPC: r 1: Character time-out indication (FIFO mode only) Reserved LPC: r ATCA-7540 Installation and Use (6806871A01A)
Page 114
Transmit Transmit Holding Register. 0b0010 FIFO Data Reading the IIR Register (if Request FIFO mode: Transmit FIFO has half the source of the interrupt) or less than half data. or writing to the Transmitter FIFO. ATCA-7540 Installation and Use (6806871A01A)
Page 115
(bit is self-clearing) 0: No effect Receiver/Transmitter ready. Not supported. LPC: w Reserved LPC: w Receiver FIFO interrupt trigger level: 00: 1 byte 01: 4 bytes LPC: w 10: 8 bytes 11: 14 bytes ATCA-7540 Installation and Use (6806871A01A)
Page 116
When parity is disabled and bit 4 is cleared, LPC: r/w odd parity (an odd number of logic ones) is selected: 1: Even parity 0: Odd parity ATCA-7540 Installation and Use (6806871A01A)
Page 117
1: Access to DLL and DLM registers 0: Access to RBR, THR and IER registers 5.1.4.2.7 Modem Control Register (MCR) This 8-bit register controls the interface with the modem or data set (or a peripheral device emulating a modem). ATCA-7540 Installation and Use (6806871A01A)
Page 118
(high) levels: 1: Loop back mode activated 0: Normal operation Autoflow control enable (AFE): 1: Autoflow control enabled (auto-# and auto-CTS# or LPC: r/w auto-CTS# only enabled) 0: Autoflow control disabled Reserved LPC: r ATCA-7540 Installation and Use (6806871A01A)
Page 119
DR is set whenever a complete incoming character has been received and transferred into the RBR or the FIFO. DR is LPC: r cleared by reading all of the data in the RBR or the FIFO: 1: New data received 0: No new data ATCA-7540 Installation and Use (6806871A01A)
Page 120
To accomplish this, it is assumed that the framing error is due to the next start bit. The ACE samples this start bit twice and then accepts the input data: 1: Framing error occurred 0: No framing error ATCA-7540 Installation and Use (6806871A01A)
Page 121
When either the THR or the TSR contains a data character, TEMT is cleared. In the FIFO mode, TEMT is set when the LPC: r transmitter FIFO and shift register are both empty: 1: THR/Transmit FIFO/TSR empty 0: THR/Transmit FIFO/TSR contains data ATCA-7540 Installation and Use (6806871A01A)
Page 122
LPC: r/w When autoflow control is enabled (DCTS is cleared), no interrupt is generated: 1: Change in state of CTS# input since last read 0: No change in state of CTS# input since last read ATCA-7540 Installation and Use (6806871A01A)
Page 123
Complement of the data carrier detect (DCD#) input When the ACE is in the diagnostic test mode (LOOP [MCR4] Ext. LPC: r = 1), this bit is equal to the MCR bit 3 (OUT2#). Not supported. ATCA-7540 Installation and Use (6806871A01A)
The baud rate of the data shifted in/out of the UART is given by: Baud Rate = UART_CLK / (16X Divisor) For example, if the pre-divider is 26, the UART_CLK is 1.8461538MHz. When the divisor is 12, the baud rate is 9600. ATCA-7540 Installation and Use (6806871A01A)
A corresponding read access delivers always zero — used and reserved for future extensions. A reserved register is read only and deliver always zero. A reserved bit is read- only and always reads zero. NOTICE LPC I/O Address = 0x600 + Address Offset ATCA-7540 Installation and Use (6806871A01A)
BIOS IPMC Watchdog Timeout Register (See Table 5-56 0x13 BIOS Push Button Enable Register (See Table 5-57 0x14 r/w1c OS Reset Source Register (See Table 5-58 0x15 r/w1c OS IPMC Watchdog Timeout Register (See ATCA-7540 Installation and Use (6806871A01A)
Page 127
Update Channel Equalization Control Register (See 0x48 5-82 Table 5-83 0x4A RTM USB Control Register (See Table 5-84 0x4B RTM Status Register (See Table 5-85 0x4C r/w1c RTM Interrupt Status Register (See Table 5-86 0x50 LED Control Register (See ATCA-7540 Installation and Use (6806871A01A)
Page 128
IPMC BIOS Communication Register 3 (See Table 5-105 0x7D LPC Scratch Register (See Table 5-106 0x7E IPMC Scratch Register (See Table 5-5 0x7F POST Code Register (See For LPC I/O address 0x80 is used. See Table 5-5 POST Code Register. ATCA-7540 Installation and Use (6806871A01A)
Maps and Registers 5.1.6 Module Identification Register The Module Identification Register identifies the ATCA-7540 blade. Table 5-39. Module Identification Register Address Offset: 0x00 Description Default Access 15:0 ATCA-7540 Blade Module Identification 0x7540 5.1.7 Version Register The version register provides the version of the FPGA bit stream. The initial value starts at 0x01 and will be incremented with each new release.
IPMC: r/w 0: disabled PWR_GOOD: 0 LPC: r 1: enabled. COM1 is forwarded to IMPC SOL over COM2 enable: IPMC: r/w 0: disabled PWR_GOOD: 0 LPC: r 1: enabled. COM2 is forwarded to IMPC Reserved ATCA-7540 Installation and Use (6806871A01A)
5.1.11 IPMC Power Failure Registers There are eight failure registers implemented to indicate the cause of a power failure and report some status information. The content of the failure registers are also displayed via the seven segment LED displays. ATCA-7540 Installation and Use (6806871A01A)
ME is in ME_OFF state. ME_ON ASW power good lost ME_PWR Timeout. No ASW power good after 45 ms ME_WAIT ASW power good lost ME_WAIT_OFF ASW power good lost Other These values will never occur ATCA-7540 Installation and Use (6806871A01A)
Reserved IPMC: r Payload Power Failure. Payload Power state machine sampled a failing Payload Power status: 0: No Payload Power Failure. Normal Payload operation. PWR_GOOD:0 IPMC: r 1: Payload Power failure. Payload Power failure detected. ATCA-7540 Installation and Use (6806871A01A)
Page 134
Timeout (debug disabled) after 280 ms. VTT voltages are not good. VTT_ENABLE Other cause: One or more voltages have failed, which have been already enabled and sampled good. One or more voltages have failed, which have been already enabled WAIT_100MS and sampled good. ATCA-7540 Installation and Use (6806871A01A)
Page 135
Table 5-50. Payload Power Failure Cause Register 2 Address Offset: 0x0C Description Default Access 12 V power good failure (signal PWRGD_VP12): 0: No 12 V power issue. PWR_GOOD:0 IPMC: r 1: 12 V power failure. ATCA-7540 Installation and Use (6806871A01A)
Page 136
1: 1.5 V power failure. The Payload Power Failure Cause Register 3 covers CPU specific voltages. When a CPU is not mounted (detected via CPU0_SKTOCC_ and CPU1_SKTOCC_), the corresponding power failure bits will never be set. ATCA-7540 Installation and Use (6806871A01A)
Page 137
PWR_GOOD:0 IPMC: r 0: No VCCIN CPU0 power issue 1: VCCIN CPU0 power failure VCCIN CPU1 power good failure (signal PWRGD_PVCCIN_CPU1): PWR_GOOD:0 IPMC: r 0: No VCCIN CPU1 power issue 1: VCCIN CPU1 power failure ATCA-7540 Installation and Use (6806871A01A)
The same situation will happen if two reset sources go active at the same time. NOTICE The OS should never write to this register. ATCA-7540 Installation and Use (6806871A01A)
CPU. A “1” in the register bit indicates that the associated reset is enabled. A “0” indicates that the associated reset source is masked. Table 5-54. Reset Mask Register Address Offset: 0x11 Description Default Access Reserved ATCA-7540 Installation and Use (6806871A01A)
1: Reset occurred IPMC: r XDPx reset request (Any one of XDPx signal caused reset LPC: r/w1c PWR_GOOD:0 1: Reset occurred IPMC: r PB_RST_ face plate push button reset LPC: r/w1c PWR_GOOD:0 1: Reset occurred IPMC: r ATCA-7540 Installation and Use (6806871A01A)
The same situation will happen if two reset sources go active at the same time. Table 5-60. IPMC Reset Source Register Address Offset: 0x17 Description Default Access PWR_GOOD Payload Power-on reset PWR_GOOD:1 IPMC: r/w1c 1: Reset occurred ATCA-7540 Installation and Use (6806871A01A)
IPMC interrupt will always be active and produce infinite IPMC interrupts. Table 5-61. IPMC Interrupt Status Register Address Offset: 0x19 Description Default Access IPMC interrupt status PWR_GOOD:0 IPMC: r/w1c 1: Platform Reset occurred (PCH_PLT_RST_) Reserved ATCA-7540 Installation and Use (6806871A01A)
X μs: IPMC: w 0: No action 1: Generate PSTATE low pulse PCH_RCIN_ pulse generation. Minimum low pulse width is X μs: IPMC: w 0: No action 1: Generate RCIN low pulse Reserved ATCA-7540 Installation and Use (6806871A01A)
0: No action IPMC: w 1: Generate PWRBTN long low pulse. Forced transition to S5 Reserved 5.1.14.1 Non-maskable Interrupt (NMI) Control Status Registers IPMC can initiate a NMI. Host can identify NMI comes from IPMC. ATCA-7540 Installation and Use (6806871A01A)
When the IPMC has generated a NMI pulse, the host can identify this event reading the register below. The host needs to clear this flag. Table 5-67. NMI Status Register Address Offset: 0x20 Signal/Group Description Default Access PCH_NMI NMI pulse triggered by IPMC PWR_GOOD: 0 LPC: r/1wc Reserved ATCA-7540 Installation and Use (6806871A01A)
Address Offset: 0x22 Description Default Access Telecom CLK_MONITOR_FINISHED interrupt: 3: 0 LPC: r One or more Telecom Clock measurements have finished. Telecom CLK_MONITOR_OUT_OF_RANGE interrupt: LPC: r One or more Telecom Clocks are out of range ATCA-7540 Installation and Use (6806871A01A)
0: RTM_SPI_MISO is high. No RTM interrupt. 1: RTM_SPI_MISO is low. One or more RTM RTM_SPI_MISO Ext. LPC: r interrupt sources are active. When RTM SPI Master face is active the current level is latched. Reserved ATCA-7540 Installation and Use (6806871A01A)
Table 5-72. Address Map of Interrupt Mask and Map Registers Address Offset of Interrupt Source(s) Description Interrupt Mask IPMC to Host Interrupt IPMC signals interrupt 0x25 Telecom Interrupt Telecom interrupt 0x26 RTM_SPI_MISO RTM interrupt sources 0x27 ATCA-7540 Installation and Use (6806871A01A)
Page 152
0x12: Frame number 18. INTA_ 0x13: Frame number 19. INTB_ 0x14: Frame number 20. INTC_ 0x15: Frame number 21. INTD_ 0x16 - 0x1F: Frame number 22-31. IRQ Frame Number not valid. Value is ignored. Reserved ATCA-7540 Installation and Use (6806871A01A)
PCI Ext. Express slot. IPMC: Input signal per slot which indicates BUTTON# Input that the user wishes to hot remove or hot add a PCI Express card/module. LPC: r ATCA-7540 Installation and Use (6806871A01A)
Page 154
A retention latch is used on the platform to mechanically hold EMIL Output Ext. the card in place. Refer to PCI Express Server/Workstation Module Electromechanical Spec Rev 1.0 for details of the timing requirements of this pin output. ATCA-7540 Installation and Use (6806871A01A)
In this case the platform reset will be transformed by the FPGA logic to payload power cycle including the ME. This is done to guarantee no SPI access to boot flash when switching the other device. ATCA-7540 Installation and Use (6806871A01A)
Page 156
1: Selects Recover Boot SPI Flash. TARGET_BOOT_SELECT. Target Boot Flash Selection. 0: Selects Default Boot SPI Flash LPC: r PWR_GOOD: 0 1: Selects Recovery Boot SPI Flash IPMC: r/w Note: New Flash selection valid with next platform reset ATCA-7540 Installation and Use (6806871A01A)
SPI master protocol. The signal, RTM_SPI_MISO is also used to signal an RTM interrupt to the baseboard. See Flash Status and Selection Registers on page 155. NOTICE At the moment there is no RTM with an SPI interface defined. ATCA-7540 Installation and Use (6806871A01A)
Page 158
A write access to the RTM SPI Address/Command Register with the Command Bit 1 (Read) starts a SPI read transaction. This contains the data read from the SPI device. Table 5-81. RTM SPI Read Register Address Offset: 0x43 Description Default Access RTM SPI read data LPC: r ATCA-7540 Installation and Use (6806871A01A)
1: UC3_EQ_TX is tri-state Control output Signal UC4_EQ_RX: LPC: r/w 0: UC4_EQ_RX is driven low IPMC: r 1: UC4_EQ_RX is tri-state Control output Signal UC4_EQ_TX: LPC: r/w 0: UC4_EQ_TX is driven low IPMC: r 1: UC4_EQ_TX is tri-state ATCA-7540 Installation and Use (6806871A01A)
Spare Signal Status Register Address Offset: 0x52 Description Default Access Signal level of SW100_2 (Connected to SW100.2) Ext. Signal level of SW1.4 (Connected to SW1.4) Ext. Signal level of spare connections SPARE[2:1] Ext. Reserved Ext. ATCA-7540 Installation and Use (6806871A01A)
Bit 0 = Non critical Error CPU_ERR_[1] Ext. Bit 1 = Non-fatal error (operating system or firmware action required to contain and recover) CPU_ERR_[2] Ext. Bit 2 = Fatal error (system reset likely required to recover) Reserved ATCA-7540 Installation and Use (6806871A01A)
Telecom Clock Monitor Status Register Address: 0x61 Description Default Access Result available for supervised Telecom Clock 0 to 3. Corresponding bit is set when measurement has LPC: r/w1c finished. Clearing bit triggers new measurement. Reserved ATCA-7540 Installation and Use (6806871A01A)
Page 164
Clearing bit triggers new sequence of measurements. Reserved Table 5-94. Telecom Clock Monitor Select Register Address: 0x63 Description Default Access Table 5-90 Select supervised Telecom Clocks. See Supervised Telecom Clocks Reference List: LPC: r/w 0-3: Select corresponding clock Reserved ATCA-7540 Installation and Use (6806871A01A)
Page 165
6: Period Counter incremented with each 64th master clock 7: Period Counter incremented with each 128th master clock 8: Period Counter incremented with each 256th master clock 9 and all others: Period Counter incremented with each 512th master clock Reserved ATCA-7540 Installation and Use (6806871A01A)
Page 166
Table 5-98. Telecom Clock Monitor Upper Limit Register Address: 0x69 -0x6A Description Default Access Upper Limit for supervised Telecom Clock: 15:0 0xFFFF LPC: r/w Table 5-93 Used by Telecom Clock Monitor Out of Range Register ATCA-7540 Installation and Use (6806871A01A)
5.1.28 IPMC BIOS Communication Registers The following tables contain information about the IPMC BIOS Communication Registers. Table 5-102. IPMC BIOS Communication Register 1 Address Offset: 0x7A Description Default Access LPC: r/w IPMC BIOS Communication bits PWR_GOOD:0 IPMC: r/w ATCA-7540 Installation and Use (6806871A01A)
Page 169
The BIOS setup program is required to configure the blade hardware. This configuration is necessary for operating the blade and connected peripherals. The configuration data are stored in the same flash device from which the blade boots. ATCA-7540 Installation and Use (6806871A01A)
A NULL-Modem cable RJ45-DSUB-ATCA is available as an accessory kit for the blade. It converts the RJ-45 connector to a standard DSUB connector which can be connected to a remote terminal. By default, the following communication parameters are used: Baud rate: 115200 Flow control: None ATCA-7540 Installation and Use (6806871A01A)
3. Connect the NULL-modem cable to COM port of the blade. 4. Start up the blade. Changing Configuration Settings When the system is switched on or rebooted, the presence and functionality of the system components is tested by Power-On Self-Test (POST). ATCA-7540 Installation and Use (6806871A01A)
Page 172
In order to navigate in setup, use the arrow keys on the keyboard to highlight items on the menu. All other navigation possibilities are shown at the bottom of the menu. Additionally, an item-specific help is displayed on the right side of the window. ATCA-7540 Installation and Use (6806871A01A)
NOTE: Boot options in the Boot Menu change depending on what is selected. Enabling or Disabling devices requires the OPROM to be loaded to become an active boot device. An immediate reboot is recommended to make the boot entry visible. ATCA-7540 Installation and Use (6806871A01A)
Refer to section Boot on page 206. By changing the bootorder parameter of IPMI Boot parameter. For more information, refer to sections IPMI Boot Parameter on page System Boot Options Parameter #100 on page 235. ATCA-7540 Installation and Use (6806871A01A)
Page 175
By Boot Menu 1. Press <F4> key to enter the Boot menu. 2. Enter Boot Manager. 3. Override existing boot sequence by selecting another boot device from the boot list. ATCA-7540 Installation and Use (6806871A01A)
Page 176
If a selected legacy boot device does not load the operating system, BIOS will reset the blade. If an EFI boot device does not load the operating system, it will return to the Boot Manager. ATCA-7540 Installation and Use (6806871A01A)
2. Select Device Manager from the Boot Menu. 3. Select the iSCSI Configuration Menu. 4. Enter an iSCSI Initiator Name. 5. Add one or more iSCSI Attempts. 6. Save the iSCSI configuration with F10 key. Figure 6-4. iSCSI Configuration ATCA-7540 Installation and Use (6806871A01A)
Page 178
The worldwide unique name of the iSCSI Name Initiator. Only IQN format is accepted. Add Attempt Add an iSCSI Attempt Delete Attempts Delete an iSCSI Attempt Change Attempt Change the order of iSCSI Attempts Order Figure 6-5. Attempt Configuration 1 ATCA-7540 Installation and Use (6806871A01A)
Page 179
The minimum value is 0 and the maximum 0 .. 40 is 40. 0 means no retry. It will stall 1 second The count range is and reconnect. 0 to 16. If set to 0, there are no retries. ATCA-7540 Installation and Use (6806871A01A)
Page 180
Use to set CHAP type to either One Way or CHAP Type One Way/Mutual Mutual CHAP Name Set the CHAP name Use to set the CHAP secret password. The CHAP Secret secret length range is 12 to 16 bytes. ATCA-7540 Installation and Use (6806871A01A)
Only the BIOS parameters listed in the boot parameter table provided with the blade are saved, others will be set to default during a BIOS upgrade. ATCA-7540 Installation and Use (6806871A01A)
Page 182
3. BIOS writes the parameter to the BIOS Parameter in the Flash. 4. BIOS writes the parameter to the IPMI Boot Parameter USER area. Load Defaults 1. User enters BIOS setup and selects Load Defaults. 2. BIOS reads Default Parameter from Flash into the Setup. ATCA-7540 Installation and Use (6806871A01A)
This section provides information about the various configurations in the BIOS setup menu. NOTE: The following command can be used to read the IPMI boot parameters default area: #ipmibpar 6.7.1 Main The figure below shows the Main menu options. Figure 6-8. Main Menu Options ATCA-7540 Installation and Use (6806871A01A)
Set the Time. Use Enter to switch System Time [15:48:21] between Time elements. Set the Date. Use Enter to switch System Date [Thu 11/11/2014] between Date elements. 6.7.2 Advanced This figure below shows the Advanced menu options. Figure 6-9. Advanced Menu ATCA-7540 Installation and Use (6806871A01A)
Basic Input/Output System 6.7.2.1 Platform Information This option shows important Platform Information. Figure 6-10. Platform Information ATCA-7540 Installation and Use (6806871A01A)
Width connector (RTM) x8x4x4 x8x8 Auto Gen 1 (2.5 GT/s) Selects CPU0 PCIe Port 3A Speed for Zone 3 CPU0 PCIe Port 3A rtm_cpu0_3a connector (RTM) Gen 2 (5 GT/s) Gen 3 (8 GT/s) ATCA-7540 Installation and Use (6806871A01A)
Page 187
Gen 2 (5 GT/s) Gen 3 (8 GT/s) Auto Gen 1 (2.5 GT/s) Selects CPU1 PCIe Port 3C Speed for Zone 3 CPU1 PCIe Port 3C rtm_cpu1_3c connector (RTM) Gen 2 (5 GT/s) Gen 3 (8 GT/s) ATCA-7540 Installation and Use (6806871A01A)
Table 6-5. Advanced >> Peripheral Configuration IPMI Boot Item Values Description Parameter PCIe SR-IOV Enabled, Enables/Disables PCI Express pci_sriov Support Disabled Single Root I/O Virtualization Enabled, Enables/Disables Alternative Routing ID PCIe ARI pci_ari Disabled Interpretation (ARI) ATCA-7540 Installation and Use (6806871A01A)
Page 189
Intel VT for Enabled, Technology for Directed I/O (VT-d) by Directed I/O (VT-d) Disabled reporting the I/O device assignment to VMM through DMAR ACPI Tables Interrupt Enabled, Enables/Disables VT_D Interrupt vtd_ir Remapping Disabled Remapping Support ATCA-7540 Installation and Use (6806871A01A)
Basic Input/Output System 6.7.2.4 NVM Express Information Figure 6-13. NVM Express Information 6.7.2.5 USB Configuration Figure 6-14. USB Configuration ATCA-7540 Installation and Use (6806871A01A)
Parameter Enables/Disables USB keyboard/mouse/storage support under Enabled, UEFI and DOS environment. USB BIOS Support Disabled, UEFI Only If UEFI Only is set, it supports only in UEFI environment. 6.7.2.6 Socket Configuration Figure 6-15. Socket Configuration ATCA-7540 Installation and Use (6806871A01A)
When Disabled, forces the XD feature flag Execute Disable Bit cpu_ed Disabled to always return 0 Enable Intel TXT Enabled, Enables/Disables the Intel Trusted cpu_txt Disabled Execution Technology (TXT) Hardware Enabled, cpu_hp Enables/Disables the hardware prefetcher Prefetcher Disabled ATCA-7540 Installation and Use (6806871A01A)
Page 193
Enables/Disables the Data-Cache-Unit Prefetcher Disabled (DCU) prefetcher Enabled, DCU IP Prefetcher Enables/Disables the DCU IP prefetcher Disabled Enabled, Enables/Disables the Last-Level-Cache (LLC) LLC Prefetch Disabled prefetcher Enabled, Enables/Disables the extended APIC Extended APIC cpu_x2apic Disabled support ATCA-7540 Installation and Use (6806871A01A)
Page 194
Values Description Parameter Core Disable Bitmap Hex Value Core Disable Cpu0_dism/Cpu 0 to 0xFFFFFFFF 0: Enable all Cores Bitmap 1_dism Valid Range: 0 to 0xFFFFFFFF Enabled, IOT Cfg Configures the bit to enable IOT/OCLA Disabled ATCA-7540 Installation and Use (6806871A01A)
Figure 6-18. Common RefCode Configuration The following table contains the description for the Common RefCode Configuration option. Table 6-10. Common RefCode Configuration IPMI Boot Item Values Description Parameter Enabled, Enables/Disables non uniform memory Numa mem_numa Disabled access (NUMA) ATCA-7540 Installation and Use (6806871A01A)
Maximum Memory Frequency Selections in Memory Frequency Auto, 800-2800 mem_speed Halt on mem Enabled, Enables/Disables Halt on Memory Training mem_halt Training Error Disabled Error Hardware Memory Disabled, Short, Mem_test Select Hardware Memory test Test Long ATCA-7540 Installation and Use (6806871A01A)
The following table contains descriptions for the CPU P-State Control options. Table 6-13. CPU P-State Control IPMI Boot Item Values Description Parameter Enabled, Enables/Disables Enhanced Intel SpeedStep SpeedStep cpu_ss Disabled Technology (P-States) Enabled, Turbo Mode cpu_tm Enables/Disables processor Turbo Mode Disabled ATCA-7540 Installation and Use (6806871A01A)
Page 199
Disabled Enhanced Halt Enabled, cpu_c1e Enables the Enhanced C1E state of the CPU State Disabled Report CPU C3/C6 state to OS as ACPI C2 or OS ACPI Cx ACPI C2, ACPI C3 cpu_cxacpi ACPI C3 ATCA-7540 Installation and Use (6806871A01A)
Page 200
C6 (non Specifies the lowest C-state for the Retention) state, package. Higher C-states will save more Package C-State cpu_cslimit C6 (Retention) power, lower C-states will have lower wake state, No Limit, up latencies. Auto ATCA-7540 Installation and Use (6806871A01A)
1 Bit, 2 Bits con_sb Sets Console Redirection stop bits Flow Control None, XON/XOFF con_fc Sets Console Redirection flow control type C.R. After Continue Console Redirection after POST, Yes, No con_ap Post when OS is loaded ATCA-7540 Installation and Use (6806871A01A)
Page 202
Disabled, MEMORY_CE, MEMORY_UE_NON_FATAL, APEI Error MEMORY_UE_FATAL, Inject an error to test APEI feature Injection PCIE_CE, PCIE_UE_FATAL, PCIE_UE_NON_FATAL, APEI UEFI UEFI 2.2, UEFI 2.3.1 apei_uefiver UEFI revision of APEI error format Revision ATCA-7540 Installation and Use (6806871A01A)
Page 203
The following table contains descriptions for the IPMI Configuration options. Table 6-19. Advanced >> IPMI Configuration IPMI Boot Item Values Description Parameter Enables/Disables usage of Host Interface Enabled, IPMI KCS Interrupt ipmi_irq (KCS) interrupt. KCS interrupt is hardwired Disabled to IRQ 6. ATCA-7540 Installation and Use (6806871A01A)
Page 204
Enables/Disables Fail Safe Policy Enabled, Enabled: IPMC will switch the BIOS boot IPMI Fail Safe Disabled, failsafe bank if the FRB2 watchdog expires No Change No Change: Fail Safe Policy will not be changed by BIOS ATCA-7540 Installation and Use (6806871A01A)
Enables/Disables TPM Function. This option TPM Operation Deactivate, tpm_operation will automatically return to No-Operation. Enable and Activate Install or Change the password. The length Set Supervisor of password must be greater than one Password character. ATCA-7540 Installation and Use (6806871A01A)
EFI First, Legacy Determine whether EFI devices or Legacy Boot Priority boot_priority First devices are booted first Disabled, Disabled: Support Network Stack UEFI:IPv4, PXE Boot capability UEFI:IPv6, boot_netprot UEFI PXE: IPv4/IPv6 UEFI:IPv4/IPv6, Legacy: Legacy PXEOPROM only Legacy ATCA-7540 Installation and Use (6806871A01A)
Page 207
Select Enabled when RTM SAS Boot is required. Enabled, Disables/Enables booting from USB port USB Boot boot_usb Disabled devices Info Screen The number of seconds that the firmware 0 .. 10 info_tmout Timeout will wait for <F2> key ATCA-7540 Installation and Use (6806871A01A)
Page 208
Use the F5 key to move the devices up or down. With the space key, a boot device can be enabled or disabled. If the boot entry shows [ ], this boot entry is disabled. If it shows [X] then the boot devices is enabled. ATCA-7540 Installation and Use (6806871A01A)
Page 209
Use the F5 and F6 keys to move the devices up or down. With the space key, a boot device can be enabled or disabled. If the boot entry shows [ ], this boot entry is disabled. If it shows [X] then the boot devices is enabled. ATCA-7540 Installation and Use (6806871A01A)
Saves the changes made and then exits the Changes system Save Change Saves the changes without exiting the Without Exit system Exit Discarding Exits the system without saving the changes Changes Load Defaults Loads default Settings Discard Changes Discards the changes ATCA-7540 Installation and Use (6806871A01A)
3. Install and power up the blade. 4. Wait until the blade has completely booted and is up and running. 5. Remove the blade from the system again. 6. Set switch SW3-4 to OFF. BIOS default settings are restored. ATCA-7540 Installation and Use (6806871A01A)
Basic Input/Output System 6.10 IPMI Support The ATCA-7540 BIOS provides the following IPMI support: Sets initial timestamp for IPMI SEL events Sends Boot Initiated event Sends Memory DIMM detect and error events Sends system firmware progress events ...
- Uncorrectable ECC Memory Error PCI PERR Sensor: Critical Interrupt, Offset 04h PCI PERR PCI SERR Sensor: Critical Interrupt, Offset 05h PCI SERR 6.12.2 IPMI Error Logging BIOS generates status events like Firmware Progress events and error events. ATCA-7540 Installation and Use (6806871A01A)
Page 214
71h Base Network not detected 72h Fabric Network not detected 73h Accelerator Device not detected 74h RTM SAS Controller not detected 75h RTM Network not detected 76h RTM PCI Bridge not detected 80h Front Panel Network reduced PCI performance ATCA-7540 Installation and Use (6806871A01A)
Page 215
94h Reboot after a OEM Watchdog Timeout A0h RTM detected (unknown) A1h RTM-ATCA-747X-10G-SP detected A2h RTM-ATCA-747X-10G-D detected A3h RTM-ATCA-736X-10G-SP detected A4h RTM-ATCA-736X-10G-SAS detected A6h RTM-ATCA-7360 detected A7h RTM-ATCA-736X-DD detected A8h RTM-ATCA-736X-10G-SP detected AAh RTM-ATCA-736X-10G-SAS detected ACh SB-RTM451 detected ADh RTM-URA50 detected ATCA-7540 Installation and Use (6806871A01A)
BIOS POST Codes POST Code Description Patching CPU microcode Setup Cache as RAM PCIE MMIO Base Address initial CPU Generic MSR initial Setup CPU speed Cache as RAM test Tune CPU frequency ratio to maximum level ATCA-7540 Installation and Use (6806871A01A)
Page 218
Simple Memory test TXT function early initial Start to use Memory Set cache for physical memory Recovery device initial Found Recovery image Recovery image not found Load Recovery Image complete Start Flash BIOS with Recovery image ATCA-7540 Installation and Use (6806871A01A)
Page 219
Variable Service Initial Fail to initial Variable Service MTC Initial CPU Middle Initial Multi-processor Middle Initial SMBUS Driver Initial 8259 Initial RTC Initial SATA Controller early initial Setup SMM Control service, DXE_SMMControler_INIT Setup Legacy Interruput service, DXE_LegacyInterrupt ATCA-7540 Installation and Use (6806871A01A)
Page 220
PCI enumeration complete Keyboard Controller, Keyboard and Moust initial Video device initial Error report device initial USB host controller initial USB BUS driver initial USB device driver initial Console device initial fail Display logo or system information ATCA-7540 Installation and Use (6806871A01A)
Page 221
Send END of POST Message to ME via HECI Last Chipset initial before boot to Legacy OS Ready to Boot Legacy OS Fast recovery start flash SDHC device initial Ata Legacy device initial SD Legacy device initial ATCA-7540 Installation and Use (6806871A01A)
Page 222
Restore system configuration stage 2 Relocate SMM BASE during S3 resume Multi-processor initial during S3 resume Start to restore system configuration in SMM Restore system configuration in SMM complete Back to OS Prepare to enter S1 ATCA-7540 Installation and Use (6806871A01A)
Page 223
UPI Initialization: Phy layer settings UPI Initialization: Link layer settings UPI Initialization: Coherency Settings UPI Initialization: QPI is done Memory Initialization: DIMM Detect Memory Initialization: Clock Memory Initialization: Read SPD data Memory Initialization: Early Init ATCA-7540 Installation and Use (6806871A01A)
IPMC Intel NIC Serial You can configure the SOL parameters using ipmitool. The ATCA-7540 supports two SOL channels, which are available at their base interfaces. However, only one SOL session is allowed at a time. Table 7-1. SOL Channels SOL/LAN Channel #...
The open source ipmitool is the dominant tool used to interact with the IPMC.The ipmitool package is installed in the root file-system provided in the ATCA-7540 Linux BBS release. The RPM is also available in standard CentOS repositories. If you want to download and install the open source version, you can download it from https://github.com/ipmitool/ipmitool.
Page 227
You can change the IPMC LAN parameters using the ipmitool "lan set" commands. For example, to change the IP address of the IPMC LAN 1 interface to 192.168.21.100/24, you would use the following commands: root@ATCA-7540: ipmitool lan set 1 ipaddr 192.168.21.100 root@ATCA-7540: ipmitool lan set 1 netmask 255.255.255.0 ATCA-7540 Installation and Use (6806871A01A)
IPMC LAN interface of the ATCA-7540 that you want to use for the SOL session. For example, if you want to use the IPMC LAN 1 interface on the ATCA-7540, and the IPMC LAN 1 interface has the IP address 172.16.0.221/16, then you would have to use the "base1"...
0x2E Get BMC Global Enables 0x06/0x07 0x2F Clear Message Flags 0x06/0x07 0x30 Get Message Flags 0x06/0x07 0x31 Get Message 0x06/0x07 0x33 Send Message 0x06/0x07 0x34 Set Channel Access 0x06/0x07 0x40 Get Channel Access 0x06/0x07 0x41 ATCA-7540 Installation and Use (6806871A01A)
Get Watchdog Timer 0x06/0x07 0x25 8.1.4 SEL Device Commands The following table contains the supported SEL Device Commands. Table 8-4. Supported SEL Device Commands Command NetFn (Request/Response) Get SEL Info 0x0A/0x0B 0x40 Reserve SEL 0x0A/0x0B 0x42 ATCA-7540 Installation and Use (6806871A01A)
Comments (Request/Response) Get Device SDR Info 0x04/0x05 0x20 Get Device SDR 0x04/0x05 0x21 Reserve Device SDR Repository 0x04/0x05 0x22 Get Sensor Reading Factors 0x04/0x05 0x23 Set Sensor Hysteresis 0x04/0x05 0x24 Get Sensor Hysteresis 0x04/0x05 0x25 ATCA-7540 Installation and Use (6806871A01A)
0x02 8.1.7 Chassis Device Commands The following table contains the supported Chassis Device Commands. Table 8-7. Supported Chassis Device Commands Command NetFn (Request/Response) Set System Boot Options 0x00/0x01 0x08 Get System Boot Options 0x00/0x01 0x09 ATCA-7540 Installation and Use (6806871A01A)
Selection between default and backup boot flash as device to boot from Selection between default and backup EEPROM as device where the on- board FPGA loads its configuration stream from Timeout for graceful shutdown BIOS boot parameters ATCA-7540 Installation and Use (6806871A01A)
Page 234
IPMC shuts down the payload when the timer expires. Table 8-10. System Boot Options Parameter #98 Description 15:8 Timeout for GRACEFUL_SHUTDOWN, LSB (given in 100 msec) Timeout for GRACEFUL_SHUTDOWN, MSB (given in 100 msec) ATCA-7540 Installation and Use (6806871A01A)
Page 235
The details are given in the following sections. On the ATCA-7540 blade with particular firmware types, changing a boot parameter in the firmware setup menu changes the boot parameter in the user area as well, if the same parameter is defined both in the user area and the setup menu.
Page 236
16 byte checksum over the boot parameters data section. (LSB first) n + 1 .. n + 2 For backward compatibility reasons, the checksums 0x0000 and 0xFFFF are accepted as valid. They indicate that no checksum has been calculated and stored. ATCA-7540 Installation and Use (6806871A01A)
Page 237
Response Data 0x00: Write successful 0x80: Boot parameter storage not supported by the IPMC 0x81: Storage area is locked by another software entity 0x82: Illegal write-access 0xC9: Block selector is outside of the allowed range. ATCA-7540 Installation and Use (6806871A01A)
Page 238
This is supported by HPI, for details refer to the System Management Interface Based on HPI-B User’s Guide related to your system environment. ATCA-7540 Installation and Use (6806871A01A)
Page 239
(RTM). gen2 gen3 auto gen1 Selects CPU0 PCIe Port 3D Speed for Zone 3 rtm_cpu0_3d connector (RTM). gen2 gen3 X4x4x4x4 x4x4x8 Selects CPU1 PCIe Bifurcation for Zone 3 rtm_cpu1_bif x8x4x4 connector (RTM). x8x8 ATCA-7540 Installation and Use (6806871A01A)
Page 240
PCI Express Single Root I/O Virtualization pci_ari Alternative Routing ID nterpretation (ARI) pci_64bit 64-bit BAR support for PCI devices clock_ssc Spread Spectrum Clock Intel Virtualization Technology for Directed I/O (VT-d) vtd_ir VT-d Interrupt Remapping Support sata SATA controller Operation Mode ATCA-7540 Installation and Use (6806871A01A)
Page 241
Valid Range: 0 to 3FFE. 3FFF=Disabling 0 to FFFF all cores: Invalid cpu_ht CPU Hyper Threading cpu_ed CPU Execute Disable cpu_txt Intel Trusted Execution Technology (TXT). cpu_vt CPU Virtualization (VT-x) cpu_hp CPU Hardware Prefetcher cpu_acp CPU Adjacent Cache Prefetcher ATCA-7540 Installation and Use (6806871A01A)
Page 242
CPU C6 report cpu_c1e CPU Enhanced Halt State (C1E) cpu_cxacpi Report ACPI Cx State auto 1333 mem_speed Memory Frequency (MHz) 1600 1867 2133 mem_halt Halt on Training Error Disable Non Uniform Memory Access mem_numa (NUMA). ATCA-7540 Installation and Use (6806871A01A)
Page 243
Serial console baud rate 38400 57600 115200 con_db Serial console data bits con_par Serial console parity bits con_sb Serial console stop bits con_fc Serial console flow control hard soft con_ap Serial console redirection after POST ATCA-7540 Installation and Use (6806871A01A)
Page 244
IPMI Fail Safe nochange no_operation TPM Function. This option will automatically tpm_operation disable_deactivate return to No-Operation. enable_activate dual boot_type Boot Type legacy uefi uefi Determine whether EFI devices or Legacy boot_priority devices are booted first legacy ATCA-7540 Installation and Use (6806871A01A)
Page 245
Boot Order Devices Boot Device Description sata0 On-board SATA device (P1) sata1 On-board SATA device (P2) sata2 On-board SATA device (P3) sata3 SATA device RTM nvme0 On-board NVMe device (J1/J2) nvme1 On-board NVMe device (J1/J2) ATCA-7540 Installation and Use (6806871A01A)
Page 246
USB CDROM/DVDROM usbcdrom1 USB CDROM/DVDROM connected to USB1 usbcdrom2 USB CDROM/DVDROM connected to USB2 usbcdrom3 USB CDROM/DVDROM connected to USB RTM usbhdd USB HDD usbhdd1 USB HDD connected to USB1 usbhdd2 USB HDD connected to USB2 ATCA-7540 Installation and Use (6806871A01A)
Page 247
EFI Front Panel Network 2 (IPv6) efibasenet1v6 EFI Base Network 1 (IPv6) efibasenet2v6 EFI Base Network 2 (IPv6) efifabricnet11v6 EFI Fabric Network 1_1 (IPv6) efiffabricnet12v6 EFI Fabric Network 1_2 (IPv6) efifabricnet21v6 EFI Fabric Network 2_1 (IPv6) ATCA-7540 Installation and Use (6806871A01A)
Page 248
EFI Boot from USB device connected to USB2 eifusb3 EFI Boot from USB device connected to USB RTM windows Windows Boot Manager redhat RedHat Linux suse SuSE Linux ubuntu Ubuntu Linux fedora Fedora Linux ATCA-7540 Installation and Use (6806871A01A)
0x06 Set FRU LED State 0x2C/0x2D 0x07 Get FRU LED State 0x2C/0x2D 0x08 Set IPMB State 0x2C/0x2D 0x09 Set FRU Activation Policy 0x2C/0x2D 0x0A Get FRU Activation Policy 0x2C/0x2D 0x0B Set FRU Activation 0x2C/0x2D 0x0C ATCA-7540 Installation and Use (6806871A01A)
Page 250
0x31 Upload firmware block 0x2C/0x2D 0x32 Finish firmware upload 0x2C/0x2D 0x33 Get upgrade status 0x2C/0x2D 0x34 Activate firmware 0x2C/0x2D 0x35 Query self-test results 0x2C/0x2D 0x36 Query rollback status 0x2C/0x2D 0x37 Initiate manual rollback 0x2C/0x2D 0x38 ATCA-7540 Installation and Use (6806871A01A)
0x15 on page Get Serial Output Command Get Serial Output 0x2E/0x2F 0x16 on page 8.3.1.1 Set Serial Output Command The Set Serial Output command selects the serial port output source for a serial port connector. ATCA-7540 Installation and Use (6806871A01A)
Response Data of Set Serial Output Command Byte Data Field Completion code LSB of Artesyn Embedded Technologies IANA Enterprise number. Second byte of Artesyn Embedded Technologies IANA Enterprise number. MSB of Artesyn Embedded Technologies IANA Enterprise number. ATCA-7540 Installation and Use (6806871A01A)
0: Faceplate connector 1: Backplane connector All other values are reserved. Note: Only the faceplate connector is supported. No connector on the RTM available. Serial connector instance number. A sequential number that starts from 0. ATCA-7540 Installation and Use (6806871A01A)
The following table contains information about configuring the IPMI features. Table 8-23. Feature Configuration Command NetFn Command CMD Defined In (Request/Response) Set Feature Configuration on page Set Feature Configuration 0x2E/0x2F Get Feature Configuration on page Get Feature Configuration 0x2E/0x2F ATCA-7540 Installation and Use (6806871A01A)
LSB of Artesyn IANA Enterprise Number. A value of CDh shall be used. 2nd byte of Artesyn IANA Enterprise Number. A value of 65h shall be used. MSB of Artesyn IANA Enterprise Number. A value of 00h shall be used. ATCA-7540 Installation and Use (6806871A01A)
Supported IPMI Commands The following table provides the feature set supported with ATCA-7540. Table 8-25. Feature Selector Assignments Feature Selector Description (3) 03h Handle Debounce Fail Safe Logic (224) E0h FAILSAFE Function Enable/Disable. For details, see on page Fail Protect Logic FAIL PROTECT Function Enable/Disable.
Page 257
Bit [7-0]: Feature Selector = E0h, E1h 00h = disabled 01h = enabled 02h - 0ffh = reserved Bit [7-0]: Feature Selector = 03h 00h-FFh: Debounce timer timeout value in 100 ms Persistency / Duration ATCA-7540 Installation and Use (6806871A01A)
Graceful Reset 0x2E/0x2F 0x11 Table 8-45 on page 272 Get Payload Shutdown Time-Out 0x2E/0x2F 0x15 Table 8-46 on page 272 Set Payload Shutdown Time-Out 0x2E/0x2F 0x16 Table 8-47 on page 273 Get Module State 0x2E/0x2F 0x27 ATCA-7540 Installation and Use (6806871A01A)
Get Status Command Description Type Byte Data Field Request Data PPS IANA Private Enterprise ID 0x00400A = 16394 (Pigeon Point Systems) LSB Byte first: byte 1 = 0A, byte 2 = 40, byte 3 = 00 ATCA-7540 Installation and Use (6806871A01A)
Page 260
0: Normal Table 8-28 1: Standalone, for a description refer to Table 8-28 2: Manual Standalone, for a description refer to Bit [0] Control If set to 0, the IPMC control over the payload is disabled. ATCA-7540 Installation and Use (6806871A01A)
Page 261
Bits [0:3] Clock Bus 3 Events These bits indicate pending Clock Bus 3 requests arrived from the shelf manager 0: Clock Bus 3 Query 1: Clock Bus 3 Release 2: Clock Bus 3 Force 3: Clock Bus 3 Free ATCA-7540 Installation and Use (6806871A01A)
Bit [1] Low-level Error Logging Enable If set to "1", the IPMC outputs low-level error/diagnostic messages onto the serial debug interface. Bit [0] Error Logging Enable If set to "1", the IPMC outputs error/diagnostic messages onto the serial debug interface. ATCA-7540 Installation and Use (6806871A01A)
If set to "1", the IPMC outputs error/diagnostic messages onto the serial debug interface. Response Data Completion Code PPS IANA Private Enterprise ID 0x00400A = 16394 (Pigeon Point Systems) LSB byte first: byte 2 = 0A, byte 3 = 40, byte 4 = 00 ATCA-7540 Installation and Use (6806871A01A)
0x02: The handle switch state is read from hardware. Response Data Completion Code PPS IANA Private Enterprise ID 0x00400A = 16394 (Pigeon Point Systems) LSB Byte first: byte 2 = 0A, byte 3 = 40, byte 4 = 00 ATCA-7540 Installation and Use (6806871A01A)
After performing this sequence, the payload should send the Graceful Reset command to the IPMC over the payload Interface to notify the IPMC that the payload shutdown is complete. ATCA-7540 Installation and Use (6806871A01A)
0: Payload power is bad. 1: Payload power is good. Bit [6] 0: IPMB-L buffer is not attached. 1: IPMB-L buffer is attached. Bit [7] 0: IPMB-L buffer is not ready. 1: IPMB-L buffer is ready. ATCA-7540 Installation and Use (6806871A01A)
Chapter 9 IPMI Feature Set Introduction to the IPMI Feature Set The ATCA-7540 blade provides an intelligent hardware management system, as defined in the ® ® AdvancedTCA Base Specification (PICMG 3.0; AMC.0). This system incorporates two IPMI controllers: ®...
Page 278
IPMC. The Glue Logic FPGA is used to monitor the CPU status, the payload reset cause, the power failure registers, and to control the BIOS boot bank selection. A functional block diagram of the ATCA-7540 IPMC/MMC system is shown in the following figure.
Page 279
IPMI Feature Set Figure 9-1. IPMC Block Diagram of ATCA-7540 Front Intel CPU Lattice GLUE (FPGA) 0xFD, 0xFE LM75 TEMP FRU EEPROM 0xA2 LM75 inlet SEL EEPROM 0xA0 Front PCA9555 LM75 outlet Cortex 0x48 PIM 0x50 Microsemi ATMEGA 128...
The IPMC provides a number of subsidiary threads to serve RTM module discovery and e-keying management. The Application Layer can also operate in standalone mode intended to debug the payload without requiring a shelf manager. ATCA-7540 Installation and Use (6806871A01A)
Hardware Firmware Upgrade 9.3.1 HPM.1 Components All of the following embedded software images can be upgraded via HPM.1 protocol: IPMI boot loader IPMI firmware IPMI FRU information BIOS FPGA ATCA-7540 Installation and Use (6806871A01A)
SPI flash into the internal eNVM, depending on the successful boot flags. NOTE: The boot loader is also used as an HPM.1 component; however, there is no backup image. ATCA-7540 Installation and Use (6806871A01A)
Sensor. For more details, see Boot Bank Supervision Sensor on page 302. Besides HPM.1 manual rollback, it is possible to switch the banks without upgrading the HPM.1 firmware. For details see System Boot Options Commands on page 233. ATCA-7540 Installation and Use (6806871A01A)
9.3.1.4 BIOS Component The ATCA-7540 provides two SPI flash components for storing redundant BIOS firmware images; one is called Active, the other is Backup. Because the Active SPI flash is always routed to the Intel CPU, the IPMC can only perform HPM.1 specific firmware upgrades to the Backup SPI flash.
********************[[[[[ REPORT END ]]]]]******************** 9.3.3 Firmware Upgrade Tool The primary update mechanism for the ATCA-7540 blade is the FCU tool, which is delivered with the BBS package for the blade. The ATCA-7540 blade family also supports upgrades with the ipmitool.
The IPMI over LAN interface uses the BASE Ethernet controller to do firmware upgrades. The interface has to be configured before the first use. Configuring this interface is described in Configuring SOL Parameters on page 226. ATCA-7540 Installation and Use (6806871A01A)
The following example is provided to enable users to upgrade their firmware quickly from the payload host (one BIOS SPI flash can be upgraded in ~5 minutes). 1. Evaluate IP address of IPMC. root@ATCA-7540:~# ipmitool lan print 1 Set in Progress : Set Complete...
Page 288
IPMI Feature Set 3. Upgrade the firmware. root@ATCA-7540:~# ipmitool -C 1 -I lanplus -U rmcp -P rmcp -H 172.16.0.221 -k gkey hpm upgrade /root/bios.hpm activate PICMG HPM.1 Upgrade Agent 1.0.9: Validating firmware image integrity...OK Performing preparation stage... Services may be affected during upgrade. Do you wish to continue?
IPMI Feature Set Sensors This section provides a description of all analog and discrete sensors available on the ATCA-7540 blade. Table 9-2 lists the sensor identification numbers and information regarding the sensor type, name, supported thresholds, assertion and de-assertion information.
Page 290
0x1: IPMB-A Sensor- enabled, IPMB-B Physical [7:4] = Channel specific disabled IPMB IPMB-0 Number reading Asrt Auto Physical discrete 0x2: IPMB-A 0xF1 [3:0] = Reserved disabled, IPMB-B 0x6F enabled 0x3: IPMB-A enabled, IPMB-B enabled ATCA-7540 Installation and Use (6806871A01A)
Page 291
0x01 0x01 Voltage Threshold +3.3 V reading threshold unr uc lnr lc Asrt / Deass Auto MGMT 0x02 0x01 Voltage Threshold +12 V reading threshold unr uc lnr lc Asrt / Deass Auto 0x02 0x01 ATCA-7540 Installation and Use (6806871A01A)
Page 292
Interrupt 0x0: System Table System Sensor- Firmware Error "BIOS specific Firmware Supported 0x1: System See IPMI Spec Asrt Auto IPMI Progress discrete Firmware Hang Progress Events" on 0x6F 0x2: System 0x0F page 214 Firmware Progress ATCA-7540 Installation and Use (6806871A01A)
Page 293
0x0: No Bootable Boot Error 0xFF 0xFF Asrt Auto discrete media 0x1E 0x6F Sensor- 0x0: Initiated by System Boot specific power-up Boot Initiated 0xFF 0xFF Asrt Auto Initiated discrete 0x1: Initiated by 0x1D hard reset 0x6F ATCA-7540 Installation and Use (6806871A01A)
Page 294
Critical IRQ Asrt Auto IPMI Events" on discrete Supported 0x5: PCI SERR 0x13 page 214 IPMI 0x6F Events" on page 214 Sensor- specific Battery Battery 0xFF 0xFF 0x1: Battery failed Asrt Auto discrete 0x29 0x6F ATCA-7540 Installation and Use (6806871A01A)
Page 295
Asrt / Deass Auto Volts 0x02 0x01 Current Threshold -48 V Amps reading threshold No Thresholds Auto 0x03 0x01 Voltage Threshold HoldUp reading threshold unr uc lnr lc Asrt / Deass Auto Cap Volts 0x02 0x01 ATCA-7540 Installation and Use (6806871A01A)
Page 296
Asrt / Deass Auto Supply discrete 0x08 0x1: Power Supply Failure detected 0x6F 0x0: No events for Sensor- this sensor specific BIOS POST Reading according Asrt Auto code discrete 0xD1 to EFI BIOS port80 0x6F status codes ATCA-7540 Installation and Use (6806871A01A)
Page 297
CPU Status 0xFF 0xFF Asrt Auto discrete 0x07 0x1: Thermal Trip 0x6F Sensor- 0x0: Me Fail State specific ME Pwr Fail 0xFF 0xFF 0x1: Me Fail State Asrt Auto discrete 0xE0 0x2: Me Fail State 0x6F ATCA-7540 Installation and Use (6806871A01A)
Page 298
Asrt / Deass Auto 0x01 0x01 Temp Threshold CPU1 temp reading threshold unr uc unc Asrt / Deass Auto 0x01 0x01 CPU0 Temp Threshold DDR0 reading threshold unr uc unc Asrt / Deass Auto 0x01 0x01 Temp ATCA-7540 Installation and Use (6806871A01A)
Page 300
0x01 Management 0x0: Performance Digital Subsystem Discrete IPMC POST 0xFF 0xFF Asrt Auto Health 0x1: Performance 0x06 Lags 0x28 Sensor- ap force AP Force ALM OEM 0xDB specific 0x6F Cause MSB Asrt Auto Cause Discrete ATCA-7540 Installation and Use (6806871A01A)
Payload Driven Sensors The IPMC firmware provides Firmware Progress, OS Boot, Boot Initiated, Memory, Battery, Critical IRQ and Boot Error sensors to enable the payload firmware and payload OS to report boot progress/failure via IPMI event messages. ATCA-7540 Installation and Use (6806871A01A)
The boot bank information received from this sensor may differ from the boot bank selection performed if the boot bank selection has changed after the payload has booted. For details, see BIOS Boot Bank Selection on page 313. ATCA-7540 Installation and Use (6806871A01A)
Bit 4 Holdup Switch State 1: Holdup Cap is connected to -48 V Out Bit 3 Reserved 0: Primary side Alarm is not set Bit 2 Alarm Signal State 1: Primary side Alarm is set ATCA-7540 Installation and Use (6806871A01A)
Module PWR Entry Temp Power Entry Temp PWR Entry Status Power Entry Status IPMC Front 0x90 Inlet Temp Inlet Temp LM75 private 2 blade IPMC Front 0x94 Outlet Temp Outlet Temp LM75 private 2 blade ATCA-7540 Installation and Use (6806871A01A)
Page 305
+5 V Power Voltage blade RTM 3.3 V MGMT RTM Management Power Voltage RTM +12 V Power Voltage RTM 12 V Board Temp Board Temp IPMC Front 0x98 ADT7461 private blade XL710 Temp Fortville (XL710 Temp) ATCA-7540 Installation and Use (6806871A01A)
The Payload Power Failure Cause Register 3 covers CPU specific voltages. When a CPU is not mounted (detected via CPU0_SKTOCC_ and CPU1_SKTOCC_) the corresponding power failure bits will never be set. For more information, see Table 5-51. ATCA-7540 Installation and Use (6806871A01A)
FRU extraction caused by service-teams during servicing other FRUs. The ejector handle de-bounce function can be enabled, disabled, and configured with the use of the OEM command Set/Get Feature Configuration. For details, see Set Feature Configuration on page 255. ATCA-7540 Installation and Use (6806871A01A)
IPMI Feature Set FRU Inventory The ATCA-7540 implements two intelligent FRUs (IPMC and MMC). Every FRU provides its own FRU information (serial, part, MAC addresses). FRU information is available depending on the presence of a module. Table 9-6. FRU Information and SEL at EEPROM Storage I²C Address...
Page 309
M > 1: this descriptor specifies a pool of MAC addresses with M count MAC Address. (Canonical form, the LSB (least significant bit) first. Table 9-9. Interface Type Assignments Interface Type Description ATCA Base Interface ATCA Fabric Interface Front/Rear Panel Mezzanine Module ATCA-7540 Installation and Use (6806871A01A)
2 x SOL 1 x 10 GBE from PCH to front panel SFP+ Reset and Power Domain The ATCA-7540 blade provides the following FRU instances: FRU #0: front blade management and switch FRU #1: RTM Each FRU instance can be reset separately.
IPMC. The IPMI command being used to manage the boot configuration variables is called Set/Get System Boot Options together with parameter #100. For details, see System Boot Options Commands on page 233. ATCA-7540 Installation and Use (6806871A01A)
Page 312
For this reason, the IPMC memory is divided into numbered blocks of 16 bytes which need to be addressed individually. For this purpose the "block selector" field in the request data field is used. ATCA-7540 Installation and Use (6806871A01A)
9.12 Serial Line Selection The ATCA-7540 blade provides two serial interfaces from payload. By default, the first is routed to the front connector and the second to the RTM. In addition, there is an IPMC debug interface, which can be routed either to the front or to the RTM (this function is available if the RTM provides a serial connector at the front).
System Boot Options Commands on page 233. 9.13.1 Boot Bank Sensor The ATCA-7540 provides a Boot Bank Sensor, illustrating from which BIOS Boot Bank the boot firmware has last booted. For details, see Boot Bank Supervision Sensor on page 302.
Page 315
Event Reading Type Code: 0x6F (Sensor Specific) Event Data Byte 1: 0xA1 (System Firmware Hang) Event Data Byte 2: 0x00 (CPU instance) Event Data Byte 3: 0xXX (Failed Boot Bank ID: 0=Bank A; 1=Bank B) ATCA-7540 Installation and Use (6806871A01A)
FPGA boot bank from which the payload shall boot persistently. For details, System Boot Options Commands on page 233. 9.14.1 Boot Bank Sensor The ATCA-7540 blade provides a Boot Bank Sensor illustrating from which FPGA bank the FPGA has booted last. For details, see Boot Bank Supervision Sensor on page 302.
During initial power on, the IPMC selects the FPGA bank stored in NVRAM and evaluates the FPGA DONE signal. If the provided signal is not asserted, the IPMC selects the FPGA backup bank and tries to load the FPGA again. ATCA-7540 Installation and Use (6806871A01A)
Page 318
System Firmware FPGA Done Hang event to the ShMM Both FPGA banks corrupted Set failprotect to FAILED_TWICE Present? Remote Crisis Recovery Mode (M1) FPGA Load Done Swap Boot Bank to protect working image Success ATCA-7540 Installation and Use (6806871A01A)
9.16 Local System Event Log (SEL) The ATCA-7540 IPMC supports a local SEL. The local SEL size is configured to hold 1K entries in a circular FIFO buffer. Once the circular buffer is full, the next SEL entry will overwrite the oldest SEL entry in the buffer.
Page 320
IPMI standard command Get SEL Time. Once the initial time is received, the IPMC maintains the time locally and no further synchronization is performed with the shelf manager. ATCA-7540 Installation and Use (6806871A01A)
Document Title Publication Number ATCA-7540 Quick Start Guide 6806871A02 ATCA-7540 Safety Notes Summary 6806871A03 Basic Blade Services Software on ATCA-7540 Programmer’s Reference 6806871A04 M.2 Riser Assembly ATCA-75XX-Kit-M2 Quick Start Guide 6806872A01 SSD Module and HW Kit NVME-M.2-1TB Quick Start Guide 6806868A01 Related Specifications For additional information, refer to the following table for related specifications.
Page 322
Related Documentation ATCA-7540 Installation and Use (6806871A01A)
Need help?
Do you have a question about the ATCA-7540 and is the answer not in the manual?
Questions and answers