V1.2 - 10th October 2023 1 Product Description The ADA-R9100 is a 1U 19" Rack Mount appliance based around the AMD Ultrascale+ VU2P Ultra Low Latency FPGA. This appliance is designed to provide the lowest latency access to the highest number of ultra-low latency GTF transceivers that are the unique feature of the VU2P device.
Page 8
ADA-R9100 User Manual V1.2 - 10th October 2023 Description Measure Total Dy 540 mm Total Dx 484 mm Total Dz 44 mm Weight 11.28 kg PSU Rating 500W Table 1 : Mechanical Dimensions (Without Rails) Page 2 Product Description ad-sp-r9100_v1_2.pdf...
The AD01474 is fitted with an AMD Virtex UltraScale+ VU2P, an ultra-low latency FPGA device. The low-latency lanes are driven by the Xilinx GTF transceivers. The ADA-R9100 has been tested at both 10.3125Gbps and 25.78125Gbps for each low latency lane.
ADA-R9100 User Manual V1.2 - 10th October 2023 2.3 Redundant PSU (RPSU) The system is fitted with a 500W 1+1 redundant power supply (ATX compliant), compatible with CPU boards with 24P connectors. The RSPU is PMBus/SMBUS 1.2 compliant. To operate the RPSU remotely (query state, switch ON/OFF, etc..), see...
ADA-R9100 User Manual V1.2 - 10th October 2023 3 HW Interfaces Figure 3 : Interfaces Front Panel PWR: Power ON/OFF button/indicator. This is a momentary action pushbutton with LED indication. The two independent processing systems (ROMED4ID-2T and AD01474) remain on standby until the button is pressed.
Page 12
ADA-R9100 User Manual V1.2 - 10th October 2023 RST: ROMED4ID-2T’s reset. This is a momentary action pushbutton. It performs a system reset when pressed. QSFP28: Ethernet/Optical connections. There are 5 cages per row and 4 lanes per cage (x40 channels).
ADA-R9100 User Manual V1.2 - 10th October 2023 Figure 5 : Securing the mount support to the rack Now, fit the mounting rail (4), but not too tight (allow some horizontal movement) and slide it all the way back for maximum extension, then slide the unit in the rack until solidly supported by the previously installed rear brackets (5).
ADA-R9100 User Manual V1.2 - 10th October 2023 5 Operating System and Pre-installed SW The R9100 comes with Ubuntu 18.04.6 LTS preinstalled. It is configured with a graphical desktop and will automatically boot into it when operated locally. SSH is enabled for remote access too.
ADA-R9100 User Manual V1.2 - 10th October 2023 6 Powering the System Up The R9100 is equipped with a 1+1 redundant power supply unit (RSPU), and as such both redundant modules need to be sourced for a reliable 24/7 server operation. For best performance, plug both modules into the power...
ADA-R9100 User Manual V1.2 - 10th October 2023 6.2 Full-power operation The system will enter the full-power mode only after the power ON/OFF button of the R9100 has been pressed while in standby mode (see Section 3, item 1). The system will boot into the preinstalled Ubuntu OS and show the login screen with the default user.
ADA-R9100 User Manual V1.2 - 10th October 2023 7 Feature Description 7.1 IPMI PCIe/I2C There is an internal IPMI (PCIe/I2C) connection between the CPU System and the AD01474. It can handle the IPMI commands locally from the CPU system as a local I2C device, or remotely through the IPMI tree by the BMC/CPU Ethernet connections.
ADA-R9100 User Manual V1.2 - 10th October 2023 Note: You will need to deactivate flow control in Minicom by: Ctr-A Z --> Configure Minicom(O) --> Serial port setup --> HW flow control --> OFF --> SW flow control --> OFF Alternatively, run minicom -s to change parameters or modify the file minirc.dlf with the following lines to...
7.5 LEDs 7.5.1 System LEDs There are 9 system LEDs on the ADA-R9100, 6 of which are general purpose and whose meaning can be defined by the user. The other 3 have fixed functions described below: Figure 8 : Front Panel LEDs Comp.
ADA-R9100 User Manual V1.2 - 10th October 2023 7.5.2 SFP+ cages LEDs There are 2 LEDs per SFP+ cage, arranged in pairs of 2 together (for the top and bottom cages). The two on the right-hand side are the "module present" signal of each cage, whereas the two on the left are the "link up"(or user definable) of either one.
The reprogrammable clocks from the LMK61E2 are reconfigurable from the USB front/back interface by using Alpha Data’s avr2util utility. This allows the user to configure almost any arbitrary clock frequency during application run time for the SFP/QSFP reference clock. The maximum clock frequency for the LMK61E2 is 900MHz.
ADA-R9100 User Manual V1.2 - 10th October 2023 7.7.1 LMK61E2 The ADM-R9100 uses the LMK61E2 for arbitrary clock frequency synthesis. For complete technical details, please reference the datasheet: https://www.ti.com/lit/ds/symlink/lmk61e2.pdf The ADM-R9100 uses two LMK61E2 devices in the clock architecture. These can be accessed through either the USB or PCIe link using the AVR2UTIL application.
ADA-R9100 User Manual V1.2 - 10th October 2023 7.7.3 Si5324 Please note that some net names in the design refer to the SI5324 as an SI5328. These devices are footprint and functionally compatible. The SI5324E-C-GM was chosen at the time of production due to availability concerns and is the part fitted on every board.
The Alpha Data System Monitor is also capable of reconfiguring the flash memory and reprograming the FPGA. This provides a useful failsafe mechanism to re-program the FPGA even if it drops off the PCIe bus. The system monitor can be accessed with avr2util over USB at the front panel and rear edge.
ADA-R9100 User Manual V1.2 - 10th October 2023 Program with Vivado Hardware Manager with these settings (see xapp1233): • SPI part: mt25qu01g-spi-x1_x2_x4 • State of non-config mem I/O pins: Pull-none 7.8.2 Configuration via JTAG A micro-USB AB Cable may be attached to the front panel or rear edge USB port. This permits the FPGA to be reconfigured using the Xilinx Vivado Hardware Manager via the integrated Digilent JTAG converter box.
(through ROMED4ID-2T's BMC). 8.1 AD01474 System Monitor The ADA-R9100's USB connections described in the previous section can be used to directly access the system monitor system on the AD01474. All voltages, currents, temperatures, and non-volatile clock configuration settings can be accessed using Alpha Data's avr2util software at this interface (preinstalled in the Ubuntu OS).
ADA-R9100 User Manual V1.2 - 10th October 2023 8.1.1 System Monitor Status LEDs LEDs D35 (Red) and D34 (Green) indicate the card health status. LEDs Status Green Running and no alarms Green + Red Standby (Powered off) Flashing Green + Flashing Red...
Page 30
ADA-R9100 User Manual V1.2 - 10th October 2023 Voltage VCPU full-power 12V rail LAN_1.2V Ethernet chipset voltage 1 LAN_0.83V Ethernet chipset voltage 1 Temperatures (degrees Celsius) CPU Temp CPU on-die temperature MB Temp Motherboard chipset temperature TR1 Temp AD01474 FPGA on-die temperature...
ADA-R9100 User Manual V1.2 - 10th October 2023 9 Using Vivado Lab to program the AD01474 Once the system is powered up and has booted into Ubuntu, the default user credentials must be provided to log into Ubuntu through its GUI.
ADA-R9100 User Manual V1.2 - 10th October 2023 Figure 16 : Opening HW Manager Click on the 'Open Target' button that appears at the top, then select 'Auto Connect.' The software will scan the JTAG chain for the FPGA and display its programming status upon detection. This occurs because the FPGA is automatically programmed with a default image from Flash during power-up.
ADA-R9100 User Manual V1.2 - 10th October 2023 Figure 18 : Reprogramming the FPGA Note: Example designs are available for this system. You can request them at support@alpha-data.com. Using Vivado Lab to program the AD01474 Page 27 ad-sp-r9100_v1_2.pdf...
ADA-R9100 User Manual V1.2 - 10th October 2023 10 Management interface (BMC) The BMC processor provides the server capabilities to the system addresses, managing the different services and subsystems. The R9100 is configured to get IP adressess for the BMC and the CPU system automatically. In order to gain access to the system, the assigned IP address by your DHCP server is needed.
ADA-R9100 User Manual V1.2 - 10th October 2023 Figure 21 : BMC's administrator login You will be able to browse through the BMC's different options. See the sensors list below: Figure 22 : BMC's sensors list 10.2 Remote connection to server (GUI) Now, let us open the KVM options to remote control the CPU system.
ADA-R9100 User Manual V1.2 - 10th October 2023 Figure 23 : KVM remote control Next, the login screen of the CPU system (Ubuntu) will be displayed: Figure 24 : Ubuntu through KVM You can operate the system entirely from here, including performing an ACPI shutdown, reboot, etc. Then you...
This maximises the available power for the user application on the AD01474/75/76 subsystem and ensures the RPSU operating limits. This is after considering component derating curves and ADA-R9100's safety certification, which specifies a maximum operating temperature of 50 degrees Celsius. The CPU's speed SHOULD NOT be increased.
ADA-R9100 User Manual V1.2 - 10th October 2023 11 Remote Control and Monitoring through console commands (IPMI) The main monitoring functions are carried out by ROMED4D-2T's BMC, and these can be accessed through the (Figure 22) or queried with console commands. These are referred to as sensors in the BMC. For a...
ADA-R9100 User Manual V1.2 - 10th October 2023 Sensor ID : PSU2 Status (0xa8) Entity ID : 10.0 Sensor Type (Discrete): Power Supply States Asserted : Power Supply [Presence detected] Find below the list of RPSU sensors accessible with PMBus through the ROMED4ID-2T (PSUX=[PSU1|PSU2]):...
ADA-R9100 User Manual V1.2 - 10th October 2023 11.3 SET Commands (IPMI raw) 11.3.1 Set chassis fan array speeds Fan array speeds are set independently for ROMED4ID-2T and AD01474 to handle their cooling, with two arrays of x3 fans each (Figure 2).
ADA-R9100 User Manual V1.2 - 10th October 2023 Appendix D: System Sensors and Monitoring Access Standby Full Power Device Sensor BMCEth Front Panel USB Front Panel UART CPUEth CPUApp FPGA 3VSB 5VSB VCPU VSOC VCCM ABCD VCCM EFGH VPPM ABCD...
Page 73
ADA-R9100 User Manual V1.2 - 10th October 2023 Revision History Date Revision Changed By Nature of Change C. Gutierrez - K. Issued 23/05/23 Roth Added complete FPGA pinout and QSFP/SFP cages C. Gutierrez - K. 05/07/23 connection to the FPGA (QUADs)
Need help?
Do you have a question about the ADA-R9100 and is the answer not in the manual?
Questions and answers