Xilinx Alveo X3522 Installation Manual
Hide thumbs Also See for Alveo X3522:

Advertisement

Quick Links

Alveo X3522
Installation Guide
UG1522 (v1.0) October 18, 2022
Xilinx is creating an environment where employees, customers, and
partners feel welcome and included. To that end, we're removing non-
inclusive language from our products and related collateral. We've
launched an internal initiative to remove language that could exclude
people or reinforce historical biases, including terms embedded in our
software and IPs. You may still find examples of non-inclusive
language in our older products as we work to make these changes and
align with evolving industry standards. Follow this
link
for more
information.

Advertisement

Table of Contents
loading

Summary of Contents for Xilinx Alveo X3522

  • Page 1 Alveo X3522 Installation Guide UG1522 (v1.0) October 18, 2022 Xilinx is creating an environment where employees, customers, and partners feel welcome and included. To that end, we’re removing non- inclusive language from our products and related collateral. We’ve launched an internal initiative to remove language that could exclude people or reinforce historical biases, including terms embedded in our software and IPs.
  • Page 2: Table Of Contents

    Chapter 6: Troubleshooting ..................33 Troubleshooting the Network Driver Load................33 Known Issues..........................34 Appendix A: Additional Resources and Legal Notices ......35 Xilinx Resources.........................35 Documentation Navigator and Design Hubs.................35 UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 3 References..........................35 Revision History......................... 36 Please Read: Important Legal Notices................... 37 UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 4: Chapter 1: Introduction

    Chapter 1: Introduction Chapter 1 Introduction This is the Installation Guide for all Xilinx ® Alveo™ X3522 card variants, including the following: • X3522 low latency network adapter. • X3522PV adaptable accelerator card. It gives detailed procedures for engineers to setup the X3522, and to provide an environment for testing it.
  • Page 5: Block Diagram

    DDR C1 Port 1 DSFP28 GTY x4 XCUX35-3VSVA1365E Port 2 DSFP28 EP GTY x8 Satellite Controller UART LPC5500 Series SMBus 2xJTAG, 3xUART PMBus, SMBus, SWDIO PCIe Gen4 x8 X25588-052622 UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 6: Server Requirements

    • The server must have a 64-bit x86 processor. • The server must be able to accept a half height half length 8-lane PCIe board. • The server must meet the Thermal Specifications given in the Alveo X3522 Data Sheet (DS1002).
  • Page 7: Chapter 2: Card Installation

    Pour assurer votre sécurité personnelle et la sécurité de votre équipement: • Maintenez votre zone de travail et l'ordinateur/serveur propre et dégagé de débris. • Avant d'ouvrir le capot de l'ordinateur/système, débranchez le cordon d'alimentation. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 8 • Put the card down only on an antistatic surface such as the bag supplied in your kit. • If you are returning the card to Xilinx Product Support, place it back in its antistatic bag immediately. Attention aux Décharge Électrostatique (ESD) L'ESD peut endommager les composants électroniques lorsqu'ils sont mal manipulés, et peut...
  • Page 9: Before You Begin

    • Legen sie die Karte nur auf einer antistatischen Oberfläche ab, z.B. dem antistatischen Beutel der mit dem Kit mitgeliefert wurde. • Wenn sie die Karte an den Xilinx Product Support zurücksenden, legen Sie sie bitte sofort wieder in den antistatischen Beutel.
  • Page 10: Install The Card

    WICHTIG! Der X3522 Karte benoetigt einen PCI Express x16 Steckplatz. Die Karte sollte in einem PCIe Gen4 oder PCIe Gen3 Steckplatz installiert sein. 1. Shut down the server. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 11 4. Locate an 8‑lane PCI Express slot (refer to the server manual if necessary). Fit the Correct Bracket Xilinx adapters are supplied with a full height bracket fitted to the adapter. A low-profile bracket has also been supplied for PCIe slots that require this type of bracket.
  • Page 12 • This is sample output for an X3522 low latency network adapter that is in its supplied configuration: 01:00.0 Ethernet controller: Xilinx Corporation Device 5084 Subsystem: Xilinx Corporation Device 000b Flags: bus master, fast devsel, latency 0...
  • Page 13 Capabilities: [1c0] #19 Capabilities: [220] Transaction Processing Hints Capabilities: [e80] Vendor Specific Information: ID=0020 Rev=0 Len=010 <?> 01:00.1 Ethernet controller: Xilinx Corporation Device 5084 Subsystem: Xilinx Corporation Device 000b Flags: bus master, fast devsel, latency 0 Memory at 92a00000 (64-bit, prefetchable) [size=1M]...
  • Page 14: Connect The Card To The Network

    Capabilities: [e80] Vendor Specific Information: ID=0020 Rev=0 Len=010 <?> • This is sample output for an X3522PV adaptable accelerator card: 01:00.0 Processing accelerators: Xilinx Corporation Device 5074 Subsystem: Xilinx Corporation Device 000e Flags: bus master, fast devsel, latency 0, NUMA node 0...
  • Page 15 If the cable you are using is not keyed, check to be sure the connector is oriented properly (transmit port connected to receive port on the link partner, and vice versa). UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 16: Status Leds

    • The LEDs for cage 1 show the status of ports 0 and 2. • The LEDs for cage 2 show the status of ports 1 and 3. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 17 • Off when there is no activity on any exposed network port for the cage. Note: Some other LEDs inside the case are visible through the airflow holes. These internal LEDs are for diagnostic use only, and you should ignore them. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 18: Chapter 3: Software Installation

    This section also tells you how to configure network settings for the host server and for a link partner to which it can be connected. Choose Which Packages To Use The drivers are provided in two package formats. Choose the appropriate format to use: UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 19 1. List the kernel headers, to confirm they are installed: # ls /lib/modules/$(uname -r)/build 2. If no files are listed install the kernel-devel or kernel-smp-devel package, as appropriate. For example: # yum install kernel-devel-$(uname -r) UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 20 3. The build procedure generates a lot of console output. Towards the end of the build a "Wrote:" line identifies the location of the built binary RPM. For example: Wrote: <path>/kernel-module-auxiliary-<os_version>-<module_version>.rpm UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 21 • XN-201053-LS Alveo X3522 Net Driver Source [RPM package]. Build the Network Driver Binary RPM To build the network driver binary RPM for the currently running kernel version: 1. Locate the Alveo X3522 Net Driver Source [RPM package] that you downloaded. See Download the Auxiliary Bus Driver Source RPM.
  • Page 22 X3522 cards use the auxiliary bus driver. This is provided by some recent Linux distributions. To determine its presence, type: # ls -d /sys/bus/auxiliary • If there is output listing the directory, the auxiliary bus driver is already present: /sys/bus/auxiliary UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 23 Download the network driver DKMS Debian package: 1. Start a web browser. 2. Open the product website (see Product Website). 3. Download the following package: • XN-201054-LS Alveo X3522 Net Driver Source [Debian package]. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 24 Chapter 3: Software Installation Install the Network Driver Now install the network driver DKMS package. For example, on an Ubuntu/Debian server: 1. Locate the Alveo X3522 Net Driver Source [Debian package] that you downloaded. See Download the Auxiliary Bus Driver DKMS Debian Package.
  • Page 25 802-3-ethernet eno1 enp1s0f0 b625586a-b82c-b82f-f16c-e1bf600c7751 802-3-ethernet enp1s0f0 enp1s0f1 c133f197-d25e-a27d-acd8-cf2eda286822 802-3-ethernet enp1s0f1 virbr0 1672bdeb-3925-43d3-a559-65fdd7f7cff7 bridge virbr0 2. Look in the DEVICE column for the X3522 interface (see Determine Interface Names). UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 26 Note: The IP addresses must be on the same subnet as each other. If you do not use the IP addresses specified in this guide, ensure you still meet this requirement. 2. Bring the connection up: # nmcli connection up '<NAME>' For example: # nmcli connection up 'enp1s0f2' UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 27 # nmcli -fields IP4 connection show '<NAME>' For example: # nmcli -fields IP4 connection show 'enp1s0f2' IP4.ADDRESS[1]: 192.168.10.10/24 IP4.GATEWAY: or for the link partner: # nmcli -fields IP4 connection show 'enp1s0f0' IP4.ADDRESS[1]: 192.168.10.20/24 IP4.GATEWAY: UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 28: Chapter 4: Card Bring-Up And Validation

    Running ethtool If you have installed the X3522 low latency network adapter: 1. Examine the output of ethtool: # ethtool <interface> UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 29: Running Ip

    2. Find: • The first interface on the card (see Determine Interface Names). • Any other interfaces on the card, that can be identified by their adjacent MAC addresses. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 30: Running Ping

    Note: You can alternatively use the ifconfig -a command to confirm the correct number of network interfaces for the X3522. Running ping If you have installed the X3522 low latency network adapter: UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 31 64 bytes from 192.168.10.10: icmp_seq=10 ttl=64 time=0.049 ms --- 192.168.10.10 ping statistics --- 10 packets transmitted, 10 received, 0% packet loss, time 195ms rtt min/avg/max/mdev = 0.047/0.056/0.080/0.012 ms UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 32: Chapter 5: Next Steps

    • If you have installed the X3522 low latency network adapter, you can now use it as a network adapter. It can use Xilinx network acceleration technologies such as Onload, TCPDirect and ef_vi to improve performance and latency. Further optimization is possible through tuning. For more information about using these features, see the Alveo X3522 User Guide (UG1523).
  • Page 33: Chapter 6: Troubleshooting

    Ensure that operating ambient supplies. The system microcontroller conditions do not exceed the Thermal subsequently records that in its logs. Specifications given in the Alveo X3522 Data Sheet (DS1002). Driver installation incomplete or Missing dependent packages. Contact your Linux administrator.
  • Page 34: Known Issues

    Known Issues There might be late-breaking issues. Please refer to any README files or Release Notes in the distribution. See also Xilinx Answer Record 71752 for additional known issues. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
  • Page 35: Appendix A: Additional Resources And Legal Notices

    • On Windows, select Start → All Programs → Xilinx Design Tools → DocNav. • At the Linux command prompt, enter docnav. Xilinx Design Hubs provide links to documentation organized by design tasks and other topics, which you can use to learn key concepts and address frequently asked questions. To access the Design Hubs: •...
  • Page 36 Appendix A: Additional Resources and Legal Notices Alveo Documents 1. Alveo X3522 Data Sheet (DS1002) 2. Alveo X3522 User Guide (UG1523) 3. Alveo Card Debug Guide (XD027) 4. Alveo Data Center Accelerator Card Platforms User Guide (UG1120) Onload Documents 1. Onload User Guide (UG1586) Vivado Documents 1.
  • Page 37 IP cores may be subject to warranty and support terms contained in a license issued to you by Xilinx. Xilinx products are not designed or intended to be fail-safe or for use in any application requiring fail-safe performance; you assume sole risk and liability for...
  • Page 38 Spartan, Versal, Vitis, Virtex, Vivado, Zynq, and other designated brands included herein are trademarks of Xilinx in the United States and other countries. PCI, PCIe, and PCI Express are trademarks of PCI-SIG and used under license. All other trademarks are the property of their respective owners.

This manual is also suitable for:

Alveo x3522pv

Table of Contents