Page 1
Alveo X3522 Installation Guide UG1522 (v1.0) October 18, 2022 Xilinx is creating an environment where employees, customers, and partners feel welcome and included. To that end, we’re removing non- inclusive language from our products and related collateral. We’ve launched an internal initiative to remove language that could exclude people or reinforce historical biases, including terms embedded in our software and IPs.
Chapter 1: Introduction Chapter 1 Introduction This is the Installation Guide for all Xilinx ® Alveo™ X3522 card variants, including the following: • X3522 low latency network adapter. • X3522PV adaptable accelerator card. It gives detailed procedures for engineers to setup the X3522, and to provide an environment for testing it.
• The server must have a 64-bit x86 processor. • The server must be able to accept a half height half length 8-lane PCIe board. • The server must meet the Thermal Specifications given in the Alveo X3522 Data Sheet (DS1002).
Pour assurer votre sécurité personnelle et la sécurité de votre équipement: • Maintenez votre zone de travail et l'ordinateur/serveur propre et dégagé de débris. • Avant d'ouvrir le capot de l'ordinateur/système, débranchez le cordon d'alimentation. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 8
• Put the card down only on an antistatic surface such as the bag supplied in your kit. • If you are returning the card to Xilinx Product Support, place it back in its antistatic bag immediately. Attention aux Décharge Électrostatique (ESD) L'ESD peut endommager les composants électroniques lorsqu'ils sont mal manipulés, et peut...
• Legen sie die Karte nur auf einer antistatischen Oberfläche ab, z.B. dem antistatischen Beutel der mit dem Kit mitgeliefert wurde. • Wenn sie die Karte an den Xilinx Product Support zurücksenden, legen Sie sie bitte sofort wieder in den antistatischen Beutel.
WICHTIG! Der X3522 Karte benoetigt einen PCI Express x16 Steckplatz. Die Karte sollte in einem PCIe Gen4 oder PCIe Gen3 Steckplatz installiert sein. 1. Shut down the server. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 11
4. Locate an 8‑lane PCI Express slot (refer to the server manual if necessary). Fit the Correct Bracket Xilinx adapters are supplied with a full height bracket fitted to the adapter. A low-profile bracket has also been supplied for PCIe slots that require this type of bracket.
Page 12
• This is sample output for an X3522 low latency network adapter that is in its supplied configuration: 01:00.0 Ethernet controller: Xilinx Corporation Device 5084 Subsystem: Xilinx Corporation Device 000b Flags: bus master, fast devsel, latency 0...
Capabilities: [e80] Vendor Specific Information: ID=0020 Rev=0 Len=010 <?> • This is sample output for an X3522PV adaptable accelerator card: 01:00.0 Processing accelerators: Xilinx Corporation Device 5074 Subsystem: Xilinx Corporation Device 000e Flags: bus master, fast devsel, latency 0, NUMA node 0...
Page 15
If the cable you are using is not keyed, check to be sure the connector is oriented properly (transmit port connected to receive port on the link partner, and vice versa). UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
• The LEDs for cage 1 show the status of ports 0 and 2. • The LEDs for cage 2 show the status of ports 1 and 3. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 17
• Off when there is no activity on any exposed network port for the cage. Note: Some other LEDs inside the case are visible through the airflow holes. These internal LEDs are for diagnostic use only, and you should ignore them. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
This section also tells you how to configure network settings for the host server and for a link partner to which it can be connected. Choose Which Packages To Use The drivers are provided in two package formats. Choose the appropriate format to use: UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 19
1. List the kernel headers, to confirm they are installed: # ls /lib/modules/$(uname -r)/build 2. If no files are listed install the kernel-devel or kernel-smp-devel package, as appropriate. For example: # yum install kernel-devel-$(uname -r) UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 20
3. The build procedure generates a lot of console output. Towards the end of the build a "Wrote:" line identifies the location of the built binary RPM. For example: Wrote: <path>/kernel-module-auxiliary-<os_version>-<module_version>.rpm UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 21
• XN-201053-LS Alveo X3522 Net Driver Source [RPM package]. Build the Network Driver Binary RPM To build the network driver binary RPM for the currently running kernel version: 1. Locate the Alveo X3522 Net Driver Source [RPM package] that you downloaded. See Download the Auxiliary Bus Driver Source RPM.
Page 22
X3522 cards use the auxiliary bus driver. This is provided by some recent Linux distributions. To determine its presence, type: # ls -d /sys/bus/auxiliary • If there is output listing the directory, the auxiliary bus driver is already present: /sys/bus/auxiliary UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 23
Download the network driver DKMS Debian package: 1. Start a web browser. 2. Open the product website (see Product Website). 3. Download the following package: • XN-201054-LS Alveo X3522 Net Driver Source [Debian package]. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 24
Chapter 3: Software Installation Install the Network Driver Now install the network driver DKMS package. For example, on an Ubuntu/Debian server: 1. Locate the Alveo X3522 Net Driver Source [Debian package] that you downloaded. See Download the Auxiliary Bus Driver DKMS Debian Package.
Page 25
802-3-ethernet eno1 enp1s0f0 b625586a-b82c-b82f-f16c-e1bf600c7751 802-3-ethernet enp1s0f0 enp1s0f1 c133f197-d25e-a27d-acd8-cf2eda286822 802-3-ethernet enp1s0f1 virbr0 1672bdeb-3925-43d3-a559-65fdd7f7cff7 bridge virbr0 2. Look in the DEVICE column for the X3522 interface (see Determine Interface Names). UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 26
Note: The IP addresses must be on the same subnet as each other. If you do not use the IP addresses specified in this guide, ensure you still meet this requirement. 2. Bring the connection up: # nmcli connection up '<NAME>' For example: # nmcli connection up 'enp1s0f2' UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 27
# nmcli -fields IP4 connection show '<NAME>' For example: # nmcli -fields IP4 connection show 'enp1s0f2' IP4.ADDRESS[1]: 192.168.10.10/24 IP4.GATEWAY: or for the link partner: # nmcli -fields IP4 connection show 'enp1s0f0' IP4.ADDRESS[1]: 192.168.10.20/24 IP4.GATEWAY: UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Running ethtool If you have installed the X3522 low latency network adapter: 1. Examine the output of ethtool: # ethtool <interface> UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
2. Find: • The first interface on the card (see Determine Interface Names). • Any other interfaces on the card, that can be identified by their adjacent MAC addresses. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Note: You can alternatively use the ifconfig -a command to confirm the correct number of network interfaces for the X3522. Running ping If you have installed the X3522 low latency network adapter: UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
Page 31
64 bytes from 192.168.10.10: icmp_seq=10 ttl=64 time=0.049 ms --- 192.168.10.10 ping statistics --- 10 packets transmitted, 10 received, 0% packet loss, time 195ms rtt min/avg/max/mdev = 0.047/0.056/0.080/0.012 ms UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
• If you have installed the X3522 low latency network adapter, you can now use it as a network adapter. It can use Xilinx network acceleration technologies such as Onload, TCPDirect and ef_vi to improve performance and latency. Further optimization is possible through tuning. For more information about using these features, see the Alveo X3522 User Guide (UG1523).
Ensure that operating ambient supplies. The system microcontroller conditions do not exceed the Thermal subsequently records that in its logs. Specifications given in the Alveo X3522 Data Sheet (DS1002). Driver installation incomplete or Missing dependent packages. Contact your Linux administrator.
Known Issues There might be late-breaking issues. Please refer to any README files or Release Notes in the distribution. See also Xilinx Answer Record 71752 for additional known issues. UG1522 (v1.0) October 18, 2022 www.xilinx.com Send Feedback Alveo X3522 Installation Guide...
• On Windows, select Start → All Programs → Xilinx Design Tools → DocNav. • At the Linux command prompt, enter docnav. Xilinx Design Hubs provide links to documentation organized by design tasks and other topics, which you can use to learn key concepts and address frequently asked questions. To access the Design Hubs: •...
Page 36
Appendix A: Additional Resources and Legal Notices Alveo Documents 1. Alveo X3522 Data Sheet (DS1002) 2. Alveo X3522 User Guide (UG1523) 3. Alveo Card Debug Guide (XD027) 4. Alveo Data Center Accelerator Card Platforms User Guide (UG1120) Onload Documents 1. Onload User Guide (UG1586) Vivado Documents 1.
Page 37
IP cores may be subject to warranty and support terms contained in a license issued to you by Xilinx. Xilinx products are not designed or intended to be fail-safe or for use in any application requiring fail-safe performance; you assume sole risk and liability for...
Page 38
Spartan, Versal, Vitis, Virtex, Vivado, Zynq, and other designated brands included herein are trademarks of Xilinx in the United States and other countries. PCI, PCIe, and PCI Express are trademarks of PCI-SIG and used under license. All other trademarks are the property of their respective owners.