Advertisement

Stingray™ PS225
Quick Start Guide
User Guide
Broadcom Confidential
5880X-PS225-UG101
December 12, 2018

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the Stingray PS225 and is the answer not in the manual?

Questions and answers

Summary of Contents for Broadcom Stingray PS225

  • Page 1 Stingray™ PS225 Quick Start Guide User Guide Broadcom Confidential 5880X-PS225-UG101 December 12, 2018...
  • Page 2 The term “Broadcom” refers to Broadcom Inc. and/or its subsidiaries. For more information, please visit www.broadcom.com. Broadcom reserves the right to make changes without further notice to any products or data herein to improve reliability, function, or design. Information furnished by Broadcom is believed to be accurate and reliable. However, Broadcom does not assume any liability arising out of the application or use of this information, nor the application or use of any product or circuit described herein, neither does it convey any license under its patent rights nor the rights of others.
  • Page 3: Table Of Contents

    5 Setting Up a Linux Distribution rootfs on the PS225....................19 5.1 Running Ubuntu on a PS225 ..........................19 5.1.1 Setting Up Ubuntu on a PS225........................19 5.2 Running CentOS on a PS225 ..........................25 5.2.1 Setting Up CentOS on the PS225 ......................25 Revision History................................30 Broadcom Confidential 5880X-PS225-UG101...
  • Page 4: Introduction

    ® Broadcom PS225 SmartNIC adapters, based on Broadcom's latest data center SoC technology, offer groundbreaking network and compute power in a compact package. The PS225 adapters are PCI Express low-profile, half-length adapters, and provide two 25-Gigabit Ethernet (25GbE) ports along with eight 64-bit ARMv8 processors running at an unmatched 3.0 GHz clock rate.
  • Page 5: Board Features

    – NC-SI over MCTP (SMBus, PCIe VDM) – NC-SI over RMB (via separate connector) Form Factor:  – PCI Express CEM specification for half-height, half-length adapters – I/O brackets available in both low profile and full height Broadcom Confidential 5880X-PS225-UG101...
  • Page 6: Package Contents

    1.3 Package Contents The PS225 package contains the following components: PS225 adapter with low-profile bracket installed  Full-height bracket  The PS225 card with a low-profile bracket installed is shown in Figure Figure 2: PS225 with Low-Profile Bracket Broadcom Confidential 5880X-PS225-UG101...
  • Page 7: Ps225 Card Variants

    PS225-H16 (16 GB DDR4, part number BCM958802A8021C)  The back of the card contains a sticker that indicates the board type. Figure 3 shows an example of the 4G card label on a preproduction adapter. Figure 3: Example Label   Broadcom Confidential 5880X-PS225-UG101...
  • Page 8: Checklist

    Express 3. Install the latest binary/image package for the PS225. Upgrade if the PS225 card received has an old image. To check the image version information, refer to docSAFE (the Broadcom documentation portal) to download the NOTE: binary package required for the specific card type.
  • Page 9 Supported Nitro profile configurations in the PS225 released image package are as follows: stingray_4p.pkg stingray_2p.pkg stingray_1p.pkg BCM958802A8048C.pkg bcm958802a8048_8+8_pf_rdma.pkg bcm958802a8048_2xAN.pkg bcm958802a8048_2xAN_8+5_pf_rep.pkg bcm958802a8048_2xAN_8+4_pf_rep.pkg bcm958802a8048_2xAN_8+4_pf.pkg bcm958802a8048_2xAN_8+3_pf.pkg bcm958802a8048_2xAN_8+2_baremetal.pkg bcm958802a8048_2x25g.pkg bcm958802a8048_2x25g_8+5_pf_rep.pkg bcm958802a8048_2x25g_8+4_pf_rep.pkg bcm958802a8048_2x25g_8+4_pf.pkg bcm958802a8048_2x25g_8+3_pf.pkg bcm958802a8048_2x25g_8+2_baremetal.pkg bcm958802a8048_2x10g.pkg bcm958802a8048_2x10g_8+5_pf_rep.pkg bcm958802a8048_2x10g_8+4_pf_rep.pkg bcm958802a8048_2x10g_8+4_pf.pkg bcm958802a8048_2x10g_8+3_pf.pkg bcm958802a8048_2x10g_8+2_baremetal.pkg bcm958802a8048_1xAN.pkg bcm958802a8048_1x25g.pkg bcm958802a8048_1x10g.pkg Broadcom Confidential 5880X-PS225-UG101...
  • Page 10: Initial Board Setup And Connectivity

    Connect the other port of the PS225 card to an Ethernet switch (see Figure b. Insert the 3.5 mm plug of a USB serial cable to the 3.5 mm socket on the front panel (see Figure Broadcom Confidential 5880X-PS225-UG101...
  • Page 11: Setting Up The Serial Console (Optional)

    3. Access the ARM A72 console using a terminal emulator and configure the UART as follows: – Baud rate: 115200 – Data: 8-bit – No parity – Stop bit – No flow control A typical Linux setup for Minicom is shown in the following screen capture: Broadcom Confidential 5880X-PS225-UG101...
  • Page 12: Accessing The Ps225 From An X86 Host

    The instructions in this document assume that the GA 1.0.2 (or later) SmartNIC software release is preloaded on NOTE: the PS225. Contact Broadcom support regarding the software version that was delivered on the card. If a card is delivered with older software, contact Broadcom support for upgrade procedures. The upgrade procedure described in this document does not apply to releases earlier than GA 1.0.2.
  • Page 13: Assigning An Ip Address To The First New Host Interface

    : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 00:10:18:de:06:0e brd ff:ff:ff:ff:ff:ff enp1s0f7d1 : <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN mode DEFAULT group default qlen 1000 link/ether 00:10:18:de:06:0f brd ff:ff:ff:ff:ff:ff Broadcom Confidential 5880X-PS225-UG101...
  • Page 14 PCIe x8 Port0 Port0 Port1 Port1 192.168.1.10 is always assigned to enp8p1s0f0np0 interface on new PS225 boards. Change A72 CPUs A72(MAIA) cores to ports /etc/network/interfaces as Host(x86) to ports appropriate for your setup. Host(x86) to A72(MAIA) cores Broadcom Confidential 5880X-PS225-UG101...
  • Page 15 The content can be completely reused, but the highlighted items must be replaced. The variables NAME and DEVICE contain the interface name that was determined above. The variable UUID contains the ID of the interface, which can be obtained by running uuidgen ens4f0. Broadcom Confidential 5880X-PS225-UG101...
  • Page 16: Establishing An Ssh Connection To The Ps225

    Last login: Fri Feb 16 22:19:21 2018 root@bcm958802a8048c:~# During the first run, it is recommended to execute uname -a to verify that the latest kernel available for the PS225 is being used (verify the latest kernel with the Broadcom support team). Broadcom Confidential 5880X-PS225-UG101...
  • Page 17: Upgrading The Ps225 Software

    If the reboot or poweroff command is applied on the x86 host after the PS225 update, ensure that the L2 driver NOTE: bnxt_en is removed (sudo modprobe -r bnxt_en command on the x86 host side) so that the resources on the host are free. Broadcom Confidential 5880X-PS225-UG101...
  • Page 18 Host CPUs HTTP server 192.168.1.20 enp1s0f0 (PF8) PCIe x8 Port0 Port0 Port1 Port1 update-me.sh –s 192.168.1.20 –d nic –i all –t tftp Execute on the A72(MAIA console) A72 CPUs to upgrade the software image. Host(x86) to A72(MAIA) cores Broadcom Confidential 5880X-PS225-UG101...
  • Page 19: Setting Up A Linux Distribution Rootfs On The Ps225

    6. Mount the newly created partition to a directory of choice (for example, /mnt) using the following commands: root@bcm958802a8048c:~# mkdir /mnt/ubuntu root@bcm958802a8048c:~# mount /dev/mmcblk0p5 /mnt/ubuntu 7. Download the latest 16.04 ARM64 image from Ubuntu to the x86 host and untar it on the PS225. See the following commands: Broadcom Confidential 5880X-PS225-UG101...
  • Page 20 /mnt/ubuntu c. Remove cloud init from this prebuilt image (since it interferes with normal boot) with the following command: \u@\h:\w$ dpkg --purge cloud-init d. Add getty for ttyS0 with the following commands: \u@\h:\w$ cp /etc/init/ttyAMA0.conf /etc/init/ttyS0.conf Broadcom Confidential 5880X-PS225-UG101...
  • Page 21 /etc/hosts, and add the following line (in blue): lab@ubuntu:/$ sudo nano /etc/hosts 127.0.0.1 localhost 127.0.1.1 ubuntu b. Continue to load the driver and setup the network interface as follows: lab@ubuntu:~$ sudo depmod -a # apply only at the very first boot Broadcom Confidential 5880X-PS225-UG101...
  • Page 22 RX packets:1183 errors:0 dropped:0 overruns:0 frame:0 TX packets:1321 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:381443 (381.4 KB) TX bytes:271592 (271.5 KB) enp8s0f4 Link encap:Ethernet HWaddr 00:10:18:ad:05:0c UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1186 errors:0 dropped:0 overruns:0 frame:0 Broadcom Confidential 5880X-PS225-UG101...
  • Page 23 -A FORWARD -i eno2 -o enp8s0f0 -m state --state RELATED,ESTABLISHED -j ACCEPT byang@byang-PowerEdge-2950:~$ sudo iptables -A FORWARD -i enp8s0f0 -o eno2 -j ACCEPT d. On PS225, configure default gateway and DNS server with the following commands: Broadcom Confidential 5880X-PS225-UG101...
  • Page 24 Install gcc, for example. lab@ubuntu:/$ sudo apt install gcc lab@ubuntu:~$ sudo su root@ubuntu:~$ sed 's/PasswordAuthentication/# PasswordAuthentication/g' -i /etc/ssh/sshd_config root@ubuntu:/home/lab# dpkg-reconfigure openssh-server h. On the host, SSH from the host to the PS225 using the following command: byang@byang-PowerEdge-2950:~$ ssh lab@192.168.1.10 Broadcom Confidential 5880X-PS225-UG101...
  • Page 25: Running Centos On A Ps225

    Ensure connectivity with the host and PS225 with the following commands: byang@byang-PowerEdge-2950:~$ sudo insmod ~/temp/bnxt_en-1.8.29/bnxt_en.ko byang@byang-PowerEdge-2950:~$ sudo ifconfig enp8s0f0 192.168.1.20 up ; ping 192.168.1.10 c. On the PS225, SCP the CentOS image with the following command: cd /mnt/centos Broadcom Confidential 5880X-PS225-UG101...
  • Page 26 10. Provide connectivity to the host using the following steps: a. Install modules copied in Step Step If the insmod'ed bnxt_en.ko module in Yocto Linux has been previously installed, power cycle the system and try NOTE: again. Broadcom Confidential 5880X-PS225-UG101...
  • Page 27 HWaddr 00:10:18:ad:05:08 inet addr:192.168.1.20 Bcast:192.168.1.255 Mask:255.255.255.0 inet6 addr: fe80::210:18ff:fead:508/64 Scope:Link UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1 RX packets:1661 errors:0 dropped:0 overruns:0 frame:0 TX packets:344 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:481235 (481.2 KB) TX bytes:32437 (32.4 KB) Broadcom Confidential 5880X-PS225-UG101...
  • Page 28 Link encap:Local Loopback inet addr:127.0.0.1 Mask:255.0.0.0 inet6 addr: ::1/128 Scope:Host UP LOOPBACK RUNNING MTU:65536 Metric:1 RX packets:2002 errors:0 dropped:0 overruns:0 frame:0 TX packets:2002 errors:0 dropped:0 overruns:0 carrier:0 collisions:0 txqueuelen:1000 RX bytes:170071 (170.0 KB) TX bytes:170071 (170.0 KB) Broadcom Confidential 5880X-PS225-UG101...
  • Page 29 -t nat -A POSTROUTING -o eno2 -j MASQUERADE byang@byang-PowerEdge-2950:~$ sudo iptables -A FORWARD -i eno2 -o enp8s0f0 -m state --state RELATED,ESTABLISHED -j ACCEPT byang@byang-PowerEdge-2950:~$ sudo iptables -A FORWARD -i enp8s0f0 -o eno2 -j ACCEPT 15. Test the configuration by accessing www.google.com. lab@ubuntu:/$ ping google.com Broadcom Confidential 5880X-PS225-UG101...
  • Page 30: Revision History

    PS225 User Guide Quick Start Guide Revision History 5880X-PS225-UG101; December 12, 2018 Updated: Upgrading the PS225 Software  5880X-PS225-UG100; October 4, 2018 Initial release. Broadcom Confidential 5880X-PS225-UG101...

Table of Contents

Save PDF