Renesas RZ Series Demonstration Manual
  1. Manuals
  2. Brands
  3. Renesas Manuals
  4. Scouting Camera
  5. RZ Series
  6. Demonstration manual
Renesas RZ Series Demonstration Manual

Renesas RZ Series Demonstration Manual

Hide thumbs Also See for RZ Series:
Table of Contents

Advertisement

Quick Links

Download this manual
Renesas RZ Family
Trail Camera Demonstration Guide
Introduction
This document describes a battery-powered camera system targeted for the Trail Camera use case. This
system architecture is not limited to the Trail camera use case but can support other battery-operated camera
use cases, such as security cameras.
This camera system contains two processor modules. First is the Renesas RZ/V2L SoC running Yocto Linux.
This is the main processor and performs AI inference using the on-chip DRP-AI module on the captured images
to identify objects. The second is the RA2E1 MCU. This is an external microcontroller that is responsible for
handling motion detection and waking up the main RZ/V2L processor. The RZ/VL also has an on-chip CM33,
which is simultaneously powered on to quickly capture and store images from the camera sensor for post-
processing by A55, ISP, and the DRP-AI cores.
One of the key highlights of this design includes optimizing the Linux boot-up time to less than 2s and capturing
a valid image within 500ms from power up. This is vital for any battery-operated camera system for various
use cases.
Required Resources
Development Tools and Software
The following tools are used for development:
•
2
Renesas e
studio IDE (
installation.
•
SEGGER JLink software
•
Tera Term
(Download File List - Tera Term -
•
Minicom on Ubuntu host machine for accessing UART on Linux.
Hardware
•
Avnet RZ/V2L Board
•
Renesas RA2E1 MCU board
microprocessors/ra-cortex-m-mcus/rtk7fpa2e1s00001be-ra2e1-fast-prototyping-board).
•
Windows PC with Tera Term software and admin privileges.
•
Ubuntu 20.04 host environment as native install, VM or docker environment: For working on Yocto
distro's.
•
UART TTL cables (Raspberry Pi compatible) featuring FTDI chipset. We do not recommend
PL2302-based UART TTL cables as they have shown some issues with Windows drivers.
•
Micro USB cables to interface with the host machine.
•
Jumper wires.
•
Micro-HDMI to HDMI display interface
•
Ethernet cable
•
USB2.0 ethernet dongle.
•
Power supply that can provide 5V at 500mA with micro-USB pin.
•
Power supply that can provide 5V at 2.5 A with USB-C pin.
R12UZ0160EU0106 Rev.1.60
Jul.17.24
e² studio | Renesas
(SEGGER - The Embedded Experts - Downloads - J-Link /
(RZBoard V2L | Avnet
(https://www.renesas.com/us/en/products/microcontrollers-
) . Please ensure FSP v3.6.0 is installed during
OSDN) on Windows PC.
Boards).
User Guide
J-Trace).
Page 1 of 49

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the RZ Series and is the answer not in the manual?

Questions and answers

Related Manuals for Renesas RZ Series

Summary of Contents for Renesas RZ Series

  • Page 1 This camera system contains two processor modules. First is the Renesas RZ/V2L SoC running Yocto Linux. This is the main processor and performs AI inference using the on-chip DRP-AI module on the captured images to identify objects.

  • Page 2: Table Of Contents

    Trail Camera Reference Design Contents Trail Camera Subsystem Overview ..................4 RZBoard V2L ............................4 Renesas RA2E1 Fast Prototyping Board....................4 Key Features ........................... 5 RZ/V2L MPU Subsystem ......................5 Operational Flow ............................. 5 Fast Boot Linux Overview ........................7 RA2E1 MCU Subsystem ......................
  • Page 3 Renesas RZ Family Trail Camera Reference Design 10.3 PMOD Motion on/off-board ........................35 10.4 Wiring Procedure ........................... 36 10.5 How to get the console after bootup...................... 39 10.6 Application flow in details ........................40 10.7 Demo Inference App..........................41 10.8 Camera Operation ..........................41 10.9 Flashing prebuilt images on FPB-RA4E1 MCU board (Segger JLink boards)........

  • Page 4: Trail Camera Subsystem Overview

    RZBoard V2L is a power-efficient, vision-AI accelerated development board in a popular single-board computer format with well-supported expansion interfaces. This Renesas RZ/V2L processor-based platform is ideal for developing cost-efficient Vision-AI and a range of energy-efficient Edge AI applications. The RZ/V2L processor has two 1.2GHz Arm®...

  • Page 5: Key Features

    Renesas RZ Family Trail Camera Reference Design The image below highlights the key hardware components in the Trail Camera System. Figure 1. Trail Camera Overview 2. Key Features The trail camera application provides the following feature set: 1. Booting Linux in less than 2 sec.
  • Page 6 Renesas RZ Family Trail Camera Reference Design Figure 2. Trail Camera boot operational flow By default, the main processor RZ/V2L is in a power-off state to conserve battery. The RA2E1 MCU is kept on power ON to detect motion using the onboard proximity sensor. Once motion is detected, RA2E1 wakes up the RZ/V2L processor, which boots up the Linux OS.

  • Page 7: Fast Boot Linux Overview

    Renesas RZ Family Trail Camera Reference Design 3.2 Fast Boot Linux Overview One of the key requirements of any camera system in the market is to optimize the booting process of the Linux kernel to allow the processing of the captured images. This reference application achieves this by removing unwanted services and drivers loaded by default during the boot process.
  • Page 8 Renesas RZ Family Trail Camera Reference Design Figure 5. Necessary services of Systemd for Trail camera application R12UZ0160EU0106 Rev.1.60 Page 8 of 49 Jul.17.24...

  • Page 9: Ra2E1 Mcu Subsystem

    Renesas RZ Family Trail Camera Reference Design The optimized kernel only enables the necessary peripherals, as shown below: Figure 6. Post init boot of Trail Camera application With the above optimization, the reference application achieves the following: 1) Boot up the Linux kernel in less than 2s.

  • Page 10: Build Rz/V2L Linux Package

    Renesas RZ Family Trail Camera Reference Design Figure 7. MCU subsystem operational flow 5. Build RZ/V2L Linux Package 5.1 Setup Build Environment 5.1.1 Requirements • Ubuntu 20.04 LTS (64bit) is recommended as a build environment as we are using the ‘Dunfell’...
  • Page 11 Renesas RZ Family Trail Camera Reference Design 4. Download the following packages provided by Renesas. Use the highlighted download links and follow the links. File Name Version Download Comments Link RTK0EF0045Z0024AZJ- v3.0.4 rzv-verified- This is the VLP release package, v3.0.4.zip...

  • Page 12: Initiate Yocto Build

    Renesas RZ Family Trail Camera Reference Design 5.2 Initiate Yocto Build Add execute permission to the ‘rz_yocto.sh’ script file. $ chmod a+x rz_yocto.sh $ ./rz_yocto.sh setup rz_avnet To set up the yocto packages and prepare the build, run the following command: The above command will: 1.
  • Page 13 RA2E1 MCU project. 3. Click Launch to start e studio in the specified path. When prompted, log into your My Renesas account or click Cancel to dismiss the popup window asking for permission to log and report usage (it will remain disabled).
  • Page 14 Renesas RZ Family Trail Camera Reference Design 5. Go to File -> Import. Click import. Figure 11. Import menu option. 6. Expand General -> Existing Project Into workspace. Click Next. Figure 12. Import option for existing projects. R12UZ0160EU0106 Rev.1.60 Page 14 of 49...

  • Page 15: Build E Studio Project

    Renesas RZ Family Trail Camera Reference Design 7. On the Import dialog, Click Select archive file. Then click on Browse and navigate to the lab materials folder. Select the Motion_sensor_FPB_RA2E1.zip archive file to import from. Figure 13. Selecting archive file location.

  • Page 16: Programming The Platform

    Renesas RZ Family Trail Camera Reference Design The toolchain will report compilation and build status to the console pane in the lower-right corner of studio. When the build is completed, it should confirm that there are zero errors and zero warnings.
  • Page 17 Renesas RZ Family Trail Camera Reference Design Figure 17. Firmware update notification from JLink module 3. Windows could also prompt you to allow the gdb server through your firewall. Click the checkbox to allow it through private networks, then Allow access.

  • Page 18: Programming Rzboard V2L

    Renesas RZ Family Trail Camera Reference Design 7.3 Programming RZBoard V2L At this stage, it is assumed that the user followed the instructions to build the Linux package. The output images can be found under the ‘~/yocto/output/’ folder. Please note that this location only holds the images, not a formatted release package. The images will need to be packaged with the scripts manually.

  • Page 19: Ai Inference Application

    Renesas RZ Family Trail Camera Reference Design Figure 21. Post init application flow with auto-launch. 8.1 AI Inference Application The following diagram shows the general flow of the AI inference application. R12UZ0160EU0106 Rev.1.60 Page 19 of 49 Jul.17.24...
  • Page 20 Renesas RZ Family Trail Camera Reference Design Figure 22. AI application flow. The following is the image of the RZBoard on display. Figure 23. DRP-AI post-processed image The console log for the image looks as follows: R12UZ0160EU0106 Rev.1.60 Page 20 of 49...

  • Page 21: Flashing Prebuilt Images

    Renesas RZ Family Trail Camera Reference Design Figure 24. AI inference application console logs. It will differ based on the environment and target image. The darknet YOLOV3 model deployed in the demo application can identify multiple objects from the same image in seconds.

  • Page 22: Flashing Procedure On Windows

    Renesas RZ Family Trail Camera Reference Design The image below shows a disassembled trail camera RZBoard used to demonstrate the needed IO connections. Figure 25. Trail Camera disassembled RZBoard to demonstrate IO connections for flashing. 9.1.2 Flashing procedure on Windows The Release package contains a directory named ‘RZBoard_Windows_Flashing.’...
  • Page 23 Renesas RZ Family Trail Camera Reference Design Below is a summary of the flashing process. Figure 27. RZBoard flashing process summary. The following is the flashing procedure. R12UZ0160EU0106 Rev.1.60 Page 23 of 49 Jul.17.24...
  • Page 24 Renesas RZ Family Trail Camera Reference Design 1. Before performing image flashing, ensure the ‘Fastboot USB driver’ is installed on the Windows host PC. Check the Appendix section for more details. 2. Connect the UART TTL cable to the Avnet board’s UART port.
  • Page 25 Renesas RZ Family Trail Camera Reference Design 9. On the host machine, execute the batch script ‘usb_bootloader.bat.’ Figure 30. Select the script ‘usb_bootloader.bat’ to run. 10. Power on the board and observe the host pc running the flashing commands. This stage uses UART file transfer to load bootloaders onto the QSPI or flash.
  • Page 26 Renesas RZ Family Trail Camera Reference Design Figure 32. UART Load of fip binary. 12. Wait for it to complete. Once it’s done flashing, close the Tera Term. You should see a print like the one below. Figure 33. UART flashing console debug info from the board.
  • Page 27 Renesas RZ Family Trail Camera Reference Design 14. Remove the jumper wire you inserted in step 8. Proceed to set up the hardware connection as shown below by changing the boot switch settings to boot from QSPI. Figure 34. RZBoard normal boot hardware configuration.
  • Page 28 Renesas RZ Family Trail Camera Reference Design 18. In a couple of minutes, it will complete the image flash onto the emmc. 19. After the system image flashing is completed, IPL and ATF will be written into QSPI flash. Figure 36. SQPI flash is erased to prepare for flashing optimized IPLs 20.

  • Page 29: Flashing Procedure On Linux

    Renesas RZ Family Trail Camera Reference Design Close the Tera Term. 21. Power off and then power on the board. 22. It will boot normally, and the TTL UART will show boot up of the log that looks like the following image: Figure 38.
  • Page 30 Renesas RZ Family Trail Camera Reference Design Below is a summary of the flashing process. Figure 40. RZBoard Linux flashing process summary The following is the flashing procedure. R12UZ0160EU0106 Rev.1.60 Page 30 of 49 Jul.17.24...
  • Page 31 Renesas RZ Family Trail Camera Reference Design 1. Before performing image flashing, ensure all necessary packages are installed on the Linux host PC. See the Appendix section for more details. 2. Connect the UART TTL cable to the Avnet board’s UART port.
  • Page 32 Renesas RZ Family Trail Camera Reference Design Figure 42. UART load of Flash Writer, ATF, and U-Boot binary 13. Power off the board. The script on the Linux Host PC still runs, and it shows ‘Waiting for device…’ on the terminal.

  • Page 33: Programming The Sensing Mcu With Prebuilt Images

    Build RA2E1 MCU Package. Additional tools like the Renesas Flash programmer and Segger JLinkCommander can be used to flash the board. These are beyond the scope of this document. The product links to Renesas Flash Programmer and JLink/J-Trace are as follows: •...
  • Page 34 Renesas RZ Family Trail Camera Reference Design 4. Check the log at the end. PS C:\Renesas\Trail-Camera\Trail_Camera- System_Release_Package_v1.6\images\Download_Script_RA2E1> .\BL2_download.bat … … Connecting the tool (E2 emulator Lite) Tool: E2 emulator Lite (OBE130001) Interface: 2 wire UART Tool Firmware Version: V3.03.00.005 Emulator power supply: OFF...

  • Page 35: Appendix

    Premade units are usually back-ordered. Hence, it’s more likely that a unit is built from parts. This is relatively simple and requires the bare minimum of skills. For questions about ordering parts and components, please get in touch with sales@renesas.com. 10.2 Prerequisites:...

  • Page 36: Wiring Procedure

    Renesas RZ Family Trail Camera Reference Design 10.4 Wiring Procedure Step 1. Connect QCIOT-014 Motion Sensor board to PMOD1 on FPB-RA2E1 board. Figure 47. QCIOT-14 board connected to FPB-RA2E1 pmod1 Step 2. Connect the Switch to PMOD2 on FPB-RA2E1. Figure 48. Button board as well as QCIOT-14 board connected to FPB-RA2E1 board Step 3.
  • Page 37 Renesas RZ Family Trail Camera Reference Design To provide 5V, connect as follows: Motion Board FPB-RA4E1 Positive J2-5 Negative J2-6 Note: The dot mark near J2 indicates pin1. Step 4. Connect a jumper wire on J5-8. Connect the other end to the CEN pin on the RZBoard.
  • Page 38 Renesas RZ Family Trail Camera Reference Design Step 5. Short the SW1 switch on the RZBoard. Figure 51. SW1 switch on RZBoard Step 6. Short Pin 1-2 on CN1 connector. Figure 52. Pin 1-2 on CN1 connector R12UZ0160EU0106 Rev.1.60 Page 38 of 49...

  • Page 39: How To Get The Console After Bootup

    Renesas RZ Family Trail Camera Reference Design Step 7. Connect FPB-RA4E1 to the laptop using a USB cable. Step 8. Flash the code on FPB-RA2E1. Step 9. Short Pin 2-3 on CN1 connector. Figure 53. The FPB-RA2E1 and RZBoard Step 10. Turn ON the FPB-RA2E1 and RZBoard.

  • Page 40: Application Flow In Details

    Renesas RZ Family Trail Camera Reference Design Figure 54. Drop into console post-bootup. 10.6 Application flow in details The RZBoard image contains a script in /home/root/app-run/capture_v1.0.sh which does the following: 1. Checks for command line options and executes appropriate applications. It has two arguments: a.

  • Page 41: Demo Inference App

    Renesas RZ Family Trail Camera Reference Design 10.7 Demo Inference App The sample application at /home/root/app-run/exe is called ‘sample_app_yolo_v3_img’. This application performs the following: 1. Get the selected image from the second argument of the ‘capture_v1.0.sh’ script. 2. Copies the appropriate DDR buffer of the selected image. It then creates a bitmap file called ‘sample.bmp’...

  • Page 42: Installing Fastboot Usb Driver On Windows

    Renesas RZ Family Trail Camera Reference Design Check the log at the end. SEGGER J-Link Commander V7.80 (Compiled Sep 9 2022 11:04:40) DLL version V7.92a, compiled Aug 16 2023 15:34:08 J-Link Command File read successfully. Processing script file... J-Link>device R7FA4E10D …...
  • Page 43 Renesas RZ Family Trail Camera Reference Design 2. Right-click on it and select ‘Install’ Figure 57. Android Fastboot USB driver installation window 3. If a ‘User Account Control’ window appears, click ‘Yes.’ 4. Click ‘Install’ in the ‘Windows Security’ window.

  • Page 44: Installing Necessary Packages To Run The Support Script For Programming Rzboard Images On Linux

    Renesas RZ Family Trail Camera Reference Design Figure 59. Successfully install the Android Fastboot USB driver 10.11 Installing necessary packages to run the support script for programming RZBoard images on Linux Installation of some packages is required on your Linux machine when using the support script ‘usb_util.py’...

  • Page 45: References

    RZ/V2L - General-Purpose Microprocessor Equipped with "DRP-AI" and 3D GPU Wiki: RZ/V Series 64-bit MPU - Renesas.info RZ/V Software Tools and Scripts – Renesas.info DRP-AI tools: 11.1 IP Configuration IP address is a bit tricky to get right. It often won’t show up unless the port is powered up, and it gets complicated to identify the interface name and ensure there is an address on it.

  • Page 46: Website And Support

    Renesas RZ Family Trail Camera Reference Design 12. Website and Support Visit the following URLs to learn about key elements of the RA family, download components and related documentation, and get support: RA Product Information http://www.renesas.com/rz RA Product Support Forum https://community.renesas.com/rz...

  • Page 47: Revision History

    Renesas RZ Family Trail Camera Reference Design Revision History Description Rev. Date Page Summary — 1.00 Sep.13.23 First release featuring: • Sys-V init optimized for 1.8-sec boot. • Renesas Fast-boot. • Yolov3 application using drp-ai. • VLP 3.0.0 and dependencies.
  • Page 48 Unit Products The following usage notes are applicable to all Microprocessing unit and Microcontroller unit products from Renesas. For detailed usage notes on the products covered by this document, refer to the relevant sections of the document, as well as any technical updates that have been issued for the products.
  • Page 49 Renesas Electronics disclaims any and all liability for any damages or losses incurred by you or any third parties arising from the use of any Renesas Electronics product that is inconsistent with any Renesas Electronics data sheet, user’s manual or other Renesas Electronics document.

Table of Contents