SIYI ZT30 User Manual

Ai tracking module ii

Hide thumbs Also See for ZT30:

User manual (96 pages)

User manual (139 pages)

User manual (140 pages)

Table Of Contents

Table of Contents

Quick Links

Download this manual

SIYIAI TRACKING

MODULE II

USER MANUAL

SIYI Technology (Shenzhen) Co., Ltd.

siyi.biz/en

2024 SIYI Technology Copyright

Table of Contents

Need help?

Do you have a question about the ZT30 and is the answer not in the manual?

Questions and answers

Summary of Contents for SIYI ZT30

Page 1 SIYIAI TRACKING MODULE II USER MANUAL SIYI Technology (Shenzhen) Co., Ltd. siyi.biz/en 2024 SIYI Technology Copyright...
Page 2 Thank you for purchasing SIYI’s product. SIYI AI Tracking Module II supports collaborative control with SIYI optical pods and gimbal cameras to achieve real-time tracking and capture of targets and can highlight the tracking target in the picture through real-time focus and zoom.
Page 3 Contact Us: SIYI Official Website ( https://siyi.biz/en SIYI User Group - Facebook Facebook Linkedln YouTube 3 / 67 2024 SIYI Technology Copyright...
Page 4 User Manual Update Log Version Date Updates 2024.5 Initial version. 2024.7 新增输出跟踪目标信息、框选功能 4 / 67 2024 SIYI Technology Copyright...
Page 5: Table Of Contents
1.4 Packing List ..............................13 1.5 Indicator Definition ............................14 1.5.1 Power Indicator ............................14 1.5.2 Status Indicator ............................15 Chapter 2 Get Ready To Use SIYI AI Tracking Module ..................16 2.1 Typical Connection Diagram ........................16 2.1.1 ZT30 ................................. 16 2.1.2 ZT6 ................................17 2.1.3 ZR30 .................................18...
Page 6 3.6 Main Firmware Update Log ..........................38 3.7 SIYI AI SDK ..............................38 3.7.1SDK Protocol Format ..........................38 3.7.2SDK Communication Commands ......................39 3.7.3 SIYI Gimbal Camera SDK Communication Interface ...............42 Chapter 4 SIYI FPV APP ............................46 4.1 Settings ................................48 4.2 Link Status ..............................49 4.3 Gimbal Camera ..............................50...
Page 7: Read Tips
SIYI Technology is not obliged to any of the damage, loss, or injury. It is prohibited to use SIYI products for military purpose. Users under 14 years’ old should follow an experienced trainer’s guide.
Page 8: Storage / Carrying / Recycling
SIYI products should be placed in places which are too hot (above 60℃) or too cold (under -20℃). CAUTION SIYI products should not be placed in places under direct sunshine or too dusty or too wet. Carrying or transporting SIYI products should avoid vibration or shatter by which components may break.
Page 9: Chapter 1 Introduction
Any Object Recognition With the support of the second generation of SIYI AI tracking module, you can deploy recognition, tracking and flight control based on artificial intelligence technology by selecting any conspicuous object in the image.
Page 10 Thermal Imaging Recognition Working together with SIYI optical pod, the second-generation AI tracking module supports the recognition of human and vehicles under thermal imaging. Once selected, the optical pod will lock onto the target, greatly improving search and rescue efficiency in complex situations.
Page 11: Interface & Pinouts
1.2 Interface & Pinouts 11 / 67 2024 SIYI Technology Copyright...
Page 12: Technical Specification
1.3 Technical Specification Compatible Optical ZT30 / ZT6 / ZR30 / ZR10 / A8 mini Pods & Gimbal Cameras Any Object Specific Object Recognizable Object  Insulator Types  Human  Auto Mobile (Car, Truck, Bus)  Boat Computing Power...
Page 13: Packing List
(Connect SIYI AI tracking module’s Ethernet port to SIYI MK15 / HM30 air unit’s Ethernet port) 1 x SIYI AI Tracking Module to SIYI Link Y Cable (A Y cable which connects SIYI AI tracking module with SIYI MK15 / HM30 air unit for powering the AI tracking module, transfer video stream and control signal)
Page 14: Indicator Definition
1.5 Indicator Definition There are two indicators on SIYI AI tracking module to indicate the system’s working or abnormal status: power indicator and status indicator. 1.5.1 Power Indicator Solid Green: Module is powered normally. 14 / 67 2024 SIYI Technology Copyright...
Page 15: Status Indicator
1.5.2 Status Indicator Solid Yellow: Under firmware upgrade. Yellow Blinks: Camera is not connected. Solid Green: System is starting. Green Blinks: System is running normally. Green-Yellow Blinks: Parameter resets successfully. 15 / 67 2024 SIYI Technology Copyright...
Page 16: Chapter 2 Get Ready To Use Siyi Ai Tracking Module
Chapter 2 Get Ready To Use SIYI AI Tracking Module 2.1 Typical Connection Diagram 2.1.1 ZT30 16 / 67 2024 SIYI Technology Copyright...
Page 21: Key Features & Pre-Cautions
 Boat 2.2.1 Function ON / OFF 1. Please refer to Chapter 2.1 in this manual to connect SIYI AI tracking module with SIYI gimbal and SIYI link. 2. Confirm if gimbal camera’s firmware has been upgraded to be compatible with SIYI AI tracking module.
Page 22 4. Run SIYI FPV app, go to “Settings - Addresses”, and select “SIYI AI Camera”. 5. Return to main image, touch the AI tracking function button to enable the function. 6. Touch the button again to disable the function. Mark Using SIYI AI tracking module with multiple-sensor optical pods, in SIYI FPV app, the main stream of the optical pod should be configured as zoom camera.
Page 23: Target Recognition
Go to AI tracking settings, select AI model as “Normal”, enable “License Plate” to start recognizing license plates. Insulator Go to AI tracking settings, select AI model as “Insulator”, enable to start recognizing insulators. 23 / 67 2024 SIYI Technology Copyright...
Page 24 Any Objects Go to AI tracking settings, lock the image, then you can box any targets for recognizing and tracking. Thermal Imaging Under thermal images, SIYI AI Tracking Module II will automatically enable recognition. 24 / 67 2024 SIYI Technology Copyright...
Page 25: Target Tracking
Gimbal camera starts to track the target. Mark Zoom camera will zoom simultaneously during target tracking to keep the target displaying in the center of the image. And the zoom multiples will be displayed as well. 25 / 67 2024 SIYI Technology Copyright...
Page 26: Target Follow
Steps 1. Please refer to the picture below to connect SIYI optical pod (gimbal camera) to flight controller and integrate attitude data. 2. Confirm if the flight controller integration button shows up (which means flight controller attitude data is integrated).
Page 27 3. Switch flight mode to “Guided” and configure the max flight speed. 27 / 67 2024 SIYI Technology Copyright...
Page 28 When encountering obstacles, please immediately take over the flight manually and re-plan the route. When the tracking target is lost, the aircraft will hover. Mark 28 / 67 2024 SIYI Technology Copyright...
Page 29 When the tracked object is higher than the multi-rotor drone on the horizontal plane, AI follow function does not work; when the tracked object and the multi-rotor drone are on the same horizontal plane, AI follow function works best. 29 / 67 2024 SIYI Technology Copyright...
Page 30: Chapter 3 How To Configure The Module
Chapter 3 How To Configure The Module SIYI AI tracking module can be configured through SD card, so does firmware upgrade. Mark It is suggested to format the SD card to FAT32 before firmware upgrade. It is suggested to insert the SD card to the AI tracking module and run it for a while, then you will see the files related to module configuration.
Page 31: Ip Addresses
“192.168.144.60” is the factory default module IP addresses. “192.168.144.12” is the factory default module gateway. 3.1.2 Change IP Addresses Open the “setip.txt” file, input the IP addresses you need after “IP = ”. 31 / 67 2024 SIYI Technology Copyright...
Page 32 After changing module IP addresses, it is necessary to manually input the relevant IP addresses in SIYI FPV app to acquire video & data stream from the AI tracking module. When you are using SIYI AI tracking module with SIYI gimbals and SIYI links, please do configure its IP addresses within “192.168.144.X”...
Page 33: Client (Gimbal Camera) Addresses
Then insert the SD card to the module and power it. After three to five minutes, the new IP addresses will be flashed into module. Then we restart the module to finish changing IP addresses. 33 / 67 2024 SIYI Technology Copyright...
Page 34: Firmware Upgrade
The default IP addresses for SIYI cameras is “192.168.144.25”. If you have changed camera IP addresses, it is necessary to manually input the relevant client addresses for SIYI AI tracking module to establish video & data stream between the AI tracking module and the gimbal camera.
Page 35 1. Save the module firmware’s “.bin” file to the SD / TF card’s root directory and do not change the file name. 2. Insert the SD card with saved firmware to SIYI AI tracking module and power it. 3. Wait for three to five minutes, camera firmware will be flashed automatically and disappear from the SD card.
Page 36: Reset Module Configuration
4. Restart the module to make the configuration work. 3.4 Reset Module Configuration You can reset SIYI AI tracking module to factory configuration by pressing the RST button for five seconds. 3.5 Common IP Addresses SIYI Air Unit IP Address: 192.168.144.11 SIYI Ground Unit IP Address: 192.168.144.12...
Page 37 Network Diagnosis Tool: Ping Tools Mark SIYI cameras released after ZT30 (including ZT30 and ZT6) start to use the new addresses. SIYI cameras released before ZT30 (including ZR30, A2 mini, A8 mini, ZR10, and R1M) are stilling using the old addresses.
Page 38: Main Firmware Update Log
3.6 Main Firmware Update Log No update is available at this moment. 3.7 SIYI AI SDK SIYI AI function provides control protocol for all customers. Please refer to the below guide for secondary development based on SIYI AI functions. 3.7.1SDK Protocol Format...
Page 39: 2Sdk Communication Commands
Eg:0x 88 000100 --> corresponding version number v0.1.0 Note: Byte 4 (high byte) ignored 0x 03: Request AI module to identify status CMD_ID:0x 03 ------ A I module identification status requested send data format 39 / 67 2024 SIYI Technology Copyright...
Page 40 Pick: 0 Frame selection: the y coordinate of the uint16_t touch_ry lower-right vertex of the box. The range is the size of the video stream resolution. 40 / 67 2024 SIYI Technology Copyright...
Page 41 Data Name Data Description Number ACK Data Format uint16_t pos_x Coordinates of the tracking target x uint16_t pos_y Coordinate y of the tracking target Width of the tracking target recognition uint16_t pos_width frame 41 / 67 2024 SIYI Technology Copyright...
Page 42: Siyi Gimbal Camera Sdk Communication Interface
Track_Sta follow. 2: Lost. 3: User cancels tracking. 4: Normal tracking (arbitrary object) 3.7.3 SIYI Gimbal Camera SDK Communication Interface  IP: 192.168.144.60 (default)  Port: 37260  IP: 192.168.144.60  Port: 37260  Heartbeat Packet Data: 55 66 01 01 00 00 00 00 00 59 8B UART Serial Port ...
Page 43 [recv]: 55 66 02 0a 00 bc 04 0a 80 02 75 01 01 05 b1 02 00 00 59 67 CRC16 checksum code const uint16_t crc16_tab[256]; /*********************************************************** CRC16 Coding & Decoding G(X) = X^16+X^12+X^5+1 ***********************************************************/ uint16_t CRC16_cal(uint8_t *ptr, uint32_t len, uint16_t crc_init) uint16_t crc, oldcrc16; uint8_t temp; crc = crc_init; while (len--!=0) 43 / 67 2024 SIYI Technology Copyright...
Page 44 CRC16_cal(pbuf,len, 0); *p_result = crc_result; return 2; const uint16_t crc16_tab[256]= {0x0,0x1021,0x2042,0x3063,0x4084,0x50a5,0x60c6,0x70e7, 0x8108,0x9129,0xa14a,0xb16b,0xc18c,0xd1ad,0xe1ce,0xf1ef, 0x1231,0x210,0x3273,0x2252,0x52b5,0x4294,0x72f7,0x62d6, 0x9339,0x8318,0xb37b,0xa35a,0xd3bd,0xc39c,0xf3ff,0xe3de, 0x2462,0x3443,0x420,0x1401,0x64e6,0x74c7,0x44a4,0x5485, 0xa56a,0xb54b,0x8528,0x9509,0xe5ee,0xf5cf,0xc5ac,0xd58d, 0x3653,0x2672,0x1611,0x630,0x76d7,0x66f6,0x5695,0x46b4, 0xb75b,0xa77a,0x9719,0x8738,0xf7df,0xe7fe,0xd79d,0xc7bc, 0x48c4,0x58e5,0x6886,0x78a7,0x840,0x1861,0x2802,0x3823, 0xc9cc,0xd9ed,0xe98e,0xf9af,0x8948,0x9969,0xa90a,0xb92b, 0x5af5,0x4ad4,0x7ab7,0x6a96,0x1a71,0xa50,0x3a33,0x2a12, 0xdbfd,0xcbdc,0xfbbf,0xeb9e,0x9b79,0x8b58,0xbb3b,0xab1a, 0x6ca6,0x7c87,0x4ce4,0x5cc5,0x2c22,0x3c03,0xc60,0x1c41, 0xedae,0xfd8f,0xcdec,0xddcd,0xad2a,0xbd0b,0x8d68,0x9d49, 0x7e97,0x6eb6,0x5ed5,0x4ef4,0x3e13,0x2e32,0x1e51,0xe70, 0xff9f,0xefbe,0xdfdd,0xcffc,0xbf1b,0xaf3a,0x9f59,0x8f78, 0x9188,0x81a9,0xb1ca,0xa1eb,0xd10c,0xc12d,0xf14e,0xe16f, 0x1080,0xa1,0x30c2,0x20e3,0x5004,0x4025,0x7046,0x6067, 0x83b9,0x9398,0xa3fb,0xb3da,0xc33d,0xd31c,0xe37f,0xf35e, 0x2b1,0x1290,0x22f3,0x32d2,0x4235,0x5214,0x6277,0x7256, 0xb5ea,0xa5cb,0x95a8,0x8589,0xf56e,0xe54f,0xd52c,0xc50d, 0x34e2,0x24c3,0x14a0,0x481,0x7466,0x6447,0x5424,0x4405, 0xa7db,0xb7fa,0x8799,0x97b8,0xe75f,0xf77e,0xc71d,0xd73c, 44 / 67 2024 SIYI Technology Copyright...
Page 45 0x26d3,0x36f2,0x691,0x16b0,0x6657,0x7676,0x4615,0x5634, 0xd94c,0xc96d,0xf90e,0xe92f,0x99c8,0x89e9,0xb98a,0xa9ab, 0x5844,0x4865,0x7806,0x6827,0x18c0,0x8e1,0x3882,0x28a3, 0xcb7d,0xdb5c,0xeb3f,0xfb1e,0x8bf9,0x9bd8,0xabbb,0xbb9a, 0x4a75,0x5a54,0x6a37,0x7a16,0xaf1,0x1ad0,0x2ab3,0x3a92, 0xfd2e,0xed0f,0xdd6c,0xcd4d,0xbdaa,0xad8b,0x9de8,0x8dc9, 0x7c26,0x6c07,0x5c64,0x4c45,0x3ca2,0x2c83,0x1ce0,0xcc1, 0xef1f,0xff3e,0xcf5d,0xdf7c,0xaf9b,0xbfba,0x8fd9,0x9ff8, 0x6e17,0x7e36,0x4e55,0x5e74,0x2e93,0x3eb2,0xed1,0x1ef0 45 / 67 2024 SIYI Technology Copyright...
Page 46: Chapter 4 Siyi Fpv App
Chapter 4 SIYI FPV APP SIYI FPV is an Android application developed by SIYI to configure many SIYI products for video display, camera stream settings, and communication link status monitoring. Mark This chapter is edited based on SIYI FPV App v2.5.15.709.
Page 47 SIYI FPV App OSD Information Definition SIYI FPV Camera Function Icon Definition 47 / 67 2024 SIYI Technology Copyright...
Page 48: Settings
IP addresses, custom app interface, and switch video decoding type. About Settings Camera IP: Select among SIYI AI Camera, SIYI Camera 1 and SIYI Camera 2, between main stream and sub stream, select or input video stream RTSP addresses, disable image, or rotate the relevant image in 180 degrees.
Page 49: Link Status
OSD: Enable / disable standard OSD information. Mavlink OSD: Enable / disable Mavlink OSD information. Speed Unit: Switch speed unit between meter per seconds and kilometer per hour. Longitude and Latitude: Enable / disable information. 49 / 67 2024 SIYI Technology Copyright...
Page 50: Gimbal Camera
4.3 Gimbal Camera Configure the abundant functions of SIYI optical pod and gimbal camera. About Gimbal Camera Boot Record: Enable / disable automatic video recording by SD card as soon as the camera is powered. File Manager: Preview stored images in TF card. Format the TF card.
Page 51  CVBS: Through the CVBS pin in the gimbal camera’s Ethernet port to output videos in analog signal (Only available for ZT6 and A8 mini).  OFF: Through the gimbal camera’s Ethernet only. 51 / 67 2024 SIYI Technology Copyright...
Page 52 It will be AI tracking mode only. Camera Firmware Version: Display current camera firmware version. Gimbal Firmware Version: Display current gimbal firmware version. Zoom Firmware Version: Display current gimbal firmware version (Only available for optical zoom cameras). 52 / 67 2024 SIYI Technology Copyright...
Page 53: About Siyi Fpv
4.4 About SIYI FPV Displays the software version of SIYI FPV and common contact information of SIYI Technology. 53 / 67 2024 SIYI Technology Copyright...
Page 54: Siyi Fpv App Update Log
4.5 SIYI FPV App Update Log Date 2024-04-23 Version 2.5.15.708 1. New: Support the functions of SIYI AI Tracking Module Gen 2 (car plate recognition, insulator recognition, any object recognition) 2. Improve: UI for AI functions. 3. New: Support a new 4K camera. Updates 4.
Page 55: Siyi Fpv Sdk Guide
4. New: Status indication for missing TF card. 4.6 SIYI FPV SDK Guide SIYI provides the SIYI FPV SDK to help professional Android application developers to integrate the unique features in SIYI FPV app to their own GCS. 4.6.1 Access Method a) Add “fpvlib” into Your Project Copy the “fpvlib.aar”...
Page 56 Please pay attention to the below points for your code:  Firstly, use the static method “getInstances()” of “ConnectionManager” to get the “ConnectionManager” object. Then call the “ConnectionManager.checkConnectWithIntent()” method in the lifecycle method “onCreate()” and “onNewIntent()”. 56 / 67 2024 SIYI Technology Copyright...
Page 57: Interface Instructions
Description Single case method getInstance(Context context) “ConnectionManager” addresses video setWirelessUrl(String url1, String url2) stream. checkConnectWithIntent(Intent intent) Initial the connection. Notify that the first “Surface” is notifySurfaceCreate(Surface surface) created, the “Surface” is for video 57 / 67 2024 SIYI Technology Copyright...
Page 58 DEO_URL” “SUB_TCP_VIDEO_URL”. setRectify(Context context, boolean rectify) Attention： If distortion correction is activated, when you switch from SIYI camera addresses “RtspConstants.DEFAULT_TCP_VI DEO_URL” “SUB_TCP_VIDEO_URL” to RTSP addresses, new surface objects should be imported. One way to do 58 / 67 2024 SIYI Technology Copyright...
Page 59 * Set Camera Resolution * @param streamType： * [CameraInfo.STREAM_MAIN], [CameraInfo.STREAM_SUB]. * @param resolution： [CAMERA_RESOLUTION_SD] 480p, [CAMERA_RESOLUTION_HD] 720p, Set camera resolution. [CAMERA_RESOLUTION_FHD] 1080p. * [CAMERA_RESOLUTION_2K] 2K, [CAMERA_RESOLUTION_4K] 4K, fun setResolution(cameraIndex: Int, @CameraInfo.StreamType streamType: Int, @CameraResolution resolution: Int) 59 / 67 2024 SIYI Technology Copyright...
Page 60: Siyi Fpv Sdk Update Log
Version 2.5.13 1. Fix the issue that the video stream of some IP65 cameras may blurr. 2. Add to support ZT30 camera video stream. Updates Mark: It is necessary to update the “so” and “aar” file, which can be updated frm the “aar_so” folder.
Page 61: Chapter 5 After-Sale Service
 Product Defect  Product Damage SIYI products under the two situations can be sent back to SIYI for repairing. Defect products with valid warranty can be repaired for free. Defect products without valid warranty or damaged products should be charged of repair fees after repairing.
Page 62: Warranty
It is requested beyond seven (7) calendar days of receiving a product. A product sent to SIYI for Return & Refund Service does not include all original accessories, attachments or packaging, or any item is not in new or like-new condition, i.e., with cracks, dents, or scratches.
Page 63: 15-Day Replacement
Damage is caused to the product by uncontrollable external factors, including fire, floods, high winds, or lightning strikes. A product is not delivered to SIYI within seven (7) calendar days after Return & Refund Service confirmation is sent from SIYI.
Page 64 Legal proof-of-purchase, receipts, or invoices are not provided, or are reasonably believed to have been forged or tampered with. A product sent to SIYI for replacement does not include all original accessories, attachments, and packaging, or contains items damaged by user error.
Page 65: 1-Year Warranty Repair
Received product has not been sent back to SIYI seven (7) calendar days after replacement confirmation from SIYI. Proof of damage during transit issued by the carrier cannot be provided. Other circumstances stated in this policy. 5.2.3 1-Year Warranty Repair...
Page 66 (i.e., transmitter, video-downlink, Wi-Fi signals, etc.) Damage caused by reliability or compatibility issues when using unauthorized third-party parts. Damage caused by operating the unit with a low-charged or defective battery. 66 / 67 2024 SIYI Technology Copyright...
Page 67 Products or parts with an altered identification label or from which the identification label has been removed. SIYI Technology Business Inquiry: info@siyi.biz Phone: +86 400 838 2918 A/S Center: support@siyi.biz 67 / 67 2024 SIYI Technology Copyright...

This manual is also suitable for:

Zt6 Zr30 Zr10 A8 mini

SIYI ZT30 User Manual

Chapter 1 Introduction

Chapter 2 Get Ready to Use SIYI AI Tracking Module

Chapter 3 How to Configure the Module

Chapter 4 SIYI FPV APP

Chapter 5 After-Sale Service

Quick Links

Need help?

Questions and answers

Related Manuals for SIYI ZT30

Summary of Contents for SIYI ZT30

This manual is also suitable for:

Table of Contents