Advertisement

Quick Links

General Description
The TOFcam-660 is a cost optimized 3D camera. It is based on the
ESPROS proprietary time-of-flight technology using the epc660
TOF flagship chip. The camera controls the illumination and the im-
ager chip to obtain distance and grayscale images. The depth im-
ages are compensated against ambient light, temperature and re-
flectivity of the scene. By using one of the offered ESPROS user
interfaces, 3D point clouds in a cartesian coordinate system are
available. Thanks to the high performance of the imager chip with
the unique ambient light suppression, the camera can be used un-
der full sunlight condition.
This document allows a TOFcam-660 user easily to get the camera
connected and started using a computer. It contains a description
of all features of the device as well as all functions of GUI and ROS
application. The complete description of interfaces, protocols and
commands allows to connect the module to integrated systems. A
software development kit (SDK) with all C++ source codes,
libraries and drivers including is available by ordering the ESPROS
epc660 evaluation kit.
Figure 1: TOFcam-660
Figure 2: Color coded TOF distance
© 2021 ESPROS Photonics Corporation
Characteristics subject to change without notice
Installation and Operation Manual
Features
■ 320 x 240 pixels QVGA resolution (76'800 pixels)
■ Measurement rate up to 20 TOF measurements per second
(1.5 MIO distance and amplitude values per second)
■ Distance measurement and object recognition from centimeters
to 100 meters
■ Four different field of view and operating ranges available
■ Fully calibrated and compensated
■ Sun- and ambient-light tolerant up to 100 kLux
■ GigE and USB interface
■ Various user interfaces: GUI, ROS, Python
□ Evaluation of TOFcam-660 main features
□ Store and recall camera configuration
□ Easy collection of distance data and point clouds
□ Many explanations about "time of flight done right"
Applications
■ Research in various scientific fields
■ IoT applications
■ Evaluation and development of a epc660 based TOF sensor
□ Automatic vehicle guidance, in-cabin monitoring
□ Object classification and safeguarding
□ Face recognition, Gesture control (man-machine-interface)
Figure 3: Point Cloud
Figure 4: Amplitude as logarithmic gray scale
1 / 35
Installation_and_Operation_Manual_TOFcam660_V.02
TOFcam-660
www.espros.com

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the TOFcam-660 and is the answer not in the manual?

Questions and answers

Summary of Contents for ESPROS TOFcam-660

  • Page 1 Installation and Operation Manual General Description Features The TOFcam-660 is a cost optimized 3D camera. It is based on the ■ 320 x 240 pixels QVGA resolution (76'800 pixels) ESPROS proprietary time-of-flight technology using the epc660 ■ Measurement rate up to 20 TOF measurements per second TOF flagship chip.
  • Page 2: Table Of Contents

    Important Notes.....................................3 Abbreviations ................................4 Quick guide ................................6 3.1. Connecting the camera module ................................6 3.2. Camera settings ....................................6 TOFcam-660 time of flight camera ........................... 7 4.1. System overview ....................................7 4.2. Scope of delivery ....................................7 4.3. Ordering information ....................................7 4.4.
  • Page 3: Before You Start

    Download and use the latest software development kit (SDK) “TOFCAM660_SDK” containing all source codes of the firmware, GUI, ROS and API. Unpacking the SDK is password protected. Get back to ESPROS to check whether you fulfill the requirements to get the password.
  • Page 4: Abbreviations

    Root mean square RoHS Restriction of hazardous substances Region of interest in the pixel-field Robot Operating System Receive terminal, data in Software Development Kit © 2021 ESPROS Photonics Corporation 4 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 5 Universal Serial Bus Ultra wide field of view Positive supply voltage Wide field of view Table 1: List of abbreviations used in this document © 2021 ESPROS Photonics Corporation 5 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 6: Quick Guide

    Optimize the color scale (visual graduation) of the relevant objects in your scenery by changing the "Distance min" value. • Change the image type to the illustration of the scenery you like to see. © 2021 ESPROS Photonics Corporation 6 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 7: Tofcam-660 Time Of Flight Camera

    4. TOFcam-660 time of flight camera 4.1. System overview The TOFcam-660 is a general purpose camera based on the ESPROS epc660 cwTOF imager chip: • 24VDC power supply input • RJ45 LAN connector • General purpose I/O connector • NXP I.MX RT1062 microcontroller •...
  • Page 8 Included in TOFcam-660 basic unit. To connect the camera to a corresponding power supply. P100 609 Power adapter cable Cable to connect a TOFcam-660 directly with the power supply P100 282 P100 282 Power Supply 24VDC Input 100 … 240V DC output: 24V, 2.5A...
  • Page 9: Technical Data

    Channel 15 / 34 approx. Channel 16 / 30 Integration time selectable for distance 4'000 µs Integration time selectable for gray scale 100'000 µs © 2021 ESPROS Photonics Corporation 9 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 10: Mechanical Data

    Camera housing and heat sink Backside mounting holes (4x) Power and GPIO Connector Lens window (Rx) LAN-Connector with status LED Figure 8: Mechanical features © 2021 ESPROS Photonics Corporation 10 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 11: Mechanical Dimensions

    Term Block, R/A, 6 Pos STR 2.5mm Matching plug: Term Block Plug, 6 Pos STR 2.5mm Accessory: For matching connector plug refer to Chapter 4.3. © 2021 ESPROS Photonics Corporation 11 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 12: Ip Reset Button

    4.6.3. IP reset button If you get no connection to a TOFcam-660 with changed and unknown IP address the IP reset button allows you to reset the IP to factory standard of 10.10.31.180. Therefore press the button for 5 seconds during start-up of the camera.
  • Page 13: Firmware Upgrade

    Open a new browser-window Type the current IP of the TOFcam-660 into the address line of the browser Erase the current camera application. You need to confirm the deletion using the passowrd TOFcam-660 Choose the update file (usually cameraApplication_XiP.bin) by browsing your harddisk.
  • Page 14: Gui

    Detailed information about pixel groups or one single pixel can be illustrated. For the whole GUI there are helpful tooltips available. These tooltips pop-up by moving the cursor either to the corresponding text (refer to Figure 15). © 2021 ESPROS Photonics Corporation 14 / 35 Installation_and_Operation_Manual_TOFcam660_V.02...
  • Page 15 Please investigate the TOF theory to become familiar with the physical context. A very helpful lecture might be the book “3D-TOF, A guideline to 3D-TOF sensors that work” by ESPROS Photonics Corp. (author Beat De Coi et. al.).
  • Page 16 The ROI (region of interest) allows to reduce the active pixel field. Only pixels within the selected ROI will be acquired. The “Default ROI” button resets the ROI to full imager size of 320 x 240 pixels. Figure 15: Tooltip examples © 2021 ESPROS Photonics Corporation 16 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 17: Play Menu

    With several controls the image can be adjusted to users needs: mirror and rotation functions to adjust the image according to the camera installation position and direction of view, region of interest and all info and scope functions with dedicated information as described in Chapter 5.1.5. © 2021 ESPROS Photonics Corporation 17 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 18: Point Cloud

    Using keyboard and mouse allows further controls of the point cloud illustration. Activating the “Settings“ allows additional fine tuning of the point cloud visualization. Figure 20: Point Cloud Controls Figure 19: Point Cloud Settings © 2021 ESPROS Photonics Corporation 18 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice...
  • Page 19: Decided Information Windows

    The time scope is used to plot the chronologic distance and / or amplitude values of a single pixel or a averaged values of a selected area of the pixel field. Figure 21: Pixel data Figure 22: Pixel Scope Figure 23: Time Scope © 2021 ESPROS Photonics Corporation 19 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 20: Network Settings

    It is possible to change the IP address, subnet mask and the gateway of the camera. “Apply IP” permanently stores the current network settings of the TOFcam-660 currently connected. It is also possible to set a MAC address to the device.
  • Page 21: Operating The Device With A Ros

    ROS.org). For more details, also refer to ROS.org and ROS Wiki sensors. 6.1.2. Building the ROS driver System requirement: Linux operating system. Download the “TOFCAM660_SW_Package” from the website www.espros.com, section Downloads, 02_Cameras_and_Modules. There is enclosed the “TOFCAM660_ROS_driver” file. Extract zip file for example in...
  • Page 22: Ros Api

    6.2. ROS API This is the official driver for the ESPROS TOFcam-660. The annotation follows the rules of ROS.org. 6.2.1. Start of the node If you use in terminal mode the APIs only, without GUI: Start the ROS operating system in a Terminal1 with the command:...
  • Page 23: Dynamically Reconfigurable Parameters

    Sets ROI (region of interest) right x position. Range 7 … 319 ~roi_height Sets ROI (region of interest) height. Range 8 … 240 Table 7: ROS parameter table © 2021 ESPROS Photonics Corporation 23 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice...
  • Page 24: Communication Interface

    7.1. Description The TOFcam-660 is connected to a PC. The TOFcam-660 acts as TCP server: one TCP connection and one UDP connection are opened for command and measurement data as shown in Figure 28. A simple command/answer structure is used: the PC sends a command to the camera and the camera answers it with an acknowledge or an error code over the command connection.
  • Page 25: Communication

    “low Amplitude” Example: minAmplitude 0x01 0x01 0x90 Minimum 3d amplitude = 400LSB Table 8: Implemented commands © 2021 ESPROS Photonics Corporation 25 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 26 1: Spatial HDR Response type: acknowledge 2: Temporal HDR Example: HDR config 0x19 0x00 Mode: no HDR READ_CHIP_INFOR- MATION (0x24) READ_FIRMWARE_RELE (0x25) Table 9: Implemented commands © 2021 ESPROS Photonics Corporation 26 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 27: Responses

    2Bytes per pixel refer to chapter 9.5 Measurement data DATA_DCS 2Bytes per pixel x 4DCS refer to chapter 9.5 Measurement data Table 10: Implemented Camera Answers © 2021 ESPROS Photonics Corporation 27 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 28: Factory Commands

    0x0C 0x0D 0x0A 0x0F 0x0B MAC address = 2-12-13-10-15-11 SET_GRAYSCALE_ILLU On/Off, 1Byte unsigned 0: Off MINATION (0x27) 1: On Table 11 (ff): Implemented factory commands © 2021 ESPROS Photonics Corporation 28 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 29 Jumps from the camera application to the (0x6F) bootloader. This allows a firmware upgrade then according to Chapter 4.8 Table 11 (ff): Implemented factory commands © 2021 ESPROS Photonics Corporation 29 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 30: Measurement Data Connection (Udp)

    32Bit unsigned, offset (number of bytes) where the payload of this packet must be copied into the receiving buffer Payload Payload of the packet as described above Table 12: UDP Packet fields © 2021 ESPROS Photonics Corporation 30 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice...
  • Page 31: Payload (Application Layer)

    Offset from package start where the measurement data starts (length of header plus user data) UserData 0 … 1024 Copy of the data, that was transmitted together with the command. Table 13: Payload header fields © 2021 ESPROS Photonics Corporation 31 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 32: Data Types And Format Of Measurement Data

    Distance 64002 ADC-Overflow Distance/Amplitude/DCS 64003 Saturation Distance/Amplitude/Grayscale/DCS 64004 Bad pixel All images 64007 Interference Distance/Amplitude 64008 Edge filtered Distance/Amplitude Table 15: Coding of pixels © 2021 ESPROS Photonics Corporation 32 / 35 Installation_and_Operation_Manual_TOFcam660_V.02 Characteristics subject to change without notice www.espros.com...
  • Page 33: Maintenance And Disposal

    The design and manufacture of the cameras and components are done in compliance with the RoHS legal regulations. Traces of dangerous materials may be found in the electronic components, but not in harmful quantities. © 2021 ESPROS Photonics Corporation 33 / 35 Installation_and_Operation_Manual_TOFcam660_V.02...
  • Page 34: Addendum

    11. Addendum 11.1. Related documents Data sheet epc660, ESPROS Photonics Corp. Book 3D-TOF, A guideline to 3D-TOF sensors that work by ESPROS Photonics Corp. (author Beat Dede Coi et. al.) 11.2. Links www.espros.com www.pointcloud.org - Point Cloud Library (PCL) www.pdal.io - Point Data Abstraction Library (PDAL) www.opencv.org - OpenCV (OpenSource Computer Vision)
  • Page 35: Important Notice

    ESPROS to use such products or services or a warranty or endorsement thereof. Use of such information may require a license from a third party under the patents or other intellectual property of the third party, or a license from ESPROS under the patents or other intellec - tual property of ESPROS.

Table of Contents