1. Manuals
  2. Brands
  3. FRAMOS Manuals
  4. Microcontrollers
  5. IMX636
  6. User manual

FRAMOS IMX636 User Manual

Hide thumbs
Table of Contents

Advertisement

Quick Links

Download this manual

USER MANUAL

IMX636 DEVELOPMENT KIT
Version v1.0a from July 2023
© FRAMOS 2023, information is subject to change
without prior notice.
www.framos.com

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the IMX636 and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for FRAMOS IMX636

Summary of Contents for FRAMOS IMX636

  • Page 1: User Manual

    USER MANUAL IMX636 DEVELOPMENT KIT Version v1.0a from July 2023 © FRAMOS 2023, information is subject to change without prior notice. www.framos.com...

  • Page 2: Further Documentation And Application Guides

    For purpose of this User Manual affiliates are: FRAMOS Technologies d.o.o., FRAMOS Technologies Inc, FRAMOS Italia, FRAMOS Electronics Ltd, and MAVIS Imaging GmbH (hereinafter all together: FRAMOS) www.framos.com...

  • Page 3: Table Of Contents

    Step 3: For Advanced Case Use: ....................... 23 APPENDIX ............................24 System Block Diagram ........................26 System Block Diagram 1: FRAMOS Sensor Module with FSM-IMX636 (EVS) ........26 System Block Diagram ........................27 System Block Diagram 1: FRAMOS Sensor Adapter with Crosslink NX (FPGA) ....... 27 System Block Diagram ........................
  • Page 4 TABLE OF CONTENTS FRAMOS Sensor Adapter (FSA) J3 (PixelMate™ to FPA) Schematic ..........34 FRAMOS Sensor Adapter (FSA) J3 (PixelMate™ to FPA) Schematic (Cont.) ........35 FRAMOS Sensor Adapter (FSA) Test Points ..................36 Connectors: PixelMate™ ........................37 FRAMOS Processor Adapter (FPA) ....................38 FRAMOS Processor Adapter: Multiple Camera Setup (SW1, SW2) ...........
  • Page 5 The technical equipment described in this document, be it hardware or software, is delivered as it is and does not include any obligations to FRAMOS to provide technical customer support. Technical support is granted on a per-project basis arbitrary by FRAMOS.
  • Page 6 Customers, Integrators and End Users using or selling these products for use in such applications do so at their own risk and agree to fully indemnify FRAMOS for any damages resulting from any improper use or sale.
  • Page 7 Electro Magnetic Compliance (EMC) The FRAMOS Sensor Module Ecosystem are OEM components/devices and are provided at the open board level. Electrical components with open design do not comply with standards for electromagnetic compatibility as the unshielded circuitry enables electromagnetic interference with other electronic devices.

  • Page 8: Introduction

    INTRODUCTION This chapter briefly describes FRAMOS products, support, and service offerings that may be of special interest to you as you take your product to market. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 9: About Framos

    LinkedIn or Twitter. FRAMOS Sensor Module Ecosystem The FRAMOS Sensor Module (FSM) Ecosystem consists of FRAMOS Sensor Modules, Adapters, Software, and Sources. It provides one coherent solution supporting the whole process of integrating image sensors into embedded vision products. Within the development phase, electrical design references and driver sources provide guidance with a solid and proven baseline to quickly port into individual system designs, decreasing risk and efforts.

  • Page 10: Materials And Services

    Materials and Services Hardware • FRAMOS Sensor Module Development Kits Individual Parts: FRAMOS Sensor Modules (FSM) - Sensors on PCB, with filtering and versatile connector • • FRAMOS Sensor Adapters (FSA) - Sensor periphery and PixelMate™ interface, optional data conversion •...

  • Page 11: Product Description

    PRODUCT DESCRIPTION The following chapter describes the contents of the FSM-IMX636 Development Kit contents and lists the components to ensure you have everything you need. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 12: Order Code

    User Manual Version 1.0a Overview The FSM-IMX636 Devkit delivers high resolution, speed, and temporal resolution with “Event Based Sensing” technology in a compact package for embedded systems engineers. This Devkit integrates the IMX636-AAMR-C Event-based Vision Sensor released by Sony Semiconductor Solutions, and realized in collaboration between Sony and PROPHESEE.

  • Page 13: Getting Started

    GETTING STARTED The following chapter describes the hardware assembly procedures according to the FSM-IMX636 Development Kit. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 14: Tools

    WARNING Do not assemble equipment while the device is powered on. Disconnect power supplies before assembling equipment. Power on the devices per the manufacturer’s startup procedures. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 15: Step 1: Unpack The Framos Development Kit

    Unpack the FSM-IMX636 Devkit contents. Inspect the front-end assembly referencing the illustration below. CAUTION If any visual damage or deviation from the illustrations below are found, approach your FRAMOS contact and do not operate the equipment. Figure 2. Front views of the IMX636 front-end assembly.

  • Page 16: Step 2: Connect The Pixelmate™ To The Front End

    NOTE This step is only required if the front-end did not ship with the PixelMate™ (FMA-FC-150/60-V1A) connected. Figure 4. Example view of the pin 1 to pin 1 connection. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 17: Step 3: Connect The Fpa To The Processor Board

    NOTE For single camera use, all DIP switch SW1 settings can be left as “OFF”. For your convenience, this product ships with the DIP switch switch SW1 settings to “OFF”. Figure 5. Example view of the FPA to processor board connection. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 18: Step 4: Connect The Pixelmate™ To The Fpa

    NOTE The above illustration depicts a single camera setup. Note the difference in DIP switch SW1 settings when compared against a multiple camera setup per the data in the FPA appendix pages. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 19: Step 5: Prepare The Processor Board

    Substep 2. Connect the power supply specified by the manufacturer of your processor board. Substep 3. Follow the startup instructions of the processor board to power on. Figure 7. Example view with callouts of the processor board setup. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 20: Step 6: Proceed To Driver And Software Installation

    Step 6: Proceed to Driver and Software Installation. Proceed with the Driver and Software Installation instructions described in the following chapter. Figure 8. Completed assembly of the FSM-IMX636 Devkit. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 21: Driver And Software

    DRIVER AND SOFTWARE The following chapter provides detailed instruction on how to install the required drivers and software once the hardware is assembled. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 22: Tools

    NOTE Complete all steps in ‘Getting Started’ before beginning the below steps. The starting state requires that the processor board and the FSM-IMX636 Development Kit are powered on and connected. www.framos.com...

  • Page 23: Step 1: Download The Required Drivers And Guides

    Step 3: For Advanced Case Use: Such as horizontal or vertical Crosslink-NX blanking, see the Software section of the appendix pages to extend the basic software installation instructions accordingly. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 24: Appendix

    APPENDIX The following chapter provides additional supporting information on the individual components of the FSM-IMX636 Development Kit. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.
  • Page 25 Section: FSM-IMX636 Dev Kit July 2023 Appendix User Manual Version 1.0a NOTE This page is intentionally left blank. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 26: System Block Diagram

    Version 1.0a System Block Diagram The following diagram is a system overview of the FSM-IMX636 Devkit front-end assembly. Reference the individual segments as they appear in the following topics for better readability. From left to right, the FSM, FSA and FPA / Processor Board can be viewed quickly by clicking the link when this document is being read electronically.

  • Page 27: System Block Diagram

    Version 1.0a System Block Diagram The following diagram is a system overview of the FSM-IMX636 Devkit front-end assembly. Reference the individual segments as they appear in the following topics for better readability. From left to right, the FSM, FSA and FPA / Processor Board can be viewed quickly by clicking the link when this document is being read electronically.

  • Page 28: System Block Diagram

    Version 1.0a System Block Diagram The following diagram is a system overview of the FSM-IMX636 Devkit front-end assembly. Reference the individual segments as they appear in the following topics for better readability. From left to right, the FSM, FSA and FPA / Processor Board can be viewed quickly by clicking the link when this document is being read electronically.

  • Page 29: Framos Sensor Module (Fsm)

    60-pin PixelMate™ connector, and it is shipped pre-connected to the FSA at J1 (as indicated below). For more information on the regular operation of the FSM, please refer to the FRAMOS Sensor Module Ecosystem User Manual. The following information pertains to the IMX636 Development Kit.

  • Page 30: Framos Sensor Module (Fsm) Blanking

    Version 1.0a FRAMOS Sensor Module (FSM) Blanking The Sony IMX636 event-based vision sensor (EVS) is an image sensor that captures changes in light intensity for each pixel separately. It transmits MIPI CSI-2 frames with a variable line length, depending on the scene movements. Information is only transmitted when there is a change in light intensity.

  • Page 31: Fsm Mechanical Drawing

    User Manual Version 1.0a FSM Mechanical Drawing Figure 15. Mechanical drawing: FRAMOS Sensor Module (FSM) of the FSM-IMX636 Devkit Figure 16. Mechanical drawing: FRAMOS Sensor Module (FSM) of the FSM-IMX636 Devkit FSM Specifications For specifications, view the FRAMOS FSM-IMX636 Development Kit Factsheet and Datasheet.

  • Page 32: Framos Sensor Adapter (Fsa) Overview

    Crosslink NX J2 to FSM Figure 17. Front and rear view of the design changes to the FSA for FSM-IMX636 Devkit NOTE The current FPGA design for the FSM-IMX636 Devkit does not actively use the available DRAM chips. The DRAM chips are available for future possible use and can be implemented in your application.

  • Page 33: Framos Sensor Adapter (Fsa) Functionality

    JTAG programming is available with an external HW programmer through the FSA 6-pin header. FRAMOS Sensor Adapter (FSA) Mechanical Drawing Figure 18. Mechanical drawing: Framos Sensor Adapter (FSA) location in the FSM-IMX636 Devkit www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 34: Framos Sensor Adapter (Fsa) J3 (Pixelmate™ To Fpa) Schematic

    Pin27 I2C (SPI_MOSI) Pin13 Pin28 I2C_1_SDA Pin14 Pin29 GPIO2(XHS0) Pin15 RST_0 Pin30 EE_SS NOTE Pin 31 to Pin 60 are described in a table on the following page. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 35: Framos Sensor Adapter (Fsa) J3 (Pixelmate™ To Fpa) Schematic (Cont.)

    Pin42 MCLK3 Pin57 D_DATA_2_P Pin43 Pin58 D_CLK_0_P Pin44 Pin59 D_DATA_2_N Pin45 Pin60 D_CLK_0_N NOTE Pin 1 to Pin 30 are described in a table on the previous page. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 36: Framos Sensor Adapter (Fsa) Test Points

    Appendix User Manual Version 1.0a FRAMOS Sensor Adapter (FSA) Test Points Reference the below pinouts for your case use: Figure 19. Schematic view of the FSM-IMX636 Devkit FSA rear. Test Point Description Test Point Description Test Point Description PW EN...

  • Page 37: Connectors: Pixelmate

    For more information on the PixelMate™ connector included in this kit, view the FRAMOS Sensor Module Ecosystem User Manual PixelMate™ Cable PixelMate™ Connector Figure 20. Assembled model view of the FSM-IMX636 Development Kit. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 38: Framos Processor Adapter (Fpa)

    Each of the callouts J7, J8, J5 and J6 are 1 of 4 available Ports on the FPA, each providing 4-Lane CSI-2 that connects to the FSM-IMX636 Devkit through a PixelMate™ connection. Pin 1 must be matched to Pin 1 when connecting.

  • Page 39: Framos Processor Adapter: Multiple Camera Setup (Sw1, Sw2)

    0 (OFF) Illustrated white 0 (OFF) 1 (ON) Illustrated blue 0 (OFF) 0 (OFF) Illustrated white 0 (OFF) 1 (ON) Illustrated blue 0 (OFF) 0 (OFF) Illustrated white www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 40: Framos Processor Adapter: Multiple Camera Setup (Sw1)

    SW2 is designated to interconnect XTRIG pins and aggregate CAM2_MCLK04(MCLK2) and GPIO25_VDD_SYS_EN(SYS_PW_EN) from the FPA in parallel to all FSA connectors. By default, all positions should be OFF. Figure 24. Schematic of FPA SW2. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 41: Framos Processor Adapter: Multiple Camera Setup

    When using multiple EVS cameras, it is important to set your NVIDIA® processor board to MAXN. Monitoring system temperature for signs of overheating when running multiple EVS cameras. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 42: Framos Processor Adapter: Multiple Camera Setup System Block Diagram (1)

    Figure 25. Synchronization setup. NOTE If the power on/off sensors are mixed, adjust the SYNC terminal input of the power OFF sensor to a low state or a high-impedance state (Hi-Z). www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 43: Framos Processor Adapter: Multiple Camera Setup System Block Diagram (2)

    FRAMOS Processor Adapter: Multiple Camera Setup System Block Diagram (2) To achieve the same with another FSM-IMX636 as Master: configure the IMX636A (or IMX637A) to the master operation standby state. Configure the IMX636B (or IMX637B), and so forth, to slave operation with timestamp count clock.

  • Page 44: Software Appendix

    SOFTWARE APPENDIX The following pages elaborate on software controls when configuring environments in advanced use cases. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 45: How The Software Package Is Segmented

    As such, the software is broken into different segments: the driver section and the plugin. The driver section is a standard V4L2 driver with custom V4L2 functions provided by FRAMOS®, and the Metavision® plugin is provided by PROPHESEE® to successfully process events from the IMX636 image sensor.

  • Page 46: Imx636 Driver V4L2 Controls Documentation

    FPGA chip is utilized and support for Crosslink-NX was added to the kernel. Since the IMX636 Devkit is not a traditional frame-based image sensor, there are no standard controls such as gain, exposure, and frame rate. Utilize the below custom controls for your specific use cases.

  • Page 47: Vertical Blanking

    When this value is increased from it’s default settings, the frames per second will decrease and can lead to a Crosslink-NX internal buffer overflow. Increase these settings with caution. It is not advisable to change this control. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 48: Changing Latency And Bgr With Bias_Fo

    (BGR). It should be noted that doing so will also influence the event generation, relative to the normal brightness changes, particularly on the low illumance side. IMX636_CAMERA_CID_BIAS_HPF Name bias_hbf Type Int32 Step www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 49: Controls For Positive And Negative Thresholds

    Name bias_diff_on Type Int32 Step IMX636_CAMERA_CID_BIAS_DIFF IMX636_CAMERA_CID_BIAS_DIFF Name bias_diff Type Int32 Step WARNING The reference voltage is controlled by BIAS_DIFF. It is not advisable to change this value. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 50: Controls For Positive And Negative Thresholds (Cont.)

    The positive and negative thresholds represent the voltage change width (brightness change width), starting from the reset level, until a corresponding positive or negative event is generated. IMX636_CAMERA_CID_BIAS_DIFF_OFF IMX636_CAMERA_CID_BIAS_DIFF_OFF Name bias_diff_off Type Int32 Step www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 51: Managing 'Dead Time' With Bias_Refr

    Contrast Threshold vs BIAS_REFR Dead Time vs BIAS_REFR (register value) (register value set to 1000 lux) BIAS_REFR BIAS_REFR Figure 29. Software dead time illustration with BIAS_REFR. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 52: Calculating 'Dead Time' With Bias_Refr

    Each time the refr_valid register is read, refr_counter is updated. The diagram below illustrates the flow for measuring dead time using the dead time measurement circuit: Figure 30. Dead time measurement using BIAS_REFR_EN www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 53: Obtain Event Signals From Arbitrary Regions With Cid_Analog_Roi

    NOTE When transitioning from Analog ROI Window mode to arbitrary row column specification mode, it is necessary to set all the arbitrary row specification registers (roi/td_roi_x00 to x39) and the arbitrary column specification registers (roi/td_roi_y00 to x22). www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 54: Set Ditial Crop With Cid_Digital_Crop

    In the X direction, the start address must be set to a multiple of 32, and the end address must be set to a multiple of 32-1. • dig_crop_end_x must be greater than dig_crop_start_x, and dig_crop_end_y must be greater than dig_crop_start_y. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 55: Important Software Notices: Analytics Information

    Version 1.0a Important Software Notices: Analytics Information Regarding the FRAMOS® IMX636 plugin, it has been implemented with analytics information to address the issue of generating a large number of event packets by the image sensor, particularly in dynamic scenes. Due to the high volume of rich data generated and the significant payload associated with each packet, the processor board may be unable to process the data in a timely manner.

  • Page 56: Important Software Notices: Analytics Information

    In more demanding applications, latency can be noticeable to the human eye, potentially even in seconds, depending on the application. For this reason, resource utilization should be considered. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 57: Important Software Notices: Analytics Information

    Optimizations such as utilizing GPU cores, CUDA cores, and other platform resources may be possible and could improve processing performance. It is worth noting that Framos, the source of this information, does not focus on application-level optimizations. The evaluation was conducted using only CPU processing.

  • Page 58: Contact Information

    CONTACT INFORMATION Our world-wide talent pool is ready to help ensure your entire product development journey from proof-of-concept to prototyping, and to mass production. www.framos.com © FRAMOS 2023, information is subject to change without prior notice.

  • Page 59: Contact Information

    FRAMOS IP. More than 180 FRAMOS employees world-wide are passionate about the unlimited potential of imaging and help customers achieve the optimum results from every possible scenario. FRAMOS drives and ensures the entire product development journey from POC, through prototyping, to mass production.
  • Page 60 In no event shall the publisher and the author be liable for any loss of profit or any other commercial damage caused or alleged to have been caused directly or indirectly by this document. WWW.FRAMOS.COM...

Table of Contents