MIR AI Camera Getting Started
  1. Manuals
  2. Brands
  3. MIR Manuals
  4. Security Camera
  5. AI Camera
  6. Getting started

MIR AI Camera Getting Started

Hide thumbs Also See for AI Camera:
Table of Contents

Advertisement

Quick Links

Download this manual
Getting Started (en)
Date: 08/2020
Revision: v.1.3

Advertisement

Table of Contents
loading
Need help?

Need help?

Do you have a question about the AI Camera and is the answer not in the manual?

Questions and answers

Subscribe to Our Youtube Channel

Related Manuals for MIR AI Camera

Summary of Contents for MIR AI Camera

  • Page 1 Getting Started (en) Date: 08/2020 Revision: v.1.3...
  • Page 2 Copyright © 2019-2020 by Mobile Industrial Robots A/S. Contact the manufacturer: Mobile Industrial Robots A/S Emil Neckelmanns Vej 15F DK-5220 Odense SØ www.mobile-industrial-robots.com Phone: +45 20 377 577 Email: support@mir-robots.com CVR: 35251235 MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.

  • Page 3: Table Of Contents

    4. Commissioning 4.1 Collection phase 4.2 Pre-processing phase 4.3 Validation phase 4.4 Training phase 4.5 Upload the data model 4.6 Setting up triggers and actions 4. Troubleshooting MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.

  • Page 4: About This Document

    1. About this document 1. About this document This document describes how to install and use your MiR AI Camera. MiR AI Camera is a MiR accessory that can be implemented into your work environment to improve the flow of MiR robots connected to MiR Fleet.
  • Page 5 • The MiR network and WiFi guide specifies the performance requirements of your network and how you must configure it for MiR robots and MiR Fleet to operate successfully. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.

  • Page 6: Product Presentation

    The actions can either be the initialization of a fleet mission or locking a Limit-robots zone. Figure 2.1. When the AI camera detects a trigger object, it sends a signal to MiR Fleet. MiR Fleet then either locks a Limit-robots zone or schedules a mission.

  • Page 7: External Parts

    2. Product presentation 2.1 External parts This section presents the parts of MiR AI Camera that are visible on the outside. Figure 2.2. External parts of MiR AI Camera. Pos. Description Pos. Description Camera lens Indicator light Reset button Ventilation Nameplate...

  • Page 8: Nameplate

    2.3 MiR Fleet and operating requirements MiR AI Camera is a product that must be connected to MiR Fleet to be used as intended. The following list describes the requirements for being able to use MiR AI Camera with your MiR...

  • Page 9: Light Indicator

    2. Product presentation 2.4 Light indicator The light indicator on MiR AI Camera is used to provide feedback on its current status. The following table describes the status linked to the various colors. Color Status White Busy. The camera is updating or starting up.

  • Page 10: Getting Started

    3. Getting started 3. Getting started This section describes how to get started with MiR AI Camera. To be able to use MiR AI Camera, your MiR Fleet Server Solution must be running software version 2.10.0. 3.1 In the box This section describes the content of the MiR AI Camera box.

  • Page 11: Suggested Use

    3. Getting started 3.2 Suggested use It is important before installing MiR AI Camera to consider what you aim to use it for. This section describes some of the possible uses of MiR AI Camera, and where it should be mounted in each case.
  • Page 12 For example, if the doorway is large enough to allow a person and robot through at the same time, it should be considered only to set MiR AI Camera to lock the area if carts or other robots are approaching the doorway.
  • Page 13 3. Getting started Figure 3.1. In this example, MiR AI Camera is focusing on a loading rack. In the first image, the camera detects nothing in its field of view. In the second image, it has detected a crate and initiates a mission to send a robot over to pick up the crate.

  • Page 14: Mounting And Powering Up Mir Ai Camera

    Figure 3.2. Figure 3.2. Parts of the AI camera mount. Pos. Description Pos. Description Camera mounting holes Wall mounting holes Joint tightening knob Ball and socket joint MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 15 3. Getting started To mount MiR AI Camera follow these steps: Place the camera mount in the position you want the MiR AI Camera to be mounted. Make sure the mounting plate is placed flat against the surface. The camera mount is adjustable, so you can always adjust the orientation of the camera after fixing the camera mount.

  • Page 16: Connecting To Mir Ai Camera

    3.4 Connecting to MiR AI Camera It is possible to connect to the MiR AI Camera directly, using an Ethernet cable or wirelessly through WiFi. If you want to see a live-stream video from the camera to ensure that it is positioned correctly, you must first connect to the robot's WiFi.
  • Page 17 For the WiFi password, see the MiR passwords document included with your camera. If you cannot connect to MiR AI Camera, try to reset the camera by holding down the Reset button for ten seconds.
  • Page 18 If you just wanted to see the live-stream from the camera, you can now connect the camera via Ethernet—see Connecting through Ethernet on page 20. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 19 The AI camera hotspot vanishes, and the camera is now available in the MiR Fleet interface. Check that MiR Fleet is connected to the camera by signing into MiR Fleet and going to Setup > AI cameras. Your AI camera should appear under cameras.
  • Page 20 Connecting through Ethernet Connect MiR AI Camera to the same network as your MiR Fleet using an Ethernet cable. Check that MiR Fleet is connected to the camera by signing into MiR Fleet and going to Setup > AI cameras. Your AI camera should appear under cameras.

  • Page 21: Adding Cameras To Mir Fleet

    3. Getting started 3.5 Adding cameras to MiR Fleet The process of adding cameras to MiR Fleet is similar to adding robots to MiR Fleet. The following steps describe how to add a new MiR AI Camera to the fleet. Make sure your MiR Fleet is updated to a software version 2.10.0 and is using a host network interface configuration.
  • Page 22 Hallway or Cart pickup. Also, verify that the serial number and software version of MiR AI Camera are correct and that Disabled is set to No. Select Save when you are done. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 23 3. Getting started You can also remove cameras from MiR Fleet after adding them. To do this, select Edit for the AI camera you want to remove, and then select Remove. NOTICE When you remove an AI camera from MiR Fleet, the AI camera is automatically factory reset.

  • Page 24: Commissioning

    MiR AI Training Tool to complete the Pre-processing phase. In the training tool, you must complete the Validation and Training phases to create a model that you upload to MiR Fleet which then distributes it to the connected AI cameras.

  • Page 25: Collection Phase

    It is important that you gather images of objects where they are alone in the camera's field of view. It is less efficient to train MiR AI Camera when there are multiple target objects in the images. Figure 4.2 shows examples of both bad and good images to collect.
  • Page 26 Follow the steps below to begin the Collection phase, and download the data necessary to begin the next phase: Go to Setup > AI camera and select AI camera settings. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 27 The remaining time of the collection phase is displayed. When the displayed time has passed, return to the MiR Fleet interface and navigate to AI camera settings again to download the data. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.

  • Page 28: Pre-Processing Phase

    The data preparation and training take place on the following website: https://training.mir- robots-ai.com. This site is known as MiR AI Training Tool. The following steps describe how to upload the training data collected in the Collection phase: Open your preferred web browser and go to https://training.mir-robots-ai.com...
  • Page 29 4. Commissioning Insert your email and create a password. Select Register when you are done, and sign in with your new user. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 30 Click here to add more credits. Type in the code that came with your MiR AI Camera. You will receive the number of credits that are linked to that code. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 31 Collection phase, containing all the collected images. Select it, and upload it to the site. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.

  • Page 32: Validation Phase

    The candidate target object is framed by a green box. To start the process, you must create a new label for a target object you would like MiR AI Camera to detect. After creating a new label, you validate which images include the same target object and should be used for training.
  • Page 33 If two target objects similar in appearance are given two separate labels, it is not guaranteed that MiR AI Camera can distinguish the difference. For this reason, when creating a new label, it is important to choose a label name that correctly encapsulates the target object type that you are categorizing.
  • Page 34 Table 4.1. Overview of correct and incorrect use of labels. Validating Once you have labeled a target object, MiR AI Training Tool presents other detected target objects where similarities have been detected. You must validate which detected target objects should receive the same label. It is important that only images where the green box correctly frames the target object are validated for training.
  • Page 35 Invalid The frame includes only very little of the target object. Table 4.2. Descriptions of the framing examples in Figure 4.3. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 36 It is not necessary to complete the validation phase in one sitting. All labeling and validation is saved as you work, and you can return to MiR AI Training Tool at any time to complete it.
  • Page 37 Each image displayed in MiR AI Training Tool represents a cluster of images that are very similar. You can see how many images are included in each cluster by hovering over the image. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 38 Type a suitable label for the target object. In this case, we use the label mir200_roeq. Select Save when you have finished. You have now validated a cluster of images. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 39 If do not have enough high- quality images in one session, you can merge a session with other sessions—see Merging sessions on the next page. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 40 The following steps describe how to merge sessions: In the selected session, select Manage data. All of the other sessions you have started are displayed. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 41 Revert to separate the sessions again. If you have labeled any images in the merged session, the labels are still applied to the images after reverting. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.

  • Page 42: Training Phase

    MiR AI Camera. This can take several hours to complete, but it is not necessary for MiR AI Training Tool to be open on your PC throughout the training. Once the training is complete, you will receive an e-mail and can continue to set up your MiR AI Camera through MiR Fleet.

  • Page 43: Upload The Data Model

    4.5 Upload the data model The training phase outputs a data model. This model contains the information required for MiR AI Camera to detect the objects labeled in the validation phase. The following steps describe how to upload the file to the connected MiR AI Cameras:...
  • Page 44 4. Commissioning Connect your PC to the MiR Fleet network, and sign in to the interface. Navigate to Setup > AI cameras, and select AI camera settings. Select Upload new data model and then the data model you just downloaded from MiR AI Training Tool.

  • Page 45: Setting Up Triggers And Actions

    4. Commissioning 4.6 Setting up triggers and actions You must set up each MiR AI Camera to trigger certain actions when they detect specific trigger objects. There are two types of actions you can trigger: Lock zone or Fleet mission.
  • Page 46 Go to Setup > AI cameras, and select Edit for the AI camera you would like to set up triggers for. Select + Add trigger to create a new trigger MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 47 4. Commissioning Select Edit to add a target object that will trigger an action. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 48 4. Commissioning Select the object or objects you would like to trigger an action when the camera detects them. The available objects match the labels created in MiR AI Training Tool. In this case, new_cart_loaded is the selected target object that will trigger an action when the camera detects it.
  • Page 49 If a robot already assigned to the zone, it will finish driving through the zone even if MiR Fleet locks the zone. A zone can be assigned to a robot if it is within 10 meters of the edge of the zone.
  • Page 50 You can create as many triggers as you need. Once you have finished creating triggers, save your changes by selecting Save. The camera is now ready to trigger actions when it detects specific target objects. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.

  • Page 51: Troubleshooting

    To merge two sessions together, see Validation phase on page 32. If you suspect that you have discarded too many images incorrectly in MiR AI Training Tool, you can review all of the discarded images by selecting Discarded images in the menu bar to the right.
  • Page 52 You can review all the images associated with a label by selecting the label in the menu bar to the right in MiR AI Training Tool. MiR AI Camera Getting Started (en) 08/2020 - v.1.3 ©Copyright 2019-2020: Mobile Industrial Robots A/S.
  • Page 53 Collection phase, the MiR AI Camera may not be able to detect target objects correctly in that area. Run the Collection phase again where images of the new area are included.

Table of Contents