Chapter 1 Polymotion Chat Studio 3.1.0 Polymotion Chat Studio 3.1.0 Quick Start Guide Polymotion Chat Studio 3.1.0 Quick Start Guide Overview of Polymotion Chat Tracking System Polymotion Chat is an advanced broadcast camera automation system solution. The advanced integrated AI engine detects face and limbs building a model of the subject and uses this to control and predict movement delivering high quality and natural camera motion.
Polymotion Chat Studio 3.1.0 Quick Start Guide Connecting Cables (Dell 1U Server) Power Broadcast Panel USB Hub Power Dell 1U Server (rear) Decklink card Sync (not used) Ethernet Hub Power Power Power Power Panasonic PTZ PTA head (Junction head Box)
Polymotion Chat Studio 3.1.0 Quick Start Guide Connecting Cables (Dell 2U Server) Power Broadcast Panel USB Hub Dell 2U Server (rear) Decklink card Power Ethernet Hub Power Power Power Power Panasonic PTZ PTA head (Junction head Box) MRMC AFC Head...
Click/tap Polymotion CHAT Studio/Broadcast. If you are launching this for the first time, you will be required to add a new license file or a license code. Contact MRMC Support for a new license. Refer to Licensing your Polymotion Product on page 71.
Page 9
Polymotion Chat Studio 3.1.0 Quick Start Guide incoming sources of videos used by Polymotion system are: USB Device, RTSP Stream, Decklink and NDI. Use the FIND button to retrieve a list of available robots on your network. Add all the robots that would be part of the Polymotion Chat system in the MHC Network setup page.
Page 10
Polymotion Chat Studio 3.1.0 Quick Start Guide Under VIDEO INPUT, select the source of the video feed. Select the DEVICE. If the selected video input is Decklink or USB device, then DEVICE is the port receiving the video feed from the camera on the robot.
Page 11
Click Start CV Engine to start the program that enables Polymotion tracking in MHC. As you do so, notice that additional windows pop up, which can take up to 30 minutes; these windows are for MRMC CV Engine, a software application that runs in the background to enable Polymotion Chat, and must not be closed at any instance while using the system for accurate functioning.
Page 12
Polymotion Chat Studio 3.1.0 Quick Start Guide NDI video feed issues If a video input was selected as NDI in Step 4 but is not displayed after clicking Start CV Engine, then it is recommended that you download and install NDI Studio Monitor tool from the NDI website.
Page 13
Polymotion Chat Studio 3.1.0 Quick Start Guide Click Directions and Tracking to calibrate all participating axes. If not already done, you will be asked to home the axes. For accurate target tracking, it is important that you home all participating axes.
Page 14
Polymotion Chat Studio 3.1.0 Quick Start Guide Note Clicking Invert inverts the axis and saves the change in the robotic head. This is in contrast to the changes made on Preferences page which apply any changes to a given user only.
Page 15
Polymotion Chat Studio 3.1.0 Quick Start Guide If Rail and Lift are added to the head then additional steps for calibrating these axes will appear in Chat Wizard.
Page 16
Polymotion Chat Studio 3.1.0 Quick Start Guide In this step, you can adjust the tracking sensitivity by clicking the play button to temporarily start tracking and then tweaking the sensitivity using the slider. To modify tracking sensitivity a person needs to be present in the frame to allow tracking to begin.
Page 17
Polymotion Chat Studio 3.1.0 Quick Start Guide Repeat Steps 2-7 for all the robotic heads that are part of Polymotion Chat system. These are instructions when both MHC Server and Client are on the same machine. To configure MHC Client on a remote PC, follow the instructions in Remote Client Configuration on page 76.
Polymotion Chat Studio 3.1.0 Quick Start Guide Setting up the robotic heads for Polymotion Chat Provided all the participating robots are connected properly and video feeds from all the cameras are being successfully received and are correctly configured, your first session will involve logging in to the MHC Client.
Polymotion Chat Studio 3.1.0 Quick Start Guide When you login to MHC Client, this multi-view screen view appears which shows the live feed from all the connected cameras. If you have only one camera, then it goes straight to the operator screen. You can select the live feed from any camera to set up presets, begin tracking and change the tracking settings for that camera.
Polymotion Chat Studio 3.1.0 Quick Start Guide automatically. Also, Engineer-type users have additional controls like the Configure button, which Operator type users do not. Note When Polymotion Chat Main page is started for the first time after Chat installation, the CVE PoseNet Initialization process is started and a message appears in the LiveView window.
Polymotion Chat Studio 3.1.0 Quick Start Guide Important End stops on Focus and Zoom are not supported for Panasonic PTZ devices. In order to get the pan and tilt end stops to work smoothly for Panasonic PTZ heads, Chat system uses the settings in the head. The...
Polymotion Chat Studio 3.1.0 Quick Start Guide Setting pan and tilt soft limits If the subject moved to an undesirable position, having set the soft limits will prevent the robotic head from moving further in that direction. Carefully setting the soft limits for pan and tilt axes prevents the robotic heads from moving to positions outside the desired area.
Polymotion Chat Studio 3.1.0 Quick Start Guide Presets Non-tracking preset The Polymotion Chat Operator page allows for 32 positional presets organised Tracking in 4 banks of 8 presets each. Each of these icon Tracking presets can be set as tracking or preset non-tracking.
Polymotion Chat Studio 3.1.0 Quick Start Guide Storing a non-tracking preset Click/tap one of the connected robotic heads for which you want to store the preset. Use the controls to go to the desired head position. Ensure that the Zoom and Focus axes are in correct positions. For a tracking preset, set the position of the head to the target that you want to track.
Page 25
Polymotion Chat Studio 3.1.0 Quick Start Guide Switch to Configure mode by clicking/tapping on . You will see a yellow border around , indicating that the preset buttons are in the Configure mode. Click/tap on a preset button that you want to set. This button will now change to yellow and a Configure box display will appear.
Polymotion Chat Studio 3.1.0 Quick Start Guide Configuring a Preset Auto Framing LiveView graphics settings Option Description Label Allows the user to set a custom name for the preset. Time Time taken to go to the preset if mode is set to ‘CUT’...
Polymotion Chat Studio 3.1.0 Quick Start Guide Option Description Toggles the preset between PTZ and non PTZ preset. When greyed, the PTZ is tracking only, in other words, when going to a preset the pan, tilt and zoom axes positions will not be changed.
Page 28
Polymotion Chat Studio 3.1.0 Quick Start Guide modes, the stop zone only applies to the pan axis, tilt is handled by the setting in the Framing Size slider: from head and shoulder to full body. 1-person tracking mode applied Framing size slider...
Polymotion Chat Studio 3.1.0 Quick Start Guide Tracking mode Description 2-person tracking: In this auto framing tracking mode, the Chat system keeps two people in the frame. 3-person tracking: In this auto framing tracking mode, the Chat system keeps three...
Polymotion Chat Studio 3.1.0 Quick Start Guide the frame, another recognised person is picked for tracking until the person returns and the tracking will shift to following that person again. In this case tracking can be switched to another person temporarily by clicking on their image in LiveView video.
Polymotion Chat Studio 3.1.0 Quick Start Guide Option Description Toggles showing the green boxes or ellipses for static zones. When pressed, the person closest to the middle of the static zone is picked for tracking. (Clicking the preset button also resets tracking.)
Page 32
Polymotion Chat Studio 3.1.0 Quick Start Guide Tracking heads Non-Tracking heads Tracking modes Note that when tracking is on, some of the buttons in the Configure display are inactive. These become active only after you stop tracking. You can still change the name and picture associated with the preset while...
Page 33
Polymotion Chat Studio 3.1.0 Quick Start Guide Note regarding Birddog Autofocus function When a preset is saved with AF on, enabling it and changing the AF state will not reflect in the preset when it is enabled again. This happens because of the preset memory function in the Birddog PTZ camera.
Polymotion Chat Studio 3.1.0 Quick Start Guide Altering Static Zones Selecting in Configure mode for a preset shows a bar in LiveView window which allows you to edit the static zones. This changes the shape for Toggle between inner the static zones to either stop zone and outer rectangular or elliptical.
Polymotion Chat Studio 3.1.0 Quick Start Guide person for face recognition. To use this option, stop tracking, deselect the person, the next available face in the frame will be tracked. Edit Static Zone Use the appearing arrows and other options to edit the static zones as required, and then exit the edit mode.
10. Synchronised Robots Polymotion Chat v 3.1 has a new functionality for two or more MRMC heads to follow the same movement. It allows one or more secondary cameras to exactly follow the movement of the primary camera. This is useful for multiple camera green screen and AR work also called teleportation.
Polymotion Chat Studio 3.1.0 Quick Start Guide Fine adjustment of autoframing zoom position While auto-framing, if you move the zoom position control then two pairs of green horizontal lines appear in the live view. You can then fine tune the size of half body, zoom will then be adjusted by MHC to use the new size.
Polymotion Chat Studio 3.1.0 Quick Start Guide level of the setting in the CV-Engine tab. For more information, refer to page 45. Stopping Tracking At any point, you can turn tracking off on all participating robotic heads by clicking/tapping You can stop tracking on the currently selected head by using the pan and tilt joystick control.
Polymotion Chat Studio 3.1.0 Quick Start Guide Face Capture Page This page allows you to create a face capture library which can be created in one of the following ways: Importing a profile: If you have already created a face capture profile at...
Page 40
Polymotion Chat Studio 3.1.0 Quick Start Guide Tap CAPTURE PROFILE and specify a name. Name of every profile should be different to avoid conflict in the Face Capture database. Tap START CAPTURE. Read the on-screen instructions and tap START CAPTURING. As the subject changes head positions and facial expressions, the Chat system will automatically capture 10 images to capture a new profile.
Page 41
Polymotion Chat Studio 3.1.0 Quick Start Guide Note There is no limit on the number of people you can have in the database. However, it is recommended that you keep the number of active profiles down to a minimum to keep the processing time down.
Page 42
Polymotion Chat Studio 3.1.0 Quick Start Guide only that person will be tracked by this preset. Selecting ‘Any’ will enable tracking of all enabled profiles. Face Recognition with Autoframing Face Recognition without Autoframing An unrecognised person or a disabled profile on the FACE CAPTURE...
Polymotion Chat Studio 3.1.0 Quick Start Guide Multi-screen View If a user is assigned multiple connected heads, the default screen after login is the Multi-screen. Click/tap the Multi-screen view ( ) button to view the live video feed from up to 12 connected heads. By default, live controls for all heads are also available MultiView screen.
Polymotion Chat Studio 3.1.0 Quick Start Guide Moves Page Head is connected Selected head but not selected The tabs on the page represent the heads that you can view and control using the MHC client. You can select them for operation, setting presets or defining moves.
Polymotion Chat Studio 3.1.0 Quick Start Guide Presets You can store the position of the head as a preset. Preset 34 to 45 are available on this page. A preset button is faded when no position is stored in them.
Polymotion Chat Studio 3.1.0 Quick Start Guide the STORE button and the preset buttons, indicating that the preset buttons can be selected to store your current head position. Use the joystick controls or on-screen joystick by clicking in the Live View video to change head position.
Polymotion Chat Studio 3.1.0 Quick Start Guide Editing a preset button You can assign a name and add a picture to the preset button. To do so: Click/tap the EDIT button. Click/tap the preset button that you want to change.
Polymotion Chat Studio 3.1.0 Quick Start Guide Click/tap a preset button to assign that to A position. Click/tap B in the move button. Click/tap a preset button to assign it to the B point. Enter the time you want the move to complete in.
Polymotion Chat Studio 3.1.0 Quick Start Guide the head will seek point A. Then, the head will seek the B point in the specified time indicated by a solid yellow border around the active move and preset button. Stop button Use this button to stop a preset or a move.
Page 50
Polymotion Chat Studio 3.1.0 Quick Start Guide Video Source: Use this box to change the Video Input for camera tracking. Simply enter the name of the input stream along with the port number ( USB: Camerax Decklink: DeckLinkx ...
Page 51
Polymotion Chat Studio 3.1.0 Quick Start Guide Record tracking video: Click Start Recording to record the video output of CV Engine. This feature is useful when troubleshooting video feed issues. Lock Tilt While Tracking Subject: When this option is turned on the robot should not tilt after the target is inside the inner stop zone.
Page 52
Use Axis Position for Tracking: Turning this feature on will use the axis position of the robotic head to improve tracking performance. Synchronised Control: More than one MRMC cameras can be grouped to follow a synchronised movement. Lost Face Finder: Automatically move the tilt upward if the subject suddenly moves out of the top of the frame.
Polymotion Chat Studio 3.1.0 Quick Start Guide Polymotion Tab Settings The tracking settings are normally not changed and should be left at ‘100%’ . Depth Sensing Polymotion Chat 3.0 allows the use of an external depth sensor camera for depth sensing, or sensitivity of the tracking based on the subject moving towards or away from the camera.
Page 54
Polymotion Chat Studio 3.1.0 Quick Start Guide Select FIND DEPTH SENSORS to automatically detect the connected sensor. When the sensor is detected, click CONNECT and then click CLOSE. You can instead enter the IP address of the depth sensor and click DIRECT CONNECT to add it manually.
Page 55
Polymotion Chat Studio 3.1.0 Quick Start Guide in relation to the camera, the diagram would reflect this. Use the diagram to help you measure the offset values. Once configured, these values do not need to be changed if the hardware configuration of the camera remains the same.
Polymotion Chat Studio 3.1.0 Quick Start Guide Aligning the Depth Sensing Heat Map After you have configured the depth sensor, a heat map appears overlapping the image of the target, as follows. Heat map not aligned For accurate auto focusing using depth sensing, the heat map should exactly overlap the subject image from the camera.
Page 57
Polymotion Chat Studio 3.1.0 Quick Start Guide Heat map aligned Blue dot stays central Note Depth sensing currently works only when there is a single target in the frame.
Polymotion Chat. Broadcast studio robotic heads including MRMC robotic heads that are controlled using an existing software can use an API for Chat for subject tracking over the network from the same interface. For more information on how to use an API, contact MRMC.
Chapter 2 Using Rail Polymotion Chat Studio 3.1.0 Quick Start Guide Polymotion Chat Studio 3.1.0 Quick Start Guide Chat 3.0 supports addition of an AFC head moving on a Rail. If your Polymotion Chat Installation contains a head moving on a Rail, then there are some additional options on the Polymotion Chat user interface to control the speed and travel length on the rail.
Page 60
Polymotion Chat Studio 3.1.0 Quick Start Guide On the Preferences page, you can set limits and speed for Rail as an additional axis for the ‘parent’ head. The multi-view in the Operator login appears as below showing the video feed from the camera heads installed on the rail tracks:...
Polymotion Chat Studio 3.1.0 Quick Start Guide Configuring Rail Configure rail button To configure the rail, in the Operator main page, click , then click the appearing Configure Rail button. This will open the Rail Settings box. Rail Settings Configure rail...
Polymotion Chat Studio 3.1.0 Quick Start Guide This mode also allows you to set the A and B points or presets between which you want the head to move on the rail. To specify the A and B points, use the on-screen rail slider to position the...
Polymotion Chat Studio 3.1.0 Quick Start Guide Notes Regarding Rail Setup Rail axis settings: – Maximum speed: 20cm/s – Max acceleration: 20cm/s – Maximum deceleration: 20cm/s If the maximum speed is exceeded then the head might trip. Manually power cycle the head after trip.
Page 64
Polymotion Chat Studio 3.1.0 Quick Start Guide Notes...
Appendix 1 Installation and Backup Polymotion Chat Studio 3.1.0 Quick Start Guide Polymotion Chat Studio 3.1.0 Quick Start Guide System requirements for Polymotion Chat Studio Dell 1U or 2U server OS: Windows 10 Pro CPU: i9-12900 Processor ...
Polymotion Chat Studio 3.1.0 Quick Start Guide Configuring the Polymotion System Steps in this section are performed by MRMC as part of the factory settings. However, operators can use these as a reference when troubleshooting any issues should they occur.
Polymotion Chat Studio 3.1.0 Quick Start Guide Installing Polymotion Launcher Note This procedure is for a fresh installation of Polymotion Launcher v3.1.0 or upgrading from v3.x. If you are upgrading from a Polymotion Launcher v2.8, refer to MHC v2.8 to MHC v3.1.0 upgrade on page 68.
Page 68
Polymotion Chat Studio 3.1.0 Quick Start Guide On the next screen, select MHC. Click Next. Click Next.
Page 69
Polymotion Chat Studio 3.1.0 Quick Start Guide The next screen summarises the components selected for install. Click Install to install the MHC Polymotion Launcher (Core) - the default component of all Polymotion products. Ensure that you choose the install location as one within the MHC folder to install MHC.
Page 70
Polymotion Chat Studio 3.1.0 Quick Start Guide upgrade. You can also choose to do a Client-only installation in this dialog box. The next screen shows the components that are ready to be installed.
Page 71
Polymotion Chat Studio 3.1.0 Quick Start Guide 10. Follow the on-screen instructions. 11. Click Browse and navigate to C:\Program Files\MHC\USBtoIP_ driver\USBIPEnum.inf.
Polymotion Chat Studio 3.1.0 Quick Start Guide Installing CV Engine After installing Polymotion Launcher, double-click CV-Engine_ to start the installation. When a Setup_Server_v3.1.0.0.exe message appears asking for confirmation, click Yes.
Page 73
Polymotion Chat Studio 3.1.0 Quick Start Guide Click OK on the Setup message. Select the installation folder and click Next. You should normally not need to change the default path. Click Yes if a message appears that the folder already exists.
Page 74
Polymotion Chat Studio 3.1.0 Quick Start Guide Click Install on the next screen of the installation wizard. It is recommended that on the final screen you select the option to restart the computer and click Finish.
Polymotion Chat Studio 3.1.0 Quick Start Guide Licensing your Polymotion Product If you have recently installed MHC, when you launch MHC Polymotion Launcher, click Manage Licenses. On the Licenses window, click the Copy button the bottom of your MHC screen to copy the UID and paste it your license request including any other products such as Polymotion Chat or Polymotion Player to broadcast.support@mrmoco.com.
Polymotion Chat Studio 3.1.0 Quick Start Guide Upgrading from Polymotion Chat v2.8 to v3.1.0 Before installing the new version of Chat ensure that you backup your existing MHC and CV-Engine folders. Uninstall MHC and CV-Engine using ‘Apps & features’ in Windows Settings.
Polymotion Chat Studio 3.1.0 Quick Start Guide Backup and Restore of CV Engine Settings The two buttons at the top of CV Engine tab allow you to backup and restore CV Engine settings. Import Clicking the Import button opens a new window. If you had already exported your tracking settings for a head as a <...
Polymotion Chat Studio 3.1.0 Quick Start Guide Export When you want to back up your current tracking settings, you can export an XML file using the Export button. Later, you can load the settings using the Import button. Note that the Chat software version from which you exported the setting must be identical to the one you import.
Polymotion Chat Studio 3.1.0 Quick Start Guide Restore Defaults After clicking the Restore Defaults button, you will be prompted for confirmation if you really want to reset all CV Engine config. A confirmation will remove all your current settings and restore factory default values.
Polymotion Chat Studio 3.1.0 Quick Start Guide Remote Client Configuration Install MHC as normal on the MHC Server machine and note that machine's IP address. Install MHC with the “Client only” option on the remote client. Start up client and server on their respective machines.
Page 81
Polymotion Chat Studio 3.1.0 Quick Start Guide However, if there’s only one MHC server detected, a confirmation popup appears. MHC has now automatically configured remote video feeds for all robots. Go to Chat wizard and setup the required video input feed in to...
Page 82
Polymotion Chat Studio 3.1.0 Quick Start Guide...
Appendix 2 Troubleshooting Polymotion Chat Studio 3.1.0 Quick Start Guide Polymotion Chat Studio 3.1.0 Quick Start Guide Resolving Video Feed issues Blackmagic Media Express can be used to verify that decklink video feeds are connected to the correct input ports. Use the device menu to switch between inputs and view the incoming video feeds.
Page 84
Polymotion Chat Studio 3.1.0 Quick Start Guide Note: For a stable CV Engine, the Graphics card should be on TCC mode. Press the windows key then type “cmd”. Right click on “Command Prompt” then select “Run as administrator”. Go to the Nvidia SMI directory with "...
Polymotion Chat Studio 3.1.0 Quick Start Guide Reboot the system. Finally, use the “ ” command again to check the card(s) nvidia-smi has been correctly set to TCC mode. Note When a card is in TCC mode it is in “compute only” mode so cannot be used by Windows as a graphics card.
Polymotion Chat Studio 3.1.0 Quick Start Guide Typical symptoms, causes, and actions Symptoms Cause and/or action Warning appears that Force CV Engine close via Windows Task the tracking source is Manager disconnected. MHC server is shut down but CV engine is still running.
Page 87
Polymotion Chat Studio 3.1.0 Quick Start Guide Notes...
Page 88
Mark Roberts Motion Control Ltd. Unit 3, South East Studios, Blindley Heath, Surrey RH7 6JP United Kingdom Telephone: +44 (0) 1342 838000 info@mrmoco.com www.mrmoco.com...
Need help?
Do you have a question about the Polymotion Chat Studio 3.1.0 and is the answer not in the manual?
Questions and answers