Polymotion Chat Studio v3.5 Quick Start Guide Contents Chapter 1 Polymotion Chat Studio v3.5 ........1 Overview of Polymotion Chat Tracking System....1 Setting up Polymotion Chat Studio........1 Connecting Cables (Dell 1U Server)......2 Connecting Cables (Dell 2U Server)......3 Launching Polymotion Chat ........
Page 5
Polymotion Chat Studio v3.5 Quick Start Guide Activating and stopping a move ......48 Using Panasonic PTZs with Multi-point Moves ..49 PTZ Setup............49 Multipoint Move Workaround for Panasonic PTZ...........51 Multipoint Moves with Sony FR-7 ......51 Setup requirements ...........51 Configuring FreeD for FR-7 ......52 Setting MHC to Receive Data......52...
Page 6
Polymotion Chat Studio v3.5 Quick Start Guide Appendix 2 Troubleshooting ............91 Resolving Video Feed issues ..........91 Graphic Card Device Driver Issues......91 Typical symptoms, causes, and actions ......93...
Chapter 1 Polymotion Chat Studio v3.5 Polymotion Chat Studio v3.5 Quick Start Guide Polymotion Chat Studio v3.5 Quick Start Guide Overview of Polymotion Chat Tracking System Polymotion Chat is an advanced broadcast camera automation system solution. The advanced integrated AI engine detects face and limbs building a model of the subject and uses this to control and predict movement delivering high quality and natural camera motion.
Polymotion Chat Studio v3.5 Quick Start Guide Connecting Cables (Dell 1U Server) Power Ethernet Broadcast Panel USB Hub Power Dell 1U Server (rear) Decklink card Sync (not used) Ethernet Hub Power ETHERNET ETHERNET Power Power ETHERNET Power Panasonic PTZ PTA head (Junction...
Polymotion Chat Studio v3.5 Quick Start Guide Connecting Cables (Dell 2U Server) Power Broadcast Panel USB Hub Dell 2U Server (rear) Decklink card Power ETHERNET Ethernet Hub Power ETHERNET ETHERNET ETHERNET Power Power ETHERNET Power Panasonic PTZ PTA head (Junction...
Click/tap Polymotion CHAT Studio/Broadcast. If you are launching this for the first time, you will be required to add a new license file or a license code. Contact MRMC Support for a new license. Refer to Licensing your Polymotion Product on page 78.
Polymotion Chat Studio v3.5 Quick Start Guide Setting up Polymotion Chat using Network Setup and Chat wizard Cable together the robotic heads, Polymotion PC, cameras, and joysticks participating in the Polymotion network. Also connect the PC with the cameras using appropriate cables and data converters depending on method used for streaming the video.
Page 12
Polymotion Chat Studio v3.5 Quick Start Guide Note When adding a Sony FR-7 camera on the Network Settings page, Polymotion Chat allows for authentication to access the camera controls, for example to switch auto-focus on and off and to use Iris.
Page 13
Polymotion Chat Studio v3.5 Quick Start Guide If you have Rail or Lift axis in a system, they are configured in the network setup as the ‘child’ of the ‘parent’ head that moves along the rail. Rail set up as ‘child’ of ‘parent’ AFC head Once added in the parent-child manner, Rail and lift appear as additional axes to the parent head in the Robot Setting page.
Page 14
Polymotion Chat Studio v3.5 Quick Start Guide On the Preferences page, you can set limits and speed for Rail as an additional axis for the ‘parent’ head. > CHAT WIZARD. This page shows the added Select Settings robots as boxes where video feed from each of them can be set up.
Page 15
Polymotion Chat Studio v3.5 Quick Start Guide Under VIDEO INPUT, select the source of the video feed. Select the DEVICE. If the selected video input is Decklink or USB device, then DEVICE is the port receiving the video feed from the camera on the robot.
Page 16
Click Start CV Engine to start the program that enables Polymotion tracking in MHC. As you do so, notice that additional windows pop up, which can take up to 30 minutes; these windows are for MRMC CV Engine, a software application that runs in the background to enable Polymotion Chat, and must not be closed at any instance while using the system for accurate functioning.
Page 17
Polymotion Chat Studio v3.5 Quick Start Guide NDI video feed issues If a video input was selected as NDI in Step 5 but is not displayed after clicking Start CV Engine, then it is recommended that you download and install NDI Studio Monitor tool from the NDI website.
Page 18
The Disable/Enable toggle button can be used to disable/enable any axis. Click Next after completing each step. Note The Disable/Enable axis functionality is available for MRMC heads only. Next, the direction should be set accurately for accurate tracking. For this, use the buttons for controlling the axis to check whether...
Page 19
Polymotion Chat Studio v3.5 Quick Start Guide the robotic heads are moving in the direction stated on the button. If not, you can use the Invert button to invert the direction of the axis Note Clicking Invert inverts the axis and saves the change in the robotic head.
Page 20
Polymotion Chat Studio v3.5 Quick Start Guide...
Page 21
Polymotion Chat Studio v3.5 Quick Start Guide If Rail and Lift are added to the head then additional steps for calibrating these axes will appear in Chat Wizard.
Page 22
Polymotion Chat Studio v3.5 Quick Start Guide In this step, you can adjust the tracking sensitivity by clicking the play button to temporarily start tracking and then tweaking the sensitivity using the slider. To modify tracking sensitivity a person needs to be present in the frame to allow tracking to begin.
Page 23
Polymotion Chat Studio v3.5 Quick Start Guide Repeat Steps 2-7 for all the robotic heads that are part of Polymotion Chat system. These are instructions when both MHC Server and Client are on the same machine. To configure MHC Client on a remote PC, follow the instructions in Remote Client Configuration on page 89.
Polymotion Chat Studio v3.5 Quick Start Guide Setting up the robotic heads for Polymotion Chat Provided all the participating robots are connected properly and video feeds from all the cameras are being successfully received and are correctly configured, your first session will involve logging in to the MHC Client.
Polymotion Chat Studio v3.5 Quick Start Guide Polymotion Chat Main page Full Screen Lens Position Head LiveView Controls view button selection Goto/ Tracking Focus Velocity Zoom Velocity Pan/tilt Sensitivity Control Control Control The controls on the Main page can be used to control robotic head axes as well as set up and run presets which can be later used to follow targets automatically.
Polymotion Chat Studio v3.5 Quick Start Guide Note When Polymotion Chat Main page is started for the first time after Chat installation, the CVE PoseNet Initialization process is started and a message appears in the LiveView window. This process will continue for up to 30 minutes depending on the number of heads in your Chat configuration.
Polymotion Chat Studio v3.5 Quick Start Guide RobotLens tab for these to function accurately. The Iris control has the ‘AUTO’ toggle to allow for auto iris. Important End stops on Focus and Zoom are not supported for Panasonic PTZ devices.
Polymotion Chat Studio v3.5 Quick Start Guide Tracking Sensitivity Tracking sensitivity determines how quickly the camera moves in reaction to the target moving away from the reference point, i.e. the deflection from the desired position. This feature gives better control over lower speeds. For example, when the slider is at the half way mark the sensitivity demand is only 20%.
For more information on the Preferences page, read MHC v3.5 User Manual and MHC v3.5 Quick Start Guide. Note If active, robot tracking deactivates when the wiper function is activated for MRMC ARC-UHD and ARC-360 robotic heads. You can turn tracking on again once the wiping is complete. Presets Non-tracking...
Polymotion Chat Studio v3.5 Quick Start Guide position for limb detection and tracking and non-tracking presets used to store a position. When storing a position, all the axes positions are stored. A preset button is faded when no position is stored in them.
Polymotion Chat Studio v3.5 Quick Start Guide Switch to store mode by clicking/tapping on . You will see that the preset buttons change to yellow, indicating that the preset buttons can be selected to store your current head position. Click/tap on a preset button to store the current head position.
Page 32
Polymotion Chat Studio v3.5 Quick Start Guide Switch to Configure mode by clicking/tapping on . You will see a yellow border around , indicating that the preset buttons are in the Configure mode. Click/tap on a preset button that you want to set. This button will now change to yellow and a Configure box display will appear.
Polymotion Chat Studio v3.5 Quick Start Guide Configuring a Preset Auto Framing LiveView graphics settings Option Description Label Allows the user to set a custom name for the preset. Time Time taken to go to the preset if mode is set to ‘CUT’...
Polymotion Chat Studio v3.5 Quick Start Guide Option Description Toggles the preset between PTZ and non PTZ preset. When greyed, the PTZ is tracking only, in other words, when selecting such a preset, the pan, tilt and zoom axes positions will not be changed.
Page 35
Polymotion Chat Studio v3.5 Quick Start Guide modes, the stop zone only applies to the pan axis, tilt is handled by the setting in the Framing Size slider: from head and shoulder to full body. 1-person tracking mode applied Framing size slider...
Polymotion Chat Studio v3.5 Quick Start Guide Tracking mode Description 2-person tracking: In this auto framing tracking mode, the Chat system keeps two people in the frame. 3-person tracking: In this auto framing tracking mode, the Chat system keeps three...
Polymotion Chat Studio v3.5 Quick Start Guide the frame, another recognised person is picked for tracking until the person returns and the tracking will shift to following that person again. In this case tracking can be switched to another person temporarily by clicking on their image in LiveView video.
Polymotion Chat Studio v3.5 Quick Start Guide Option Description Toggles showing the green boxes or ellipses for static zones. When pressed, the person closest to the middle of the static zone is picked for tracking. (Clicking the preset button also resets tracking.)
Page 39
You can still change the name and picture associated with the preset while tracking is on. Note Options for changing Camera settings for MRMC Visca heads — Camera ARC 360 and ARC UHD heads — are available in Settings. For more details, refer to MHC User Manual.
Page 40
Polymotion Chat Studio v3.5 Quick Start Guide Note regarding Birddog Autofocus function When a preset is saved with AF on, enabling it and changing the AF state will not reflect in the preset when it is enabled again. This happens because of the preset memory function in the Birddog PTZ camera.
Polymotion Chat Studio v3.5 Quick Start Guide Altering Static Zones Selecting in Configure mode for a preset shows a bar in LiveView window which allows you to edit the static zones. This changes the shape for Toggle between inner the static zones to either stop zone and outer rectangular or elliptical.
Polymotion Chat Studio v3.5 Quick Start Guide Edit Static Zone Use the appearing arrows and other options to edit the static zones as required, and then exit the edit mode. Zone edit mode Follow facemode Choose Person When the little framed person icon is selected the user can choose which person on screen will be tracked.
10. Synchronised Robots Polymotion Chat supports synchronised robots, or two or more MRMC heads can be set to follow the same movement. It allows one or more secondary cameras to exactly follow the movement of the primary camera.
Polymotion Chat Studio v3.5 Quick Start Guide Motion Prediction This adds a thin white line depending on which way the target is moving/ facing and gives the tracking demand an extra boost depending on the level of the setting in the CV-Engine tab. For more information, refer to page 58.
Polymotion Chat Studio v3.5 Quick Start Guide You can stop tracking on the currently selected head by using the pan and tilt joystick control. As soon as you move the joystick the tracking will be disengaged. Another way of stopping tracking on individual robotic heads is by clicking/tapping under the head-select button.
Page 46
Polymotion Chat Studio v3.5 Quick Start Guide operator main page without needing to go to the Face Capture page, for more details refer to Live Capture on page 36. To capture a profile using the Face Capture page: FACE CAPTURE.
Polymotion Chat Studio v3.5 Quick Start Guide Editing a Profile To edit the profile, hover over it and click/tap Edit. Additional images can be added by clicking CAPTURE MORE IMAGES for more accurate face recognition. Use the Edit button to Edit the name of the profile.
Page 48
Polymotion Chat Studio v3.5 Quick Start Guide An enabled profile can be selected for face recognition by selecting a name in preset configuration. When tracking is started using this preset, only that person will be tracked by this preset. Selecting ‘Any’ will enable tracking of all enabled profiles.
Polymotion Chat Studio v3.5 Quick Start Guide Face Recognition without Autoframing An unrecognised person or a disabled profile on the FACE CAPTURE page, displays as ‘unknown’ in the Live View video on the main page. Export a Face Recognition Profile Export allows you to specify where to export the user profile which can be imported later.
Polymotion Chat Studio v3.5 Quick Start Guide Multi-screen View If a user is assigned multiple connected heads, the default screen after login is the Multi-screen. Also, when on the Chat main page, you can click/tap the Multi-screen view ( ) button to view the live video feed from up to 12 connected heads.
Polymotion Chat Studio v3.5 Quick Start Guide If you START tracking (ALL), the multi-view screen will have the tracking controls as below. Multi-Point Moves Multi-point moves allows you to set up moves that pass through upto 8 waypoints. Storing a Multi-point Move...
Page 52
Polymotion Chat Studio v3.5 Quick Start Guide Click . The EDIT MOVES pane appears. Click/tap Create new move. The new move can be configured in the appearing pane. The move can have upto 8 waypoints. To create a waypoint, either...
Page 53
Polymotion Chat Studio v3.5 Quick Start Guide to it. All empty waypoints are ignored. Each move must have at least two waypoints. Click/tap the ellipses next to a way point for additional options to delete, store and go to a waypoint.
Polymotion Chat Studio v3.5 Quick Start Guide 11. Click to save the move. The saved move appears in the Edit Moves pane. Click/tap the ellipses next to a move for additional options to delete, paste and copy moves. 12. Click to finish configuring the move.
Note When using multipoint moves in conjunction with third-party (non-MRMC) PTZ cameras, it is recommended that the PTZ’s auto-focus is engaged throughout the multipoint move; otherwise, incorrect focus control may result.
Page 56
Polymotion Chat Studio v3.5 Quick Start Guide 1.5 Add the IP address of the receiving FreeD computer and the listening port. 1.6 In MHC client, for the same Panasonic head, navigate to Robot Settings FreeD.
Polymotion Chat Studio v3.5 Quick Start Guide 1.7 Add the same listening Port number. The MHC client should start listening to the FreeD output from the PTZ head. For optimal move performance the PT speed should be set to fast.
Polymotion Chat Studio v3.5 Quick Start Guide Lens: This needs to be selected. Multipoint Moves has been optimized for use with the Sony SELP28-135G lens. Lens Calibration: The selected lens needs to be calibrated so that it accurately functions when used with Multipoint Moves.
Polymotion Chat Studio v3.5 Quick Start Guide Add the same listening Port number. The MHC client should start listening to the FreeD output from the PTZ head. Note If several robots required FreeD input then the FreeD Ports must be unique.
Polymotion Chat Studio v3.5 Quick Start Guide Click the Config button. The lens will move the zoom axis to various positions and then move the focus axis to various positions. Once finished click OK. Note This only needs to be done once per lens.
Page 61
Polymotion Chat Studio v3.5 Quick Start Guide Add waypoints as before. Note that the waypoints will not include PTZ axes and the thumbnails will be added accordingly. Following is an example for a child-only move for a Rail Lift System.
Polymotion Chat Studio v3.5 Quick Start Guide Single-point Tracking Single-point tracking enables the setup of a point that the head remains pointing to regardless of the position on the rail and/or lift. For it to work, it requires some configuration: First, you need to set up nodal offsets.
Page 63
Polymotion Chat Studio v3.5 Quick Start Guide Put the crosshairs on the target on the other end of the rail (or lift) and then click CALIBRATE. In the screen below target is the screw at the end of the rail.
Polymotion Chat Studio v3.5 Quick Start Guide Move the head to the other end of the rail (or lift), point the camera to the same target again and click the A point. Click Configure to turn off the configure mode.
Page 65
Polymotion Chat Studio v3.5 Quick Start Guide Help info button Video Source: Use this box to change the Video Input for camera tracking. Simply enter the name of the input stream along with the port number ( USB: Camerax ...
Page 66
Output Pose Data: Toggle switch to send pose data to the Pose Data Output Port and IP. Synchronised Control: More than one MRMC cameras can be grouped to follow a synchronised movement. Record tracking video: Click Start Recording to record the video output of CV Engine.
Page 67
Polymotion Chat Studio v3.5 Quick Start Guide Use Axis Position for Occlusion Handling: Turning this feature on will use the axis position of the robotic head to improve tracking performance. Show Detection on Face: When checked tracking points and lines on face are shown.
Page 68
Polymotion Chat Studio v3.5 Quick Start Guide Face Tracking Recovery: If facial recognition cannot recognise the current subject due to a momentary occlusion or sideways aspect of the face, the options are: Wait for the named face to re-appear and start tracking again ...
Polymotion Chat Studio v3.5 Quick Start Guide Auto Framing Tab Auto Framing tab allows you to modify the auto framing tracking settings for individual robot settings so that if, for instance, the camera is in a darker place or the zoom is in very tight you can adjust the tracking parameters of just that robot to allow for better tracking performance and then you can restore these values to the default at the end of your session.
Polymotion Chat Studio v3.5 Quick Start Guide Polymotion Tab Settings The tracking settings are normally not changed and should be left at ‘100%’ . Depth Sensing Polymotion Chat 3.0 allows the use of an external depth sensor camera for depth sensing, or sensitivity of the tracking based on the subject moving towards or away from the camera.
Page 71
Polymotion Chat Studio v3.5 Quick Start Guide Select FIND DEPTH SENSORS to automatically detect the connected sensor. When the sensor is detected, click CONNECT and then click CLOSE. You can instead enter the IP address of the depth sensor and click DIRECT CONNECT to add it manually.
Page 72
Polymotion Chat Studio v3.5 Quick Start Guide in relation to the camera, the diagram would reflect this. Use the diagram to help you measure the offset values. Once configured, these values do not need to be changed if the hardware configuration of the camera remains the same.
Polymotion Chat Studio v3.5 Quick Start Guide Aligning the Depth Sensing Heat Map After you have configured the depth sensor, a heat map appears overlapping the image of the target, as follows. Heat map not aligned For accurate auto focusing using depth sensing, the heat map should exactly overlap the subject image from the camera.
Page 74
Polymotion Chat Studio v3.5 Quick Start Guide Heat map aligned Blue dot stays central Note Depth sensing currently works only when there is a single target in the frame.
Polymotion Chat. Broadcast studio robotic heads including MRMC robotic heads that are controlled using an existing software can use an API for Chat for subject tracking over the network from the same interface. For more information on how to use an API, contact MRMC.
Page 76
Polymotion Chat Studio v3.5 Quick Start Guide Notes...
Appendix 1 Installation and Backup Polymotion Chat Studio v3.5 Quick Start Guide Polymotion Chat Studio v3.5 Quick Start Guide System requirements for Polymotion Chat Studio Dell 1U or 2U server OS: Windows 10 Pro CPU: Intel i9, AMD Ryzen 9 or equivalent ...
Polymotion Chat Studio v3.5 Quick Start Guide Configuring the Polymotion System Steps in this section are performed by MRMC as part of the factory settings. However, operators can use these as a reference when troubleshooting any issues should they occur.
Polymotion Chat Studio v3.5 Quick Start Guide Installing Polymotion Launcher Note This procedure is for a fresh installation of Polymotion Launcher v3.5.x or upgrading from v3.5.x. If you are upgrading from a Polymotion Launcher v2.8, refer to Upgrading from Polymotion Chat v2.8 to v3.5.x on page 79.
Page 80
Polymotion Chat Studio v3.5 Quick Start Guide Accept the license agreement and click Next. Specify the location of the MHC application on your hard drive. By default it is installed in C:\Program Files\MHC. Click Next..
Page 81
Polymotion Chat Studio v3.5 Quick Start Guide On the next screen, select MHC. Click Next. The next screen summarises the components selected for install. Click Install to install the MHC Polymotion Launcher (Core) - the default component of all Polymotion products.
Polymotion Chat Studio v3.5 Quick Start Guide Installing CV Engine Note It is crucial that the CV Engine display adapter drivers compatible with the NVIDIA graphics card on your computer are manually downloaded from https://www.nvidia.co.uk/Download/ index.aspx?lang=en-uk and installed. After installing Polymotion Launcher, double-click CV-Engine_ to start the installation.
Page 83
Polymotion Chat Studio v3.5 Quick Start Guide Click Install on the next screen of the installation wizard. When installing CV engine for the first time, you must check the Generate AI models to initiate Pose Estimation. This process can take up to 20 minutes.
Polymotion Chat Studio v3.5 Quick Start Guide Click Finish. At any point, to access Help files for MHC and Polymotion Products including all MRMC broadcast hardware products, use the MHC Help desktop icon. Licensing your Polymotion Product If you have recently installed MHC, when you launch MHC Polymotion Launcher, click Manage Licenses.
Polymotion Chat Studio v3.5 Quick Start Guide other products such as Polymotion Chat or Polymotion Player to broadcast.support@mrmoco.com. On the receipt of your license file, save it on to the disk, launch Polymotion Launcher. Click the Add new licence file button and select the new license file.
Polymotion Chat Studio v3.5 Quick Start Guide Start Polymotion Launcher from the desktop icon created during install. As this is a major software version update, a new license is required. Request a new license using the form in the application and install the new license file that you will receive by email using the procedure in Licensing your Polymotion Product on page 78.
Polymotion Chat Studio v3.5 Quick Start Guide > file using Export button before, you can import the config .xml exported settings. Export When you want to back up your current tracking settings, you can export an XML file using the Export button. Later, you can load the settings using the Import button.
Polymotion Chat Studio v3.5 Quick Start Guide Note Import/Export of CV Engine and Robot settings is not supported for remote clients. You will need to perform the operation of the MHC Server computer. Save Config Clicking Save Config button will save CV Engine settings in <...
Polymotion Chat Studio v3.5 Quick Start Guide because “MHCCVConfigs.xml” file saved by “SAVE SETTINGS” button will also be cleared up. Backup and Restore All User Settings Polymotion v3.5.x allows you to backup and restore all user settings for client and server including the CV-Engine settings held by the server, saved presets settings, robot parameters, screen grabs for preset buttons and so on.
Page 90
Polymotion Chat Studio v3.5 Quick Start Guide At the first screen of the Backup utility, select Backup and click Next. In the next screen, select the MHC installation folder that you want to back up.
Page 91
Polymotion Chat Studio v3.5 Quick Start Guide Close both MHC Server and Client. Your backup/restore may not be consistent if the backup was taken while MHC still running. So, it is highly recommended to complete the configuration and then do the backup.
Polymotion Chat Studio v3.5 Quick Start Guide Restore Ensure that Polymotion/MHC is installed on the PC where you want to restore the previously stored backup. Start the MHC Backup Utility and select Restore and click Next.
Page 93
Polymotion Chat Studio v3.5 Quick Start Guide Select the MHC installation folder where the configuration needs to be restored and click Next. Navigate to the backup file and click Next.
Page 94
Polymotion Chat Studio v3.5 Quick Start Guide Note that the restore operation cannot be reversed. If you are unsure make a backup of current configuration using this tool before attempting to restore.
Polymotion Chat Studio v3.5 Quick Start Guide Remote Client Configuration Install MHC as normal on the MHC Server machine and note that machine's IP address. Install MHC with the “Client only” option on the remote client. Start up client and server on their respective machines.
Page 96
Polymotion Chat Studio v3.5 Quick Start Guide However, if there’s only one MHC server detected, a confirmation popup appears. MHC has now automatically configured remote video feeds for all robots. Go to Chat wizard and setup the required video input feed in to CV-Engine.
Appendix 2 Troubleshooting Polymotion Chat Studio v3.5 Quick Start Guide Polymotion Chat Studio v3.5 Quick Start Guide Resolving Video Feed issues Blackmagic Media Express can be used to verify that decklink video feeds are connected to the correct input ports. Use the device menu to switch between inputs and view the incoming video feeds.
Page 98
Polymotion Chat Studio v3.5 Quick Start Guide are not showing driver errors like the one below. If they are, then uninstall the device driver and then restart your machine.
Polymotion Chat Studio v3.5 Quick Start Guide Typical symptoms, causes, and actions Symptoms Cause and/or action Warning appears that Force CV Engine close via Windows Task the tracking source is Manager disconnected. MHC server is shut down but CV engine is still running.
Page 100
Polymotion Chat Studio v3.5 Quick Start Guide Notes...
Page 101
Polymotion Chat Studio v3.5 Quick Start Guide Notes...
Page 102
Mark Roberts Motion Control Ltd. Unit 3, South East Studios, Blindley Heath, Surrey RH7 6JP United Kingdom Telephone: +44 (0) 1342 838000 info@mrmoco.com www.mrmoco.com...
Need help?
Do you have a question about the POLYMOTION CHAT STUDIO V3.5 and is the answer not in the manual?
Questions and answers