OptoFidelity Video Multimeter – User Manual Contents OptoFidelity Video Multimeter ................1 User Manual ....................1 General information on OptoFidelity Video Multimeter ........6 Start Window .................... 6 Frame rate measurement task ..............7 Overview tab ..................7 Statistics tab ..................9 Configuration tab ................
1 General information on OptoFidelity Video Multimeter OptoFidelity Video Multimeter is a compact desktop solution for measuring the true and objective video playback performance of a mobile, tablet or any multimedia device directly from the display of that device. It is controlled with a resistive touch display which works best with, for example, a fingernail or stylus.
OptoFidelity Video Multimeter – User Manual 3 Frame rate measurement task The frame rate measurement task determines the playback smoothness of the device under test (DUT) with a test video. A blinking marker is measured from the display of device and this marker helps to determine frame intervals and missing frames. The basic measurement setup is shown in Figure 2.
Page 8
Note: To get repeatable results start and stop the measurement in the white period at the start and end of the video. Such videos can be generated in OptoFidelity Test Video Generator (TVG) by using the setting calibration=both.
OptoFidelity Video Multimeter – User Manual Figure 5: Message window after saving the measurement results Figure 6. “Show MOS” button is available after the file is saved. 3.2 Statistics tab During or after performing a measurement you can switch to the Stats (Statistics) tab to see further information.
OptoFidelity Video Multimeter – User Manual Figure 7: Statistics tab The upper row displays the minimum, average, standard deviation and maximum values of the frame intervals. The lower row displays the total number of frames and the amount of dropped frames.
OptoFidelity Video Multimeter – User Manual 1. RGB (6-color): Marker with specific color sequence of 6 different colors. This measures frame intervals and detects dropped frames. 2. Black & White: Black and white marker. A simple method for testing frame intervals, but detecting dropped frames is not possible.
= 0 The device serial number must match the physical Video Multimeter device. License files are generated by OptoFidelity only. License files should not be edited manually. 4.2 Audio input cable connection This feature requires an audio input. A 3.5mm audio jack cable must be connected to Sensor 1 interface.
OptoFidelity Video Multimeter – User Manual Figure 10: Lip sync audio cable connected to Sensor 1 input 4.3 Framerate application’s Lip sync tab When you have completed successfully the previous actions (valid license file copied and audio cable connected), the Framerate task shows an additional tab in the Video Multimeter UI as shown in Figure 11.
Page 14
OptoFidelity Video Multimeter – User Manual Figure 12: Lip sync tab's Audio volume indicator The audio volume indicator value should be observed especially during the audio markers. The ‘Marker detected’ indicator flashes with a blue color when the marker is detected.
OptoFidelity Video Multimeter – User Manual Graph scale colors (green, yellow, red) come from different standards and suggestions. Limits, which are only instructive, are set as follows: • Green (Good): within -15 … +45 ms (Acceptance limit according to ATSC IS- 191) •...
OptoFidelity Video Multimeter – User Manual Figure 15: USB mode selection screen When the USB cable is connected and the device is on, a selection window such as in Figure 15 opens on the display. The window has options Data transfer and Charge only.
= 0 The device serial number must match the physical Video Multimeter device. License files are generated by OptoFidelity only. License files should not be edited manually. 6.2 External trigger configuration The External trigger feature is active when the corresponding application is started from the main menu.
OptoFidelity Video Multimeter – User Manual The functions of this screen are as follows: • Pulse length (ms): the length of the positive pulse in milliseconds that is generated at the moment of a detected video frame • Pulse delay (ms): the delay in milliseconds between the video frame detection and the rising edge of the pulse •...
= 0 The device serial number must match the physical Video Multimeter device. License files are generated by OptoFidelity only. License files should not be edited manually. 7.2 Camera viewfinder latency measurement setup The measurement setup is very simple; Video Multimeter shows a blinking marker, which is captured by the camera of the device under test (DUT).
Page 20
OptoFidelity Video Multimeter – User Manual Figure 19: Camera latency application just started In the Camera latency application the marker (black-white) blinks at one second intervals. The interval is fixed and enables the measurement of a latency of a maximum of 500 milliseconds.
OptoFidelity Video Multimeter – User Manual 8 Video Transfer Performance The Video Transfer Performance measurement determines end-to-end characteristics of a video transfer system, such as a video call. It differs from Camera Framerate option by only measuring end-to-end characteristics: framerate on display, video latency and lipsync.
OptoFidelity Video Multimeter – User Manual The camera takes images of the color marker on the RGB led target. The color displayed will change for every frame the camera takes. The fiber on the receiving end monitors the color on the display and detects the frame timing by accurately measuring the changes.
Page 23
OptoFidelity Video Multimeter – User Manual More detailed measurement results can be seen on the Stats tab. The "Frames on display" section displays the minimum and maximum frame time during the measurement, the average frame time, and the standard deviation of the frame times.
Page 24
OptoFidelity Video Multimeter – User Manual Figure 24: Video Transfer Performance lipsync tab After stopping the measurement, the results can be saved to a CSV file by pressing Save button on the Overview tab. A message box will show the path where file has been saved and the number of frames in the measurement.
OptoFidelity Video Multimeter – User Manual The saved CSV files are separated by semicolons and can be opened using e.g. Microsoft Excel. Columns of the result file are described in table below: Column Measurement unit Description 1: Timestamp microseconds (µs) Start of the frame display, running timestamp from the start of the measurement.
= 0 The device serial number must match the physical Video Multimeter device. License files are generated by OptoFidelity only. License files should not be edited manually. 9.2 Dual FPS measurement setup In Dual FPS measurement setup the test video is shown on both primary and secondary displays.
OptoFidelity Video Multimeter – User Manual Figure 26: Typical setup for measuring two displays simultaneously The test video used in Dual FPS measurement must have the 6-color RGB marker. Dual measurement does not support other marker types. For Dual FPS measurement the secondary fiber must be connected to the Video Multimeter Sensor port.
OptoFidelity Video Multimeter – User Manual Figure 28: Dual FPS application just started 9.4 Dual FPS Color calibration Color calibration must be done before measurement can be started; therefore, Calibrate is the only active button on Dual FPS application initially. Calibration is started from Calibrate button.
OptoFidelity Video Multimeter – User Manual Figure 24. Dual FPS application during measurement. After stopping the measurement, the Overview page shows the results from the previous measurement. result table includes following results primary secondary measurements: • FPS: Frames per second.
OptoFidelity Video Multimeter – User Manual the example of result data file content in Figure 26. Each row corresponds to one frame, and has the following columns: A) Microsecond timestamp of the frame start for primary measurement. B) Microsecond length of the primary frame (-1 for dropped frames).
= 0 The device serial number must match the physical Video Multimeter device. License files are generated by OptoFidelity only. License files should not be edited manually. 10.2 VR Display Measurement Setup In VR Display measurement, the device under test is attached to the rotating disk.
Figure 29 Measure VR displays application after the start 10.4 Measure VR Displays Measurement First step is to start the test application (e.g. Futuremark VRMark Twist, OptoFidelity WMRH Test App) on the device under test. If the test case includes (video/application/game) framerate measurement, color calibration must be first carried out.
Page 33
OptoFidelity Video Multimeter – User Manual Once the test application shows completely white content, the measurement is started with Start button. During the measurement, the label of the push button is updated as Stop (see Figure 30). When the device under test is moving and the...
OptoFidelity Video Multimeter – User Manual 10.5 Measure VR Displays Save Function Measurement results can be saved by pushing the Save button. After saving successfully, the message window shows the name of the saved file. See the example in Figure 32.
OptoFidelity Video Multimeter – User Manual 11 Mean Opinion Score (MOS) The saved video quality results can be further analyzed in the Mean Opinion Score (MOS) application. Each measured value is given a score from 1 to 5. A score of 5 is the best result and a score of 1 indicates poor quality video.
OptoFidelity Video Multimeter – User Manual Figure 36. MOS view for FPS result without and with lip sync The FPS result consists of the following individual values: • FPS jerkiness: Average of frame rates. • FPS jitter: Standard deviation of frame rates.
Page 37
OptoFidelity Video Multimeter – User Manual shows a detailed view. The detailed view position can be selected from the upper graph. The detailed view is scrollable. Figure 37. MOS Graph view A guide to the whole measurement interpretation is as follows: •...
OptoFidelity Video Multimeter – User Manual Numerical values for frame and lip sync are visible at the bottom of the detailed view by selecting a frame. See examples in Figure 39. Figure 39. Single frame details. 11.4 MOS Configuration (OptoFidelity default) The Mean Opinion Score (MOS) is calculated separately for each individual result.
Page 39
OptoFidelity Video Multimeter – User Manual Latency jitter LatencyJitter Table 1. MOS default configuration The MOS configuration is changed by editing the mos.ini file that is found in the Video Multimeter file system in the frm folder. See the instructions for accessing Video Multimeter files in Chapter 5.
= 0 The device serial number must match the physical Video Multimeter device. License files are generated by OptoFidelity only. License files should not be edited manually. 12.2 Motion Blur measurement method Video Multimeter’s tristimulus sensor is being used to measure the settling times for different colors.
Page 41
OptoFidelity Video Multimeter – User Manual And the most interesting part, rise/fall part / settling (full persistence example): Low persistence example looks like this: Page 41 of 51...
OptoFidelity Video Multimeter – User Manual The definitive part of OptoFidelity’s Motion Blur assessment is the ability to calculate the computed blur image, and finally calculate the SSIM quality index. 12.3 Motion Blur measurement setup The following picture illustrates a typical mechanical setup for OptoFidelity Video Multimeter Motion Blur measurement.
Page 43
OptoFidelity Video Multimeter – User Manual While measurement is on, the “Cancel” button is visible and “Measuring xxx channel yyy” text is updating. Also the red, green and blue bars, showing the relative intensity of corresponding color channels, are updating.
OptoFidelity Video Multimeter – User Manual 12.5 Motion Blur latency results analysis & saving “Graphs”-tab contains the settling curves for each color channel. The image pair below shows typical curves for full (left) and low persistence (right) display. “Image”-tab contains the computed blur images. The image pair below shows example images for full and low persistence displays.
Page 45
OptoFidelity Video Multimeter – User Manual By clicking the “Pursuit camera” button, it is possible to toggle to “Slow motion” mode. Slow motion –mode simulates, how the blur image would look like, during the display update process. The slow motion –image is updated in one millisecond intervals.
= 0 The device serial number must match the physical Video Multimeter device. License files are generated by OptoFidelity only. License files should not be edited manually. 13.2 Timebase Calibration application usage Open the Timebase Calibration application by navigating and tapping the corresponding application in the main menu.
OptoFidelity Video Multimeter – User Manual Figure 41. Timebase Calibration waveform example Close the Timebase Calibration application to stop the waveform generation. 13.3 Valid result for Timebase Calibration The target value for the waveform period is 1.000 milliseconds, but it is acceptable to be in the range of 0.995..1.005 milliseconds (+/- 5 microsecond jitter is acceptable).
Page 48
OptoFidelity Video Multimeter – User Manual Figure 42: Video Multimeter's display showing random noise, indicating firmware upgrade mode. The device should become visible as a USB DFU device, and drivers should be installed automatically. Start the Firmware Upgrade application on the computer, and click the Start button.
Page 49
OptoFidelity Video Multimeter – User Manual Figure 43: Firmware Upgrade application Page 49 of 51...
OptoFidelity Video Multimeter – User Manual 15 Technical specifications External dimensions: 12x8x3 cm Operating temperature range: -10 C to +40 C Storage temperature range: -20 C to +60 C Internal memory: 4 GB Operating time using the battery: 6 hours...
OptoFidelity Video Multimeter – User Manual 16 References [1] OptoFidelity, ”Protocol for Control API, VideoMultimeter_Control_Protocol.pdf”. 17 Change history Ver. Status Date Author Remarks Draft 5.3.2013 First release Release 7.5.2013 Release 2013Q1.0 Release 27.5.2013 FPS UI + file format Lip sync option, Remote Release 27.6.2014...