3D Velocity Measurement of Translational Motion using a Stereo Camera

Sigit Ristanto, Waskito Nugroho, Eko Sulistya, Gede Bayu Suparta

Abstract


This research aims to create a 3D velocity measurement system using a stereo camera. The 3D velocity in this paper is the velocity which consists of three velocity components in 3D Cartesian coordinates. Particular attention is focused on translational motion. The system set consists of a stereo camera and a mini-PC with Python 3.7, and OpenCV 4.0 installed. The measurement method begins with the selection of the measured object, object detection using template matching, disparity calculation using the triangulation principle, velocity calculation based on object displacement information and time between frames, and the storage of measurement results. The measurement system's performance was tested by experimenting with measuring conveyor velocity from forward-looking and angle-looking directions. The experimental results show that the 3D trajectory of the object can be displayed, the velocity of each component and the speed as the magnitude of the velocity can be obtained, and so the 3D velocity measurement can be performed. The camera can be positioned forward-looking or at a certain angle without affecting the measurement results. The measurement of the speed of the conveyor is 11.6 cm/s with an accuracy of 0.4 cm/s. The results of this study can be applied in the performance inspection process of conveyors and other industrial equipment that requires speed measurement. In addition, it can also be developed for accident analysis in transportation systems and practical tools for physics learning.

Keywords


Stereo vision; speed measurement; object tracking; visual odometry; autonomous driving.

Full Text:

PDF

References


J. H. Kim, W. T. Oh, J. H. Choi, and J. C. Park, “Reliability verification of vehicle speed estimate method in forensic videos,†Forensic Sci. Int., vol. 287, pp. 195–206, 2018.

L. R. Costa, M. S. Rauen, and A. B. Fronza, “Car speed estimation based on image scale factor,†Forensic Sci. Int., vol. 310, p. 110229, 2020.

S. J. Yoon and T. Kim, “Development of stereo visual odometry based on photogrammetric feature optimization,†Remote Sens., vol. 11, no. 1, 2019.

E. Jung, N. Yang, and D. Cremers, “Multi-frame GAN: Image enhancement for stereo visual odometry in low light,†arXiv, no. CoRL 2019, pp. 1–10, 2019.

R. Fan, L. Wang, M. J. Bocus, and I. Pitas, “Computer stereo vision for autonomous driving,†arXiv, 2020.

L. Li, Y. H. Liu, T. Jiang, K. Wang, and M. Fang, “Adaptive Trajectory Tracking of Nonholonomic Mobile Robots Using Vision-Based Position and Velocity Estimation,†IEEE Trans. Cybern., vol. 48, no. 2, pp. 571–582, 2018.

Y. Liu, Y. Gu, J. Li, and X. Zhang, “Robust stereo visual odometry using improved RANSAC-based methods for mobile robot localization,†Sensors (Switzerland), vol. 17, no. 10, 2017.

J. Guo et al., “Real-time measurement and estimation of the 3D geometry and motion parameters for spatially unknown moving targets,†Aerosp. Sci. Technol., vol. 97, p. 105619, 2020.

D. Ge, D. Wang, Y. Zou, and J. Shi, “Motion and inertial parameter estimation of non-cooperative target on orbit using stereo vision,†Adv. Sp. Res., vol. 66, no. 6, pp. 1475–1484, 2020.

Z. Li, F. Zeng, C. Yan, J. Wang, and L. Tang, “Design of belt conveyor speed control system of ‘internet+,’†IOP Conf. Ser. Mater. Sci. Eng., vol. 563, no. 4, 2019.

Y. Gao, T. Qiao, H. Zhang, Y. Yang, Y. Pang, and H. Wei, “A contactless measuring speed system of belt conveyor based on machine vision and machine learning,†measurement, vol. 139, pp. 127–133, 2019.

P. Najman and P. Zemcik, “Vehicle Speed Measurement Using Stereo Camera Pair,†IEEE Trans. Intell. Transp. Syst., pp. 1–9, 2020.

L. Yang, M. Li, X. Song, Z. Xiong, C. Hou, and B. Qu, “Vehicle Speed Measurement Based on Binocular Stereovision System,†IEEE Access, vol. 7, pp. 106628–106641, 2019.

A. Safaei, “Adaptive relative velocity estimation algorithm for autonomous mobile robots using the measurements on acceleration and relative distance,†Int. J. Adapt. Control Signal Process., vol. 34, no. 3, pp. 372–388, 2020.

H. Deng, U. Arif, K. Yang, Z. Xi, Q. Quan, and K. Y. Cai, “Global optical flow-based estimation of velocity for multicopters using monocular vision in GPS-denied environments,†Optik (Stuttg)., vol. 219, no. March 2019, p. 164923, 2020.

G. Gallego and D. Scaramuzza, “Accurate angular velocity estimation with an event camera,†IEEE Robot. Autom. Lett., vol. 2, no. 2, pp. 632–639, 2017.

F. Guo and R. Chellappa, “Video Metrology Using a Single Camera,†IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 7, pp. 1329–1335, 2010.

N. Murmu, B. Chakraborty, and D. Nandi, “Relative velocity measurement using low cost single camera-based stereo vision system,†Measurement, vol. 141, pp. 1–11, 2019.

Y. C. Lim, M. Lee, C. H. Lee, S. Kwon, and J. H. Lee, “Improvement of stereo vision-based position and velocity estimation and tracking using a stripe-based disparity estimation and inverse perspective map-based extended Kalman filter,†Opt. Lasers Eng., vol. 48, no. 9, pp. 859–868, 2010.

“A Novel Approach to Measurement of the Transverse Velocity of the Large-Scale Objects.†[Online]. Available: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC7988419/. [Accessed: 30-Apr-2021].

S. L. Jeng, W. H. Chieng, and H. P. Lu, “Estimating speed using a side-looking single-radar vehicle detector,†IEEE Trans. Intell. Transp. Syst., vol. 15, no. 2, pp. 607–614, 2014.




DOI: http://dx.doi.org/10.18517/ijaseit.11.6.15548

Refbacks

  • There are currently no refbacks.


Published by INSIGHT - Indonesian Society for Knowledge and Human Development