{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,11]],"date-time":"2026-11-11T03:35:41Z","timestamp":1794368141128,"version":"4.9.0"},"reference-count":34,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,17]],"date-time":"2018-08-17T00:00:00Z","timestamp":1534464000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Natural Science Foundation of the Heilongjiang Province of China","award":["F2016003"],"award-info":[{"award-number":["F2016003"]}]},{"name":"Specialized Research Fund for Doctoral Program of Higher Education","award":["20122304110014"],"award-info":[{"award-number":["20122304110014"]}]},{"name":"Manipulator Data Processing Development","award":["KY10700150065"],"award-info":[{"award-number":["KY10700150065"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Recorded video data must be clear for accuracy and faster analysis during post-processing, which often requires video stabilization systems to remove undesired motion. In this paper, we proposed a hybrid method to estimate the motion and to stabilize videos by the switching function. This method switched the estimated motion between a Kanade\u2013Lucus\u2013Tomasi (KLT) tracker and an IMU-aided motion estimator. It facilitated the best function to stabilize the video in real-time as those methods had numerous advantages in estimating the motion. To achieve this, we used a KLT tracker to correct the motion for low rotations and an IMU-aided motion estimator for high rotation, owing to the poor performance of the KLT tracker during larger movements. Furthermore, a Kalman filter was used to remove the undesired motion and hence smoothen the trajectory. To increase the frame rate, a multi-threaded approach was applied to execute the algorithm in the array. Irrespective of the situations exposed to the experimental results of the moving camera from five video sequences revealed that the proposed algorithm stabilized the video efficiently.<\/jats:p>","DOI":"10.3390\/s18082708","type":"journal-article","created":{"date-parts":[[2018,8,17]],"date-time":"2018-08-17T10:54:25Z","timestamp":1534503265000},"page":"2708","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["A Hybrid Motion Estimation for Video Stabilization Based on an IMU Sensor"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5441-4167","authenticated-orcid":false,"given":"Jutamanee","family":"Auysakul","sequence":"first","affiliation":[{"name":"College of Mechanical and Electrical Engineering, Harbin Engineering University, Harbin 150001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"He","family":"Xu","sequence":"additional","affiliation":[{"name":"College of Mechanical and Electrical Engineering, Harbin Engineering University, Harbin 150001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Vishwanath","family":"Pooneeth","sequence":"additional","affiliation":[{"name":"College of Mechanical and Electrical Engineering, Harbin Engineering University, Harbin 150001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fowers, S.G., Lee, D.-J., Tippetts, B.J., Lillywhite, K.D., Dennis, A.W., and Archibald, J.K. (2007, January 20\u201323). Vision aided stabilization and the development of a quad-rotor micro UAV. Proceedings of the 2007 International Symposium on Computational Intelligence in Robotics and Automation, Jacksonville, FL, USA.","DOI":"10.1109\/CIRA.2007.382886"},{"key":"ref_2","unstructured":"Garc\u00eda, G.B., Suarez, O.D., Aranda, J.L.E., Tercero, J.S., Gracia, I.S., and Enano, N.V. (2015). Learning Image Processing with OpenCV, Packt Publishing Ltd."},{"key":"ref_3","first-page":"2","article-title":"Digital video stabilization and rolling shutter correction using gyroscopes","volume":"1","author":"Karpenko","year":"2011","journal-title":"CSTR"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/1531326.1531350","article-title":"Content-preserving warps for 3D video stabilization","volume":"Volume 28","author":"Liu","year":"2009","journal-title":"ACM Transactions on Graphics (TOG)"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TCE.2012.6311347","article-title":"Fast feature-based video stabilization without accumulative global motion estimation","volume":"58","author":"Xu","year":"2012","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Cheng, X., Hao, Q., and Xie, M. (2016). A Comprehensive Motion Estimation Technique for the Improvement of EIS Methods Based on the SURF Algorithm and Kalman Filter. Sensors, 16.","DOI":"10.3390\/s16040486"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"46","DOI":"10.1186\/1687-5281-2014-46","article-title":"Real-time video stabilization without phantom movements for micro aerial vehicles","volume":"2014","author":"Aguilar","year":"2014","journal-title":"EURASIP J. Image Video Proc."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"947","DOI":"10.1007\/s11042-012-1095-z","article-title":"Video stabilization using maximally stable extremal region features","volume":"68","author":"Okade","year":"2014","journal-title":"Multimed. Tools Appl."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Philip, J.T., Samuvel, B., Pradeesh, K., and Nimmi, N.K. (2014, January 24\u201326). A comparative study of block matching and optical flow motion estimation algorithms. Proceedings of the 2014 Annual International Conference on Emerging Research Areas: Magnetics, Machines and Drives (AICERA\/iCMMD), Kottayam, India.","DOI":"10.1109\/AICERA.2014.6908204"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Spampinato, G., Bruna, A.R., Guarneri, I., and Tomaselli, V. (2016, January 5\u20137). Advanced feature based digital video stabilization. Proceedings of the 2016 IEEE 6th International Conference on Consumer Electronics-Berlin (ICCE-Berlin), Berlin, Germany.","DOI":"10.1109\/ICCE-Berlin.2016.7684716"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1109\/TCE.2013.6490269","article-title":"Feature point classification based global motion estimation for video stabilization","volume":"59","author":"Kim","year":"2013","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Battiato, S., Gallo, G., Puglisi, G., and Scellato, S. (2007, January 10\u201314). SIFT features tracking for video stabilization. Proceedings of the 2007 14th International Conference on Image Analysis and Processing, Modena, Italy.","DOI":"10.1109\/ICIAP.2007.4362878"},{"key":"ref_13","first-page":"5012","article-title":"Real-time SURF-based video stabilization system for an FPGA-driven mobile robot","volume":"63","author":"Shene","year":"2016","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"716","DOI":"10.1109\/TCSVT.2016.2589860","article-title":"Video stabilization for strict real-time applications","volume":"27","author":"Dong","year":"2017","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lim, A., Ramesh, B., Yang, Y., Xiang, C., Gao, Z., and Lin, F. (2017). Real-time optical flow-based video stabilization for unmanned aerial vehicles. J. Real-Time Image Proc., 1\u201311.","DOI":"10.1007\/s11554-017-0699-y"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"3391","DOI":"10.1109\/JSEN.2018.2810060","article-title":"An Efficient Gyro-Aided Optical Flow Estimation in Fast Rotations With Auto-Calibration","volume":"18","author":"Li","year":"2018","journal-title":"IEEE Sens. J."},{"key":"ref_17","first-page":"437","article-title":"Stochastic modelling and analysis of IMU sensor errors","volume":"22","author":"Zhao","year":"2011","journal-title":"Archiwum Fotogrametrii, Kartografii i Teledetekcji"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Gadeke, T., Schmid, J., Zahnlecker, M., Stork, W., and Muller-Glaser, K.D. (2012, January 3\u20134). Smartphone pedestrian navigation by foot-IMU sensor fusion. Proceedings of the Ubiquitous Positioning, Indoor Navigation, and Location Based Service (UPINLBS), Helsinki, Finland.","DOI":"10.1109\/UPINLBS.2012.6409787"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1425","DOI":"10.1016\/j.robot.2014.06.001","article-title":"Human\u2013robot interaction based on wearable IMU sensor and laser range finder","volume":"62","author":"Cifuentes","year":"2014","journal-title":"Robot. Auton. Syst."},{"key":"ref_20","unstructured":"Lake, S., Bailey, M., and Grant, A. (2016). Method and Apparatus for Analyzing Capacitive EMG and IMU Sensor Signals for Gesture Control. (US9299248B2), Google Patents."},{"key":"ref_21","unstructured":"Azfar, A.Z., and Hazry, D. (2011, January 4\u20136). A simple approach on implementing imu sensor fusion in pid controller for stabilizing quadrotor flight control. Proceedings of the 2011 IEEE 7th International Colloquium on Signal Processing and its Applications (CSPA), Penang, Malaysia."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Mousas, C. (2017). Full-body locomotion reconstruction of virtual characters using a single inertial measurement unit. Sensors, 17.","DOI":"10.3390\/s17112589"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Antonello, R., Oboe, R., Ramello, A., Ito, K., Felicini, N., and Cenedese, A. (2013, January 28\u201331). IMU-aided image stabilization and tracking in a HSM-driven camera positioning unit. Proceedings of the 2013 IEEE International Symposium on Industrial Electronics, Taipei, Taiwan.","DOI":"10.1109\/ISIE.2013.6563833"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Odelga, M., Kochanek, N., and B\u00fclthoff, H.H. (2017, January 3\u20135). Efficient real-time video stabilization for UAVs using only IMU data. Proceedings of the 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED-UAS), Link\u00f6ping, Sweden.","DOI":"10.1109\/RED-UAS.2017.8101668"},{"key":"ref_25","first-page":"1","article-title":"Accelerometer based digital video stabilization for general security surveillance systems","volume":"4","year":"2010","journal-title":"Int. J. Secur. Appl."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Ryu, Y.G., Roh, H.C., and Chung, M.J. (2010, January 27\u201330). Video stabilization for robot eye using IMU-aided feature tracker. Proceedings of the ICCAS 2010, Gyeonggi-do, Korea.","DOI":"10.1109\/ICCAS.2010.5670177"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"013002","DOI":"10.1117\/1.JEI.23.1.013002","article-title":"Instantaneous video stabilization for unmanned aerial vehicles","volume":"23","author":"Dong","year":"2014","journal-title":"J. Electron. Imaging"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Briod, A., Zufferey, J.-C., and Floreano, D. (2012, January 14\u201318). Automatically calibrating the viewing direction of optic-flow sensors. Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), St Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6225011"},{"key":"ref_29","unstructured":"Shi, J., and Tomasi, C. (1994, January 21\u201323). Good features to track. Proceedings of the 1994 IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/s11063-015-9439-0","article-title":"Real-Time Model-Based Video Stabilization for Microaerial Vehicles","volume":"43","author":"Aguilar","year":"2016","journal-title":"Neural Process. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1006\/rtim.2001.0278","article-title":"Real-time digital image stabilization using Kalman filters","volume":"8","year":"2002","journal-title":"Real-Time Imaging"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1755","DOI":"10.1177\/0278364911416391","article-title":"Gyro-aided feature tracking for a moving camera: Fusion, auto-calibration and GPU implementation","volume":"30","author":"Hwangbo","year":"2011","journal-title":"Int. J. Robot. Res."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/BF00198917","article-title":"An image-interpolation technique for the computation of optic flow and egomotion","volume":"71","author":"Srinivasan","year":"1994","journal-title":"Biol. Cybern."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"6745","DOI":"10.1007\/s11042-014-1928-z","article-title":"Video stabilization with moving object detecting and tracking for aerial video surveillance","volume":"74","author":"Walha","year":"2015","journal-title":"Multimed. Tools Appl."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2708\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:19:22Z","timestamp":1760195962000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/18\/8\/2708"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,17]]},"references-count":34,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["s18082708"],"URL":"https:\/\/doi.org\/10.3390\/s18082708","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,8,17]]}}}