{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,29]],"date-time":"2026-05-29T19:15:42Z","timestamp":1780082142725,"version":"3.54.0"},"reference-count":34,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2017,2,10]],"date-time":"2017-02-10T00:00:00Z","timestamp":1486684800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Acquisition of stabilized video is an important issue for various type of digital cameras. This paper presents an adaptive camera path estimation method using robust feature detection to remove shaky artifacts in a video. The proposed algorithm consists of three steps: (i) robust feature detection using particle keypoints between adjacent frames; (ii) camera path estimation and smoothing; and (iii) rendering to reconstruct a stabilized video. As a result, the proposed algorithm can estimate the optimal homography by redefining important feature points in the flat region using particle keypoints. In addition, stabilized frames with less holes can be generated from the optimal, adaptive camera path that minimizes a temporal total variation (TV). The proposed video stabilization method is suitable for enhancing the visual quality for various portable cameras and can be applied to robot vision, driving assistant systems, and visual surveillance systems.<\/jats:p>","DOI":"10.3390\/s17020337","type":"journal-article","created":{"date-parts":[[2017,2,15]],"date-time":"2017-02-15T10:09:07Z","timestamp":1487153347000},"page":"337","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Robust Video Stabilization Using Particle Keypoint Update and l1-Optimized Camera Path"],"prefix":"10.3390","volume":"17","author":[{"given":"Semi","family":"Jeon","sequence":"first","affiliation":[{"name":"Department of Image, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Inhye","family":"Yoon","sequence":"additional","affiliation":[{"name":"Department of Image, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Korea"},{"name":"ADAS Camera Team, LG Electronics, 322 Gyeongmyeong-daero, Seo-gu, Incheon 22744, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4038-7065","authenticated-orcid":false,"given":"Jinbeum","family":"Jang","sequence":"additional","affiliation":[{"name":"Department of Image, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seungji","family":"Yang","sequence":"additional","affiliation":[{"name":"Future Technology R&amp;D, SK Telecom, Sunae-dong, Bundang-gu, Seongnam 13595, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jisung","family":"Kim","sequence":"additional","affiliation":[{"name":"Future Technology R&amp;D, SK Telecom, Sunae-dong, Bundang-gu, Seongnam 13595, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8593-7155","authenticated-orcid":false,"given":"Joonki","family":"Paik","sequence":"additional","affiliation":[{"name":"Department of Image, Chung-Ang University, 84 Heukseok-ro, Dongjak-gu, Seoul 06974, Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2017,2,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Golik, B. (2006). Development of a Test Method for Image Stabilizing Systems. [Ph.D. Thesis, University of Applied Sciences].","DOI":"10.1117\/12.703485"},{"key":"ref_2","unstructured":"Buehler, C., Bosse, M., and McMillan, L. (2001, January 8\u201314). Non-metric image-based rendering for video stabilization. Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, USA."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1016\/j.imavis.2005.09.003","article-title":"Adaptive robust estimation of affine parameters from block motion vectors","volume":"23","author":"Jang","year":"2005","journal-title":"Image Vis. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"566","DOI":"10.1109\/TCE.2006.1649681","article-title":"Digital image stabilization based on circular block matching","volume":"52","author":"Xu","year":"2006","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5573\/IEIESPC.2015.4.1.001","article-title":"Object tracking using adaptive template matching","volume":"4","author":"Chantara","year":"2015","journal-title":"IEIE Trans. Smart Process. Comput."},{"key":"ref_6","unstructured":"Chang, H.C., Lai, S.H., and Lu, K.R. (2004, January 27\u201330). A robust and efficient video stabilization algorithm. Proceedings of the 2004 IEEE International Conference on Multimedia and Expo, Taipei, Taiwan."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1109\/TPAMI.2006.141","article-title":"Full-frame video stabilization with motion inpainting","volume":"28","author":"Matsushita","year":"2006","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"8","DOI":"10.1155\/2013\/651650","article-title":"An integrated new scheme for digital video stabilization","volume":"2013","author":"Xu","year":"2013","journal-title":"Adv. Multimed."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Battiato, S., Gallo, G., Puglisi, G., and Scellato, S. (2007, January 10\u201314). SIFT features tracking for video stabilization. Proceedings of the 14th International Conference on Image Analysis and Processing, Modena, Italy.","DOI":"10.1109\/ICIAP.2007.4362878"},{"key":"ref_10","unstructured":"Lee, K.Y., Chuang, Y.Y., Chen, B.Y., and Ouhyoung, M. (October, January 27). Video stabilization using robust feature trajectories. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1109\/TCE.2012.6311347","article-title":"Fast feature-based video stabilization without accumulative global motion estimation","volume":"58","author":"Xu","year":"2012","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"16630","DOI":"10.3390\/s140916630","article-title":"Sequential and Automatic Image-Sequence Registration of Road Areas Monitored from a Hovering Helicopter","volume":"14","author":"Nejadasl","year":"2014","journal-title":"Sensors"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cheng, X., Hao, Q., and Xie, M. (2016). A Comprehensive Motion Estimation Technique for the Improvement of EIS Methods Based on the SURF Algorithm and Kalman Filter. Sensors, 16.","DOI":"10.3390\/s16040486"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1145\/2461912.2461995","article-title":"Bundled camera paths for video stabilization","volume":"32","author":"Liu","year":"2013","journal-title":"ACM Trans. Graph."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1109\/TCE.2013.6490269","article-title":"Feature point classification based global motion estimation for video stabilization","volume":"59","author":"Kim","year":"2013","journal-title":"IEEE Trans. Consum. Electron."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1145\/1531326.1531350","article-title":"Content-preserving warps for 3D video stabilization","volume":"28","author":"Liu","year":"2009","journal-title":"ACM Trans. Graph."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhou, Z., Jin, H., and Ma, Y. (2013, January 23\u201328). Plane-based content preserving warps for video stabilization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.298"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"224","DOI":"10.5573\/IEIESPC.2015.4.4.224","article-title":"Real-time Full-view 3D Human Reconstruction using Multiple RGB-D Cameras","volume":"4","author":"Yoon","year":"2015","journal-title":"IEIE Trans. Smart Process. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"407","DOI":"10.5573\/IEIESPC.2015.4.6.407","article-title":"Subjective Evaluation on Perceptual Tracking Errors from Modeling Errors in Model-Based Tracking","volume":"4","author":"Rhee","year":"2015","journal-title":"IEIE Trans. Smart Process. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Jeon, S., Yoon, I., Kim, B., Kim, J., and Paik, J. (2016, January 7\u201311). Robust feature detection using particle keypoints and its application to video stabilization in a consumer handheld camera. Proceedings of the 2016 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.","DOI":"10.1109\/ICCE.2016.7430587"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"110","DOI":"10.5573\/IEIESPC.2015.4.2.110","article-title":"A Novel Approach for Object Detection in Illuminated and Occluded Video Sequences Using Visual Information with Object Feature Estimation","volume":"4","author":"Sharma","year":"2015","journal-title":"IEIE Trans. Smart Process. Comput."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"153","DOI":"10.5573\/IEIESPC.2016.5.3.153","article-title":"Recent Advances in Feature Detector and Descriptor: A Survey","volume":"5","author":"Lee","year":"2016","journal-title":"IEIE Trans. Smart Process. Comput."},{"key":"ref_23","unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Bay, H., Tuytelaars, T., and Van Gool, L. (2006, January 7\u201313). Surf: Speeded up robust features. Proceedings of the European Conference on Computer Vision\u2013ECCV, Graz, Austria.","DOI":"10.1007\/11744023_32"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rosten, E., and Drummond, T. (2006, January 7\u201313). Machine learning for high-speed corner detection. Proceedings of the European Conference on Computer Vision\u2013ECCV, Graz, Austria.","DOI":"10.1007\/11744023_34"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). Brief: Binary robust independent elementary features. Proceedings of the European Conference on Computer Vision\u2013ECCV, Heraklion, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (2011, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 IEEE International Conference on Computer Vision (ICCV), Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Alahi, A., Ortiz, R., and Vandergheynst, P. (2012, January 16\u201321). Freak: Fast retina keypoint. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247715"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"ACM Commun."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0167-2789(92)90242-F","article-title":"Nonlinear total variation based noise removal algorithms","volume":"60","author":"Rudin","year":"1992","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Grundmann, M., Kwatra, V., and Essa, I. (2011, January 20\u201325). Auto-directed video stabilization with robust l1 optimal camera paths. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995525"},{"key":"ref_33","first-page":"5012","article-title":"Real-Time SURF-Based Video Stabilization System for an FPGA-Driven Mobile Robot","volume":"63","author":"Shene","year":"2016","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_34","first-page":"357191","article-title":"Hybrid Video Stabilization for Mobile Vehicle Detection on SURF in Aerial Surveillance","volume":"2015","author":"Gao","year":"2015","journal-title":"Discret. Dyn. Nat. Soc."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/2\/337\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T18:27:57Z","timestamp":1760207277000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/17\/2\/337"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,2,10]]},"references-count":34,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2017,2]]}},"alternative-id":["s17020337"],"URL":"https:\/\/doi.org\/10.3390\/s17020337","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,2,10]]}}}