{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,10]],"date-time":"2026-06-10T11:09:24Z","timestamp":1781089764652,"version":"3.54.1"},"reference-count":28,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T00:00:00Z","timestamp":1610496000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010115","name":"R\u00e9gion Auvergne-Rh\u00f4ne-Alpes","doi-asserted-by":"publisher","award":["1701104601-40893"],"award-info":[{"award-number":["1701104601-40893"]}],"id":[{"id":"10.13039\/501100010115","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Unmanned aerial vehicles (UAVs) have become a very popular way of acquiring video within contexts such as remote data acquisition or surveillance. Unfortunately, their viewpoint is often unstable, which tends to impact the automatic processing of their video flux negatively. To counteract the effects of an inconsistent viewpoint, two video processing strategies are classically adopted, namely registration and stabilization, which tend to be affected by distinct issues, namely jitter and drifting. Following our prior work, we suggest that the motion estimators used in both situations can be modeled to take into account their inherent errors. By acknowledging that drifting and jittery errors are of a different nature, we propose a combination that is able to limit their influence and build a hybrid solution for jitter-free video registration. In this work, however, our modeling was restricted to 2D-rigid transforms, which are rather limited in the case of airborne videos. In the present paper, we extend and refine the theoretical ground of our previous work. This addition allows us to show how to practically adapt our previous work to perspective transforms, which our study shows to be much more accurate for this problem. A lightweight implementation enables us to automatically register stationary UAV videos in real time. Our evaluation includes traffic surveillance recordings of up to 2 h and shows the potential of the proposed approach when paired with background subtraction tasks.<\/jats:p>","DOI":"10.3390\/s21020513","type":"journal-article","created":{"date-parts":[[2021,1,13]],"date-time":"2021-01-13T21:50:54Z","timestamp":1610574654000},"page":"513","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Registering Unmanned Aerial Vehicle Videos in the Long Term"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1807-6065","authenticated-orcid":false,"given":"Pierre","family":"Lemaire","sequence":"first","affiliation":[{"name":"Universit\u00e9 Lumi\u00e8re - Lyon 2, LIRIS, UMR5205, F-69676 Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5577-5335","authenticated-orcid":false,"given":"Carlos Fernando","family":"Crispim-Junior","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Lumi\u00e8re - Lyon 2, LIRIS, UMR5205, F-69676 Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0933-2485","authenticated-orcid":false,"given":"Lionel","family":"Robinault","sequence":"additional","affiliation":[{"name":"Foxstream, F-69120 Vaulx-en-Velin, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9208-6275","authenticated-orcid":false,"given":"Laure","family":"Tougne","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Lumi\u00e8re - Lyon 2, LIRIS, UMR5205, F-69676 Lyon, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,1,13]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1016\/j.jhydrol.2016.06.012","article-title":"Surface flow measurements from drones","volume":"540","author":"Tauro","year":"2016","journal-title":"J. Hydrol."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.trc.2019.11.023","article-title":"On the new era of urban traffic monitoring with massive drone data: The pNEUMA large-scale field experiment","volume":"111","author":"Barmpounakis","year":"2020","journal-title":"Transp. Res. Part C Emerg. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Lupashin, S., and D\u2019Andrea, R. (2013, January 3\u20137). Stabilization of a flying vehicle on a taut tether using inertial sensing. Proceedings of the 2013 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.","DOI":"10.1109\/IROS.2013.6696698"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Nith, R., and Rekimoto, J. (2019, January 23\u201327). Falconer: A Tethered Aerial Companion for Enhancing Personal Space. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.","DOI":"10.1109\/VR.2019.8798367"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Montany\u00e0, J., L\u00f3pez, J., Fontanes, P., Urbani, M., van der Velde, O., and Romero, D. (2018, January 2\u20137). Using tethered drones to investigate ESD in wind turbine blades during fair and thunderstorm weather. Proceedings of the 2018 34th International Conference on Lightning Protection (ICLP), Rzeszow, Poland.","DOI":"10.1109\/ICLP.2018.8503283"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Lemaire, P., Crispim-Junior, C.F., Robinault, L., and Tougne, L. (2019, January 7\u20139). Jitter-Free Registration for Unmanned Aerial Vehicle Videos. Proceedings of the International Symposium on Visual Computing, Lake Tahoe, NV, USA.","DOI":"10.1007\/978-3-030-33720-9_41"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1007\/s11263-012-0607-7","article-title":"A variational approach to video registration with subspace constraints","volume":"104","author":"Garg","year":"2013","journal-title":"Int. J. Comput. Vis."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1145\/1899404.1899408","article-title":"Subspace video stabilization","volume":"30","author":"Liu","year":"2011","journal-title":"ACM Trans. Graph."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Grundmann, M., Kwatra, V., and Essa, I. (2011, January 20\u201325). Auto-directed video stabilization with robust l1 optimal camera paths. Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995525"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Schonberger, J.L., and Frahm, J.M. (2016, January 27\u201330). Structure-from-motion revisited. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.445"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1255","DOI":"10.1109\/TRO.2017.2705103","article-title":"Orb-slam2: An open-source slam system for monocular, stereo, and rgb-d cameras","volume":"33","year":"2017","journal-title":"IEEE Trans. Robot."},{"key":"ref_12","unstructured":"Shen, H., Pan, Q., Cheng, Y., and Yu, Y. (2009, January 20\u201322). Fast video stabilization algorithm for UAV. Proceedings of the ICIS 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems, Shanghai, China."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Abdelli, A. (2016, January 18\u201320). Recursive motion smoothing for online video stabilization in wide-area surveillance. Proceedings of the 2016 International Conference on Big Data and Smart Computing (BigComp), Hong Kong, China.","DOI":"10.1109\/BIGCOMP.2016.7425799"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1007\/s11063-015-9439-0","article-title":"Real-time model-based video stabilization for microaerial vehicles","volume":"43","author":"Aguilar","year":"2016","journal-title":"Neural Process. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1858","DOI":"10.1109\/TPAMI.2008.113","article-title":"Parametric image alignment using enhanced correlation coefficient maximization","volume":"30","author":"Evangelidis","year":"2008","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"38544","DOI":"10.1109\/ACCESS.2018.2853100","article-title":"Multi-temporal remote sensing image registration using deep convolutional features","volume":"6","author":"Yang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, J., Wang, C., Liu, S., Jia, L., Wang, J., and Zhou, J. (2019). Content-aware unsupervised deep homography estimation. arXiv.","DOI":"10.1007\/978-3-030-58452-8_38"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5491","DOI":"10.1109\/TIP.2016.2607419","article-title":"Joint video stitching and stabilization from moving cameras","volume":"25","author":"Guo","year":"2016","journal-title":"IEEE Trans. Image Process."},{"key":"ref_19","unstructured":"Shi, J. (1994, January 21\u201323). Good features to track. Proceedings of the CVPR\u201994, 1994 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Liu, S., Yuan, L., Tan, P., and Sun, J. (2014, January 23\u201328). Steadyflow: Spatially smooth optical flow for video stabilization. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.","DOI":"10.1109\/CVPR.2014.536"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"2283","DOI":"10.1109\/TIP.2018.2884280","article-title":"Deep Online Video Stabilization With Multi-Grid Warping Transformation Learning","volume":"28","author":"Wang","year":"2019","journal-title":"IEEE Trans. Image Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"2346","DOI":"10.1109\/LRA.2018.2809549","article-title":"Unsupervised deep homography: A fast and robust homography estimation model","volume":"3","author":"Nguyen","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1109\/34.24792","article-title":"Principal warps: Thin-plate splines and the decomposition of deformations","volume":"11","author":"Bookstein","year":"1989","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Hartley, R., and Zisserman, A. (2003). Multiple View Geometry in Computer Vision, Cambridge University Press.","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_25","unstructured":"Welch, G., and Bishop, G. (1995). An Introduction to the Kalman Filter, University of North Carolina. Technical Report."},{"key":"ref_26","unstructured":"Bradski, G., and Kaehler, A. (2000). OpenCV. Dobb\u2019s J. Softw. Tools, 3, Available online: https:\/\/github.com\/opencv\/opencv\/wiki\/CiteOpenCV."},{"key":"ref_27","first-page":"4","article-title":"Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm","volume":"5","author":"Bouguet","year":"2001","journal-title":"Intel Corp."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1109\/TIP.2010.2101613","article-title":"ViBe: A universal background subtraction algorithm for video sequences","volume":"20","author":"Barnich","year":"2010","journal-title":"IEEE Trans. Image Process."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/2\/513\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:10:30Z","timestamp":1760159430000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/2\/513"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,13]]},"references-count":28,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2021,1]]}},"alternative-id":["s21020513"],"URL":"https:\/\/doi.org\/10.3390\/s21020513","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,13]]}}}