{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T01:50:22Z","timestamp":1760233822529,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2021,2,25]],"date-time":"2021-02-25T00:00:00Z","timestamp":1614211200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006041","name":"Innovate UK","doi-asserted-by":"publisher","award":["105625"],"award-info":[{"award-number":["105625"]}],"id":[{"id":"10.13039\/501100006041","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Unmanned Aerial Vehicles (UAVs) that can fly around an aircraft carrying several sensors, e.g., thermal and optical cameras, to inspect the parts of interest without removing them can have significant impact in reducing inspection time and cost. One of the main challenges in the UAV based active InfraRed Thermography (IRT) inspection is the UAV\u2019s unexpected motions. Since active thermography is mainly concerned with the analysis of thermal sequences, unexpected motions can disturb the thermal profiling and cause data misinterpretation especially for providing an automated process pipeline of such inspections. Additionally, in the scenarios where post-analysis is intended to be applied by an inspector, the UAV\u2019s unexpected motions can increase the risk of human error, data misinterpretation, and incorrect characterization of possible defects. Therefore, post-processing is required to minimize\/eliminate such undesired motions using digital video stabilization techniques. There are number of video stabilization algorithms that are readily available; however, selecting the best suited one is also challenging. Therefore, this paper evaluates video stabilization algorithms to minimize\/mitigate undesired UAV motion and proposes a simple method to find the best suited stabilization algorithm as a fundamental first step towards a fully operational UAV-IRT inspection system.<\/jats:p>","DOI":"10.3390\/s21051604","type":"journal-article","created":{"date-parts":[[2021,2,26]],"date-time":"2021-02-26T04:36:24Z","timestamp":1614314184000},"page":"1604","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Evaluation and Selection of Video Stabilization Techniques for UAV-Based Active Infrared Thermography Application"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3271-5011","authenticated-orcid":false,"given":"Shashank","family":"Pant","sequence":"first","affiliation":[{"name":"National Research Council Canada, Ottawa, ON K1A 0R6, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3184-5255","authenticated-orcid":false,"given":"Parham","family":"Nooralishahi","sequence":"additional","affiliation":[{"name":"Computer Vision and Systems Laboratory (CVSL), Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada"}]},{"given":"Nicolas P.","family":"Avdelidis","sequence":"additional","affiliation":[{"name":"Computer Vision and Systems Laboratory (CVSL), Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada"},{"name":"School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield MK43 0AL, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0198-7439","authenticated-orcid":false,"given":"Clemente","family":"Ibarra-Castanedo","sequence":"additional","affiliation":[{"name":"Computer Vision and Systems Laboratory (CVSL), Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6301-6235","authenticated-orcid":false,"given":"Marc","family":"Genest","sequence":"additional","affiliation":[{"name":"National Research Council Canada, Ottawa, ON K1A 0R6, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6414-1166","authenticated-orcid":false,"given":"Shakeb","family":"Deane","sequence":"additional","affiliation":[{"name":"School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield MK43 0AL, UK"}]},{"given":"Julio J.","family":"Valdes","sequence":"additional","affiliation":[{"name":"National Research Council Canada, Ottawa, ON K1A 0R6, Canada"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2829-1298","authenticated-orcid":false,"given":"Argyrios","family":"Zolotas","sequence":"additional","affiliation":[{"name":"School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield MK43 0AL, UK"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8777-2008","authenticated-orcid":false,"given":"Xavier P. V.","family":"Maldague","sequence":"additional","affiliation":[{"name":"Computer Vision and Systems Laboratory (CVSL), Department of Electrical and Computer Engineering, Laval University, Quebec City, QC G1V 0A6, Canada"}]}],"member":"1968","published-online":{"date-parts":[[2021,2,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1016\/j.eja.2014.01.004","article-title":"Tree height quantification using very high resolution imagery acquired from an unmanned aerial vehicle (UAV) and automatic 3D photo-reconstruction methods","volume":"55","author":"Angileri","year":"2014","journal-title":"Eur. J. Agron."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1083","DOI":"10.1016\/j.sbspro.2014.01.143","article-title":"Urban Traffic Analysis through an UAV","volume":"111","author":"Salvo","year":"2014","journal-title":"Procedia Soc. Behav. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.autcon.2014.01.004","article-title":"Mobile 3D mapping for surveying earthwork projects using an Unmanned Aerial Vehicle (UAV) system","volume":"41","author":"Siebert","year":"2014","journal-title":"Automat. Constr."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.jas.2014.02.015","article-title":"Archaeological aerial thermography: A case study at the Chaco-era Blue J community, New Mexico","volume":"45","author":"Cassana","year":"2014","journal-title":"J. Archaeol. Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"13","DOI":"10.3390\/machines2010013","article-title":"The Multiple Unmanned Air Vehicle Persistent Surveillance Problem: A Review","volume":"2","author":"Nigam","year":"2014","journal-title":"Machines"},{"key":"ref_6","first-page":"263","article-title":"The Regulation of Civilian UAVs\u2019 Impacts on Public Safety","volume":"30","author":"Clarke","year":"2014","journal-title":"CLSR."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"179","DOI":"10.5194\/isprs-archives-XLII-2-W6-179-2017","article-title":"Automatic Fault Recognition of Photovoltaic Modules Based on Statistical Analysis of Uav Thermography","volume":"42","author":"Kim","year":"2017","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Barbedo, J.G.A. (2019). A Review on the Use of Unmanned Aerial Vehicles and Imaging Sensors for Monitoring and Assessing Plant Stresses. Drones, 3.","DOI":"10.3390\/drones3020040"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ortiz-Sanz, J., Gil-Docampo, M., Arza-Garc\u00eda, M., and Ca\u00f1as-Guerrero, I. (2019). IR Thermography from UAVs to Monitor Thermal Anomalies in the Envelopes of Traditional Wine Cellars: Field Test. Remote Sens., 11.","DOI":"10.3390\/rs11121424"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Tsouros, D.C., Bibi, S., and Sarigiannidis, P.G. (2019). A Review on UAV-Based Applications for Precision Agriculture. Information, 10.","DOI":"10.3390\/info10110349"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Burke, C., McWhirter, P.R., Veitch-Michaelis, J., McAree, O., Pointon, H.A.G., Wich, S., and Longmore, S. (2019). Requirements and Limitations of Thermal Drones for Effective Search and Rescue in Marine and Coastal Areas. Drones, 3.","DOI":"10.3390\/drones3040078"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Melis, M.T., Da Pelo, S., Erb\u00ec, I., Loche, M., Deiana, G., Demurtas, V., Meloni, M.A., Dess\u00ec, F., Funedda, A., and Scaioni, M. (2020). Thermal Remote Sensing from UAVs: A Review on Methods in Coastal Cliffs Prone to Landslides. Remote Sens., 1.","DOI":"10.3390\/rs12121971"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"56","DOI":"10.1016\/j.infrared.2017.02.014","article-title":"Solar loading thermography: Time-lapsed thermographic survey and advanced thermographic signal processing for the inspection of civil engineering and cultural heritage structures","volume":"82","author":"Sfarra","year":"2017","journal-title":"Infrared Phys. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Ibarra-Castanedo, C., Brault, L., Genest, M., Farley, V., and Maldague, X.P. (2012, January 11\u201314). Detection and characterization of water ingress in honeycomb structures by passive and active infrared thermography using a high resolution camera. Proceedings of the 11th International Conference on Quantitative InfraRed Thermography, Naples, Italy.","DOI":"10.1117\/12.918567"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Zhang, H., Avdelidis, N.P., Osman, A., Ibarra-Castanedo, C., Sfarra, S., Fernandes, H., Matikas, T.E., and Maldague, X.P. (2017). Enhanced infrared image processing for impacted carbon\/glass fiber-reinforced composite evaluation. Sensors, 18.","DOI":"10.3390\/s18010045"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Aghaei, M., Leva, S., and Grimaccia, F. (2016, January 5\u201310). PV power plant inspection by image mosaicing techniques for IR real-time images. Proceedings of the 2016 IEEE 43rd Photovoltaic Specialists Conference (PVSC), Portland, OR, USA.","DOI":"10.1109\/PVSC.2016.7750236"},{"key":"ref_17","first-page":"103","article-title":"Scanning pulse phase thermography with line heating","volume":"9","author":"Sorger","year":"2013","journal-title":"Quant. InfraRed Thermogr. J."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Mavromatidis, L.E., Dauvergne, J.-L., Saleri, R., and Batsale, J.-C. (2014, January 7\u201311). First experiments for the diagnosis and thermophysical sampling using impulse IR thermography from Unmanned Aerial Vehicle (UAV). Proceedings of the QIRT Conference, Bordeaux, France.","DOI":"10.21611\/qirt.2014.213"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"47","DOI":"10.3166\/qirt.1.47-70","article-title":"Pulsed phase thermography reviewed","volume":"1","author":"Maldague","year":"2004","journal-title":"Quant. InfraRed Thermogr. J."},{"key":"ref_20","unstructured":"Sachs, D., Nasiri, S., Goehl, D., and Image Stabilization Technology Overview (2021, February 22). InvenSense. Whitepaper. Available online: https:\/\/www.digikey.gr\/Web%20Export\/Supplier%20Content\/invensense-1428\/pdf\/invensense-image-stabilization-technology.pdf."},{"key":"ref_21","unstructured":"Shen, H., Pan, Q., Cheng, Y., and Yu, Y. (2009, January 20\u201322). Fast video stabilization algorithm for UAV. Proceedings of the IEEE International Conference on Intelligent Computing and Intelligent Systems, Shanghai, China."},{"key":"ref_22","unstructured":"Wang, Y., Hou, Z., Leman, K., and Chang, R. (2011, January 13\u201315). Real-time video stabilization for Unmanned Aerials Vehicles. Proceedings of the Conference on Machine Vision Applications, Nara, Japan."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Hong, S., Hong, T., and Yang, W. (2010, January 14\u201316). Multi-resolution unmanned aerial vehicle video stabilization. Proceedings of the IEEE 2010 National Aerospace and Electronics Conference (NAECON), Dayton, OH, USA.","DOI":"10.1109\/NAECON.2010.5712935"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Rahmanair, W., Wang, W.-J., and Chen, H.-C. (2019). Real-Time Detection and Recognition of Multiple Moving Objects for Aerial Surveillance. Electronics, 8.","DOI":"10.3390\/electronics8121373"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.aasri.2013.10.012","article-title":"Video Stabilization for Aerial Video Surveillance","volume":"4","author":"Walha","year":"2013","journal-title":"AASRI Procedia"},{"key":"#cr-split#-ref_26.1","doi-asserted-by":"crossref","unstructured":"Bebis, G., Boyle, R., Parvin, B., Koracin, D., Wang, S., Kyungnam, K., Benes, B., Moreland, K., Borst, C., and DiVerdi, S. (2011). A fast video stabilization system based on speeded-up robust features. Advances in Visual Computing, Proceedings of the International Symposium on Visual Computing","DOI":"10.1007\/978-3-642-24031-7"},{"key":"#cr-split#-ref_26.2","unstructured":"Las Vegas, NV, USA, 26-28 September 2011, Springer."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Auberger, S., and Miro, C. (2005, January 15\u201317). Digital Video Stabilization Architecture for Low Cost Devices. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, Zagreb, Croatia.","DOI":"10.1109\/ISPA.2005.195458"},{"key":"ref_28","unstructured":"Marcenaro, L., Vernazza, G., and Regazzoni, C.S. (2001, January 7\u201310). Image stabilization algorithms for video-surveillance applications. Proceedings of the 2001 International Conference on Image Processing (Cat. No.01CH37205), Thessaloniki, Greece."},{"key":"ref_29","unstructured":"Morimoto, C., and Chellappa, R. (1998, January 15). Evaluation of image stabilization algorithms. Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP \u201998 (Cat. No.98CH36181), Seattle, WA, USA."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Souza, M., and Pedrini, H. (2018). Digital video stabilization based on adaptive camera trajectory smoothing. J. Image Video Proc., 37.","DOI":"10.1186\/s13640-018-0277-7"},{"key":"ref_31","unstructured":"Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9\u201312). Multiscale structural similarity for image quality assessment. Proceedings of the Thirty-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA."},{"key":"ref_32","unstructured":"Thakur, A.S. (2020, July 12). Video Stabilization Using Point Feature Matching in OpenCV. Learn OpenCV. Available online: https:\/\/www.learnopencv.com\/author\/abhi-una12\/."},{"key":"ref_33","unstructured":"Shi-Tomasi Corner Detector (2021, January 19). OpenCV. Available online: https:\/\/docs.opencv.org\/3.4\/d8\/dd8\/tutorial_good_features_to_track.html."},{"key":"ref_34","unstructured":"Optical Flow (2021, January 19). OpenCV. Available online: https:\/\/docs.opencv.org\/3.4\/d4\/dee\/tutorial_optical_flow.html."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/s00591-010-0080-8","article-title":"Exponential moving average versus moving exponential average","volume":"58","author":"Klinker","year":"2011","journal-title":"Math. Semesterber."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Sammut, C., and Webb, G.I. (2011). Gaussian Distribution. Encyclopedia of Machine Learning, Springer.","DOI":"10.1007\/978-0-387-30164-8"},{"key":"ref_37","unstructured":"Linear Regression (2020, July 10). Scikit-Learn. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.linear_model.LinearRegression.html."},{"key":"ref_38","unstructured":"Support Vector Regression (2020, July 13). Scikit-Learn. Available online: https:\/\/scikit-learn.org\/stable\/modules\/generated\/sklearn.svm.SVR.html."},{"key":"ref_39","unstructured":"Butterworth Filter (2020, July 18). SciPy.org. Available online: https:\/\/docs.scipy.org\/doc\/scipy\/reference\/generated\/scipy.signal.butter.html."},{"key":"ref_40","unstructured":"ZENMUSE XT (2021, February 22). User Manual, v1.2; FFC Calibration. Available online: https:\/\/dl.djicdn.com\/downloads\/zenmuse_xt\/en\/Zenmuse_XT_User_Manual_en_v1.2.pdf."},{"key":"ref_41","unstructured":"(2021, January 07). What Calibration Terms are Applied in the Camera? There is the FFC and also the Gain Calibration. Are there others? Can I Do My Own Calibration? FLIR. Available online: https:\/\/www.flir.ca\/support-center\/oem\/what-calibration-terms-are-applied-in-the-camera-there-is-the-ffc-and-also-the-gain-calibration.-are-there-others-can-i-do-my-own-calibration\/."},{"key":"ref_42","unstructured":"Tukey, J.W. (1977). Exploratory Data Analysis. Addison-Wesley."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Litvin, A., Konrad, J., and Karl, W. (2003, January 7). Probabilistic Video Stabilization Using Kalman Filtering and Mosaicing. Proceedings of the SPIE 5022, Image and Video Communications and Processing, Santa Clara, CA, USA.","DOI":"10.1117\/12.476436"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1007\/s11263-006-0001-4","article-title":"Video Epitomes","volume":"76","author":"Cheung","year":"2008","journal-title":"Int. J. Comput. Vis."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"1150","DOI":"10.1109\/TPAMI.2006.141","article-title":"Full-frame video stabilization with motion inpainting","volume":"28","author":"Matsushita","year":"2006","journal-title":"IEEE Trans. Patt. Anal. Mach. Intell."},{"key":"ref_46","unstructured":"Maldague, X.P.V. (2001). Theory and Practice of Infrared Technology for NonDestructive Testing, John Wiley-Interscience. 684."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1337","DOI":"10.1117\/1.1566969","article-title":"Reconstruction and enhancement of active thermographic image sequences","volume":"42","author":"Shepard","year":"2003","journal-title":"Opt. Eng."},{"key":"ref_48","first-page":"611","article-title":"Interpreting the results of pulsed thermography data","volume":"61","author":"Martin","year":"2003","journal-title":"Mater. Eval."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"521","DOI":"10.1016\/S0263-8223(02)00161-7","article-title":"Principal component thermography for flaw contrast enhancement and flaw depth characterisation in composite structures","volume":"58","author":"Rajic","year":"2002","journal-title":"Compos. Struct."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1604\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:28:25Z","timestamp":1760160505000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/5\/1604"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,25]]},"references-count":50,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["s21051604"],"URL":"https:\/\/doi.org\/10.3390\/s21051604","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,2,25]]}}}