{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,24]],"date-time":"2025-12-24T12:26:03Z","timestamp":1766579163682,"version":"build-2065373602"},"reference-count":49,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T00:00:00Z","timestamp":1625356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>A large amount of information needs to be identified and produced during the process of promoting projects of interest. Thermal infrared (TIR) images are extensively used because they can provide information that cannot be extracted from visible images. In particular, TIR oblique images facilitate the acquisition of information of a building\u2019s facade that is challenging to obtain from a nadir image. When a TIR oblique image and the 3D information acquired from conventional visible nadir imagery are combined, a great synergy for identifying surface information can be created. However, it is an onerous task to match common points in the images. In this study, a robust matching method of image pairs combined with different wavelengths and geometries (i.e., visible nadir-looking vs. TIR oblique, and visible oblique vs. TIR nadir-looking) is proposed. Three main processes of phase congruency, histogram matching, and Image Matching by Affine Simulation (IMAS) were adjusted to accommodate the radiometric and geometric differences of matched image pairs. The method was applied to Unmanned Aerial Vehicle (UAV) images of building and non-building areas. The results were compared with frequently used matching techniques, such as scale-invariant feature transform (SIFT), speeded-up robust features (SURF), synthetic aperture radar\u2013SIFT (SAR\u2013SIFT), and Affine SIFT (ASIFT). The method outperforms other matching methods in root mean square error (RMSE) and matching performance (matched and not matched). The proposed method is believed to be a reliable solution for pinpointing surface information through image matching with different geometries obtained via TIR and visible sensors.<\/jats:p>","DOI":"10.3390\/s21134587","type":"journal-article","created":{"date-parts":[[2021,7,4]],"date-time":"2021-07-04T22:35:22Z","timestamp":1625438122000},"page":"4587","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Feature Matching Combining Radiometric and Geometric Characteristics of Images, Applied to Oblique- and Nadir-Looking Visible and TIR Sensors of UAV Imagery"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4846-1944","authenticated-orcid":false,"given":"Hyoseon","family":"Jang","sequence":"first","affiliation":[{"name":"School of Civil and Environmental Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6216-3214","authenticated-orcid":false,"given":"Sangkyun","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2122-0534","authenticated-orcid":false,"given":"Suhong","family":"Yoo","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0937-4530","authenticated-orcid":false,"given":"Soohee","family":"Han","sequence":"additional","affiliation":[{"name":"Department of Geoinformatics Engineering, Kyungil University, Gyeongsan 38428, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hong-Gyoo","family":"Sohn","sequence":"additional","affiliation":[{"name":"School of Civil and Environmental Engineering, Yonsei University, Seoul 03722, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,7,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1127\/1432-8364\/2015\/0274","article-title":"Generation of TIR-attributed 3D Point Clouds from UAV-based Thermal Imagery","volume":"5","author":"Westfeld","year":"2015","journal-title":"Photogramm. Fernerkund. Geoinf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2963","DOI":"10.1109\/TGRS.2015.2509179","article-title":"Review of thermal infrared applications and requirements for future high-resolution sensors","volume":"54","author":"Sobrino","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1007\/s10462-012-9345-z","article-title":"Automatic fire detection based on soft computing techniques: Review from 2000 to 2010","volume":"42","author":"Mahdipour","year":"2014","journal-title":"Artif. Intell. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/j.jvolgeores.2016.06.014","article-title":"Drone with thermal infrared camera provides high resolution georeferenced imagery of the Waikite geothermal area, New Zealand","volume":"325","author":"Harvey","year":"2016","journal-title":"J. Volcanol. Geotherm. Res."},{"key":"ref_5","first-page":"2253","article-title":"Infrared thermography based disaster management using drone and flir camera","volume":"119","author":"Divager","year":"2018","journal-title":"Int. J. Pure Appl. Math."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/j.jvolgeores.2009.05.001","article-title":"The 2005 eruption of Kliuchevskoi volcano: Chronology and processes derived from ASTER spaceborne and field-based data","volume":"184","author":"Rose","year":"2009","journal-title":"J. Volcanol. Geotherm. Res."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Grealish, K., Kacir, T., Backer, B., and Norton, P. (2005, January 27). An advanced infrared thermal imaging module for military and commercial applications. Proceedings of the Unattended Ground Sensor Technologies and Applications VII, Orlando, FL, USA.","DOI":"10.1117\/12.606946"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Zoran, M., Savastru, R., Savastru, D., Miclos, S., Tautan, M., and Baschir, L. (2012, January 19). Thermal pollution assessment in nuclear power plant environment by satellite remote sensing data. Proceedings of the Remote Sensing for Agriculture, Ecosystems, and Hydrology XIV, Edinburgh, UK.","DOI":"10.1117\/12.974402"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.apenergy.2014.08.005","article-title":"Infrared thermography (IRT) applications for building diagnostics: A review","volume":"134","author":"Kylili","year":"2014","journal-title":"Appl. Energy"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3077","DOI":"10.1016\/j.rser.2017.10.031","article-title":"Applications of the infrared thermography in the energy audit of buildings: A review","volume":"82","author":"Lucchi","year":"2018","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive image features from scale-invariant keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"Speeded-Up Robust Features (SURF)","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"7233","DOI":"10.1080\/01431161.2020.1755737","article-title":"Exterior orientation estimation of oblique aerial images using SfM-based robust bundle adjustment","volume":"41","author":"Verykokou","year":"2020","journal-title":"Int. J. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Jiang, S., and Jiang, W. (2018). Efficient SfM for Oblique UAV Images: From match pair selection to geometrical verification. Remote Sens., 10.","DOI":"10.3390\/rs10081246"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"3690","DOI":"10.3390\/s140203690","article-title":"Feature point descriptors: Infrared and visible spectra","volume":"14","author":"Ricaurte","year":"2014","journal-title":"Sensors"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Rublee, E., Rabaud, V., Konolige, K., and Bradski, G. (2011, January 6\u201313). ORB: An efficient alternative to SIFT or SURF. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126544"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Leutenegger, S., Chli, M., and Siegwart, R.Y. (, January 6\u201313). BRISK: Binary robust invariant scalable keypoints. Proceedings of the 2011 International Conference on Computer Vision, Barcelona, Spain.","DOI":"10.1109\/ICCV.2011.6126542"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Calonder, M., Lepetit, V., Strecha, C., and Fua, P. (2010, January 5\u201311). BRIEF: Binary robust independent elementary features. Proceedings of the European Conference on Computer Vision, Heraklion, Crete, Greece.","DOI":"10.1007\/978-3-642-15561-1_56"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Alahi, A., Ortiz, R., and Vandergheynst, P. (2012, January 16\u201321). FREAK: Fast retina keypoint. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.","DOI":"10.1109\/CVPR.2012.6247715"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"12661","DOI":"10.3390\/s120912661","article-title":"Multispectral image feature points","volume":"12","author":"Aguilera","year":"2012","journal-title":"Sensors"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1210","DOI":"10.1109\/TITS.2014.2354731","article-title":"Multispectral stereo odometry","volume":"16","author":"Mouats","year":"2015","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Liu, X., Li, J.B., and Pan, J.S. (2019). Feature point matching based on distinct wavelength phase congruency and log-gabor filters in infrared and visible images. Sensors, 19.","DOI":"10.3390\/s19194244"},{"key":"ref_23","unstructured":"Ke, Y., and Sukthankar, R. (July, January 27). PCA-SIFT: A more distinctive representation for local image descriptors. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, DC, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"438","DOI":"10.1137\/080732730","article-title":"ASIFT: A new framework for fully affine invariant image comparison","volume":"2","author":"Morel","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1109\/TIP.2011.2160271","article-title":"A novel algorithm for view and illumination invariant image matching","volume":"21","author":"Yu","year":"2012","journal-title":"IEEE Trans. Image Process."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1364\/AO.52.000096","article-title":"Invariant matching method for different viewpoint angle images","volume":"52","author":"Chen","year":"2013","journal-title":"Appl. Opt."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"81","DOI":"10.1016\/j.cviu.2015.08.005","article-title":"MODS: Fast and robust method for two-view matching","volume":"141","author":"Mishkin","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Yang, K., Pan, A., Yang, Y., Zhang, S., Ong, S., and Tang, H. (2017). Remote sensing image registration using multiple image features. Remote Sens., 9.","DOI":"10.20944\/preprints201705.0027.v2"},{"key":"ref_29","unstructured":"Amanda, G., Jason, F., and Carl, S. (2014, January 5\u20136). Automatic georeferencing of imagery from high-resolution, low-altitude, low-cost aerial platforms. Proceedings of the Geospatial InfoFusion and Video Analytics IV; and Motion Imagery for ISR and Situational Awareness II, Baltimore, MD, USA."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"251","DOI":"10.5201\/ipol.2018.225","article-title":"Fast affine invariant image matching","volume":"8","author":"Delon","year":"2018","journal-title":"Image Process. Line"},{"key":"ref_31","first-page":"477","article-title":"Improved Image matching method based on affine transformation using nadir and oblique-looking drone imagery","volume":"38","author":"Jang","year":"2020","journal-title":"J. Korean Soc. Surv. Geod. Photogramm. Cartogr."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1109\/PROC.1981.12022","article-title":"The importance of phase in signals","volume":"69","author":"Oppenheim","year":"1981","journal-title":"Proc. IEEE"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1016\/0167-8655(87)90013-4","article-title":"Feature detection from local energy","volume":"6","author":"Morrone","year":"1987","journal-title":"Pattern Recognit. Lett."},{"key":"ref_34","first-page":"1","article-title":"Image features from phase congruency","volume":"1","author":"Kovesi","year":"1999","journal-title":"Videre J. Comput. Vis. Res."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Sun, C., Talbot, H., Ourselin, S., and Adriaansen, T. (2003). Phase congruency detects corners and edges. Digital Image Computing: Techniques and Applications, Proceedings of the VIIth Biennial Australian Pattern Recognition Society Conference, DICTA 2003, CSIRO Publishing. [7th ed.].","DOI":"10.1071\/9780643090989"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kuenzer, C., and Dech, S. (2013). Thermal Infrared Remote Sensing: Sensors, Methods, Applications, Springer Science+Business Media.","DOI":"10.1007\/978-94-007-6639-6"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Richards, J.A. (2013). Remote Sensing Digital Image Analysis, Springer. [5th ed.].","DOI":"10.1007\/978-3-642-30062-2"},{"key":"ref_38","first-page":"961","article-title":"Review on color transfer between images","volume":"2","author":"Dhanve","year":"2014","journal-title":"Int. J. Eng. Res. Gen. Sci."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Tian, Q.-C., and Cohen, L. (2017). Histogram-based color transfer for image stitching. J. Imaging, 3.","DOI":"10.3390\/jimaging3030038"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1109\/38.946629","article-title":"Color transfer between images","volume":"21","author":"Reinhard","year":"2001","journal-title":"IEEE Comput. Graph. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"111","DOI":"10.5194\/isprs-archives-XLIII-B2-2020-111-2020","article-title":"Mindflow based dense matching between Tir and Rgb images","volume":"XLIII-B2-2020","author":"Zhu","year":"2020","journal-title":"Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Jel\u00e9nek, J., Kopa\u010dkov\u00e1, V., Kouck\u00e1, L., and Mi\u0161urec, J. (2016). Testing a modified PCA-Based sharpening approach for image fusion. Remote Sens., 8.","DOI":"10.3390\/rs8100794"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography","volume":"24","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_44","unstructured":"Qian, H., Yue, J.W., and Chen, M. (2019, January 15\u201317). Research progress on feature matching of SAR and optical images. Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, International Conference on Geomatics in the Big Data Era (ICGBD), Guilin, China."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Markiewicz, J., Abratkiewicz, K., Gromek, A., Samczynski, W.O.P., and Gromek, D. (2019). Geometrical matching of SAR and optical images utilizing ASIFT features for SAR-based navigation aided systems. Sensors, 19.","DOI":"10.3390\/s19245500"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote sensing image registration with modified SIFT and enhanced feature matching","volume":"14","author":"Ma","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhu, R., Yu, D., Ji, S., and Lu, M. (2019). Matching RGB and infrared remote sensing images with densely-connected convolutional neural networks. Remote Sens., 11.","DOI":"10.3390\/rs11232836"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2351","DOI":"10.1109\/36.789634","article-title":"A feature-based image registration algorithm using improved chain-code representation combined with invariant moments","volume":"37","author":"Dai","year":"1999","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Tang, Z., Monasse, P., and Morel, J.-M. (2014, January 27\u201330). Improving the matching precision of SIFT. Proceedings of the IEEE International Conference on Image Processing (ICIP 2014), Paris, France.","DOI":"10.1109\/ICIP.2014.7026164"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4587\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:25:53Z","timestamp":1760163953000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/13\/4587"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,4]]},"references-count":49,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["s21134587"],"URL":"https:\/\/doi.org\/10.3390\/s21134587","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,7,4]]}}}