{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T02:13:55Z","timestamp":1768011235318,"version":"3.49.0"},"reference-count":52,"publisher":"MDPI AG","issue":"13","license":[{"start":{"date-parts":[[2021,6,24]],"date-time":"2021-06-24T00:00:00Z","timestamp":1624492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Registration of long-wave infrared (LWIR) hyperspectral images with their thermal and emissivity components has until now received comparatively less attention with respect to the visible near and short wave infrared hyperspectral images. In this paper, the registration of LWIR hyperspectral images is investigated to enhance applications of LWIR images such as change detection, temperature and emissivity separation, and target detection. The proposed approach first searches for the best features of hyperspectral image pixels for extraction and matching in the LWIR range and then performs a global registration over two-dimensional maps of three-dimensional hyperspectral cubes. The performances of temperature and emissivity features in the thermal domain along with the average energy and principal components of spectral radiance are investigated. The global registration performed over whole 2D maps is further improved by blockwise local refinements. Among the two proposed approaches, the geometric refinement seeks the best keypoint combination in the neighborhood of each block to estimate the transformation for that block. The alternative optimization-based refinement iteratively finds the best transformation by maximizing the similarity of the reference and transformed blocks. The possible blocking artifacts due to blockwise mapping are finally eliminated by pixelwise refinement. The experiments are evaluated with respect to the (i) utilized similarity metrics in the LWIR range between transformed and reference blocks, (ii) proposed geometric- and optimization-based methods, and (iii) image pairs captured on the same and different days. The better performance of the proposed approach compared to manual, GPU-IMU-based, and state-of-the-art image registration methods is verified.<\/jats:p>","DOI":"10.3390\/rs13132465","type":"journal-article","created":{"date-parts":[[2021,6,24]],"date-time":"2021-06-24T11:01:38Z","timestamp":1624532498000},"page":"2465","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Geometric- and Optimization-Based Registration Methods for Long-Wave Infrared Hyperspectral Images"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8749-8646","authenticated-orcid":false,"given":"Alper","family":"Koz","sequence":"first","affiliation":[{"name":"Center for Image Analysis (OGAM), Middle East Technical University, 06800 Ankara, Turkey"}]},{"given":"Ufuk","family":"Efe","sequence":"additional","affiliation":[{"name":"Center for Image Analysis (OGAM), Middle East Technical University, 06800 Ankara, Turkey"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/146370.146374","article-title":"A survey of image registration techniques","volume":"24","author":"Brown","year":"1992","journal-title":"ACM Comput. Surv."},{"key":"ref_2","unstructured":"Liao, R. (2019). Deformable Image Registration for Hyperspectral Images. [Master\u2019s Thesis, Dept. of Electrical and Systems Eng., McKelvey School of Engineering, Washington University]."},{"key":"ref_3","unstructured":"Veste, S. (2017). Registration in Hyperspectral and Multispectral Imaging. [Master\u2019s Thesis, Department of Electronic Systems, Norwegian University of Science and Technology]."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"748","DOI":"10.1109\/TGRS.2008.2011280","article-title":"Interest Points for Hyperspectral Image Data","volume":"47","author":"Mukherjee","year":"2009","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2589","DOI":"10.1109\/TGRS.2011.2109389","article-title":"Automatic Image Registration Through Image Segmentation and SIFT","volume":"49","author":"Goncalves","year":"2011","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2037","DOI":"10.3390\/rs5052037","article-title":"Optimizing SIFT for Matching of Short Wave Infrared and Visible Wavelength Images","volume":"5","author":"Sima","year":"2013","journal-title":"Remote. Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1049\/el:20082477","article-title":"Multi-spectral remote image registration based on SIFT","volume":"44","author":"Yi","year":"2008","journal-title":"Electron. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Vural, M.F., Yard\u0131mc\u0131, Y., and Temizel, A. (2009, January 12\u201317). Registration of Multispectral Satellite Images with Oriented-Restricted SIFT. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Cape Town, South Africa.","DOI":"10.1109\/IGARSS.2009.5417801"},{"key":"ref_9","unstructured":"Ord\u00f3\u00f1ez, A., Heras, D.B., and Arg\u00fcello, F. (August, January 28). Surf-Based Registration for Hyperspectral Images. Proceedings of the IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1080\/01490419.2011.634964","article-title":"Pushbroom-Frame Imagery Co-Registration","volume":"35","author":"Rzhanov","year":"2012","journal-title":"Mar. Geod."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4521","DOI":"10.1109\/TGRS.2012.2191791","article-title":"A Vector SIFT Detector for Interest Point Detection in Hyperspectral Imagery","volume":"50","author":"Mukherjee","year":"2012","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"73340O","DOI":"10.1117\/12.819487","article-title":"Interest point detection for hyperspectral imagery","volume":"Volume 7334","author":"Roysam","year":"2009","journal-title":"Proceedings of the SPIE Defense"},{"key":"ref_13","unstructured":"Kern, J.P., Pattichis, M., and Stearns, S.D. (2003, January 9\u201312). Registration of image cubes using multivariate mutual information. Proceedings of the The Thirty-Seventh Asilomar Conference on Signals, Systems & Computers, Pacific Grove, CA, USA."},{"key":"ref_14","first-page":"61","article-title":"Registration of Remn ote Sensing Hyperspectral Imagery Using Mutual Information and Stochastic Optimization","volume":"21","author":"Luo","year":"2006","journal-title":"Remote Sens. Technol. Appl."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Hasan, M., Pickering, M., Robles-Kelly, A., Zhou, J., and Jia, X. (2010, January 3). Registration of hyperspectral and trichromatic images via cross cumulative residual entropy maximization. Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong, China.","DOI":"10.1109\/ICIP.2010.5651054"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Zhou, Y., Rangarajan, A., and Gader, P.D. (2017, January 21\u201326). Nonrigid Registration of Hyperspectral and Color Images with Vastly Different Spatial and Spectral Resolutions for Spectral Unmixing and Pansharpening. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.201"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"3020","DOI":"10.1109\/TGRS.2019.2946803","article-title":"An Integrated Approach to Registration and Fusion of Hyperspectral and Multi-spectral Images","volume":"58","author":"Zhou","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"986","DOI":"10.1109\/TMI.2003.815867","article-title":"Mutual Information based registration of medical images","volume":"22","author":"Pluim","year":"2003","journal-title":"IEEE Trans. Med Imaging"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kim, B.H., Kim, M.Y., and Chae, Y.S. (2017). Background Registration-Based Adaptive Noise Filtering of LWIR\/MWIR Imaging Sensors for UAV Applications. Sensors, 18.","DOI":"10.3390\/s18010060"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Steven, V., Hoecke, V., Nele, T., Bart, M., Bart, S., Peter, L., Charles-Frederik, H., and Rik, V.D.W. (2011). Hot Topics in Video Fire Surveillance. Video Surveillance, InTech.","DOI":"10.5772\/14190"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Koz, A., \u00c7al\u0131\u015fkan, A., Ayd\u0131n, A., and Alatan, A. (2016, January 21\u201324). Registration of MWIR-LWIR Band Hyperspectral Images. In Proceedings of the 8th Work-shop on Hyperspectral Image and Signal Processing: Evolution in Remote Sensing, Los Angeles, CA, USA.","DOI":"10.1109\/WHISPERS.2016.8071708"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, K., Pan, A., Yang, Y., Zhang, S., Ong, S.H., and Tang, H. (2017). Remote Sensing Image Registration Using Multiple Image Features. Remote Sens., 9.","DOI":"10.20944\/preprints201705.0027.v2"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"6469","DOI":"10.1109\/TGRS.2015.2441954","article-title":"Robust Feature Matching for Remote Sensing Image Registration via Locally Linear Transforming","volume":"53","author":"Ma","year":"2015","journal-title":"IEEE Trans. Geosci. Remote. Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1458","DOI":"10.3906\/elk-1907-92","article-title":"Feature points-based image registration between satellite imagery and aerial images of agricultural land","volume":"28","author":"Abbas","year":"2020","journal-title":"Turk. J. Electr. Eng. Comput. Sci."},{"key":"ref_25","unstructured":"Mostafa, M.M.R., and Hutton, J. (2001, January 24\u201327). Direct Positioning and Orientation Systems. How do they work? What is the attainable accu-racy? In Proceedings of the American Society of Photogrammetry and Remote Sensing Annual Meeting, St. Louis, MO, USA."},{"key":"ref_26","unstructured":"Cramer, M., Stallmann, D., and Haala, N. (2000, January 16\u201323). Direct Georefererencing Using GPS\/Inertial Exterior Orientations for Photogrammetric Applications. Proceedings of the XIXth International Society for Photogrammetry and Remote Sensing Congress, Amsterdam, The Netherlands."},{"key":"ref_27","unstructured":"Yuan, X., and Zhang, X. (2008, January 3\u201311). Theoretical Accuracy of Direct Georeferencing with Position and Orientation System in Aerial Pho-togrammetry. Proceedings of the XXIth, International Society for Photogrammetry and Remote Sensing Congress, Beijing, China."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Efe, U., Gokalp, K., Ince, A., and Alatan, A. (2021, January 25). DFM: A Performance Baseline for Deep Feature Matching. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Virtual.","DOI":"10.1109\/CVPRW53098.2021.00484"},{"key":"ref_29","unstructured":"Rocco, I., Cimpoi, M., Arandjelovic, R., Torii, A., Pajdla, T., and Sivic, J. (2020). Ncnet: Neighbourhood con-sensus networks for estimating image correspondences. IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhou, Q., Sattler, T., and Leal-Taixe, L. (2021, January 19\u201325). Patch2pix: Epipolar-guided pixel-level correspondences. Proceedings of Conference on Computer Vision and Pattern Recognition (CVPR), Virtual.","DOI":"10.1109\/CVPR46437.2021.00464"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2018, January 18\u201322). Self-supervised interest point detection and description. Proceedings of the Computer Vision and Pattern Recognition Workshop, Salt Lake City, Utah.","DOI":"10.1109\/CVPRW.2018.00060"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Dusmanu, M., Rocco, I., Pajdla, T., Pollefeys, M., Sivic, J., Torii, A., and Sattler, T. (2019, January 16\u201320). D2-Net: A Trainable CNN for Joint Description and Detection of Local Features. Proceedings of the 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, USA.","DOI":"10.1109\/CVPR.2019.00828"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1007\/s11263-018-1117-z","article-title":"Locality Preserving Matching","volume":"127","author":"Ma","year":"2019","journal-title":"Int. J. Comput. Vis."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sarlin, P.-E., DeTone, D., Malisiewicz, T., and Rabinovich, A. (2020, January 13\u201319). SuperGlue: Learning Feature Matching with Graph Neural Networks. Proceedings of the2020 Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00499"},{"key":"ref_35","unstructured":"DeTone, D., Malisiewicz, T., and Rabinovich, A. (2016, January 18). Deep image homography estimation. Proceedings of the RSS Workshop: Limits and Potentials of Deep Learning in Robotics, Ann Arbor, MI, USA."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2346","DOI":"10.1109\/LRA.2018.2809549","article-title":"Unsupervised Deep Homography: A Fast and Robust Homography Estimation Model","volume":"3","author":"Nguyen","year":"2018","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by Maximization of Mutual Information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error measurement to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"346","DOI":"10.1016\/j.cviu.2007.09.014","article-title":"SURF: Speeded Up Robust Features","volume":"110","author":"Bay","year":"2008","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_41","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"102","DOI":"10.1117\/12.258057","article-title":"LWIR\/MWIR imaging hyperspectral sensor for airborne and ground-based remote sensing","volume":"Volume 2819","author":"Hackwell","year":"1996","journal-title":"Proceedings of the Imaging Spectrometry II"},{"key":"ref_43","unstructured":"Pipia, L., Arag\u00fc\u00e9s, F.P., Tard\u00e0, A., Martinez, L., Pal\u00e0, V., and Arbiol, R. (October, January 27). Thermal Airborne Spectrographic Imager for Temperature and Emissivity Retrieval. Proceedings of the 3rd International Symposium on the Recent Advances in Quantitative Remote Sensing, Valencia, Spain."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Hartley, R., Zisserman, A., and Faugeras, O. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press (CUP).","DOI":"10.1017\/CBO9780511811685"},{"key":"ref_45","first-page":"726","article-title":"Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography","volume":"24","author":"Fischler","year":"1987","journal-title":"Read. Comput. Vis."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Koz, A., Soydan, H., Duzgun, H.S., and Alatan, A.A. (2016, January 10\u201315). A local extrema based method on 2D brightness temperature maps for detection of archaeological artifacts. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729014"},{"key":"ref_47","unstructured":"Smith, R.B. (2021, June 23). Computing the Planck Function. Available online: http:\/\/yceo.yale.edu\/sites\/default\/files\/files\/ComputingThePlanckFunction.pdf."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1113","DOI":"10.1109\/36.700995","article-title":"A Temperature and Emissivity Seperation Algorithm for Advanced Spaceborne Thermal Emission and Reflection Radiometer (ASTER) images","volume":"36","author":"Mukherjee","year":"1998","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_49","unstructured":"Harris, C., and Stephens, M. (September, January 31). A Combined Corner and Edge Detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Terriberry, T.B. (2015, January 10\u201312). Adaptive motion compensation without blocking artifacts. Proceedings of the Visual Information Processing and Communication VI, San Francisco, CA, USA.","DOI":"10.1117\/12.2080412"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Vedaldi, A., and Fulkerson, B.M. (2010, January 25\u201329). VLFeat: An open and portable library of computer vision algorithms. Proceedings of the 18th ACM international conference on Multimedia, Firenze, Italy.","DOI":"10.1145\/1873951.1874249"},{"key":"ref_52","unstructured":"(2021, June 23). Matlab Hyperspectral Toolbox by Isaac Greg. Available online: https:\/\/github.com\/isaacgerg\/matlabHyperspectralToolbox\/tree\/master\/hyperspectralToolbox."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2465\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:22:58Z","timestamp":1760163778000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/13\/2465"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,24]]},"references-count":52,"journal-issue":{"issue":"13","published-online":{"date-parts":[[2021,7]]}},"alternative-id":["rs13132465"],"URL":"https:\/\/doi.org\/10.3390\/rs13132465","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,24]]}}}