{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,17]],"date-time":"2025-12-17T12:57:08Z","timestamp":1765976228228,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2018,8,5]],"date-time":"2018-08-05T00:00:00Z","timestamp":1533427200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The automatic image registration serves as a technical prerequisite for multimodal remote sensing image fusion. Meanwhile, it is also the technical basis for change detection, image stitching and target recognition. The demands of subpixel level registration accuracy can be rarely satisfied with a multimodal image registration method based on feature matching. In light of this, we propose a Generic and automatic Markov Random Field (MRF)-based registration framework of multimodal image using grayscale and gradient information. The proposed approach performs non-rigid registration and formulates an MRF model while grayscale and gradient statistical information of a multimodal image is employed for the evaluation of similarity while the spatial weighting function is optimized simultaneously. Besides, the value space is discretized to improve the convergence speed. The developed automatic approach was validated both qualitatively and quantitatively, demonstrating its potential for a variety of multimodal remote sensing datasets and scenes. As for the registration accuracy, the average target registration error of the proposed framework is less than 1 pixel, while the maximum displacement error is less than 1 pixel. Compared with the polynomial model registration based on manual selection, the registration accuracy has been significantly improved. In the meantime, the proposed approach had the partial applicability for the multimodal image registration of large deformation scenes. It is also proved that the proposed registration framework using grayscale and gradient information outperforms the MRF-based registration using only grayscale information and only gradient information while the proposed registration framework using Gaussian function as spatial weighting function is superior to that using distance inverse weight method.<\/jats:p>","DOI":"10.3390\/rs10081228","type":"journal-article","created":{"date-parts":[[2018,8,7]],"date-time":"2018-08-07T03:44:18Z","timestamp":1533613458000},"page":"1228","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Generic and Automatic Markov Random Field-Based Registration for Multimodal Remote Sensing Image Using Grayscale and Gradient Information"],"prefix":"10.3390","volume":"10","author":[{"given":"Li","family":"Yan","sequence":"first","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}]},{"given":"Ziqi","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}]},{"given":"Yi","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}]},{"given":"Zhiyun","family":"Ye","sequence":"additional","affiliation":[{"name":"School of Geodesy and Geomatics, Wuhan University, 129 Luoyu Road, Wuhan 430079, China"}]}],"member":"1968","published-online":{"date-parts":[[2018,8,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1109\/TNNLS.2016.2636227","article-title":"A Deep Convolutional Coupling Network for Change Detection Based on Heterogeneous Optical and Radar Images","volume":"29","author":"Liu","year":"2018","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Bongiorno, D.L., Bryson, M., Bridge, T.C.L., Dansereau, D.G., and Williams, S.B. (2017). Coregistered Hyperspectral and Stereo Image Seafloor Mapping from an Autonomous Underwater Vehicle. J. Field Robot.","DOI":"10.1002\/rob.21713"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Sakamoto, Y., Kuwahara, T., and Yoshida, K. (2018). HPT: A High Spatial Resolution Multispectral Sensor for Microsatellite Remote Sensing. Sensors, 18.","DOI":"10.3390\/s18020619"},{"key":"ref_4","first-page":"1","article-title":"Analysis and prospect of multi-source image registration techniques","volume":"31","author":"Liu","year":"2004","journal-title":"Opto-Electron. Eng."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/146370.146374","article-title":"A Survey of Image Registration Techniques","volume":"24","author":"Brown","year":"1999","journal-title":"ACM Comput. Surv."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/LGRS.2012.2216500","article-title":"Registration of Optical and SAR Satellite Images by Exploring the Spatial Relationship of the Improved SIFT","volume":"10","author":"Fan","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1109\/83.366480","article-title":"A contour-based approach to multisensor image registration","volume":"4","author":"Li","year":"1995","journal-title":"IEEE Trans. Image Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1117\/1.600908","article-title":"Automatic visual\/IR image registration","volume":"35","author":"Li","year":"1996","journal-title":"Opt. Eng."},{"key":"ref_9","first-page":"60","article-title":"Automatic registration of aerophotos based on SUSAN operator","volume":"32","author":"Zhang","year":"2006","journal-title":"Sci. Surv. Map."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kelman, A., Sofka, M., and Stewart, C.V. (2007, January 17\u201322). Keypoint Descriptors for Matching Across Multiple Image Modalities and Non-linear Intensity Variations. Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Minneapolis, MN, USA.","DOI":"10.1109\/CVPR.2007.383426"},{"key":"ref_11","first-page":"115","article-title":"Image Features From Phase Congruency","volume":"1","author":"Kovesi","year":"1999","journal-title":"J. Comput. Vis. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1016\/j.patrec.2009.05.016","article-title":"AISIR: Automated inter-sensor\/inter-band satellite image registration using robust complex wavelet feature representations","volume":"31","author":"Wong","year":"2010","journal-title":"Pattern Recogn. Lett."},{"key":"ref_13","first-page":"383","article-title":"An Extended SURF Descriptor and Its Application in Remote Sensing Images Registration","volume":"42","author":"Nan","year":"2013","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_14","unstructured":"Collignon, A. (1995). Automated multi-modality image registration based on information theory. Information Processing in Medical Imaging, Kluwer Academic Publishers."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1109\/42.563664","article-title":"Multimodality image registration by maximization of mutual information","volume":"16","author":"Maes","year":"1997","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1023\/A:1007958904918","article-title":"Alignment by maximization of mutual information","volume":"24","author":"Viola","year":"1997","journal-title":"Int. J. Comput. Vis."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1016\/S0031-3203(98)00091-0","article-title":"An overlap invariant entropy measure of 3D medical image alignment","volume":"32","author":"Studholme","year":"1999","journal-title":"Pattern Recogn."},{"key":"ref_18","first-page":"438","article-title":"Non-rigid registration using higher-order mutual information","volume":"3979","author":"Rueckert","year":"2000","journal-title":"Proc. SPIE Int. Soc. Opt. Eng."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Russakoff, D.B., Tomasi, C., Rohlfing, T., and Maurer, C.R. (2004, January 11\u201314). Image Similarity Using Mutual Information of Regions. Proceedings of the Computer Vision\u2014ECCV 2004, European Conference on Computer Vision, Prague, Czech Republic.","DOI":"10.1007\/978-3-540-24672-5_47"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"43","DOI":"10.5566\/ias.v31.p43-53","article-title":"Multi-feature mutual information image registration","volume":"31","author":"Likar","year":"2012","journal-title":"Image Anal. Stereol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s11263-006-0011-2","article-title":"Non-Rigid Multi-Modal Image Registration Using Cross-Cumulative Residual Entropy","volume":"74","author":"Wang","year":"2007","journal-title":"Int. J. Comput. Vis."},{"key":"ref_22","first-page":"6","article-title":"Automatic registration of multisensor airborne imagery","volume":"Volume 12","author":"Fan","year":"2005","journal-title":"Proceedings of the 34th Applied Imagery and Pattern Recognition Workshop (AIPR\u201905)"},{"key":"ref_23","first-page":"969","article-title":"An Operator of Gradient Consistency for Multimodal Image Registration","volume":"38","author":"Li","year":"2013","journal-title":"Wuhan Daxue Xuebao (Xinxi Kexue Ban)\/Geomat. Inf. Sci. Wuhan Univ."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1423","DOI":"10.1016\/j.media.2012.05.008","article-title":"MIND: Modality independent neighbourhood descriptor for multi-modal deformable registration","volume":"16","author":"Heinrich","year":"2012","journal-title":"Med. Image Anal."},{"key":"ref_25","first-page":"268","article-title":"Automated multispectral remote sensing image registration using local self-similarity","volume":"43","author":"Ye","year":"2014","journal-title":"Acta Geod. Cartogr. Sin."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"809","DOI":"10.1109\/42.876307","article-title":"Image registration by maximization of combined mutual information and gradient information","volume":"19","author":"Pluim","year":"2002","journal-title":"IEEE Trans. Med. Imaging"},{"key":"ref_27","first-page":"277","article-title":"Multi-modality Image Registration Using Mutual Information Based on Gradient Vector Flow","volume":"Volume 3","author":"Guo","year":"2006","journal-title":"Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906)"},{"key":"ref_28","unstructured":"Yong, S.K., Lee, J.H., and Ra, J.B. (2008). Multi-Sensor Image Registration Based on Intensity and Edge Orientation Information, Elsevier Science Inc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1109\/LSP.2010.2040928","article-title":"Robust CCD and IR Image Registration Using Gradient-Based Statistical Information","volume":"17","author":"Lee","year":"2010","journal-title":"IEEE Signal Proc. Lett."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Karantzalos, K., Sotiras, A., and Paragios, N. (2014, January 23\u201328). Efficient and Automated Multimodal Satellite Data Registration through MRFs and Linear Programming. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops, Columbus, OH, USA.","DOI":"10.1109\/CVPRW.2014.57"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"121","DOI":"10.5194\/isprs-annals-III-1-121-2016","article-title":"Automatic mrf-based registration of high resolution satellite video data","volume":"III-1","author":"Platias","year":"2016","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_32","first-page":"1461","article-title":"A Fast Image Registration Algorithm for Diffeomorphic Image with Large Deformation","volume":"41","author":"Yan","year":"2015","journal-title":"Acta Autom. Sin."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1436","DOI":"10.1109\/TPAMI.2007.1061","article-title":"Approximate labeling via graph cuts based on linear programming","volume":"29","author":"Komodakis","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Komodakis, N., Tziritas, G., and Paragios, N. (2008). Performance VS. Computational Efficiency for Optimizing Single and Dynamic MRFs: Setting the State of the Art with Primal-Dual Strategies, Elsevier Science Inc.","DOI":"10.1016\/j.cviu.2008.06.007"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Strekalovskiy, E., and Cremers, D. (2014). Real-Time Minimization of the Piecewise Smooth Mumford-Shah Functional, Springer.","DOI":"10.1007\/978-3-319-10605-2_9"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"328","DOI":"10.1109\/TPAMI.2007.1166","article-title":"Stereo Processing by Semiglobal Matching and Mutual Information","volume":"30","author":"Hirschm","year":"2007","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","unstructured":"Kim, J., Kolmogorov, V., and Zabih, R. (2003, January 13\u201316). Visual correspondence using energy minimization and mutual information. Proceedings of the IEEE International Conference on Computer Vision, Nice, France."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1006\/gmod.2000.0531","article-title":"Injectivity Conditions of 2D and 3D Uniform Cubic B-Spline Functions","volume":"62","author":"Choi","year":"2000","journal-title":"Graph. Models"},{"key":"ref_39","first-page":"885","article-title":"SIFT based automatic registration of remotely-sensed imagery","volume":"10","author":"Li","year":"2006","journal-title":"J. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/8\/1228\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:16:43Z","timestamp":1760195803000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/8\/1228"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,8,5]]},"references-count":39,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2018,8]]}},"alternative-id":["rs10081228"],"URL":"https:\/\/doi.org\/10.3390\/rs10081228","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2018,8,5]]}}}