{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:06:17Z","timestamp":1760241977659,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2018,11,20]],"date-time":"2018-11-20T00:00:00Z","timestamp":1542672000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["No.61331016, No.41371342"],"award-info":[{"award-number":["No.61331016, No.41371342"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the National Key Research and Development Program of China","award":["No.2016YFC0803000"],"award-info":[{"award-number":["No.2016YFC0803000"]}]},{"name":"the Hubei Innovation Group","award":["2018CFA006"],"award-info":[{"award-number":["2018CFA006"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Automatic image registration of optical-to-Synthetic aperture radar (SAR) images is difficult because of the inconsistency of radiometric and geometric properties between the optical image and the SAR image. The intensity-based methods may require many calculations and be ineffective when there are geometric distortions between these two images. The feature-based methods have high requirements on features, and there are certain challenges in feature extraction and matching. A new automatic optical-to-SAR image registration framework is proposed in this paper. First, modified holistically nested edge detection is employed to detect the main contours in both the optical and SAR images. Second, a mesh grid strategy is presented to perform a coarse-to-fine registration. The coarse registration calculates the feature matching and summarizes the preliminary results for the fine registration process. Finally, moving direct linear transformation is introduced to perform a homography warp to alleviate parallax. The experimental results show the effectiveness and accuracy of our proposed method.<\/jats:p>","DOI":"10.3390\/rs10111837","type":"journal-article","created":{"date-parts":[[2018,11,21]],"date-time":"2018-11-21T11:23:27Z","timestamp":1542799407000},"page":"1837","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A Point Pattern Chamfer Registration of Optical and SAR Images Based on Mesh Grids"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3662-5769","authenticated-orcid":false,"given":"Chu","family":"He","sequence":"first","affiliation":[{"name":"Electronic and Information School, Wuhan University, Wuhan 430072, China"},{"name":"State Key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"}]},{"given":"Peizhang","family":"Fang","sequence":"additional","affiliation":[{"name":"Electronic and Information School, Wuhan University, Wuhan 430072, China"}]},{"given":"Dehui","family":"Xiong","sequence":"additional","affiliation":[{"name":"Electronic and Information School, Wuhan University, Wuhan 430072, China"}]},{"given":"Wenwei","family":"Wang","sequence":"additional","affiliation":[{"name":"Electronic and Information School, Wuhan University, Wuhan 430072, China"}]},{"given":"Mingsheng","family":"Liao","sequence":"additional","affiliation":[{"name":"State Key Laboratory for Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China"},{"name":"Collaborative Innovation Center for Geospatial Technology, 129 Luoyu Road, Wuhan 430079, China"}]}],"member":"1968","published-online":{"date-parts":[[2018,11,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/146370.146374","article-title":"A survey of image registration techniques","volume":"24","author":"Brown","year":"1992","journal-title":"ACM Comput. Surv."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"5357","DOI":"10.1109\/JSTARS.2016.2617120","article-title":"Evaluating moisture and geometry effects on L-band SAR classification performance over a tropical rain forest environment","volume":"9","author":"Liesenberg","year":"2016","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3345","DOI":"10.1080\/01431161.2015.1054960","article-title":"Detection of environmental hazards through the feature-based fusion of optical and SAR data: A case study in southern Italy","volume":"36","author":"Errico","year":"2015","journal-title":"Int. J. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Zhang, G., Sui, H., Song, Z., Hua, F., and Hua, L. (2017, January 17\u201319). Automatic Registration Method of SAR and Optical Image Based on Line Features and Spectral Graph Theory. Proceedings of the International Conference on Multimedia and Image Processing, Wuhan, China.","DOI":"10.1109\/ICMIP.2017.49"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"7219","DOI":"10.1080\/01431161.2014.967887","article-title":"A new affine invariant feature extraction method for SAR image registration","volume":"35","author":"Yang","year":"2014","journal-title":"Int. J. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1109\/TGRS.2009.2034842","article-title":"Mutual-Information-Based Registration of TerraSAR-X and Ikonos Imagery in Urban Areas","volume":"48","author":"Suri","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Hasan, M., Pickering, M.R., and Jia, X. (2009, January 1\u20133). Multi-modal registration of SAR and optical satellite images. Proceedings of the Digital Image Computing: Techniques and Applications, Melbourne, VIC, Australia.","DOI":"10.1109\/DICTA.2009.77"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"119","DOI":"10.5194\/isprsannals-II-3-W4-119-2015","article-title":"A new approach for optical and sar satellite image registration","volume":"2","author":"Merkle","year":"2015","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1115","DOI":"10.1109\/TIP.2004.828435","article-title":"A maximum likelihood approach for image registration using control point and intensity","volume":"13","author":"Li","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_10","unstructured":"Cheah, T.C., Shanmugam, S.A., and Mann, K.A.L. (2012, January 27\u201328). Medical image registration by maximizing mutual information based on combination of intensity and gradient information. Proceedings of the 2012 International Conference on Biomedical Engineering (ICoBE), Penang, Malaysia."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1495","DOI":"10.1109\/TIP.2003.819237","article-title":"Multiresolution registration of remote sensing imagery by optimization of mutual information using a stochastic gradient","volume":"12","author":"Johnson","year":"2003","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","unstructured":"Li, Z., and Leung, H. (2007, January 9\u201312). Contour-based multisensor image registration with rigid transformation. Proceedings of the 2007 10th International Conference on Information Fusion, Quebec, QC, Canada."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"3701","DOI":"10.1080\/0143116031000117047","article-title":"Mutual information-based image registration for remote sensing data","volume":"24","author":"Arora","year":"2003","journal-title":"Int. J. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Saidi, F., Chen, J., and Wang, P. (2017, January 13\u201315). A refined automatic co-registration method for high-resolution optical and sar images by maximizing mutual information. Proceedings of the IEEE International Conference on Signal and Image Processing, Beijing, China.","DOI":"10.1109\/SIPROCESS.2016.7888258"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"4328","DOI":"10.1109\/TGRS.2013.2281391","article-title":"A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information","volume":"52","author":"Gong","year":"2014","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Distinctive Image Features from Scale-Invariant Keypoints","volume":"60","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1109\/LGRS.2012.2216500","article-title":"Registration of optical and SAR satellite images by exploring the spatial relationship of the improved SIFT","volume":"10","author":"Fan","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"SAR-SIFT: A SIFT-Like Algorithm for SAR Images","volume":"53","author":"Dellinger","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1080\/01431160902927622","article-title":"Applicability of the SIFT operator to geometric SAR image registration","volume":"31","author":"Schwind","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1109\/LGRS.2011.2177437","article-title":"BFSIFT: A Novel Method to Find Feature Matches for SAR Image Registration","volume":"9","author":"Wang","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1109\/LGRS.2014.2330593","article-title":"Adapted Anisotropic Gaussian SIFT Matching Strategy for SAR Registration","volume":"12","author":"Wang","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_22","first-page":"562","article-title":"SAR Image Registration Using Phase Congruency and Nonlinear Diffusion-Based SIFT","volume":"12","author":"Fan","year":"2014","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1426","DOI":"10.1109\/LGRS.2015.2406336","article-title":"A Uniform SIFT-Like Algorithm for SAR Image Registration","volume":"12","author":"Wang","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Wang, F., Wan, L., and You, H. (2017). An Advanced Rotation Invariant Descriptor for SAR Image Registration. Remote Sens., 9.","DOI":"10.3390\/rs9070686"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2169","DOI":"10.1080\/01431161003621585","article-title":"Feature-based image registration using the shape context","volume":"31","author":"Huang","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_26","unstructured":"Li, H., Manjunath, B.S., and Mitra, S.K. (1995). A Contour-Based Approach to Multisensor Image Registration, IEEE Press."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1080\/01431160701294687","article-title":"Multisource data registration based on NURBS description of contours","volume":"29","author":"Pan","year":"2008","journal-title":"Int. J. Remote Sens."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/S0924-2716(01)00031-4","article-title":"An improved model for automatic feature-based registration of SAR and SPOT images","volume":"56","author":"Dare","year":"2001","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"679","DOI":"10.1109\/TPAMI.1986.4767851","article-title":"A Computational Approach to Edge Detection","volume":"PAMI-8","author":"Canny","year":"1986","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"35","DOI":"10.5201\/ipol.2012.gjmr-lsd","article-title":"LSD: A line segment detector","volume":"2","author":"Gioi","year":"2012","journal-title":"Image Process. Line"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1109\/36.673672","article-title":"An optimal multiedge detector for SAR image segmentation","volume":"36","author":"Fjortoft","year":"1998","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1661","DOI":"10.1109\/LGRS.2016.2600704","article-title":"Edge Detector for Polarimetric SAR Images Using SIRV Model and Gauss-Shaped Filter","volume":"13","author":"Xiang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Liu, J., Scott, K.A., Gawish, A., and Fieguth, P. (2016). Automatic Detection of the Ice Edge in SAR Imagery Using Curvelet Transform and Active Contour. Remote Sens., 8.","DOI":"10.3390\/rs8060480"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s11263-017-1004-z","article-title":"Holistically-Nested Edge Detection","volume":"125","author":"Xie","year":"2015","journal-title":"Int. J. Comput. Vis."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"603","DOI":"10.1109\/TGRS.2013.2242895","article-title":"Automatic Registration of Multisensor Images Using an Integrated Spatial and Mutual Information (SMI) Metric","volume":"52","author":"Liang","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1109\/LGRS.2015.2507982","article-title":"Feature-Area Optimization: A Novel SAR Image Registration Method","volume":"13","author":"Liu","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Xiang, Y., Wang, F., and You, H. (2018). An Automatic and Novel SAR Image Registration Algorithm: A Case Study of the Chinese GF-3 Satellite. Sensors, 18.","DOI":"10.3390\/s18020672"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Xiong, B., Li, W., Zhao, L., Lu, J., Zhang, X., and Kuang, G. (2016, January 10\u201315). Registration for SAR and optical images based on straight line features and mutual information. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium, Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729667"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"4897","DOI":"10.1109\/JSTARS.2014.2341173","article-title":"A Union Matching Method for SAR Images Based on SIFT and Edge Strength","volume":"7","author":"Chen","year":"1939","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"706","DOI":"10.1109\/LGRS.2016.2539207","article-title":"SAR Image Registration Based on Multifeature Detection and Arborescence Network Matching","volume":"13","author":"Zhu","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"6058","DOI":"10.1109\/TGRS.2015.2431498","article-title":"Automatic Optical-to-SAR Image Registration by Iterative Line Extraction and Voronoi Integrated Spectral Point Matching","volume":"53","author":"Sui","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote Sensing Image Registration with Modified SIFT and Enhanced Feature Matching","volume":"14","author":"Ma","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Rui, J., Wang, C., Zhang, H., and Jin, F. (2016). Multi-Sensor SAR Image Registration Based on Object Shape. Remote Sens., 8.","DOI":"10.3390\/rs8110923"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"2869","DOI":"10.1109\/TGRS.2003.817226","article-title":"Automatic satellite image georeferencing using a contour-matching approach","volume":"41","author":"Eugenio","year":"2008","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Liu, M.Y., Tuzel, O., Veeraraghavan, A., and Chellappa, R. (2010, January 13\u201318). Fast directional chamfer matching. Proceedings of the 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, USA.","DOI":"10.1109\/CVPR.2010.5539837"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zaragoza, J., Chin, T.J., Tran, Q.H., Brown, M.S., and Suter, D. (2013, January 23\u201328). As-Projective-As-Possible Image Stitching with Moving DLT. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.303"},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Lin, W.Y., Liu, S., Matsushita, Y., and Ng, T.T. (2011, January 20\u201325). Smoothly varying affine stitching. Proceedings of the Computer Vision and Pattern Recognition, Colorado Springs, CO, USA.","DOI":"10.1109\/CVPR.2011.5995314"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/0031-3203(86)90030-0","article-title":"Minimum error thresholding","volume":"19","author":"Kittler","year":"1986","journal-title":"Pattern Recognit."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/S0924-2716(97)83001-8","article-title":"Quality assessment of remote sensing image registration-analysis and testing of control point residuals","volume":"52","author":"Buiten","year":"1997","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Bansal, M., and Daniilidis, K. (2013, January 23\u201328). Joint Spectral Correspondence for Disparate Image Matching. Proceedings of the Computer Vision and Pattern Recognition, Portland, OR, USA.","DOI":"10.1109\/CVPR.2013.361"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1109\/LGRS.2011.2163491","article-title":"Multilevel SIFT matching for large-size VHR image registration","volume":"9","author":"Huo","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1837\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T15:30:54Z","timestamp":1760196654000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/10\/11\/1837"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,11,20]]},"references-count":51,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2018,11]]}},"alternative-id":["rs10111837"],"URL":"https:\/\/doi.org\/10.3390\/rs10111837","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2018,11,20]]}}}