{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T09:59:11Z","timestamp":1773827951945,"version":"3.50.1"},"reference-count":61,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2021,6,7]],"date-time":"2021-06-07T00:00:00Z","timestamp":1623024000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61806154"],"award-info":[{"award-number":["61806154"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"the National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61801345"],"award-info":[{"award-number":["61801345"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"the Natural Science Basic Research Program in Shaanxi Province of China","award":["2020JQ-307"],"award-info":[{"award-number":["2020JQ-307"]}]},{"name":"the Fundamental Research Funds for the Central Universities","award":["JBF211903"],"award-info":[{"award-number":["JBF211903"]}]},{"name":"the China Postdoctoral Science Foundation Funded Project","award":["2019M653565"],"award-info":[{"award-number":["2019M653565"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>SAR image registration is a crucial problem in SAR image processing since the registration results with high precision are conducive to improving the quality of other problems, such as change detection of SAR images. Recently, for most DL-based SAR image registration methods, the problem of SAR image registration has been regarded as a binary classification problem with matching and non-matching categories to construct the training model, where a fixed scale is generally set to capture pair image blocks corresponding to key points to generate the training set, whereas it is known that image blocks with different scales contain different information, which affects the performance of registration. Moreover, the number of key points is not enough to generate a mass of class-balance training samples. Hence, we proposed a new method of SAR image registration that meanwhile utilizes the information of multiple scales to construct the matching models. Specifically, considering that the number of training samples is small, deep forest was employed to train multiple matching models. Moreover, a multi-scale fusion strategy is proposed to integrate the multiple predictions and obtain the best pair matching points between the reference image and the sensed image. Finally, experimental results on four datasets illustrate that the proposed method is better than the compared state-of-the-art methods, and the analyses for different scales also indicate that the fusion of multiple scales is more effective and more robust for SAR image registration than one single fixed scale.<\/jats:p>","DOI":"10.3390\/rs13112227","type":"journal-article","created":{"date-parts":[[2021,6,7]],"date-time":"2021-06-07T22:23:00Z","timestamp":1623104580000},"page":"2227","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Multi-Scale Fused SAR Image Registration Based on Deep Forest"],"prefix":"10.3390","volume":"13","author":[{"given":"Shasha","family":"Mao","sequence":"first","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinyuan","family":"Yang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2619-6481","authenticated-orcid":false,"given":"Shuiping","family":"Gou","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Licheng","family":"Jiao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tao","family":"Xiong","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, International Research Center for Intelligent Perception and Computation, Joint International Research Laboratory of Intelligent Perception and Computation, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lin","family":"Xiong","sequence":"additional","affiliation":[{"name":"JD Finance America Corporation, 675 E Middlefield Rd, Mountain View, CA 94043, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,6,7]]},"reference":[{"key":"ref_1","unstructured":"Bao, Z., Xing, M.D., and Wang, T. (2005). Radar Imaging Technology, Publishing House of Electronics Industry."},{"key":"ref_2","unstructured":"Maitre, H. (2013). Processing of Synthetic Aperture Radar Images, ISTE."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.isprsjprs.2012.09.010","article-title":"A review of eo image information mining","volume":"75","author":"Quartulli","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"38544","DOI":"10.1109\/ACCESS.2018.2853100","article-title":"Multi-temporal remote sensing image registration using deep convolutional features","volume":"6","author":"Yang","year":"2018","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2114","DOI":"10.1109\/TGRS.2009.2012407","article-title":"Unsupervised change detection from multichannel sar data by markovian data fusion","volume":"47","author":"Moser","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"609","DOI":"10.1109\/JPROC.2012.2197169","article-title":"A novel framework for the design of change-detection systems for very-high-resolution remote sensing images","volume":"101","author":"Bruzzone","year":"2013","journal-title":"Proc. IEEE"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1109\/LGRS.2016.2554606","article-title":"Unsupervised sar image change detection based on sift keypoints and region information","volume":"13","author":"Wang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2900","DOI":"10.1109\/TGRS.2011.2113351","article-title":"High-resolution optical and sar image fusion for building database updating","volume":"49","author":"Poulain","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2212","DOI":"10.1109\/JSTARS.2013.2272773","article-title":"An area-based image fusion scheme for the integration of sar and optical satellite imagery","volume":"6","author":"Byun","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"5729","DOI":"10.1109\/TGRS.2016.2571309","article-title":"Fast and accurate target detection based on multiscale saliency and active contour model for high-resolution sar images","volume":"54","author":"Tu","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1925","DOI":"10.1109\/LGRS.2016.2618604","article-title":"A modified cfar algorithm based on object proposals for ship target detection in sar images","volume":"13","author":"Dai","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"902","DOI":"10.1109\/LGRS.2018.2885196","article-title":"A modified cartesian factorized back-projection algorithm for highly squint spotlight synthetic aperture radar imaging","volume":"16","author":"Luo","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/LGRS.2014.2353674","article-title":"Medium-earth-orbit sar focusing using range doppler algorithm with integrated two-step azimuth perturbation","volume":"12","author":"Huang","year":"2015","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1109\/TNNLS.2020.2978017","article-title":"Video sar imaging based on low-rank tensor recovery","volume":"32","author":"Pu","year":"2021","journal-title":"IEEE Trans. Neural Netw. Learn. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"6390","DOI":"10.1109\/TGRS.2017.2727060","article-title":"A 2-d space-variant motion estimation and compensation method for ultrahigh-resolution airborne stepped-frequency sar with long integration time","volume":"55","author":"Chen","year":"2017","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2232","DOI":"10.1109\/TIP.2021.3051484","article-title":"Deep sar imaging and motion compensation","volume":"30","author":"Wei","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1080\/01431160902927622","article-title":"Applicability of the si ft operator to geometric sar image registration","volume":"31","author":"Schwind","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1109\/LGRS.2011.2177437","article-title":"Bfsift: A novel method to find feature matches for sar image registration","volume":"9","author":"Wang","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_19","first-page":"15","article-title":"Research on methods of image registration","volume":"46","author":"Liang","year":"2010","journal-title":"Image Technol."},{"key":"ref_20","first-page":"63","article-title":"Review of SAR image registration methods","volume":"5","author":"Xu","year":"2013","journal-title":"Geospat. Inf."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"581","DOI":"10.3390\/rs9060581","article-title":"Remote sensing image registration using multiple image features","volume":"9","author":"Kun","year":"2017","journal-title":"Remote Sens."},{"key":"ref_22","first-page":"307","article-title":"Research of automated image registration technique for infrared images based on optical flow field analysis","volume":"22","author":"Zhang","year":"2003","journal-title":"J. Infrared Millim. Waves."},{"key":"ref_23","first-page":"1","article-title":"Guided locality preserving feature matching for remote sensing image registration","volume":"5","author":"Ma","year":"2018","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1109\/LGRS.2011.2166752","article-title":"A fast offset estimation approach for insar image subpixel registration","volume":"9","author":"Li","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Sarvaiya, J.N., Patnaik, S., and Bombaywala, S. (2009, January 28\u201329). Image Registration by Template Matching Using Normalized Cross-Correlation. Proceedings of the 2009 International Conference on Advances in Computing, Control, and Telecommunication Technologies, Bangalore, India.","DOI":"10.1109\/ACT.2009.207"},{"key":"ref_26","first-page":"51","article-title":"Mutual information as a similarity measure for remote sensing image registration","volume":"4383","author":"Johnson","year":"2001","journal-title":"Proc. SPIE Int. Soc. Opt. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Averbuch, A., and Keller, Y. (2002, January 15\u201318). FFT based image registration. Proceedings of the IEEE International Conference on Acoustics, Dubrovnik, Croatia.","DOI":"10.1109\/ICASSP.2002.5745436"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"2445","DOI":"10.1109\/TGRS.2003.817664","article-title":"Performance of mutual information similarity measure for registration of multitemporal remote sensing images","volume":"41","author":"Chen","year":"2003","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, Y., Yu, Q., and Yu, W. (2012, January 22\u201327). An improved Normalized Cross Correlation algorithm for SAR image registration. Proceedings of the Geoscience and Remote Sensing Symposium, Munich, Germany.","DOI":"10.1109\/IGARSS.2012.6350961"},{"key":"ref_30","unstructured":"Harris, C., and Stephens, M. (September, January 31). A combined corner and edge detector. Proceedings of the Alvey Vision Conference, Manchester, UK."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1023\/B:VISI.0000029664.99615.94","article-title":"Sift\u2014The scale invariant feature transform","volume":"2","author":"Lowe","year":"2004","journal-title":"Int. J. Comput. Vis."},{"key":"ref_32","unstructured":"Ke, Y., and Sukthankar, R. (July, January 27). PCA-SIFT: A more distinctive representation for local image descriptors. Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition\u2014CVPR 2004, Washington, DC, USA."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"Sar-sift: A sift-like algorithm for sar images","volume":"53","author":"Dellinger","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_34","first-page":"62","article-title":"Modular representation of layered neural networks","volume":"13","author":"Watanabe","year":"2017","journal-title":"Neural Netw."},{"key":"ref_35","first-page":"472","article-title":"A survey of computer vision-based human motion capture","volume":"16","author":"Thomas","year":"2001","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Guo, Y., Sun, Z., Qu, R., Jiao, L., and Zhang, X. (2020). Fuzzy superpixels based semi-supervised similarity-constrained cnn for polsar image classification. Remote Sens., 12.","DOI":"10.3390\/rs12101694"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Rostami, M., Kolouri, S., Eaton, E., and Kim, K. (2019). Deep transfer learning for few-shot sar image classification. Remote Sens., 11.","DOI":"10.20944\/preprints201905.0030.v1"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Krestenitis, M., Orfanidis, G., Ioannidis, K., Avgerinakis, K., and Kompatsiaris, I. (2019). Oil spill identification from satellite images using deep neural networks. Remote Sens., 11.","DOI":"10.3390\/rs11151762"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Haas, J., and Rabus, B. (2021). Uncertainty Estimation for Deep Learning-Based Segmentation of Roads in Synthetic Aperture Radar Imagery. Remote Sens., 13.","DOI":"10.3390\/rs13081472"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"3028","DOI":"10.1109\/JSTARS.2019.2916560","article-title":"Registration of multimodal remote sensing image based on deep fully convolutional neural network","volume":"12","author":"Zhang","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zagoruyko, S., and Komodakis, N. (2015, January 7\u201312). Learning to Compare Image Patches Via Convolutional Neural Networks. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.","DOI":"10.1109\/CVPR.2015.7299064"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.isprsjprs.2017.12.012","article-title":"A deep learning framework for remote sensing image registration","volume":"145","author":"Wang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_43","unstructured":"Han, X., Leung, T., Jia, Y., Sukthankar, R., and Berg, A.C. (2015). MatchNet: Unifying feature and metric learning for patch-based matching. Comput. Vis. Pattern Recognit., 3325\u20133337."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H., and Feng, J. (2017). Deep Forest: Towards an Alternative to Deep Neural Networks. arXiv.","DOI":"10.24963\/ijcai.2017\/497"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1007\/s11704-019-8208-z","article-title":"A survey on ensemble learning","volume":"14","author":"Dong","year":"2020","journal-title":"Front. Comput. Sci."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Zhou, Z.H. (2012). Ensemble Methods: Foundations and Algorithms, Taylor Francis.","DOI":"10.1201\/b12207"},{"key":"ref_48","first-page":"1","article-title":"End-to-end ensemble learning by exploiting the correlation between individuals and weights","volume":"51","author":"Mao","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Mao, S., Chen, J.W., Jiao, L., Gou, S., and Wang, R. (2019). Maximizing diversity by transformed ensemble learning. Appl. Soft Comput., 82.","DOI":"10.1016\/j.asoc.2019.105580"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1823","DOI":"10.1080\/01431161.2011.602651","article-title":"Applying tree-based ensemble algorithms to the classification of ecological zones using multi-temporal multi-source remote-sensing data","volume":"33","author":"Miao","year":"2012","journal-title":"Int. J. Remote Sens."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.rse.2011.12.003","article-title":"Random forest classification of mediterranean land cover using multi-seasonal imagery and multi-seasonal texture","volume":"121","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.foreco.2012.05.010","article-title":"Use of random forests for modeling and mapping forest canopy fuels for fire behavior analysis in Lassen Volcanic National Park, California, USA-ScienceDirect","volume":"279","author":"Pierce","year":"2012","journal-title":"For. Ecol. Manag."},{"key":"ref_53","first-page":"1","article-title":"Polarimetric SAR image classification using multi-features combination and extremely randomized clustering forests","volume":"2010","author":"Zou","year":"2010","journal-title":"Eurasip J. Adv. Signal Process."},{"key":"ref_54","unstructured":"Ma, W.P., Yang, H., Wu, Y., Jiao, L.C., and Chen, X.B. (2018). A SAR Image Change Detection Method Based on Deep Forest. [Master\u2019s Thesis, Xidian University]."},{"key":"ref_55","first-page":"819","article-title":"Normalized cross correlation","volume":"28","author":"Ranjan","year":"1995","journal-title":"Image Process."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1145\/358669.358692","article-title":"Random sample consensus","volume":"6","author":"Fischler","year":"1981","journal-title":"Commun. ACM"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/LGRS.2008.2012441","article-title":"Measures for an objective evaluation of the geometric correction process quality","volume":"6","author":"Goncalves","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1109\/LGRS.2016.2600858","article-title":"Remote sensing image registration with modified sift and enhanced feature matching","volume":"14","author":"Ma","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Rocco, I., Arandjelovi\u0107, R., and Sivic, J. (2020, January 23\u201328). Efficient neighbourhood consensus networks via submanifold sparse convolutions. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58545-7_35"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1109\/LGRS.2009.2025059","article-title":"Unsupervised change detection in satellite images using principal component analysis and k-means clustering","volume":"6","author":"Celik","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1016\/0895-4356(88)90031-5","article-title":"A reappraisal of the kappa coefficient","volume":"41","author":"Thompson","year":"1988","journal-title":"J. Clin. Epidemiol."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/11\/2227\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:11:40Z","timestamp":1760163100000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/11\/2227"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,7]]},"references-count":61,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["rs13112227"],"URL":"https:\/\/doi.org\/10.3390\/rs13112227","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,6,7]]}}}