{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T18:46:34Z","timestamp":1761677194939,"version":"build-2065373602"},"reference-count":46,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,6,4]],"date-time":"2023-06-04T00:00:00Z","timestamp":1685836800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"State Key Program of National Natural Science of China","award":["62234010","61806154","62102296","2019M653565","2022JQ-661"],"award-info":[{"award-number":["62234010","61806154","62102296","2019M653565","2022JQ-661"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62234010","61806154","62102296","2019M653565","2022JQ-661"],"award-info":[{"award-number":["62234010","61806154","62102296","2019M653565","2022JQ-661"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"China Postdoctoral Science Foundation Funded Project","award":["62234010","61806154","62102296","2019M653565","2022JQ-661"],"award-info":[{"award-number":["62234010","61806154","62102296","2019M653565","2022JQ-661"]}]},{"DOI":"10.13039\/501100007128","name":"Natural Science Foundation of Shaanxi Province","doi-asserted-by":"publisher","award":["62234010","61806154","62102296","2019M653565","2022JQ-661"],"award-info":[{"award-number":["62234010","61806154","62102296","2019M653565","2022JQ-661"]}],"id":[{"id":"10.13039\/501100007128","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In SAR image registration, most existing methods consider the image registration as a two-classification problem to construct the pair training samples for training the deep model. However, it is difficult to obtain a mass of given matched-points directly from SAR images as the training samples. Based on this, we propose a multi-class double-transformation network for SAR image registration based on Swin-Transformer. Different from existing methods, the proposed method directly considers each key point as an independent category to construct the multi-classification model for SAR image registration. Then, based on the key points from the reference and sensed images, respectively, a double-transformation network with two branches is designed to search for matched-point pairs. In particular, to weaken the inherent diversity between two SAR images, key points from one image are transformed to the other image, and the transformed image is used as the basic image to capture sub-images corresponding to all key points as the training and testing samples. Moreover, a precise-matching module is designed to increase the reliability of the obtained matched-points by eliminating the inconsistent matched-point pairs given by two branches. Finally, a series of experiments illustrate that the proposed method can achieve higher registration performance compared to existing methods.<\/jats:p>","DOI":"10.3390\/rs15112927","type":"journal-article","created":{"date-parts":[[2023,6,5]],"date-time":"2023-06-05T02:18:29Z","timestamp":1685931509000},"page":"2927","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Multi-Class Double-Transformation Network for SAR Image Registration"],"prefix":"10.3390","volume":"15","author":[{"given":"Xiaozheng","family":"Deng","sequence":"first","affiliation":[{"name":"Chinese Flight Test Establishment, Xi\u2019an 710089, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shasha","family":"Mao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinyuan","family":"Yang","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shiming","family":"Lu","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2619-6481","authenticated-orcid":false,"given":"Shuiping","family":"Gou","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Youming","family":"Zhou","sequence":"additional","affiliation":[{"name":"Chinese Flight Test Establishment, Xi\u2019an 710089, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Licheng","family":"Jiao","sequence":"additional","affiliation":[{"name":"Key Laboratory of Intelligent Perception and Image Understanding of Ministry of Education, School of Artificial Intelligence, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,6,4]]},"reference":[{"key":"ref_1","unstructured":"Fitch, J.P. (2012). Synthetic Aperture Radar, Springer Science & Business Media."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1007\/s11069-014-1122-7","article-title":"Mapping and monitoring geological hazards using optical, LiDAR, and synthetic aperture RADAR image data","volume":"73","author":"Joyce","year":"2014","journal-title":"Nat. Hazards"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.isprsjprs.2012.09.010","article-title":"A review of EO image information mining","volume":"75","author":"Quartulli","year":"2013","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1109\/LGRS.2016.2554606","article-title":"Unsupervised sar image change detection based on sift keypoints and region information","volume":"13","author":"Wang","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2900","DOI":"10.1109\/TGRS.2011.2113351","article-title":"High-resolution optical and SAR image fusion for building database updating","volume":"49","author":"Poulain","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2212","DOI":"10.1109\/JSTARS.2013.2272773","article-title":"An Area-Based Image Fusion Scheme for the Integration of SAR and Optical Satellite Imagery","volume":"6","author":"Byun","year":"2013","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"2114","DOI":"10.1109\/TGRS.2009.2012407","article-title":"Unsupervised Change Detection from Multichannel SAR Data by Markovian Data Fusion","volume":"47","author":"Moser","year":"2009","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"5729","DOI":"10.1109\/TGRS.2016.2571309","article-title":"Fast and Accurate Target Detection Based on Multiscale Saliency and Active Contour Model for High-Resolution SAR Images","volume":"54","author":"Song","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Giusti, E., Ghio, S., Oveis, A.H., and Martorella, M. (2022). Proportional Similarity-Based Openmax Classifier for Open Set Recognition in SAR Images. Remote Sens., 14.","DOI":"10.3390\/rs14184665"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1959","DOI":"10.1080\/01431160902927622","article-title":"Applicability of the sift operator to geometric sar image registration","volume":"31","author":"Schwind","year":"2010","journal-title":"Int. J. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1109\/LGRS.2011.2177437","article-title":"Bfsift: A novel method to find feature matches for sar image registration","volume":"9","author":"Wang","year":"2012","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.isprsjprs.2017.12.012","article-title":"A deep learning framework for remote sensing image registration","volume":"145","author":"Wang","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"453","DOI":"10.1109\/TGRS.2014.2323552","article-title":"SAR-SIFT: A SIFT-Like Algorithm for SAR Images","volume":"53","author":"Dellinger","year":"2015","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"242","DOI":"10.1109\/LGRS.2017.2783879","article-title":"PSOSAC: Particle Swarm Optimization Sample Consensus Algorithm for Remote Sensing Image Registration","volume":"15","author":"Wu","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5694","DOI":"10.1109\/JSTARS.2020.3024899","article-title":"Accelerating SAR Image Registration Using Swarm-Intelligent GPU Parallelization","volume":"13","author":"Liu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Mao, S., Yang, J., Gou, S., Jiao, L., Xiong, T., and Xiong, L. (2021). Multi-Scale Fused SAR Image Registration Based on Deep Forest. Remote Sens., 13.","DOI":"10.3390\/rs13112227"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Zhang, S., Sui, L., Zhou, R., Xun, Z., Du, C., and Guo, X. (2022). Mountainous SAR Image Registration Using Image Simulation and an L2E Robust Estimator. Sustainability, 14.","DOI":"10.3390\/su14159315"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"4328","DOI":"10.1109\/TGRS.2013.2281391","article-title":"A novel coarse-to-fine scheme for automatic image registration based on SIFT and mutual information","volume":"52","author":"Gong","year":"2013","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_19","first-page":"158","article-title":"Comparison of the ratio of the standard deviation of the RR interval and the root mean squared successive differences (SD\/rMSSD) to the low frequency-to-high frequency (LF\/HF) ratio in a patient population and normal healthy controls","volume":"43","author":"Sollers","year":"2007","journal-title":"Biomed. Sci. Instrum."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"4834","DOI":"10.1109\/TGRS.2019.2893310","article-title":"A Novel Two-Step Registration Method for Remote Sensing Images Based on Deep and Local Features","volume":"57","author":"Ma","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Quan, D., Wang, S., Ning, M., Xiong, T., and Jiao, L. (2016, January 10\u201315). Using deep neural networks for synthetic aperture radar image registration. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.","DOI":"10.1109\/IGARSS.2016.7729723"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1109\/LGRS.2017.2781741","article-title":"Remote sensing image registration using convolutional neural network features","volume":"15","author":"Ye","year":"2018","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Mu, J., Gou, S., Mao, S., and Zheng, S. (2021, January 21\u201325). A Stepwise Matching Method for Multi-modal Image based on Cascaded Network. Proceedings of the 29th ACM International Conference on Multimedia, Nice, France.","DOI":"10.1145\/3474085.3475644"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5201115","DOI":"10.1109\/TGRS.2022.3231904","article-title":"Self-Supervised SAR Image Registration With SAR-Superpoint and Transformation Aggregation","volume":"61","author":"Zou","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"5203715","DOI":"10.1109\/TGRS.2023.3246964","article-title":"Adaptive Self-Supervised SAR Image Registration with Modifications of Alignment Transformation","volume":"61","author":"Mao","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1016\/j.neucom.2021.03.091","article-title":"A review on the attention mechanism of deep learning","volume":"452","author":"Niu","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1145\/3465055","article-title":"An attentive survey of attention models","volume":"12","author":"Chaudhari","year":"2021","journal-title":"ACM Trans. Intell. Syst. Technol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Kim, Y., Lee, J., Lee, E.B., and Lee, J.H. (2020, January 4\u20135). Application of Natural Language Processing (NLP) and Text-Mining of Big-Data to Engineering-Procurement-Construction (EPC) Bid and Contract Documents. Proceedings of the 6th Conference on Data Science and Machine Learning Applications (CDMA), Riyadh, Saudi Arabia.","DOI":"10.1109\/CDMA47397.2020.00027"},{"key":"ref_29","unstructured":"Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhudinov, R., Zemel, R., and Bengio, Y. (2015, January 6\u201311). Show, attend and tell: Neural image caption generation with visual attention. Proceedings of the International Conference on Machine Learning, Lille, France."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Guo, H., Zheng, K., Fan, X., Yu, H., and Wang, S. (2019, January 15\u201320). Visual attention consistency under image transforms for multi-label image classification. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00082"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"8065","DOI":"10.1109\/TGRS.2019.2918080","article-title":"Visual attention-driven hyperspectral image classification","volume":"57","author":"Haut","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"11307","DOI":"10.1038\/s41598-020-67529-x","article-title":"Object detection based on an adaptive attention mechanism","volume":"10","author":"Li","year":"2020","journal-title":"Sci. Rep."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1109\/TIP.2018.2865280","article-title":"Attention CoupleNet: Fully convolutional attention coupling network for object detection","volume":"28","author":"Zhu","year":"2018","journal-title":"IEEE Trans. Image Process."},{"key":"ref_34","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, \u0141., and Polosukhin, I. (2017, January 4\u20139). Attention is all you need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA."},{"key":"ref_35","unstructured":"Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2018). Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1109\/TPAMI.2022.3152247","article-title":"A Survey on Vision Transformer","volume":"45","author":"Han","year":"2023","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Dai, Z., Yang, Z., Yang, Y., Carbonell, J., Le, Q.V., and Salakhutdinov, R. (2019). Transformer-xl: Attentive language models beyond a fixed-length context. arXiv.","DOI":"10.18653\/v1\/P19-1285"},{"key":"ref_38","unstructured":"Chen, J., Lu, Y., Yu, Q., Luo, X., Adeli, E., Wang, Y., Lu, L., Yuille, A.L., and Zhou, Y. (2021). Transunet: Transformers make strong encoders for medical image segmentation. arXiv."},{"key":"ref_39","unstructured":"Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 x 16 words: Transformers for image recognition at scale. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11\u201317). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00986"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"8","DOI":"10.9753\/icce.v17.8","article-title":"The measurement of incident and reflected spectra using a least squares method","volume":"17","author":"Mansard","year":"1980","journal-title":"Coast. Eng. Proc."},{"key":"ref_42","unstructured":"Hugo, T., Matthieu, C., Matthijs, D., Francisco, M., Alexandre, S., and Herv\u00e9, J. (2021, January 18\u201324). Training data-efficient image transformers & distillation through attention. Proceedings of the 38th International Conference on Machine Learning, PMLR, Virtual Event."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1109\/LGRS.2008.2012441","article-title":"Measures for an Objective Evaluation of the Geometric Correction Process Quality","volume":"6","author":"Goncalves","year":"2009","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_44","first-page":"1150","article-title":"Object recognition from local scale-invariant features","volume":"2","author":"Lowe","year":"1999","journal-title":"IEEE Int. Conf. Comput. Vis."},{"key":"ref_45","unstructured":"Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/11\/2927\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:47:54Z","timestamp":1760125674000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/11\/2927"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,4]]},"references-count":46,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,6]]}},"alternative-id":["rs15112927"],"URL":"https:\/\/doi.org\/10.3390\/rs15112927","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,6,4]]}}}