{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T15:47:05Z","timestamp":1772725625410,"version":"3.50.1"},"reference-count":56,"publisher":"MDPI AG","issue":"23","license":[{"start":{"date-parts":[[2023,11,30]],"date-time":"2023-11-30T00:00:00Z","timestamp":1701302400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key R&amp;D Program of China","award":["2018YFA0701900"],"award-info":[{"award-number":["2018YFA0701900"]}]},{"name":"National Key R&amp;D Program of China","award":["2018YFA0701901"],"award-info":[{"award-number":["2018YFA0701901"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>The efficiency and accuracy of target recognition in synthetic aperture radar (SAR) imagery have seen significant progress lately, stemming from the encouraging advancements of automatic target recognition (ATR) technology based on deep learning. However, the development of a deep learning-based SAR ATR algorithm still faces two critical challenges: the difficulty of feature extraction caused by the unique nature of SAR imagery and the scarcity of datasets caused by the high acquisition cost. Due to its desirable image nature and extremely low acquisition cost, the simulated optical target imagery obtained through computer simulation is considered a valuable complement to SAR imagery. In this study, a CycleGAN-based SAR and simulated optical image fusion network (SOIF-CycleGAN) is designed and demonstrated to mitigate the adverse effects of both challenges simultaneously through SAR-optical image bidirectional translation. SAR-to-optical (S2O) image translation produces artificial optical images that are high-quality and rich in details, which are used as supplementary information for SAR images to assist ATR. Conversely, optical-to-SAR (O2S) image translation generates pattern-rich artificial SAR images and provides additional training data for SAR ATR algorithms. Meanwhile, a new dataset of SAR-optical image pairs containing eight different types of aircraft has been created for training and testing SOIF-CycleGAN. By combining image-quality assessment (IQA) methods and human vision, the evaluation verified that the proposed network possesses exceptional bidirectional translation capability. Finally, the results of the S2O and O2S image translations are simultaneously integrated into a SAR ATR network, resulting in an overall accuracy improvement of 6.33%. This demonstrates the effectiveness of SAR-optical image fusion in enhancing the performance of SAR ATR.<\/jats:p>","DOI":"10.3390\/rs15235569","type":"journal-article","created":{"date-parts":[[2023,11,30]],"date-time":"2023-11-30T09:37:54Z","timestamp":1701337074000},"page":"5569","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["CycleGAN-Based SAR-Optical Image Fusion for Target Recognition"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8999-5515","authenticated-orcid":false,"given":"Yuchuang","family":"Sun","sequence":"first","affiliation":[{"name":"National Key Laboratory of Microwave Imaging Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronics, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-4271-9096","authenticated-orcid":false,"given":"Kaijia","family":"Yan","sequence":"additional","affiliation":[{"name":"National Key Laboratory of Microwave Imaging Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronics, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}]},{"given":"Wangzhe","family":"Li","sequence":"additional","affiliation":[{"name":"National Key Laboratory of Microwave Imaging Technology, Aerospace Information Research Institute, Chinese Academy of Sciences, Beijing 100190, China"},{"name":"School of Electronics, Electrical and Communication Engineering, University of Chinese Academy of Sciences, Beijing 100049, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,11,30]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Li, J., Yu, Z., Yu, L., Cheng, P., Chen, J., and Chi, C. (2023). A Comprehensive Survey on SAR ATR in Deep-Learning Era. Remote Sens., 15.","DOI":"10.3390\/rs15051454"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Liu, L., and Lei, B. Can SAR Images and Optical Images Transfer with Each Other? In Proceedings of the IGARSS 2018\u20132018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain, 22\u201327 July 2018.","DOI":"10.1109\/IGARSS.2018.8518921"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Fuentes Reyes, M., Auer, S., Merkle, N., Henry, C., and Schmitt, M. (2019). SAR-to-Optical Image Translation Based on Conditional Generative Adversarial Networks Optimization, Opportunities and Limits. Remote Sens., 11.","DOI":"10.3390\/rs11172067"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"108208","DOI":"10.1016\/j.patcog.2021.108208","article-title":"SAR-to-optical image translation based on improved CGAN","volume":"121","author":"Yang","year":"2022","journal-title":"Pattern Recognit."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Sun, Y., Jiang, W., Yang, J., and Li, W. (2022). SAR Target Recognition Using cGAN-Based SAR-to-Optical Image Translation. Remote Sens., 14.","DOI":"10.3390\/rs14081793"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative adversarial networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Gao, F., Yang, Y., Wang, J., Sun, J., Yang, E., and Zhou, H. (2018). A Deep Convolutional Generative Adversarial Networks (DCGANs)-Based Semi-Supervised Method for Object Recognition in Synthetic Aperture Radar (SAR) Images. Remote Sens., 10.","DOI":"10.3390\/rs10060846"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Liu, W., Zhao, Y., Liu, M., Dong, L., Liu, X., and Hui, M. (2018, January 17). Generating simulated sar images using generative adversarial network. Proceedings of the Applications of Digital Image Processing XLI. International Society for Optics and Photonics, San Diego, CA, USA.","DOI":"10.1117\/12.2320024"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xie, D., Ma, J., Li, Y., and Liu, X. (2021, January 18\u201320). Data Augmentation of Sar Sensor Image via Information Maximizing Generative Adversarial Net. Proceedings of the 2021 IEEE 4th International Conference on Electronic Information and Communication Technology (ICEICT), Xi\u2019an, China.","DOI":"10.1109\/ICEICT53123.2021.9531250"},{"key":"ref_10","first-page":"1","article-title":"Learning to Generate SAR Images With Adversarial Autoencoder","volume":"60","author":"Song","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"107528","DOI":"10.1016\/j.sigpro.2020.107528","article-title":"Deceptive jamming template synthesis for SAR based on generative adversarial nets","volume":"172","author":"Fan","year":"2020","journal-title":"Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4806","DOI":"10.1109\/TGRS.2016.2551720","article-title":"Target Classification Using the Deep Convolutional Networks for SAR Images","volume":"54","author":"Chen","year":"2016","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","first-page":"3","article-title":"An overview of automatic target recognition","volume":"6","author":"Dudgeon","year":"1993","journal-title":"Linc. Lab. J."},{"key":"ref_14","unstructured":"Keydel, E.R., Lee, S.W., and Moore, J.T. (1996, January 10). MSTAR extended operating conditions: A tutorial. Proceedings of the Algorithms for Synthetic Aperture Radar Imagery III. International Society for Optics and Photonics, Orlando, FL, USA."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1109\/7.937475","article-title":"Support vector machines for SAR automatic target recognition","volume":"37","author":"Zhao","year":"2001","journal-title":"IEEE Trans. Aerosp. Electron. Syst."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1016\/S0262-8856(03)00057-X","article-title":"Genetic algorithm based feature selection for target detection in SAR images","volume":"21","author":"Bhanu","year":"2003","journal-title":"Image Vis. Comput."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Mishra, A.K., and Motaung, T. (2015, January 21\u201322). Application of linear and nonlinear PCA to SAR ATR. Proceedings of the 2015 25th International Conference Radioelektronika (RADIOELEKTRONIKA), Pardubice, Czech Republic.","DOI":"10.1109\/RADIOELEK.2015.7129065"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Majumder, U., Christiansen, E., Wu, Q., Inkawhich, N., Blasch, E., and Nehrbass, J. (2017, January 1). High-performance computing for automatic target recognition in synthetic aperture radar imagery. Proceedings of the Cyber Sensing 2017. International Society for Optics and Photonics, Anaheim, CA, USA.","DOI":"10.1117\/12.2263218"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"109402","DOI":"10.1016\/j.patcog.2023.109402","article-title":"Cross-task and cross-domain SAR target recognition: A meta-transfer learning approach","volume":"138","author":"Zhang","year":"2023","journal-title":"Pattern Recognit."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"195","DOI":"10.1109\/JSTARS.2017.2755672","article-title":"OpenSARShip: A dataset dedicated to Sentinel-1 ship interpretation","volume":"11","author":"Huang","year":"2017","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Li, B., Liu, B., Huang, L., Guo, W., Zhang, Z., and Yu, W. (2017, January 13\u201314). OpenSARShip 2.0: A large-volume dataset for deeper interpretation of ship targets in Sentinel-1 imagery. Proceedings of the 2017 SAR in Big Data Era: Models, Methods and Applications (BIGSARDATA), Beijing, China.","DOI":"10.1109\/BIGSARDATA.2017.8124929"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"140303","DOI":"10.1007\/s11432-019-2772-5","article-title":"FUSAR-Ship: Building a high-resolution SAR-AIS matchup dataset of Gaofen-3 for ship detection and recognition","volume":"63","author":"Hou","year":"2020","journal-title":"Sci. China Inform. Sci."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, L., Pan, Z., Qiu, X., and Peng, L. (2018, January 22\u201327). SAR Target Classification with CycleGAN Transferred Simulated Samples. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8517866"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"5226517","DOI":"10.1109\/TGRS.2022.3166174","article-title":"SCAN: Scattering characteristics analysis network for few-shot aircraft classification in high-resolution SAR images","volume":"60","author":"Sun","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Pohl, C., and Van Genderen, J. (2016). Remote Sensing Image Fusion, CRC Press.","DOI":"10.1201\/9781315370101"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Merkle, N., Fischer, P., Auer, S., and Muller, R. (2017, January 23\u201328). On the possibility of conditional adversarial networks for multi-sensor image matching. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8127535"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Enomoto, K., Sakurada, K., Wang, W., Kawaguchi, N., Matsuoka, M., and Nakamura, R. (2018, January 22\u201327). Image Translation Between Sar and Optical Imagery with Generative Adversarial Nets. Proceedings of the IGARSS 2018\u20142018 IEEE International Geoscience and Remote Sensing Symposium, Valencia, Spain.","DOI":"10.1109\/IGARSS.2018.8518719"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Schmitt, M., Hughes, L.H., and Zhu, X.X. (2018). The SEN1-2 Dataset for Deep Learning in SAR-Optical Data Fusion. arXiv.","DOI":"10.5194\/isprs-annals-IV-1-141-2018"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Zhang, J., Zhou, J., Li, M., Zhou, H., and Yu, T. (2020). Quality Assessment of SAR-to-Optical Image Translation. Remote Sens., 12.","DOI":"10.3390\/rs12213472"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Hwang, J., Yu, C., and Shin, Y. (2020, January 21\u201323). SAR-to-Optical Image Translation Using SSIM and Perceptual Loss Based Cycle-Consistent GAN. Proceedings of the 2020 International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Republic of Korea.","DOI":"10.1109\/ICTC49870.2020.9289381"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"60338","DOI":"10.1109\/ACCESS.2020.2977103","article-title":"A SAR-to-Optical Image Translation Method Based on Conditional Generation Adversarial Network (cGAN)","volume":"8","author":"Li","year":"2020","journal-title":"IEEE Access"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"5","DOI":"10.5194\/isprs-annals-IV-1-5-2018","article-title":"SAR to optical image synthesis for cloud removal with generative adversarial networks","volume":"4","author":"Bermudez","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1220","DOI":"10.1109\/LGRS.2019.2894734","article-title":"Synthesis of Multispectral Optical Images From SAR\/Optical Multitemporal Data Using Conditional Generative Adversarial Networks","volume":"16","author":"Bermudez","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"333","DOI":"10.1016\/j.isprsjprs.2020.05.013","article-title":"Cloud removal in Sentinel-2 imagery using a deep residual neural network and SAR-optical data fusion","volume":"166","author":"Meraner","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"5866","DOI":"10.1109\/TGRS.2020.3024744","article-title":"Multisensor Data Fusion for Cloud Removal in Global and All-Season Sentinel-2 Imagery","volume":"59","author":"Ebel","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_36","first-page":"4704616","article-title":"Seeing Through Clouds in Satellite Images","volume":"61","author":"Zhao","year":"2023","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.isprsjprs.2022.11.015","article-title":"Progressive fusion learning: A multimodal joint segmentation framework for building extraction from optical and SAR images","volume":"195","author":"Li","year":"2023","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Toriya, H., Dewan, A., and Kitahara, I. (August, January 28). SAR2OPT: Image Alignment Between Multi-Modal Images Using Generative Adversarial Networks. Proceedings of the IGARSS 2019, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8898605"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Chen, Z., Liu, J., Liu, F., Zhang, W., Xiao, L., and Shi, J. (2022, January 17\u201322). Learning Transformations between Heterogeneous SAR and Optical Images for Change Detection. Proceedings of the IGARSS 2022\u20142022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia.","DOI":"10.1109\/IGARSS46834.2022.9884752"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.isprsjprs.2021.07.007","article-title":"A deep translation (GAN) based change detection network for optical and SAR remote sensing images","volume":"179","author":"Li","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1016\/j.isprsjprs.2021.02.018","article-title":"Sentinel SAR-optical fusion for crop type mapping using deep learning and Google Earth Engine","volume":"175","author":"Adrian","year":"2021","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"112467","DOI":"10.1016\/j.rse.2021.112467","article-title":"Learning U-Net without forgetting for near real-time wildfire monitoring by the fusion of SAR and optical time series","volume":"261","author":"Zhang","year":"2021","journal-title":"Remote Sens. Environ."},{"key":"ref_43","first-page":"102818","article-title":"Fusion of optical and SAR images based on deep learning to reconstruct vegetation NDVI time series in cloud-prone regions","volume":"112","author":"Li","year":"2022","journal-title":"Int. J. Appl. Earth Obs. Geoinf."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/j.isprsjprs.2023.03.003","article-title":"Reconstructing cloud-contaminated NDVI images with SAR-Optical fusion using spatio-temporal partitioning and multiple linear regression","volume":"198","author":"Mao","year":"2023","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_45","unstructured":"Fu, S., Xu, F., and Jin, Y.Q. (2019). Reciprocal translation between SAR and optical remote sensing images with cascaded-residual adversarial networks. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Lewis, B., Scarnati, T., Sudkamp, E., Nehrbass, J., Rosencrantz, S., and Zelnio, E. (2019, January 14). A SAR dataset for ATR development: The Synthetic and Measured Paired Labeled Experiment (SAMPLE). Proceedings of the Algorithms for Synthetic Aperture Radar Imagery XXVI. International Society for Optics and Photonics, Baltimore, MD, USA.","DOI":"10.1117\/12.2523460"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1445","DOI":"10.1109\/TGRS.2009.2029339","article-title":"Ray-Tracing Simulation Techniques for Understanding High-Resolution SAR Images","volume":"48","author":"Auer","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Gartley, M., Goodenough, A., Brown, S., and Kauffman, R.P. (2010, January 18). A comparison of spatial sampling techniques enabling first principles modeling of a synthetic aperture RADAR imaging platform. Proceedings of the Algorithms for Synthetic Aperture Radar Imagery XVII, International Society for Optics and Photonics, Orlando, FL, USA.","DOI":"10.1117\/12.849552"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"4011005","DOI":"10.1109\/LGRS.2021.3065682","article-title":"A High-Quality Multicategory SAR Images Generation Method With Multiconstraint GAN for ATR","volume":"19","author":"Du","year":"2022","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Oh, J., and Kim, M. (2021). PeaceGAN: A GAN-Based Multi-Task Learning Method for SAR Target Image Generation with a Pose Estimator and an Auxiliary Classifier. Remote Sens., 13.","DOI":"10.3390\/rs13193939"},{"key":"ref_51","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv."},{"key":"ref_52","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (1997, January 17\u201319). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, San Juan, PR, USA."},{"key":"ref_53","unstructured":"Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv."},{"key":"ref_54","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6\u201311). Wasserstein generative adversarial networks. Proceedings of the International Conference on Machine Learning, PMLR, Sydney, Australia."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Karras, T., Laine, S., and Aila, T. (2019, January 15\u201320). A style-based generator architecture for generative adversarial networks. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","DOI":"10.1109\/CVPR.2019.00453"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18\u201323). The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. Proceedings of the 31st IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00068"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/23\/5569\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:34:32Z","timestamp":1760132072000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/23\/5569"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,30]]},"references-count":56,"journal-issue":{"issue":"23","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["rs15235569"],"URL":"https:\/\/doi.org\/10.3390\/rs15235569","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,11,30]]}}}