{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,20]],"date-time":"2026-07-20T16:23:54Z","timestamp":1784564634006,"version":"3.55.0"},"reference-count":35,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2021,10,3]],"date-time":"2021-10-03T00:00:00Z","timestamp":1633219200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["91538201"],"award-info":[{"award-number":["91538201"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62022092"],"award-info":[{"award-number":["62022092"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61671463"],"award-info":[{"award-number":["61671463"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>In recent years, the interpretation of SAR images has been significantly improved with the development of deep learning technology, and using conditional generative adversarial nets (CGANs) for SAR-to-optical transformation, also known as image translation, has become popular. Most of the existing image translation methods based on conditional generative adversarial nets are modified based on CycleGAN and pix2pix, focusing on style transformation in practice. In addition, SAR images and optical images are characterized by heterogeneous features and large spectral differences, leading to problems such as incomplete image details and spectral distortion in the heterogeneous transformation of SAR images in urban or semiurban areas and with complex terrain. Aiming to solve the problems of SAR-to-optical transformation, Serial GANs, a feature-preserving heterogeneous remote sensing image transformation model, is proposed in this paper for the first time. This model uses the Serial Despeckling GAN and Colorization GAN to complete the SAR-to-optical transformation. Despeckling GAN transforms the SAR images into optical gray images, retaining the texture details and semantic information. Colorization GAN transforms the optical gray images obtained in the first step into optical color images and keeps the structural features unchanged. The model proposed in this paper provides a new idea for heterogeneous image transformation. Through decoupling network design, structural detail information and spectral information are relatively independent in the process of heterogeneous transformation, thereby enhancing the detail information of the generated optical images and reducing its spectral distortion. Using SEN-2 satellite images as the reference, this paper compares the degree of similarity between the images generated by different models and the reference, and the results revealed that the proposed model has obvious advantages in feature reconstruction and the economical volume of the parameters. It also showed that Serial GANs have great potential in decoupling image transformation.<\/jats:p>","DOI":"10.3390\/rs13193968","type":"journal-article","created":{"date-parts":[[2021,10,8]],"date-time":"2021-10-08T21:26:20Z","timestamp":1633728380000},"page":"3968","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Serial GANs: A Feature-Preserving Heterogeneous Remote Sensing Image Transformation Model"],"prefix":"10.3390","volume":"13","author":[{"given":"Daning","family":"Tan","sequence":"first","affiliation":[{"name":"Institute of Information Fusion, Naval Aviation University, Yantai 264001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5216-3181","authenticated-orcid":false,"given":"Yu","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Information Fusion, Naval Aviation University, Yantai 264001, China"},{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gang","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electronic Engineering, Tsinghua University, Beijing 100084, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Libo","family":"Yao","sequence":"additional","affiliation":[{"name":"Institute of Information Fusion, Naval Aviation University, Yantai 264001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shun","family":"Sun","sequence":"additional","affiliation":[{"name":"Institute of Information Fusion, Naval Aviation University, Yantai 264001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"You","family":"He","sequence":"additional","affiliation":[{"name":"Institute of Information Fusion, Naval Aviation University, Yantai 264001, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,10,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Scarpa, G., Gargiulo, M., Mazza, A., and Gaetano, R. (2018). A CNN-based fusion method for feature extraction from sentinel data. Remote Sens., 10.","DOI":"10.3390\/rs10020236"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1445","DOI":"10.1109\/TGRS.2009.2029339","article-title":"Ray-Tracing Simulation Techniques for Understanding High-Resolution SAR Images","volume":"48","author":"Auer","year":"2010","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1109\/MGRS.2013.2277512","article-title":"A Tutorial on Speckle Reduction in Synthetic Aperture Radar Images","volume":"1","author":"Argenti","year":"2013","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Reyes, M.F., Auer, S., Merkle, N., Henry, C., and Schmitt, M. (2019). SAR-to-optical image translation based on conditional generative adversarial networks-optimization, opportunities and limits. Remote Sens., 11.","DOI":"10.3390\/rs11172067"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1763","DOI":"10.1109\/LSP.2017.2758203","article-title":"SAR Image Despeckling Using a Convolutional Neural Network","volume":"24","author":"Wang","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Lattari, F., Leon, B.G., Asaro, F., Rucci, A., Prati, C., and Matteucci, M. (2019). Deep learning for SAR image despeckling. Remote Sens., 11.","DOI":"10.3390\/rs11131532"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Dalsasso, E., Yang, X., Denis, L., Tupin, F., and Yang, W. (2020). SAR Image Despeckling by Deep Neural Networks: From a pre-trained model to an end-to-end training strategy. Remote Sens., 12.","DOI":"10.3390\/rs12162636"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3142","DOI":"10.1109\/TIP.2017.2662206","article-title":"Beyond a gaussian denoiser: Residual learning of deep cnn for image denoising","volume":"26","author":"Zhang","year":"2017","journal-title":"IEEE Trans. Image Process."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Chierchia, G., Cozzolino, D., Poggi, G., and Verdoliva, L. (2017, January 23\u201328). SAR image despeckling through convolutional neural networks. Proceedings of the 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Fort Worth, TX, USA.","DOI":"10.1109\/IGARSS.2017.8128234"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"196","DOI":"10.3390\/rs10020196","article-title":"Learning a Dilated Residual Network for SAR Image Despeckling","volume":"10","author":"Qiang","year":"2018","journal-title":"Remote Sens."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-image translation with conditional adversarial networks. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Zhu, J.-Y., Park, T., Isola, P., and Efros, A.A. Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks In Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy, 22\u201329 October 2017; Volume 2242\u20132251.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Wang, T.-C., Liu, M.-Y., Zhu, J.-Y., Tao, A., Kautz, J., and Catanzaro, B. (2018, January 18\u201323). High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00917"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Choi, Y., Choi, M., Kim, M., Ha, J.W., Kim, S., and Choo, J. (2018, January 18\u201323). StarGAN: Unified Generative Adversarial Networks for Multi-domain Image-to-Image Translation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00916"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Li, J., Monroe, W., Shi, T., Jean, S., Ritter, A., and Jurafsky, D. (2017, January 7\u201311). Adversarial learning for neural dialogue generation. Proceedings of the EMNLP 2017\u2014Conference on Empirical Methods in Natural Language Processing, Copenhagen, Denmark.","DOI":"10.18653\/v1\/D17-1230"},{"key":"ref_16","unstructured":"Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., and Lee, H. (2016, January 19\u201324). Generative adversarial text to image synthesis. Proceedings of the 33rd International Conference on Machine Learning (ICML-2016), New York, NY, USA."},{"key":"ref_17","unstructured":"Denton, E., Szlam, A., and Fergus, R. (2015). Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks. arXiv."},{"key":"ref_18","unstructured":"Mathieu, M., Couprie, C., and LeCun, Y. (2016, January 2\u20134). Deep multi-scale video prediction beyond mean square error. Proceedings of the 4th International Conference on Learning Representations, ICLR 2016, San Juan, Puerto Rico."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2016, January 21\u201326). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zhu, J.-Y., Kr\u00e4henb\u00fchl, P., Shechtman, E., and Efros, A.A. (2016, January 11\u201314). Generative Visual Manipulation on the Natural Image Manifold. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46454-1_36"},{"key":"ref_21","unstructured":"Brock, A., Lim, T., Ritchie, J.M., and Weston, N. (2017, January 24\u201326). Neural photo editing with introspective adversarial networks. Proceedings of the 5th International Conference on Learning Representations, Toulon, France."},{"key":"ref_22","unstructured":"Fu, S., Xu, F., and Jin, Y.Q. (2019). Translating sar to optical images for assisted interpretation. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"129136","DOI":"10.1109\/ACCESS.2019.2939649","article-title":"SAR-to-optical image translation using supervised cycle-consistent adversarial networks","volume":"7","author":"Wang","year":"2019","journal-title":"IEEE Access"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"70925","DOI":"10.1109\/ACCESS.2020.2987105","article-title":"Feature-guided SAR-to-optical image translation","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ma, C., Rao, Y., Cheng, Y., Chen, C., Lu, J., and Zhou, J. (2020, January 16\u201318). Structure-Preserving Super Resolution With Gradient Guidance. Proceedings of the 2020 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2020, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00779"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"141","DOI":"10.5194\/isprs-annals-IV-1-141-2018","article-title":"The SEN1-2 dataset for deep learning in SAR-optical data fusion","volume":"4","author":"Schmitt","year":"2018","journal-title":"ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.rse.2011.05.028","article-title":"GMES Sentinel-1 mission","volume":"120","author":"Torres","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, T., and Zhang, X. (2021). Injection of Traditional Hand-Crafted Features into Modern CNN-Based Models for SAR Ship Classification: What, Why, Where, and How. Remote Sens., 13.","DOI":"10.3390\/rs13112091"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"9431","DOI":"10.3390\/rs70709431","article-title":"Sentinel-1A product geolocation accuracy: Commissioning phase results","volume":"7","author":"Schubert","year":"2015","journal-title":"Remote Sens."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1016\/j.rse.2011.11.026","article-title":"Sentinel-2: ESA\u2019s optical high-resolution mission for GMES operational services","volume":"120","author":"Drusch","year":"2012","journal-title":"Remote Sens. Environ."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., and Efros, A.A. (2016, January 11\u201314). Colorful image colorization. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.","DOI":"10.1007\/978-3-319-46487-9_40"},{"key":"ref_32","unstructured":"Zhang, T., Zhang, X., Shi, J., Wei, S., Wang, J., Li, J., Su, H., and Zhou, Y. (2020). Balance scene learning mechanism for offshore and inshore ship detection in SAR images. IEEE Geosci. Remote Sens. Lett."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Sangkloy, P., Lu, J., Fang, C., Yu, F., and Hays, J. (2017, January 21\u201326). Scribbler: Controlling Deep Image Synthesis with Sketch and Color. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.723"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"2378","DOI":"10.1109\/TIP.2011.2109730","article-title":"FSIM: A Feature Similarity Index for Image Quality Assessment","volume":"20","author":"Zhang","year":"2011","journal-title":"IEEE Trans. Image Process."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/19\/3968\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:09:10Z","timestamp":1760166550000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/19\/3968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,3]]},"references-count":35,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["rs13193968"],"URL":"https:\/\/doi.org\/10.3390\/rs13193968","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,3]]}}}