{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,19]],"date-time":"2026-05-19T23:33:29Z","timestamp":1779233609064,"version":"3.51.4"},"reference-count":44,"publisher":"MDPI AG","issue":"16","license":[{"start":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T00:00:00Z","timestamp":1628553600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100017591","name":"Key Industry Innovation Chain of Shaanxi","doi-asserted-by":"publisher","award":["2020ZDLGY05-01"],"award-info":[{"award-number":["2020ZDLGY05-01"]}],"id":[{"id":"10.13039\/501100017591","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61871311"],"award-info":[{"award-number":["61871311"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Mainstream image super-resolution (SR) methods are generally based on paired training samples. As the high-resolution (HR) remote sensing images are difficult to collect with a limited imaging device, most of the existing remote sensing super-resolution methods try to down-sample the collected original images to generate an auxiliary low-resolution (LR) image and form a paired pseudo HR-LR dataset for training. However, the distribution of the generated LR images is generally inconsistent with the real images due to the limitation of remote sensing imaging devices. In this paper, we propose a perceptually unpaired super-resolution method by constructing a multi-stage aggregation network (MSAN). The optimization of the network depends on consistency losses. In particular, the first phase is to preserve the contents of the super-resolved results, by constraining the content consistency between the down-scaled SR results and the low-quality low-resolution inputs. The second stage minimizes perceptual feature loss between the current result and LR input to constrain perceptual-content consistency. The final phase employs the generative adversarial network (GAN) to adding photo-realistic textures by constraining perceptual-distribution consistency. Numerous experiments on synthetic remote sensing datasets and real remote sensing images show that our method obtains more plausible results than other SR methods quantitatively and qualitatively. The PSNR of our network is 0.06dB higher than the SOTA method\u2014HAN on the UC Merced test set with complex degradation.<\/jats:p>","DOI":"10.3390\/rs13163167","type":"journal-article","created":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T22:40:31Z","timestamp":1628635231000},"page":"3167","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Unpaired Remote Sensing Image Super-Resolution with Multi-Stage Aggregation Networks"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9590-6379","authenticated-orcid":false,"given":"Lize","family":"Zhang","sequence":"first","affiliation":[{"name":"School of Electronic Engineering, Xidian Universerty, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wen","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Xidian Universerty, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5242-9904","authenticated-orcid":false,"given":"Yuanfei","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaopeng","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Xidian Universerty, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hongyi","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Electronic Engineering, Xidian Universerty, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,8,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"35","DOI":"10.2528\/PIERC20061003","article-title":"High efficiency X-band series-fed microstrip array antenna","volume":"105","author":"Shirkolaei","year":"2020","journal-title":"Prog. Electromagn. Res. C"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"192965","DOI":"10.1109\/ACCESS.2020.3032826","article-title":"A Comprehensive Survey on \u201cVarious Decoupling Mechanisms With Focus on Metamaterial and Metasurface Principles Applicable to SAR and MIMO Antenna Systems\u201d","volume":"8","author":"Alibakhshikenari","year":"2020","journal-title":"IEEE Access"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Qin, M., Hu, L., Du, Z., Gao, Y., Qin, L., Zhang, F., and Liu, R. (2020). Achieving Higher Resolution Lake Area from Remote Sensing Images through an Unsupervised Deep Learning Super-Resolution Method. Remote. Sens., 12.","DOI":"10.3390\/rs12121937"},{"key":"ref_4","unstructured":"Allebach, J., and Wong, P.W. (1996, January 16\u201319). Edge-directed interpolation. Proceedings of the IEEE International Conference on Image Processing, Lausanne, Switzerland."},{"key":"ref_5","unstructured":"Dong, W., Zhang, L., Shi, G., and Wu, X. (2009, January 7\u201310). Nonlocal back-projection for adaptive image enlargement. In Proceeding of the IEEE International Conference on Image Processing, Cairo, Egypt."},{"key":"ref_6","unstructured":"Yang, J., Wright, J., Huang, T., and Ma, Y. (2008, January 23\u201328). Image super-resolution as sparse representation of raw image patches. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, AK, USA."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Gu, S., Zuo, W., Xie, Q., Meng, D., Feng, X., and Zhang, L. (2015, January 7\u201313). Convolutional sparse coding for image super-resolution. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.","DOI":"10.1109\/ICCV.2015.212"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1109\/TPAMI.2016.2542816","article-title":"Graphical representation for heterogeneous face recognition","volume":"39","author":"Peng","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image super-resolution using deep convolutional networks","volume":"38","author":"Dong","year":"2015","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27\u201330). Accurate image super-resolution using very deep convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Tai, Y., Yang, J., and Liu, X. (2017, January 21\u201326). Image super-resolution via deep recursive residual network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.298"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18\u201323). Residual dense network for image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00262"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Tong, T., Li, G., Liu, X., and Gao, Q. (2017, January 22\u201329). Image super-resolution using dense skip connections. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.514"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Mu Lee, K. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_17","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2016, January 16\u201321). Generative adversarial networks. A. Courville, and Y. Bengio, Generative adversarial networks. Proceedings of the International Conference on Neural Information Processing, Kyoto, Japan."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Wang, X., Yu, K., Wu, S., Gu, J., Liu, Y., Dong, C., Qiao, Y., and Change Loy, C. (2018, January 8\u201314). Esrgan: Enhanced super-resolution generative adversarial networks. Proceedings of the European Conference on Computer Vision Workshops, Munich, Germany.","DOI":"10.1007\/978-3-030-11021-5_5"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, K., Li, K., Wang, L., Zhong, B., and Fu, Y. (2018, January 8\u201314). Image super-resolution using very deep residual channel attention networks. Proceedings of the European Conference on Computer Vision, Munich, Germany.","DOI":"10.1007\/978-3-030-01234-2_18"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2325","DOI":"10.1109\/TIP.2021.3050856","article-title":"Interpretable Detail-Fidelity Attention Network for Single Image Super-Resolution","volume":"30","author":"Huang","year":"2021","journal-title":"IEEE Trans. Image Process."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Efrat, N., Glasner, D., Apartsin, A., Nadler, B., and Levin, A. (2013, January 1\u20138). Accurate blur models vs. image priors in single image super-resolution. Proceedings of the IEEE International Conference on Computer Vision, Sydney, NSW, Australia.","DOI":"10.1109\/ICCV.2013.352"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Yang, C.Y., Ma, C., and Yang, M.H. (2014, January 6\u201312). Single-image super-resolution: A benchmark. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_25"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1109\/LGRS.2010.2055033","article-title":"Satellite image classification via two-layer sparse coding with biased image representation","volume":"8","author":"Dai","year":"2010","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"474","DOI":"10.1145\/1944846.1944852","article-title":"Image and video upscaling from local self-examples","volume":"30","author":"Freedman","year":"2011","journal-title":"ACM Trans. Graph. (TOG)"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Yuan, Y., Liu, S., Zhang, J., Zhang, Y., Dong, C., and Lin, L. (2018, January 18\u201322). Unsupervised image super-resolution using cycle-in-cycle generative adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00113"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Shocher, A., Cohen, N., and Irani, M. (2018, January 18\u201323). \u201czero-shot\u201d super-resolution using deep internal learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00329"},{"key":"ref_27","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2018, January 18\u201323). Deep image prior. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"29027","DOI":"10.1109\/ACCESS.2020.2972300","article-title":"An unsupervised remote sensing single-image super-resolution method based on generative adversarial network","volume":"8","author":"Zhang","year":"2020","journal-title":"IEEE Access"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, P., Zhang, H., Zhou, F., and Jiang, Z. (August, January 28). Unsupervised remote sensing image super-resolution using cycle CNN. Proceedings of the IGARSS 2019 IEEE International Geoscience and Remote Sensing Symposium, Yokohama, Japan.","DOI":"10.1109\/IGARSS.2019.8898648"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Zhang, N., Wang, Y., Zhang, X., Xu, D., Wang, X., Ben, G., Zhao, Z., and Li, Z. (2020). A Multi-Degradation Aided Method for Unsupervised Remote Sensing Image Super Resolution with Convolution Neural Networks. IEEE Trans. Geosci. Remote Sens., 1\u201314.","DOI":"10.1109\/TGRS.2020.3042460"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Huang, Y., Sun, X., Lu, W., Li, J., and Gao, X. (2019, January 27\u201328). Un-Paired Real World Super-Resolution with Degradation Consistency. Proceedings of the IEEE International Conference on Computer Vision Workshops, Seoul, Korea.","DOI":"10.1109\/ICCVW.2019.00429"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21\u201326). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., Totz, J., Aitken, A.P., Bishop, R., Rueckert, D., and Wang, Z. (2016, January 27\u201330). Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.207"},{"key":"ref_34","unstructured":"Simonyan, K., and Zisserman, A. (2015, January 7\u20139). Very deep convolutional networks for large scale image recognition. In Proccedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_35","unstructured":"Zhang, W., Liu, Y., Dong, C., and Qiao, Y. (November, January 27). RankSRGAN: Generative adversarial networks with ranker for image Super-resolution. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Korea."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Yang, Y., and Newsam, S. (2010, January 2\u20135). Bag-Of-Visual-Words and Spatial Extensions for Land-Use Classification. Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, San Jose, CA, USA.","DOI":"10.1145\/1869790.1869829"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Xia, G.S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., and Zhang, L. (2018, January 18\u201323). DOTA: A large-scale dataset for object detection in aerial images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00418"},{"key":"ref_38","unstructured":"Kingma, D.P., and Ba, J.L. (2015, January 7\u20139). Adam: A method for stochastic optimization. Proceedings of the 3rd International Conference on Learning Representations, San Diego, CA, USA."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1109\/LSP.2012.2227726","article-title":"Making a \u201ccompletely blind\u201d image quality analyzer","volume":"20","author":"Mittal","year":"2012","journal-title":"IEEE Signal. Process. Lett."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Zhang, R., Isola, P., Efros, A.A., Shechtman, E., and Wang, O. (2018, January 18\u201323). The unreasonable effectiveness of deep features as a perceptual metric. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00068"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Hui, Z., Gao, X., Yang, Y., and Wang, X. (2019, January 21\u201325). Lightweight image super-resolution with information multi-distillation network. Proceedings of the MM\u201919: 27th ACM International Conference on Multimedia, Nice, France.","DOI":"10.1145\/3343031.3351084"},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Niu, B., Wen, W., Ren, W., Zhang, X., Yang, L., Wang, S., Zhang, K., Cao, X., and Shen, H. (2020, January 23\u201328). Single image super-resolution via a holistic attention network. Proceedings of the European Conference on Computer Vision, Glasgow, UK.","DOI":"10.1007\/978-3-030-58610-2_12"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Guo, Y., Chen, J., Wang, J., Chen, Q., Cao, J., Deng, Z., Xu, Y., and Tan, M. (2020, January 13\u201319). Closed-loop matters: Dual regression networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.","DOI":"10.1109\/CVPR42600.2020.00545"}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3167\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:43:40Z","timestamp":1760165020000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/16\/3167"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,10]]},"references-count":44,"journal-issue":{"issue":"16","published-online":{"date-parts":[[2021,8]]}},"alternative-id":["rs13163167"],"URL":"https:\/\/doi.org\/10.3390\/rs13163167","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,10]]}}}