{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,18]],"date-time":"2025-12-18T09:19:54Z","timestamp":1766049594591,"version":"build-2065373602"},"reference-count":26,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,3,19]],"date-time":"2021-03-19T00:00:00Z","timestamp":1616112000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61705173","51801142"],"award-info":[{"award-number":["61705173","51801142"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004750","name":"Aeronautical Science Foundation of China","doi-asserted-by":"publisher","award":["201901081002"],"award-info":[{"award-number":["201901081002"]}],"id":[{"id":"10.13039\/501100004750","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Panchromatic (PAN) images contain abundant spatial information that is useful for earth observation, but always suffer from low-resolution ( LR) due to the sensor limitation and large-scale view field. The current super-resolution (SR) methods based on traditional attention mechanism have shown remarkable advantages but remain imperfect to reconstruct the edge details of SR images. To address this problem, an improved SR model which involves the self-attention augmented Wasserstein generative adversarial network ( SAA-WGAN) is designed to dig out the reference information among multiple features for detail enhancement. We use an encoder-decoder network followed by a fully convolutional network (FCN) as the backbone to extract multi-scale features and reconstruct the High-resolution (HR) results. To exploit the relevance between multi-layer feature maps, we first integrate a convolutional block attention module (CBAM) into each skip-connection of the encoder-decoder subnet, generating weighted maps to enhance both channel-wise and spatial-wise feature representation automatically. Besides, considering that the HR results and LR inputs are highly similar in structure, yet cannot be fully reflected in traditional attention mechanism, we, therefore, designed a self augmented attention (SAA) module, where the attention weights are produced dynamically via a similarity function between hidden features; this design allows the network to flexibly adjust the fraction relevance among multi-layer features and keep the long-range inter information, which is helpful to preserve details. In addition, the pixel-wise loss is combined with perceptual and gradient loss to achieve comprehensive supervision. Experiments on benchmark datasets demonstrate that the proposed method outperforms other SR methods in terms of both objective evaluation and visual effect.<\/jats:p>","DOI":"10.3390\/s21062158","type":"journal-article","created":{"date-parts":[[2021,3,21]],"date-time":"2021-03-21T23:47:41Z","timestamp":1616370461000},"page":"2158","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Panchromatic Image Super-Resolution Via Self Attention-Augmented Wasserstein Generative Adversarial Network"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5855-870X","authenticated-orcid":false,"given":"Juan","family":"Du","sequence":"first","affiliation":[{"name":"Xidian School of Physics and Optoelectronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0025-4890","authenticated-orcid":false,"given":"Kuanhong","family":"Cheng","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Xi\u2019an University of Technology, Xi\u2019an 710048, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yue","family":"Yu","sequence":"additional","affiliation":[{"name":"Xidian School of Physics and Optoelectronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dabao","family":"Wang","sequence":"additional","affiliation":[{"name":"Beijing Institute of Spacecraft System Engineering, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Huixin","family":"Zhou","sequence":"additional","affiliation":[{"name":"Xidian School of Physics and Optoelectronic Engineering, Xidian University, Xi\u2019an 710071, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,3,19]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Courtrai, L., Pham, M.T., and Lef\u00e8vre, S. (2020). Small Object Detection in Remote Sensing Images Based on Super-Resolution with Auxiliary Generative Adversarial Networks. Remote Sens., 12.","key":"ref_1","DOI":"10.3390\/rs12193152"},{"doi-asserted-by":"crossref","unstructured":"Wang, P., Zhang, G., Hao, S., and Wang, L. (2019). Improving Remote Sensing Image Super-Resolution Mapping Based on the Spatial Attraction Model by Utilizing the Pansharpening Technique. Remote Sens., 11.","key":"ref_2","DOI":"10.3390\/rs11030247"},{"doi-asserted-by":"crossref","unstructured":"Ma, W., Pan, Z., Yuan, F., and Lei, B. (2019). Super-Resolution of Remote Sensing Images via a Dense Residual Generative Adversarial Network. Remote Sens., 11.","key":"ref_3","DOI":"10.3390\/rs11212578"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"117961","DOI":"10.1109\/ACCESS.2020.3005213","article-title":"Efficient Spatial Pyramid of Dilated Convolution and Bottleneck Network for Zero-Shot Super Resolution","volume":"8","author":"Du","year":"2020","journal-title":"IEEE Access"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3106","DOI":"10.1109\/TMM.2019.2919431","article-title":"Deep Learning for Single Image Super-Resolution: A Brief Review","volume":"21","author":"Yang","year":"2019","journal-title":"IEEE Trans. Multimed."},{"key":"ref_6","first-page":"4844","article-title":"Achieving budget-optimality with adaptive schemes in crowdsourcing","volume":"29","author":"Lee","year":"2016","journal-title":"Advances in Neural Information Processing Systems"},{"doi-asserted-by":"crossref","unstructured":"Zhang, Y., Li, K., Kai, L., Wang, L., and Yun, F. (2018, January 8\u201314). Image Super-Resolution Using Very Deep Residual Channel Attention Networks. Proceedings of the 15th European Conference, Munich, Germany.","key":"ref_7","DOI":"10.1007\/978-3-030-01234-2_18"},{"unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. CoRR, Available online: http:\/\/xxx.lanl.gov\/abs\/1706.03762.","key":"ref_8"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"3911","DOI":"10.1109\/TCSVT.2019.2915238","article-title":"Channel-wise and Spatial Feature Modulation Network for Single Image Super-Resolution","volume":"30","author":"Hu","year":"2019","journal-title":"IEEE Trans. Circuits Syst. Video Technol."},{"unstructured":"Bello, I., Zoph, B., Vaswani, A., Shlens, J., and Le, Q.V. (November, January 27). Attention Augmented Convolutional Networks. Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.","key":"ref_10"},{"doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","key":"ref_11","DOI":"10.1109\/CVPR.2017.19"},{"unstructured":"Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A.C. (2017). Improved training of wasserstein gans. Advances in Neural Information Processing Systems, Available online: https:\/\/arxiv.org\/pdf\/1704.00028.pdf.","key":"ref_12"},{"doi-asserted-by":"crossref","unstructured":"Kupyn, O., Budzan, V., Mykhailych, M., Mishkin, D., and Matas, J. (2018, January 18\u201322). DeblurGAN: Blind Motion Deblurring Using Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","key":"ref_13","DOI":"10.1109\/CVPR.2018.00854"},{"doi-asserted-by":"crossref","unstructured":"Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8\u201314). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.","key":"ref_14","DOI":"10.1007\/978-3-030-01234-2_1"},{"doi-asserted-by":"crossref","unstructured":"Dai, T., and Cai, J. (2019, January 15\u201320). Second-order Attention Network for Single Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.","key":"ref_15","DOI":"10.1109\/CVPR.2019.01132"},{"doi-asserted-by":"crossref","unstructured":"Wang, L., Wang, Y., Liang, Z., Lin, Z., Yang, J., An, W., and Guo, Y. (2019, January 15\u201320). Learning Parallax Attention for Stereo Image Super-Resolution. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.","key":"ref_16","DOI":"10.1109\/CVPR.2019.01253"},{"unstructured":"Weng, L. (2019, April 18). From GAN to WGAN. Available online: https:\/\/arxiv.org\/pdf\/1904.08994.pdf.","key":"ref_17"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"140","DOI":"10.1016\/j.neucom.2019.07.094","article-title":"G-GANISR: Gradual generative adversarial network for image super resolution","volume":"366","author":"Shamsolmoali","year":"2019","journal-title":"Neurocomputing"},{"doi-asserted-by":"crossref","unstructured":"Du, J., Zhou, H., Qian, K., Tan, W., and Yu, Y. (2020). RGB-IR Cross Input and Sub-Pixel Upsampling Network for Infrared Image Super-Resolution. Sensors, 20.","key":"ref_19","DOI":"10.3390\/s20010281"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1109\/TPAMI.2015.2439281","article-title":"Image SuperResolution Using Deep Convolutional Networks","volume":"38","author":"Dong","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27\u201330). Accurate Image Super-Resolution Using Very Deep Convolutional Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","key":"ref_21","DOI":"10.1109\/CVPR.2016.182"},{"doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Mu Lee, K. (2017, January 21\u201326). Enhanced Deep Residual Networks for Single Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Honolulu, HI, USA.","key":"ref_22","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"2599","DOI":"10.1109\/TPAMI.2018.2865304","article-title":"Fast and accurate image super-resolution with deep laplacian pyramid networks","volume":"41","author":"Lai","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., Totz, J., and Wang, Z. (2016, January 27\u201330). Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","key":"ref_24","DOI":"10.1109\/CVPR.2016.207"},{"doi-asserted-by":"crossref","unstructured":"Zhang, Y., Tian, Y., Kong, Y., Zhong, B., and Fu, Y. (2018, January 18\u201322). Residual Dense Network for Image Super-Resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.","key":"ref_25","DOI":"10.1109\/CVPR.2018.00262"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1016\/j.neucom.2019.04.097","article-title":"Single image super-resolution with enhanced Laplacian pyramid network via conditional generative adversarial learning","volume":"398","author":"Zhang","year":"2020","journal-title":"Neurocomputing"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/6\/2158\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T05:38:06Z","timestamp":1760161086000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/21\/6\/2158"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,19]]},"references-count":26,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,3]]}},"alternative-id":["s21062158"],"URL":"https:\/\/doi.org\/10.3390\/s21062158","relation":{},"ISSN":["1424-8220"],"issn-type":[{"type":"electronic","value":"1424-8220"}],"subject":[],"published":{"date-parts":[[2021,3,19]]}}}