{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,29]],"date-time":"2025-10-29T06:27:36Z","timestamp":1761719256780,"version":"build-2065373602"},"reference-count":24,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T00:00:00Z","timestamp":1696377600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61802199","62372235"],"award-info":[{"award-number":["61802199","62372235"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>High-quality satellite cloud images are of great significance for weather diagnosis and prediction. However, many of these images are often degraded due to relative motion, atmospheric turbulence, instrument noise, and other factors. In the satellite imaging process, the degradation also cannot be completely corrected. Therefore, it is necessary to further improve the satellite cloud image quality for real applications. In this study, we propose an unsupervised image restoration model with a two-stage network, in which the first stage, named the Prior-Knowledge-based Generative Adversarial Network (PKKernelGAN), aims to learn the blur kernel, and the second stage, named the Zero-Shot Deep Residual Network (ZSResNet), aims to improve the image quality. In PKKernelGAN, we propose a satellite cloud imaging loss function, which is a novel objective function that brings optimization of a generative model into the prior-knowledge domain. In ZSResNet, we build a dataset which contains the original satellite cloud image as high-quality images (HQ) paired with low-quality images (LQ) generated by the blur kernel learning from PKKernelGAN. The above innovations lead to a more efficient local structure in satellite cloud image restoration. The original dataset of our experiment is from the Sunflower 8 satellite provided by the Japan Meteorological Agency. This dataset is divided into training and testing sets to train and test PKKernelGAN. Then, ZSResNet is trained by the \u201cLQ\u2013HQ\u201d image pairs generated by PKKernelGAN. Compared with other supervised and unsupervised deep learning models for image restoration, our model has a better performance. Extensive experiments have demonstrated that our proposed model can achieve better performance on different datasets.<\/jats:p>","DOI":"10.3390\/rs15194820","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T11:58:57Z","timestamp":1696420737000},"page":"4820","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["A Prior-Knowledge-Based Generative Adversarial Network for Unsupervised Satellite Cloud Image Restoration"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7487-7305","authenticated-orcid":false,"given":"Liling","family":"Zhao","sequence":"first","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"},{"name":"School of Automation, Nanjing University of Information Science and Technology, Nanjing 210094, China"}]},{"given":"Xiaoao","family":"Duanmu","sequence":"additional","affiliation":[{"name":"School of Automation, Nanjing University of Information Science and Technology, Nanjing 210094, China"}]},{"given":"Quansen","family":"Sun","sequence":"additional","affiliation":[{"name":"School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing 210094, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"e621","DOI":"10.7717\/peerj-cs.621","article-title":"A comprehensive review of deep learning-based single image super-resolution","volume":"7","author":"Bashir","year":"2021","journal-title":"PeerJ Comput. Sci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1016\/j.inffus.2021.09.005","article-title":"Real-world single image super-resolution: A brief review","volume":"79","author":"Chen","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1364\/JOSA.54.000931","article-title":"Diffraction and resolving power","volume":"54","author":"Harris","year":"1964","journal-title":"JOSA"},{"key":"ref_4","first-page":"317","article-title":"Multiframe image restoration and registration","volume":"1","author":"Tsai","year":"1984","journal-title":"Multiframe Image Restor. Regist."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Dong, C., Loy, C.C., He, K., and Tang, X. (2014, January 6\u201312). Learning a deep convolutional network for image super-resolution. Proceedings of the IEEE European Conference on Computer Vision, Zurich, Switzerland.","DOI":"10.1007\/978-3-319-10593-2_13"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Kim, J., Lee, J.K., and Lee, K.M. (2016, January 27\u201330). Accurate image super-resolution using very deep convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.182"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Lim, B., Son, S., Kim, H., Nah, S., and Mu Lee, K. (2017, January 21\u201326). Enhanced deep residual networks for single image super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Honolulu, HI, USA.","DOI":"10.1109\/CVPRW.2017.151"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22\u201329). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.","DOI":"10.1109\/ICCV.2017.244"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Ignatov, A., Kobyshev, N., Timofte, R., Vanhoey, K., and van Gool, L. (2018, January 18\u201322). Wespe: Weakly supervised photo enhancer for digital cameras. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPRW.2018.00112"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1190","DOI":"10.1109\/LSP.2020.3005043","article-title":"Dual back-projection-based internal learning for blind super-resolution","volume":"27","author":"Kim","year":"2020","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Shocher, A., Cohen, N., and Irani, M. (2018, January 18\u201322). \u201cZero-shot\u201d super-resolution using deep internal learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00329"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ji, X., Cao, Y., Tai, Y., Wang, C., Li, J., and Huang, F. (2020, January 14\u201319). Real-world super-resolution via kernel estimation and noise injection. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.","DOI":"10.1109\/CVPRW50498.2020.00241"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Zhang, K., Liang, J., Van Gool, L., and Timofte, R. (2021, January 11\u201317). Designing a practical degradation model for deep blind image super-resolution. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCV48922.2021.00475"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Wang, X., Xie, L., Dong, C., and Shan, Y. (2021, January 11\u201317). Real-esrgan: Training real-world blind super-resolution with pure synthetic data. Proceedings of the IEEE\/CVF International Conference on Computer Vision, Montreal, BC, Canada.","DOI":"10.1109\/ICCVW54120.2021.00217"},{"key":"ref_16","unstructured":"Nayak, G.K., Jain, S., Babu, R.V., and Chakraborty, A. (2020, January 24\u201326). Fusion of Deep and Non-Deep Methods for Fast Super-Resolution of Satellite Images. Proceedings of the 2020 IEEE Sixth International Conference on Multimedia Big Data (BigMM), New Delhi, India."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Keshk, H.M., Abdel-Aziem, M.M., Ali, A.S., and Assal, M. (2014, January 27\u201329). Performance evaluation of quality measurement for super-resolution satellite images. Proceedings of the 2014 Science and Information Conference, London, UK.","DOI":"10.1109\/SAI.2014.6918212"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"937","DOI":"10.3788\/OPE.20162404.0937","article-title":"Infrared nephogram super-resolution algorithm based on TV-L1 decomposition","volume":"24","author":"Fu","year":"2016","journal-title":"Opt. Precis. Eng."},{"key":"ref_19","first-page":"275","article-title":"Nephogram super-resolution algorithm using over-complete dictionary via sparse representation","volume":"16","author":"Jin","year":"2012","journal-title":"J. Remote Sens."},{"key":"ref_20","first-page":"126","article-title":"A Method of Infrared Nephogram Super-resolution Based on Structural Group Sparse Representation","volume":"43","author":"Zhou","year":"2016","journal-title":"Opto-Electron. Eng."},{"key":"ref_21","unstructured":"Su, J. (2018). Research on Super-Resolution Reconstruction Algorithm of Infrared Cloud Image Based on Learning. [Master\u2019s Thesis, University of Chinese Academy of Sciences]."},{"key":"ref_22","unstructured":"Holst, G.C. (2008). Electro-Optical Imaging System Performance, SPIE."},{"key":"ref_23","first-page":"284","article-title":"Blind super-resolution kernel estimation using an internal-GAN","volume":"32","author":"Shocher","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1016\/j.isprsjprs.2020.06.021","article-title":"Thin cloud removal in optical remote sensing images based on generative adversarial networks and physical model of cloud distortion","volume":"166","author":"Li","year":"2020","journal-title":"ISPRS J. Photogramm. Remote Sens."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/19\/4820\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:05:12Z","timestamp":1760130312000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/19\/4820"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,4]]},"references-count":24,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2023,10]]}},"alternative-id":["rs15194820"],"URL":"https:\/\/doi.org\/10.3390\/rs15194820","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,10,4]]}}}