{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T16:03:01Z","timestamp":1783699381161,"version":"3.55.0"},"reference-count":41,"publisher":"MDPI AG","issue":"19","license":[{"start":{"date-parts":[[2021,9,28]],"date-time":"2021-09-28T00:00:00Z","timestamp":1632787200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["51677123"],"award-info":[{"award-number":["51677123"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Ground-based cloud images can provide information on weather and cloud conditions, which play an important role in cloud cover monitoring and photovoltaic power generation forecasting. However, the cloud motion prediction of ground-based cloud images still lacks advanced and complete methods, and traditional technologies based on image processing and motion vector calculation are difficult to predict cloud morphological changes. In this paper, we propose a cloud motion prediction method based on Cascade Causal Long Short-Term Memory (CCLSTM) and Super-Resolution Network (SR-Net). Firstly, CCLSTM is used to estimate the shape and speed of cloud motion. Secondly, the Super-Resolution Network is built based on perceptual losses to reconstruct the result of CCLSTM and, finally, make it clearer. We tested our method on Atmospheric Radiation Measurement (ARM) Climate Research Facility TSI (total sky imager) images. The experiments showed that the method is able to predict the sky cloud changes in the next few steps.<\/jats:p>","DOI":"10.3390\/rs13193876","type":"journal-article","created":{"date-parts":[[2021,9,28]],"date-time":"2021-09-28T21:38:09Z","timestamp":1632865089000},"page":"3876","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":15,"title":["A Method of Ground-Based Cloud Motion Predict: CCLSTM + SR-Net"],"prefix":"10.3390","volume":"13","author":[{"given":"Zhiying","family":"Lu","sequence":"first","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9516-5611","authenticated-orcid":false,"given":"Zehan","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xin","family":"Li","sequence":"additional","affiliation":[{"name":"School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8486-4727","authenticated-orcid":false,"given":"Jianfeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"School of Information Science and Engineering, Shandong Normal University, Jinan 250014, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,28]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1358","DOI":"10.1109\/TGRS.2018.2866206","article-title":"A Selection Criterion for the Optimal Resolution of Ground-Based Remote Sensing Cloud Images for Cloud Classification","volume":"57","author":"Wang","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1109\/MGRS.2015.2510448","article-title":"Ground-based image analysis: A tutorial on machine-learning techniques and applications","volume":"4","author":"Dev","year":"2016","journal-title":"IEEE Geosci. Remote Sens. Mag."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Leveque, L., Dev, S., Hossari, M., Lee, Y.H., and Winkler, S. (2019, January 17\u201320). Subjective Quality Assessment of Ground-based Camera Images. Proceedings of the 2019 Photonics & Electromagnetics Research Symposium-Fall (PIERS-FALL), Xiamen, China.","DOI":"10.1109\/PIERS-Fall48861.2019.9021449"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1007\/s00703-013-0245-9","article-title":"Ground-based measurements of local cloud cover","volume":"120","author":"Silva","year":"2013","journal-title":"Meteorol. Atmos. Phys."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"730","DOI":"10.1016\/j.solener.2019.06.041","article-title":"Short-term solar power forecast with deep learning: Exploring optimal input and output configuration","volume":"188","author":"Sun","year":"2019","journal-title":"Sol. Energy"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1016\/j.apr.2017.08.004","article-title":"Study of continuous air pollution in winter over Wuhan based on ground-based and satellite observations","volume":"9","author":"Liu","year":"2018","journal-title":"Atmos. Pollut. Res."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1175\/JTECH1875.1","article-title":"Retrieving cloud characteristics from ground-based daytime color all-sky images","volume":"23","author":"Long","year":"2006","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Dissawa, D.M.L.H., Ekanayake, M.P.B., Godaliyadda, G.M.R.I., Ekanayake, J.B., and Agalgaonkar, A.P. (2017, January 6\u20139). Cloud motion tracking for short-term on-site cloud coverage prediction. Proceedings of the Seventeenth International Conference on Advances in ICT for Emerging Regions, Colombo, Sri Lanka.","DOI":"10.1109\/ICTER.2017.8257803"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"El Jaouhari, Z., Zaz, Y., and Masmoudi, L. (2015, January 10\u201313). Cloud tracking from whole-sky ground-based images. Proceedings of the 3rd International Renewable and Sustainable Energy Conference, Marrakech, Morocco.","DOI":"10.1109\/IRSEC.2015.7455105"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Dissawa, D.M.L.H., Godaliyadda, G.M.R.I., Ekanayake, M.P.B., Ekanayake, J.B., and Agalgaonkar, A.P. (2017, January 15\u201316). Cross-correlation based cloud motion estimation for short-term solar irradiation predictions. Proceedings of the IEEE International Conference on Industrial and Information Systems, Peradeniya, Sri Lanka.","DOI":"10.1109\/ICIINFS.2017.8300338"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1016\/j.solener.2017.10.075","article-title":"Robust cloud motion estimation by spatio-temporal correlation analysis of irradiance data","volume":"159","author":"Jamaly","year":"2018","journal-title":"Sol. Energy"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"7972","DOI":"10.1109\/TGRS.2019.2917612","article-title":"Supervised Fine-Grained Cloud Detection and Recognition in Whole-Sky Images","volume":"57","author":"Ye","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"816","DOI":"10.1109\/LGRS.2017.2681658","article-title":"Deep convolutional activations-based features for ground-based cloud classification","volume":"14","author":"Shi","year":"2017","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Liu, S., Li, M., Zhang, Z., Xiao, B., and Cao, X. (2018). Multimodal ground-based cloud classification using joint fusion convolutional neural network. Remote Sens., 10.","DOI":"10.3390\/rs10060822"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"85688","DOI":"10.1109\/ACCESS.2019.2926092","article-title":"Hierarchical multimodal fusion for ground-based cloud classification in weather station networks","volume":"7","author":"Liu","year":"2019","journal-title":"IEEE Access"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"7790","DOI":"10.1109\/TGRS.2020.2984265","article-title":"Multimodal Ground-Based Remote Sensing Cloud Classification via Learning Heterogeneous Deep Features","volume":"58","author":"Liu","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","unstructured":"Shi, X., Chen, Z., Wang, H., Yeung, D., Wong, W., and Woo, W. (2015, January 7\u201312). Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting. Proceedings of the 29th Annual Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_18","unstructured":"Wang, Y., Long, M., Wang, J., Gao, Z., and Yu, P.S. (2017, January 4\u20139). PredRNN: Recurrent Neural Networks for Predictive Learning using Spatiotemporal LSTMs. Proceedings of the 31st Annual Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_19","unstructured":"Wang, Y., Gao, Z., Long, M., Wang, J., and Yu, P.S. (2018, January 10\u201315). PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning. Proceedings of the 35th International Conference on Machine Learning, Stockholmsm\u00e4ssan, Stockholm, Sweden."},{"key":"ref_20","unstructured":"Fan, H., Zhu, L., and Yang, Y. (February, January 27). Cubic LSTMs for Video Prediction. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Xu, Z., Du, J., Wang, J., Jiang, C., and Ren, Y. (2019, January 20\u201324). Satellite Image Prediction Relying on GAN and LSTM Neural Networks. Proceedings of the ICC 2019\u20132019 IEEE International Conference on Communications, Shanghai, China.","DOI":"10.1109\/ICC.2019.8761462"},{"key":"ref_22","unstructured":"Denton, E., and Birodkar, V. (2017, January 4\u20139). Unsupervised Learning of Disentangled Representations from Video. Proceedings of the 31st Annual Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Su, X., Li, T., An, C., and Wang, G. (2020). Prediction of Short-Time Cloud Motion Using a Deep-Learning Model. Atmosphere, 11.","DOI":"10.3390\/atmos11111151"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1109\/LSP.2016.2611485","article-title":"Beyond Frame-level CNN: Saliency-Aware 3-D CNN With LSTM for Video Action Recognition","volume":"24","author":"Wang","year":"2017","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Wu, H., Lu, Z., Zhang, J., and Ren, T. (2021). Facial Expression Recognition Based on Multi-Features Cooperative Deep Convolutional Network. Appl. Sci., 11.","DOI":"10.3390\/app11041428"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"2881","DOI":"10.1016\/j.solener.2011.08.025","article-title":"Intra-hour forecasting with a total sky imager at the UC San Diego solar energy testbed","volume":"85","author":"Chow","year":"2011","journal-title":"Sol. Energy"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"800","DOI":"10.1049\/el:20080522","article-title":"Scope of validity of PSNR in image\/video quality assessment","volume":"44","author":"Ghanbari","year":"2008","journal-title":"Electron. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TIP.2003.819861","article-title":"Image quality assessment: From error visibility to structural similarity","volume":"13","author":"Wang","year":"2004","journal-title":"IEEE Trans. Image Process."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"510","DOI":"10.1016\/j.solener.2019.01.096","article-title":"3D-CNN-based feature extraction of ground-based cloud images for direct normal irradiance prediction","volume":"181","author":"Zhao","year":"2019","journal-title":"Sol. Energy"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ledig, C., Theis, L., Husz\u00e1r, F., Caballero, J., Cunningham, A., Acosta, A., Aitken, A., Tejani, A., Totz, J., and Wang, Z. (2017, January 21\u201326). Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.19"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Balakrishnan, G., Dalca, A., Zhao, A., Guttag, J., Durand, F., and Freeman, W. (November, January 27). Visual Deprojection: Probabilistic Recovery of Collapsed Dimensions. Proceedings of the 2019 IEEE\/CVF International Conference on Computer Vision, Seoul, Korea.","DOI":"10.1109\/ICCV.2019.00026"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"258","DOI":"10.1016\/j.image.2018.04.016","article-title":"Detecting USM image sharpening by using CNN","volume":"68","author":"Ye","year":"2018","journal-title":"Signal Process. Image Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"2599","DOI":"10.1109\/TPAMI.2018.2865304","article-title":"Fast and Accurate Image Super-Resolution with Deep Laplacian Pyramid Networks","volume":"41","author":"Lai","year":"2019","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_34","unstructured":"Yu, F., and Koltun, V. (2016). Multi-Scale Context Aggregation by Dilated Convolutions. arXiv."},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Shi, W., Caballero, J., Husz\u00e1r, F., Totz, J., Aitken, A., Bishop, R., Rueckert, D., and Wang, Z. (2016, January 27\u201330). Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.207"},{"key":"ref_36","first-page":"694","article-title":"Perceptual Losses for Real-Time Style Transfer and Super-Resolution","volume":"Volume 9906","author":"Johnson","year":"2016","journal-title":"Proceedings of the 14th European Conference on Computer Vision"},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Sangkloy, P., Lu, J., Fang, C., Yu, F., and Hays, J. (2017, January 21\u201326). Scribbler: Controlling deep image synthesis with sketch and color. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.723"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Yang, C., Lu, X., Lin, Z., Shechtman, E., Wang, O., and Li, H. (2017, January 21\u201326). High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.434"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2289","DOI":"10.1109\/TMI.2020.2968472","article-title":"SACNN: Self-Attention Convolutional Neural Network for Low-Dose CT Denoising with Self-Supervised Perceptual Loss Network","volume":"39","author":"Li","year":"2020","journal-title":"IEEE Trans. Med. Imaging."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1109\/TVCG.2019.2930512","article-title":"Perceptual-Aware Sketch Simplification Based on Integrated VGG Layers","volume":"27","author":"Xu","year":"2019","journal-title":"IEEE Trans. Vis. Comput. Graph."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/19\/3876\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:06:10Z","timestamp":1760166370000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/19\/3876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,28]]},"references-count":41,"journal-issue":{"issue":"19","published-online":{"date-parts":[[2021,10]]}},"alternative-id":["rs13193876"],"URL":"https:\/\/doi.org\/10.3390\/rs13193876","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,28]]}}}