{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,30]],"date-time":"2026-03-30T16:56:11Z","timestamp":1774889771997,"version":"3.50.1"},"reference-count":32,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2023,7,25]],"date-time":"2023-07-25T00:00:00Z","timestamp":1690243200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61501247"],"award-info":[{"award-number":["61501247"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61703212"],"award-info":[{"award-number":["61703212"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61802197"],"award-info":[{"award-number":["61802197"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62071240"],"award-info":[{"award-number":["62071240"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["BK20160971"],"award-info":[{"award-number":["BK20160971"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["BK20171458"],"award-info":[{"award-number":["BK20171458"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Science Foundation of Jiangsu Province of China","award":["61501247"],"award-info":[{"award-number":["61501247"]}]},{"name":"National Science Foundation of Jiangsu Province of China","award":["61703212"],"award-info":[{"award-number":["61703212"]}]},{"name":"National Science Foundation of Jiangsu Province of China","award":["61802197"],"award-info":[{"award-number":["61802197"]}]},{"name":"National Science Foundation of Jiangsu Province of China","award":["62071240"],"award-info":[{"award-number":["62071240"]}]},{"name":"National Science Foundation of Jiangsu Province of China","award":["BK20160971"],"award-info":[{"award-number":["BK20160971"]}]},{"name":"National Science Foundation of Jiangsu Province of China","award":["BK20171458"],"award-info":[{"award-number":["BK20171458"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Nowcasting has emerged as a critical foundation for services including heavy rain alerts and public transportation management. Although widely used for short-term forecasting, models such as TrajGRU and PredRNN exhibit limitations in predicting low-intensity rainfall and low temporal resolution, resulting in suboptimal performance during infrequent heavy rainfall events. To tackle these challenges, we introduce a spatio-temporal sequence and generative adversarial network model for short-term precipitation forecasting based on radar data. By enhancing the ConvLSTM model with a pre-trained TransGAN generator, we improve feature resolution. We first assessed the model\u2019s performance on the Moving MNIST dataset and subsequently validated it on the HKO-7 dataset. Employing metrics such as Mean Squared Error (MSE), Mean Absolute Error (MAE), Structural Similarity Index Measure (SSIM), Critical Success Index (CSI), Probability of Detection (POD), and False Alarm Ratio (FAR), we compare our model\u2019s performance to existing models. Experimental results reveal that our proposed ConvLSTM-TransGAN model effectively captures weather system evolution and surpasses the performance of other traditional models.<\/jats:p>","DOI":"10.3390\/rs15153720","type":"journal-article","created":{"date-parts":[[2023,7,26]],"date-time":"2023-07-26T01:09:01Z","timestamp":1690333741000},"page":"3720","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Integrating Spatio-Temporal and Generative Adversarial Networks for Enhanced Nowcasting Performance"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4786-4036","authenticated-orcid":false,"given":"Wenbin","family":"Yu","sequence":"first","affiliation":[{"name":"School of Software, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"Huaihe River Basin Meteorological Center, Hefei 230031, China"},{"name":"Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"given":"Suxun","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Software, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"School of Computer Science, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4458-5843","authenticated-orcid":false,"given":"Chengjun","family":"Zhang","sequence":"additional","affiliation":[{"name":"Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"School of Computer Science, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4448-2617","authenticated-orcid":false,"given":"Yadang","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Computer Science, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"given":"Xinyu","family":"Sheng","sequence":"additional","affiliation":[{"name":"Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"School of Computer Science, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"BYD Company Limited, Shenzhen 518119, China"}]},{"given":"Yu","family":"Yao","sequence":"additional","affiliation":[{"name":"School of Software, Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"Jiangsu Collaborative Innovation Center of Atmospheric Environment and Equipment Technology (CICAEET), Nanjing University of Information Science and Technology, Nanjing 210044, China"},{"name":"School of Computer Science, Nanjing University of Information Science and Technology, Nanjing 210044, China"}]},{"given":"Jie","family":"Liu","sequence":"additional","affiliation":[{"name":"Huaihe River Basin Meteorological Center, Hefei 230031, China"},{"name":"Anhui Meteorological Observatory, Hefei 230031, China"}]},{"given":"Gaoping","family":"Liu","sequence":"additional","affiliation":[{"name":"Huaihe River Basin Meteorological Center, Hefei 230031, China"},{"name":"Anhui Meteorological Observatory, Hefei 230031, China"}]}],"member":"1968","published-online":{"date-parts":[[2023,7,25]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1038\/nature14956","article-title":"The quiet revolution of numerical weather prediction","volume":"525","author":"Bauer","year":"2015","journal-title":"Nature"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1109\/JSTARS.2020.3040648","article-title":"PFST-LSTM: A SpatioTemporal LSTM Model With Pseudoflow Prediction for Precipitation Nowcasting","volume":"14","author":"Luo","year":"2021","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_3","unstructured":"Shi, X., Chen, Z., Wang, H., Yeung, D., Wong, W., and Woo, W. (2015, January 7\u201312). Convolutional LSTM Network: A machine learning approach for precipitation nowcasting. Proceedings of the International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_4","unstructured":"Shi, X., Gao, Z., Lausen, L., Wang, H., Yeung, D., Wong, W., and Woo, W. (2017, January 4\u20139). Deep learning for precipitation nowcasting: A benchmark and a new model. Proceedings of the International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_5","unstructured":"Wang, Y., Long, M., Wang, J., Gao, Z., and Yu, P.S. (2017, January 4\u20139). PredRNN: Recurrent neural networks for predictive learning using spatiotemporal LSTMs. Proceedings of the International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_6","unstructured":"Wang, Y., Gao, Z., Long, M., Wang, J., and Yu, P.S. (2018, January 10\u201315). PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning. Proceedings of the International Conference on Machine Learning, Sweden, Stockholm."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Oliu, M., Selva, J., and Escalera, S. Folded Recurrent Neural Networks for Future Video Prediction. Proceedings of the Computer Vision\u2014ECCV 2018: 15th European Conference, Munich, Germany, 8\u201314 September 2018.","DOI":"10.1007\/978-3-030-01264-9_44"},{"key":"ref_8","unstructured":"Pr\u00e9mont-Schwarz, I., Ilin, A., Hao, T.H., Rasmus, A., Boney, R., and Valpola, H. (2017, January 4\u20139). Recurrent ladder networks. Proceedings of the International Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_9","unstructured":"Kim, S., Hong, S., Joh, M., and Song, S. (2017). DeepRain: ConvLSTM Network for Precipitation Prediction using Multichannel Radar Data. arXiv."},{"key":"ref_10","unstructured":"Fan, H., Zhu, L., and Yang, Y. (February, January 27). Cubic LSTMs for video prediction. Proceedings of the AAAI Conference on Artificial Intelligence, Honolulu, HI, USA."},{"key":"ref_11","unstructured":"Lin, Z., Li, M., Zheng, Z., Cheng, Y., and Yuan, C. (2020, January 7\u201312). Self-Attention ConvLSTM for Spatiotemporal Prediction. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Jing, J., Li, Q., Peng, X., Ma, Q., and Tang, S. (2020, January 4\u20138). HPRNN: A Hierarchical Sequence Prediction Model for Long-Term Weather Radar Echo Extrapolation. Proceedings of the ICASSP 2020\u20142020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Barcelona, Spain.","DOI":"10.1109\/ICASSP40776.2020.9054232"},{"key":"ref_13","unstructured":"Kaae S\u00f8nderby, C., Espeholt, L., Heek, J., Dehghani, M., Oliver, A., Salimans, T., Agrawal, S., Hickey, J., and Kalchbrenner, N. (2020). MetNet: A Neural Weather Model for Precipitation Forecasting. arXiv."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1038\/s41586-021-03854-z","article-title":"Skilful precipitation nowcasting using deep generative models of radar","volume":"597","author":"Ravuri","year":"2021","journal-title":"Nature"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Cao, Y., Zhang, D., Zheng, X., Shan, H., and Zhang, J. (2023). Mutual Information Boosted Precipitation Nowcasting from Radar Images. Remote Sens., 15.","DOI":"10.3390\/rs15061639"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Huang, Q., Chen, S., and Tan, J. (2023). TSRC: A Deep Learning Model for Precipitation Short-Term Forecasting over China Using Radar Echo Data. Remote Sens., 15.","DOI":"10.3390\/rs15010142"},{"key":"ref_17","unstructured":"Jiang, Y., Chang, S., and Wang, Z. (2021, January 6\u201314). TransGAN: Two Pure Transformers Can Make One Strong GAN, and That Can Scale Up. Proceedings of the International Conference on Neural Information Processing Systems, Virtual."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1162\/neco.1997.9.8.1735","article-title":"Long Short-Term Memory","volume":"9","author":"Hochreiter","year":"1997","journal-title":"Neural Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"79","DOI":"10.3354\/cr030079","article-title":"Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance","volume":"30","author":"Willmott","year":"2005","journal-title":"Clim. Res."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1016\/0304-3800(89)90035-5","article-title":"Mean squared error of prediction as a criterion for evaluating and comparing system models","volume":"44","author":"Wallach","year":"1989","journal-title":"Ecol. Model."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Hor\u00e9, A., and Ziou, D. (2010, January 23\u201326). Image Quality Metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.579"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"L14801","DOI":"10.1029\/2005GL023451","article-title":"Precipitation forecast skill of numerical weather prediction models and radar nowcasts","volume":"32","author":"Lin","year":"2005","journal-title":"Geophys. Res. Lett."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1109\/TBDATA.2018.2871151","article-title":"Short-Term Rainfall Forecasting Using Multi-Layer Perceptron","volume":"6","author":"Zhang","year":"2020","journal-title":"IEEE Trans. Big Data"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"RRumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2278","DOI":"10.1109\/5.726791","article-title":"Gradient-based learning applied to document recognition","volume":"86","author":"Lecun","year":"1998","journal-title":"Proc. IEEE"},{"key":"ref_26","unstructured":"Karras, T., Aila, T., Laine, S., and Lehtinen, J. (May, January 30). Progressive Growing of GANs for Improved Quality, Stability, and Variation. Proceedings of the International Conference on Learning Representations, Vancouver, BC, Canada."},{"key":"ref_27","unstructured":"Denton, E., Chintala, S., Szlam, A., and Fergus, R. (2015, January 7\u201312). Deep generative image models using a Laplacian pyramid of adversarial networks. Proceedings of the International Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1145\/3422622","article-title":"Generative adversarial networks","volume":"63","author":"Goodfellow","year":"2020","journal-title":"Commun. ACM"},{"key":"ref_29","unstructured":"Hudson, D.A., and Zitnick, L. (2021, January 18\u201324). Generative Adversarial Transformers. Proceedings of the International Conference on Machine Learning, Virtual."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1038\/s41597-020-0574-8","article-title":"TAASRAD19, a high-resolution weather radar reflectivity dataset for precipitation nowcasting","volume":"7","author":"Franch","year":"2020","journal-title":"Sci. Data"},{"key":"ref_31","unstructured":"Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks. arXiv."},{"key":"ref_32","unstructured":"Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6\u201311). Wasserstein generative adversarial networks. Proceedings of the International Conference on Machine Learning, Singapore."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3720\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T20:18:55Z","timestamp":1760127535000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/15\/3720"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,25]]},"references-count":32,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2023,8]]}},"alternative-id":["rs15153720"],"URL":"https:\/\/doi.org\/10.3390\/rs15153720","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,7,25]]}}}