{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,17]],"date-time":"2025-11-17T08:20:46Z","timestamp":1763367646408,"version":"build-2065373602"},"reference-count":34,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2023,10,29]],"date-time":"2023-10-29T00:00:00Z","timestamp":1698537600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"KMA Research and Development program \u201cDeveloping AI technology for weather forecasting\u201d","award":["KMA 2021-00121"],"award-info":[{"award-number":["KMA 2021-00121"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Precipitation nowcasting is critical for preventing damage to human life and the economy. Radar echo tracking methods such as optical flow algorithms have been widely employed for precipitation nowcasting because they can track precipitation motions well. Thus, this method, including the McGill algorithm for precipitation nowcasting by Lagrangian extrapolation (MAPLE), was implemented for operational precipitation nowcasting. However, advection-based methods struggle to predict the nonlinear motions of precipitation fields and dynamic processes, such as the growth and decay of precipitation. This study proposes an enhanced optical flow model using a multi-temporal optical flow field and a conditional generative adversarial network (cGAN). We trained the proposed model using a 3-year radar dataset provided by the Korean Meteorological Administration and performed forecast skill evaluations using both qualitative and quantitative methods. In particular, the model featuring multi-temporal optical flow enhances prediction accuracy for the nonlinear motion of precipitation fields, and the model\u2019s accuracy can be further improved through the use of the cGAN structure. We have verified that these improvements hold for 0\u20133 h lead times. Based on this performance enhancement, we conclude that the multi-temporal optical flow model with cGAN has a potential role in operational precipitation nowcasting.<\/jats:p>","DOI":"10.3390\/rs15215169","type":"journal-article","created":{"date-parts":[[2023,10,30]],"date-time":"2023-10-30T13:20:07Z","timestamp":1698672007000},"page":"5169","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Enhancing Rainfall Nowcasting Using Generative Deep Learning Model with Multi-Temporal Optical Flow"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7670-4897","authenticated-orcid":false,"given":"Ji-Hoon","family":"Ha","sequence":"first","affiliation":[{"name":"National Institute of Meteorological Sciences, Jeju 63568, Republic of Korea"}]},{"given":"Hyesook","family":"Lee","sequence":"additional","affiliation":[{"name":"National Institute of Meteorological Sciences, Jeju 63568, Republic of Korea"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"1387","DOI":"10.5194\/gmd-12-1387-2019","article-title":"Optical flow models as an open benchmark for radar-based precipitation nowcasting (rainymotion v0.1)","volume":"12","author":"Ayzel","year":"2019","journal-title":"Geosci. Model Dev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2637","DOI":"10.1175\/JTECH-D-17-0110.1","article-title":"An Enhanced Optical Flow Technique for Radar Nowcasting of Precipitation and Winds","volume":"34","author":"Bechini","year":"2017","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.jhydrol.2003.11.011","article-title":"Development of a precipitation nowcasting algorithm based upon optical flow techniques","volume":"288","author":"Bowler","year":"2004","journal-title":"J. Hydrol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"4185","DOI":"10.5194\/gmd-12-4185-2019","article-title":"Pysteps: An open-source Python library for probabilistic precipitation nowcasting (v1.0)","volume":"12","author":"Pulkkinen","year":"2019","journal-title":"Geosci. Model Dev."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"6624","DOI":"10.1002\/wrcr.20536","article-title":"Formulation and evaluation of a scale decomposition-based stochastic precipitation nowcast scheme","volume":"49","author":"Seed","year":"2013","journal-title":"Water Resour. Res."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/s13143-010-1009-9","article-title":"McGill Algorithm for Precipitation Nowcasting by Lagrangian Extrapolation (MAPLE) Applied to the South Korean Radar Network. Part II: Real-Time Verification for the Summer Season","volume":"46","author":"Shi","year":"2010","journal-title":"Asia-Pac. J. Atmos. Sci."},{"key":"ref_7","unstructured":"Shi, X., Chen, Z., Wang, H., Yeung, D.-Y., Wong, W.-K., and Woo, W.-C. (2015, January 7\u201310). Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting. Proceedings of the Advances in Neural Information Processing Systems, Proceedings of the Conference on Neural Information Processing Systems, New Orleans, Louisiana."},{"key":"ref_8","unstructured":"Shi, X., Gao, Z., Lausen, L., Wang, H., and Yeung, D.-Y. (2017, January 4\u20139). Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model. Proceedings of the Advances in Neural Information Processing Systems, Proceedings of the Conference on Neural Information Processing Systems, Long Beach, CA, USA."},{"key":"ref_9","unstructured":"S\u00f8nderby, C.K., Espeholt, L., Heek, J., Dehghani, M., Oliver, A., Salimans, T., and Kalchbrenner, N. (2020). Metnet: A neural weather model for precipitation forecasting. arXiv."},{"key":"ref_10","unstructured":"Agrawal, S., Barrington, L., Bromberg, C., Burge, J., Gazen, C., and Hickey, J. (2019). Machine learning for precipitation nowcasting from radar images. arXiv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2631","DOI":"10.5194\/gmd-13-2631-2020","article-title":"RainNet v1.0: A convolutional neural network for radar-based precipitation nowcasting","volume":"13","author":"Ayzel","year":"2020","journal-title":"Geosci. Model Dev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"105072","DOI":"10.1016\/j.cageo.2022.105072","article-title":"Effective training strategies for deep-learning-based precipitation nowcasting and estimation","volume":"161","author":"Ko","year":"2022","journal-title":"Comput. Geosci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lebedev, V., Ivashkin, V., Rudenko, I., Ganshin, A., Molchanov, A., Ovcharenko, S., Grokhovetskiy, R., Bushmarinov, I., and Solomentsev, D. (2019, January 4\u20138). Precipitation nowcasting with satellite imagery. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330762"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1007\/s13143-022-00310-4","article-title":"Evaluation of Deep-Learning-Based Very Short-Term Rainfall Forecasts in South Korea","volume":"59","author":"Oh","year":"2023","journal-title":"Asia-Pac. J. Atmos. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"5967","DOI":"10.5194\/gmd-15-5967-2022","article-title":"Rad-cGAN v1.0: Radar-based precipitation nowcasting model with conditional generative adversarial networks for multiple dam domains","volume":"15","author":"Choi","year":"2022","journal-title":"Geosci. Model Dev."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"4104308","DOI":"10.1109\/TGRS.2021.3108812","article-title":"Very Short-Term Rainfall Prediction Using Ground Radar Observations and Conditional Generative Adversarial Networks","volume":"60","author":"Kim","year":"2022","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1038\/s41586-021-03854-z","article-title":"Skilful precipitation nowcasting using deep generative models of radar","volume":"597","author":"Ravuri","year":"2021","journal-title":"Nature"},{"key":"ref_18","unstructured":"Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014, January 8\u201313). Generative Adversarial Nets. Proceedings of the Advances in Neural Information Processing Systems, Proceedings of the Conference on Neural Information Processing Systems, Montreal, QC, Canada."},{"key":"ref_19","unstructured":"Mirza, M., and Osindero, S. (2014). 2014: Conditional generative adversarial nets. arXiv."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1016\/j.atmosres.2014.02.024","article-title":"Perception and use of uncertainty in severe weather warnings by emergency services in Germany","volume":"158\u2013159","author":"Kox","year":"2015","journal-title":"Atmos. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e2053","DOI":"10.1002\/met.2053","article-title":"Use and perception of weather forecast information across Europe","volume":"29","author":"Sivle","year":"2022","journal-title":"Meteorol. Appl."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Jiang, H., Sun, D., Jampani, V., Yang, M.-H., Learned-Miller, E., and Kautz, J. (2018, January 18\u201323). Super slomo: High quality estimation of multiple intermediate frames for video interpolation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00938"},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Liu, M., Xu, C., Yao, C., Lin, C., and Zhao, Y. (2022). 2022: JNMR: Joint Non-linear Motion Regression for Video Frame Interpolation. arXiv.","DOI":"10.1109\/TIP.2023.3315122"},{"key":"ref_24","unstructured":"Liu, Y., Xie, L., Siyao, L., Sun, W., Qiao, Y., and Dong, C. (2020). Computer Vision\u2013ECCV 2020 Workshops, Springer International Publishing. Part IV 16."},{"key":"ref_25","unstructured":"Xu, X., Siyao, L., Sun, W., Yin, A., and Yang, M.-H. (2019, January 8\u201314). Quadratic video interpolation. Proceedings of the Advances in Neural Information Processing Systems, Proceedings of the Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_26","unstructured":"Zhang, Y., Wang, C., and Tao, D. (2020, January 6\u201312). Video frame interpolation without temporal priors. Proceedings of the Advances in Neural Information Processing Systems, Proceedings of the Conference on Neural Information Processing Systems, Online."},{"key":"ref_27","unstructured":"Seo, M., Choi, Y., Ryu, H., Park, H., Bae, H., Lee, H., and Seo, W. (2022, January 18). Intermediate and Future Frame Prediction of Geostationary Satellite Imagery with Warp and Refine Network. Proceedings of the AAAI 2022 Fall Symposium: The Role of AI in Responding to Climate Challenges, Arlington, VA, USA."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/j.jhydrol.2015.08.063","article-title":"Inter-comparison of radar rainfall rate using Constant Altitude Plan Position Indicator and hybrid surface rainfall maps","volume":"531","author":"Kwon","year":"2015","journal-title":"J. Hydrol."},{"key":"ref_29","unstructured":"Wedel, A., Pock, T., Zach, C., Bischof, H., and Cremers, D. (2009). Statistical and Geometrical Approaches to Visual Motion Analysis, Springer."},{"key":"ref_30","unstructured":"Arfken, G.B., and Weber, H.J. (2005). Mathematical Methods for Physicists, International Edition, Academic Press. [6th ed.]."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2296","DOI":"10.1109\/TGRS.2010.2103946","article-title":"Scale Filtering for Improved Nowcasting Performance in a High-Resolution X-Band Radar Network","volume":"49","author":"Ruzanski","year":"2011","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Isola, P., Zhu, J., Zhou, T., and Efros, A.A. (2017, January 21\u201326). Image-to-Image Translation with conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.632"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"6.1","DOI":"10.1175\/AMSMONOGRAPHS-D-16-0013.1","article-title":"Ice-Phase Precipitation","volume":"58","author":"Gultepe","year":"2017","journal-title":"Meteorol. Monogr."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/21\/5169\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:13:53Z","timestamp":1760130833000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/15\/21\/5169"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,29]]},"references-count":34,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["rs15215169"],"URL":"https:\/\/doi.org\/10.3390\/rs15215169","relation":{},"ISSN":["2072-4292"],"issn-type":[{"type":"electronic","value":"2072-4292"}],"subject":[],"published":{"date-parts":[[2023,10,29]]}}}