{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T03:54:15Z","timestamp":1768881255073,"version":"3.49.0"},"reference-count":33,"publisher":"MDPI AG","issue":"24","license":[{"start":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T00:00:00Z","timestamp":1734912000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"National Key Research and Development Program of China","award":["2022YFB3902200"],"award-info":[{"award-number":["2022YFB3902200"]}]},{"name":"National Key Research and Development Program of China","award":["42071318"],"award-info":[{"award-number":["42071318"]}]},{"name":"National Key Research and Development Program of China","award":["241111212800"],"award-info":[{"award-number":["241111212800"]}]},{"name":"National Key Research and Development Program of China","award":["232102240020"],"award-info":[{"award-number":["232102240020"]}]},{"name":"National Key Research and Development Program of China","award":["2023DT012"],"award-info":[{"award-number":["2023DT012"]}]},{"name":"National Key Research and Development Program of China","award":["AIRSE202408"],"award-info":[{"award-number":["AIRSE202408"]}]},{"name":"National Natural Science Foundation of China","award":["2022YFB3902200"],"award-info":[{"award-number":["2022YFB3902200"]}]},{"name":"National Natural Science Foundation of China","award":["42071318"],"award-info":[{"award-number":["42071318"]}]},{"name":"National Natural Science Foundation of China","award":["241111212800"],"award-info":[{"award-number":["241111212800"]}]},{"name":"National Natural Science Foundation of China","award":["232102240020"],"award-info":[{"award-number":["232102240020"]}]},{"name":"National Natural Science Foundation of China","award":["2023DT012"],"award-info":[{"award-number":["2023DT012"]}]},{"name":"National Natural Science Foundation of China","award":["AIRSE202408"],"award-info":[{"award-number":["AIRSE202408"]}]},{"name":"Key R&amp;D Projects in Henan Province","award":["2022YFB3902200"],"award-info":[{"award-number":["2022YFB3902200"]}]},{"name":"Key R&amp;D Projects in Henan Province","award":["42071318"],"award-info":[{"award-number":["42071318"]}]},{"name":"Key R&amp;D Projects in Henan Province","award":["241111212800"],"award-info":[{"award-number":["241111212800"]}]},{"name":"Key R&amp;D Projects in Henan Province","award":["232102240020"],"award-info":[{"award-number":["232102240020"]}]},{"name":"Key R&amp;D Projects in Henan Province","award":["2023DT012"],"award-info":[{"award-number":["2023DT012"]}]},{"name":"Key R&amp;D Projects in Henan Province","award":["AIRSE202408"],"award-info":[{"award-number":["AIRSE202408"]}]},{"name":"Scientific and Technological Key Project in Henan Province","award":["2022YFB3902200"],"award-info":[{"award-number":["2022YFB3902200"]}]},{"name":"Scientific and Technological Key Project in Henan Province","award":["42071318"],"award-info":[{"award-number":["42071318"]}]},{"name":"Scientific and Technological Key Project in Henan Province","award":["241111212800"],"award-info":[{"award-number":["241111212800"]}]},{"name":"Scientific and Technological Key Project in Henan Province","award":["232102240020"],"award-info":[{"award-number":["232102240020"]}]},{"name":"Scientific and Technological Key Project in Henan Province","award":["2023DT012"],"award-info":[{"award-number":["2023DT012"]}]},{"name":"Scientific and Technological Key Project in Henan Province","award":["AIRSE202408"],"award-info":[{"award-number":["AIRSE202408"]}]},{"name":"China University Research Innovation Fund","award":["2022YFB3902200"],"award-info":[{"award-number":["2022YFB3902200"]}]},{"name":"China University Research Innovation Fund","award":["42071318"],"award-info":[{"award-number":["42071318"]}]},{"name":"China University Research Innovation Fund","award":["241111212800"],"award-info":[{"award-number":["241111212800"]}]},{"name":"China University Research Innovation Fund","award":["232102240020"],"award-info":[{"award-number":["232102240020"]}]},{"name":"China University Research Innovation Fund","award":["2023DT012"],"award-info":[{"award-number":["2023DT012"]}]},{"name":"China University Research Innovation Fund","award":["AIRSE202408"],"award-info":[{"award-number":["AIRSE202408"]}]},{"name":"Beijing Engineering Research Center of Aerial Intelligent Remote Sensing Equipments Fund","award":["2022YFB3902200"],"award-info":[{"award-number":["2022YFB3902200"]}]},{"name":"Beijing Engineering Research Center of Aerial Intelligent Remote Sensing Equipments Fund","award":["42071318"],"award-info":[{"award-number":["42071318"]}]},{"name":"Beijing Engineering Research Center of Aerial Intelligent Remote Sensing Equipments Fund","award":["241111212800"],"award-info":[{"award-number":["241111212800"]}]},{"name":"Beijing Engineering Research Center of Aerial Intelligent Remote Sensing Equipments Fund","award":["232102240020"],"award-info":[{"award-number":["232102240020"]}]},{"name":"Beijing Engineering Research Center of Aerial Intelligent Remote Sensing Equipments Fund","award":["2023DT012"],"award-info":[{"award-number":["2023DT012"]}]},{"name":"Beijing Engineering Research Center of Aerial Intelligent Remote Sensing Equipments Fund","award":["AIRSE202408"],"award-info":[{"award-number":["AIRSE202408"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Radar echo extrapolation by ground-based remote sensing is essential for weather prediction and flight guiding. Existing radar echo extrapolation methods can hardly capture complex spatiotemporal features, resulting in the low accuracy of predictions, and, therefore, severely restrict their use in extreme weather situations. A deep learning method was recently applied for extrapolating radar echoes; however, its accuracy declines too quickly over a short time. In this study, we introduce a solution: Residual Transformer and Unet (ResTUnet), a novel model that improves prediction accuracy and exhibits good stability with a slow rate of accuracy decline. This presented Rest-Net model is designed to solve the issue of declining prediction accuracy by integrating a 1*1 convolution to diminish the neural network parameters. We constructed an observed dataset by Zhengzhou East Airport radar observation from July 2022 to August 2022 and performed 90 min experiments comprising five aspects, including extrapolation images, the Probability of Detection (POD) index, the Critical Success Index (CSI), the False Alarm Rate (FAR) index, and the Heidke Skill Score (HSS) index. The experimental results show that the ResTUnet model improved the CSI, HSS index, and the POD index by 17.20%, 11.97%, and 11.35%, compared to current models, including Convolutional Long Short-Term Memory (convLSTM), the Convolutional Gated Recurrent Unit (convGRU), the Trajectory Gated Recurrent Unit (TrajGRU), and the improved recurrent network for video predictive learning, the Predictive Recurrent Neural Network++ (predRNN++). In addition, the mean squared error of the ResTUnet model remains stable at 15% between 0 and 60 min and starts to increase after 60\u201390 min, which is 12% better than the current models. This enhancement in prediction accuracy has practical applications in meteorological services and decision making.<\/jats:p>","DOI":"10.3390\/rs16244792","type":"journal-article","created":{"date-parts":[[2024,12,23]],"date-time":"2024-12-23T09:13:38Z","timestamp":1734945218000},"page":"4792","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["ResTUnet: A Novel Neural Network Model for Nowcasting Using Radar Echo Sequences by Ground-Based Remote Sensing"],"prefix":"10.3390","volume":"16","author":[{"given":"Lei","family":"Zhang","sequence":"first","affiliation":[{"name":"Henan Key Laboratory of Big Data Analysis and Processing, Henan University, Kaifeng 475004, China"},{"name":"School of Computer and Information Engineering, Henan University, Kaifeng 475004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ruoyang","family":"Zhang","sequence":"additional","affiliation":[{"name":"Henan Key Laboratory of Big Data Analysis and Processing, Henan University, Kaifeng 475004, China"},{"name":"School of Computer and Information Engineering, Henan University, Kaifeng 475004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yu","family":"Wu","sequence":"additional","affiliation":[{"name":"Institute of Surface-Earth System Science, School of Earth System Science, Tianjin University, Tianjin 300072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yadong","family":"Wang","sequence":"additional","affiliation":[{"name":"Henan Key Laboratory of Big Data Analysis and Processing, Henan University, Kaifeng 475004, China"},{"name":"School of Computer and Information Engineering, Henan University, Kaifeng 475004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanfeng","family":"Zhang","sequence":"additional","affiliation":[{"name":"Henan Key Laboratory of Big Data Analysis and Processing, Henan University, Kaifeng 475004, China"},{"name":"School of Computer and Information Engineering, Henan University, Kaifeng 475004, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lijuan","family":"Zheng","sequence":"additional","affiliation":[{"name":"Land Satellite Remote Sensing Application Center, Ministry of Natural Resources of China, Beijing 100048, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chongbin","family":"Xu","sequence":"additional","affiliation":[{"name":"Beijing Institute of Space Mechanics & Electricity, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xin","family":"Zuo","sequence":"additional","affiliation":[{"name":"Beijing Institute of Space Mechanics & Electricity, Beijing 100094, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zeyu","family":"Wang","sequence":"additional","affiliation":[{"name":"Institute of Surface-Earth System Science, School of Earth System Science, Tianjin University, Tianjin 300072, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,23]]},"reference":[{"key":"ref_1","unstructured":"Reyniers, M. (2008). Quantitative Precipitation Forecasts Based on Radar Observations: Principles, Algorithms and Operational Systems, Institut Royal M\u00e9t\u00e9orologique de Belgique."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"2079","DOI":"10.1175\/1520-0477(1998)079<2079:NTASR>2.0.CO;2","article-title":"Nowcasting thunderstorms: A status report","volume":"79","author":"Wilson","year":"1998","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2689","DOI":"10.1175\/MWR-D-11-00181.1","article-title":"The diurnal cycle of precipitation from continental radar mosaics and numerical weather prediction models. part ii: Intercomparison among numerical models and with nowcasting","volume":"140","author":"Berenguer","year":"2012","journal-title":"Mon. Weather Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"e2019EA000812","DOI":"10.1029\/2019EA000812","article-title":"A deep learning-based methodology for precipitation nowcasting with radar","volume":"7","author":"Chen","year":"2020","journal-title":"Earth Space Sci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1038\/273287a0","article-title":"Three-dimensional storm motion detection by conventional weather radar","volume":"273","author":"Rinehart","year":"1978","journal-title":"Nature"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1286","DOI":"10.1175\/1520-0450(1995)034<1286:NOMAGO>2.0.CO;2","article-title":"Nowcasting of motion and growth of precipitation with radar over a complex orography","volume":"34","author":"Li","year":"1995","journal-title":"J. Appl. Meteorol. Climatol."},{"key":"ref_7","first-page":"690","article-title":"Improvement and application test of trec algorithm for convective storm nowcast","volume":"18","author":"Mingxuan","year":"2007","journal-title":"J. Appl. Meteorol. Sci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"74","DOI":"10.1016\/j.jhydrol.2003.11.011","article-title":"Development of a precipitation nowcasting algorithm based upon optical flow techniques","volume":"288","author":"Bowler","year":"2004","journal-title":"J. Hydrol."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Woo, W.C., and Wong, W.K. (2017). Operational application of optical flow techniques to radar-based rainfall nowcasting. Atmosphere, 8.","DOI":"10.3390\/atmos8030048"},{"key":"ref_10","first-page":"4103508","article-title":"Convective precipitation nowcasting using u-net model","volume":"60","author":"Han","year":"2021","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_11","first-page":"802","article-title":"Convolutional LSTM network: A machine learning approach for precipitation nowcasting","volume":"28","author":"Shi","year":"2015","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_12","first-page":"5622","article-title":"Deep learning for precipitation nowcasting: A benchmark and a new model","volume":"30","author":"Shi","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_13","first-page":"879","article-title":"Predrnn: Recurrent neural networks for predictive learning using spatiotemporal lstms","volume":"30","author":"Wang","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_14","unstructured":"Wang, Y., Gao, Z., Long, M., Wang, J., and Philip, S.Y. (2018, January 10\u201315). Predrnn++: Towards a resolution of the deep-in-time dilemma in spatiotemporal predictive learning. Proceedings of the International Conference on Machine Learning, PMLR, Stockholm, Sweden."},{"key":"ref_15","unstructured":"S\u00f8nderby, C.K., Espeholt, L., Heek, J., Dehghani, M., Oliver, A., Salimans, T., Agrawal, S., Hickey, J., and Kalchbrenner, N. (2020). Metnet: A neural weather model for precipitation forecasting. arXiv."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015). U-net: Convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015, Proceedings of the 18th International Conference, Munich, Germany, 5\u20139 October 2015, Springer. Part III 18.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.patrec.2021.01.036","article-title":"Smaat-unet: Precipitation nowcasting using a small attention-unet architecture","volume":"145","author":"Trebing","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"5145","DOI":"10.1038\/s41467-022-32483-x","article-title":"Deep learning for twelve hour precipitation forecasts","volume":"13","author":"Espeholt","year":"2022","journal-title":"Nat. Commun."},{"key":"ref_19","first-page":"15475","article-title":"Rest: An efficient transformer for visual recognition","volume":"34","author":"Zhang","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"2680","DOI":"10.1029\/2019MS001705","article-title":"Can machines learn to predict weather? using deep learning to predict gridded 500-hpa geopotential height from historical weather data","volume":"11","author":"Weyn","year":"2019","journal-title":"J. Adv. Model. Earth Syst."},{"key":"ref_21","first-page":"6000","article-title":"Attention is all you need","volume":"30","author":"Vaswani","year":"2017","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_22","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V. (2016). Instance normalization: The missing ingredient for fast stylization. arXiv."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Chollet, F. (2017, January 21\u201326). Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.195"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1175\/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2","article-title":"The critical success index as an indicator of warning skill","volume":"5","author":"Schaefer","year":"1990","journal-title":"Weather Forecast."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1017\/S1350482701003061","article-title":"How to judge the quality and value of weather forecast products","volume":"8","author":"Thornes","year":"2001","journal-title":"Meteorol. Appl."},{"key":"ref_26","unstructured":"PLi, W., Wong, W.K., Chan, K.Y., and Lai, E.S.T. (2000). SWIRLS\u2014An Evolving Nowcasting System, Hong Kong Special Administrative Region Government."},{"key":"ref_27","first-page":"1525","article-title":"Root mean square error (rmse) or mean absolute error (mae)","volume":"7","author":"Chai","year":"2014","journal-title":"Geosci. Model Dev. Discuss."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Zhang, Z. (2018, January 4\u20136). Improved adam optimizer for deep neural networks. Proceedings of the 2018 IEEE\/ACM 26th International Symposium on Quality of Service (IWQoS), Banff, AB, Canada.","DOI":"10.1109\/IWQoS.2018.8624183"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Wang, D., Yang, Y., and Ning, S. (2018, January 8\u201313). Deepstcl: A deep spatiotemporal convlstm for travel demand prediction. Proceedings of the 2018 International Joint Conference on Neural Networks (IJCNN), Rio de Janeiro, Brazil.","DOI":"10.1109\/IJCNN.2018.8489530"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1109\/LGRS.2019.2926776","article-title":"A generative adversarial gated recurrent unit model for precipitation nowcasting","volume":"17","author":"Tian","year":"2019","journal-title":"IEEE Geosci. Remote Sens. Lett."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"126776","DOI":"10.1016\/j.jclepro.2021.126776","article-title":"Weather radar echo prediction method based on convolution neural network and long short-term memory networks for sustainable e-agriculture","volume":"298","author":"Zhang","year":"2021","journal-title":"J. Clean. Prod."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"104761","DOI":"10.1016\/j.envsoft.2020.104761","article-title":"Distributed long-term hourly streamflow predictions using deep learning\u2013a case study for state of iowa","volume":"131","author":"Xiang","year":"2020","journal-title":"Environ. Model. Softw."},{"key":"ref_33","unstructured":"Cui, Z., Chen, W., and Chen, Y. (2016). Multi-scale convolutional neural networks for time series classification. arXiv."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/24\/4792\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:58:11Z","timestamp":1760115491000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/16\/24\/4792"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,23]]},"references-count":33,"journal-issue":{"issue":"24","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["rs16244792"],"URL":"https:\/\/doi.org\/10.3390\/rs16244792","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,23]]}}}