{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T18:04:33Z","timestamp":1771697073182,"version":"3.50.1"},"reference-count":34,"publisher":"MDPI AG","issue":"18","license":[{"start":{"date-parts":[[2021,9,11]],"date-time":"2021-09-11T00:00:00Z","timestamp":1631318400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>Quantitative precipitation prediction is essential for managing water-related disasters, including floods, landslides, tsunamis, and droughts. Recent advances in data-driven approaches using deep learning techniques provide improved precipitation nowcasting performance. Moreover, it has been known that multi-modal information from various sources could improve deep learning performance. This study introduces the RAIN-F+ dataset, which is the fusion dataset for rainfall prediction, and proposes the benchmark models for precipitation prediction using the RAIN-F+ dataset. The RAIN-F+ dataset is an integrated weather observation dataset including radar, surface station, and satellite observations covering the land area over the Korean Peninsula. The benchmark model is developed based on the U-Net architecture with residual upsampling and downsampling blocks. We examine the results depending on the number of the integrated dataset for training. Overall, the results show that the fusion dataset outperforms the radar-only dataset over time. Moreover, the results with the radar-only dataset show the limitations in predicting heavy rainfall over 10 mm\/h. This suggests that the various information from multi-modality is crucial for precipitation nowcasting when applying the deep learning method.<\/jats:p>","DOI":"10.3390\/rs13183627","type":"journal-article","created":{"date-parts":[[2021,9,12]],"date-time":"2021-09-12T21:48:01Z","timestamp":1631483281000},"page":"3627","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["RAIN-F+: The Data-Driven Precipitation Prediction Model for Integrated Weather Observations"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8212-1126","authenticated-orcid":false,"given":"Yeji","family":"Choi","sequence":"first","affiliation":[{"name":"SI-Analytics, 70 Yuseong-daero 1689 beon-gil, Yuseong-gu, Daejeon 34047, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3399-4438","authenticated-orcid":false,"given":"Keumgang","family":"Cha","sequence":"additional","affiliation":[{"name":"SI-Analytics, 70 Yuseong-daero 1689 beon-gil, Yuseong-gu, Daejeon 34047, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6235-5806","authenticated-orcid":false,"given":"Minyoung","family":"Back","sequence":"additional","affiliation":[{"name":"SI-Analytics, 70 Yuseong-daero 1689 beon-gil, Yuseong-gu, Daejeon 34047, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5277-6113","authenticated-orcid":false,"given":"Hyunguk","family":"Choi","sequence":"additional","affiliation":[{"name":"SI-Analytics, 70 Yuseong-daero 1689 beon-gil, Yuseong-gu, Daejeon 34047, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Taegyun","family":"Jeon","sequence":"additional","affiliation":[{"name":"SI-Analytics, 70 Yuseong-daero 1689 beon-gil, Yuseong-gu, Daejeon 34047, Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,9,11]]},"reference":[{"key":"ref_1","unstructured":"Xingjian, S., Chen, Z., Wang, H., Yeung, D.Y., Wong, W.K., and Woo, W.C. (2015, January 7\u201312). Convolutional LSTM network: A machine learning approach for precipitation nowcasting. Proceedings of the Advances in Neural Information Processing Systems, Montreal, QC, USA."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1007\/s12040-012-0212-8","article-title":"Sensitivity of tropical cyclone Jal simulations to physics parameterizations","volume":"121","author":"Chandrasekar","year":"2012","journal-title":"J. Earth Syst. Sci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2773","DOI":"10.1109\/JSTARS.2018.2840491","article-title":"Nowcasting of precipitation in the high-resolution Dallas\u2013Fort Worth (DFW) urban radar remote sensing network","volume":"11","author":"Pulkkinen","year":"2018","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1369","DOI":"10.1109\/JSTARS.2019.2908974","article-title":"Fully spectral method for radar-based precipitation nowcasting","volume":"12","author":"Pulkkinen","year":"2019","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"971","DOI":"10.1175\/JTECH-D-18-0242.1","article-title":"Stochastic spectral method for radar-based probabilistic precipitation nowcasting","volume":"36","author":"Pulkkinen","year":"2019","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"7845","DOI":"10.1109\/TGRS.2020.2984594","article-title":"Nowcasting of convective rainfall using volumetric radar observations","volume":"58","author":"Pulkkinen","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1175\/JTECH-D-18-0192.1","article-title":"CASA Prediction System over Dallas\u2013Fort Worth Urban Network: Blending of Nowcasting and High-Resolution Numerical Weather Prediction Model","volume":"37","author":"Radhakrishnan","year":"2020","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_8","unstructured":"S\u00f8nderby, C.K., Espeholt, L., Heek, J., Dehghani, M., Oliver, A., Salimans, T., Agrawal, S., Hickey, J., and Kalchbrenner, N. (2020). Metnet: A neural weather model for precipitation forecasting. arXiv."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1016\/j.patrec.2021.01.036","article-title":"SmaAt-UNet: Precipitation nowcasting using a small attention-UNet architecture","volume":"145","author":"Trebing","year":"2021","journal-title":"Pattern Recognit. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kumar, A., Islam, T., Sekimoto, Y., Mattmann, C., and Wilson, B. (2020). Convcast: An embedded convolutional LSTM based architecture for precipitation nowcasting using satellite data. PLoS ONE, 15.","DOI":"10.1371\/journal.pone.0230114"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2631","DOI":"10.5194\/gmd-13-2631-2020","article-title":"RainNet v1. 0: A convolutional neural network for radar-based precipitation nowcasting","volume":"13","author":"Ayzel","year":"2020","journal-title":"Geosci. Model Dev."},{"key":"ref_12","unstructured":"de Witt, C.S., Tong, C., Zantedeschi, V., De Martini, D., Kalaitzis, A., Chantry, M., Watson-Parris, D., and Bilinski, P. (2021, January 2\u20139). RainBench: Towards Data-Driven Global Precipitation Forecasting from Satellite Imagery. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual Event, online."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"4340","DOI":"10.1109\/TGRS.2020.3016820","article-title":"More diverse means better: Multimodal deep learning meets remote-sensing imagery classification","volume":"59","author":"Hong","year":"2020","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_14","first-page":"423","article-title":"Multimodal machine learning: A survey and taxonomy","volume":"41","author":"Ahuja","year":"2018","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.inffus.2017.10.006","article-title":"A survey on deep learning for big data","volume":"42","author":"Zhang","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5971","DOI":"10.1109\/JSTARS.2020.3010879","article-title":"Multimodal Deep Learning for Heterogeneous GNSS-R Data Fusion and Ocean Wind Speed Retrieval","volume":"13","author":"Chu","year":"2020","journal-title":"IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1175\/JTECH-D-19-0146.1","article-title":"A deep learning network for cloud-to-ground lightning nowcasting with multisource data","volume":"37","author":"Zhou","year":"2020","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Miao, K., Wang, W., Hu, R., Zhang, L., Zhang, Y., Wang, X., and Nian, F. (2020). Multimodal Semisupervised Deep Graph Learning for Automatic Precipitation Nowcasting. Math. Probl. Eng., 2020.","DOI":"10.1155\/2020\/4018042"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Li, G., and Choi, Y. (2021). HPC cluster-based user-defined data integration platform for deep learning in geoscience applications. Comput. Geosci., 104868.","DOI":"10.1016\/j.cageo.2021.104868"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"234","DOI":"10.1016\/j.jhydrol.2015.08.063","article-title":"Inter-comparison of radar rainfall rate using constant altitude plan position indicator and hybrid surface rainfall maps","volume":"531","author":"Kwon","year":"2015","journal-title":"J. Hydrol."},{"key":"ref_21","first-page":"26","article-title":"NASA global precipitation measurement (GPM) integrated multi-satellite retrievals for GPM (IMERG)","volume":"4","author":"Huffman","year":"2015","journal-title":"Algorithm Theor. Basis Doc. Version"},{"key":"ref_22","unstructured":"Balaji, C., Krishnamoorthy, C., and Chandrasekar, R. (2014). On the possibility of retrieving near-surface rain rate from the microwave sounder SAPHIR of the Megha-Tropiques mission. Curr. Sci., 587\u2013593."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Ramanujam, S., Chandrasekar, R., and Chakravarthy, B. (2011). A new PCA-ANN algorithm for retrieval of rainfall structure in a precipitating atmosphere. Int. J. Numer. Methods Heat Fluid Flow.","DOI":"10.1108\/09615531111177769"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2265","DOI":"10.1175\/JTECH-D-15-0039.1","article-title":"The evolution of the Goddard profiling algorithm to a fully parametric scheme","volume":"32","author":"Kummerow","year":"2015","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2366","DOI":"10.1109\/TGRS.2019.2948262","article-title":"Passive Microwave Precipitation Retrieval Algorithm with A Priori Databases of Various Cloud Microphysics Schemes: Tropical Cyclone Applications","volume":"58","author":"Choi","year":"2019","journal-title":"IEEE Trans. Geosci. Remote Sens."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Takenaka, H., Sakashita, T., Higuchi, A., and Nakajima, T. (2020). Geolocation correction for geostationary satellite observations by a phase-only correlation method using a visible channel. Remote Sens., 12.","DOI":"10.3390\/rs12152472"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Yamamoto, Y., Ichii, K., Higuchi, A., and Takenaka, H. (2020). Geolocation accuracy assessment of Himawari-8\/AHI imagery for application to terrestrial monitoring. Remote Sens., 12.","DOI":"10.3390\/rs12091372"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Choi, Y., Cha, K., Back, M., Choi, H., and Jeon, T. (2021, January 11\u201316). RAIN-F: A fusion dataset for rainfall prediction using convolutional neural network. Proceedings of the IGARSS 2021\u20142021 IEEE International Geoscience and Remote Sensing Symposium, Brussels, Belgium.","DOI":"10.1109\/IGARSS47720.2021.9555094"},{"key":"ref_29","unstructured":"Choi, Y. (2021, September 07). RAIN-F: Radar-AWS-IMERG Network Fusion Dataset for Precipitation Nowcasting. Available online: https:\/\/dataon.kisti.re.kr\/search\/view.do?mode=view&svcId=3a75ba8975fcc74572ced9ed5d58a7d1."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5\u20139). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Lebedev, V., Ivashkin, V., Rudenko, I., Ganshin, A., Molchanov, A., Ovcharenko, S., Grokhovetskiy, R., Bushmarinov, I., and Solomentsev, D. (2019, January 4\u20138). Precipitation nowcasting with satellite imagery. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.","DOI":"10.1145\/3292500.3330762"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.isprsjprs.2017.11.011","article-title":"Beyond RGB: Very high resolution urban remote sensing with multimodal deep networks","volume":"140","author":"Audebert","year":"2018","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1002\/met.1531","article-title":"Evaluation of the gap filler radar as an implementation of the 1.5 km CAPPI data in Korea","volume":"23","author":"Yoo","year":"2016","journal-title":"Meteorol. Appl."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/18\/3627\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T07:00:55Z","timestamp":1760166055000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/13\/18\/3627"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,11]]},"references-count":34,"journal-issue":{"issue":"18","published-online":{"date-parts":[[2021,9]]}},"alternative-id":["rs13183627"],"URL":"https:\/\/doi.org\/10.3390\/rs13183627","relation":{},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,9,11]]}}}