{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,15]],"date-time":"2026-06-15T22:55:48Z","timestamp":1781564148914,"version":"3.54.5"},"reference-count":59,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,5]],"date-time":"2022-08-05T00:00:00Z","timestamp":1659657600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100007569","name":"Carl-Zeiss-Stiftung","doi-asserted-by":"publisher","award":["P2018-02-003"],"award-info":[{"award-number":["P2018-02-003"]}],"id":[{"id":"10.13039\/100007569","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Remote Sensing"],"abstract":"<jats:p>While thunderstorms can pose severe risks to property and life, forecasting remains challenging, even at short lead times, as these often arise in meta-stable atmospheric conditions. In this paper, we examine the question of how well we could perform short-term (up to 180 min) forecasts using exclusively multi-spectral satellite images and past lighting events as data. We employ representation learning based on deep convolutional neural networks in an \u201cend-to-end\u201d fashion. Here, a crucial problem is handling the imbalance of the positive and negative classes appropriately in order to be able to obtain predictive results (which is not addressed by many previous machine-learning-based approaches). The resulting network outperforms previous methods based on physically based features and optical flow methods (similar to operational prediction models) and generalizes across different years. A closer examination of the classifier performance over time and under masking of input data indicates that the learned model actually draws most information from structures in the visible spectrum, with infrared imaging sustaining some classification performance during the night.<\/jats:p>","DOI":"10.3390\/rs14153760","type":"journal-article","created":{"date-parts":[[2022,8,9]],"date-time":"2022-08-09T04:16:55Z","timestamp":1660018615000},"page":"3760","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["End-to-End Prediction of Lightning Events from Geostationary Satellite Images"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8970-9523","authenticated-orcid":false,"given":"Sebastian","family":"Brodehl","sequence":"first","affiliation":[{"name":"Institute of Computer Science, Johannes Gutenberg University Mainz, 55128 Mainz, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0376-0393","authenticated-orcid":false,"given":"Richard","family":"M\u00fcller","sequence":"additional","affiliation":[{"name":"German Weather Service, 63067 Offenbach, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elmar","family":"Sch\u00f6mer","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, Johannes Gutenberg University Mainz, 55128 Mainz, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4008-4977","authenticated-orcid":false,"given":"Peter","family":"Spichtinger","sequence":"additional","affiliation":[{"name":"Institute for Atmospheric Physics, Johannes Gutenberg University Mainz, 55128 Mainz, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Wand","sequence":"additional","affiliation":[{"name":"Institute of Computer Science, Johannes Gutenberg University Mainz, 55128 Mainz, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,5]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Saunders, C. (2008). Charge separation mechanisms in clouds. Planetary Atmospheric Electricity, Springer.","DOI":"10.1007\/978-0-387-87664-1_22"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Pruppacher, H.R., and Klett, J.D. (2010). Microphysics of Clouds and Precipitation. Atmospheric and Oceanographic Sciences Library, Kluwer Academic Publishers.","DOI":"10.1007\/978-0-306-48100-0"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1002\/qj.2378","article-title":"The ICON (ICOsahedral Non-hydrostatic) modelling framework of DWD and MPI-M: Description of the non-hydrostatic dynamical core","volume":"141","author":"Reinert","year":"2015","journal-title":"Q. J. R. Meteorol. Soc."},{"key":"ref_4","unstructured":"Reinert, D., Prill, F., Frank, H., Denhard, M., Baldauf, M., Schraff, C., Gebhardt, C., Marsigli, C., and Z\u00e4ngl, G. (2021). DWD Database Reference for the Global and Regional ICON and ICON-EPS Forecasting System, DWD. Technical Report Version 2.1.7."},{"key":"ref_5","first-page":"2","article-title":"Nowcasting Guidelines\u2013A Summary","volume":"68","author":"Schmid","year":"2019","journal-title":"Bull. N\u00b0"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1175\/BAMS-D-11-00153.1","article-title":"Nowcasting: The Promise of New Technologies of Communication, Modeling, and Observation","volume":"93","author":"Mass","year":"2012","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_7","unstructured":"Oprea, S., Martinez-Gonzalez, P., Garcia-Garcia, A., Castro-Vargas, J.A., Orts-Escolano, S., Rodr\u00edguez, J.G., and Argyros, A.A. (2020). A Review on Deep Learning Techniques for Video Prediction. arXiv."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"55","DOI":"10.5194\/adgeo-17-55-2008","article-title":"Cell-tracking with lightning data from LINET","volume":"17","author":"Betz","year":"2008","journal-title":"Adv. Geosci."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cviu.2015.02.008","article-title":"Optical flow modeling and computation: A survey","volume":"134","author":"Fortun","year":"2015","journal-title":"Comput. Vis. Image Underst."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1175\/WAF-D-18-0038.1","article-title":"NowCastMIX: Automatic Integrated Warnings for Severe Convection on Nowcasting Time Scales at the German Weather Service, Weather and Forecasting","volume":"33","author":"James","year":"2018","journal-title":"Weather Forecast."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1016\/S0273-1177(97)00051-3","article-title":"Monitoring deep convection and convective overshooting with Meteosat","volume":"19","author":"Schmetz","year":"1997","journal-title":"Adv. Space Res."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"M\u00fcller, R., Haussler, S., Jerg, M., and Heizenreder, D. (2019). A Novel Approach for the Detection of Developing Thunderstorm Cells. Remote Sens., 11.","DOI":"10.3390\/rs11040443"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"2567","DOI":"10.1175\/WAF-D-20-0028.1","article-title":"A Deep-Learning Model for Automated Detection of Intense Midlatitude Convection Using Geostationary Satellite Images","volume":"35","author":"Cintineo","year":"2020","journal-title":"Weather Forecast."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"M\u00fcller, R., Barleben, A., Haussler, S., and Jerg, M. (2022). A Novel Approach for the Global Detection and Nowcasting of Deep Convection and Thunderstorms. Remote Sens., 14.","DOI":"10.20944\/preprints202206.0008.v1"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"2699","DOI":"10.5194\/amt-14-2699-2021","article-title":"Applying machine learning methods to detect convection using Geostationary Operational Environmental Satellite-16 (GOES-16) advanced baseline imager (ABI) data","volume":"14","author":"Lee","year":"2021","journal-title":"Atmos. Meas. Tech."},{"key":"ref_16","unstructured":"Autones, F. (2016). Algorithm Theoretical Basis Document for Convection Products, NWC-SAF (METEO-FRANCE). Technical report."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Gijben, M., and Coning, C. (2017). Using Satellite and Lightning Data to Track Rapidly Developing Thunderstorms in Data Sparse Regions. Atmosphere, 8.","DOI":"10.3390\/atmos8040067"},{"key":"ref_18","unstructured":"Teredesai, A., Kumar, V., Li, Y., Rosales, R., Terzi, E., and Karypis, G. (2019, January 4\u20138). The Error is the Feature: How to Forecast Lightning using a Model Prediction Error. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1039","DOI":"10.1175\/JAMC-D-14-0129.1","article-title":"Probabilistic 0\u20131-h convective initiation nowcasts that combine geostationary satellite observations and numerical weather prediction model data","volume":"54","author":"Mecikalski","year":"2015","journal-title":"J. Appl. Meteorol. Climatol."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1175\/JTECH-D-19-0146.1","article-title":"A Deep Learning Network for Cloud-to-Ground Lightning Nowcasting with Multisource Data","volume":"37","author":"Zhou","year":"2020","journal-title":"J. Atmos. Ocean. Technol."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20\u201325). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami Beach, FL, USA.","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"ref_22","unstructured":"Pereira, F., Burges, C.J.C., Bottou, L., and Weinberger, K.Q. (2012). ImageNet Classification with Deep Convolutional Neural Networks. Advances in Neural Information Processing Systems, Curran Associates, Inc."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27\u201330). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.","DOI":"10.1109\/CVPR.2016.90"},{"key":"ref_24","first-page":"234","article-title":"U-Net: Convolutional Networks for Biomedical Image Segmentation","volume":"9351","author":"Navab","year":"2015","journal-title":"Lecture Notes in Computer Science, Proceedings of the Medical Image Computing and Computer-Assisted Intervention\u2014MICCAI 2015\u201418th International Conference, Munich, Germany, 5\u20139 October 2015"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Dewitte, S., Cornelis, J., M\u00fcller, R., and Munteanu, A. (2021). Artificial Intelligence Revolutionises Weather Forecast, Climate Monitoring and Decadal Prediction. Remote Sens., 13.","DOI":"10.3390\/rs13163209"},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Hoeser, T., and K\u00fcnzer, C. (2020). Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review-Part I: Evolution and Recent Trends. Remote Sens., 12.","DOI":"10.3390\/rs12101667"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Hoeser, T., Bachofer, F., and Kuenzer, C. (2020). Object Detection and Image Segmentation with Deep Learning on Earth Observation Data: A Review - Part II: Applications. Remote Sens., 12.","DOI":"10.3390\/rs12183053"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1016\/j.isprsjprs.2019.04.015","article-title":"Deep learning in remote sensing applications: A meta-analysis and review","volume":"152","author":"Ma","year":"2019","journal-title":"ISPRS J. Photogramm. Remote Sens."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"ES473","DOI":"10.1175\/BAMS-D-18-0324.1","article-title":"Leveraging Modern Artificial Intelligence for Remote Sensing and NWP: Benefits and Challenges","volume":"100","author":"Boukabara","year":"2019","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2631","DOI":"10.5194\/gmd-13-2631-2020","article-title":"RainNet v1.0: A convolutional neural network for radar-based precipitation nowcasting","volume":"13","author":"Ayzel","year":"2020","journal-title":"Geosci. Model Dev."},{"key":"ref_31","unstructured":"Teredesai, A., Kumar, V., Li, Y., Rosales, R., Terzi, E., and Karypis, G. Precipitation Nowcasting with Satellite Imagery. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, KDD 2019, Anchorage, AK, USA, 4\u20138 August 2019."},{"key":"ref_32","unstructured":"Agrawal, S., Barrington, L., Bromberg, C., Burge, J., Gazen, C., and Hickey, J. (2019). Machine Learning for Precipitation Nowcasting from Radar Images. arXiv."},{"key":"ref_33","unstructured":"Guyon, I., von Luxburg, U., Bengio, S., Wallach, H.M., Fergus, R., Vishwanathan, S.V.N., and Garnett, R. (2017, January 4\u20139). Deep Learning for Precipitation Nowcasting: A Benchmark and A New Model. Proceedings of the Advances in Neural Information Processing Systems 30: Annual Conference on Neural Information Processing Systems 2017, Long Beach, CA, USA."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Han, D., Lee, J., Im, J., Sim, S., Lee, S., and Han, H. (2019). A Novel Framework of Detecting Convective Initiation Combining Automated Sampling, Machine Learning, and Repeated Model Tuning from Geostationary Satellite Data. Remote Sens., 11.","DOI":"10.3390\/rs11121454"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41612-019-0098-0","article-title":"Nowcasting lightning occurrence from commonly available meteorological parameters using machine learning techniques","volume":"2","author":"Mostajabi","year":"2019","journal-title":"Npj Clim. Atmos. Sci."},{"key":"ref_36","unstructured":"EUMETSAT (2022, June 14). High Rate SEVIRI Level 1.5 Image Data\u2014MSG\u20140 Degree. Available online: https:\/\/navigator.eumetsat.int\/product\/EO:EUM:DAT:MSG:HRSEVIRI."},{"key":"ref_37","unstructured":"Brodehl, S. (2022, June 14). pyPublicDecompWT: Python Bindings for EUMETSAT\u2019s PublicDecompWT (v2.8.1.3). Available online: https:\/\/pypi.org\/project\/pyPublicDecompWT."},{"key":"ref_38","unstructured":"Raspaud, M., Hoese, D., Lahtinen, P., Finkensieper, S., Holl, G., Proud, S., Dybbroe, A., Meraner, A., Feltz, J., and Zhang, X. (2022, June 14). Pytroll\/Satpy, Version 0.36.0 (2022\/04\/14). Available online: https:\/\/iopscience.iop.org\/article\/10.1088\/1755-1315\/750\/1\/012011\/meta."},{"key":"ref_39","unstructured":"Hoese, D., Lahtinen, P., Raspaud, M., Roberts, W., Bot, S., Finkensieper, S., Dybbroe, A., Holl, G., and Itkin, M. (2022, June 14). Pytroll\/Pyresample, Version 1.23.0. Available online: https:\/\/www.preprints.org\/manuscript\/202206.0238\/v1."},{"key":"ref_40","unstructured":"Met Office (2022, June 14). Cartopy: A Cartographic Python Library with a Matplotlib Interface. Available online: https:\/\/scitools.org.uk\/cartopy."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Cui, Y., Jia, M., Lin, T., Song, Y., and Belongie, S.J. (2019). Class-Balanced Loss Based on Effective Number of Samples. Computer Vision Foundation, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2019, Long Beach, CA, USA, 16\u201320 June 2019, IEEE.","DOI":"10.1109\/CVPR.2019.00949"},{"key":"ref_42","first-page":"630","article-title":"Identity Mappings in Deep Residual Networks","volume":"Volume 9908","author":"Leibe","year":"2016","journal-title":"Lecture Notes in Computer Science, Proceedings of the Computer Vision - ECCV 2016\u201414th European Conference, Amsterdam, The Netherlands, 11\u201314 October 2016"},{"key":"ref_43","unstructured":"Ulyanov, D., Vedaldi, A., and Lempitsky, V.S. (2016). Instance Normalization: The Missing Ingredient for Fast Stylization. arXiv."},{"key":"ref_44","unstructured":"F\u00fcrnkranz, J., and Joachims, T. (2010, January 21\u201324). Rectified Linear Units Improve Restricted Boltzmann Machines. Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1038\/323533a0","article-title":"Learning representations by back-propagating errors","volume":"323","author":"Rumelhart","year":"1986","journal-title":"Nature"},{"key":"ref_46","unstructured":"Loshchilov, I., and Hutter, F. (2019, January 6\u20139). Decoupled Weight Decay Regularization. Proceedings of the 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA."},{"key":"ref_47","unstructured":"Smith, L.N., and Topin, N. (2017). Super-Convergence: Very Fast Training of Residual Networks Using Large Learning Rates. arXiv."},{"key":"ref_48","unstructured":"Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019). PyTorch: An Imperative Style, High-Performance Deep Learning Library. arXiv."},{"key":"ref_49","unstructured":"Klimaver\u00e4nderung und Wasserwirtschaft (KLIWA) (2022, June 14). Klimawandel in S\u00fcddeutschland\u2014Ver\u00e4nderung von Meteorologischen und Hydrologischen Kenngr\u00f6\u00dfen; Monitoringbericht 2016. Available online: https:\/\/www.kliwa.de\/_download\/KLIWA_Monitoringbericht_2016.pdf."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1175\/BAMS-85-8-1107","article-title":"The severe thunderstorm electrification and precipitation study","volume":"85","author":"Lang","year":"2004","journal-title":"Bull. Am. Meteorol. Soc."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1878","DOI":"10.1175\/1520-0469(1990)047<1878:DOTOTA>2.0.CO;2","article-title":"Determination of the Optical Thickness and Effective Particle Radius of Clouds from Reflected Solar Radiation Measurements. Part I: Theory","volume":"47","author":"Nakajima","year":"1990","journal-title":"J. Atmos. Sci."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1175\/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2","article-title":"The Critical Success Index as an Indicator of Warning Skill","volume":"5","author":"Schaefer","year":"1990","journal-title":"Weather Forecast."},{"key":"ref_53","unstructured":"Gerapetritis, H., and Pelissier, J.M. (2004). On the Behavior of the Critical Success Index, Eastern Region Technical Attachment (National Weather Service (U.S.)), NOAA\/National Weather Service. No. 2004-03."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1038\/s41586-021-03854-z","article-title":"Skilful precipitation nowcasting using deep generative models of radar","volume":"597","author":"Ravuri","year":"2021","journal-title":"Nature"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Dolean, V., Jolivet, P., and Nataf, F. (2015). An Introduction to Domain Decomposition Methods\u2014Algorithms, Theory, and Parallel Implementation, SIAM.","DOI":"10.1137\/1.9781611974065"},{"key":"ref_56","first-page":"1","article-title":"Improving Reproducibility in Machine Learning Research (A Report from the NeurIPS 2019 Reproducibility Program)","volume":"22","author":"Pineau","year":"2021","journal-title":"J. Mach. Learn. Res."},{"key":"ref_57","unstructured":"Garg, S., Rasp, S., and Thuerey, N. (2022). WeatherBench Probability: A benchmark dataset for probabilistic medium-range weather forecasting along with deep learning baseline models. arXiv."},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Smith, L.N. (2017). Cyclical Learning Rates for Training Neural Networks. IEEE Computer Society, Proceedings of the 2017 IEEE Winter Conference on Applications of Computer Vision, WACV 2017, Santa Rosa, CA, USA, 24\u201331 March 2017, IEEE.","DOI":"10.1109\/WACV.2017.58"},{"key":"ref_59","unstructured":"Hartmann, D., Brodehl, S., and Wand, M. (2022, June 14). ActCooLR\u2014High-Level Learning Rate Schedules Using Activation Pattern Temperature. Available online: https:\/\/openreview.net\/forum?id=yqj6q_eNTJd."}],"container-title":["Remote Sensing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3760\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:04:46Z","timestamp":1760141086000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-4292\/14\/15\/3760"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,5]]},"references-count":59,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["rs14153760"],"URL":"https:\/\/doi.org\/10.3390\/rs14153760","relation":{"has-preprint":[{"id-type":"doi","id":"10.20944\/preprints202206.0238.v1","asserted-by":"object"}]},"ISSN":["2072-4292"],"issn-type":[{"value":"2072-4292","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,5]]}}}