{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T17:10:44Z","timestamp":1790788244449,"version":"4.1.0"},"reference-count":37,"publisher":"National Academy of Sciences","issue":"20","license":[{"start":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T00:00:00Z","timestamp":1683504000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2023,5,16]]},"abstract":"<jats:p>\n                    Accurate prediction of precipitation intensity is crucial for both human and natural systems, especially in a warming climate more prone to extreme precipitation. Yet, climate models fail to accurately predict precipitation intensity, particularly extremes. One missing piece of information in traditional climate model parameterizations is subgrid-scale cloud structure and organization, which affects precipitation intensity and stochasticity at coarse resolution. Here, using global storm-resolving simulations and machine learning, we show that, by implicitly learning subgrid organization, we can accurately predict precipitation variability and stochasticity with a low-dimensional set of latent variables. Using a neural network to parameterize coarse-grained precipitation, we find that the overall behavior of precipitation is reasonably predictable using large-scale quantities only; however, the neural network cannot predict the variability of precipitation (\n                    <jats:italic>R<\/jats:italic>\n                    <jats:sup>2<\/jats:sup>\n                    \u223c 0.45) and underestimates precipitation extremes. The performance is significantly improved when the network is informed by our organization metric, correctly predicting precipitation extremes and spatial variability (\n                    <jats:italic>R<\/jats:italic>\n                    <jats:sup>2<\/jats:sup>\n                    \u223c 0.9). The organization metric is implicitly learned by training the algorithm on a high-resolution precipitable water field, encoding the degree of subgrid organization. The organization metric shows large hysteresis, emphasizing the role of memory created by subgrid-scale structures. We demonstrate that this organization metric can be predicted as a simple memory process from information available at the previous time steps. These findings stress the role of organization and memory in accurate prediction of precipitation intensity and extremes and the necessity of parameterizing subgrid-scale convective organization in climate models to better project future changes of water cycle and extremes.\n                  <\/jats:p>","DOI":"10.1073\/pnas.2216158120","type":"journal-article","created":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T15:17:50Z","timestamp":1683559070000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":46,"title":["Implicit learning of convective organization explains precipitation stochasticity"],"prefix":"10.1073","volume":"120","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7441-4116","authenticated-orcid":false,"given":"Sara","family":"Shamekh","sequence":"first","affiliation":[{"name":"Department of Earth of Environmental Engineering, Columbia University, New York, NY 10027"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6883-3285","authenticated-orcid":false,"given":"Kara D.","family":"Lamb","sequence":"additional","affiliation":[{"name":"Department of Earth of Environmental Engineering, Columbia University, New York, NY 10027"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4150-0610","authenticated-orcid":false,"given":"Yu","family":"Huang","sequence":"additional","affiliation":[{"name":"Department of Earth of Environmental Engineering, Columbia University, New York, NY 10027"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0845-8345","authenticated-orcid":false,"given":"Pierre","family":"Gentine","sequence":"additional","affiliation":[{"name":"Department of Earth of Environmental Engineering, Columbia University, New York, NY 10027"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2023,5,8]]},"reference":[{"key":"e_1_3_4_1_2","doi-asserted-by":"crossref","unstructured":"C. E. Holloway Observing convective aggregation. Surv. Geophys. 38 1199\u20131236 (2017).","DOI":"10.1007\/s10712-017-9419-1"},{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-fluid-022421-011319"},{"key":"e_1_3_4_3_2","doi-asserted-by":"crossref","unstructured":"A. K. Betts M. J. Miller A new convective adjustment scheme. part ii: Single column tests using gate wave bomex atex and arctic air-mass data sets. Q. J. R. Meteorol. Soc. 112 693\u2013709 (1986).","DOI":"10.1256\/smsqj.47307"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0469(2001)058<0529:OOTCIL>2.0.CO;2"},{"key":"e_1_3_4_5_2","doi-asserted-by":"crossref","unstructured":"N. A. Da Silva C. Muller S. Shamekh B. Fildier Significant amplification of instantaneous extreme precipitation with convective self-aggregation. J. Adv. Model. Earth Syst. 13 e2021MS002607 (2021).","DOI":"10.1029\/2021MS002607"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41558-022-01400-x"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1038\/ngeo2789"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0469(1974)031<0674:IOACCE>2.0.CO;2"},{"key":"e_1_3_4_9_2","doi-asserted-by":"crossref","unstructured":"R. Pincus H. W. Barker J. J. Morcrette A fast flexible approximate technique for computing radiative transfer in inhomogeneous cloud fields. J. Geophys. Res. Atmos. 108 (2003) https:\/\/doi.org\/10.1029\/2002JD003322.","DOI":"10.1029\/2002JD003322"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature01092"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1175\/2009JAS2962.1"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1002\/wcc.318"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1175\/BAMS-D-15-00268.1"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2014.05.103"},{"key":"e_1_3_4_15_2","doi-asserted-by":"crossref","unstructured":"P. Angulo-Umana D. Kim Mesoscale convective clustering enhances tropical precipitation. Sci. Adv. 9 eabo5317 (2023).","DOI":"10.1126\/sciadv.abo5317"},{"key":"e_1_3_4_16_2","doi-asserted-by":"crossref","unstructured":"B. Mapes R. Neale Parameterizing convective organization to escape the entrainment dilemma. J. Adv. Model. Earth Syst. 3 (2011) https:\/\/doi.org\/10.1029\/2011MS000042.","DOI":"10.1029\/2011MS000042"},{"key":"e_1_3_4_17_2","doi-asserted-by":"crossref","unstructured":"P. Gentine M. Pritchard S. Rasp G. Reinaudi G. Yacalis Could machine learning break the convection parameterization deadlock? Geophys. Res. Lett. 45 5742\u20135751 (2018).","DOI":"10.1029\/2018GL078202"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1810286115"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1029\/2019MS001711"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17142-3"},{"key":"e_1_3_4_21_2","doi-asserted-by":"crossref","unstructured":"G. Mooers et al. Assessing the potential of deep learning for emulating cloud superparameterization in climate models with real-geography boundary conditions. J. Adv. Model. Earth Syst. 13 e2020MS002385 (2021)","DOI":"10.1029\/2020MS002385"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0469(2003)060<0607:CRMOTA>2.0.CO;2"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1186\/s40645-019-0304-z"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1038\/nphys314"},{"key":"e_1_3_4_25_2","doi-asserted-by":"crossref","unstructured":"C. J. Muller L. E. Back P. A. O\u2019Gorman K. A. Emanuel A model for the relationship between tropical precipitation and column water vapor. Geophys. Res. Lett. 36 (2009) https:\/\/doi.org\/10.1029\/2009GL039667.","DOI":"10.1029\/2009GL039667"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1029\/2018MS001482"},{"key":"e_1_3_4_27_2","doi-asserted-by":"publisher","DOI":"10.1175\/2011JCLI3876.1"},{"key":"e_1_3_4_28_2","doi-asserted-by":"publisher","DOI":"10.1175\/JAS-D-18-0036.1"},{"key":"e_1_3_4_29_2","doi-asserted-by":"crossref","unstructured":"M. Janssens et al. Cloud patterns in the trades have four interpretable dimensions. Geophys. Res. Lett. 48 e2020GL091001 (2021)","DOI":"10.1029\/2020GL091001"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2019.108973"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1109\/TGRS.2021.3098008"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14339"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/ngeo2398"},{"key":"e_1_3_4_34_2","doi-asserted-by":"crossref","unstructured":"C. Kodama A. T. Noda M. Satoh An assessment of the cloud signals simulated by NICAM using ISCCP CALIPSO and cloudsat satellite simulators. J. Geophys. Res. Atmos. 117 (2012) https:\/\/doi.org\/10.1029\/2011JD017317.","DOI":"10.1029\/2011JD017317"},{"key":"e_1_3_4_35_2","unstructured":"M. Abadi et al. \u201c{TensorFlow}: A system for {Large-Scale} machine learning\u201d in 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16) (2016) pp. 265\u2013283."},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2020.100591"},{"key":"e_1_3_4_37_2","unstructured":"S. Shamekh K. D. Lamb Y. Huang Cloud Organization. Github . https:\/\/github.com\/Sshamekh\/Precip-org. Deposited December 2022."}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2216158120","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,21]],"date-time":"2023-09-21T09:16:04Z","timestamp":1695287764000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/10.1073\/pnas.2216158120"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,8]]},"references-count":37,"journal-issue":{"issue":"20","published-print":{"date-parts":[[2023,5,16]]}},"alternative-id":["10.1073\/pnas.2216158120"],"URL":"https:\/\/doi.org\/10.1073\/pnas.2216158120","relation":{"has-preprint":[{"id-type":"doi","id":"10.1002\/essoar.10512517.1","asserted-by":"object"}]},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,8]]},"assertion":[{"value":"2022-09-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-03-29","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-05-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2216158120"}}