{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,5]],"date-time":"2026-05-05T13:38:12Z","timestamp":1777988292469,"version":"3.51.4"},"reference-count":51,"publisher":"American Astronomical Society","issue":"1","license":[{"start":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T00:00:00Z","timestamp":1747353600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T00:00:00Z","timestamp":1747353600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/iopscience.iop.org\/info\/page\/text-and-data-mining"}],"funder":[{"DOI":"10.13039\/100010665","name":"H2020 Excellent science Marie Sk\u0142odowska-Curie Actions","doi-asserted-by":"crossref","award":["955620"],"award-info":[{"award-number":["955620"]}],"id":[{"id":"10.13039\/100010665","id-type":"DOI","asserted-by":"crossref"}]},{"name":"MEC \u2223 Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":["UIDP+UIDB\/00611\/2019"],"award-info":[{"award-number":["UIDP+UIDB\/00611\/2019"]}]},{"name":"MEC \u2223 Funda\u00e7\u00e3o para a Ci\u00eancia e a Tecnologia","award":["UIDB+UIDP\/04434\/2020"],"award-info":[{"award-number":["UIDB+UIDP\/04434\/2020"]}]}],"content-domain":{"domain":["iopscience.iop.org"],"crossmark-restriction":false},"short-container-title":["ApJ"],"published-print":{"date-parts":[[2025,5,20]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Reliable forecasting models are necessary to mitigate the risks posed by solar flares to human technology. This study introduces a novel deep learning forecasting approach while emphasizing the need for performance evaluation methods tailored to better highlight current models\u2019 limitations. In particular, we show that models reaching state-of-the-art performance with traditional metrics have similar explanatory power to no-skill persistence models and notably struggle to forecast change in activity significantly better than random guesses. We also discuss shortcomings in traditional evaluation metrics like the True Skill Statistic (TSS), which we show to be mathematically dependent on the class balance for specific models. We introduce patch-distributed CNNs, which allow us to perform full-disk forecasts while providing event probabilities in solar subregions and position predictions. This new framework offers similar information to active region (AR)-based forecasting models while bypassing the problem of unrecorded and misattributed flares that are detrimental to machine learning training. As a result, the model also operates independently of prior feature extraction and AR detection, thus offering promising operational utility with minimal external dependencies. Finally, a method is proposed for constructing balanced and independent cross-validation folds for full-disk models. Models combining Solar Dynamic Observatory (SDO)\/Atmospheric Imaging Assembly EUV images as inputs show improved performance compared to employing SDO\/HMI photospheric magnetograms, with a TSS of 0.74 for the C+ model and 0.62 for the M+ model.<\/jats:p>","DOI":"10.3847\/1538-4357\/adc56d","type":"journal-article","created":{"date-parts":[[2025,5,16]],"date-time":"2025-05-16T05:46:42Z","timestamp":1747374402000},"page":"108","update-policy":"https:\/\/doi.org\/10.1088\/crossmark-policy","source":"Crossref","is-referenced-by-count":3,"title":["Limits of Solar Flare Forecasting Models and New Deep Learning Approach*"],"prefix":"10.3847","volume":"985","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3694-7813","authenticated-orcid":true,"given":"G.","family":"Francisco","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0007-2465-1931","authenticated-orcid":true,"given":"M.","family":"Berretti","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6746-2917","authenticated-orcid":true,"given":"S.","family":"Chierichini","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4443-9966","authenticated-orcid":true,"given":"R.","family":"Mugatwala","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1663-3334","authenticated-orcid":true,"given":"J.","family":"Fernandes","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6106-8285","authenticated-orcid":true,"given":"T.","family":"Barata","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2500-5054","authenticated-orcid":true,"given":"D.","family":"Del Moro","sequence":"additional","affiliation":[]}],"member":"2208","published-online":{"date-parts":[[2025,5,16]]},"reference":[{"key":"apjadc56dbib1","author":"Abadi","year":"2015","unstructured":"Abadi M. Agarwal A. Barham P. 2015 TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems https:\/\/www.tensorflow.org\/"},{"key":"apjadc56dbib2","author":"Aghajanyan","year":"2020"},{"key":"apjadc56dbib3","doi-asserted-by":"publisher","first-page":"181","DOI":"10.3847\/1538-4357\/ad1837","volume":"961","author":"Athiray","year":"2024","journal-title":"ApJ"},{"key":"apjadc56dbib4","doi-asserted-by":"publisher","first-page":"89","DOI":"10.3847\/0004-637X\/829\/2\/89","volume":"829","author":"Barnes","year":"2016","journal-title":"ApJ"},{"key":"apjadc56dbib5","doi-asserted-by":"publisher","first-page":"2801","DOI":"10.21105\/joss.02801","volume":"5","author":"Barnes","year":"2020","journal-title":"JOSS"},{"key":"apjadc56dbib6","doi-asserted-by":"publisher","first-page":"L41","DOI":"10.1088\/2041-8205\/747\/2\/L41","volume":"747","author":"Bloomfield","year":"2012","journal-title":"ApJL"},{"key":"apjadc56dbib7","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1029\/2021SW002976","volume":"20","author":"Brown","year":"2022","journal-title":"SpWea"},{"key":"apjadc56dbib8","doi-asserted-by":"publisher","first-page":"1166","DOI":"10.1029\/2018SW002061","volume":"17","author":"Camporeale","year":"2019","journal-title":"SpWea"},{"key":"apjadc56dbib9","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1186\/s12864-019-6413-7","volume":"21","author":"Chicco","year":"2020","journal-title":"BMCG"},{"key":"apjadc56dbib10","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s13040-023-00322-4","volume":"16","author":"Chicco","year":"2023","journal-title":"Biomed. Data Min."},{"key":"apjadc56dbib11","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1186\/s13040-021-00244-z","volume":"14","author":"Chicco","year":"2021a","journal-title":"Biomed. Data Min."},{"key":"apjadc56dbib12","doi-asserted-by":"publisher","first-page":"78368","DOI":"10.1109\/ACCESS.2021.3084050","volume":"9","author":"Chicco","year":"2021b","journal-title":"IEEA"},{"key":"apjadc56dbib13","doi-asserted-by":"publisher","first-page":"3332","DOI":"10.1093\/mnras\/staa1257","volume":"495","author":"Cinto","year":"2020","journal-title":"MNRAS"},{"key":"apjadc56dbib14","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1006\/jcis.1996.0217","volume":"179","author":"Crocker","year":"1996","journal-title":"JCIS"},{"key":"apjadc56dbib15","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0222916","volume":"14","author":"Delgado","year":"2019","journal-title":"PLoSO"},{"key":"apjadc56dbib16","first-page":"248","author":"Deng","year":"2009"},{"key":"apjadc56dbib17","doi-asserted-by":"publisher","first-page":"232","DOI":"10.3847\/1538-4357\/ac2b2b","volume":"922","author":"Deng","year":"2021","journal-title":"ApJ"},{"key":"apjadc56dbib18","doi-asserted-by":"publisher","first-page":"9","DOI":"10.3847\/1538-4365\/ac5b0c","volume":"260","author":"Deshmukh","year":"2022","journal-title":"ApJS"},{"key":"apjadc56dbib19","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.14790146","author":"Francisco","year":"2025","unstructured":"Francisco G. 2025 Patch-CNN for Weakly-supervised Flare Forecasting, v1 Zenodo, doi: 10.5281\/zenodo.14790146"},{"key":"apjadc56dbib20","doi-asserted-by":"publisher","author":"Francisco","year":"2024","DOI":"10.5281\/zenodo.10465436"},{"key":"apjadc56dbib21","doi-asserted-by":"publisher","first-page":"275","DOI":"10.1007\/BF00681100","volume":"154","author":"Garcia","year":"1994","journal-title":"SoPh"},{"key":"apjadc56dbib22","doi-asserted-by":"publisher","first-page":"A105","DOI":"10.1051\/0004-6361\/202243617","volume":"662","author":"Guastavino","year":"2022a","journal-title":"A&A"},{"key":"apjadc56dbib23","doi-asserted-by":"publisher","first-page":"399","DOI":"10.3389\/fspas.2022.1039805","volume":"9","author":"Guastavino","year":"2022b","journal-title":"FrASS"},{"key":"apjadc56dbib24","doi-asserted-by":"publisher","first-page":"1993","DOI":"10.1109\/TNNLS.2022.3186068","volume":"35","author":"Guastavino","year":"2022"},{"key":"apjadc56dbib25","author":"Hanssen","year":"1965"},{"key":"apjadc56dbib26","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1080\/20014422.1926.11881138","volume":"8","author":"Heidke","year":"1926","journal-title":"GeAn"},{"key":"apjadc56dbib27","author":"Hu","year":"2021"},{"key":"apjadc56dbib28","doi-asserted-by":"publisher","first-page":"7","DOI":"10.3847\/1538-4357\/aaae00","volume":"856","author":"Huang","year":"2018","journal-title":"ApJ"},{"key":"apjadc56dbib29","author":"Kingma","year":"2014"},{"key":"apjadc56dbib30","doi-asserted-by":"publisher","first-page":"5454","DOI":"10.1109\/CVPR.2017.579","author":"Kokkinos","year":"2017"},{"key":"apjadc56dbib31","doi-asserted-by":"publisher","first-page":"36","DOI":"10.3847\/1538-4365\/ab2e12","volume":"243","author":"Leka","year":"2019","journal-title":"ApJS"},{"key":"apjadc56dbib32","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1007\/s11207-011-9776-8","volume":"275","author":"Lemen","year":"2012","journal-title":"SoPh"},{"key":"apjadc56dbib33","doi-asserted-by":"publisher","first-page":"10","DOI":"10.3847\/1538-4357\/ab6d04","volume":"891","author":"Li","year":"2020","journal-title":"ApJ"},{"key":"apjadc56dbib34","author":"Loshchilov","year":"2017"},{"key":"apjadc56dbib35","doi-asserted-by":"publisher","first-page":"442","DOI":"10.1016\/0005-2795(75)90109-9","volume":"405","author":"Matthews","year":"1975","journal-title":"BBAcB"},{"key":"apjadc56dbib36","doi-asserted-by":"publisher","first-page":"113","DOI":"10.3847\/1538-4357\/aab9a7","volume":"858","author":"Nishizuka","year":"2018","journal-title":"ApJ"},{"key":"apjadc56dbib37","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1007\/978-3-031-43430-3_5","author":"Pandey","year":"2023"},{"key":"apjadc56dbib38","doi-asserted-by":"publisher","first-page":"91","DOI":"10.3847\/1538-4357\/aaed40","volume":"869","author":"Park","year":"2018","journal-title":"ApJ"},{"key":"apjadc56dbib39","doi-asserted-by":"publisher","first-page":"453","DOI":"10.1126\/science.ns-4.93.453","volume":"4","author":"Peirce","year":"1884","journal-title":"Sci"},{"key":"apjadc56dbib40","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/s11207-011-9841-3","volume":"275","author":"Pesnell","year":"2012","journal-title":"SoPh"},{"key":"apjadc56dbib41","doi-asserted-by":"publisher","first-page":"2048","DOI":"10.1016\/j.asr.2022.11.020","volume":"71","author":"Plutino","year":"2023","journal-title":"AdSpR"},{"key":"apjadc56dbib42","doi-asserted-by":"publisher","DOI":"10.5281\/zenodo.11150339","author":"Plutino","year":"2024","unstructured":"Plutino N. Michele B. Gr\u00e9goire F. 2024 Solar Flare Catalog: Plutino Extension, v2 Zenodo, doi: 10.5281\/zenodo.11150339"},{"key":"apjadc56dbib43","author":"Ruder","year":"2017"},{"key":"apjadc56dbib44","doi-asserted-by":"publisher","first-page":"739","DOI":"10.1016\/j.asr.2008.11.004","volume":"43","author":"Schrijver","year":"2009","journal-title":"AdSpR"},{"key":"apjadc56dbib45","author":"Selvaraju","year":"2016"},{"key":"apjadc56dbib46","author":"Shazeer","year":"2017"},{"key":"apjadc56dbib47","author":"Springenberg","year":"2014"},{"key":"apjadc56dbib48","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3847\/1538-4357\/ac64a6","volume":"931","author":"Sun","year":"2022","journal-title":"ApJ"},{"key":"apjadc56dbib49","author":"Tan","year":"2021"},{"key":"apjadc56dbib50","doi-asserted-by":"publisher","first-page":"354","DOI":"10.3389\/fspas.2022.1031211","volume":"9","author":"Van der Sande","year":"2022","journal-title":"FrASS"},{"key":"apjadc56dbib51","doi-asserted-by":"publisher","first-page":"8","DOI":"10.3847\/1538-4357\/abdebe","volume":"910","author":"Yi","year":"2021","journal-title":"ApJ"}],"container-title":["The Astrophysical Journal"],"original-title":[],"link":[{"URL":"https:\/\/iopscience.iop.org\/article\/10.3847\/1538-4357\/adc56d","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.3847\/1538-4357\/adc56d\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.3847\/1538-4357\/adc56d\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/iopscience.iop.org\/article\/10.3847\/1538-4357\/adc56d\/pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,5,21]],"date-time":"2025-05-21T08:34:46Z","timestamp":1747816486000},"score":1,"resource":{"primary":{"URL":"https:\/\/iopscience.iop.org\/article\/10.3847\/1538-4357\/adc56d"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,16]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,5,16]]},"published-print":{"date-parts":[[2025,5,20]]}},"URL":"https:\/\/doi.org\/10.3847\/1538-4357\/adc56d","relation":{"is-supplemented-by":[{"id-type":"doi","id":"10.22541\/essoar.170688972.24631782\/v3","asserted-by":"subject"},{"id-type":"doi","id":"10.5281\/zenodo.10465436","asserted-by":"subject"},{"id-type":"doi","id":"10.5281\/zenodo.10465436","asserted-by":"subject"},{"id-type":"doi","id":"10.5281\/zenodo.14790146","asserted-by":"subject"}],"has-preprint":[{"id-type":"doi","id":"10.22541\/essoar.170688972.24631782\/v1","asserted-by":"object"},{"id-type":"doi","id":"10.22541\/essoar.170688972.24631782\/v2","asserted-by":"object"},{"id-type":"doi","id":"10.22541\/essoar.170688972.24631782\/v3","asserted-by":"object"}]},"ISSN":["0004-637X","1538-4357"],"issn-type":[{"value":"0004-637X","type":"print"},{"value":"1538-4357","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,16]]},"assertion":[{"value":"Limits of Solar Flare Forecasting Models and New Deep Learning Approach*","name":"article_title","label":"Article Title"},{"value":"The Astrophysical Journal","name":"journal_title","label":"Journal Title"},{"value":"paper","name":"article_type","label":"Article Type"},{"value":"\u00a9 2025. The Author(s). Published by the American Astronomical Society.","name":"copyright_information","label":"Copyright Information"},{"value":"2024-09-03","name":"date_received","label":"Date Received","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2025-03-23","name":"date_accepted","label":"Date Accepted","group":{"name":"publication_dates","label":"Publication dates"}},{"value":"2025-05-16","name":"date_epub","label":"Online publication date","group":{"name":"publication_dates","label":"Publication dates"}}]}}