{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,12]],"date-time":"2026-02-12T17:05:24Z","timestamp":1770915924970,"version":"3.50.1"},"reference-count":73,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,6,14]],"date-time":"2023-06-14T00:00:00Z","timestamp":1686700800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Appl. Math. Stat."],"abstract":"<jats:p>The Epidemic Type Aftershock Sequence (ETAS) model and the modified Omori law (MOL) are two aftershock rate models that are used for operational earthquake\/aftershock forecasting. Previous studies have investigated the relative performance of the two models for specific case studies. However, a rigorous comparative evaluation of the forecasting performance of the basic aftershock rate models for several different earthquake sequences has not been done before. In this study, forecasts of five prominent aftershock sequences from multiple catalogs are computed using the Bayesian predictive distribution, which fully accounts for the uncertainties in the model parameters. This is done by the Markov Chain Monte Carlo (MCMC) sampling of the model parameters and forward simulation of the ETAS or MOL models to compute the aftershock forecasts. The forecasting results are evaluated using five different statistical tests, including two comparison tests. The forecasting skill tests indicate that the ETAS model tends to perform consistently well on the first three tests. The MOL fails the same tests for certain forecasting time intervals. However, in the comparison tests, it is not definite whether the ETAS model is the better performing model. This work demonstrates the use of forecast testing for different catalogs, which is also applicable to catalogs with a higher magnitude of completeness.<\/jats:p>","DOI":"10.3389\/fams.2023.1126511","type":"journal-article","created":{"date-parts":[[2023,6,14]],"date-time":"2023-06-14T05:42:51Z","timestamp":1686721371000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Testing the forecasting skills of aftershock models using a Bayesian framework"],"prefix":"10.3389","volume":"9","author":[{"given":"Elisa","family":"Dong","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Robert","family":"Shcherbakov","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Katsuichiro","family":"Goda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2023,6,14]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"1155","DOI":"10.1007\/s11069-012-0198-1","article-title":"Earthquake prediction: 20 years of global experiment","volume":"69","author":"Kossobokov","year":"2013","journal-title":"Nat Hazards."},{"key":"B2","doi-asserted-by":"publisher","first-page":"3313","DOI":"10.1785\/0120180126","article-title":"Spatiotemporal seismic hazard and risk assessment of aftershocks of m 9 megathrust earthquakes","volume":"108","author":"Zhang","year":"2018","journal-title":"Bull Seismol Soc Am."},{"key":"B3","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1016\/0040-1951(65)90003-X","article-title":"Lateral inhomogeneities of the upper mantle","volume":"2","author":"B\u00e5th","year":"1965","journal-title":"Tectonophysics."},{"key":"B4","doi-asserted-by":"publisher","first-page":"1968","DOI":"10.1785\/012003162","article-title":"A modified form of B\u00e5th's law","volume":"94","author":"Shcherbakov","year":"2004","journal-title":"Bull Seismol Soc Am."},{"key":"B5","doi-asserted-by":"publisher","first-page":"3222","DOI":"10.1785\/0120120337","article-title":"Aftershock statistics of major subduction earthquakes","volume":"103","author":"Shcherbakov","year":"2013","journal-title":"Bull Seismol Soc Am."},{"key":"B6","first-page":"521","article-title":"A statistical study on the occurrence of aftershocks","volume":"30","author":"Utsu","year":"1961","journal-title":"Geophys Mag."},{"key":"B7","first-page":"197","article-title":"Aftershocks and earthquake statistics (ii) further investigation of aftershocks and other earthquake sequences based on a new classification of earthquake sequences","volume":"3","author":"Utsu","year":"1971","journal-title":"J Facul Sci."},{"key":"B8","doi-asserted-by":"publisher","first-page":"743","DOI":"10.1007\/s00024-010-0069-1","article-title":"Forecasting the locations of future large earthquakes: an analysis and verification","volume":"167","author":"Shcherbakov","year":"2010","journal-title":"Pure Appl Geophys."},{"key":"B9","doi-asserted-by":"publisher","first-page":"1184","DOI":"10.1785\/0120090192","article-title":"Likelihood-based tests for evaluating space-rate-magnitude earthquake forecasts","volume":"100","author":"Zechar","year":"2010","journal-title":"Bull Seismol Soc Am."},{"key":"B10","doi-asserted-by":"publisher","first-page":"728","DOI":"10.2478\/s11600-011-0013-5","article-title":"Efficient testing of earthquake forecasting models","volume":"59","author":"Rhoades","year":"2011","journal-title":"Acta Geophys."},{"key":"B11","doi-asserted-by":"publisher","first-page":"2290","DOI":"10.1785\/0120160073","article-title":"Three ingredients for improved global aftershock forecasts: tectonic region, time-dependent catalog incompleteness, and intersequence variability","volume":"106","author":"Page","year":"2016","journal-title":"Bull Seismol Soc Am."},{"key":"B12","doi-asserted-by":"publisher","first-page":"262","DOI":"10.1785\/0220180240","article-title":"Updated California aftershock parameters","volume":"90","author":"Hardebeck","year":"2019","journal-title":"Seismol Res Lett."},{"key":"B13","doi-asserted-by":"publisher","first-page":"242","DOI":"10.1785\/0220180213","article-title":"Implementation of a real-time system for automatic aftershock forecasting in Japan","volume":"90","author":"Omi","year":"2019","journal-title":"Seismol Res Lett."},{"key":"B14","doi-asserted-by":"publisher","first-page":"L21302","DOI":"10.1029\/2009gl040233","article-title":"Real-time forecasting following a damaging earthquake","volume":"36","author":"Marzocchi","year":"2009","journal-title":"Geophys Res Lett."},{"key":"B15","doi-asserted-by":"publisher","first-page":"2450","DOI":"10.1785\/0120160100","article-title":"Automatic aftershock forecasting: a test using real-time seismicity data in Japan","volume":"106","author":"Omi","year":"2016","journal-title":"Bull Seismol Soc Am."},{"key":"B16","doi-asserted-by":"publisher","first-page":"291","DOI":"10.2307\/3214359","article-title":"Point-process models with linearly parametrized intensity for application to earthquake data","volume":"23","author":"Ogata","year":"1986","journal-title":"J Appl Prob."},{"key":"B17","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1080\/01621459.1988.10478560","article-title":"Statistical-models for earthquake occurrences and residual analysis for point-processes","volume":"83","author":"Ogata","year":"1988","journal-title":"J Am Stat Assoc."},{"key":"B18","doi-asserted-by":"publisher","first-page":"207","DOI":"10.5047\/eps.2010.12.010","article-title":"Next-day earthquake forecasts for the Japan region generated by the ETAS model","volume":"63","author":"Zhuang","year":"2011","journal-title":"Earth Planets Space."},{"key":"B19","doi-asserted-by":"publisher","first-page":"711","DOI":"10.1093\/gji\/ggu442","article-title":"Log-likelihood of earthquake models: evaluation of models and forecasts","volume":"201","author":"Harte","year":"2015","journal-title":"Geophys J Int."},{"key":"B20","doi-asserted-by":"publisher","first-page":"1266","DOI":"10.1093\/gji\/ggv524","article-title":"Model parameter estimation bias induced by earthquake magnitude cut-off","volume":"204","author":"Harte","year":"2016","journal-title":"Geophys J Int."},{"key":"B21","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1093\/gji\/ggx146","article-title":"Probability distribution of forecasts based on the ETAS model","volume":"210","author":"Harte","year":"2017","journal-title":"Geophys J Int."},{"key":"B22","doi-asserted-by":"publisher","first-page":"759","DOI":"10.1093\/gji\/ggy150","article-title":"Effect of sample size on parameter estimates and earthquake forecasts","volume":"214","author":"Harte","year":"2018","journal-title":"Geophys J Int."},{"key":"B23","doi-asserted-by":"publisher","first-page":"1894","DOI":"10.1093\/gji\/ggz088","article-title":"Evaluation of earthquake stochastic models based on their real-time forecasts: a case study of Kaikoura 2016","volume":"217","author":"Harte","year":"2019","journal-title":"Geophys J Int."},{"key":"B24","first-page":"113","article-title":"On after-shocks of earthquakes","volume":"7","author":"Omori","year":"1894","journal-title":"J Coll Sci Imp Univ Tokyo."},{"key":"B25","doi-asserted-by":"crossref","first-page":"2601","DOI":"10.1029\/93JB02581","article-title":"A constitutive law for rate of earthquake production and its application to earthquake clustering","volume":"99","author":"Dieterich","year":"1994","journal-title":"J Geophys Res."},{"key":"B26","first-page":"935","article-title":"Static stress changes and the triggering of earthquakes","volume":"84","author":"King","year":"1994","journal-title":"Bull Seismol Soc Am."},{"key":"B27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.4294\/jpe1952.43.1","article-title":"The centenary of the Omori formula for a decay law of aftershock activity","volume":"43","author":"Utsu","year":"1995","journal-title":"J Phys Earth."},{"key":"B28","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511818516","volume-title":"The Mechanics of Earthquakes and Faulting","author":"Scholz","year":"2002"},{"key":"B29","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1007\/s00024-003-2435-8","article-title":"Demarcation and scaling of long-term seismogenesis","volume":"161","author":"Evison","year":"2004","journal-title":"Pure Appl Geophys."},{"key":"B30","doi-asserted-by":"publisher","first-page":"2053","DOI":"10.1785\/0120080049","article-title":"Uniform California earthquake rupture forecast, Version 2 (UCERF 2)","volume":"99","author":"Field","year":"2009","journal-title":"Bull Seismol Soc Am."},{"key":"B31","doi-asserted-by":"publisher","first-page":"36668","DOI":"10.1038\/srep36668","article-title":"Power-law rheology controls aftershock triggering and decay","volume":"6","author":"Zhang","year":"2016","journal-title":"Sci Rep."},{"key":"B32","doi-asserted-by":"publisher","first-page":"1764","DOI":"10.1093\/GJI\/GGW486","article-title":"Multiplicative earthquake likelihood models incorporating strain rates","volume":"208","author":"Rhoades","year":"2017","journal-title":"Geophys J Int."},{"key":"B33","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1093\/GJI\/GGX268","article-title":"Prospective and retrospective evaluation of five-year earthquake forecast models for California","volume":"211","author":"Strader","year":"2017","journal-title":"Geophys J Int."},{"key":"B34","doi-asserted-by":"publisher","first-page":"3943","DOI":"10.1029\/94jb03014","article-title":"New seismic gap hypothesis: five years after","volume":"100","author":"Kagan","year":"1995","journal-title":"J Geophys Res."},{"key":"B35","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1785\/gssrl.78.1.17","article-title":"Earthquake likelihood model testing","volume":"78","author":"Schorlemmer","year":"2007","journal-title":"Seismol Res Lett."},{"key":"B36","doi-asserted-by":"publisher","first-page":"e2020JB020887","DOI":"10.1029\/2020JB020887","article-title":"Statistics and forecasting of aftershocks during the 2019 Ridgecrest, California, earthquake sequence","volume":"126","author":"Shcherbakov","year":"2021","journal-title":"J Geophys Res."},{"key":"B37","doi-asserted-by":"publisher","first-page":"4051","DOI":"10.1038\/s41467-019-11958-4","article-title":"Forecasting the magnitude of the largest expected earthquake","volume":"10","author":"Shcherbakov","year":"2019","journal-title":"Nat Commun."},{"key":"B38","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1007\/s000240050275","article-title":"Seismicity analysis through point-process modeling: a review","volume":"155","author":"Ogata","year":"1999","journal-title":"Pure Appl Geophys."},{"key":"B39","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1111\/j.1365-246X.1975.tb05893.x","article-title":"Stochastic models for earthquake sequences","volume":"42","author":"Vere-Jones","year":"1975","journal-title":"Geophys J Int."},{"key":"B40","doi-asserted-by":"publisher","first-page":"218501","DOI":"10.1103\/PhysRevLett.95.218501","article-title":"Model for the distribution of aftershock interoccurrence times","volume":"95","author":"Shcherbakov","year":"2005","journal-title":"Phys Rev Lett."},{"key":"B41","first-page":"627","article-title":"Complexity and earthquakes","volume-title":"Earthquake Seismology","author":"Shcherbakov","year":"2015"},{"key":"B42","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1023\/A:1003403601725","article-title":"Space-time point-process models for earthquake occurrences","volume":"50","author":"Ogata","year":"1998","journal-title":"Ann I Stat Math."},{"key":"B43","doi-asserted-by":"publisher","first-page":"155","DOI":"10.4401\/ag-4848","article-title":"The ETAS model for daily forecasting of Italian seismicity in the CSEP experiment","volume":"53","author":"Lombardi","year":"2010","journal-title":"Ann Geophys."},{"key":"B44","doi-asserted-by":"publisher","first-page":"115","DOI":"10.4294\/jpe1952.31.115","article-title":"Estimation of the parameters in the modified Omori formula for aftershock frequencies by the maximum-likelihood procedure","volume":"31","author":"Ogata","year":"1983","journal-title":"J Phys Earth."},{"key":"B45","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1785\/BSSA0340040185","article-title":"Frequency of earthquakes in California","volume":"4","author":"Gutenberg","year":"1944","journal-title":"Bull Seismol Soc Am."},{"key":"B46","doi-asserted-by":"publisher","first-page":"645","DOI":"10.1007\/s00024-010-0079-z","article-title":"Foundations of statistical seismology","volume":"167","author":"Vere-Jones","year":"2010","journal-title":"Pure Appl Geophys."},{"key":"B47","first-page":"237","article-title":"Maximum likelihood estimate of b in the formula logN = a\u2212bM and its confidence limits","volume":"43","author":"Aki","year":"1965","journal-title":"Bull Earthquake Res Inst."},{"key":"B48","first-page":"99","article-title":"A method for determining the value of b in a formula logn = a \u2212 bM showing the magnitude-frequency relation for earthquakes","volume":"13","author":"Utsu","year":"1965","journal-title":"Geophys Bull Hokkaido Univ."},{"key":"B49","doi-asserted-by":"crossref","first-page":"889","DOI":"10.1785\/BSSA0760030889","article-title":"On estimating varying b-values","volume":"76","author":"Guttorp","year":"1986","journal-title":"Bull Seismol Soc Am."},{"key":"B50","volume-title":"An Introduction to the Theory of Point Processes","author":"Daley","year":"2003"},{"key":"B51","doi-asserted-by":"publisher","first-page":"6380","DOI":"10.1002\/2014GL061272","article-title":"Bayesian confidence intervals for the magnitude of the largest aftershock","volume":"41","author":"Shcherbakov","year":"2014","journal-title":"Geophys Res Lett."},{"key":"B52","doi-asserted-by":"publisher","first-page":"1207","DOI":"10.1785\/012003098","article-title":"Short-term properties of earthquake catalogs and models of earthquake source","volume":"94","author":"Kagan","year":"2004","journal-title":"Bull Seismol Soc Am."},{"key":"B53","doi-asserted-by":"publisher","first-page":"L17307","DOI":"10.1029\/2006GL026744","article-title":"Anomalous early aftershock decay rate of the 2004 Mw 6","volume":"33","author":"Peng","year":"2006","journal-title":"Geophys Res Lett."},{"key":"B54","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1785\/0220150211","article-title":"Rate-dependent incompleteness of earthquake catalogs","volume":"87","author":"Hainzl","year":"2016","journal-title":"Seismol Res Lett."},{"key":"B55","doi-asserted-by":"publisher","first-page":"6499","DOI":"10.1002\/2016jb013319","article-title":"Apparent triggering function of aftershocks resulting from rate-dependent incompleteness of earthquake catalogs","volume":"121","author":"Hainzl","year":"2016","journal-title":"J Geophys Res."},{"key":"B56","doi-asserted-by":"publisher","first-page":"2662","DOI":"10.1785\/0120100336","article-title":"Statistical analysis of the 2002 Mw 7","volume":"101","author":"Bhattacharya","year":"2011","journal-title":"Bull Seismol Soc Am."},{"key":"B57","doi-asserted-by":"publisher","first-page":"2482","DOI":"10.1029\/2003JB002485","article-title":"Predictability in the epidemic-type aftershock sequence model of interacting triggered seismicity","volume":"108","author":"Helmstetter","year":"2003","journal-title":"J Geophys Res."},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.5078\/corssa-43806322","article-title":"Stochastic simulation of earthquake catalogs","author":"Zhuang","year":"2015","journal-title":"Community Online Resource for Statistical Seismicity Analysis"},{"key":"B59","doi-asserted-by":"publisher","first-page":"1173","DOI":"10.1126\/science.243.4895.1173","article-title":"Earthquake hazard after a mainshock in California","volume":"243","author":"Reasenberg","year":"1989","journal-title":"Science."},{"key":"B60","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1093\/gji\/ggx407","article-title":"Constraining the magnitude of the largest event in a foreshock-mainshock-aftershock sequence","volume":"212","author":"Shcherbakov","year":"2018","journal-title":"Geophys J Int."},{"key":"B61","doi-asserted-by":"publisher","first-page":"715","DOI":"10.1111\/j.1365-246X.2007.03676.x","article-title":"Testing alarm-based earthquake predictions","volume":"172","author":"Zechar","year":"2008","journal-title":"Geophys J Int."},{"key":"B62","doi-asserted-by":"publisher","first-page":"1251","DOI":"10.1785\/0220180031","article-title":"Prospective CSEP evaluation of 1-day, 3-month, and 5-yr earthquake forecasts for Italy","volume":"89","author":"Taroni","year":"2018","journal-title":"Seismol Res Lett."},{"key":"B63","volume-title":"Testing aftershock forecasts using Bayesian methods","author":"Dong","year":"2022"},{"key":"B64","doi-asserted-by":"publisher","first-page":"3553","DOI":"10.1007\/S10518-015-9795-1","article-title":"The 2013 European seismic hazard model: key components and results","volume":"13","author":"Woessner","year":"2015","journal-title":"Bull Earthquake Eng."},{"key":"B65","doi-asserted-by":"publisher","first-page":"19","DOI":"10.5194\/nhess-10-19-2010","article-title":"Strong foreshock signal preceding the L'Aquila (Italy) earthquake (Mw 6","volume":"10","author":"Papadopoulos","year":"2010","journal-title":"Nat Haz Earth Syst Sci."},{"key":"B66","doi-asserted-by":"publisher","first-page":"8626","DOI":"10.1029\/2019JB017874","article-title":"Improving physics-based aftershock forecasts during the 2016\u20132017 Central Italy earthquake cascade","volume":"124","author":"Mancini","year":"2019","journal-title":"J Geophys Res."},{"key":"B67","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/S40623-016-0564-4","article-title":"First result from the GEONET real-time analysis system (REGARD): the case of the 2016 Kumamoto earthquakes","volume":"68","author":"Kawamoto","year":"2016","journal-title":"Earth Planets Space."},{"key":"B68","article-title":"The 2020 Mw 6","author":"Morton","year":"2020"},{"key":"B69","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1130\/G32528.1","article-title":"Surface rupture during the 2010 Mw 7","volume":"40","author":"Quigley","year":"2012","journal-title":"Geology."},{"key":"B70","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1080\/00288306.2012.676556","article-title":"Statistical analysis of the 2010 Mw 7","volume":"55","author":"Shcherbakov","year":"2012","journal-title":"N Z J Geol Geophys."},{"key":"B71","doi-asserted-by":"publisher","first-page":"764","DOI":"10.1111\/j.1365-246X.2011.04967.x","article-title":"Time variations of aftershock decay parameters of the 2009 April 6 L'Aquila (central Italy) earthquake: Evidence of the emergence of a negative exponential regime superimposed to the power law","volume":"185","author":"Lolli","year":"2011","journal-title":"Geophys J Int."},{"key":"B72","doi-asserted-by":"publisher","first-page":"349","DOI":"10.1029\/2011EO410001","article-title":"Strong shaking in recent New Zealand earthquakes","volume":"92","author":"Fry","year":"2011","journal-title":"Eos."},{"key":"B73","doi-asserted-by":"publisher","first-page":"1229","DOI":"10.1785\/0220180032","article-title":"Highlights from the first ten years of the New Zealand earthquake forecast testing center","volume":"89","author":"Rhoades","year":"2018","journal-title":"Seismol Res Lett."}],"container-title":["Frontiers in Applied Mathematics and Statistics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fams.2023.1126511\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,22]],"date-time":"2024-10-22T06:56:55Z","timestamp":1729580215000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fams.2023.1126511\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,14]]},"references-count":73,"alternative-id":["10.3389\/fams.2023.1126511"],"URL":"https:\/\/doi.org\/10.3389\/fams.2023.1126511","relation":{},"ISSN":["2297-4687"],"issn-type":[{"value":"2297-4687","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,14]]},"article-number":"1126511"}}