{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,11]],"date-time":"2026-11-11T12:48:45Z","timestamp":1794401325166,"version":"4.9.0"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,3,22]],"date-time":"2021-03-22T00:00:00Z","timestamp":1616371200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,3,22]],"date-time":"2021-03-22T00:00:00Z","timestamp":1616371200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000925","name":"National Health and Medical Research Council","doi-asserted-by":"publisher","award":["1158763"],"award-info":[{"award-number":["1158763"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000925","name":"National Health and Medical Research Council","doi-asserted-by":"publisher","award":["1196900"],"award-info":[{"award-number":["1196900"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Res Methodol"],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Interrupted time series analysis is increasingly used to evaluate the impact of large-scale health interventions. While segmented regression is a common approach, it is not always adequate, especially in the presence of seasonality and autocorrelation. An Autoregressive Integrated Moving Average (ARIMA) model is an alternative method that can accommodate these issues.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We describe the underlying theory behind ARIMA models and how they can be used to evaluate population-level interventions, such as the introduction of health policies. We discuss how to select the shape of the impact, the model selection process, transfer functions, checking model fit, and interpretation of findings. We also provide R and SAS code to replicate our results.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We illustrate ARIMA modelling using the example of a policy intervention to reduce inappropriate prescribing. In January 2014, the Australian government eliminated prescription refills for the 25\u2009mg tablet strength of quetiapine, an antipsychotic, to deter its prescribing for non-approved indications. We examine the impact of this policy intervention on dispensing of quetiapine using dispensing claims data.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>ARIMA modelling is a useful tool to evaluate the impact of large-scale interventions when other approaches are not suitable, as it can account for underlying trends, autocorrelation and seasonality and allows for flexible modelling of different types of impacts.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12874-021-01235-8","type":"journal-article","created":{"date-parts":[[2021,3,22]],"date-time":"2021-03-22T11:03:04Z","timestamp":1616410984000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":761,"title":["Interrupted time series analysis using autoregressive integrated moving average (ARIMA) models: a guide for evaluating large-scale health interventions"],"prefix":"10.1186","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3701-4997","authenticated-orcid":false,"given":"Andrea L.","family":"Schaffer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1841-9056","authenticated-orcid":false,"given":"Timothy A.","family":"Dobbins","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7137-6855","authenticated-orcid":false,"given":"Sallie-Anne","family":"Pearson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,3,22]]},"reference":[{"key":"1235_CR1","doi-asserted-by":"publisher","DOI":"10.5888\/pcd12.150187","volume":"12","author":"SB Soumerai","year":"2015","unstructured":"Soumerai SB, Starr D, Majumdar SR. How do you know which health care effectiveness research you can trust? A Guide to Study Design for the Perplexed. Prev Chronic Dis. 2015;12:E101.","journal-title":"Prev Chronic Dis"},{"key":"1235_CR2","unstructured":"Shadish WR, Cook TD, Campbell DT. Experimental and quasi-experimental designs for generalized causal inference. Belmont, CA: Wadsworth\/Cengage Learning; 2002."},{"key":"1235_CR3","doi-asserted-by":"publisher","first-page":"2082","DOI":"10.1093\/ije\/dyy135","volume":"47","author":"J Lopez Bernal","year":"2018","unstructured":"Lopez Bernal J, Cummins S, Gasparrini A. The use of controls in interrupted time series studies of public health interventions. Int J Epidemiol. 2018;47:2082\u201393.","journal-title":"Int J Epidemiol"},{"key":"1235_CR4","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1016\/j.jclinepi.2014.10.003","volume":"68","author":"A Fretheim","year":"2015","unstructured":"Fretheim A, Zhang F, Ross-Degnan D, Oxman AD, Cheyne H, Foy R, et al. A reanalysis of cluster randomized trials showed interrupted time-series studies were valuable in health system evaluation. J Clin Epidemiol. 2015;68:324\u201333.","journal-title":"J Clin Epidemiol"},{"key":"1235_CR5","doi-asserted-by":"publisher","first-page":"82","DOI":"10.1016\/j.jclinepi.2018.05.026","volume":"103","author":"JL Bernal","year":"2018","unstructured":"Bernal JL, Soumerai S, Gasparrini A. A methodological framework for model selection in interrupted time series studies. J Clin Epidemiol. 2018;103:82\u201391.","journal-title":"J Clin Epidemiol"},{"key":"1235_CR6","first-page":"348","volume":"46","author":"J Lopez Bernal","year":"2016","unstructured":"Lopez Bernal J, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2016;46:348\u201355.","journal-title":"Int J Epidemiol"},{"key":"1235_CR7","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1046\/j.1365-2710.2002.00430.x","volume":"27","author":"AK Wagner","year":"2002","unstructured":"Wagner AK, Soumerai SB, Zhang F, Ross-Degnan D. Segmented regression analysis of interrupted time series studies in medication use research. J Clin Pharm Ther. 2002;27:299\u2013309.","journal-title":"J Clin Pharm Ther"},{"key":"1235_CR8","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1093\/heapol\/czr004","volume":"27","author":"M Lagarde","year":"2012","unstructured":"Lagarde M. How to do (or not to do) \u2026 assessing the impact of a policy change with routine longitudinal data. Health Policy Plan. 2012;27:76\u201383.","journal-title":"Health Policy Plan"},{"key":"1235_CR9","doi-asserted-by":"publisher","first-page":"1866","DOI":"10.1111\/add.14643","volume":"114","author":"E Beard","year":"2019","unstructured":"Beard E, Marsden J, Brown J, Tombor I, Stapleton J, Michie S, et al. Understanding and using time series analyses in addiction research. Addiction. 2019;114:1866\u201384.","journal-title":"Addiction."},{"key":"1235_CR10","doi-asserted-by":"crossref","unstructured":"Hyndman R, Athanasopoulos G. Forecasting: principles and practice. 2nd edition. 2018. https:\/\/otexts.com\/fpp2\/. .","DOI":"10.32614\/CRAN.package.fpp2"},{"key":"1235_CR11","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1093\/cid\/cis509","volume":"55","author":"L Sun","year":"2012","unstructured":"Sun L, Klein EY, Laxminarayan R. Seasonality and temporal correlation between community antibiotic use and resistance in the United States. Clin Infect Dis. 2012;55:687\u201394.","journal-title":"Clin Infect Dis"},{"key":"1235_CR12","doi-asserted-by":"publisher","first-page":"869","DOI":"10.1186\/1471-2458-12-869","volume":"12","author":"A Schaffer","year":"2012","unstructured":"Schaffer A, Muscatello D, Cretikos M, Gilmour R, Tobin S, Ward J. The impact of influenza a(H1N1)pdm09 compared with seasonal influenza on intensive care admissions in New South Wales, Australia, 2007 to 2010: a time series analysis. BMC Public Health. 2012;12:869.","journal-title":"BMC Public Health"},{"key":"1235_CR13","doi-asserted-by":"publisher","first-page":"634","DOI":"10.1186\/s13104-015-1616-8","volume":"8","author":"L Mellish","year":"2015","unstructured":"Mellish L, Karanges EA, Litchfield MJ, Schaffer AL, Blanch B, Daniels BJ, et al. The Australian pharmaceutical benefits scheme data collection: a practical guide for researchers. BMC Res Notes. 2015;8:634.","journal-title":"BMC Res Notes"},{"key":"1235_CR14","doi-asserted-by":"publisher","first-page":"1072","DOI":"10.1002\/pds.5026","volume":"29","author":"K B\u00f8dkergaard","year":"2020","unstructured":"B\u00f8dkergaard K, Selmer RM, Hallas J, Kjerpeseth LJ, Potteg\u00e5rd A, Skovlund E, et al. Using the waiting time distribution with random index dates to estimate prescription durations in the presence of seasonal stockpiling. Pharmacoepidemiol Drug Saf. 2020;29:1072\u20138.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"1235_CR15","doi-asserted-by":"crossref","unstructured":"Liboschik T, Fokianos K, Fried R tscount: An R Package for Analysis of Count Time Series Following Generalized Linear Models J Stat Softw 2017;82:1\u201351.","DOI":"10.18637\/jss.v082.i05"},{"key":"1235_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v067.i07","volume":"67","author":"WTM Dunsmuir","year":"2015","unstructured":"Dunsmuir WTM, Scott DJ. The glarma package for observation-driven time series regression of counts. J Stat Softw. 2015;67:1\u201336.","journal-title":"J Stat Softw"},{"key":"1235_CR17","doi-asserted-by":"publisher","first-page":"591","DOI":"10.5694\/mja15.00103","volume":"202","author":"AL Schaffer","year":"2015","unstructured":"Schaffer AL, Buckley NA, Dobbins TA, Banks E, Pearson S-A. The crux of the matter: did the ABC\u2019s catalyst program change statin use in Australia? Med J Aust. 2015;202:591\u20134.","journal-title":"Med J Aust"},{"key":"1235_CR18","doi-asserted-by":"publisher","first-page":"1223","DOI":"10.1001\/jamainternmed.2016.2992","volume":"176","author":"AL Schaffer","year":"2016","unstructured":"Schaffer AL, Buckley NA, Cairns R, Pearson S-A. Interrupted time series analysis of the effect of rescheduling alprazolam in Australia: taking control of prescription drug use. JAMA Intern Med. 2016;176:1223\u20135.","journal-title":"JAMA Intern Med"},{"key":"1235_CR19","doi-asserted-by":"publisher","first-page":"29","DOI":"10.5694\/mja13.11070","volume":"200","author":"JM Young","year":"2014","unstructured":"Young JM, Stacey I, Dobbins TA, Dunlop S, Dessaix AL, Currow DC. Association between tobacco plain packaging and Quitline calls: a population-based, interrupted time-series analysis. Med J Aust. 2014;200:29\u201332.","journal-title":"Med J Aust"},{"key":"1235_CR20","doi-asserted-by":"publisher","first-page":"16","DOI":"10.1186\/1471-2288-6-16","volume":"6","author":"S Gilmour","year":"2006","unstructured":"Gilmour S, Degenhardt L, Hall W, Day C. Using intervention time series analyses to assess the effects of imperfectly identifiable natural events: a general method and example. BMC Med Res Methodol. 2006;6:16.","journal-title":"BMC Med Res Methodol"},{"key":"1235_CR21","doi-asserted-by":"publisher","first-page":"100","DOI":"10.1186\/s12889-017-4998-9","volume":"18","author":"TJ Lane","year":"2018","unstructured":"Lane TJ, Gray S, Hassani-Mahmooei B, Collie A. Effectiveness of employer financial incentives in reducing time to report worker injury: an interrupted time series study of two Australian workers\u2019 compensation jurisdictions. BMC Public Health. 2018;18:100.","journal-title":"BMC Public Health"},{"key":"1235_CR22","doi-asserted-by":"publisher","first-page":"8","DOI":"10.3111\/13696998.2011.626097","volume":"15","author":"P Sun","year":"2011","unstructured":"Sun P, Chang J, Zhang J, Khaler K. Evolutionary cost analysis of valsartan initiation among patients with hypertension: a time series approach. J Med Econ. 2011;15:8\u201318.","journal-title":"J Med Econ"},{"key":"1235_CR23","doi-asserted-by":"publisher","DOI":"10.1002\/9781118619193","volume-title":"Time series analysis: forecasting and control","author":"GEP Box","year":"2008","unstructured":"Box GEP, Jenkins GM, Reinsel GC. Time series analysis: forecasting and control. Hoboken, NJ: John Wiley & Sons, Inc.; 2008. https:\/\/doi.org\/10.1002\/9781118619193."},{"key":"1235_CR24","doi-asserted-by":"publisher","first-page":"808","DOI":"10.1093\/ije\/20.3.808","volume":"20","author":"U Helfenstein","year":"1991","unstructured":"Helfenstein U. The use of transfer function models, intervention analysis and related time series methods in epidemiology. Int J Epidemiol. 1991;20:808\u201315.","journal-title":"Int J Epidemiol"},{"key":"1235_CR25","doi-asserted-by":"publisher","DOI":"10.1002\/9781118150528","volume-title":"Forecasting with dynamic regression models","author":"A Pankratz","year":"1991","unstructured":"Pankratz A. Forecasting with dynamic regression models. Hoboken, NJ, USA: John Wiley & Sons, Inc.; 1991. https:\/\/doi.org\/10.1002\/9781118150528."},{"key":"1235_CR26","unstructured":"Hyndman R, Kostenko AV. Minimum Sample Size requirements for Seasonal Forecasting Models. Foresight Int J Appl Forecast. 2007;:12\u20135."},{"key":"1235_CR27","doi-asserted-by":"publisher","first-page":"439","DOI":"10.1002\/pds.4408","volume":"27","author":"J Brett","year":"2018","unstructured":"Brett J, Schaffer A, Dobbins T, Buckley NA, Pearson SA. The impact of permissive and restrictive pharmaceutical policies on quetiapine dispensing: evaluating a policy pendulum using interrupted time series analysis. Pharmacoepidemiol Drug Saf. 2018;27:439\u201346.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"1235_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v027.i03","volume":"27","author":"RJ Hyndman","year":"2008","unstructured":"Hyndman RJ, Khandakar Y. Automatic time series forecasting: the forecast package for R. J Stat Softw. 2008;27:1\u201322.","journal-title":"J Stat Softw"},{"key":"1235_CR29","doi-asserted-by":"crossref","unstructured":"Lu CY, Simon G, Soumerai SB Counter-Point: Staying Honest When Policy Changes Backfire Med Care 2018;56:384.","DOI":"10.1097\/MLR.0000000000000897"},{"key":"1235_CR30","first-page":"39","volume":"14","author":"J Shaw","year":"2019","unstructured":"Shaw J, Murphy AL, Turner JP, Gardner DM, Silvius JL, Bouck Z, et al. Policies for Deprescribing: an international scan of intended and unintended outcomes of limiting sedative-hypnotic use in community-dwelling older adults. Healthc Policy Polit Sante. 2019;14:39\u201351.","journal-title":"Healthc Policy Polit Sante"},{"key":"1235_CR31","doi-asserted-by":"publisher","first-page":"986","DOI":"10.1002\/pds.3480","volume":"22","author":"BA Briesacher","year":"2013","unstructured":"Briesacher BA, Soumerai SB, Zhang F, Toh S, Andrade SE, Wagner JL, et al. A critical review of methods to evaluate the impact of FDA regulatory actions. Pharmacoepidemiol Drug Saf. 2013;22:986\u201394.","journal-title":"Pharmacoepidemiol Drug Saf"},{"key":"1235_CR32","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1186\/s12874-019-0777-x","volume":"19","author":"J Hudson","year":"2019","unstructured":"Hudson J, Fielding S, Ramsay CR. Methodology and reporting characteristics of studies using interrupted time series design in healthcare. BMC Med Res Methodol. 2019;19:137.","journal-title":"BMC Med Res Methodol"},{"key":"1235_CR33","doi-asserted-by":"publisher","first-page":"950","DOI":"10.1016\/j.jclinepi.2014.12.018","volume":"68","author":"R Jandoc","year":"2015","unstructured":"Jandoc R, Burden AM, Mamdani M, L\u00e9vesque LE, Cadarette SM. Interrupted time series analysis in drug utilization research is increasing: systematic review and recommendations. J Clin Epidemiol. 2015;68:950\u20136.","journal-title":"J Clin Epidemiol"}],"container-title":["BMC Medical Research Methodology"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-021-01235-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/s12874-021-01235-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/s12874-021-01235-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,26]],"date-time":"2024-08-26T11:00:14Z","timestamp":1724670014000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedresmethodol.biomedcentral.com\/articles\/10.1186\/s12874-021-01235-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,22]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["1235"],"URL":"https:\/\/doi.org\/10.1186\/s12874-021-01235-8","relation":{},"ISSN":["1471-2288"],"issn-type":[{"value":"1471-2288","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,3,22]]},"assertion":[{"value":"13 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 March 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"As this study relied on publicly available, aggregate data no ethics approval was required.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The Centre for Big Data Research in Health, UNSW Sydney has received funding from AbbVie Australia to conduct research unrelated to the present study. AbbVie did not have any knowledge of, or involvement in, the present study. SAP is a member of the Drug Utilisation Sub Committee of the Pharmaceutical Benefits Advisory Committee. The views expressed in this paper do not represent those of the Committee.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"58"}}