{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T19:32:15Z","timestamp":1793734335628,"version":"4.6.1"},"reference-count":29,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T00:00:00Z","timestamp":1790121600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"name":"Australian Government Medical Research Future Fund","award":["2022\u20132025"],"award-info":[{"award-number":["2022\u20132025"]}],"id":[{"id":"https:\/\/ror.org\/0513v5k17","id-type":"ROR","asserted-by":"crossref"}]},{"name":"Australian Government Medical Research Future Fund","award":["2015823"],"award-info":[{"award-number":["2015823"]}],"id":[{"id":"https:\/\/ror.org\/0513v5k17","id-type":"ROR","asserted-by":"crossref"}]},{"name":"National Health and Medical Research Council","award":["GNT119378"],"award-info":[{"award-number":["GNT119378"]}],"id":[{"id":"https:\/\/ror.org\/011kf5r70","id-type":"ROR","asserted-by":"crossref"}]},{"name":"NHMRC Investigator","award":["GNT2026400"],"award-info":[{"award-number":["GNT2026400"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2026,10,5]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Detection of outliers is a common feature of quality monitoring programs, with the goal of identifying unwarranted variation in quality of care. However, there remains limited agreement on the most appropriate methods for detecting outliers, in particular in long-term care facilities. This study aimed to compare methods for outlier detection among long-term care facilities and assess the suitability of each method for use in monitoring quality and safety of care.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>A cross-sectional population-based study of Australian long-term care facilities during 2019 was conducted using the Registry of Senior Australians National Historical Cohort. Outlier detection methods differing in control limits, handling of overdispersion, and use of multiple testing adjustments identified outlier long-term care facilities on four quality indicators (emergency department presentations, antipsychotic use, fall-related hospitalizations, and pressure injury-related hospitalizations). The number of outliers identified using each method and the agreement between methods was examined. Simulation studies were undertaken to assess reasons for differences between methods.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>A total of 234 890 persons (241 925 person-episodes) at 2744 long-term care facilities were included. The indicator with the highest event rate was emergency department presentations (37.9% of person-episodes), followed by antipsychotic use (21.5%), fall-related hospitalizations (13.6%), and pressure injury-related hospitalizations (3.4%). Most indicators exhibited some overdispersion. Differences between confidence interval-based and prediction interval-based methods were largest for low event rate indicators, where the number of outliers with higher-than-expected event rates identified differed by up to a factor of 4. Methods that did not address overdispersion had high false-positive rates.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>These results indicate that the number of long-term care facility outliers identified can vary widely between methods. Quality monitoring programs in long-term care should use appropriate prediction interval-based methods for constructing control limits and take steps to address overdispersion.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/intqhc\/mzag144","type":"journal-article","created":{"date-parts":[[2026,9,22]],"date-time":"2026-09-22T11:41:14Z","timestamp":1790077274000},"source":"Crossref","is-referenced-by-count":0,"title":["Comparing methodological approaches for outlier detection: a cross-sectional study of 2744 Australian long-term care facilities"],"prefix":"10.1093","volume":"38","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2476-6989","authenticated-orcid":false,"given":"Dylan","family":"Harries","sequence":"first","affiliation":[{"name":"Registry of Senior Australians Research Centre, South Australian Health and Medical Research Institute , Adelaide, South Australia,","place":["Australia"]},{"name":"Registry of Senior Australians Research Centre, Caring Futures Institute, College of Health and Enablement, Flinders University, Bedford Park, South Australia ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0916-3098","authenticated-orcid":false,"given":"Johannes","family":"Schwabe","sequence":"additional","affiliation":[{"name":"Registry of Senior Australians Research Centre, South Australian Health and Medical Research Institute , Adelaide, South Australia,","place":["Australia"]},{"name":"Registry of Senior Australians Research Centre, Caring Futures Institute, College of Health and Enablement, Flinders University, Bedford Park, South Australia ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9634-2803","authenticated-orcid":false,"given":"Robert N","family":"Jorissen","sequence":"additional","affiliation":[{"name":"Registry of Senior Australians Research Centre, South Australian Health and Medical Research Institute , Adelaide, South Australia,","place":["Australia"]},{"name":"Registry of Senior Australians Research Centre, Caring Futures Institute, College of Health and Enablement, Flinders University, Bedford Park, South Australia ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9097-0374","authenticated-orcid":false,"given":"Brian W","family":"Pulling","sequence":"additional","affiliation":[{"name":"Registry of Senior Australians Research Centre, South Australian Health and Medical Research Institute , Adelaide, South Australia,","place":["Australia"]},{"name":"Registry of Senior Australians Research Centre, Caring Futures Institute, College of Health and Enablement, Flinders University, Bedford Park, South Australia ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1192-4121","authenticated-orcid":false,"given":"Gillian E","family":"Caughey","sequence":"additional","affiliation":[{"name":"Registry of Senior Australians Research Centre, South Australian Health and Medical Research Institute , Adelaide, South Australia,","place":["Australia"]},{"name":"Registry of Senior Australians Research Centre, Caring Futures Institute, College of Health and Enablement, Flinders University, Bedford Park, South Australia ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2840-3496","authenticated-orcid":false,"given":"Tracy","family":"Comans","sequence":"additional","affiliation":[{"name":"National Ageing Research Institute, Royal Melbourne Hospital , Melbourne, Victoria,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8261-2665","authenticated-orcid":false,"given":"Maria C","family":"Inacio","sequence":"additional","affiliation":[{"name":"Registry of Senior Australians Research Centre, South Australian Health and Medical Research Institute , Adelaide, South Australia,","place":["Australia"]},{"name":"Registry of Senior Australians Research Centre, Caring Futures Institute, College of Health and Enablement, Flinders University, Bedford Park, South Australia ,","place":["Australia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"name":"the ACAC QMET Collaborators","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Len C","family":"Gray","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Johanna I","family":"Westbrook","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeffrey","family":"Braithwaite","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peter","family":"Hibbert","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Janet K","family":"Sluggett","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nasir","family":"Wabe","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2026,9,23]]},"reference":[{"key":"2026110314113645900_mzag144-B1","author":"Australian Government. Department of Health and Aged Care","year":"2021"},{"key":"2026110314113645900_mzag144-B2","doi-asserted-by":"publisher","first-page":"105747","DOI":"10.1016\/j.jamda.2025.105747","article-title":"Quality indicators to monitor care in long-term care facilities: a scoping review","volume":"26","author":"Caughey","year":"2025","journal-title":"J Am Med Dir Assoc"},{"key":"2026110314113645900_mzag144-B3","doi-asserted-by":"publisher","first-page":"105876","DOI":"10.1016\/j.jamda.2025.105876","article-title":"Quality indicators to monitor home care services for the older population: a scoping review","volume":"26","author":"Caughey","year":"2025","journal-title":"J Am Med Dir Assoc"},{"key":"2026110314113645900_mzag144-B4","doi-asserted-by":"publisher","first-page":"683","DOI":"10.1056\/NEJMsb1002320","article-title":"Accountability measures\u2014using measurement to promote quality improvement","volume":"363","author":"Chassin","year":"2010","journal-title":"N Engl J Med"},{"key":"2026110314113645900_mzag144-B5","volume-title":"Design for Care Compare Nursing Home Five-Star Quality Rating System: Technical Users\u2019 Guide July 2025","author":"Centers for Medicare & Medicaid Services"},{"key":"2026110314113645900_mzag144-B6","author":"Australian Government. Department of Health and Aged Care. Star Ratings Provider Manual","year":"2025"},{"key":"2026110314113645900_mzag144-B7","doi-asserted-by":"publisher","first-page":"e069130","DOI":"10.1136\/bmjopen-2022-069130","article-title":"Evaluations of statistical methods for outlier detection when benchmarking in clinical registries: a systematic review","volume":"13","author":"Hansen","year":"2023","journal-title":"BMJ Open"},{"key":"2026110314113645900_mzag144-B8","doi-asserted-by":"publisher","first-page":"526","DOI":"10.1177\/0272989X03258443","article-title":"The use of fixed-and random-effects models for classifying hospitals as mortality outliers: a Monte Carlo assessment","volume":"23","author":"Austin","year":"2003","journal-title":"Med Decis Making"},{"key":"2026110314113645900_mzag144-B9","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1161\/CIRCOUTCOMES.113.000685","article-title":"Effect of provider volume on the accuracy\u00a0of hospital report cards","volume":"7","author":"Austin","year":"2014","journal-title":"Circ Cardiovasc Qual Outcomes"},{"key":"2026110314113645900_mzag144-B10","doi-asserted-by":"publisher","first-page":"246","DOI":"10.1007\/s10742-024-00338-1","article-title":"Evaluating methods of outlier detection when benchmarking clinical registry data\u2013a simulation study","volume":"25","author":"Hansen","year":"2025","journal-title":"Health Serv Outcomes Res Method"},{"key":"2026110314113645900_mzag144-B11","doi-asserted-by":"publisher","first-page":"133517","DOI":"10.1016\/j.ijcard.2025.133517","article-title":"Evaluating methods to detect variation in hospital level mortality and renal insufficiency within an Australian cardiac surgery registry","volume":"438","author":"Hansen","year":"2025","journal-title":"Int J Cardiol"},{"key":"2026110314113645900_mzag144-B12","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1056\/NEJM199602083340611","article-title":"Benefits and hazards of reporting medical outcomes publicly","volume":"334","author":"Chassin","year":"1996","journal-title":"N Engl J Med"},{"key":"2026110314113645900_mzag144-B13","doi-asserted-by":"publisher","first-page":"3350","DOI":"10.1177\/0962280217700169","article-title":"Guidelines on constructing funnel plots for quality indicators: a case study on mortality in intensive care unit patients","volume":"27","author":"Verburg","year":"2018","journal-title":"Stat Methods Med Res"},{"key":"2026110314113645900_mzag144-B14","doi-asserted-by":"publisher","first-page":"1185","DOI":"10.1002\/sim.1970","article-title":"Funnel plots for comparing institutional performance","volume":"24","author":"Spiegelhalter","year":"2005","journal-title":"Stat Med"},{"key":"2026110314113645900_mzag144-B15","doi-asserted-by":"publisher","first-page":"e066390","DOI":"10.1136\/bmjopen-2022-066390","article-title":"Registry of Senior Australians (ROSA): integrating cross-sectoral information to evaluate quality and safety of care provided to older people","volume":"12","author":"Inacio","year":"2022","journal-title":"BMJ Open"},{"key":"2026110314113645900_mzag144-B16","doi-asserted-by":"publisher","first-page":"502","DOI":"10.1093\/intqhc\/mzaa078","article-title":"The Registry of Senior Australians outcome monitoring system: quality and safety indicators for residential aged care","volume":"32","author":"Inacio","year":"2020","journal-title":"Int J Qual Health Care"},{"key":"2026110314113645900_mzag144-B17","author":"Registry of Senior Australians","year":"2024"},{"key":"2026110314113645900_mzag144-B18","doi-asserted-by":"publisher","first-page":"e021122","DOI":"10.1136\/bmjopen-2017-021122","article-title":"The validity of the Rx-risk Comorbidity Index using medicines mapped to the Anatomical Therapeutic Chemical (ATC) classification system","volume":"8","author":"Pratt","year":"2018","journal-title":"BMJ Open"},{"key":"2026110314113645900_mzag144-B19","author":"Australian Government Department of Health and Aged Care","year":"2025"},{"key":"2026110314113645900_mzag144-B20","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1186\/1471-2288-12-98","article-title":"The probability of being identified as an outlier with commonly used funnel plot control limits for the standardised mortality ratio","volume":"12","author":"Seaton","year":"2012","journal-title":"BMC Med Res Methodol"},{"key":"2026110314113645900_mzag144-B21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1111\/j.1467-985X.2011.01010.x","article-title":"Statistical methods for healthcare regulation: rating, screening and surveillance","volume":"175","author":"Spiegelhalter","year":"2012","journal-title":"J R Stat Soc A"},{"key":"2026110314113645900_mzag144-B22","doi-asserted-by":"publisher","first-page":"520","DOI":"10.1136\/bmjqs-2019-009447","article-title":"Quality measurement and nursing homes: measuring what matters","volume":"28","author":"Burke","year":"2019","journal-title":"BMJ Qual Saf"},{"key":"2026110314113645900_mzag144-B23","doi-asserted-by":"publisher","first-page":"2645","DOI":"10.1002\/(SICI)1097-0258(19971215)16:23&lt;2645::AID-SIM696&gt;3.0.CO;2-D","article-title":"Comparing risk-adjustment methods for provider profiling","volume":"16","author":"DeLong","year":"1997","journal-title":"Statist Med"},{"key":"2026110314113645900_mzag144-B24","doi-asserted-by":"publisher","first-page":"3609","DOI":"10.1002\/sim.2215","article-title":"The effect of provider-level ascertainment bias on profiling nursing homes","volume":"24","author":"Roy","year":"2005","journal-title":"Stat Med"},{"key":"2026110314113645900_mzag144-B25","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1097\/SLA.0b013e31818e544b","article-title":"Impact of statistical approaches for handling missing data on trauma center quality","volume":"249","author":"Glance","year":"2009","journal-title":"Ann Surg"},{"key":"2026110314113645900_mzag144-B26","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1177\/0269216311398700","article-title":"Using maps and funnel plots to explore variation in place of death from cancer within London, 2002\u20132007","volume":"25","author":"Madden","year":"2011","journal-title":"Palliat Med"},{"key":"2026110314113645900_mzag144-B27","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.canep.2011.07.004","article-title":"Impact of using multiple causes of death codes to compute site-specific, death certificate-based cancer mortality statistics in the United States","volume":"36","author":"Fink","year":"2012","journal-title":"Cancer Epidemiol"},{"key":"2026110314113645900_mzag144-B28","author":"Australian Government Department of Health and Aged Care","year":"2018"},{"key":"2026110314113645900_mzag144-B29","author":"The Association for Public Health Observatories","year":"2009"}],"container-title":["International Journal for Quality in Health Care"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/intqhc\/advance-article-pdf\/doi\/10.1093\/intqhc\/mzag144\/71348184\/mzag144.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/intqhc\/article-pdf\/38\/4\/mzag144\/71348184\/mzag144.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/intqhc\/article-pdf\/38\/4\/mzag144\/71348184\/mzag144.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,11,3]],"date-time":"2026-11-03T19:11:46Z","timestamp":1793733106000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/intqhc\/article\/doi\/10.1093\/intqhc\/mzag144\/8832244"}},"subtitle":[],"editor":[{"given":"Bronwyn","family":"Newman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,9,23]]},"references-count":29,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2026,10,5]]}},"URL":"https:\/\/doi.org\/10.1093\/intqhc\/mzag144","relation":{},"ISSN":["1353-4505","1464-3677"],"issn-type":[{"value":"1353-4505","type":"print"},{"value":"1464-3677","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2026,10]]},"published":{"date-parts":[[2026,9,23]]},"article-number":"mzag144"}}