{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,16]],"date-time":"2026-10-16T10:42:31Z","timestamp":1792147351130,"version":"4.4.0"},"reference-count":42,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T00:00:00Z","timestamp":1753228800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T00:00:00Z","timestamp":1753228800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"Australian Government Research Training Program (RTP) Stipend and RTP Fee-Offset Scholarship through Monash University"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["HIM J"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:p>\n                    <jats:bold>Background:<\/jats:bold>\n                    There is increasing interest in the public reporting of health provider benchmarking within clinical registries to identify underperforming sites (also known as outliers). As such, research into the optimal methods and ideal conditions for outlier detection is important.\n                    <jats:bold>Objective:<\/jats:bold>\n                    The aim of this study was to assess the accuracy of benchmarking and outlier classification methods for different values of clinical registry sizes and case volume minimums.\n                    <jats:bold>Method:<\/jats:bold>\n                    Clinical registry datasets were parametrically simulated varying the following parameters: number of sites, clinicians, patients and outcome events, case volume minimum and outcome prevalence. Two benchmarking models (unadjusted and risk-adjusted with logistic regression) and two outlier classification techniques (confidence intervals and control limits) were applied to each simulated dataset. The accuracy of outlier flagging was assessed using the receiver operator characteristic area under the curve (ROCAUC).\n                    <jats:bold>Results:<\/jats:bold>\n                    Risk-adjusted benchmarking performed better than unadjusted benchmarking across the registry sizes evaluated, providing up to a 20% increase in ROCAUC. The number of sites and clinicians had little effect on performance, while higher accuracy with increasing number of patients per site and outcome prevalence was observed. A threshold of 100 to 150 outcome events per site was needed to reach &gt;80% ROCAUC.\n                    <jats:bold>Conclusion:<\/jats:bold>\n                    The use of low prevalence outcomes for benchmarking hospitals to detect outliers may be inappropriate, especially for clinical registries with low patient volumes.\n                    <jats:bold>Implications for health information management practice:<\/jats:bold>\n                    Clinical registries should consider their patient volumes and outcome prevalence before commencing benchmarking analyses to determine if acceptable accuracy can be achieved for their setting.\n                  <\/jats:p>","DOI":"10.1177\/18333583251355820","type":"journal-article","created":{"date-parts":[[2025,7,23]],"date-time":"2025-07-23T12:03:21Z","timestamp":1753272201000},"page":"80-89","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":4,"title":["Accuracy of site benchmarking in clinical quality registries of varying size"],"prefix":"10.1177","volume":"55","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5583-8773","authenticated-orcid":false,"given":"Jessy","family":"Hansen","sequence":"first","affiliation":[{"name":"School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ahmad Reza","family":"Pourghaderi","sequence":"additional","affiliation":[{"name":"School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9413-6897","authenticated-orcid":false,"given":"Susannah","family":"Ahern","sequence":"additional","affiliation":[{"name":"School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2693-5034","authenticated-orcid":false,"given":"Arul","family":"Earnest","sequence":"additional","affiliation":[{"name":"School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,7,23]]},"reference":[{"key":"e_1_3_3_2_1","doi-asserted-by":"publisher","DOI":"10.5694\/mja16.00659"},{"key":"e_1_3_3_3_1","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCOUTCOMES.113.000685"},{"key":"e_1_3_3_4_1","unstructured":"Australian Commission on Safety and Quality in Health Care (ACSQHC) (2022a) Australian Register of Clinical Registries. Available at: https:\/\/www.safetyandquality.gov.au\/publications-and-resources\/australian-register-clinical-registries (accessed 1 August 2022)."},{"key":"e_1_3_3_5_1","unstructured":"Australian Commission on Safety and Quality in Health Care (ACSQHC) (2022b) Framework for Australian clinical quality registries - a national standard for clinical safety and quality data collections and reporting Second Edition. Report Commonwealth of Australia Australia December."},{"key":"e_1_3_3_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.healthpol.2016.08.003"},{"key":"e_1_3_3_7_1","doi-asserted-by":"publisher","DOI":"10.5334\/egems.248"},{"key":"e_1_3_3_8_1","doi-asserted-by":"publisher","DOI":"10.1111\/ans.17438"},{"key":"e_1_3_3_9_1","doi-asserted-by":"publisher","DOI":"10.5694\/mja16.00027"},{"key":"e_1_3_3_10_1","doi-asserted-by":"publisher","DOI":"10.1097\/TA.0000000000002297"},{"key":"e_1_3_3_11_1","unstructured":"Department of Health (2021) Maximising the value of Australia\u2019s clinical quality outcomes data\u2014A national strategy for clinical quality registries and virtual registries. Report Department of Health Australia February."},{"key":"e_1_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.1177\/0272989X13498825"},{"key":"e_1_3_3_13_1","doi-asserted-by":"publisher","DOI":"10.5694\/j.1326-5377.2011.tb03007.x"},{"key":"e_1_3_3_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/imj.13289"},{"key":"e_1_3_3_15_1","doi-asserted-by":"publisher","DOI":"10.2307\/2983325"},{"key":"e_1_3_3_16_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2022-069130"},{"key":"e_1_3_3_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10742-024-00338-1"},{"key":"e_1_3_3_18_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-199608000-00002"},{"key":"e_1_3_3_19_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0183667"},{"key":"e_1_3_3_20_1","doi-asserted-by":"publisher","DOI":"10.1093\/intqhc\/mzx196"},{"key":"e_1_3_3_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10729-013-9264-9"},{"key":"e_1_3_3_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.5779"},{"key":"e_1_3_3_23_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-018-3832-0"},{"key":"e_1_3_3_24_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12877-020-01741-2"},{"key":"e_1_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0000000000002166"},{"key":"e_1_3_3_26_1","doi-asserted-by":"publisher","DOI":"10.5694\/j.1326-5377.2010.tb03499.x"},{"key":"e_1_3_3_27_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12884-016-0921-0"},{"key":"e_1_3_3_28_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.8086"},{"key":"e_1_3_3_29_1","doi-asserted-by":"publisher","DOI":"10.1111\/1475-6773.12149"},{"key":"e_1_3_3_30_1","doi-asserted-by":"publisher","DOI":"10.1136\/gutjnl-2011-301941"},{"key":"e_1_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.prrv.2013.04.004"},{"key":"e_1_3_3_32_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjop.12081"},{"key":"e_1_3_3_33_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2012-001689"},{"key":"e_1_3_3_34_1","doi-asserted-by":"publisher","DOI":"10.1097\/MLR.0000000000000407"},{"key":"e_1_3_3_35_1","doi-asserted-by":"publisher","DOI":"10.1186\/1471-2288-14-53"},{"key":"e_1_3_3_36_1","doi-asserted-by":"publisher","DOI":"10.1002\/sim.1970"},{"key":"e_1_3_3_37_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-985X.2011.01010.x"},{"key":"e_1_3_3_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2014.08.097"},{"key":"e_1_3_3_39_1","doi-asserted-by":"publisher","DOI":"10.1097\/00005650-199901000-00012"},{"key":"e_1_3_3_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jval.2020.05.011"},{"key":"e_1_3_3_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0140-6736(13)61491-9"},{"key":"e_1_3_3_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-020-05923-x"},{"key":"e_1_3_3_43_1","doi-asserted-by":"publisher","DOI":"10.5694\/mja15.00921"}],"container-title":["Health Information Management Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/18333583251355820","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/18333583251355820","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/18333583251355820","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:04:48Z","timestamp":1777449888000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/18333583251355820"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,23]]},"references-count":42,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1177\/18333583251355820"],"URL":"https:\/\/doi.org\/10.1177\/18333583251355820","relation":{},"ISSN":["1833-3583","1833-3575"],"issn-type":[{"value":"1833-3583","type":"print"},{"value":"1833-3575","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,23]]}}}