{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,16]],"date-time":"2026-07-16T02:32:10Z","timestamp":1784169130647,"version":"3.55.0"},"reference-count":42,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2024,12,17]],"date-time":"2024-12-17T00:00:00Z","timestamp":1734393600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000724","name":"The Health Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000724","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/T001569\/1"],"award-info":[{"award-number":["EP\/T001569\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/W006022\/1"],"award-info":[{"award-number":["EP\/W006022\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100023699","name":"Health Data Research UK","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100023699","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012338","name":"Alan Turing Institute","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100012338","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.plosdigitalhealth.org"],"crossmark-restriction":false},"short-container-title":["PLOS Digit Health"],"abstract":"<jats:p>The Scottish Patients at Risk of Re-Admission and Admission (SPARRA) score predicts individual risk of emergency hospital admission for approximately 80% of the Scottish population. It was developed using routinely collected electronic health records, and is used by primary care practitioners to inform anticipatory care, particularly for individuals with high healthcare needs. We comprehensively assess the SPARRA score across population subgroups defined by age, sex, ethnicity, socioeconomic deprivation, and geographic location. For these subgroups, we consider differences in overall performance, score distribution, and false positive and negative rates, using causal methods to identify effects mediated through age, sex, and deprivation. We show that the score is well-calibrated across subgroups, but that rates of false positives and negatives vary widely, mediated by various causes including variability in demographic characteristics, admission reasons, and potentially differential data availability. Our work assists practitioners in the application and interpretation of the SPARRA score in population subgroups.<\/jats:p>","DOI":"10.1371\/journal.pdig.0000675","type":"journal-article","created":{"date-parts":[[2024,12,17]],"date-time":"2024-12-17T18:29:11Z","timestamp":1734460151000},"page":"e0000675","update-policy":"https:\/\/doi.org\/10.1371\/journal.pdig.corrections_policy","source":"Crossref","is-referenced-by-count":2,"title":["Differential behaviour of a risk score for emergency hospital admission by demographics in Scotland\u2014A retrospective study"],"prefix":"10.1371","volume":"3","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6928-2198","authenticated-orcid":true,"given":"Ioanna","family":"Thoma","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3578-4477","authenticated-orcid":true,"given":"Simon","family":"Rogers","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jillian","family":"Ireland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rachel","family":"Porteous","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katie","family":"Borland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3638-1960","authenticated-orcid":true,"given":"Catalina A.","family":"Vallejos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2211-233X","authenticated-orcid":true,"given":"Louis J. M.","family":"Aslett","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0049-8238","authenticated-orcid":true,"given":"James","family":"Liley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2024,12,17]]},"reference":[{"issue":"10035","key":"pdig.0000675.ref001","doi-asserted-by":"crossref","first-page":"2323","DOI":"10.1016\/S0140-6736(16)00620-6","article-title":"Clinical workload in UK primary care: a retrospective analysis of 100 million consultations in England, 2007\u201314","volume":"387","author":"FR Hobbs","year":"2016","journal-title":"The Lancet"},{"issue":"1","key":"pdig.0000675.ref002","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1108\/IJHCQA-08-2017-0159","article-title":"Failure demand: a concept evaluation in UK primary care","volume":"32","author":"P Walley","year":"2019","journal-title":"International Journal of Health Care Quality Assurance"},{"key":"pdig.0000675.ref003","article-title":"How has the COVID-19 pandemic impacted primary care","author":"C Fraser","year":"2021","journal-title":"The Health Foundation"},{"key":"pdig.0000675.ref004","volume-title":"The National framework for service change in NHS Scotland","author":"Rural Access Action Team","year":"2005"},{"issue":"4","key":"pdig.0000675.ref005","doi-asserted-by":"crossref","first-page":"222","DOI":"10.1177\/135581960000500407","article-title":"Conditions for which onset or hospital admission is potentially preventable by timely and effective ambulatory care","volume":"5","author":"C Sanderson","year":"2000","journal-title":"Journal of health services research & policy"},{"issue":"7024","key":"pdig.0000675.ref006","doi-asserted-by":"crossref","first-page":"162","DOI":"10.1136\/bmj.312.7024.162","article-title":"Alternatives to hospital care: what are they and who should decide?","volume":"312","author":"J Coast","year":"1996","journal-title":"BMJ"},{"issue":"1","key":"pdig.0000675.ref007","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1136\/qshc.8.1.16","article-title":"Left in limbo: patients\u2019 views on care across the primary\/secondary interface","volume":"8","author":"C Preston","year":"1999","journal-title":"BMJ Quality & Safety"},{"key":"pdig.0000675.ref008","volume-title":"Underfunded, underdoctored, overstretched: the NHS in 2016","author":"Royal College of Physicians"},{"issue":"15","key":"pdig.0000675.ref009","doi-asserted-by":"crossref","first-page":"1688","DOI":"10.1001\/jama.2011.1515","article-title":"Risk prediction models for hospital readmission: a systematic review","volume":"306","author":"D Kansagara","year":"2011","journal-title":"Jama"},{"issue":"11","key":"pdig.0000675.ref010","doi-asserted-by":"crossref","first-page":"e1002695","DOI":"10.1371\/journal.pmed.1002695","article-title":"Predicting the risk of emergency admission with machine learning: Development and validation using linked electronic health records","volume":"15","author":"F Rahimian","year":"2018","journal-title":"PLoS medicine"},{"issue":"2","key":"pdig.0000675.ref011","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1093\/fampra\/cml069","article-title":"Predicting the likelihood of emergency admission to hospital of older people: development and validation of the Emergency Admission Risk Likelihood Index (EARLI)","volume":"24","author":"D Lyon","year":"2007","journal-title":"Family practice"},{"issue":"8","key":"pdig.0000675.ref012","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1097\/MLR.0000000000000171","article-title":"Risk prediction models to predict emergency hospital admission in community-dwelling adults: a systematic review","volume":"52","author":"E Wallace","year":"2014","journal-title":"Medical care"},{"issue":"8","key":"pdig.0000675.ref013","doi-asserted-by":"crossref","first-page":"406","DOI":"10.1177\/014107680609900818","article-title":"Identifying patients at high risk of emergency hospital admissions: a logistic regression analysis","volume":"99","author":"A Bottle","year":"2006","journal-title":"Journal of the Royal Society of Medicine"},{"issue":"7563","key":"pdig.0000675.ref014","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1136\/bmj.38870.657917.AE","article-title":"Case finding for patients at risk of readmission to hospital: development of algorithm to identify high risk patients","volume":"333","author":"J Billings","year":"2006","journal-title":"Bmj"},{"issue":"1","key":"pdig.0000675.ref015","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1038\/s41746-024-01250-1","article-title":"Development and assessment of a machine learning tool for predicting emergency admission in Scotland","volume":"7","author":"J Liley","year":"2024","journal-title":"npj Digital Medicine"},{"key":"pdig.0000675.ref016","unstructured":"SPARRA made easy;. https:\/\/publichealthscotland.scot\/our-areas-of-work\/social-and-community-care\/scottish-patients-at-risk-of-readmission-and-admission-sparra\/overview\/."},{"key":"pdig.0000675.ref017","unstructured":"Health and Social Care Information Programme. A Report on the Development of SPARRA Version 3 (Developing Risk Prediction to Support Preventative and Anticipatory Care in Scotland); 2011."},{"issue":"6464","key":"pdig.0000675.ref018","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1126\/science.aax2342","article-title":"Dissecting racial bias in an algorithm used to manage the health of populations","volume":"366","author":"Z Obermeyer","year":"2019","journal-title":"Science"},{"key":"pdig.0000675.ref019","unstructured":"Bolsover District Council, Chesterfield Borough Council, Derbyshire Dales District Council, High Peak Borough Council, North East Derbyshire District Council. Health Improvement; 2012."},{"issue":"1","key":"pdig.0000675.ref020","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s12939-021-01397-3","article-title":"Measuring health inequalities: a systematic review of widely used indicators and topics","volume":"20","author":"S Albert-Ballestar","year":"2021","journal-title":"International Journal for Equity in Health"},{"key":"pdig.0000675.ref021","unstructured":"Scottish Government. Scottish government urban rural classification; 2016. Available from: www.gov.scot\/publications\/scottish-government-urban-rural-classification-2016."},{"issue":"6","key":"pdig.0000675.ref022","doi-asserted-by":"crossref","first-page":"1457","DOI":"10.1016\/j.socscimed.2005.08.045","article-title":"A comparison of health inequalities in urban and rural Scotland","volume":"62","author":"KA Levin","year":"2006","journal-title":"Social Science & Medicine"},{"key":"pdig.0000675.ref023","unstructured":"Thomson J. Rural deprivation; 2016. Available from: https:\/\/www.gov.scot\/binaries\/content\/documents\/govscot\/publications\/research-and-analysis\/2017\/02\/scottish-index-of-multiple-deprivation-rural-deprivation-evidence-and-case-studies\/documents\/rural-deprivation-an-evidence-review\/rural-deprivation-an-evidence-review\/govscot:document\/rural+deprivation+evidence+review.pdf."},{"issue":"2","key":"pdig.0000675.ref024","first-page":"166","article-title":"Access to health and health care: how race and ethnicity matter","volume":"77","author":"LD Richardson","year":"2010","journal-title":"Mount Sinai Journal of Medicine: A Journal of Translational and Personalized Medicine: A Journal of Translational and Personalized Medicine"},{"issue":"3","key":"pdig.0000675.ref025","doi-asserted-by":"crossref","first-page":"1407","DOI":"10.1111\/1475-6773.12705","article-title":"Racial\/ethnic and gender disparities in health care use and access","volume":"53","author":"JI Manuel","year":"2018","journal-title":"Health services research"},{"issue":"7","key":"pdig.0000675.ref026","doi-asserted-by":"crossref","first-page":"1221","DOI":"10.1016\/S0277-9536(02)00502-6","article-title":"Explaining variation in health status across space and time: implications for racial and ethnic disparities in self-rated health","volume":"57","author":"CR Browning","year":"2003","journal-title":"Social science & medicine"},{"key":"pdig.0000675.ref027","volume-title":"Mortality and life expectancy trends in the UK: stalling progress","author":"L Marshall","year":"2019"},{"key":"pdig.0000675.ref028","unstructured":"Saleiro P, Kuester B, Hinkson L, London J, Stevens A, Anisfeld A, et al. Aequitas: A bias and fairness audit toolkit. arXiv preprint arXiv:181105577. 2018;."},{"key":"pdig.0000675.ref029","unstructured":"Mitchell S, Potash E, Barocas S, D\u2019Amour A, Lum K. Prediction-based decisions and fairness: A catalogue of choices, assumptions, and definitions. arXiv preprint arXiv:181107867. 2018;."},{"key":"pdig.0000675.ref030","unstructured":"Zuo A, Wei S, Liu T, Han B, Zhang K, Gong M. Counterfactual Fairness with Partially Known Causal Graph. arXiv preprint arXiv:220513972. 2022;."},{"key":"pdig.0000675.ref031","article-title":"Counterfactual fairness","volume":"30","author":"MJ Kusner","year":"2017","journal-title":"Advances in neural information processing systems"},{"issue":"4","key":"pdig.0000675.ref032","doi-asserted-by":"crossref","first-page":"669","DOI":"10.1093\/biomet\/82.4.669","article-title":"Causal diagrams for empirical research","volume":"82","author":"J Pearl","year":"1995","journal-title":"Biometrika"},{"issue":"4","key":"pdig.0000675.ref033","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1002\/bimj.200810443","article-title":"The performance of risk prediction models","volume":"50","author":"TA Gerds","year":"2008","journal-title":"Biometrical Journal: Journal of Mathematical Methods in Biosciences"},{"key":"pdig.0000675.ref034","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1016\/j.jclinepi.2015.12.005","article-title":"A calibration hierarchy for risk models was defined: from utopia to empirical data","volume":"74","author":"B Van Calster","year":"2016","journal-title":"Journal of clinical epidemiology"},{"issue":"3","key":"pdig.0000675.ref035","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1175\/WAF993.1","article-title":"Increasing the reliability of reliability diagrams","volume":"22","author":"J Br\u00f6cker","year":"2007","journal-title":"Weather and forecasting"},{"key":"pdig.0000675.ref036","volume-title":"Epidemiology, biostatistics, and preventive medicine","author":"JF Jekel","year":"2007"},{"key":"pdig.0000675.ref037","unstructured":"Nilforoshan H, Gaebler JD, Shroff R, Goel S. Causal conceptions of fairness and their consequences. In: International Conference on Machine Learning. PMLR; 2022. p. 16848\u201316887."},{"key":"pdig.0000675.ref038","doi-asserted-by":"crossref","unstructured":"Corbett-Davies S, Pierson E, Feller A, Goel S, Huq A. Algorithmic decision making and the cost of fairness. In: Proceedings of the 23rd acm sigkdd international conference on knowledge discovery and data mining; 2017. p. 797\u2013806.","DOI":"10.1145\/3097983.3098095"},{"key":"pdig.0000675.ref039","unstructured":"Zliobaite I. On the relation between accuracy and fairness in binary classification. arXiv preprint arXiv:150505723. 2015;."},{"key":"pdig.0000675.ref040","unstructured":"Kleinberg J, Mullainathan S, Raghavan M. Inherent trade-offs in the fair determination of risk scores. arXiv preprint arXiv:160905807. 2016;."},{"issue":"5","key":"pdig.0000675.ref041","doi-asserted-by":"crossref","first-page":"e185","DOI":"10.2196\/jmir.9134","article-title":"Possible sources of bias in primary care electronic health record data use and reuse","volume":"20","author":"RA Verheij","year":"2018","journal-title":"Journal of medical Internet research"},{"key":"pdig.0000675.ref042","article-title":"Biases in electronic health record data due to processes within the healthcare system: retrospective observational study","volume":"361","author":"D Agniel","year":"2018","journal-title":"BMJ"}],"container-title":["PLOS Digital Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0000675","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,17]],"date-time":"2024-12-17T18:29:28Z","timestamp":1734460168000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pdig.0000675"}},"subtitle":[],"editor":[{"given":"Po-Chih","family":"Kuo","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2024,12,17]]},"references-count":42,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12,17]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pdig.0000675","relation":{},"ISSN":["2767-3170"],"issn-type":[{"value":"2767-3170","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,17]]}}}