{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,26]],"date-time":"2026-03-26T05:12:46Z","timestamp":1774501966855,"version":"3.50.1"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,4,12]],"date-time":"2019-04-12T00:00:00Z","timestamp":1555027200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,4,12]],"date-time":"2019-04-12T00:00:00Z","timestamp":1555027200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]},{"name":"UCLH NIHR Biomedical Research Centre"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Failure to attend scheduled hospital appointments disrupts clinical management and consumes resource estimated at \u00a31 billion annually in the United Kingdom National Health Service alone. Accurate stratification of absence risk can maximize the yield of preventative interventions. The wide multiplicity of potential causes, and the poor performance of systems based on simple, linear, low-dimensional models, suggests complex predictive models of attendance are needed. Here, we quantify the effect of using complex, non-linear, high-dimensional models enabled by machine learning. Models systematically varying in complexity based on logistic regression, support vector machines, random forests, AdaBoost, or gradient boosting machines were trained and evaluated on an unselected set of 22,318 consecutive scheduled magnetic resonance imaging appointments at two UCL hospitals. High-dimensional Gradient Boosting Machine-based models achieved the best performance reported in the literature, exhibiting an area under the receiver operating characteristic curve of 0.852 and average precision of 0.511. Optimal predictive performance required 81 variables. Simulations showed net potential benefit across a wide range of attendance characteristics, peaking at \u00a33.15 per appointment at current prevalence and call efficiency. Optimal attendance prediction requires more complex models than have hitherto been applied in the field, reflecting the complex interplay of patient, environmental, and operational causal factors. Far from an exotic luxury, high-dimensional models based on machine learning are likely essential to optimal scheduling amongst other operational aspects of hospital care. High predictive performance is achievable with data from a single institution, obviating the need for aggregating large-scale sensitive data across governance boundaries.<\/jats:p>","DOI":"10.1038\/s41746-019-0103-3","type":"journal-article","created":{"date-parts":[[2019,4,12]],"date-time":"2019-04-12T10:02:59Z","timestamp":1555063379000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":99,"title":["Predicting scheduled hospital attendance with artificial intelligence"],"prefix":"10.1038","volume":"2","author":[{"given":"Amy","family":"Nelson","sequence":"first","affiliation":[]},{"given":"Daniel","family":"Herron","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9623-7007","authenticated-orcid":false,"given":"Geraint","family":"Rees","sequence":"additional","affiliation":[]},{"given":"Parashkev","family":"Nachev","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2019,4,12]]},"reference":[{"key":"103_CR1","unstructured":"Hospital Outpatient Activity, 2017\u201318. NHS Digital. Available at: https:\/\/digital.nhs.uk\/data-and-information\/publications\/statistical\/hospital-outpatient-activity\/2017-18. Accessed 20 Feb 2019."},{"key":"103_CR2","doi-asserted-by":"publisher","first-page":"412","DOI":"10.1016\/j.healthpol.2018.02.002","volume":"122","author":"LF Dantas","year":"2018","unstructured":"Dantas, L. F., Fleck, J. L., Cyrino Oliveira, F. L. & Hamacher, S. No-shows in appointment scheduling\u2014a systematic literature review. Health Policy 122, 412\u2013421 (2018).","journal-title":"Health Policy"},{"key":"103_CR3","unstructured":"NHS England. Heart patients among those to benefit as NHS England backs innovation. Available at: https:\/\/www.england.nhs.uk\/2018\/04\/heart-patients-among-those-to-benefit-as-nhs-england-backs-innovation\/. Accessed 19 Feb 2019."},{"key":"103_CR4","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1093\/fampra\/20.2.178","volume":"20","author":"A George","year":"2003","unstructured":"George, A. & Rubin, G. Non-attendance in general practice: a systematic review and its implications for access to primary health care. Fam. Pract. 20, 178\u2013184 (2003).","journal-title":"Fam. Pract."},{"key":"103_CR5","doi-asserted-by":"publisher","unstructured":"Lee, G. et al. Leveraging on predictive analytics to manage clinic no show and improve accessibility of care. In 2017 IEEE International Conference on Data Science and Advanced Analytics (DSAA) 429\u2013438. https:\/\/doi.org\/10.1109\/DSAA.2017.25 (2017).","DOI":"10.1109\/DSAA.2017.25"},{"key":"103_CR6","unstructured":"Dravenstott, R. et al. Applying predictive modeling to identify patients at risk to no-show. In IIE Annual Conference Expo 2014 2370\u20132378 (2014)."},{"key":"103_CR7","doi-asserted-by":"publisher","first-page":"e1708","DOI":"10.7205\/MILMED-D-16-00345","volume":"182","author":"RM Goffman","year":"2017","unstructured":"Goffman, R. M. et al. Modeling patient no-show history and predicting future outpatient appointment behavior in the Veterans Health Administration. Mil. Med. 182, e1708\u2013e1714 (2017).","journal-title":"Mil. Med."},{"key":"103_CR8","doi-asserted-by":"publisher","first-page":"475","DOI":"10.1108\/IJHCQA-06-2015-0077","volume":"29","author":"YL Huang","year":"2016","unstructured":"Huang, Y.-L. & Hanauer, D. A. Time dependent patient no-show predictive modelling development. Int. J. Health Care Qual. Assur. 29, 475\u2013488 (2016).","journal-title":"Int. J. Health Care Qual. Assur."},{"key":"103_CR9","doi-asserted-by":"publisher","first-page":"724","DOI":"10.1007\/s11606-014-3165-6","volume":"30","author":"DM Blumenthal","year":"2015","unstructured":"Blumenthal, D. M., Singal, G., Mangla, S. S., Macklin, E. A. & Chung, D. C. Predicting non-adherence with outpatient colonoscopy using a novel electronic tool that measures prior non-adherence. J. Gen. Intern. Med. 30, 724\u2013731 (2015).","journal-title":"J. Gen. Intern. Med."},{"key":"103_CR10","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.eswa.2018.02.022","volume":"102","author":"S Srinivas","year":"2018","unstructured":"Srinivas, S. & Ravindran, A. R. Optimizing outpatient appointment system using machine learning algorithms and scheduling rules: a prescriptive analytics framework. Expert Syst. Appl. 102, 245\u2013261 (2018).","journal-title":"Expert Syst. Appl."},{"key":"103_CR11","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2016-012116","volume":"6","author":"D Robotham","year":"2016","unstructured":"Robotham, D., Satkunanathan, S., Reynolds, J., Stahl, D. & Wykes, T. Using digital notifications to improve attendance in clinic: systematic review and meta-analysis. BMJ Open 6, e012116 (2016).","journal-title":"BMJ Open"},{"key":"103_CR12","doi-asserted-by":"publisher","unstructured":"Gurol-Urganci, I., de Jongh, T., Vodopivec-Jamsek, V., Atun, R. & Car, J. Mobile phone messaging reminders for attendance at healthcare appointments. Cochrane Database Syst. Rev. CD007458, https:\/\/doi.org\/10.1002\/14651858.CD007458.pub3 (2013).","DOI":"10.1002\/14651858.CD007458.pub3"},{"key":"103_CR13","doi-asserted-by":"publisher","first-page":"358","DOI":"10.1258\/jtt.2011.110707","volume":"17","author":"PE Hasvold","year":"2011","unstructured":"Hasvold, P. E. & Wootton, R. Use of telephone and SMS reminders to improve attendance at hospital appointments: a systematic review. J. Telemed. Telecare 17, 358\u2013364 (2011).","journal-title":"J. Telemed. Telecare"},{"key":"103_CR14","unstructured":"Breese, J. S., Heckerman, D. & Kadie, C. Empirical analysis of predictive algorithms for collaborative filtering. In Proceedings of the Fourteenth Conference on Uncertainty in Artificial Intelligence 43\u201352 (Morgan Kaufmann Publishers Inc., 1998)."},{"key":"103_CR15","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1111\/j.1752-9824.2010.01048.x","volume":"2","author":"BL Paterson","year":"2010","unstructured":"Paterson, B. L., Charlton, P. & Richard, S. Non-attendance in chronic disease clinics: a matter of non-compliance? J. Nurs. Healthc. Chronic Illn. 2, 63\u201374 (2010).","journal-title":"J. Nurs. Healthc. Chronic Illn."},{"key":"103_CR16","doi-asserted-by":"publisher","DOI":"10.1186\/s12913-018-2979-z","volume":"18","author":"CA Parente","year":"2018","unstructured":"Parente, C. A., Salvatore, D., Gallo, G. M. & Cipollini, F. Using overbooking to manage no-shows in an Italian healthcare center. BMC Health Serv. Res. 18, 185 (2018).","journal-title":"BMC Health Serv. Res."},{"key":"103_CR17","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.ejor.2016.02.017","volume":"253","author":"SL Harris","year":"2016","unstructured":"Harris, S. L., May, J. H. & Vargas, L. G. Predictive analytics model for healthcare planning and scheduling. Eur. J. Oper. Res. 253, 121\u2013131 (2016).","journal-title":"Eur. J. Oper. Res."},{"key":"103_CR18","first-page":"273","volume":"20","author":"C Cortes","year":"1995","unstructured":"Cortes, C. & Vapnik, V. Support-vector networks. Mach. Learn. 20, 273\u2013297 (1995).","journal-title":"Mach. Learn."},{"key":"103_CR19","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1006\/jcss.1997.1504","volume":"55","author":"Y Freund","year":"1997","unstructured":"Freund, Y. & Schapire, R. E. A decision-theoretic generalization of on-line learning and an application to boosting. J. Comput. Syst. Sci. 55, 119\u2013139 (1997).","journal-title":"J. Comput. Syst. Sci."},{"key":"103_CR20","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1214\/aos\/1013203451","volume":"29","author":"JH Friedman","year":"2001","unstructured":"Friedman, J. H. Greedy function approximation: a gradient boosting machine. Ann. Stat. 29, 1189\u20131232 (2001).","journal-title":"Ann. Stat."},{"key":"103_CR21","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1613\/jair.953","volume":"16","author":"NV Chawla","year":"2002","unstructured":"Chawla, N. V., Bowyer, K. W., Hall, L. O. & Kegelmeyer, W. P. SMOTE: synthetic minority over-sampling technique. J. Artif. Intell. Res. 16, 321\u2013357 (2002).","journal-title":"J. Artif. Intell. Res."},{"key":"103_CR22","unstructured":"NHS Reference Costs 2015 to 2016\u2014GOV.UK. https:\/\/www.gov.uk\/government\/publications\/nhs-reference-costs-2015-to-2016. Accessed 19 Feb 2019."},{"key":"103_CR23","first-page":"181","volume":"14","author":"SG Baker","year":"2012","unstructured":"Baker, S. G. & Kramer, B. S. Evaluating a new marker for risk prediction: decision analysis to the rescue. Discov. Med. 14, 181\u2013188 (2012).","journal-title":"Discov. Med."},{"key":"103_CR24","unstructured":"Statistics. Diagnostic Imaging Dataset 2018\u201319 Data. https:\/\/www.england.nhs.uk\/statistics\/statistical-work-areas\/diagnostic-imaging-dataset\/diagnostic-imaging-dataset-2018-19-data\/. Accessed 20 Feb 2019."},{"key":"103_CR25","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1109\/MCSE.2007.58","volume":"9","author":"TE Oliphant","year":"2007","unstructured":"Oliphant, T. E. Python for scientific computing. Comput. Sci. Eng. 9, 10\u201320 (2007).","journal-title":"Comput. Sci. Eng."},{"key":"103_CR26","doi-asserted-by":"crossref","unstructured":"McKinney, W. Data structures for statistical computing in Python. In Proceedings of the 9th Python in Science Conference (SciPy 2010), Vol. 445, 51\u201356 (2010).","DOI":"10.25080\/Majora-92bf1922-00a"},{"key":"103_CR27","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa, F. et al. Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825\u20132830 (2011).","journal-title":"J. Mach. Learn. Res."},{"key":"103_CR28","unstructured":"GeographicLib: GeographicLib Library. https:\/\/geographiclib.sourceforge.io\/html\/. Accessed 18 Sep 2018."},{"key":"103_CR29","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1109\/MCSE.2007.55","volume":"9","author":"JD Hunter","year":"2007","unstructured":"Hunter, J. D. Matplotlib: a 2D graphics environment. Comput. Sci. Eng. 9, 90\u201395 (2007).","journal-title":"Comput. Sci. Eng."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0103-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0103-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0103-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,17]],"date-time":"2022-12-17T18:29:06Z","timestamp":1671301746000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0103-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,12]]},"references-count":29,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["103"],"URL":"https:\/\/doi.org\/10.1038\/s41746-019-0103-3","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,12]]},"assertion":[{"value":"16 November 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 March 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 April 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"26"}}