{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T11:20:17Z","timestamp":1791890417150,"version":"4.3.4"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,11,24]],"date-time":"2020-11-24T00:00:00Z","timestamp":1606176000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,11,24]],"date-time":"2020-11-24T00:00:00Z","timestamp":1606176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000735","name":"University of Cambridge","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000735","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Mach Learn"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The coronavirus disease 2019 (COVID-19) global pandemic poses the threat of overwhelming healthcare systems with unprecedented demands for intensive care resources. Managing these demands cannot be effectively conducted\u00a0without a nationwide collective effort that relies on data to forecast hospital demands on the national, regional, hospital and individual levels. To this end, we developed the<jats:italic>COVID-19 Capacity Planning and Analysis System<\/jats:italic>(CPAS)\u2014a machine learning-based system for hospital resource planning that we have successfully deployed at individual hospitals and across regions in the UK in coordination with NHS Digital. In this paper, we discuss the main challenges of deploying a machine learning-based decision support system at national scale, and explain how CPAS addresses these challenges by (1) defining the appropriate learning problem,\u00a0(2) combining bottom-up and top-down analytical approaches, (3) using state-of-the-art machine learning algorithms, (4) integrating heterogeneous data sources, and (5) presenting the result with an interactive and transparent interface. CPAS is one of the first machine learning-based systems to be deployed in hospitals on a national scale to address the COVID-19 pandemic\u2014we conclude the paper with a summary of the lessons learned from this experience.<\/jats:p>","DOI":"10.1007\/s10994-020-05921-4","type":"journal-article","created":{"date-parts":[[2020,11,24]],"date-time":"2020-11-24T18:18:32Z","timestamp":1606241912000},"page":"15-35","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["CPAS: the UK\u2019s national machine learning-based hospital capacity planning system for COVID-19"],"prefix":"10.1007","volume":"110","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4561-0342","authenticated-orcid":false,"given":"Zhaozhi","family":"Qian","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ahmed M.","family":"Alaa","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mihaela","family":"van der Schaar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,11,24]]},"reference":[{"key":"5921_CR1","unstructured":"Ahmad, M. A., Eckert, C., & Teredesai, A. (2018). Interpretable machine learning in healthcare. In Proceedings of the 2018 ACM international conference on bioinformatics, computational biology, and health informatics (pp. 559\u2013560)."},{"key":"5921_CR2","unstructured":"Alaa, A., & van\u00a0der Schaar, M. (2018). Autoprognosis: Automated clinical prognostic modeling via bayesian optimization with structured kernel learning. In International conference on machine learning (pp. 139\u2013148)."},{"issue":"5","key":"5921_CR3","doi-asserted-by":"publisher","first-page":"e0213653","DOI":"10.1371\/journal.pone.0213653","volume":"14","author":"AM Alaa","year":"2019","unstructured":"Alaa, A. M., Bolton, T., Di Angelantonio, E., Rudd, J. H., & van der Schaar, M. (2019). Cardiovascular disease risk prediction using automated machine learning: A prospective study of 423,604 uk biobank participants. PloS one, 14(5), e0213653.","journal-title":"PloS one"},{"issue":"1","key":"5921_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41598-018-29523-2","volume":"8","author":"AM Alaa","year":"2018","unstructured":"Alaa, A. M., & van der Schaar, M. (2018). Prognostication and risk factors for cystic fibrosis via automated machine learning. Scientific Reports, 8(1), 1\u201319.","journal-title":"Scientific Reports"},{"issue":"10229","key":"5921_CR5","doi-asserted-by":"publisher","first-page":"1015","DOI":"10.1016\/S0140-6736(20)30673-5","volume":"395","author":"J Bedford","year":"2020","unstructured":"Bedford, J., Enria, D., Giesecke, J., Heymann, D. L., Ihekweazu, C., Kobinger, G., et al. (2020). Covid-19: Towards controlling of a pandemic. The Lancet, 395(10229), 1015\u20131018.","journal-title":"The Lancet"},{"key":"5921_CR6","unstructured":"Buuren, S. v., & Groothuis-Oudshoorn, K. (2010). mice: Multivariate imputation by chained equations in r. Journal of statistical software 1\u201368."},{"issue":"11","key":"5921_CR7","doi-asserted-by":"publisher","first-page":"1245","DOI":"10.1016\/0895-4356(94)90129-5","volume":"47","author":"M Charlson","year":"1994","unstructured":"Charlson, M., Szatrowski, T. P., Peterson, J., & Gold, J. (1994). Validation of a combined comorbidity index. Journal of clinical epidemiology, 47(11), 1245\u20131251.","journal-title":"Journal of clinical epidemiology"},{"key":"5921_CR8","doi-asserted-by":"crossref","unstructured":"Chen, T., & Guestrin, C. (2016). Xgboost: A scalable tree boosting system. In Proceedings of the 22nd acm sigkdd international conference on knowledge discovery and data mining (pp. 785\u2013794).","DOI":"10.1145\/2939672.2939785"},{"key":"5921_CR9","doi-asserted-by":"crossref","unstructured":"Chernick, M. R., Gonz\u00e1lez-Manteiga, W., Crujeiras, R. M., & Barrios, E. B. (2011). Bootstrap methods","DOI":"10.1007\/978-3-642-04898-2_150"},{"issue":"2","key":"5921_CR10","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1111\/j.2517-6161.1972.tb00899.x","volume":"34","author":"DR Cox","year":"1972","unstructured":"Cox, D. R. (1972). Regression models and life-tables. Journal of the Royal Statistical Society: Series B (Methodological), 34(2), 187\u2013202.","journal-title":"Journal of the Royal Statistical Society: Series B (Methodological)"},{"issue":"1","key":"5921_CR11","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1007\/BF02293750","volume":"42","author":"J De Leeuw","year":"1977","unstructured":"De Leeuw, J. (1977). Correctness of kruskal\u2019s algorithms for monotone regression with ties. Psychometrika, 42(1), 141\u2013144.","journal-title":"Psychometrika"},{"key":"5921_CR12","unstructured":"Google. (2020). Covid-19 community mobility. Retrieved July 4, 2020 from, https:\/\/www.google.com\/covid19\/mobility\/."},{"issue":"1\u20133","key":"5921_CR13","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1023\/A:1012487302797","volume":"46","author":"I Guyon","year":"2002","unstructured":"Guyon, I., Weston, J., Barnhill, S., & Vapnik, V. (2002). Gene selection for cancer classification using support vector machines. Machine Learning, 46(1\u20133), 389\u2013422.","journal-title":"Machine Learning"},{"issue":"4","key":"5921_CR14","doi-asserted-by":"publisher","first-page":"599","DOI":"10.1137\/S0036144500371907","volume":"42","author":"HW Hethcote","year":"2000","unstructured":"Hethcote, H. W. (2000). The mathematics of infectious diseases. SIAM Review, 42(4), 599\u2013653.","journal-title":"SIAM Review"},{"key":"5921_CR15","unstructured":"Hinton, G. E. (1990). Connectionist learning procedures. In Machine Learning (pp. 555\u2013610). Elsevier."},{"issue":"3","key":"5921_CR16","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1093\/biostatistics\/kxj011","volume":"7","author":"T Hothorn","year":"2006","unstructured":"Hothorn, T., B\u00fchlmann, P., Dudoit, S., Molinaro, A., & Van Der Laan, M. J. (2006). Survival ensembles. Biostatistics, 7(3), 355\u2013373.","journal-title":"Biostatistics"},{"key":"5921_CR17","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-05318-5","volume-title":"Automated machine learning: Methods, systems, challenges","author":"F Hutter","year":"2019","unstructured":"Hutter, F., Kotthoff, L., & Vanschoren, J. (2019). Automated machine learning: Methods, systems, challenges. Berlin: Springer."},{"issue":"2130","key":"5921_CR18","doi-asserted-by":"publisher","first-page":"1563","DOI":"10.1098\/rspa.2010.0348","volume":"467","author":"M Hutzenthaler","year":"2011","unstructured":"Hutzenthaler, M., Jentzen, A., & Kloeden, P. E. (2011). Strong and weak divergence in finite time of euler\u2019s method for stochastic differential equations with non-globally lipschitz continuous coefficients. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 467(2130), 1563\u20131576.","journal-title":"Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences"},{"key":"5921_CR19","doi-asserted-by":"crossref","unstructured":"Hyvarinen, A. (1999). Fast ica for noisy data using gaussian moments. In 1999 IEEE international symposium on circuits and systems (ISCAS) (Vol. 5, pp. 57\u201361). IEEE.","DOI":"10.1109\/ISCAS.1999.777510"},{"issue":"772","key":"5921_CR20","first-page":"700","volume":"115","author":"WO Kermack","year":"1927","unstructured":"Kermack, W. O., & McKendrick, A. G. (1927). A contribution to the mathematical theory of epidemics. Proceedings of the Royal Society of london Series A, Containing Papers of a Mathematical and Physical Character, 115(772), 700\u2013721.","journal-title":"Proceedings of the Royal Society of london Series A, Containing Papers of a Mathematical and Physical Character"},{"key":"5921_CR21","unstructured":"Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. Preprint arXiv:14126980"},{"issue":"1","key":"5921_CR22","first-page":"826","volume":"18","author":"L Kotthoff","year":"2017","unstructured":"Kotthoff, L., Thornton, C., Hoos, H. H., Hutter, F., & Leyton-Brown, K. (2017). Auto-weka 2.0: Automatic model selection and hyperparameter optimization in weka. The Journal of Machine Learning Research, 18(1), 826\u2013830.","journal-title":"The Journal of Machine Learning Research"},{"key":"5921_CR23","unstructured":"Lee, C., Zame, W., Alaa, A., & Schaar, M. (2019). Temporal quilting for survival analysis. In The 22nd international conference on artificial intelligence and statistics (pp. 596\u2013605)."},{"issue":"3","key":"5921_CR24","first-page":"18","volume":"2","author":"A Liaw","year":"2002","unstructured":"Liaw, A., Wiener, M., et al. (2002). Classification and regression by randomforest. R News, 2(3), 18\u201322.","journal-title":"R News"},{"issue":"2","key":"5921_CR25","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1016\/0025-5564(95)92756-5","volume":"125","author":"MY Li","year":"1995","unstructured":"Li, M. Y., & Muldowney, J. S. (1995). Global stability for the seir model in epidemiology. Mathematical Biosciences, 125(2), 155\u2013164.","journal-title":"Mathematical Biosciences"},{"key":"5921_CR26","unstructured":"NHS. (2020a). Health careers in intensive care medicine. Retrieved July 4, 2020 from, https:\/\/www.healthcareers.nhs.uk\/explore-roles\/doctors\/roles-doctors\/intensive-care-medicine."},{"key":"5921_CR27","unstructured":"NHS. (2020b). Intensive care. Retrieved July 4, 2020 from, https:\/\/www.nhs.uk\/conditions\/Intensive-care\/."},{"key":"5921_CR28","unstructured":"NHS. (2020c). Nhs nightingale london hospital. Retrieved July 4, 2020 from, http:\/\/www.bartshealth.nhs.uk\/nightingale."},{"key":"5921_CR29","unstructured":"NHS. (2020d). Trials begin of machine learning system to help hospitals plan and manage covid-19 treatment resources developed by nhs digital and university of cambridge. Retrieved June 28, 2020 from, https:\/\/digital.nhs.uk\/news-and-events\/news\/trials-begin-of-machine-learning-system-to-help-hospitals-plan-and-manage-covid-19-treatment-resources-developed-by-nhs-digital-and-university-of-cambridge."},{"issue":"4","key":"5921_CR30","doi-asserted-by":"publisher","first-page":"313","DOI":"10.11648\/j.acm.20150404.19","volume":"4","author":"AC Osemwinyen","year":"2015","unstructured":"Osemwinyen, A. C., & Diakhaby, A. (2015). Mathematical modelling of the transmission dynamics of ebola virus. Applied and Computational Mathematics, 4(4), 313\u2013320.","journal-title":"Applied and Computational Mathematics"},{"issue":"3","key":"5921_CR31","first-page":"61","volume":"10","author":"J Platt","year":"1999","unstructured":"Platt, J., et al. (1999). Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. Advances in Large Margin Classifiers, 10(3), 61\u201374.","journal-title":"Advances in Large Margin Classifiers"},{"key":"5921_CR32","unstructured":"P\u00f6lsterl, S., Navab, N., & Katouzian, A. (2016). An efficient training algorithm for kernel survival support vector machines. Preprint arXiv:161107054"},{"issue":"9","key":"5921_CR33","doi-asserted-by":"publisher","first-page":"609","DOI":"10.1177\/0037549706073695","volume":"82","author":"SF Railsback","year":"2006","unstructured":"Railsback, S. F., Lytinen, S. L., & Jackson, S. K. (2006). Agent-based simulation platforms: Review and development recommendations. Simulation, 82(9), 609\u2013623.","journal-title":"Simulation"},{"key":"5921_CR34","unstructured":"Ranganath, R., Gerrish, S., & Blei, D. (2014). Black box variational inference. In Artificial Intelligence and Statistics (pp. 814\u2013822)."},{"key":"5921_CR35","unstructured":"Rasmussen, C. E. (2003). Gaussian processes in machine learning. In Summer School on Machine Learning (pp. 63\u201371). Springer."},{"key":"5921_CR36","unstructured":"Snoek, J., Larochelle, H., & Adams, R. P. (2012). Practical bayesian optimization of machine learning algorithms. In Advances in neural information processing systems (pp. 2951\u20132959)."},{"issue":"1","key":"5921_CR37","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1093\/bioinformatics\/btr597","volume":"28","author":"DJ Stekhoven","year":"2012","unstructured":"Stekhoven, D. J., & B\u00fchlmann, P. (2012). Missforest\u2013non-parametric missing value imputation for mixed-type data. Bioinformatics, 28(1), 112\u2013118.","journal-title":"Bioinformatics"},{"key":"5921_CR38","unstructured":"Van Belle, V., Pelckmans, K., Suykens, J. A., & Van Huffel, S. (2011). Learning transformation models for ranking and survival analysis. Journal of Machine Learning Research, 12(3)."},{"key":"5921_CR39","unstructured":"van\u00a0der Schaar, M., Yoon, J., Qian, Z., Jarrett, D., & Bica, I. (2020). clairvoyance alpha: the first unified end-to-end automl pipeline for time-series data. Retrieved July 4, 2020 from, https:\/\/www.vanderschaar-lab.com\/clairvoyance-alpha-the-first-unified-end-to-end-automl-pipeline-for-time-series-data\/."},{"key":"5921_CR40","unstructured":"Wingate, D., & Weber, T. (2013). Automated variational inference in probabilistic programming. Preprint arXiv:13011299"},{"key":"5921_CR41","unstructured":"Yoon, J., Jordon, J., & Van Der\u00a0Schaar, M. (2018). Gain: Missing data imputation using generative adversarial nets. In International conference on machine learning (ICML)."},{"key":"5921_CR42","unstructured":"Zhang, Y., Jordon, J., Alaa, A. M., & van\u00a0der Schaar, M. (2019). Lifelong bayesian optimization. Preprint arXiv:190512280."},{"issue":"2","key":"5921_CR43","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1111\/j.1467-9868.2005.00503.x","volume":"67","author":"H Zou","year":"2005","unstructured":"Zou, H., & Hastie, T. (2005). Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 67(2), 301\u2013320.","journal-title":"Journal of the Royal Statistical Society: Series B (Statistical Methodology)"}],"container-title":["Machine Learning"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-020-05921-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10994-020-05921-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10994-020-05921-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,17]],"date-time":"2024-08-17T23:37:38Z","timestamp":1723937858000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10994-020-05921-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,11,24]]},"references-count":43,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["5921"],"URL":"https:\/\/doi.org\/10.1007\/s10994-020-05921-4","relation":{},"ISSN":["0885-6125","1573-0565"],"issn-type":[{"value":"0885-6125","type":"print"},{"value":"1573-0565","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,11,24]]},"assertion":[{"value":"13 July 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 September 2020","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 September 2020","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 November 2020","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}