{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,18]],"date-time":"2026-06-18T10:20:48Z","timestamp":1781778048993,"version":"3.54.5"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T00:00:00Z","timestamp":1669161600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,23]],"date-time":"2022-11-23T00:00:00Z","timestamp":1669161600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100006093","name":"Patient-Centered Outcomes Research Institute","doi-asserted-by":"publisher","award":["ME-1606-35555"],"award-info":[{"award-number":["ME-1606-35555"]}],"id":[{"id":"10.13039\/100006093","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001826","name":"ZonMw","doi-asserted-by":"publisher","award":["10430 01 201 0019"],"award-info":[{"award-number":["10430 01 201 0019"]}],"id":[{"id":"10.13039\/501100001826","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Supporting decisions for patients who present to the emergency department (ED) with COVID-19 requires accurate prognostication. We aimed to evaluate prognostic models for predicting outcomes in hospitalized patients with COVID-19, in different locations and across time.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We included patients who presented to the ED with suspected COVID-19 and were admitted to 12 hospitals in the New York City (NYC) area and 4 large Dutch hospitals. We used second-wave patients who presented between September and December 2020 (2137 and 3252 in NYC and the Netherlands, respectively) to evaluate models that were developed on first-wave patients who presented between March and August 2020 (12,163 and 5831). We evaluated two prognostic models for in-hospital death: The Northwell COVID-19 Survival (NOCOS) model was developed on NYC data and the COVID Outcome Prediction in the Emergency Department (COPE) model was developed on Dutch data. These models were validated on subsequent second-wave data at the same site (temporal validation) and at the other site (geographic validation). We assessed model performance by the Area Under the receiver operating characteristic Curve (AUC), by the E-statistic, and by net benefit.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Twenty-eight-day mortality was considerably higher in the NYC first-wave data (21.0%), compared to the second-wave (10.1%) and the Dutch data (first wave 10.8%; second wave 10.0%). COPE discriminated well at temporal validation (AUC 0.82), with excellent calibration (E-statistic 0.8%). At geographic validation, discrimination was satisfactory (AUC 0.78), but with moderate over-prediction of mortality risk, particularly in higher-risk patients (E-statistic 2.9%). While discrimination was adequate when NOCOS was tested on second-wave NYC data (AUC 0.77), NOCOS systematically overestimated the mortality risk (E-statistic 5.1%). Discrimination in the Dutch data was good (AUC 0.81), but with over-prediction of risk, particularly in lower-risk patients (E-statistic 4.0%). Recalibration of COPE and NOCOS led to limited net benefit improvement in Dutch data, but to substantial net benefit improvement in NYC data.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>NOCOS performed moderately worse than COPE, probably reflecting unique aspects of the early pandemic in NYC. Frequent updating of prognostic models is likely to be required for transportability over time and space during a dynamic pandemic.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12916-022-02651-3","type":"journal-article","created":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T18:48:38Z","timestamp":1669315718000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["Prognostic models for COVID-19 needed updating to warrant transportability over time and space"],"prefix":"10.1186","volume":"20","author":[{"given":"David","family":"van Klaveren","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Theodoros P.","family":"Zanos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jason","family":"Nelson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Todd J.","family":"Levy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinny G.","family":"Park","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Isabel R. A.","family":"Retel Helmrich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Judith A. C.","family":"Rietjens","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Melissa J.","family":"Basile","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Negin","family":"Hajizadeh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hester F.","family":"Lingsma","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David M.","family":"Kent","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2022,11,23]]},"reference":[{"issue":"1","key":"2651_CR1","first-page":"3","volume":"1","author":"J Nkengasong","year":"2020","unstructured":"Nkengasong J, Iwasaki A, Victora C, Oh J, Gao GF, Agrawal A, et al. The global response to the COVID-19 pandemic. Med (N Y). 2020;1(1):3\u20138.","journal-title":"Med (N Y)"},{"key":"2651_CR2","unstructured":"World Health Organization. Coronavirus disease (COVID-19) pandemic. Available from: https:\/\/www.who.int\/health-topics\/coronavirus. Accessed 18 Oct 2022."},{"issue":"20","key":"2651_CR3","doi-asserted-by":"publisher","first-page":"2052","DOI":"10.1001\/jama.2020.6775","volume":"323","author":"S Richardson","year":"2020","unstructured":"Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York City area. JAMA. 2020;323(20):2052\u20139.","journal-title":"JAMA."},{"issue":"10229","key":"2651_CR4","doi-asserted-by":"publisher","first-page":"1054","DOI":"10.1016\/S0140-6736(20)30566-3","volume":"395","author":"F Zhou","year":"2020","unstructured":"Zhou F, Yu T, Du R, Fan G, Liu Y, Liu Z, et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: a retrospective cohort study. Lancet. 2020;395(10229):1054\u201362.","journal-title":"Lancet."},{"issue":"20","key":"2651_CR5","doi-asserted-by":"publisher","first-page":"2098","DOI":"10.1001\/jama.2020.7681","volume":"323","author":"S Richardson","year":"2020","unstructured":"Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Clarification of mortality rate and data in abstract, results, and table 2. JAMA. 2020;323(20):2098.","journal-title":"JAMA."},{"issue":"5","key":"2651_CR6","doi-asserted-by":"publisher","first-page":"472","DOI":"10.1188\/20.CJON.472-474","volume":"24","author":"N Cazeau","year":"2020","unstructured":"Cazeau N. Social Isolation: Managing Psychological Distress in Hospitalized Patients During the COVID-19 Pandemic. Clin J Oncol Nurs. 2020;24(5):472\u20134.","journal-title":"Clin J Oncol Nurs"},{"key":"2651_CR7","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.m1328","volume":"369","author":"L Wynants","year":"2020","unstructured":"Wynants L, Van Calster B, Collins GS, Riley RD, Heinze G, Schuit E, et al. Prediction models for diagnosis and prognosis of COVID-19: systematic review and critical appraisal. BMJ. 2020;369:m1328.","journal-title":"BMJ."},{"issue":"12","key":"2651_CR8","doi-asserted-by":"publisher","first-page":"1426","DOI":"10.1007\/s00134-021-06524-w","volume":"47","author":"Y Lombardi","year":"2021","unstructured":"Lombardi Y, Azoyan L, Szychowiak P, Bellamine A, Lemaitre G, Bernaux M, et al. External validation of prognostic scores for COVID-19: a multicenter cohort study of patients hospitalized in Greater Paris University Hospitals. Intensive Care Med. 2021;47(12):1426\u201339.","journal-title":"Intensive Care Med"},{"issue":"1","key":"2651_CR9","doi-asserted-by":"publisher","first-page":"230","DOI":"10.1186\/s12916-019-1466-7","volume":"17","author":"B Van Calster","year":"2019","unstructured":"Van Calster B, McLernon DJ, van Smeden M, Wynants L, Steyerberg EW. Calibration: The Achilles heel of predictive analytics. BMC Med. 2019;17(1):230.","journal-title":"BMC Med"},{"issue":"2","key":"2651_CR10","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1177\/0272989X14547233","volume":"35","author":"B Van Calster","year":"2015","unstructured":"Van Calster B, Vickers AJ. Calibration of risk prediction models: impact on decision-analytic performance. Med Decis Mak. 2015;35(2):162\u20139.","journal-title":"Med Decis Mak"},{"issue":"4","key":"2651_CR11","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCOUTCOMES.121.008487","volume":"15","author":"G Gulati","year":"2022","unstructured":"Gulati G, Upshaw J, Wessler BS, Brazil RJ, Nelson J, van Klaveren D, et al. Generalizability of cardiovascular disease clinical prediction models: 158 independent external validations of 104 unique models. Circ Cardiovasc Qual Outcomes. 2022;15(4):e008487.","journal-title":"Circ Cardiovasc Qual Outcomes"},{"issue":"11","key":"2651_CR12","doi-asserted-by":"publisher","first-page":"1011","DOI":"10.1056\/NEJMra2206573","volume":"387","author":"DH Barouch","year":"2022","unstructured":"Barouch DH. COVID-19 vaccines \u2014 immunity, variants, boosters. N Engl J Med. 2022;387(11):1011\u201320.","journal-title":"N Engl J Med"},{"key":"2651_CR13","unstructured":"COVID-19 Treatment Guidelines Panel. Coronavirus Disease 2019 (COVID-19) Treatment Guidelines. National Institutes of Health. Available at https:\/\/www.covid19treatmentguidelines.nih.gov\/. Accessed 18 October 2022."},{"key":"2651_CR14","doi-asserted-by":"publisher","unstructured":"Levy TJ, Richardson S, Coppa K, Barnaby DP, McGinn T, Becker LB, et al. Development and validation of a survival calculator for hospitalized patients with COVID-19. medRxiv.\u00a02020:2020.04.22.20075416. https:\/\/doi.org\/10.1101\/2020.04.22.20075416.","DOI":"10.1101\/2020.04.22.20075416"},{"issue":"9","key":"2651_CR15","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2021-051468","volume":"11","author":"D van Klaveren","year":"2021","unstructured":"van Klaveren D, Rekkas A, Alsma J, Verdonschot R, Koning D, Kamps MJA, et al. COVID outcome prediction in the emergency department (COPE): using retrospective Dutch hospital data to develop simple and valid models for predicting mortality and need for intensive care unit admission in patients who present at the emergency department with suspected COVID-19. BMJ Open. 2021;11(9):e051468.","journal-title":"BMJ Open"},{"key":"2651_CR16","unstructured":"R Core Team (2020). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.\u00a02020. URL http:\/\/www.R-project.org\/."},{"issue":"3","key":"2651_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.18637\/jss.v045.i03","volume":"45","author":"S Van Buuren","year":"2011","unstructured":"Van Buuren S, Groothuis-Oudshoorn K. MICE: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011;45(3):1\u201367.","journal-title":"J Stat Softw"},{"issue":"23","key":"2651_CR18","doi-asserted-by":"publisher","first-page":"4136","DOI":"10.1002\/sim.6997","volume":"35","author":"D van Klaveren","year":"2016","unstructured":"van Klaveren D, Gonen M, Steyerberg EW, Vergouwe Y. A new concordance measure for risk prediction models in external validation settings. Stat Med. 2016;35(23):4136\u201352.","journal-title":"Stat Med"},{"key":"2651_CR19","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3462-1","volume-title":"Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis","author":"FE Harrell","year":"2001","unstructured":"Harrell FE. Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis. New York: Springer-Verlag; 2001."},{"issue":"6","key":"2651_CR20","doi-asserted-by":"publisher","first-page":"565","DOI":"10.1177\/0272989X06295361","volume":"26","author":"AJ Vickers","year":"2006","unstructured":"Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Mak. 2006;26(6):565\u201374.","journal-title":"Med Decis Mak"},{"issue":"8","key":"2651_CR21","doi-asserted-by":"publisher","DOI":"10.1161\/CIRCOUTCOMES.121.007858","volume":"14","author":"BS Wessler","year":"2021","unstructured":"Wessler BS, Nelson J, Park JG, McGinnes H, Gulati G, Brazil R, et al. External Validations of Cardiovascular Clinical Prediction Models: A Large-Scale Review of the Literature. Circ Cardiovasc Qual Outcomes. 2021;14(8):e007858.","journal-title":"Circ Cardiovasc Qual Outcomes"},{"issue":"1","key":"2651_CR22","doi-asserted-by":"publisher","first-page":"W1","DOI":"10.7326\/M18-1377","volume":"170","author":"KGM Moons","year":"2019","unstructured":"Moons KGM, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration. Ann Intern Med. 2019;170(1):W1\u2013w33.","journal-title":"Ann Intern Med"},{"issue":"1","key":"2651_CR23","doi-asserted-by":"publisher","first-page":"20","DOI":"10.1186\/s41512-021-00110-w","volume":"5","author":"EM Schnellinger","year":"2021","unstructured":"Schnellinger EM, Yang W, Kimmel SE. Comparison of dynamic updating strategies for clinical prediction models. Diagn Progn Res. 2021;5(1):20.","journal-title":"Diagn Progn Res"},{"issue":"1","key":"2651_CR24","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1177\/0962280215626466","volume":"27","author":"TL Su","year":"2018","unstructured":"Su TL, Jaki T, Hickey GL, Buchan I, Sperrin M. A review of statistical updating methods for clinical prediction models. Stat Methods Med Res. 2018;27(1):185\u201397.","journal-title":"Stat Methods Med Res"},{"issue":"2","key":"2651_CR25","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1161\/CIRCOUTCOMES.114.001645","volume":"9","author":"S Siregar","year":"2016","unstructured":"Siregar S, Nieboer D, Vergouwe Y, Versteegh MI, Noyez L, Vonk AB, et al. Improved Prediction by Dynamic Modeling: An Exploratory Study in the Adult Cardiac Surgery Database of the Netherlands Association for Cardio-Thoracic Surgery. Circ Cardiovasc Qual Outcomes. 2016;9(2):171\u201381.","journal-title":"Circ Cardiovasc Qual Outcomes"},{"key":"2651_CR26","doi-asserted-by":"publisher","DOI":"10.1016\/j.jbi.2020.103611","volume":"112","author":"SE Davis","year":"2020","unstructured":"Davis SE, Greevy RA Jr, Lasko TA, Walsh CG, Matheny ME. Detection of calibration drift in clinical prediction models to inform model updating. J Biomed Inform. 2020;112:103611.","journal-title":"J Biomed Inform"},{"key":"2651_CR27","doi-asserted-by":"publisher","DOI":"10.1016\/j.artmed.2022.102256","volume":"125","author":"S Chi","year":"2022","unstructured":"Chi S, Tian Y, Wang F, Zhou T, Jin S, Li J. A novel lifelong machine learning-based method to eliminate calibration drift in clinical prediction models. Artif Intell Med. 2022;125:102256.","journal-title":"Artif Intell Med"},{"key":"2651_CR28","doi-asserted-by":"crossref","unstructured":"Gulati G, Upshaw JN, Wessler BS, Brazil RJ, Nelson J, van Klaveren D, et al. The Generalizability of Cardiovascular Disease Clinical Prediction Models: 158 Large-Scale Independent External Validations of 104 Unique Models. Circ Cardiovasc Qual Outcomes.\u00a02022;15(4):e008487.","DOI":"10.1161\/CIRCOUTCOMES.121.008487"},{"issue":"1","key":"2651_CR29","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1001\/jama.2018.5602","volume":"320","author":"N Shah","year":"2018","unstructured":"Shah N, Steyerberg E, Kent D. Big Data and Predictive Analytics: Recalibrating Expectations. JAMA. 2018;320(1):27\u20138.","journal-title":"JAMA."},{"issue":"1","key":"2651_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s41512-020-00090-3","volume":"5","author":"DA Jenkins","year":"2021","unstructured":"Jenkins DA, Martin GP, Sperrin M, Riley RD, Debray TPA, Collins GS, et al. Continual updating and monitoring of clinical prediction models: time for dynamic prediction systems? Diagn Progn Res. 2021;5(1):1.","journal-title":"Diagn Progn Res"},{"issue":"2","key":"2651_CR31","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1016\/j.ijforecast.2020.08.004","volume":"38","author":"JPA Ioannidis","year":"2022","unstructured":"Ioannidis JPA, Cripps S, Tanner MA. Forecasting for COVID-19 has failed. Int J Forecast. 2022;38(2):423\u201338.","journal-title":"Int J Forecast"},{"key":"2651_CR32","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.jclinepi.2015.04.005","volume":"69","author":"EW Steyerberg","year":"2016","unstructured":"Steyerberg EW, Harrell FE Jr. Prediction models need appropriate internal, internal-external, and external validation. J Clin Epidemiol. 2016;69:245\u20137.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"2651_CR33","doi-asserted-by":"publisher","first-page":"51","DOI":"10.7326\/M18-1376","volume":"170","author":"RF Wolff","year":"2019","unstructured":"Wolff RF, Moons KGM, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies. Ann Intern Med. 2019;170(1):51\u20138.","journal-title":"Ann Intern Med"},{"key":"2651_CR34","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1016\/j.jclinepi.2021.06.017","volume":"138","author":"E Venema","year":"2021","unstructured":"Venema E, Wessler BS, Paulus JK, Salah R, Raman G, Leung LY, et al. Large-scale validation of the Prediction model Risk Of Bias ASsessment Tool (PROBAST) using a short form: high risk of bias models show poorer discrimination. J Clin Epidemiol. 2021;138:32\u20139.","journal-title":"J Clin Epidemiol"},{"issue":"1","key":"2651_CR35","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1186\/s41512-022-00122-0","volume":"6","author":"I Helmrich","year":"2022","unstructured":"Helmrich I, Mikolic A, Kent DM, Lingsma HF, Wynants L, Steyerberg EW, et al. Does poor methodological quality of prediction modeling studies translate to poor model performance? An illustration in traumatic brain injury. Diagn Progn Res. 2022;6(1):8.","journal-title":"Diagn Progn Res"},{"issue":"6","key":"2651_CR36","doi-asserted-by":"publisher","first-page":"649","DOI":"10.1161\/CIRCOUTCOMES.111.000012","volume":"6","author":"GL Hickey","year":"2013","unstructured":"Hickey GL, Grant SW, Caiado C, Kendall S, Dunning J, Poullis M, et al. Dynamic prediction modeling approaches for cardiac surgery. Circ Cardiovasc Qual Outcomes. 2013;6(6):649\u201358.","journal-title":"Circ Cardiovasc Qual Outcomes"}],"container-title":["BMC Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-022-02651-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12916-022-02651-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12916-022-02651-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T18:51:20Z","timestamp":1669315880000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmedicine.biomedcentral.com\/articles\/10.1186\/s12916-022-02651-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,23]]},"references-count":36,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["2651"],"URL":"https:\/\/doi.org\/10.1186\/s12916-022-02651-3","relation":{},"ISSN":["1741-7015"],"issn-type":[{"value":"1741-7015","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,23]]},"assertion":[{"value":"22 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 November 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The Daily Board of the Medical Ethics Committee Erasmus MC of Rotterdam, The Netherlands, has approved the research proposal (MEC-2020-0297). This study was approved by the Institutional Review Boards at Northwell Health as minimal-risk research that used data collected for routine clinical practice, and as such, waived the requirement for informed consent.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"456"}}