{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,26]],"date-time":"2026-10-26T19:31:24Z","timestamp":1793043084017,"version":"4.5.0"},"reference-count":64,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T00:00:00Z","timestamp":1635379200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T00:00:00Z","timestamp":1635379200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>The evidence of the impact of traditional statistical (TS) and artificial intelligence (AI) tool interventions in clinical practice was limited. This study aimed to investigate the clinical impact and quality of randomized controlled trials (RCTs) involving interventions evaluating TS, machine learning (ML), and deep learning (DL) prediction tools. A systematic review on PubMed was conducted to identify RCTs involving TS\/ML\/DL tool interventions in the past decade. A total of 65 RCTs from 26,082 records were included. A majority of them had model development studies and generally good performance was achieved. The function of TS and ML tools in the RCTs mainly included assistive treatment decisions, assistive diagnosis, and risk stratification, but DL trials were only conducted for assistive diagnosis. Nearly two-fifths of the trial interventions showed no clinical benefit compared to standard care. Though DL and ML interventions achieved higher rates of positive results than TS in the RCTs, in trials with low risk of bias (17\/65) the advantage of DL to TS was reduced while the advantage of ML to TS disappeared. The current applications of DL were not yet fully spread performed in medicine. It is predictable that DL will integrate more complex clinical problems than ML and TS tools in the future. Therefore, rigorous studies are required before the clinical application of these tools.<\/jats:p>","DOI":"10.1038\/s41746-021-00524-2","type":"journal-article","created":{"date-parts":[[2021,10,28]],"date-time":"2021-10-28T10:02:44Z","timestamp":1635415364000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":120,"title":["Clinical impact and quality of randomized controlled trials involving interventions evaluating artificial intelligence prediction tools: a systematic review"],"prefix":"10.1038","volume":"4","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3954-5449","authenticated-orcid":false,"given":"Qian","family":"Zhou","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3927-7069","authenticated-orcid":false,"given":"Zhi-hang","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yi-heng","family":"Cao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sui","family":"Peng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,10,28]]},"reference":[{"key":"524_CR1","doi-asserted-by":"publisher","first-page":"g7594","DOI":"10.1136\/bmj.g7594","volume":"350","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD statement. BMJ 350, g7594 (2015).","journal-title":"BMJ"},{"key":"524_CR2","doi-asserted-by":"publisher","first-page":"1583","DOI":"10.1056\/NEJMp2000589","volume":"382","author":"MJ Pencina","year":"2020","unstructured":"Pencina, M. J., Goldstein, B. A. & D'Agostino, R. B. Prediction models-development, evaluation, and clinical application. N. Engl. J. Med 382, 1583\u20131586 (2020).","journal-title":"N. Engl. J. Med"},{"key":"524_CR3","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.jclinepi.2015.04.005","volume":"69","author":"EW Steyerberg","year":"2016","unstructured":"Steyerberg, E. W. & Harrell, F. E. Jr. Prediction models need appropriate internal, internal-external, and external validation. J. Clin. Epidemiol. 69, 245\u2013247 (2016).","journal-title":"J. Clin. Epidemiol."},{"key":"524_CR4","doi-asserted-by":"publisher","first-page":"2727","DOI":"10.1001\/jama.291.22.2727","volume":"291","author":"KA Eagle","year":"2004","unstructured":"Eagle, K. A. et al. A validated prediction model for all forms of acute coronary syndrome: estimating the risk of 6-month postdischarge death in an international registry. Jama 291, 2727\u20132733 (2004).","journal-title":"Jama"},{"key":"524_CR5","doi-asserted-by":"publisher","first-page":"1837","DOI":"10.1161\/01.CIR.97.18.1837","volume":"97","author":"PW Wilson","year":"1998","unstructured":"Wilson, P. W. et al. Prediction of coronary heart disease using risk factor categories. Circulation 97, 1837\u20131847 (1998).","journal-title":"Circulation"},{"key":"524_CR6","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-019-0148-3","volume":"2","author":"P Shah","year":"2019","unstructured":"Shah, P. et al. Artificial intelligence and machine learning in clinical development: a translational perspective. NPJ Digit. Med. 2, 69 (2019).","journal-title":"NPJ Digit. Med."},{"key":"524_CR7","doi-asserted-by":"publisher","first-page":"2035","DOI":"10.1136\/gutjnl-2019-320466","volume":"69","author":"F van der Sommen","year":"2020","unstructured":"van der Sommen, F. et al. Machine learning in GI endoscopy: practical guidance in how to interpret a novel field. Gut 69, 2035\u20132045 (2020).","journal-title":"Gut"},{"key":"524_CR8","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1053\/j.gastro.2019.08.058","volume":"158","author":"C Le Berre","year":"2019","unstructured":"Le Berre, C. et al. Application of artificial intelligence to gastroenterology and hepatology. Gastroenterology 158, 76\u201394.e72 (2019).","journal-title":"Gastroenterology"},{"key":"524_CR9","doi-asserted-by":"publisher","first-page":"2656","DOI":"10.1007\/s00259-019-04372-x","volume":"46","author":"M Sollini","year":"2019","unstructured":"Sollini, M., Antunovic, L., Chiti, A. & Kirienko, M. Towards clinical application of image mining: a systematic review on artificial intelligence and radiomics. Eur. J. Nucl. Med. Mol. Imaging 46, 2656\u20132672 (2019).","journal-title":"Eur. J. Nucl. Med. Mol. Imaging"},{"key":"524_CR10","doi-asserted-by":"publisher","first-page":"1204","DOI":"10.2214\/AJR.19.21346","volume":"213","author":"E West","year":"2019","unstructured":"West, E., Mutasa, S., Zhu, Z. & Ha, R. Global trend in artificial intelligence-based publications in radiology from 2000 to 2018. AJR Am. J. Roentgenol. 213, 1204\u20131206 (2019).","journal-title":"AJR Am. J. Roentgenol."},{"key":"524_CR11","doi-asserted-by":"publisher","first-page":"m689","DOI":"10.1136\/bmj.m689","volume":"368","author":"M Nagendran","year":"2020","unstructured":"Nagendran, M. et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. BMJ 368, m689 (2020).","journal-title":"BMJ"},{"key":"524_CR12","doi-asserted-by":"publisher","first-page":"l6927","DOI":"10.1136\/bmj.l6927","volume":"368","author":"S Vollmer","year":"2020","unstructured":"Vollmer, S. et al. Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness. BMJ 368, l6927 (2020).","journal-title":"BMJ"},{"key":"524_CR13","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-020-0229-3","volume":"3","author":"IS Stafford","year":"2020","unstructured":"Stafford, I. S. et al. A systematic review of the applications of artificial intelligence and machine learning in autoimmune diseases. NPJ Digit. Med. 3, 30 (2020).","journal-title":"NPJ Digit. Med."},{"key":"524_CR14","doi-asserted-by":"publisher","unstructured":"Benedetto, U. et al. Machine learning improves mortality risk prediction after cardiac surgery: systematic review and meta-analysis. J. Thoracic Cardiovasc. Surg. https:\/\/doi.org\/10.1016\/j.jtcvs.2020.07.105 (2020).","DOI":"10.1016\/j.jtcvs.2020.07.105"},{"key":"524_CR15","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1002\/ehf2.13073","volume":"8","author":"S Shin","year":"2021","unstructured":"Shin, S. et al. Machine learning vs. conventional statistical models for predicting heart failure readmission and mortality. ESC Heart Fail. 8, 106\u2013115 (2021).","journal-title":"ESC Heart Fail."},{"key":"524_CR16","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1053\/j.gastro.2019.09.009","volume":"158","author":"DL Shung","year":"2020","unstructured":"Shung, D. L. et al. Validation of a machine learning model that outperforms clinical risk scoring systems for upper gastrointestinal bleeding. Gastroenterology 158, 160\u2013167 (2020).","journal-title":"Gastroenterology"},{"key":"524_CR17","doi-asserted-by":"publisher","first-page":"1133","DOI":"10.1016\/j.jhep.2019.02.023","volume":"70","author":"X Xu","year":"2019","unstructured":"Xu, X. et al. Radiomic analysis of contrast-enhanced CT predicts microvascular invasion and outcome in hepatocellular carcinoma. J. Hepatol. 70, 1133\u20131144 (2019).","journal-title":"J. Hepatol."},{"key":"524_CR18","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-20655-6","volume":"12","author":"A Abrol","year":"2021","unstructured":"Abrol, A. et al. Deep learning encodes robust discriminative neuroimaging representations to outperform standard machine learning. Nat. Commun. 12, 353 (2021).","journal-title":"Nat. Commun."},{"key":"524_CR19","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-18037-z","volume":"11","author":"MA Schulz","year":"2020","unstructured":"Schulz, M. A. et al. Different scaling of linear models and deep learning in UKBiobank brain images versus machine-learning datasets. Nat. Commun. 11, 4238 (2020).","journal-title":"Nat. Commun."},{"key":"524_CR20","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"524_CR21","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"524_CR22","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.jclinepi.2019.02.004","volume":"110","author":"E Christodoulou","year":"2019","unstructured":"Christodoulou, E. et al. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. J. Clin. Epidemiol. 110, 12\u201322 (2019).","journal-title":"J. Clin. Epidemiol."},{"key":"524_CR23","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.jclinepi.2020.12.018","volume":"133","author":"TE Cowling","year":"2021","unstructured":"Cowling, T. E., Cromwell, D. A., Bellot, A., Sharples, L. D. & van der Meulen, J. Logistic regression and machine learning predicted patient mortality from large sets of diagnosis codes comparably. J. Clin. Epidemiol. 133, 43\u201352 (2021).","journal-title":"J. Clin. Epidemiol."},{"key":"524_CR24","doi-asserted-by":"publisher","unstructured":"Gosselt, H. R. et al. Complex machine-learning algorithms and multivariable logistic regression on par in the prediction of insufficient clinical response to methotrexate in rheumatoid arthritis. J. Pers. Med. https:\/\/doi.org\/10.3390\/jpm11010044 (2021).","DOI":"10.3390\/jpm11010044"},{"key":"524_CR25","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-020-3427-8","volume":"21","author":"AM Smith","year":"2020","unstructured":"Smith, A. M. et al. Standard machine learning approaches outperform deep representation learning on phenotype prediction from transcriptomics data. BMC Bioinform. 21, 119 (2020).","journal-title":"BMC Bioinform."},{"key":"524_CR26","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1136\/heartjnl-2011-301247","volume":"98","author":"KG Moons","year":"2012","unstructured":"Moons, K. G. et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart 98, 691\u2013698 (2012).","journal-title":"Heart"},{"key":"524_CR27","doi-asserted-by":"publisher","DOI":"10.1186\/s41512-018-0033-6","volume":"2","author":"TH Kappen","year":"2018","unstructured":"Kappen, T. H. et al. Evaluating the impact of prediction models: lessons learned, challenges, and recommendations. Diagnostic Prognostic Res. 2, 11 (2018).","journal-title":"Diagnostic Prognostic Res."},{"key":"524_CR28","doi-asserted-by":"publisher","first-page":"b606","DOI":"10.1136\/bmj.b606","volume":"338","author":"KG Moons","year":"2009","unstructured":"Moons, K. G., Altman, D. G., Vergouwe, Y. & Royston, P. Prognosis and prognostic research: application and impact of prognostic models in clinical practice. BMJ 338, b606 (2009).","journal-title":"BMJ"},{"key":"524_CR29","doi-asserted-by":"publisher","first-page":"1223","DOI":"10.1001\/jama.293.10.1223","volume":"293","author":"AX Garg","year":"2005","unstructured":"Garg, A. X. et al. Effects of computerized clinical decision support systems on practitioner performance and patient outcomes: a systematic review. Jama 293, 1223\u20131238 (2005).","journal-title":"Jama"},{"key":"524_CR30","doi-asserted-by":"publisher","first-page":"1085","DOI":"10.1016\/j.jclinepi.2008.04.008","volume":"61","author":"DB Toll","year":"2008","unstructured":"Toll, D. B., Janssen, K. J., Vergouwe, Y. & Moons, K. G. Validation, updating and impact of clinical prediction rules: a review. J. Clin. Epidemiol. 61, 1085\u20131094 (2008).","journal-title":"J. Clin. Epidemiol."},{"key":"524_CR31","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6947-11-62","volume":"11","author":"E Wallace","year":"2011","unstructured":"Wallace, E. et al. Framework for the impact analysis and implementation of Clinical Prediction Rules (CPRs). BMC Med. Inform. Decis. Mak. 11, 62 (2011).","journal-title":"BMC Med. Inform. Decis. Mak."},{"key":"524_CR32","doi-asserted-by":"publisher","first-page":"2175","DOI":"10.1056\/NEJMms1604593","volume":"374","author":"LE Bothwell","year":"2016","unstructured":"Bothwell, L. E., Greene, J. A., Podolsky, S. H. & Jones, D. S. Assessing the gold standard\u2014lessons from the history of RCTs. N. Engl. J. Med. 374, 2175\u20132181 (2016).","journal-title":"N. Engl. J. Med."},{"key":"524_CR33","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1016\/j.ijmedinf.2017.02.014","volume":"102","author":"E Caballero-Ruiz","year":"2017","unstructured":"Caballero-Ruiz, E. et al. A web-based clinical decision support system for gestational diabetes: automatic diet prescription and detection of insulin needs. Int. J. Med. Inform. 102, 35\u201349 (2017).","journal-title":"Int. J. Med. Inform."},{"key":"524_CR34","doi-asserted-by":"publisher","first-page":"1719","DOI":"10.1016\/S0140-6736(17)30568-8","volume":"389","author":"IC Group","year":"2017","unstructured":"Group, I. C. Computerised interpretation of fetal heart rate during labour (INFANT): a randomised controlled trial. Lancet 389, 1719\u20131729 (2017).","journal-title":"Lancet"},{"key":"524_CR35","doi-asserted-by":"publisher","first-page":"e285","DOI":"10.2196\/jmir.6465","volume":"18","author":"RS Sadasivam","year":"2016","unstructured":"Sadasivam, R. S., Borglund, E. M., Adams, R., Marlin, B. M. & Houston, T. K. Impact of a collective intelligence tailored messaging system on smoking cessation: the perspect randomized experiment. J. Med. Internet Res. 18, e285 (2016).","journal-title":"J. Med. Internet Res."},{"key":"524_CR36","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1016\/j.cell.2015.11.001","volume":"163","author":"D Zeevi","year":"2015","unstructured":"Zeevi, D. et al. Personalized nutrition by prediction of glycemic responses. Cell 163, 1079\u20131094 (2015).","journal-title":"Cell"},{"key":"524_CR37","doi-asserted-by":"publisher","DOI":"10.1186\/s12874-020-01050-7","volume":"20","author":"P Kent","year":"2020","unstructured":"Kent, P., Cancelliere, C., Boyle, E., Cassidy, J. D. & Kongsted, A. A conceptual framework for prognostic research. BMC Med. Res. Methodol. 20, 172 (2020).","journal-title":"BMC Med. Res. Methodol."},{"key":"524_CR38","doi-asserted-by":"publisher","first-page":"2138","DOI":"10.1177\/1460458219900452","volume":"26","author":"K Cresswell","year":"2020","unstructured":"Cresswell, K. et al. Investigating the use of data-driven artificial intelligence in computerised decision support systems for health and social care: a systematic review. Health Inform. J. 26, 2138\u20132147 (2020).","journal-title":"Health Inform. J."},{"key":"524_CR39","doi-asserted-by":"publisher","first-page":"e12286","DOI":"10.2196\/12286","volume":"21","author":"AK Triantafyllidis","year":"2019","unstructured":"Triantafyllidis, A. K. & Tsanas, A. Applications of machine learning in real-life digital health interventions: review of the literature. J. Med. Internet Res. 21, e12286 (2019).","journal-title":"J. Med. Internet Res."},{"key":"524_CR40","doi-asserted-by":"publisher","first-page":"834","DOI":"10.1016\/j.jclinepi.2010.02.005","volume":"63","author":"KF Schulz","year":"2010","unstructured":"Schulz, K. F., Altman, D. G. & Moher, D. CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials. J. Clin. Epidemiol. 63, 834\u2013840 (2010).","journal-title":"J. Clin. Epidemiol."},{"key":"524_CR41","doi-asserted-by":"publisher","first-page":"1467","DOI":"10.1038\/s41591-019-0603-3","volume":"25","author":"AI Consort","year":"2019","unstructured":"Consort, A. I. & Group, S.-A. S. Reporting guidelines for clinical trials evaluating artificial intelligence interventions are needed. Nat. Med. 25, 1467\u20131468 (2019).","journal-title":"Nat. Med."},{"key":"524_CR42","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1038\/s41591-020-1034-x","volume":"26","author":"X Liu","year":"2020","unstructured":"Liu, X., Cruz Rivera, S., Moher, D., Calvert, M. J. & Denniston, A. K. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nat. Med. 26, 1364\u20131374 (2020).","journal-title":"Nat. Med."},{"key":"524_CR43","doi-asserted-by":"publisher","first-page":"d5928","DOI":"10.1136\/bmj.d5928","volume":"343","author":"JP Higgins","year":"2011","unstructured":"Higgins, J. P. et al. The Cochrane Collaboration\u2019s tool for assessing risk of bias in randomised trials. BMJ 343, d5928 (2011).","journal-title":"BMJ"},{"key":"524_CR44","doi-asserted-by":"publisher","first-page":"e32844","DOI":"10.1371\/journal.pone.0032844","volume":"7","author":"GJ Geersing","year":"2012","unstructured":"Geersing, G. J. et al. Search filters for finding prognostic and diagnostic prediction studies in Medline to enhance systematic reviews. PLoS ONE 7, e32844 (2012).","journal-title":"PLoS ONE"},{"key":"524_CR45","doi-asserted-by":"publisher","first-page":"b2700","DOI":"10.1136\/bmj.b2700","volume":"339","author":"A Liberati","year":"2009","unstructured":"Liberati, A. et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ 339, b2700 (2009).","journal-title":"BMJ"},{"key":"524_CR46","doi-asserted-by":"publisher","first-page":"134","DOI":"10.1016\/j.jclinepi.2014.11.010","volume":"68","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. Transparent reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD): the TRIPOD statement. J. Clin. Epidemiol. 68, 134\u2013143 (2015).","journal-title":"J. Clin. Epidemiol."},{"key":"524_CR47","doi-asserted-by":"publisher","first-page":"1159","DOI":"10.1016\/S0140-6736(05)71879-1","volume":"365","author":"AW Chan","year":"2005","unstructured":"Chan, A. W. & Altman, D. G. Epidemiology and reporting of randomised trials published in PubMed journals. Lancet 365, 1159\u20131162 (2005).","journal-title":"Lancet"},{"key":"524_CR48","doi-asserted-by":"publisher","first-page":"c723","DOI":"10.1136\/bmj.c723","volume":"340","author":"S Hopewell","year":"2010","unstructured":"Hopewell, S., Dutton, S., Yu, L. M., Chan, A. W. & Altman, D. G. The quality of reports of randomised trials in 2000 and 2006: comparative study of articles indexed in PubMed. Bmj 340, c723 (2010).","journal-title":"Bmj"},{"key":"524_CR49","doi-asserted-by":"publisher","first-page":"2293","DOI":"10.1056\/NEJMsb1609216","volume":"375","author":"RE Sherman","year":"2016","unstructured":"Sherman, R. E. et al. Real-world evidence\u2014what is it and what can it tell us? N. Engl. J. Med. 375, 2293\u20132297 (2016).","journal-title":"N. Engl. J. Med."},{"key":"524_CR50","doi-asserted-by":"publisher","first-page":"2812","DOI":"10.1007\/s00259-019-04493-3","volume":"46","author":"Q Zhou","year":"2019","unstructured":"Zhou, Q., Cao, Y. H. & Chen, Z. H. Lack of evidence and criteria to evaluate artificial intelligence and radiomics tools to be implemented in clinical settings. Eur. J. Nucl. Med. Mol. Imaging 46, 2812\u20132813 (2019).","journal-title":"Eur. J. Nucl. Med. Mol. Imaging"},{"key":"524_CR51","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1001\/jamaoncol.2015.3730","volume":"2","author":"M Clemons","year":"2016","unstructured":"Clemons, M. et al. Risk model-guided antiemetic prophylaxis vs physician\u2019s choice in patients receiving chemotherapy for early-stage breast cancer: a randomized clinical trial. JAMA Oncol. 2, 225\u2013231 (2016).","journal-title":"JAMA Oncol."},{"key":"524_CR52","doi-asserted-by":"publisher","first-page":"897","DOI":"10.1007\/s00380-015-0695-8","volume":"31","author":"C Guenancia","year":"2016","unstructured":"Guenancia, C. et al. Clinical effectiveness of the systematic use of the GRACE scoring system (in addition to clinical assessment) for ischaemic outcomes and bleeding complications in the management of NSTEMI compared with clinical assessment alone: a prospective study. Heart Vessels 31, 897\u2013906 (2016).","journal-title":"Heart Vessels"},{"key":"524_CR53","doi-asserted-by":"publisher","first-page":"1560","DOI":"10.1016\/S0140-6736(11)60937-9","volume":"378","author":"JC Hill","year":"2011","unstructured":"Hill, J. C. et al. Comparison of stratified primary care management for low back pain with current best practice (STarT Back): a randomised controlled trial. Lancet 378, 1560\u20131571 (2011).","journal-title":"Lancet"},{"key":"524_CR54","doi-asserted-by":"publisher","first-page":"e1003142","DOI":"10.1371\/journal.pmed.1003142","volume":"17","author":"GJ Geersing","year":"2020","unstructured":"Geersing, G. J. et al. Effect of tailoring anticoagulant treatment duration by applying a recurrence risk prediction model in patients with venous thromboembolism compared to usual care: a randomized controlled trial. PLoS Med. 17, e1003142 (2020).","journal-title":"PLoS Med."},{"key":"524_CR55","doi-asserted-by":"publisher","first-page":"e204759","DOI":"10.1001\/jamaoncol.2020.4759","volume":"6","author":"CR Manz","year":"2020","unstructured":"Manz, C. R. et al. Effect of integrating machine learning mortality estimates with behavioral nudges to clinicians on serious illness conversations among patients with cancer: a stepped-wedge cluster randomized clinical trial. JAMA Oncol. 6, e204759 (2020).","journal-title":"JAMA Oncol."},{"key":"524_CR56","doi-asserted-by":"publisher","first-page":"145","DOI":"10.1016\/j.cardfail.2016.08.007","volume":"23","author":"BD Steinhart","year":"2016","unstructured":"Steinhart, B. D. et al. A randomized control trial using a validated prediction model for diagnosing acute heart failure in undifferentiated dyspneic emergency department patients\u2014results of the GASP4Ar Study. J. Card. Fail. 23, 145\u2013152 (2016).","journal-title":"J. Card. Fail."},{"key":"524_CR57","doi-asserted-by":"publisher","first-page":"182","DOI":"10.1016\/j.cct.2006.05.007","volume":"28","author":"MA Hussey","year":"2007","unstructured":"Hussey, M. A. & Hughes, J. P. Design and analysis of stepped wedge cluster randomized trials. Contemp. Clin. Trials 28, 182\u2013191 (2007).","journal-title":"Contemp. Clin. Trials"},{"key":"524_CR58","doi-asserted-by":"publisher","first-page":"e2032320","DOI":"10.1001\/jamanetworkopen.2020.32320","volume":"4","author":"SN Blomberg","year":"2021","unstructured":"Blomberg, S. N. et al. Effect of machine learning on dispatcher recognition of out-of-hospital cardiac arrest during calls to emergency medical services: a randomized clinical trial. JAMA Netw. Open 4, e2032320 (2021).","journal-title":"JAMA Netw. Open"},{"key":"524_CR59","doi-asserted-by":"publisher","first-page":"814","DOI":"10.2215\/CJN.07181009","volume":"5","author":"ME Brier","year":"2010","unstructured":"Brier, M. E., Gaweda, A. E., Dailey, A., Aronoff, G. R. & Jacobs, A. A. Randomized trial of model predictive control for improved anemia management. Clin. J. Am. Soc. Nephrol. 5, 814\u2013820 (2010).","journal-title":"Clin. J. Am. Soc. Nephrol."},{"key":"524_CR60","doi-asserted-by":"publisher","first-page":"897","DOI":"10.1089\/tmj.2013.0049","volume":"19","author":"SM Finkelstein","year":"2013","unstructured":"Finkelstein, S. M. et al. A randomized controlled trial comparing health and quality of life of lung transplant recipients following nurse and computer-based triage utilizing home spirometry monitoring. Telemed. J. e-Health. 19, 897\u2013903 (2013).","journal-title":"Telemed. J. e-Health."},{"key":"524_CR61","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1016\/S2468-1253(19)30411-X","volume":"5","author":"P Wang","year":"2020","unstructured":"Wang, P. et al. Effect of a deep-learning computer-aided detection system on adenoma detection during colonoscopy (CADe-DB trial): a double-blind randomised study. Lancet Gastroenterol. Hepatol. 5, 343\u2013351 (2020).","journal-title":"Lancet Gastroenterol. Hepatol."},{"key":"524_CR62","doi-asserted-by":"publisher","first-page":"512","DOI":"10.1053\/j.gastro.2020.04.062","volume":"159","author":"A Repici","year":"2020","unstructured":"Repici, A. et al. Efficacy of real-time computer-aided detection of colorectal neoplasia in a randomized trial. Gastroenterology 159, 512\u2013520.e517 (2020).","journal-title":"Gastroenterology"},{"key":"524_CR63","doi-asserted-by":"publisher","first-page":"1676","DOI":"10.1111\/jgh.15070","volume":"35","author":"M Aziz","year":"2020","unstructured":"Aziz, M., Fatima, R., Dong, C., Lee\u2010Smith, W. & Nawras, A. The impact of deep convolutional neural network\u2010based artificial intelligence on colonoscopy outcomes: a systematic review with meta\u2010analysis. J. Gastroenterol. Hepatol. 35, 1676\u20131683 (2020).","journal-title":"J. Gastroenterol. Hepatol."},{"key":"524_CR64","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1002\/jhm.2009","volume":"8","author":"TC Bailey","year":"2013","unstructured":"Bailey, T. C. et al. A trial of a real-time alert for clinical deterioration in patients hospitalized on general medical wards. J. Hosp. Med. 8, 236\u2013242 (2013).","journal-title":"J. Hosp. Med."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00524-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00524-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00524-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T19:02:42Z","timestamp":1670094162000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00524-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10,28]]},"references-count":64,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["524"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00524-2","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10,28]]},"assertion":[{"value":"7 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 September 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 October 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"154"}}