{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T13:34:08Z","timestamp":1776087248027,"version":"3.50.1"},"reference-count":72,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,1,19]],"date-time":"2022-01-19T00:00:00Z","timestamp":1642550400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,19]],"date-time":"2022-01-19T00:00:00Z","timestamp":1642550400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Machine learning (ML) is a rapidly advancing field with increasing utility in health care. We conducted a systematic review and critical appraisal of ML applications in vascular surgery. MEDLINE, Embase, and Cochrane CENTRAL were searched from inception to March 1, 2021. Study screening, data extraction, and quality assessment were performed by two independent reviewers, with a third author resolving discrepancies. All original studies reporting ML applications in vascular surgery were included. Publication trends, disease conditions, methodologies, and outcomes were summarized. Critical appraisal was conducted using the PROBAST risk-of-bias and TRIPOD reporting adherence tools. We included 212 studies from a pool of 2235 unique articles. ML techniques were used for diagnosis, prognosis, and image segmentation in carotid stenosis, aortic aneurysm\/dissection, peripheral artery disease, diabetic foot ulcer, venous disease, and renal artery stenosis. The number of publications on ML in vascular surgery increased from 1 (1991\u20131996) to 118 (2016\u20132021). Most studies were retrospective and single center, with no randomized controlled trials. The median area under the receiver operating characteristic curve (AUROC) was 0.88 (range 0.61\u20131.00), with 79.5% [62\/78] studies reporting AUROC\u2009\u2265\u20090.80. Out of 22 studies comparing ML techniques to existing prediction tools, clinicians, or traditional regression models, 20 performed better and 2 performed similarly. Overall, 94.8% (201\/212) studies had high risk-of-bias and adherence to reporting standards was poor with a rate of 41.4%. Despite improvements over time, study quality and reporting remain inadequate. Future studies should consider standardized tools such as PROBAST and TRIPOD to improve study quality and clinical applicability.<\/jats:p>","DOI":"10.1038\/s41746-021-00552-y","type":"journal-article","created":{"date-parts":[[2022,1,19]],"date-time":"2022-01-19T11:02:56Z","timestamp":1642590176000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":115,"title":["Machine learning in vascular surgery: a systematic review and critical appraisal"],"prefix":"10.1038","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7191-1034","authenticated-orcid":false,"given":"Ben","family":"Li","sequence":"first","affiliation":[]},{"given":"Tiam","family":"Feridooni","sequence":"additional","affiliation":[]},{"given":"Cesar","family":"Cuen-Ojeda","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8797-7137","authenticated-orcid":false,"given":"Teruko","family":"Kishibe","sequence":"additional","affiliation":[]},{"given":"Charles","family":"de Mestral","sequence":"additional","affiliation":[]},{"given":"Muhammad","family":"Mamdani","sequence":"additional","affiliation":[]},{"given":"Mohammed","family":"Al-Omran","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,1,19]]},"reference":[{"key":"552_CR1","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1007\/978-1-62703-748-8_7","volume":"1107","author":"Y Ba\u015ftanlar","year":"2014","unstructured":"Ba\u015ftanlar, Y. & \u00d6zuysal, M. Introduction to machine learning. Methods Mol. Biol. 1107, 105\u2013128 (2014).","journal-title":"Methods Mol. Biol."},{"key":"552_CR2","doi-asserted-by":"publisher","first-page":"1433","DOI":"10.1097\/ACM.0000000000002792","volume":"94","author":"M Rowe","year":"2019","unstructured":"Rowe, M. An introduction to machine learning for clinicians. Acad. Med. J. Assoc. Am. Med. Coll. 94, 1433\u20131436 (2019).","journal-title":"Acad. Med. J. Assoc. Am. Med. Coll."},{"key":"552_CR3","unstructured":"Artificial intelligence in healthcare market with Covid-19 impact analysis by offering, technology, end-use application, end user and region \u2013 global forecast to 2026. https:\/\/www.reportlinker.com\/p04897122\/Artificial-Intelligence-in-Healthcare-Market-by-Offering-Technology-Application-End-User-Industry-and-Geography-Global-Forecast-to.html. (2021)."},{"key":"552_CR4","doi-asserted-by":"publisher","first-page":"020303","DOI":"10.7189\/jogh.08.020303","volume":"8","author":"T Panch","year":"2018","unstructured":"Panch, T., Szolovits, P. & Atun, R. Artificial intelligence, machine learning and health systems. J. Glob. Health 8, 020303 (2018).","journal-title":"J. Glob. Health"},{"key":"552_CR5","doi-asserted-by":"publisher","first-page":"233","DOI":"10.1038\/nmeth.4642","volume":"15","author":"D Bzdok","year":"2018","unstructured":"Bzdok, D., Altman, N. & Krzywinski, M. Statistics versus machine learning. Nat. Methods 15, 233\u2013234 (2018).","journal-title":"Nat. Methods"},{"key":"552_CR6","first-page":"52","volume":"21","author":"A Stella","year":"2020","unstructured":"Stella, A. The way we were: technology will change the profession of vascular surgery. Transl. Med. UniSa 21, 52\u201358 (2020).","journal-title":"Transl. Med. UniSa"},{"key":"552_CR7","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1007\/978-3-030-33128-3_1","volume":"1213","author":"H-P Chan","year":"2020","unstructured":"Chan, H.-P., Samala, R. K., Hadjiiski, L. M. & Zhou, C. Deep learning in medical image analysis. Adv. Exp. Med. Biol. 1213, 3\u201321 (2020).","journal-title":"Adv. Exp. Med. Biol."},{"key":"552_CR8","unstructured":"Shaw, P. M., Loree, J. & Gibbons, R. C. Abdominal aortic aneurysm. in StatPearls (StatPearls Publishing, 2021)."},{"key":"552_CR9","unstructured":"Zemaitis, M. R., Boll, J. M. & Dreyer, M. A. Peripheral arterial disease. In StatPearls (StatPearls Publishing, 2021)."},{"key":"552_CR10","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1146\/annurev.bioeng.8.061505.095802","volume":"8","author":"P Sajda","year":"2006","unstructured":"Sajda, P. Machine learning for detection and diagnosis of disease. Annu. Rev. Biomed. Eng. 8, 537\u2013565 (2006).","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"552_CR11","doi-asserted-by":"publisher","first-page":"793","DOI":"10.1016\/j.jvs.2016.08.107","volume":"65","author":"KM Bennett","year":"2017","unstructured":"Bennett, K. M., Kent, K. C., Schumacher, J., Greenberg, C. C. & Scarborough, J. E. Targeting the most important complications in vascular surgery. J. Vasc. Surg. 65, 793\u2013803 (2017).","journal-title":"J. Vasc. Surg."},{"key":"552_CR12","doi-asserted-by":"publisher","first-page":"346","DOI":"10.1016\/j.jss.2021.02.045","volume":"264","author":"O Elfanagely","year":"2021","unstructured":"Elfanagely, O. et al. Machine learning and surgical outcomes prediction: a systematic review. J. Surg. Res. 264, 346\u2013361 (2021).","journal-title":"J. Surg. Res."},{"key":"552_CR13","unstructured":"Vascular Quality Initiative. https:\/\/www.vqi.org\/. (2021)."},{"key":"552_CR14","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1016\/j.ejvssr.2018.03.004","volume":"39","author":"R Lee","year":"2018","unstructured":"Lee, R. et al. Applied machine learning for the prediction of growth of abdominal aortic aneurysm in humans. EJVES Short. Rep. 39, 24\u201328 (2018).","journal-title":"EJVES Short. Rep."},{"key":"552_CR15","doi-asserted-by":"publisher","first-page":"18343","DOI":"10.1038\/s41598-020-74936-7","volume":"10","author":"S Talebi","year":"2020","unstructured":"Talebi, S. et al. Machine learning for endoleak detection after endovascular aortic repair. Sci. Rep. 10, 18343 (2020).","journal-title":"Sci. Rep."},{"key":"552_CR16","doi-asserted-by":"publisher","first-page":"1515","DOI":"10.1016\/j.jvs.2016.04.026","volume":"64","author":"EG Ross","year":"2016","unstructured":"Ross, E. G. et al. The use of machine learning for the identification of peripheral artery disease and future mortality risk. J. Vasc. Surg. 64, 1515\u20131522.e3 (2016).","journal-title":"J. Vasc. Surg."},{"key":"552_CR17","doi-asserted-by":"publisher","first-page":"51","DOI":"10.7326\/M18-1376","volume":"170","author":"RF Wolff","year":"2019","unstructured":"Wolff, R. F. et al. PROBAST: a tool to assess the risk of bias and applicability of prediction model studies. Ann. Intern. Med. 170, 51\u201358 (2019).","journal-title":"Ann. Intern. Med."},{"key":"552_CR18","doi-asserted-by":"publisher","first-page":"55","DOI":"10.7326\/M14-0697","volume":"162","author":"GS Collins","year":"2015","unstructured":"Collins, G. S., Reitsma, J. B., Altman, D. G. & Moons, K. G. M. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD statement. Ann. Intern. Med. 162, 55\u201363 (2015).","journal-title":"Ann. Intern. Med."},{"key":"552_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-019-0106-0","volume":"2","author":"S Sarwar","year":"2019","unstructured":"Sarwar, S. et al. Physician perspectives on integration of artificial intelligence into diagnostic pathology. Npj Digit. Med. 2, 1\u20137 (2019).","journal-title":"Npj Digit. Med."},{"key":"552_CR20","doi-asserted-by":"publisher","first-page":"e12802","DOI":"10.2196\/12802","volume":"21","author":"C Blease","year":"2019","unstructured":"Blease, C. et al. Artificial intelligence and the future of primary care: exploratory qualitative study of UK general practitioners\u2019 views. J. Med. Internet Res. 21, e12802 (2019).","journal-title":"J. Med. Internet Res."},{"key":"552_CR21","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1111\/acem.14190","volume":"28","author":"H Kareemi","year":"2021","unstructured":"Kareemi, H., Vaillancourt, C., Rosenberg, H., Fournier, K. & Yadav, K. Machine learning versus usual care for diagnostic and prognostic prediction in the emergency department: a systematic review. Acad. Emerg. Med. 28, 184\u2013196 (2021).","journal-title":"Acad. Emerg. Med."},{"key":"552_CR22","doi-asserted-by":"publisher","first-page":"e034568","DOI":"10.1136\/bmjopen-2019-034568","volume":"10","author":"M Yusuf","year":"2020","unstructured":"Yusuf, M. et al. Reporting quality of studies using machine learning models for medical diagnosis: a systematic review. BMJ Open 10, e034568 (2020).","journal-title":"BMJ Open"},{"key":"552_CR23","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1093\/neuros\/nyx384","volume":"83","author":"JT Senders","year":"2018","unstructured":"Senders, J. T. et al. Natural and artificial intelligence in neurosurgery: a systematic review. Neurosurgery 83, 181\u2013192 (2018).","journal-title":"Neurosurgery"},{"key":"552_CR24","doi-asserted-by":"publisher","first-page":"e3200","DOI":"10.1097\/GOX.0000000000003200","volume":"8","author":"T Jarvis","year":"2020","unstructured":"Jarvis, T., Thornburg, D., Rebecca, A. M. & Teven, C. M. Artificial intelligence in plastic surgery: current applications, future directions, and ethical implications. Plast. Reconstr. Surg. Glob. Open 8, e3200 (2020).","journal-title":"Plast. Reconstr. Surg. Glob. Open"},{"key":"552_CR25","doi-asserted-by":"publisher","first-page":"478","DOI":"10.1186\/s13018-020-02002-z","volume":"15","author":"N Maffulli","year":"2020","unstructured":"Maffulli, N. et al. Artificial intelligence and machine learning in orthopedic surgery: a systematic review protocol. J. Orthop. Surg. 15, 478 (2020).","journal-title":"J. Orthop. Surg."},{"key":"552_CR26","doi-asserted-by":"publisher","first-page":"13","DOI":"10.1056\/NEJMoa1310753","volume":"370","author":"CJ Cooper","year":"2014","unstructured":"Cooper, C. J. et al. Stenting and medical therapy for atherosclerotic renal-artery stenosis. N. Engl. J. Med. 370, 13\u201322 (2014).","journal-title":"N. Engl. J. Med."},{"key":"552_CR27","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.clineuro.2017.12.005","volume":"164","author":"JP Jeon","year":"2018","unstructured":"Jeon, J. P., Kim, C., Oh, B.-D., Kim, S. J. & Kim, Y.-S. Prediction of persistent hemodynamic depression after carotid angioplasty and stenting using artificial neural network model. Clin. Neurol. Neurosurg. 164, 127\u2013131 (2018).","journal-title":"Clin. Neurol. Neurosurg."},{"key":"552_CR28","doi-asserted-by":"publisher","first-page":"853","DOI":"10.1016\/j.sjbs.2019.12.020","volume":"27","author":"C Lin","year":"2020","unstructured":"Lin, C. et al. The amputation and survival of patients with diabetic foot based on establishment of prediction model. Saudi J. Biol. Sci. 27, 853\u2013858 (2020).","journal-title":"Saudi J. Biol. Sci."},{"key":"552_CR29","doi-asserted-by":"publisher","first-page":"e318686","DOI":"10.1155\/2013\/318686","volume":"2013","author":"K Singh","year":"2013","unstructured":"Singh, K., Singh, V. K., Agrawal, N. K., Gupta, S. K. & Singh, K. Association of toll-like receptor 4 polymorphisms with diabetic foot ulcers and application of artificial neural network in DFU risk assessment in type 2 diabetes patients. BioMed. Res. Int. 2013, e318686 (2013).","journal-title":"BioMed. Res. Int."},{"key":"552_CR30","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1177\/0272989X9801800114","volume":"18","author":"P Lapuerta","year":"1998","unstructured":"Lapuerta, P. et al. Neural network assessment of perioperative cardiac risk in vascular surgery patients. Med. Decis. Making 18, 70\u201375 (1998).","journal-title":"Med. Decis. Making"},{"key":"552_CR31","doi-asserted-by":"publisher","first-page":"e009447","DOI":"10.1161\/CIRCINTERVENTIONS.120.009447","volume":"13","author":"EH Weissler","year":"2020","unstructured":"Weissler, E. H. et al. Use of natural language processing to improve identification of patients with peripheral artery disease. Circ. Cardiovasc. Interv. 13, e009447 (2020).","journal-title":"Circ. Cardiovasc. Interv."},{"key":"552_CR32","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1016\/j.jvs.2015.02.038","volume":"62","author":"ES Wise","year":"2015","unstructured":"Wise, E. S., Hocking, K. M. & Brophy, C. M. Prediction of in-hospital mortality after ruptured abdominal aortic aneurysm repair using an artificial neural network. J. Vasc. Surg. 62, 8\u201315 (2015).","journal-title":"J. Vasc. Surg."},{"key":"552_CR33","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.jamcollsurg.2019.09.015","volume":"230","author":"JM Hyer","year":"2020","unstructured":"Hyer, J. M. et al. Can we improve prediction of adverse surgical outcomes? Development of a surgical complexity score using a novel machine learning technique. J. Am. Coll. Surg. 230, 43\u201352.e1 (2020).","journal-title":"J. Am. Coll. Surg."},{"key":"552_CR34","doi-asserted-by":"publisher","first-page":"562","DOI":"10.1007\/s10439-012-0691-4","volume":"41","author":"K Lee","year":"2013","unstructured":"Lee, K. et al. Surface curvature as a classifier of abdominal aortic aneurysms: a comparative analysis. Ann. Biomed. Eng. 41, 562\u2013576 (2013).","journal-title":"Ann. Biomed. Eng."},{"key":"552_CR35","doi-asserted-by":"publisher","first-page":"168","DOI":"10.3348\/kjr.2020.0313","volume":"22","author":"Y Yu","year":"2021","unstructured":"Yu, Y. et al. A three-dimensional deep convolutional neural network for automatic segmentation and diameter measurement of type B aortic dissection. Korean J. Radiol. 22, 168\u2013178 (2021).","journal-title":"Korean J. Radiol."},{"key":"552_CR36","doi-asserted-by":"publisher","first-page":"e1001146","DOI":"10.1371\/journal.pgen.1001146","volume":"6","author":"S Okser","year":"2010","unstructured":"Okser, S. et al. Genetic variants and their interactions in the prediction of increased pre-clinical carotid atherosclerosis: the cardiovascular risk in young Finns study. PLOS Genet. 6, e1001146 (2010).","journal-title":"PLOS Genet."},{"key":"552_CR37","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.compbiomed.2016.11.011","volume":"80","author":"T Araki","year":"2017","unstructured":"Araki, T. et al. Stroke risk stratification and its validation using ultrasonic echolucent carotid wall plaque morphology: a machine learning paradigm. Comput. Biol. Med. 80, 77\u201396 (2017).","journal-title":"Comput. Biol. Med."},{"key":"552_CR38","doi-asserted-by":"publisher","first-page":"829","DOI":"10.1007\/s10016-005-7685-8","volume":"19","author":"R Mofidi","year":"2005","unstructured":"Mofidi, R. et al. Prediction of the exact degree of internal carotid artery stenosis using an artificial neural network based on duplex velocity measurements. Ann. Vasc. Surg. 19, 829\u2013837 (2005).","journal-title":"Ann. Vasc. Surg."},{"key":"552_CR39","doi-asserted-by":"crossref","unstructured":"Karhade, A. V. et al. Development of machine learning and natural language processing algorithms for preoperative prediction and automated identification of intraoperative vascular injury in anterior lumbar spine surgery. Spine J. 21, 1635\u20131642 (2021).","DOI":"10.1016\/j.spinee.2020.04.001"},{"key":"552_CR40","doi-asserted-by":"publisher","first-page":"564","DOI":"10.1097\/SLA.0000000000004132","volume":"272","author":"ZB Perkins","year":"2020","unstructured":"Perkins, Z. B. et al. Predicting the outcome of limb revascularization in patients with lower-extremity arterial trauma: development and external validation of a supervised machine-learning algorithm to support surgical decisions. Ann. Surg. 272, 564\u2013572 (2020).","journal-title":"Ann. Surg."},{"key":"552_CR41","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1111\/jep.13324","volume":"26","author":"X Wang","year":"2020","unstructured":"Wang, X. et al. Comparing different venous thromboembolism risk assessment machine learning models in Chinese patients. J. Eval. Clin. Pract. 26, 26\u201334 (2020).","journal-title":"J. Eval. Clin. Pract."},{"key":"552_CR42","doi-asserted-by":"publisher","first-page":"e14563","DOI":"10.14814\/phy2.14563","volume":"8","author":"JL Zhang","year":"2020","unstructured":"Zhang, J. L. et al. Exercise-induced calf muscle hyperemia: rapid mapping of magnetic resonance imaging using deep learning approach. Physiol. Rep. 8, e14563 (2020).","journal-title":"Physiol. Rep."},{"key":"552_CR43","doi-asserted-by":"publisher","first-page":"467","DOI":"10.1016\/j.jvs.2005.11.022","volume":"43","author":"VG Hadjianastassiou","year":"2006","unstructured":"Hadjianastassiou, V. G. et al. Informed prognosis [corrected] after abdominal aortic aneurysm repair using predictive modeling techniques [corrected]. J. Vasc. Surg. 43, 467\u2013473 (2006).","journal-title":"J. Vasc. Surg."},{"key":"552_CR44","first-page":"A11214","volume":"140","author":"M Madani","year":"2019","unstructured":"Madani, M. et al. Machine learning detection of endoleak following endovascular aortic repair. Circulation 140, A11214\u2013A11214 (2019).","journal-title":"Circulation"},{"key":"552_CR45","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1016\/j.avsg.2008.04.004","volume":"22","author":"M Aleksic","year":"2008","unstructured":"Aleksic, M. et al. Implementation of an artificial neuronal network to predict shunt necessity in carotid surgery. Ann. Vasc. Surg. 22, 635\u2013642 (2008).","journal-title":"Ann. Vasc. Surg."},{"key":"552_CR46","doi-asserted-by":"publisher","first-page":"1151","DOI":"10.1007\/s00330-020-07213-w","volume":"31","author":"A Hata","year":"2021","unstructured":"Hata, A. et al. Deep learning algorithm for detection of aortic dissection on non-contrast-enhanced CT. Eur. Radiol. 31, 1151\u20131159 (2021).","journal-title":"Eur. Radiol."},{"key":"552_CR47","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-021-00394-8","volume":"4","author":"M Ravaut","year":"2021","unstructured":"Ravaut, M. et al. Predicting adverse outcomes due to diabetes complications with machine learning using administrative health data. Npj Digit. Med. 4, 1\u201312 (2021).","journal-title":"Npj Digit. Med."},{"key":"552_CR48","doi-asserted-by":"publisher","first-page":"e004741","DOI":"10.1161\/CIRCOUTCOMES.118.004741","volume":"12","author":"EG Ross","year":"2019","unstructured":"Ross, E. G. et al. Predicting future cardiovascular events in patients with peripheral artery disease using electronic health record data. Circ. Cardiovasc. Qual. Outcomes 12, e004741 (2019).","journal-title":"Circ. Cardiovasc. Qual. Outcomes"},{"key":"552_CR49","doi-asserted-by":"publisher","first-page":"17","DOI":"10.1016\/j.gpb.2017.07.003","volume":"16","author":"C Cao","year":"2018","unstructured":"Cao, C. et al. Deep learning and its applications in biomedicine. Genomics Proteom. Bioinforma. 16, 17\u201332 (2018).","journal-title":"Genomics Proteom. Bioinforma."},{"key":"552_CR50","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/j.jvs.2019.12.026","volume":"72","author":"J Raffort","year":"2020","unstructured":"Raffort, J. et al. Artificial intelligence in abdominal aortic aneurysm. J. Vasc. Surg. 72, 321\u2013333.e1 (2020).","journal-title":"J. Vasc. Surg."},{"key":"552_CR51","doi-asserted-by":"publisher","first-page":"476","DOI":"10.1016\/j.wneu.2017.09.149","volume":"109","author":"JT Senders","year":"2018","unstructured":"Senders, J. T. et al. Machine learning and neurosurgical outcome prediction: a systematic review. World Neurosurg. 109, 476\u2013486.e1 (2018).","journal-title":"World Neurosurg."},{"key":"552_CR52","doi-asserted-by":"publisher","first-page":"m689","DOI":"10.1136\/bmj.m689","volume":"368","author":"M Nagendran","year":"2020","unstructured":"Nagendran, M. et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies in medical imaging. BMJ 368, m689 (2020).","journal-title":"BMJ"},{"key":"552_CR53","first-page":"26","volume":"369","author":"L Wynants","year":"2020","unstructured":"Wynants, L. et al. Prediction models for diagnosis and prognosis of covid-19: systematic review and critical appraisal. BMJ 369, 26 (2020).","journal-title":"BMJ"},{"key":"552_CR54","first-page":"191","volume":"2020","author":"M Ghassemi","year":"2020","unstructured":"Ghassemi, M. et al. A review of challenges and opportunities in machine learning for health. AMIA Summits Transl. Sci. Proc. 2020, 191\u2013200 (2020).","journal-title":"AMIA Summits Transl. Sci. Proc."},{"key":"552_CR55","doi-asserted-by":"publisher","first-page":"e006556","DOI":"10.1161\/CIRCOUTCOMES.120.006556","volume":"13","author":"LM Stevens","year":"2020","unstructured":"Stevens, L. M., Mortazavi, B. J., Deo, R. C., Curtis, L. & Kao, D. P. Recommendations for reporting machine learning analyses in clinical research. Circ. Cardiovasc. Qual. Outcomes 13, e006556 (2020).","journal-title":"Circ. Cardiovasc. Qual. Outcomes"},{"key":"552_CR56","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1038\/s41746-020-00341-z","volume":"3","author":"S-C Huang","year":"2020","unstructured":"Huang, S.-C., Pareek, A., Seyyedi, S., Banerjee, I. & Lungren, M. P. Fusion of medical imaging and electronic health records using deep learning: a systematic review and implementation guidelines. Npj Digit. Med. 3, 1\u20139 (2020).","journal-title":"Npj Digit. Med."},{"key":"552_CR57","doi-asserted-by":"publisher","first-page":"e279","DOI":"10.1016\/S2589-7500(20)30102-3","volume":"2","author":"CS Lee","year":"2020","unstructured":"Lee, C. S. & Lee, A. Y. Clinical applications of continual learning machine learning. Lancet Digit. Health 2, e279\u2013e281 (2020).","journal-title":"Lancet Digit. Health"},{"key":"552_CR58","unstructured":"GitHub. https:\/\/github.com\/. (2021)."},{"key":"552_CR59","doi-asserted-by":"publisher","first-page":"1544","DOI":"10.1001\/jamainternmed.2018.3763","volume":"178","author":"MA Gianfrancesco","year":"2018","unstructured":"Gianfrancesco, M. A., Tamang, S., Yazdany, J. & Schmajuk, G. Potential biases in machine learning algorithms using electronic health record data. JAMA Intern. Med. 178, 1544\u20131547 (2018).","journal-title":"JAMA Intern. Med."},{"key":"552_CR60","doi-asserted-by":"publisher","first-page":"E1351","DOI":"10.1503\/cmaj.202434","volume":"193","author":"AA Verma","year":"2021","unstructured":"Verma, A. A. et al. Implementing machine learning in medicine. CMAJ 193, E1351\u2013E1357 (2021).","journal-title":"CMAJ"},{"key":"552_CR61","doi-asserted-by":"publisher","unstructured":"Cohen, J. P. et al. Problems in the deployment of machine-learned models in health care. CMAJ 193, E1391\u2013E1394 (2021) https:\/\/doi.org\/10.1503\/cmaj.202066.","DOI":"10.1503\/cmaj.202066"},{"key":"552_CR62","doi-asserted-by":"publisher","unstructured":"Antoniou, T. & Mamdani, M. Evaluation of machine learning solutions in medicine. CMAJ 193, E1425\u2013E1429 (2021) https:\/\/doi.org\/10.1503\/cmaj.210036.","DOI":"10.1503\/cmaj.210036"},{"key":"552_CR63","doi-asserted-by":"publisher","first-page":"1806","DOI":"10.1001\/jama.2019.16489","volume":"322","author":"Y Liu","year":"2019","unstructured":"Liu, Y., Chen, P.-H. C., Krause, J. & Peng, L. How to read articles that use machine learning: users\u2019 guides to the medical literature. JAMA 322, 1806\u20131816 (2019).","journal-title":"JAMA"},{"key":"552_CR64","doi-asserted-by":"publisher","first-page":"1577","DOI":"10.1016\/S0140-6736(19)30037-6","volume":"393","author":"GS Collins","year":"2019","unstructured":"Collins, G. S. & Moons, K. G. M. Reporting of artificial intelligence prediction models. Lancet 393, 1577\u20131579 (2019).","journal-title":"Lancet"},{"key":"552_CR65","doi-asserted-by":"publisher","first-page":"e1000097","DOI":"10.1371\/journal.pmed.1000097","volume":"6","author":"D Moher","year":"2009","unstructured":"Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. PRISMA Group Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 6, e1000097 (2009).","journal-title":"PLoS Med."},{"key":"552_CR66","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-020-01542-z","volume":"10","author":"ML Rethlefsen","year":"2021","unstructured":"Rethlefsen, M. L. et al. PRISMA-S: an extension to the PRISMA statement for reporting literature searches in systematic reviews. Syst. Rev. 10, 39 (2021).","journal-title":"Syst. Rev."},{"key":"552_CR67","unstructured":"PROSPERO: International Prospective Register of Systematic Reviews. National Institute for Health Research (NHS) https:\/\/www.crd.york.ac.uk\/prospero\/ (2018)."},{"key":"552_CR68","unstructured":"EndNote. https:\/\/endnote.com\/. (2021)."},{"key":"552_CR69","unstructured":"Google Translate. https:\/\/translate.google.ca\/. (2021)."},{"key":"552_CR70","unstructured":"Covidence. https:\/\/www.covidence.org\/. (2021)."},{"key":"552_CR71","doi-asserted-by":"publisher","first-page":"e1001744","DOI":"10.1371\/journal.pmed.1001744","volume":"11","author":"KGM Moons","year":"2014","unstructured":"Moons, K. G. M. et al. Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modelling Studies: The CHARMS Checklist. PLoS Med. 11, e1001744 (2014).","journal-title":"PLoS Med."},{"key":"552_CR72","doi-asserted-by":"publisher","first-page":"1315","DOI":"10.1097\/JTO.0b013e3181ec173d","volume":"5","author":"JN Mandrekar","year":"2010","unstructured":"Mandrekar, J. N. Receiver operating characteristic curve in diagnostic test assessment. J. Thorac. Oncol. 5, 1315\u20131316 (2010).","journal-title":"J. Thorac. Oncol."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00552-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00552-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00552-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,25]],"date-time":"2022-11-25T08:19:55Z","timestamp":1669364395000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00552-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,19]]},"references-count":72,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["552"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00552-y","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,19]]},"assertion":[{"value":"20 June 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 December 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"7"}}