{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T03:35:43Z","timestamp":1773804943219,"version":"3.50.1"},"reference-count":76,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T00:00:00Z","timestamp":1643241600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T00:00:00Z","timestamp":1643241600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Artificial intelligence (AI) centred diagnostic systems are increasingly recognised as robust solutions in healthcare delivery pathways. In turn, there has been a concurrent rise in secondary research studies regarding these technologies in order to influence key clinical and policymaking decisions. It is therefore essential that these studies accurately appraise methodological quality and risk of bias within shortlisted trials and reports. In order to assess whether this critical step is performed, we undertook a meta-research study evaluating adherence to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool within AI diagnostic accuracy systematic reviews. A literature search was conducted on all studies published from 2000 to December 2020. Of 50 included reviews, 36 performed the quality assessment, of which 27 utilised the QUADAS-2 tool. Bias was reported across all four domains of QUADAS-2. Two hundred forty-three of 423 studies (57.5%) across all systematic reviews utilising QUADAS-2 reported a high or unclear risk of bias in the patient selection domain, 110 (26%) reported a high or unclear risk of bias in the index test domain, 121 (28.6%) in the reference standard domain and 157 (37.1%) in the flow and timing domain. This study demonstrates the incomplete uptake of quality assessment tools in reviews of AI-based diagnostic accuracy studies and highlights inconsistent reporting across all domains of quality assessment. Poor standards of reporting act as barriers to clinical implementation. The creation of an AI-specific extension for quality assessment tools of diagnostic accuracy AI studies may facilitate the safe translation of AI tools into clinical practice.<\/jats:p>","DOI":"10.1038\/s41746-021-00544-y","type":"journal-article","created":{"date-parts":[[2022,1,27]],"date-time":"2022-01-27T11:03:15Z","timestamp":1643281395000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":93,"title":["Quality assessment standards in artificial intelligence diagnostic accuracy systematic reviews: a meta-research study"],"prefix":"10.1038","volume":"5","author":[{"given":"Shruti","family":"Jayakumar","sequence":"first","affiliation":[]},{"given":"Viknesh","family":"Sounderajah","sequence":"additional","affiliation":[]},{"given":"Pasha","family":"Normahani","sequence":"additional","affiliation":[]},{"given":"Leanne","family":"Harling","sequence":"additional","affiliation":[]},{"given":"Sheraz R.","family":"Markar","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1668-0672","authenticated-orcid":false,"given":"Hutan","family":"Ashrafian","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7815-7989","authenticated-orcid":false,"given":"Ara","family":"Darzi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,1,27]]},"reference":[{"key":"544_CR1","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1038\/s41586-019-1799-6","volume":"577","author":"SM McKinney","year":"2020","unstructured":"McKinney, S. M. et al. International evaluation of an AI system for breast cancer screening. Nature 577, 89\u201394 (2020).","journal-title":"Nature"},{"key":"544_CR2","doi-asserted-by":"crossref","first-page":"1342","DOI":"10.1038\/s41591-018-0107-6","volume":"24","author":"J De Fauw","year":"2018","unstructured":"De Fauw, J. et al. Clinically applicable deep learning for diagnosis and referral in retinal disease. Nat. Med. 24, 1342\u20131350 (2018).","journal-title":"Nat. Med."},{"key":"544_CR3","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-018-37186-2","volume":"9","author":"M Yamada","year":"2019","unstructured":"Yamada, M. et al. Development of a real-time endoscopic image diagnosis support system using deep learning technology in colonoscopy. Sci. Rep. 9, 1\u20139 (2019).","journal-title":"Sci. Rep."},{"key":"544_CR4","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-018-0076-7","volume":"2","author":"K Nagpal","year":"2019","unstructured":"Nagpal, K. et al. Development and validation of a deep learning algorithm for improving Gleason scoring of prostate cancer. npj Digit. Med. 2, 1\u201310 (2019).","journal-title":"npj Digit. Med."},{"key":"544_CR5","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/1471-2288-3-25","volume":"3","author":"P Whiting","year":"2003","unstructured":"Whiting, P., Rutjes, A. W. S., Reitsma, J. B., Bossuyt, P. M. M. & Kleijnen, J. The development of QUADAS: A tool for the quality assessment of studies of diagnostic accuracy included in systematic reviews. BMC Medical Research Methodology 3, 1\u201313 (2003).","journal-title":"BMC Medical Research Methodology"},{"key":"544_CR6","doi-asserted-by":"crossref","first-page":"529","DOI":"10.7326\/0003-4819-155-8-201110180-00009","volume":"155","author":"PF Whiting","year":"2011","unstructured":"Whiting, P. F. et al. Quadas-2: A revised tool for the quality assessment of diagnostic accuracy studies. Annals of Internal Medicine 155, 529\u2013536 (2011).","journal-title":"Annals of Internal Medicine"},{"key":"544_CR7","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1038\/nrclinonc.2017.141","volume":"14","author":"P Lambin","year":"2017","unstructured":"Lambin, P. et al. Radiomics: The bridge between medical imaging and personalized medicine. Nature Reviews Clinical Oncology 14, 749\u2013762 (2017).","journal-title":"Nature Reviews Clinical Oncology"},{"key":"544_CR8","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1148\/radiol.2017170586","volume":"287","author":"RA Frank","year":"2018","unstructured":"Frank, R. A. et al. Are Study and Journal Characteristics Reliable Indicators of \u201cTruth\u201d in Imaging Research? Radiology 287, 215\u2013223 (2018).","journal-title":"Radiology"},{"key":"544_CR9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41746-019-0211-0","volume":"3","author":"C Guo","year":"2020","unstructured":"Guo, C. et al. Challenges for the evaluation of digital health solutions\u2014A call for innovative evidence generation approaches. npj Digit. Med. 3, 1\u201314 (2020).","journal-title":"npj Digit. Med."},{"key":"544_CR10","doi-asserted-by":"crossref","first-page":"3558","DOI":"10.1007\/s00330-020-06666-3","volume":"30","author":"S Ursprung","year":"2020","unstructured":"Ursprung, S. et al. Radiomics of computed tomography and magnetic resonance imaging in renal cell carcinoma\u2014a systematic review and meta-analysis. Eur. Radiol. 30, 3558\u20133566 (2020).","journal-title":"Eur. Radiol."},{"key":"544_CR11","doi-asserted-by":"publisher","unstructured":"Cho, S. J. et al. Brain metastasis detection using machine learning: a systematic review and meta-analysis. Neuro. Oncol. 1\u201312, https:\/\/doi.org\/10.1093\/neuonc\/noaa232 (2020).","DOI":"10.1093\/neuonc\/noaa232"},{"key":"544_CR12","first-page":"519","volume":"10","author":"E Pellegrini","year":"2018","unstructured":"Pellegrini, E. et al. Machine learning of neuroimaging for assisted diagnosis of cognitive impairment and dementia: A systematic review. Alzheimer\u2019s Dement. Diagnosis, Assess. Dis. Monit. 10, 519\u2013535 (2018).","journal-title":"Alzheimer\u2019s Dement. Diagnosis, Assess. Dis. Monit."},{"key":"544_CR13","doi-asserted-by":"crossref","first-page":"2751","DOI":"10.1097\/CORR.0000000000001360","volume":"478","author":"OQ Groot","year":"2020","unstructured":"Groot, O. Q. et al. Does Artificial Intelligence Outperform Natural Intelligence in Interpreting Musculoskeletal Radiological Studies? A Systematic Review. Clin. Orthop. Relat. Res. 478, 2751\u20132764 (2020).","journal-title":"Clin. Orthop. Relat. Res."},{"key":"544_CR14","doi-asserted-by":"crossref","first-page":"2482","DOI":"10.1097\/CORR.0000000000000848","volume":"477","author":"DWG Langerhuizen","year":"2019","unstructured":"Langerhuizen, D. W. G. et al. What Are the Applications and Limitations of Artificial Intelligence for Fracture Detection and Classification in Orthopaedic Trauma Imaging? A Systematic Review. Clin. Orthop. Relat. Res. 477, 2482\u20132491 (2019).","journal-title":"Clin. Orthop. Relat. Res."},{"key":"544_CR15","doi-asserted-by":"crossref","unstructured":"Ruffano, L. et al. Computer-assisted diagnosis techniques (dermoscopy and spectroscopy-based) for diagnosing skin cancer in adults. Cochrane Database Syst. Rev. 2018, (2018).","DOI":"10.1002\/14651858.CD013186"},{"key":"544_CR16","doi-asserted-by":"crossref","unstructured":"Chuchu, N. et al. Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma. Cochrane Database Syst. Rev. 2018, (2018).","DOI":"10.1002\/14651858.CD013192"},{"key":"544_CR17","first-page":"1","volume":"0","author":"AS Azam","year":"2020","unstructured":"Azam, A. S. et al. Diagnostic concordance and discordance in digital pathology: a systematic review and meta-analysis. J. Clin. Pathol. 0, 1\u20138 (2020).","journal-title":"J. Clin. Pathol."},{"key":"544_CR18","doi-asserted-by":"crossref","first-page":"577","DOI":"10.1016\/j.cjca.2019.09.013","volume":"36","author":"PA Iannattone","year":"2020","unstructured":"Iannattone, P. A., Zhao, X., VanHouten, J., Garg, A. & Huynh, T. Artificial Intelligence for Diagnosis of Acute Coronary Syndromes: A Meta-analysis of Machine Learning Approaches. Can. J. Cardiol. 36, 577\u2013583 (2020).","journal-title":"Can. J. Cardiol."},{"key":"544_CR19","first-page":"178","volume":"88","author":"J Sprockel","year":"2018","unstructured":"Sprockel, J., Tejeda, M., Yate, J., Diaztagle, J. & Gonz\u00e1lez, E. Intelligent systems tools in the diagnosis of acute coronary syndromes: A systemic review. Arch. Cardiol. Mex. 88, 178\u2013189 (2018).","journal-title":"Arch. Cardiol. Mex."},{"key":"544_CR20","doi-asserted-by":"crossref","first-page":"104885","DOI":"10.1016\/j.oraloncology.2020.104885","volume":"110","author":"H Mahmood","year":"2020","unstructured":"Mahmood, H. et al. Use of artificial intelligence in diagnosis of head and neck precancerous and cancerous lesions: A systematic review. Oral. Oncol. 110, 104885 (2020).","journal-title":"Oral. Oncol."},{"key":"544_CR21","doi-asserted-by":"crossref","first-page":"12592","DOI":"10.1073\/pnas.1919012117","volume":"117","author":"AJ Larrazabal","year":"2020","unstructured":"Larrazabal, A. J., Nieto, N., Peterson, V., Milone, D. H. & Ferrante, E. Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis. Proc. Natl. Acad. Sci. U. S. A. 117, 12592\u201312594 (2020).","journal-title":"Proc. Natl. Acad. Sci. U. S. A."},{"key":"544_CR22","doi-asserted-by":"crossref","DOI":"10.1186\/s12916-019-1426-2","volume":"17","author":"CJ Kelly","year":"2019","unstructured":"Kelly, C. J., Karthikesalingam, A., Suleyman, M., Corrado, G. & King, D. Key challenges for delivering clinical impact with artificial intelligence. BMC Medicine 17, 195 (2019).","journal-title":"BMC Medicine"},{"key":"544_CR23","doi-asserted-by":"publisher","unstructured":"Kamulegeya, L. H. et al. Using artificial intelligence on dermatology conditions in Uganda: A case for diversity in training data sets for machine learning. bioRxiv 826057, https:\/\/doi.org\/10.1101\/826057 (2019).","DOI":"10.1101\/826057"},{"key":"544_CR24","doi-asserted-by":"crossref","first-page":"1247","DOI":"10.1001\/jamadermatol.2018.2348","volume":"154","author":"AS Adamson","year":"2018","unstructured":"Adamson, A. S. & Smith, A. Machine learning and health care disparities in dermatology. JAMA Dermatology 154, 1247\u20131248 (2018).","journal-title":"JAMA Dermatology"},{"key":"544_CR25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3457607","volume":"54","author":"N Mehrabi","year":"2021","unstructured":"Mehrabi, N., Morstatter, F., Saxena, N., Lerman, K. & Galstyan, A. A Survey on Bias and Fairness in Machine Learning. ACM Comput. Surv. 54, 1\u201335 (2021).","journal-title":"ACM Comput. Surv."},{"key":"544_CR26","doi-asserted-by":"crossref","first-page":"1354","DOI":"10.1016\/j.gie.2011.08.001","volume":"74","author":"S Gross","year":"2011","unstructured":"Gross, S. et al. Computer-based classification of small colorectal polyps by using narrow-band imaging with optical magnification. Gastrointest. Endosc. 74, 1354\u20131359 (2011).","journal-title":"Gastrointest. Endosc."},{"key":"544_CR27","doi-asserted-by":"crossref","first-page":"807","DOI":"10.1038\/s41591-020-0941-1","volume":"26","author":"V Sounderajah","year":"2020","unstructured":"Sounderajah, V. et al. Developing specific reporting guidelines for diagnostic accuracy studies assessing AI interventions: The STARD-AI Steering Group. Nat. Med. 26, 807\u2013808 (2020).","journal-title":"Nat. Med."},{"key":"544_CR28","first-page":"231","volume":"28","author":"R Challen","year":"2019","unstructured":"Challen, R. et al. BMJ Qual Artificial intelligence, bias and clinical safety. Saf 28, 231\u2013237 (2019).","journal-title":"Saf"},{"key":"544_CR29","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1148\/radiol.2020192224","volume":"295","author":"MJ Willemink","year":"2020","unstructured":"Willemink, M. J. et al. Preparing medical imaging data for machine learning. Radiology 295, 4\u201315 (2020).","journal-title":"Radiology"},{"key":"544_CR30","doi-asserted-by":"crossref","first-page":"e0221339","DOI":"10.1371\/journal.pone.0221339","volume":"14","author":"M Harris","year":"2019","unstructured":"Harris, M. et al. A systematic review of the diagnostic accuracy of artificial intelligence-based computer programs to analyze chest x-rays for pulmonary tuberculosis. PLoS One 14, e0221339 (2019).","journal-title":"PLoS One"},{"key":"544_CR31","first-page":"108ra113","volume":"3","author":"AH Beck","year":"2011","unstructured":"Beck, A. H. et al. Imaging: Systematic analysis of breast cancer morphology uncovers stromal features associated with survival. Sci. Transl. Med. 3, 108ra113 (2011).","journal-title":"Sci. Transl. Med."},{"key":"544_CR32","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1038\/s41551-018-0195-0","volume":"2","author":"R Poplin","year":"2018","unstructured":"Poplin, R. et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nat. Biomed. Eng. 2, 158\u2013164 (2018).","journal-title":"Nat. Biomed. Eng."},{"key":"544_CR33","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1016\/S0140-6736(19)31721-0","volume":"394","author":"ZI Attia","year":"2019","unstructured":"Attia, Z. I. et al. An artificial intelligence-enabled ECG algorithm for the identification of patients with atrial fibrillation during sinus rhythm: a retrospective analysis of outcome prediction. Lancet 394, 861\u2013867 (2019).","journal-title":"Lancet"},{"key":"544_CR34","doi-asserted-by":"crossref","first-page":"588","DOI":"10.3389\/fpsyt.2020.00588","volume":"11","author":"L Steardo","year":"2020","unstructured":"Steardo, L. et al. Application of Support Vector Machine on fMRI Data as Biomarkers in Schizophrenia Diagnosis: A Systematic Review. Front. Psychiatry 11, 588 (2020).","journal-title":"Front. Psychiatry"},{"key":"544_CR35","doi-asserted-by":"crossref","first-page":"e14108","DOI":"10.2196\/14108","volume":"6","author":"SJ Moon","year":"2019","unstructured":"Moon, S. J., Hwang, J., Kana, R., Torous, J. & Kim, J. W. Accuracy of Machine Learning Algorithms for the Diagnosis of Autism Spectrum Disorder: Systematic Review and Meta-Analysis of Brain Magnetic Resonance Imaging. Studies. JMIR Ment. Heal. 6, e14108 (2019).","journal-title":"Studies. JMIR Ment. Heal."},{"key":"544_CR36","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.pnpbp.2018.08.005","volume":"91","author":"W Bruin","year":"2019","unstructured":"Bruin, W., Denys, D. & van Wingen, G. Diagnostic neuroimaging markers of obsessive-compulsive disorder: Initial evidence from structural and functional MRI studies. Progress in Neuro-Psychopharmacology and Biological Psychiatry 91, 49\u201359 (2019).","journal-title":"Progress in Neuro-Psychopharmacology and Biological Psychiatry"},{"key":"544_CR37","doi-asserted-by":"crossref","first-page":"220","DOI":"10.3389\/fnagi.2019.00220","volume":"11","author":"T Jo","year":"2019","unstructured":"Jo, T., Nho, K. & Saykin, A. J. Deep Learning in Alzheimer\u2019s Disease: Diagnostic Classification and Prognostic Prediction Using Neuroimaging Data. Front. Aging Neurosci. 11, 220 (2019).","journal-title":"Front. Aging Neurosci."},{"key":"544_CR38","first-page":"21","volume":"19","author":"A Marka","year":"2019","unstructured":"Marka, A., Carter, J. B., Toto, E. & Hassanpour, S. Automated detection of nonmelanoma skin cancer using digital images: A systematic review. BMC Med. Imaging 19, 21 (2019).","journal-title":"Imaging"},{"key":"544_CR39","doi-asserted-by":"crossref","first-page":"797","DOI":"10.1016\/j.jclinepi.2009.02.005","volume":"62","author":"JB Reitsma","year":"2009","unstructured":"Reitsma, J. B., Rutjes, A. W. S., Khan, K. S., Coomarasamy, A. & Bossuyt, P. M. A review of solutions for diagnostic accuracy studies with an imperfect or missing reference standard. J. Clin. Epidemiol. 62, 797\u2013806 (2009).","journal-title":"J. Clin. Epidemiol."},{"key":"544_CR40","doi-asserted-by":"crossref","first-page":"1364","DOI":"10.1038\/s41591-020-1034-x","volume":"26","author":"X Liu","year":"2020","unstructured":"Liu, X., Cruz Rivera, S., Moher, D., Calvert, M. J. & Denniston, A. K. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nat. med. 26, 1364\u20131374 (2020).","journal-title":"Nat. med."},{"key":"544_CR41","doi-asserted-by":"crossref","first-page":"1577","DOI":"10.1016\/S0140-6736(19)30037-6","volume":"393","author":"GS Collins","year":"2019","unstructured":"Collins, G. S. & Moons, K. G. M. Reporting of artificial intelligence prediction models. The Lancet 393, 1577\u20131579 (2019).","journal-title":"The Lancet"},{"key":"544_CR42","doi-asserted-by":"crossref","first-page":"1351","DOI":"10.1038\/s41591-020-1037-7","volume":"26","author":"S Cruz Rivera","year":"2020","unstructured":"Cruz Rivera, S. et al. Guidelines for clinical trial protocols for interventions involving artificial intelligence: the SPIRIT-AI extension. Nat. Med. 26, 1351\u20131363 (2020).","journal-title":"Nat. Med."},{"key":"544_CR43","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1016\/j.amepre.2016.06.008","volume":"51","author":"E Murray","year":"2016","unstructured":"Murray, E. et al. Evaluating Digital Health Interventions: Key Questions and Approaches. Am. J. Prev. Med. 51, 843\u2013851 (2016).","journal-title":"J. Prev. Med."},{"key":"544_CR44","first-page":"332","volume":"339","author":"D Moher","year":"2009","unstructured":"Moher, D., Liberati, A., Tetzlaff, J. & Altman, D. G. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. BMJ (Online) 339, 332\u2013336 (2009).","journal-title":"BMJ (Online)"},{"key":"544_CR45","doi-asserted-by":"crossref","unstructured":"Shea, B. J. et al. AMSTAR 2: A critical appraisal tool for systematic reviews that include randomised or non-randomised studies of healthcare interventions, or both. BMJ 358, j4008 (2017).","DOI":"10.1136\/bmj.j4008"},{"key":"544_CR46","doi-asserted-by":"crossref","unstructured":"Nayantara, P. V., Kamath, S., Manjunath, K. N. & Rajagopal, K. V. Computer-aided diagnosis of liver lesions using CT images: A systematic review. Comput. Bio. Med. 127 (2020).","DOI":"10.1016\/j.compbiomed.2020.104035"},{"key":"544_CR47","doi-asserted-by":"crossref","unstructured":"Cromb\u00e9, A. et al. Systematic review of sarcomas radiomics studies: Bridging the gap between concepts and clinical applications? Eur. J. Radiol. 132, (2020).","DOI":"10.1016\/j.ejrad.2020.109283"},{"key":"544_CR48","doi-asserted-by":"publisher","DOI":"10.1016\/j.arthro.2020.09.012","author":"KN Kunze","year":"2020","unstructured":"Kunze, K. N. et al. Diagnostic Performance of Artificial Intelligence for Detection of Anterior Cruciate Ligament and Meniscus Tears: A Systematic Review. Arthrosco. - J. Arthrosco. Related Sur. https:\/\/doi.org\/10.1016\/j.arthro.2020.09.012 (2020).","journal-title":"Arthrosco. - J. Arthrosco. Related Sur."},{"key":"544_CR49","doi-asserted-by":"crossref","unstructured":"Ninatti, G., Kirienko, M., Neri, E., Sollini, M. & Chiti, A. Imaging-based prediction of molecular therapy targets in NSCLC by radiogenomics and AI approaches: A systematic review. Diagnostics 10, (2020).","DOI":"10.3390\/diagnostics10060359"},{"key":"544_CR50","doi-asserted-by":"crossref","first-page":"655","DOI":"10.1007\/s10278-020-00320-6","volume":"33","author":"A Halder","year":"2020","unstructured":"Halder, A., Dey, D. & Sadhu, A. K. Lung Nodule Detection from Feature Engineering to Deep Learning in Thoracic CT Images: a Comprehensive Review. J. Digit. Imaging 33, 655\u2013677 (2020).","journal-title":"J. Digit. Imaging"},{"key":"544_CR51","doi-asserted-by":"crossref","unstructured":"Li, D. et al. The performance of deep learning algorithms on automatic pulmonary nodule detection and classification tested on different datasets that are not derived from LIDC-IDRI: A systematic review. Diagnostics 9, (2019).","DOI":"10.3390\/diagnostics9040207"},{"key":"544_CR52","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.4251\/wjgo.v11.i12.1218","volume":"11","author":"SA Azer","year":"2019","unstructured":"Azer, S. A. Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review. World J. of Gastroi. Oncol. 11, 1218\u20131230 (2019).","journal-title":"World J. of Gastroi. Oncol."},{"key":"544_CR53","doi-asserted-by":"crossref","unstructured":"Sarmento, R. M., Vasconcelos, F. F. X., Filho, P. P. R., Wu, W. & De Albuquerque, V. H. C. Automatic Neuroimage Processing and Analysis in Stroke - A Systematic Review. IEEE Rev. Biomed. Eng. 13, 130\u2013155 (2020)..","DOI":"10.1109\/RBME.2019.2934500"},{"key":"544_CR54","first-page":"1605","volume":"15","author":"R De Filippis","year":"2019","unstructured":"De Filippis, R. et al. Machine learning techniques in a structural and functional MRI diagnostic approach in schizophrenia: A systematic review. Neuropsychiat DisTreat. 15, 1605\u20131627 (2019).","journal-title":"Neuropsychiat DisTreat."},{"key":"544_CR55","doi-asserted-by":"crossref","unstructured":"Pehrson, L. M., Nielsen, M. B. & Lauridsen, C. A. Automatic pulmonary nodule detection applying deep learning or machine learning algorithms to the LIDC-IDRI database: A systematic review. Diagnostics 9, (2019).","DOI":"10.3390\/diagnostics9010029"},{"key":"544_CR56","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1016\/j.nicl.2018.08.028","volume":"20","author":"J McCarthy","year":"2018","unstructured":"McCarthy, J., Collins, D. L. & Ducharme, S. Morphometric MRI as a diagnostic biomarker of frontotemporal dementia: A systematic review to determine clinical applicability. NeuroImage Clin. 20, 685\u2013696 (2018).","journal-title":"NeuroImage Clin."},{"key":"544_CR57","doi-asserted-by":"crossref","first-page":"E5","DOI":"10.3171\/2018.8.FOCUS18325","volume":"45","author":"AV Nguyen","year":"2018","unstructured":"Nguyen, A. V., Blears, E. E., Ross, E., Lall, R. R. & Ortega-Barnett, J. Machine learning applications for the differentiation of primary central nervous system lymphoma from glioblastoma on imaging: A systematic review and meta-analysis. Neurosurg. Focus 45, E5 (2018).","journal-title":"Neurosurg. Focus"},{"key":"544_CR58","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1093\/neuros\/nyx384","volume":"83","author":"JT Senders","year":"2018","unstructured":"Senders, J. T. et al. Natural and artificial intelligence in neurosurgery: A systematic review. Clin. Neurosurg. 83, 181\u2013192 (2018).","journal-title":"Clin. Neurosurg."},{"key":"544_CR59","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.semarthrit.2017.06.005","volume":"47","author":"A Smith","year":"2017","unstructured":"Smith, A., L\u00f3pez-Sol\u00e0, M., McMahon, K., Pedler, A. & Sterling, M. Multivariate pattern analysis utilizing structural or functional MRI\u2014In individuals with musculoskeletal pain and healthy controls: A systematic review. Semin. Arthritis Rheum. 47, 418\u2013431 (2017).","journal-title":"Semin. Arthritis Rheum."},{"key":"544_CR60","doi-asserted-by":"crossref","unstructured":"Li, Y., Zhang, Z., Dai, C., Dong, Q. & Badrigilan, S. Accuracy of deep learning for automated detection of pneumonia using chest X-Ray images: A systematic review and meta-analysis. Comput. Bio. Med. 123, (2020).","DOI":"10.1016\/j.compbiomed.2020.103898"},{"key":"544_CR61","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1159\/000504390","volume":"9","author":"L Xu","year":"2020","unstructured":"Xu, L. et al. Computer-Aided Diagnosis Systems in Diagnosing Malignant Thyroid Nodules on Ultrasonography: A Systematic Review and Meta-Analysis. Eur. Thyroid J. 9, 186\u2013193 (2020).","journal-title":"Eur. Thyroid J."},{"key":"544_CR62","doi-asserted-by":"crossref","first-page":"713.e17","DOI":"10.1016\/j.crad.2020.05.021","volume":"75","author":"S Yang","year":"2020","unstructured":"Yang, S. et al. Diagnostic accuracy of deep learning in orthopaedic fractures: a systematic review and meta-analysis. Clin. Radiol. 75, 713.e17\u2013713.e28 (2020).","journal-title":"Clin. Radiol."},{"key":"544_CR63","doi-asserted-by":"crossref","first-page":"211","DOI":"10.11152\/mu-2402","volume":"22","author":"J Li","year":"2020","unstructured":"Li, J. et al. The value of S-Detect for the differential diagnosis of breast masses on ultrasound: a systematic review and pooled meta-analysis. Med. Ultrason. 22, 211 (2020).","journal-title":"Med. Ultrason."},{"key":"544_CR64","doi-asserted-by":"crossref","unstructured":"Zhao, W. J. et al. Effectiveness evaluation of computer-aided diagnosis system for the diagnosis of thyroid nodules on ultrasound: A systematic review and meta-analysis. Medicine (United States) 98, (2019).","DOI":"10.1097\/MD.0000000000016379"},{"key":"544_CR65","doi-asserted-by":"crossref","unstructured":"Bang, C. S., Lee, J. J. & Baik, G. H. Artificial intelligence for the prediction of helicobacter pylori infection in endoscopic images: Systematic review and meta-analysis of diagnostic test accuracy. J. Med. Inter. Res. 22, (2020).","DOI":"10.2196\/preprints.21983"},{"key":"544_CR66","doi-asserted-by":"crossref","first-page":"356","DOI":"10.1016\/j.gie.2020.07.038","volume":"93","author":"BP Mohan","year":"2020","unstructured":"Mohan, B. P. et al. High pooled performance of convolutional neural networks in computer-aided diagnosis of GI ulcers and\/or hemorrhage on wireless capsule endoscopy images: a systematic review and meta-analysis. Gastrointest. Endosc. 93, 356\u2013364.e4 (2020).","journal-title":"Gastrointest. Endosc."},{"key":"544_CR67","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/j.gie.2020.06.059","volume":"93","author":"C Hassan","year":"2021","unstructured":"Hassan, C. et al. Performance of artificial intelligence in colonoscopy for adenoma and polyp detection: a systematic review and meta-analysis. Gastrointest. Endosc. 93, 77\u201385.e6 (2021).","journal-title":"Gastrointest. Endosc."},{"key":"544_CR68","doi-asserted-by":"crossref","first-page":"11","DOI":"10.1016\/j.gie.2020.02.033","volume":"92","author":"TKL Lui","year":"2020","unstructured":"Lui, T. K. L., Guo, C. G. & Leung, W. K. Accuracy of artificial intelligence on histology prediction and detection of colorectal polyps: a systematic review and meta-analysis. Gastrointest. Endosc. 92, 11\u201322.e6 (2020).","journal-title":"Gastrointest. Endosc."},{"key":"544_CR69","doi-asserted-by":"crossref","first-page":"821","DOI":"10.1016\/j.gie.2020.06.034","volume":"92","author":"TKL Lui","year":"2020","unstructured":"Lui, T. K. L., Tsui, V. W. M. & Leung, W. K. Accuracy of artificial intelligence\u2013assisted detection of upper GI lesions: a systematic review and meta-analysis. Gastrointest. Endosc. 92, 821\u2013830.e9 (2020).","journal-title":"Gastrointest. Endosc."},{"key":"544_CR70","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1530\/EJE-19-0968","volume":"183","author":"S Wang","year":"2020","unstructured":"Wang, S. et al. Performance of deep neural network-based artificial intelligence method in diabetic retinopathy screening: A systematic review and meta-analysis of diagnostic test accuracy. Eur. J. Endocrin. 183, 41\u201349 (2020).","journal-title":"Eur. J. Endocrin."},{"key":"544_CR71","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1016\/j.gie.2020.04.039","volume":"92","author":"S Soffer","year":"2020","unstructured":"Soffer, S. et al. Deep learning for wireless capsule endoscopy: a systematic review and meta-analysis. Gastrointest. Endosc. 92, 831\u2013839.e8 (2020).","journal-title":"Gastrointest. Endosc."},{"key":"544_CR72","doi-asserted-by":"crossref","unstructured":"Islam, M. M., Yang, H. C., Poly, T. N., Jian, W. S. & (Jack) Li, Y. C. Deep learning algorithms for detection of diabetic retinopathy in retinal fundus photographs: A systematic review and meta-analysis. Comput. Meth. Prog. Biomed. 191, 105320 (2020).","DOI":"10.1016\/j.cmpb.2020.105320"},{"key":"544_CR73","doi-asserted-by":"crossref","first-page":"1018","DOI":"10.3390\/jcm9041018","volume":"9","author":"MM Islam","year":"2020","unstructured":"Islam, M. M., Poly, T. N., Walther, B. A., Yang, H. C. & Li, Y.-C. (Jack). Artificial Intelligence in Ophthalmology: A Meta-Analysis of Deep Learning Models for Retinal Vessels Segmentation. J. Clin. Med. 9, 1018 (2020).","journal-title":"J. Clin. Med."},{"key":"544_CR74","doi-asserted-by":"crossref","first-page":"149","DOI":"10.18240\/ijo.2020.01.22","volume":"13","author":"P Murtagh","year":"2020","unstructured":"Murtagh, P., Greene, G. & O\u2019Brien, C. Current applications of machine learning in the screening and diagnosis of glaucoma: A systematic review and Meta-analysis. Int. J. Ophthalmol. 13, 149\u2013162 (2020).","journal-title":"Int. J. Ophthalmol."},{"key":"544_CR75","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.oret.2018.10.014","volume":"3","author":"KB Nielsen","year":"2019","unstructured":"Nielsen, K. B., Lautrup, M. L., Andersen, J. K. H., Savarimuthu, T. R. & Grauslund, J. Deep Learning\u2013Based Algorithms in Screening of Diabetic Retinopathy: A Systematic Review of Diagnostic Performance. Ophthalmol. Retina 3, 294\u2013304 (2019).","journal-title":"Ophthalmol. Retina"},{"key":"544_CR76","doi-asserted-by":"crossref","first-page":"591","DOI":"10.1111\/j.1365-2133.2009.09093.x","volume":"161","author":"SM Rajpara","year":"2009","unstructured":"Rajpara, S. M., Botello, A. P., Townend, J. & Ormerod, A. D. Systematic review of dermoscopy and digital dermoscopy\/ artificial intelligence for the diagnosis of melanoma. Br. J. Dermatol. 161, 591\u2013604 (2009).","journal-title":"Br. J. Dermatol."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00544-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00544-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00544-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,25]],"date-time":"2022-11-25T08:22:38Z","timestamp":1669364558000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-021-00544-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,27]]},"references-count":76,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2022,12]]}},"alternative-id":["544"],"URL":"https:\/\/doi.org\/10.1038\/s41746-021-00544-y","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,1,27]]},"assertion":[{"value":"10 April 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 November 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 January 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"HA and AD: HA is Chief Scientific Officer, Preemptive Medicine and Health Security, Flagship Pioneering, AD is Executive Chairman of Preemptive Medicine and Health Security, Flagship Pioneering.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"11"}}