{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,17]],"date-time":"2026-04-17T16:30:59Z","timestamp":1776443459452,"version":"3.51.2"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T00:00:00Z","timestamp":1695772800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000272","name":"DH | National Institute for Health Research","doi-asserted-by":"publisher","award":["NIHR302258"],"award-info":[{"award-number":["NIHR302258"]}],"id":[{"id":"10.13039\/501100000272","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100013126","name":"Psoriasis Association","doi-asserted-by":"publisher","award":["PhD Studentship"],"award-info":[{"award-number":["PhD Studentship"]}],"id":[{"id":"10.13039\/100013126","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000265","name":"RCUK | Medical Research Council","doi-asserted-by":"publisher","award":["[MR\/R001839\/1]"],"award-info":[{"award-number":["[MR\/R001839\/1]"]}],"id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Skin diseases affect one-third of the global population, posing a major healthcare burden. Deep learning may optimise healthcare workflows through processing skin images via neural networks to make predictions. A focus of deep learning research is skin lesion triage to detect cancer, but this may not translate to the wider scope of &gt;2000 other skin diseases. We searched for studies applying deep learning to skin images, excluding benign\/malignant lesions (1\/1\/2000-23\/6\/2022, PROSPERO CRD42022309935). The primary outcome was accuracy of deep learning algorithms in disease diagnosis or severity assessment. We modified QUADAS-2 for quality assessment. Of 13,857 references identified, 64 were included. The most studied diseases were acne, psoriasis, eczema, rosacea, vitiligo, urticaria. Deep learning algorithms had high specificity and variable sensitivity in diagnosing these conditions. Accuracy of algorithms in diagnosing acne (median 94%, IQR 86\u201398; <jats:italic>n<\/jats:italic>\u2009=\u200911), rosacea (94%, 90\u201397; <jats:italic>n<\/jats:italic>\u2009=\u20094), eczema (93%, 90\u201399; <jats:italic>n<\/jats:italic>\u2009=\u20099) and psoriasis (89%, 78\u201392; <jats:italic>n<\/jats:italic>\u2009=\u20098) was high. Accuracy for grading severity was highest for psoriasis (range 93\u2013100%, <jats:italic>n<\/jats:italic>\u2009=\u20092), eczema (88%, <jats:italic>n<\/jats:italic>\u2009=\u20091), and acne (67\u201386%, <jats:italic>n<\/jats:italic>\u2009=\u20094). However, 59 (92%) studies had high risk-of-bias judgements and 62 (97%) had high-level applicability concerns. Only 12 (19%) reported participant ethnicity\/skin type. Twenty-four (37.5%) evaluated the algorithm in an independent dataset, clinical setting or prospectively. These data indicate potential of deep learning image analysis in diagnosing and monitoring common skin diseases. Current research has important methodological\/reporting limitations. Real-world, prospectively-acquired image datasets with external validation\/testing will advance deep learning beyond the current experimental phase towards clinically-useful tools to mitigate rising health and cost impacts of skin disease.<\/jats:p>","DOI":"10.1038\/s41746-023-00914-8","type":"journal-article","created":{"date-parts":[[2023,9,27]],"date-time":"2023-09-27T05:01:40Z","timestamp":1695790900000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":76,"title":["Systematic review of deep learning image analyses for the diagnosis and monitoring of skin disease"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5891-6511","authenticated-orcid":false,"given":"Shern Ping","family":"Choy","sequence":"first","affiliation":[]},{"given":"Byung Jin","family":"Kim","sequence":"additional","affiliation":[]},{"given":"Alexandra","family":"Paolino","sequence":"additional","affiliation":[]},{"given":"Wei Ren","family":"Tan","sequence":"additional","affiliation":[]},{"given":"Sarah Man Lin","family":"Lim","sequence":"additional","affiliation":[]},{"given":"Jessica","family":"Seo","sequence":"additional","affiliation":[]},{"given":"Sze Ping","family":"Tan","sequence":"additional","affiliation":[]},{"given":"Luc","family":"Francis","sequence":"additional","affiliation":[]},{"given":"Teresa","family":"Tsakok","sequence":"additional","affiliation":[]},{"given":"Michael","family":"Simpson","sequence":"additional","affiliation":[]},{"given":"Jonathan N. W. N.","family":"Barker","sequence":"additional","affiliation":[]},{"given":"Magnus D.","family":"Lynch","sequence":"additional","affiliation":[]},{"given":"Mark S.","family":"Corbett","sequence":"additional","affiliation":[]},{"given":"Catherine H.","family":"Smith","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4692-3794","authenticated-orcid":false,"given":"Satveer K.","family":"Mahil","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,9,27]]},"reference":[{"key":"914_CR1","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","volume":"25","author":"A Esteva","year":"2019","unstructured":"Esteva, A. et al. A guide to deep learning in healthcare. Nat. Med. 25, 24\u201329 (2019).","journal-title":"Nat. Med"},{"key":"914_CR2","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1111\/bjd.18880","volume":"183","author":"X Du-Harpur","year":"2020","unstructured":"Du-Harpur, X., Watt, F. M., Luscombe, N. M. & Lynch, M. D. What is AI? Applications of artificial intelligence to dermatology. Br. J. Dermatol. 183, 423\u201330. (2020).","journal-title":"Br. J. Dermatol."},{"key":"914_CR3","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/nature14539","volume":"521","author":"Y LeCun","year":"2015","unstructured":"LeCun, Y., Bengio, Y. & Hinton, G. Deep learning. Nature 521, 436\u2013444 (2015).","journal-title":"Nature"},{"key":"914_CR4","unstructured":"Brownlee J. What is the Difference Between Test and Validation Datasets? https:\/\/machinelearningmastery.com\/difference-test-validation-datasets\/ (2023)."},{"key":"914_CR5","doi-asserted-by":"publisher","first-page":"m689","DOI":"10.1136\/bmj.m689","volume":"368","author":"M Nagendran","year":"2020","unstructured":"Nagendran, M. et al. Artificial intelligence versus clinicians: systematic review of design, reporting standards, and claims of deep learning studies. BMJ 368, m689 (2020).","journal-title":"BMJ"},{"key":"914_CR6","doi-asserted-by":"publisher","first-page":"1291","DOI":"10.1001\/jamadermatol.2019.1375","volume":"155","author":"V Dick","year":"2019","unstructured":"Dick, V., Sinz, C., Mittlb\u00f6ck, M., Kittler, H. & Tschandl, P. Accuracy of computer-aided diagnosis of melanoma: a meta-analysis. JAMA Dermatol. 155, 1291\u20131299 (2019).","journal-title":"JAMA Dermatol."},{"key":"914_CR7","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"914_CR8","doi-asserted-by":"publisher","first-page":"e466","DOI":"10.1016\/S2589-7500(22)00023-1","volume":"4","author":"OT Jones","year":"2022","unstructured":"Jones, O. T. et al. Artificial intelligence and machine learning algorithms for early detection of skin cancer in community and primary care settings: a systematic review. Lancet Digit Health 4, e466\u2013e76 (2022).","journal-title":"Lancet Digit Health"},{"key":"914_CR9","doi-asserted-by":"crossref","unstructured":"Ujiie, H. et al. Unmet medical needs in chronic, non-communicable inflammatory skin diseases. Front. Med. 9, 875492 (2022).","DOI":"10.3389\/fmed.2022.875492"},{"key":"914_CR10","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1145\/3065386","volume":"60","author":"A Krizhevsky","year":"2017","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 84\u201390 (2017).","journal-title":"Commun. ACM"},{"key":"914_CR11","unstructured":"Moolayil J. J. A Layman\u2019s Guide to Deep Convolutional Neural Networks. https:\/\/towardsdatascience.com\/a-laymans-guide-to-deep-convolutional-neural-networks-7e937628605f (2023)."},{"key":"914_CR12","doi-asserted-by":"publisher","first-page":"1527","DOI":"10.1038\/jid.2013.446","volume":"134","author":"RJ Hay","year":"2014","unstructured":"Hay, R. J. et al. The global burden of skin disease in 2010: an analysis of the prevalence and impact of skin conditions. J. Invest Dermatol. 134, 1527\u201334 (2014).","journal-title":"J. Invest Dermatol."},{"key":"914_CR13","doi-asserted-by":"publisher","first-page":"100150","DOI":"10.1016\/j.xjidi.2022.100150","volume":"3","author":"HK Jeong","year":"2023","unstructured":"Jeong, H. K., Park, C., Henao, R. & Kheterpal, M. Deep learning in dermatology: a systematic review of current approaches, outcomes, and limitations. JID Innov. 3, 100150 (2023).","journal-title":"JID Innov."},{"key":"914_CR14","first-page":"Cd013186","volume":"12","author":"L Ferrante di Ruffano","year":"2018","unstructured":"Ferrante di Ruffano, L. et al. Computer-assisted diagnosis techniques (dermoscopy and spectroscopy-based) for diagnosing skin cancer in adults. Cochrane Database Syst. Rev. 12, Cd013186 (2018).","journal-title":"Cochrane Database Syst. Rev"},{"key":"914_CR15","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-021-00438-z","volume":"4","author":"R Aggarwal","year":"2021","unstructured":"Aggarwal, R. et al. Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis. npj Digit. Med. 4, 65 (2021).","journal-title":"npj Digit. Med."},{"key":"914_CR16","doi-asserted-by":"publisher","first-page":"12592","DOI":"10.1073\/pnas.1919012117","volume":"117","author":"AJ Larrazabal","year":"2020","unstructured":"Larrazabal, A. J., Nieto, N., Peterson, V., Milone, D. H. & Ferrante, E. Gender imbalance in medical imaging datasets produces biased classifiers for computer-aided diagnosis. Proc. Natl Acad. Sci. USA 117, 12592\u201312594 (2020).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"914_CR17","doi-asserted-by":"publisher","first-page":"e35","DOI":"10.1016\/S2589-7500(19)30004-4","volume":"1","author":"V Bellemo","year":"2019","unstructured":"Bellemo, V. et al. Artificial intelligence using deep learning to screen for referable and vision-threatening diabetic retinopathy in Africa: a clinical validation study. The Lancet Digital Health 1, e35\u2013e44 (2019).","journal-title":"The Lancet Digital Health"},{"key":"914_CR18","doi-asserted-by":"publisher","first-page":"e2253820","DOI":"10.1001\/jamanetworkopen.2022.53820","volume":"6","author":"H Kim","year":"2023","unstructured":"Kim, H. et al. Development and validation of a deep learning\u2013based synthetic bone-suppressed model for pulmonary nodule detection in chest radiographs. JAMA Network Open 6, e2253820 (2023).","journal-title":"JAMA Network Open"},{"key":"914_CR19","doi-asserted-by":"publisher","first-page":"e271","DOI":"10.1016\/S2589-7500(19)30123-2","volume":"1","author":"X Liu","year":"2019","unstructured":"Liu, X. et al. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: a systematic review and meta-analysis. Lancet Digit Health 1, e271\u2013e97 (2019).","journal-title":"Lancet Digit Health"},{"key":"914_CR20","doi-asserted-by":"crossref","unstructured":"Wen, D. & Khan, S. M. Xu A. J, et al. Characteristics of publicly available skin cancer image datasets: a systematic review. Lancet Digit. Health 4, e64\u2013e74 (2022).","DOI":"10.1016\/S2589-7500(21)00252-1"},{"key":"914_CR21","doi-asserted-by":"publisher","first-page":"292","DOI":"10.1093\/bjd\/ljac047","volume":"188","author":"ML Chen","year":"2022","unstructured":"Chen, M. L. et al. Evaluation of diagnosis diversity in artificial intelligence datasets: a scoping review. Brit. J. Dermatol. 188, 292\u2013294 (2022).","journal-title":"Brit. J. Dermatol."},{"key":"914_CR22","doi-asserted-by":"publisher","first-page":"1362","DOI":"10.1001\/jamadermatol.2021.3129","volume":"157","author":"R Daneshjou","year":"2021","unstructured":"Daneshjou, R., Smith, M. P., Sun, M. D., Rotemberg, V. & Zou, J. Lack of transparency and potential bias in artificial intelligence data sets and algorithms: a scoping review. JAMA Dermatol.157, 1362\u20131369 (2021).","journal-title":"JAMA Dermatol."},{"key":"914_CR23","unstructured":"U.S. Food & Drug. Artificial Intelligence and Machine Learning (AI\/ML)-Enabled Medical Devices. https:\/\/www.fda.gov\/medical-devices\/software-medical-device-samd\/artificial-intelligence-and-machine-learning-aiml-enabled-medical-devices (2022)."},{"key":"914_CR24","doi-asserted-by":"publisher","first-page":"e048008","DOI":"10.1136\/bmjopen-2020-048008","volume":"11","author":"GS Collins","year":"2021","unstructured":"Collins, G. S. et al. Protocol for development of a reporting guideline (TRIPOD-AI) and risk of bias tool (PROBAST-AI) for diagnostic and prognostic prediction model studies based on artificial intelligence. BMJ Open 11, e048008 (2021).","journal-title":"BMJ Open"},{"key":"914_CR25","doi-asserted-by":"publisher","first-page":"1663","DOI":"10.1038\/s41591-021-01517-0","volume":"27","author":"V Sounderajah","year":"2021","unstructured":"Sounderajah, V. et al. A quality assessment tool for artificial intelligence-centered diagnostic test accuracy studies: QUADAS-AI. Nat Med 27, 1663\u20131665 (2021).","journal-title":"Nat Med"},{"key":"914_CR26","doi-asserted-by":"publisher","first-page":"90","DOI":"10.1001\/jamadermatol.2021.4915","volume":"158","author":"R Daneshjou","year":"2022","unstructured":"Daneshjou, R. et al. Checklist for evaluation of image-based artificial intelligence reports in dermatology: CLEAR derm consensus guidelines from the international skin imaging collaboration artificial intelligence working group. JAMA Dermatol. 158, 90\u201396 (2022).","journal-title":"JAMA Dermatol."},{"key":"914_CR27","unstructured":"Page M. J. H. J. & Sterne J. A. C. Chapter 13: Assessing risk of bias due to missing results in a synthesis. in Cochrane Handbook for Systematic Reviews of Interventions version 63 (updated February 2022) Ch. 13 (Cochrane, 2022)."},{"key":"914_CR28","unstructured":"NHS. Referral Optimisation for People with Skin Conditions. https:\/\/www.england.nhs.uk\/long-read\/referral-optimisation-for-people-with-skin-conditions\/ (2022)."},{"key":"914_CR29","unstructured":"TPW. Psoprotect: Psoriasis Registry for Outcomes, Therapy and Epidemiology of COVID-19 Infection. https:\/\/psoprotect.org\/ (2020)."},{"key":"914_CR30","unstructured":"Group ILoDS. International League of Dermatological Societies. https:\/\/www.ilds.org\/ (2023)."},{"key":"914_CR31","doi-asserted-by":"publisher","first-page":"1364","DOI":"10.1038\/s41591-020-1034-x","volume":"26","author":"X Liu","year":"2020","unstructured":"Liu, X. et al. Reporting guidelines for clinical trial reports for interventions involving artificial intelligence: the CONSORT-AI extension. Nat. Med. 26, 1364\u201374 (2020).","journal-title":"Nat. Med."},{"key":"914_CR32","unstructured":"NICE. Artificial Intelligence (AI) and Digital Regulations Service. https:\/\/www.nice.org.uk\/about\/what-we-do\/digital-health\/multi-agency-advisory-service-for-ai-and-data-driven-technologies (2023)."},{"key":"914_CR33","doi-asserted-by":"publisher","DOI":"10.1186\/2046-4053-4-1","volume":"4","author":"D Moher","year":"2015","unstructured":"Moher, D. et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst. Rev. 4, 1 (2015).","journal-title":"Syst. Rev."},{"key":"914_CR34","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6947-7-16","volume":"7","author":"C Schardt","year":"2007","unstructured":"Schardt, C., Adams, M. B., Owens, T., Keitz, S. & Fontelo, P. Utilization of the PICO framework to improve searching PubMed for clinical questions. BMC Med. Informatics and Decision Making 7, 16 (2007).","journal-title":"BMC Med. Informatics and Decision Making"},{"key":"914_CR35","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-016-0384-4","volume":"5","author":"M Ouzzani","year":"2016","unstructured":"Ouzzani, M., Hammady, H., Fedorowicz, Z. & Elmagarmid, A. Rayyan\u2014a web and mobile app for systematic reviews. Syst. Rev. 5, 210 (2016).","journal-title":"Syst. Rev."},{"key":"914_CR36","doi-asserted-by":"publisher","first-page":"51","DOI":"10.7326\/M18-1376","volume":"170","author":"RF Wolff","year":"2019","unstructured":"Wolff, R. F. et al. PROBAST: A tool to assess the risk of bias and applicability of prediction model studies. Ann. Intern. Med. 170, 51\u201358 (2019).","journal-title":"Ann. Intern. Med"},{"key":"914_CR37","doi-asserted-by":"publisher","first-page":"l6890","DOI":"10.1136\/bmj.l6890","volume":"368","author":"M Campbell","year":"2020","unstructured":"Campbell, M. et al. Synthesis without meta-analysis (SWiM) in systematic reviews: reporting guideline. BMJ 368, l6890 (2020).","journal-title":"BMJ"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00914-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00914-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00914-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,18]],"date-time":"2023-11-18T12:30:39Z","timestamp":1700310639000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00914-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,27]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["914"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00914-8","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,27]]},"assertion":[{"value":"7 May 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 August 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 September 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"J.N.W.N.B. has attended advisory boards and\/or spoken at sponsored symposia and\/or received research funding from: AbbVie, Almirall, Amgen, Boehringer-Ingelheim, Bristol Myers Squibb, Celgene, Janssen, Leo, Lilly, Novartis, Samsung, Sun Pharma. C.H.S. reports departmental research funding as investigator in EU-IMI consortia involving multiple industry partners (see biomap-imi.eu and hippocrates-imi.eu for details). S.K.M. reports departmental income from Abbvie, Almirall, Eli Lilly, Leo, Novartis, Sanofi, UCB, outside the submitted work. There were no conflicts of interest reported by the remaining authors.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"180"}}