{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T21:08:21Z","timestamp":1783717701825,"version":"3.55.0"},"reference-count":31,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2024,10,24]],"date-time":"2024-10-24T00:00:00Z","timestamp":1729728000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>Background: Patients with skin lesions suspicious for skin cancer or atypical melanocytic nevi of uncertain malignant potential often present to dermatologists, who may have variable dermoscopy triage clinical experience. Objective: To evaluate the clinical utility of a digital dermoscopy image-based artificial intelligence algorithm (DDI-AI device) on the diagnosis and management of skin cancers by dermatologists. Methods: Thirty-six United States board-certified dermatologists evaluated 50 clinical images and 50 digital dermoscopy images of the same skin lesions (25 malignant and 25 benign), first without and then with knowledge of the DDI-AI device output. Participants indicated whether they thought the lesion was likely benign (unremarkable) or malignant (suspicious). Results: The management sensitivity of dermatologists using the DDI-AI device was 91.1%, compared to 84.3% with DDI, and 70.0% with clinical images. The management specificity was 71.0%, compared to 68.4% and 64.9%, respectively. The diagnostic sensitivity of dermatologists using the DDI-AI device was 86.1%, compared to 78.8% with DDI, and 63.4% with clinical images. Diagnostic specificity using the DDI-AI device increased to 80.7%, compared to 75.9% and 73.6%, respectively. Conclusion: The use of the DDI-AI device may quickly, safely, and effectively improve dermoscopy performance, skin cancer diagnosis, and management when used by dermatologists, independent of training and experience.<\/jats:p>","DOI":"10.3390\/cancers16213592","type":"journal-article","created":{"date-parts":[[2024,10,25]],"date-time":"2024-10-25T03:46:04Z","timestamp":1729827964000},"page":"3592","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Clinical Utility of a Digital Dermoscopy Image-Based Artificial Intelligence Device in the Diagnosis and Management of Skin Cancer by Dermatologists"],"prefix":"10.3390","volume":"16","author":[{"given":"Alexander M.","family":"Witkowski","sequence":"first","affiliation":[{"name":"Department of Dermatology, Oregon Health and Science University, Portland, OR 97239, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joshua","family":"Burshtein","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University of Illinois-Chicago, Chicago, IL 60637, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Christopher","sequence":"additional","affiliation":[{"name":"Ironwood Dermatology, Tucson, AZ 85737, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clay","family":"Cockerell","sequence":"additional","affiliation":[{"name":"Cockerell Dermatopathology, Dallas, TX 75230, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6289-0465","authenticated-orcid":false,"given":"Lilia","family":"Correa","sequence":"additional","affiliation":[{"name":"Department of Dermatology & Cutaneous Oncology, University of South Florida, Tampa, FL 33612, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Cotter","sequence":"additional","affiliation":[{"name":"Las Vegas Dermatology, Las Vegas, NV 89144, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Darrell L.","family":"Ellis","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Nashville VA Medical Centers and Vanderbilt University, Nashville, TN 37232, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aaron S.","family":"Farberg","sequence":"additional","affiliation":[{"name":"Bare Dermatology, Dallas, TX 75235, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jane M.","family":"Grant-Kels","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University of Connecticut School of Medicine, Farmington, CT 06030, USA"},{"name":"Department of Dermatology, University of Florida College of Medicine, Gainesville, FL 32606, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0028-8986","authenticated-orcid":false,"given":"Teri M.","family":"Greiling","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Oregon Health and Science University, Portland, OR 97239, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9185-0056","authenticated-orcid":false,"given":"James M.","family":"Grichnik","sequence":"additional","affiliation":[{"name":"Department of Dermatology & Cutaneous Oncology, University of South Florida, Tampa, FL 33612, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9140-0648","authenticated-orcid":false,"given":"Sancy A.","family":"Leachman","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Oregon Health and Science University, Portland, OR 97239, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anthony","family":"Linfante","sequence":"additional","affiliation":[{"name":"Department of Dermatology and Dermatopathology, University of Texas Medical Branch, Galveston, TX 77555, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ashfaq","family":"Marghoob","sequence":"additional","affiliation":[{"name":"Dermatology Service, Memorial Sloan Kettering Skin Cancer Center, Hauppauge, NY 11788, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Etan","family":"Marks","sequence":"additional","affiliation":[{"name":"Skin Pathology Associates, Delray Beach, FL 33446, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Khoa","family":"Nguyen","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Oregon Health and Science University, Portland, OR 97239, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex G.","family":"Ortega-Loayza","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Oregon Health and Science University, Portland, OR 97239, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6612-9267","authenticated-orcid":false,"given":"Gyorgy","family":"Paragh","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Roswell Park Comprehensive Cancer Center, Buffalo, NY 14263, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Giovanni","family":"Pellacani","sequence":"additional","affiliation":[{"name":"Department of Dermatology, La Sapienza University, Rome 00161, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harold","family":"Rabinovitz","sequence":"additional","affiliation":[{"name":"Skin and Cancer Associates, Plantation, FL 33324, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Darrell","family":"Rigel","sequence":"additional","affiliation":[{"name":"Department of Dermatology, NYU Grossman School of Medicine, New York, NY 10016, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3918-9483","authenticated-orcid":false,"given":"Daniel M.","family":"Siegel","sequence":"additional","affiliation":[{"name":"Department of Dermatology, SUNY Downstate Health Sciences University, Brooklyn, NY 11203, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9735-0100","authenticated-orcid":false,"given":"Eingun James","family":"Song","sequence":"additional","affiliation":[{"name":"Frontier Dermatology, Salem, OR 97302, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Swanson","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Mayo Clinic Arizona, Scottsdale, AZ 85259, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Trask","sequence":"additional","affiliation":[{"name":"Skin Cancer & Dermatology Center of Southern Oregon, Medford, OR 97504, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3089-8109","authenticated-orcid":false,"given":"Joanna","family":"Ludzik","sequence":"additional","affiliation":[{"name":"Department of Dermatology, Oregon Health and Science University, Portland, OR 97239, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,10,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"7","DOI":"10.3322\/caac.21654","article-title":"Cancer statistics, 2021","volume":"71","author":"Siegel","year":"2021","journal-title":"CA Cancer J. Clin."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1016\/j.cps.2021.05.001","article-title":"Melanoma Risk Factors and Prevention","volume":"48","author":"Dzwierzynski","year":"2021","journal-title":"Clin. Plast. Surg."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3622","DOI":"10.1200\/JCO.2001.19.16.3622","article-title":"Prognostic Factors Analysis of 17,600 Melanoma Patients: Validation of the American Joint Committee on Cancer Melanoma Staging System","volume":"19","author":"Balch","year":"2001","journal-title":"J. Clin. Oncol."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1001\/archderm.143.4.488","article-title":"Melanoma outcomes for Medicare patients: Association of stage and survival with detection by a dermatologist vs. a nondermatologist","volume":"143","author":"Pennie","year":"2007","journal-title":"Arch. Dermatol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"301","DOI":"10.3322\/caac.20074","article-title":"The evolution of melanoma diagnosis: 25 years beyond the ABCDs","volume":"60","author":"Rigel","year":"2010","journal-title":"CA Cancer J. Clin."},{"key":"ref_6","unstructured":"(2024, September 01). WHAT TO LOOK FOR: ABCDES OF MELANOMA. Available online: https:\/\/www.aad.org\/public\/diseases\/skin-cancer\/find\/at-risk\/abcdes."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1159\/000075042","article-title":"Three-point checklist of dermoscopy. A new screening method for early detection of melanoma","volume":"208","author":"Soyer","year":"2004","journal-title":"Dermatology"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1111\/j.1365-2133.2005.06983.x","article-title":"Three-point checklist of dermoscopy: An open internet study","volume":"154","author":"Zalaudek","year":"2006","journal-title":"Br. J. Dermatol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"380","DOI":"10.7556\/jaoa.2019.067","article-title":"Dermoscopy: A Review of the Structures That Facilitate Melanoma Detection","volume":"119","author":"Marghoob","year":"2019","journal-title":"J. Osteopath. Med."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"478","DOI":"10.1097\/CMR.0000000000000478","article-title":"Real-world performance and utility of a noninvasive gene expression assay to evaluate melanoma risk in pigmented lesions","volume":"28","author":"Ferris","year":"2018","journal-title":"Melanoma Res."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"e13323","DOI":"10.1111\/srt.13323","article-title":"Dermoscopic features associated with 3-GEP PLA: LINC00518, PRAME, and TERT expression in suspicious pigmented lesions","volume":"29","author":"Ludzik","year":"2023","journal-title":"Skin. Res. Technol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"s384","DOI":"10.25251\/skin.8.supp.384","article-title":"Non-invasive Gene Expression Analysis Rules Out Melanoma with High Negative Predictive Value Regardless of Skin Phototype","volume":"8","author":"Skelsey","year":"2024","journal-title":"SKIN J. Cutan. Med."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1001\/jamadermatol.2022.1570","article-title":"Effect of Reflectance Confocal Microscopy for Suspect Lesions on Diagnostic Accuracy in Melanoma: A Randomized Clinical Trial","volume":"158","author":"Pellacani","year":"2022","journal-title":"JAMA Dermatol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1007\/s10103-018-2696-1","article-title":"Optical coherence tomography imaging of melanoma skin cancer","volume":"34","author":"Bittar","year":"2019","journal-title":"Lasers Med. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Schuh, S., Ruini, C., Perwein, M.K.E., Daxenberger, F., Gust, C., Sattler, E.C., and Welzel, J. (2022). Line-Field Confocal Optical Coherence Tomography: A New Tool for the Differentiation between Nevi and Melanomas?. Cancers, 14.","DOI":"10.3390\/cancers14051140"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.1111\/bjd.13121","article-title":"Clinical performance of the Nevisense system in cutaneous melanoma detection: An international, multicentre, prospective and blinded clinical trial on efficacy and safety","volume":"171","author":"Malvehy","year":"2014","journal-title":"Br. J. Dermatol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"210","DOI":"10.25251\/skin.6.3.5","article-title":"Diagnostic Efficacy of Electrical Impedance Spectroscopy Versus Dermoscopy for Pigmented Skin Lesions: A Pilot Study","volume":"6","author":"Owji","year":"2022","journal-title":"SKIN J. Cutan. Med."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"21501319231205979","DOI":"10.1177\/21501319231205979","article-title":"Clinical Utility of an AI-powered, Handheld Elastic Scattering Spectroscopy Device on the Diagnosis and Management of Skin Cancer by Primary Care Physicians","volume":"14","author":"Jaklitsch","year":"2023","journal-title":"J. Prim. Care Community Health"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1001\/archdermatol.2010.302","article-title":"The Performance of MelaFind: A Prospective Multicenter Study","volume":"147","author":"Monheit","year":"2011","journal-title":"Arch. Dermatol."},{"key":"ref_20","first-page":"414","article-title":"Diagnostic performance of the MelaFind device in a real-life clinical setting","volume":"15","author":"Fink","year":"2017","journal-title":"JDDG J. Dtsch. Dermatol. Ges."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"877","DOI":"10.1111\/srt.13205","article-title":"Augmenting pigmented lesion assay results with the three-point dermoscopy checklist to improve pigmented lesion triage","volume":"28","author":"Ludzik","year":"2022","journal-title":"Skin. Res. Technol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"e2023244","DOI":"10.5826\/dpc.1303a244","article-title":"Delphi Consensus Among International Experts on the Diagnosis, Management, and Surveillance for Lentigo Maligna","volume":"13","author":"Longo","year":"2023","journal-title":"Dermatol. Pract. Concept."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"25","DOI":"10.3122\/jabfm.2022.220143R1","article-title":"Expert Consensus Statement on Proficiency Standards for Dermoscopy Education in Primary Care","volume":"36","author":"Tran","year":"2023","journal-title":"J. Am. Board Fam. Med."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"e2022182","DOI":"10.5826\/dpc.1204a182","article-title":"Indications for Digital Monitoring of Patients with Multiple Nevi: Recommendations from the International Dermoscopy Society","volume":"12","author":"Russo","year":"2022","journal-title":"Dermatol. Pract. Concept."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1001\/jamadermatol.2016.5500","article-title":"Ugly Duckling Sign as a Major Factor of Efficiency in Melanoma Detection","volume":"153","author":"Wazaefi","year":"2017","journal-title":"JAMA Dermatol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1080\/01621459.1927.10502953","article-title":"Probable Inference, the Law of Succession, and Statistical Inference","volume":"22","author":"Wilson","year":"1927","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Saha, K.K., Miller, D., and Wang, S. (2015). A comparison of some approximate confidence intervals for a single proportion for clustered binary outcome data. Int. J. Biostat., 12.","DOI":"10.1515\/ijb-2015-0024"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"276","DOI":"10.11613\/BM.2012.031","article-title":"Interrater reliability: The kappa statistic","volume":"22","author":"McHugh","year":"2012","journal-title":"Biochem. Med."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"424","DOI":"10.25251\/skin.4.5.5","article-title":"Integrating Electrical Impedance Spectroscopy into Clinical Decisions for Pigmented Skin Lesions Improves Diagnostic Accuracy: A Multitiered Study","volume":"4","author":"Litchman","year":"2020","journal-title":"SKIN J. Cutan. Med."},{"key":"ref_30","unstructured":"(2024, March 26). FDA Clearance Granted for First AI-Powered Medical Device to Detect All Three Common Skin Cancers (Melanoma, Basal Cell Carcinoma and Squamous Cell Carcinoma). Available online: https:\/\/www.dermasensor.com\/fda-clearance-granted-for-first-ai-powered-medical-device-to-detect-all-three-common-skin-cancers-melanoma-basal-cell-carcinoma-and-squamous-cell-carcinoma\/."},{"key":"ref_31","unstructured":"(2024, September 01). Device Classification Under Section 513(f)(2)(De Novo), Available online: https:\/\/www.accessdata.fda.gov\/scripts\/cdrh\/cfdocs\/cfpmn\/denovo.cfm?id=DEN230008."}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/16\/21\/3592\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:19:58Z","timestamp":1760113198000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/16\/21\/3592"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,10,24]]},"references-count":31,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2024,11]]}},"alternative-id":["cancers16213592"],"URL":"https:\/\/doi.org\/10.3390\/cancers16213592","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,10,24]]}}}