{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T20:48:29Z","timestamp":1793134109460,"version":"4.5.0"},"reference-count":45,"publisher":"MDPI AG","issue":"15","license":[{"start":{"date-parts":[[2022,8,7]],"date-time":"2022-08-07T00:00:00Z","timestamp":1659830400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Department of Dermatology"},{"name":"Research Foundation for Young Researchers Grant of the University of Basel, Switzerland"},{"name":"Voluntary Academic Society Grant, Basel, Switzerland"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Cancers"],"abstract":"<jats:p>The exponential increase in algorithm-based mobile health (mHealth) applications (apps) for melanoma screening is a reaction to a growing market. However, the performance of available apps remains to be investigated. In this prospective study, we investigated the diagnostic accuracy of a class 1 CE-certified smartphone app in melanoma risk stratification and its patient and dermatologist satisfaction. Pigmented skin lesions \u2265 3 mm and any suspicious smaller lesions were assessed by the smartphone app SkinVision\u00ae (SkinVision\u00ae B.V., Amsterdam, the Netherlands, App-Version 6.8.1), 2D FotoFinder ATBM\u00ae master (FotoFinder ATBM\u00ae Systems GmbH, Bad Birnbach, Germany, Version 3.3.1.0), 3D Vectra\u00ae WB360 (Canfield Scientific, Parsippany, NJ, USA, Version 4.7.1) total body photography (TBP) devices, and dermatologists. The high-risk score of the smartphone app was compared with the two gold standards: histological diagnosis, or if not available, the combination of dermatologists\u2019, 2D and 3D risk assessments. A total of 1204 lesions among 114 patients (mean age 59 years; 51% females (55 patients at high-risk for developing a melanoma, 59 melanoma patients)) were included. The smartphone app\u2019s sensitivity, specificity, and area under the receiver operating characteristics (AUROC) varied between 41.3\u201383.3%, 60.0\u201382.9%, and 0.62\u20130.72% according to two study-defined reference standards. Additionally, all patients and dermatologists completed a newly created questionnaire for preference and trust of screening type. The smartphone app was rated as trustworthy by 36% (20\/55) of patients at high-risk for melanoma, 49% (29\/59) of melanoma patients, and 8.8% (10\/114) of dermatologists. Most of the patients rated the 2D TBP imaging (93% (51\/55) resp. 88% (52\/59)) and the 3D TBP imaging (91% (50\/55) resp. 90% (53\/59)) as trustworthy. A skin cancer screening by combination of dermatologist and smartphone app was favored by only 1.8% (1\/55) resp. 3.4% (2\/59) of the patients; no patient preferred an assessment by a smartphone app alone. The diagnostic accuracy in clinical practice was not as reliable as previously advertised and the satisfaction with smartphone apps for melanoma risk stratification was scarce. MHealth apps might be a potential medium to increase awareness for melanoma screening in the lay population, but healthcare professionals and users should be alerted to the potential harm of over-detection and poor performance. In conclusion, we suggest further robust evidence-based evaluation before including market-approved apps in self-examination for public health benefits.<\/jats:p>","DOI":"10.3390\/cancers14153829","type":"journal-article","created":{"date-parts":[[2022,8,7]],"date-time":"2022-08-07T21:03:50Z","timestamp":1659906230000},"page":"3829","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":61,"title":["Over-Detection of Melanoma-Suspect Lesions by a CE-Certified Smartphone App: Performance in Comparison to Dermatologists, 2D and 3D Convolutional Neural Networks in a Prospective Data Set of 1204 Pigmented Skin Lesions Involving Patients\u2019 Perception"],"prefix":"10.3390","volume":"14","author":[{"given":"Anna Sophie","family":"Jahn","sequence":"first","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alexander Andreas","family":"Navarini","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sara Elisa","family":"Cerminara","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lisa","family":"Kostner","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Stephanie Marie","family":"Huber","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Kunz","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9914-1545","authenticated-orcid":false,"given":"Julia-Tatjana","family":"Maul","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Zurich, 8091 Zurich, Switzerland"},{"name":"Faculty of Medicine, University of Zurich, 8006 Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2279-6906","authenticated-orcid":false,"given":"Reinhard","family":"Dummer","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Zurich, 8091 Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Seraina","family":"Sommer","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anja Dominique","family":"Neuner","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5902-9420","authenticated-orcid":false,"given":"Mitchell Paul","family":"Levesque","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Zurich, 8091 Zurich, Switzerland"},{"name":"Faculty of Medicine, University of Zurich, 8006 Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2940-006X","authenticated-orcid":false,"given":"Phil Fang","family":"Cheng","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Zurich, 8091 Zurich, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9202-0073","authenticated-orcid":false,"given":"Lara Valeska","family":"Maul","sequence":"additional","affiliation":[{"name":"Department of Dermatology, University Hospital of Basel, 4031 Basel, Switzerland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,8,7]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Chac\u00f3n, M., Pfluger, Y., Angel, M., Waisberg, F., and Enrico, D. (2020). Uncommon Subtypes of Malignant Melanomas: A Review Based on Clinical and Molecular Perspectives. Cancers, 12.","DOI":"10.3390\/cancers12092362"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/978-3-030-46227-7_6","article-title":"Epidemiology of Skin Cancer: Update 2019","volume":"1268","author":"Leiter","year":"2020","journal-title":"Adv. Exp. Med. Biol."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1535","DOI":"10.1056\/NEJMoa1910836","article-title":"Five-Year Survival with Combined Nivolumab and Ipilimumab in Advanced Melanoma","volume":"381","author":"Larkin","year":"2019","journal-title":"N. Engl. J. Med."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1093\/annonc\/mdz011","article-title":"Five-year survival outcomes for patients with advanced melanoma treated with pembrolizumab in KEYNOTE-001","volume":"30","author":"Hamid","year":"2019","journal-title":"Ann. Oncol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1056\/NEJMoa1904059","article-title":"Five-Year Outcomes with Dabrafenib plus Trametinib in Metastatic Melanoma","volume":"381","author":"Robert","year":"2019","journal-title":"N. Engl. J. Med."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1615\/CritRevEukaryotGeneExpr.2020028454","article-title":"Malignant Melanoma: Skin Cancer-Diagnosis, Prevention, and Treatment","volume":"30","author":"Ahmed","year":"2020","journal-title":"Crit. Rev. Eukaryot. Gene Expr."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/j.jaad.2018.08.055","article-title":"Guidelines of care for the management of primary cutaneous melanoma","volume":"80","author":"Swetter","year":"2019","journal-title":"J. Am. Acad Dermatol."},{"key":"ref_8","unstructured":"Anderson, M. (2021, July 21). Technology Device Ownership: 2015. Available online: https:\/\/www.pewresearch.org\/internet\/2015\/10\/29\/technology-device-ownership-2015\/."},{"key":"ref_9","unstructured":"Pew Research Center (2021, July 30). Mobile Fact Sheet. Available online: https:\/\/www.pewresearch.org\/internet\/fact-sheet\/mobile\/."},{"key":"ref_10","first-page":"7611686","article-title":"Research on the Impact of mHealth Apps on the Primary Healthcare Professionals in Patient Care","volume":"2021","year":"2021","journal-title":"Appl. Bionics Biomech."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1","DOI":"10.5070\/D3242038180","article-title":"Growth of mobile applications in dermatology\u20142017 update","volume":"24","author":"Flaten","year":"2018","journal-title":"Dermatol. Online J."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.ijmedinf.2018.08.004","article-title":"Fighting Melanoma with Smartphones: A Snapshot of Where We are a Decade after App Stores Opened Their Doors","volume":"118","author":"Ngoo","year":"2018","journal-title":"Int. J. Med. Inform."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ouellette, S., and Rao, B.K. (2022). Usefulness of Smartphones in Dermatology: A US-Based Review. Int. J. Environ. Res. Public Health, 19.","DOI":"10.3390\/ijerph19063553"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1507","DOI":"10.1111\/bjd.13665","article-title":"Smartphone applications for melanoma detection by community, patient and generalist clinician users: A review","volume":"172","author":"Kassianos","year":"2015","journal-title":"Br. J. Dermatol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"m127","DOI":"10.1136\/bmj.m127","article-title":"Algorithm based smartphone apps to assess risk of skin cancer in adults: Systematic review of diagnostic accuracy studies","volume":"368","author":"Freeman","year":"2020","journal-title":"BMJ"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"5767360","DOI":"10.1155\/2018\/5767360","article-title":"eSkin: Study on the Smartphone Application for Early Detection of Malignant Melanoma","volume":"2018","author":"Kleczek","year":"2018","journal-title":"Wirel. Commun. Mob. Comput."},{"key":"ref_17","unstructured":"Kent, C. (2022, May 28). New Analysis Raises Concerns over Accuracy of Skin Cancer Risk Apps. Available online: https:\/\/www.medicaldevice-network.com\/news\/skin-cancer-apps\/."},{"key":"ref_18","first-page":"e13376","article-title":"Development of smartphone apps for skin cancer risk assessment: Progress and promise","volume":"21","author":"Noels","year":"2019","journal-title":"JMIR Dermatol."},{"key":"ref_19","unstructured":"(2021, July 25). SkinVision. Available online: https:\/\/www.skinvision.com\/."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1111\/jdv.15935","article-title":"Accuracy of a smartphone application for triage of skin lesions based on machine learning algorithms","volume":"34","author":"Udrea","year":"2020","journal-title":"J. Eur. Acad Dermatol. Venereol."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"e582","DOI":"10.1111\/jdv.16382","article-title":"Sensitivity and specificity of SkinVision are likely to have been overestimated","volume":"34","author":"Deeks","year":"2020","journal-title":"J. Eur. Acad Dermatol. Venereol."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1749","DOI":"10.1038\/s41416-021-01302-3","article-title":"AI-based smartphone apps for risk assessment of skin cancer need more evaluation and better regulation","volume":"124","author":"Matin","year":"2021","journal-title":"Br. J. Cancer"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1089\/tmj.2016.0259","article-title":"mHealth App for Risk Assessment of Pigmented and Nonpigmented Skin Lesions-A Study on Sensitivity and Specificity in Detecting Malignancy","volume":"23","author":"Thissen","year":"2017","journal-title":"Telemed. e-Health"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"274","DOI":"10.1111\/jdv.15873","article-title":"Poor agreement between the automated risk assessment of a smartphone application for skin cancer detection and the rating by dermatologists","volume":"34","author":"Chung","year":"2020","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"583","DOI":"10.1111\/bjd.15443","article-title":"Conflicting results between the analysis of skin lesions using a mobile-phone application and a dermatologist\u2019s clinical diagnosis: A pilot study","volume":"177","author":"Nabil","year":"2017","journal-title":"Br. J. Dermatol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"961","DOI":"10.1111\/bjd.20441","article-title":"Views on mobile health apps for skin cancer screening in the general population: An in-depth qualitative exploration of perceived barriers and facilitators","volume":"185","author":"Sangers","year":"2021","journal-title":"Br. J. Dermatol."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"691","DOI":"10.1007\/s00105-020-04658-4","article-title":"Artificial intelligence and smartphone program applications (Apps): Relevance for dermatological practice","volume":"71","author":"Blum","year":"2020","journal-title":"Hautarzt"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"551","DOI":"10.1016\/j.det.2017.06.014","article-title":"Smartphone-Based Applications for Skin Monitoring and Melanoma Detection","volume":"35","author":"Chao","year":"2017","journal-title":"Dermatol. Clin."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1136\/medethics-2017-104741","article-title":"A mobile revolution for healthcare? Setting the agenda for bioethics","volume":"44","author":"Lucivero","year":"2018","journal-title":"J. Med. Ethics"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1001\/jamadermatol.2019.5014","article-title":"Patient Perspectives on the Use of Artificial Intelligence for Skin Cancer Screening: A Qualitative Study","volume":"156","author":"Nelson","year":"2020","journal-title":"JAMA Dermatol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"233","DOI":"10.3389\/fmed.2020.00233","article-title":"Artificial Intelligence in Skin Cancer Diagnostics: The Patients\u2019 Perspective","volume":"7","author":"Jutzi","year":"2020","journal-title":"Front. Med."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1158","DOI":"10.1016\/j.jaad.2019.12.063","article-title":"Meta-analysis of number needed to treat for diagnosis of melanoma by clinical setting","volume":"82","author":"Petty","year":"2020","journal-title":"J. Am. Acad. Dermatol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e175","DOI":"10.1111\/ajd.12599","article-title":"Efficacy of smartphone applications in high-risk pigmented lesions","volume":"59","author":"Ngoo","year":"2018","journal-title":"Australas. J. Dermatol."},{"key":"ref_34","first-page":"Cd013192","article-title":"Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma","volume":"12","author":"Chuchu","year":"2018","journal-title":"Cochrane Database Syst. Rev."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"744","DOI":"10.1111\/bjd.20903","article-title":"Accuracy of commercially available smartphone applications for the detection of melanoma","volume":"186","author":"Sun","year":"2021","journal-title":"Br. J. Dermatol."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1111\/jdv.12648","article-title":"Accuracy of a smartphone application using fractal image analysis of pigmented moles compared to clinical diagnosis and histological result","volume":"29","author":"Maier","year":"2015","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"649","DOI":"10.1159\/000520474","article-title":"Validation of a Market-Approved Artificial Intelligence Mobile Health App for Skin Cancer Screening: A Prospective Multicenter Diagnostic Accuracy Study","volume":"238","author":"Sangers","year":"2022","journal-title":"Dermatology"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"e1913436","DOI":"10.1001\/jamanetworkopen.2019.13436","article-title":"Assessment of Accuracy of an Artificial Intelligence Algorithm to Detect Melanoma in Images of Skin Lesions","volume":"2","author":"Phillips","year":"2019","journal-title":"JAMA Netw. Open"},{"key":"ref_39","unstructured":"European Commission (2022, May 30). Medical Devices: Guidance Document. Available online: https:\/\/ec.europa.eu\/docsroom\/documents\/10337\/attachments\/1\/translations\/en\/renditions\/pdf."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"e81","DOI":"10.2196\/mhealth.7689","article-title":"Mobile Health in Oncology: A Patient Survey About App-Assisted Cancer Care","volume":"5","author":"Kessel","year":"2017","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"e13844","DOI":"10.2196\/13844","article-title":"Patient Attitudes and Their Awareness towards Skin Cancer-Related Apps: Cross-Sectional Survey","volume":"7","author":"Steeb","year":"2019","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1836","DOI":"10.1093\/annonc\/mdy166","article-title":"Man against machine: Diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists","volume":"29","author":"Haenssle","year":"2018","journal-title":"Ann. Oncol."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1111\/bjd.18875","article-title":"Attitudes towards artificial intelligence within dermatology: An international online survey","volume":"183","author":"Polesie","year":"2020","journal-title":"Br. J. Dermatol."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"e22909","DOI":"10.2196\/22909","article-title":"Digital Natives\u2019 Preferences on Mobile Artificial Intelligence Apps for Skin Cancer Diagnostics: Survey Study","volume":"9","author":"Jutzi","year":"2021","journal-title":"JMIR Mhealth Uhealth"},{"key":"ref_45","first-page":"2055207619828225","article-title":"Evaluating healthcare practitioners\u2019 views on store-and-forward teledermoscopy services for the diagnosis of skin cancer","volume":"5","author":"Janda","year":"2019","journal-title":"Digit. Health"}],"container-title":["Cancers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2072-6694\/14\/15\/3829\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:05:23Z","timestamp":1760141123000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2072-6694\/14\/15\/3829"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,8,7]]},"references-count":45,"journal-issue":{"issue":"15","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["cancers14153829"],"URL":"https:\/\/doi.org\/10.3390\/cancers14153829","relation":{},"ISSN":["2072-6694"],"issn-type":[{"value":"2072-6694","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,8,7]]}}}