{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,16]],"date-time":"2026-04-16T04:10:51Z","timestamp":1776312651055,"version":"3.50.1"},"reference-count":45,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,5,20]],"date-time":"2023-05-20T00:00:00Z","timestamp":1684540800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,5,20]],"date-time":"2023-05-20T00:00:00Z","timestamp":1684540800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Artificial intelligence (AI) based algorithms for classification of suspicious skin lesions have been implemented in mobile phone apps (mHealth), but their effect on healthcare systems is undocumented. In 2019, a large Dutch health insurance company offered 2.2 million adults free access to an mHealth app for skin cancer detection. To study the impact on dermatological healthcare consumption, we conducted a retrospective population-based pragmatic study. We matched 18,960 mHealth-users who completed at least one successful assessment with the app to 56,880 controls who did not use the app and calculated odds ratios (OR) to compare dermatological claims between both groups in the first year after granting free access. A short-term cost-effectiveness analysis was performed to determine the cost per additional detected (pre)malignancy. Here we report that mHealth-users had more claims for (pre)malignant skin lesions than controls (6.0% vs 4.6%, OR 1.3 (95% CI 1.2\u20131.4)) and also a more than threefold higher risk of claims for benign skin tumors and nevi (5.9% vs 1.7%, OR 3.7 (95% CI 3.4\u20134.1)). The costs of detecting one additional (pre)malignant skin lesion with the app compared to the current standard of care were \u20ac2567. Based on these results, AI in mHealth appears to have a positive impact on detecting more cutaneous (pre)malignancies, but this should be balanced against the for now stronger increase in care consumption for benign skin tumors and nevi.<\/jats:p>","DOI":"10.1038\/s41746-023-00831-w","type":"journal-article","created":{"date-parts":[[2023,5,20]],"date-time":"2023-05-20T09:02:29Z","timestamp":1684573349000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":72,"title":["An artificial intelligence based app for skin cancer detection evaluated in a population based setting"],"prefix":"10.1038","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7997-8532","authenticated-orcid":false,"given":"Anna M.","family":"Smak Gregoor","sequence":"first","affiliation":[]},{"given":"Tobias E.","family":"Sangers","sequence":"additional","affiliation":[]},{"given":"Lytske J.","family":"Bakker","sequence":"additional","affiliation":[]},{"given":"Loes","family":"Hollestein","sequence":"additional","affiliation":[]},{"given":"Carin A.","family":"Uyl \u2013 de Groot","sequence":"additional","affiliation":[]},{"given":"Tamar","family":"Nijsten","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8578-901X","authenticated-orcid":false,"given":"Marlies","family":"Wakkee","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2023,5,20]]},"reference":[{"key":"831_CR1","unstructured":"Schreuder, K., de Groot, J., Hollestein, L. M., Louwman, M. huidkankerrapport IKNL, https:\/\/iknl.nl\/nieuws\/2019\/steeds-vaker-huidkanker,-nationaal-plan-nodig (2019)."},{"key":"831_CR2","doi-asserted-by":"publisher","first-page":"1300","DOI":"10.1001\/jamadermatol.2020.3677","volume":"156","author":"S Tokez","year":"2020","unstructured":"Tokez, S., Hollestein, L., Louwman, M., Nijsten, T. & Wakkee, M. Incidence of multiple vs first cutaneous squamous cell carcinoma on a nationwide scale and estimation of future incidences of cutaneous squamous cell carcinoma. JAMA Dermatol. 156, 1300\u20131306 (2020).","journal-title":"JAMA Dermatol."},{"key":"831_CR3","doi-asserted-by":"publisher","first-page":"1069","DOI":"10.1111\/j.1365-2133.2012.10830.x","volume":"166","author":"A Lomas","year":"2012","unstructured":"Lomas, A., Leonardi-Bee, J. & Bath-Hextall, F. A systematic review of worldwide incidence of nonmelanoma skin cancer. Br. J. Dermatol. 166, 1069\u20131080 (2012).","journal-title":"Br. J. Dermatol."},{"key":"831_CR4","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1007\/s13671-012-0035-5","volume":"2","author":"ST Chen","year":"2013","unstructured":"Chen, S. T., Geller, A. C. & Tsao, H. Update on the epidemiology of melanoma. Curr. Dermatol. Rep. 2, 24\u201334 (2013).","journal-title":"Curr. Dermatol. Rep."},{"key":"831_CR5","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1111\/bjd.17110","volume":"180","author":"M Janda","year":"2019","unstructured":"Janda, M. & Soyer, H. P. Can clinical decision making be enhanced by artificial intelligence? Br. J. Dermatol. 180, 247\u2013248 (2019).","journal-title":"Br. J. Dermatol."},{"key":"831_CR6","doi-asserted-by":"publisher","first-page":"938","DOI":"10.1016\/S1470-2045(19)30333-X","volume":"20","author":"P Tschandl","year":"2019","unstructured":"Tschandl, P. et al. Comparison of the accuracy of human readers versus machine-learning algorithms for pigmented skin lesion classification: an open, web-based, international, diagnostic study. Lancet Oncol. 20, 938\u2013947 (2019).","journal-title":"Lancet Oncol."},{"key":"831_CR7","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"831_CR8","doi-asserted-by":"publisher","first-page":"1836","DOI":"10.1093\/annonc\/mdy166","volume":"29","author":"HA Haenssle","year":"2018","unstructured":"Haenssle, H. A. et al. Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists. Ann. Oncol. 29, 1836\u20131842 (2018).","journal-title":"Ann. Oncol."},{"key":"831_CR9","doi-asserted-by":"publisher","first-page":"m127","DOI":"10.1136\/bmj.m127","volume":"368","author":"K Freeman","year":"2020","unstructured":"Freeman, K. et al. Algorithm based smartphone apps to assess risk of skin cancer in adults: systematic review of diagnostic accuracy studies. BMJ 368, m127 (2020).","journal-title":"BMJ"},{"key":"831_CR10","unstructured":"CZ. SkinVision reimbursement CZ, https:\/\/www.cz.nl\/vergoedingen\/skinvision (2023)."},{"key":"831_CR11","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1038\/s41591-021-01614-0","volume":"28","author":"P Rajpurkar","year":"2022","unstructured":"Rajpurkar, P., Chen, E., Banerjee, O. & Topol, E. J. AI in health and medicine. Nat. Med. 28, 31\u201338 (2022).","journal-title":"Nat. Med."},{"key":"831_CR12","doi-asserted-by":"publisher","first-page":"648","DOI":"10.1111\/jdv.15935","volume":"34","author":"A Udrea","year":"2020","unstructured":"Udrea, A. et al. Accuracy of a smartphone application for triage of skin lesions based on machine learning algorithms. J. Eur. Acad. Dermatol. Venereol. 34, 648\u2013655 (2020).","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"831_CR13","doi-asserted-by":"publisher","unstructured":"Sangers, T. et al. Validation of a market-approved artificial intelligence mobile health app for skin cancer screening: a prospective multicenter diagnostic accuracy study. Dermatology, 1\u20138, https:\/\/doi.org\/10.1159\/000520474 (2022).","DOI":"10.1159\/000520474"},{"key":"831_CR14","doi-asserted-by":"publisher","first-page":"2390","DOI":"10.1002\/cncr.31271","volume":"124","author":"GB Taksler","year":"2018","unstructured":"Taksler, G. B., Keating, N. L. & Rothberg, M. B. Implications of false-positive results for future cancer screenings. Cancer 124, 2390\u20132398 (2018).","journal-title":"Cancer"},{"key":"831_CR15","doi-asserted-by":"publisher","first-page":"1167","DOI":"10.1001\/jamadermatol.2019.1514","volume":"155","author":"KC Nelson","year":"2019","unstructured":"Nelson, K. C., Swetter, S. M., Saboda, K., Chen, S. C. & Curiel-Lewandrowski, C. Evaluation of the number-needed-to-biopsy metric for the diagnosis of cutaneous melanoma: a systematic review and meta-analysis. JAMA Dermatol. 155, 1167\u20131174 (2019).","journal-title":"JAMA Dermatol."},{"key":"831_CR16","first-page":"CD012352","volume":"6","author":"M Johansson","year":"2019","unstructured":"Johansson, M., Brodersen, J., Gotzsche, P. C. & Jorgensen, K. J. Screening for reducing morbidity and mortality in malignant melanoma. Cochrane Database Syst. Rev. 6, CD012352 (2019).","journal-title":"Cochrane Database Syst. Rev."},{"key":"831_CR17","doi-asserted-by":"publisher","unstructured":"Adamson, A. S., Suarez, E. A. & Welch, H. G. Estimating overdiagnosis of melanoma using trends among black and white patients in the US. JAMA Dermatol. https:\/\/doi.org\/10.1001\/jamadermatol.2022.0139 (2022).","DOI":"10.1001\/jamadermatol.2022.0139"},{"key":"831_CR18","doi-asserted-by":"publisher","first-page":"e008158","DOI":"10.1136\/bmjopen-2015-008158","volume":"5","author":"M Boniol","year":"2015","unstructured":"Boniol, M., Autier, P. & Gandini, S. Melanoma mortality following skin cancer screening in Germany. BMJ Open 5, e008158 (2015).","journal-title":"BMJ Open"},{"key":"831_CR19","doi-asserted-by":"publisher","first-page":"432","DOI":"10.1002\/cncr.29755","volume":"122","author":"A Stang","year":"2016","unstructured":"Stang, A. & Jockel, K. H. Does skin cancer screening save lives? A detailed analysis of mortality time trends in Schleswig-Holstein and Germany. Cancer 122, 432\u2013437 (2016).","journal-title":"Cancer"},{"key":"831_CR20","doi-asserted-by":"publisher","first-page":"72","DOI":"10.1056\/NEJMsb2019760","volume":"384","author":"HG Welch","year":"2021","unstructured":"Welch, H. G., Mazer, B. L. & Adamson, A. S. The rapid rise in cutaneous melanoma diagnoses. N. Engl. J. Med. 384, 72\u201379 (2021).","journal-title":"N. Engl. J. Med."},{"key":"831_CR21","doi-asserted-by":"publisher","first-page":"2285","DOI":"10.1056\/NEJMp1907407","volume":"381","author":"AS Adamson","year":"2019","unstructured":"Adamson, A. S. & Welch, H. G. Machine learning and the cancer-diagnosis problem - no gold standard. N. Engl. J. Med. 381, 2285\u20132287 (2019).","journal-title":"N. Engl. J. Med."},{"key":"831_CR22","doi-asserted-by":"publisher","first-page":"e772","DOI":"10.1111\/jdv.17442","volume":"35","author":"TE Sangers","year":"2021","unstructured":"Sangers, T. E., Nijsten, T. & Wakkee, M. Mobile health skin cancer risk assessment campaign using artificial intelligence on a population-wide scale: a retrospective cohort analysis. J. Eur. Acad. Dermatol. Venereol. 35, e772\u2013e774 (2021).","journal-title":"J. Eur. Acad. Dermatol. Venereol."},{"key":"831_CR23","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1016\/j.jdin.2020.10.013","volume":"2","author":"K Urban","year":"2021","unstructured":"Urban, K., Mehrmal, S., Uppal, P., Giesey, R. L. & Delost, G. R. The global burden of skin cancer: a longitudinal analysis from the Global Burden of Disease Study, 1990-2017. JAAD Int. 2, 98\u2013108 (2021).","journal-title":"JAAD Int."},{"key":"831_CR24","doi-asserted-by":"publisher","unstructured":"Kulkarni, R. P., Yu, W. Y. & Leachman, S. A. To improve melanoma outcomes, focus on risk stratification, not overdiagnosis. JAMA Dermatol. https:\/\/doi.org\/10.1001\/jamadermatol.2022.0097 (2022).","DOI":"10.1001\/jamadermatol.2022.0097"},{"key":"831_CR25","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1097\/CEJ.0000000000000056","volume":"24","author":"LG Gordon","year":"2015","unstructured":"Gordon, L. G. & Rowell, D. Health system costs of skin cancer and cost-effectiveness of skin cancer prevention and screening: a systematic review. Eur. J. Cancer Prev. 24, 141\u2013149 (2015).","journal-title":"Eur. J. Cancer Prev."},{"key":"831_CR26","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1016\/j.jval.2016.12.017","volume":"20","author":"LG Gordon","year":"2017","unstructured":"Gordon, L. G. et al. Cost-effectiveness analysis of a skin awareness intervention for early detection of skin cancer targeting men older than 50 years. Value Health 20, 593\u2013601 (2017).","journal-title":"Value Health"},{"key":"831_CR27","doi-asserted-by":"publisher","first-page":"701","DOI":"10.1016\/j.jaad.2017.11.033","volume":"78","author":"M Matsumoto","year":"2018","unstructured":"Matsumoto, M. et al. Estimating the cost of skin cancer detection by dermatology providers in a large health care system. J. Am. Acad. Dermatol. 78, 701\u2013709 (2018).","journal-title":"J. Am. Acad. Dermatol."},{"key":"831_CR28","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1093\/jnci\/djz137","volume":"112","author":"WE Barlow","year":"2020","unstructured":"Barlow, W. E. et al. Evaluating screening participation, follow-up, and outcomes for breast, cervical, and colorectal cancer in the PROSPR Consortium. J. Natl Cancer Inst. 112, 238\u2013246 (2020).","journal-title":"J. Natl Cancer Inst."},{"key":"831_CR29","unstructured":"Borrelli, C. et al. NHS Breast Screening Programme (NHS, 2016)."},{"key":"831_CR30","doi-asserted-by":"publisher","first-page":"2595","DOI":"10.1001\/jama.2016.6828","volume":"315","author":"AB Knudsen","year":"2016","unstructured":"Knudsen, A. B. et al. Estimation of benefits, burden, and harms of colorectal cancer screening strategies: modeling study for the US Preventive Services Task Force. JAMA 315, 2595\u20132609 (2016).","journal-title":"JAMA"},{"key":"831_CR31","doi-asserted-by":"publisher","first-page":"279","DOI":"10.7326\/M15-2886","volume":"164","author":"AL Siu","year":"2016","unstructured":"Siu, A. L. U.S. Preventive Services Task Force Screening for Breast Cancer: U.S. Preventive Services Task Force Recommendation Statement. Ann. Intern. Med. 164, 279\u2013296 (2016).","journal-title":"Ann. Intern. Med."},{"key":"831_CR32","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1111\/1471-0528.16400","volume":"128","author":"E Jansen","year":"2021","unstructured":"Jansen, E. et al. Cost-effectiveness of HPV-based cervical screening based on first year results in the Netherlands: a modelling study. BJOG 128, 573\u2013582 (2021).","journal-title":"BJOG"},{"key":"831_CR33","doi-asserted-by":"publisher","first-page":"7846","DOI":"10.1002\/cam4.2498","volume":"8","author":"O Mandrik","year":"2019","unstructured":"Mandrik, O. et al. Systematic reviews as a \u201clens of evidence\u201d: determinants of cost-effectiveness of breast cancer screening. Cancer Med. 8, 7846\u20137858 (2019).","journal-title":"Cancer Med."},{"key":"831_CR34","doi-asserted-by":"publisher","first-page":"1969","DOI":"10.1016\/j.cgh.2019.01.014","volume":"17","author":"T Ran","year":"2019","unstructured":"Ran, T. et al. Cost-effectiveness of colorectal cancer screening strategies-a systematic review. Clin. Gastroenterol. Hepatol. 17, 1969\u20131981 (2019).","journal-title":"Clin. Gastroenterol. Hepatol."},{"key":"831_CR35","unstructured":"Global Burden of Disease 2019 Cancer Collaboration et al. Cancer incidence, mortality, years of life lost, years lived with disability, and disability-adjusted life years for 29 cancer groups from 2010 to 2019: a systematic analysis for the global burden of disease study 2019. JAMA Oncol. 8, 420\u2013444 (2022)."},{"key":"831_CR36","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1001\/jamadermatol.2016.4518","volume":"153","author":"L Pil","year":"2017","unstructured":"Pil, L. et al. Cost-effectiveness and budget effect analysis of a population-based skin cancer screening. JAMA Dermatol. 153, 147\u2013153 (2017).","journal-title":"JAMA Dermatol."},{"key":"831_CR37","doi-asserted-by":"publisher","first-page":"1089","DOI":"10.1001\/jamadermatol.2021.2856","volume":"157","author":"N Anand","year":"2021","unstructured":"Anand, N., Edwards, L., Baker, L. X., Chren, M. M. & Wheless, L. Validity of using billing codes from electronic health records to estimate skin cancer counts. JAMA Dermatol. 157, 1089\u20131094 (2021).","journal-title":"JAMA Dermatol."},{"key":"831_CR38","doi-asserted-by":"publisher","first-page":"i969","DOI":"10.1136\/bmj.i969","volume":"352","author":"N Pearce","year":"2016","unstructured":"Pearce, N. Analysis of matched case-control studies. BMJ 352, i969 (2016).","journal-title":"BMJ"},{"key":"831_CR39","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1017\/S0266462316000064","volume":"32","author":"LR Buisman","year":"2016","unstructured":"Buisman, L. R. et al. The early bird catches the worm: early cost-effectiveness analysis of new medical tests. Int. J. Technol. Assess Health Care 32, 46\u201353 (2016).","journal-title":"Int. J. Technol. Assess Health Care"},{"key":"831_CR40","unstructured":"Register, N. T. Trial NL9586. The impact of a SmartPhone applicatiOn for skin cancer risk assessmenT on the healthcare system (SPOT-study): a randomized controlled trial. https:\/\/www.trialregister.nl\/trial\/9586 (2021)."},{"key":"831_CR41","doi-asserted-by":"publisher","first-page":"e13376.4","DOI":"10.2196\/13376","volume":"2","author":"TM de Carvalho","year":"2019","unstructured":"de Carvalho, T. M., Noels, E., Wakkee, M., Udrea, A. & Nijsten, T. Development of smartphoneapps for skin cancer risk assessment: progress and promise. JMIR Dermatol. 2, e13376.4 (2019).","journal-title":"JMIR Dermatol."},{"key":"831_CR42","unstructured":"NZA. Open DIS Data, https:\/\/www.opendisdata.nl\/ (2022)."},{"key":"831_CR43","doi-asserted-by":"crossref","unstructured":"Zorginstituut, N. Referentiebestand FKGs, https:\/\/www.zorginstituutnederland.nl\/publicaties\/publicatie\/2018\/10\/11\/referentiebestand-fkgs-2019 (2019).","DOI":"10.1016\/S1464-2859(19)30291-3"},{"key":"831_CR44","unstructured":"CPB SES scores, https:\/\/bronnen.zorggegevens.nl\/Bron?naam=Sociaal-Economische-Status-per-postcodegebied (2017)."},{"key":"831_CR45","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","volume":"57","author":"Y Benjamini","year":"1995","unstructured":"Benjamini, Y. & Hochberg, Y. Controlling the false discovery rate - a practical and powerful approach to multiple testing. J R Stat Soc B 57, 289\u2013300 (1995).","journal-title":"J R Stat Soc B"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00831-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00831-w","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00831-w.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,20]],"date-time":"2024-10-20T20:17:08Z","timestamp":1729455428000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-023-00831-w"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,20]]},"references-count":45,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["831"],"URL":"https:\/\/doi.org\/10.1038\/s41746-023-00831-w","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,20]]},"assertion":[{"value":"30 September 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 May 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The Erasmus MC Department of Dermatology has received an unrestricted research grant from SkinVision B.V. T.N. serves on the SkinVision scientific advisory board and has equity in the company. All other authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"90"}}