{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,23]],"date-time":"2026-10-23T21:49:07Z","timestamp":1792792147464,"version":"4.5.0"},"reference-count":32,"publisher":"Wiley","issue":"8","license":[{"start":{"date-parts":[[2024,12,8]],"date-time":"2024-12-08T00:00:00Z","timestamp":1733616000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"DOI":"10.13039\/501100020062","name":"Melanoma Centre of Research Excellence","doi-asserted-by":"publisher","award":["2006551"],"award-info":[{"award-number":["2006551"]}],"id":[{"id":"10.13039\/501100020062","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020062","name":"Melanoma Centre of Research Excellence","doi-asserted-by":"publisher","award":["614197"],"award-info":[{"award-number":["614197"]}],"id":[{"id":"10.13039\/501100020062","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["P30 CA008748"],"award-info":[{"award-number":["P30 CA008748"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U24\u2010CA264369"],"award-info":[{"award-number":["U24\u2010CA264369"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"publisher","award":["U24\u2010CA285296"],"award-info":[{"award-number":["U24\u2010CA285296"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000947","name":"Australian Cancer Research Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000947","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Acad Dermatol Venereol"],"published-print":{"date-parts":[[2025,8]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>While the high accuracy of reported AI tools for melanoma detection is promising, the lack of holistic consideration of the patient is often criticized. Along with medical history, a dermatologist would also consider intra\u2010patient nevi patterns, such that nevi that are different from others on a given patient are treated with suspicion.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>To evaluate whether patient\u2010contextual lesion\u2010images improves diagnostic accuracy for melanoma in a dermoscopic image\u2010based AI competition and a human reader study.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>An international online AI competition was held in 2020. The task was to classify dermoscopy images as melanoma or benign lesions. A multi\u2010source dataset of dermoscopy images grouped by patient were provided, and additional use of public datasets was permitted. Competitors were judged on area under the receiver operating characteristic (AUROC) on a private leaderboard. Concurrently, a human reader study was hosted using a subset of the test data. Participants gave their initial diagnosis of an index case (melanoma vs. benign) and were then presented with seven additional lesion\u2010images of that patient before giving a second prediction of the index case. Outcome measures were sensitivity and specificity.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The top 50 of 3308 AI competition entries achieved AUROC scores ranging from 0.943 to 0.949. Few algorithms considered intra\u2010patient lesion patterns and instead most evaluated images independently. The median sensitivity and specificity of human readers before receiving contextual images were 60.0% and 86.7%, and after were 60.0% and 85.7%. Human and AI algorithm performance varied by image source.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>This study provided an open\u2010source state\u2010of\u2010the\u2010art algorithm for melanoma detection that has been evaluated at multiple centres. Patient\u2010contextual images did not positively impact performance of AI algorithms or human readers. Providing seven contextual images and no total body image may have been insufficient to test the applicability of the intra\u2010patient lesion patterns.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/jdv.20479","type":"journal-article","created":{"date-parts":[[2024,12,9]],"date-time":"2024-12-09T02:44:56Z","timestamp":1733712296000},"page":"1489-1499","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Effect of patient\u2010contextual skin images in human\u2010 and artificial intelligence\u2010based diagnosis of melanoma: Results from the 2020\n                    <scp>SIIM<\/scp>\n                    \u2010\n                    <scp>ISIC<\/scp>\n                    melanoma classification challenge"],"prefix":"10.1111","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6745-0386","authenticated-orcid":false,"given":"Nicholas R.","family":"Kurtansky","sequence":"first","affiliation":[{"name":"Dermatology Service, Department of Medicine Memorial Sloan Kettering Cancer Center  New York City New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2944-0013","authenticated-orcid":false,"given":"Clare A.","family":"Primiero","sequence":"additional","affiliation":[{"name":"Frazer Institute, Dermatology Research Centre The University of Queensland  Brisbane Queensland Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3876-501X","authenticated-orcid":false,"given":"Brigid","family":"Betz\u2010Stablein","sequence":"additional","affiliation":[{"name":"Frazer Institute, Dermatology Research Centre The University of Queensland  Brisbane Queensland Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marc","family":"Combalia","sequence":"additional","affiliation":[{"name":"Melanoma Unit, Dermatology Department, Hospital C\u013a\u0131nic Barcelona Universitat de Barcelona, IDIBAPS  Barcelona Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pascale","family":"Guitera","sequence":"additional","affiliation":[{"name":"Melanoma Institute Australia and Sydney Melanoma Diagnostic Center  Sydney New South Wales Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7320-1901","authenticated-orcid":false,"given":"Allan","family":"Halpern","sequence":"additional","affiliation":[{"name":"Dermatology Service, Department of Medicine Memorial Sloan Kettering Cancer Center  New York City New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jonathan","family":"Kentley","sequence":"additional","affiliation":[{"name":"Dermatology Service, Department of Medicine Memorial Sloan Kettering Cancer Center  New York City New York USA"},{"name":"Department of Dermatology Chelsea and Westminster Hospital  London UK"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Harald","family":"Kittler","sequence":"additional","affiliation":[{"name":"Department of Dermatology Medical University of Vienna  Vienna Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9566-8238","authenticated-orcid":false,"given":"Konstantinos","family":"Liopyris","sequence":"additional","affiliation":[{"name":"University of Athens Medical School  Athens Greece"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Josep","family":"Malvehy","sequence":"additional","affiliation":[{"name":"Melanoma Unit, Dermatology Department, Hospital C\u013a\u0131nic Barcelona Universitat de Barcelona, IDIBAPS  Barcelona Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3847-5664","authenticated-orcid":false,"given":"Christoph","family":"Rinner","sequence":"additional","affiliation":[{"name":"Center for Medical Data Science Medical University of Vienna  Vienna Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0391-7810","authenticated-orcid":false,"given":"Philipp","family":"Tschandl","sequence":"additional","affiliation":[{"name":"Department of Dermatology Medical University of Vienna  Vienna Austria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jochen","family":"Weber","sequence":"additional","affiliation":[{"name":"Dermatology Service, Department of Medicine Memorial Sloan Kettering Cancer Center  New York City New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Veronica","family":"Rotemberg","sequence":"additional","affiliation":[{"name":"Dermatology Service, Department of Medicine Memorial Sloan Kettering Cancer Center  New York City New York USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"H. Peter","family":"Soyer","sequence":"additional","affiliation":[{"name":"Frazer Institute, Dermatology Research Centre The University of Queensland  Brisbane Queensland Australia"},{"name":"Dermatology Department Princess Alexandra Hospital  Brisbane Queensland Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2024,12,8]]},"reference":[{"key":"e_1_2_13_2_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41746-023-00872-1"},{"key":"e_1_2_13_3_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-020-0942-0"},{"key":"e_1_2_13_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejca.2023.112954"},{"key":"e_1_2_13_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-023-02475-5"},{"key":"e_1_2_13_6_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature21056"},{"key":"e_1_2_13_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaad.2017.08.016"},{"key":"e_1_2_13_8_1","unstructured":"CodellaN RotembergV TschandlP CelebiME DuszaS GutmanD et\u00a0al.Skin lesion analysis toward melanoma detection 2018: a challenge hosted by the international skin imaging collaboration (ISIC).arXiv.2019. Available from:https:\/\/doi.org\/10.48550\/arXiv.1902.03368"},{"key":"e_1_2_13_9_1","first-page":"168","volume-title":"2018 IEEE 15th International\u00a0Symposium on Biomedical Imaging (ISBI 2018)","author":"Gutman DA","year":"2018"},{"key":"e_1_2_13_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/S2589-7500(22)00021-8"},{"key":"e_1_2_13_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13555-022-00833-8"},{"key":"e_1_2_13_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jid.2023.11.007"},{"key":"e_1_2_13_13_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamadermatol.2018.3964"},{"key":"e_1_2_13_14_1","doi-asserted-by":"publisher","DOI":"10.1002\/ijc.21001"},{"key":"e_1_2_13_15_1","doi-asserted-by":"publisher","DOI":"10.5826\/dpc.11S1a161S"},{"key":"e_1_2_13_16_1","doi-asserted-by":"publisher","DOI":"10.1111\/bjd.19706"},{"issue":"6","key":"e_1_2_13_17_1","first-page":"1005","article-title":"Melanoma: epidemiology, risk factors, pathogenesis, diagnosis and classification","volume":"28","author":"Rastrelli M","year":"2014","journal-title":"In Vivo"},{"key":"e_1_2_13_18_1","doi-asserted-by":"publisher","DOI":"10.1001\/archderm.137.12.1583"},{"key":"e_1_2_13_19_1","doi-asserted-by":"publisher","DOI":"10.1001\/archderm.141.4.434"},{"key":"e_1_2_13_20_1","doi-asserted-by":"publisher","DOI":"10.1001\/archderm.134.1.103-a"},{"key":"e_1_2_13_21_1","doi-asserted-by":"publisher","DOI":"10.1001\/jamadermatol.2016.5500"},{"key":"e_1_2_13_22_1","doi-asserted-by":"publisher","DOI":"10.1001\/archdermatol.2007.15"},{"key":"e_1_2_13_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jaad.2017.06.152"},{"key":"e_1_2_13_24_1","doi-asserted-by":"publisher","DOI":"10.1111\/jdv.14065"},{"key":"e_1_2_13_25_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41597-021-00815-z"},{"key":"e_1_2_13_26_1","doi-asserted-by":"publisher","DOI":"10.1111\/jdv.13840"},{"key":"e_1_2_13_27_1","volume-title":"SIIM\u2010ISIC 2020 challenge dataset","author":"International Skin Imaging Collaboration","year":"2020"},{"key":"e_1_2_13_28_1","doi-asserted-by":"publisher","DOI":"10.2196\/15597"},{"key":"e_1_2_13_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1470-2045(19)30333-X"},{"key":"e_1_2_13_30_1","first-page":"113160K","article-title":"Multi\u2010reader multi\u2010case analysis of variance software for diagnostic performance comparison of imaging modalities","volume":"11316","author":"Smith BJ","year":"2020","journal-title":"Proc SPIE Int Soc Opt Eng"},{"key":"e_1_2_13_31_1","doi-asserted-by":"publisher","DOI":"10.1364\/JOSAA.24.000B70"},{"key":"e_1_2_13_32_1","unstructured":"HaQ LiuB LiuF.Identifying melanoma images using EfficientNet ensemble: winning solution to the SIIM\u2010ISIC melanoma classification challenge.arXiv.2020. Available from:https:\/\/doi.org\/10.48550\/arXiv.2010.05351"},{"key":"e_1_2_13_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10278-021-00483-w"}],"container-title":["Journal of the European Academy of Dermatology and Venereology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jdv.20479","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,4]],"date-time":"2025-08-04T07:20:38Z","timestamp":1754292038000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jdv.20479"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,8]]},"references-count":32,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2025,8]]}},"alternative-id":["10.1111\/jdv.20479"],"URL":"https:\/\/doi.org\/10.1111\/jdv.20479","archive":["Portico"],"relation":{},"ISSN":["0926-9959","1468-3083"],"issn-type":[{"value":"0926-9959","type":"print"},{"value":"1468-3083","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,8]]},"assertion":[{"value":"2024-05-31","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-12-08","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}