{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T20:48:29Z","timestamp":1793134109441,"version":"4.5.0"},"reference-count":32,"publisher":"PeerJ","license":[{"start":{"date-parts":[[2025,8,28]],"date-time":"2025-08-28T00:00:00Z","timestamp":1756339200000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004331","name":"Johnson and Johnson","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100004331","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/100015539","name":"Australian Government","doi-asserted-by":"crossref","id":[{"id":"10.13039\/100015539","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:sec>\n               <jats:title>Background<\/jats:title>\n               <jats:p>Artificial intelligence (AI) is poised to revolutionise how melanoma is detected in clinical practice, yet few studies have been published with patient data at the forefront.<\/jats:p>\n            <\/jats:sec>\n            <jats:sec>\n               <jats:title>Objective<\/jats:title>\n               <jats:p>The primary aim of this study was to investigate the clinical performance of a market-approved convolutional neural network (CNN) to better differentiate skin lesions suspicious of being malignant melanoma (MM). A secondary aim of this study was to compare the diagnostic performance of the CNN across two separate general practices, that are skin cancer focused clinics.<\/jats:p>\n            <\/jats:sec>\n            <jats:sec>\n               <jats:title>Methods<\/jats:title>\n               <jats:p>Multicentre, cross-sectional study using a commercially available CNN on 373 melanocytic lesions (114 melanoma, 259 non-melanoma) from participants attending a skin examination within two Australian specialised, general practice clinics. Performance metrics included sensitivity, specificity, predictive values, diagnostic odds ratios, accuracy and area under the curve (AUC) of receiver operating characteristics (ROC) used for classification of images.<\/jats:p>\n            <\/jats:sec>\n            <jats:sec>\n               <jats:title>Results<\/jats:title>\n               <jats:p>The CNN average sensitivity [Gold Coast <jats:italic>vs<\/jats:italic> Townsville] was calculated as 63.2% [61.5% <jats:italic>vs<\/jats:italic> 68.6%], specificity as 53.9% [52.5% <jats:italic>vs<\/jats:italic> 55.1%], positive predictive value as 37.8% [28.9% <jats:italic>vs<\/jats:italic> 44.0%] and negative predictive value as 76.8% [71.4% <jats:italic>vs<\/jats:italic> 84.2%]. Likelihood ratios were 1.4 for positive likelihood ratio, 0.7 for negative likelihood ratio and a diagnostic odds ratio of 2.0 across both clinics. Accuracy was calculated as 56.6% [56.1% <jats:italic>vs<\/jats:italic> 57.5%] and the AUC of ROC for both clinics was 0.602 and 0.615 for Townsville and Gold Coast, respectively.<\/jats:p>\n            <\/jats:sec>\n            <jats:sec>\n               <jats:title>Conclusions<\/jats:title>\n               <jats:p>Improvement of the performance of this CNN for the classification of images, particularly when suspecting MM is necessary before it may be used in a clinical setting in Australia. Other validated AI systems used internationally may also require review for use in an Australian setting.<\/jats:p>\n            <\/jats:sec>","DOI":"10.7717\/peerj.19876","type":"journal-article","created":{"date-parts":[[2025,8,28]],"date-time":"2025-08-28T08:31:47Z","timestamp":1756369907000},"page":"e19876","source":"Crossref","is-referenced-by-count":1,"title":["Market-approved convolutional neural network tasked with classifying skin lesions under suspicion of melanoma: performance across primary care clinics within Australia"],"prefix":"10.7717","volume":"13","author":[{"given":"Ian J.","family":"Miller","sequence":"first","affiliation":[{"name":"Aquatic Based Research, Faculty of Health, Southern Cross University, Bilinga, Qld, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael","family":"Stapelberg","sequence":"additional","affiliation":[{"name":"Aquatic Based Research, Faculty of Health, Southern Cross University, Bilinga, Qld, Australia"},{"name":"Skin Clinic Robina, Robina, Qld, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeremy","family":"Hudson","sequence":"additional","affiliation":[{"name":"Aquatic Based Research, Faculty of Health, Southern Cross University, Bilinga, Qld, Australia"},{"name":"North Queensland Skin Centre, Unaffiliated, Townsville, Qld, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Paul","family":"Coxon","sequence":"additional","affiliation":[{"name":"Aquatic Based Research, Faculty of Health, Southern Cross University, Bilinga, Qld, Australia"},{"name":"North Queensland Skin Centre, Unaffiliated, Townsville, Qld, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathaniel","family":"Milani","sequence":"additional","affiliation":[{"name":"North Queensland Skin Centre, Unaffiliated, Townsville, Qld, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nedeljka","family":"Rosic","sequence":"additional","affiliation":[{"name":"Aquatic Based Research, Faculty of Health, Southern Cross University, Bilinga, Qld, Australia"},{"name":"Department of Biomedical Sciences, Faculty of Health, Southern Cross University, Bilinga, Qld, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James","family":"Furness","sequence":"additional","affiliation":[{"name":"Water Based Research Unit, Bond University, Robina, Qld, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joe","family":"Walsh","sequence":"additional","affiliation":[{"name":"Sport Science Institute, Sydney, NSW, Australia"},{"name":"AI Consulting Group, Sydney, NSW, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mike","family":"Climstein","sequence":"additional","affiliation":[{"name":"Physical Activity, Lifestyle, Ageing and Wellbeing Faculty Research Group, University of Sydney, Sydney,  NSW, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4443","published-online":{"date-parts":[[2025,8,28]]},"reference":[{"issue":"11","key":"10.7717\/peerj.19876\/ref-1","doi-asserted-by":"publisher","first-page":"1247","DOI":"10.1001\/jamadermatol.2018.2348","article-title":"Machine learning and health care disparities in dermatology","volume":"154","author":"Adamson","year":"2018","journal-title":"JAMA Dermatology"},{"issue":"5","key":"10.7717\/peerj.19876\/ref-2","doi-asserted-by":"publisher","first-page":"495","DOI":"10.1001\/jamadermatol.2022.0160","article-title":"Global burden of cutaneous melanoma in 2020 and projections to 2040","volume":"158","author":"Arnold","year":"2022","journal-title":"JAMA Dermatology"},{"key":"10.7717\/peerj.19876\/ref-3","article-title":"Cancer data in Australia","author":"Australian Institute of Health and Welfare","year":"2023"},{"issue":"1","key":"10.7717\/peerj.19876\/ref-4","doi-asserted-by":"publisher","first-page":"299","DOI":"10.20506\/rst.40.1.3226","article-title":"Diagnostic likelihood ratio - the next-generation of diagnostic test accuracy measurement","volume":"40","author":"Caraguel","year":"2021","journal-title":"Revue Scientifique Et Technique"},{"key":"10.7717\/peerj.19876\/ref-5","doi-asserted-by":"publisher","first-page":"168","DOI":"10.48550\/arXiv.1710.05006","article-title":"Skin lesion analysis towards melanoma detection: a challenge at the 2017 International Symposium on Biomedical Imaging (ISBI), Hosted by the International Skin Imaging Collaboration (ISIC)","author":"Codella","year":"2018"},{"key":"10.7717\/peerj.19876\/ref-6","doi-asserted-by":"publisher","article-title":"A Modified Inception-v4 for Imbalanced Skin Cancer Classification Dataset","year":"2019","DOI":"10.1109\/ICCES48960.2019.9068110"},{"issue":"6","key":"10.7717\/peerj.19876\/ref-7","doi-asserted-by":"publisher","first-page":"1355","DOI":"10.1111\/jdv.16165","article-title":"Diagnostic performance of a deep learning convolutional neural network in the differentiation of combined naevi and melanomas","volume":"34","author":"Fink","year":"2020","journal-title":"Journal of the European Academy of Dermatology and Venereology: JEADV"},{"issue":"3","key":"10.7717\/peerj.19876\/ref-8","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1016\/j.jaad.2021.02.012","article-title":"Discrimination between invasive and in situ melanomas using a convolutional neural network","volume":"86","author":"Gillstedt","year":"2022","journal-title":"Journal of the American Academy of Dermatology"},{"issue":"8","key":"10.7717\/peerj.19876\/ref-9","doi-asserted-by":"publisher","first-page":"1836","DOI":"10.1093\/annonc\/mdy166","article-title":"Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists","volume":"29","author":"Haenssle","year":"2018","journal-title":"Annals of Oncology"},{"issue":"1","key":"10.7717\/peerj.19876\/ref-10","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/j.annonc.2019.10.013","article-title":"Man against machine reloaded: performance of a market-approved convolutional neural network in classifying a broad spectrum of skin lesions in comparison with 96 dermatologists working under less artificial conditions","volume":"31","author":"Haenssle","year":"2020","journal-title":"Annals of Oncology"},{"issue":"5","key":"10.7717\/peerj.19876\/ref-11","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1016\/S0196-0644(99)70346-X","article-title":"Likelihood ratio: a powerful tool for incorporating the results of a diagnostic test into clinical decisionmaking","volume":"33","author":"Hayden","year":"1999","journal-title":"Annals of Emergency Medicine"},{"issue":"4","key":"10.7717\/peerj.19876\/ref-12","doi-asserted-by":"publisher","first-page":"499","DOI":"10.1159\/000530225","article-title":"Artificial intelligence for the classification of pigmented skin lesions in populations with skin of color: a systematic review","volume":"239","author":"Liu","year":"2023","journal-title":"Dermatology"},{"issue":"2","key":"10.7717\/peerj.19876\/ref-13","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1016\/j.jaad.2020.04.019","article-title":"The use of noninvasive imaging techniques in the diagnosis of melanoma: a prospective diagnostic accuracy study","volume":"85","author":"MacLellan","year":"2021","journal-title":"Journal of the American Academy of Dermatology"},{"key":"10.7717\/peerj.19876\/ref-14","article-title":"Melanoma: confirming the diagnosis","author":"Melanoma Research Alliance","year":"2024"},{"issue":"4","key":"10.7717\/peerj.19876\/ref-15","doi-asserted-by":"publisher","first-page":"1183","DOI":"10.3390\/cancers15041183","article-title":"AI-powered diagnosis of skin cancer: a contemporary review, open challenges and future research directions","volume":"15","author":"Melarkode","year":"2023","journal-title":"Cancers"},{"issue":"10","key":"10.7717\/peerj.19876\/ref-16","doi-asserted-by":"publisher","first-page":"e679-e691","DOI":"10.1016\/S2589-7500(23)00130-9","article-title":"Comparison of humans versus mobile phone-powered artificial intelligence for the diagnosis and management of pigmented skin cancer in secondary care: a multicentre, prospective, diagnostic, clinical trial","volume":"5","author":"Menzies","year":"2023","journal-title":"The Lancet Digital Health"},{"issue":"7","key":"10.7717\/peerj.19876\/ref-17","doi-asserted-by":"publisher","first-page":"1443","DOI":"10.3390\/cancers16071443","article-title":"Performance of commercial dermatoscopic systems that incorporate artificial intelligence for the identification of melanoma in general practice: a systematic review","volume":"16","author":"Miller","year":"2024","journal-title":"Cancers"},{"key":"10.7717\/peerj.19876\/ref-18","doi-asserted-by":"publisher","first-page":"e15737","DOI":"10.7717\/peerj.15737","article-title":"Implementation of artificial intelligence for the detection of cutaneous melanoma within a primary care setting: prevalence and types of skin cancer in outdoor enthusiasts","volume":"11","author":"Miller","year":"2023","journal-title":"PeerJ"},{"issue":"1","key":"10.7717\/peerj.19876\/ref-19","doi-asserted-by":"publisher","first-page":"25","DOI":"10.4097\/kja.21209","article-title":"Receiver operating characteristic curve: overview and practical use for clinicians","volume":"75","author":"Nahm","year":"2022","journal-title":"Korean Journal of Anesthesiology"},{"key":"10.7717\/peerj.19876\/ref-20","doi-asserted-by":"publisher","first-page":"723914","DOI":"10.3389\/fmed.2021.723914","article-title":"Discrimination between invasive and in situ melanomas using clinical close-up images and a de novo convolutional neural network","volume":"8","author":"Polesie","year":"2021","journal-title":"Frontiers in Medicine"},{"issue":"4","key":"10.7717\/peerj.19876\/ref-21","first-page":"572","article-title":"Survival rates of patients with metastatic malignant melanoma","volume":"7","author":"Sandru","year":"2014","journal-title":"Journal of Medicine and Life"},{"key":"10.7717\/peerj.19876\/ref-22","doi-asserted-by":"publisher","first-page":"2818","DOI":"10.48550\/arXiv.1512.00567","article-title":"Rethinking the inception architecture for computer vision","author":"Szegedy","year":"2016"},{"key":"10.7717\/peerj.19876\/ref-23","doi-asserted-by":"publisher","first-page":"1264846","DOI":"10.3389\/fmed.2023.1264846","article-title":"Real-world post-deployment performance of a novel machine learning-based digital health technology for skin lesion assessment and suggestions for post-market surveillance","volume":"10","author":"Thomas","year":"2023","journal-title":"Frontiers in Medicine"},{"key":"10.7717\/peerj.19876\/ref-24","first-page":"470","article-title":"Melanoma: a management guide for GPs","volume":"41","author":"Thompson","year":"2012","journal-title":"AJGP (Australian Journal of General Practice)"},{"key":"10.7717\/peerj.19876\/ref-25","doi-asserted-by":"publisher","first-page":"180161","DOI":"10.1038\/sdata.2018.161","article-title":"The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions","volume":"5","author":"Tschandl","year":"2018","journal-title":"Scientific Data"},{"issue":"4","key":"10.7717\/peerj.19876\/ref-26","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1111\/bjd.21649","article-title":"The effect of screening on melanoma incidence and biopsy rates","volume":"187","author":"Whiteman","year":"2022","journal-title":"British Journal of Dermatology"},{"issue":"6","key":"10.7717\/peerj.19876\/ref-27","doi-asserted-by":"publisher","first-page":"621","DOI":"10.1001\/jamadermatol.2023.0905","article-title":"Assessment of diagnostic performance of dermatologists cooperating with a convolutional neural network in a prospective clinical study: human with machine","volume":"159","author":"Winkler","year":"2023","journal-title":"JAMA Dermatology"},{"issue":"10","key":"10.7717\/peerj.19876\/ref-28","doi-asserted-by":"publisher","first-page":"1135","DOI":"10.1001\/jamadermatol.2019.1735","article-title":"Association between surgical skin markings in dermoscopic images and diagnostic performance of a deep learning convolutional neural network for melanoma recognition","volume":"155","author":"Winkler","year":"2019","journal-title":"JAMA Dermatology"},{"key":"10.7717\/peerj.19876\/ref-29","doi-asserted-by":"publisher","first-page":"114026","DOI":"10.1016\/j.ejca.2024.114026","article-title":"Performance of an automated total body mapping algorithm to detect melanocytic lesions of clinical relevance","volume":"202","author":"Winkler","year":"2024","journal-title":"European Journal of Cancer"},{"issue":"8","key":"10.7717\/peerj.19876\/ref-30","doi-asserted-by":"publisher","first-page":"1178","DOI":"10.1111\/ddg.14510","article-title":"Collective human intelligence outperforms artificial intelligence in a skin lesion classification task","volume":"19","author":"Winkler","year":"2021","journal-title":"JDDG Journal der Deutschen Dermatologischen Gesellschaft"},{"key":"10.7717\/peerj.19876\/ref-31","doi-asserted-by":"publisher","first-page":"146","DOI":"10.1016\/j.ejca.2020.12.010","article-title":"Association between different scale bars in dermoscopic images and diagnostic performance of a market-approved deep learning convolutional neural network for melanoma recognition","volume":"145","author":"Winkler","year":"2021","journal-title":"European Journal of Cancer"},{"key":"10.7717\/peerj.19876\/ref-32","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1016\/j.ejca.2021.10.030","article-title":"Monitoring patients at risk for melanoma: may convolutional neural networks replace the strategy of sequential digital dermoscopy?","volume":"160","author":"Winkler","year":"2022","journal-title":"European Journal of Cancer"}],"container-title":["PeerJ"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/peerj.com\/articles\/19876.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/19876.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/19876.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/peerj.com\/articles\/19876.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,28]],"date-time":"2025-08-28T08:31:55Z","timestamp":1756369915000},"score":1,"resource":{"primary":{"URL":"https:\/\/peerj.com\/articles\/19876"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,28]]},"references-count":32,"alternative-id":["10.7717\/peerj.19876"],"URL":"https:\/\/doi.org\/10.7717\/peerj.19876","archive":["CLOCKSS","LOCKSS","Portico"],"relation":{},"ISSN":["2167-8359"],"issn-type":[{"value":"2167-8359","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,28]]},"article-number":"e19876"}}