{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T17:07:39Z","timestamp":1790269659067,"version":"4.1.0"},"reference-count":32,"publisher":"SPIE-Intl Soc Optical Eng","issue":"06","license":[{"start":{"date-parts":[[2022,6,30]],"date-time":"2022-06-30T00:00:00Z","timestamp":1656547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Biomed. Opt."],"published-print":{"date-parts":[[2022,6,30]]},"abstract":"<jats:p>Significance: Raman spectroscopy (RS) provides an automated approach for assisting Mohs micrographic surgery for skin cancer diagnosis; however, the specificity of RS is limited by the high spectral similarity between tumors and normal tissues structures. Reflectance confocal microscopy (RCM) provides morphological and cytological details by which many features of epidermis and hair follicles can be readily identified. Combining RS with deep-learning-aided RCM has the potential to improve the diagnostic accuracy of RS in an automated fashion, without requiring additional input from the clinician.\nAim: The aim of this study is to improve the specificity of RS for detecting basal cell carcinoma (BCC) using an artificial neural network trained on RCM images to identify false positive normal skin structures (hair follicles and epidermis).\nApproach: Our approach was to build a two-step classification model. In the first step, a Raman biophysical model that was used in prior work classified BCC tumors from normal tissue structures with high sensitivity. In the second step, 191 RCM images were collected from the same site as the Raman data and served as inputs for two ResNet50 networks. The networks selected the hair structure and epidermis images, respectively, within all images corresponding to the positive predictions of the Raman biophysical model with high specificity. The specificity of the BCC biophysical model was improved by moving the Raman spectra corresponding to these selected images from false positive to true negative.\nResults: Deep-learning trained on RCM images removed 52% of false positive predictions from the Raman biophysical model result while maintaining a sensitivity of 100%. The specificity was improved from 84.2% using Raman spectra alone to 92.4% by integrating Raman spectra with RCM images.\nConclusions: Combining RS with deep-learning-aided RCM imaging is a promising tool for guiding tumor resection surgery.<\/jats:p>","DOI":"10.1117\/1.jbo.27.6.065004","type":"journal-article","created":{"date-parts":[[2022,6,30]],"date-time":"2022-06-30T02:30:41Z","timestamp":1656556241000},"page":"1-9","source":"Crossref","is-referenced-by-count":16,"title":["Deep learning on reflectance confocal microscopy improves Raman spectral diagnosis of basal cell carcinoma"],"prefix":"10.1117","volume":"27","author":[{"given":"Mengkun","family":"Chen","sequence":"first","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9048-7144","authenticated-orcid":false,"given":"Xu","family":"Feng","sequence":"additional","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Matthew C.","family":"Fox","sequence":"additional","affiliation":[{"name":"Dell Medical School, The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-0987-0646","authenticated-orcid":false,"given":"Jason S.","family":"Reichenberg","sequence":"additional","affiliation":[{"name":"Dell Medical School, The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabiana C. P. S.","family":"Lopes","sequence":"additional","affiliation":[{"name":"Dell Medical School, The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Katherine R.","family":"Sebastian","sequence":"additional","affiliation":[{"name":"Dell Medical School, The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mia K.","family":"Markey","sequence":"additional","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James W.","family":"Tunnell","sequence":"additional","affiliation":[{"name":"The Univ. of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"189","reference":[{"key":"r1","doi-asserted-by":"publisher","DOI":"10.1016\/S0094-0143(21)00392-X"},{"key":"r2","doi-asserted-by":"publisher","DOI":"10.1097\/DSS.0000000000001352"},{"key":"r3","doi-asserted-by":"publisher","DOI":"10.1039\/C5CS00581G"},{"key":"r4","author":"Gardiner","year":"1989"},{"key":"r5","doi-asserted-by":"publisher","DOI":"10.1046\/j.1523-1747.2002.01807.x"},{"key":"r6","doi-asserted-by":"publisher","DOI":"10.1117\/1.3251053"},{"key":"r7","doi-asserted-by":"publisher","DOI":"10.1002\/lsm.20653"},{"key":"r8","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1311289110"},{"key":"r9","doi-asserted-by":"publisher","DOI":"10.3390\/photonics8070282"},{"key":"r10","doi-asserted-by":"publisher","DOI":"10.1117\/1.JBO.23.5.057002"},{"key":"r11","doi-asserted-by":"publisher","DOI":"10.1016\/j.sder.2009.06.004"},{"key":"r12","doi-asserted-by":"publisher","DOI":"10.1002\/lsm.22600"},{"key":"r13","doi-asserted-by":"publisher","DOI":"10.1067\/mjd.2002.124690"},{"key":"r14","doi-asserted-by":"publisher","DOI":"10.1111\/jdv.13712"},{"key":"r15","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-021-82969-9"},{"key":"r16","doi-asserted-by":"publisher","DOI":"10.1016\/J.JID.2021.06.015"},{"key":"r17","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.3.000488"},{"key":"r18","doi-asserted-by":"publisher","DOI":"10.1364\/OL.44.001383"},{"key":"r19","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.8.002835"},{"key":"r20","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.10.000104"},{"key":"r21","doi-asserted-by":"publisher","DOI":"10.1002\/jbio.201960109"},{"key":"r22","doi-asserted-by":"publisher","DOI":"10.1186\/s40537-016-0043-6"},{"key":"r23","article-title":"Transfer learning with ensembles of deep neural networks for skin cancer detection in imbalanced data sets","author":"Qureshi","year":"2021"},{"key":"r24","first-page":"135","author":"Robin","year":"2021"},{"key":"r25","doi-asserted-by":"publisher","DOI":"10.1016\/j.mlwa.2021.100036"},{"key":"r26","doi-asserted-by":"publisher","DOI":"10.1109\/ICATMRI51801.2020.9398388"},{"key":"r27","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2016.90"},{"key":"r28","article-title":"TensorFlow: large-scale machine learning on heterogeneous distributed systems","author":"Abadi","year":"2016"},{"key":"r29","doi-asserted-by":"publisher","DOI":"10.1364\/BOE.422168"},{"key":"r30","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00934-2_33"},{"key":"r31","doi-asserted-by":"publisher","DOI":"10.1111\/j.1468-3083.2010.03834.x"},{"key":"r32","doi-asserted-by":"publisher","DOI":"10.1109\/ICPR.2016.7899844"}],"container-title":["Journal of Biomedical Optics"],"original-title":[],"link":[{"URL":"https:\/\/www.spiedigitallibrary.org\/journals\/journal-of-biomedical-optics\/volume-27\/issue-06\/065004\/Deep-learning-on-reflectance-confocal-microscopy-improves-Raman-spectral-diagnosis\/10.1117\/1.JBO.27.6.065004.full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T16:43:12Z","timestamp":1790268192000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.spiedigitallibrary.org\/journals\/journal-of-biomedical-optics\/volume-27\/issue-06\/065004\/Deep-learning-on-reflectance-confocal-microscopy-improves-Raman-spectral-diagnosis\/10.1117\/1.JBO.27.6.065004.full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,6,30]]},"references-count":32,"journal-issue":{"issue":"06","published-online":{"date-parts":[[2022,6,1]]}},"URL":"https:\/\/doi.org\/10.1117\/1.jbo.27.6.065004","relation":{},"ISSN":["1083-3668","1560-2281"],"issn-type":[{"value":"1083-3668","type":"print"},{"value":"1560-2281","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,6,30]]}}}