{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,29]],"date-time":"2026-10-29T23:56:59Z","timestamp":1793318219671,"version":"4.5.0"},"reference-count":46,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2017,9,20]],"date-time":"2017-09-20T00:00:00Z","timestamp":1505865600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2017,9,20]],"date-time":"2017-09-20T00:00:00Z","timestamp":1505865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>\n                    Oral Squamous Cell Carcinoma (OSCC) is a common type of cancer of the oral epithelium. Despite their high impact on mortality, sufficient screening methods for early diagnosis of OSCC often lack accuracy and thus OSCCs are mostly diagnosed at a late stage. Early detection and accurate outline estimation of OSCCs would lead to a better curative outcome and a reduction in recurrence rates after surgical treatment. Confocal Laser Endomicroscopy (CLE) records sub-surface micro-anatomical images for\n                    <jats:italic>in vivo<\/jats:italic>\n                    cell structure analysis. Recent CLE studies showed great prospects for a reliable, real-time ultrastructural imaging of OSCC\n                    <jats:italic>in situ<\/jats:italic>\n                    . We present and evaluate a novel automatic approach for OSCC diagnosis using deep learning technologies on CLE images. The method is compared against textural feature-based machine learning approaches that represent the current state of the art. For this work, CLE image sequences (7894 images) from patients diagnosed with OSCC were obtained from 4 specific locations in the oral cavity, including the OSCC lesion. The present approach is found to outperform the state of the art in CLE image recognition with an area under the curve (AUC) of 0.96 and a mean accuracy of 88.3% (sensitivity 86.6%, specificity 90%).\n                  <\/jats:p>","DOI":"10.1038\/s41598-017-12320-8","type":"journal-article","created":{"date-parts":[[2017,9,14]],"date-time":"2017-09-14T07:50:41Z","timestamp":1505375441000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":281,"title":["Automatic Classification of Cancerous Tissue in Laserendomicroscopy Images of the Oral Cavity using Deep Learning"],"prefix":"10.1038","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5294-5247","authenticated-orcid":false,"given":"Marc","family":"Aubreville","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Knipfer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nicolai","family":"Oetter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Jaremenko","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik","family":"Rodner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joachim","family":"Denzler","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christopher","family":"Bohr","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Helmut","family":"Neumann","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Florian","family":"Stelzle","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andreas","family":"Maier","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2017,9,20]]},"reference":[{"key":"12320_CR1","doi-asserted-by":"publisher","first-page":"1890","DOI":"10.1056\/NEJMra001375","volume":"345","author":"A Forastiere","year":"2001","unstructured":"Forastiere, A., Koch, W., Trotti, A. & Sidransky, D. Head and Neck Cancer. The New England Journal of Medicine \n                           345, 1890\u20131900 (2001).","journal-title":"The New England Journal of Medicine"},{"key":"12320_CR2","doi-asserted-by":"publisher","first-page":"E359","DOI":"10.1002\/ijc.29210","volume":"136","author":"J Ferlay","year":"2014","unstructured":"Ferlay, J. et al. Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012. International Journal of Cancer \n                           136, E359\u2013E386 (2014).","journal-title":"International Journal of Cancer"},{"key":"12320_CR3","doi-asserted-by":"publisher","first-page":"1375","DOI":"10.1002\/cncr.20482","volume":"101","author":"M Muto","year":"2004","unstructured":"Muto, M. et al. Squamous cell carcinoma in situ at oropharyngeal and hypopharyngeal mucosal sites. Cancer \n                           101, 1375\u20131381 (2004).","journal-title":"Cancer"},{"key":"12320_CR4","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1016\/j.oraloncology.2005.05.001","volume":"42","author":"B Swinson","year":"2006","unstructured":"Swinson, B., Jerjes, W., El-Maaytah, M., Norris, P. & Hopper, C. Optical techniques in diagnosis of head and neck malignancy. Oral oncology \n                           42, 221\u2013228 (2006).","journal-title":"Oral oncology"},{"key":"12320_CR5","doi-asserted-by":"publisher","first-page":"3252","DOI":"10.1364\/BOE.5.003252","volume":"5","author":"C Knipfer","year":"2014","unstructured":"Knipfer, C. et al. Raman difference spectroscopy: a non-invasive method for identification of oral squamous cell carcinoma. Biomedical Optics Express \n                           5, 3252\u201314 (2014).","journal-title":"Biomedical Optics Express"},{"key":"12320_CR6","doi-asserted-by":"publisher","first-page":"400","DOI":"10.1159\/000081209","volume":"41","author":"E Laemmel","year":"2004","unstructured":"Laemmel, E. et al. Fibered confocal fluorescence microscopy (Cell-viZio) facilitates extended imaging in the field of microcirculation. A comparison with intravital microscopy. Journal of vascular research \n                           41, 400\u2013411 (2004).","journal-title":"Journal of vascular research"},{"key":"12320_CR7","first-page":"388","volume":"139","author":"H Neumann","year":"2010","unstructured":"Neumann, H., Kiesslich, R., Wallace, M. B. & Neurath, M. F. Confocal Laser Endomicroscopy: Technical Advances and Clinical Applications. YGAST \n                           139, 388\u2013392.e1-2 (2010).","journal-title":"YGAST"},{"key":"12320_CR8","doi-asserted-by":"publisher","first-page":"1275","DOI":"10.1055\/s-2006-944813","volume":"38","author":"A Hoffman","year":"2006","unstructured":"Hoffman, A. et al. Confocal laser endomicroscopy: technical status and current indications. Endoscopy \n                           38, 1275\u20131283 (2006).","journal-title":"Endoscopy"},{"key":"12320_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s12967-016-0919-4","volume":"14","author":"N Oetter","year":"2016","unstructured":"Oetter, N. et al. Development and validation of a classification and scoring system for the diagnosis of oral squamous cell carcinomas through confocal laser endomicroscopy. Journal of Translational Medicine \n                           14, 1\u201311 (2016).","journal-title":"Journal of Translational Medicine"},{"key":"12320_CR10","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1177\/0194599814528660","volume":"151","author":"CAO Nathan","year":"2014","unstructured":"Nathan, C. A. O. et al. Confocal Laser Endomicroscopy in the Detection of Head and Neck Precancerous Lesions. Otolaryngology \u2013 Head and Neck Surgery \n                           151, 73\u201380 (2014).","journal-title":"Otolaryngology \u2013 Head and Neck Surgery"},{"key":"12320_CR11","doi-asserted-by":"publisher","first-page":"737","DOI":"10.1113\/eph8702478","volume":"87.6","author":"F Helmchen","year":"2002","unstructured":"Helmchen, F. Miniaturization of fluorescence microscopes using fibre optics. Experimental Physiology \n                           87.6, 737\u2013745 (2002).","journal-title":"Experimental Physiology"},{"key":"12320_CR12","doi-asserted-by":"publisher","first-page":"128","DOI":"10.1002\/sca.4950100403","volume":"10","author":"M Minsky","year":"1988","unstructured":"Minsky, M. Memoir on inventing the confocal scanning microscope. Scanning \n                           10, 128\u2013138 (1988).","journal-title":"Scanning"},{"key":"12320_CR13","doi-asserted-by":"crossref","unstructured":"Abbaci, M., Breuskin, I., Casiraghi, O. & De Leeuw, F. Confocal laser endomicroscopy for non-invasive head and neck cancer imaging: a comprehensive review. Oral oncology (2014).","DOI":"10.1016\/j.oraloncology.2014.05.002"},{"key":"12320_CR14","first-page":"867","volume":"26","author":"H Neumann","year":"2011","unstructured":"Neumann, H., Vieth, M., Atreya, R., Neurath, M. F. & Mudter, J. Prospective evaluation of the learning curve of confocal laser endomicroscopy in patients with IBD. Histology and histopathology \n                           26, 867\u2013872 (2011).","journal-title":"Histology and histopathology"},{"key":"12320_CR15","doi-asserted-by":"publisher","first-page":"338","DOI":"10.1016\/j.gie.2010.10.002","volume":"73","author":"A Mennone","year":"2011","unstructured":"Mennone, A. & Nathanson, M. Needle-based confocal laser endomicroscopy to assess liver histology in vivo. Gastrointestinal Endoscopy \n                           73, 338\u2013344 (2011).","journal-title":"Gastrointestinal Endoscopy"},{"key":"12320_CR16","doi-asserted-by":"publisher","first-page":"5560","DOI":"10.3748\/wjg.v18.i39.5560","volume":"18","author":"B Andr\u00e9","year":"2012","unstructured":"Andr\u00e9, B. et al. Software for automated classification of probe-based confocal laser endomicroscopy videos of colorectal polyps. World journal of Gastroenterology \n                           18, 5560\u20135569 (2012).","journal-title":"World journal of Gastroenterology"},{"key":"12320_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2016\/6183218","volume":"2016","author":"A Kamen","year":"2016","unstructured":"Kamen, A. et al. Automatic Tissue Differentiation Based on Confocal Endomicroscopic Images for Intraoperative Guidance in Neurosurgery. BioMed Research International \n                           2016, 1\u20138 (2016).","journal-title":"BioMed Research International"},{"key":"12320_CR18","doi-asserted-by":"crossref","unstructured":"Veronese, E. et al. Hybrid patch-based and image-wide classification of confocal laser endomicroscopy images in Barrett\u2019s esophagus surveillance. In 2013 IEEE 10th International Symposium on Biomedical Imaging (ISBI 2013), 362\u2013365 (IEEE, 2013).","DOI":"10.1109\/ISBI.2013.6556487"},{"key":"12320_CR19","doi-asserted-by":"crossref","unstructured":"Jaremenko, C. et al. Classification of Confocal Laser Endomicroscopic Images of the Oral Cavity to Distinguish Pathological from Healthy Tissue. In Bildverarbeitung f\u00fcr die Medizin 2015, 479\u2013485 (Springer Berlin Heidelberg, 2015).","DOI":"10.1007\/978-3-662-46224-9_82"},{"key":"12320_CR20","doi-asserted-by":"publisher","first-page":"E1419","DOI":"10.1002\/hed.24253","volume":"38","author":"A Dittberner","year":"2016","unstructured":"Dittberner, A. et al. Automated analysis of confocal laser endomicroscopy images to detect head and neck cancer. Head & Neck \n                           38, E1419\u2013E1426 (2016).","journal-title":"Head & Neck"},{"key":"12320_CR21","unstructured":"Rodner, E. et al. Analysis and Classification of Microscopy Images with Cell Border Distance Statistics. In Jahrestagung der Deutschen Gesellschaft f\u00fcr Medizinische Physik DGMP, 1\u20132 (2015)."},{"key":"12320_CR22","doi-asserted-by":"publisher","first-page":"215","DOI":"10.1113\/jphysiol.1968.sp008455","volume":"195","author":"DH Hubel","year":"1968","unstructured":"Hubel, D. H. & Wiesel, T. N. Receptive fields and functional architecture of monkey striate cortex. The Journal of physiology \n                           195, 215\u2013243 (1968).","journal-title":"The Journal of physiology"},{"key":"12320_CR23","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1007\/s11263-015-0816-y","volume":"115","author":"O Russakovsky","year":"2015","unstructured":"Russakovsky, O., Deng, J., Su, H. & Krause, J. Imagenet large scale visual recognition challenge. International Journal of Computer Vision \n                           115, 211\u2013252 (2015).","journal-title":"International Journal of Computer Vision"},{"key":"12320_CR24","doi-asserted-by":"publisher","first-page":"1285","DOI":"10.1109\/TMI.2016.2528162","volume":"35","author":"H-C Shin","year":"2016","unstructured":"Shin, H.-C. et al. Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning. IEEE Transactions on Medical Imaging \n                           35, 1285\u20131298 (2016).","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"12320_CR25","doi-asserted-by":"publisher","first-page":"1170","DOI":"10.1109\/TMI.2015.2482920","volume":"35","author":"HR Roth","year":"2016","unstructured":"Roth, H. R. et al. Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation. IEEE Transactions on Medical Imaging \n                           35, 1170\u20131181 (2016).","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"12320_CR26","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature \n                           542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"12320_CR27","volume":"6","author":"G Litjens","year":"2016","unstructured":"Litjens, G. et al. Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis. Nature Publishing Group \n                           6, 26286 (2016).","journal-title":"Nature Publishing Group"},{"key":"12320_CR28","doi-asserted-by":"crossref","unstructured":"W\u00fcrfl, T., Ghesu, F. C., Christlein, V. & Maier, A. Deep Learning Computed Tomography. In Medical Image Computing and Computer-Assisted Intervention \u2013 MICCAI 2016, 432\u2013440 (Springer International Publishing, Cham, 2016).","DOI":"10.1007\/978-3-319-46726-9_50"},{"key":"12320_CR29","unstructured":"Aubreville, M. et al. Correlation-based Alignment of Raw Endoscopic Sequence Data with Physician Selected Movies. Workshop Germany Brazil 2016: Understanding the aggressiveness of cancer cells through novel imaging techniques (2016)."},{"key":"12320_CR30","doi-asserted-by":"publisher","first-page":"2037","DOI":"10.1109\/TPAMI.2006.244","volume":"28","author":"T Ahonen","year":"2006","unstructured":"Ahonen, T., Hadid, A. & Pietik\u00e4inen, M. Face Description with Local Binary Patterns: Application to Face Recognition. IEEE transactions on pattern analysis and machine intelligence \n                           28, 2037\u20132041 (2006).","journal-title":"IEEE transactions on pattern analysis and machine intelligence"},{"key":"12320_CR31","doi-asserted-by":"publisher","first-page":"117","DOI":"10.1016\/j.artmed.2010.02.006","volume":"49","author":"L Nanni","year":"2010","unstructured":"Nanni, L., Lumini, A. & Brahnam, S. Local binary patterns variants as texture descriptors for medical image analysis. Artificial intelligence in medicine \n                           49, 117\u2013125 (2010).","journal-title":"Artificial intelligence in medicine"},{"key":"12320_CR32","doi-asserted-by":"publisher","first-page":"610","DOI":"10.1109\/TSMC.1973.4309314","volume":"SMC-3","author":"RM Haralick","year":"1973","unstructured":"Haralick, R. M., Shanmugam, K. & Dinstein, I. Textural Features for Image Classification. IEEE Transactions on Systems, Man, and Cybernetics \n                           SMC-3, 610\u2013621 (1973).","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics"},{"key":"12320_CR33","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1109\/36.377929","volume":"33","author":"A Baraldi","year":"1995","unstructured":"Baraldi, A. & Parmiggiani, F. An investigation of the textural characteristics associated with gray level cooccurrence matrix statistical parameters. IEEE Transactions on Geoscience and Remote Sensing \n                           33, 293\u2013304 (1995).","journal-title":"IEEE Transactions on Geoscience and Remote Sensing"},{"key":"12320_CR34","doi-asserted-by":"crossref","unstructured":"Vo, K., Jaremenko, C., Maier, A., Neumann, H. & Bohr, C. Automatic Classification and Pathological Staging of Confocal Laser Endomicroscopic Images of the Vocal Cords. Bildverarbeitung f\u00fcr die Medizin 2017, 312 (Springer Berlin Heidelberg, 2017).","DOI":"10.1007\/978-3-662-54345-0_70"},{"key":"12320_CR35","doi-asserted-by":"publisher","first-page":"2278","DOI":"10.1109\/5.726791","volume":"86","author":"Y Lecun","year":"1998","unstructured":"Lecun, Y., Bottou, L., Bengio, Y. & Haffner, P. Gradient-based learning applied to document recognition. Proceedings of the IEEE \n                           86, 2278\u20132324 (1998).","journal-title":"Proceedings of the IEEE"},{"key":"12320_CR36","unstructured":"Abadi, M. et al. TensorFlow: A system for large-scale machine learning. ArXiv e-prints (2016)."},{"key":"12320_CR37","unstructured":"Kingma, D. & Ba, J. Adam: A method for stochastic optimization. ICLR 2015, reprint on arXiv.org (2014)."},{"key":"12320_CR38","doi-asserted-by":"crossref","unstructured":"Szegedy, C., Vanhoucke, V., Ioffe, S., Shlens, J. & Wojna, Z. Rethinking the Inception Architecture for Computer Vision. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2818\u20132826 (IEEE, 2016).","DOI":"10.1109\/CVPR.2016.308"},{"key":"12320_CR39","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. ImageNet: A Large-Scale Hierarchical Image Database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"12320_CR40","doi-asserted-by":"crossref","unstructured":"Aubreville, M. et al. Patch-based Carcinoma Detection on Confocal Laser Endomicroscopy Images - A Cross-Site Robustness Assessment. ArXiv e-prints (2017).","DOI":"10.5220\/0006534700270034"},{"key":"12320_CR41","doi-asserted-by":"crossref","unstructured":"Mualla, F., Sch\u00f6ll, S., Bohr, C., Neumann, H. & Maier, A. Epithelial Cell Detection in Endomicroscopy Images of the Vocal Folds. In International Multidisciplinary Microscopy Congress, 201\u2013205 (Springer International Publishing, Cham, 2014).","DOI":"10.1007\/978-3-319-04639-6_28"},{"key":"12320_CR42","doi-asserted-by":"crossref","unstructured":"Bier, B. et al. Band-Pass Filter Design by Segmentation in Frequency Domain for Detection of Epithelial Cells in Endomicroscope Images. In Bildverarbeitung f\u00fcr die Medizin 2015, 413\u2013418 (Springer Berlin Heidelberg, 2015).","DOI":"10.1007\/978-3-662-46224-9_71"},{"key":"12320_CR43","doi-asserted-by":"crossref","unstructured":"He, K., Zhang, X., Ren, S. & Sun, J. Deep Residual Learning for Image Recognition. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 770\u2013778 (IEEE, 2016).","DOI":"10.1109\/CVPR.2016.90"},{"key":"12320_CR44","doi-asserted-by":"publisher","first-page":"334","DOI":"10.1038\/nrclinonc.2013.64","volume":"10","author":"RL Keith","year":"2013","unstructured":"Keith, R. L. & Miller, Y. E. Lung cancer chemoprevention: current status and future prospects. Nature Reviews Clinical Oncology \n                           10, 334\u2013343 (2013).","journal-title":"Nature Reviews Clinical Oncology"},{"key":"12320_CR45","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1016\/j.jebdp.2013.10.006","volume":"13","author":"JL Cleveland","year":"2013","unstructured":"Cleveland, J. L. & Robison, V. A. Clinical oral examinations may not be predictive of dysplasia or oral squamous cell carcinoma. The journal of evidence-based dental practice \n                           13, 151\u2013154 (2013).","journal-title":"The journal of evidence-based dental practice"},{"key":"12320_CR46","first-page":"188","volume":"80","author":"LM Abbey","year":"1995","unstructured":"Abbey, L. M., Kaugars, G. E., Gunsolley, J. C. & Burns, J. C. Intraexaminer and interexaminer reliability in the diagnosis of oral epithelial dysplasia. Oral Surgery \n                           80, 188\u2013191 (1995).","journal-title":"Oral Surgery"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-12320-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-12320-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-12320-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T06:17:46Z","timestamp":1671776266000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-12320-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,9,20]]},"references-count":46,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["12320"],"URL":"https:\/\/doi.org\/10.1038\/s41598-017-12320-8","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,9,20]]},"assertion":[{"value":"14 March 2017","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 September 2017","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 September 2017","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}],"article-number":"11979"}}