{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,27]],"date-time":"2026-10-27T09:12:28Z","timestamp":1793092348248,"version":"4.5.0"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T00:00:00Z","timestamp":1629331200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["51772144"],"award-info":[{"award-number":["51772144"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Project of Invigorating Health Care through Science, Technology and Education Jiangsu Provincial Medical Youth Talent","award":["QNRC2016120"],"award-info":[{"award-number":["QNRC2016120"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Routine dental visit is the most common approach to detect the gingivitis. However, such diagnosis can sometimes be unavailable due to the limited medical resources in certain areas and costly for low-income populations. This study proposes to screen the existence of gingivitis and its irritants, i.e., dental calculus and soft deposits, from oral photos with a novel Multi-Task Learning convolutional neural network (CNN) model. The study can be meaningful for promoting the public dental health, since it sheds light on a cost-effective and ubiquitous solution for the early detection of dental issues. With 625 patients included in this study, the classification Area Under the Curve (AUC) for detecting gingivitis, dental calculus and soft deposits were 87.11%, 80.11%, and 78.57%, respectively; Meanwhile, according to our experiments, the model can also localize the three types of findings on oral photos with moderate accuracy, which enables the model to explain the screen results. By comparing to general-purpose CNNs, we showed our model significantly outperformed on both classification and localization tasks, which indicates the effectiveness of Multi-Task Learning on dental disease detection. In all, the study shows the potential of deep learning for enabling the screening of dental diseases among large populations.<\/jats:p>","DOI":"10.1038\/s41598-021-96091-3","type":"journal-article","created":{"date-parts":[[2021,8,19]],"date-time":"2021-08-19T06:30:05Z","timestamp":1629354605000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":64,"title":["A deep learning approach to automatic gingivitis screening based on classification and localization in RGB photos"],"prefix":"10.1038","volume":"11","author":[{"given":"Wen","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuan","family":"Liang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuan","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chao","family":"Liu","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lei","family":"He","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Leiying","family":"Miao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weibin","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,8,19]]},"reference":[{"key":"96091_CR1","doi-asserted-by":"publisher","first-page":"83","DOI":"10.1111\/idh.12078","volume":"13","author":"SC Supranoto","year":"2015","unstructured":"Supranoto, S. C., Slot, D. E., Addy, M. & Ga, V. D. W. The effect of chlorhexidine dentifrice or gel versus chlorhexidine mouthwash on plaque, gingivitis, bleeding and tooth discoloration: A systematic review. Int. J. Dental Hygiene 13, 83\u201392 (2015).","journal-title":"Int. J. Dental Hygiene"},{"key":"96091_CR2","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1177\/0022034516677938","volume":"96","author":"S Miyauchi","year":"2017","unstructured":"Miyauchi, S. et al. Sphingomyelin phosphodiesterase 3 enhances cytodifferentiation of periodontal ligament cells. J. Dent. Res. 96, 339\u2013346 (2017).","journal-title":"J. Dent. Res."},{"key":"96091_CR3","first-page":"661","volume":"83","author":"PE Petersen","year":"2005","unstructured":"Petersen, P. E., Bourgeois, D., Ogawa, H., Estupinan-Day, S. & Ndiaye, C. The global burden of oral diseases and risks to oral health. Bull. World Health Organ. 83, 661\u2013669 (2005).","journal-title":"Bull. World Health Organ."},{"key":"96091_CR4","doi-asserted-by":"publisher","first-page":"101694","DOI":"10.1016\/j.artmed.2019.07.002","volume":"99","author":"YP Liu","year":"2019","unstructured":"Liu, Y. P. et al. Referable diabetic retinopathy identification from eye fundus images with weighted path for convolutional neural network. Artif. Intell. Med. 99, 101694 (2019).","journal-title":"Artif. Intell. Med."},{"key":"96091_CR5","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.media.2017.07.005","volume":"42","author":"G Litjens","year":"2017","unstructured":"Litjens, G. et al. A survey on deep learning in medical image analysis. Med. Image Anal. 42, 60\u201388 (2017).","journal-title":"Med. Image Anal."},{"key":"96091_CR6","doi-asserted-by":"publisher","first-page":"1562","DOI":"10.1109\/TMI.2018.2791721","volume":"37","author":"G Wang","year":"2018","unstructured":"Wang, G. et al. Interactive medical image segmentation using deep learning with image-specific fine tuning. IEEE Trans. Med. Imaging. 37, 1562\u20131573 (2018).","journal-title":"IEEE Trans. Med. Imaging."},{"key":"96091_CR7","first-page":"20","volume":"1","author":"A Mariakakis","year":"2017","unstructured":"Mariakakis, A. et al. Biliscreen: Smartphone-based scleral jaundice monitoring for liver and pancreatic disorders. Proc. ACM Interact. Mobile Wearable Ubiquitous Technol. 1, 20 (2017).","journal-title":"Proc. ACM Interact. Mobile Wearable Ubiquitous Technol."},{"key":"96091_CR8","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1080\/02763869.2012.724287","volume":"31","author":"E Vardell","year":"2012","unstructured":"Vardell, E. & Bou-Crick, C. VisualDx: A visual diagnostic decision support tool. Med. Ref. Serv. 31, 414\u2013424 (2012).","journal-title":"Med. Ref. Serv."},{"key":"96091_CR9","first-page":"81","volume":"1","author":"A Mariakakis","year":"2017","unstructured":"Mariakakis, A. et al. PupilScreen: Using smartphones to assess traumatic brain injury. Proc. ACM Interact. Mobile Wearable Ubiquitous Technol. 1, 81 (2017).","journal-title":"Proc. ACM Interact. Mobile Wearable Ubiquitous Technol."},{"key":"96091_CR10","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1038\/s41598-019-44839-3","volume":"9","author":"J Krois","year":"2019","unstructured":"Krois, J. et al. Deep learning for the radiographic detection of periodontal bone loss. Sci. Rep. 9, 84\u201395 (2019).","journal-title":"Sci. Rep."},{"key":"96091_CR11","doi-asserted-by":"publisher","first-page":"1227","DOI":"10.1177\/0022034519871884","volume":"98","author":"F Casalegno","year":"2019","unstructured":"Casalegno, F. et al. Caries detection with near-infrared transillumination using deep learning. J. Dent. Res. 98, 1227\u20131233 (2019).","journal-title":"J. Dent. Res."},{"key":"96091_CR12","doi-asserted-by":"publisher","first-page":"114","DOI":"10.5051\/jpis.2018.48.2.114","volume":"48","author":"JH Lee","year":"2018","unstructured":"Lee, J. H., Kim, D. H., Jeong, S. N. & Choi, S. H. Diagnosis and prediction of periodontally compromised teeth using a deep learning-based convolutional neural network algorithm. J. Periodontal Implant Sci. 48, 114\u2013123 (2018).","journal-title":"J. Periodontal Implant Sci."},{"key":"96091_CR13","doi-asserted-by":"publisher","first-page":"249","DOI":"10.1177\/0022034520901715","volume":"99","author":"HJ Yu","year":"2020","unstructured":"Yu, H. J. et al. Automated skeletal classification with lateral cephalometry based on artificial intelligence. J. Dent. Res. 99, 249\u2013256 (2020).","journal-title":"J. Dent. Res."},{"key":"96091_CR14","doi-asserted-by":"publisher","first-page":"1455","DOI":"10.1016\/j.acra.2007.08.006","volume":"14","author":"SG Armato","year":"2007","unstructured":"Armato, S. G. et al. The lung image database consortium (LIDC): Ensuring the integrity of expert-defined \u201ctruth\u201d1. Acad. Radiol. 14, 1455\u20131463 (2007).","journal-title":"Acad. Radiol."},{"key":"96091_CR15","doi-asserted-by":"crossref","unstructured":"Ranjan, R., Sankar, S., Castillo, C. D. & Chellappa, R. An all-in-one convolutional neural network for face analysis. In 2017 IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017), pp. 17\u201324 (IEEE, 2017).","DOI":"10.1109\/FG.2017.137"},{"key":"96091_CR16","doi-asserted-by":"crossref","unstructured":"Bansal, A., Nanduri, A., Castillo, C., Ranjan, R. & Chellappa, R. Umdfaces: An annotated face dataset for training deep networks. In 2016 IEEE International Joint Conference on Biometrics (IJCB), (IEEE, 2016).","DOI":"10.1109\/BTAS.2017.8272731"},{"key":"96091_CR17","first-page":"1097","volume":"25","author":"A Krizhevsky","year":"2012","unstructured":"Krizhevsky, A., Sutskever, I. & Hinton, G. E. Imagenet classification with deep convolutional neural networks. Adv. Neural. Inf. Process. Syst. 25, 1097\u20131105 (2012).","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"96091_CR18","doi-asserted-by":"crossref","unstructured":"Liu, W., Anguelov, D., Erhan, D., Szegedy, C. & Berg, A. C. SSD: Single shot multibox detector. In European Conference on Computer Vision, pp. 21\u201337 (Springer, 2016).","DOI":"10.1007\/978-3-319-46448-0_2"},{"key":"96091_CR19","unstructured":"Simonyan, K. & Zisserman, A. Very deep convolutional networks for large scale image recognition. Computer Science. arXiv preprint  arXiv:1409.1556 (2014)."},{"key":"96091_CR20","doi-asserted-by":"crossref","unstructured":"Selvaraju, R.R. et al. Grad-cam: Visual explanations from deep networks via gradient-based localization. In Proceedings of the IEEE International Conference on Computer Vision, pp. 42\u201348 (IEEE, 2017).","DOI":"10.1109\/ICCV.2017.74"},{"key":"96091_CR21","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1038\/nature21056","volume":"542","author":"A Esteva","year":"2017","unstructured":"Esteva, A. et al. Dermatologist-level classification of skin cancer with deep neural networks. Nature 542, 115\u2013118 (2017).","journal-title":"Nature"},{"key":"96091_CR22","doi-asserted-by":"crossref","unstructured":"Redmon, J. & Farhadi, A. YOLO9000: better, faster, stronger. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7263\u20137271 (IEEE, 2017).","DOI":"10.1109\/CVPR.2017.690"},{"key":"96091_CR23","doi-asserted-by":"crossref","unstructured":"Deng, J. et al. Imagenet: a large scalehierarchical image database. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 643\u2013651 (IEEE, 2009).","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"96091_CR24","doi-asserted-by":"publisher","first-page":"707","DOI":"10.1016\/j.media.2010.05.005","volume":"14","author":"B van Ginneken","year":"2010","unstructured":"van Ginneken, B. et al. Comparing and combining algorithms for computer-aided detection of pulmonary nodules in computed tomography scans: The ANODE09 study. Med. Image Anal. 14, 707\u2013722 (2010).","journal-title":"Med. Image Anal."},{"key":"96091_CR25","doi-asserted-by":"publisher","first-page":"2113","DOI":"10.1148\/rg.2017170077","volume":"37","author":"G Chartrand","year":"2017","unstructured":"Chartrand, G. et al. Deep learning: A primer for radiologists. Radiographics 37, 2113\u20132131 (2017).","journal-title":"Radiographics"},{"issue":"5","key":"96091_CR26","doi-asserted-by":"publisher","first-page":"1127","DOI":"10.1109\/TMI.2017.2789181","volume":"37","author":"Z Wang","year":"2018","unstructured":"Wang, Z. et al. Automated detection of clinically significant prostate cancer in mp-MRI images based on an end-to-end deep neural network. IEEE Trans. Med. Imaging 37(5), 1127\u20131139 (2018).","journal-title":"IEEE Trans. Med. Imaging"},{"issue":"7","key":"96091_CR27","doi-asserted-by":"publisher","first-page":"915","DOI":"10.1016\/j.acra.2013.03.001","volume":"20","author":"DP Chakraborty","year":"2013","unstructured":"Chakraborty, D. P. A brief history of free-response receiver operating characteristic paradigm data analysis. Acad. Radiol. 20(7), 915\u2013919 (2013).","journal-title":"Acad. Radiol."},{"key":"96091_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.media.2017.06.015","volume":"42","author":"AA Setio","year":"2017","unstructured":"Setio, A. A. et al. Validation, comparison, and combination of algorithms for automatic detection of pulmonary nodules in computed tomography images: The LUNA16 challenge. Med. Image Anal. 42, 1\u201313 (2017).","journal-title":"Med. Image Anal."},{"issue":"3","key":"96091_CR29","doi-asserted-by":"publisher","first-page":"036501","DOI":"10.1117\/1.JMI.5.3.036501","volume":"5","author":"K Yan","year":"2018","unstructured":"Yan, K., Wang, X., Lu, L. & Summers, R. M. DeepLesion: Automated mining of large-scale lesion annotations and universal lesion detection with deep learning. J. Med. Imaging 5(3), 036501 (2018).","journal-title":"J. Med. Imaging"},{"key":"96091_CR30","doi-asserted-by":"publisher","first-page":"2402","DOI":"10.1001\/jama.2016.17216","volume":"316","author":"V Gulshan","year":"2016","unstructured":"Gulshan, V. et al. Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs. JAMA 316, 2402\u20132410 (2016).","journal-title":"JAMA"},{"key":"96091_CR31","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1167\/9.2.9","volume":"9","author":"M De Vrijer","year":"2009","unstructured":"De Vrijer, M., Medendorp, W. P. & Van Gisbergen, J. A. M. Accuracy-precision trade-off in visual orientation constancy. J. Vis. 9, 9\u20139 (2009).","journal-title":"J. Vis."},{"key":"96091_CR32","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.dsp.2017.10.011","volume":"73","author":"G Montavon","year":"2018","unstructured":"Montavon, G., Samek, W. & M\u00fcller, K. R. Methods for interpreting and understanding deep neural networks. Digit. Signal Process. 73, 1\u201315 (2018).","journal-title":"Digit. Signal Process."},{"key":"96091_CR33","doi-asserted-by":"publisher","first-page":"9289","DOI":"10.1038\/s41598-020-62971-3","volume":"10","author":"A Jalali","year":"2020","unstructured":"Jalali, A. et al. Deep learning for improved risk prediction in surgical outcomes. Sci Rep. 10, 9289 (2020).","journal-title":"Sci Rep."},{"issue":"60","key":"96091_CR34","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1111\/j.1600-0757.2012.00446.x","volume":"2000","author":"ED Beltr\u00e1n-Aguilar","year":"2012","unstructured":"Beltr\u00e1n-Aguilar, E. D., Eke, P. I., Thornton-Evans, G. & Petersen, P. E. Recording and surveillance systems for periodontal diseases. Periodontol. 2000(60), 40\u201353 (2012).","journal-title":"Periodontol."},{"key":"96091_CR35","doi-asserted-by":"publisher","first-page":"1041","DOI":"10.1177\/0022034513505621","volume":"92","author":"PI Eke","year":"2013","unstructured":"Eke, P. I. et al. Self-reported measures for surveillance of periodontitis. J. Dent. Res. 92, 1041\u20131047 (2013).","journal-title":"J. Dent. Res."},{"key":"96091_CR36","volume-title":"Explaining Explanations: An Overview of Interpretability of Machine Learning","author":"LH Gilpin","year":"2018","unstructured":"Gilpin, L. H. et al. Explaining Explanations: An Overview of Interpretability of Machine Learning (Computer Science and Artificial Intelligence Laboratory Massachusetts Institute of Technology Cambridge, 2018)."},{"key":"96091_CR37","doi-asserted-by":"crossref","unstructured":"Khoreva, A., Benenson, R., Hosang, J., Hein, M. & Schiele, B. Simple does it: Weakly supervised instance and semantic segmentation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.  825\u2013833 (IEEE, 2016).","DOI":"10.1109\/CVPR.2017.181"},{"key":"96091_CR38","doi-asserted-by":"crossref","unstructured":"Bai, W. et al. Semi-supervised learning for network-based cardiac MR image segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 253\u2013260 (Springer, 2017).","DOI":"10.1007\/978-3-319-66185-8_29"},{"key":"96091_CR39","doi-asserted-by":"publisher","first-page":"280","DOI":"10.1016\/j.media.2019.03.009","volume":"54","author":"V Cheplygina","year":"2019","unstructured":"Cheplygina, V., de Bruijne, M. & Pluim, J. P. W. Not-so-supervised: A survey of semi-supervised, multi-instance, and transfer learning in medical image analysis. Med. Image Anal. 54, 280\u2013296 (2019).","journal-title":"Med. Image Anal."},{"key":"96091_CR40","first-page":"456","volume":"4","author":"E Choi","year":"2018","unstructured":"Choi, E., Xiao, C., Stewart, W. F. & Sun, J. Mime: Multilevel medical embedding of electronic health records for predictive healthcare. Adv. Neural. Inf. Process. Syst. 4, 456\u2013461 (2018).","journal-title":"Adv. Neural. Inf. Process. Syst."},{"key":"96091_CR41","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","volume":"25","author":"A Esteva","year":"2019","unstructured":"Esteva, A. et al. A guide to deep learning in healthcare. Nat. Med. 25, 24\u201329 (2019).","journal-title":"Nat. Med."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-96091-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-96091-3","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-96091-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,3]],"date-time":"2022-12-03T07:52:17Z","timestamp":1670053937000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-021-96091-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,8,19]]},"references-count":41,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2021,12]]}},"alternative-id":["96091"],"URL":"https:\/\/doi.org\/10.1038\/s41598-021-96091-3","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-117989\/v1","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,8,19]]},"assertion":[{"value":"29 November 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 July 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 August 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"16831"}}