{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T10:02:13Z","timestamp":1788343333986,"version":"build-2803163510"},"reference-count":37,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T00:00:00Z","timestamp":1691712000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,8,11]],"date-time":"2023-08-11T00:00:00Z","timestamp":1691712000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Oral Health"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>Introducing artificial intelligence (AI) into the medical field proved beneficial in automating tasks and streamlining the practitioners\u2019 lives. Hence, this study was conducted\u00a0to design and evaluate an AI tool called\u00a0Make Sure Caries Detector and Classifier (MSc)\u00a0for detecting pathological exposure of pulp on digital periapical radiographs and to compare its performance with dentists.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This study was a diagnostic, multi-centric study, with 3461 digital periapical radiographs from three countries and seven centers. MSc was built using Yolov5-x model, and it was used for exposed and unexposed pulp detection. The dataset was split into a train, validate, and test dataset; the\u00a0ratio was 8\u20131-1 to prevent overfitting. 345 images with 752 labels were randomly allocated to test MSc. The performance metrics used to test MSc performance included mean average precision (mAP), precision, F1 score, recall, and area under receiver operating characteristic curve (AUC). The metrics used to compare the performance with that of 10 certified dentists were: right diagnosis exposed (RDE), right diagnosis not exposed (RDNE), false diagnosis exposed (FDE), false diagnosis not exposed (FDNE), missed diagnosis (MD), and over diagnosis (OD).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      MSc achieved a performance of more than 90% in all metrics examined: an average precision of 0.928, recall of 0.918, F1-score of 0.922, and AUC of 0.956 (\n                      <jats:italic>P<\/jats:italic>\n                      &lt;.05). The results showed a higher mean of 1.94 for all right (correct) diagnosis parameters in MSc group, while a higher mean of 0.64 for all wrong diagnosis parameters in the dentists group (\n                      <jats:italic>P<\/jats:italic>\n                      &lt;.05).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The designed MSc tool proved itself reliable in the detection and differentiating between exposed and unexposed pulp in the internally validated model. It also showed a better performance for the detection of exposed and unexposed pulp when compared to the 10 dentists\u2019 consensus.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12903-023-03251-0","type":"journal-article","created":{"date-parts":[[2023,8,10]],"date-time":"2023-08-10T20:02:03Z","timestamp":1691697723000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["Detection of the pathological exposure of pulp using an artificial intelligence tool: a multicentric study over periapical radiographs"],"prefix":"10.1186","volume":"23","author":[{"given":"A.","family":"Altukroni","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A.","family":"Alsaeedi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"C.","family":"Gonzalez-Losada","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J. H.","family":"Lee","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M.","family":"Alabudh","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M.","family":"Mirah","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S.","family":"El-Amri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"O.","family":"Ezz El-Deen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2023,8,11]]},"reference":[{"key":"3251_CR1","unstructured":"Gil AMC, Gispert AE\u00c1. General remarks about minimal intervention dentistry. Rev Cubana Estomatol. 2016;53(2):37\u201344."},{"key":"3251_CR2","doi-asserted-by":"crossref","unstructured":"Leite AF, Vasconcelos KF, Willems H, Jacobs R. Radiomics and machine learning in oral healthcare. Proteomics Clin Appl. 2020;14(3):e1900040.","DOI":"10.1002\/prca.201900040"},{"key":"3251_CR3","doi-asserted-by":"crossref","unstructured":"Lee JH, Kim DH, Jeong SN, Choi SH. Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm. J Dent. 2018;77:106\u201311.","DOI":"10.1016\/j.jdent.2018.07.015"},{"key":"3251_CR4","doi-asserted-by":"publisher","first-page":"347","DOI":"10.4067\/S0718-381X2017000300347","volume":"3","author":"J Estay","year":"2017","unstructured":"Estay J, Bersezio C, Arias R, Fern\u00e1ndez E, Oliveira Junior OB, Ferrarezi de Andrade M. Effect of Clinical Experience on Accuracy and Reliability of Radiographic Caries Detection. Int J Odontostomatol. 2017;3:347\u201352.","journal-title":"Int J Odontostomatol"},{"key":"3251_CR5","doi-asserted-by":"crossref","unstructured":"Diniz MB, Rodrigues JA, Neuhaus KW, Cordeiro RC, Lussi A. Influence of examiner's clinical experience on the reproducibility and accuracy of radiographic examination in detecting occlusal caries. Clin Oral Investig. 2010;14(5):515\u201323.","DOI":"10.1007\/s00784-009-0323-z"},{"key":"3251_CR6","doi-asserted-by":"crossref","unstructured":"Shams N, Panahandeh N, Aghababa H, Shams B, Hemati E. Effects of education and experience on detection of proximal caries on digital radiographs. Oral Radiol. 2015;32(3):154\u20139.","DOI":"10.1007\/s11282-015-0227-3"},{"key":"3251_CR7","doi-asserted-by":"publisher","first-page":"763","DOI":"10.21037\/atm-21-119","volume":"9","author":"L Zheng","year":"2021","unstructured":"Zheng L, Wang H, Mei L, Chen Q, Zhang Y, Zhang H. Artificial intelligence in digital cariology: a new tool for the diagnosis of deep caries and pulpitis using convolutional neural networks. Ann Transl Med. 2021;9:763.","journal-title":"Ann Transl Med"},{"key":"3251_CR8","doi-asserted-by":"publisher","first-page":"24","DOI":"10.1038\/s41591-018-0316-z","volume":"1","author":"A Esteva","year":"2019","unstructured":"Esteva A, Robicquet A, Ramsundar B, Kuleshov V, DePristo M, Chou K, et al. A guide to deep learning in healthcare. Nat Med. 2019;1:24\u20139.","journal-title":"Nat Med"},{"issue":"22","key":"3251_CR9","doi-asserted-by":"publisher","first-page":"2199","DOI":"10.1001\/jama.2017.14585","volume":"318","author":"B Ehteshami Bejnordi","year":"2017","unstructured":"Bejnordi B Ehteshami, Veta M, van P Johannes Diest, van B Ginneken, Karssemeijer N, Litjens G, et al. Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer. JAMA. 2017;318(22):2199\u2013210.","journal-title":"JAMA"},{"key":"3251_CR10","doi-asserted-by":"crossref","unstructured":"Wang X, Peng Y, Lu L, Lu Z, Bagheri M, Summers RM. Chestx-ray8: hospital-scale chest x-ray database and benchmarks on weakly-supervised classification and localization of common thorax diseases. Honolulu: IEEE Conference on Computer Vision and Pattern Recognition (CVPR); 2017. p. 3462\u201371.","DOI":"10.1109\/CVPR.2017.369"},{"key":"3251_CR11","doi-asserted-by":"publisher","first-page":"15001","DOI":"10.1088\/1361-6579\/aaf34d","volume":"1","author":"N Strodthoff","year":"2019","unstructured":"Strodthoff N, Strodthoff C. Detecting and interpreting myocardial infarction using fully convolutional neural networks. Physiol Meas. 2019;1:15001.","journal-title":"Physiol Meas"},{"issue":"3 Pt B","key":"3251_CR12","doi-asserted-by":"publisher","first-page":"504","DOI":"10.1016\/j.jacr.2017.12.026","volume":"15","author":"JH Thrall","year":"2018","unstructured":"Thrall JH, Li X, Li Q, Cruz C, Do S, Dreyer K. Artificial Intelligence and Machine Learning in Radiology: Opportunities, Challenges, Pitfalls, and Criteria for Success. J Am Coll Radiol. 2018;15(3 Pt B):504\u20138.","journal-title":"J Am Coll Radiol"},{"key":"3251_CR13","doi-asserted-by":"crossref","unstructured":"Bluemke DA, Moy L, Bredella MA, Ertl-Wagner BB, Fowler KJ, Goh VJ, Halpern EF, Hess CP, Schiebler ML, Weiss CR. Assessing radiology research on artificial intelligence: a brief guide for authors, reviewers, and readers-from the radiology editorial board. Radiology. 2020;294(3):487\u20139.","DOI":"10.1148\/radiol.2019192515"},{"key":"3251_CR14","doi-asserted-by":"publisher","first-page":"33","DOI":"10.3348\/kjr.2019.0312","volume":"1","author":"S Do","year":"2020","unstructured":"Do S, Song KD, Chung JW. Basics of Deep Learning: A Radiologist\u2019s Guide to Understanding Published Radiology Articles on Deep Learning. Korean J Radiol. 2020;1:33\u201341.","journal-title":"Korean J Radiol"},{"key":"3251_CR15","doi-asserted-by":"publisher","first-page":"590","DOI":"10.1148\/radiol.2018180547","volume":"3","author":"S Soffer","year":"2019","unstructured":"Soffer S, Ben-Cohen A, Shimon O, Amitai MM, Greenspan H, Klang E. Convolutional Neural Networks for Radiologic Images: A Radiologist\u2019s Guide. Radiology. 2019;3:590\u2013606.","journal-title":"Radiology"},{"key":"3251_CR16","doi-asserted-by":"publisher","first-page":"20190107","DOI":"10.1259\/dmfr.20190107","volume":"1","author":"K Hung","year":"2020","unstructured":"Hung K, Montalvao C, Tanaka R, Kawai T, Bornstein MM. The use and performance of artificial intelligence applications in dental and maxillofacial radiology: A systematic review. Dentomaxillofac Radiol. 2020;1:20190107.","journal-title":"Dentomaxillofac Radiol"},{"key":"3251_CR17","doi-asserted-by":"publisher","first-page":"81","DOI":"10.5624\/isd.2020.50.2.81","volume":"2","author":"R Nagi","year":"2020","unstructured":"Nagi R, Aravinda K, Rakesh N, Gupta R, Pal A, Mann AK. Clinical applications and performance of intelligent systems in dental and maxillofacial radiology: A review. Imaging Sci Dent. 2020;2:81\u201392.","journal-title":"Imaging Sci Dent"},{"key":"3251_CR18","doi-asserted-by":"publisher","first-page":"8","DOI":"10.1007\/s13755-019-0096-y","volume":"1","author":"V Geetha","year":"2020","unstructured":"Geetha V, Aprameya KS, Hinduja DM. Dental caries diagnosis in digital radiographs using back-propagation neural network. Heal Inf Sci Syst. 2020;1:8.","journal-title":"Heal Inf Sci Syst"},{"key":"3251_CR19","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1016\/j.tripleo.2008.03.002","volume":"6","author":"KL Devito","year":"2008","unstructured":"Devito KL, de Souza BF, Felippe Filho WN. An artificial multilayer perceptron neural network for diagnosis of proximal dental caries. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 2008;6:879\u201384.","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol Endod"},{"key":"3251_CR20","doi-asserted-by":"crossref","unstructured":"Yu Y, Li Y, Li Y-J, Wang JM, Lin DH, Ye WP. Tooth decay diagnosis using back propagation neural network. Dalian: In proceedings of the 2006 international conference on machine learning and cybernetics; 2006. p. 3956\u20139.","DOI":"10.1109\/ICMLC.2006.258789"},{"key":"3251_CR21","doi-asserted-by":"crossref","unstructured":"Li W, Kuang W, Li Y, Li YJ, Ye WP: Clinical X-ray image based tooth decay diagnosis using SVM. Proceedings of international conference on machine learning and cybernetics. 2007:1616\u201319.","DOI":"10.1109\/ICMLC.2007.4370404"},{"key":"3251_CR22","unstructured":"Ali RB, Ejbali R, Zaied M. Detection and classification of dental caries in x-ray images using deep neural networks. International conference on software engineering advances. 2016:223\u20137."},{"key":"3251_CR23","doi-asserted-by":"crossref","unstructured":"Singh P, Sehgal P. Automated caries detection based on radon transformation and DCT. 2017 8th international conference on computing, communication and networking technologies (ICCCNT). 2017:1\u20136.","DOI":"10.1109\/ICCCNT.2017.8204030"},{"key":"3251_CR24","doi-asserted-by":"publisher","first-page":"826","DOI":"10.1148\/radiol.2015151516","volume":"3","author":"PM Bossuyt","year":"2015","unstructured":"Bossuyt PM, Reitsma JB, Bruns DE, Bruns DE, Glasziou PP, Irwig L, et al. STARD 2015: An updated list of essential items for reporting diagnostic accuracy studies1. Radiology. 2015;3:826\u201332.","journal-title":"Radiology"},{"key":"3251_CR25","doi-asserted-by":"crossref","unstructured":"Schwendicke F, Singh T, Lee JH, Gaudin R, Chaurasia A, Wiegand T, Uribe S, Krois J. IADR e-oral health network and the ITU WHO focus group AI for Health. Artificial intelligence in dental research: Checklist for authors, reviewers, readers. J Dent. 2021;107:103610.","DOI":"10.1016\/j.jdent.2021.103610"},{"key":"3251_CR26","doi-asserted-by":"crossref","unstructured":"Kim JE, Nam NE, Shim JS, Jung YH, Cho BH, Hwang JJ. Transfer learning via deep neural networks for implant fixture system classification using periapical radiographs. J Clin Med. 2020;9(4):1117.","DOI":"10.3390\/jcm9041117"},{"key":"3251_CR27","doi-asserted-by":"publisher","first-page":"193","DOI":"10.5624\/isd.2020.50.3.193","volume":"3","author":"J Sur","year":"2020","unstructured":"Sur J, Bose S, Khan F, Dewangan D, Sawriya E, Roul A. Knowledge, attitudes, and perceptions regarding the future of artificial intelligence in oral radiology in India: A survey. Imaging Sci Dent. 2020;3:193.","journal-title":"Imaging Sci Dent"},{"key":"3251_CR28","doi-asserted-by":"crossref","unstructured":"Lian L, Zhu T, Zhu F, Zhu H. Deep learning for caries detection and classification. Diagnostics (Basel). 2021;11(9):1672.","DOI":"10.3390\/diagnostics11091672"},{"key":"3251_CR29","first-page":"1","volume":"11","author":"M Prados-Privado","year":"2020","unstructured":"Prados-Privado M, Villal\u00f3n JG, Mart\u00ednez-Mart\u00ednez CH, Ivorra C, Prados-Frutos JC. Dental caries diagnosis and detection using neural networks: A systematic review. J Clin Med. 2020;11:1\u201313.","journal-title":"J Clin Med"},{"key":"3251_CR30","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1177\/0022034520915714","volume":"7","author":"F Schwendicke","year":"2020","unstructured":"Schwendicke F, Samek W, Krois J. Artificial Intelligence in Dentistry: Chances and Challenges. J Dent Res. 2020;7:769\u201374.","journal-title":"J Dent Res"},{"key":"3251_CR31","doi-asserted-by":"crossref","unstructured":"Berdouses ED, Koutsouri GD, Tripoliti EE, Matsopoulos GK, Oulis CJ, Fotiadis DI. A computer-aided automated methodology for the detection and classification of occlusal caries from photographic color images. Comput Biol Med. 2015;119\u201335.","DOI":"10.1016\/j.compbiomed.2015.04.016"},{"key":"3251_CR32","doi-asserted-by":"crossref","unstructured":"K\u00fchnisch J, Meyer O, Hesenius M, Hickel R, Gruhn V. Caries detection on intraoral images using artificial intelligence. J Dent Res. 2022;101(2):158\u201365.","DOI":"10.1177\/00220345211032524"},{"key":"3251_CR33","first-page":"1315","volume":"9","author":"JN Mandrekar","year":"2010","unstructured":"Mandrekar JN. Receiver operating characteristic curve in diagnostic test assessment. J Thorac Oncol Off Publ Int Assoc Study Lung Cancer. 2010;9:1315\u20136.","journal-title":"J Thorac Oncol Off Publ Int Assoc Study Lung Cancer"},{"key":"3251_CR34","doi-asserted-by":"crossref","unstructured":"Prajapati SA, Nagaraj R, Mitra S. Classification of dental diseases using CNN and transfer learning. Proceedings of the 2017 5th International Symposium on Computational and Business Intelligence (ISCBI), Dubai, United Arab Emirates. 2017:70\u20134.","DOI":"10.1109\/ISCBI.2017.8053547"},{"key":"3251_CR35","doi-asserted-by":"crossref","unstructured":"Cantu AG, Gehrung S, Krois J, Chaurasia A, Rossi JG, Gaudin R, Elhennawy K, Schwendicke F. Detecting caries lesions of different radiographic extension on bitewings using deep learning. J Dent. 2020;100:103425.","DOI":"10.1016\/j.jdent.2020.103425"},{"key":"3251_CR36","doi-asserted-by":"publisher","DOI":"10.1007\/b97636","volume-title":"Model Selection and Multimodel Inference","author":"KP Burnham","year":"2004","unstructured":"Burnham KP, Anderson DR. Model Selection and Multimodel Inference. New York, NY, USA: Springer; 2004. (978-0-387-95364-9."},{"key":"3251_CR37","doi-asserted-by":"crossref","unstructured":"Mutasa S, Sun S, Ha R. Understanding artificial intelligence based radiology studies: What is overfitting? Clin Imaging. 2020;65:96-9.","DOI":"10.1016\/j.clinimag.2020.04.025"}],"container-title":["BMC Oral Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12903-023-03251-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12903-023-03251-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12903-023-03251-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,17]],"date-time":"2023-11-17T14:05:56Z","timestamp":1700229956000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcoralhealth.biomedcentral.com\/articles\/10.1186\/s12903-023-03251-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,11]]},"references-count":37,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["3251"],"URL":"https:\/\/doi.org\/10.1186\/s12903-023-03251-0","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-2629211\/v1","asserted-by":"object"}]},"ISSN":["1472-6831"],"issn-type":[{"value":"1472-6831","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,11]]},"assertion":[{"value":"26 February 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 July 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"11 August 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The study protocol was approved by the IRB in the local committee for ethics of health and scientific research in health affairs in Medina region (IRB 25\/2021), Daejeon Dental Hospital, Wonkwang University College of Dentistry, and Complutense University of Madrid Informed consent was waived by the IRB in the local committee for ethics of health and scientific research in health affairs in Medina region (IRB 25\/2021) due to retrospective nature of the study. All methods were performed in accordance with the Declaration of Helsinki.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"553"}}