{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,7]],"date-time":"2026-11-07T11:13:04Z","timestamp":1794049984779,"version":"4.8.0"},"reference-count":28,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:00:00Z","timestamp":1710720000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T00:00:00Z","timestamp":1710720000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["321408-IPN\u00c6RINGSLIV20"],"award-info":[{"award-number":["321408-IPN\u00c6RINGSLIV20"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["321408-IPN\u00c6RINGSLIV20"],"award-info":[{"award-number":["321408-IPN\u00c6RINGSLIV20"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["321408-IPN\u00c6RINGSLIV20"],"award-info":[{"award-number":["321408-IPN\u00c6RINGSLIV20"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["321408-IPN\u00c6RINGSLIV20"],"award-info":[{"award-number":["321408-IPN\u00c6RINGSLIV20"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["321408-IPN\u00c6RINGSLIV20"],"award-info":[{"award-number":["321408-IPN\u00c6RINGSLIV20"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["321408-IPN\u00c6RINGSLIV20"],"award-info":[{"award-number":["321408-IPN\u00c6RINGSLIV20"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005416","name":"Norges Forskningsr\u00e5d","doi-asserted-by":"publisher","award":["321408-IPN\u00c6RINGSLIV20"],"award-info":[{"award-number":["321408-IPN\u00c6RINGSLIV20"]}],"id":[{"id":"10.13039\/501100005416","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100024102","name":"SINTEF","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100024102","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Oral Health"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Dental caries diagnosis requires the manual inspection of diagnostic bitewing images of the patient, followed by a visual inspection and probing of the identified dental pieces with potential lesions. Yet the use of artificial intelligence, and in particular deep-learning, has the potential to aid in the diagnosis by providing a quick and informative analysis of the bitewing images.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>A dataset of 13,887 bitewings from the HUNT4 Oral Health Study were annotated individually by six different experts, and used to train three different object detection deep-learning architectures: RetinaNet (ResNet50), YOLOv5 (M size), and EfficientDet (D0 and D1 sizes). A consensus dataset of 197 images, annotated jointly by the same six dental clinicians, was used for evaluation. A five-fold cross validation scheme was used to evaluate the performance of the AI models.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The trained models show an increase in average precision and F1-score, and decrease of false negative rate, with respect to the dental clinicians. When compared against the dental clinicians, the YOLOv5 model shows the largest improvement, reporting 0.647 mean average precision, 0.548 mean F1-score, and 0.149 mean false negative rate. Whereas the best annotators on each of these metrics reported 0.299, 0.495, and 0.164 respectively.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>Deep-learning models have shown the potential to assist dental professionals in the diagnosis of caries. Yet, the task remains challenging due to the artifacts natural to the bitewing images.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12903-024-04120-0","type":"journal-article","created":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T02:01:58Z","timestamp":1710727318000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":58,"title":["AI-Dentify: deep learning for proximal caries detection on bitewing x-ray - HUNT4 Oral Health Study"],"prefix":"10.1186","volume":"24","author":[{"given":"Javier","family":"P\u00e9rez de Frutos","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ragnhild","family":"Holden Helland","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shreya","family":"Desai","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Line Cathrine","family":"Nymoen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas","family":"Lang\u00f8","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Theodor","family":"Remman","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Abhijit","family":"Sen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,3,18]]},"reference":[{"key":"4120_CR1","volume-title":"Global oral health status report: towards universal health coverage for oral health by 2030","author":"WH Organisation","year":"2022","unstructured":"Organisation WH. Global oral health status report: towards universal health coverage for oral health by 2030. Geneva: World Health Organization; 2022."},{"issue":"2","key":"4120_CR2","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1038\/sj.ebd.6401166","volume":"17","author":"F Schwendicke","year":"2016","unstructured":"Schwendicke F, Tzschoppe M, Paris S. Accuracy of dental radiographs for caries detection. Evid-Based Dent. 2016;17(2):43. https:\/\/doi.org\/10.1038\/sj.ebd.6401166.","journal-title":"Evid-Based Dent."},{"key":"4120_CR3","doi-asserted-by":"publisher","unstructured":"Schwendicke F, G\u00f6stemeyer G. Conventional bitewing radiography. Clin Dent Rev. 2020;4(1):22. https:\/\/doi.org\/10.1007\/s41894-020-00086-8.","DOI":"10.1007\/s41894-020-00086-8"},{"issue":"6","key":"4120_CR4","doi-asserted-by":"publisher","first-page":"879","DOI":"10.1016\/J.TRIPLEO.2008.03.002","volume":"106","author":"KL Devito","year":"2008","unstructured":"Devito KL, de Souza Barbosa F, Filho WNF. An artificial multilayer perceptron neural network for diagnosis of proximal dental caries. Oral Surg Oral Med Oral Pathol Oral Radiol Endod. 2008;106(6):879\u201384. https:\/\/doi.org\/10.1016\/J.TRIPLEO.2008.03.002.","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol Endod."},{"key":"4120_CR5","doi-asserted-by":"publisher","first-page":"119","DOI":"10.1016\/J.COMPBIOMED.2015.04.016","volume":"62","author":"ED Berdouses","year":"2015","unstructured":"Berdouses ED, Koutsouri GD, Tripoliti EE, Matsopoulos GK, Oulis CJ, Fotiadis DI. A computer-aided automated methodology for the detection and classification of occlusal caries from photographic color images. Comput Biol Med. 2015;62:119\u201335. https:\/\/doi.org\/10.1016\/J.COMPBIOMED.2015.04.016.","journal-title":"Comput Biol Med."},{"key":"4120_CR6","doi-asserted-by":"publisher","unstructured":"Singh P, Sehgal P. Automated caries detection based on Radon transformation and DCT. 8th International Conference on Computing, Communications and Networking Technologies, ICCCNT 2017. 2017. https:\/\/doi.org\/10.1109\/ICCCNT.2017.8204030.","DOI":"10.1109\/ICCCNT.2017.8204030"},{"issue":"1","key":"4120_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.5624\/isd.2019.49.1.1","volume":"49","author":"JJ Hwang","year":"2019","unstructured":"Hwang JJ, Jung YH, Cho BH, Heo MS. An overview of deep learning in the field of dentistry. Imaging Sci Dent. 2019;49(1):1. https:\/\/doi.org\/10.5624\/isd.2019.49.1.1.","journal-title":"Imaging Sci Dent."},{"issue":"11","key":"4120_CR8","doi-asserted-by":"publisher","first-page":"3579","DOI":"10.3390\/jcm9113579","volume":"9","author":"M Prados-Privado","year":"2020","unstructured":"Prados-Privado M, Garc\u00eda Villal\u00f3n J, Mart\u00ednez-Mart\u00ednez CH, Ivorra C, Prados-Frutos JC. Dental Caries Diagnosis and Detection Using Neural Networks: A Systematic Review. J Clin Med. 2020;9(11):3579. https:\/\/doi.org\/10.3390\/jcm9113579.","journal-title":"J Clin Med."},{"key":"4120_CR9","doi-asserted-by":"publisher","first-page":"103226","DOI":"10.1016\/j.jdent.2019.103226","volume":"91","author":"F Schwendicke","year":"2019","unstructured":"Schwendicke F, Golla T, Dreher M, Krois J. Convolutional neural networks for dental image diagnostics: A scoping review. J Dent. 2019;91:103226. https:\/\/doi.org\/10.1016\/j.jdent.2019.103226.","journal-title":"J Dent."},{"issue":"1","key":"4120_CR10","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1007\/S11265-016-1214-6\/FIGURES\/10","volume":"90","author":"J Choi","year":"2018","unstructured":"Choi J, Eun H, Kim C. Boosting Proximal Dental Caries Detection via Combination of Variational Methods and Convolutional Neural Network. J Signal Process Syst. 2018;90(1):87\u201397. https:\/\/doi.org\/10.1007\/S11265-016-1214-6\/FIGURES\/10.","journal-title":"J Signal Process Syst."},{"key":"4120_CR11","unstructured":"Srivastava MM, Kumar P, Pradhan L, Varadarajan S. Detection of Tooth caries in Bitewing Radiographs using Deep Learning. 2017. arXiv preprint arXiv:1711.07312."},{"key":"4120_CR12","doi-asserted-by":"publisher","first-page":"106","DOI":"10.1016\/J.JDENT.2018.07.015","volume":"77","author":"JH Lee","year":"2018","unstructured":"Lee JH, Kim DH, Jeong SN, Choi SH. Detection and diagnosis of dental caries using a deep learning-based convolutional neural network algorithm. J Dent. 2018;77:106\u201311. https:\/\/doi.org\/10.1016\/J.JDENT.2018.07.015.","journal-title":"J Dent."},{"key":"4120_CR13","doi-asserted-by":"publisher","unstructured":"Lee S, Oh Si, Jo J, Kang S, Shin Y, Park Jw. Deep learning for early dental caries detection in bitewing radiographs. Sci Rep. 2021;11(1):16807. https:\/\/doi.org\/10.1038\/s41598-021-96368-7.","DOI":"10.1038\/s41598-021-96368-7"},{"key":"4120_CR14","doi-asserted-by":"publisher","first-page":"103425","DOI":"10.1016\/j.jdent.2020.103425","volume":"100","author":"AG Cantu","year":"2020","unstructured":"Cantu AG, Gehrung S, Krois J, Chaurasia A, Rossi JG, Gaudin R, et al. Detecting caries lesions of different radiographic extension on bitewings using deep learning. J Dent. 2020;100:103425. https:\/\/doi.org\/10.1016\/j.jdent.2020.103425.","journal-title":"J Dent."},{"issue":"1","key":"4120_CR15","doi-asserted-by":"publisher","first-page":"573","DOI":"10.1186\/s12903-022-02589-1","volume":"22","author":"EY Park","year":"2022","unstructured":"Park EY, Cho H, Kang S, Jeong S, Kim EK. Caries detection with tooth surface segmentation on intraoral photographic images using deep learning. BMC Oral Health. 2022;22(1):573. https:\/\/doi.org\/10.1186\/s12903-022-02589-1.","journal-title":"BMC Oral Health."},{"key":"4120_CR16","unstructured":"Godfellow I, Bengio Y, Courville A. Deep Learning. MIT Press; 2016. http:\/\/www.deeplearningbook.org\/."},{"issue":"4","key":"4120_CR17","doi-asserted-by":"publisher","first-page":"968","DOI":"10.1093\/ije\/dys095","volume":"42","author":"S Krokstad","year":"2012","unstructured":"Krokstad S, Langhammer A, Hveem K, Holmen T, Midthjell K, Stene T, et al. Cohort Profile: The HUNT Study. Norway Int J Epidemiol. 2012;42(4):968\u201377. https:\/\/doi.org\/10.1093\/ije\/dys095.","journal-title":"Norway. Int J Epidemiol."},{"issue":"9","key":"4120_CR18","doi-asserted-by":"publisher","first-page":"1189","DOI":"10.1111\/jcpe.13507","volume":"48","author":"IH St\u00f8dle","year":"2021","unstructured":"St\u00f8dle IH, Verket A, H\u00f8vik H, Sen A, Koldsland OC. Prevalence of periodontitis based on the 2017 classification in a Norwegian population: The HUNT study. J Clin Periodontol. 2021;48(9):1189\u201399. https:\/\/doi.org\/10.1111\/jcpe.13507.","journal-title":"J Clin Periodontol."},{"issue":"3","key":"4120_CR19","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1080\/00016357.2022.2117735","volume":"81","author":"SC R\u00f8dseth","year":"2022","unstructured":"R\u00f8dseth SC, H\u00f8vik H, Schuller AA, Skudutyte-Rysstad R. Dental caries in a Norwegian adult population, the HUNT4 oral health study; prevalence, distribution and 45-year trends. Acta Odontol Scand. 2022;81(3):202\u201310. https:\/\/doi.org\/10.1080\/00016357.2022.2117735.","journal-title":"Acta Odontol Scand."},{"key":"4120_CR20","doi-asserted-by":"publisher","unstructured":"Smistad E, \u00d8stvik A, Lovstakken L. Annotation Web - An open-source web-based annotation tool for ultrasound images. 2021. p. 1\u20134. https:\/\/doi.org\/10.1109\/IUS52206.2021.9593336.","DOI":"10.1109\/IUS52206.2021.9593336"},{"key":"4120_CR21","unstructured":"Westberg TE, D\u00f8ving LM, Bj\u00f8rg A. Kliniske rutiner- Kariologi. 2010. https:\/\/www.odont.uio.no\/iko\/om\/organisasjon\/fagavd\/kariologi-gerodontologi\/rutiner-metoder\/.\u00a0Accessed 12\/07\/2021."},{"key":"4120_CR22","doi-asserted-by":"publisher","unstructured":"Hansson HH, Espelid I. Kan vi stole p\u00e5 kariesregistreringen? Validering av to visuelle indekser for registrering av okklusalkaries basert p\u00e5 ekstraherte tenner. Nor Tannlegeforen Tid. 2012;(122):676\u2013682. https:\/\/doi.org\/10.56373\/2012-9-11.","DOI":"10.56373\/2012-9-11"},{"key":"4120_CR23","doi-asserted-by":"crossref","unstructured":"Lin TY, Goyal P, Girshick R, He K, Doll\u00e1r P. Focal Loss for Dense Object Detection. 2017. arXiv preprint arXiv:1708.02002.","DOI":"10.1109\/ICCV.2017.324"},{"key":"4120_CR24","doi-asserted-by":"publisher","unstructured":"Jocher G, Chaurasia A, Stoken A, Borovec J, NanoCode012, Kwon Y, et\u00a0al. ultralytics\/yolov5: v7.0 - YOLOv5 SOTA Realtime Instance Segmentation. 2022. https:\/\/doi.org\/10.5281\/ZENODO.7347926.","DOI":"10.5281\/ZENODO.7347926"},{"key":"4120_CR25","doi-asserted-by":"publisher","unstructured":"Tan M, Pang R, Le QV. EfficientDet: Scalable and efficient object detection. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. 2020. p. 10778\u201310787. https:\/\/doi.org\/10.1109\/CVPR42600.2020.01079.","DOI":"10.1109\/CVPR42600.2020.01079"},{"key":"4120_CR26","doi-asserted-by":"publisher","unstructured":"Georgieva VM, Mihaylova AD, Petrov PP. An application of dental X-ray image enhancement. 2017 13th International Conference on Advanced Technologies, Systems and Services in Telecommunications, TELSIKS. 2017. p. 447\u2013450. https:\/\/doi.org\/10.1109\/TELSKS.2017.8246321.","DOI":"10.1109\/TELSKS.2017.8246321"},{"key":"4120_CR27","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511802843","volume-title":"Boostrap methods and their applications","author":"AC Davison","year":"1997","unstructured":"Davison AC, Hinkley DV. Boostrap methods and their applications. New York: Cambridge University Press; 1997."},{"issue":"3","key":"4120_CR28","doi-asserted-by":"publisher","first-page":"279","DOI":"10.3390\/ELECTRONICS10030279","volume":"10","author":"R Padilla","year":"2021","unstructured":"Padilla R, Passos WL, Dias TLB, Netto SL, Da Silva EAB. A comparative analysis of object detection metrics with a companion open-source toolkit. Electronics. 2021;10(3):279. https:\/\/doi.org\/10.3390\/ELECTRONICS10030279.","journal-title":"Electronics."}],"container-title":["BMC Oral Health"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12903-024-04120-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12903-024-04120-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12903-024-04120-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,3,18]],"date-time":"2024-03-18T02:02:07Z","timestamp":1710727327000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcoralhealth.biomedcentral.com\/articles\/10.1186\/s12903-024-04120-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,3,18]]},"references-count":28,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["4120"],"URL":"https:\/\/doi.org\/10.1186\/s12903-024-04120-0","relation":{},"ISSN":["1472-6831"],"issn-type":[{"value":"1472-6831","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,3,18]]},"assertion":[{"value":"30 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 March 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"18 March 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Ethical approval has already been granted by the Regional Ethical Committee (REK) based in central Norway (project number 64645), and also had approval from Norsk Senter for Forskningsdata (reference number 718269). In the HUNT4 Oral Health Study, written and signed consent was acquired from the participants\u00a0[].","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare the following financial interest\/personal relationships that may be considered as potential competing interests: SD is employee at Boneprox A.B., and TR is CEO of Boneprox A.S., and is co-founder of Boneprox A.S.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"344"}}