{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T06:13:22Z","timestamp":1788416002358,"version":"build-2803163510"},"reference-count":28,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T00:00:00Z","timestamp":1788393600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004489","name":"Mitacs","doi-asserted-by":"publisher","award":["IT41257"],"award-info":[{"award-number":["IT41257"]}],"id":[{"id":"10.13039\/501100004489","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Oral Health"],"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Artificial intelligence (AI)-based tooth segmentation has the potential to improve the efficiency and consistency of digital clinical workflows; however, the generalizability of commercially available algorithms on clinical datasets and their interpretability remain limited.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>This study proposed a two-level evaluation method. It evaluated the performance of a black-box commercial algorithm using an expert-annotated clinical reference dataset of 126 intraoral scans representing diverse clinical presentations, including severe crowding, spacing, missing teeth, and dental restorations. Two specialists independently generated reference annotations. In the next level, a transparent two-stage segmentation method combining YOLOv8-based tooth localization and numbering with a 3D U-Net segmentation model was developed using 80 scans from an open-source dataset and evaluated alongside the commercial algorithm. Performance was evaluated using the Dice Similarity Coefficient (DSC) and tooth classification accuracy. Tooth detection and numbering were assessed descriptively using confusion matrices and accuracy. End-to-end segmentation performance was compared at the scan level using paired parametric or nonparametric tests, depending on the distribution of paired differences. Regional performance differences between anterior and posterior regions and between maxillary and mandibular jaws were assessed using independent parametric or nonparametric tests, as appropriate.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The commercial algorithm achieved significantly higher segmentation performance than the transparent model, with a median DSC of 0.90 (IQR 0.86\u20130.95) versus 0.76 (IQR 0.66\u20130.84), respectively (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&amp;lt;\u20090.001). In contrast, the transparent model showed tooth-numbering accuracy of 0.92 versus 0.83. No significant differences in DSC were observed between anterior and posterior regions for either algorithm. Maxillary and mandibular performance did not differ significantly for the commercial algorithm, whereas the transparent model performed significantly better in the mandible.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Discussion<\/jats:title>\n                    <jats:p>The commercial algorithm demonstrated strong segmentation performance on an independent, expert-annotated clinical dataset. Although the transparent approach achieved lower segmentation accuracy, it offered greater methodological transparency and insight into decision-making.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.3389\/froh.2026.1923460","type":"journal-article","created":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T05:22:12Z","timestamp":1788412932000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Validation of a commercial intraoral auto-segmentation algorithm against expert-annotated clinical data with comparison to a transparent algorithm"],"prefix":"10.3389","volume":"7","author":[{"given":"Rojin","family":"Adabdokht","sequence":"first","affiliation":[{"name":"Mike Petryk School of Dentistry, Faculty of Medicine & Dentistry, University of Alberta","place":["Edmonton, Alberta, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Manuel","family":"Lagravere Vich","sequence":"additional","affiliation":[{"name":"Mike Petryk School of Dentistry, Faculty of Medicine & Dentistry, University of Alberta","place":["Edmonton, Alberta, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thanandon","family":"Imaromkul","sequence":"additional","affiliation":[{"name":"Tomorrow Smile Digital Healthcare LTD","place":["Vancouver, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kridsada","family":"Tosakparalerd","sequence":"additional","affiliation":[{"name":"Tomorrow Smile Digital Healthcare LTD","place":["Vancouver, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Victor","family":"de Miranda Ladewig","sequence":"additional","affiliation":[{"name":"Mike Petryk School of Dentistry, Faculty of Medicine & Dentistry, University of Alberta","place":["Edmonton, Alberta, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wenji","family":"Cai","sequence":"additional","affiliation":[{"name":"Mike Petryk School of Dentistry, Faculty of Medicine & Dentistry, University of Alberta","place":["Edmonton, Alberta, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chitian","family":"Ji","sequence":"additional","affiliation":[{"name":"Mike Petryk School of Dentistry, Faculty of Medicine & Dentistry, University of Alberta","place":["Edmonton, Alberta, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hollis","family":"Lai","sequence":"additional","affiliation":[{"name":"Mike Petryk School of Dentistry, Faculty of Medicine & Dentistry, University of Alberta","place":["Edmonton, Alberta, Canada"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2026,9,3]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"804","DOI":"10.1186\/s12903-024-04582-2","article-title":"Convolutional neural network for automated tooth segmentation on intraoral scans","volume":"24","author":"Wang","year":"2024","journal-title":"BMC Oral Health"},{"key":"B2","doi-asserted-by":"publisher","first-page":"105323","DOI":"10.1016\/j.jdent.2024.105323","article-title":"Automated monitoring of tooth wear progression using AI on intraoral scans","volume":"150","author":"van Nistelrooij","year":"2024","journal-title":"J Dent"},{"key":"B3","doi-asserted-by":"publisher","first-page":"282","DOI":"10.1016\/j.ajodo.2024.05.015","article-title":"Evaluation of the accuracy of automated tooth segmentation of intraoral scans using artificial intelligence-based software packages","volume":"166","author":"Yacout","year":"2024","journal-title":"Am J Orthod Dentofacial Orthop"},{"key":"B4","doi-asserted-by":"publisher","first-page":"3158","DOI":"10.1109\/TMI.2022.3180343","article-title":"Two-Stage mesh deep learning for automated tooth segmentation and landmark localization on 3D intraoral scans","volume":"41","author":"Wu","year":"2022","journal-title":"IEEE Trans Med Imaging"},{"key":"B5","doi-asserted-by":"publisher","first-page":"111050","DOI":"10.1016\/j.jss.2021.111050","article-title":"Systematic literature review of validation methods for AI systems","volume":"181","author":"Myllyaho","year":"2021","journal-title":"J Syst Softw"},{"key":"B6","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.acra.2019.09.009","article-title":"The algorithmic audit: working with vendors to validate radiology-AI algorithms\u2014how we do it","volume":"27","author":"Mahajan","year":"2020","journal-title":"Acad Radiol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"e53207","DOI":"10.2196\/53207","article-title":"How explainable artificial intelligence can increase or decrease Clinicians\u2019 trust in AI applications in health care: systematic review","volume":"3","author":"Rosenbacke","year":"2024","journal-title":"JMIR AI"},{"key":"B8","doi-asserted-by":"publisher","first-page":"101805","DOI":"10.1016\/j.inffus.2023.101805","article-title":"Explainable artificial intelligence (XAI): what we know and what is left to attain trustworthy artificial intelligence","volume":"99","author":"Ali","year":"2023","journal-title":"Inf Fusion"},{"key":"B9","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1016\/0164-1212(84)90030-X","article-title":"Development and application of a white box approach to integration testing","volume":"4","author":"Haley","year":"1984","journal-title":"J Syst Softw"},{"key":"B10","first-page":"1","article-title":"A critical analysis of the limitation of deep learning based 3D dental mesh segmentation methods in segmenting partial scans","author":"Jana","year":"2023"},{"key":"B11","doi-asserted-by":"publisher","first-page":"107821","DOI":"10.1016\/j.compbiomed.2023.107821","article-title":"A fine-grained orthodontics segmentation model for 3D intraoral scan data","volume":"168","author":"Li","year":"2024","journal-title":"Comput Biol Med"},{"key":"B12","doi-asserted-by":"publisher","first-page":"945","DOI":"10.1016\/S0895-7177(03)90079-3","article-title":"Analysis of STL files","volume":"38","author":"Szilv\u015bi-Nagy","year":"2003","journal-title":"Math Comput Model"},{"key":"B13","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1148\/rg.331125023","article-title":"Informatics in radiology: what can you see in a single glance and how might this guide visual search in medical images?","volume":"33","author":"Drew","year":"2013","journal-title":"RadioGraphics"},{"key":"B14","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1016\/j.acra.2019.08.018","article-title":"A review of perceptual expertise in radiology-how it develops, how we can test it, and why humans still matter in the era of artificial intelligence","volume":"27","author":"Waite","year":"2020","journal-title":"Acad Radiol"},{"key":"B15","volume-title":"Ultralytics YOLO26: Unified real-time end-to-end vision models","author":"Jocher","year":"2026"},{"key":"B16","author":"\u00c7i\u00e7ek","year":"2016"},{"key":"B17","author":"Dawson-Haggerty","year":"2019"},{"key":"B18","volume-title":"Roboflow (Version 1.0) [Software]","author":"Dwyer","year":"2024"},{"key":"B19","author":"He","year":"2015"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1152","DOI":"10.3390\/su8111152","article-title":"How to assess market readiness for an innovative solution: the case of heat recovery technologies for SMEs","volume":"8","author":"Solberg Hjorth","year":"2016","journal-title":"Sustainability"},{"key":"B21","doi-asserted-by":"publisher","first-page":"1267","DOI":"10.3390\/bioengineering11121267","article-title":"Artificial intelligence in dentistry: a descriptive review","volume":"11","author":"Mallineni","year":"2024","journal-title":"Bioengineering"},{"key":"B22","doi-asserted-by":"publisher","first-page":"2760","DOI":"10.3390\/diagnostics13172760","article-title":"Redefining radiology: a review of artificial intelligence integration in medical imaging","volume":"13","author":"Najjar","year":"2023","journal-title":"Diagnostics"},{"key":"B23","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1186\/s13104-022-06096-y","article-title":"Towards a guideline for evaluation metrics in medical image segmentation","volume":"15","author":"M\u00fcller","year":"2022","journal-title":"BMC Res Notes"},{"key":"B24","doi-asserted-by":"publisher","first-page":"110280","DOI":"10.1016\/j.mri.2024.110280","article-title":"Manual data labeling, radiology, and artificial intelligence: it is a dirty job, but someone has to do it","volume":"116","author":"Mart\u00edn-Noguerol","year":"2025","journal-title":"Magn Reson Imaging"},{"key":"B25","doi-asserted-by":"publisher","first-page":"e200029","DOI":"10.1148\/ryai.2020200029","article-title":"Checklist for artificial intelligence in medical imaging (CLAIM): a guide for authors and reviewers","volume":"2","author":"Mongan","year":"2020","journal-title":"Radiol Artif Intell"},{"key":"B26","doi-asserted-by":"publisher","first-page":"e0282402","DOI":"10.1371\/journal.pone.0282402","article-title":"Classification performance bias between training and test sets in a limited mammography dataset","volume":"19","author":"Hou","year":"2024","journal-title":"PLoS One"},{"key":"B27","doi-asserted-by":"publisher","first-page":"S0939388925000777","DOI":"10.1016\/j.zemedi.2025.04.008","article-title":"Comparative analysis of open-source against commercial AI-based segmentation models for online adaptive MR-guided radiotherapy","author":"Langner","year":"2025","journal-title":"Z F\u00fcr Med Phys"},{"key":"B28","doi-asserted-by":"publisher","first-page":"5397","DOI":"10.1109\/TCYB.2020.2980145","article-title":"3D RoI-aware U-net for accurate and efficient colorectal tumor segmentation","volume":"51","author":"Huang","year":"2021","journal-title":"IEEE Trans Cybern"}],"container-title":["Frontiers in Oral Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/froh.2026.1923460\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T05:22:13Z","timestamp":1788412933000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/froh.2026.1923460\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,3]]},"references-count":28,"alternative-id":["10.3389\/froh.2026.1923460"],"URL":"https:\/\/doi.org\/10.3389\/froh.2026.1923460","relation":{},"ISSN":["2673-4842"],"issn-type":[{"value":"2673-4842","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,3]]},"article-number":"1923460"}}