{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T00:46:44Z","timestamp":1791420404217,"version":"4.3.3"},"reference-count":25,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2023,7,7]],"date-time":"2023-07-07T00:00:00Z","timestamp":1688688000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"funder":[{"DOI":"10.13039\/100019266","name":"Korea Medical Device Development Fund","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100019266","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Korea government","award":["1711197865"],"award-info":[{"award-number":["1711197865"]}]},{"name":"Korea government","award":["RS-2023-00223150"],"award-info":[{"award-number":["RS-2023-00223150"]}]},{"DOI":"10.13039\/501100003569","name":"Ministry of Food and Drug Safety","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003569","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:title>Summary<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objectives<\/jats:title>\n                    <jats:p>To compare the reliability, reproducibility, and time-based efficiency of automatic digital (AD) and manual digital (MD) model analyses using intraoral scan models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Material and methods<\/jats:title>\n                    <jats:p>Two examiners analysed 26 intraoral scanner records using MD and AD methods for orthodontic modelling. Tooth size reproducibility was confirmed using a Bland\u2013Altman plot. The Wilcoxon signed-rank test was conducted to compare the model analysis parameters (tooth size, sum of 12-teeth, Bolton analysis, arch width, arch perimeter, arch length discrepancy, and overjet\/overbite) for each method, including the time taken for model analysis.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The MD group exhibited a relatively larger spread of 95% agreement limits when compared with AD group. The standard deviations of repeated tooth measurements were 0.15 mm (MD group) and 0.08 mm (AD group). The mean difference values of the 12-tooth (1.80\u20132.38 mm) and arch perimeter (1.42\u20133.23 mm) for AD group was significantly (P &amp;lt; 0.001) larger than that for the MD group. The arch width, Bolton, and overjet\/overbite were clinically insignificant. The overall mean time required for the measurements was 8.62 min and 0.56 min for the MD and AD groups, respectively.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Limitations<\/jats:title>\n                    <jats:p>Validation results may vary in different clinical cases because our evaluation was limited to mild-to-moderate crowding in the complete dentition.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Significant differences were observed between AD and MD groups. The AD method demonstrated reproducible analysis in a considerably reduced timeframe, along with a significant difference in measurements compared to the MD method. Therefore, AD analysis should not be interchanged with MD, and vice versa.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/ejo\/cjad032","type":"journal-article","created":{"date-parts":[[2023,6,22]],"date-time":"2023-06-22T19:17:51Z","timestamp":1687461471000},"page":"712-721","source":"Crossref","is-referenced-by-count":20,"title":["Reliability and time-based efficiency of artificial intelligence-based automatic digital model analysis system"],"prefix":"10.1093","volume":"45","author":[{"given":"Jae-Hun","family":"Yu","sequence":"first","affiliation":[{"name":"Department of Orthodontics, Institute of Craniofacial Deformity, Yonsei University College of Dentistry , Seoul , Korea"},{"name":"BK21 FOUR Project, Yonsei University College of Dentistry , Seoul , Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ji-Hoi","family":"Kim","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Institute of Craniofacial Deformity, Yonsei University College of Dentistry , Seoul , Korea"},{"name":"BK21 FOUR Project, Yonsei University College of Dentistry , Seoul , Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jing","family":"Liu","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Institute of Craniofacial Deformity, Yonsei University College of Dentistry , Seoul , Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Utkarsh","family":"Mangal","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Institute of Craniofacial Deformity, Yonsei University College of Dentistry , Seoul , Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hee-Kap","family":"Ahn","sequence":"additional","affiliation":[{"name":"Department of Computer Science and Engineering, Graduate School of Artificial Intelligence, Pohang University of Science and Technology , Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8761-3819","authenticated-orcid":false,"given":"Jung-Yul","family":"Cha","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Institute of Craniofacial Deformity, Yonsei University College of Dentistry , Seoul , Korea"},{"name":"BK21 FOUR Project, Yonsei University College of Dentistry , Seoul , Korea"},{"name":"Institute for Innovation in Digital Healthcare, Yonsei University , Seoul , Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,7,7]]},"reference":[{"key":"2023113008163178700_CIT0001","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.ajodo.2015.06.029","article-title":"Diagnostic accuracy and measurement sensitivity of digital models for orthodontic purposes: a systematic review","volume":"149","author":"Rossini","year":"2016","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0002","doi-asserted-by":"crossref","first-page":"8414605","DOI":"10.1155\/2018\/8414605","article-title":"Model analysis of digital models in moderate to severe crowding: in vivo validation and clinical application","volume":"2018","author":"Yoon","year":"2018","journal-title":"Biomed Research International"},{"key":"2023113008163178700_CIT0003","doi-asserted-by":"crossref","first-page":"16.e1","DOI":"10.1016\/j.ajodo.2008.11.019","article-title":"Comparison of space analysis evaluations with digital models and plaster dental casts","volume":"136","author":"Leifert","year":"2009","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0004","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1016\/j.ajodo.2006.03.035","article-title":"Evaluation of a software program for applying the American Board of Orthodontics objective grading system to digital casts","volume":"133","author":"Hildebrand","year":"2008","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0005","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1016\/j.ajodo.2013.12.014","article-title":"Comparison of virtual and manual tooth setups with digital and plaster models in extraction cases","volume":"145","author":"Im","year":"2014","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0006","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1093\/ejo\/cjv001","article-title":"Reliability and validity of measurements on digital study models and plaster models","volume":"38","author":"Reuschl","year":"2016","journal-title":"European Journal of Orthodontics"},{"key":"2023113008163178700_CIT0007","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1016\/j.ajodo.2014.06.018","article-title":"Measurement of the buccolingual inclination of teeth: manual technique vs 3-dimensional software","volume":"146","author":"Nouri","year":"2014","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0008","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.ajodo.2011.12.028","article-title":"Accuracy and reproducibility of 3-dimensional digital model measurements","volume":"142","author":"Sousa","year":"2012","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0009","doi-asserted-by":"crossref","first-page":"903","DOI":"10.2319\/022019-127.1","article-title":"Automated identification of cephalometric landmarks: Part 1-Comparisons between the latest deep-learning methods YOLOV3 and SSD","volume":"89","author":"Park","year":"2019","journal-title":"Angle Orthodontist"},{"key":"2023113008163178700_CIT0010","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-022-13595-2","article-title":"Accuracy and efficiency of automatic tooth segmentation in digital dental models using deep learning","volume":"12","author":"Im","year":"2022","journal-title":"Scientific Reports"},{"key":"2023113008163178700_CIT0011","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1093\/ejo\/cjx040","article-title":"Intra-observer reliability and agreement of manual and digital orthodontic model analysis","volume":"40","author":"Koretsi","year":"2018","journal-title":"European Journal of Orthodontics"},{"key":"2023113008163178700_CIT0012","doi-asserted-by":"crossref","first-page":"3387","DOI":"10.1007\/s00784-018-2772-8","article-title":"Reliability and intra-examiner agreement of orthodontic model analysis with a digital caliper on plaster and printed dental models","volume":"23","author":"Koretsi","year":"2019","journal-title":"Clinical Oral Investigations"},{"key":"2023113008163178700_CIT0013","doi-asserted-by":"crossref","first-page":"382","DOI":"10.1016\/0002-9416(83)90322-6","article-title":"The analysis of errors in orthodontic measurements","volume":"83","author":"Houston","year":"1983","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0014","doi-asserted-by":"crossref","first-page":"886","DOI":"10.1016\/j.ajodo.2016.04.021","article-title":"Assessing agreement in measurements of orthodontic study models: digital caliper on plaster models vs 3-dimensional software on models scanned by structured-light scanner","volume":"150","author":"Hassan","year":"2016","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0015","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1007\/s10278-009-9211-y","article-title":"Orthodontic study cast analysis\u2014reproducibility of recordings and agreement between conventional and 3D virtual measurements","volume":"23","author":"Sj\u00f6gren","year":"2010","journal-title":"Journal of Digital Imaging"},{"key":"2023113008163178700_CIT0016","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"Journal of chiropractic medicine"},{"key":"2023113008163178700_CIT0017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1601-6343.2010.01503.x","article-title":"Orthodontic measurements on digital study models compared with plaster models: a systematic review","volume":"14","author":"Fleming","year":"2011","journal-title":"Orthodontics & Craniofacial Research"},{"key":"2023113008163178700_CIT0018","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/S0889-5406(03)00152-5","article-title":"Comparison of measurements made on digital and plaster models","volume":"124","author":"Santoro","year":"2003","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0019","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1016\/j.ajodo.2004.08.023","article-title":"Validity, reliability, and reproducibility of plaster vs digital study models: Comparison of peer assessment rating and Bolton analysis and their constituent measurements","volume":"129","author":"Stevens","year":"2006","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0020","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1016\/j.ajodo.2013.05.011","article-title":"Accuracy and reproducibility of dental replica models reconstructed by different rapid prototyping techniques","volume":"145","author":"Hazeveld","year":"2014","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163178700_CIT0021","doi-asserted-by":"crossref","first-page":"104819","DOI":"10.1016\/j.compbiomed.2021.104819","article-title":"Automatic recognition of landmarks on digital dental models","volume":"137","author":"Woodsend","year":"2021","journal-title":"Computers in Biology and Medicine"},{"key":"2023113008163178700_CIT0022","first-page":"444","article-title":"DentalPointNet: Landmark Localization on High-Resolution 3D Digital Dental Models","author":"Lang","year":"2022"},{"key":"2023113008163178700_CIT0023","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1007\/s00056-014-0217-9","article-title":"Comparison of orthodontic measurements on dental plaster casts and 3D scans","volume":"75","author":"Radeke","year":"2014","journal-title":"Journal of Orofacial Orthopedics"},{"key":"2023113008163178700_CIT0024","doi-asserted-by":"crossref","first-page":"304","DOI":"10.1177\/00220345211040459","article-title":"Toward clinically applicable 3-dimensional tooth segmentation via deep learning","volume":"101","author":"Hao","year":"2022","journal-title":"Journal of Dental Research"},{"key":"2023113008163178700_CIT0025","doi-asserted-by":"crossref","first-page":"101949","DOI":"10.1016\/j.media.2020.101949","article-title":"TSegNet: an efficient and accurate tooth segmentation network on 3D dental model","volume":"69","author":"Cui","year":"2021","journal-title":"Medical Image Analysis"}],"container-title":["European Journal of Orthodontics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ejo\/article-pdf\/45\/6\/712\/53878916\/cjad032.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ejo\/article-pdf\/45\/6\/712\/53878916\/cjad032.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,30]],"date-time":"2023-11-30T03:16:53Z","timestamp":1701314213000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ejo\/article\/45\/6\/712\/7221306"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,7,7]]},"references-count":25,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,7,7]]},"published-print":{"date-parts":[[2023,11,30]]}},"URL":"https:\/\/doi.org\/10.1093\/ejo\/cjad032","relation":{},"ISSN":["0141-5387","1460-2210"],"issn-type":[{"value":"0141-5387","type":"print"},{"value":"1460-2210","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2023,12,1]]},"published":{"date-parts":[[2023,7,7]]}}}