{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T23:27:35Z","timestamp":1786750055984,"version":"build-2736575974"},"reference-count":43,"publisher":"Georg Thieme Verlag KG","license":[{"start":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T00:00:00Z","timestamp":1786665600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Eur J Dent"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>This systematic review aimed to evaluate the performance and clinical validation of artificial intelligence (AI) and rule-based methods for skeletal maturation assessment using cervical vertebral maturation (CVM) and hand\u2013wrist radiography. The review was conducted in accordance with the PRISMA 2020 guidelines and registered in PROSPERO. The PICOS framework guided selection of experimental, randomized controlled, and observational studies that applied AI to radiographic images of the cervical vertebrae or hand\u2013wrist region. Eligible studies compared AI-derived classifications with expert assessments. Studies based on non-radiographic indicators, non-English publications, and investigations not involving AI methodologies were excluded. A systematic search was performed in PubMed, Scopus, EBSCOhost, and SpringerLink for articles published between 2015 and 2025. The methodological quality and risk of bias were evaluated using the QUADAS-2 tool. For CVM-based studies reporting sufficient quantitative data, a random-effects meta-analysis with restricted maximum likelihood (REML) estimation was performed using logit-transformed accuracy proportions. Heterogeneity was assessed using the Q statistic and the I\n               2 index. Studies based on hand\u2013wrist radiography were excluded from the quantitative synthesis due to heterogeneity in outcome measures and the limited number of studies. Seven studies met the eligibility criteria, including five that used lateral cephalograms for CVM analysis and two that used hand\u2013wrist radiographs for skeletal age estimation. CVM-based models demonstrated moderate to high diagnostic performance, with reported accuracy or agreement ranging from 60.4 to 82.8%, and kappa values reaching 0.985. These findings corresponded to a pooled accuracy of 80%. When compared with human observer assessments, several CVM-based models achieved comparable levels of agreement in selected studies. However, their performance remained variable across validation settings. Hand\u2013wrist-based models showed consistently high agreement with human observers, with correlation coefficients up to r\u2009=\u20090.98 and mean absolute errors below 6 months, indicating stable reproducibility relative to expert readings. AI demonstrates promising potential for assisting skeletal maturation assessment, although accuracy varies across model architectures and validation settings. Current evidence supports the use of AI primarily as a diagnostic support tool, with further prospective multicenter studies required before routine clinical implementation. However, the current evidence remains limited due to the small number of studies and methodological heterogeneity.<\/jats:p>","DOI":"10.1055\/s-0046-1825873","type":"journal-article","created":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T23:13:26Z","timestamp":1786749206000},"source":"Crossref","is-referenced-by-count":0,"title":["Validity of Using Artificial Intelligence to Predict Skeletal Maturation in Orthodontic Treatment: A Systematic Review and Meta-analysis"],"prefix":"10.1055","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-8278-502X","authenticated-orcid":false,"given":"Gita","family":"Gayatri","sequence":"additional","affiliation":[{"name":"Doctoral Program, Faculty of Medicine, Universitas Padjadjaran, Bandung, Indonesia"},{"name":"Department of Orthodontics, Faculty of Dentistry, Padjadjaran University, Bandung, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Endah","family":"Mardiati","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Faculty of Dentistry, Padjadjaran University, Bandung, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ani","family":"Melani","sequence":"additional","affiliation":[{"name":"Department of Oral Biology, Faculty of Dentistry, Padjadjaran University, Bandung, Indonesia"},{"name":"Department of Oral Biology, Faculty of Dentistry, Universitas Jenderal Achmad Yani, Cimahi, West Java, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Solachudin","family":"Jauhari","sequence":"additional","affiliation":[{"name":"Faculty of Dentistry, Brunei Darussalam University, Darussalam, Brunei"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2222-5895","authenticated-orcid":false,"given":"Arief","family":"Cahyanto","sequence":"additional","affiliation":[{"name":"Department of Clinical Sciences, College of Dentistry, Ajman University, Ajman, United Arab Emirates"},{"name":"Centre of Medical and Bio-allied Health Sciences Research, Ajman University, Ajman, United Arab Emirates"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Widyawardhana","family":"Adiprawita","sequence":"additional","affiliation":[{"name":"Department of Biomedical Technology, School of Electrical Engineering and Informatics, Institut Teknologi Bandung, Bandung, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8005-808X","authenticated-orcid":false,"given":"Wisnu","family":"Fadila","sequence":"additional","affiliation":[{"name":"National Research and Innovation Agency (BRIN), Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"family":"Novina","sequence":"additional","affiliation":[{"name":"Department of Pediatrics, Faculty of Medicine, Padjadjaran University, Bandung, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rifaz Muhammad","family":"Sukma","sequence":"additional","affiliation":[{"name":"Department of Biomedical Technology, School of Electrical Engineering and Informatics, Institut Teknologi Bandung, Bandung, Indonesia"},{"name":"Department of Informatics, Faculty of Science and Informatics, Universitas Jenderal Achmad Yani, Cimahi, Indonesia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"194","published-online":{"date-parts":[[2026,8,14]]},"reference":[{"issue":"04","key":"ref1","first-page":"398","article-title":"Correlation between dental age, chronological age, and cervical vertebral maturation in patients with Class II malocclusion: a retrospective study in a Romanian population group","volume":"12","author":"M Ghergie","year":"2025","journal-title":"Children (Basel)"},{"issue":"02","key":"ref2","first-page":"94","article-title":"Artificial intelligence and machine learning in orthodontics: a review of literature","volume":"10","author":"N Srinivasan","year":"2025","journal-title":"Int J Pharm Res Appl"},{"issue":"01","key":"ref3","first-page":"213","article-title":"Oral and maxillofacial radiology in orthodontics","volume":"22","author":"A Mozahab","year":"2025","journal-title":"WJBPHS"},{"issue":"01","key":"ref4","doi-asserted-by":"crossref","first-page":"41","DOI":"10.52206\/jsmc.2024.14.1.820","article-title":"Interobserver reliability of cervical vertebral maturation staging","volume":"14","author":"M M Ali","year":"2024","journal-title":"J Saidu Med Coll"},{"issue":"02","key":"ref5","first-page":"56","article-title":"Transforming orthodontics with artificial intelligence: a comprehensive review","volume":"3","author":"S M Thakur","year":"2024","journal-title":"J Adv Dental Pract Res"},{"issue":"24","key":"ref6","doi-asserted-by":"crossref","first-page":"3677","DOI":"10.3390\/diagnostics13243677","article-title":"Artificial intelligence and its clinical applications in orthodontics: a systematic review","volume":"13","author":"G Dipalma","year":"2023","journal-title":"Diagnostics (Basel)"},{"issue":"04","key":"ref7","doi-asserted-by":"crossref","first-page":"232","DOI":"10.34172\/joddd.41114","article-title":"Determination of cervical vertebral maturation using machine learning in lateral cephalograms","volume":"18","author":"S Kavousinejad","year":"2024","journal-title":"J Dent Res Dent Clin Dent Prospect"},{"issue":"01","key":"ref8","doi-asserted-by":"crossref","first-page":"28","DOI":"10.1186\/s40510-024-00527-1","article-title":"Estimating mandibular growth stage based on cervical vertebral maturation in lateral cephalometric radiographs using artificial intelligence","volume":"25","author":"S A Shoari","year":"2024","journal-title":"Prog Orthod"},{"issue":"01","key":"ref9","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1186\/s12903-025-05482-9","article-title":"Performance of artificial intelligence on cervical vertebral maturation assessment: a systematic review and meta-analysis","volume":"25","author":"T S Sadeghi","year":"2025","journal-title":"BMC Oral Health"},{"issue":"01","key":"ref10","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1016\/j.jds.2020.06.019","article-title":"Developments, application, and performance of artificial intelligence in dentistry - a systematic review","volume":"16","author":"S B Khanagar","year":"2021","journal-title":"J Dent Sci"},{"issue":"71","key":"ref11","doi-asserted-by":"crossref","first-page":"n71","DOI":"10.1136\/bmj.n71","article-title":"The PRISMA 2020 statement: an updated guideline for reporting systematic reviews","volume":"372","author":"M J Page","year":"2021","journal-title":"BMJ"},{"issue":"02","key":"ref12","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1080\/02763869.2019.1588072","article-title":"PROSPERO: an international register of systematic review protocols","volume":"38","author":"J H Schiavo","year":"2019","journal-title":"Med Ref Serv Q"},{"issue":"11","key":"ref13","doi-asserted-by":"crossref","first-page":"e71487","DOI":"10.1002\/hsr2.71487","article-title":"The role of artificial intelligence in orthodontics for determining skeletal age based on cervical vertebra maturation degree: a comprehensive review","volume":"8","author":"P Farzanegan","year":"2025","journal-title":"Health Sci Rep"},{"issue":"11","key":"ref14","doi-asserted-by":"crossref","first-page":"278","DOI":"10.3390\/jimaging10110278","article-title":"Convolutional neural network-based deep learning methods for skeletal growth prediction in dental patients","volume":"10","author":"M H Mohammed","year":"2024","journal-title":"J Imaging"},{"issue":"01","key":"ref15","doi-asserted-by":"crossref","first-page":"148","DOI":"10.31616\/asj.2024.0452","article-title":"Performance and clinical implications of machine learning models for detecting cervical ossification of the posterior longitudinal ligament: a systematic review","volume":"19","author":"W Liawrungrueang","year":"2025","journal-title":"Asian Spine J"},{"issue":"03","key":"ref16","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1159\/000536277","article-title":"Exploring the methodological approaches of studies on radiographic databases used in cariology to feed artificial intelligence: a systematic review","volume":"58","author":"A D Ndiaye","year":"2024","journal-title":"Caries Res"},{"key":"ref17","doi-asserted-by":"crossref","first-page":"104115","DOI":"10.1016\/j.jdent.2022.104115","article-title":"Deep learning for caries detection: a systematic review","volume":"122","author":"H Mohammad-Rahimi","year":"2022","journal-title":"J Dent"},{"issue":"09","key":"ref18","doi-asserted-by":"crossref","first-page":"893","DOI":"10.3390\/jpm11090893","article-title":"COVID mortality prediction with machine learning methods: a systematic review and critical appraisal","volume":"11","author":"F Bottino","year":"2021","journal-title":"J Pers Med"},{"issue":"01","key":"ref19","doi-asserted-by":"crossref","first-page":"482","DOI":"10.1016\/j.jds.2020.05.022","article-title":"Scope and performance of artificial intelligence technology in orthodontic diagnosis, treatment planning, and clinical decision-making - a systematic review","volume":"16","author":"S B Khanagar","year":"2021","journal-title":"J Dent Sci"},{"issue":"S 02","key":"ref20","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1111\/ocr.12517","article-title":"Artificial intelligence in orthodontics: Where are we now? A scoping review","volume":"24","author":"A Monill-Gonz\u00e1lez","year":"2021","journal-title":"Orthod Craniofac Res"},{"issue":"03","key":"ref21","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1111\/ocr.12615","article-title":"Artificial intelligence-based algorithm for cervical vertebrae maturation stage assessment","volume":"26","author":"M T Radwan","year":"2023","journal-title":"Orthod Craniofac Res"},{"issue":"12","key":"ref22","doi-asserted-by":"crossref","first-page":"2200","DOI":"10.3390\/diagnostics11122200","article-title":"Development of an artificial intelligence system for the automatic evaluation of cervical vertebral maturation status","volume":"11","author":"J Zhou","year":"2021","journal-title":"Diagnostics (Basel)"},{"issue":"01","key":"ref23","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1038\/s41746-021-00438-z","article-title":"Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis","volume":"4","author":"R Aggarwal","year":"2021","journal-title":"NPJ Digit Med"},{"issue":"05","key":"ref24","doi-asserted-by":"crossref","first-page":"e222639","DOI":"10.1148\/radiol.222639","article-title":"Standalone AI for breast cancer detection at screening digital mammography and digital breast tomosynthesis: a systematic review and meta-analysis","volume":"307","author":"J H Yoon","year":"2023","journal-title":"Radiology"},{"issue":"01","key":"ref25","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1038\/s41746-024-01031-w","article-title":"Human-AI interaction in skin cancer diagnosis: a systematic review and meta-analysis","volume":"7","author":"I Krakowski","year":"2024","journal-title":"NPJ Digit Med"},{"issue":"02","key":"ref26","doi-asserted-by":"crossref","first-page":"112","DOI":"10.4041\/kjod.2022.52.2.112","article-title":"Deep learning for the classification of cervical maturation degree and pubertal growth spurts: a pilot study","volume":"52","author":"H Mohammad-Rahimi","year":"2022","journal-title":"Korean J Orthod"},{"issue":"06","key":"ref27","doi-asserted-by":"crossref","first-page":"e173","DOI":"10.1016\/j.ajodo.2020.08.014","article-title":"Validation of cervical vertebral maturation stages: artificial intelligence vs human observer visual analysis","volume":"158","author":"H Amasya","year":"2020","journal-title":"Am J Orthod Dentofacial Orthop"},{"issue":"03","key":"ref28","doi-asserted-by":"crossref","first-page":"692","DOI":"10.1148\/radiol.2021204021","article-title":"Artificial intelligence algorithm improves radiologist performance in skeletal age assessment: a prospective multicenter randomized controlled trial","volume":"301","author":"D K Eng","year":"2021","journal-title":"Radiology"},{"issue":"07","key":"ref29","doi-asserted-by":"crossref","first-page":"1347","DOI":"10.1007\/s00247-022-05310-0","article-title":"Validation of automated bone age analysis from hand radiographs in a North American pediatric population","volume":"52","author":"J J Bowden","year":"2022","journal-title":"Pediatr Radiol"},{"issue":"14","key":"ref30","doi-asserted-by":"crossref","first-page":"4047","DOI":"10.3390\/jcm13144047","article-title":"Accuracy of artificial intelligence for cervical vertebral maturation assessment - a systematic review","volume":"13","author":"W Kazimierczak","year":"2024","journal-title":"J Clin Med"},{"issue":"S 01","key":"ref31","doi-asserted-by":"crossref","first-page":"S547","DOI":"10.4103\/jpbs.jpbs_319_25","article-title":"Radiological assessment of skeletal maturity: a comparative study of hand-wrist radiographs and cervical vertebrae","volume":"17","author":"S Yadav","year":"2025","journal-title":"J Pharm Bioallied Sci"},{"issue":"04","key":"ref32","doi-asserted-by":"crossref","first-page":"316","DOI":"10.1016\/S0929-6646(08)60093-5","article-title":"Radiographic assessment of skeletal maturation stages for orthodontic patients: hand-wrist bones or cervical vertebrae?","volume":"107","author":"E HH Lai","year":"2008","journal-title":"J Formos Med Assoc"},{"issue":"06","key":"ref33","doi-asserted-by":"crossref","first-page":"925","DOI":"10.3233\/BMR-210003","article-title":"Reliability of cervical vertebral maturation compared to hand-wrist for skeletal maturation assessment in growing subjects: a systematic review","volume":"34","author":"M Ferrillo","year":"2021","journal-title":"J Back Musculoskelet Rehabil"},{"issue":"01","key":"ref34","doi-asserted-by":"crossref","first-page":"798","DOI":"10.1186\/s12903-023-03483-0","article-title":"Assessment of correlation between hand-wrist maturation and cervical vertebral maturation: a fractal analysis study","volume":"23","author":"\u0130 Eninan\u00e7","year":"2023","journal-title":"BMC Oral Health"},{"issue":"06","key":"ref35","doi-asserted-by":"crossref","first-page":"20220070","DOI":"10.1259\/dmfr.20220070","article-title":"Convolutional neural network-based automatic cervical vertebral maturation classification method","volume":"51","author":"H Li","year":"2022","journal-title":"Dentomaxillofac Radiol"},{"key":"ref36","doi-asserted-by":"crossref","first-page":"166","DOI":"10.12688\/f1000research.160533.1","article-title":"The reproducibility of cervical vertebrae maturation: a cross-sectional comparative study between two methods","volume":"14","author":"D Pratiwi","year":"2025","journal-title":"F1000 Res"},{"key":"ref37","doi-asserted-by":"crossref","first-page":"128","DOI":"10.25259\/APOS_73_2024","article-title":"Deep learning models to classify skeletal growth phase on 3D radiographs","volume":"15","author":"N Ameli","year":"2025","journal-title":"APOS Trends Orthod"},{"issue":"06","key":"ref38","first-page":"220","article-title":"Evaluation of the quality of the results of orthodontic treatment in the clinics of St. Petersburg","volume":"23","author":"E S Vinogradova","year":"2021","journal-title":"Medical & Pharmaceutical Journal Pulse"},{"issue":"01","key":"ref39","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1038\/s41368-025-00357-9","article-title":"Expert consensus on early orthodontic treatment of class III malocclusion","volume":"17","author":"X Zhou","year":"2025","journal-title":"Int J Oral Sci"},{"issue":"79","key":"ref40","first-page":"55","article-title":"Building a dataset of Wroc\u0142aw's historic tenements. Image annotation for machine learning applications","volume":"3","author":"A Marcin\u00f3w","year":"2024","journal-title":"Architectus"},{"issue":"06","key":"ref41","doi-asserted-by":"crossref","first-page":"364","DOI":"10.5455\/aim.2015.23.364-368","article-title":"Computer-based assessment of cervical vertebral maturation stages using digital lateral cephalograms","volume":"23","author":"V Dzemidzic","year":"2015","journal-title":"Acta Inform Med"},{"key":"ref42","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1111\/ocr.12644","article-title":"AggregateNet: A deep learning model for automated classification of cervical vertebral maturation stages","volume":"26","author":"S F Atici","year":"2023","journal-title":"Orthod Craniofac Res"},{"issue":"01","key":"ref43","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1186\/s40510-024-00535-1","article-title":"Classification of cervical vertebral maturation stages with machine learning models: leveraging datasets with high inter- and intra-observer agreement","volume":"25","author":"P Kanchanapiboon","year":"2024","journal-title":"Prog Orthod"}],"container-title":["European Journal of Dentistry"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/www.thieme-connect.de\/products\/ejournals\/pdf\/10.1055\/s-0046-1825873.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,14]],"date-time":"2026-08-14T23:14:15Z","timestamp":1786749255000},"score":1,"resource":{"primary":{"URL":"http:\/\/www.thieme-connect.de\/DOI\/DOI?10.1055\/s-0046-1825873"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,8,14]]},"references-count":43,"URL":"https:\/\/doi.org\/10.1055\/s-0046-1825873","archive":["Portico","CLOCKSS"],"relation":{},"ISSN":["1305-7456","1305-7464"],"issn-type":[{"value":"1305-7456","type":"print"},{"value":"1305-7464","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,8,14]]}}}