{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,9]],"date-time":"2026-10-09T20:08:44Z","timestamp":1791576524699,"version":"4.3.4"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"1","license":[{"start":{"date-parts":[[2023,12,19]],"date-time":"2023-12-19T00:00:00Z","timestamp":1702944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,1,11]]},"abstract":"Abstract<\/jats:title>\n \n Objectives<\/jats:title>\n To compare artificial intelligence (AI)-driven web-based platform and manual measurements for analysing facial asymmetry in craniofacial CT examinations.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n The study included 95 craniofacial CT scans from patients aged 18-30\u2009years. The degree of asymmetry was measured based on AI platform-predefined anatomical landmarks: sella (S), condylion (Co), anterior nasal spine (ANS), and menton (Me). The concordance between the results of automatic asymmetry reports and manual linear 3D measurements was calculated. The asymmetry rate (AR) indicator was determined for both automatic and manual measurements, and the concordance between them was calculated. The repeatability of manual measurements in 20 randomly selected subjects was assessed. The concordance of measurements of quantitative variables was assessed with interclass correlation coefficient (ICC) according to the Shrout and Fleiss classification.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Erroneous AI tracings were found in 16.8% of cases, reducing the analysed cases to 79. The agreement between automatic and manual asymmetry measurements was very low (ICC &lt; 0.3). A lack of agreement between AI and manual AR analysis (ICC type 3\u2009=\u20090) was found. The repeatability of manual measurements and AR calculations showed excellent correlation (ICC type 2\u2009&gt;\u20090.947).<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The results indicate that the rate of tracing errors and lack of agreement with manual AR analysis make it impossible to use the tested AI platform to assess the degree of facial asymmetry.<\/jats:p>\n <\/jats:sec>","DOI":"10.1093\/dmfr\/twad006","type":"journal-article","created":{"date-parts":[[2024,1,10]],"date-time":"2024-01-10T00:16:29Z","timestamp":1704845789000},"page":"52-59","source":"Crossref","is-referenced-by-count":15,"title":["Skeletal facial asymmetry: reliability of manual and artificial intelligence-driven analysis"],"prefix":"10.1093","volume":"53","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1850-3525","authenticated-orcid":false,"given":"Natalia","family":"Kazimierczak","sequence":"first","affiliation":[{"name":"Kazimierczak Private Dental Practice , 85-009 Bydgoszcz, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8372-0550","authenticated-orcid":false,"given":"Wojciech","family":"Kazimierczak","sequence":"additional","affiliation":[{"name":"Kazimierczak Private Dental Practice , 85-009 Bydgoszcz, Poland"},{"name":"Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun , 85-067 Bydgoszcz, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4307-6852","authenticated-orcid":false,"given":"Zbigniew","family":"Serafin","sequence":"additional","affiliation":[{"name":"Department of Radiology and Diagnostic Imaging, Collegium Medicum, Nicolaus Copernicus University in Torun , 85-067 Bydgoszcz, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pawe\u0142","family":"Nowicki","sequence":"additional","affiliation":[{"name":"Kazimierczak Private Dental Practice , 85-009 Bydgoszcz, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tomasz","family":"Jankowski","sequence":"additional","affiliation":[{"name":"Jankowscy Private Dental Practice , 68-200 \u017bary, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Agnieszka","family":"Jankowska","sequence":"additional","affiliation":[{"name":"Jankowscy Private Dental Practice , 68-200 \u017bary, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4374-2568","authenticated-orcid":false,"given":"Joanna","family":"Janiszewska-Olszowska","sequence":"additional","affiliation":[{"name":"Department of Interdisciplinary Dentistry, Pomeranian Medical University in Szczecin , 70-111 Szczecin, Poland"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2023,12,19]]},"reference":[{"issue":"4","key":"2024011215405350600_twad006-B1","doi-asserted-by":"crossref","first-page":"737","DOI":"10.3390\/sym14040737","article-title":"Facial asymmetry: a narrative review of the most common neurological causes","volume":"14","author":"Chojdak-\u0141ukasiewicz","year":"2022","journal-title":"Symmetry (Basel)"},{"issue":"3","key":"2024011215405350600_twad006-B2","doi-asserted-by":"crossref","first-page":"846","DOI":"10.1097\/SCS.0000000000005204","article-title":"Virtual surgical planning and three-dimensional printed guide for soft tissue correction in facial asymmetry","volume":"30","author":"Arias","year":"2019","journal-title":"J Craniofac Surg"},{"issue":"5","key":"2024011215405350600_twad006-B3","first-page":"806","article-title":"Spectrum and management of dentofacial deformities in a multiethnic Asian population","volume":"76(","author":"Ming","year":"2006","journal-title":"Angle Orthodontist"},{"issue":"3","key":"2024011215405350600_twad006-B4","first-page":"171","article-title":"The prevalence of facial asymmetry in the dentofacial deformities population at the University of North Carolina","volume":"12","author":"Severt","year":"1997","journal-title":"Int J Adult Orthodon Orthognath Surg"},{"key":"2024011215405350600_twad006-B5","first-page":"210","article-title":"The prevalence of facial asymmetry in preorthodontic treatment","volume":"4","author":"Anistoroaei","year":"2014","journal-title":"Int J Med Dentistry"},{"issue":"2","key":"2024011215405350600_twad006-B6","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1111\/ocr.12603","article-title":"Facial asymmetry in children with either unilateral lambdoid craniosynostosis or positional posterior plagiocephaly","volume":"26","author":"Nevaste-Boldt","year":"2023","journal-title":"Orthod Craniofac Res"},{"issue":"5","key":"2024011215405350600_twad006-B7","doi-asserted-by":"crossref","first-page":"1599","DOI":"10.1097\/PRS.0b013e3181babc1f","article-title":"Differential diagnosis of the idiopathic laterally deviated mandible","volume":"124","author":"Kawamoto","year":"2009","journal-title":"Plast Reconstr Surg"},{"issue":"1","key":"2024011215405350600_twad006-B8","doi-asserted-by":"crossref","first-page":"64","DOI":"10.4103\/0973-029X.92976","article-title":"A comprehensive review of the genetic basis of cleft lip and palate","volume":"16","author":"Kohli","year":"2012","journal-title":"J Oral Maxillofac Pathol"},{"issue":"1","key":"2024011215405350600_twad006-B9","doi-asserted-by":"crossref","first-page":"e49","DOI":"10.1016\/j.tripleo.2008.03.023","article-title":"Craniofacial polyostotic fibrous dysplasia: a case report and review of the literature","volume":"106","author":"Abdelkarim","year":"2008","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol Endod"},{"key":"2024011215405350600_twad006-B10","article-title":"Facial asymmetry: etiology, evaluation, and management","volume":"34","author":"Cheong","year":"2011","journal-title":"Chang Gung Med J"},{"issue":"1","key":"2024011215405350600_twad006-B11","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.cden.2015.08.004","article-title":"Temporomandibular joint disorders and orofacial pain","volume":"60","author":"Ahmad","year":"2016","journal-title":"Dent Clin North Am"},{"issue":"4","key":"2024011215405350600_twad006-B12","doi-asserted-by":"crossref","first-page":"445","DOI":"10.1016\/j.bjoms.2020.09.003","article-title":"Patients\u2019 narratives of orthognathic treatment for facial asymmetry: a qualitative study","volume":"59","author":"Kettle","year":"2021","journal-title":"Br J Oral Maxillofac Surg"},{"key":"2024011215405350600_twad006-B13","doi-asserted-by":"crossref","first-page":"1549","DOI":"10.1007\/978-981-15-1346-6_70","volume-title":"Oral and Maxillofacial Surgery for the Clinician","author":"Andrade","year":"2021"},{"issue":"5","key":"2024011215405350600_twad006-B14","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1016\/j.ajodo.2017.08.024","article-title":"Three-dimensional computed tomography analysis of mandibular morphology in patients with facial asymmetry and mandibular retrognathism","volume":"153","author":"You","year":"2018","journal-title":"Am J Orthod Dentofacial Orthop"},{"issue":"2","key":"2024011215405350600_twad006-B15","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s00784-015-1660-8","article-title":"Facial asymmetry quantitative evaluation in oculoauriculovertebral spectrum","volume":"20","author":"Manara","year":"2016","journal-title":"Clin Oral Investig"},{"issue":"1","key":"2024011215405350600_twad006-B16","doi-asserted-by":"crossref","first-page":"56","DOI":"10.2174\/18742106-v16-e2111251","article-title":"Facial asymmetry detected with 3D methods in orthodontics: a systematic review","volume":"16","author":"Pedersoli","year":"2022","journal-title":"TODENTJ"},{"issue":"1","key":"2024011215405350600_twad006-B17","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1093\/ejo\/cjr045","article-title":"Evaluation and comparison of postero-anterior cephalograms and cone-beam computed tomography images for the detection of mandibular asymmetry","volume":"35","author":"Damstra","year":"2013","journal-title":"Eur J Orthod"},{"issue":"7","key":"2024011215405350600_twad006-B18","doi-asserted-by":"crossref","first-page":"1414","DOI":"10.3390\/sym14071414","article-title":"A review of three-dimensional facial asymmetry analysis methods","volume":"14","author":"Zhu","year":"2022","journal-title":"Symmetry (Basel)"},{"issue":"1","key":"2024011215405350600_twad006-B19","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.jcms.2018.11.011","article-title":"Three-dimensional evaluation of facial asymmetry in patients with hemifacial microsomia using stereophotogrammetry","volume":"47","author":"Cassi","year":"2019","journal-title":"J Craniomaxillofac Surg"},{"issue":"9","key":"2024011215405350600_twad006-B20","doi-asserted-by":"crossref","first-page":"1847.e1","DOI":"10.1016\/j.joms.2016.05.012","article-title":"Comparison of different calculation methods used to analyze facial soft tissue asymmetry: global and partial 3-dimensional quantitative evaluation of healthy subjects","volume":"74","author":"Ozsoy","year":"2016","journal-title":"J Oral Maxillofac Surg"},{"key":"2024011215405350600_twad006-B21","article-title":"Facial morphological changes following denture treatment in children with hypohidrotic ectodermal dysplasia","volume":"42","author":"Ding","year":"2020","journal-title":"Pediatr Dent"},{"key":"2024011215405350600_twad006-B22","doi-asserted-by":"crossref","first-page":"S224","DOI":"10.1097\/SAP.0000000000002687","article-title":"Automatic assessment of 3-dimensional facial soft tissue symmetry before and after orthognathic surgery using a machine learning model: a preliminary experience","volume":"86(3S Suppl 2)","author":"Lo","year":"2021","journal-title":"Ann Plast Surg"},{"issue":"2","key":"2024011215405350600_twad006-B23","first-page":"155","article-title":"The effects of differences in landmark identification on the cephalometric measurements in traditional versus digitized cephalometry","volume":"74","author":"Chen","year":"2004","journal-title":"Angle Orthodontist"},{"issue":"3","key":"2024011215405350600_twad006-B24","first-page":"394","article-title":"Reproducibility of cephalometric measurements made by three radiology clinics","volume":"76","author":"Dias Da Silveira","year":"2006","journal-title":"Angle Orthod"},{"issue":"3","key":"2024011215405350600_twad006-B25","doi-asserted-by":"crossref","first-page":"329","DOI":"10.2319\/021220-100.1","article-title":"Evaluation of automated cephalometric analysis based on the latest deep learning method","volume":"91","author":"Hwang","year":"2021","journal-title":"Angle Orthod"},{"issue":"1","key":"2024011215405350600_twad006-B26","doi-asserted-by":"crossref","first-page":"69","DOI":"10.2319\/022019-129.1","article-title":"Automated identification of cephalometric landmarks: part 2-might it be better than human?","volume":"90","author":"Hwang","year":"2020","journal-title":"Angle Orthodontist"},{"key":"2024011215405350600_twad006-B27","doi-asserted-by":"crossref","DOI":"10.46889\/JDHOR.2023.4103","article-title":"Locating cephalometric landmarks with multi-phase deep learning","author":"Nishimoto","year":"2023","journal-title":"JDHOR"},{"issue":"1","key":"2024011215405350600_twad006-B28","first-page":"1","article-title":"3D cephalometric landmark detection by multiple stage deep reinforcement learning","volume":"11","author":"Kang","year":"2021","journal-title":"Sci Rep"},{"issue":"1","key":"2024011215405350600_twad006-B29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41598-022-25215-0","article-title":"Effectiveness of cone-beam computed tomography-generated cephalograms using artificial intelligence cephalometric analysis","volume":"12","author":"Chung","year":"2022","journal-title":"Sci Rep"},{"issue":"20","key":"2024011215405350600_twad006-B30","doi-asserted-by":"crossref","first-page":"6621","DOI":"10.3390\/jcm12206621","article-title":"Correlation analysis of nasal septum deviation and results of AI-driven automated 3D cephalometric analysis","volume":"12","author":"Kazimierczak","year":"2023","journal-title":"J Clin Med"},{"issue":"3","key":"2024011215405350600_twad006-B31","doi-asserted-by":"crossref","first-page":"142","DOI":"10.5152\/TurkJOrthod.2020.20062","article-title":"Web-based fully automated cephalometric analysis: comparisons between app-aided, computerized, and manual tracings","volume":"33","author":"Meri\u00e7","year":"2020","journal-title":"Turk J Orthod"},{"issue":"1","key":"2024011215405350600_twad006-B32","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1016\/j.jormas.2019.04.017","article-title":"Evaluation of an online website-based platform for cephalometric analysis","volume":"121","author":"Alqahtani","year":"2020","journal-title":"J Stomatol Oral Maxillofac Surg"},{"issue":"S19","key":"2024011215405350600_twad006-B33","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1186\/s12859-016-1370-5","article-title":"Ceph-X: development and evaluation of 2D cephalometric system","volume":"17","author":"Mosleh","year":"2016","journal-title":"BMC Bioinformatics"},{"issue":"1","key":"2024011215405350600_twad006-B34","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1177\/001316446002000104","article-title":"A coefficient of agreement for nominal scales","volume":"20","author":"Cohen","year":"1960","journal-title":"Educ Psychol Meas"},{"issue":"3","key":"2024011215405350600_twad006-B35","first-page":"233","article-title":"Method for quantifying facial asymmetry in three dimensions using stereophotogrammetry","volume":"65","author":"Ras","year":"1995","journal-title":"Angle Orthod"},{"issue":"6","key":"2024011215405350600_twad006-B36","doi-asserted-by":"crossref","first-page":"786","DOI":"10.1016\/j.ajodo.2006.03.025","article-title":"A novel method for the 3-dimensional simulation of orthognathic surgery by using a multimodal image-fusion technique","volume":"130","author":"Uechi","year":"2006","journal-title":"Am J Orthod Dentofacial Orthop"},{"issue":"10","key":"2024011215405350600_twad006-B37","doi-asserted-by":"crossref","first-page":"2008","DOI":"10.3390\/sym14102008","article-title":"The loss of symmetry in unilateral bony syngnathia: case report and literature review","volume":"14","author":"Crincoli","year":"2022","journal-title":"Symmetry (Basel)"},{"issue":"9","key":"2024011215405350600_twad006-B38","doi-asserted-by":"crossref","first-page":"1835","DOI":"10.1016\/j.joms.2017.03.029","article-title":"Does orthognathic surgery cause or cure temporomandibular disorders? A systematic review and meta-analysis","volume":"75","author":"Al-Moraissi","year":"2017","journal-title":"J Oral Maxillofac Surg"},{"issue":"1","key":"2024011215405350600_twad006-B39","doi-asserted-by":"crossref","first-page":"38","DOI":"10.2319\/112112-890.1","article-title":"Three-dimensional cone beam computed tomographic image reorientation using soft tissues as reference for facial asymmetry diagnosis","volume":"84","author":"Lee","year":"2014","journal-title":"Angle Orthod"},{"issue":"2","key":"2024011215405350600_twad006-B40","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s00784-015-1660-8","article-title":"Facial asymmetry quantitative evaluation in oculoauriculovertebral spectrum","volume":"20","author":"Manara","year":"2016","journal-title":"Clin Oral Invest"},{"issue":"1","key":"2024011215405350600_twad006-B41","doi-asserted-by":"crossref","DOI":"10.1186\/s40902-020-00260-9","article-title":"Quantification of three-dimensional facial asymmetry for diagnosis and postoperative evaluation of orthognathic surgery","volume":"42","author":"Cao","year":"2020","journal-title":"Maxillofac Plast Reconstr Surg"},{"issue":"3","key":"2024011215405350600_twad006-B42","doi-asserted-by":"crossref","first-page":"213","DOI":"10.5005\/jp-journals-10005-1112","article-title":"Comparison of the reliability of anatomic landmarks based on PA cephalometric radiographs and 3D CT scans in patients with facial asymmetry","volume":"4","author":"Jain","year":"2011","journal-title":"Int J Clin Pediatr Dent"},{"issue":"3","key":"2024011215405350600_twad006-B43","doi-asserted-by":"crossref","first-page":"402","DOI":"10.1016\/j.tripleo.2006.07.015","article-title":"Accuracy of measurements and reliability of landmark identification with computed tomography (CT) techniques in the maxillofacial area: a systematic review","volume":"104","author":"Lou","year":"2007","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol Endod"},{"issue":"3","key":"2024011215405350600_twad006-B44","doi-asserted-by":"crossref","first-page":"236","DOI":"10.1093\/ejo\/cjq057","article-title":"Prevalence of mandibular asymmetries in growing patients","volume":"33","author":"Ramirez-Yanez","year":"2011","journal-title":"Eur J Orthod"},{"issue":"2","key":"2024011215405350600_twad006-B45","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.tripleo.2004.06.072","article-title":"3D-CT evaluation of facial asymmetry","volume":"99","author":"Katsumata","year":"2005","journal-title":"Oral Surg Oral Med Oral Pathol Oral Radiol Endod"},{"issue":"4","key":"2024011215405350600_twad006-B46","doi-asserted-by":"crossref","first-page":"e678","DOI":"10.4317\/medoral.17721","article-title":"A study on the reproducibility of cephalometric landmarks when undertaking a three-dimensional (3D) cephalometric analysis","volume":"17","author":"Zamora","year":"2012","journal-title":"Med Oral Patol Oral Cir Bucal"},{"issue":"2","key":"2024011215405350600_twad006-B47","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1590\/1678-775720140336","article-title":"Reliability and reproducibility of three-dimensional cephalometric landmarks using CBCT: a systematic review","volume":"23","author":"De Oliveira Lisboa","year":"2015","journal-title":"J Appl Oral Sci"}],"container-title":["Dentomaxillofacial Radiology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/dmfr\/advance-article-pdf\/doi\/10.1093\/dmfr\/twad006\/54850769\/twad006.pdf","content-type":"application\/pdf","content-version":"am","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/dmfr\/article-pdf\/53\/1\/52\/55470501\/twad006.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/dmfr\/article-pdf\/53\/1\/52\/55470501\/twad006.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,1,12]],"date-time":"2024-01-12T15:42:25Z","timestamp":1705074145000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/dmfr\/article\/53\/1\/52\/7479713"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,19]]},"references-count":47,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1,11]]}},"URL":"https:\/\/doi.org\/10.1093\/dmfr\/twad006","relation":{},"ISSN":["0250-832X","1476-542X"],"issn-type":[{"value":"0250-832X","type":"print"},{"value":"1476-542X","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2024,1,1]]},"published":{"date-parts":[[2023,12,19]]}}}