{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,21]],"date-time":"2026-09-21T16:16:59Z","timestamp":1790007419375,"version":"4.0.1"},"reference-count":40,"publisher":"Wiley","issue":"S1","license":[{"start":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T00:00:00Z","timestamp":1749859200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"},{"start":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T00:00:00Z","timestamp":1749859200000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Orthod Craniofacial Res"],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Malocclusion presents functional and aesthetic challenges, necessitating accurate diagnosis and treatment. However, variability in orthodontic treatment planning persists due to subjective assessments, limiting consistency and objectivity. Electronic dental records (EDRs) contain vast patient data that could address these challenges, but much of the rich clinical information is documented as free text, complicating analysis. This study aims to develop an Orthodontic Natural Language Processing (ONLP) model to extract structured orthodontics\u2010related information from unstructured EDRs and identify critical features influencing malocclusion using machine learning (ML).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>Data from 7693 orthodontic patients were analysed to train, test and validate the ONLP and ML models. A gold\u2010standard dataset was created through manual review. The ONLP model utilised supervised (Named Entity Recognition\u2014NER) and unsupervised (K\u2010means clustering) approaches to structure information from free text. Machine learning models, including Logistic Regression, Gaussian Naive Bayes, Random Forest and XGBoost, were subsequently applied to identify feature importance for malocclusion classification.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The ONLP model achieved 89% sensitivity, 92% specificity and 91% accuracy in extracting orthodontics\u2010related information. The supervised model demonstrated 84% accuracy, 82% F1\u2010score and 84% recall, excelling in identifying Classes I and III malocclusions but showing reduced sensitivity for Class II. Machine learning analysis highlighted key features for malocclusion classification: maxillary crowding, overjet and arch perimeter discrepancy for Class I; maxillary spacing and anterior crossbite for Class II; and dental midline deviation and occlusal wear for Class III.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>This study demonstrates a novel approach to automating orthodontic data extraction using the ONLP model, enabling advanced big data analytics and enhancing data\u2010driven orthodontic research and care.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/ocr.12944","type":"journal-article","created":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T04:13:59Z","timestamp":1749874439000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Building and Evaluating an Orthodontic Natural Language Processing Model for Automated Clinical Note Information Extraction"],"prefix":"10.1111","volume":"28","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0559-5958","authenticated-orcid":false,"given":"Jay S.","family":"Patel","sequence":"first","affiliation":[{"name":"Center for Dental Informatics and Artificial Intelligence, Department of Oral Health Sciences Temple University Kornberg School of Dentistry  Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Divakar","family":"Karanth","sequence":"additional","affiliation":[{"name":"Department of Orthodontics University of Florida College of Dentistry  Gainesville Florida USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2025,6,14]]},"reference":[{"key":"e_1_2_12_2_1","doi-asserted-by":"publisher","DOI":"10.3390\/DJ9100117"},{"key":"e_1_2_12_3_1","doi-asserted-by":"publisher","DOI":"10.1111\/J.1600\u20100722.1973.TB01489.X"},{"key":"e_1_2_12_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/0002\u20109416(68)90304\u20107"},{"key":"e_1_2_12_5_1","doi-asserted-by":"publisher","DOI":"10.1093\/EJO\/CJAA051"},{"key":"e_1_2_12_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/0889\u20105406(91)70058\u20105"},{"key":"e_1_2_12_7_1","article-title":"Retrospective Cohort Studies: Advantages and Disadvantages","volume":"348","author":"Sedgwick P.","year":"2014","journal-title":"BMJ (Clinical Research Ed.)"},{"key":"e_1_2_12_8_1","doi-asserted-by":"publisher","DOI":"10.1055\/S\u20100042\u20101757880"},{"key":"e_1_2_12_9_1","doi-asserted-by":"publisher","DOI":"10.3389\/FRAI.2022.979525"},{"key":"e_1_2_12_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545729.3545744"},{"key":"e_1_2_12_11_1","doi-asserted-by":"publisher","DOI":"10.1055\/S\u20100039\u20101681088"},{"key":"e_1_2_12_12_1","first-page":"130","volume-title":"BioNLP: Proceedings of the 2012 Workshop on Biomedical Natural Language Processing","author":"South B. R.","year":"2012"},{"key":"e_1_2_12_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.JDENT.2013.04.006"},{"key":"e_1_2_12_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.PROCS.2018.05.052"},{"key":"e_1_2_12_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3545729.3545744"},{"key":"e_1_2_12_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/J.ESWA.2010.08.066"},{"key":"e_1_2_12_17_1","doi-asserted-by":"publisher","DOI":"10.12785\/ijcds\/130172"},{"key":"e_1_2_12_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0031\u20103203(02)00060\u20102"},{"key":"e_1_2_12_19_1","doi-asserted-by":"publisher","DOI":"10.1055\/S\u20100040\u20101709506\/ID\/JR190234RA\u201034\/BIB"},{"key":"e_1_2_12_20_1","doi-asserted-by":"publisher","DOI":"10.1613\/jair.953"},{"key":"e_1_2_12_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/S42979\u2010021\u201000592\u2010X"},{"key":"e_1_2_12_22_1","doi-asserted-by":"publisher","DOI":"10.7326\/M18\u20101377"},{"key":"e_1_2_12_23_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2020.eval4nlp-1.9"},{"key":"e_1_2_12_24_1","doi-asserted-by":"publisher","DOI":"10.3348\/kjr.2021.0223"},{"key":"e_1_2_12_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-39940-9_565"},{"key":"e_1_2_12_26_1","first-page":"4766","volume-title":"Advances in Neural Information Processing Systems","author":"Lundberg S. M.","year":"2017"},{"key":"e_1_2_12_27_1","first-page":"904","volume-title":"AMIA Annual Symposium Proceedings","author":"Chuang Y.\u2010S.","year":"2024"},{"key":"e_1_2_12_28_1","doi-asserted-by":"publisher","DOI":"10.1259\/DMFR.20190441\/SUPPL_FILE\/DMFR.20190441.SUPPL\u201001.DOCX"},{"key":"e_1_2_12_29_1","doi-asserted-by":"publisher","DOI":"10.4041\/KJOD.2022.52.2.112"},{"key":"e_1_2_12_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/OCR.12514"},{"key":"e_1_2_12_31_1","doi-asserted-by":"publisher","DOI":"10.1111\/OCR.12501"},{"key":"e_1_2_12_32_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41591-018-0279-0"},{"key":"e_1_2_12_33_1","first-page":"35","volume-title":"HealthInfo","author":"Murata S.","year":"2017"},{"key":"e_1_2_12_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMI.2020.2971730"},{"key":"e_1_2_12_35_1","doi-asserted-by":"publisher","DOI":"10.2319\/111608\u2010588.1"},{"key":"e_1_2_12_36_1","doi-asserted-by":"publisher","DOI":"10.1097\/SCS.0000000000005650"},{"key":"e_1_2_12_37_1","unstructured":"T.Kajiwara C.Tanikawa Y.Shimizu C.Chu T.Yamashiro andH.Nagahara \u201cUsing Natural Language Processing to Develop an Automated Orthodontic Diagnostic System\u201d."},{"key":"e_1_2_12_38_1","doi-asserted-by":"publisher","DOI":"10.1093\/EJO\/CJAB083"},{"key":"e_1_2_12_39_1","doi-asserted-by":"publisher","DOI":"10.4258\/HIR.2018.24.1.22"},{"key":"e_1_2_12_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0300\u20105712(97)00027\u20104"},{"key":"e_1_2_12_41_1","doi-asserted-by":"publisher","DOI":"10.1177\/03000605211000157"}],"container-title":["Orthodontics &amp; Craniofacial Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/ocr.12944","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/ocr.12944","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/ocr.12944","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T09:18:23Z","timestamp":1773220703000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/ocr.12944"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,14]]},"references-count":40,"journal-issue":{"issue":"S1","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["10.1111\/ocr.12944"],"URL":"https:\/\/doi.org\/10.1111\/ocr.12944","archive":["Portico"],"relation":{},"ISSN":["1601-6335","1601-6343"],"issn-type":[{"value":"1601-6335","type":"print"},{"value":"1601-6343","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,14]]},"assertion":[{"value":"2025-01-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-14","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-06-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}