{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T19:31:26Z","timestamp":1790969486293,"version":"4.1.0"},"reference-count":51,"publisher":"SAGE Publications","issue":"2","license":[{"start":{"date-parts":[[2025,1,22]],"date-time":"2025-01-22T00:00:00Z","timestamp":1737504000000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2025,1,22]],"date-time":"2025-01-22T00:00:00Z","timestamp":1737504000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The Cleft Palate Craniofacial Journal"],"published-print":{"date-parts":[[2025,2]]},"abstract":"<jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>Post-surgical lip symmetry assessment is a key indicator of cleft repair success. Traditional methods rely on distances between anatomical landmarks, which are impractical for video analysis and overlook texture and appearance. We propose an artificial intelligence (AI) approach to automate this process, analyzing lateral lip morphology for a quantitative symmetry evaluation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design<\/jats:title>\n                    <jats:p>We utilize contrastive learning to quantify lip symmetry by measuring the similarity between the representations of the sides, which is subsequently used to classify the severity of asymmetry. Our model does not require patient images for training. Instead, we introduce dissimilarities in face images from open datasets using two methods: temporal misalignment for video frames and face transformations to simulate lip asymmetry observed in the target population. The model differentiates the left and right image representations to assess asymmetry. We evaluated our model on 146 images of patients with repaired cleft lip.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>The deep learning model trained with face transformations categorized patient images into five asymmetry levels, achieving a weighted accuracy of 75% and a Pearson correlation of 0.31 with medical expert human evaluations. The model utilizing temporal misalignment achieved a weighted accuracy of 69% and a Pearson correlation of 0.27 for the same classification task.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>We propose an automated approach for assessing lip asymmetry in patients with repaired cleft lip by transforming facial images of control subjects to train a deep learning model, eliminating manual anatomical landmarks. Our promising results provide a more efficient and objective tool for evaluating surgical outcomes.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/10556656241312730","type":"journal-article","created":{"date-parts":[[2025,1,22]],"date-time":"2025-01-22T04:13:22Z","timestamp":1737519202000},"page":"289-299","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":15,"title":["Deep Learning-Based Assessment of Lip Symmetry for Patients With Repaired Cleft Lip"],"prefix":"10.1177","volume":"62","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8118-4213","authenticated-orcid":false,"given":"Karen","family":"Rosero","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, The University of Texas at Dallas, Richardson, TX, USA"},{"name":"Carnegie Mellon University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ali N.","family":"Salman","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, The University of Texas at Dallas, Richardson, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3168-1879","authenticated-orcid":false,"given":"Lucas M.","family":"Harrison","sequence":"additional","affiliation":[{"name":"University of Texas Southwestern Medical Center"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alex A.","family":"Kane","sequence":"additional","affiliation":[{"name":"University of Texas Southwestern Medical Center"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlos","family":"Busso","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, The University of Texas at Dallas, Richardson, TX, USA"},{"name":"Carnegie Mellon University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9025-399X","authenticated-orcid":false,"given":"Rami R.","family":"Hallac","sequence":"additional","affiliation":[{"name":"University of Texas Southwestern Medical Center"},{"name":"Analytical Imaging and Modeling Center, Children's Health, Dallas, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2025,1,22]]},"reference":[{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1016\/0278-2391(94)90528-2"},{"issue":"6","key":"e_1_3_4_3_2","first-page":"1010","article-title":"Relative en- and exophthalmometry in zygomatic fractures comparing optical non-contact, non-ionizing 3D imaging to the Hertel instrument and computed tomography","volume":"31","author":"Nkenke E","year":"2003","unstructured":"Nkenke E, Benz M, Maier T, et al. Relative en- and exophthalmometry in zygomatic fractures comparing optical non-contact, non-ionizing 3D imaging to the Hertel instrument and computed tomography. JOMS. 2003;31(6):1010-5182. doi:https:\/\/doi.org\/10.1016\/j.jcms.2003.07.001","journal-title":"JOMS"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1597\/04-138.1"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.3390\/sym14040737"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1597\/1545-1569_1993_030_0082_ceosoc_2.3.co_2"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1590\/S1678-77572012000100003"},{"key":"#cr-split#-e_1_3_4_8_2.1","doi-asserted-by":"crossref","unstructured":"Rosero K Salman AN Sisman B et al. Enhanced facial landmarks detection for patients with repaired cleft lip and palate. Paper presented at 18th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2024). May 27-31 2024","DOI":"10.1109\/FG59268.2024.10582022"},{"key":"#cr-split#-e_1_3_4_8_2.2","unstructured":"Istanbul Turkey. Accessed July 12 2024. https:\/\/ieeexplore.ieee.org\/abstract\/document\/10582022."},{"key":"#cr-split#-e_1_3_4_9_2.1","doi-asserted-by":"crossref","unstructured":"Rosero K Salman AN Hallac RR et al. Lip abnormality detection for patients with repaired cleft lip and palate: a lip normalization approach. Paper presented at 26th International Conference on Multimodal Interaction (ICMI 2024). November 4-8 2024","DOI":"10.1109\/FG59268.2024.10582022"},{"key":"#cr-split#-e_1_3_4_9_2.2","unstructured":"San Jos\u00e9 Costa Rica. Accessed November 25 2024. https:\/\/dl.acm.org\/doi\/abs\/10.1145\/3678957.3685726."},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1597\/15-053"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcms.2016.11.005"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1177\/1055665620924871"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1597\/15-274"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jacr.2020.04.007"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1186\/s12910-021-00687-3"},{"key":"e_1_3_4_16_2","first-page":"1755","article-title":"Dlib-ml: a machine learning toolkit","volume":"10","author":"King DE","year":"2009","unstructured":"King DE. Dlib-ml: a machine learning toolkit. JMLR. 2009;10:1755-1758. doi:https:\/\/doi.org\/10.5555\/1577069.1755843","journal-title":"JMLR"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2019.07.003"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-014-0532-5"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.3758\/s13428-020-01482-5"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2021.627678"},{"key":"#cr-split#-e_1_3_4_21_2.1","doi-asserted-by":"crossref","unstructured":"Medvedev I Shadmand F Gon\u00e7alves N. Young Labeled Faces in the Wild (YLFW): a dataset for children faces recognition. Paper presented at 18th IEEE International Conference on Automatic Face and Gesture Recognition (FG 2024). May 27-31 2024","DOI":"10.1109\/FG59268.2024.10582021"},{"key":"#cr-split#-e_1_3_4_21_2.2","unstructured":"Istanbul Turkey. Accessed July 13 2024. https:\/\/ieeexplore.ieee.org\/document\/10582021."},{"key":"e_1_3_4_22_2","volume-title":"Deep Learning","author":"Goodfellow I","year":"2016","unstructured":"Goodfellow I, Bengio Y, Courville A. Deep Learning. 1st ed. MIT Press; 2016.","edition":"1"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10916-018-1088-1"},{"key":"e_1_3_4_24_2","unstructured":"Rosero K Salman AN Busso C et al. A tailored machine learning approach for cleft lip symmetry analysis. Abstract presented at the American Cleft Palate Craniofacial Association Annual Meeting (ACPA 2024); April 10\u201313 2024; Denver CO."},{"key":"#cr-split#-e_1_3_4_25_2.1","unstructured":"Simonyan K Zisserman A. Very deep convolutional networks for large-scale image recognition. Paper presented at International Conference on Learning Representations (ICLR 2015). May 7-9 2015"},{"key":"#cr-split#-e_1_3_4_25_2.2","unstructured":"San Diego CA. Accessed April 15 2024. https:\/\/arxiv.org\/abs\/1409.1556."},{"key":"#cr-split#-e_1_3_4_26_2.1","doi-asserted-by":"crossref","unstructured":"Szegedy C Liu W Jia Y et al. Going deeper with convolutions. Paper presented at IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015). June 7-12 2015","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"#cr-split#-e_1_3_4_26_2.2","unstructured":"Boston MA. Accessed March 1 2024. https:\/\/ieeexplore.ieee.org\/document\/7298594."},{"key":"#cr-split#-e_1_3_4_27_2.1","doi-asserted-by":"crossref","unstructured":"Sandler M Howard A Zhu M et al. MobileNetV2: inverted residuals and linear bottlenecks. Paper presented at IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018). June 18-23 2018","DOI":"10.1109\/CVPR.2018.00474"},{"key":"#cr-split#-e_1_3_4_27_2.2","unstructured":"Salt Lake City UT. Accessed March 23 2024. https:\/\/ieeexplore.ieee.org\/document\/8578572."},{"key":"#cr-split#-e_1_3_4_28_2.1","unstructured":"Chopra S Hadsell R LeCun Y. Learning a similarity metric discriminatively with application to face verification. In Paper presented at IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005). June 20-25 2005"},{"key":"#cr-split#-e_1_3_4_28_2.2","unstructured":"San Diego CA. Accessed March 21 2024. https:\/\/ieeexplore.ieee.org\/document\/1467314."},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"#cr-split#-e_1_3_4_30_2.1","doi-asserted-by":"crossref","unstructured":"Deng JM Dong W Socher R et al. ImageNet: a large-scale hierarchical image database. Paper presented at IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2009). June 20-25 2009","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"#cr-split#-e_1_3_4_30_2.2","unstructured":"Miami FL. Accessed June 16 2024. https:\/\/ieeexplore.ieee.org\/document\/5206848."},{"key":"#cr-split#-e_1_3_4_31_2.1","doi-asserted-by":"crossref","unstructured":"Bakaki P Richard B Pereira E et al. Key landmarks detection of cleft lip-repaired partially occluded facial images for aesthetics outcome assessment. Paper presented at International Conference on Image Analysis and Processing. May 23-27 2022","DOI":"10.1007\/978-3-031-06430-2_60"},{"key":"#cr-split#-e_1_3_4_31_2.2","unstructured":"Lecce Italy. Accessed November 18 2024. https:\/\/link.springer.com\/chapter\/10.1007\/978-3-031-06430-2_60."},{"key":"#cr-split#-e_1_3_4_32_2.1","doi-asserted-by":"crossref","unstructured":"Baltrusaitis T Robinson P Morency LP. OpenFace: an open source facial behavior analysis toolkit. Paper presented at IEEE Winter Conference on Applications of Computer Vision (WACV 2016). March 7-10 2016","DOI":"10.1109\/WACV.2016.7477553"},{"key":"#cr-split#-e_1_3_4_32_2.2","unstructured":"Lake Placid NY. Accessed January 16 2024. https:\/\/ieeexplore.ieee.org\/document\/7477553."},{"key":"e_1_3_4_33_2","doi-asserted-by":"crossref","unstructured":"Bulat A Tzimiropoulos G. How far are we from solving the 2D & 3D face alignment problem? (and a dataset of 230 000 3D facial landmarks). Paper presented at IEEE International Conference on Computer Vision (ICCV 2017); October 22\u201329 2017; Venice Italy. Accessed December 5 2023. https:\/\/doi.ieeecomputersociety.org\/10.1109\/ICCV.2017.116.","DOI":"10.1109\/ICCV.2017.116"},{"key":"e_1_3_4_34_2","unstructured":"Kartynnik Y Ablavatski A Grishchenko I et al. Real-time facial surface geometry from monocular video on mobile GPUs. Paper presented at CVPR Workshop on Computer Vision for Augmented and Virtual Reality (CVPR 2019). June 17 2019; Long Beach CA. Accessed November 8 2023. https:\/\/research.google\/pubs\/real-time-facial-surface-geometry-from-monocular-video-on-mobile-gpus\/."},{"key":"e_1_3_4_35_2","unstructured":"Cort\u00e9s G Villalobos F Flores M. Asymmetry level in cleft lip children using dendrite morphological neural network. Paper presented at 11th Mexican Conference on Pattern Recognition (MCPR 2019). June 29 2019; Quer\u00e9taro Mexico. Accessed January 8 2024. https:\/\/link.springer.com\/chapter\/10.1007\/978-3-030-21077-9 22#citeas."},{"key":"#cr-split#-e_1_3_4_36_2.1","doi-asserted-by":"crossref","unstructured":"Wu J Tse R Shapiro LG. Learning to rank the severity of unrepaired cleft lip nasal deformity on 3D mesh data. Paper presented at 22nd IEEE International Conference on Pattern Recognition (ICPR 2014). August 24-28 2014","DOI":"10.1109\/ICPR.2014.88"},{"key":"#cr-split#-e_1_3_4_36_2.2","unstructured":"Stockholm Sweden. Accessed February 10 2024. https:\/\/ieeexplore.ieee.org\/document\/6976799."},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcms.2018.03.023"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.bjps.2017.09.016"},{"issue":"1","key":"e_1_3_4_39_2","article-title":"Cheiloplasty by Pfeifer\u2019s technique","volume":"4","author":"Kumar RVK","year":"2017","unstructured":"Kumar RVK, Reddy YS. Cheiloplasty by Pfeifer\u2019s technique. J Cleft Lip Palate Craniofacial Anomalies. 2017;4(Suppl 1):S113-S117. doi: https:\/\/doi.org\/10.4103\/jclpca.jclpca_59_17","journal-title":"J Cleft Lip Palate Craniofacial Anomalies"},{"key":"#cr-split#-e_1_3_4_40_2.1","doi-asserted-by":"crossref","unstructured":"Zhang L Rao A Agrawala M. Adding conditional control to text-to-image diffusion models. Paper presented at IEEE International Conference on Computer Vision (CVF 2023). October 1-6 2023","DOI":"10.1109\/ICCV51070.2023.00355"},{"key":"#cr-split#-e_1_3_4_40_2.2","unstructured":"Paris France. Accessed February 18 2024. https:\/\/ieeexplore.ieee.org\/document\/10377881."}],"container-title":["The Cleft Palate Craniofacial Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10556656241312730","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10556656241312730","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10556656241312730","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:21:30Z","timestamp":1777393290000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10556656241312730"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,22]]},"references-count":51,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,2]]}},"alternative-id":["10.1177\/10556656241312730"],"URL":"https:\/\/doi.org\/10.1177\/10556656241312730","relation":{},"ISSN":["1055-6656","1545-1569"],"issn-type":[{"value":"1055-6656","type":"print"},{"value":"1545-1569","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,22]]}}}