{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,2,21]],"date-time":"2025-02-21T12:39:51Z","timestamp":1740141591636,"version":"3.37.3"},"reference-count":51,"publisher":"Oxford University Press (OUP)","issue":"6","license":[{"start":{"date-parts":[[2023,5,13]],"date-time":"2023-05-13T00:00:00Z","timestamp":1683936000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2023,11,30]]},"abstract":"<jats:title>Summary<\/jats:title>\n               <jats:sec>\n                  <jats:title>Background\/objectives<\/jats:title>\n                  <jats:p>The aim of this research was to determine the reliability of a novel index for the assessment of smile esthetics in patients with cleft lip and\/or palate (CL \u00b1 P) at the end of their multidisciplinary treatment, for use in clinical and academic settings.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Materials and methods<\/jats:title>\n                  <jats:p>Five orthodontists, five periodontologists, five general practitioners, five dental students, and five laypeople rated the smiles of 10 patients with CL \u00b1 P twice at a 2 weeks interval. The rating scale consisted of four main categories: 1. nasolabial esthetics, 2. gingival esthetics, 3. dental esthetics, and 4. overall esthetics. A total of 15 parameters were rated. Intra- and inter-rater agreements were calculated using SPSS.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>The inter-rater agreement varied between good and excellent whereby the orthodontists, periodontists, general practitioners, dental students, and laypeople obtained agreement scores of 0.86, 0.92, 0.84, 0.90, and 0.89, respectively. The intra-rater agreement was good with agreement scores of 0.78, 0.84, 0.84, 0.80, and 0.79, respectively.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Limitations<\/jats:title>\n                  <jats:p>Smile esthetics were rated on static pictures, not in real life or by video recordings in a young adult population.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions\/implications<\/jats:title>\n                  <jats:p>The cleft lip and palate smile esthetic index is a reliable tool for the assessment of smile esthetics in patients with CL \u00b1 P.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/ejo\/cjad016","type":"journal-article","created":{"date-parts":[[2023,5,13]],"date-time":"2023-05-13T22:33:16Z","timestamp":1684017196000},"page":"662-670","source":"Crossref","is-referenced-by-count":1,"title":["Reliability of the novel cleft lip and palate smile esthetic index (CLP-SEI)"],"prefix":"10.1093","volume":"45","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4524-786X","authenticated-orcid":false,"given":"Jonathan","family":"Luyten","sequence":"first","affiliation":[{"name":"Department of Orthodontics, Ghent University , Ghent , Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Laurent","family":"Thierens","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Ghent University , Ghent , Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7022-1680","authenticated-orcid":false,"given":"No\u00ebmi M C","family":"De Roo","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Ghent University , Ghent , Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liesbeth","family":"Temmerman","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Ghent University , Ghent , Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Guy A M","family":"De Pauw","sequence":"additional","affiliation":[{"name":"Department of Orthodontics, Ghent University , Ghent , Belgium"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","published-online":{"date-parts":[[2023,5,13]]},"reference":[{"key":"2023113008163421300_CIT0001","doi-asserted-by":"crossref","first-page":"1958","DOI":"10.1016\/j.joms.2017.04.042","article-title":"Effects of objective 3-dimensional measures of facial shape and symmetry on perceptions of facial attractiveness","volume":"75","author":"Hatch","year":"2017","journal-title":"Journal of Oral and Maxillofacial Surgery"},{"key":"2023113008163421300_CIT0002","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1016\/j.ajodo.2017.08.016","article-title":"Objective assessment of the contribution of dental esthetics and facial attractiveness in men via eye tracking","volume":"153","author":"Baker","year":"2018","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163421300_CIT0003","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1016\/j.ajodo.2014.12.016","article-title":"Contribution of malocclusion and female facial attractiveness to smile esthetics evaluated by eye tracking","volume":"147","author":"Richards","year":"2015","journal-title":"American Journal of \u00adOrthodontics and Dentofacial Orthopedics"},{"key":"2023113008163421300_CIT0004","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1016\/j.ajodo.2014.07.001","article-title":"Do dental esthetics have any influence on finding a job","volume":"146","author":"Pithon","year":"2014","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163421300_CIT0005","doi-asserted-by":"crossref","first-page":"45","DOI":"10.34172\/joddd.2022.008","article-title":"Visual perception of repaired cleft lip scarring face associated with different malocclusions via eye-tracking","volume":"16","author":"Guimaraes","year":"2022","journal-title":"Journal of Dental Research Dental Clinics Dental Prospects"},{"key":"2023113008163421300_CIT0006","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1111\/j.1365-2648.2004.03227.x","article-title":"Altered body image: appearance-related concerns of people with visible disfigurement","volume":"48","author":"Rumsey","year":"2004","journal-title":"Journal of Advanced Nursing"},{"key":"2023113008163421300_CIT0007","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1007\/s10006-015-0518-1","article-title":"Psychosocial acceptance of cleft patients: has something changed","volume":"20","author":"Pausch","year":"2016","journal-title":"Oral and Maxillofacial Surgery"},{"key":"2023113008163421300_CIT0008","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1597\/07-124.1","article-title":"Social experience in 10-year-old children born with a cleft: exploring psychosocial resilience","volume":"46","author":"Feragen","year":"2009","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0009","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1007\/s00784-013-1109-x","article-title":"Validation of the prosthetic esthetic index","volume":"18","author":"Ozhayat","year":"2014","journal-title":"Clinical Oral Investigations"},{"key":"2023113008163421300_CIT0010","first-page":"397","article-title":"The Smile Esthetic Index (SEI): A method to measure the esthetics of the smile. An intra-rater and inter-rater agreement study","volume":"8","author":"Rotundo","year":"2015","journal-title":"European Journal of Oral Implantology"},{"key":"2023113008163421300_CIT0011","doi-asserted-by":"crossref","first-page":"740","DOI":"10.1016\/j.ajodo.2016.06.022","article-title":"Laypeople\u2019s perceptions of frontal smile esthetics: A systematic review","volume":"150","author":"Parrini","year":"2016","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163421300_CIT0012","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.ajodo.2014.10.024","article-title":"Hypodontia and supernumerary and impacted teeth in children with various types of clefts","volume":"147","author":"Jamilian","year":"2015","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"},{"key":"2023113008163421300_CIT0013","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1093\/ejo\/cjp156","article-title":"Dental anomalies in individuals with cleft lip and\/or palate","volume":"32","author":"Akcam","year":"2010","journal-title":"European Journal of Orthodontics"},{"key":"2023113008163421300_CIT0014","doi-asserted-by":"crossref","first-page":"281","DOI":"10.4103\/2321-1407.194790","article-title":"Orthodontic management of patients with cleft lip and palate","volume":"6","author":"Shetye","year":"2016","journal-title":"APOS Trends Orthodontics"},{"key":"2023113008163421300_CIT0015","doi-asserted-by":"crossref","first-page":"540","DOI":"10.1597\/15-292","article-title":"A Standard set of outcome measures for the comprehensive appraisal of cleft care","volume":"54","author":"Allori","year":"2017","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0016","doi-asserted-by":"crossref","first-page":"1233","DOI":"10.1016\/j.bjps.2012.04.001","article-title":"Outcomes in facial aesthetics in cleft lip and palate surgery: A systematic review","volume":"65","author":"Sharma","year":"2012","journal-title":"Journal of Plastic, Reconstructive and Aesthetic Surgery"},{"key":"2023113008163421300_CIT0017","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1597\/1545-1569_1993_030_0001_aaafot_2.3.co_2","article-title":"Anthropometric and anthroposcopic findings of the nasal and facial region in cleft patients before and after primary lip and palate repair","volume":"30","author":"Farkas","year":"1993","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0018","doi-asserted-by":"crossref","first-page":"55","DOI":"10.3109\/02844318009105735","article-title":"Lip-nose morphology and symmetry in unilateral celft lip and palate patients following a two-stage lip closure","volume":"14","author":"Friede","year":"1980","journal-title":"Scandinavian Journal of Plastic and Reconstructive Surgery"},{"key":"2023113008163421300_CIT0019","doi-asserted-by":"crossref","first-page":"288","DOI":"10.1016\/0007-1226(92)90054-2","article-title":"The V.L.S. classification for secondary deformities in the unilateral cleft lip","volume":"45","author":"Assuncao","year":"1992","journal-title":"British Journal of Plastic Surgery"},{"key":"2023113008163421300_CIT0020","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1597\/1545-1569_1991_028_0385_doamfr_2.3.co_2","article-title":"Development of a method for rating nasolabial appearance in patients with clefts of the lip and palate","volume":"28","author":"Asher-McDade","year":"1991","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0021","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1597\/14-017","article-title":"The americleft project: A proposed expanded nasolabial appearance yardstick for 5- to 7-year-old patients with complete unilateral cleft lip and palate (CUCLP)","volume":"53","author":"Mercado","year":"2016","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0022","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1097\/00006534-199401000-00005","article-title":"Facial impairment scales for clefts","volume":"93","author":"Tobiasen","year":"1994","journal-title":"Plastic and Reconstructive Surgery"},{"key":"2023113008163421300_CIT0023","doi-asserted-by":"crossref","first-page":"1683","DOI":"10.1097\/SCS.0b013e3181b3ed9c","article-title":"Reference photographs for nasolabial appearance rating in unilateral cleft lip and palate","volume":"20","author":"Kuijpers-Jagtman","year":"2009","journal-title":"The Journal of Craniofacial Surgery"},{"key":"2023113008163421300_CIT0024","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1597\/08-175.1","article-title":"Quantitative measurement of symmetry from photographs following surgery for unilateral cleft lip and palate","volume":"47","author":"Pigott","year":"2010","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0025","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1016\/j.jclinepi.2010.03.002","article-title":"Guidelines for reporting reliability and agreement studies (GRRAS) were proposed","volume":"64","author":"Kottner","year":"2011","journal-title":"Journal of Clinical Epidemiology"},{"key":"2023113008163421300_CIT0026","doi-asserted-by":"crossref","first-page":"3205","DOI":"10.1002\/sim.935","article-title":"Planning a reproducibility study: how many subjects and how many replicates per subject for an expected width of the 95 per cent confidence interval of the intraclass correlation coefficient","volume":"20","author":"Giraudeau","year":"2001","journal-title":"Statistics in Medicine"},{"key":"2023113008163421300_CIT0027","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1002\/(SICI)1097-0258(19980115)17:1<101::AID-SIM727>3.0.CO;2-E","article-title":"Sample size and optimal designs for reliability studies","volume":"17","author":"Walter","year":"1998","journal-title":"Statistics in Medicine"},{"key":"2023113008163421300_CIT0028","doi-asserted-by":"crossref","first-page":"1547","DOI":"10.1002\/sim.2294","article-title":"Effective number of subjects and number of raters for inter-rater reliability studies","volume":"25","author":"Saito","year":"2006","journal-title":"Statistics in Medicine"},{"key":"2023113008163421300_CIT0029","doi-asserted-by":"crossref","first-page":"1331","DOI":"10.1002\/sim.1108","article-title":"Sample size requirements for estimating intraclass correlations with desired precision","volume":"21","author":"Bonett","year":"2002","journal-title":"Statistics in Medicine"},{"key":"2023113008163421300_CIT0030","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1007\/s00357-021-09386-5","article-title":"A comparison of reliability coefficients for ordinal rating scales","volume":"38","author":"de Raadt","year":"2021","journal-title":"Journal of Classification"},{"key":"2023113008163421300_CIT0031","doi-asserted-by":"crossref","first-page":"1506","DOI":"10.1080\/02664763.2013.788617","article-title":"Comparing the methods of measuring multi-rater agreement on an ordinal rating scale: A simulation study with an application to real data","volume":"40","author":"Sertdemir","year":"2013","journal-title":"Journal of Applied Statistics"},{"key":"2023113008163421300_CIT0032","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A guideline of selecting and reporting intraclass correlation coefficients for reliability research","volume":"15","author":"Koo","year":"2016","journal-title":"Journal of Chiropractic Medicine"},{"key":"2023113008163421300_CIT0033","doi-asserted-by":"crossref","first-page":"53","DOI":"10.5116\/ijme.4dfb.8dfd","article-title":"Making sense of Cronbach\u2019s alpha","volume":"2","author":"Tavakol","year":"2011","journal-title":"International Journal of Medical Education"},{"key":"2023113008163421300_CIT0034","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1177\/014662168500900103","article-title":"The effect of number of rating scale categories on levels of interrater reliability: A Monte Carlo investigation","volume":"9","author":"Cicchetti","year":"1985","journal-title":"Applied Psychological Measurement"},{"key":"2023113008163421300_CIT0035","doi-asserted-by":"crossref","first-page":"516","DOI":"10.4103\/ejd.ejd_31_18","article-title":"Comparison of professional and laypeople evaluation of nasolabial esthetics following unilateral cleft lip repair","volume":"12","author":"Adetayo","year":"2018","journal-title":"European Journal of Dentistry"},{"key":"2023113008163421300_CIT0036","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1177\/1055665619868332","article-title":"Developing an eye-tracking protocol to determine children\u2019s visual perception of secondary cleft lip deformity","volume":"57","author":"Karp","year":"2020","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0037","doi-asserted-by":"crossref","first-page":"20","DOI":"10.4103\/jos.JOS_76_20","article-title":"Visual facial perception of postsurgical cleft lip scarring assessed by laypeople via eye-tracking","volume":"10","author":"Guimaraes","year":"2021","journal-title":"Journal of Orthodontic Science"},{"key":"2023113008163421300_CIT0038","doi-asserted-by":"crossref","first-page":"635","DOI":"10.14219\/jada.archive.2011.0245","article-title":"Laypeople\u2019s preferences regarding frontal dentofacial esthetics: tooth-related factors","volume":"142","author":"Witt","year":"2011","journal-title":"Journal of the American Dental Association"},{"key":"2023113008163421300_CIT0039","doi-asserted-by":"crossref","first-page":"506","DOI":"10.1016\/j.bjps.2012.12.001","article-title":"Nasal asymmetry in unilateral cleft lip and palate","volume":"66","author":"Freeman","year":"2013","journal-title":"Journal of Plastic, Reconstructive and Aesthetic Surgery"},{"key":"2023113008163421300_CIT0040","doi-asserted-by":"crossref","first-page":"1717","DOI":"10.1097\/SCS.0000000000006466","article-title":"Evaluation of divine proportions in face and smile of patients with unilateral cleft lip and palate","volume":"31","author":"Omidkhoda","year":"2020","journal-title":"The Journal of Craniofacial Surgery"},{"key":"2023113008163421300_CIT0041","doi-asserted-by":"crossref","first-page":"563734","DOI":"10.1155\/2012\/563734","article-title":"Esthetic composition of smile in individuals with cleft lip, alveolus, and palate: visibility of the periodontium and the esthetics of smile","volume":"2012","author":"Esper","year":"2012","journal-title":"Plastic Surgery International"},{"key":"2023113008163421300_CIT0042","first-page":"17","article-title":"The perception of smile attractiveness among Saudi population","volume":"7","author":"Mokhtar","year":"2015","journal-title":"Clinical, Cosmetic and Investigational Dentistry"},{"key":"2023113008163421300_CIT0043","doi-asserted-by":"crossref","first-page":"194","DOI":"10.1597\/10-043","article-title":"Prevalence of dental anomalies in nonsyndromic individuals with cleft lip and palate: a systematic review and meta-analysis","volume":"49","author":"Tannure","year":"2012","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0044","first-page":"154","article-title":"Evaluation of periodontal tissues in growing patients with bilateral cleft lip and palate. A pilot study","volume":"21","author":"Wyrebek","year":"2017","journal-title":"Developmental Period Medicine"},{"key":"2023113008163421300_CIT0045","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jormas.2019.06.004","article-title":"Maxillary shape at the end of puberty in operated unilateral cleft lip and palate: a geometric morphometric assessment using computer tomography","volume":"121","author":"Segna","year":"2020","journal-title":"Journal of Stomatology, Oral and Maxillofacial Surgery"},{"key":"2023113008163421300_CIT0046","doi-asserted-by":"crossref","first-page":"7432","DOI":"10.3390\/ijerph18147432","article-title":"Maxillary arch dimensions in 6-year-old cleft children in northern Finland: a cross-sectional study","volume":"18","author":"Corcoran","year":"2021","journal-title":"International Journal of Environmental Research and Public Health"},{"key":"2023113008163421300_CIT0047","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1597\/1545-1569(2001)038<0386:FAAFIR>2.0.CO;2","article-title":"Facial attractiveness and facial impairment ratings in children with craniofacial malformations","volume":"38","author":"Okkerse","year":"2001","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0048","doi-asserted-by":"crossref","first-page":"1242","DOI":"10.1097\/SCS.0000000000001784","article-title":"The Asher-McDade aesthetic index in comparison with two scoring systems in nonsyndromic complete unilateral cleft lip and palate patients","volume":"26","author":"Mosmuller","year":"2015","journal-title":"The Journal of Craniofacial Surgery"},{"key":"2023113008163421300_CIT0049","doi-asserted-by":"crossref","first-page":"462","DOI":"10.1177\/10556656211009702","article-title":"Long-term effects of nasoalveolar molding in patients with unilateral cleft lip and palate: a systematic review and meta-analysis","volume":"59","author":"Padovano","year":"2022","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0050","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1597\/15-274","article-title":"The development of the cleft aesthetic rating scale: a new rating scale for the assessment of nasolabial appearance in complete unilateral cleft lip and palate patients","volume":"54","author":"Mosmuller","year":"2017","journal-title":"The Cleft Palate-Craniofacial Journal"},{"key":"2023113008163421300_CIT0051","doi-asserted-by":"crossref","first-page":"793","DOI":"10.1016\/j.ajodo.2013.07.012","article-title":"Photographic and videographic assessment of the smile: objective and subjective evaluations of posed and spontaneous smiles","volume":"144","author":"Walder","year":"2013","journal-title":"American Journal of Orthodontics and Dentofacial Orthopedics"}],"container-title":["European Journal of Orthodontics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/ejo\/article-pdf\/45\/6\/662\/53878923\/cjad016.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/ejo\/article-pdf\/45\/6\/662\/53878923\/cjad016.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,11,30]],"date-time":"2023-11-30T08:17:14Z","timestamp":1701332234000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/ejo\/article\/45\/6\/662\/7161797"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,13]]},"references-count":51,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2023,5,13]]},"published-print":{"date-parts":[[2023,11,30]]}},"URL":"https:\/\/doi.org\/10.1093\/ejo\/cjad016","relation":{},"ISSN":["0141-5387","1460-2210"],"issn-type":[{"type":"print","value":"0141-5387"},{"type":"electronic","value":"1460-2210"}],"subject":[],"published-other":{"date-parts":[[2023,12,1]]},"published":{"date-parts":[[2023,5,13]]}}}