{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T11:35:32Z","timestamp":1768217732182,"version":"3.49.0"},"reference-count":51,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T00:00:00Z","timestamp":1768176000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["JCM"],"abstract":"<jats:p>Background\/Objectives: Multidisciplinary outcome studies are carried out to evaluate long-term treatment in patients with cleft lip and palate. Speech function as one of the key outcomes of the treatment is examined by means of an auditory-perceptual analysis. For scientific and global studies it is essential to reduce the risk of bias as much as possible. The aim of the present study was the examination of auditory-perceptive analyses on the basis of an outcome study. Reliability was evaluated. Methods: Twenty patients were examined to evaluate their speech function. The speech sample was obtained via the online tool Zoom\u2122. The speech sample consisted of single words (picture supported), a version of the German \u201cGreat Ormond Street Speech Assessment\u201d (GOS.SP.ASS) sentences and spontaneous speech. The analysis was carried out by three experienced examiners, all using the German version of the Universal Reporting Parameters at two different times. The intrarater and interrater reliability were calculated. Results: Twenty participants with unilateral cleft and palate and a minimum age of 18 years (\u00f8 20.1) were enrolled in the analysis of the speech function. None of the participants had undergone a secondary operation due to velopharyngeal incompetence. The examination happened at a point in time before an osteotomy might be needed. The multidisciplinary treatment of the 20 participants regarding their speech function was successful. There were only marginal abnormalities. The listeners showed a very good intrarater and moderate interrater reliability (ICC\/Fleiss\u2019 kappa). An overall percentual agreement of 88.3% was achieved. Conclusions: These positive results cannot be compared with outcome studies on a national or international level, since the construction of the speech sample as well as the structure and the implementation of the auditing process reveal considerable deficiencies in methodological rigor. The small number of examiners and patients as well as the patients\u2019 minor residual impairments influence the significance of the statistical calculation by kappa and ICC. The auditory-perceptual analysis should be validated for German-speaking countries.<\/jats:p>","DOI":"10.3390\/jcm15020588","type":"journal-article","created":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T08:20:37Z","timestamp":1768206037000},"page":"588","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reliability of Auditory-Perceptual Analysis in the Study of Speech Function in Patients with Unilateral Cleft and Palate"],"prefix":"10.3390","volume":"15","author":[{"given":"Alexandra","family":"Bloeck","sequence":"first","affiliation":[{"name":"Practice for Speech and Language Therapy, 55590 Meisenheim, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nora Ann","family":"Doyle","sequence":"additional","affiliation":[{"name":"Department of Oral and Maxillofacial Surgery, University Hospital T\u00fcbingen, 72076 Tuebingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7333-9406","authenticated-orcid":false,"given":"Sylva","family":"Bartel","sequence":"additional","affiliation":[{"name":"Department of Phoniatrics and Pediatric Audiology, ENT Clinic, University Hospital, 06120 Halle (Saale), Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-8428-725X","authenticated-orcid":false,"given":"Michael","family":"Krimmel","sequence":"additional","affiliation":[{"name":"Department of Oral and Maxillofacial Surgery, University Hospital T\u00fcbingen, 72076 Tuebingen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2026,1,12]]},"reference":[{"key":"ref_1","unstructured":"(2025, December 22). Cleft Registry And Audit Network. Annual Report. Available online: https:\/\/www.crane-database.org.uk\/wp-content\/uploads\/2024\/12\/CRANE-2024-Annual-Report_V1_final.pdf."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1597\/06-086.1","article-title":"Universal parameters for reporting speech outcomes in individuals with cleft palate","volume":"45","author":"Henningsson","year":"2008","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_3","unstructured":"Deutsche Gesellschaft f\u00fcr Mund-Kiefer- und Gesichtschirurgie e.V., and Deutsche Gesellschaft f\u00fcr Zahn-Mund- und Kieferheilkunde e.V (2025, December 22). Therapie der Lippen-Kiefer-Gaumenspalten. Available online: https:\/\/www.awmf.org\/service\/awmf-aktuell\/therapie-der-lippen-kiefer-gaumen-fehlbildungen-3."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Paradowska-Stolarz, A., Mikulewicz, M., and Du\u015b-Ilnicka, I. (2022). Current Concepts and Challenges in the Treatment of Cleft Lip and Palate Patients-A Comprehensive Review. J. Pers. Med., 12.","DOI":"10.3390\/jpm12122089"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"519","DOI":"10.1016\/j.ijom.2024.12.001","article-title":"Between unity and disparity: Current treatment protocols for common orofacial clefts in European expert centres","volume":"54","author":"Mathijssen","year":"2025","journal-title":"Int. J. Oral. Maxillofac. Surg."},{"key":"ref_6","unstructured":"Fox, A.V. (2007). Kindliche Aussprachestoerungen, Schulz-Kirchner Verlag."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3109\/13682829409041477","article-title":"A screening assessment of cleft palate speech (Great Ormond Street Speech Assessment)","volume":"29","author":"Sell","year":"1994","journal-title":"Eur. J. Disord. Commun."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1597\/1545-1569(2000)037<0348:SALIIT>2.3.CO;2","article-title":"The state of the art: Speech and language issues in the cleft palate population","volume":"37","author":"Kuehn","year":"2000","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1597\/02-136","article-title":"Methodology for perceptual assessment of speech in patients with cleft palate: A critical review of the literature","volume":"41","author":"Lohmander","year":"2004","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1597\/1545-1569_2001_038_0059_roltoc_2.0.co_2","article-title":"Reliability of Listener Transcriptions of Compensatory Articulations","volume":"38","author":"Gooch","year":"2001","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"103","DOI":"10.1080\/13682820400016522","article-title":"Issues in perceptual speech analysis in cleft palate and related disorders: A review","volume":"40","author":"Sell","year":"2005","journal-title":"Int. J. Lang. Commun. Disord."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1597\/04-141.1","article-title":"The cleft audit protocol for speech-augmented: A validated and reliable measure for auditing cleft speech","volume":"43","author":"John","year":"2006","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1080\/136828299247595","article-title":"GOS.SP.ASS.\u201998: An assessment for speech disorders associated with cleft palate and\/or velopharyngeal dysfunction (revised)","volume":"34","author":"Sell","year":"1999","journal-title":"Int. J. Lang. Commun. Disord."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"529","DOI":"10.1080\/13682820802196815","article-title":"Cleft audit protocol for speech (CAPS-A): A comprehensive training package for speech analysis","volume":"44","author":"Sell","year":"2009","journal-title":"Int. J. Lang. Commun. Disord."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1597\/14-027","article-title":"The Americleft Speech Project: A Training and Reliability Study","volume":"53","author":"Chapman","year":"2016","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1177\/1055665619862726","article-title":"Stages in the Development and Validation of a Belgian Dutch Outcome Tool for the Perceptual Evaluation of Speech in Patients With Cleft Palate","volume":"57","author":"Bruneel","year":"2020","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_17","unstructured":"Cleft Palate International Speech Issues (2025). Guidelines for Creating a Restricted Wordlist for Cross-Linguistic Comparison, Karolinska Institutet. Available online: https:\/\/clispi.com\/clispi.php?id=386&mid=387&p=386&l=1."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1597\/08-039.1","article-title":"Methodology for speech assessment in the Scandcleft project--an international randomized clinical trial on palatal surgery: Experiences from a pilot study","volume":"46","author":"Lohmander","year":"2009","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1111\/1460-6984.12625","article-title":"perceptual outcome measure of velopharyngeal function based on the Cleft Audit Protocol for Speech-Augmented (CAPS-A VPC-Sum): Validation through a speech osteotomy study","volume":"56","author":"Pereira","year":"2021","journal-title":"Int. J. Lang. Commun. Disord."},{"key":"ref_20","first-page":"14","article-title":"GOSSPASS \u201898-D: Ein Untersuchungsprotokoll f\u00fcr Patienten mit Lippen-Kiefer-Gaumenspalten","volume":"1","author":"Bressmann","year":"2002","journal-title":"Forum Logop\u00e4die"},{"key":"ref_21","unstructured":"Neumann, S. (2025, December 22). Deutsche Version GOS.SP.ASS\u201998\u2013D-cleftNet; i-Magazine AG. Available online: https:\/\/www.yumpu.com\/user\/cleftnet.de."},{"key":"ref_22","first-page":"6","article-title":"LKGF: Online-Erhebung. Eine deutschlandweite Erhebung zur logop\u00e4dischen Versorgungsstruktur und -qualit\u00e4t","volume":"38","author":"Reckziegel","year":"2024","journal-title":"Forum. Logop\u00e4die"},{"key":"ref_23","unstructured":"Neumann, S. (2011). LKGSF-Komplex, Ernst Rheinhard Verlag."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1016\/j.jcm.2016.02.012","article-title":"A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research","volume":"15","author":"Koo","year":"2016","journal-title":"J. Chiropr. Med."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"613","DOI":"10.1177\/001316447303300309","article-title":"The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability","volume":"33","author":"Fleiss","year":"1973","journal-title":"Educ. Psychol. Meas."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1037\/h0031619","article-title":"Measuring nominal scale agreement among many raters","volume":"76","author":"Fleiss","year":"1971","journal-title":"Psychol. Bull."},{"key":"ref_27","unstructured":"Copilot, M. (2025, October 16). Intrarater-Reliabilit\u00e4t. Available online: https:\/\/copilot.microsoft.com."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1076\/jcen.23.5.695.1249","article-title":"The precision of reliability and validity estimates re-visited: Distinguishing between clinical and statistical significance of sample size requirements","volume":"23","author":"Cicchetti","year":"2001","journal-title":"J. Clin. Exp. Neuropsychol."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"225","DOI":"10.3109\/02699209108986113","article-title":"Reliability studies in broad and narrow phonetic transcription","volume":"5","author":"Shriberg","year":"1991","journal-title":"Clin. Linguist. Phon."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"D\u00f6ring, N., and Bortz, J. (2016). Forschungsmethoden und Evaluation in den Sozial- und Humanwissemnshaften, Springer.","DOI":"10.1007\/978-3-642-41089-5"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1136","DOI":"10.1044\/2020_JSLHR-20-00214","article-title":"Effect of Training With Anchors on Auditory-Perceptual Evaluation of Dysphonia in Speech-Language Pathology Students","volume":"64","author":"Wong","year":"2021","journal-title":"J. Speech. Lang. Hear. Res."},{"key":"ref_32","unstructured":"Harris, S. (2018). The Voice Clinic Handbook, Compton Publishing."},{"key":"ref_33","unstructured":"Howard, S., and Lohmander, A. (2013). Cleft Palate Speech: Assessment and Intervention, John Wiley & Sons."},{"key":"ref_34","unstructured":"Kahl-Nieke, B. (2010). Einf\u00fchrung in die Kieferorthop\u00e4die. Diagnostik, Behandlungsplanung, Therapie, Deutscher Zahn\u00e4rzte Verlag."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"125","DOI":"10.17219\/dmp\/170921","article-title":"Is prevalence of dental anomalies site-specific in cleft lip and palate patients? A systematic review and meta-analysis","volume":"62","author":"Wadhwa","year":"2025","journal-title":"Dent. Med. Probl."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"1177","DOI":"10.1044\/jshr.3606.1177","article-title":"Effect of microphone type and placement on voice perturbation measurements","volume":"36","author":"Titze","year":"1993","journal-title":"J. Speech. Hear. Res."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"108639","DOI":"10.1016\/j.apacoust.2022.108639","article-title":"Evaluation of noise excitation as a method for detection of hypernasality","volume":"190","author":"Young","year":"2022","journal-title":"Appl. Acoust."},{"key":"ref_38","unstructured":"Peterson-Falzone, S., Trost-Cardamone, J., Karnell, P.M., and Haardin-Jones, M. (2016). The Clinician\u2019s Guide to Treating Cleft Palate Speech, Elsevier."},{"key":"ref_39","unstructured":"Ferlin, F., Yamashita, R.P., and Fukushiro, A.P. (2017). Influence of high and low intraoral pressure consonants on the speech nasality and nasalance in patients with repaired cleft palate. Audiol.\u2014Commun. Res., 22."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"544","DOI":"10.1597\/02-164.1","article-title":"Speech outcome following treatment in cross-linguistic cleft palate studies: Methodological implications","volume":"41","author":"Hutters","year":"2004","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"348","DOI":"10.3109\/13682822.2010.507615","article-title":"The impact of speech material on speech judgement in children with and without cleft palate","volume":"46","author":"Salameh","year":"2011","journal-title":"Int. J. Lang. Commun. Disord."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1177\/1055665617718546","article-title":"Comparing Methodologies in a Series of Speech Outcome Studies: Challenges and Lessons Learned","volume":"55","author":"Ahl","year":"2018","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1189","DOI":"10.1177\/10556656221097820","article-title":"The First Hybrid International Educational Comprehensive Cleft Care Workshop","volume":"60","author":"Kantar","year":"2023","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/S0021-9924(02)00134-X","article-title":"The influence of listener experience and academic training on ratings of nasality","volume":"36","author":"Lewis","year":"2003","journal-title":"J. Commun. Disord."},{"key":"ref_45","first-page":"169","article-title":"Inter-rater reliability in cleft palate speech assessment","volume":"2","author":"Hayden","year":"2000","journal-title":"J. Clin.Excell."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1597\/05-164","article-title":"A cross-sectional study of speech in 10-year-old children with cleft palate: Results and issues of rater reliability","volume":"44","author":"Lohmander","year":"2007","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1080\/02699200802688596","article-title":"Effect of listener training on perceptual judgement of hypernasality","volume":"23","author":"Lee","year":"2009","journal-title":"Clin. Linguist. Phon."},{"key":"ref_48","first-page":"360","article-title":"Understanding interobserver agreement: The kappa statistic","volume":"37","author":"Viera","year":"2005","journal-title":"Fam. Med."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1597\/15-164","article-title":"Perceptual Judgments of Resonance, Nasal Airflow, Understandability, and Acceptability in Speakers With Cleft Palate: Ordinal Versus Visual Analogue Scaling","volume":"54","author":"Castick","year":"2017","journal-title":"Cleft Palate-Craniofacial J."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2986","DOI":"10.1109\/TBME.2021.3058424","article-title":"Deep Learning Algorithm for Objective Assessment of Hypernasality in Children With Cleft Palate","volume":"68","author":"Mathad","year":"2021","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"1684","DOI":"10.1177\/10556656241271646","article-title":"Using Artificial Intelligence for Assessment of Velopharyngeal Competence in Children Born With Cleft Palate With or Without Cleft Lip","volume":"62","author":"Cornefjord","year":"2024","journal-title":"Cleft Palate-Craniofacial J."}],"container-title":["Journal of Clinical Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/2\/588\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,12]],"date-time":"2026-01-12T08:36:50Z","timestamp":1768207010000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2077-0383\/15\/2\/588"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,1,12]]},"references-count":51,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2026,1]]}},"alternative-id":["jcm15020588"],"URL":"https:\/\/doi.org\/10.3390\/jcm15020588","relation":{},"ISSN":["2077-0383"],"issn-type":[{"value":"2077-0383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,1,12]]}}}