{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,12]],"date-time":"2026-09-12T02:16:10Z","timestamp":1789179370876,"version":"build-2803163510"},"reference-count":28,"publisher":"SAGE Publications","issue":"5","license":[{"start":{"date-parts":[[2020,10,8]],"date-time":"2020-10-08T00:00:00Z","timestamp":1602115200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The Cleft Palate Craniofacial Journal"],"published-print":{"date-parts":[[2021,5]]},"abstract":"<jats:sec>\n                    <jats:title>Background:<\/jats:title>\n                    <jats:p>Analyze intrarater and interrater reliability for evaluating endoscopic images of velopharyngeal (VP) physiology.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method:<\/jats:title>\n                    <jats:p>Speakers produced 9 speech stimuli representing 4 stimulus types: sustained phonemes, repetitions of \u201cpuh,\u201d single words, and short phrases. The 37-speaker participants included 16 patients with VP dysfunction and 21 control participants. Five raters independently rated the video images for degree of VP opening, location of opening, and pattern of closure. Outcome measures included intrarater and interrater measures of reliability and the effects of raters and stimulus type on ratings.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>Intrarater reliability was acceptable, and ratings were logically consistent. Fixed effects regression coefficients for the patient and the control groups showed that raters were a significant source of variability for degree of opening and pattern of closing. Stimulus type was not a significant source of variation for any metric for the controls, but stimulus type was a significant determinant for degree of opening for patients. The degree of opening was larger for sustained phonemes than for the other speech stimuli. Ratings for degree of opening were most similar for repeated \u201cpuh.\u201d<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>Interrater reliability needs to be improved so that the assessment procedure produces more consistent findings among clinicians, thus strengthening our evidence base for this procedure. Interrater additional research is needed to understand how the stimulus affects ratings of VP physiology, to identify stimuli that yield the most useful clinical information, and to understand how training affects the ratings of VP physiology.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/1055665620961911","type":"journal-article","created":{"date-parts":[[2020,10,8]],"date-time":"2020-10-08T05:27:40Z","timestamp":1602134860000},"page":"546-556","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":8,"title":["The Reliability of Visual Ratings of Velopharyngeal Physiology for Speech"],"prefix":"10.1177","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8626-9304","authenticated-orcid":false,"given":"Thomas","family":"Watterson","sequence":"first","affiliation":[{"name":"University of Nevada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeanne","family":"Wendel","sequence":"additional","affiliation":[{"name":"University of Nevada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lynn M.","family":"Grames","sequence":"additional","affiliation":[{"name":"St. Louis Children\u2019s Hospital"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amanda","family":"Warner","sequence":"additional","affiliation":[{"name":"Washoe County School District"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2020,10,8]]},"reference":[{"key":"e_1_3_2_2_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.1902.225"},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1597\/11-131"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1288\/00005537-198102000-00015"},{"issue":"3","key":"e_1_3_2_5_1","first-page":"217","article-title":"Reliability of flexible fiberoptic nasopharyngoscopy for evaluation of velopharyngeal function in a clinical population","volume":"26","author":"D\u2019Antonio LL","year":"1989","unstructured":"D\u2019Antonio LL, Marsh JL, Province MA, Muntz HA, Phillips CJ. Reliability of flexible fiberoptic nasopharyngoscopy for evaluation of velopharyngeal function in a clinical population. Cleft Palate J. 1989;26(3):217\u2013225.","journal-title":"Cleft Palate J"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11135-014-0003-1"},{"key":"e_1_3_2_7_1","doi-asserted-by":"publisher","DOI":"10.1597\/1545-1569(1990)027<0337:SFTRON>2.3.CO;2"},{"issue":"2","key":"e_1_3_2_8_1","first-page":"97","article-title":"Reliability of the nasopharyngeal fiberscope (NPF) for assessing velopharyngeal function","volume":"20","author":"Ibuki K","year":"1983","unstructured":"Ibuki K, Karnell MP, Morris HL. Reliability of the nasopharyngeal fiberscope (NPF) for assessing velopharyngeal function. Cleft Palate J. 1983;20(2):97\u2013104.","journal-title":"Cleft Palate J"},{"key":"e_1_3_2_9_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.2302.429"},{"issue":"3","key":"e_1_3_2_10_1","first-page":"199","article-title":"Reliability of the nasopharyngeal fiberscope (NPF) for assessing velopharyngeal function: analysis by judgment","volume":"20","author":"Karnell MP","year":"1983","unstructured":"Karnell MP, Ibuki K, Morris HL, Van Demark DR. Reliability of the nasopharyngeal fiberscope (NPF) for assessing velopharyngeal function: analysis by judgment. Cleft Palate J. 1983;20(3):199\u2013208.","journal-title":"Cleft Palate J"},{"issue":"2","key":"e_1_3_2_11_1","first-page":"88","article-title":"A cineradiographic investigations of velar movement variables in two normals","volume":"13","author":"Kuehn DP","year":"1976","unstructured":"Kuehn DP. A cineradiographic investigations of velar movement variables in two normals. Cleft Palate J. 1976;13(2):88\u2013103.","journal-title":"Cleft Palate J"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4101.51"},{"key":"e_1_3_2_13_1","volume-title":"Cleft Palate and Craniofacial Anomalies","author":"Kummer A","year":"2014","unstructured":"Kummer A. Cleft Palate and Craniofacial Anomalies. Cengage Learning; 2014."},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1597\/1545-1569_2003_040_0590_trbtco_2.0.co_2"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.otohns.2005.11.028"},{"key":"e_1_3_2_16_1","first-page":"286","article-title":"Fiberoptic examination of velopharyngeal closure in normal individuals","volume":"11","author":"Matsuya T","year":"1974","unstructured":"Matsuya T, Miyazaki T, Yamaoka M. Fiberoptic examination of velopharyngeal closure in normal individuals. J Cleft Palate. 1974:11(July):286\u2013291.","journal-title":"J Cleft Palate"},{"key":"e_1_3_2_17_1","first-page":"2","volume-title":"What\u2019s New? Language Learning Perspectives","author":"Meline T","year":"2006","unstructured":"Meline T. Evidence-based speech-language pathology (practice). What\u2019s New? Language Learning Perspectives. 2006:2\u20135."},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.0501.30"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.1097\/01.PRS.0000169694.29082.69"},{"issue":"3","key":"e_1_3_2_20_1","first-page":"216","article-title":"A cineradiographic and electromyographic investigation of velar positioning in non-nasal speech","volume":"17","author":"Seaver EJ","year":"1980","unstructured":"Seaver EJ, Kuehn DP. A cineradiographic and electromyographic investigation of velar positioning in non-nasal speech. Cleft Palate J. 1980;17(3):216\u2013226.","journal-title":"Cleft Palate J"},{"issue":"7","key":"e_1_3_2_21_1","first-page":"757","article-title":"Multicenter interrater and intrarater reliability in the endoscopic evaluation of velopharyngeal insufficiency","volume":"134","author":"Sie KCY","year":"2008","unstructured":"Sie KCY, Starr JR, Bloom DC, Cunningham M, de Serres LM, Drake AF, Elluru RG, Haddad J, Hartnick C, MacArthur C, et al. Multicenter interrater and intrarater reliability in the endoscopic evaluation of velopharyngeal insufficiency. Otolaryngol Head Neck Surg. 2008;134(7):757\u2013763.","journal-title":"Otolaryngol Head Neck Surg"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/0007-1226(82)90146-1"},{"key":"e_1_3_2_23_1","first-page":"429","article-title":"The sphincteric mechanism of velopharyngeal closure","volume":"10","author":"Skolnick ML","year":"1973","unstructured":"Skolnick ML, McCall GN, Barnes M. The sphincteric mechanism of velopharyngeal closure. Cleft Palate J. 1973;10(July):429\u2013446.","journal-title":"Cleft Palate J"},{"issue":"5","key":"e_1_3_2_24_1","first-page":"360","article-title":"Understanding interobserver agreement\u201d the kappa statistic","volume":"37","author":"Viera AJ","year":"2005","unstructured":"Viera AJ, Garrett JM. Understanding interobserver agreement\u201d the kappa statistic. Fam Med. 2005;37(5):360\u2013363","journal-title":"Fam Med"},{"key":"e_1_3_2_25_1","first-page":"52","article-title":"A pressure-flow technique for measuring velopharyngeal orifice area during continuous speech","volume":"1","author":"Warren DW","year":"1964","unstructured":"Warren DW, Dubois AB. A pressure-flow technique for measuring velopharyngeal orifice area during continuous speech. Cleft Palate J. 1964;1(January):52\u201371.","journal-title":"Cleft Palate J"},{"issue":"4","key":"e_1_3_2_26_1","first-page":"271","article-title":"Observed effects of velopharyngeal orifice size on vowel identification and vowel nasality","volume":"18","author":"Watterson T","year":"1981","unstructured":"Watterson T, Emanuel FW. Observed effects of velopharyngeal orifice size on vowel identification and vowel nasality. Cleft Palate J. 1981;18(4):271\u2013278.","journal-title":"Cleft Palate J"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1044\/ssod24.2.67"},{"issue":"9","key":"e_1_3_2_28_1","first-page":"947","article-title":"Interrater and intrarater reliability in the evaluation of velopharyngeal insufficiency within a single institution","volume":"132","author":"Yoon PJ","year":"2006","unstructured":"Yoon PJ, Starr JR, Perkins JA, Bloom D, Sie KCY. Interrater and intrarater reliability in the evaluation of velopharyngeal insufficiency within a single institution. Otolaryngol Head Neck Surg. 2006;132(9):947\u2013951.","journal-title":"Otolaryngol Head Neck Surg"},{"key":"e_1_3_2_29_1","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3906.1199"}],"container-title":["The Cleft Palate Craniofacial Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1055665620961911","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1055665620961911","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1055665620961911","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:22:37Z","timestamp":1777393357000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1055665620961911"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,8]]},"references-count":28,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2021,5]]}},"alternative-id":["10.1177\/1055665620961911"],"URL":"https:\/\/doi.org\/10.1177\/1055665620961911","relation":{},"ISSN":["1055-6656","1545-1569"],"issn-type":[{"value":"1055-6656","type":"print"},{"value":"1545-1569","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,10,8]]}}}