{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T02:09:29Z","timestamp":1780452569760,"version":"3.54.1"},"reference-count":47,"publisher":"SAGE Publications","issue":"8","license":[{"start":{"date-parts":[[2018,4,10]],"date-time":"2018-04-10T00:00:00Z","timestamp":1523318400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The Cleft Palate Craniofacial Journal"],"published-print":{"date-parts":[[2018,9]]},"abstract":"<jats:sec>\n                    <jats:title>Objective:<\/jats:title>\n                    <jats:p>To compare reliability in auditory-perceptual assessment of hypernasality for 3 different methods and to explore the influence of language background.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Design:<\/jats:title>\n                    <jats:p>Comparative methodological study.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Participants and Materials:<\/jats:title>\n                    <jats:p>Audio recordings of 5-year-old Swedish-speaking children with repaired cleft lip and palate consisting of 73 stimuli of 9 nonnasal single-word strings in 3 different randomized orders. Four experienced speech-language pathologists (2 native speakers of Brazilian\u2013Portuguese and 2 native speakers of Swedish) participated as listeners. After individual training, each listener performed the hypernasality rating task. Each order of stimuli was analyzed individually using the 2-step, VISOR and Borg centiMax scale methods.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Main Outcome Measures:<\/jats:title>\n                    <jats:p>Comparison of intra- and inter-rater reliability, and consistency\u00a0 for each method within language of the listener and between listener languages (Swedish and Brazilian\u2013Portuguese).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>Good to excellent intra-rater reliability was found within each listener for all methods, 2-step: \u03ba = 0.59-0.93; VISOR: intraclass correlation coefficient (ICC) = 0.80-0.99; Borg centiMax (cM) scale: ICC = 0.80-1.00. The highest inter-rater reliability was demonstrated for VISOR (ICC = 0.60-0.90) and Borg cM-scale (ICC = 0.40-0.80). High consistency within each method was found with the highest for the Borg cM scale (ICC = 0.89-0.91). There was a significant difference in the ratings between the Swedish and the Brazilian listeners for all methods.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions:<\/jats:title>\n                    <jats:p>The category-ratio scale Borg cM was considered most reliable in the assessment of hypernasality. Language background of Brazilian\u2013Portuguese listeners influenced the perceptual ratings of hypernasality in Swedish speech samples, despite their experience in perceptual assessment of cleft palate speech disorders.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1177\/1055665618767116","type":"journal-article","created":{"date-parts":[[2018,4,10]],"date-time":"2018-04-10T13:27:20Z","timestamp":1523366840000},"page":"1060-1071","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":32,"title":["Reliability of Hypernasality Rating"],"prefix":"10.1177","volume":"55","author":[{"given":"Renata Paciello","family":"Yamashita","sequence":"first","affiliation":[{"name":"Laboratory of Physiology, Hospital for Rehabilitation of Craniofacial Anomalies, University of Sao Paulo, Bauru, S\u00e3o Paulo, Brazil"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Elisabet","family":"Borg","sequence":"additional","affiliation":[{"name":"Department of Psychology, Stockholm University, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Svante","family":"Granqvist","sequence":"additional","affiliation":[{"name":"Division of Speech and Language Pathology, Karolinska Institutet, Royal Institute of Technology, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anette","family":"Lohmander","sequence":"additional","affiliation":[{"name":"Division of Speech and Language Pathology, Karolinska Institutet, Karolinska University Hospital, Stockholm, Sweden"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"179","published-online":{"date-parts":[[2018,4,10]]},"reference":[{"key":"bibr1-1055665618767116","unstructured":"Altman DG. Practical Statistics for Medical Research. London, England: Chapman & Hall\/CRC Press; 1991:404."},{"key":"bibr2-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/1545-1569_1996_033_0333_nvfnss_2.3.co_2"},{"key":"bibr3-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2007.10.006"},{"key":"bibr4-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/09-201"},{"key":"bibr5-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/14-040"},{"key":"bibr6-1055665618767116","volume-title":"Physical performance and perceived exertion","author":"Borg G","year":"1962"},{"key":"bibr7-1055665618767116","volume-title":"Psychophysical Judgment and the Process of Perception","author":"Borg G","year":"1982"},{"key":"bibr8-1055665618767116","volume-title":"Borg\u2019s Perceived exertion and pain scales","author":"Borg G","year":"1998"},{"key":"bibr9-1055665618767116","volume-title":"On Perceived Exertion and its Measurement. Stockholm, Sweden","author":"Borg E","year":"2007"},{"key":"bibr10-1055665618767116","volume-title":"Presented at the 27th Annual Meeting of the International Society for Psychophysics","author":"Borg E"},{"key":"bibr11-1055665618767116","first-page":"15","volume":"28","author":"Borg G","year":"2001","journal-title":"Psychologica"},{"key":"bibr12-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/09-106"},{"key":"bibr13-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/05-164"},{"key":"bibr14-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1080\/13682820802295203"},{"key":"bibr15-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/15-164"},{"key":"bibr16-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2002\/009)"},{"key":"bibr17-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1037\/1040-3590.6.4.284"},{"key":"bibr18-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2005.08.007"},{"key":"bibr19-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2010\/09-0205)"},{"key":"bibr20-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176344552"},{"key":"bibr21-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3601.14"},{"key":"bibr22-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1080\/14015430310015255"},{"key":"bibr23-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/02-164.1"},{"key":"bibr24-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1016\/j.jvoice.2011.06.003"},{"key":"bibr25-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/1058-0360.0503.07"},{"key":"bibr26-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/1545-1569_1999_036_0328_tirotp_2.3.co_2"},{"key":"bibr27-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/jshr.3601.21"},{"key":"bibr28-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1121\/1.1289362"},{"key":"bibr29-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1080\/13682820801890400"},{"key":"bibr30-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1080\/02699200802688596"},{"key":"bibr31-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/08-039.1"},{"key":"bibr32-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1080\/2000656X.2016.1254645"},{"key":"bibr33-1055665618767116","first-page":"371","volume":"1","author":"Moll K","year":"1964","journal-title":"Cleft Palate Craniofac J"},{"key":"bibr34-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1597\/1545-1569_1994_031_0356_movcfd_2.3.co_2"},{"key":"bibr35-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1055\/s-2007-1021244"},{"key":"bibr36-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1159\/000200768"},{"key":"bibr37-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1590\/2317-1782\/20162015163"},{"key":"bibr38-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1093\/bjps\/44.3.477"},{"key":"bibr39-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2005\/022)"},{"key":"bibr40-1055665618767116","first-page":"117","volume":"5","author":"Sideridis GD","year":"2010","journal-title":"Int J Educ Psychol Assess"},{"key":"bibr41-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1037\/h0043680"},{"key":"bibr42-1055665618767116","unstructured":"Stevens SS. Psychophysics: introduction to its perceptual, neural and social prospects. New York, NY: Wiley; 1975."},{"key":"bibr43-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1002\/1097-0258(20001230)19:24<3483::AID-SIM786>3.0.CO;2-A"},{"key":"bibr44-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcomdis.2007.02.002"},{"key":"bibr45-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1002\/nur.4770130405"},{"key":"bibr46-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2002\/006)"},{"key":"bibr47-1055665618767116","doi-asserted-by":"publisher","DOI":"10.1044\/jslhr.4304.979"}],"container-title":["The Cleft Palate Craniofacial Journal"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1055665618767116","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/1055665618767116","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1055665618767116","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:19:13Z","timestamp":1777393153000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1055665618767116"}},"subtitle":["Comparison of 3 Different Methods for Perceptual Assessment"],"short-title":[],"issued":{"date-parts":[[2018,4,10]]},"references-count":47,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2018,9]]}},"alternative-id":["10.1177\/1055665618767116"],"URL":"https:\/\/doi.org\/10.1177\/1055665618767116","relation":{},"ISSN":["1055-6656","1545-1569"],"issn-type":[{"value":"1055-6656","type":"print"},{"value":"1545-1569","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,4,10]]}}}