{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,1]],"date-time":"2026-06-01T23:44:35Z","timestamp":1780357475813,"version":"3.54.1"},"reference-count":28,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2015,5,7]],"date-time":"2015-05-07T00:00:00Z","timestamp":1430956800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Access. Comput."],"published-print":{"date-parts":[[2015,6,7]]},"abstract":"<jats:p>In this article, we report on the use of an automatic technique to assess pronunciation in the context of several types of speech disorders. Even if such tools already exist, they are more widely used in a different context, namely, Computer-Assisted Language Learning, in which the objective is to assess nonnative pronunciation by detecting learners\u2019 mispronunciations at segmental and\/or suprasegmental levels. In our work, we sought to determine if the Goodness of Pronunciation (GOP) algorithm, which aims to detect phone-level mispronunciations by means of automatic speech recognition, could also detect segmental deviances in disordered speech. Our main experiment is an analysis of speech from people with unilateral facial palsy. This pathology may impact the realization of certain phonemes such as bilabial plosives and sibilants. Speech read by 32 speakers at four different clinical severity grades was automatically aligned and GOP scores were computed for each phone realization. The highest scores, which indicate large dissimilarities with standard phone realizations, were obtained for the most severely impaired speakers. The corresponding speech subset was manually transcribed at phone level; 8.3% of the phones differed from standard pronunciations extracted from our lexicon. The GOP technique allowed the detection of 70.2% of mispronunciations with an equal rate of about 30% of false rejections and false acceptances. Finally, to broaden the scope of the study, we explored the correlation between GOP values and speech comprehensibility scores on a second corpus, composed of sentences recorded by six people with speech impairments due to cancer surgery or neurological disorders. Strong correlations were achieved between GOP scores and subjective comprehensibility scores (about 0.7 absolute). Results from both experiments tend to validate the use of GOP to measure speech capability loss, a dimension that could be used as a complement to physiological measures in pathologies causing speech disorders.<\/jats:p>","DOI":"10.1145\/2739051","type":"journal-article","created":{"date-parts":[[2015,5,11]],"date-time":"2015-05-11T16:30:57Z","timestamp":1431361857000},"page":"1-14","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":7,"title":["Automatic Assessment of Speech Capability Loss in Disordered Speech"],"prefix":"10.1145","volume":"6","author":[{"given":"Thomas","family":"Pellegrini","sequence":"first","affiliation":[{"name":"Universit\u00e9 de Toulouse; UPS; IRIT, Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lionel","family":"Fontan","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Toulouse; UPS; IRIT, Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julie","family":"Mauclair","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Descartes; IRIT, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J\u00e9r\u00f4me","family":"Farinas","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Toulouse; UPS; IRIT, Toulouse, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charlotte","family":"Alazard-Guiu","sequence":"additional","affiliation":[{"name":"Universit\u00e9 de Toulouse; Octogone-Lordat, TOULOUSE Cedex"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Marina","family":"Robert","sequence":"additional","affiliation":[{"name":"Universit\u00e9 Paris Ouest, Nanterre, France"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Peggy","family":"Gatignol","sequence":"additional","affiliation":[{"name":"H\u00f4pital de la Piti\u00e9 Salp\u00e9tri\u00e8re, Paris, France"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2015,5,7]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"A.-C. Albinhac and A. Rodier. 2003. Analyse quantitative et qualitative des troubles d\u2019articulation dans les paralysies faciales p\u00e9riph\u00e9riques. M\u00e9moire pour l\u2019obtention du CCO. Paris.  A.-C. Albinhac and A. Rodier. 2003. Analyse quantitative et qualitative des troubles d\u2019articulation dans les paralysies faciales p\u00e9riph\u00e9riques. M\u00e9moire pour l\u2019obtention du CCO. Paris."},{"key":"e_1_2_1_2_1","volume-title":"Proceedings of ICSLP. Kobe","author":"Bernstein J.","unstructured":"J. Bernstein , M. Cohen , H. Murveit , D. Rtischev , and M. Weintraub . 1990. Automatic evaluation and training in English pronunciation . In Proceedings of ICSLP. Kobe J. Bernstein, M. Cohen, H. Murveit, D. Rtischev, and M. Weintraub. 1990. Automatic evaluation and training in English pronunciation. In Proceedings of ICSLP. Kobe"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2009.04.005"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1017\/S002221510011093X"},{"key":"e_1_2_1_6_1","unstructured":"L. Fontan P. Gaillard and V. Woisard. 2014. Comprendre et agir: Les tests pragmatiques de compr\u00e9hension de la parole et EloKanz. In Travaux en phon\u00e9tique clinique R. Sock B. Vaxelaire and C. Fauth (Eds.). 131--144.  L. Fontan P. Gaillard and V. Woisard. 2014. Comprendre et agir: Les tests pragmatiques de compr\u00e9hension de la parole et EloKanz. In Travaux en phon\u00e9tique clinique R. Sock B. Vaxelaire and C. Fauth (Eds.). 131--144."},{"key":"e_1_2_1_7_1","volume-title":"Proceedings Interspeech. Lisbon, 1149--1152","author":"Galliano S.","unstructured":"S. Galliano , E. Geoffrois , D. Mostefa , K. Choukri , J.-F. Bonastre , and G. Gravier . 2005. The ESTER phase II evaluation campaign for the rich transcription of French broadcast news . In Proceedings Interspeech. Lisbon, 1149--1152 . S. Galliano, E. Geoffrois, D. Mostefa, K. Choukri, J.-F. Bonastre, and G. Gravier. 2005. The ESTER phase II evaluation campaign for the rich transcription of French broadcast news. In Proceedings Interspeech. Lisbon, 1149--1152."},{"key":"e_1_2_1_8_1","unstructured":"P. Gatignol and G. Lamas. 2004. Paralysies faciales. Solal Editions.  P. Gatignol and G. Lamas. 2004. Paralysies faciales. Solal Editions."},{"key":"e_1_2_1_9_1","volume-title":"Alignements phonetique train Phase 1. (mars","author":"Gravier G.","year":"2005","unstructured":"G. Gravier . 2005. Alignements phonetique train Phase 1. (mars 2005 ). http:\/\/www.afcp-parole.org\/camp&lowbar;eval&lowbar;systemes_transcription\/private\/repository\/IRENE\/align-irisa-enst-phase1.tar.gz. G. Gravier. 2005. Alignements phonetique train Phase 1. (mars 2005). http:\/\/www.afcp-parole.org\/camp&lowbar;eval&lowbar;systemes_transcription\/private\/repository\/IRENE\/align-irisa-enst-phase1.tar.gz."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/019459988509300202"},{"key":"e_1_2_1_11_1","volume-title":"Proceedings of the 2009 ISCA Workshop on Speech and Language Technology in Education (SLaTE \u201909)","author":"Kanters S.","unstructured":"S. Kanters , C. Cucchiarini , and H. Strik . 2009. The goodness of pronunciation algorithm: A detailed performance study . In Proceedings of the 2009 ISCA Workshop on Speech and Language Technology in Education (SLaTE \u201909) . Warwickshire, 2--5. S. Kanters, C. Cucchiarini, and H. Strik. 2009. The goodness of pronunciation algorithm: A detailed performance study. In Proceedings of the 2009 ISCA Workshop on Speech and Language Technology in Education (SLaTE \u201909). Warwickshire, 2--5."},{"key":"e_1_2_1_12_1","unstructured":"T. Kawahara and N. Minematsu. 2012. Tutorial on CALL Systems at Interspeech. Portland.  T. Kawahara and N. Minematsu. 2012. Tutorial on CALL Systems at Interspeech. Portland."},{"key":"e_1_2_1_13_1","first-page":"91","article-title":"Automatic speech recognition (ASR) and its use as a tool for assessment or therapy of voice, speech, and language disorders. Logopedics, Phoniatrics","volume":"34","author":"Kitzin P.","year":"2009","unstructured":"P. Kitzin , A. Maier , and V. L. Ahlander . 2009 . Automatic speech recognition (ASR) and its use as a tool for assessment or therapy of voice, speech, and language disorders. Logopedics, Phoniatrics , Vocology 34 , 2 (2009), 91 -- 96 . P. Kitzin, A. Maier, and V. L. Ahlander. 2009. Automatic speech recognition (ASR) and its use as a tool for assessment or therapy of voice, speech, and language disorders. Logopedics, Phoniatrics, Vocology 34, 2 (2009), 91--96.","journal-title":"Vocology"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00415-005-0715-1"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of Interspeech. Brighton, 608--611","author":"Luo D.","unstructured":"D. Luo , Y. Qiao , N. Minematsu , Y. Yamauchi , and K. Hirose . 2009. Analysis and utilization of MLLR speaker adaptation technique for learners\u2019 pronunciation evaluation . In Proceedings of Interspeech. Brighton, 608--611 . D. Luo, Y. Qiao, N. Minematsu, Y. Yamauchi, and K. Hirose. 2009. Analysis and utilization of MLLR speaker adaptation technique for learners\u2019 pronunciation evaluation. In Proceedings of Interspeech. Brighton, 608--611."},{"key":"e_1_2_1_16_1","volume-title":"Proceedings of Interspeech. 594--597","author":"Luo D.","unstructured":"D. Luo , Y. Qiao , N. Minematsu , Y. Yamauchi , and K. Hirose . 2010. Regularized-MLLR speaker adaptation for computer-assisted language learning system . In Proceedings of Interspeech. 594--597 . D. Luo, Y. Qiao, N. Minematsu, Y. Yamauchi, and K. Hirose. 2010. Regularized-MLLR speaker adaptation for computer-assisted language learning system. In Proceedings of Interspeech. 594--597."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2009.01.004"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1155\/2010\/926951"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of Interspeech. Lyon, 2167--2171","author":"Mauclair J.","unstructured":"J. Mauclair , L. Koenig , M. Robert , and P. Gatignol . 2013. Burst-based features for the classification of pathological voices . In Proceedings of Interspeech. Lyon, 2167--2171 . J. Mauclair, L. Koenig, M. Robert, and P. Gatignol. 2013. Burst-based features for the classification of pathological voices. In Proceedings of Interspeech. Lyon, 2167--2171."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2012.01.175"},{"key":"e_1_2_1_21_1","unstructured":"M. Robert J. Mauclair E. Lannadere F. Tank\u00e9r\u00e9 G. Lamas and P. Gatignol. 2011. Analyse des troubles articulatoires au cours des paralysies faciales p\u00e9riph\u00e9riques. LXVII Congr\u00e8s de la Soci\u00e9t\u00e9 Fran\u00e7aise de Phoniatrie (2011).  M. Robert J. Mauclair E. Lannadere F. Tank\u00e9r\u00e9 G. Lamas and P. Gatignol. 2011. Analyse des troubles articulatoires au cours des paralysies faciales p\u00e9riph\u00e9riques. LXVII Congr\u00e8s de la Soci\u00e9t\u00e9 Fran\u00e7aise de Phoniatrie (2011)."},{"key":"e_1_2_1_22_1","volume-title":"Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910)","author":"Saz O.","year":"2010","unstructured":"O. Saz , E. Lleida , C. Vaquero , and W.-R. Rodr\u00edguez . 2010 . The alborada-I3A corpus of disordered speech . In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910) (19-21), N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner, and D. Tapias (Eds.). ELRA, Valletta, Malta. O. Saz, E. Lleida, C. Vaquero, and W.-R. Rodr\u00edguez. 2010. The alborada-I3A corpus of disordered speech. In Proceedings of the 7th International Conference on Language Resources and Evaluation (LREC\u201910) (19-21), N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner, and D. Tapias (Eds.). ELRA, Valletta, Malta."},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2009.04.006"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijporl.2006.05.016"},{"key":"e_1_2_1_25_1","volume-title":"HMMs. In Proceedings of STiLL. Marholmen, 91--94","author":"Sevenster B.","unstructured":"B. Sevenster , G. de Krom , and G. Bloothooft . 1998. Evaluation and training of second-language learners\u2019 pronunciation using phoneme-based HMMs. In Proceedings of STiLL. Marholmen, 91--94 . B. Sevenster, G. de Krom, and G. Bloothooft. 1998. Evaluation and training of second-language learners\u2019 pronunciation using phoneme-based HMMs. In Proceedings of STiLL. Marholmen, 91--94."},{"key":"e_1_2_1_26_1","volume-title":"Proceedings of Interspeech. Antwerp","author":"Strik H.","unstructured":"H. Strik , Khiet P. Truong , F. de Wet , and C. Cucchiarini . 2007. Comparing classifiers for pronunciation error detection . In Proceedings of Interspeech. Antwerp , 1837--1840. H. Strik, Khiet P. Truong, F. de Wet, and C. Cucchiarini. 2007. Comparing classifiers for pronunciation error detection. In Proceedings of Interspeech. Antwerp, 1837--1840."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2010\/09-0100)"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-6393(99)00044-8"},{"key":"e_1_2_1_30_1","first-page":"2","article-title":"The HTK hidden Markov model toolkit: Design and philosophy","volume":"2","author":"Young S. J.","year":"1994","unstructured":"S. J. Young and S. J. Young . 1994 . The HTK hidden Markov model toolkit: Design and philosophy . Entropic Cambridge Research Laboratory, Ltd 2 (1994), 2 -- 44 . S. J. Young and S. J. Young. 1994. The HTK hidden Markov model toolkit: Design and philosophy. Entropic Cambridge Research Laboratory, Ltd 2 (1994), 2--44.","journal-title":"Entropic Cambridge Research Laboratory, Ltd"}],"container-title":["ACM Transactions on Accessible Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2739051","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2739051","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:16:23Z","timestamp":1750227383000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2739051"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,5,7]]},"references-count":28,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2015,6,7]]}},"alternative-id":["10.1145\/2739051"],"URL":"https:\/\/doi.org\/10.1145\/2739051","relation":{},"ISSN":["1936-7228","1936-7236"],"issn-type":[{"value":"1936-7228","type":"print"},{"value":"1936-7236","type":"electronic"}],"subject":[],"published":{"date-parts":[[2015,5,7]]},"assertion":[{"value":"2014-04-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-02-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2015-05-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}