{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T23:28:53Z","timestamp":1778542133644,"version":"3.51.4"},"reference-count":50,"publisher":"Acoustical Society of America (ASA)","issue":"2","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["BCS2141413"],"award-info":[{"award-number":["BCS2141413"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,8,1]]},"abstract":"<jats:p>For most of his illustrious career, Ken Stevens focused on examining and documenting the rich detail about vocal tract changes available to listeners underlying the acoustic signal of speech. Current approaches to speech inversion take advantage of this rich detail to recover information about articulatory movement. Our previous speech inversion work focused on movements of the tongue and lips, for which \u201cground truth\u201d is readily available. In this study, we describe acquisition and validation of ground-truth articulatory data about velopharyngeal port constriction, using both the well-established measure of nasometry plus a novel technique\u2014high-speed nasopharyngoscopy. Nasometry measures the acoustic output of the nasal and oral cavities to derive the measure nasalance. High-speed nasopharyngoscopy captures images of the nasopharyngeal region and can resolve velar motion during speech. By comparing simultaneously collected data from both acquisition modalities, we show that nasalance is a sufficiently sensitive measure to use as ground truth for our speech inversion system. Further, a speech inversion system trained on nasalance can recover known patterns of velopharyngeal port constriction shown by American English speakers. Our findings match well with Stevens' own studies of the acoustics of nasal consonants.<\/jats:p>","DOI":"10.1121\/10.0028124","type":"journal-article","created":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T13:42:44Z","timestamp":1724852564000},"page":"1380-1390","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":7,"title":["Speaker-independent speech inversion for recovery of velopharyngeal port constriction degree"],"prefix":"10.1121","volume":"156","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3914-0612","authenticated-orcid":false,"given":"Yashish M.","family":"Siriwardena","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Maryland College Park 1 , College Park, Maryland 20742, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2105-2486","authenticated-orcid":false,"given":"Suzanne E.","family":"Boyce","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders, University of Cincinnati 2 , Cincinnati, Ohio 45267-0379, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark K.","family":"Tiede","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Yale University 3 , New Haven, Connecticut 06511, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Liran","family":"Oren","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders, University of Cincinnati 2 , Cincinnati, Ohio 45267-0379, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brittany","family":"Fletcher","sequence":"additional","affiliation":[{"name":"Department of Communication Sciences and Disorders, University of Cincinnati 2 , Cincinnati, Ohio 45267-0379, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Michael","family":"Stern","sequence":"additional","affiliation":[{"name":"Department of Linguistics, Yale University 4 , New Haven, Connecticut 06510, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carol Y.","family":"Espy-Wilson","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Engineering, University of Maryland College Park 1 , College Park, Maryland 20742, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"231","published-online":{"date-parts":[[2024,8,28]]},"reference":[{"key":"2024082813423516600_c1","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1177\/10556656211025406","article-title":"Nasalance scores for normal speakers of American English obtained by the Nasometer II using the MacKay-Kummer SNAP-R test","volume":"59","year":"2022","journal-title":"Cleft Palate Craniofacial J."},{"key":"2024082813423516600_c2","first-page":"317","article-title":"Protocol for a model-based evaluation of a dynamic acoustic-to-articulatory inversion method using electromagnetic articulography","year":"2008"},{"key":"2024082813423516600_c3","doi-asserted-by":"publisher","first-page":"101137","DOI":"10.1016\/j.wocn.2022.101137","article-title":"Neural representations for modeling variation in speech","volume":"92","year":"2022","journal-title":"J. Phon."},{"key":"2024082813423516600_c4","first-page":"249","article-title":"Nasals and nasalization: The relation between segmental and coarticulatory timing","author":"Trouvain","year":"2007"},{"key":"2024082813423516600_c5","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.wocn.2008.10.002","article-title":"Timing effects of syllable structure and stress on nasals: A real-time MRI examination","volume":"37","year":"2009","journal-title":"J. Phon."},{"key":"2024082813423516600_c6","doi-asserted-by":"publisher","first-page":"911","DOI":"10.1121\/10.0002925","article-title":"A practical method of estimating the time-varying degree of vowel nasalization from acoustic features","volume":"149","year":"2021","journal-title":"J. Acoust. Soc. Am."},{"issue":"1","key":"2024082813423516600_c7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.16995\/labphon.9152","article-title":"An investigation of the dynamics of vowel nasalization in Arabana using machine learning of acoustic features","volume":"14","year":"2023","journal-title":"Lab. Phonol."},{"key":"2024082813423516600_c8","first-page":"1","article-title":"Evidence of vocal tract articulation in self-supervised learning of speech","year":"2023"},{"key":"2024082813423516600_c9","doi-asserted-by":"publisher","first-page":"466","DOI":"10.1016\/j.wocn.2009.08.001","article-title":"Effects of initial position versus prominence in English","volume":"37","year":"2009","journal-title":"J. Phon."},{"key":"2024082813423516600_c10","volume-title":"Elements of Information Theory","year":"2006"},{"key":"2024082813423516600_c11","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1597\/1545-1569_1991_028_0184_uonaad_2.3.co_2","article-title":"Use of nasometry as a diagnostic tool for identifying patients with velopharyngeal impairment","volume":"28","year":"1991","journal-title":"Cleft Palate Craniofac J."},{"key":"2024082813423516600_c48","volume-title":"Motor Speech Disorders","year":"1975"},{"key":"2024082813423516600_c12","first-page":"2117","article-title":"Speech enhancement using auditory phase opponency model","year":"2005"},{"key":"2024082813423516600_c13","first-page":"243","article-title":"Speech inversion using naturally spoken data","volume-title":"Rethinking Reduction","author":"Francesco","year":"2018"},{"key":"2024082813423516600_c14","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1207\/s15548430jlr3601_5","article-title":"Phonics: A large phoneme - Grapheme frequency count revised","volume":"36","year":"2004","journal-title":"J. Lit. Res."},{"key":"2024082813423516600_c15","first-page":"131","article-title":"Articulatory investigation of coronal consonants","volume-title":"The Articulatory Basis of Locality in Phonology","year":"1999"},{"key":"2024082813423516600_c16","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1109\/TSA.2003.822636","article-title":"Estimation of articulatory movements from speech acoustics using an HMM-based speech production model","volume":"12","year":"2004","journal-title":"IEEE Trans. Speech Audio Process."},{"key":"2024082813423516600_c17","doi-asserted-by":"publisher","first-page":"3451","DOI":"10.1109\/TASLP.2021.3122291","article-title":"HuBERT: Self-supervised speech representation learning by masked prediction of hidden units","volume":"29","year":"2021","journal-title":"IEEE\/ACM Trans. Audio. Speech. Lang. Process."},{"key":"2024082813423516600_c49","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1109\/IEEESTD.1969.7405210","article-title":"IEEE Recommended Practice for Speech Quality Measurements","volume":"17","author":"IEEE","year":"1969","journal-title":"IEEE Trans. Audio Electroacoust."},{"key":"2024082813423516600_c18","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1016\/j.wocn.2014.03.003","article-title":"The coordination of boundary tones and its interaction with prominence","volume":"44","year":"2014","journal-title":"J. Phon."},{"key":"2024082813423516600_c19","doi-asserted-by":"publisher","first-page":"e12371","DOI":"10.1111\/lnc3.12371","article-title":"Research methods in articulatory phonetics II: Studying other gestures and recent trends","volume":"14","year":"2020","journal-title":"Lang. Linguist. Compass"},{"key":"2024082813423516600_c50","article-title":"The articulatory organization of syllables: A kinematic analysis of labial and velar gestures","year":"1989"},{"key":"2024082813423516600_c20","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1006\/jpho.1999.0089","article-title":"Physiological organization of syllables: A review","volume":"27","year":"1999","journal-title":"J. Phon."},{"key":"2024082813423516600_c21","doi-asserted-by":"publisher","first-page":"20130397","DOI":"10.1098\/rstb.2013.0397","article-title":"Gestural coordination at prosodic boundaries and its role for prosodic structure and speech planning processes","volume":"369","year":"2014","journal-title":"Philos. Trans. R. Soc. B"},{"key":"2024082813423516600_c22","volume-title":"Speech Analysis with Production Constraints","year":"2001"},{"key":"2024082813423516600_c23","doi-asserted-by":"publisher","first-page":"3365","DOI":"10.1121\/1.412702","article-title":"Correlating movement and acoustic measures of nasalization","volume":"97","year":"1995","journal-title":"J. Acoust. Soc. Am."},{"key":"2024082813423516600_c24","doi-asserted-by":"publisher","first-page":"498","DOI":"10.21437\/Interspeech.2017-1386","article-title":"Montreal Forced Aligner: Trainable Text-Speech Alignment Using Kaldi","volume-title":"Proceedings of InterSpeech","year":"2017"},{"key":"2024082813423516600_c25","article-title":"librosa: Audio and Music Signal Analysis in Python","year":"2015"},{"key":"2024082813423516600_c26","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1016\/j.specom.2017.03.003","article-title":"Hybrid convolutional neural networks for articulatory and acoustic information based speech recognition","volume":"89","year":"2017","journal-title":"Speech Commun."},{"key":"2024082813423516600_c28","doi-asserted-by":"publisher","first-page":"A335","DOI":"10.1121\/10.0027721","article-title":"How nasal airflow can affect nasalance magnitude","volume":"155","year":"2024","journal-title":"J. Acoust. Soc. Am."},{"key":"2024082813423516600_c27","doi-asserted-by":"publisher","first-page":"637","DOI":"10.1177\/1055665619894183","article-title":"Using high-speed nasopharyngoscopy to quantify the bubbling above the velopharyngeal valve in cases of nasal rustle","volume":"57","year":"2020","journal-title":"Cleft Palate Craniofac J."},{"key":"2024082813423516600_c29","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1121\/1.1921448","article-title":"Modeling the articulatory space using a hypercube codebook for acoustic-to-articulatory inversion","volume":"118","year":"2005","journal-title":"J. Acoust. Soc. Am."},{"key":"2024082813423516600_c30","volume-title":"Physiology of Speech Production: Results and Implications of a Quantitative Cineradiographic Study","year":"1969"},{"key":"2024082813423516600_c31","first-page":"74","article-title":"An empirical investigation of the nonuniqueness in the acoustic-to-articulatory mapping","year":"2007"},{"key":"2024082813423516600_c32","article-title":"SpeechBrain: A general-purpose speech toolkit","year":"2021"},{"key":"2024082813423516600_c33","doi-asserted-by":"publisher","first-page":"965","DOI":"10.1177\/10556656221149516","article-title":"Models for predicting velopharyngeal competence based on speech and resonance errors and velopharyngeal area estimation","volume":"61","year":"2023","journal-title":"Cleft Palate Craniofacial J."},{"key":"2024082813423516600_c34","first-page":"301","article-title":"Audio data augmentation for acoustic-to-articulatory speech inversion","year":"2023"},{"key":"2024082813423516600_c36","first-page":"1","article-title":"The secret source: Incorporating source features to improve acoustic-to-articulatory speech inversion","volume-title":"ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing","year":"2023"},{"key":"2024082813423516600_c35","first-page":"4743","article-title":"Speaker-independent speech inversion for estimation of nasalance","year":"2023"},{"key":"2024082813423516600_c37","doi-asserted-by":"publisher","first-page":"316","DOI":"10.1121\/1.5116130","article-title":"Unsupervised speaker adaptation for speaker independent acoustic to articulatory speech inversion","volume":"146","year":"2019","journal-title":"J. Acoust. Soc. Am."},{"key":"2024082813423516600_c38","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/S0095-4470(19)31520-7","article-title":"On the quantal nature of speech","volume":"17","year":"1989","journal-title":"J. Phon."},{"key":"2024082813423516600_c39","volume-title":"Acoustic Phonetics","year":"2000"},{"key":"2024082813423516600_c40","doi-asserted-by":"publisher","first-page":"1872","DOI":"10.1121\/1.1458026","article-title":"Toward a model for lexical access based on acoustic landmarks and distinctive features","volume":"111","year":"2002","journal-title":"J. Acoust. Soc. Am."},{"key":"2024082813423516600_c41","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.wocn.2008.10.004","article-title":"Quantal theory, enhancement and overlap","volume":"38","year":"2010","journal-title":"J. Phon."},{"key":"2024082813423516600_c42","first-page":"9","article-title":"Cineradiographic studies of speech","volume-title":"Speech Transmission Laboratory Quarterly Progress and Status Report","year":"1963"},{"key":"2024082813423516600_c43","doi-asserted-by":"publisher","first-page":"3580","DOI":"10.1121\/1.4987629","article-title":"Quantifying kinematic aspects of reduction in a contrasting rate production task","volume":"141","year":"2017","journal-title":"J. Acoust. Soc. Am."},{"key":"2024082813423516600_c44","first-page":"1129","article-title":"Acoustic-to-articulatory inversion mapping with gaussian mixture model","year":"2004"},{"key":"2024082813423516600_c45","article-title":"X-ray microbeam speech production database user's handbook","volume-title":"IEEE Personal Communications","year":"1994"},{"key":"2024082813423516600_c46","first-page":"1","article-title":"Speaker-independent acoustic-to-articulatory speech inversion","year":"2023"},{"key":"2024082813423516600_c47","doi-asserted-by":"publisher","first-page":"9889","DOI":"10.1007\/s11042-014-2183-z","article-title":"Acoustic to articulatory mapping with deep neural network","volume":"74","year":"2014","journal-title":"Multimed. Tools Appl."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/156\/2\/1380\/20133775\/1380_1_10.0028124.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/156\/2\/1380\/20133775\/1380_1_10.0028124.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T13:42:55Z","timestamp":1724852575000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/156\/2\/1380\/3310152\/Speaker-independent-speech-inversion-for-recovery"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,8,1]]},"references-count":50,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,8,1]]}},"URL":"https:\/\/doi.org\/10.1121\/10.0028124","relation":{},"ISSN":["0001-4966"],"issn-type":[{"value":"0001-4966","type":"print"}],"subject":[],"published-other":{"date-parts":[[2024,8]]},"published":{"date-parts":[[2024,8,1]]}}}