{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,28]],"date-time":"2026-09-28T18:34:53Z","timestamp":1790620493031,"version":"4.1.0"},"reference-count":47,"publisher":"Acoustical Society of America (ASA)","issue":"6","funder":[{"name":"NIH","award":["R01DC007124"],"award-info":[{"award-number":["R01DC007124"]}]},{"name":"NSF","award":["1514544"],"award-info":[{"award-number":["1514544"]}]}],"content-domain":{"domain":["pubs.aip.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,12,1]]},"abstract":"<jats:p>This paper proposes a modular architecture for articulatory synthesis from a gestural specification comprising relatively simple models for the vocal tract, the glottis, aero-acoustics, and articulatory control. The vocal tract module combines a midsagittal statistical analysis articulatory model, derived by factor analysis of air-tissue boundaries in real-time magnetic resonance imaging data, with an \u03b1\u03b2 model for converting midsagittal section to area function specifications. The aero-acoustics and glottis models were based on a software implementation of classic work by Maeda. The articulatory control module uses dynamical systems, which implement articulatory gestures, to animate the statistical articulatory model, inspired by the task dynamics model. Results on synthesizing vowel-consonant-vowel sequences with plosive consonants, using models that were built on data from, and simulate the behavior of, two different speakers are presented.<\/jats:p>","DOI":"10.1121\/1.5139413","type":"journal-article","created":{"date-parts":[[2019,12,20]],"date-time":"2019-12-20T19:12:13Z","timestamp":1576869133000},"page":"4458-4471","update-policy":"https:\/\/doi.org\/10.1063\/aip-crossmark-policy-page","source":"Crossref","is-referenced-by-count":14,"title":["A modular architecture for articulatory synthesis from gestural specification"],"prefix":"10.1121","volume":"146","author":[{"given":"Rachel","family":"Alexander","sequence":"first","affiliation":[{"name":"Signal Analysis & Interpretation Laboratory (SAIL), University of Southern California , Los Angeles, California 90007, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tanner","family":"Sorensen","sequence":"additional","affiliation":[{"name":"Signal Analysis & Interpretation Laboratory (SAIL), University of Southern California , Los Angeles, California 90007, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asterios","family":"Toutios","sequence":"additional","affiliation":[{"name":"Signal Analysis & Interpretation Laboratory (SAIL), University of Southern California , Los Angeles, California 90007, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shrikanth","family":"Narayanan","sequence":"additional","affiliation":[{"name":"Signal Analysis & Interpretation Laboratory (SAIL), University of Southern California , Los Angeles, California 90007, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"231","published-online":{"date-parts":[[2019,12,20]]},"reference":[{"issue":"3","key":"2023080309154602500_c1","doi-asserted-by":"publisher","first-page":"533","DOI":"10.1006\/jpho.2002.0166","article-title":"Three-dimensional linear articulatory modeling of tongue, lips and face, based on MRI and video images","volume":"30","year":"2002","journal-title":"J. Phon."},{"issue":"4","key":"2023080309154602500_c2","doi-asserted-by":"publisher","first-page":"e60603","DOI":"10.1371\/journal.pone.0060603","article-title":"Modeling consonant-vowel coarticulation for articulatory speech synthesis","volume":"8","year":"2013","journal-title":"PloS One"},{"issue":"4","key":"2023080309154602500_c3","doi-asserted-by":"publisher","first-page":"1218","DOI":"10.1109\/TASL.2006.889731","article-title":"Simulation of losses due to turbulence in the time-varying vocal system","volume":"15","year":"2007","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"issue":"9\/10","key":"2023080309154602500_c4","first-page":"341","article-title":"Praat, a system for doing phonetics by computer","volume":"5","year":"2001","journal-title":"Glot Int."},{"issue":"3","key":"2023080309154602500_c5","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1109\/TMI.2008.928920","article-title":"Region segmentation in the frequency domain applied to upper airway real-time magnetic resonance images","volume":"28","year":"2009","journal-title":"IEEE Trans. Med. Imag."},{"issue":"4","key":"2023080309154602500_c6","doi-asserted-by":"publisher","first-page":"1791","DOI":"10.1121\/1.2335423","article-title":"Synchronized and noise-robust audio recordings during realtime magnetic resonance imaging scans","volume":"120","year":"2006","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080309154602500_c7","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1159\/000261913","article-title":"Articulatory phonology: An overview","volume":"49","year":"1992","journal-title":"Phonetica"},{"issue":"2","key":"2023080309154602500_c8","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/S0095-4470(02)00085-2","article-title":"The elastic phrase: Modeling the dynamics of boundary-adjacent lengthening","volume":"31","year":"2003","journal-title":"J. Phon."},{"issue":"6","key":"2023080309154602500_c9","doi-asserted-by":"publisher","first-page":"597","DOI":"10.1121\/1.1906940","article-title":"Some experiments on the perception of synthetic speech sounds","volume":"24","year":"1952","journal-title":"J. Acoust. Soc. Am."},{"issue":"2","key":"2023080309154602500_c10","doi-asserted-by":"publisher","first-page":"853","DOI":"10.1121\/1.1639325","article-title":"Construction and control of a physiological articulatory model","volume":"115","year":"2004","journal-title":"J. Acoust. Soc. Am."},{"issue":"4","key":"2023080309154602500_c11","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1121\/1.1908024","article-title":"Acoustic loci and transitional cues for consonants","volume":"27","year":"1955","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080309154602500_c12","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1016\/j.specom.2016.06.002","article-title":"Extension of the single-matrix formulation of the vocal tract: Consideration of bilateral channels and connection of self-oscillating models of the vocal folds with a glottal chink","volume":"82","year":"2016","journal-title":"Speech Commun."},{"issue":"2","key":"2023080309154602500_c13","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1016\/S0167-6393(02)00132-2","article-title":"Combining MRI, EMA and EPG measurements in a three-dimensional tongue model","volume":"41","year":"2003","journal-title":"Speech Commun."},{"issue":"1","key":"2023080309154602500_c14","doi-asserted-by":"publisher","first-page":"389","DOI":"10.1121\/1.3586785","article-title":"A theoretical model of the pressure field arising from asymmetric intraglottal flows applied to a two-mass model of the vocal folds","volume":"130","year":"2011","journal-title":"J. Acoust. Soc. Am."},{"issue":"3\u20134","key":"2023080309154602500_c15","first-page":"31","article-title":"Vocal source analysis\u2014A progress report","volume":"20","year":"1979","journal-title":"STL-QPSR (Speech Transmission Laboratory, KTH, Stockholm, Sweden)"},{"issue":"6","key":"2023080309154602500_c16","doi-asserted-by":"publisher","first-page":"1233","DOI":"10.1002\/j.1538-7305.1972.tb02651.x","article-title":"Synthesis of voiced sounds from a two-mass model of the vocal cords","volume":"51","year":"1972","journal-title":"Bell Syst. Tech. J."},{"issue":"4","key":"2023080309154602500_c17","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1159\/000261943","article-title":"A gestural production model and its application to reduction in German","volume":"50","year":"1993","journal-title":"Phonetica"},{"key":"2023080309154602500_c18","doi-asserted-by":"crossref","first-page":"306","DOI":"10.1007\/978-3-642-00525-1","article-title":"Articulatory synthesis of speech and singing: State of the art and suggestions for future research","volume-title":"Multimodal Signals: Cognitive and Algorithmic Issues","author":"Esposito","year":"2009"},{"issue":"1","key":"2023080309154602500_c19","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1016\/j.specom.2012.08.001","article-title":"Statistical methods for estimation of direct and differential kinematics of the vocal tract","volume":"55","year":"2013","journal-title":"Speech Commun."},{"key":"2023080309154602500_c20","first-page":"2024","article-title":"Articulatory copy synthesis from cine X-ray films","year":"2013"},{"key":"2023080309154602500_c21","first-page":"475","article-title":"State-of-the-art MRI protocol for comprehensive assessment of vocal tract structure and function","year":"2016"},{"issue":"1","key":"2023080309154602500_c22","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1002\/mrm.26090","article-title":"A fast and flexible MRI system for the study of dynamic vocal tract shaping","volume":"77","year":"2017","journal-title":"Magn. Reson. Med."},{"key":"2023080309154602500_c23","first-page":"152","article-title":"Un mod\u00e8le articulatoire de la langue avec des composantes lin\u00e9aires","year":"1979"},{"issue":"3-4","key":"2023080309154602500_c24","doi-asserted-by":"publisher","first-page":"199","DOI":"10.1016\/0167-6393(82)90017-6","article-title":"A digital simulation method of the vocal-tract system","volume":"1","year":"1982","journal-title":"Speech Commun."},{"key":"2023080309154602500_c25","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1007\/978-94-009-2037-8","article-title":"Compensatory articulation during speech: Evidence from the analysis and synthesis of vocal tract shapes using an articulatory model","volume-title":"Speech Production and Speech Modelling","author":"Hardcastle","year":"1990"},{"key":"2023080309154602500_c26","first-page":"145","article-title":"Phonemes as concatenable units: VCV synthesis using a vocal-tract synthesizer","author":"Simpson","year":"1996"},{"issue":"4","key":"2023080309154602500_c27","doi-asserted-by":"publisher","first-page":"1070","DOI":"10.1121\/1.1913427","article-title":"Articulatory model for the study of speech production","volume":"53","year":"1973","journal-title":"J. Acoust. Soc. Am."},{"issue":"2","key":"2023080309154602500_c28","doi-asserted-by":"publisher","first-page":"S687","DOI":"10.1044\/2014_JSLHR-S-12-0279","article-title":"Modeling the biomechanical influence of epilaryngeal stricture on the vocal folds: A low-dimensional model of vocal\u2013ventricular fold coupling","volume":"57","year":"2014","journal-title":"J. Speech Lang. Hear. Res."},{"issue":"3","key":"2023080309154602500_c29","doi-asserted-by":"publisher","first-page":"179","DOI":"10.1016\/j.specom.2007.08.001","article-title":"Single-matrix formulation of a time domain acoustic model of the vocal tract with side branches","volume":"50","year":"2008","journal-title":"Speech Commun."},{"key":"2023080309154602500_c30","doi-asserted-by":"publisher","first-page":"1771","DOI":"10.1121\/1.1652588","article-title":"An approach to real-time magnetic resonance imaging for speech production","volume":"115","year":"2004","journal-title":"J. Acoust. Soc. Am."},{"issue":"1","key":"2023080309154602500_c31","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1121\/1.1909864","article-title":"Coarticulation in VCV utterances: Spectrographic measurements","volume":"39","year":"1966","journal-title":"J. Acoust. Soc. Am."},{"issue":"1","key":"2023080309154602500_c32","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1121\/1.1921448","article-title":"Modeling the articulatory space using a hypercube codebook for acoustic-to-articulatory inversion","volume":"118","year":"2005","journal-title":"J. Acoust. Soc. Am."},{"key":"2023080309154602500_c33","unstructured":"ownCloud (2019). http:\/\/sail.usc.edu\/span\/artsyn2019 (Last viewed 12\/10\/2019)."},{"issue":"1","key":"2023080309154602500_c34","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1044\/jshr.3501.53","article-title":"Vocal tract area function estimation from midsagittal dimensions with CT scans and a vocal tract cast: Modeling the transition with two sets of coefficients","volume":"35","year":"1992","journal-title":"J. Speech Lang. Hear. Res."},{"issue":"4","key":"2023080309154602500_c35","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1207\/s15326969eco0104_2","article-title":"A dynamical approach to gestural patterning in speech production","volume":"1","year":"1989","journal-title":"Ecol. Psychol."},{"key":"2023080309154602500_c36","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/978-94-009-2037-8","article-title":"Articulatory Synthesis","volume-title":"Speech Production and Speech Modelling","author":"Hardcastle","year":"1990"},{"key":"2023080309154602500_c37","unstructured":"Shadle, C. (1985). \u201cThe Acoustics of Fricative Consonants,\u201d Ph.D. thesis, Massachusetts Institute of Technology, Cambridge, MA."},{"key":"2023080309154602500_c38","article-title":"Prospects for articulatory synthesis: A position paper","year":"2001"},{"issue":"3","key":"2023080309154602500_c39","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1016\/S0167-6393(00)00084-4","article-title":"Mid-sagittal cut to area function transformations: Direct measurements of mid-sagittal distance and area with MRI","volume":"36","year":"2002","journal-title":"Speech Commun."},{"key":"2023080309154602500_c40","article-title":"Characterizing vocal tract dynamics across speakers using real-time MRI","year":"2016"},{"issue":"3","key":"2023080309154602500_c41","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1121\/1.5093538","article-title":"Task-dependence of articulator synergies","volume":"145","year":"2019","journal-title":"J. Acoust. Soc. Am."},{"issue":"4","key":"2023080309154602500_c42","doi-asserted-by":"publisher","first-page":"989","DOI":"10.1016\/j.csl.2012.10.005","article-title":"Phrase-level speech simulation with an airway modulation model of speech production","volume":"27","year":"2013","journal-title":"Comput. Speech Lang."},{"key":"2023080309154602500_c43","doi-asserted-by":"publisher","first-page":"e6","DOI":"10.1017\/ATSIP.2016.5","article-title":"Advances in real-time magnetic resonance imaging of the vocal tract for speech science and technology research","volume":"5","year":"2016","journal-title":"APSIPA Trans. Sign. Inf. Process."},{"key":"2023080309154602500_c44","first-page":"2738","article-title":"Articulatory synthesis of French connected speech from EMA data","year":"2013"},{"key":"2023080309154602500_c45","article-title":"Factor analysis of vocal-tract outlines derived from real-time magnetic resonance imaging data","year":"2015"},{"key":"2023080309154602500_c46","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1093\/oso\/9780199296675.001.0001","article-title":"Area functions and articulatory modeling as a tool for investigating the articulatory, acoustic and perceptual properties of sounds across languages","volume-title":"Experimental Approaches to Phonology","author":"Sol\u00e9","year":"2007"},{"issue":"5","key":"2023080309154602500_c47","doi-asserted-by":"publisher","first-page":"967","DOI":"10.1109\/TASLP.2018.2800280","article-title":"Acoustic denoising using dictionary learning with spectral and temporal regularization","volume":"26","year":"2018","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."}],"container-title":["The Journal of the Acoustical Society of America"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/146\/6\/4458\/13665031\/4458_1_online.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/pubs.aip.org\/asa\/jasa\/article-pdf\/146\/6\/4458\/13665031\/4458_1_online.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,29]],"date-time":"2024-07-29T00:34:13Z","timestamp":1722213253000},"score":1,"resource":{"primary":{"URL":"https:\/\/pubs.aip.org\/jasa\/article\/146\/6\/4458\/952442\/A-modular-architecture-for-articulatory-synthesis"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,1]]},"references-count":47,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2019,12,1]]}},"URL":"https:\/\/doi.org\/10.1121\/1.5139413","relation":{},"ISSN":["0001-4966","1520-8524"],"issn-type":[{"value":"0001-4966","type":"print"},{"value":"1520-8524","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2019,12]]},"published":{"date-parts":[[2019,12,1]]}}}