{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T17:46:58Z","timestamp":1794332818302,"version":"4.9.0"},"reference-count":56,"publisher":"American Speech Language Hearing Association","issue":"8S","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J Speech Lang Hear Res"],"published-print":{"date-parts":[[2023,8,17]]},"abstract":"<jats:sec><jats:title>Purpose:<\/jats:title><jats:p>Current electromagnetic tongue tracking devices are not amenable for daily use and thus not suitable for silent speech interface and other applications. We have recently developed MagTrack, a novel wearable electromagnetic articulograph tongue tracking device. This study aimed to validate MagTrack for potential silent speech interface applications.<\/jats:p><\/jats:sec><jats:sec><jats:title>Method:<\/jats:title><jats:p>We conducted two experiments: (a) classification of eight isolated vowels in consonant\u2013vowel\u2013consonant form and (b) continuous silent speech recognition. In these experiments, we used data from healthy adult speakers collected with MagTrack. The performance of vowel classification was measured by accuracies. The continuous silent speech recognition was measured by phoneme error rates. The performance was then compared with results using data collected with commercial electromagnetic articulograph in a prior study.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results:<\/jats:title><jats:p>The isolated vowel classification using MagTrack achieved an average accuracy of 89.74% when leveraging all MagTrack signals (<jats:italic>x<\/jats:italic>,<jats:italic>y<\/jats:italic>,<jats:italic>z<\/jats:italic>coordinates; orientation; and magnetic signals), which outperformed the accuracy using commercial electromagnetic articulograph data (only<jats:italic>y<\/jats:italic>,<jats:italic>z<\/jats:italic>coordinates) in our previous study. The continuous speech recognition from two subjects using MagTrack achieved phoneme error rates of 73.92% and 66.73%, respectively. The commercial electromagnetic articulograph achieved 64.53% from the same subject (66.73% using MagTrack data).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions:<\/jats:title><jats:p>MagTrack showed comparable results with the commercial electromagnetic articulograph when using the same localized information. Adding raw magnetic signals would improve the performance of MagTrack. Our preliminary testing demonstrated the potential for silent speech interface as a lightweight wearable device. This work also lays the foundation to support MagTrack's potential for other applications including visual feedback\u2013based speech therapy and second language learning.<\/jats:p><\/jats:sec>","DOI":"10.1044\/2023_jslhr-22-00319","type":"journal-article","created":{"date-parts":[[2023,5,5]],"date-time":"2023-05-05T22:58:11Z","timestamp":1683327491000},"page":"3206-3221","source":"Crossref","is-referenced-by-count":12,"title":["MagTrack: A Wearable Tongue Motion Tracking System for Silent Speech Interfaces"],"prefix":"10.1044","volume":"66","author":[{"given":"Beiming","family":"Cao","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Engineering, The University of Texas at Austin"},{"name":"Department of Speech, Language, and Hearing Sciences, The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shravan","family":"Ravi","sequence":"additional","affiliation":[{"name":"Department of Computer Science, The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nordine","family":"Sebkhi","sequence":"additional","affiliation":[{"name":"School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Arpan","family":"Bhavsar","sequence":"additional","affiliation":[{"name":"School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omer T.","family":"Inan","sequence":"additional","affiliation":[{"name":"School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wen","family":"Xu","sequence":"additional","affiliation":[{"name":"Division of Computer Science, Texas Woman's University, Denton"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7265-217X","authenticated-orcid":false,"given":"Jun","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Speech, Language, and Hearing Sciences, The University of Texas at Austin"},{"name":"Department of Neurology, The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1310","reference":[{"key":"e_1_3_2_2_1","first-page":"12449","article-title":"wav2vec 2.0: A framework for self-supervised learning of speech representations","volume":"33","author":"Baevski A.","year":"2020","unstructured":"Baevski, A. , Zhou, Y. , Mohamed, A. , & Auli, M. (2020). wav2vec 2.0: A framework for self-supervised learning of speech representations. Advances in Neural Information Processing Systems, 33, 12449\u201312460.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_3_1","volume-title":"Head & neck surgery\u2014Otolaryngology","author":"Bailey B. J.","year":"2006","unstructured":"Bailey, B. J. , Johnson, J. T. , & Newlands, S. D. (2006). Head & neck surgery\u2014Otolaryngology (4th ed.). Lippincott Williams & Wilkins."},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1361090"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1044\/2021_AJSLP-20-00216"},{"key":"e_1_3_2_6_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2011\/10-0226)"},{"key":"e_1_3_2_7_1","volume-title":"Augmentative and alternative communication: Management of severe communication disorders in children and adults","author":"Beukelman D. R.","year":"1998","unstructured":"Beukelman, D. R. , & Mirenda, P. (1998). Augmentative and alternative communication: Management of severe communication disorders in children and adults (2nd ed.), Brooks.","edition":"2"},{"key":"e_1_3_2_8_1","first-page":"3152","article-title":"Articulation-to-speech synthesis using articulatory flesh point sensors' orientation information","volume":"2018","author":"Cao B.","year":"2018","unstructured":"Cao, B. , Kim, M. , Wang, J. R. , van Santen, J. , Mau, T. , & Wang, J. (2018). Articulation-to-speech synthesis using articulatory flesh point sensors' orientation information. Proceedings of Interspeech, 2018, 3152\u20133156. https:\/\/doi.org\/10.21437\/Interspeech.2018-2484","journal-title":"Proceedings of Interspeech"},{"key":"e_1_3_2_9_1","first-page":"651","article-title":"Investigating speech reconstruction for laryngectomees for silent speech interfaces","volume":"2021","author":"Cao B.","year":"2021","unstructured":"Cao, B. , Sebkhi, N. , Bhavsar, A. , Inan, O. T. , Samlan, R. , Mau, T. , & Wang, J. (2021). Investigating speech reconstruction for laryngectomees for silent speech interfaces. Proceedings of Interspeech, 2021, 651\u2013655. https:\/\/doi.org\/10.21437\/Interspeech.2021-1842","journal-title":"Proceedings of Interspeech"},{"key":"e_1_3_2_10_1","volume-title":"Comparing the performance of individual articulatory flesh points for articulation-to-speech synthesis [Paper presentation]","author":"Cao B.","year":"2019","unstructured":"Cao, B. , Tsang, B. Y. , & Wang, J. (2019). Comparing the performance of individual articulatory flesh points for articulation-to-speech synthesis [Paper presentation] . International Congress of Phonetic Sciences, Melbourne, Australia."},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.3390\/s22166056"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0094-1298(20)32374-9"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00994018"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2009.08.002"},{"key":"e_1_3_2_15_1","volume-title":"NDI company update\u2014June 2020","author":"Denny M.","year":"2020","unstructured":"Denny, M. (2020). NDI company update\u2014June 2020. NDI. Retrieved September 5, 2022, from https:\/\/www.ndigital.com\/ndi-company-update-june-2020\/"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ASRU46091.2019.9003804"},{"key":"e_1_3_2_17_1","doi-asserted-by":"publisher","DOI":"10.1002\/hed.24353"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.medengphy.2007.05.003"},{"key":"e_1_3_2_19_1","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyg.2020.01238"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2017.2757263"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rlfa.2018.07.004"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2020.3026579"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.3390\/app12031167"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.3109\/21678421.2013.817585"},{"key":"e_1_3_2_25_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-5109"},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1214\/009053607000000677"},{"key":"e_1_3_2_27_1","doi-asserted-by":"publisher","DOI":"10.1080\/00401706.1991.10484833"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.381436"},{"key":"e_1_3_2_29_1","first-page":"1174","article-title":"Opti-speech: A real-time, 3d visual feedback system for speech training","volume":"2014","author":"Katz W. F.","year":"2014","unstructured":"Katz, W. F. , Campbell, T. F. , Wang, J. , Farrar, E. , Eubanks, J. C. , Balasubramanian, A. , Prabhakaran, B. , & Rennaker, R. (2014). Opti-speech: A real-time, 3d visual feedback system for speech training. Proceedings of Interspeech, 2014, 1174\u20131178. https:\/\/doi.org\/10.21437\/Interspeech.2014-298","journal-title":"Proceedings of Interspeech"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2015.00612"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.2147\/MDER.S133225"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2017.2758999"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-00214-5_133"},{"key":"e_1_3_2_34_1","first-page":"1025","article-title":"End-to-end deep learning speech recognition model for silent speech challenge","volume":"2020","author":"Kimura N.","year":"2020","unstructured":"Kimura, N. , Su, Z. , & Saeki, T. (2020). End-to-end deep learning speech recognition model for silent speech challenge. Proceedings of Interspeech, 2020, 1025\u20131026.","journal-title":"Proceedings of Interspeech"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.5139423"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aac965"},{"key":"e_1_3_2_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00453713"},{"key":"e_1_3_2_38_1","unstructured":"Povey D. Ghoshal A. Boulianne G. Burget L. Glembek O. Goel N. Hannemann M. Motlicek P. Qian Y. Schwarz P. Silovsky J. Stemmer G. & Vesely K. (2011). The Kaldi speech recognition toolkit [Paper presentation]. IEEE 2011 Workshop on Automatic Speech Recognition and Understanding. Waikoloa Village Hawai'i. http:\/\/infoscience.epfl.ch\/record\/192584"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.5334\/labphon.237"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1044\/2021_JSLHR-20-00394"},{"key":"e_1_3_2_41_1","doi-asserted-by":"publisher","DOI":"10.1121\/1.1479146"},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1044\/2016_JSLHR-S-15-0223"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/TASLP.2017.2752365"},{"key":"e_1_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/JSEN.2020.3046469"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1109\/TBME.2021.3113291"},{"key":"e_1_3_2_46_1","first-page":"1932","article-title":"Neural speaker embeddings for ultrasound-based silent speech interfaces","volume":"2021","author":"Shandiz A. H.","year":"2021","unstructured":"Shandiz, A. H. , T\u00f3th, L. , Gosztolya, G. , Mark\u00f3, A. , Csap\u00f3, T. G. (2021). Neural speaker embeddings for ultrasound-based silent speech interfaces. Proceedings of Interspeech, 2021, 1932\u20131936. https:\/\/doi.org\/10.21437\/Interspeech.2021-1466","journal-title":"Proceedings of Interspeech"},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511816338"},{"key":"e_1_3_2_48_1","first-page":"4576","article-title":"Tongue and lip motion patterns in alaryngeal speech","volume":"2020","author":"Teplansky K. J.","year":"2020","unstructured":"Teplansky, K. J. , Wisler, A. , Cao, B. , Liang, W. , Whited, C. W. , Mau, T. , & Wang, J. (2020). Tongue and lip motion patterns in alaryngeal speech. Proceedings of Interspeech, 2020, 4576\u20134580.","journal-title":"Proceedings of Interspeech"},{"key":"e_1_3_2_49_1","doi-asserted-by":"publisher","DOI":"10.1121\/10.0003062"},{"key":"e_1_3_2_50_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2013\/12-0030)"},{"key":"e_1_3_2_51_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/W15-5114"},{"key":"e_1_3_2_52_1","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.21437\/Interspeech.2016-1542","article-title":"Towards automatic detection of amyotrophic lateral sclerosis from speech acoustic and articulatory samples","volume":"2016","author":"Wang J.","year":"2016","unstructured":"Wang, J. , Kothalkar, P. V. , Cao, B. , & Heitzman, D. (2016). Towards automatic detection of amyotrophic lateral sclerosis from speech acoustic and articulatory samples. Proceedings of Interspeech, 2016, 1195\u20131199. https:\/\/doi.org\/10.21437\/Interspeech.2016-1542","journal-title":"Proceedings of Interspeech"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-1906"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1044\/2015_JSLHR-S-14-0112"},{"key":"e_1_3_2_55_1","volume-title":"X-ray microbeam speech production database user's handbook","author":"Westbury J. R.","year":"1994","unstructured":"Westbury, J. R. (1994). X-ray microbeam speech production database user's handbook. University of Wisconsin."},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.1044\/2021_JSLHR-21-00298"},{"key":"e_1_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.1044\/1092-4388(2008\/07-0218)"}],"container-title":["Journal of Speech, Language, and Hearing Research"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/pubs.asha.org\/doi\/pdf\/10.1044\/2023_JSLHR-22-00319","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,19]],"date-time":"2024-10-19T22:26:55Z","timestamp":1729376815000},"score":1,"resource":{"primary":{"URL":"http:\/\/pubs.asha.org\/doi\/10.1044\/2023_JSLHR-22-00319"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,17]]},"references-count":56,"journal-issue":{"issue":"8S","published-print":{"date-parts":[[2023,8,17]]}},"alternative-id":["10.1044\/2023_JSLHR-22-00319"],"URL":"https:\/\/doi.org\/10.1044\/2023_jslhr-22-00319","relation":{},"ISSN":["1092-4388","1558-9102"],"issn-type":[{"value":"1092-4388","type":"print"},{"value":"1558-9102","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,17]]}}}