{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T12:53:46Z","timestamp":1776084826310,"version":"3.50.1"},"reference-count":41,"publisher":"Wiley","issue":"2","license":[{"start":{"date-parts":[[2021,1,7]],"date-time":"2021-01-07T00:00:00Z","timestamp":1609977600000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,1,7]],"date-time":"2021-01-07T00:00:00Z","timestamp":1609977600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100009023","name":"Precursory Research for Embryonic Science and Technology","doi-asserted-by":"publisher","award":["JPMJPR17JA"],"award-info":[{"award-number":["JPMJPR17JA"]}],"id":[{"id":"10.13039\/501100009023","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["KAKENHI 15K01849"],"award-info":[{"award-number":["KAKENHI 15K01849"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["advanced.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Advanced Intelligent Systems"],"published-print":{"date-parts":[[2021,2]]},"abstract":"<jats:sec><jats:label\/><jats:p>Recent advances in brain imaging technology have furthered our knowledge of the neural basis of auditory and speech processing, often via contributions from invasive brain signal recording and stimulation studies conducted intraoperatively. Herein, an approach for synthesizing vowel sounds straightforwardly from scalp\u2010recorded electroencephalography (EEG), a noninvasive neurophysiological recording method is demonstrated. Given cortical current signals derived from the EEG acquired while human participants listen to and recall (i.e., imagined) two vowels, \/a\/ and \/i\/, sound parameters are estimated by a convolutional neural network (CNN). The speech synthesized from the estimated parameters is sufficiently natural to achieve recognition rates &gt;85% during a subsequent sound discrimination task. Notably, the CNN identifies the involvement of the brain areas mediating the \u201cwhat\u201d auditory stream, namely the superior, middle temporal, and Heschl's gyri, demonstrating the efficacy of the computational method in extracting auditory\u2010related information from neuroelectrical activity. Differences in cortical sound representation between listening versus recalling are further revealed, such that the fusiform, calcarine, and anterior cingulate gyri contributes during listening, whereas the inferior occipital gyrus is engaged during recollection. The proposed approach can expand the scope of EEG in decoding auditory perception that requires high spatial and temporal resolution.<\/jats:p><\/jats:sec>","DOI":"10.1002\/aisy.202000164","type":"journal-article","created":{"date-parts":[[2021,1,10]],"date-time":"2021-01-10T08:13:05Z","timestamp":1610266385000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Vowel Sound Synthesis from Electroencephalography during Listening and Recalling"],"prefix":"10.1002","volume":"3","author":[{"given":"Wataru","family":"Akashi","sequence":"first","affiliation":[{"name":"Institute of Innovative Research Tokyo Institute of Technology  4259 Nagatsuta-cho Midori-ku Yokohama 226-8503 Japan"}]},{"given":"Hiroyuki","family":"Kambara","sequence":"additional","affiliation":[{"name":"Institute of Innovative Research Tokyo Institute of Technology  4259 Nagatsuta-cho Midori-ku Yokohama 226-8503 Japan"}]},{"given":"Yousuke","family":"Ogata","sequence":"additional","affiliation":[{"name":"Institute of Innovative Research Tokyo Institute of Technology  4259 Nagatsuta-cho Midori-ku Yokohama 226-8503 Japan"}]},{"given":"Yasuharu","family":"Koike","sequence":"additional","affiliation":[{"name":"Institute of Innovative Research Tokyo Institute of Technology  4259 Nagatsuta-cho Midori-ku Yokohama 226-8503 Japan"}]},{"given":"Ludovico","family":"Minati","sequence":"additional","affiliation":[{"name":"Institute of Innovative Research Tokyo Institute of Technology  4259 Nagatsuta-cho Midori-ku Yokohama 226-8503 Japan"},{"name":"Center for Mind\/Brain Science (CIMeC) University of Trento  Via delle Regole 101 TN 38123 Mattarello Italy"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7495-9113","authenticated-orcid":false,"given":"Natsue","family":"Yoshimura","sequence":"additional","affiliation":[{"name":"Institute of Innovative Research Tokyo Institute of Technology  4259 Nagatsuta-cho Midori-ku Yokohama 226-8503 Japan"},{"name":"PRESTO Japan Science and Technology Agency  4-1-8 Honcho Kawaguchi-shi Saitama 332-0012 Japan"},{"name":"Department of Computational Brain Imaging ATR Brain Information Communication Research Laboratory Group  2-2-2 Hikaridai, Seika-cho Soraku-gun Kyoto 619-0288 Japan"},{"name":"Integrative Brain Imaging Center National Center of Neurology and Psychiatry  4-1-1 Ogawa-Higashi Kodaira Tokyo 187-8551 Japan"}]}],"member":"311","published-online":{"date-parts":[[2021,1,7]]},"reference":[{"key":"e_1_2_8_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2008.11.004"},{"key":"e_1_2_8_3_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1234330"},{"key":"e_1_2_8_4_1","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/ab0c59"},{"key":"e_1_2_8_5_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41586-019-1119-1"},{"key":"e_1_2_8_6_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-020-0608-8"},{"key":"e_1_2_8_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2004.06.037"},{"key":"e_1_2_8_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2011.08.029"},{"key":"e_1_2_8_9_1","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2016.00175"},{"key":"e_1_2_8_10_1","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-016-0028-x"},{"key":"e_1_2_8_11_1","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/123.12.2400"},{"key":"e_1_2_8_12_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2017.10.020"},{"key":"e_1_2_8_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-9452(08)70124-2"},{"key":"e_1_2_8_14_1","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/10.5.512"},{"key":"e_1_2_8_15_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1164318"},{"key":"e_1_2_8_16_1","doi-asserted-by":"publisher","DOI":"10.3758\/s13414-019-01666-y"},{"key":"e_1_2_8_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2004.01.014"},{"key":"e_1_2_8_18_1","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.2001.0888"},{"key":"e_1_2_8_19_1","doi-asserted-by":"crossref","unstructured":"S.Imai inIEEE Int. Conf. on Acoustics Speech and Signal Processing \u2013 Proc. Vol.8 IEEE Boston MA1983 p.93.","DOI":"10.1109\/ICASSP.1983.1172250"},{"key":"e_1_2_8_20_1","unstructured":"T.Fukada K.Tokuda T.Kobayashi S.Imai inIEEE Int. Conf. on Acoustics Speech and Signal Processing \u2013 Proc. Vol.1 IEEE San Francisco CL1992 p.138."},{"key":"e_1_2_8_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2008.06.013"},{"key":"e_1_2_8_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/jmri.21445"},{"key":"e_1_2_8_23_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.20201"},{"key":"e_1_2_8_24_1","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhh061"},{"key":"e_1_2_8_25_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.20122"},{"key":"e_1_2_8_26_1","first-page":"5197","volume":"27","author":"Zhao L.","year":"2017","journal-title":"Cereb. Cortex"},{"key":"e_1_2_8_27_1","doi-asserted-by":"publisher","DOI":"10.1080\/13554790802709054"},{"key":"e_1_2_8_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-011-2715-y"},{"key":"e_1_2_8_29_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.20560"},{"key":"e_1_2_8_30_1","doi-asserted-by":"publisher","DOI":"10.1162\/jocn.2006.18.5.766"},{"key":"e_1_2_8_31_1","doi-asserted-by":"publisher","DOI":"10.1186\/1744-8069-1-6"},{"key":"e_1_2_8_32_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2132313100"},{"key":"e_1_2_8_33_1","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.10112"},{"key":"e_1_2_8_34_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0506268103"},{"key":"e_1_2_8_35_1","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/116.1.1"},{"key":"e_1_2_8_36_1","doi-asserted-by":"publisher","DOI":"10.5334\/joc.72"},{"key":"e_1_2_8_37_1","doi-asserted-by":"publisher","DOI":"10.1097\/AUD.0b013e3182280353"},{"key":"e_1_2_8_38_1","unstructured":"M.Abadi P.Barham J.Chen Z.Chen A.Davis J.Dean M.Devin S.Ghemawat G.Irving M.Isard M.Kudlur J.Levenberg R.Monga S.Moore D. G.Murray B.Steiner P.Tucker V.Vasudevan P.Warden M.Wicke Y.Yu X.Zheng inProc. 12th USENIX Symp. Oper. Syst. Des. Implementation OSDI 2016 Vol.1 USENIX Georgia GA2016 p.265."},{"key":"e_1_2_8_39_1","unstructured":"D. P.Kingma J. L.Ba in3rd Int. Conf. Learn. Represent. ICLR 2015 \u2013 Conf. Track Proc. Vol.1 International Speech Communication Association San Diego CA2015 p.1."},{"key":"e_1_2_8_40_1","doi-asserted-by":"crossref","unstructured":"H.Hu in11th Int. Conf. Knowled. Sci. Eng. Management. KSEM 2018 Vol.2 Springer Cham2018 291.","DOI":"10.1007\/978-3-319-99247-1_26"},{"key":"e_1_2_8_41_1","doi-asserted-by":"crossref","unstructured":"H.Hu inICNC-FSKD 2018 \u2013 14th Int. Conf. Nat. Comput. Fuzzy Syst. Knowl. Discov. Vol.1 IEEE Huangshan2018 856.","DOI":"10.1109\/FSKD.2018.8687140"},{"key":"e_1_2_8_42_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2019.116189"}],"container-title":["Advanced Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202000164","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/aisy.202000164","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202000164","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aisy.202000164","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,7]],"date-time":"2025-10-07T23:25:11Z","timestamp":1759879511000},"score":1,"resource":{"primary":{"URL":"https:\/\/advanced.onlinelibrary.wiley.com\/doi\/10.1002\/aisy.202000164"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1,7]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,2]]}},"alternative-id":["10.1002\/aisy.202000164"],"URL":"https:\/\/doi.org\/10.1002\/aisy.202000164","archive":["Portico"],"relation":{},"ISSN":["2640-4567","2640-4567"],"issn-type":[{"value":"2640-4567","type":"print"},{"value":"2640-4567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,7]]},"assertion":[{"value":"2020-07-16","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-07","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"2000164"}}