{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T12:25:16Z","timestamp":1773836716642,"version":"3.50.1"},"reference-count":77,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T00:00:00Z","timestamp":1681948800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T00:00:00Z","timestamp":1681948800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100006978","name":"University of California Berkeley","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100006978","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Comparing artificial neural networks with outputs of neuroimaging techniques has recently seen substantial advances in (computer) vision and text-based language models. Here, we propose a framework to compare biological and artificial neural computations of spoken language representations and propose several new challenges to this paradigm. The proposed technique is based on a similar principle that underlies electroencephalography (EEG): averaging of neural (artificial or biological) activity across neurons in the time domain, and allows to compare encoding of any acoustic property in the brain and in intermediate convolutional layers of an artificial neural network. Our approach allows a direct comparison of responses to a phonetic property in the brain and in deep neural networks that requires no linear transformations between the signals. We argue that the brain stem response (cABR) and the response in intermediate convolutional layers to the exact same stimulus are highly similar without applying any transformations, and we\u00a0quantify this observation. The proposed technique not only reveals similarities, but also allows for analysis of the encoding of actual acoustic properties in the two signals: we compare peak latency (i) in cABR relative to the stimulus in the brain stem and in (ii) intermediate convolutional layers relative to the input\/output in deep convolutional networks. We also examine and compare the effect of prior language exposure on the peak latency in cABR and in intermediate convolutional layers. Substantial similarities in peak latency encoding between the human brain and intermediate convolutional networks emerge based on results from eight trained networks (including a replication experiment). The proposed technique can be used to compare encoding between the human brain and intermediate convolutional layers for any acoustic property and for other neuroimaging techniques.<\/jats:p>","DOI":"10.1038\/s41598-023-33384-9","type":"journal-article","created":{"date-parts":[[2023,4,20]],"date-time":"2023-04-20T13:01:26Z","timestamp":1681995686000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Encoding of speech in convolutional layers and the brain stem based on language experience"],"prefix":"10.1038","volume":"13","author":[{"given":"Ga\u0161per","family":"Begu\u0161","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alan","family":"Zhou","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"T. Christina","family":"Zhao","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2023,4,20]]},"reference":[{"key":"33384_CR1","doi-asserted-by":"publisher","first-page":"488","DOI":"10.1038\/s41583-021-00473-5","volume":"22","author":"F Pulverm\u00fcller","year":"2021","unstructured":"Pulverm\u00fcller, F., Tomasello, R., Henningsen-Schomers, M. R. & Wennekers, T. Biological constraints on neural network models of cognitive function. Nat. Rev. Neurosci. 22, 488\u2013502. https:\/\/doi.org\/10.1038\/s41583-021-00473-5 (2021).","journal-title":"Nat. Rev. Neurosci."},{"key":"33384_CR2","unstructured":"Bengio, Y., Lee, D., Bornschein, J. & Lin, Z. Towards biologically plausible deep learning. CoRR arXiv:1502.04156 (2015)."},{"key":"33384_CR3","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1016\/j.tics.2018.12.005","volume":"23","author":"JC Whittington","year":"2019","unstructured":"Whittington, J. C. & Bogacz, R. Theories of error back-propagation in the brain. Trends Cogn. Sci. 23, 235\u2013250. https:\/\/doi.org\/10.1016\/j.tics.2018.12.005 (2019).","journal-title":"Trends Cogn. Sci."},{"key":"33384_CR4","doi-asserted-by":"publisher","first-page":"94","DOI":"10.3389\/fncom.2016.00094","volume":"10","author":"AH Marblestone","year":"2016","unstructured":"Marblestone, A. H., Wayne, G. & Kording, K. P. Toward an integration of deep learning and neuroscience. Front. Comput. Neurosci. 10, 94. https:\/\/doi.org\/10.3389\/fncom.2016.00094 (2016).","journal-title":"Front. Comput. Neurosci."},{"key":"33384_CR5","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/BF00344251","volume":"36","author":"K Fukushima","year":"1980","unstructured":"Fukushima, K. Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position. Biol. Cybern. 36, 193\u2013202. https:\/\/doi.org\/10.1007\/BF00344251 (1980).","journal-title":"Biol. Cybern."},{"key":"33384_CR6","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1162\/neco.1989.1.4.541","volume":"1","author":"Y LeCun","year":"1989","unstructured":"LeCun, Y. et al. Backpropagation applied to handwritten zip code recognition. Neural Comput. 1, 541\u2013551. https:\/\/doi.org\/10.1162\/neco.1989.1.4.541 (1989).","journal-title":"Neural Comput."},{"key":"33384_CR7","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1038\/nn.4244","volume":"19","author":"DLK Yamins","year":"2016","unstructured":"Yamins, D. L. K. & DiCarlo, J. J. Using goal-driven deep learning models to understand sensory cortex. Nat. Neurosci. 19, 356\u2013365. https:\/\/doi.org\/10.1038\/nn.4244 (2016).","journal-title":"Nat. Neurosci."},{"key":"33384_CR8","doi-asserted-by":"publisher","first-page":"121","DOI":"10.1016\/j.conb.2019.02.003","volume":"55","author":"AJ Kell","year":"2019","unstructured":"Kell, A. J. & McDermott, J. H. Deep neural network models of sensory systems: Windows onto the role of task constraints. Curr. Opin. Neurobiol. 55, 121\u2013132. https:\/\/doi.org\/10.1016\/j.conb.2019.02.003 (2019) (Machine Learning, Big Data, and Neuroscience.).","journal-title":"Curr. Opin. Neurobiol."},{"key":"33384_CR9","doi-asserted-by":"publisher","first-page":"2017","DOI":"10.1162\/jocn\\_a_01544","volume":"33","author":"GW Lindsay","year":"2021","unstructured":"Lindsay, G. W. Convolutional neural networks as a model of the visual system: Past, present, and future. J. Cogn. Neurosci. 33, 2017\u20132031. https:\/\/doi.org\/10.1162\/jocn_a_01544 (2021).","journal-title":"J. Cogn. Neurosci."},{"key":"33384_CR10","unstructured":"la\u00a0Tour, T.\u00a0D., Lu, M., Eickenberg, M. & Gallant, J.\u00a0L. A finer mapping of convolutional neural network layers to the visual cortex. In SVRHM 2021 Workshop @ NeurIPS 1\u201311 (2021)."},{"key":"33384_CR11","unstructured":"Goodfellow, I. et\u00a0al. Generative adversarial nets. In Advances in Neural Information Processing Systems (eds. Ghahramani, Z., Welling, M., Cortes, C., Lawrence, N.\u00a0D. & Weinberger, K.\u00a0Q.), vol. 27, 2672\u20132680 (Curran Associates, Inc., 2014)."},{"key":"33384_CR12","doi-asserted-by":"publisher","first-page":"44","DOI":"10.3389\/frai.2020.00044","volume":"3","author":"G Begu\u0161","year":"2020","unstructured":"Begu\u0161, G. Generative adversarial phonology: Modeling unsupervised phonetic and phonological learning with neural networks. Front. Artif. Intell. 3, 44. https:\/\/doi.org\/10.3389\/frai.2020.00044 (2020).","journal-title":"Front. Artif. Intell."},{"key":"33384_CR13","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1016\/j.neunet.2021.03.017","volume":"139","author":"G Begu\u0161","year":"2021","unstructured":"Begu\u0161, G. CiwGAN and fiwGAN: Encoding information in acoustic data to model lexical learning with generative adversarial networks. Neural Netw. 139, 305\u2013325. https:\/\/doi.org\/10.1016\/j.neunet.2021.03.017 (2021).","journal-title":"Neural Netw."},{"key":"33384_CR14","doi-asserted-by":"publisher","first-page":"1180","DOI":"10.1162\/tacl\\_a\\_00421","volume":"9","author":"G Begu\u0161","year":"2021","unstructured":"Begu\u0161, G. Identity-based patterns in deep convolutional networks: Generative adversarial phonology and reduplication. Trans. Assoc. Comput. Linguist. 9, 1180\u20131196. https:\/\/doi.org\/10.1162\/tacl_a_00421 (2021).","journal-title":"Trans. Assoc. Comput. Linguist."},{"key":"33384_CR15","doi-asserted-by":"publisher","DOI":"10.1016\/j.csl.2021.101244","volume":"71","author":"G Begu\u0161","year":"2022","unstructured":"Begu\u0161, G. Local and non-local dependency learning and emergence of rule-like representations in speech data by deep convolutional generative adversarial networks. Comput. Speech Lang. 71, 101244. https:\/\/doi.org\/10.1016\/j.csl.2021.101244 (2022).","journal-title":"Comput. Speech Lang."},{"key":"33384_CR16","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1093\/jole\/lzw013","volume":"2","author":"ST Piantadosi","year":"2017","unstructured":"Piantadosi, S. T. & Fedorenko, E. Infinitely productive language can arise from chance under communicative pressure. J. Lang. Evol. 2, 141\u2013147. https:\/\/doi.org\/10.1093\/jole\/lzw013 (2017).","journal-title":"J. Lang. Evol."},{"key":"33384_CR17","doi-asserted-by":"crossref","unstructured":"Begu\u0161, G., Zhou, A., Wu, P. & Anumanchipalli, G.\u00a0K. Articulation GAN: Unsupervised modeling of articulatory learning. arXiv arXiv:2210.15173 (2022).","DOI":"10.1109\/ICASSP49357.2023.10096800"},{"key":"33384_CR18","doi-asserted-by":"publisher","unstructured":"Agrawal, P., Stansbury, D., Malik, J. & Gallant, J. L. Pixels to Voxels: Modeling Visual Representation in the Human Brain. https:\/\/doi.org\/10.48550\/ARXIV.1407.5104 (2014).","DOI":"10.48550\/ARXIV.1407.5104"},{"key":"33384_CR19","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pcbi.1003963","volume":"10","author":"CF Cadieu","year":"2014","unstructured":"Cadieu, C. F. et al. Deep neural networks rival the representation of primate IT cortex for core visual object recognition. PLoS Comput. Biol. 10, 1\u201318. https:\/\/doi.org\/10.1371\/journal.pcbi.1003963 (2014).","journal-title":"PLoS Comput. Biol."},{"key":"33384_CR20","doi-asserted-by":"publisher","first-page":"10005","DOI":"10.1523\/JNEUROSCI.5023-14.2015","volume":"35","author":"U G\u00fc\u00e7l\u00fc","year":"2015","unstructured":"G\u00fc\u00e7l\u00fc, U. & van Gerven, M. A. J. Deep neural networks reveal a gradient in the complexity of neural representations across the ventral stream. J. Neurosci. 35, 10005\u201310014. https:\/\/doi.org\/10.1523\/JNEUROSCI.5023-14.2015 (2015).","journal-title":"J. Neurosci."},{"key":"33384_CR21","doi-asserted-by":"publisher","first-page":"27755","DOI":"10.1038\/srep27755","volume":"6","author":"RM Cichy","year":"2016","unstructured":"Cichy, R. M., Khosla, A., Pantazis, D., Torralba, A. & Oliva, A. Comparison of deep neural networks to spatio\u2013temporal cortical dynamics of human visual object recognition reveals hierarchical correspondence. Sci. Rep. 6, 27755. https:\/\/doi.org\/10.1038\/srep27755 (2016).","journal-title":"Sci. Rep."},{"key":"33384_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pcbi.1006327","volume":"14","author":"MR Greene","year":"2018","unstructured":"Greene, M. R. & Hansen, B. C. Shared spatiotemporal category representations in biological and artificial deep neural networks. PLoS Comput. Biol. 14, 1\u201317. https:\/\/doi.org\/10.1371\/journal.pcbi.1006327 (2018).","journal-title":"PLoS Comput. Biol."},{"key":"33384_CR23","doi-asserted-by":"publisher","first-page":"184","DOI":"10.1016\/j.neuroimage.2016.10.001","volume":"152","author":"M Eickenberg","year":"2017","unstructured":"Eickenberg, M., Gramfort, A., Varoquaux, G. & Thirion, B. Seeing it all: Convolutional network layers map the function of the human visual system. Neuroimage 152, 184\u2013194. https:\/\/doi.org\/10.1016\/j.neuroimage.2016.10.001 (2017).","journal-title":"Neuroimage"},{"key":"33384_CR24","doi-asserted-by":"publisher","unstructured":"Storrs, K.\u00a0R. & Kriegeskorte, N. Deep learning for cognitive neuroscience. In The Cognitive Neurosciences (The MIT Press, 2020). https:\/\/doi.org\/10.7551\/mitpress\/11442.003.0077. https:\/\/direct.mit.edu\/book\/chapter-pdf\/2053752\/c051600_9780262356176.pdf","DOI":"10.7551\/mitpress\/11442.003.0077"},{"key":"33384_CR25","doi-asserted-by":"crossref","unstructured":"Jain, S. & Huth, A. Incorporating context into language encoding models for fMRI. In Advances in Neural Information Processing Systems (eds. Bengio, S. et\u00a0al.), vol.\u00a031, 1\u201310 (Curran Associates, Inc., 2018).","DOI":"10.1101\/327601"},{"key":"33384_CR26","doi-asserted-by":"publisher","unstructured":"Jat, S., Tang, H., Talukdar, P. & Mitchell, T. Relating simple sentence representations in deep neural networks and the brain. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics 5137\u20135154. https:\/\/doi.org\/10.18653\/v1\/P19-1507 (Association for Computational Linguistics, Florence, Italy, 2019).","DOI":"10.18653\/v1\/P19-1507"},{"key":"33384_CR27","doi-asserted-by":"publisher","first-page":"e2105646118","DOI":"10.1073\/pnas.2105646118","volume":"118","author":"M Schrimpf","year":"2021","unstructured":"Schrimpf, M. et al. The neural architecture of language: Integrative modeling converges on predictive processing. Proc. Natl. Acad. Sci. 118, e2105646118. https:\/\/doi.org\/10.1073\/pnas.2105646118 (2021).","journal-title":"Proc. Natl. Acad. Sci."},{"key":"33384_CR28","doi-asserted-by":"publisher","first-page":"630","DOI":"10.1016\/j.neuron.2018.03.044","volume":"98","author":"AJE Kell","year":"2018","unstructured":"Kell, A. J. E., Yamins, D. L. K., Shook, E. N., Norman-Haignere, S. V. & McDermott, J. H. A task-optimized neural network replicates human auditory behavior, predicts brain responses, and reveals a cortical processing hierarchy. Neuron 98, 630-644.e16. https:\/\/doi.org\/10.1016\/j.neuron.2018.03.044 (2018).","journal-title":"Neuron"},{"key":"33384_CR29","doi-asserted-by":"crossref","unstructured":"Millet, J. & King, J.-R. Inductive biases, pretraining and fine-tuning jointly account for brain responses to speech. arXiv:2103.01032 (2021).","DOI":"10.31219\/osf.io\/fq6gd"},{"key":"33384_CR30","doi-asserted-by":"publisher","first-page":"532","DOI":"10.3389\/fnins.2018.00532","volume":"12","author":"N Huang","year":"2018","unstructured":"Huang, N., Slaney, M. & Elhilali, M. Connecting deep neural networks to physical, perceptual, and electrophysiological auditory signals. Front. Neurosci. 12, 532. https:\/\/doi.org\/10.3389\/fnins.2018.00532 (2018).","journal-title":"Front. Neurosci."},{"key":"33384_CR31","doi-asserted-by":"publisher","first-page":"385","DOI":"10.1016\/j.neuron.2019.10.019","volume":"105","author":"PW Donhauser","year":"2020","unstructured":"Donhauser, P. W. & Baillet, S. Two distinct neural timescales for predictive speech processing. Neuron 105, 385-393.e9. https:\/\/doi.org\/10.1016\/j.neuron.2019.10.019 (2020).","journal-title":"Neuron"},{"key":"33384_CR32","doi-asserted-by":"publisher","first-page":"5517","DOI":"10.1523\/JNEUROSCI.2914-18.2019","volume":"39","author":"T Koumura","year":"2019","unstructured":"Koumura, T., Terashima, H. & Furukawa, S. Cascaded tuning to amplitude modulation for natural sound recognition. J. Neurosci. 39, 5517\u20135533. https:\/\/doi.org\/10.1523\/JNEUROSCI.2914-18.2019 (2019).","journal-title":"J. Neurosci."},{"key":"33384_CR33","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2023.1000079","author":"SS Smith","year":"2023","unstructured":"Smith, S. S., Sollini, J. & Akeroyd, M. A. Inferring the basis of binaural detection with a modified autoencoder. Front. Neurosci. https:\/\/doi.org\/10.3389\/fnins.2023.1000079 (2023).","journal-title":"Front. Neurosci."},{"key":"33384_CR34","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pcbi.1007558","volume":"16","author":"F Khatami","year":"2020","unstructured":"Khatami, F. & Escab\u00ed, M. A. Spiking network optimized for word recognition in noise predicts auditory system hierarchy. PLoS Comput. Biol. 16, 1\u201327. https:\/\/doi.org\/10.1371\/journal.pcbi.1007558 (2020).","journal-title":"PLoS Comput. Biol."},{"key":"33384_CR35","doi-asserted-by":"publisher","first-page":"e12823","DOI":"10.1111\/cogs.12823","volume":"44","author":"JS Magnuson","year":"2020","unstructured":"Magnuson, J. S. et al. Earshot: A minimal neural network model of incremental human speech recognition. Cogn. Sci. 44, e12823. https:\/\/doi.org\/10.1111\/cogs.12823 (2020).","journal-title":"Cogn. Sci."},{"key":"33384_CR36","doi-asserted-by":"publisher","first-page":"7278","DOI":"10.1038\/s41467-021-27366-6","volume":"12","author":"MR Saddler","year":"2021","unstructured":"Saddler, M. R., Gonzalez, R. & McDermott, J. H. Deep neural network models reveal interplay of peripheral coding and stimulus statistics in pitch perception. Nat. Commun. 12, 7278. https:\/\/doi.org\/10.1038\/s41467-021-27366-6 (2021).","journal-title":"Nat. Commun."},{"key":"33384_CR37","doi-asserted-by":"publisher","unstructured":"Harwath, D. & Glass, J. Towards visually grounded sub-word speech unit discovery. In ICASSP 2019\u20142019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 3017\u20133021. https:\/\/doi.org\/10.1109\/ICASSP.2019.8682666 (2019).","DOI":"10.1109\/ICASSP.2019.8682666"},{"key":"33384_CR38","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1007\/s11263-019-01205-0","volume":"128","author":"D Harwath","year":"2020","unstructured":"Harwath, D. et al. Jointly discovering visual objects and spoken words from raw sensory input. Int. J. Comput. Vis. 128, 620\u2013641. https:\/\/doi.org\/10.1007\/s11263-019-01205-0 (2020).","journal-title":"Int. J. Comput. Vis."},{"key":"33384_CR39","doi-asserted-by":"crossref","unstructured":"Lust, B. C. Child Language: Acquisition and Growth. Cambridge Textbooks in Linguistics (Cambridge University Press, 2006).","DOI":"10.1017\/CBO9780511803413"},{"key":"33384_CR40","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1080\/0163853X.2020.1719795","volume":"57","author":"EV Clark","year":"2020","unstructured":"Clark, E. V. Conversational repair and the acquisition of language. Discourse Process. 57, 441\u2013459. https:\/\/doi.org\/10.1080\/0163853X.2020.1719795 (2020).","journal-title":"Discourse Process."},{"key":"33384_CR41","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1017\/S0305000900008680","volume":"21","author":"E Bates","year":"1994","unstructured":"Bates, E. et al. Developmental and stylistic variation in the composition of early vocabulary. J. Child Lang. 21, 85\u2013123. https:\/\/doi.org\/10.1017\/S0305000900008680 (1994).","journal-title":"J. Child Lang."},{"key":"33384_CR42","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1016\/j.conb.2019.04.002","volume":"55","author":"N Kriegeskorte","year":"2019","unstructured":"Kriegeskorte, N. & Douglas, P. K. Interpreting encoding and decoding models. Curr. Opin. Neurobiol. 55, 167\u2013179. https:\/\/doi.org\/10.1016\/j.conb.2019.04.002 (2019) (Machine Learning, Big Data, and Neuroscience).","journal-title":"Curr. Opin. Neurobiol."},{"key":"33384_CR43","unstructured":"Lipton, Z.\u00a0C. & Tripathi, S. Precise recovery of latent vectors from generative adversarial networks. arXiv arXiv:1702.04782 (2017)."},{"key":"33384_CR44","unstructured":"Keyes, A., Bayat, N., Khazaie, V.\u00a0R. & Mohsenzadeh, Y. Latent Vector Recovery of Audio GANs. arXiv arXiv:2010.08534 (2020)."},{"key":"33384_CR45","doi-asserted-by":"publisher","unstructured":"Vihman, M. Perception and production in phonological development. In The Handbook of Language Emergence 437\u2013457 (Wiley, 2015). https:\/\/doi.org\/10.1002\/9781118346136.ch20","DOI":"10.1002\/9781118346136.ch20"},{"key":"33384_CR46","doi-asserted-by":"publisher","first-page":"302","DOI":"10.1097\/AUD.0b013e3181cdb272","volume":"31","author":"E Skoe","year":"2010","unstructured":"Skoe, E. & Kraus, N. Auditory brain stem response to complex sounds: A tutorial. Ear Hear. 31, 302 (2010).","journal-title":"Ear Hear."},{"key":"33384_CR47","doi-asserted-by":"publisher","first-page":"8716","DOI":"10.1073\/pnas.1800186115","volume":"115","author":"TC Zhao","year":"2018","unstructured":"Zhao, T. C. & Kuhl, P. K. Linguistic effect on speech perception observed at the brainstem. Proc. Natl. Acad. Sci. 115, 8716\u20138721. https:\/\/doi.org\/10.1073\/pnas.1800186115 (2018).","journal-title":"Proc. Natl. Acad. Sci."},{"key":"33384_CR48","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/j.bandl.2019.05.002","volume":"194","author":"TC Zhao","year":"2019","unstructured":"Zhao, T. C., Masapollo, M., Polka, L., M\u00e9nard, L. & Kuhl, P. K. Effects of formant proximity and stimulus prototypicality on the neural discrimination of vowels: Evidence from the auditory frequency-following response. Brain Lang. 194, 77\u201383. https:\/\/doi.org\/10.1016\/j.bandl.2019.05.002 (2019).","journal-title":"Brain Lang."},{"key":"33384_CR49","unstructured":"Garofolo, J.\u00a0S. et\u00a0al. TIMIT acoustic-phonetic continuous speech corpus. In Linguistic Data Consortium (1993)."},{"key":"33384_CR50","doi-asserted-by":"publisher","unstructured":"Pineda, L.\u00a0A., Pineda, L.\u00a0V., Cu\u00e9tara, J., Castellanos, H. & L\u00f3pez, I. DIMEx100: A new phonetic and speech corpus for Mexican Spanish. In Advances in Artificial Intelligence\u2014IBERAMIA 2004 974\u2013983 (Springer, 2004). https:\/\/doi.org\/10.1007\/978-3-540-30498-2_97.","DOI":"10.1007\/978-3-540-30498-2_97"},{"key":"33384_CR51","doi-asserted-by":"publisher","first-page":"3214","DOI":"10.1109\/TASLP.2022.3209938","volume":"30","author":"G Begu\u0161","year":"2022","unstructured":"Begu\u0161, G. & Zhou, A. Interpreting intermediate convolutional layers of generative CNNs trained on waveforms. IEEE\/ACM Trans. Audio Speech Lang. Process. 30, 3214\u20133229. https:\/\/doi.org\/10.1109\/TASLP.2022.3209938 (2022).","journal-title":"IEEE\/ACM Trans. Audio Speech Lang. Process."},{"key":"33384_CR52","doi-asserted-by":"publisher","unstructured":"Begu\u0161, G. & Zhou, A. Interpreting intermediate convolutional layers in unsupervised acoustic word classification. In ICASSP 2022\u20142022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) 8207\u20138211 (2022). https:\/\/doi.org\/10.1109\/ICASSP43922.2022.9746849.","DOI":"10.1109\/ICASSP43922.2022.9746849"},{"key":"33384_CR53","doi-asserted-by":"publisher","DOI":"10.1007\/s42113-022-00166-x","author":"O Guest","year":"2023","unstructured":"Guest, O. & Martin, A. E. On logical inference over brains, behaviour, and artificial neural networks. Comput. Brain Behav. https:\/\/doi.org\/10.1007\/s42113-022-00166-x (2023).","journal-title":"Comput. Brain Behav."},{"key":"33384_CR54","doi-asserted-by":"publisher","unstructured":"Kim, J., Sangjun, O., Kim, Y. & Lee, M. Convolutional neural network with biologically inspired retinal structure. In Procedia Computer Science, 7th Annual International Conference on Biologically Inspired Cognitive Architectures, BICA 2016, vol. 88, 145\u2013154. https:\/\/doi.org\/10.1016\/j.procs.2016.07.418 (2016).","DOI":"10.1016\/j.procs.2016.07.418"},{"key":"33384_CR55","unstructured":"Bartunov, S. et\u00a0al. Assessing the scalability of biologically-motivated deep learning algorithms and architectures. In Proceedings of the 32nd International Conference on Neural Information Processing Systems, NIPS\u201918, 9390\u20139400 (Curran Associates Inc., 2018)."},{"key":"33384_CR56","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1515\/TL.2006.015","volume":"32","author":"P Kiparsky","year":"2006","unstructured":"Kiparsky, P. Amphichronic program vs. evolutionary phonology. Theor. Linguist. 32, 217\u2013236 (2006).","journal-title":"Theor. Linguist."},{"key":"33384_CR57","doi-asserted-by":"crossref","unstructured":"Kiparsky, P. Universals constrain change, change results in typological generalizations. In Linguistic Universals and Language Change (ed. Good, J.) 23\u201353 (Oxford University Press, 2008).","DOI":"10.1093\/acprof:oso\/9780199298495.003.0002"},{"key":"33384_CR58","doi-asserted-by":"crossref","unstructured":"Blevins, J. Evolutionary phonology: A holistic approach to sound change typology. In Handbook of Historical Phonology (eds. Honeybone, P. & Salmons, J.) 485\u2013500 (Oxford University Press, 2013).","DOI":"10.1093\/oxfordhb\/9780199232819.013.006"},{"key":"33384_CR59","doi-asserted-by":"publisher","first-page":"689","DOI":"10.1017\/S002222671800049X","volume":"55","author":"G Begu\u0161","year":"2019","unstructured":"Begu\u0161, G. Post-nasal devoicing and the blurring process. J. Linguist. 55, 689\u2013753. https:\/\/doi.org\/10.1017\/S002222671800049X (2019).","journal-title":"J. Linguist."},{"key":"33384_CR60","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1017\/S0952675720000263","volume":"37","author":"G Begu\u0161","year":"2020","unstructured":"Begu\u0161, G. Estimating historical probabilities of natural and unnatural processes. Phonology 37, 515\u2013549. https:\/\/doi.org\/10.1017\/S0952675720000263 (2020).","journal-title":"Phonology"},{"key":"33384_CR61","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1353\/lan.2021.0084","volume":"98","author":"G Begu\u0161","year":"2022","unstructured":"Begu\u0161, G. Distinguishing cognitive from historical influences in phonology. Language 98, 1\u201334. https:\/\/doi.org\/10.1353\/lan.2021.0084 (2022).","journal-title":"Language"},{"key":"33384_CR62","doi-asserted-by":"publisher","first-page":"1964","DOI":"10.3389\/fpsyg.2015.01964","volume":"6","author":"J Culbertson","year":"2016","unstructured":"Culbertson, J. & Kirby, S. Simplicity and specificity in language: Domain-general biases have domain-specific effects. Front. Psychol. 6, 1964. https:\/\/doi.org\/10.3389\/fpsyg.2015.01964 (2016).","journal-title":"Front. Psychol."},{"key":"33384_CR63","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1162\/jocn.2009.21362","volume":"23","author":"GM Bidelman","year":"2011","unstructured":"Bidelman, G. M., Gandour, J. T. & Krishnan, A. Cross-domain effects of music and language experience on the representation of pitch in the human auditory brainstem. J. Cogn. Neurosci. 23, 425\u2013434. https:\/\/doi.org\/10.1162\/jocn.2009.21362 (2011).","journal-title":"J. Cogn. Neurosci."},{"key":"33384_CR64","unstructured":"Boersma, P. & Weenink, D. Praat: Doing phonetics by computer [computer program]. version 5.4.06. http:\/\/www.praat.org\/ (2015). Accessed 21 February 2015."},{"key":"33384_CR65","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1111\/j.1467-9868.2010.00749.x","volume":"73","author":"SN Wood","year":"2011","unstructured":"Wood, S. N. Fast stable restricted maximum likelihood and marginal likelihood estimation of semiparametric generalized linear models. J. R. Stat. Soc. (B) 73, 3\u201336 (2011).","journal-title":"J. R. Stat. Soc. (B)"},{"key":"33384_CR66","unstructured":"Donahue, C., McAuley, J.\u00a0J. & Puckette, M.\u00a0S. Adversarial audio synthesis. In 7th International Conference on Learning Representations, ICLR 2019 1\u201316 (OpenReview.net, 2019)."},{"key":"33384_CR67","unstructured":"Radford, A., Metz, L. & Chintala, S. Unsupervised representation learning with deep convolutional generative adversarial networks. In 4th International Conference on Learning Representations, ICLR 2016, Conference Track Proceedings (eds. Bengio, Y. & LeCun, Y.) (2016)."},{"key":"33384_CR68","unstructured":"Arjovsky, M., Chintala, S. & Bottou, L. Wasserstein generative adversarial networks. In Proceedings of the 34th International Conference on Machine Learning, Proceedings of Machine Learning Research (eds. Precup, D. & Teh, Y.\u00a0W.), vol.\u00a070, 214\u2013223 (PMLR, International Convention Centre, 2017)."},{"key":"33384_CR69","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1371\/journal.pbio.2005127","volume":"16","author":"SV Norman-Haignere","year":"2018","unstructured":"Norman-Haignere, S. V. & McDermott, J. H. Neural responses to natural and model-matched stimuli reveal distinct computations in primary and nonprimary auditory cortex. PLoS Biol. 16, 1\u201346. https:\/\/doi.org\/10.1371\/journal.pbio.2005127 (2018).","journal-title":"PLoS Biol."},{"key":"33384_CR70","unstructured":"Lenth, R. emmeans: Estimated Marginal Means, aka Least-Squares Means (2018). R package version 1.3.0."},{"key":"33384_CR71","doi-asserted-by":"publisher","first-page":"176","DOI":"10.1016\/j.tins.2005.02.003","volume":"28","author":"N Kraus","year":"2005","unstructured":"Kraus, N. & Nicol, T. Brainstem origins for cortical \u2018what\u2019 and \u2018where\u2019 pathways in the auditory system. Trends Neurosci. 28, 176\u2013181. https:\/\/doi.org\/10.1016\/j.tins.2005.02.003 (2005).","journal-title":"Trends Neurosci."},{"key":"33384_CR72","doi-asserted-by":"publisher","first-page":"659","DOI":"10.1097\/AUD.0000000000000648","volume":"40","author":"G BinKhamis","year":"2022","unstructured":"BinKhamis, G. et al. Speech auditory brainstem responses: Effects of background, stimulus duration, consonant-vowel, and number of epochs. Ear Hear. 40, 659\u2013670. https:\/\/doi.org\/10.1097\/AUD.0000000000000648 (2022).","journal-title":"Ear Hear."},{"key":"33384_CR73","doi-asserted-by":"publisher","first-page":"e276","DOI":"10.1097\/AUD.0000000000000301","volume":"37","author":"G Laumen","year":"2016","unstructured":"Laumen, G., Ferber, A. T., Klump, G. M. & Tollin, D. J. The physiological basis and clinical use of the binaural interaction component of the auditory brainstem response. Ear Hear. 37, e276 (2016).","journal-title":"Ear Hear."},{"key":"33384_CR74","doi-asserted-by":"publisher","first-page":"5036","DOI":"10.1038\/s41467-019-13003-w","volume":"10","author":"EBJ Coffey","year":"2019","unstructured":"Coffey, E. B. J. et al. Evolving perspectives on the sources of the frequency-following response. Nat. Commun. 10, 5036. https:\/\/doi.org\/10.1038\/s41467-019-13003-w (2019).","journal-title":"Nat. Commun."},{"key":"33384_CR75","first-page":"32","volume":"31","author":"CF Hockett","year":"1959","unstructured":"Hockett, C. F. Animal, \u201clanguages\u2019\u2019 and human language. Hum. Biol. 31, 32\u201339 (1959).","journal-title":"Hum. Biol."},{"key":"33384_CR76","unstructured":"Abrams, D.\u00a0A. & Kraus, N. Auditory pathway representations of speech sounds in humans. In Handbook of Clinical Audiology, chap.\u00a028, 527\u2013544 (Wolters Kluwer Health, 2015)."},{"key":"33384_CR77","doi-asserted-by":"publisher","first-page":"192","DOI":"10.1016\/S0378-5955(02)00327-1","volume":"166","author":"A Krishnan","year":"2002","unstructured":"Krishnan, A. Human frequency-following responses: Representation of steady-state synthetic vowels. Hear. Res. 166, 192\u2013201. https:\/\/doi.org\/10.1016\/S0378-5955(02)00327-1 (2002).","journal-title":"Hear. Res."}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-33384-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-33384-9","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-33384-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,10]],"date-time":"2023-12-10T22:58:37Z","timestamp":1702249117000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-023-33384-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,20]]},"references-count":77,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,12]]}},"alternative-id":["33384"],"URL":"https:\/\/doi.org\/10.1038\/s41598-023-33384-9","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2022.01.03.474864","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,20]]},"assertion":[{"value":"2 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 April 2023","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"20 April 2023","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"6480"}}