{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,20]],"date-time":"2026-08-20T14:54:20Z","timestamp":1787237660753,"version":"build-2736575974"},"reference-count":78,"publisher":"National Academy of Sciences","issue":"18","license":[{"start":{"date-parts":[[2025,4,28]],"date-time":"2025-04-28T00:00:00Z","timestamp":1745798400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000055","name":"HHS | NIH | National Institute on Deafness and Other Communication Disorders","doi-asserted-by":"publisher","award":["1F30DC021342-01"],"award-info":[{"award-number":["1F30DC021342-01"]}],"id":[{"id":"10.13039\/100000055","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000025","name":"HHS | NIH | National Institute of Mental Health","doi-asserted-by":"publisher","award":["5R01MH132225-02"],"award-info":[{"award-number":["5R01MH132225-02"]}],"id":[{"id":"10.13039\/100000025","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000055","name":"HHS | NIH | National Institute on Deafness and Other Communication Disorders","doi-asserted-by":"publisher","award":["R21DC019217-01A1"],"award-info":[{"award-number":["R21DC019217-01A1"]}],"id":[{"id":"10.13039\/100000055","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000055","name":"HHS | NIH | National Institute on Deafness and Other Communication Disorders","doi-asserted-by":"publisher","award":["R01DC013315-07"],"award-info":[{"award-number":["R01DC013315-07"]}],"id":[{"id":"10.13039\/100000055","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.pnas.org"],"crossmark-restriction":true},"short-container-title":["Proc. Natl. Acad. Sci. U.S.A."],"published-print":{"date-parts":[[2025,5,6]]},"abstract":"<jats:p>Efficient behavior is supported by humans\u2019 ability to rapidly recognize acoustically distinct sounds as members of a common category. Within the auditory cortex, critical unanswered questions remain regarding the organization and dynamics of sound categorization. We performed intracerebral recordings during epilepsy surgery evaluation as 20 patient-participants listened to natural sounds. We then built encoding models to predict neural responses using sound representations extracted from different layers within a deep neural network (DNN) pretrained to categorize sounds from acoustics. This approach yielded accurate models of neural responses throughout the auditory cortex. The complexity of a cortical site\u2019s representation (measured by the depth of the DNN layer that produced the best model) was closely related to its anatomical location, with shallow, middle, and deep layers associated with core (primary auditory cortex), lateral belt, and parabelt regions, respectively. Smoothly varying gradients of representational complexity existed within these regions, with complexity increasing along a posteromedial-to-anterolateral direction in core and lateral belt and along posterior-to-anterior and dorsal-to-ventral dimensions in parabelt. We then characterized the time (relative to sound onset) when feature representations emerged; this measure of temporal dynamics increased across the auditory hierarchy. Finally, we found separable effects of region and temporal dynamics on representational complexity: sites that took longer to begin encoding stimulus features had higher representational complexity independent of region, and downstream regions encoded more complex features independent of temporal dynamics. These findings suggest that hierarchies of timescales and complexity represent a functional organizational principle of the auditory stream underlying our ability to rapidly categorize sounds.<\/jats:p>","DOI":"10.1073\/pnas.2412243122","type":"journal-article","created":{"date-parts":[[2025,4,28]],"date-time":"2025-04-28T15:00:36Z","timestamp":1745852436000},"update-policy":"https:\/\/doi.org\/10.1073\/pnas.cm10313","source":"Crossref","is-referenced-by-count":9,"title":["A hierarchy of processing complexity and timescales for natural sounds in the human auditory cortex"],"prefix":"10.1073","volume":"122","author":[{"given":"Kyle M.","family":"Rupp","sequence":"first","affiliation":[{"name":"Department of Neurological Surgery, University of Pittsburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2562-2394","authenticated-orcid":false,"given":"Jasmine L.","family":"Hect","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, University of Pittsburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Emily E.","family":"Harford","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, University of Pittsburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8732-4977","authenticated-orcid":false,"given":"Lori L.","family":"Holt","sequence":"additional","affiliation":[{"name":"Department of Psychology, The University of Texas at Austin"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1746-4656","authenticated-orcid":false,"given":"Avniel Singh","family":"Ghuman","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, University of Pittsburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5089-460X","authenticated-orcid":false,"given":"Taylor J.","family":"Abel","sequence":"additional","affiliation":[{"name":"Department of Neurological Surgery, University of Pittsburgh"},{"name":"Department of Bioengineering, University of Pittsburgh"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"341","published-online":{"date-parts":[[2025,4,28]]},"reference":[{"key":"e_1_3_4_1_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-11684-1"},{"key":"e_1_3_4_2_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.2005127"},{"key":"e_1_3_4_3_2","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhs162"},{"key":"e_1_3_4_4_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.pneurobio.2020.101982"},{"key":"e_1_3_4_5_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1003412"},{"key":"e_1_3_4_6_2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.2001.85.3.1220"},{"key":"e_1_3_4_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2010.01.046"},{"key":"e_1_3_4_8_2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00395.2001"},{"key":"e_1_3_4_9_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaz3468"},{"key":"e_1_3_4_10_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1779-15.2016"},{"key":"e_1_3_4_11_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-018-37359-z"},{"key":"e_1_3_4_12_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1617622114"},{"key":"e_1_3_4_13_2","doi-asserted-by":"publisher","DOI":"10.1121\/1.1624067"},{"key":"e_1_3_4_14_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn.3347"},{"key":"e_1_3_4_15_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-023-01285-9"},{"key":"e_1_3_4_16_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2015.11.035"},{"key":"e_1_3_4_17_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.53445"},{"key":"e_1_3_4_18_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1007992"},{"key":"e_1_3_4_19_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1002759"},{"key":"e_1_3_4_20_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0907682106"},{"key":"e_1_3_4_21_2","doi-asserted-by":"publisher","DOI":"10.1038\/35002078"},{"key":"e_1_3_4_22_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-023-01468-4"},{"key":"e_1_3_4_23_2","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.abe7547"},{"key":"e_1_3_4_24_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2018.03.044"},{"key":"e_1_3_4_25_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.3002366"},{"key":"e_1_3_4_26_2","doi-asserted-by":"publisher","DOI":"10.1523\/ENEURO.0362-20.2021"},{"key":"e_1_3_4_27_2","first-page":"131","volume-title":"2017 IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Hershey S.","year":"2017","unstructured":"S. Hershey , \u201cCNN architectures for large-scale audio classification\u201d in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP, 2017), pp. 131\u2013135."},{"key":"e_1_3_4_28_2","first-page":"776","volume-title":"2017 IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Gemmeke J. F.","year":"2017","unstructured":"J. F. Gemmeke , \u201cAudio set: An ontology and human-labeled dataset for audio events\u201d in 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP, 2017), pp. 776\u2013780."},{"key":"e_1_3_4_29_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1245994"},{"key":"e_1_3_4_30_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpsycho.2014.03.006"},{"key":"e_1_3_4_31_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2014.07.004"},{"key":"e_1_3_4_32_2","doi-asserted-by":"publisher","DOI":"10.1002\/cne.1407"},{"key":"e_1_3_4_33_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn1530"},{"key":"e_1_3_4_34_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0296-10.2010"},{"key":"e_1_3_4_35_2","doi-asserted-by":"publisher","DOI":"10.1162\/089892901564108"},{"key":"e_1_3_4_36_2","doi-asserted-by":"publisher","DOI":"10.1016\/0006-8993(73)90731-2"},{"key":"e_1_3_4_37_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2014.00225"},{"key":"e_1_3_4_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00221-002-1014-z"},{"key":"e_1_3_4_39_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.7701330"},{"key":"e_1_3_4_40_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1448-11.2011"},{"key":"e_1_3_4_41_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pbio.0040215"},{"key":"e_1_3_4_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2014.10.022"},{"key":"e_1_3_4_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2007.05.061"},{"key":"e_1_3_4_44_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2742-09.2010"},{"key":"e_1_3_4_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0926-6410(03)00079-X"},{"key":"e_1_3_4_46_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1164318"},{"key":"e_1_3_4_47_2","doi-asserted-by":"publisher","DOI":"10.1097\/00001756-200311140-00019"},{"key":"e_1_3_4_48_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2015.06.050"},{"key":"e_1_3_4_49_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2021.08.043"},{"key":"e_1_3_4_50_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1113427109"},{"key":"e_1_3_4_51_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2331"},{"key":"e_1_3_4_52_2","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/123.12.2400"},{"key":"e_1_3_4_53_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(03)00669-X"},{"key":"e_1_3_4_54_2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00248.2004"},{"key":"e_1_3_4_55_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1388-12.2012"},{"key":"e_1_3_4_56_2","doi-asserted-by":"publisher","DOI":"10.1152\/jn.01120.2009"},{"key":"e_1_3_4_57_2","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5306-12.2013"},{"key":"e_1_3_4_58_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-021-01261-y"},{"key":"e_1_3_4_59_2","doi-asserted-by":"publisher","DOI":"10.1038\/nn.4021"},{"key":"e_1_3_4_60_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.crneur.2023.100118"},{"key":"e_1_3_4_61_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.crneur.2024.100127"},{"key":"e_1_3_4_62_2","doi-asserted-by":"publisher","DOI":"10.1007\/s101620010052"},{"key":"e_1_3_4_63_2","doi-asserted-by":"publisher","DOI":"10.1038\/13158"},{"key":"e_1_3_4_64_2","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0402680101"},{"key":"e_1_3_4_65_2","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.39906"},{"key":"e_1_3_4_66_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.07.017"},{"key":"e_1_3_4_67_2","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0115549"},{"key":"e_1_3_4_68_2","doi-asserted-by":"publisher","DOI":"10.3171\/2018.1.PEDS17435"},{"key":"e_1_3_4_69_2","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhg087"},{"key":"e_1_3_4_70_2","doi-asserted-by":"publisher","DOI":"10.1155\/2011\/879716"},{"key":"e_1_3_4_71_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2004.12.034"},{"key":"e_1_3_4_72_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.abb4588"},{"key":"e_1_3_4_73_2","doi-asserted-by":"publisher","DOI":"10.1006\/nimg.2000.0715"},{"key":"e_1_3_4_74_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00429-005-0029-1"},{"key":"e_1_3_4_75_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cortex.2020.02.021"},{"key":"e_1_3_4_76_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v033.i01"},{"key":"e_1_3_4_77_2","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v106.i01"},{"key":"e_1_3_4_78_2","first-page":"1097","article-title":"ImageNet classification with deep convolutional neural networks","volume":"25","author":"Krizhevsky A.","year":"2012","unstructured":"A. Krizhevsky, I. Sutskever, G. E. Hinton, ImageNet classification with deep convolutional neural networks. Proc. Adv. Neural Inf. Process. Syst. 25, 1097\u20131105 (2012).","journal-title":"Proc. Adv. Neural Inf. Process. Syst."}],"container-title":["Proceedings of the National Academy of Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/pnas.org\/doi\/pdf\/10.1073\/pnas.2412243122","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,28]],"date-time":"2025-04-28T15:00:40Z","timestamp":1745852440000},"score":1,"resource":{"primary":{"URL":"https:\/\/pnas.org\/doi\/10.1073\/pnas.2412243122"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,28]]},"references-count":78,"journal-issue":{"issue":"18","published-print":{"date-parts":[[2025,5,6]]}},"alternative-id":["10.1073\/pnas.2412243122"],"URL":"https:\/\/doi.org\/10.1073\/pnas.2412243122","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2024.05.24.595822","asserted-by":"object"}]},"ISSN":["0027-8424","1091-6490"],"issn-type":[{"value":"0027-8424","type":"print"},{"value":"1091-6490","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,28]]},"assertion":[{"value":"2024-06-18","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-21","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-04-28","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e2412243122"}}