{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T13:40:07Z","timestamp":1750858807090,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":58,"publisher":"ACM","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,12,18]]},"DOI":"10.1145\/3703323.3704280","type":"proceedings-article","created":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T12:03:28Z","timestamp":1750853008000},"page":"358-361","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Language Models and Brain Alignment: Brain Encoding and Decoding"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5975-622X","authenticated-orcid":false,"given":"Subba Reddy","family":"Oota","sequence":"first","affiliation":[{"name":"Inria, Bordeaux, IN"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2204-0890","authenticated-orcid":false,"given":"Raju Surampudi","family":"Bapi","sequence":"additional","affiliation":[{"name":"International Institute of Information Technology Hyderabad, Hyderabad, IN"}]}],"member":"320","published-online":{"date-parts":[[2025,6,25]]},"reference":[{"key":"e_1_3_3_1_2_2","unstructured":"Nicolas Affolter Beni Egressy Damian Pascual and Roger Wattenhofer. 2020. Brain2Word: Decoding Brain Activity for Language Generation. arXiv preprint arXiv:2009.04765 (2020)."},{"key":"e_1_3_3_1_3_2","doi-asserted-by":"crossref","unstructured":"Andrew\u00a0James Anderson Jeffrey\u00a0R Binder Leonardo Fernandino Colin\u00a0J Humphries Lisa\u00a0L Conant Mario Aguilar Xixi Wang Donias Doko and Rajeev\u00a0DS Raizada. 2017. Predicting neural activity patterns associated with sentences using a neurobiologically motivated model of semantic representation. Cerebral Cortex 27 9 (2017) 4379\u20134395.","DOI":"10.1093\/cercor\/bhw240"},{"key":"e_1_3_3_1_4_2","doi-asserted-by":"crossref","unstructured":"Andrew\u00a0James Anderson Jeffrey\u00a0R Binder Leonardo Fernandino Colin\u00a0J Humphries Lisa\u00a0L Conant Rajeev\u00a0DS Raizada Feng Lin and Edmund\u00a0C Lalor. 2019. An integrated neural decoder of linguistic and experiential meaning. Journal of Neuroscience 39 45 (2019) 8969\u20138987.","DOI":"10.1523\/JNEUROSCI.2575-18.2019"},{"key":"e_1_3_3_1_5_2","doi-asserted-by":"crossref","unstructured":"Andrew\u00a0James Anderson Kelsey McDermott Brian Rooks Kathi\u00a0L Heffner David Dodell-Feder and Feng\u00a0V Lin. 2020. Decoding individual identity from brain activity elicited in imagining common experiences. Nature communications 11 1 (2020) 1\u201314.","DOI":"10.1038\/s41467-020-19630-y"},{"key":"e_1_3_3_1_6_2","unstructured":"Richard Antonello Javier\u00a0S Turek Vy Vo and Alexander Huth. 2021. Low-dimensional structure in the space of language representations is reflected in brain responses. NeurIPS 34 (2021) 8332\u20138344."},{"key":"e_1_3_3_1_7_2","volume-title":"The Eleventh International Conference on Learning Representations","author":"Aw Khai\u00a0Loong","year":"2023","unstructured":"Khai\u00a0Loong Aw and Mariya Toneva. 2023. Training language models to summarize narratives improves brain alignment. In The Eleventh International Conference on Learning Representations."},{"key":"e_1_3_3_1_8_2","first-page":"1336","volume-title":"ICML","author":"Caucheteux Charlotte","year":"2021","unstructured":"Charlotte Caucheteux, Alexandre Gramfort, and Jean-Remi King. 2021. Disentangling syntax and semantics in the brain with deep networks. In ICML. PMLR, 1336\u20131348."},{"key":"e_1_3_3_1_9_2","doi-asserted-by":"crossref","unstructured":"Charlotte Caucheteux and Jean-R\u00e9mi King. 2020. Language processing in brains and deep neural networks: computational convergence and its limits. Nature Communications Biology (2020).","DOI":"10.1101\/2020.07.03.186288"},{"key":"e_1_3_3_1_10_2","doi-asserted-by":"crossref","unstructured":"Alexandre D\u00e9fossez Charlotte Caucheteux J\u00e9r\u00e9my Rapin Ori Kabeli and Jean-R\u00e9mi King. 2022. Decoding speech from non-invasive brain recordings. arXiv preprint arXiv:2208.12266 (2022).","DOI":"10.1038\/s42256-023-00714-5"},{"key":"e_1_3_3_1_11_2","doi-asserted-by":"crossref","unstructured":"Fatma Deniz Anwar\u00a0O Nunez-Elizalde Alexander\u00a0G Huth and Jack\u00a0L Gallant. 2019. The representation of semantic information across human cerebral cortex during listening versus reading is invariant to stimulus modality. Journal of Neuroscience 39 39 (2019) 7722\u20137736.","DOI":"10.1523\/JNEUROSCI.0675-19.2019"},{"key":"e_1_3_3_1_12_2","doi-asserted-by":"crossref","unstructured":"Jon Gauthier and Roger Levy. 2019. Linking artificial and human neural representations of language. arXiv preprint arXiv:1910.01244 (2019).","DOI":"10.18653\/v1\/D19-1050"},{"key":"e_1_3_3_1_13_2","doi-asserted-by":"crossref","unstructured":"Ariel Goldstein Zaid Zada Eliav Buchnik Mariano Schain Amy Price Bobbi Aubrey Samuel\u00a0A Nastase Amir Feder Dotan Emanuel Alon Cohen et\u00a0al. 2022. Shared computational principles for language processing in humans and deep language models. Nature neuroscience 25 3 (2022) 369\u2013380.","DOI":"10.1038\/s41593-022-01026-4"},{"key":"e_1_3_3_1_14_2","doi-asserted-by":"crossref","unstructured":"Laura Gwilliams Graham Flick Alec Marantz Liina Pylkkanen David Poeppel and Jean-Remi King. 2022. MEG-MASC: a high-quality magneto-encephalography dataset for evaluating natural speech processing. arXiv preprint arXiv:2208.11488 (2022).","DOI":"10.1038\/s41597-023-02752-5"},{"key":"e_1_3_3_1_15_2","doi-asserted-by":"crossref","unstructured":"Laura Gwilliams Jean-Remi King Alec Marantz and David Poeppel. 2022. Neural dynamics of phoneme sequences reveal position-invariant code for content and order. Nature communications 13 1 (2022) 6606.","DOI":"10.1038\/s41467-022-34326-1"},{"key":"e_1_3_3_1_16_2","doi-asserted-by":"crossref","unstructured":"Giacomo Handjaras Emiliano Ricciardi Andrea Leo Alessandro Lenci Luca Cecchetti Mirco Cosottini and Giovanna Marotta. 2016. How concepts are encoded in the human brain: a modality independent category-based cortical organization of semantic knowledge. Neuroimage 135 (2016) 232\u2013242.","DOI":"10.1016\/j.neuroimage.2016.04.063"},{"key":"e_1_3_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/K19-1050"},{"key":"e_1_3_3_1_18_2","doi-asserted-by":"crossref","unstructured":"Nora Hollenstein Jonathan Rotsztejn Marius Troendle Andreas Pedroni Ce Zhang and Nicolas Langer. 2018. ZuCo a simultaneous EEG and eye-tracking resource for natural sentence reading. Scientific data 5 1 (2018) 1\u201313.","DOI":"10.1038\/sdata.2018.291"},{"key":"e_1_3_3_1_19_2","doi-asserted-by":"crossref","unstructured":"Alexander\u00a0G Huth Wendy\u00a0A De\u00a0Heer Thomas\u00a0L Griffiths Fr\u00e9d\u00e9ric\u00a0E Theunissen and Jack\u00a0L Gallant. 2016. Natural speech reveals the semantic maps that tile human cerebral cortex. Nature 532 7600 (2016) 453\u2013458.","DOI":"10.1038\/nature17637"},{"key":"e_1_3_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1101\/327601"},{"key":"e_1_3_3_1_21_2","doi-asserted-by":"crossref","unstructured":"Carina Kauf Greta Tuckute Roger Levy Jacob Andreas and Evelina Fedorenko. 2023. Lexical semantic content not syntactic structure is the main contributor to ANN-brain similarity of fMRI responses in the language network. bioRxiv (2023) 2023\u201305.","DOI":"10.1101\/2023.05.05.539646"},{"key":"e_1_3_3_1_22_2","doi-asserted-by":"crossref","unstructured":"Sreejan Kumar Theodore\u00a0R Sumers Takateru Yamakoshi Ariel Goldstein Uri Hasson Kenneth\u00a0A Norman Thomas\u00a0L Griffiths Robert\u00a0D Hawkins and Samuel\u00a0A Nastase. 2022. Reconstructing the cascade of language processing in the brain using the internal computations of a transformer-based language model. BioRxiv (2022) 2022\u201306.","DOI":"10.32470\/CCN.2022.1255-0"},{"key":"e_1_3_3_1_23_2","unstructured":"Jixing Li Shohini Bhattasali Shulin Zhang Berta Franzluebbers Wen-Ming Luh R\u00a0Nathan Spreng Jonathan\u00a0R Brennan Yiming Yang Christophe Pallier and John Hale. 2021. Le Petit Prince: A multilingual fMRI corpus using ecological stimuli. Biorxiv (2021) 2021\u201310."},{"key":"e_1_3_3_1_24_2","unstructured":"Khai Loong\u00a0Aw Syrielle Montariol Badr AlKhamissi Martin Schrimpf and Antoine Bosselut. 2023. Instruction-tuning Aligns LLMs to the Human Brain. arXiv e-prints (2023) arXiv\u20132312."},{"key":"e_1_3_3_1_25_2","unstructured":"Gabriele Merlin and Mariya Toneva. 2022. Language models and brain alignment: beyond word-level semantics and prediction. arXiv preprint arXiv:2212.00596 (2022)."},{"key":"e_1_3_3_1_26_2","unstructured":"Juliette Millet Charlotte Caucheteux Yves Boubenec Alexandre Gramfort Ewan Dunbar Christophe Pallier Jean-Remi King et\u00a0al. 2022. Toward a realistic model of speech processing in the brain with self-supervised learning. Advances in Neural Information Processing Systems 35 (2022) 33428\u201333443."},{"key":"e_1_3_3_1_27_2","doi-asserted-by":"crossref","unstructured":"Tom\u00a0M Mitchell Svetlana\u00a0V Shinkareva Andrew Carlson Kai-Min Chang Vicente\u00a0L Malave and Robert\u00a0A Mason. 2008. Predicting human brain activity associated with the meanings of nouns. Science 320 5880 (2008) 1191\u20131195.","DOI":"10.1126\/science.1152876"},{"key":"e_1_3_3_1_28_2","doi-asserted-by":"crossref","unstructured":"Samuel\u00a0A Nastase Yun-Fei Liu Hanna Hillman Asieh Zadbood Liat Hasenfratz Neggin Keshavarzian Janice Chen Christopher\u00a0J Honey Yaara Yeshurun Mor Regev et\u00a0al. 2021. Narratives: fMRI data for evaluating models of naturalistic language comprehension. bioRxiv (2021) 2020\u201312.","DOI":"10.1101\/2020.12.23.424091"},{"key":"e_1_3_3_1_29_2","volume-title":"Proceedings of the Annual Meeting of the Cognitive Science Society","volume":"44","author":"Oota Subba\u00a0Reddy","year":"2022","unstructured":"Subba\u00a0Reddy Oota, Frederic Alexandre, and Xavier Hinaut. 2022. Long-Term Plausibility of Language Models and Neural Dynamics during Narrative Listening. In Proceedings of the Annual Meeting of the Cognitive Science Society , Vol.\u00a044."},{"key":"e_1_3_3_1_30_2","unstructured":"Subba\u00a0Reddy Oota Jashn Arora Veeral Agarwal Mounika Marreddy Manish Gupta and Bapi\u00a0Raju Surampudi. 2022. Neural Language Taskonomy: Which NLP Tasks are the most Predictive of fMRI Brain Activity? NAACL (2022)."},{"key":"e_1_3_3_1_31_2","first-page":"105","volume-title":"COLING","author":"Oota Subba\u00a0Reddy","year":"2022","unstructured":"Subba\u00a0Reddy Oota, Jashn Arora, Manish Gupta, and Raju\u00a0S Bapi. 2022. Multi-view and Cross-view Brain Decoding. In COLING. 105\u2013115."},{"key":"e_1_3_3_1_32_2","unstructured":"Subba\u00a0Reddy Oota Manish Gupta and Mariya Toneva. 2023. Joint processing of linguistic properties in brains and language models. NeurIPS (2023)."},{"key":"e_1_3_3_1_33_2","unstructured":"Subba\u00a0Reddy Oota Mounika Marreddy Manish Gupta and Bapi\u00a0Raju Surampud. 2023. Syntactic Structure Processing in the Brain while Listening. arXiv preprint arXiv:2302.08589 (2023)."},{"key":"e_1_3_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP49357.2023.10096248"},{"key":"e_1_3_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2019.8852339"},{"key":"e_1_3_3_1_36_2","unstructured":"Alexandre Pasquiou Yair Lakretz John Hale Bertrand Thirion and Christophe Pallier. 2022. Neural language models are not born equal to fit brain data but training helps. arXiv preprint arXiv:2207.03380 (2022)."},{"key":"e_1_3_3_1_37_2","doi-asserted-by":"crossref","unstructured":"Alexandre Pasquiou Yair Lakretz Bertrand Thirion and Christophe Pallier. 2023. Information-Restricted Neural Language Models Reveal Different Brain Regions\u2019 Sensitivity to Semantics Syntax and Context. arXiv preprint arXiv:2302.14389 (2023).","DOI":"10.1162\/nol_a_00125"},{"key":"e_1_3_3_1_38_2","doi-asserted-by":"crossref","unstructured":"Francisco Pereira Matthew Botvinick and Greg Detre. 2013. Using Wikipedia to learn semantic feature representations of concrete concepts in neuroimaging experiments. Artificial intelligence 194 (2013) 240\u2013252.","DOI":"10.1016\/j.artint.2012.06.005"},{"key":"e_1_3_3_1_39_2","doi-asserted-by":"crossref","unstructured":"Francisco Pereira Bin Lou Brianna Pritchett Nancy Kanwisher Matthew Botvinick and Ev Fedorenko. 2016. Decoding of generic mental representations from functional MRI data using word embeddings. bioRxiv (2016) 057216.","DOI":"10.1101\/057216"},{"key":"e_1_3_3_1_40_2","doi-asserted-by":"crossref","unstructured":"Francisco Pereira Bin Lou Brianna Pritchett Samuel Ritter Samuel\u00a0J Gershman Nancy Kanwisher Matthew Botvinick and Evelina Fedorenko. 2018. Toward a universal decoder of linguistic meaning from brain activation. Nature communications 9 1 (2018) 1\u201313.","DOI":"10.1038\/s41467-018-03068-4"},{"key":"e_1_3_3_1_41_2","unstructured":"Aniketh\u00a0Janardhan Reddy and Leila Wehbe. 2021. Can fMRI reveal the representation of syntactic structure in the brain? NeurIPS 34 (2021) 9843\u20139856."},{"key":"e_1_3_3_1_42_2","doi-asserted-by":"crossref","unstructured":"Martin Schrimpf Idan Blank Greta Tuckute Carina Kauf Eghbal\u00a0A Hosseini Nancy Kanwisher Joshua Tenenbaum and Evelina Fedorenko. 2021. The neural architecture of language: Integrative reverse-engineering converges on a model for predictive processing. PNAS Vol (2021) To appear.","DOI":"10.1101\/2020.06.26.174482"},{"key":"e_1_3_3_1_43_2","unstructured":"Dan Schwartz Mariya Toneva and Leila Wehbe. 2019. Inducing brain-relevant bias in natural language processing models. NIPS 32 (2019) 14123\u201314133."},{"key":"e_1_3_3_1_44_2","unstructured":"Jingyuan Sun and Marie-Francine Moens. 2023. Fine-tuned vs. prompt-tuned supervised representations: which better account for brain language representations? arXiv preprint arXiv:2310.01854 (2023)."},{"key":"e_1_3_3_1_45_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33017047"},{"key":"e_1_3_3_1_46_2","doi-asserted-by":"crossref","unstructured":"Jingyuan Sun Shaonan Wang Jiajun Zhang and Chengqing Zong. 2020. Neural Encoding and Decoding With Distributed Sentence Representations. IEEE TNNLS 32 2 (2020) 589\u2013603.","DOI":"10.1109\/TNNLS.2020.3027595"},{"key":"e_1_3_3_1_47_2","unstructured":"Jingyuan Sun Xiaohan Zhang and Marie-Francine Moens. 2023. Tuning In to Neural Encoding: Linking Human Brain and Artificial Supervised Representations of Language. arXiv preprint arXiv:2310.04460 (2023)."},{"key":"e_1_3_3_1_48_2","doi-asserted-by":"crossref","unstructured":"Jerry Tang Amanda LeBel Shailee Jain and Alexander\u00a0G Huth. 2022. Semantic reconstruction of continuous language from non-invasive brain recordings. bioRxiv (2022) 2022\u201309.","DOI":"10.1101\/2022.09.29.509744"},{"key":"e_1_3_3_1_49_2","unstructured":"Mariya Toneva Otilia Stretcu Barnab\u00e1s P\u00f3czos Leila Wehbe and Tom\u00a0M Mitchell. 2020. Modeling Task Effects on Meaning Representation in the Brain via Zero-Shot MEG Prediction. NIPS 33 (2020)."},{"key":"e_1_3_3_1_50_2","unstructured":"Mariya Toneva and Leila Wehbe. 2019. Interpreting and improving natural-language processing (in machines) with natural language-processing (in the brain). NeurIPS (2019)."},{"key":"e_1_3_3_1_51_2","doi-asserted-by":"crossref","unstructured":"Greta Tuckute Jenelle Feather Dana Boebinger and Josh\u00a0H McDermott. 2022. Many but not all deep neural network audio models capture brain responses and exhibit hierarchical region correspondence. bioRxiv (2022).","DOI":"10.32470\/CCN.2022.1065-0"},{"key":"e_1_3_3_1_52_2","doi-asserted-by":"crossref","unstructured":"Greta Tuckute Aalok Sathe Shashank Srikant Maya Taliaferro Mingye Wang Martin Schrimpf Kendrick Kay and Evelina Fedorenko. 2023. Driving and suppressing the human language network using large language models. CCN (2023).","DOI":"10.32470\/CCN.2023.1403-0"},{"key":"e_1_3_3_1_53_2","unstructured":"Aditya\u00a0R Vaidya Shailee Jain and Alexander\u00a0G Huth. 2022. Self-supervised models of audio effectively explain human cortical responses to speech. ICML (2022)."},{"key":"e_1_3_3_1_54_2","doi-asserted-by":"crossref","unstructured":"Jing Wang Vladimir\u00a0L Cherkassky and M\u00a0Adam Just. 2017. Predicting the brain activation pattern associated with the propositional content of a sentence: Modeling neural representations of events and states. HBM 10 (2017) 4865\u20134881.","DOI":"10.1002\/hbm.23692"},{"key":"e_1_3_3_1_55_2","doi-asserted-by":"crossref","unstructured":"Shaonan Wang Jiajun Zhang Haiyan Wang Nan Lin and Chengqing Zong. 2020. Fine-grained neural decoding with distributed word representations. Information Sciences 507 (2020) 256\u2013272.","DOI":"10.1016\/j.ins.2019.08.043"},{"key":"e_1_3_3_1_56_2","doi-asserted-by":"crossref","unstructured":"Leila Wehbe Brian Murphy Partha Talukdar Alona Fyshe Aaditya Ramdas and Tom Mitchell. 2014. Simultaneously uncovering the patterns of brain regions involved in different story reading subprocesses. PloS one 9 11 (2014) e112575.","DOI":"10.1371\/journal.pone.0112575"},{"key":"e_1_3_3_1_57_2","doi-asserted-by":"crossref","unstructured":"Xiaohan Zhang Shaonan Wang Nan Lin Jiajun Zhang and Chengqing Zong. 2022. Probing Word Syntactic Representations in the Brain by a Feature Elimination Method. AAAI (2022).","DOI":"10.1609\/aaai.v36i10.21427"},{"key":"e_1_3_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.emnlp-main.535"},{"key":"e_1_3_3_1_59_2","doi-asserted-by":"crossref","unstructured":"Yizhen Zhang Kuan Han Robert Worth and Zhongming Liu. 2020. Connecting concepts in the brain by mapping cortical representations of semantic relations. Nature communications 11 1 (2020) 1\u201313.","DOI":"10.1038\/s41467-020-15804-w"}],"event":{"name":"CODS-COMAD 2024: 8th International Conference on Data Science and Management of Data (12th ACM IKDD CODS and 30th COMAD)","location":"Jodhpur India","acronym":"CODS-COMAD Dec '24"},"container-title":["Proceedings of the 8th International Conference on Data Science and Management of Data (12th ACM IKDD CODS and 30th COMAD)"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3703323.3704280","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,25]],"date-time":"2025-06-25T13:03:14Z","timestamp":1750856594000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3703323.3704280"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,18]]},"references-count":58,"alternative-id":["10.1145\/3703323.3704280","10.1145\/3703323"],"URL":"https:\/\/doi.org\/10.1145\/3703323.3704280","relation":{},"subject":[],"published":{"date-parts":[[2024,12,18]]},"assertion":[{"value":"2025-06-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}