{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,23]],"date-time":"2026-03-23T18:46:11Z","timestamp":1774291571217,"version":"3.50.1"},"reference-count":98,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"DOI":"10.13039\/501100002341","name":"Academy of Finland","doi-asserted-by":"crossref","award":["22653, 328875, 336085, 350323 and 35291"],"award-info":[{"award-number":["22653, 328875, 336085, 350323 and 35291"]}],"id":[{"id":"10.13039\/501100002341","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Horizon 2020 FET programme of the European Union","award":["CHIST-ERA-20-BCI-001"],"award-info":[{"award-number":["CHIST-ERA-20-BCI-001"]}]},{"name":"Villum Foundation and Velux Foundation"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Inf. Syst."],"published-print":{"date-parts":[[2026,1,31]]},"abstract":"<jats:p>\n                    Recent neuroimaging studies have revealed the association between relevance and brain responses. However, fundamental questions about how the human brain responds to a human relevance judgement of an entire text document and how such responses could be used in predicting document relevance remain unexplored. Here, we present the first work to utilise electroencephalography (EEG) data for predicting document relevance with respect to the topic selected by a human whose brain responses are recorded during document reading. Our approach jointly learns to predict document relevance from EEG and word embeddings computed for the document under a bimodal architecture. The EEG representations in our bimodal architecture account for a human\u2019s attention towards words, and word embeddings are used as a representation of word semantics. Experiments with several EEG decoding models and word embedding models show that document relevance can be predicted from EEG data and that our bimodal approach yields higher prediction performance (\n                    <jats:inline-formula content-type=\"math\/tex\">\n                      <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(\\text{AUROC}=0.68\\)<\/jats:tex-math>\n                    <\/jats:inline-formula>\n                    ) than models with only word embeddings (\n                    <jats:inline-formula content-type=\"math\/tex\">\n                      <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(\\text{AUROC}=0.62\\)<\/jats:tex-math>\n                    <\/jats:inline-formula>\n                    ) or only EEG data (\n                    <jats:inline-formula content-type=\"math\/tex\">\n                      <jats:tex-math notation=\"LaTeX\" version=\"MathJax\">\\(\\text{AUROC}=0.63\\)<\/jats:tex-math>\n                    <\/jats:inline-formula>\n                    ). Our findings create new opportunities for modelling document relevance through implicit physiological signals, emphasising the combined importance of human brain signals and language models in capturing personalised document relevance beyond traditional behavioural signals.\n                  <\/jats:p>","DOI":"10.1145\/3766067","type":"journal-article","created":{"date-parts":[[2025,9,8]],"date-time":"2025-09-08T18:30:57Z","timestamp":1757356257000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Predicting Document Relevance from Brain Recordings"],"prefix":"10.1145","volume":"44","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2839-9514","authenticated-orcid":false,"given":"Vadym","family":"Gryshchuk","sequence":"first","affiliation":[{"name":"University of Copenhagen, Copenhagen, Denmark"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7001-4817","authenticated-orcid":false,"given":"Maria","family":"Maistro","sequence":"additional","affiliation":[{"name":"University of Copenhagen, Copenhagen, Denmark"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2600-2701","authenticated-orcid":false,"given":"Christina","family":"Lioma","sequence":"additional","affiliation":[{"name":"University of Copenhagen, Copenhagen, Denmark"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2203-4928","authenticated-orcid":false,"given":"Tuukka","family":"Ruotsalo","sequence":"additional","affiliation":[{"name":"University of Copenhagen, Copenhagen, Denmark and LUT University, Lahti, Finland"}]}],"member":"320","published-online":{"date-parts":[[2025,11,14]]},"reference":[{"key":"e_1_3_3_2_2","first-page":"719","volume-title":"Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201915)","author":"Allegretti Marco","year":"2015","unstructured":"Marco Allegretti, Yashar Moshfeghi, Maria Hadjigeorgieva, Frank E. Pollick, Joemon M. Jose, and Gabriella Pasi. 2015. When relevance judgement is happening? An EEG-based study. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201915). ACM, New York, NY, 719\u2013722. DOI: 10.1145\/2766462.2767811"},{"key":"e_1_3_3_3_2","first-page":"371","volume-title":"Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201910)","author":"Arapakis Ioannis","year":"2010","unstructured":"Ioannis Arapakis, Konstantinos Athanasakos, and Joemon M. Jose. 2010. A comparison of general vs personalised affective models for the prediction of topical relevance. In Proceedings of the 33rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201910). ACM, New York, NY, 371\u2013378. DOI: 10.1145\/1835449.1835512"},{"key":"e_1_3_3_4_2","first-page":"395","volume-title":"Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201908)","author":"Arapakis Ioannis","year":"2008","unstructured":"Ioannis Arapakis, Joemon M. Jose, and Philip D. Gray. 2008. Affective feedback: An investigation into the role of emotions in the information seeking process. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201908). ACM, New York, NY, 395\u2013402. DOI: 10.1145\/1390334.1390403"},{"key":"e_1_3_3_5_2","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1145\/1631272.1631336","volume-title":"Proceedings of the 17th ACM International Conference on Multimedia (MM \u201909)","author":"Arapakis Ioannis","year":"2009","unstructured":"Ioannis Arapakis, Ioannis Konstas, and Joemon M. Jose. 2009. Using facial expressions and peripheral physiological signals as implicit indicators of topical relevance. In Proceedings of the 17th ACM International Conference on Multimedia (MM \u201909). ACM, New York, NY, 461\u2013470. DOI: 10.1145\/1631272.1631336"},{"key":"e_1_3_3_6_2","first-page":"1309","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201920)","author":"Arapakis Ioannis","year":"2020","unstructured":"Ioannis Arapakis and Luis A. Leiva. 2020. Learning efficient representations of mouse movements to predict user attention. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201920). ACM, New York, NY, 1309\u20131318. DOI: 10.1145\/3397271.3401031"},{"key":"e_1_3_3_7_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neulet.2010.05.053"},{"key":"e_1_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-016-9184-8"},{"key":"e_1_3_3_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00216-011-4985-4"},{"key":"e_1_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3130348.3130371"},{"key":"e_1_3_3_11_2","first-page":"1521","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201920)","author":"Bi Keping","year":"2020","unstructured":"Keping Bi, Qingyao Ai, and W. Bruce Croft. 2020. A transformer-based embedding model for personalized product search. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201920). ACM, Virtual Event, China, 1521\u20131524. DOI: 10.1145\/3397271.3401192"},{"key":"e_1_3_3_12_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2010.06.048"},{"key":"e_1_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00051"},{"key":"e_1_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.5334\/joc.72"},{"key":"e_1_3_3_15_2","doi-asserted-by":"publisher","DOI":"10.1515\/commun.2006.022"},{"key":"e_1_3_3_16_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2010.00194"},{"key":"e_1_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1038\/s42003-022-03036-1"},{"key":"e_1_3_3_18_2","doi-asserted-by":"crossref","first-page":"11146","DOI":"10.1145\/3664647.3685508","volume-title":"Proceedings of the 32nd ACM International Conference on Multimedia","author":"de la Torre-Ortiz Carlos","year":"2024","unstructured":"Carlos de la Torre-Ortiz and Tuukka Ruotsalo. 2024. Perceptual visual similarity from EEG: Prediction and image generation. In Proceedings of the 32nd ACM International Conference on Multimedia. ACM, New York, NY, 11146\u201311155. DOI: 10.1145\/3664647.3685508"},{"key":"e_1_3_3_19_2","first-page":"4171","volume-title":"Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Devlin Jacob","year":"2019","unstructured":"Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2019. BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1, Long and Short Papers, Association for Computational Linguistics, Minneapolis, Minnesota, 4171\u20134186. DOI: 10.18653\/v1\/N19-1423"},{"key":"e_1_3_3_20_2","first-page":"3003","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201922)","author":"Dietz Laura","year":"2022","unstructured":"Laura Dietz, Shubham Chatterjee, Connor Lennox, Sumanta Kashyapi, Pooja Oza, and Ben Gamari. 2022. Wikimarks: Harvesting relevance benchmarks from wikipedia. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201922). ACM, New York, NY, 3003\u20133012. DOI: 10.1145\/3477495.3531731"},{"key":"e_1_3_3_21_2","first-page":"425","volume-title":"Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval","author":"Eugster Manuel J. A.","year":"2014","unstructured":"Manuel J. A. Eugster, Tuukka Ruotsalo, Michiel M. Spap\u00e9, Ilkka Kosunen, Oswald Barral, Niklas Ravaja, Giulio Jacucci, and Samuel Kaski. 2014. Predicting term-relevance from brain signals. In Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval. ACM, Gold Coast, Queensland, Australia, 425\u2013434. DOI: 10.1145\/2600428.2609594"},{"key":"e_1_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1038\/srep38580"},{"key":"e_1_3_3_23_2","doi-asserted-by":"publisher","DOI":"10.1037\/h0031619"},{"key":"e_1_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1002\/hbm.20571"},{"key":"e_1_3_3_25_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-024-46631-y"},{"key":"e_1_3_3_26_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2013.00267"},{"key":"e_1_3_3_27_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0022-1031(03)00092-1"},{"key":"e_1_3_3_28_2","first-page":"58","volume-title":"Proceedings of the 5th Information Interaction in Context Symposium (IIiX \u201914)","author":"Gwizdka Jacek","year":"2014","unstructured":"Jacek Gwizdka. 2014. Characterizing relevance with eye-tracking measures. In Proceedings of the 5th Information Interaction in Context Symposium (IIiX \u201914). ACM, New York, NY, 58\u201367. DOI: 10.1145\/2637002.2637011"},{"key":"e_1_3_3_29_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23904"},{"key":"e_1_3_3_30_2","doi-asserted-by":"publisher","DOI":"10.3758\/pbr.16.5.850"},{"key":"e_1_3_3_31_2","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1997.9.8.1735"},{"key":"e_1_3_3_32_2","doi-asserted-by":"crossref","first-page":"538","DOI":"10.18653\/v1\/K19-1050","volume-title":"Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL)","author":"Hollenstein Nora","year":"2019","unstructured":"Nora Hollenstein, Antonio de la Torre, Nicolas Langer, and Ce Zhang. 2019. CogniVal: A framework for cognitive word embedding evaluation. In Proceedings of the 23rd Conference on Computational Natural Language Learning (CoNLL). Association for Computational Linguistics, Hong Kong, China, 538\u2013549. DOI: 10.18653\/v1\/K19-1050"},{"key":"e_1_3_3_33_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2021.659410"},{"key":"e_1_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1038\/sdata.2018.291"},{"key":"e_1_3_3_35_2","first-page":"138","volume-title":"Proceedings of the 12th Language Resources and Evaluation Conference","author":"Hollenstein Nora","year":"2020","unstructured":"Nora Hollenstein, Marius Troendle, Ce Zhang, and Nicolas Langer. 2020. ZuCo 2.0: A dataset of physiological recordings during natural reading and annotation. In Proceedings of the 12th Language Resources and Evaluation Conference. European Language Resources Association, Marseille, France, 138\u2013146. Retrieved from https:\/\/aclanthology.org\/2020.lrec-1.18"},{"key":"e_1_3_3_36_2","first-page":"1253","volume-title":"Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM \u201918)","author":"Inel Oana","year":"2018","unstructured":"Oana Inel, Giannis Haralabopoulos, Dan Li, Christophe Van Gysel, Zolt\u00e1n Szl\u00e1vik, Elena Simperl, Kanoulas Evangelos, and Lora Aroyo. 2018. Studying topical relevance with evidence-based crowdsourcing. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management (CIKM \u201918). ACM, New York, NY, 1253\u20131262. DOI: 10.1145\/3269206.3271779"},{"key":"e_1_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24161"},{"key":"e_1_3_3_38_2","first-page":"1006","volume-title":"Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201924)","author":"Ji Kaixin","year":"2024","unstructured":"Kaixin Ji, Danula Hettiachchi, Flora D. Salim, Falk Scholer, and Damiano Spina. 2024. Characterizing information seeking processes with multiple physiological signals. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201924). ACM, New York, NY, 1006\u20131017. DOI: 10.1145\/3626772.3657793"},{"key":"e_1_3_3_39_2","first-page":"154","volume-title":"Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201905)","author":"Joachims Thorsten","year":"2005","unstructured":"Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2005. Accurately interpreting clickthrough data as implicit feedback. In Proceedings of the 28th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201905). ACM, New York, NY, 154\u2013161. DOI: 10.1145\/1076034.1076063"},{"key":"e_1_3_3_40_2","doi-asserted-by":"crossref","first-page":"781","DOI":"10.1145\/3018661.3018699","volume-title":"Proceedings of the 10th ACM International Conference on Web Search and Data Mining (WSDM \u201917)","author":"Joachims Thorsten","year":"2017","unstructured":"Thorsten Joachims, Adith Swaminathan, and Tobias Schnabel. 2017. Unbiased learning-to-rank with biased feedback. In Proceedings of the 10th ACM International Conference on Web Search and Data Mining (WSDM \u201917). ACM, New York, NY, 781\u2013789. DOI: 10.1145\/3018661.3018699"},{"key":"e_1_3_3_41_2","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1145\/3652583.3658119","volume-title":"Proceedings of the 2024 International Conference on Multimedia Retrieval (ICMR \u201924)","author":"Joos Lucas","year":"2024","unstructured":"Lucas Joos, Bastian J\u00e4ckl, Daniel A. Keim, Maximilian T. Fischer, Ladislav Peska, and Jakub Loko\u010d. 2024. Known-item search in video: An eye tracking-based study. In Proceedings of the 2024 International Conference on Multimedia Retrieval (ICMR \u201924). ACM, New York, NY, 311\u2013319. DOI: 10.1145\/3652583.3658119"},{"key":"e_1_3_3_42_2","volume-title":"Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Kangassalo Lauri","year":"2019","unstructured":"Lauri Kangassalo, Michiel Spap\u00e9, Giulio Jacucci, and Tuukka Ruotsalo. 2019. Why do users issue good queries? In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, Paris, France. DOI: 10.1145\/3331184.3331243"},{"key":"e_1_3_3_43_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-63828-5"},{"key":"e_1_3_3_44_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2023.1338738"},{"key":"e_1_3_3_45_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jml.2004.10.002"},{"key":"e_1_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24179"},{"key":"e_1_3_3_47_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-08848-0"},{"key":"e_1_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1002\/brb3.3008"},{"key":"e_1_3_3_49_2","first-page":"3863","volume-title":"Proceedings of the National Academy of Sciences","volume":"103","author":"Kriegeskorte Nikolaus","year":"2006","unstructured":"Nikolaus Kriegeskorte, Rainer Goebel, and Peter Bandettini. 2006. Information-based functional brain mapping. Proceedings of the National Academy of Sciences 103, 10 (Feb. 2006), 3863\u20133868. DOI: 10.1073\/pnas.0600244103"},{"key":"e_1_3_3_50_2","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.093008.131123"},{"key":"e_1_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.7350657"},{"key":"e_1_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.1038\/307161a0"},{"key":"e_1_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3663669"},{"key":"e_1_3_3_54_2","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aace8c"},{"key":"e_1_3_3_55_2","doi-asserted-by":"publisher","DOI":"10.1080\/23273798.2022.2091150"},{"key":"e_1_3_3_56_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2020.2973153"},{"key":"e_1_3_3_57_2","first-page":"849","volume-title":"Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM \u201914)","author":"Liu Yiqun","year":"2014","unstructured":"Yiqun Liu, Chao Wang, Ke Zhou, Jianyun Nie, Min Zhang, and Shaoping Ma. 2014. From skimming to reading: A two-stage examination model for web search. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management (CIKM \u201914). ACM, New York, NY, 849\u2013858. DOI: 10.1145\/2661829.2661907"},{"key":"e_1_3_3_58_2","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2552\/aab2f2"},{"key":"e_1_3_3_59_2","doi-asserted-by":"publisher","DOI":"10.1016\/S1364-6613(00)01545-X"},{"key":"e_1_3_3_60_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10209-021-00826-y"},{"key":"e_1_3_3_61_2","doi-asserted-by":"publisher","DOI":"10.1080\/23273798.2017.1330485"},{"key":"e_1_3_3_62_2","first-page":"610","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201922)","author":"Michalkova Dominika","year":"2022","unstructured":"Dominika Michalkova, Mario Parra-Rodriguez, and Yashar Moshfeghi. 2022. Information need awareness: An EEG study. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201922). ACM, New York, NY, 610\u2013621. DOI: 10.1145\/3477495.3531999"},{"key":"e_1_3_3_63_2","doi-asserted-by":"publisher","DOI":"10.1145\/3611384"},{"key":"e_1_3_3_64_2","unstructured":"Tomas Mikolov Kai Chen Greg Corrado and Jeffrey Dean. 2013. Efficient estimation of word representations in vector space. arXiv:1301.3781. Retrieved from https:\/\/arxiv.org\/abs\/1301.3781"},{"key":"e_1_3_3_65_2","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1007\/978-3-642-36973-5_2","volume-title":"Advances in Information Retrieval","author":"Moshfeghi Yashar","year":"2013","unstructured":"Yashar Moshfeghi, Luisa R. Pinto, Frank E. Pollick, and Joemon M. Jose. 2013. Understanding relevance: An fMRI study. In Advances in Information Retrieval. Pavel Serdyukov, Pavel Braslavski, Sergei O. Kuznetsov, Jaap Kamps, Stefan R\u00fcger, Eugene Agichtein, Ilya Segalovich, and Emine Yilmaz (Eds.), Springer, Berlin, 14\u201325."},{"key":"e_1_3_3_66_2","doi-asserted-by":"crossref","first-page":"1300","DOI":"10.1145\/3308558.3313671","volume-title":"Proceedings of the World Wide Web Conference (WWW \u201919)","author":"Moshfeghi Yashar","year":"2019","unstructured":"Yashar Moshfeghi, Peter Triantafillou, and Frank Pollick. 2019. Towards predicting a realisation of an information need based on brain signals. In Proceedings of the World Wide Web Conference (WWW \u201919). ACM, New York, NY, 1300\u20131309. DOI: 10.1145\/3308558.3313671"},{"key":"e_1_3_3_67_2","first-page":"335","volume-title":"Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201916)","author":"Moshfeghi Yashar","year":"2016","unstructured":"Yashar Moshfeghi, Peter Triantafillou, and Frank E. Pollick. 2016. Understanding information need: An FMRI study. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201916). ACM, New York, NY, 335\u2013344. DOI: 10.1145\/2911451.2911534"},{"key":"e_1_3_3_68_2","volume-title":"Challenges in Magnetoencephalographic Studies of Naturalistic Reading and Speech","author":"M\u00e4kel\u00e4 Sasu","year":"2024","unstructured":"Sasu M\u00e4kel\u00e4. 2024. Challenges in Magnetoencephalographic Studies of Naturalistic Reading and Speech. Doctoral Thesis. Aalto University, Espoo, Finland. Retrieved from https:\/\/aaltodoc.aalto.fi\/items\/d1394262-843f-4365-8bf7-1c6e8fb013a5"},{"key":"e_1_3_3_69_2","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1145\/3643489.3661115","volume-title":"Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge (LSC \u201924)","author":"Nguyen-Ho Thang-Long","year":"2024","unstructured":"Thang-Long Nguyen-Ho, Onanong Kongmeesub, Minh-Triet Tran, Dongyun Nie, Graham Healy, and Cathal Gurrin. 2024. EAGLE: Eyegaze-assisted guidance and learning evaluation for lifelong retrieval. In Proceedings of the 7th Annual ACM Workshop on the Lifelog Search Challenge (LSC \u201924). ACM, New York, NY, 18\u201323. DOI: 10.1145\/3643489.3661115"},{"key":"e_1_3_3_70_2","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS \u201923)","author":"Oota Subba Reddy","year":"2024","unstructured":"Subba Reddy Oota, Manish Gupta, and Mariya Toneva. 2024. Joint processing of linguistic properties in brains and language models. In Proceedings of the 37th International Conference on Neural Information Processing Systems (NIPS \u201923). Curran Associates Inc., Red Hook, NY, Article 790, 14 pages."},{"key":"e_1_3_3_71_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-95467-3_3"},{"key":"e_1_3_3_72_2","first-page":"2825","article-title":"Scikit-learn: Machine learning in Python","volume":"12","author":"Pedregosa Fabian","year":"2011","unstructured":"Fabian Pedregosa, Ga\u00ebl Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, et al. 2011. Scikit-learn: Machine learning in Python. Journal of Machine Learning Research 12 (Oct. 2011), 2825\u20132830.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_3_73_2","volume-title":"Proceedings of the 13th ACM Conference on Recommender Systems","author":"Pei Changhua","year":"2019","unstructured":"Changhua Pei, Yi Zhang, Yongfeng Zhang, Fei Sun, Xiao Lin, Hanxiao Sun, Jian Wu, Peng Jiang, Junfeng Ge, Wenwu Ou, et al. 2019. Personalized re-ranking for recommendation. In Proceedings of the 13th ACM Conference on Recommender Systems. ACM, Copenhagen, Denmark. DOI: 10.1145\/3298689.3347000"},{"key":"e_1_3_3_74_2","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.3115\/v1\/D14-1162","volume-title":"Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP)","author":"Pennington Jeffrey","year":"2014","unstructured":"Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. GloVe: Global vectors for word representation. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, Doha, Qatar, 1532\u20131543. DOI: 10.3115\/v1\/D14-1162"},{"key":"e_1_3_3_75_2","first-page":"299","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201920)","author":"Pinkosova Zuzana","year":"2020","unstructured":"Zuzana Pinkosova, William J. McGeown, and Yashar Moshfeghi. 2020. The cortical activity of graded relevance. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201920). ACM, New York, NY, 299\u2013308. DOI: 10.1145\/3397271.3401106"},{"key":"e_1_3_3_76_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-emnlp.120"},{"key":"e_1_3_3_77_2","first-page":"3982","volume-title":"Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)","author":"Reimers Nils","year":"2019","unstructured":"Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence embeddings using Siamese BERT-Networks. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan (Eds.), Association for Computational Linguistics, Hong Kong, China, 3982\u20133992. DOI: 10.18653\/v1\/D19-1410"},{"key":"e_1_3_3_78_2","volume-title":"Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing","author":"Ren Yuqi","year":"2021","unstructured":"Yuqi Ren and Deyi Xiong. 2021. CogAlign: Learning to align textual neural representations to cognitive language processing signals. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing. Association for Computational Linguistics. DOI: 10.18653\/v1\/2021.acl-long.291"},{"key":"e_1_3_3_79_2","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2024.3391508"},{"key":"e_1_3_3_80_2","first-page":"2443","volume-title":"Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201921)","author":"Srinivasan Krishna","year":"2021","unstructured":"Krishna Srinivasan, Karthik Raman, Jiecao Chen, Michael Bendersky, and Marc Najork. 2021. WIT: Wikipedia-based image text dataset for multimodal multilingual machine learning. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201921). ACM, New York, NY, 2443\u20132449. DOI: 10.1145\/3404835.3463257"},{"key":"e_1_3_3_81_2","volume-title":"Proceedings of the 37th International Conference on Neural Information Processing (NIPS \u201923)","author":"Tang Jerry","year":"2024","unstructured":"Jerry Tang, Meng Du, Vy. A. Vo, Vasudev Lal, and Alexander G. Huth. 2024. Brain encoding models based on multimodal transformers can transfer across language and vision. In Proceedings of the 37th International Conference on Neural Information Processing (NIPS \u201923). Curran Associates Inc., Red Hook, NY, Article 1290, 13 pages."},{"key":"e_1_3_3_82_2","doi-asserted-by":"publisher","DOI":"10.1038\/s41593-023-01304-9"},{"key":"e_1_3_3_83_2","first-page":"6000","volume-title":"Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS \u201917)","author":"Vaswani Ashish","year":"2017","unstructured":"Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, \u0141ukasz Kaiser, and Illia Polosukhin. 2017. Attention is all you need. In Proceedings of the 31st International Conference on Neural Information Processing Systems (NIPS \u201917). Curran Associates Inc., Red Hook, NY, 6000\u20136010."},{"key":"e_1_3_3_84_2","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2023.1122941"},{"key":"e_1_3_3_85_2","doi-asserted-by":"publisher","unstructured":"Lijuan Wang Steven Frisson Yali Pan and Ole Jensen. 2024. Fast hierarchical processing of orthographic and semantic parafoveal information during natural reading. BioRxiv: 2024.09.27.615440. Retrieved from 10.1101\/2024.09.27.615440","DOI":"10.1101\/2024.09.27.615440"},{"key":"e_1_3_3_86_2","first-page":"881","volume-title":"Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201917)","author":"White Ryen W.","year":"2017","unstructured":"Ryen W. White and Ryan Ma. 2017. Improving search engines via large-scale physiological sensing. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201917). ACM, New York, NY, 881\u2013884. DOI: 10.1145\/3077136.3080669"},{"key":"e_1_3_3_87_2","volume-title":"Proceedings of the 14th ACM Conference on Recommender Systems","author":"Wu Liwei","year":"2020","unstructured":"Liwei Wu, Shuqing Li, Cho-Jui Hsieh, and James Sharpnack. 2020. SSE-PT: Sequential recommendation via personalized transformer. In Proceedings of the 14th ACM Conference on Recommender Systems. ACM, Brazil. DOI: 10.1145\/3383313.3412258"},{"issue":"1","key":"e_1_3_3_88_2","article-title":"An evidence perspective on topical relevance types and its implications for exploratory and task-based retrieval","volume":"12","author":"Xiaoli Huang","year":"2006","unstructured":"Huang Xiaoli and Soergel Dagobert. 2006. An evidence perspective on topical relevance types and its implications for exploratory and task-based retrieval. Information Research 12, 1 (2006), 15 pages. Retrieved from https:\/\/informationr.net\/ir\/12-1\/paper281.html","journal-title":"Information Research"},{"key":"e_1_3_3_89_2","volume-title":"Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM","author":"Yao Jing","year":"2020","unstructured":"Jing Yao, Zhicheng Dou, and Ji-Rong Wen. 2020. Employing personal word embeddings for personalized search. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, China. DOI: 10.1145\/3397271.3401153"},{"key":"e_1_3_3_90_2","doi-asserted-by":"publisher","DOI":"10.1145\/3637874"},{"key":"e_1_3_3_91_2","first-page":"380","volume-title":"Proceedings of the ACM Web Conference 2022 (WWW \u201922)","author":"Ye Ziyi","year":"2022","unstructured":"Ziyi Ye, Xiaohui Xie, Yiqun Liu, Zhihong Wang, Xuesong Chen, Min Zhang, and Shaoping Ma. 2022. Towards a better understanding of human reading comprehension with brain signals. In Proceedings of the ACM Web Conference 2022 (WWW \u201922). ACM, New York, NY, 380\u2013391. DOI: 10.1145\/3485447.3511966"},{"key":"e_1_3_3_92_2","first-page":"633","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201922)","author":"Ye Ziyi","year":"2022","unstructured":"Ziyi Ye, Xiaohui Xie, Yiqun Liu, Zhihong Wang, Xuancheng Li, Jiaji Li, Xuesong Chen, Min Zhang, and Shaoping Ma. 2022. Why don\u2019t you click: Understanding non-click results in web search with brain signals. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR \u201922). ACM, New York, NY, 633\u2013645. DOI: 10.1145\/3477495.3532082"},{"key":"e_1_3_3_93_2","first-page":"7561","volume-title":"Proceedings of the 32nd ACM International Conference on Multimedia (MM \u201924)","author":"Ye Ziyi","year":"2024","unstructured":"Ziyi Ye, Jingtao Zhan, Qingyao Ai, Yiqun Liu, Maarten de Rijke, Christina Lioma, and Tuukka Ruotsalo. 2024. Query augmentation with brain signals. In Proceedings of the 32nd ACM International Conference on Multimedia (MM \u201924). ACM, New York, NY, 7561\u20137570. DOI: 10.1145\/3664647.3681658"},{"key":"e_1_3_3_94_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainres.2007.01.030"},{"key":"e_1_3_3_95_2","doi-asserted-by":"publisher","DOI":"10.1088\/1741-2560\/8\/2\/025005"},{"key":"e_1_3_3_96_2","doi-asserted-by":"publisher","DOI":"10.1145\/2795403.2795405"},{"key":"e_1_3_3_97_2","first-page":"227","volume-title":"Proceedings of the 13th International Conference on Human-Computer Interaction (INTERACT \u201921)","author":"Zhang Yuhao","year":"2021","unstructured":"Yuhao Zhang, Md Zakir Hossain, and Shafin Rahman. 2021. DeepVANet: A deep end-to-end network for multi-modal emotion recognition. In Proceedings of the 13th International Conference on Human-Computer Interaction (INTERACT \u201921). Springer-Verlag, Berlin, 227\u2013237. DOI: 10.1007\/978-3-030-85613-7_16"},{"key":"e_1_3_3_98_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2024.112094"},{"key":"e_1_3_3_99_2","first-page":"3822","volume-title":"Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies","author":"Zhao Xinpei","year":"2024","unstructured":"Xinpei Zhao, Jingyuan Sun, Shaonan Wang, Jing Ye, Xiaohan Zhang, and Chengqing Zong. 2024. MapGuide: A simple yet effective method to reconstruct continuous language from brain activities. In Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1: Long Papers. Kevin Duh, Helena Gomez, and Steven Bethard (Eds.), Association for Computational Linguistics, Mexico City, Mexico, 3822\u20133832. DOI: 10.18653\/v1\/2024.naacl-long.211"}],"container-title":["ACM Transactions on Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3766067","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,14]],"date-time":"2025-11-14T14:11:25Z","timestamp":1763129485000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3766067"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,14]]},"references-count":98,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,31]]}},"alternative-id":["10.1145\/3766067"],"URL":"https:\/\/doi.org\/10.1145\/3766067","relation":{},"ISSN":["1046-8188","1558-2868"],"issn-type":[{"value":"1046-8188","type":"print"},{"value":"1558-2868","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,14]]},"assertion":[{"value":"2024-09-23","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-08-20","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-11-14","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}