{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:26:43Z","timestamp":1760146003395,"version":"build-2065373602"},"reference-count":45,"publisher":"Association for Computing Machinery (ACM)","issue":"1","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGIR Forum"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:p>\n            This event report presents an overview of a series of tutorials conducted at CHIIR 2024, SIGIR 2024, and SIGIR-AP 2024, all centered around the emerging, socially significant theme of\n            <jats:italic toggle=\"yes\">cognitive biases<\/jats:italic>\n            in Interactive Information Retrieval (IIR) and Generative IR (GenIR). Each tutorial focused on a critical aspect of this growing research area, offering attendees a combination of theoretical foundations from psychology and behavioral economics, empirical studies, hands-on methodological discussions, and forward-looking design exercises in IIR and GenIR applications. As IR systems increasingly integrate generative and conversational interfaces, understanding the interplay between human cognitive biases and AI-driven information environments becomes not only essential for advancing theory but also vital for designing responsible and user-centered search and chat systems. These tutorials provided participants with analytical tools, practical frameworks, and collaborative opportunities to rethink ranking and evaluation, user modeling, and system design through the lens of cognitive psychology and behavioral economics. The strong engagement across all three SIGIR venues signals a growing momentum toward bias-aware, human-centric IR research.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Date:<\/jats:bold>\n            March\u2013December 2025.\n          <\/jats:p>\n          <jats:p>\n            <jats:bold>Website:<\/jats:bold>\n            https:\/\/beiir.github.io\/.\n          <\/jats:p>","DOI":"10.1145\/3769733.3769736","type":"journal-article","created":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:04:53Z","timestamp":1760112293000},"page":"1-13","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Report on the CHIIR 2024, SIGIR 2024, and SIGIR-AP 2024 tutorials on Characterizing, Evaluating, and Mitigating Cognitive Biases in Interactive and Generative IR"],"prefix":"10.1145","volume":"59","author":[{"given":"Jiqun","family":"Liu","sequence":"first","affiliation":[{"name":"The University of Oklahoma, Norman, OK, USA"}]},{"given":"Leif","family":"Azzopardi","sequence":"additional","affiliation":[{"name":"University of Strathclyde, Glasgow, Scotland"}]}],"member":"320","published-online":{"date-parts":[[2025,10,10]]},"reference":[{"key":"e_1_2_1_1_1","first-page":"1207","volume-title":"Proceedings of the 17th ACM Conference on Recommender Systems","author":"Acharya Arkadeep","year":"2023","unstructured":"Arkadeep Acharya, Brijraj Singh, and Naoyuki Onoe. Llm based generation of item-description for recommendation system. In Proceedings of the 17th ACM Conference on Recommender Systems, pages 1204\u20131207, 2023."},{"key":"e_1_2_1_2_1","volume-title":"Bounded rationality and satisficing in young people's web-based decision making. Journal of the American society for Information Science and Technology, 53(1):16\u201327","author":"Agosto Denise E","year":"2002","unstructured":"Denise E Agosto. Bounded rationality and satisficing in young people's web-based decision making. Journal of the American society for Information Science and Technology, 53(1):16\u201327, 2002."},{"key":"e_1_2_1_3_1","first-page":"37","volume-title":"Proceedings of the 2021 ACM SIGIR Conference on Human Information Interaction and Retrieval","author":"Azzopardi Leif","year":"2021","unstructured":"Leif Azzopardi. Cognitive biases in search: a review and reflection of cognitive biases in information retrieval. In Proceedings of the 2021 ACM SIGIR Conference on Human Information Interaction and Retrieval, pages 27\u201337, 2021."},{"key":"e_1_2_1_4_1","first-page":"290","volume-title":"Proceedings of the 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region","author":"Azzopardi Leif","year":"2024","unstructured":"Leif Azzopardi and Jiqun Liu. Evaluating cognitive biases in conversational and generative iir: A tutorial. In Proceedings of the 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, pages 287\u2013290, 2024a."},{"key":"e_1_2_1_5_1","first-page":"430","volume-title":"Proceedings of the 2024 ACM SIGIR Conference on Human Information Interaction and Retrieval","author":"Azzopardi Leif","year":"2024","unstructured":"Leif Azzopardi and Jiqun Liu. Search under uncertainty: Cognitive biases and heuristics-tutorial on modeling search interaction using behavioral economics. In Proceedings of the 2024 ACM SIGIR Conference on Human Information Interaction and Retrieval, pages 427\u2013430, 2024b."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3442188.3445922"},{"key":"e_1_2_1_7_1","doi-asserted-by":"crossref","unstructured":"Nattapat Boonprakong Gaole He Ujwal Gadiraju Niels Van Berkel Danding Wang Si Chen Jiqun Liu Benjamin Tag Jorge Goncalves and Tilman Dingler. Workshop on understanding and mitigating cognitive biases in human-ai collaboration. In Companion Publication of the 2023 ACM SIGCHI Conference on Computer Supported Cooperative Work and Social Computing pages 512\u2013517 2023.","DOI":"10.1145\/3584931.3611284"},{"key":"e_1_2_1_8_1","first-page":"979","volume-title":"Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing","author":"Boonprakong Nattapat","year":"2024","unstructured":"Nattapat Boonprakong, Kaixin Ji, Ziyi Ye, Benjamin Tag, Damiano Spina, Tuukka Ruotsalo, and Flora D Salim. Advancing physiological methods for human-information interaction. In Companion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing, pages 976\u2013979, 2024."},{"key":"e_1_2_1_9_1","first-page":"3405","volume-title":"Proceedings of the ACM web conference 2023","author":"Chen Nuo","year":"2023","unstructured":"Nuo Chen, Jiqun Liu, and Tetsuya Sakai. A reference-dependent model for web search evaluation: Understanding and measuring the experience of boundedly rational users. In Proceedings of the ACM web conference 2023, pages 3396\u20133405, 2023."},{"key":"e_1_2_1_10_1","first-page":"63","volume-title":"Proceedings of the 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region","author":"Chen Nuo","year":"2024","unstructured":"Nuo Chen, Jiqun Liu, Xiaoyu Dong, Qijiong Liu, Tetsuya Sakai, and Xiao-Ming Wu. Ai can be cognitively biased: An exploratory study on threshold priming in llm-based batch relevance assessment. In Proceedings of the 2024 Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region, pages 54\u201363, 2024."},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3708884"},{"key":"e_1_2_1_12_1","first-page":"24","volume-title":"Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval","author":"Chen Ye","year":"2017","unstructured":"Ye Chen, Ke Zhou, Yiqun Liu, Min Zhang, and Shaoping Ma. Meta-evaluation of online and offline web search evaluation metrics. In Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pages 15\u201324, 2017."},{"key":"e_1_2_1_13_1","first-page":"6","volume-title":"Andreas Dengel. Workshop on detection and design for cognitive biases in people and computing systems. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems","author":"Dingler Tilman","year":"2020","unstructured":"Tilman Dingler, Benjamin Tag, Evangelos Karapanos, Koichi Kise, and Andreas Dengel. Workshop on detection and design for cognitive biases in people and computing systems. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, pages 1\u20136, 2020."},{"key":"e_1_2_1_14_1","first-page":"305","volume-title":"Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval","author":"Draws Tim","year":"2021","unstructured":"Tim Draws, Nava Tintarev, Ujwal Gadiraju, Alessandro Bozzon, and Benjamin Timmermans. This is not what we ordered: Exploring why biased search result rankings affect user attitudes on debated topics. In Proceedings of the 44th international ACM SIGIR conference on research and development in information retrieval, pages 295\u2013305, 2021."},{"key":"e_1_2_1_15_1","first-page":"134","volume-title":"Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval","author":"Edwards Ashlee","year":"2017","unstructured":"Ashlee Edwards and Diane Kelly. Engaged or frustrated? disambiguating emotional state in search. In Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pages 125\u2013134, 2017."},{"key":"e_1_2_1_16_1","first-page":"170","volume-title":"Proceedings of the eleventh ACM international conference on web search and data mining","author":"Eickhoff Carsten","year":"2018","unstructured":"Carsten Eickhoff. Cognitive biases in crowdsourcing. In Proceedings of the eleventh ACM international conference on web search and data mining, pages 162\u2013170, 2018."},{"key":"e_1_2_1_17_1","first-page":"806","volume-title":"Proceedings of the 27th International Conference on Intelligent User Interfaces","author":"Gajos Krzysztof Z","year":"2022","unstructured":"Krzysztof Z Gajos and Lena Mamykina. Do people engage cognitively with ai? impact of ai assistance on incidental learning. In Proceedings of the 27th International Conference on Intelligent User Interfaces, pages 794\u2013806, 2022."},{"key":"e_1_2_1_18_1","volume-title":"Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997, 2","author":"Gao Yunfan","year":"2023","unstructured":"Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, Haofen Wang, and Haofen Wang. Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997, 2, 2023."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.24161"},{"key":"e_1_2_1_20_1","first-page":"10","volume-title":"Adjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction","author":"Ji Kaixin","year":"2024","unstructured":"Kaixin Ji, Sachin Pathiyan Cherumanal, Johanne R Trippas, Danula Hettiachchi, Flora D Salim, Falk Scholer, and Damiano Spina. Towards detecting and mitigating cognitive bias in spoken conversational search. In Adjunct Proceedings of the 26th International Conference on Mobile Human-Computer Interaction, pages 1\u201310, 2024."},{"key":"e_1_2_1_21_1","volume-title":"Maps of bounded rationality: Psychology for behavioral economics. American economic review, 93(5):1449\u20131475","author":"Kahneman Daniel","year":"2003","unstructured":"Daniel Kahneman. Maps of bounded rationality: Psychology for behavioral economics. American economic review, 93(5):1449\u20131475, 2003."},{"key":"e_1_2_1_22_1","volume-title":"Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in neural information processing systems, 33:9459\u20139474","author":"Lewis Patrick","year":"2020","unstructured":"Patrick Lewis, Ethan Perez, Aleksandra Piktus, Fabio Petroni, Vladimir Karpukhin, Naman Goyal, Heinrich K\u00fcttler, Mike Lewis, Wen-tau Yih, Tim Rockt\u00e4schel, et al. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in neural information processing systems, 33:9459\u20139474, 2020."},{"key":"e_1_2_1_23_1","volume-title":"Large language models for generative recommendation: A survey and visionary discussions. arXiv preprint arXiv:2309.01157","author":"Li Lei","year":"2023","unstructured":"Lei Li, Yongfeng Zhang, Dugang Liu, and Li Chen. Large language models for generative recommendation: A survey and visionary discussions. arXiv preprint arXiv:2309.01157, 2023."},{"key":"e_1_2_1_24_1","volume-title":"A behavioral economics approach to interactive information retrieval. The Information Retrieval Series, 48","author":"Liu Jiqun","year":"2023","unstructured":"Jiqun Liu. A behavioral economics approach to interactive information retrieval. The Information Retrieval Series, 48, 2023a."},{"key":"e_1_2_1_25_1","first-page":"246","volume-title":"Proceedings of the 2023 ACM SIGIR Conference on Human Information Interaction and Retrieval","author":"Liu Jiqun","year":"2023","unstructured":"Jiqun Liu. Toward a two-sided fairness framework in search and recommendation. In Proceedings of the 2023 ACM SIGIR Conference on Human Information Interaction and Retrieval, pages 236\u2013246, 2023b."},{"key":"e_1_2_1_26_1","first-page":"3016","volume-title":"Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Liu Jiqun","year":"2024","unstructured":"Jiqun Liu and Leif Azzopardi. Search under uncertainty: Cognitive biases and heuristics: a tutorial on testing, mitigating and accounting for cognitive biases in search experiments. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 3013\u20133016, 2024."},{"key":"e_1_2_1_27_1","first-page":"1150","volume-title":"Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval","author":"Liu Jiqun","year":"2020","unstructured":"Jiqun Liu and Fangyuan Han. Investigating reference dependence effects on user search interaction and satisfaction: A behavioral economics perspective. In Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval, pages 1141\u20131150, 2020."},{"key":"e_1_2_1_28_1","first-page":"167","volume-title":"Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval","author":"Liu Jiqun","year":"2025","unstructured":"Jiqun Liu and Jiangen He. Boundedly rational searchers interacting with medical misinformation: Characterizing context-dependent decoy effects on credibility and usefulness evaluation in sessions. In Proceedings of the 2025 ACM SIGIR Conference on Human Information Interaction and Retrieval, pages 154\u2013167, 2025."},{"key":"e_1_2_1_29_1","volume-title":"Trapped by expectations: Functional fixedness in llm-enabled chat search. arXiv preprint arXiv:2504.02074","author":"Liu Jiqun","year":"2025","unstructured":"Jiqun Liu, Jamshed Karimnazarov, and Ryen W White. Trapped by expectations: Functional fixedness in llm-enabled chat search. arXiv preprint arXiv:2504.02074, 2025."},{"key":"e_1_2_1_30_1","volume-title":"Cognitive biases in large language models for news recommendation. arXiv preprint arXiv:2410.02897","author":"Lyu Yougang","year":"2024","unstructured":"Yougang Lyu, Xiaoyu Zhang, Zhaochun Ren, and Maarten de Rijke. Cognitive biases in large language models for news recommendation. arXiv preprint arXiv:2410.02897, 2024."},{"key":"e_1_2_1_31_1","first-page":"54","volume-title":"proceedings of the seventeenth Australasian document computing symposium","author":"Moffat Alistair","year":"2012","unstructured":"Alistair Moffat, Falk Scholer, and Paul Thomas. Models and metrics: Ir evaluation as a user process. In proceedings of the seventeenth Australasian document computing symposium, pages 47\u201354, 2012."},{"key":"e_1_2_1_32_1","first-page":"70","volume-title":"Proceedings of the 2016 acm on conference on human information interaction and retrieval","author":"Mostafa Javed","year":"2016","unstructured":"Javed Mostafa and Jacek Gwizdka. Deepening the role of the user: Neuro-physiological evidence as a basis for studying and improving search. In Proceedings of the 2016 acm on conference on human information interaction and retrieval, pages 63\u201370, 2016."},{"key":"e_1_2_1_33_1","first-page":"199","volume-title":"Proceedings of the 32nd ACM conference on hypertext and social media","author":"Rieger Alisa","year":"2021","unstructured":"Alisa Rieger, Tim Draws, Mari\u00ebt Theune, and Nava Tintarev. This item might reinforce your opinion: Obfuscation and labeling of search results to mitigate confirmation bias. In Proceedings of the 32nd ACM conference on hypertext and social media, pages 189\u2013199, 2021."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3635034"},{"key":"e_1_2_1_35_1","volume-title":"Behavioral economics: Past, present, and future. American economic review, 106(7):1577\u20131600","author":"Thaler Richard H","year":"2016","unstructured":"Richard H Thaler. Behavioral economics: Past, present, and future. American economic review, 106(7):1577\u20131600, 2016."},{"key":"e_1_2_1_36_1","volume-title":"Judgment under uncertainty: Heuristics and biases: Biases in judgments reveal some heuristics of thinking under uncertainty. science, 185(4157):1124\u20131131","author":"Tversky Amos","year":"1974","unstructured":"Amos Tversky and Daniel Kahneman. Judgment under uncertainty: Heuristics and biases: Biases in judgments reveal some heuristics of thinking under uncertainty. science, 185(4157):1124\u20131131, 1974."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00122574"},{"key":"e_1_2_1_38_1","first-page":"237","volume-title":"Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval","author":"Wang Ben","year":"2024","unstructured":"Ben Wang and Jiqun Liu. Cognitively biased users interacting with algorithmically biased results in whole-session search on debated topics. In Proceedings of the 2024 ACM SIGIR International Conference on Theory of Information Retrieval, pages 227\u2013237, 2024a."},{"issue":"9","key":"e_1_2_1_39_1","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1002\/asi.24935","article-title":"dynamic perceptions of search gain and cost in sessions: An expectation confirmation model","volume":"75","author":"Wang Ben","year":"2024","unstructured":"Ben Wang and Jiqun Liu. Understanding users' dynamic perceptions of search gain and cost in sessions: An expectation confirmation model. Journal of the Association for Information Science and Technology, 75(9):937\u2013956, 2024b.","journal-title":"Journal of the Association for Information Science and Technology"},{"key":"e_1_2_1_40_1","first-page":"12","volume-title":"Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval","author":"White Ryen","year":"2013","unstructured":"Ryen White. Beliefs and biases in web search. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval, pages 3\u201312, 2013."},{"key":"e_1_2_1_41_1","first-page":"596","volume-title":"World Conference on Explainable Artificial Intelligence","author":"Wu Zhangyi","unstructured":"Zhangyi Wu, Tim Draws, Federico Cau, Francesco Barile, Alisa Rieger, and Nava Tintarev. Explaining search result stances to opinionated people. In World Conference on Explainable Artificial Intelligence, pages 573\u2013596. Springer, 2023."},{"key":"e_1_2_1_42_1","first-page":"65","volume-title":"Proceedings of the 1st International Workshop on Brain-Computer Interfaces (BCI) for Multimedia Understanding","author":"Ye Ziyi","year":"2024","unstructured":"Ziyi Ye, Qingyao Ai, and Yiqun Liu. Brain-computer interface meets information retrieval: Perspective on next-generation information system. In Proceedings of the 1st International Workshop on Brain-Computer Interfaces (BCI) for Multimedia Understanding, pages 61\u201365, 2024."},{"key":"e_1_2_1_43_1","first-page":"2538","volume-title":"Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval","author":"Zerveas George","year":"2022","unstructured":"George Zerveas, Navid Rekabsaz, Daniel Cohen, and Carsten Eickhoff. Mitigating bias in search results through contextual document reranking and neutrality regularization. In Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 2532\u20132538, 2022."},{"key":"e_1_2_1_44_1","first-page":"17196","volume-title":"Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing","author":"Zhou Hanyu","year":"2024","unstructured":"Hanyu Zhou, Sreya Muppalla, Zeynep Yildiz, Miryung Kim, Amit Sahai, Nanyun Peng, et al. Measuring psychological depth in language models. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 17162\u201317196, 2024."},{"key":"e_1_2_1_45_1","volume-title":"Large language models for information retrieval: A survey. arXiv preprint arXiv:2308.07107","author":"Zhu Yutao","year":"2023","unstructured":"Yutao Zhu, Huaying Yuan, Shuting Wang, Jiongnan Liu, Wenhan Liu, Chenlong Deng, Haonan Chen, Zheng Liu, Zhicheng Dou, and Ji-Rong Wen. Large language models for information retrieval: A survey. arXiv preprint arXiv:2308.07107, 2023."}],"container-title":["ACM SIGIR Forum"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3769733.3769736","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:05:23Z","timestamp":1760112323000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3769733.3769736"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6]]},"references-count":45,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["10.1145\/3769733.3769736"],"URL":"https:\/\/doi.org\/10.1145\/3769733.3769736","relation":{},"ISSN":["0163-5840"],"issn-type":[{"value":"0163-5840","type":"print"}],"subject":[],"published":{"date-parts":[[2025,6]]},"assertion":[{"value":"2025-10-10","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}