{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,21]],"date-time":"2026-07-21T23:16:48Z","timestamp":1784675808944,"version":"3.55.0"},"publisher-location":"New York, NY, USA","reference-count":52,"publisher":"ACM","license":[{"start":{"date-parts":[[2025,4,25]],"date-time":"2025-04-25T00:00:00Z","timestamp":1745539200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,4,26]]},"DOI":"10.1145\/3706598.3714082","type":"proceedings-article","created":{"date-parts":[[2025,4,24]],"date-time":"2025-04-24T03:30:09Z","timestamp":1745465409000},"page":"1-15","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["Effects of LLM-based Search on Decision Making: Speed, Accuracy, and Overreliance"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9057-6924","authenticated-orcid":false,"given":"Sofia Eleni","family":"Spatharioti","sequence":"first","affiliation":[{"name":"Microsoft Research, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7792-1989","authenticated-orcid":false,"given":"David","family":"Rothschild","sequence":"additional","affiliation":[{"name":"Microsoft Research, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0970-5598","authenticated-orcid":false,"given":"Daniel G","family":"Goldstein","sequence":"additional","affiliation":[{"name":"Microsoft Research, New York, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9364-9604","authenticated-orcid":false,"given":"Jake M","family":"Hofman","sequence":"additional","affiliation":[{"name":"Microsoft Research, NYC, New York, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,4,25]]},"reference":[{"key":"e_1_3_3_3_2_2","doi-asserted-by":"crossref","unstructured":"Eugene Agichtein Steve Lawrence and Luis Gravano. 2004. Learning to find answers to questions on the web. ACM Transactions on Internet Technology (TOIT) 4 2 (2004) 129\u2013162.","DOI":"10.1145\/990301.990303"},{"key":"e_1_3_3_3_3_2","doi-asserted-by":"crossref","unstructured":"Marcia\u00a0J Bates. 1989. The design of browsing and berrypicking techniques for the online search interface. Online review 13 5 (1989) 407\u2013424. Publisher: MCB UP Ltd.","DOI":"10.1108\/eb024320"},{"key":"e_1_3_3_3_4_2","doi-asserted-by":"publisher","unstructured":"Michael Bendersky and W.\u00a0Bruce Croft. 2008. Discovering key concepts in verbose queries(SIGIR \u201908). Association for Computing Machinery New York NY USA 491\u2013498. 10.1145\/1390334.1390419","DOI":"10.1145\/1390334.1390419"},{"key":"e_1_3_3_3_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2348283.2348312"},{"key":"e_1_3_3_3_6_2","unstructured":"Sergey Brin. 1998. The PageRank citation ranking: bringing order to the web. Proceedings of ASIS 1998 98 (1998) 161\u2013172."},{"key":"e_1_3_3_3_7_2","doi-asserted-by":"crossref","unstructured":"Bart\u00a0J Bronnenberg Jun\u00a0B Kim and Carl\u00a0F Mela. 2016. Zooming in on choice: How do consumers search for cameras online? Marketing Science 35 5 (2016) 693\u2013712.","DOI":"10.1287\/mksc.2016.0977"},{"key":"e_1_3_3_3_8_2","doi-asserted-by":"publisher","DOI":"10.3386\/w31161"},{"key":"e_1_3_3_3_9_2","doi-asserted-by":"crossref","unstructured":"Zana Bu\u00e7inca Maja\u00a0Barbara Malaya and Krzysztof\u00a0Z Gajos. 2021. To trust or to think: cognitive forcing functions can reduce overreliance on AI in AI-assisted decision-making. Proceedings of the ACM on Human-Computer Interaction 5 CSCW1 (2021) 1\u201321.","DOI":"10.1145\/3449287"},{"key":"e_1_3_3_3_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641904"},{"key":"e_1_3_3_3_11_2","doi-asserted-by":"publisher","DOI":"10.1145\/1963405.1963413"},{"key":"e_1_3_3_3_12_2","doi-asserted-by":"crossref","unstructured":"Fabrizio Dell\u2019Acqua Edward McFowland Ethan\u00a0R Mollick Hila Lifshitz-Assaf Katherine Kellogg Saran Rajendran Lisa Krayer Fran\u00e7ois Candelon and Karim\u00a0R Lakhani. 2023. Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of AI on Knowledge Worker Productivity and Quality. Harvard Business School Technology & Operations Mgt. Unit Working Paper24-013 (2023).","DOI":"10.2139\/ssrn.4573321"},{"key":"e_1_3_3_3_13_2","doi-asserted-by":"publisher","DOI":"10.1145\/365024.365116"},{"key":"e_1_3_3_3_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/371920.372094"},{"key":"e_1_3_3_3_15_2","doi-asserted-by":"crossref","unstructured":"Simon G\u00e4chter Esther Kaiser and Manfred K\u00f6nigstein. 2024. Incentive contracts crowd out voluntary cooperation: Evidence from gift-exchange experiments. (2024).","DOI":"10.2139\/ssrn.4769909"},{"key":"e_1_3_3_3_16_2","doi-asserted-by":"crossref","unstructured":"Manish Gupta and Michael Bendersky. 2015. Information Retrieval with Verbose Queries(SIGIR \u201915). Association for Computing Machinery New York NY USA 1121\u20131124.","DOI":"10.1145\/2766462.2767877"},{"key":"e_1_3_3_3_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/2661829.2661912"},{"key":"e_1_3_3_3_18_2","doi-asserted-by":"crossref","unstructured":"Bernard\u00a0J Jansen Amanda Spink and Tefko Saracevic. 2000. Real life real users and real needs: a study and analysis of user queries on the web. Information Processing & Management 36 2 (2000) 207\u2013227.","DOI":"10.1016\/S0306-4573(99)00056-4"},{"key":"e_1_3_3_3_19_2","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609633"},{"key":"e_1_3_3_3_20_2","unstructured":"Saurav Kadavath Tom Conerly Amanda Askell Tom Henighan Dawn Drain Ethan Perez Nicholas Schiefer Zac Hatfield-Dodds Nova DasSarma Eli Tran-Johnson and others. 2022. Language models (mostly) know what they know. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2207.05221 (2022)."},{"key":"e_1_3_3_3_21_2","doi-asserted-by":"crossref","unstructured":"Jun\u00a0B Kim Paulo Albuquerque and Bart\u00a0J Bronnenberg. 2011. Mapping online consumer search. Journal of Marketing Research 48 1 (2011) 13\u201327.","DOI":"10.1509\/jmkr.48.1.13"},{"key":"e_1_3_3_3_22_2","doi-asserted-by":"publisher","DOI":"10.1145\/3630106.3658941"},{"key":"e_1_3_3_3_23_2","unstructured":"Steve Lawrence. 2000. Context in Web Search. IEEE Data Engineering Bulletin 23 3 (2000) 25\u201332."},{"key":"e_1_3_3_3_24_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642428"},{"key":"e_1_3_3_3_25_2","unstructured":"Patrick Lewis Ethan Perez Aleksandra Piktus Fabio Petroni Vladimir Karpukhin Naman Goyal Heinrich K\u00fcttler Mike Lewis Wen-tau Yih Tim Rockt\u00e4schel et\u00a0al. 2020. Retrieval-augmented generation for knowledge-intensive nlp tasks. Advances in Neural Information Processing Systems 33 (2020) 9459\u20139474."},{"key":"e_1_3_3_3_26_2","unstructured":"Stephanie Lin Jacob Hilton and Owain Evans. 2022. Teaching Models to Express Their Uncertainty in Words. Transactions on Machine Learning Research (2022). https:\/\/openreview.net\/forum?id=8s8K2UZGTZ"},{"key":"e_1_3_3_3_27_2","doi-asserted-by":"crossref","unstructured":"Jiqun Liu. 2021. Deconstructing search tasks in interactive information retrieval: A systematic review of task dimensions and predictors. Information Processing & Management 58 3 (2021) 102522. Publisher: Elsevier.","DOI":"10.1016\/j.ipm.2021.102522"},{"key":"e_1_3_3_3_28_2","doi-asserted-by":"crossref","unstructured":"Jia Liu and Olivier Toubia. 2018. A semantic approach for estimating consumer content preferences from online search queries. Marketing Science 37 6 (2018) 930\u2013952.","DOI":"10.1287\/mksc.2018.1112"},{"key":"e_1_3_3_3_29_2","doi-asserted-by":"crossref","unstructured":"Jia Liu and Olivier Toubia. 2020. Search query formation by strategic consumers. Quantitative Marketing and Economics 18 (2020) 155\u2013194.","DOI":"10.1007\/s11129-019-09217-3"},{"key":"e_1_3_3_3_30_2","doi-asserted-by":"crossref","unstructured":"Jia Liu Olivier Toubia and Shawndra Hill. 2021. Content-based model of web search behavior: An application to TV show search. Management Science 67 10 (2021) 6378\u20136398.","DOI":"10.1287\/mnsc.2020.3827"},{"key":"e_1_3_3_3_31_2","unstructured":"Nelson\u00a0F Liu Tianyi Zhang and Percy Liang. 2023. Evaluating verifiability in generative search engines. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2304.09848 (2023)."},{"key":"e_1_3_3_3_32_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445562"},{"key":"e_1_3_3_3_33_2","doi-asserted-by":"crossref","unstructured":"Joshua Maynez Shashi Narayan Bernd Bohnet and Ryan McDonald. 2020. On faithfulness and factuality in abstractive summarization. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2005.00661 (2020).","DOI":"10.18653\/v1\/2020.acl-main.173"},{"key":"e_1_3_3_3_34_2","doi-asserted-by":"publisher","DOI":"10.1145\/2600428.2609508"},{"key":"e_1_3_3_3_35_2","doi-asserted-by":"publisher","DOI":"10.1145\/3397481.3450639"},{"key":"e_1_3_3_3_36_2","doi-asserted-by":"crossref","unstructured":"Shakked Noy and Whitney Zhang. 2023. Experimental evidence on the productivity effects of generative artificial intelligence. Science 381 6654 (2023) 187\u2013192.","DOI":"10.1126\/science.adh2586"},{"key":"e_1_3_3_3_37_2","doi-asserted-by":"publisher","DOI":"10.1145\/2806416.2806488"},{"key":"e_1_3_3_3_38_2","unstructured":"OpenAI. 2023. GPT-4 Technical Report. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2303.08774 (2023)."},{"key":"e_1_3_3_3_39_2","volume-title":"Appropriate reliance on Generative AI: Research synthesis","author":"Passi Samir","year":"2024","unstructured":"Samir Passi, Shipi Dhanorkar, and Mihaela Vorvoreanu. 2024. Appropriate reliance on Generative AI: Research synthesis. Technical Report MSR-TR-2024-7. Microsoft. https:\/\/www.microsoft.com\/en-us\/research\/publication\/appropriate-reliance-on-generative-ai-research-synthesis\/"},{"key":"e_1_3_3_3_40_2","volume-title":"Overreliance on AI: Literature Review","author":"Passi Samir","year":"2022","unstructured":"Samir Passi and Mihaela Vorvoreanu. 2022. Overreliance on AI: Literature Review. Technical Report MSR-TR-2022-12. Microsoft. https:\/\/www.microsoft.com\/en-us\/research\/publication\/overreliance-on-ai-literature-review\/"},{"key":"e_1_3_3_3_41_2","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139173933"},{"key":"e_1_3_3_3_42_2","unstructured":"Sida Peng Eirini Kalliamvakou Peter Cihon and Mert Demirer. 2023. The impact of ai on developer productivity: Evidence from github copilot. arXiv preprint arXiv:https:\/\/arXiv.org\/abs\/2302.06590 (2023)."},{"key":"e_1_3_3_3_43_2","doi-asserted-by":"crossref","unstructured":"Girish\u00a0N Punj and Richard Staelin. 1983. A model of consumer information search behavior for new automobiles. Journal of Consumer Research 9 4 (1983) 366\u2013380.","DOI":"10.1086\/208931"},{"key":"e_1_3_3_3_44_2","doi-asserted-by":"crossref","unstructured":"Abigail Sellen and Eric Horvitz. 2024. The rise of the AI Co-Pilot: Lessons for design from aviation and beyond. Commun. ACM 67 7 (2024) 18\u201323.","DOI":"10.1145\/3637865"},{"key":"e_1_3_3_3_45_2","doi-asserted-by":"crossref","unstructured":"Kathryn Sharpe\u00a0Wessling Joel Huber and Oded Netzer. 2017. MTurk character misrepresentation: Assessment and solutions. Journal of Consumer Research 44 1 (2017) 211\u2013230.","DOI":"10.1093\/jcr\/ucx053"},{"key":"e_1_3_3_3_46_2","doi-asserted-by":"publisher","DOI":"10.1145\/331403.331405"},{"key":"e_1_3_3_3_47_2","volume-title":"Search engine market share worldwide","year":"2023","unstructured":"StatCounter. 2023. Search engine market share worldwide. https:\/\/gs.statcounter.com\/search-engine-market-share"},{"key":"e_1_3_3_3_48_2","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642902"},{"key":"e_1_3_3_3_49_2","volume-title":"Algorithmic writing assistance on jobseekers\u2019 resumes increases hires","author":"Inwegen Emma van","year":"2023","unstructured":"Emma van Inwegen, Zanele\u00a0T Munyikwa, and John\u00a0J Horton. 2023. Algorithmic writing assistance on jobseekers\u2019 resumes increases hires. Technical Report. National Bureau of Economic Research."},{"key":"e_1_3_3_3_50_2","unstructured":"Helena Vasconcelos Gagan Bansal Adam Fourney Q\u00a0Vera Liao and Jennifer\u00a0Wortman Vaughan. 2024. Generation probabilities are not enough: Exploring the effectiveness of uncertainty highlighting in AI-powered code completions. TOCHI 2024: ACM Transactions on Computer-Human Interaction (2024)."},{"key":"e_1_3_3_3_51_2","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300509"},{"key":"e_1_3_3_3_52_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2023.findings-acl.551"},{"key":"e_1_3_3_3_53_2","doi-asserted-by":"publisher","DOI":"10.1145\/3520312.3534864"}],"event":{"name":"CHI 2025: CHI Conference on Human Factors in Computing Systems","location":"Yokohama Japan","acronym":"CHI '25","sponsor":["SIGCHI ACM Special Interest Group on Computer-Human Interaction"]},"container-title":["Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3714082","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3706598.3714082","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,4]],"date-time":"2025-07-04T05:11:34Z","timestamp":1751605894000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3706598.3714082"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,25]]},"references-count":52,"alternative-id":["10.1145\/3706598.3714082","10.1145\/3706598"],"URL":"https:\/\/doi.org\/10.1145\/3706598.3714082","relation":{},"subject":[],"published":{"date-parts":[[2025,4,25]]},"assertion":[{"value":"2025-04-25","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}