{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T21:51:55Z","timestamp":1773870715343,"version":"3.50.1"},"reference-count":150,"publisher":"Association for Computing Machinery (ACM)","issue":"7","license":[{"start":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T00:00:00Z","timestamp":1760572800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"NSF","doi-asserted-by":"publisher","award":["2141335,2302730"],"award-info":[{"award-number":["2141335,2302730"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000002","name":"NIH","doi-asserted-by":"publisher","award":["R01AI188576"],"award-info":[{"award-number":["R01AI188576"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100015257","name":"Northeastern University","doi-asserted-by":"publisher","award":["Tier-1 Research Grant"],"award-info":[{"award-number":["Tier-1 Research Grant"]}],"id":[{"id":"10.13039\/100015257","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2025,10,18]]},"abstract":"<jats:p>\n            The rapid advancement of Large Language Models (LLMs) has created numerous potentials for integration with conversational assistants (CAs) assisting people in their daily tasks, particularly due to their extensive flexibility. However, users' real-world experiences interacting with these assistants remain unexplored. In this research, we chose cooking, a complex daily task, as a scenario to explore people's successful and unsatisfactory experiences while receiving assistance from an LLM-based CA,\n            <jats:italic toggle=\"yes\">Mango Mango<\/jats:italic>\n            . We discovered that participants value the system's ability to offer customized instructions based on context, provide extensive information beyond the recipe, and assist them in dynamic task planning. However, users expect the system to be more adaptive to oral conversation and provide more suggestive responses to keep them actively involved. Recognizing that users began treating our LLM-CA as a personal assistant or even a partner rather than just a recipe-reading tool, we propose five design considerations for future development.\n          <\/jats:p>","DOI":"10.1145\/3757442","type":"journal-article","created":{"date-parts":[[2025,10,16]],"date-time":"2025-10-16T17:06:01Z","timestamp":1760634361000},"page":"1-35","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["\"Mango Mango, How to Let The Lettuce Dry Without A Spinner?\": Exploring User Perceptions of Using An LLM-Based Conversational Assistant Toward Cooking Partner"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-5132-5171","authenticated-orcid":false,"given":"Szeyi","family":"Chan","sequence":"first","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6084-5131","authenticated-orcid":false,"given":"Jiachen","family":"Li","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-8329-4610","authenticated-orcid":false,"given":"Bingsheng","family":"Yao","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5044-1494","authenticated-orcid":false,"given":"Amama","family":"Mahmood","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, Baltimore, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6838-3701","authenticated-orcid":false,"given":"Chien-Ming","family":"Huang","sequence":"additional","affiliation":[{"name":"Johns Hopkins University, Baltimore, Maryland, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2374-382X","authenticated-orcid":false,"given":"Holly","family":"Jimison","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8486-9384","authenticated-orcid":false,"given":"Elizabeth D.","family":"Mynatt","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9371-9441","authenticated-orcid":false,"given":"Dakuo","family":"Wang","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]}],"member":"320","published-online":{"date-parts":[[2025,10,16]]},"reference":[{"key":"e_1_2_1_1_1","volume-title":"The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches. arXiv preprint arXiv:2406.03339","author":"Abeysinghe Bhashithe","year":"2024","unstructured":"Bhashithe Abeysinghe and Ruhan Circi. 2024. The Challenges of Evaluating LLM Applications: An Analysis of Automated, Human, and LLM-Based Approaches. arXiv preprint arXiv:2406.03339 (2024)."},{"key":"e_1_2_1_2_1","unstructured":"Michael Ahn Anthony Brohan Noah Brown Yevgen Chebotar Omar Cortes Byron David Chelsea Finn Chuyuan Fu Keerthana Gopalakrishnan Karol Hausman Alex Herzog Daniel Ho Jasmine Hsu Julian Ibarz Brian Ichter Alex Irpan Eric Jang Rosario Jauregui Ruano Kyle Jeffrey Sally Jesmonth Nikhil J Joshi Ryan Julian Dmitry Kalashnikov Yuheng Kuang Kuang-Huei Lee Sergey Levine Yao Lu Linda Luu Carolina Parada Peter Pastor Jornell Quiambao Kanishka Rao Jarek Rettinghouse Diego Reyes Pierre Sermanet Nicolas Sievers Clayton Tan Alexander Toshev Vincent Vanhoucke Fei Xia Ted Xiao Peng Xu Sichun Xu Mengyuan Yan and Andy Zeng. 2022. Do As I Can Not As I Say: Grounding Language in Robotic Affordances. arXiv:2204.01691 [cs.RO]"},{"key":"e_1_2_1_3_1","unstructured":"Majid Alfifi Xiangjue Dong Timo Feldman Allen Lin Karthic Madanagopal Aditya Pethe Maria Teleki Zhuoer Wang Ziwei Zhu and James Caverlee. [n.d.]. Howdy Y'all: An Alexa TaskBot. ( [n. d.])."},{"key":"e_1_2_1_4_1","volume-title":"Natural language understanding","author":"Allen James","unstructured":"James Allen. 1995. Natural language understanding. Benjamin-Cummings Publishing Co., Inc."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.3390\/s21248448"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/3311956"},{"key":"e_1_2_1_7_1","volume-title":"What does the literature say about the use of personal voice assistants in older adults? A scoping review. Disability and Rehabilitation: Assistive Technology","author":"Arnold Anneliese","year":"2022","unstructured":"Anneliese Arnold, Stephanie Kolody, Aidan Comeau, and Antonio Miguel Cruz. 2022. What does the literature say about the use of personal voice assistants in older adults? A scoping review. Disability and Rehabilitation: Assistive Technology (2022), 1-12."},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"John W Ayers Adam Poliak Mark Dredze Eric C Leas Zechariah Zhu Jessica B Kelley Dennis J Faix Aaron M Goodman Christopher A Longhurst Michael Hogarth et al. 2023. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA internal medicine (2023).","DOI":"10.1001\/jamainternmed.2023.1838"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Yejin Bang Samuel Cahyawijaya Nayeon Lee Wenliang Dai Dan Su Bryan Wilie Holy Lovenia Ziwei Ji Tiezheng Yu Willy Chung et al. 2023. A multitask multilingual multimodal evaluation of chatgpt on reasoning hallucination and interactivity. arXiv preprint arXiv:2302.04023 (2023).","DOI":"10.18653\/v1\/2023.ijcnlp-main.45"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581118"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517683"},{"key":"e_1_2_1_12_1","first-page":"96","volume-title":"Computer-Supported Collaborative Learning Conference, CSCL","volume":"1","author":"Beirl Diana","year":"2019","unstructured":"Diana Beirl, Y Rogers, and Nicola Yuill. 2019. Using voice assistant skills in family life. In Computer-Supported Collaborative Learning Conference, CSCL, Vol. 1. International Society of the Learning Sciences, Inc., 96-103."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376344"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264901"},{"key":"e_1_2_1_15_1","first-page":"3","article-title":"Do it yourself, but not alone: companion-technology for home improvement-bringing a planning-based interactive DIY assistant to life","volume":"35","author":"Bercher Pascal","year":"2021","unstructured":"Pascal Bercher, Gregor Behnke, Matthias Kraus, Marvin Schiller, Dietrich Manstetten, Michael Dambier, Michael Dorna, Wolfgang Minker, Birte Glimm, and Susanne Biundo. 2021. Do it yourself, but not alone: companion-technology for home improvement-bringing a planning-based interactive DIY assistant to life. KI-K\u00fcnstliche Intelligenz, Vol. 35, 3-4 (2021), 367-375.","journal-title":"KI-K\u00fcnstliche Intelligenz"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.2196\/32161"},{"key":"e_1_2_1_17_1","unstructured":"Thorsten Brants Ashok C Popat Peng Xu Franz J Och and Jeffrey Dean. 2007. Large language models in machine translation. (2007)."},{"key":"e_1_2_1_18_1","volume-title":"Using thematic analysis in psychology. Qualitative research in psychology","author":"Braun Virginia","year":"2006","unstructured":"Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology, Vol. 3, 2 (2006), 77-101."},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3484507"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445409"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445691"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/MPRV.2010.75"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3322276.3322332"},{"key":"e_1_2_1_24_1","volume-title":"Charles Sutton, Sebastian Gehrmann, et al.","author":"Chowdhery Aakanksha","year":"2022","unstructured":"Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, Maarten Bosma, Gaurav Mishra, Adam Roberts, Paul Barham, Hyung Won Chung, Charles Sutton, Sebastian Gehrmann, et al., 2022. Palm: Scaling language modeling with pathways. arXiv preprint arXiv:2204.02311 (2022)."},{"key":"e_1_2_1_25_1","volume-title":"Deep reinforcement learning from human preferences. Advances in neural information processing systems","author":"Christiano Paul F","year":"2017","unstructured":"Paul F Christiano, Jan Leike, Tom Brown, Miljan Martic, Shane Legg, and Dario Amodei. 2017. Deep reinforcement learning from human preferences. Advances in neural information processing systems, Vol. 30 (2017)."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijcci.2021.100403"},{"key":"e_1_2_1_27_1","unstructured":"Hyung Won Chung Le Hou Shayne Longpre Barret Zoph Yi Tay William Fedus Eric Li Xuezhi Wang Mostafa Dehghani Siddhartha Brahma et al. 2022a. Scaling instruction-finetuned language models. arXiv preprint arXiv:2210.11416 (2022)."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3519873"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2935334.2935386"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3098279.3098539"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03193268"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3572334.3572371"},{"key":"e_1_2_1_33_1","doi-asserted-by":"crossref","unstructured":"Emily Czekalski and David Watson. 2024. Efficiently updating domain knowledge in large language models: Techniques for knowledge injection without comprehensive retraining. (2024).","DOI":"10.21203\/rs.3.rs-4533670\/v1"},{"key":"e_1_2_1_34_1","unstructured":"Hai Dang Lukas Mecke Florian Lehmann Sven Goller and Daniel Buschek. 2022. How to Prompt? Opportunities and Challenges of Zero- and Few-Shot Learning for Human-AI Interaction in Creative Applications of Generative Models. arXiv:2209.01390 [cs.HC]"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445039"},{"key":"e_1_2_1_36_1","volume-title":"ChatGPT as a tool for self-directed foreign language learning. Innovation in Language Learning and Teaching","author":"Dizon Gilbert","year":"2024","unstructured":"Gilbert Dizon. 2024. ChatGPT as a tool for self-directed foreign language learning. Innovation in Language Learning and Teaching (2024), 1-17."},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3078072.3084330"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3459990.3465195"},{"key":"e_1_2_1_39_1","volume-title":"Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997","author":"Gao Yunfan","year":"2023","unstructured":"Yunfan Gao, Yun Xiong, Xinyu Gao, Kangxiang Jia, Jinliu Pan, Yuxi Bi, Yi Dai, Jiawei Sun, Haofen Wang, and Haofen Wang. 2023. Retrieval-augmented generation for large language models: A survey. arXiv preprint arXiv:2312.10997, Vol. 2 (2023)."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3381002"},{"key":"e_1_2_1_41_1","volume-title":"Discovery of grounded theory: Strategies for qualitative research","author":"Glaser Barney","unstructured":"Barney Glaser and Anselm Strauss. 2017. Discovery of grounded theory: Strategies for qualitative research. Routledge."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3654777.3676414"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300439"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517617"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517684"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1101149.1101228"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2021.104395"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501995"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1177\/154193120605000909"},{"key":"e_1_2_1_50_1","volume-title":"Advances in psychology.","author":"Hart Sandra G","unstructured":"Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139-183."},{"key":"e_1_2_1_51_1","volume-title":"SAPIEN: affective virtual agents powered by large language models. arXiv preprint arXiv:2308.03022","author":"Hasan Masum","year":"2023","unstructured":"Masum Hasan, Cengiz Ozel, Sammy Potter, and Ehsan Hoque. 2023. SAPIEN: affective virtual agents powered by large language models. arXiv preprint arXiv:2308.03022 (2023)."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1145\/3472714.3473634"},{"key":"e_1_2_1_53_1","volume-title":"Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608","author":"Hoffman Robert R","year":"2018","unstructured":"Robert R Hoffman, Shane T Mueller, Gary Klein, and Jordan Litman. 2018. Metrics for explainable AI: Challenges and prospects. arXiv preprint arXiv:1812.04608 (2018)."},{"key":"e_1_2_1_54_1","volume-title":"an introduction to voice assistants. Medical reference services quarterly","author":"Hoy Matthew B","year":"2018","unstructured":"Matthew B Hoy. 2018. Alexa, Siri, Cortana, and more: an introduction to voice assistants. Medical reference services quarterly, Vol. 37, 1 (2018), 81-88."},{"key":"e_1_2_1_55_1","unstructured":"Lei Huang Weijiang Yu Weitao Ma Weihong Zhong Zhangyin Feng Haotian Wang Qianglong Chen Weihua Peng Xiaocheng Feng Bing Qin et al. 2023. A survey on hallucination in large language models: Principles taxonomy challenges and open questions. ACM Transactions on Information Systems (2023)."},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173869"},{"key":"e_1_2_1_57_1","volume-title":"Large Language Models as Sous Chefs: Revising Recipes with GPT-3. arXiv preprint arXiv:2306.13986","author":"Hwang Alyssa","year":"2023","unstructured":"Alyssa Hwang, Bryan Li, Zhaoyi Hou, and Dan Roth. 2023a. Large Language Models as Sous Chefs: Revising Recipes with GPT-3. arXiv preprint arXiv:2306.13986 (2023)."},{"key":"e_1_2_1_58_1","volume-title":"Rewriting the Script: Adapting Text Instructions for Voice Interaction. arXiv preprint arXiv:2306.09992","author":"Hwang Alyssa","year":"2023","unstructured":"Alyssa Hwang, Natasha Oza, Chris Callison-Burch, and Andrew Head. 2023b. Rewriting the Script: Adapting Text Instructions for Voice Interaction. arXiv preprint arXiv:2306.09992 (2023)."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3642183"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581196"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1080\/09658211.2020.1860228"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/3571730"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491101.3503564"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501870"},{"key":"e_1_2_1_65_1","volume-title":"Large Language Models: A Deep Dive: Bridging Theory and Practice","author":"Kamath Uday","unstructured":"Uday Kamath, Kevin Keenan, Garrett Somers, and Sarah Sorenson. 2024. LLM challenges and solutions. In Large Language Models: A Deep Dive: Bridging Theory and Practice. Springer, 219-274."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1145\/3676492"},{"key":"e_1_2_1_67_1","volume-title":"Tianshi Li, and Hong Shen.","author":"Kapania Shivani","year":"2024","unstructured":"Shivani Kapania, Ruiyi Wang, Toby Jia-Jun Li, Tianshi Li, and Hong Shen. 2024. '' I'm categorizing LLM as a productivity tool'': Examining ethics of LLM use in HCI research practices. arXiv preprint arXiv:2403.19876 (2024)."},{"key":"e_1_2_1_68_1","doi-asserted-by":"crossref","unstructured":"Enkelejda Kasneci Kathrin Se\u00dfler Stefan K\u00fcchemann Maria Bannert Daryna Dementieva Frank Fischer Urs Gasser Georg Groh Stephan G\u00fcnnemann Eyke H\u00fcllermeier et al. 2023. ChatGPT for good? On opportunities and challenges of large language models for education. Learning and individual differences Vol. 103 (2023) 102274.","DOI":"10.1016\/j.lindif.2023.102274"},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3501931"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445579"},{"key":"e_1_2_1_71_1","volume-title":"Careless Whisper: Speech-to-Text Hallucination Harms. In The 2024 ACM Conference on Fairness, Accountability, and Transparency. 1672-1681","author":"Koenecke Allison","year":"2024","unstructured":"Allison Koenecke, Anna Seo Gyeong Choi, Katelyn X Mei, Hilke Schellmann, and Mona Sloane. 2024. Careless Whisper: Speech-to-Text Hallucination Harms. In The 2024 ACM Conference on Fairness, Accountability, and Transparency. 1672-1681."},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1145\/3316782.3321524"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1145\/3382507.3418818"},{"key":"e_1_2_1_74_1","volume-title":"Exploring the Use of Large Language Models for Improving the Awareness of Mindfulness. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1-7.","author":"Kumar Harsh","year":"2023","unstructured":"Harsh Kumar, Yiyi Wang, Jiakai Shi, Ilya Musabirov, Norman AS Farb, and Joseph Jay Williams. 2023. Exploring the Use of Large Language Models for Improving the Awareness of Mindfulness. In Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems. 1-7."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/3463516"},{"key":"e_1_2_1_76_1","volume-title":"Improved Instruction Ordering in Recipe-Grounded Conversation. arXiv preprint arXiv:2305.17280","author":"Le Duong Minh","year":"2023","unstructured":"Duong Minh Le, Ruohao Guo, Wei Xu, and Alan Ritter. 2023. Improved Instruction Ordering in Recipe-Grounded Conversation. arXiv preprint arXiv:2305.17280 (2023)."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502030"},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581369"},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3663548.3675662"},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2019.1622786"},{"key":"e_1_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.7759\/cureus.40895"},{"key":"e_1_2_1_82_1","volume-title":"Conversational interfaces for information search. Understanding and Improving Information Search: A Cognitive Approach","author":"Liao Q Vera","year":"2020","unstructured":"Q Vera Liao, Werner Geyer, Michael Muller, and Yasaman Khazaen. 2020. Conversational interfaces for information search. Understanding and Improving Information Search: A Cognitive Approach (2020), 267-287."},{"key":"e_1_2_1_83_1","volume-title":"Ai transparency in the age of llms: A human-centered research roadmap. arXiv preprint arXiv:2306.01941","author":"Vera Liao Q","year":"2023","unstructured":"Q Vera Liao and Jennifer Wortman Vaughan. 2023. Ai transparency in the age of llms: A human-centered research roadmap. arXiv preprint arXiv:2306.01941 (2023), 5368-5393."},{"key":"e_1_2_1_84_1","volume-title":"Mohammad Tariqul Islam Khan, and Si Na Kew.","author":"Liew Tze Wei","year":"2023","unstructured":"Tze Wei Liew, Su-Mae Tan, Wei Ming Pang, Mohammad Tariqul Islam Khan, and Si Na Kew. 2023. I am Alexa, your virtual tutor!: The effects of Amazon Alexa's text-to-speech voice enthusiasm in a multimedia learning environment. Education and information technologies, Vol. 28, 2 (2023), 1455-1489."},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1177\/10451595231184928"},{"key":"e_1_2_1_86_1","volume-title":"What Makes Good In-Context Examples for GPT-3? arXiv preprint arXiv:2101.06804","author":"Liu Jiachang","year":"2021","unstructured":"Jiachang Liu, Dinghan Shen, Yizhe Zhang, Bill Dolan, Lawrence Carin, and Weizhu Chen. 2021. What Makes Good In-Context Examples for GPT-3? arXiv preprint arXiv:2101.06804 (2021)."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517731"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.acalib.2023.102720"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.5334\/pb-50-3-4-309"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1177\/0961000618759414"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858288"},{"key":"e_1_2_1_92_1","volume-title":"International Journal of Human-Computer Studies","author":"Mahmood Amama","year":"2024","unstructured":"Amama Mahmood, Junxiang Wang, Bingsheng Yao, Dakuo Wang, and Chien-Ming Huang. 2024. User interaction patterns and breakdowns in conversing with LLM-powered voice assistants. International Journal of Human-Computer Studies (2024), 103406."},{"key":"e_1_2_1_93_1","first-page":"943","volume-title":"Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society","volume":"7","author":"Manzini Arianna","year":"2024","unstructured":"Arianna Manzini, Geoff Keeling, Lize Alberts, Shannon Vallor, Meredith Ringel Morris, and Iason Gabriel. 2024. The Code That Binds Us: Navigating the Appropriateness of Human-AI Assistant Relationships. In Proceedings of the AAAI\/ACM Conference on AI, Ethics, and Society, Vol. 7. 943-957."},{"key":"e_1_2_1_94_1","doi-asserted-by":"publisher","DOI":"10.1145\/3517428.3544830"},{"key":"e_1_2_1_95_1","volume-title":"Conversational modelling for chatbots: current approaches and future directions. Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung","author":"McTear Michael","year":"2018","unstructured":"Michael McTear. 2018. Conversational modelling for chatbots: current approaches and future directions. Studientexte zur Sprachkommunikation: Elektronische Sprachsignalverarbeitung (2018), 175-185."},{"key":"e_1_2_1_96_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173580"},{"key":"e_1_2_1_97_1","first-page":"399","volume-title":"Thirteenth symposium on usable privacy and security (SOUPS","author":"Naeini Pardis Emami","year":"2017","unstructured":"Pardis Emami Naeini, Sruti Bhagavatula, Hana Habib, Martin Degeling, Lujo Bauer, Lorrie Faith Cranor, and Norman Sadeh. 2017. Privacy expectations and preferences in an &#123;IoT&#125; world. In Thirteenth symposium on usable privacy and security (SOUPS 2017). 399-412."},{"key":"e_1_2_1_98_1","volume-title":"Recipe Enrichment: Knowledge Required for a Cooking Assistant. In ICAART (2). 822-829.","author":"Neumann Nils","year":"2021","unstructured":"Nils Neumann and Sven Wachsmuth. 2021. Recipe Enrichment: Knowledge Required for a Cooking Assistant. In ICAART (2). 822-829."},{"key":"e_1_2_1_99_1","volume-title":"Proceedings of WSDM'19 Task Intelligence Workshop (TI@ WSDM19)","author":"Nouri Elnaz","year":"2019","unstructured":"Elnaz Nouri, Adam Fourney, Robert Sim, and Ryen W White. 2019. Supporting complex tasks using multiple devices. In Proceedings of WSDM'19 Task Intelligence Workshop (TI@ WSDM19)."},{"key":"e_1_2_1_100_1","volume-title":"Chatgpt versus traditional question answering for knowledge graphs: Current status and future directions towards knowledge graph chatbots. arXiv preprint arXiv:2302.06466","author":"Omar Reham","year":"2023","unstructured":"Reham Omar, Omij Mangukiya, Panos Kalnis, and Essam Mansour. 2023. Chatgpt versus traditional question answering for knowledge graphs: Current status and future directions towards knowledge graph chatbots. arXiv preprint arXiv:2302.06466 (2023)."},{"key":"e_1_2_1_101_1","unstructured":"OpenAI. 2023. GPT-4 Technical Report. ArXiv Vol. abs\/2303.08774 (2023). https:\/\/api.semanticscholar.org\/CorpusID:257532815"},{"key":"e_1_2_1_102_1","first-page":"27730","article-title":"Training language models to follow instructions with human feedback","volume":"35","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al., 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, Vol. 35 (2022), 27730-27744.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_103_1","volume-title":"Nineteenth Symposium on Usable Privacy and Security (SOUPS","author":"Park Sunyup","year":"2023","unstructured":"Sunyup Park, Anna Lenhart, Michael Zimmer, and Jessica Vitak. 2023. '' Nobody's Happy'': Design Insights from &#123;Privacy-Conscious&#125; Smart Home Power Users on Enhancing Data Transparency, Visibility, and Control. In Nineteenth Symposium on Usable Privacy and Security (SOUPS 2023)."},{"key":"e_1_2_1_104_1","volume-title":"Designing voice user interfaces: Principles of conversational experiences. '' O'Reilly Media","author":"Pearl Cathy","unstructured":"Cathy Pearl. 2016. Designing voice user interfaces: Principles of conversational experiences. '' O'Reilly Media, Inc.''."},{"key":"e_1_2_1_105_1","unstructured":"Indrasen Poola. 2023. Overcoming ChatGPTs inaccuracies with Pre-Trained AI Prompt Engineering Sequencing Process. (2023)."},{"key":"e_1_2_1_106_1","doi-asserted-by":"publisher","DOI":"10.1145\/3487553.3524228"},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1145\/3373759"},{"key":"e_1_2_1_108_1","volume-title":"Semantic consistency for assuring reliability of large language models. arXiv preprint arXiv:2308.09138","author":"Raj Harsh","year":"2023","unstructured":"Harsh Raj, Vipul Gupta, Domenic Rosati, and Subhabrata Majumdar. 2023. Semantic consistency for assuring reliability of large language models. arXiv preprint arXiv:2308.09138 (2023)."},{"key":"e_1_2_1_109_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1351324997001502"},{"key":"e_1_2_1_110_1","volume-title":"Leveraging Large Language Models for Multiple Choice Question Answering. In The Eleventh International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=yKbprarjc5B","author":"Robinson Joshua","year":"2023","unstructured":"Joshua Robinson and David Wingate. 2023. Leveraging Large Language Models for Multiple Choice Question Answering. In The Eleventh International Conference on Learning Representations. https:\/\/openreview.net\/forum?id=yKbprarjc5B"},{"key":"e_1_2_1_111_1","doi-asserted-by":"publisher","DOI":"10.1145\/2540930.2540952"},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1145\/3196709.3196772"},{"key":"e_1_2_1_113_1","first-page":"50","article-title":"Natural language generation: an overview","volume":"1","author":"Semaan Paul","year":"2012","unstructured":"Paul Semaan. 2012. Natural language generation: an overview. J Comput Sci Res, Vol. 1, 3 (2012), 50-57.","journal-title":"J Comput Sci Res"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1145\/3654777.3676450"},{"key":"e_1_2_1_115_1","unstructured":"Mrinank Sharma Meg Tong Tomasz Korbak David Duvenaud Amanda Askell Samuel R Bowman Newton Cheng Esin Durmus Zac Hatfield-Dodds Scott R Johnston et al. 2023. Towards understanding sycophancy in language models. arXiv preprint arXiv:2310.13548 (2023)."},{"key":"e_1_2_1_116_1","unstructured":"Xinyue Shen Zeyuan Chen Michael Backes and Yang Zhang. 2023. In chatgpt we trust? measuring and characterizing the reliability of chatgpt. arXiv preprint arXiv:2304.08979 (2023)."},{"key":"e_1_2_1_117_1","volume-title":"International Workshop on Chatbot Research and Design. Springer, 171-189","author":"Stolwijk Gina EM","year":"2022","unstructured":"Gina EM Stolwijk and Florian A Kunneman. 2022. Increasing the Coverage of Clarification Responses for a Cooking Assistant. In International Workshop on Chatbot Research and Design. Springer, 171-189."},{"key":"e_1_2_1_118_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376225"},{"key":"e_1_2_1_119_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.eacl-demos.29"},{"key":"e_1_2_1_120_1","volume-title":"CodeHalu: Code Hallucinations in LLMs Driven by Execution-based Verification. arXiv preprint arXiv:2405.00253","author":"Tian Yuchen","year":"2024","unstructured":"Yuchen Tian, Weixiang Yan, Qian Yang, Qian Chen, Wen Wang, Ziyang Luo, and Lei Ma. 2024. CodeHalu: Code Hallucinations in LLMs Driven by Execution-based Verification. arXiv preprint arXiv:2405.00253 (2024)."},{"key":"e_1_2_1_121_1","volume-title":"Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971","author":"Touvron Hugo","year":"2023","unstructured":"Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timoth\u00e9e Lacroix, Baptiste Rozi\u00e8re, Naman Goyal, Eric Hambro, Faisal Azhar, et al., 2023. Llama: Open and efficient foundation language models. arXiv preprint arXiv:2302.13971 (2023)."},{"key":"e_1_2_1_122_1","doi-asserted-by":"publisher","DOI":"10.1145\/3313831.3376760"},{"key":"e_1_2_1_123_1","volume-title":"Sahil Gupta, Dung Ngoc Thai, Wenlong Zhao, SUNJAE KWON, Victor Ardulov, Karim Tarabishy, Andrew McCallum, et al.","author":"Vishwanath Prathiksha Rumale","year":"2024","unstructured":"Prathiksha Rumale Vishwanath, Simran Tiwari, Tejas Ganesh Naik, Sahil Gupta, Dung Ngoc Thai, Wenlong Zhao, SUNJAE KWON, Victor Ardulov, Karim Tarabishy, Andrew McCallum, et al., 2024. Faithfulness Hallucination Detection in Healthcare AI. In Artificial Intelligence and Data Science for Healthcare: Bridging Data-Centric AI and People-Centric Healthcare."},{"key":"e_1_2_1_124_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445536"},{"key":"e_1_2_1_125_1","doi-asserted-by":"publisher","DOI":"10.1145\/3308561.3353773"},{"key":"e_1_2_1_126_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3580895"},{"key":"e_1_2_1_127_1","unstructured":"Jiaqi Wang Enze Shi Sigang Yu Zihao Wu Chong Ma Haixing Dai Qiushi Yang Yanqing Kang Jinru Wu Huawen Hu et al. 2023b. Prompt engineering for healthcare: Methodologies and applications. arXiv preprint arXiv:2304.14670 (2023)."},{"key":"e_1_2_1_128_1","unstructured":"Jiaqi Wang Zihao Wu Yiwei Li Hanqi Jiang Peng Shu Enze Shi Huawen Hu Chong Ma Yiheng Liu Xuhui Wang et al. 2024b. Large language models for robotics: Opportunities challenges and perspectives. arXiv preprint arXiv:2401.04334 (2024)."},{"key":"e_1_2_1_129_1","doi-asserted-by":"publisher","DOI":"10.1145\/3613904.3641960"},{"key":"e_1_2_1_130_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563657.3595975"},{"key":"e_1_2_1_131_1","volume-title":"Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le.","author":"Wei Jason","year":"2021","unstructured":"Jason Wei, Maarten Bosma, Vincent Y Zhao, Kelvin Guu, Adams Wei Yu, Brian Lester, Nan Du, Andrew M Dai, and Quoc V Le. 2021. Finetuned language models are zero-shot learners. arXiv preprint arXiv:2109.01652 (2021)."},{"key":"e_1_2_1_132_1","volume-title":"Leveraging large language models to power chatbots for collecting user self-reported data. arXiv preprint arXiv:2301.05843","author":"Wei Jing","year":"2023","unstructured":"Jing Wei, Sungdong Kim, Hyunhoon Jung, and Young-Ho Kim. 2023. Leveraging large language models to power chatbots for collecting user self-reported data. arXiv preprint arXiv:2301.05843 (2023)."},{"key":"e_1_2_1_133_1","first-page":"24824","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al., 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, Vol. 35 (2022), 24824-24837.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_134_1","volume-title":"Flavia Conti Rossini, and Jan Marco Leimeister.","author":"Winkler Rainer","year":"2019","unstructured":"Rainer Winkler, Matthias S\u00f6llner, Maya Lisa Neuweiler, Flavia Conti Rossini, and Jan Marco Leimeister. 2019. Alexa, can you help us solve this problem? How conversations with smart personal assistant tutors increase task group outcomes. In Extended abstracts of the 2019 CHI conference on human factors in computing systems. 1-6."},{"key":"e_1_2_1_135_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517582"},{"key":"e_1_2_1_136_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581252"},{"key":"e_1_2_1_137_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581641.3584031"},{"key":"e_1_2_1_138_1","doi-asserted-by":"publisher","DOI":"10.1145\/3581754.3584136"},{"key":"e_1_2_1_139_1","doi-asserted-by":"publisher","DOI":"10.1145\/3381804"},{"key":"e_1_2_1_140_1","doi-asserted-by":"crossref","unstructured":"Xuhai Xu Bingsheng Yao Yuanzhe Dong Saadia Gabriel Hong Yu James Hendler Marzyeh Ghassemi Anind K. Dey and Dakuo Wang. 2023b. Mental-LLM: Leveraging Large Language Models for Mental Health Prediction via Online Text Data. arXiv:2307.14385 [cs.CL]","DOI":"10.1145\/3643540"},{"key":"e_1_2_1_141_1","volume-title":"Leveraging large language models for mental health prediction via online text data. arXiv preprint arXiv:2307.14385","author":"Xu Xuhai","year":"2023","unstructured":"Xuhai Xu, Bingshen Yao, Yuanzhe Dong, Hong Yu, James Hendler, Anind K Dey, and Dakuo Wang. 2023c. Leveraging large language models for mental health prediction via online text data. arXiv preprint arXiv:2307.14385 (2023)."},{"key":"e_1_2_1_142_1","doi-asserted-by":"publisher","DOI":"10.1145\/3585088.3589354"},{"key":"e_1_2_1_143_1","doi-asserted-by":"publisher","DOI":"10.1145\/3699765"},{"key":"e_1_2_1_144_1","doi-asserted-by":"publisher","DOI":"10.1145\/3544548.3581388"},{"key":"e_1_2_1_145_1","volume-title":"Can Humans Oversee Agents to Prevent Privacy Leakage? A Study on Privacy Awareness, Preferences, and Trust in Language Model Agents. arXiv preprint arXiv:2411.01344","author":"Zhang Zhiping","year":"2024","unstructured":"Zhiping Zhang, Bingcan Guo, and Tianshi Li. 2024a. Can Humans Oversee Agents to Prevent Privacy Leakage? A Study on Privacy Awareness, Preferences, and Trust in Language Model Agents. arXiv preprint arXiv:2411.01344 (2024)."},{"key":"e_1_2_1_146_1","volume-title":"Proceedings of the CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery New York, NY, USA, 1-26","author":"Zhang Zhiping","year":"2024","unstructured":"Zhiping Zhang, Michelle Jia, Hao-Ping Lee, Bingsheng Yao, Sauvik Das, Ada Lerner, Dakuo Wang, and Tianshi Li. 2024b. ''It'sa Fair Game'', or Is It? Examining How Users Navigate Disclosure Risks and Benefits When Using LLM-Based Conversational Agents. In Proceedings of the CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery New York, NY, USA, 1-26."},{"key":"e_1_2_1_147_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517479"},{"key":"e_1_2_1_148_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3502036"},{"key":"e_1_2_1_149_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445124"},{"key":"e_1_2_1_150_1","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-020-00424-4"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757442","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3757442","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,17]],"date-time":"2025-10-17T02:06:53Z","timestamp":1760666813000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3757442"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,16]]},"references-count":150,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2025,10,18]]}},"alternative-id":["10.1145\/3757442"],"URL":"https:\/\/doi.org\/10.1145\/3757442","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,16]]},"assertion":[{"value":"2025-10-16","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}