{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,14]],"date-time":"2026-04-14T00:56:43Z","timestamp":1776128203609,"version":"3.50.1"},"reference-count":99,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2024,5,13]],"date-time":"2024-05-13T00:00:00Z","timestamp":1715558400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Interact. Mob. Wearable Ubiquitous Technol."],"published-print":{"date-parts":[[2024,5,13]]},"abstract":"<jats:p>Developing chatbots as personal companions has long been a goal of artificial intelligence researchers. Recent advances in Large Language Models (LLMs) have delivered a practical solution for endowing chatbots with anthropomorphic language capabilities. However, it takes more than LLMs to enable chatbots that can act as companions. Humans use their understanding of individual personalities to drive conversations. Chatbots also require this capability to enable human-like companionship. They should act based on personalized, real-time, and time-evolving knowledge of their users. We define such essential knowledge as the common ground between chatbots and their users, and we propose to build a common-ground-aware dialogue system from an LLM-based module, named OS-1, to enable chatbot companionship. Hosted by eyewear, OS-1 can sense the visual and audio signals the user receives and extract real-time contextual semantics. Those semantics are categorized and recorded to formulate historical contexts from which the user's profile is distilled and evolves over time, i.e., OS-1 gradually learns about its user. OS-1 combines knowledge from real-time semantics, historical contexts, and user-specific profiles to produce a common-ground-aware prompt input into the LLM module. The LLM's output is converted to audio, spoken to the wearer when appropriate. We conduct laboratory and in-field studies to assess OS-1's ability to build common ground between the chatbot and its user. The technical feasibility and capabilities of the system are also evaluated. Our results show that by utilizing personal context, OS-1 progressively develops a better understanding of its users. This enhances user satisfaction and potentially leads to various personal service scenarios, such as emotional support and assistance.<\/jats:p>","DOI":"10.1145\/3659600","type":"journal-article","created":{"date-parts":[[2024,5,15]],"date-time":"2024-05-15T12:20:41Z","timestamp":1715775641000},"page":"1-41","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":17,"title":["Can Large Language Models Be Good Companions?"],"prefix":"10.1145","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0008-4497-724X","authenticated-orcid":false,"given":"Zhenyu","family":"Xu","sequence":"first","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-7570-4078","authenticated-orcid":false,"given":"Hailin","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-6159-6914","authenticated-orcid":false,"given":"Zhouyang","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5902-1306","authenticated-orcid":false,"given":"Yingying","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Computer and Information Sciences, University of Strathclyde, Glasgow, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9944-0369","authenticated-orcid":false,"given":"Rui","family":"Zhu","sequence":"additional","affiliation":[{"name":"Bayes Business School, City, University of London, London, United Kingdom"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6220-029X","authenticated-orcid":false,"given":"Yujiang","family":"Wang","sequence":"additional","affiliation":[{"name":"Oxford Suzhou Centre for Advanced Research, Suzhou, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8897-5931","authenticated-orcid":false,"given":"Mingzhi","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2607-916X","authenticated-orcid":false,"given":"Yuhu","family":"Chang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9437-1376","authenticated-orcid":false,"given":"Qin","family":"Lv","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Colorado Boulder, Boulder, Colorado, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5428-9530","authenticated-orcid":false,"given":"Robert P.","family":"Dick","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, Michigan, United States"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2164-8175","authenticated-orcid":false,"given":"Fan","family":"Yang","sequence":"additional","affiliation":[{"name":"School of Microelectronics, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6633-4826","authenticated-orcid":false,"given":"Tun","family":"Lu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2915-974X","authenticated-orcid":false,"given":"Ning","family":"Gu","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3944-7531","authenticated-orcid":false,"given":"Li","family":"Shang","sequence":"additional","affiliation":[{"name":"School of Computer Science, Fudan University, Shanghai, China"}]}],"member":"320","published-online":{"date-parts":[[2024,5,15]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.mlwa.2020.100006"},{"key":"e_1_2_1_2_1","volume-title":"International Conference on Machine Learning. PMLR, 337--371","author":"Aher Gati V","year":"2023","unstructured":"Gati V Aher, Rosa I Arriaga, and Adam Tauman Kalai. 2023. Using large language models to simulate multiple humans and replicate human subject studies. In International Conference on Machine Learning. PMLR, 337--371."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/3415187"},{"key":"e_1_2_1_4_1","volume-title":"MPCHAT: Towards Multimodal Persona-Grounded Conversation. arXiv:2305.17388 [cs.CL]","author":"Ahn Jaewoo","year":"2023","unstructured":"Jaewoo Ahn, Yeda Song, Sangdoo Yun, and Gunhee Kim. 2023. MPCHAT: Towards Multimodal Persona-Grounded Conversation. arXiv:2305.17388 [cs.CL]"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1037\/h0073629"},{"key":"e_1_2_1_6_1","volume-title":"The Falcon Series of Language Models:Towards Open Frontier Models. Hugging Face repository","author":"Almazrouei Ebtesam","year":"2023","unstructured":"Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Merouane Debbah, Etienne Goffinet, Daniel Heslow, Julien Launay, Quentin Malartic, Badreddine Noune, Baptiste Pannier, and Guilherme Penedo. 2023. The Falcon Series of Language Models:Towards Open Frontier Models. Hugging Face repository (2023)."},{"key":"e_1_2_1_7_1","unstructured":"Jinze Bai Shuai Bai Yunfei Chu Zeyu Cui Kai Dang Xiaodong Deng Yang Fan Wenbin Ge Yu Han Fei Huang Binyuan Hui Luo Ji Mei Li Junyang Lin Runji Lin Dayiheng Liu Gao Liu Chengqiang Lu Keming Lu Jianxin Ma Rui Men Xingzhang Ren Xuancheng Ren Chuanqi Tan Sinan Tan Jianhong Tu Peng Wang Shijie Wang Wei Wang Shengguang Wu Benfeng Xu Jin Xu An Yang Hao Yang Jian Yang Shusheng Yang Yang Yao Bowen Yu Hongyi Yuan Zheng Yuan Jianwei Zhang Xingxuan Zhang Yichang Zhang Zhenru Zhang Chang Zhou Jingren Zhou Xiaohuan Zhou and Tianhang Zhu. 2023. Qwen Technical Report. arXiv preprint arXiv:2309.16609 (2023)."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.paid.2008.12.011"},{"key":"e_1_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Iz Beltagy Kyle Lo and Arman Cohan. 2019. SciBERT: A Pretrained Language Model for Scientific Text. arXiv:1903.10676 [cs.CL]","DOI":"10.18653\/v1\/D19-1371"},{"key":"e_1_2_1_10_1","doi-asserted-by":"crossref","unstructured":"Maciej Besta Nils Blach Ales Kubicek Robert Gerstenberger Lukas Gianinazzi Joanna Gajda Tomasz Lehmann Michal Podstawski Hubert Niewiadomski Piotr Nyczyk et al. 2023. Graph of thoughts: Solving elaborate problems with large language models. arXiv preprint arXiv:2308.09687 (2023).","DOI":"10.1609\/aaai.v38i16.29720"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300651"},{"key":"e_1_2_1_12_1","volume-title":"Yuanzhi Li, Scott Lundberg, et al.","author":"Bubeck S\u00e9bastien","year":"2023","unstructured":"S\u00e9bastien Bubeck, Varun Chandrasekaran, Ronen Eldan, Johannes Gehrke, Eric Horvitz, Ece Kamar, Peter Lee, Yin Tat Lee, Yuanzhi Li, Scott Lundberg, et al. 2023. Sparks of artificial general intelligence: Early experiments with gpt-4. arXiv preprint arXiv:2303.12712 (2023)."},{"key":"e_1_2_1_13_1","unstructured":"USC Bureau. 2010. Frequently occurring surnames from the 2010 census. https:\/\/www.census.gov\/topics\/population\/genealogy\/data\/2010_surnames.html"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3486622.3493992"},{"key":"e_1_2_1_15_1","volume-title":"Proceedings of the 4th International Workshop on Human-Computer Conversation. 1--5.","author":"Castellano Ginevra","year":"2008","unstructured":"Ginevra Castellano, Ruth Aylett, Kerstin Dautenhahn, Ana Paiva, Peter W McOwan, and Steve Ho. 2008. Long-term affect sensitive and socially interactive companions. In Proceedings of the 4th International Workshop on Human-Computer Conversation. 1--5."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICASSP39728.2021.9414624"},{"key":"e_1_2_1_17_1","doi-asserted-by":"crossref","unstructured":"Yupeng Chang Xu Wang Jindong Wang Yuan Wu Linyi Yang Kaijie Zhu Hao Chen Xiaoyuan Yi Cunxiang Wang Yidong Wang Wei Ye Yue Zhang Yi Chang Philip S. Yu Qiang Yang and Xing Xie. 2023. A Survey on Evaluation of Large Language Models. arXiv:2307.03109 [cs.CL]","DOI":"10.1145\/3641289"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3463509"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCE-Taiwan49838.2020.9258014"},{"key":"e_1_2_1_20_1","volume-title":"Xing","author":"Chiang Wei-Lin","year":"2023","unstructured":"Wei-Lin Chiang, Zhuohan Li, Zi Lin, Ying Sheng, Zhanghao Wu, Hao Zhang, Lianmin Zheng, Siyuan Zhuang, Yonghao Zhuang, Joseph E. Gonzalez, Ion Stoica, and Eric P. Xing. 2023. Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality. https:\/\/lmsys.org\/blog\/2023-03-30-vicuna\/"},{"key":"e_1_2_1_21_1","volume-title":"A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future. arXiv preprint arXiv:2309.15402","author":"Chu Zheng","year":"2023","unstructured":"Zheng Chu, Jingchang Chen, Qianglong Chen, Weijiang Yu, Tao He, Haotian Wang, Weihua Peng, Ming Liu, Bing Qin, and Ting Liu. 2023. A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future. arXiv preprint arXiv:2309.15402 (2023)."},{"key":"e_1_2_1_22_1","volume-title":"Using language","author":"Clark Herbert H","unstructured":"Herbert H Clark. 1996. Using language. Cambridge university press."},{"key":"e_1_2_1_23_1","volume-title":"Context and common ground. Concise Encyclopedia of Philosophy of Language and Linguistics (2006)","author":"Clark Herbert H","year":"2006","unstructured":"Herbert H Clark and Keith Brown. 2006. Context and common ground. Concise Encyclopedia of Philosophy of Language and Linguistics (2006) (2006), 85--87."},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/0364-0213(89)90008-6"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300705"},{"key":"e_1_2_1_26_1","unstructured":"Alibaba Cloud. 2023. Intelligent Speech Interaction for Human-Computer Interaction - Alibaba Cloud --- alibabacloud.com. https:\/\/www.alibabacloud.com\/product\/intelligent-speech-interaction. [Accessed 10-08-2023]."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971648.2971752"},{"key":"e_1_2_1_28_1","volume-title":"Visual Dialog. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Das Abhishek","year":"2017","unstructured":"Abhishek Das, Satwik Kottur, Khushi Gupta, Avi Singh, Deshraj Yadav, Jose M. F. Moura, Devi Parikh, and Dhruv Batra. 2017. Visual Dialog. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10462-020-09866-x"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1145\/3267305.3267316"},{"key":"e_1_2_1_31_1","volume-title":"Competition: From Machine Learning to Intelligent Conversations","author":"Dinan Emily","year":"2020","unstructured":"Emily Dinan, Varvara Logacheva, Valentin Malykh, Alexander Miller, Kurt Shuster, Jack Urbanek, Douwe Kiela, Arthur Szlam, Iulian Serban, Ryan Lowe, et al. 2020. The second conversational intelligence challenge (convai2). In The NeurIPS'18 Competition: From Machine Learning to Intelligent Conversations. Springer, 187--208."},{"key":"e_1_2_1_32_1","volume-title":"A survey for in-context learning. arXiv preprint arXiv:2301.00234","author":"Dong Qingxiu","year":"2022","unstructured":"Qingxiu Dong, Lei Li, Damai Dai, Ce Zheng, Zhiyong Wu, Baobao Chang, Xu Sun, Jingjing Xu, and Zhifang Sui. 2022. A survey for in-context learning. arXiv preprint arXiv:2301.00234 (2022)."},{"key":"e_1_2_1_33_1","unstructured":"Torantulino et al. [n. d.]. AutoGPT. https:\/\/github.com\/Significant-Gravitas\/Auto-GPT."},{"key":"e_1_2_1_34_1","volume-title":"Being polite: Modeling politeness variation in a personalized dialog agent","author":"Firdaus Mauajama","year":"2022","unstructured":"Mauajama Firdaus, Arunav Shandilya, Asif Ekbal, and Pushpak Bhattacharyya. 2022. Being polite: Modeling politeness variation in a personalized dialog agent. IEEE Transactions on Computational Social Systems (2022)."},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.newideapsych.2021.100877"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2632048.2632079"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3383123"},{"key":"e_1_2_1_38_1","unstructured":"Humane. 2024. Humane AI Pin. https:\/\/hu.ma.ne\/aipin."},{"key":"e_1_2_1_39_1","unstructured":"Qualcomm Technologies Inc. 2023. Qualcomm Snapdragon Wear 4100 Plus Platform | New Smartwatch Processor | Qualcomm --- qualcomm.com. https:\/\/www.qualcomm.com\/products\/mobile\/snapdragon\/wearables\/snapdragon-wear-4100-plus-platform. [Accessed 10-08-2023]."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/3214273"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1145\/3240167.3240174"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1080\/01488376.2011.580697"},{"key":"e_1_2_1_43_1","unstructured":"Bo Li Yuanhan Zhang Liangyu Chen Jinghao Wang Fanyi Pu Jingkang Yang Chunyuan Li and Ziwei Liu. 2023. MIMIC-IT: Multi-Modal In-Context Instruction Tuning. arXiv:2306.05425 [cs.CV]"},{"key":"e_1_2_1_44_1","unstructured":"Junnan Li Dongxu Li Silvio Savarese and Steven Hoi. 2023. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models. arXiv:2301.12597 [cs.CV]"},{"key":"e_1_2_1_45_1","volume-title":"Acute-eval: Improved dialogue evaluation with optimized questions and multi-turn comparisons. arXiv preprint arXiv:1909.03087","author":"Li Margaret","year":"2019","unstructured":"Margaret Li, Jason Weston, and Stephen Roller. 2019. Acute-eval: Improved dialogue evaluation with optimized questions and multi-turn comparisons. arXiv preprint arXiv:1909.03087 (2019)."},{"key":"e_1_2_1_46_1","volume-title":"Privacy-preserving prompt tuning for large language model services. arXiv preprint arXiv:2305.06212","author":"Li Yansong","year":"2023","unstructured":"Yansong Li, Zhixing Tan, and Yang Liu. 2023. Privacy-preserving prompt tuning for large language model services. arXiv preprint arXiv:2305.06212 (2023)."},{"key":"e_1_2_1_47_1","volume-title":"Towards standard criteria for human evaluation of Chatbots: a survey. arXiv preprint arXiv:2105.11197","author":"Liang Hongru","year":"2021","unstructured":"Hongru Liang and Huaqing Li. 2021. Towards standard criteria for human evaluation of Chatbots: a survey. arXiv preprint arXiv:2105.11197 (2021)."},{"key":"e_1_2_1_48_1","unstructured":"Haotian Liu Chunyuan Li Qingyang Wu and Yong Jae Lee. 2023. Visual Instruction Tuning. (2023)."},{"key":"e_1_2_1_49_1","volume-title":"RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation. arXiv preprint arXiv:2306.07206","author":"Liu Shuai","year":"2023","unstructured":"Shuai Liu, Hyundong J Cho, Marjorie Freedman, Xuezhe Ma, and Jonathan May. 2023. RECAP: Retrieval-Enhanced Context-Aware Prefix Encoder for Personalized Dialogue Response Generation. arXiv preprint arXiv:2306.07206 (2023)."},{"key":"e_1_2_1_50_1","unstructured":"Encode OSS Ltd. 2023. Starlette --- starlette.io. https:\/\/www.starlette.io\/. [Accessed 10-08-2023]."},{"key":"e_1_2_1_51_1","unstructured":"Redis Ltd. 2023. Redis --- redis.io. https:\/\/redis.io\/. [Accessed 10-08-2023]."},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.27.070203.144157"},{"key":"e_1_2_1_53_1","unstructured":"Meta. 2024. Ray-Ban Meta Smart Glasses. https:\/\/www.meta.com\/smart-glasses\/."},{"key":"e_1_2_1_54_1","unstructured":"Nasrin Mostafazadeh Chris Brockett Bill Dolan Michel Galley Jianfeng Gao Georgios P. Spithourakis and Lucy Vanderwende. 2017. Image-Grounded Conversations: Multimodal Context for Natural Question and Response Generation. arXiv:1701.08251 [cs.CL]"},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-48051-9_17"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1037\/14404-000"},{"key":"e_1_2_1_57_1","unstructured":"OpenAI. 2022. Introducing ChatGPT. https:\/\/openai.com\/blog\/chatgpt."},{"key":"e_1_2_1_58_1","unstructured":"OpenAI. 2023. GPT-4 Technical Report. arXiv:arXiv:2303.08774"},{"key":"e_1_2_1_59_1","first-page":"27730","article-title":"Training language models to follow instructions with human feedback","volume":"35","author":"Ouyang Long","year":"2022","unstructured":"Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems 35 (2022), 27730--27744.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-05654-3_4"},{"key":"e_1_2_1_61_1","volume-title":"Percy Liang, and Michael S.","author":"Park Joon Sung","year":"2023","unstructured":"Joon Sung Park, Joseph C. O'Brien, Carrie J. Cai, Meredith Ringel Morris, Percy Liang, and Michael S. Bernstein. 2023. Generative Agents: Interactive Simulacra of Human Behavior. arXiv:2304.03442 [cs.HC]"},{"key":"e_1_2_1_62_1","volume-title":"Summarization is (almost) dead. arXiv preprint arXiv:2309.09558","author":"Pu Xiao","year":"2023","unstructured":"Xiao Pu, Mingqi Gao, and Xiaojun Wan. 2023. Summarization is (almost) dead. arXiv preprint arXiv:2309.09558 (2023)."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1145\/3610910"},{"key":"e_1_2_1_64_1","volume-title":"Communicative agents for software development. arXiv preprint arXiv:2307.07924","author":"Qian Chen","year":"2023","unstructured":"Chen Qian, Xin Cong, Cheng Yang, Weize Chen, Yusheng Su, Juyuan Xu, Zhiyuan Liu, and Maosong Sun. 2023. Communicative agents for software development. arXiv preprint arXiv:2307.07924 (2023)."},{"key":"e_1_2_1_65_1","unstructured":"Rabbit. 2024. Rabbit. https:\/\/www.rabbit.tech\/."},{"key":"e_1_2_1_66_1","volume-title":"International Conference on Machine Learning. PMLR, 28492--28518","author":"Radford Alec","year":"2023","unstructured":"Alec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, and Ilya Sutskever. 2023. Robust speech recognition via large-scale weak supervision. In International Conference on Machine Learning. PMLR, 28492--28518."},{"key":"e_1_2_1_67_1","unstructured":"Ashwin Ram Rohit Prasad Chandra Khatri Anu Venkatesh Raefer Gabriel Qing Liu Jeff Nunn Behnam Hedayatnia Ming Cheng Ashish Nagar et al. 2018. Conversational ai: The science behind the alexa prize. arXiv preprint arXiv:1801.03604 (2018)."},{"key":"e_1_2_1_68_1","unstructured":"Sebasti\u00e1n Ram\u00edrez. 2023. FastAPI --- fastapi.tiangolo.com. https:\/\/fastapi.tiangolo.com\/. [Accessed 10-08-2023]."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_2_1_70_1","doi-asserted-by":"publisher","DOI":"10.1145\/3432223"},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.4018\/IJSPPC.325475"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCE50685.2021.9427763"},{"key":"e_1_2_1_73_1","volume-title":"The Open-domain Paradox for Chatbots: Common Ground as the Basis for Human-like Dialogue. arXiv preprint arXiv:2303.11708","author":"Skantze Gabriel","year":"2023","unstructured":"Gabriel Skantze and A Seza Do\u011fru\u00f6z. 2023. The Open-domain Paradox for Chatbots: Common Ground as the Basis for Human-like Dialogue. arXiv preprint arXiv:2303.11708 (2023)."},{"key":"e_1_2_1_74_1","volume-title":"Human evaluation of conversations is an open problem: comparing the sensitivity of various methods for evaluating dialogue agents. arXiv preprint arXiv:2201.04723","author":"Smith Eric Michael","year":"2022","unstructured":"Eric Michael Smith, Orion Hsu, Rebecca Qian, Stephen Roller, Y-Lan Boureau, and Jason Weston. 2022. Human evaluation of conversations is an open problem: comparing the sensitivity of various methods for evaluating dialogue agents. arXiv preprint arXiv:2201.04723 (2022)."},{"key":"e_1_2_1_75_1","volume-title":"Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona. arXiv preprint arXiv:2305.11482","author":"Tang Yihong","year":"2023","unstructured":"Yihong Tang, Bo Wang, Miao Fang, Dongming Zhao, Kun Huang, Ruifang He, and Yuexian Hou. 2023. Enhancing Personalized Dialogue Generation with Contrastive Latent Variables: Combining Sparse and Dense Persona. arXiv preprint arXiv:2305.11482 (2023)."},{"key":"e_1_2_1_76_1","unstructured":"Gemini Team Rohan Anil Sebastian Borgeaud Yonghui Wu Jean-Baptiste Alayrac Jiahui Yu Radu Soricut Johan Schalkwyk Andrew M Dai Anja Hauth et al. 2023. Gemini: a family of highly capable multimodal models. arXiv preprint arXiv:2312.11805 (2023)."},{"key":"e_1_2_1_77_1","unstructured":"Hugo Touvron Louis Martin Kevin Stone Peter Albert Amjad Almahairi Yasmine Babaei Nikolay Bashlykov Soumya Batra Prajjwal Bhargava Shruti Bhosale et al. 2023. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288 (2023)."},{"key":"e_1_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.86.2.320"},{"key":"e_1_2_1_79_1","unstructured":"Anushree Venkatesh Chandra Khatri Ashwin Ram Fenfei Guo Raefer Gabriel Ashish Nagar Rohit Prasad Ming Cheng Behnam Hedayatnia Angeliki Metallinou et al. 2017. On evaluating and comparing conversational agents. (2017)."},{"key":"e_1_2_1_80_1","doi-asserted-by":"publisher","DOI":"10.1145\/3448016.3457550"},{"key":"e_1_2_1_81_1","volume-title":"Is ChatGPT a good sentiment analyzer? A preliminary study. arXiv preprint arXiv:2304.04339","author":"Wang Zengzhi","year":"2023","unstructured":"Zengzhi Wang, Qiming Xie, Zixiang Ding, Yi Feng, and Rui Xia. 2023. Is ChatGPT a good sentiment analyzer? A preliminary study. arXiv preprint arXiv:2304.04339 (2023)."},{"key":"e_1_2_1_82_1","volume-title":"Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus.","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Yi Tay, Rishi Bommasani, Colin Raffel, Barret Zoph, Sebastian Borgeaud, Dani Yogatama, Maarten Bosma, Denny Zhou, Donald Metzler, Ed H. Chi, Tatsunori Hashimoto, Oriol Vinyals, Percy Liang, Jeff Dean, and William Fedus. 2022. Emergent Abilities of Large Language Models. arXiv:2206.07682 [cs.CL]"},{"key":"e_1_2_1_83_1","first-page":"24824","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei Jason","year":"2022","unstructured":"Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Fei Xia, Ed Chi, Quoc V Le, Denny Zhou, et al. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems 35 (2022), 24824--24837.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_84_1","volume-title":"International Workshop on Machine Learning for Multimodal Interaction. Springer, 36--45","author":"Wilks Yorick","year":"2004","unstructured":"Yorick Wilks. 2004. Artificial companions. In International Workshop on Machine Learning for Multimodal Interaction. Springer, 36--45."},{"key":"e_1_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1080\/01488376.2017.1329775"},{"key":"e_1_2_1_86_1","volume-title":"Unveiling security, privacy, and ethical concerns of chatgpt. Journal of Information and Intelligence","author":"Wu Xiaodong","year":"2023","unstructured":"Xiaodong Wu, Ran Duan, and Jianbing Ni. 2023. Unveiling security, privacy, and ethical concerns of chatgpt. Journal of Information and Intelligence (2023)."},{"key":"e_1_2_1_87_1","unstructured":"Zhiheng Xi Wenxiang Chen Xin Guo Wei He Yiwen Ding Boyang Hong Ming Zhang Junzhe Wang Senjie Jin Enyu Zhou et al. 2023. The rise and potential of large language model based agents: A survey. arXiv preprint arXiv:2309.07864 (2023)."},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2022.acl-long.356"},{"key":"e_1_2_1_89_1","unstructured":"Xinchao Xu Zhibin Gou Wenquan Wu Zheng-Yu Niu Hua Wu Haifeng Wang and Shihang Wang. 2022. Long Time No See! Open-Domain Conversation with Long-Term Persona Memory. arXiv:2203.05797 [cs.CL]"},{"key":"e_1_2_1_90_1","volume-title":"Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601","author":"Yao Shunyu","year":"2023","unstructured":"Shunyu Yao, Dian Yu, Jeffrey Zhao, Izhak Shafran, Thomas L Griffiths, Yuan Cao, and Karthik Narasimhan. 2023. Tree of thoughts: Deliberate problem solving with large language models. arXiv preprint arXiv:2305.10601 (2023)."},{"key":"e_1_2_1_91_1","volume-title":"React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629","author":"Yao Shunyu","year":"2022","unstructured":"Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik Narasimhan, and Yuan Cao. 2022. React: Synergizing reasoning and acting in language models. arXiv preprint arXiv:2210.03629 (2022)."},{"key":"e_1_2_1_92_1","unstructured":"Qinghao Ye Haiyang Xu Guohai Xu Jiabo Ye Ming Yan Yiyang Zhou Junyang Wang Anwen Hu Pengcheng Shi Yaya Shi Chenliang Li Yuanhong Xu Hehong Chen Junfeng Tian Qian Qi Ji Zhang and Fei Huang. 2023. mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality. arXiv:2304.14178 [cs.CL]"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1145\/2915926.2915952"},{"key":"e_1_2_1_94_1","doi-asserted-by":"crossref","unstructured":"Saizheng Zhang Emily Dinan Jack Urbanek Arthur Szlam Douwe Kiela and Jason Weston. 2018. Personalizing Dialogue Agents: I have a dog do you have pets too? arXiv:1801.07243 [cs.AI]","DOI":"10.18653\/v1\/P18-1205"},{"key":"e_1_2_1_95_1","unstructured":"Wayne Xin Zhao Kun Zhou Junyi Li Tianyi Tang Xiaolei Wang Yupeng Hou Yingqian Min Beichen Zhang Junjie Zhang Zican Dong et al. 2023. A survey of large language models. arXiv preprint arXiv:2303.18223 (2023)."},{"key":"e_1_2_1_96_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/3517250","article-title":"Do smart glasses dream of sentimental visions? Deep emotionship analysis for eyewear devices","volume":"6","author":"Zhao Yingying","year":"2022","unstructured":"Yingying Zhao, Yuhu Chang, Yutian Lu, Yujiang Wang, Mingzhi Dong, Qin Lv, Robert P Dick, Fan Yang, Tun Lu, Ning Gu, et al. 2022. Do smart glasses dream of sentimental visions? Deep emotionship analysis for eyewear devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1--29.","journal-title":"Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"},{"key":"e_1_2_1_97_1","doi-asserted-by":"crossref","unstructured":"Wanjun Zhong Lianghong Guo Qiqi Gao He Ye and Yanlin Wang. 2023. MemoryBank: Enhancing Large Language Models with Long-Term Memory. arXiv:2305.10250 [cs.CL]","DOI":"10.1609\/aaai.v38i17.29946"},{"key":"e_1_2_1_98_1","volume-title":"Jay Pujara, and Xiang Ren.","author":"Zhou Pei","year":"2022","unstructured":"Pei Zhou, Hyundong Cho, Pegah Jandaghi, Dong-Ho Lee, Bill Yuchen Lin, Jay Pujara, and Xiang Ren. 2022. Reflect, Not Reflex: Inference-Based Common Ground Improves Dialogue Response Quality. arXiv:2211.09267 [cs.CL]"},{"key":"e_1_2_1_99_1","unstructured":"Deyao Zhu Jun Chen Xiaoqian Shen Xiang Li and Mohamed Elhoseiny. 2023. MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models. arXiv:2304.10592 [cs.CV]"}],"container-title":["Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659600","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3659600","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:02:01Z","timestamp":1755882121000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3659600"}},"subtitle":["An LLM-Based Eyewear System with Conversational Common Ground"],"short-title":[],"issued":{"date-parts":[[2024,5,13]]},"references-count":99,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2024,5,13]]}},"alternative-id":["10.1145\/3659600"],"URL":"https:\/\/doi.org\/10.1145\/3659600","relation":{},"ISSN":["2474-9567"],"issn-type":[{"value":"2474-9567","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,13]]},"assertion":[{"value":"2024-05-15","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}