{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T08:25:53Z","timestamp":1773390353632,"version":"3.50.1"},"reference-count":48,"publisher":"Association for Computing Machinery (ACM)","issue":"CSCW2","license":[{"start":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T00:00:00Z","timestamp":1696377600000},"content-version":"vor","delay-in-days":6,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["2021280804"],"award-info":[{"award-number":["2021280804"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Hum.-Comput. Interact."],"published-print":{"date-parts":[[2023,9,28]]},"abstract":"<jats:p>While commercial conversational agents (CA) (i.e. Google assistant, Siri, Alexa) are widely used, these systems have limitations in error-handling, flexibility, personalization and overall dialogue management that are amplified in care coordination settings. In this paper, we synthesize and articulate these limitations through quantitative and qualitative analysis of 56 older adults interacting with a commercial CA deployed in their home for a 10 week period. We look at the CA as a compensatory technology in an older adult's care network. We argue that the CA limitations are rooted in the rigid cue-and-response style of task-oriented interactions common in CAs. We then propose a redesign for CA conversation flow to favor flexibility and personalization that is nonetheless viable within the limitations of current AI and machine learning technologies. We explore design tradeoffs to better support the usability needs of older adults compared to current design optimizations driven by efficiency and privacy goals.<\/jats:p>","DOI":"10.1145\/3610170","type":"journal-article","created":{"date-parts":[[2023,10,4]],"date-time":"2023-10-04T15:54:10Z","timestamp":1696434850000},"page":"1-28","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":16,"title":["\"I don't know how to help with that\" - Learning from Limitations of Modern Conversational Agent Systems in Caregiving Networks"],"prefix":"10.1145","volume":"7","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7902-8115","authenticated-orcid":false,"given":"Tamara","family":"Zubatiy","sequence":"first","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3969-7787","authenticated-orcid":false,"given":"Niharika","family":"Mathur","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3358-6362","authenticated-orcid":false,"given":"Larry","family":"Heck","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1200-911X","authenticated-orcid":false,"given":"Kayci L.","family":"Vickers","sequence":"additional","affiliation":[{"name":"Emory University, Atlanta, GA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5558-9786","authenticated-orcid":false,"given":"Agata","family":"Rozga","sequence":"additional","affiliation":[{"name":"Georgia Institute of Technology, Atlanta, GA, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8486-9384","authenticated-orcid":false,"given":"Elizabeth D.","family":"Mynatt","sequence":"additional","affiliation":[{"name":"Northeastern University, Boston, MA, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,10,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Daniel Adiwardana Minh-Thang Luong David R So Jamie Hall Noah Fiedel Romal Thoppilan Zi Yang Apoorv Kulshreshtha Gaurav Nemade Lu et al. 2020. Towards a human-like open-domain chatbot. ArXiv:2001.09977 (2020)."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.gerinurse.2018.11.002"},{"key":"e_1_2_1_3_1","first-page":"316","article-title":"A home-based individualized information communication technology training program for older adults: a demonstration of effectiveness and value","volume":"11","author":"Arthanat Sajay","year":"2016","unstructured":"Sajay Arthanat, Kerryellen G Vroman, and Catherine Lysack. 2016. A home-based individualized information communication technology training program for older adults: a demonstration of effectiveness and value. Disability and Rehabilitation: Assistive Technology 11, 4 (2016), 316--324.","journal-title":"Disability and Rehabilitation: Assistive Technology"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1080\/17483107.2018.1493752"},{"key":"e_1_2_1_5_1","volume-title":"proceedings","volume":"2018","author":"Azevedo Renato FL","year":"2018","unstructured":"Renato FL Azevedo, Dan Morrow, James Graumlich, Ann Willemsen-Dunlap, Mark Hasegawa-Johnson, Thomas S Huang, Kuangxiao Gu, Suma Bhat, Tarek Sakakini, Victor Sadauskas, et al. 2018. Using conversational agents to explain medication instructions to older adults. In AMIA annual symp. proceedings, Vol. 2018. American Medical Informatics Association, 185."},{"key":"e_1_2_1_6_1","volume-title":"Plato-xl: Exploring the large-scale pre-training of dialogue generation. arXiv preprint arXiv:2109.09519","author":"Bao Siqi","year":"2021","unstructured":"Siqi Bao, Huang He, Fan Wang, Hua Wu, Haifeng Wang, Wenquan Wu, Zhihua Wu, Zhen Guo, Hua Lu, Xinxian Huang, et al. 2021. Plato-xl: Exploring the large-scale pre-training of dialogue generation. arXiv preprint arXiv:2109.09519 (2021)."},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3491102.3517683"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300473"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/3264901"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3484507"},{"key":"e_1_2_1_11_1","volume-title":"MultiWOZ--a large-scale multi-domain wizard-of-oz dataset for task-oriented dialogue modelling. arXiv preprint arXiv:1810.00278","author":"Budzianowski Pawel","year":"2018","unstructured":"Pawel Budzianowski, Tsung-Hsien Wen, Bo-Hsiang Tseng, Inigo Casanueva, Stefan Ultes, Osman Ramadan, and Milica Gasic. 2018. MultiWOZ--a large-scale multi-domain wizard-of-oz dataset for task-oriented dialogue modelling. arXiv preprint arXiv:1810.00278 (2018)."},{"key":"e_1_2_1_12_1","volume-title":"Effect of conceptual and lexical errorless versus trial-and-error learning in amnestic mild cognitive impairment. Neuropsychological rehabilitation 29, 6","author":"Callahan Brandy L","year":"2019","unstructured":"Brandy L Callahan and Nicole D Anderson. 2019. Effect of conceptual and lexical errorless versus trial-and-error learning in amnestic mild cognitive impairment. Neuropsychological rehabilitation 29, 6 (2019), 969--982."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3449101"},{"key":"e_1_2_1_14_1","volume-title":"Telecommunications technology as an aid to family caregivers of persons with dementia. Psychosomatic medicine 64, 3","author":"Czaja Sara J","year":"2002","unstructured":"Sara J Czaja and Mark P Rubert. 2002. Telecommunications technology as an aid to family caregivers of persons with dementia. Psychosomatic medicine 64, 3 (2002), 469--476."},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/1178477.1178484"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/3209882"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1080\/03601277.2017.1395986"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2675133.2675252"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1038\/scientificamerican0984-52"},{"key":"e_1_2_1_20_1","volume-title":"Voice Assistant Demographic Data--Young Consumers More Likely to Own Smart Speakers While Over 60 Bias Toward Alexa and Siri. Voicebot. ai 21","author":"Kinsella Bret","year":"2019","unstructured":"Bret Kinsella. 2019. Voice Assistant Demographic Data--Young Consumers More Likely to Own Smart Speakers While Over 60 Bias Toward Alexa and Siri. Voicebot. ai 21 (2019)."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1145\/354401.354406"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1089\/153056203766437525"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.2196\/38525"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/0953-5438(89)90016-7"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/2399193.2399195"},{"key":"e_1_2_1_26_1","volume-title":"The use of errorless learning strategies for patients with Alzheimer's disease: A literature review. Int'l Journal of rehabilitation research 35, 4","author":"Li Ruijie","year":"2012","unstructured":"Ruijie Li and Karen PY Liu. 2012. The use of errorless learning strategies for patients with Alzheimer's disease: A literature review. Int'l Journal of rehabilitation research 35, 4 (2012), 292--298."},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1093\/geront\/gnz178"},{"key":"e_1_2_1_28_1","volume-title":"Clinical outcomes of aging in place. Nursing research 54, 3","author":"Marek Karen Dorman","year":"2005","unstructured":"Karen Dorman Marek, Lori Popejoy, Greg Petroski, David Mehr, Marilyn Rantz, and Wen-Chieh Lin. 2005. Clinical outcomes of aging in place. Nursing research 54, 3 (2005), 202--211."},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/169059.169215"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1532-5415.2005.53221.x"},{"key":"e_1_2_1_31_1","volume-title":"Da Young Ju, et al","author":"Oh Young Hoon","year":"2020","unstructured":"Young Hoon Oh, Kyungjin Chung, Da Young Ju, et al. 2020. Differences in interactions with a conversational agent. Int'l journal of environmental research and public health 17, 9 (2020), 3189."},{"key":"e_1_2_1_32_1","volume-title":"Technology for aging in place. Aging in Place Technology Watch","author":"Orlov Laurie M","year":"2012","unstructured":"Laurie M Orlov. 2012. Technology for aging in place. Aging in Place Technology Watch (2012)."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.48550\/ARXIV.2206.11309"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1212\/WNL.0000000000004826"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1177\/1460458220955104"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3174214"},{"key":"e_1_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Margherita Rampioni Vera Stara Elisa Felici Lorena Rossi Susy Paolini et al. 2021. Embodied conversational agents for patients with dementia: Thematic literature analysis. JMIR mHealth and uHealth 9 7 (2021) e25381.","DOI":"10.2196\/25381"},{"key":"e_1_2_1_38_1","volume-title":"Robert SP Jones, and Linda Clare","author":"Roberts Judith L","year":"2018","unstructured":"Judith L Roberts, Nicole D Anderson, Emma Guild, Andr\u00e9e-Ann Cyr, Robert SP Jones, and Linda Clare. 2018. The benefits of errorless learning for people with amnestic mild cognitive impairment. Neuropsychological rehabilitation 28, 6 (2018), 984--996."},{"key":"e_1_2_1_39_1","doi-asserted-by":"crossref","unstructured":"Stephen Roller Emily Dinan Naman Goyal Da Ju Mary Williamson Yinhan Liu Jing Xu Myle Ott Kurt Shuster Eric M Smith et al. 2020. Recipes for building an open-domain chatbot. arXiv preprint arXiv:2004.13637 (2020).","DOI":"10.18653\/v1\/2021.eacl-main.24"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/1471301213481224"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.3233\/JAD-130887"},{"key":"e_1_2_1_42_1","volume-title":"Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, et al .","author":"Thoppilan Romal","year":"2022","unstructured":"Romal Thoppilan, Daniel De Freitas, Jamie Hall, Noam Shazeer, Apoorv Kulshreshtha, Heng-Tze Cheng, Alicia Jin, Taylor Bos, Leslie Baker, Yu Du, et al . 2022. Lamda: Language models for dialog applications. arXiv preprint arXiv:2201.08239 (2022)."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1177\/0733464815609440"},{"key":"e_1_2_1_44_1","volume-title":"United States: Population projections for 2020 to","author":"Vespa Jonathan","year":"2018","unstructured":"Jonathan Vespa, David M Armstrong, Lauren Medina, et al. 2018. Demographic turning points for the United States: Population projections for 2020 to 2060. US Department of Commerce, Economics and Statistics Administration, US . . . ."},{"key":"e_1_2_1_45_1","volume-title":"The meaning of \"aging in place\" to older people. The gerontologist 52, 3","author":"Wiles Janine L","year":"2012","unstructured":"Janine L Wiles, Annette Leibing, Nancy Guberman, Jeanne Reeve, and Ruth ES Allen. 2012. The meaning of \"aging in place\" to older people. The gerontologist 52, 3 (2012), 357--366."},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v36i10.21416"},{"key":"e_1_2_1_47_1","volume-title":"Dialogpt: Large-scale generative pre-training for conversational response generation. arXiv preprint arXiv:1911.00536","author":"Zhang Yizhe","year":"2019","unstructured":"Yizhe Zhang, Siqi Sun, Michel Galley, Yen-Chun Chen, Chris Brockett, Xiang Gao, Jianfeng Gao, Jingjing Liu, and Bill Dolan. 2019. Dialogpt: Large-scale generative pre-training for conversational response generation. arXiv preprint arXiv:1911.00536 (2019)."},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445124"}],"container-title":["Proceedings of the ACM on Human-Computer Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610170","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610170","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3610170","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,21]],"date-time":"2025-08-21T04:18:03Z","timestamp":1755749883000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3610170"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,9,28]]},"references-count":48,"journal-issue":{"issue":"CSCW2","published-print":{"date-parts":[[2023,9,28]]}},"alternative-id":["10.1145\/3610170"],"URL":"https:\/\/doi.org\/10.1145\/3610170","relation":{},"ISSN":["2573-0142"],"issn-type":[{"value":"2573-0142","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,9,28]]},"assertion":[{"value":"2023-10-04","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}