{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T21:24:24Z","timestamp":1781645064310,"version":"3.54.5"},"reference-count":37,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T00:00:00Z","timestamp":1678838400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Digit. Health"],"abstract":"<jats:sec><jats:title>Introduction<\/jats:title><jats:p>Virtual conversational agents (i.e., chatbots) are an intuitive form of data collection. Understanding older adults' experiences with chatbots could help identify their usability needs. This quality improvement study evaluated older adults' experiences with a chatbot for health data collection. A secondary goal was to understand how perceptions differed based on length of chatbot forms.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>After a demographic survey, participants (\u226560 years) completed either a short (21 questions), moderate (30 questions), or long (66 questions) chatbot form. Perceived ease-of-use, usefulness, usability, likelihood to recommend, and cognitive load were measured post-test. Qualitative and quantitative analyses were used.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>A total of 260 participants reported on usability and satisfaction metrics including perceived ease-of-use (5.8\/7), usefulness (4.7\/7), usability (5.4\/7), and likelihood to recommend (Net Promoter Score\u2009=\u20090). Cognitive load (12.3\/100) was low. There was a statistically significant difference in perceived usefulness between groups, with a significantly higher mean perceived usefulness for Group 1 than Group 3. No other group differences were observed. The chatbot was perceived as quick, easy, and pleasant with concerns about technical issues, privacy, and security. Participants provided suggestions to enhance progress tracking, edit responses, improve readability, and have options to ask questions.<\/jats:p><\/jats:sec><jats:sec><jats:title>Discussion<\/jats:title><jats:p>Older adults found the chatbot to be easy, useful, and usable. The chatbot required low cognitive load demonstrating it could be an enjoyable health data collection tool for older adults. These results will inform the development of a health data collection chatbot technology.<\/jats:p><\/jats:sec>","DOI":"10.3389\/fdgth.2023.1125926","type":"journal-article","created":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T05:20:40Z","timestamp":1678857640000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Older adults' experience with virtual conversational agents for health data collection"],"prefix":"10.3389","volume":"5","author":[{"given":"Hattie","family":"Wilczewski","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiral","family":"Soni","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Julia","family":"Ivanova","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Triton","family":"Ong","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Janelle F.","family":"Barrera","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian E.","family":"Bunnell","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brandon M.","family":"Welch","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2023,3,15]]},"reference":[{"key":"B1","year":""},{"key":"B2","volume-title":"Health Status and health care service utilization","year":"2008"},{"key":"B3","doi-asserted-by":"publisher","first-page":"1711","DOI":"10.1001\/jama.2015.2417","article-title":"Family health history: the case for better tools","volume":"313","author":"Welch","year":"2015","journal-title":"JAMA"},{"key":"B4","doi-asserted-by":"publisher","first-page":"281","DOI":"10.1093\/pubmed\/fdi031","article-title":"Mode of questionnaire administration can have serious effects on data quality","volume":"27","author":"Bowling","year":"2005","journal-title":"J Public Health"},{"key":"B5","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1038\/gim.2014.198","article-title":"Acceptability and feasibility of a virtual counselor (VICKY) to collect family health histories","volume":"17","author":"Wang","year":"2015","journal-title":"Genet Med"},{"key":"B6","author":"Skjuve","year":"2018"},{"key":"B7","doi-asserted-by":"publisher","first-page":"e17158","DOI":"10.2196\/17158","article-title":"Conversational agents in health care: scoping review and conceptual analysis","volume":"22","author":"Car L","year":"2020","journal-title":"J Med Internet Res"},{"key":"B8","doi-asserted-by":"publisher","first-page":"2946","DOI":"10.1177\/1460458220955104","article-title":"An empirical study investigating the user acceptance of a virtual conversational agent interface for family health history collection among the geriatric population","volume":"26","author":"Ponathil","year":"2020","journal-title":"Health Informatics J"},{"key":"B9","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1080\/03601270701364628","article-title":"Older adults seeking healthcare information on the internet","volume":"33","author":"Hardt","year":"2007","journal-title":"Educ Gerontol"},{"key":"B10","volume-title":"Usability for senior citizens: Improved, but still lacking","author":"Nielsen","year":""},{"key":"B11","doi-asserted-by":"publisher","first-page":"e10019","DOI":"10.2196\/10019","article-title":"Mobilizing mHealth data collection in older adults: challenges and opportunities","volume":"2","author":"Cosco","year":"2019","journal-title":"JMIR Aging"},{"key":"B12","doi-asserted-by":"publisher","first-page":"1710","DOI":"10.1016\/j.chb.2010.06.020","article-title":"Older adults talk technology: technology usage and attitudes","volume":"26","author":"Mitzner","year":"2010","journal-title":"Comput Human Behav"},{"key":"B13","doi-asserted-by":"publisher","first-page":"645805","DOI":"10.3389\/fdgth.2021.645805","article-title":"Psychometric properties of a chatbot version of the PHQ-9 with adults and older adults","volume":"3","author":"Dosovitsky","year":"2021","journal-title":"Front Digit Health"},{"key":"B14","unstructured":"2019"},{"key":"B15","article-title":"Online form design: older adults\u2019 access to housing and welfare services","volume":"21","author":"Lines","year":"2004","journal-title":"HCI and the Older Population"},{"key":"B16","doi-asserted-by":"publisher","year":"","DOI":"10.3758\/s13428-021-01694-3"},{"key":"B17","doi-asserted-by":"crossref","DOI":"10.2139\/ssrn.3775075","article-title":"Reply to MTurk, Prolific or panels? Choosing the right audience for online research","author":"Litman","year":"2021","journal-title":"SSRN Electron J"},{"key":"B18","doi-asserted-by":"publisher","first-page":"319","DOI":"10.2307\/249008","article-title":"Perceived usefulness, perceived ease of use, and user acceptance of information technology","volume":"13","author":"Davis","year":"1989","journal-title":"Miss Q"},{"key":"B19","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1080\/10447319509526110","article-title":"IBM Computer usability satisfaction questionnaires: psychometric evaluation and instructions for use","volume":"7","author":"Lewis","year":"1995","journal-title":"Int J Hum Comput Interact"},{"key":"B20","first-page":"139","article-title":"Development of NASA-TLX (task load Index): results of empirical and theoretical research","volume-title":"Advances in psychology","author":"Hart","year":"1988"},{"key":"B21","year":"2021"},{"key":"B22","doi-asserted-by":"publisher","first-page":"2146","DOI":"10.1177\/1049732320924625","article-title":"Use of the patient health questionnaire (PHQ-9) in practice: interactions between patients and physicians","volume":"30","author":"Ford","year":"2020","journal-title":"Qual Health Res"},{"key":"B23","year":""},{"key":"B24","doi-asserted-by":"publisher","first-page":"e27","DOI":"10.2196\/jmir.8.4.e27","article-title":"eHEALS: the eHealth literacy scale","volume":"8","author":"Norman","year":"2006","journal-title":"J Med Internet Res"},{"key":"B25","doi-asserted-by":"publisher","first-page":"1727","DOI":"10.1177\/1541931215591373","article-title":"How high is high? A meta-analysis of NASA-TLX global workload scores","volume":"59","author":"Grier","year":"2015","journal-title":"Proc Hum Fact Ergon Soc Annu Meet"},{"key":"B26","unstructured":""},{"key":"B27","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1191\/1478088706qp063oa","article-title":"Using thematic analysis in psychology","volume":"3","author":"Braun","year":"2006","journal-title":"Qual Res Psychol"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.3389\/fdgth.2022.954069","article-title":"Virtual conversational agents versus online forms: patient experience and preferences for health data collection","volume":"4","author":"Soni","year":"2022","journal-title":"Front Digit Health"},{"key":"B29","doi-asserted-by":"publisher","first-page":"823","DOI":"10.1177\/0149206320969787","article-title":"MTurk research: review and recommendations","volume":"47","author":"Aguinis","year":"2021","journal-title":"J Manage"},{"key":"B30","doi-asserted-by":"publisher","first-page":"1081","DOI":"10.1002\/jgc4.1239","article-title":"Family health history collected by virtual conversational agents: an empirical study to investigate the efficacy of this approach","volume":"29","author":"Ponathil","year":"2020","journal-title":"J Genet Couns"},{"key":"B31","first-page":"396","volume-title":"Intellectual development in adulthood: the Seattle longitudinal study","author":"Warner Schaie","year":"1996"},{"key":"B32","doi-asserted-by":"publisher","first-page":"428","DOI":"10.4017\/gt.2013.11.3.001.00","article-title":"Willingness of older adults to share data and privacy concerns after exposure to unobtrusive in-home monitoring","volume":"11","author":"Boise","year":"2013","journal-title":"Gerontechnology"},{"key":"B33","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1177\/0733464818807468","article-title":"Older adult internet use and eHealth literacy","volume":"39","author":"Arcury","year":"2020","journal-title":"J Appl Gerontol"},{"key":"B34","doi-asserted-by":"publisher","first-page":"e70","DOI":"10.2196\/jmir.3992","article-title":"Ehealth literacy and web 2.0 health information seeking behaviors among baby boomers and older adults","volume":"17","author":"Tennant","year":"2015","journal-title":"J Med Internet Res"},{"key":"B35","doi-asserted-by":"publisher","first-page":"23337214211064228","DOI":"10.1177\/23337214211064227","article-title":"Exploring predictors of eHealth literacy among older adults: findings from the 2020 CALSPEAKS survey","volume":"7","author":"Berkowsky","year":"2021","journal-title":"Gerontol Geriatr Med"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1097\/CIN.0000000000000146","article-title":"Testing reliability and validity of the eHealth literacy scale (eHEALS) for older adults recruited online","author":"Chung","year":"2015","journal-title":"Comput Inform Nurs"},{"key":"B37","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1002\/bdm.1753","article-title":"Data collection in a flat world: the strengths and weaknesses of mechanical Turk samples","volume":"26","author":"Goodman","year":"2013","journal-title":"J Behav Decis Mak"}],"container-title":["Frontiers in Digital Health"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1125926\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,15]],"date-time":"2023-03-15T05:20:48Z","timestamp":1678857648000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fdgth.2023.1125926\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,3,15]]},"references-count":37,"alternative-id":["10.3389\/fdgth.2023.1125926"],"URL":"https:\/\/doi.org\/10.3389\/fdgth.2023.1125926","relation":{},"ISSN":["2673-253X"],"issn-type":[{"value":"2673-253X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,3,15]]},"article-number":"1125926"}}