{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,25]],"date-time":"2025-10-25T12:35:45Z","timestamp":1761395745329,"version":"3.37.3"},"reference-count":39,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,5,15]],"date-time":"2020-05-15T00:00:00Z","timestamp":1589500800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,5,15]],"date-time":"2020-05-15T00:00:00Z","timestamp":1589500800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100007268","name":"Washington University in St. Louis","doi-asserted-by":"publisher","award":["Healthcare Innovation Lab, Department of Anesthesiology and Institute for Informatics"],"award-info":[{"award-number":["Healthcare Innovation Lab, Department of Anesthesiology and Institute for Informatics"]}],"id":[{"id":"10.13039\/100007268","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Voice-based personal assistants using artificial intelligence (AI) have been widely adopted and used in home-based settings. Their success has created considerable interest for its use in healthcare applications; one area of prolific growth in AI is that of voice-based virtual counselors for mental health and well-being. However, in spite of its promise, building realistic virtual counselors to achieve higher-order maturity levels beyond task-based interactions presents considerable conceptual and pragmatic challenges. We describe one such conceptual challenge\u2014cognitive plausibility, defined as the ability of virtual counselors to emulate the human cognitive system by simulating how a skill or function is accomplished. An important cognitive plausibility consideration for voice-based agents is its ability to engage in meaningful and seamless interactive communication. Drawing on a broad interdisciplinary research literature and based on our experiences with developing two voice-based (voice-only) prototypes that are in the early phases of testing, we articulate two conceptual considerations for their design and use\u2014conceptualizing voice-based virtual counselors as communicative agents and establishing virtual co-presence. We discuss why these conceptual considerations are important and how it can lead to the development of voice-based counselors for real-world use.<\/jats:p>","DOI":"10.1038\/s41746-020-0278-7","type":"journal-article","created":{"date-parts":[[2020,5,15]],"date-time":"2020-05-15T10:21:14Z","timestamp":1589538074000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":14,"title":["Cognitive plausibility in voice-based AI health counselors"],"prefix":"10.1038","volume":"3","author":[{"given":"Thomas","family":"Kannampallil","sequence":"first","affiliation":[]},{"given":"Joshua M.","family":"Smyth","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1198-9849","authenticated-orcid":false,"given":"Steve","family":"Jones","sequence":"additional","affiliation":[]},{"given":"Philip R. O.","family":"Payne","sequence":"additional","affiliation":[]},{"given":"Jun","family":"Ma","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,5,15]]},"reference":[{"key":"278_CR1","doi-asserted-by":"publisher","first-page":"44","DOI":"10.1038\/s41591-018-0300-7","volume":"25","author":"E Topol","year":"2019","unstructured":"Topol, E. High-performance medicine: the convergence of human and artificial intelligence. Nat. Med. 25, 44 (2019).","journal-title":"Nat. Med."},{"key":"278_CR2","volume-title":"Deep Medicine: How Artificial Intelligence can make Healthcare Human Again","author":"E Topol","year":"2019","unstructured":"Topol, E. Deep Medicine: How Artificial Intelligence can make Healthcare Human Again (Basic Books, New York, 2019)."},{"key":"278_CR3","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1001\/jama.2018.18932","volume":"321","author":"TM Maddox","year":"2019","unstructured":"Maddox, T. M., Rumsfeld, J. S. & Payne, P. R. Questions for artificial intelligence in health care. JAMA 321, 31\u201332 (2019).","journal-title":"JAMA"},{"key":"278_CR4","unstructured":"Sciuto, A., Saini, A., Forlizzi, J. & Hong, J. I. A mixed-methods studies of in-home conversational agent usage. In Proceedings of the 2018 Designing Interactive Systems Conference 857\u2013868 (ACM, 2018)."},{"key":"278_CR5","doi-asserted-by":"crossref","unstructured":"Cho, M., Lee, S.-s. & Lee, K.-P. Once a kind friend is now a thing: Understanding how conversational agents at home are forgotten. In Proceedings of the 2019 on Designing Interactive Systems Conference, 1557\u20131569 (ACM, 2019).","DOI":"10.1145\/3322276.3322332"},{"key":"278_CR6","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1177\/1461444819858691","volume":"22","author":"AL Guzman","year":"2019","unstructured":"Guzman, A. L. & Lewis, S. C. Artificial intelligence and communication: a human-machine communication research agenda. New Media Soc 22, 70\u201386 (2019).","journal-title":"New Media Soc"},{"key":"278_CR7","doi-asserted-by":"crossref","unstructured":"Luger, E. & Sellen, A. Like having a really bad PA: the gulf between user expectation and experience of conversational agents. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 5286\u20135297 (ACM, 2016).","DOI":"10.1145\/2858036.2858288"},{"key":"278_CR8","unstructured":"Black, S. To benefit the NHS, AI must be guided by intelligence, not hype. https:\/\/blogs.bmj.com\/bmj\/2019\/09\/20\/stephen-black-to-benefit-the-nhs-ai-must-be-guided-by-intelligence-not-hype\/ (2019)."},{"key":"278_CR9","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.1093\/jamia\/ocy072","volume":"25","author":"L Laranjo","year":"2018","unstructured":"Laranjo, L. et al. Conversational agents in healthcare: a systematic review. J. Am. Med. Inform. Assoc. 25, 1248\u20131258 (2018).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"278_CR10","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6553","volume":"19","author":"S Provoost","year":"2017","unstructured":"Provoost, S., Lau, H. M., Ruwaard, J. & Riper, H. Embodied conversational agents in clinical psychology: a scoping review. J. Med. Internet Res. 19, e151 (2017).","journal-title":"J. Med. Internet Res."},{"key":"278_CR11","doi-asserted-by":"publisher","first-page":"102409","DOI":"10.1016\/j.ijhcs.2020.102409","volume":"138","author":"S ter Stal","year":"2020","unstructured":"ter Stal, S., Kramer, L. L., Tabak, M., op den Akker, H. & Hermens, H. Design features of embodied conversational agents in eHealth: a literature review. Int. J. Hum. Comput. Stud 138, 102409 (2020).","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"278_CR12","doi-asserted-by":"crossref","unstructured":"Utami, D. & Bickmore, T. Collaborative user responses in multiparty interaction with a couples counselor robot. In 2019 14th ACM\/IEEE International Conference on Human-Robot Interaction (HRI) 294\u2013303 (IEEE, 2019).","DOI":"10.1109\/HRI.2019.8673177"},{"key":"278_CR13","doi-asserted-by":"crossref","unstructured":"Utami, D., Bickmore, T., Nikolopoulou, A. & Paasche-Orlow, M. Talk about death: End of life planning with a virtual agent. In International Conference on Intelligent Virtual Agents 441\u2013450 (Springer, 2017).","DOI":"10.1007\/978-3-319-67401-8_55"},{"key":"278_CR14","doi-asserted-by":"publisher","first-page":"822","DOI":"10.1038\/gim.2014.198","volume":"17","author":"C Wang","year":"2015","unstructured":"Wang, C. et al. Acceptability and feasibility of a virtual counselor (VICKY) to collect family health histories. Genet. Med. 17, 822\u2013830 (2015).","journal-title":"Genet. Med."},{"key":"278_CR15","doi-asserted-by":"publisher","first-page":"342","DOI":"10.1016\/j.jbi.2016.11.002","volume":"64","author":"TG Kannampallil","year":"2016","unstructured":"Kannampallil, T. G., Abraham, J. & Patel, V. L. Methodological framework for evaluating clinical processes: a cognitive informatics perspective. J. Biomed. Inform. 64, 342\u2013351 (2016).","journal-title":"J. Biomed. Inform."},{"key":"278_CR16","unstructured":"Wenger, E. Artificial Intelligence and Tutoring Systems: Computational and Cognitive Approaches to the Communication of Knowledge (Morgan Kaufmann, 2014)."},{"key":"278_CR17","unstructured":"Kennedy, W. G. Cognitive plausibility in cognitive modeling, artificial Intelligence, and social simulation. In Proceedings of the International Conference on Cognitive Modeling (ICCM), Manchester, UK, 24\u201326 (ICCM, 2009)."},{"key":"278_CR18","doi-asserted-by":"crossref","unstructured":"Nass, C., Steuer, J. & Tauber, E. R. Computers are social actors. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 72\u201378 (ACM, 1994).","DOI":"10.1145\/191666.191703"},{"key":"278_CR19","unstructured":"Reeves, B. & Nass, C. I. The Media Equation: How People Treat Computers, Television, and New Media like Real People and Places (Cambridge University Press, 1996)."},{"key":"278_CR20","doi-asserted-by":"crossref","unstructured":"Brennan, S. E., Galati, A. & Kuhlen, A. K. In Psychology of Learning and Motivation, Vol. 53, 301\u2013344 (Elsevier, 2010).","DOI":"10.1016\/S0079-7421(10)53008-1"},{"key":"278_CR21","unstructured":"Clark, H. H. & Brennan, S. E. In Perspectives on Socially Shared Cognition (eds Resnick, L. B., Levine, J. M. & Teasley, S. D.) 127\u2013149 (APA Books, Washington, 1991)."},{"key":"278_CR22","unstructured":"Clark, H. H. Using Language (Cambridge University Press, 1996)."},{"key":"278_CR23","unstructured":"Shannon, C. E. & Weaver, W. A Mathematical Model of Communication, Vol. 11 (University of Illinois Press, 1949)."},{"key":"278_CR24","first-page":"169","volume":"27","author":"MJ Pickering","year":"2004","unstructured":"Pickering, M. J. & Garrod, S. Toward a mechanistic psychology of dialogue. Behav. Brain Sci. 27, 169\u2013190 (2004).","journal-title":"Behav. Brain Sci."},{"key":"278_CR25","doi-asserted-by":"publisher","first-page":"305","DOI":"10.1111\/j.1756-8765.2009.01021.x","volume":"1","author":"K Shockley","year":"2009","unstructured":"Shockley, K., Richardson, D. C. & Dale, R. Conversation and coordinative structures. Top. Cogn. Sci. 1, 305\u2013319 (2009).","journal-title":"Top. Cogn. Sci."},{"key":"278_CR26","doi-asserted-by":"publisher","first-page":"1482","DOI":"10.1037\/0278-7393.22.6.1482","volume":"22","author":"SE Brennan","year":"1996","unstructured":"Brennan, S. E. & Clark, H. H. Conceptual pacts and lexical choice in conversation. J. Exp. Psychol. Learn. Mem. Cognition 22, 1482 (1996).","journal-title":"J. Exp. Psychol. Learn. Mem. Cognition"},{"key":"278_CR27","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1111\/j.1756-8765.2009.01019.x","volume":"1","author":"SE Brennan","year":"2009","unstructured":"Brennan, S. E. & Hanna, J. E. Partner\u2010specific adaptation in dialog. Top. Cogn. Sci. 1, 274\u2013291 (2009).","journal-title":"Top. Cogn. Sci."},{"key":"278_CR28","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1561\/1500000074","volume":"13","author":"J Gao","year":"2019","unstructured":"Gao, J., Galley, M. & Li, L. Neural approaches to conversational AI. Found. Trends\u00ae Inf. Retr. 13, 127\u2013298 (2019).","journal-title":"Found. Trends\u00ae Inf. Retr."},{"key":"278_CR29","unstructured":"Ram, A. et al. Conversational AI: the science behind the Alexa prize. In 1st Proceedings of Alexa Prize. Amazon (2018)."},{"key":"278_CR30","unstructured":"Venkatesh, A. et al. On evaluating and comparing conversational agents. In 31st Conference on Neural Information Processing Systems (NIPS, Long Beach, CA, 2018)."},{"key":"278_CR31","doi-asserted-by":"crossref","unstructured":"Yan, R. Chitty-Chitty-Chat Bot: Deep Learning for Conversational AI. In IJCAI, 5520\u20135526 (2018).","DOI":"10.24963\/ijcai.2018\/778"},{"key":"278_CR32","unstructured":"Goffman, E. The Presentation of Self in Everyday Life (Harmondsworth London, 1978)."},{"key":"278_CR33","unstructured":"Biocca, F. & Harms, C. Defining and measuring social presence: Contribution to the networked minds theory and measure. In Proceedings of PRESENCE, 1\u201336 (2002)."},{"key":"278_CR34","doi-asserted-by":"publisher","first-page":"445","DOI":"10.1162\/105474603322761261","volume":"12","author":"S Zhao","year":"2003","unstructured":"Zhao, S. Toward a taxonomy of copresence. Presence Teleoperators Virtual Environ. 12, 445\u2013455 (2003).","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"278_CR35","unstructured":"Guzman, A. L. Human-Machine Communication: Rethinking Communication, Technology, and Ourselves (Peter Lang Publishing, Incorporated, 2018)."},{"key":"278_CR36","doi-asserted-by":"crossref","unstructured":"Mlyn\u00e1\u0159, J., Alavi, H. S., Verma, H. & Cantoni, L. Towards a sociological conception of artificial intelligence. In International Conference on Artificial General Intelligence, 130\u2013139 (Springer, 2018).","DOI":"10.1007\/978-3-319-97676-1_13"},{"key":"278_CR37","doi-asserted-by":"crossref","unstructured":"Eyben, F., Weninger, F., Gross, F. & Schuller, B. Recent developments in opensmile, the munich open-source multimedia feature extractor. In Proceedings of the 21st ACM International Conference on Multimedia, 835\u2013838 (ACM, 2013).","DOI":"10.1145\/2502081.2502224"},{"key":"278_CR38","doi-asserted-by":"crossref","unstructured":"Mostafa, M., Crick, T., Calderon, A. C. & Oatley, G. Incorporating emotion and personality-based analysis in user-centered modelling. In International Conference on Innovative Techniques and Applications of Artificial Intelligence, 383\u2013389 (Springer, 2016).","DOI":"10.1007\/978-3-319-47175-4_29"},{"key":"278_CR39","doi-asserted-by":"publisher","first-page":"214","DOI":"10.1016\/j.jad.2017.08.038","volume":"225","author":"T Taguchi","year":"2018","unstructured":"Taguchi, T. et al. Major depressive disorder discrimination using vocal acoustic features. J. Affect. Disord. 225, 214\u2013220 (2018).","journal-title":"J. Affect. Disord."}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0278-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0278-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0278-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T02:14:10Z","timestamp":1670379250000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-020-0278-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,5,15]]},"references-count":39,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["278"],"URL":"https:\/\/doi.org\/10.1038\/s41746-020-0278-7","relation":{},"ISSN":["2398-6352"],"issn-type":[{"type":"electronic","value":"2398-6352"}],"subject":[],"published":{"date-parts":[[2020,5,15]]},"assertion":[{"value":"16 December 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 April 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 May 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"J.M. is a paid scientific consultant for Health Mentor, Inc. (San Jose, CA, USA).","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"72"}}