{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,13]],"date-time":"2026-04-13T15:27:59Z","timestamp":1776094079658,"version":"3.50.1"},"reference-count":51,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2020,1,7]],"date-time":"2020-01-07T00:00:00Z","timestamp":1578355200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,1,7]],"date-time":"2020-01-07T00:00:00Z","timestamp":1578355200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["npj Digit. Med."],"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Virtual agents have demonstrated their ability to conduct clinical interviews. However, the factors influencing patients\u2019 engagement with these agents have not yet been assessed. The objective of this study is to assess in outpatients the trust and acceptance of virtual agents performing medical interviews and to explore their influence on outpatients\u2019 engagement. In all, 318 outpatients were enroled. The agent was perceived as trustworthy and well accepted by the patients, confirming the good engagement of patients in the interaction. Older and less-educated patients accepted the virtual medical agent (VMA) more than younger and well-educated ones. Credibility of the agent appeared to main dimension, enabling engaged and non-engaged outpatients to be classified. Our results show a high rate of engagement with the virtual agent that was mainly related to high trust and acceptance of the agent. These results open new paths for the future use of VMAs in medicine.<\/jats:p>","DOI":"10.1038\/s41746-019-0213-y","type":"journal-article","created":{"date-parts":[[2020,1,7]],"date-time":"2020-01-07T11:02:56Z","timestamp":1578394976000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":66,"title":["Trust and acceptance of a virtual psychiatric interview between embodied conversational agents and outpatients"],"prefix":"10.1038","volume":"3","author":[{"given":"Pierre","family":"Philip","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8107-9758","authenticated-orcid":false,"given":"Lucile","family":"Dupuy","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8938-8683","authenticated-orcid":false,"given":"Marc","family":"Auriacombe","sequence":"additional","affiliation":[]},{"given":"Fushia","family":"Serre","sequence":"additional","affiliation":[]},{"given":"Etienne","family":"de Sevin","sequence":"additional","affiliation":[]},{"given":"Alain","family":"Sauteraud","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5203-8444","authenticated-orcid":false,"given":"Jean-Arthur","family":"Micoulaud-Franchi","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,1,7]]},"reference":[{"key":"213_CR1","doi-asserted-by":"publisher","first-page":"1036","DOI":"10.1016\/S2215-0366(15)00332-6","volume":"2","author":"T Wykes","year":"2015","unstructured":"Wykes, T. et al. Mental health research priorities for Europe. Lancet Psychiatry 2, 1036\u20131042 (2015).","journal-title":"Lancet Psychiatry"},{"key":"213_CR2","doi-asserted-by":"publisher","first-page":"1248","DOI":"10.1093\/jamia\/ocy072","volume":"25","author":"L Laranjo","year":"2018","unstructured":"Laranjo, L. et al. Conversational agents in healthcare: a systematic review. J. Am. Med. Inform. Assoc. 25, 1248\u20131258 (2018).","journal-title":"J. Am. Med. Inform. Assoc."},{"key":"213_CR3","doi-asserted-by":"publisher","DOI":"10.2196\/jmir.6553","volume":"19","author":"S Provoost","year":"2017","unstructured":"Provoost, S., Lau, H. M., Ruwaard, J. & Riper, H. Embodied Conversational Agents in Clinical Psychology: A Scoping Review. J. Med. Internet Res. 19, e151 (2017).","journal-title":"J. Med. Internet Res."},{"key":"213_CR4","doi-asserted-by":"publisher","unstructured":"Vaidyam, A. N., Wisniewski, H., Halamka, J. D., Kashavan, M. S. & Torous, J. B. Chatbots and Conversational Agents in Mental Health: A Review of the Psychiatric Landscape. Can. J. Psychiatry 0706743719828977 (2019). https:\/\/doi.org\/10.1177\/0706743719828977.","DOI":"10.1177\/0706743719828977"},{"key":"213_CR5","doi-asserted-by":"publisher","unstructured":"Cassell, J. et al. Animated Conversation: Rule-based Generation of Facial Expression, Gesture & Spoken Intonation for Multiple Conversational Agents. in Proceedings of the 21st Annual Conference on Computer Graphics and Interactive Techniques 413\u2013420 (ACM, 1994). https:\/\/doi.org\/10.1145\/192161.192272.","DOI":"10.1145\/192161.192272"},{"key":"213_CR6","doi-asserted-by":"publisher","DOI":"10.1038\/srep42656","volume":"7","author":"P Philip","year":"2017","unstructured":"Philip, P. et al. Virtual human as a new diagnostic tool, a proof of concept study in the field of major depressive disorders. Sci. Rep. 7, 42656 (2017).","journal-title":"Sci. Rep."},{"key":"213_CR7","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.drugalcdep.2018.08.025","volume":"193","author":"M Auriacombe","year":"2018","unstructured":"Auriacombe, M. et al. Development and validation of a virtual agent to screen tobacco and alcohol use disorders. Drug Alcohol Depend. 193, 1\u20136 (2018).","journal-title":"Drug Alcohol Depend."},{"key":"213_CR8","doi-asserted-by":"crossref","unstructured":"Lucas, G. M. et al. Reporting Mental Health Symptoms: Breaking Down Barriers to Care with Virtual Human Interviewers. Front. Robot. AI 4, 51 (2017).","DOI":"10.3389\/frobt.2017.00051"},{"key":"213_CR9","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2544103","volume":"4","author":"C Lisetti","year":"2013","unstructured":"Lisetti, C., Amini, R., Yasavur, U. & Rishe, N. I Can Help You Change! An Empathic Virtual Agent Delivers Behavior Change Health Interventions. ACM Trans. Manag. Inf. Syst. 4, 1\u201319 (2013).","journal-title":"ACM Trans. Manag. Inf. Syst."},{"key":"213_CR10","doi-asserted-by":"crossref","unstructured":"Ren, J., Bickmore, T., Hempstead, M. & Jack, B. Birth Control, Drug Abuse, or Domestic Violence? What Health Risk Topics Are Women Willing to Discuss with a Virtual Agent? in Intelligent Virtual Agents (eds. Bickmore, T., Marsella, S. & Sidner, C.) 350\u2013359 (Springer International Publishing, 2014).","DOI":"10.1007\/978-3-319-09767-1_46"},{"key":"213_CR11","doi-asserted-by":"publisher","first-page":"1543","DOI":"10.1007\/s10803-011-1179-z","volume":"41","author":"IM Hopkins","year":"2011","unstructured":"Hopkins, I. M. et al. Avatar Assistant: Improving Social Skills in Students with an ASD Through a Computer-Based Intervention. J. Autism Dev. Disord. 41, 1543\u20131555 (2011).","journal-title":"J. Autism Dev. Disord."},{"key":"213_CR12","doi-asserted-by":"publisher","unstructured":"Bickmore, T. W. et al. Managing Chronic Conditions with a Smartphone-based Conversational Virtual Agent. in Proceedings of the 18th International Conference on Intelligent Virtual Agents - IVA \u201918 119\u2013124 (ACM Press, 2018). https:\/\/doi.org\/10.1145\/3267851.3267908.","DOI":"10.1145\/3267851.3267908"},{"key":"213_CR13","doi-asserted-by":"crossref","unstructured":"Henson, P., Wisniewski, H., Hollis, C., Keshavan, M. & Torous, J. Digital mental health apps and the therapeutic alliance: initial review. BJPsych Open 5, e15 (2019).","DOI":"10.1192\/bjo.2018.86"},{"key":"213_CR14","doi-asserted-by":"publisher","first-page":"775","DOI":"10.1016\/S2215-0366(17)30333-4","volume":"4","author":"D Bhugra","year":"2017","unstructured":"Bhugra, D. et al. The WPA- Lancet Psychiatry Commission on the Future of Psychiatry. Lancet Psychiatry 4, 775\u2013818 (2017).","journal-title":"Lancet Psychiatry"},{"key":"213_CR15","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/j.apnr.2009.04.003","volume":"24","author":"JD Tariman","year":"2011","unstructured":"Tariman, J. D., Berry, D. L., Halpenny, B., Wolpin, S. & Schepp, K. Validation and testing of the Acceptability E-scale for Web-based patient-reported outcomes in cancer care. Appl. Nurs. Res. 24, 53\u201358 (2011).","journal-title":"Appl. Nurs. Res."},{"key":"213_CR16","doi-asserted-by":"publisher","first-page":"319","DOI":"10.2307\/249008","volume":"13","author":"FD Davis","year":"1989","unstructured":"Davis, F. D. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Q. 13, 319\u2013340 (1989).","journal-title":"MIS Q."},{"key":"213_CR17","doi-asserted-by":"crossref","unstructured":"Bevan, N., et al. Standards for Usability, Usability Reports and Usability Measures. in Human-Computer Interaction. Theory, Design, Development and Practice (ed. Kurosu, M.) 268\u2013278 (Springer International Publishing, 2016).","DOI":"10.1007\/978-3-319-39510-4_25"},{"key":"213_CR18","doi-asserted-by":"publisher","first-page":"361","DOI":"10.1007\/s12369-010-0068-5","volume":"2","author":"M Heerink","year":"2010","unstructured":"Heerink, M., Kr\u00f6se, B., Evers, V. & Wielinga, B. Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model. Int. J. Soc. Robot. 2, 361\u2013375 (2010).","journal-title":"Int. J. Soc. Robot."},{"key":"213_CR19","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1016\/j.psychres.2016.01.043","volume":"237","author":"J-A Micoulaud-Franchi","year":"2016","unstructured":"Micoulaud-Franchi, J.-A. et al. Validation of the French version of the Acceptability E-scale (AES) for mental E-health systems. Psychiatry Res. 237, 196\u2013200 (2016).","journal-title":"Psychiatry Res."},{"key":"213_CR20","doi-asserted-by":"crossref","unstructured":"Cassell, J. & Bickmore, T. External Manifestations of Trustworthiness in the Interface. Commun. ACM 43, 7 (2000).","DOI":"10.1145\/355112.355123"},{"key":"213_CR21","doi-asserted-by":"publisher","first-page":"97","DOI":"10.1016\/j.ijmedinf.2017.09.016","volume":"108","author":"M Zhang","year":"2017","unstructured":"Zhang, M., Luo, M., Nie, R. & Zhang, Y. Technical attributes, health attribute, consumer attributes and their roles in adoption intention of healthcare wearable technology. Int. J. Med. Inf. 108, 97\u2013109 (2017).","journal-title":"Int. J. Med. Inf."},{"key":"213_CR22","doi-asserted-by":"crossref","unstructured":"Benbasat, I. & Wang, W. Trust In and Adoption of Online Recommendation Agents. J. Assoc. Inf. Syst. 6, 4 (2005).","DOI":"10.17705\/1jais.00065"},{"key":"213_CR23","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1080\/10864415.2003.11044275","volume":"7","author":"PA Pavlou","year":"2003","unstructured":"Pavlou, P. A. Consumer Acceptance of Electronic Commerce: Integrating Trust and Risk with the Technology Acceptance Model. Int. J. Electron. Commer. 7, 101\u2013134 (2003).","journal-title":"Int. J. Electron. Commer."},{"key":"213_CR24","doi-asserted-by":"publisher","first-page":"635","DOI":"10.1080\/00140139.2014.895855","volume":"57","author":"K Chen","year":"2014","unstructured":"Chen, K. & Chan, A. H. S. Gerontechnology acceptance by elderly Hong Kong Chinese: a senior technology acceptance model (STAM). Ergonomics 57, 635\u2013652 (2014).","journal-title":"Ergonomics"},{"key":"213_CR25","doi-asserted-by":"crossref","unstructured":"Micoulaud-Franchi, J.-A. et al. Acceptability of Embodied Conversational Agent in a Health Care Context. in Intelligent Virtual Agents (eds. Traum, D. et al.) 416\u2013419 (Springer International Publishing, 2016).","DOI":"10.1007\/978-3-319-47665-0_45"},{"key":"213_CR26","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1162\/PRES_a_00197","volume":"23","author":"P Philip","year":"2014","unstructured":"Philip, P., Bioulac, S., Sauteraud, A., Chaufton, C. & Olive, J. Could a Virtual Human Be Used to Explore Excessive Daytime Sleepiness in Patients? Presence Teleoperators Virtual Environ. 23, 369\u2013376 (2014).","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"213_CR27","unstructured":"Lacour, C. Les dipl\u00f4m\u00e9s du sup\u00e9rieur en Aquitaine: la r\u00e9gion profite de son attractivit\u00e9 (2015)."},{"key":"213_CR28","doi-asserted-by":"publisher","first-page":"15015","DOI":"10.1038\/nrdp.2015.15","volume":"1","author":"P L\u00e9vy","year":"2015","unstructured":"L\u00e9vy, P. et al. Obstructive sleep apnoea syndrome. Nat. Rev. Dis. Prim. 1, 15015 (2015).","journal-title":"Nat. Rev. Dis. Prim."},{"key":"213_CR29","doi-asserted-by":"publisher","unstructured":"Durick, J., Robertson, T., Brereton, M., Vetere, F. & Nansen, B. Dispelling Ageing Myths in Technology Design. in Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration 467\u2013476 (ACM, 2013). https:\/\/doi.org\/10.1145\/2541016.2541040.","DOI":"10.1145\/2541016.2541040"},{"key":"213_CR30","doi-asserted-by":"publisher","first-page":"22","DOI":"10.1016\/j.maturitas.2015.03.015","volume":"82","author":"IG Chouvarda","year":"2015","unstructured":"Chouvarda, I. G., Goulis, D. G., Lambrinoudaki, I. & Maglaveras, N. Connected health and integrated care: Toward new models for chronic disease management. Maturitas 82, 22\u201327 (2015).","journal-title":"Maturitas"},{"key":"213_CR31","unstructured":"World Health Organization. World Report on Ageing and Health. (World Health Organization, 2015)."},{"key":"213_CR32","doi-asserted-by":"publisher","first-page":"125","DOI":"10.7326\/0003-4819-108-1-125","volume":"108","author":"AL Suchman","year":"1988","unstructured":"Suchman, A. L. & Matthews, D. A. What makes the patient-doctor relationship therapeutic? Exploring the connexional dimension of medical care. Ann. Intern. Med. 108, 125\u2013130 (1988).","journal-title":"Ann. Intern. Med."},{"key":"213_CR33","doi-asserted-by":"crossref","unstructured":"Ardito, R. B. & Rabellino, D. Therapeutic Alliance and Outcome of Psychotherapy: Historical Excursus, Measurements, and Prospects for Research. Front. Psychol. 2, 270 (2011).","DOI":"10.3389\/fpsyg.2011.00270"},{"key":"213_CR34","unstructured":"Preece, J. et al. Human-Computer Interaction. (Addison-Wesley Longman Ltd., 1994)."},{"key":"213_CR35","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1007\/s41347-019-00095-w","volume":"4","author":"J Torous","year":"2019","unstructured":"Torous, J. et al. Creating a Digital Health Smartphone App and Digital Phenotyping Platform for Mental Health and Diverse Healthcare Needs: an Interdisciplinary and Collaborative Approach. J. Technol. Behav. Sci. 4, 73\u201385 (2019).","journal-title":"J. Technol. Behav. Sci."},{"key":"213_CR36","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1038\/s41746-018-0042-4","volume":"1","author":"LE Gracey","year":"2018","unstructured":"Gracey, L. E. et al. Use of user-centered design to create a smartphone application for patient-reported outcomes in atopic dermatitis. Npj Digit. Med. 1, 33 (2018).","journal-title":"Npj Digit. Med."},{"key":"213_CR37","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1038\/s41746-018-0073-x","volume":"1","author":"R Ata","year":"2018","unstructured":"Ata, R. et al. Clinical validation of smartphone-based activity tracking in peripheral artery disease patients. Npj Digit. Med. 1, 66 (2018).","journal-title":"Npj Digit. Med."},{"key":"213_CR38","unstructured":"ISO 9241-210:2019. Ergonomics of human-system interaction \u2014 Part 210: Human-centred design for interactive systems. (2019)."},{"key":"213_CR39","unstructured":"National Institute for Health and Care Excellence. NICE digital. NICE https:\/\/www.nice.org.uk\/digital."},{"key":"213_CR40","unstructured":"NHS England. Digital transformation. https:\/\/www.england.nhs.uk\/digitaltechnology\/."},{"key":"213_CR41","unstructured":"Medical Research Council. Methods research to support the assessment of diagnostic health technologies. https:\/\/mrc.ukri.org\/funding\/how-we-fund-research\/opportunities\/methods-research-to-support-the-assessment-of-diagnostic-health-technologies\/ (2018)."},{"key":"213_CR42","unstructured":"European Medicines Agency. Big data. https:\/\/www.ema.europa.eu\/en\/about-us\/how-we-work\/big-data (2019)."},{"key":"213_CR43","unstructured":"King, M. R. N., Rothberg, S., Dawson, R. & Batmaz, F. Bridging the edtech evidence gap: A realist evaluation framework refined for complex technology initiatives. (2016)."},{"key":"213_CR44","doi-asserted-by":"publisher","unstructured":"Wolverton, C. C. & Lanier, P. A. Utilizing the Technology-Organization-Environment Framework to Examine the Adoption Decision in a Healthcare Context. Handb. Res. Evol. IT Rise E-Soc. 401\u2013423 (2019). https:\/\/doi.org\/10.4018\/978-1-5225-7214-5.ch018.","DOI":"10.4018\/978-1-5225-7214-5.ch018"},{"key":"213_CR45","doi-asserted-by":"publisher","first-page":"i68","DOI":"10.1136\/qshc.2010.042085","volume":"19","author":"DF Sittig","year":"2010","unstructured":"Sittig, D. F. & Singh, H. A New Socio-technical Model for Studying Health Information Technology in Complex Adaptive Healthcare Systems. Qual. Saf. Health Care 19, i68\u2013i74 (2010).","journal-title":"Qual. Saf. Health Care"},{"key":"213_CR46","doi-asserted-by":"publisher","first-page":"498","DOI":"10.1176\/appi.ps.201700423","volume":"69","author":"JB Torous","year":"2018","unstructured":"Torous, J. B. et al. A Hierarchical Framework for Evaluation and Informed Decision Making Regarding Smartphone Apps for Clinical Care. Psychiatr. Serv. 69, 498\u2013500 (2018).","journal-title":"Psychiatr. Serv."},{"key":"213_CR47","doi-asserted-by":"publisher","first-page":"662","DOI":"10.1097\/NMD.0000000000000864","volume":"206","author":"J Torous","year":"2018","unstructured":"Torous, J. et al. The Emerging Imperative for a Consensus Approach Toward the Rating and Clinical Recommendation of Mental Health Apps. J. Nerv. Ment. Dis. 206, 662\u2013666 (2018).","journal-title":"J. Nerv. Ment. Dis."},{"key":"213_CR48","first-page":"186","volume":"46","author":"V Venkatesh","year":"2000","unstructured":"Venkatesh, V. & Davis, F. D. A Theoretical Extension of the Technology Acceptance Model: Four Longitudinal. Field Stud. Manag. Sci. 46, 186\u2013204 (2000).","journal-title":"Field Stud. Manag. Sci."},{"key":"213_CR49","doi-asserted-by":"publisher","first-page":"359","DOI":"10.1038\/sj.npp.1300030","volume":"28","author":"J-F Etter","year":"2003","unstructured":"Etter, J.-F., Houezec, J. L. & Perneger, T. V. A Self-Administered Questionnaire to Measure Dependence on Cigarettes: The Cigarette Dependence Scale. Neuropsychopharmacology 28, 359 (2003).","journal-title":"Neuropsychopharmacology"},{"key":"213_CR50","doi-asserted-by":"publisher","first-page":"231","DOI":"10.1016\/0002-9343(87)90061-1","volume":"82","author":"B Bush","year":"1987","unstructured":"Bush, B., Shaw, S., Cleary, P., Delbanco, T. L. & Aronson, M. D. Screening for alcohol abuse using the cage questionnaire. Am. J. Med. 82, 231\u2013235 (1987).","journal-title":"Am. J. Med."},{"key":"213_CR51","doi-asserted-by":"publisher","first-page":"297","DOI":"10.1007\/BF02310555","volume":"16","author":"LJ Cronbach","year":"1951","unstructured":"Cronbach, L. J. Coefficient alpha and the internal structure of tests. Psychometrika 16, 297\u2013334 (1951).","journal-title":"Psychometrika"}],"container-title":["npj Digital Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0213-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0213-y","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0213-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,7]],"date-time":"2022-12-07T01:46:29Z","timestamp":1670377589000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41746-019-0213-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,1,7]]},"references-count":51,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2020,12]]}},"alternative-id":["213"],"URL":"https:\/\/doi.org\/10.1038\/s41746-019-0213-y","relation":{},"ISSN":["2398-6352"],"issn-type":[{"value":"2398-6352","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,1,7]]},"assertion":[{"value":"10 July 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 December 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 January 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"2"}}