{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,13]],"date-time":"2026-03-13T08:52:25Z","timestamp":1773391945766,"version":"3.50.1"},"reference-count":69,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,8,30]],"date-time":"2023-08-30T00:00:00Z","timestamp":1693353600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>Smart speakers and conversational agents have been accepted into our homes for a number of tasks such as playing music, interfacing with the internet of things, and more recently, general chit-chat. However, they have been less readily accepted in our workplaces. This may be due to data privacy and security concerns that exist with commercially available smart speakers. However, one of the reasons for this may be that a smart speaker is simply too abstract and does not portray the social cues associated with a trustworthy work colleague. Here, we present an in-depth mixed method study, in which we investigate this question of embodiment in a serious task-based work scenario of a first responder team. We explore the concepts of trust, engagement, cognitive load, and human performance using a humanoid head style robot, a commercially available smart speaker, and a specially developed dialogue manager. Studying the effect of embodiment on trust, being a highly subjective and multi-faceted phenomena, is clearly challenging, and our results indicate that potentially, the robot, with its anthropomorphic facial features, expressions, and eye gaze, was trusted more than the smart speaker. In addition, we found that embodying a conversational agent helped increase task engagement and performance compared to the smart speaker. This study indicates that embodiment could potentially be useful for transitioning conversational agents into the workplace, and further <jats:italic>in situ<\/jats:italic>, \u201cin the wild\u201d experiments with domain workers could be conducted to confirm this.<\/jats:p>","DOI":"10.3389\/frobt.2023.1234767","type":"journal-article","created":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T07:38:14Z","timestamp":1693467494000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Seeing eye to eye: trustworthy embodiment for task-based conversational agents"],"prefix":"10.3389","volume":"10","author":[{"given":"David A.","family":"Robb","sequence":"first","affiliation":[]},{"given":"Jos\u00e9","family":"Lopes","sequence":"additional","affiliation":[]},{"given":"Muneeb I.","family":"Ahmad","sequence":"additional","affiliation":[]},{"given":"Peter E.","family":"McKenna","sequence":"additional","affiliation":[]},{"given":"Xingkun","family":"Liu","sequence":"additional","affiliation":[]},{"given":"Katrin","family":"Lohan","sequence":"additional","affiliation":[]},{"given":"Helen","family":"Hastie","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,8,30]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"25","DOI":"10.5898\/jhri.6.1.admoni","article-title":"Social eye gaze in human-robot interaction: a review","volume":"6","author":"Admoni","year":"2017","journal-title":"J. Human-Robot Interact."},{"key":"B2","article-title":"Trust and cognitive load during human-robot interaction","volume-title":"Proceedings of the AAAI symposium on artificial intelligence for human-robot interaction, 7th-9th november, 2019","author":"Ahmad","year":""},{"key":"B3","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1177\/1059712319844182","article-title":"Robot\u2019s adaptive emotional feedback sustains children\u2019s social engagement and promotes their vocabulary learning: a long-term child\u2013robot interaction study","volume":"27","author":"Ahmad","year":"","journal-title":"Adapt. Behav."},{"key":"B4","first-page":"3","article-title":"Towards a multimodal measure for physiological behaviours to estimate cognitive load","volume-title":"Engineering psychology and cognitive ergonomics. Mental workload, human physiology, and human energy","author":"Ahmad","year":""},{"key":"B5","doi-asserted-by":"publisher","DOI":"10.1007\/s00779-020-01455-7","article-title":"A framework to estimate cognitive load using physiological data","author":"Ahmad","year":"","journal-title":"Personal Ubiquitous Comput"},{"key":"B6","doi-asserted-by":"publisher","first-page":"14","DOI":"10.3390\/mti1030014","article-title":"A systematic review of adaptivity in human-robot interaction","volume":"1","author":"Ahmad","year":"2017","journal-title":"Multimodal Technol. Interact."},{"key":"B7","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1007\/978-3-642-34584-5_9","article-title":"Furhat: a back-projected human-like robot head for multiparty human-machine interaction","volume-title":"Cognitive behavioural systems","author":"Al Moubayed","year":"2012"},{"key":"B8","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1007\/978-3-642-40415-3_22","article-title":"Conversational gaze aversion for virtual agents","volume-title":"Intelligent virtual agents","author":"Andrist","year":"2013"},{"key":"B9","first-page":"25","article-title":"Conversational gaze aversion for humanlike robots","volume-title":"Proceedings of the 2014 ACM\/IEEE international conference on human-robot interaction (HRI)","author":"Andrist","year":"2014"},{"key":"B10","doi-asserted-by":"publisher","first-page":"289","DOI":"10.2307\/2786027","article-title":"Eye-contact, distance and affiliation","volume":"28","author":"Argyle","year":"1965","journal-title":"Sociometry"},{"key":"B11","doi-asserted-by":"crossref","first-page":"396","DOI":"10.1145\/365024.365304","article-title":"Relational agents: a model and implementation of building user trust","volume-title":"Proceedings of the SIGCHI conference on Human factors in computing systems","author":"Bickmore","year":"2001"},{"key":"B12","doi-asserted-by":"publisher","first-page":"173","DOI":"10.1023\/b:grup.0000021840.85686.57","article-title":"The influence of task load and automation trust on deception detection","volume":"13","author":"Biros","year":"2004","journal-title":"Group Decis. Negot."},{"key":"B13","article-title":"That certain look: social amplification of animate vision","volume-title":"Proceedings of the AAAI fall symposium on society of intelligence agents\u2014the human in the loop","author":"Breazeal","year":"2000"},{"key":"B14","doi-asserted-by":"publisher","first-page":"113","DOI":"10.3758\/brm.41.1.113","article-title":"Nasa tlx: software for assessing subjective mental workload","volume":"41","author":"Cao","year":"2009","journal-title":"Behav. Res. methods"},{"key":"B15","first-page":"52","article-title":"More than just a pretty face: affordances of embodiment","author":"Cassell","year":"2000"},{"key":"B16","doi-asserted-by":"publisher","first-page":"194","DOI":"10.1016\/j.chb.2018.02.025","article-title":"Stereotypes or golden rules? Exploring likable voice traits of social robots as active aging companions for tech-savvy baby boomers in taiwan","volume":"84","author":"Chang","year":"2018","journal-title":"Comput. Hum. Behav."},{"key":"B17","first-page":"195","article-title":"Trust and cognitive load","volume-title":"Robust multimodal cognitive load measurement","author":"Chen","year":"2016"},{"key":"B18","doi-asserted-by":"crossref","DOI":"10.4135\/9781452230153","volume-title":"Basics of qualitative research: techniques and procedures for developing grounded theory","author":"Corbin","year":"2008"},{"key":"B19","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1007\/978-3-642-22000-5_3","article-title":"Goal orientated conversational agents: applications to benefit society","volume-title":"KES international symposium on agent and multi-agent systems: technologies and applications","author":"Crockett","year":"2011"},{"key":"B20","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1006\/ijhc.1999.0325","article-title":"The impact of animated interface agents: a review of empirical research","volume":"52","author":"Dehn","year":"2000","journal-title":"Int. J. human-computer Stud."},{"key":"B21","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1016\/j.chb.2018.08.027","article-title":"Evaluations of an artificial intelligence instructor\u2019s voice: social identity theory in human-robot interactions","volume":"90","author":"Edwards","year":"2019","journal-title":"Comput. Hum. Behav."},{"key":"B22","first-page":"125","article-title":"\u2018if you sound like me, you must be more human\u2019: on the interplay of robot and user features on human-robot acceptance and anthropomorphism","author":"Eyssel","year":"2012"},{"key":"B23","volume-title":"Discovering statistics using SPSS","author":"Field","year":"2009"},{"key":"B24","doi-asserted-by":"publisher","first-page":"73","DOI":"10.3389\/frobt.2018.00073","article-title":"Effects of robot facial characteristics and gender in persuasive human-robot interaction","volume":"5","author":"Ghazali","year":"2018","journal-title":"Front. Robotics AI"},{"key":"B25","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1007\/978-3-540-74997-4_12","article-title":"Creating rapport with virtual agents","volume-title":"International workshop on intelligent virtual agents","author":"Gratch","year":"2007"},{"key":"B26","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1177\/0018720811417254","article-title":"A meta-analysis of factors affecting trust in human-robot interaction","volume":"53","author":"Hancock","year":"2011","journal-title":"Hum. Factors"},{"key":"B27","first-page":"0018720820922080","volume-title":"Evolving trust in robots: specification through sequential and comparative meta-analyses","author":"Hancock","year":"2020"},{"key":"B28","first-page":"904","article-title":"Nasa-task load index (nasa-tlx); 20 years later","volume-title":"Proceedings of the human factors and ergonomics society annual meeting","author":"Hart","year":"2006"},{"key":"B29","article-title":"The role of embodiment and perspective in direction-giving systems","volume-title":"2010 AAAI fall symposium series","author":"Hasegawa","year":"2010"},{"key":"B30","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1145\/3025171.3025198","article-title":"Supporting trust in autonomous driving","volume-title":"Proceedings of the 22nd international conference on intelligent user interfaces","author":"H\u00e4uslschmid","year":"2017"},{"key":"B31","first-page":"332","article-title":"Towards adaptive social behavior generation for assistive robots using reinforcement learning","author":"Hemminahaus","year":"2017"},{"key":"B32","first-page":"342","article-title":"Real-time adaptive game to reduce cognitive load","volume-title":"Proceedings of the 9th international conference on human-agent interaction(HAI)","author":"Hennings","year":"2021"},{"key":"B33","doi-asserted-by":"crossref","first-page":"617","DOI":"10.1145\/3340764.3344878","article-title":"Who do you want to talk to? User-centered design for human-like robot faces","volume-title":"Proceedings of Mensch und Computer 2019","author":"Heuer","year":"2019"},{"key":"B34","doi-asserted-by":"crossref","first-page":"295a","DOI":"10.1109\/HICSS.2005.103","article-title":"Assessing cognitive load with physiological sensors","volume-title":"Proceedings of the 38th annual Hawaii international conference on system Sciences","author":"Ikehara","year":"2005"},{"key":"B35","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1016\/s0148-2963(03)00140-1","article-title":"Cognitive and affective trust in service relationships","volume":"58","author":"Johnson","year":"2005","journal-title":"J. Bus. Res."},{"key":"B36","doi-asserted-by":"crossref","first-page":"213","DOI":"10.1007\/978-1-4614-8280-2_19","article-title":"Multimodal open-domain conversations with the nao robot","volume-title":"Natural interaction with robots, knowbots and smartphones","author":"Jokinen","year":"2014"},{"key":"B37","doi-asserted-by":"publisher","first-page":"119","DOI":"10.5555\/3294033.3294034","article-title":"Wizard of oz (woz) a yellow brick journey","volume":"13","author":"Kelley","year":"2018","journal-title":"J. Usability Stud."},{"key":"B38","first-page":"105","article-title":"Does a digital assistant need a body? The influence of visual embodiment and social behavior on the perception of intelligent virtual agents in ar","author":"Kim","year":"2018"},{"key":"B39","first-page":"529","article-title":"Reducing task load with an embodied intelligent virtual assistant for improved performance in collaborative decision making","author":"Kim","year":"2020"},{"key":"B40","doi-asserted-by":"crossref","first-page":"881","DOI":"10.1145\/3196709.3196784","article-title":"Designing for workplace reflection: a chat and voice-based conversational agent","volume-title":"Proceedings of the 2018 designing interactive systems conference","author":"Kocielnik","year":"2018"},{"key":"B41","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1145\/3308532.3329466","article-title":"The effects of anthropomorphism and non-verbal social behaviour in virtual assistants","volume-title":"Proceedings of the 19th ACM international conference on intelligent virtual agents.","author":"Kontogiorgos","year":"2019"},{"key":"B42","doi-asserted-by":"publisher","first-page":"1336","DOI":"10.3758\/s13428-018-1075-y","article-title":"Preprocessing pupil size data: guidelines and code","volume":"51","author":"Kret","year":"2019","journal-title":"Behav. Res. methods"},{"key":"B43","doi-asserted-by":"crossref","DOI":"10.1109\/HRI.2019.8673286","article-title":"Towards a conversational agent for remote robot-human teaming","volume-title":"Proceedings of ACM\/IEEE intl. Conf. On human-robot interaction","author":"Lopes","year":"2019"},{"key":"B44","first-page":"75","article-title":"Demonstration of a social robot for control of remote autonomous systems","volume-title":"Companion of the 2020 ACM\/IEEE international conference on human-robot interaction(HRI)","author":"Lopes","year":"2020"},{"key":"B45","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1109\/mra.2012.2192811","article-title":"The uncanny valley [from the field]","volume":"19","author":"Mori","year":"2012","journal-title":"IEEE Robotics Automation Mag."},{"key":"B46","first-page":"33","article-title":"The uncanny valley","volume":"7","author":"Mori","year":"1970","journal-title":"Energy"},{"key":"B47","first-page":"155","article-title":"# naorobot: exploring nao discourse on twitter","author":"Mubin","year":"2016"},{"key":"B48","first-page":"139","article-title":"Estimating user\u2019s engagement from eye-gaze behaviors in human-agent conversations","author":"Nakano","year":"2010"},{"key":"B49","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1145\/1027933.1027957","article-title":"When do we interact multimodally?","volume-title":"Proceedings of the 6th international conference on Multimodal interfaces","author":"Oviatt","year":"2004"},{"key":"B50","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1207\/s15326985ep3801_1","article-title":"Cognitive load theory and instructional design: recent developments","volume":"38","author":"Paas","year":"2003","journal-title":"Educ. Technol."},{"key":"B51","doi-asserted-by":"publisher","first-page":"811","DOI":"10.1007\/s10459-018-9865-7","article-title":"Engagement: what is it good for? The role of learner engagement in healthcare simulation contexts","volume":"24","author":"Padgett","year":"2019","journal-title":"Adv. Health Sci. Educ."},{"key":"B52","first-page":"363","article-title":"A multidimensional perspective on the uncanny valley effect: studying the interplay between a robot\u2019s appearance and interaction strategy","author":"Paetzel","year":"2017"},{"key":"B53","first-page":"402","article-title":"Congruency matters-how ambiguous gender cues increase a robot\u2019s uncanniness","volume-title":"International conference on social robotics","author":"Paetzel","year":""},{"key":"B54","first-page":"297","article-title":"Effects of multimodal cues on children\u2019s perception of uncanniness in a social robot","author":"Paetzel","year":""},{"key":"B55","first-page":"372","article-title":"A digital twin for human-robot interaction","author":"Pairet","year":"2019"},{"key":"B56","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1080\/10447318.2020.1807710","article-title":"Systematic review: trust-building factors and implications for conversational agent design","volume":"37","author":"Rheu","year":"2021","journal-title":"Int. J. Human\u2013Computer Interact."},{"key":"B57","doi-asserted-by":"publisher","first-page":"e0127680","DOI":"10.1371\/journal.pone.0127680","article-title":"Effects of cognitive load on trusting behavior\u2013an experiment using the trust game","volume":"10","author":"Samson","year":"2015","journal-title":"PloS one"},{"key":"B58","volume-title":"The perception and measurement of human-robot trust","author":"Schaefer","year":"2013"},{"key":"B59","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1007\/s10648-013-9242-2","article-title":"Attention, working memory, and long-term memory in multimedia learning: an integrated perspective based on process models of working memory","volume":"26","author":"Schweppe","year":"2014","journal-title":"Educ. Psychol. Rev."},{"key":"B60","article-title":"When do we need a human? Anthropomorphic design and trustworthiness of conversational agents","author":"Seeger","year":"2017"},{"key":"B61","first-page":"1","article-title":"Face value? Exploring the effects of embodiment for a group facilitation agent","author":"Shamekhi","year":"2018"},{"key":"B62","doi-asserted-by":"publisher","first-page":"569","DOI":"10.1177\/1046878114554176","article-title":"Measuring video game engagement through the cognitive and affective dimensions","volume":"45","author":"Sharek","year":"2014","journal-title":"Simul. Gaming"},{"key":"B63","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511557842","volume-title":"Qualitative analysis for social scientists","author":"Strauss","year":"1987"},{"key":"B64","first-page":"450","article-title":"Situated facial displays: towards social interaction","author":"Takeuchi","year":"1995"},{"key":"B65","first-page":"152","article-title":"An empirical study on the trustworthiness of life-like interface agents","author":"Van Mulken","year":"1999"},{"key":"B66","first-page":"271","article-title":"Paradise: a framework for evaluating spoken dialogue agents","volume-title":"Association for computational linguistics","author":"Walker","year":"1997"},{"key":"B67","first-page":"56","article-title":"Is it my looks? Or something i said? The impact of explanations, embodiment, and expectations on trust and performance in human-robot teams","author":"Wang","year":"2018"},{"key":"B68","first-page":"1","article-title":"A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces","author":"Yee","year":"2007"},{"key":"B69","first-page":"556","article-title":"Look but don\u2019t stare: mutual gaze interaction in social robots","author":"Zhang","year":"2017"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1234767\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,31]],"date-time":"2023-08-31T07:38:28Z","timestamp":1693467508000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1234767\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,8,30]]},"references-count":69,"alternative-id":["10.3389\/frobt.2023.1234767"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1234767","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,8,30]]},"article-number":"1234767"}}