{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,10]],"date-time":"2026-03-10T11:20:29Z","timestamp":1773141629691,"version":"3.50.1"},"reference-count":43,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T00:00:00Z","timestamp":1687824000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>To reduce costs and effort, experiments in human-robot interaction can be carried out in Virtual Reality (VR) or in screen-based (SB) formats. However, it is not well examined whether robots are perceived and experienced in the same way in VR and SB as they are in the physical world. This study addresses this topic in a between-subjects experiment, measuring trust and engagement of an interaction with a mobile service robot in a museum scenario. Measures were made in three different settings, either the real world, in VR or in a game-like SB and then compared with an ANOVA. The results indicate, that neither trust nor engagement differ dependent on the experimental setting. The results imply that both VR and SB are eligible ways to explore the interaction with a mobile service robot, if some peculiarities of each medium are taken into account.<\/jats:p>","DOI":"10.3389\/frobt.2023.1156715","type":"journal-article","created":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T15:37:26Z","timestamp":1687880246000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Virtual reality check: a comparison of virtual reality, screen-based, and real world settings as research methods for HRI"],"prefix":"10.3389","volume":"10","author":[{"given":"Jana","family":"Plomin","sequence":"first","affiliation":[]},{"given":"Paul","family":"Schweidler","sequence":"additional","affiliation":[]},{"given":"Astrid","family":"Oehme","sequence":"additional","affiliation":[]}],"member":"1965","published-online":{"date-parts":[[2023,6,27]]},"reference":[{"key":"B1","first-page":"701","article-title":"The effect of presence on human-robot interaction","volume-title":"RO-MAN 2008-the 17th IEEE international symposium on robot and human interactive communication","author":"Bainbridge","year":"2008"},{"key":"B2","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1145\/782896.782911","article-title":"Interacting with an embodied emotional character","volume-title":"Proceedings of the 2003 international conference on Designing pleasurable products and interfaces","author":"Bartneck","year":"2003"},{"key":"B3","volume-title":"Virtuelle realit\u00e4ten","author":"Bente","year":"2002"},{"key":"B4","doi-asserted-by":"publisher","first-page":"254","DOI":"10.1007\/s10458-012-9216-7","article-title":"Tinker: A relational agent museum guide","volume":"27","author":"Bickmore","year":"2013","journal-title":"Aut. agents multi-agent Syst."},{"key":"B5","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1145\/2157689.2157709","article-title":"Human-robot interaction: Developing trust in robots","volume-title":"Proceedings of the seventh annual ACM\/IEEE international conference on Human-Robot Interaction","author":"Billings","year":"2012"},{"key":"B6","unstructured":"Intrinsic motivation inventory. CSDT\n            DeciE. L.\n            RyanR. M.\n          2003"},{"key":"B7","doi-asserted-by":"publisher","first-page":"4","DOI":"10.5898\/jhri.6.3.deligianis","article-title":"The impact of intergroup bias on trust and approach behaviour towards a humanoid robot","volume":"6","author":"Deligianis","year":"2017","journal-title":"J. human-robot Interact."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1194","DOI":"10.1016\/j.jesp.2008.03.003","article-title":"Virtual prejudice","volume":"44","author":"Dotsch","year":"2008","journal-title":"J. Exp. Soc. Psychol."},{"key":"B9","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/BF03193146","article-title":"G power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences","volume":"39","author":"Faul","year":"2007","journal-title":"Behav. Res. Methods"},{"key":"B10","doi-asserted-by":"publisher","first-page":"237","DOI":"10.3102\/00346543042003237","article-title":"Consequences of failure to meet assumptions underlying the fixed effects analyses of variance and covariance","volume":"42","author":"Glass","year":"1972","journal-title":"Rev. Educ. Res."},{"key":"B11","first-page":"125","article-title":"What immersive virtual environment technology can offer to social cognition","volume":"13","author":"Groom","year":"2002","journal-title":"Psychol. Inq."},{"key":"B12","first-page":"370","article-title":"The peculiarities of robot embodiment (EmCorp-Scale): Development, validation and initial test of the embodiment and corporeality of artificial agents scale","volume-title":"2018 13th ACM\/IEEE international conference on human-robot interaction (HRI)","author":"Hoffmann","year":"2018"},{"key":"B13","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1109\/ROMAN.2005.1513759","article-title":"Comparison of human psychology for real and virtual mobile manipulators","volume-title":"ROMAN 2005. IEEE international workshop on robot and human interactive communication, 2005","author":"Inoue","year":"2005"},{"key":"B14","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1145\/2696454.2696486","article-title":"Will people keep the secret of a humanoid robot? Psychological intimacy in HRI","volume-title":"Proceedings of the tenth annual ACM\/IEEE international conference on human-robot interaction","author":"Kahn","year":"2015"},{"key":"B15","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1016\/j.ijhcs.2014.01.004","article-title":"Direct comparison of psychological evaluation between virtual and real humanoids: Personal space and subjective impressions","volume":"72","author":"Kamide","year":"2014","journal-title":"Int. J. Human-Computer Stud."},{"key":"B16","doi-asserted-by":"publisher","first-page":"293","DOI":"10.1007\/s12369-014-0277-4","article-title":"Comparing robot embodiments in a guided discovery learning interaction with children","volume":"7","author":"Kennedy","year":"2015","journal-title":"Int. J. Soc. Robotics"},{"key":"B17","first-page":"4","article-title":"Effect of a robot on user perceptions","volume-title":"2004 IEEE\/RSJ International conference on intelligent robots and systems","author":"Kidd","year":"2004"},{"key":"B18","doi-asserted-by":"publisher","first-page":"169","DOI":"10.1521\/soco.2008.26.2.169","article-title":"Anthropomorphic interactions with a robot and robot\u2013like agent","volume":"26","author":"Kiesler","year":"2008","journal-title":"Soc. Cogn."},{"key":"B19","first-page":"77","article-title":"Are emotional robots more fun to play with?","volume-title":"RO-MAN 2008-the 17th IEEE international symposium on robot and human interactive communication","author":"Leite","year":"2008"},{"key":"B20","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1016\/j.ijhcs.2015.01.001","article-title":"The benefit of being physically present: A survey of experimental works comparing co-present robots, telepresent robots and virtual agents","volume":"77","author":"Li","year":"2015","journal-title":"Int. J. Human-Computer Stud."},{"key":"B21","first-page":"431","article-title":"Comparing human-robot proxe-mics between virtual reality and the real world","volume-title":"2019 14th ACM\/IEEE international con ference on human-robot interaction (HRI)","author":"Li","year":"2019"},{"key":"B22","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1109\/ROMAN.2017.8172387","article-title":"Understanding human-robot interaction in virtualreality","volume-title":"2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN)","author":"Liu","year":"2017"},{"key":"B23","doi-asserted-by":"publisher","first-page":"557","DOI":"10.3758\/bf03200735","article-title":"Immersive virtual environment technology as a basic research tool in psychology","volume":"31","author":"Loomis","year":"1999","journal-title":"Behav. Res. methods, Instrum. Comput."},{"key":"B24","doi-asserted-by":"publisher","first-page":"1474","DOI":"10.1177\/1541931218621334","article-title":"How immersion, presence, emotion, & workload differ in virtual reality and traditional game mediums","volume":"62","author":"Lum","year":"2018","journal-title":"Proc. Hum. Factors Ergonomics Soc. Annu. Meet."},{"key":"B25","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1145\/1228716.1228736","article-title":"Comparing a computer agent with a humanoid robot","volume-title":"Proceedings of the ACM\/IEEE international conference on Human-robot interaction","author":"Powers","year":"2007"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1269","DOI":"10.1080\/02699930903309268","article-title":"Social anxiety predicts avoidance behaviour in virtual encounters","volume":"24","author":"Rinck","year":"2010","journal-title":"Cognition Emot."},{"key":"B27","doi-asserted-by":"publisher","first-page":"1432","DOI":"10.1177\/1071181311551298","article-title":"A model of human-robot trust: Theoretical model development","volume":"55","author":"Sanders","year":"2011","journal-title":"Proc. Hum. Factors Ergonomics Soc. Annu. Meet."},{"key":"B28","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/978-1-4899-7668-0_10","article-title":"Measuring trust in human robot interactions: Development of the \u201ctrust perception scale-HRI\u201d","volume-title":"Robust intelligence and trust in autonomous systems","author":"Schaefer","year":"2016"},{"key":"B29","first-page":"113","article-title":"Fidelity & validity in robotic simulation","volume-title":"2015 IEEE international inter-disciplinary conference on cognitive methods in situation awareness and decision support (CogSIMA)","author":"Schaefer","year":"2015"},{"key":"B30","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1089\/109493101300117884","article-title":"Research on presence in virtual reality: A survey","volume":"4","author":"Schuemie","year":"2001","journal-title":"CyberPsychology Behav."},{"key":"B31","doi-asserted-by":"publisher","first-page":"401","DOI":"10.3233\/NRE-2011-0670","article-title":"Virtual realities as motivational tools for robotic assisted gait training in children: A surface electromyography study","volume":"28","author":"Schuler","year":"2011","journal-title":"NeuroRehabilitation"},{"key":"B32","volume-title":"MRI-Szenarien einfach klassifizieren mit dddder Kontext-Person-Roboter-Heuristik \u201eKOPROH","author":"Schweidler","year":"2020"},{"key":"B33","volume-title":"Understanding virtual reality: Interface, application, and design","author":"Sherman","year":"2018"},{"key":"B34","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1016\/j.artint.2005.03.005","article-title":"Explorations in engagement for humans and robots","volume":"166","author":"Sidner","year":"2005","journal-title":"Artif. Intell."},{"key":"B35","doi-asserted-by":"crossref","first-page":"411","DOI":"10.1109\/HRI.2019.8673219","article-title":"Reframing the role of novelty within social HRI: From noise to information","volume-title":"2019 14th ACM\/IEEE international conference on human-robot interaction (HRI)","author":"Smedegaard","year":"2019"},{"key":"B36","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/1121241.1121249","article-title":"Common metrics for human-robot interaction","volume-title":"Proceedings of the 1st ACM SIGCHI\/SIGART conference on Human-robot interaction","author":"Steinfeld","year":"2006"},{"key":"B37","doi-asserted-by":"crossref","first-page":"5495","DOI":"10.1109\/IROS.2009.5354145","article-title":"Influences on proxemic behaviors in human-robot interaction","volume-title":"2009 IEEE\/RSJ international conference on intelligent robots and systems","author":"Takayama","year":"2009"},{"key":"B38","doi-asserted-by":"publisher","first-page":"507","DOI":"10.1108\/JSM-01-2018-0045","article-title":"Trust in humanoid robots: Implications for services marketing","volume":"33","author":"van Pinxteren","year":"2019","journal-title":"J. Serv. Mark."},{"key":"B39","first-page":"872","article-title":"Embodiment and human-robot interaction: A task-based perspective","volume-title":"RO-MAN 2007-the 16th IEEE international symposium on robot and human interactive communication","author":"Wainer","year":"2007"},{"key":"B40","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1007\/978-3-030-28619-4_28","article-title":"Comparing robot grasping tele-operation across desktop and virtual reality with ROS reality","volume-title":"Robotics research","author":"Whitney","year":"2020"},{"key":"B41","doi-asserted-by":"crossref","first-page":"514","DOI":"10.1145\/3371382.3378374","article-title":"Towards using Virtual Reality for replicating HRI studies","volume-title":"Companion of the 2020 ACM\/IEEE international conference on human-robot interaction","author":"Wijnen","year":"2020"},{"key":"B42","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1162\/105474605323384654","article-title":"The factor structure of the presence questionnaire","volume":"14","author":"Witmer","year":"2005","journal-title":"Presence Teleoperators Virtual Environ."},{"key":"B43","volume-title":"Presence, Telepresence and immersion: The cognitive factors of embodiment and interaction in virtual environments","author":"Zaga","year":"1995"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1156715\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,6,27]],"date-time":"2023-06-27T15:37:50Z","timestamp":1687880270000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2023.1156715\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,27]]},"references-count":43,"alternative-id":["10.3389\/frobt.2023.1156715"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2023.1156715","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,27]]},"article-number":"1156715"}}