{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,6]],"date-time":"2026-10-06T16:43:11Z","timestamp":1791304991973,"version":"4.3.1"},"reference-count":56,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,12,18]],"date-time":"2024-12-18T00:00:00Z","timestamp":1734480000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Artif. Intell."],"abstract":"<jats:p>Educational materials that utilize generative AI (e.g., ChatGPT) have been developed, thus, allowing students to learn through conversations with robots or agents. However, if these artificial entities provide incorrect information (hallucinating), it could lead to confusion among students. To investigate whether students can detect lies from these artificial entities, we conducted an experiment using the social robot Furhat and we make it engage in various types of deceptive interactions. Twenty-two Japanese middle school students participated in ten teaching sessions with Furhat using a human and an anime facial appearances while employing different types of deception: Lying, Paltering, Pandering, and Bullshit. The results revealed that the majority of students were deceived by those lies. Additionally, the robot's facial appearance (i.e., social agency) affected both the learning effectiveness and the likelihood of being deceived. We conclude that an anime robot face is recommended to be used as it excelled in learning effectiveness as it attracts students attention. An anime face also provided protection against deceptive techniques due to its low social agency which leads to ineffectiveness in persuasion and deception. This study underscores the importance of preparing AI-based educational tools and scripts carefully to prevent the dissemination of false information produced through generative AI hallucinations to students.<\/jats:p>","DOI":"10.3389\/frai.2024.1493348","type":"journal-article","created":{"date-parts":[[2024,12,18]],"date-time":"2024-12-18T12:52:32Z","timestamp":1734526352000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Deception detection in educational AI: challenges for Japanese middle school students in interacting with generative AI robots"],"prefix":"10.3389","volume":"7","author":[{"given":"Ahmed","family":"Salem","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kaoru","family":"Sumi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,12,18]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"15266","DOI":"10.1038\/s41598-022-19501-0","article-title":"A study on the influence of service robots' level of anthropomorphism on the willingness of users to follow their recommendations","volume":"12","author":"Abdi","year":"2022","journal-title":"Sci. Rep"},{"key":"B2","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1007\/978-3-642-34584-5_9","article-title":"\u201cFurhat: a back-projected human-like robot head for multiparty human-machine interaction,\u201d","volume-title":"Cognitive Behavioural Systems: COST 2102 International Training School, Dresden, Germany, February 21\u201326, 2011, Revised Selected Papers","author":"Al Moubayed","year":"2012"},{"key":"B3","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/s12369-008-0001-3","article-title":"Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots","volume":"1","author":"Bartneck","year":"2009","journal-title":"Int. J. Soc. Robot"},{"key":"B4","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1109\/SMC.2019.8913932","article-title":"\u201cBerrick: a low-cost robotic head platform for human-robot interaction,\u201d","volume-title":"2019 IEEE International Conference on Systems, Man and Cybernetics (SMC)","author":"Berra","year":"2019"},{"key":"B5","volume-title":"Lying: Moral choice in public and private life","author":"Bok","year":"2011"},{"key":"B6","doi-asserted-by":"publisher","first-page":"411","DOI":"10.3389\/fpsyg.2014.00411","article-title":"Baby schema in human and animal faces induces cuteness perception and gaze allocation in children","volume":"5","author":"Borgi","year":"2014","journal-title":"Front. Psychol"},{"key":"B7","doi-asserted-by":"publisher","first-page":"441","DOI":"10.1007\/s11023-016-9405-2","article-title":"Dynamics of perceptible agency: the case of social robots","volume":"26","author":"Brincker","year":"2016","journal-title":"Minds Mach"},{"key":"B8","doi-asserted-by":"publisher","first-page":"1268","DOI":"10.1037\/dev0000884","article-title":"Robot teachers for children? Young children trust robots depending on their perceived accuracy and agency","volume":"56","author":"Brink","year":"2020","journal-title":"Dev. Psychol"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199577415.001.0001","author":"Carson","year":"2010","journal-title":"Lying and Deception: Theory and Practice"},{"key":"B10","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/s10676-017-9441-5","article-title":"How to describe and evaluate \u201cdeception\u201d phenomena: recasting the metaphysics, ethics, and politics of ICTs in terms of magic and performance and taking a relational and narrative turn","volume":"20","author":"Coeckelbergh","year":"2018","journal-title":"Ethics Inf. Technol"},{"key":"B11","doi-asserted-by":"publisher","first-page":"1850006","DOI":"10.1142\/S0219843618500068","article-title":"Emotional storytelling using virtual and robotic agents","volume":"15","author":"Costa","year":"2018","journal-title":"Int. J. Humanoid Robot"},{"key":"B12","article-title":"\u201cUnderstanding the effect of anthropomorphic design: Towards more persuasive conversational agents,\u201d","volume-title":"International Conference on Information Systems (ICIS) 2020 Proceedings","author":"Cui","year":"2020"},{"key":"B13","article-title":"\u201cPromoting sustainable mobility beliefs with persuasive and anthropomorphic design: Insights from an experiment with a conversational agent,\u201d","volume-title":"International Conference on Information Systems (ICIS) 2019 Proceedings","author":"Diederich","year":"2019"},{"key":"B14","unstructured":"Dodge\n              T.\n            \n          \n          Bloomington, IN\n          Indiana University, ProQuest Dissertations and Theses\n          The effects of interactivity and visual realism on children's cognitive empathy toward narrative characters\n          \n          2009"},{"key":"B15","doi-asserted-by":"publisher","first-page":"615","DOI":"10.1007\/s12369-020-00654-9","article-title":"Effects of different types of social robot voices on affective evaluations in different application fields","volume":"13","author":"Dou","year":"2021","journal-title":"Int. J. Soc. Robot"},{"key":"B16","doi-asserted-by":"publisher","first-page":"627","DOI":"10.1016\/j.chb.2016.06.005","volume":"65","author":"Edwards","year":"2016"},{"key":"B17","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1521\/soco.2008.26.2.143","article-title":"When we need a human: motivational determinants of anthropomorphism","volume":"26","author":"Epley","year":"2008","journal-title":"Soc. Cogn"},{"key":"B18","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1037\/0033-295X.114.4.864","article-title":"On seeing human: a three-factor theory of anthropomorphism","volume":"114","author":"Epley","year":"2007","journal-title":"Psychol. Rev"},{"key":"B19","doi-asserted-by":"crossref","DOI":"10.1515\/9781400826537","volume-title":"On Bullshit","author":"Frankfurt","year":"2005"},{"key":"B20","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1111\/j.1439-0310.2008.01603.x","article-title":"Baby schema in infant faces induces cuteness perception and motivation for caretaking in adults","volume":"115","author":"Glocker","year":"2009","journal-title":"Ethology"},{"key":"B21","doi-asserted-by":"publisher","first-page":"64","DOI":"10.3389\/frobt.2019.00064","article-title":"Can a robot catch you lying? A machine learning system to detect lies during interactions","volume":"6","author":"Gonzalez-Billandon","year":"2019","journal-title":"Front. Robot. AI"},{"key":"B22","volume-title":"Applied Thematic Analysis","author":"Guest","year":"2011"},{"key":"B23","volume-title":"Bullshit and Philosophy: Guaranteed to Get Perfect Results Every Time, Volume 24","author":"Hardcastle","year":"2006"},{"key":"B24","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780190652951.003.0011","volume-title":"White Lies on Silver Tongues: Why Robots Need to Deceive (and How)","author":"Isaac","year":"2017"},{"key":"B25","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.cogsys.2013.07.001","article-title":"Mindreading deception in dialog","volume":"28","author":"Isaac","year":"2014","journal-title":"Cogn. Syst. Res"},{"key":"B26","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3571730","article-title":"Survey of hallucination in natural language generation","volume":"55","author":"Ji","year":"2023","journal-title":"ACM Comput. Surv"},{"key":"B27","doi-asserted-by":"publisher","first-page":"703","DOI":"10.1080\/01425692.2023.2203360","article-title":"Educational purity and technological danger: understanding scepticism towards the use of telepresence robots in school","volume":"44","author":"Johannessen","year":"2023","journal-title":"Br. J. Sociol. Educ"},{"key":"B28","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1027\/\/1016-9040.4.2.59","article-title":"Ecological behavior, environmental attitude, and feelings of responsibility for the environment","volume":"4","author":"Kaiser","year":"1999","journal-title":"Eur. Psychol"},{"key":"B29","doi-asserted-by":"publisher","first-page":"1205","DOI":"10.1037\/a0039650","article-title":"The effects of feedback on energy conservation: a meta-analysis","volume":"141","author":"Karlin","year":"2015","journal-title":"Psychol. Bull"},{"key":"B30","first-page":"93","article-title":"\u201cThe impact of humanoid robots on students' computational thinking,\u201d","volume-title":"Australian Council for Computers in Education 2016 Conference: Refereed Proceedings","author":"Keane","year":"2016"},{"key":"B31","doi-asserted-by":"publisher","first-page":"107383","DOI":"10.1016\/j.chb.2022.107383","article-title":"Perceived credibility of an AI instructor in online education: the role of social presence and voice features","volume":"136","author":"Kim","year":"2022","journal-title":"Comput. Human Behav"},{"key":"B32","doi-asserted-by":"publisher","first-page":"1415782","DOI":"10.3389\/frai.2024.1415782","article-title":"Adolescents' use and perceived usefulness of generative AI for schoolwork: exploring their relationships with executive functioning and academic achievement","volume":"7","author":"Klarin","year":"2024","journal-title":"Front. Artif. Intell"},{"key":"B33","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1109\/ROMAN.2013.6628441","article-title":"\u201cWhat makes people empathize with an emotional robot?: the impact of agency and physical embodiment on human empathy for a robot,\u201d","volume-title":"2013 IEEE Ro-man","author":"Kwak","year":"2013"},{"key":"B34","volume-title":"Computers as Theatre","author":"Laurel","year":"1993"},{"key":"B35","doi-asserted-by":"crossref","DOI":"10.4324\/9781315703152","volume-title":"Japanese Visual Culture: Explorations in the World of Manga and Anime","author":"MacWilliams","year":"2014"},{"key":"B36","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1109\/CAI59869.2024.00033","article-title":"\u201cAI hallucinations: a misnomer worth clarifying,\u201d","volume-title":"2024 IEEE Conference on Artificial Intelligence (CAI)","author":"Maleki","year":"2024"},{"key":"B37","doi-asserted-by":"publisher","first-page":"669","DOI":"10.1006\/ijhc.1996.0073","article-title":"Can computers be teammates?","volume":"45","author":"Nass","year":"1996","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B38","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1145\/3319502.3374839","article-title":"\u201cEffects of anthropomorphism and accountability on trust in human robot interaction,\u201d","volume-title":"Proceedings of the 2020 ACM\/IEEE international conference on human-robot interaction","author":"Natarajan","year":"2020"},{"key":"B39","volume-title":"Interaction Design: Beyond Human-computer Interaction","author":"Preece","year":"2002"},{"key":"B40","volume-title":"Interaction Design: Beyond Human-Computer Interaction","author":"Preece","year":"2015"},{"key":"B41","doi-asserted-by":"crossref","first-page":"166","DOI":"10.1145\/2909824.3020242","article-title":"\u201c(IR) relevance of gender? on the influence of gender stereotypes on learning with a robot,\u201d","volume-title":"Proceedings of the 2017 ACM\/IEEE international conference on human-robot interaction","author":"Reich-Stiebert","year":"2017"},{"key":"B42","doi-asserted-by":"publisher","first-page":"456","DOI":"10.1037\/pspi0000081","article-title":"Artful paltering: the risks and rewards of using truthful statements to mislead others","volume":"112","author":"Rogers","year":"2017","journal-title":"J. Pers. Soc. Psychol"},{"key":"B43","doi-asserted-by":"crossref","DOI":"10.33422\/6th.iacetl.2023.11.100","article-title":"\u201cChatgpt, an excellent liar: how conversational agent hallucinations impact learning and teaching,\u201d","volume-title":"Proceedings of the 7th International Conference on Teaching, Learning and Education","author":"Salamin","year":"2023"},{"key":"B44","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1109\/COMPSAC61105.2024.00090","article-title":"\u201cA comparative human-robot interaction study between face-display and an advanced social robot,\u201d","volume-title":"2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)","author":"Salem","year":"2024"},{"key":"B45","doi-asserted-by":"publisher","first-page":"115","DOI":"10.1006\/ijhc.2001.0473","article-title":"Informing the design of a virtual environment to support learning in children","volume":"55","author":"Scaife","year":"2001","journal-title":"Int. J. Hum. Comput. Stud"},{"key":"B46","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1515\/9781503626607-004","article-title":"\u201c2. Paltering,\u201d","volume-title":"Deception: From Ancient Empires to Internet Dating","author":"Schauer","year":"2009"},{"key":"B47","doi-asserted-by":"publisher","first-page":"613","DOI":"10.1007\/s00146-016-0667-2","article-title":"The case of classroom robots: teachers' deliberations on the ethical tensions","volume":"32","author":"Serholt","year":"2017","journal-title":"AI Soc"},{"key":"B48","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1007\/s10676-020-09573-9","volume":"23","author":"Sharkey","year":"2021"},{"key":"B49","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/s10676-016-9387-z","article-title":"Should we welcome robot teachers?","volume":"18","author":"Sharkey","year":"2016","journal-title":"Ethics Inf. Technol"},{"key":"B50","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1016\/S0032-9592(97)90060-1","article-title":"Pandering","volume":"32","author":"Sullivan","year":"1997","journal-title":"J. Thought"},{"key":"B51","unstructured":"Artificial intelligence and education, challenges and disadvantages for the teacher\n          \n          30\n          50\n          \n            \n              Tao\n              B.\n            \n            \n              D\u00edaz\n              V.\n            \n            \n              Guerra\n              Y.\n            \n          \n          36590861\n          Arctic J\n          72\n          2019"},{"key":"B52","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/978-3-319-42773-7_12","article-title":"\u201cTechnology and behavioral design in tourism,\u201d","volume-title":"Design science in tourism: Foundations of destination management","author":"Tussyadiah","year":"2017"},{"key":"B53","doi-asserted-by":"publisher","first-page":"4637","DOI":"10.3390\/su15054637","article-title":"The effectiveness of educational robots in improving learning outcomes: a meta-analysis","volume":"15","author":"Wang","year":"2023","journal-title":"Sustainability"},{"key":"B54","unstructured":"Wood\n              G.\n            \n          \n          master thesis\n          The impact of AI literacy training on the perception of anthropomorphism and trust in conversational AI\n          \n          2024"},{"key":"B55","doi-asserted-by":"publisher","first-page":"18","DOI":"10.1186\/s41239-023-00391-9","article-title":"Developing a gamified artificial intelligence educational robot to promote learning effectiveness and behavior in laboratory safety courses for undergraduate students","volume":"20","author":"Yang","year":"2023","journal-title":"Int. J. Educ. Technol. High. Educ"},{"key":"B56","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1504\/IJIL.2020.107620","article-title":"Motivating students' learning in science and technology by using robots","volume":"27","author":"Zhang","year":"2020","journal-title":"Int. J. Innov. Learn"}],"container-title":["Frontiers in Artificial Intelligence"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1493348\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,12,18]],"date-time":"2024-12-18T12:52:44Z","timestamp":1734526364000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frai.2024.1493348\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,18]]},"references-count":56,"alternative-id":["10.3389\/frai.2024.1493348"],"URL":"https:\/\/doi.org\/10.3389\/frai.2024.1493348","relation":{},"ISSN":["2624-8212"],"issn-type":[{"value":"2624-8212","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,12,18]]},"article-number":"1493348"}}