{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,18]],"date-time":"2026-02-18T01:11:23Z","timestamp":1771377083997,"version":"3.50.1"},"reference-count":39,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2025,8,31]],"date-time":"2025-08-31T00:00:00Z","timestamp":1756598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Open Access Publication Fund of Humboldt-Universit\u00e4t zu Berlin"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Robotics"],"abstract":"<jats:p>This paper presents the design and evaluation of a sound-driven robot quiz system that enhances fairness and engagement in educational human\u2013robot interaction (HRI). The system integrates a real-time sound-based first-responder detection mechanism with gamified multimodal feedback, including verbal cues, music, gestures, points, and badges. Motivational design followed the Octalysis framework, and the system was evaluated using validated scales from the Technology Acceptance Model (TAM), the Intrinsic Motivation Inventory (IMI), and the Godspeed Questionnaire. An experimental study was conducted with 32 university students comparing the proposed multimodal system combined with sound-driven first quiz responder detection to a sequential turn-taking quiz response with a verbal-only feedback system as a baseline. Results revealed significantly higher scores for the experimental group across perceived usefulness (M = 4.32 vs. 3.05, d = 2.14), perceived ease of use (M = 4.03 vs. 3.17, d = 1.43), behavioral intention (M = 4.24 vs. 3.28, d = 1.62), and motivation (M = 4.48 vs. 3.39, d = 3.11). The sound-based first-responder detection system achieved 97.5% accuracy and was perceived as fair and intuitive. These findings highlight the impact of fairness, motivational feedback, and multimodal interaction on learner engagement. The proposed system offers a scalable model for designing inclusive and engaging educational robots that promote active participation through meaningful and enjoyable interactions.<\/jats:p>","DOI":"10.3390\/robotics14090123","type":"journal-article","created":{"date-parts":[[2025,9,1]],"date-time":"2025-09-01T08:28:15Z","timestamp":1756715295000},"page":"123","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Design and Evaluation of a Sound-Driven Robot Quiz System with Fair First-Responder Detection and Gamified Multimodal Feedback"],"prefix":"10.3390","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8604-8501","authenticated-orcid":false,"given":"Rezaul","family":"Tutul","sequence":"first","affiliation":[{"name":"Department of Mathematics and Natural Sciences, Humboldt University of Berlin, 10117 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Niels","family":"Pinkwart","sequence":"additional","affiliation":[{"name":"Department of Mathematics and Natural Sciences, Humboldt University of Berlin, 10117 Berlin, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,8,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"eaat5954","DOI":"10.1126\/scirobotics.aat5954","article-title":"Social robots for education: A review","volume":"3","author":"Belpaeme","year":"2018","journal-title":"Sci. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Papakostas, G.A., Sidiropoulos, G.K., Papadopoulou, C.I., Vrochidou, E., Kaburlasos, V.G., Papadopoulou, M.T., Holeva, V., Nikopoulou, V.-A., and Dalivigkas, N. (2021). Social Robots in Special Education: A Systematic Review. Electronics, 10.","DOI":"10.3390\/electronics10121398"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Stasolla, F., Curcio, E., Borgese, A., Passaro, A., Di Gioia, M., Zullo, A., and Martini, E. (2025). Educational Robotics and Game-Based Interventions for Overcoming Dyscalculia: A Pilot Study. Computers, 14.","DOI":"10.20944\/preprints202503.0153.v1"},{"key":"ref_4","first-page":"532","article-title":"Engaging Young Students in Effective Robotics Education: An Embodied Learning-Based Computer Programming Approach","volume":"62","author":"Zhang","year":"2023","journal-title":"J. Educ. Comput. Res."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1159","DOI":"10.1007\/s12369-020-00621-4","article-title":"A Social Robot Learning to Facilitate an Assistive Group-Based Activity from Non-expert Caregivers","volume":"12","author":"Louie","year":"2020","journal-title":"Int. J. Soc. Robot."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"18","DOI":"10.1186\/s41239-023-00391-9","article-title":"Developing a gamified artificial intelligence educational robot to promote learning effectiveness and behaviour in laboratory safety courses for undergraduate students","volume":"20","author":"Yang","year":"2023","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Chang, M.L., Trafton, G., McCurry, J.M., and Thomaz, A.L. (2021, January 8\u201312). Unfair! Perceptions of Fairness in Human-Robot Teams. Proceedings of the 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), Vancouver, BC, Canada.","DOI":"10.1109\/RO-MAN50785.2021.9515428"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Tutul, R., Buchem, I., Jakob, A., and Pinkwart, N. (2024). Enhancing Learner Motivation, Engagement, and Enjoyment Through Sound-Recognizing Humanoid Robots in Quiz-Based Educational Games. Digital Interaction and Machine Intelligence, Proceedings of the MIDI\u20192023\u201411th Machine Intelligence and Digital Interaction Conference, Warsaw, Poland, 12\u201314 December 2023, Springer Nature. Lecture Notes in Networks and Systems.","DOI":"10.1007\/978-3-031-66594-3_13"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"12389","DOI":"10.1149\/10701.12389ecst","article-title":"Social Robots in Education for Long-Term Human-Robot Interaction: Socially Supportive Behaviour of Robotic Tutor for Creating Robo-Tangible Learning Environment in a Guided Discovery Learning Interaction","volume":"107","author":"Alam","year":"2022","journal-title":"ECS Trans."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1007\/s12369-013-0178-y","article-title":"Social robots for long-term interaction: A survey","volume":"5","author":"Leite","year":"2013","journal-title":"Int. J. Soc. Robot."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Bacula, A., and Knight, H. (2024, January 9\u201310). Dancing with Robots at a Science Museum: Coherent Motions Got More People To Dance, Incoherent Sends Weaker Signal. Proceedings of the 2024 International Symposium on Technological Advances in Human-Robot Interaction, Boulder, CO, USA.","DOI":"10.1145\/3648536.3648546"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1080\/03004430.2025.2452587","article-title":"Dancing With children or dancing for children? Measuring the effects of a dance intervention in children\u2019s confidence and agency","volume":"195","author":"Theodotou","year":"2025","journal-title":"Early Child Dev. Care"},{"key":"ref_13","unstructured":"Chou, Y.K. (2015). Actionable Gamification: Beyond Points, Badges, and Leaderboards, Octalysis Group."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1079","DOI":"10.1007\/s12369-020-00683-4","article-title":"A Reinforcement Learning Based Cognitive Empathy Framework for Social Robots","volume":"13","author":"Bagheri","year":"2020","journal-title":"Int. J. Soc. Robot."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"186","DOI":"10.1287\/mnsc.46.2.186.11926","article-title":"A theoretical extension of the TAM: Four longitudinal studies","volume":"46","author":"Venkatesh","year":"2000","journal-title":"Manag. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Deci, E.L., and Ryan, R.M. (1985). Intrinsic Motivation and Self-Determination in Human Behavior, Springer.","DOI":"10.1007\/978-1-4899-2271-7"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1007\/s12369-008-0001-3","article-title":"Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots","volume":"1","author":"Bartneck","year":"2009","journal-title":"Int. J. Soc. Robot."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"18927","DOI":"10.1007\/s10639-024-12570-w","article-title":"Humanoid robot-empowered language learning based on self-determination theory","volume":"29","author":"Fung","year":"2024","journal-title":"Educ. Inf. Technol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Hirschmanner, M., Gross, S., Krenn, B., Neubarth, F., Trapp, M., and Vincze, M. (2018, January 5\u20138). Grounded Word Learning on a Pepper Robot. Proceedings of the 18th International Conference on Intelligent Virtual Agents, Sydney, NSW, Australia.","DOI":"10.1145\/3267851.3267903"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Schiavo, F., Campitiello, L., Todino, M.D., and Di Tore, P.A. (2024). Educational Robots, Emotion Recognition and ASD: New Horizon in Special Education. Educ. Sci., 14.","DOI":"10.3390\/educsci14030258"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Ackermann, H., Lange, A.L., Hafner, V.V., and Lazarides, R. (2025). How adaptive social robots influence cognitive, emotional, and self-regulated learning. Sci. Rep., 15.","DOI":"10.1038\/s41598-025-91236-0"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Goldman, E.J., Baumann, A., and Poulin-Dubois, D. (2023). Pre-schoolers\u2019 anthropomorphizing of robots: Do human-like properties matter?. Front. Psychol., 13.","DOI":"10.3389\/fpsyg.2022.1102370"},{"key":"ref_23","unstructured":"Guo, J., Ishiguro, H., and Sumioka, H. (May, January 26). A Multimodal System for Empathy Expression: Impact of Haptic and Auditory Stimuli. Proceedings of the Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA\u201925), Yokohama, Japan. Article 44."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Su, H., Qi, W., Chen, J., Yang, C., Sandoval, J., and Laribi, M.A. (2023). Recent advancements in multimodal human\u2013robot interaction. Front. Neurorobot., 17.","DOI":"10.3389\/fnbot.2023.1084000"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/s12369-014-0277-4","article-title":"Comparing Robot Embodiments in a Guided Discovery Learning Interaction with Children","volume":"7","author":"Kennedy","year":"2015","journal-title":"Int. J. Soc. Robot."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Delecluse, M., Sanchez, S., Cussat-Blanc, S., Schneider, N., and Welcomme, J.-B. (2014, January 12\u201316). High-level behavior regulation for multi-robot systems. Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation (GECCO Comp\u201914), Vancouver, BC, Canada.","DOI":"10.1145\/2598394.2598454"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1037\/dev0001363","article-title":"Tiny dancers: Effects of musical familiarity and tempo on children\u2019s free dancing","volume":"58","author":"Kragness","year":"2022","journal-title":"Dev. Psychol."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"7699","DOI":"10.1109\/LRA.2025.3575983","article-title":"EMOTION: Expressive Motion Sequence Generation for Humanoid Robots with In-Context Learning","volume":"10","author":"Huang","year":"2024","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1103","DOI":"10.1177\/00187208221133272","article-title":"The Influence of Robots\u2019 Fairness on Humans\u2019 Reward-Punishment Behaviors and Trust in Human-Robot Cooperative Teams","volume":"66","author":"Cao","year":"2022","journal-title":"Hum. Factors"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1007\/s12369-023-01047-4","article-title":"When it is ok to give the Robot Less: Children\u2019s Fairness Intuitions Towards Robots","volume":"15","author":"Ayalon","year":"2023","journal-title":"Int. J. Soc. Robot."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Salinas-Mart\u00ednez, \u00c1.-G., Cunill\u00e9-Rodr\u00edguez, J., Aquino-L\u00f3pez, E., and Garc\u00eda-Moreno, A.-I. (2024). Multimodal Human\u2013Robot Interaction Using Gestures and Speech: A Case Study for Printed Circuit Board Manufacturing. J. Manuf. Mater. Process., 8.","DOI":"10.3390\/jmmp8060274"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s41239-017-0042-5","article-title":"Gamifying education: What is known, what is believed and what remains uncertain: A critical review","volume":"14","author":"Dichev","year":"2017","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Hamari, J., Koivisto, J., and Sarsa, H. (2014, January 6\u20139). Does gamification work? A literature review of empirical studies on gamification. Proceedings of the 47th Hawaii International Conference on System Sciences, Waikoloa, HI, USA.","DOI":"10.1109\/HICSS.2014.377"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Sripathy, A., Bobu, A., Li, Z., Sreenath, K., Brown, D.S., and Dragan, A.D. (2022, January 23\u201327). Teaching Robots to Span the Space of Functional Expressive Motion. Proceedings of the 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Kyoto, Japan.","DOI":"10.1109\/IROS47612.2022.9981964"},{"key":"ref_35","doi-asserted-by":"crossref","unstructured":"Buchem, I., Mc Elroy, A., and Tutul, R. (2022, January 7\u20139). Designing and programming game-based learning with humanoid robots: A case study of the multimodal \u201cMake or Do\u201d English grammar game with the Pepper robot. Proceedings of the 15th Annual International Conference of Education, Research and Innovation, Seville, Spain.","DOI":"10.21125\/iceri.2022.0403"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Saerbeck, M., Schut, T., Bartneck, C., and Janse, M.D. (2010, January 10\u201315). Expressive robots in education: Varying the degree of social supportive behavior of a robotic tutor. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI\u201910), Atlanta, GA, USA.","DOI":"10.1145\/1753326.1753567"},{"key":"ref_37","unstructured":"Ravandi, B.S. (2024, January 15). Gamification for Personalized Human-Robot Interaction in Companion Social Robots. Proceedings of the 12th International Conference on Affective Computing and Intelligent Interaction Workshops and Demos (ACIIW), Glasgow, UK."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Picard, R.W. (1997). Affective Computing, The MIT Press.","DOI":"10.7551\/mitpress\/1140.001.0001"},{"key":"ref_39","unstructured":"Tutul, R., Jakob, A., Buchem, I., and Pinkwart, N. (2023, January 6\u20139). Sound recognition with a humanoid robot for a quiz game in an educational environment. Proceedings of the Fortschritte der Akustik\u2014DAGA 2023, Hamburg, Germany."}],"container-title":["Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2218-6581\/14\/9\/123\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T18:36:38Z","timestamp":1760034998000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2218-6581\/14\/9\/123"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,31]]},"references-count":39,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2025,9]]}},"alternative-id":["robotics14090123"],"URL":"https:\/\/doi.org\/10.3390\/robotics14090123","relation":{},"ISSN":["2218-6581"],"issn-type":[{"value":"2218-6581","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,8,31]]}}}