{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,25]],"date-time":"2026-06-25T21:32:06Z","timestamp":1782423126263,"version":"3.54.5"},"reference-count":78,"publisher":"Association for Computing Machinery (ACM)","issue":"4","content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2025,12,31]]},"abstract":"<jats:p>Teachable robots in education have the ability to increase student engagement and learning through personalised interactions and the use of social behaviours, such as speech, gaze and emotional expressions. Adaptation of these behaviours is motivated by an interest in tailoring the learning experience to an individual user and improving user outcomes. This work proposes an adaptive response-selection algorithm for a teachable robot which aims to increase user task engagement. A Q-learning algorithm learns an individualised policy and is rewarded based on the user\u2019s paraphrasing behaviour and response time when teaching the robot. A user study is conducted across two user groups, recruited from Australia and Japan. This study evaluates the performance of the adaptive approach for response selection against a non-adaptive method and explores the differences in response and perception of the teaching task between the two participant groups. The results show that measures of task engagement increase more when using the adaptive approach compared to a non-adaptive method of response selection, but that this difference is not consistent across both participant groups. The adaptive approach is also shown to have a positive effect on user perceptions of the interaction.<\/jats:p>","DOI":"10.1145\/3743692","type":"journal-article","created":{"date-parts":[[2025,6,9]],"date-time":"2025-06-09T08:20:31Z","timestamp":1749457231000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Adapting a Teachable Robot\u2019s Dialog Responses Using Reinforcement Learning: Cross-Cultural User Study Exploring Effect on Engagement"],"prefix":"10.1145","volume":"14","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9879-204X","authenticated-orcid":false,"given":"Rachel","family":"Love","sequence":"first","affiliation":[{"name":"Department of Electrical and Computer Systems Engineering, Monash University, Clayton, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1303-064X","authenticated-orcid":false,"given":"Philip R.","family":"Cohen","sequence":"additional","affiliation":[{"name":"Openstream, Inc., Deer Harbor, Washington, USA and Department of Data Science and Artificial Intelligence, Monash University, Clayton, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7767-4765","authenticated-orcid":false,"given":"Gentiane","family":"Venture","sequence":"additional","affiliation":[{"name":"University of Tokyo Graduate School of Engineering Department of Electrical Engineering and Information Systems, Bunkyo-ku, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4169-2141","authenticated-orcid":false,"given":"Dana","family":"Kuli\u0107","sequence":"additional","affiliation":[{"name":"Department of Electrical and Computer Systems Engineering and Department of Mechanical and Aerospace Engineering, Monash University, Clayton, Australia"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,7,22]]},"reference":[{"key":"e_1_3_1_2_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.6.1.Admoni"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.3390\/mti1030014"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1080\/0144929X.2021.1977389"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1145\/2974804.2974829"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2017.1300750"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.3390\/s21041292"},{"key":"e_1_3_1_8_2","first-page":"168","volume-title":"Proceedings of the 12th International Conference on Educational Data Mining (EDM 2019)","author":"Ausin M. S.","year":"2019","unstructured":"M. S. Ausin. 2019. Leveraging deep reinforcement learning for pedagogical policy induction in an intelligent tutoring system. In Proceedings of the 12th International Conference on Educational Data Mining (EDM 2019). Universit\u00e9 du Qu\u00e9bec; Polytechnique Montr\u00e9al, Montreal, Canada, 168\u2013177."},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aat5954"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1787\/589b283f-en"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1080\/08839510590910200"},{"key":"e_1_3_1_12_2","doi-asserted-by":"publisher","DOI":"10.1186\/s41239-019-0176-8"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-32552-1_72"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1145\/3411764.3445068"},{"key":"e_1_3_1_15_2","doi-asserted-by":"publisher","DOI":"10.5555\/3091125.3091339"},{"key":"e_1_3_1_16_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10956-009-9180-4"},{"key":"e_1_3_1_17_2","author":"Chhibber Nalin","year":"2019","unstructured":"Nalin Chhibber. 2019. Towards the learning, perception, and effectiveness of teachable conversational agents. Master\u2019s thesis. University of Waterloo","journal-title":"Towards the learning, perception, and effectiveness of teachable conversational agents"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1145\/1122445.1122456"},{"key":"e_1_3_1_19_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN53752.2022.9900744"},{"key":"e_1_3_1_20_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-020-10182-8"},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.3758\/BRM.41.4.1149"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.3102\/00346543074001059"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2018.8525832"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2021.596055"},{"key":"e_1_3_1_25_2","first-page":"3951","volume-title":"Proceedings of the 13th AAAI Conference on Artificial Intelligence (AAAI \u201916)","author":"Gordon Goren","year":"2016","unstructured":"Goren Gordon, Samuel Spaulding, Jacqueline Kory Westlund, Jin Joo Lee, Luke Plummer, Marayna Martinez, Madhurima Das, and Cynthia Breazeal. 2016. Affective personalization of a social robot tutor for children\u2019s second language skills. In Proceedings of the 13th AAAI Conference on Artificial Intelligence (AAAI \u201916). AAAI Press, 3951\u20133957."},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-90944-4_10"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1111\/ajsp.12022"},{"key":"e_1_3_1_28_2","unstructured":"Matthew Henderson Rami Al-Rfou Brian Strope Yun-Hsuan Sung Laszlo Lukacs Ruiqi Guo Sanjiv Kumar Balint Miklos and Ray Kurzweil. 2017. Efficient Natural Language Response Suggestion for Smart Reply. arXiv:1705.00652. Retrieved from http:\/\/arxiv.org\/abs\/1705.00652"},{"key":"e_1_3_1_29_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-009-9134-9"},{"key":"e_1_3_1_30_2","doi-asserted-by":"publisher","DOI":"10.1145\/2696454.2696479"},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.2.2.Huang"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2009.01.007"},{"key":"e_1_3_1_33_2","unstructured":"UBTECH Robotics Inc. 2021. Yanshee. Retrieved from https:\/\/yandev.ubtrobot.com\/"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2016.7451758"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1155\/2018\/4578762"},{"key":"e_1_3_1_36_2","doi-asserted-by":"publisher","DOI":"10.20965\/jrm.2018.p0282"},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.1007\/s43154-020-00008-3"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2014.6926325"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2019.01.010"},{"key":"e_1_3_1_40_2","doi-asserted-by":"publisher","DOI":"10.1145\/3479538"},{"key":"e_1_3_1_41_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-014-0227-1"},{"key":"e_1_3_1_42_2","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2016.2546700"},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1145\/2559636.2559671"},{"key":"e_1_3_1_44_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-020-00710-4"},{"key":"e_1_3_1_45_2","volume-title":"Proceedings of the 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)","author":"Love Rachel","year":"2023","unstructured":"Rachel Love, Edith Law, Philip R. Cohen, and Dana Kulic. 2023. Adapting a teachable robot\u2019s dialog responses using reinforcement learning in teaching conversation. In Proceedings of the 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). IEEE Press, 8 pages."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-025-00461-1"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1109\/HRI.2016.7451760"},{"key":"e_1_3_1_48_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-023-01085-y"},{"key":"e_1_3_1_49_2","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.98.2.224"},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-30139-4_53"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.robot.2014.09.031"},{"key":"e_1_3_1_52_2","unstructured":"Microsoft. 2023. LUIS (Language Understanding) - Cognitive Services - Microsoft. Retrieved from https:\/\/www.luis.ai\/"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-012-0171-x"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/s00146-022-01476-1"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.1111\/jnu.12422"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.3301687"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020209"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v33i01.33018050"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1109\/RO-MAN50785.2021.9515354"},{"key":"e_1_3_1_60_2","unstructured":"Nils Reimers. 2023. Sentence-Transformers: Sentence Embeddings using BERT \/ RoBERTa \/ XLM-R. Retrieved from https:\/\/github.com\/UKPLab\/sentence-transformers"},{"key":"e_1_3_1_61_2","unstructured":"Nils Reimers. 2024. Sentence-Transformers\/All-MiniLM-L6-v2 Hugging Face. Retrieved from https:\/\/huggingface.co\/sentence-transformers\/all-MiniLM-L6-v2"},{"key":"e_1_3_1_62_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/D19-1410"},{"key":"e_1_3_1_63_2","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2017.8172330"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1037\/0022-3514.43.3.450"},{"key":"e_1_3_1_65_2","doi-asserted-by":"publisher","DOI":"10.1145\/1753326.1753567"},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-011-0124-9"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2005.03.005"},{"key":"e_1_3_1_68_2","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton Richard S.","year":"2018","unstructured":"Richard S. Sutton and Andrew G. Barto. 2018. Reinforcement Learning: An Introduction, 2nd ed. MIT Press, Cambridge, MA.","edition":"2"},{"key":"e_1_3_1_69_2","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2015.7363546"},{"key":"e_1_3_1_70_2","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.1.1.Tanaka"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-06134-0_42"},{"key":"e_1_3_1_72_2","doi-asserted-by":"publisher","DOI":"10.1145\/3242969.3242976"},{"key":"e_1_3_1_73_2","doi-asserted-by":"publisher","DOI":"10.1145\/2701973.2701989"},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1145\/1978942.1978963"},{"key":"e_1_3_1_75_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.edurev.2021.100388"},{"key":"e_1_3_1_76_2","doi-asserted-by":"publisher","DOI":"10.1145\/3202185.3202743"},{"key":"e_1_3_1_77_2","doi-asserted-by":"publisher","DOI":"10.1017\/mor.2023.21"},{"key":"e_1_3_1_78_2","first-page":"704","volume-title":"Social RoboticsLecture Notes in Computer Science","author":"Zaga Cristina","year":"2015","unstructured":"Cristina Zaga, Manja Lohse, Khiet P. Truong, and Vanessa Evers. 2015. The effect of a robot\u2019s social character on children\u2019s task engagement: Peer versus tutor. In Social Robotics. Adriana Tapus, Elisabeth Andr\u00e9, Jean-Claude Martin, Fran\u00e7ois Ferland, and Mehdi Ammi (Eds.), Lecture Notes in Computer Science. Springer International Publishing, Cham, 704\u2013713."},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2020.00099"}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3743692","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,22]],"date-time":"2025-07-22T19:26:54Z","timestamp":1753212414000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3743692"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,22]]},"references-count":78,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,12,31]]}},"alternative-id":["10.1145\/3743692"],"URL":"https:\/\/doi.org\/10.1145\/3743692","relation":{},"ISSN":["2573-9522"],"issn-type":[{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,7,22]]},"assertion":[{"value":"2024-02-08","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-03-22","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-07-22","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}