{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,15]],"date-time":"2026-04-15T16:50:19Z","timestamp":1776271819085,"version":"3.50.1"},"reference-count":36,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2019,11,22]],"date-time":"2019-11-22T00:00:00Z","timestamp":1574380800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,11,22]],"date-time":"2019-11-22T00:00:00Z","timestamp":1574380800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010664","name":"H2020 Future and Emerging Technologies","doi-asserted-by":"publisher","award":["687831"],"award-info":[{"award-number":["687831"]}],"id":[{"id":"10.13039\/100010664","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004794","name":"Centre National de la Recherche Scientifique","doi-asserted-by":"publisher","award":["MI ROBAUTISTE"],"award-info":[{"award-number":["MI ROBAUTISTE"]}],"id":[{"id":"10.13039\/501100004794","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100004794","name":"Centre National de la Recherche Scientifique","doi-asserted-by":"publisher","award":["PICS 279521"],"award-info":[{"award-number":["PICS 279521"]}],"id":[{"id":"10.13039\/501100004794","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J of Soc Robotics"],"published-print":{"date-parts":[[2020,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>This paper presents a contribution aiming at testing novel child\u2013robot teaching schemes that could be used in future studies to support the development of social and collaborative skills of children with autism spectrum disorders (ASD). We present a novel experiment where the classical roles are reversed: in this scenario the children are the teachers providing positive or negative reinforcement to the Kaspar robot in order for it to learn arbitrary associations between different toy names and the locations where they are positioned. The objective is to stimulate interaction and collaboration between children while teaching the robot, and also provide them tangible examples to understand that sometimes learning requires several repetitions. To facilitate this game, we developed a reinforcement learning algorithm enabling Kaspar to verbally convey its level of uncertainty during the learning process, so as to better inform the children about the reasons behind its successes and failures. Overall, 30 typically developing (TD) children aged between 7 and 8 (19 girls, 11 boys) and 9 children with ASD performed 25 sessions (16 for TD; 9 for ASD) of the experiment in groups, and managed to teach Kaspar all associations in 2 to 7 trials. During the course of study Kaspar only made rare unexpected associations (2 perseverative errors and 2 win-shifts, within a total of 314 trials), primarily due to exploratory choices, and eventually reached minimal uncertainty. Thus, the robot\u2019s behaviour was clear and consistent for the children, who all expressed enthusiasm in the experiment.<\/jats:p>","DOI":"10.1007\/s12369-019-00607-x","type":"journal-article","created":{"date-parts":[[2019,11,22]],"date-time":"2019-11-22T08:02:53Z","timestamp":1574409773000},"page":"709-720","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":17,"title":["A Novel Reinforcement-Based Paradigm for Children to Teach the Humanoid Kaspar Robot"],"prefix":"10.1007","volume":"12","author":[{"given":"Abolfazl","family":"Zaraki","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2515-1046","authenticated-orcid":false,"given":"Mehdi","family":"Khamassi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luke J.","family":"Wood","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriella","family":"Lakatos","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Costas","family":"Tzafestas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Farshid","family":"Amirabdollahian","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ben","family":"Robins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kerstin","family":"Dautenhahn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,11,22]]},"reference":[{"issue":"1","key":"607_CR1","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s12369-010-0082-7","volume":"3","author":"WA Bainbridge","year":"2011","unstructured":"Bainbridge WA, Hart JW, Kim ES, Scassellati B (2011) The benefits of interactions with physically present robots over video-displayed agents. Int J Soc Robot 3(1):41\u201352","journal-title":"Int J Soc Robot"},{"key":"607_CR2","doi-asserted-by":"publisher","first-page":"37","DOI":"10.1080\/10400435.2007.10131864","volume":"19","author":"A Billard","year":"2006","unstructured":"Billard A, Robins B, Dautenhahn K, Nadel J (2006) Building robota, a mini-humanoid robot for the rehabilitation of children with autism. RESNA Assist Technol J 19:37\u201349","journal-title":"RESNA Assist Technol J"},{"issue":"3\u20134","key":"607_CR3","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1080\/08839510590910200","volume":"19","author":"G Biswas","year":"2005","unstructured":"Biswas G, Leelawong K, Schwartz D, Vye N et al (2005) Learning by teaching: a new agent paradigm for educational software. Appl Artif Intell 19(3\u20134):363\u2013392","journal-title":"Appl Artif Intell"},{"key":"607_CR4","first-page":"21","volume":"50","author":"S Brophy","year":"1999","unstructured":"Brophy S, Biswas G, Katzlberger T, Bransford J, Schwartz D (1999) Teachable agents: combining insights from learning theory and computer science. Artif Intell Educ 50:21\u201328","journal-title":"Artif Intell Educ"},{"key":"607_CR5","doi-asserted-by":"crossref","unstructured":"Castro-Gonz\u00e1lez \u00c1, Amirabdollahian F, Polani D, Malfaz M, Salichs MA (2011) Robot self-preservation and adaptation to user preferences in game play, a preliminary study. In: 2011 IEEE international conference on robotics and biomimetics (ROBIO). IEEE, pp 2491\u20132498","DOI":"10.1109\/ROBIO.2011.6181679"},{"key":"607_CR6","unstructured":"Dautenhahn K (1999) Robots as social actors: aurora and the case of autism. In: Proceedings of CT99, the third international cognitive technology conference, August, San Francisco, vol 359, p 374"},{"issue":"3\u20134","key":"607_CR7","doi-asserted-by":"publisher","first-page":"369","DOI":"10.1155\/2009\/708594","volume":"6","author":"K Dautenhahn","year":"2009","unstructured":"Dautenhahn K, Nehaniv CL, Walters ML, Robins B, Kose-Bagci H, Mirza NA, Blow M (2009) KASPAR\u2014a minimally expressive humanoid robot for human\u2013robot interaction research. Appl Bionics Biomech 6(3\u20134):369\u2013397","journal-title":"Appl Bionics Biomech"},{"key":"607_CR8","unstructured":"Ferari E, Robins B, Dautenhahn K (2009) Robot as a social mediator\u2014a play scenario implementation with children with autism. In: 8th international conference on interaction design and children. IDC, pp 243\u2013252"},{"key":"607_CR9","doi-asserted-by":"crossref","unstructured":"Hood D, Lemaignan S, Dillenbourg P (2015) When children teach a robot to write: an autonomous teachable humanoid which uses simulated handwriting. In: Proceedings of the tenth annual ACM\/IEEE international conference on human\u2013robot interaction. ACM, pp 83\u201390","DOI":"10.1145\/2696454.2696479"},{"key":"607_CR10","first-page":"1","volume":"11","author":"LI Ismail","year":"2018","unstructured":"Ismail LI, Verhoeven T, Dambre J, Wyffels F (2018) Leveraging robotics research for children with autism: a review. Int J Soc Robot 11:1\u201322","journal-title":"Int J Soc Robot"},{"key":"607_CR11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3389\/fnbot.2011.00001","volume":"5","author":"M Khamassi","year":"2011","unstructured":"Khamassi M, Lall\u00e9e S, Enel P, Procyk E, Dominey P (2011) Robot cognitive control with a neurophysiologically inspired reinforcement learning model. Front Neurorobot 5:1","journal-title":"Front Neurorobot"},{"issue":"4","key":"607_CR12","doi-asserted-by":"publisher","first-page":"881","DOI":"10.1109\/TCDS.2018.2843122","volume":"10","author":"M Khamassi","year":"2018","unstructured":"Khamassi M, Velentzas G, Tsitsimis T, Tzafestas C (2018) Robot fast adaptation to changes in human engagement during simulated dynamic social interaction with active exploration in parameterized reinforcement learning. IEEE Trans Cogn Dev Syst 10(4):881\u2013893","journal-title":"IEEE Trans Cogn Dev Syst"},{"key":"607_CR13","unstructured":"Kidd CD, Breazeal C (2008) Robots at home: understanding long-term human-robot interaction. In: 2008 IEEE\/RSJ international conference on intelligent robots and systems. IEEE, pp 3230\u20133235"},{"key":"607_CR14","doi-asserted-by":"crossref","unstructured":"Kozima H, Yasuda Y, Nakagawa C (2007) Social interaction facilitated by a minimally-designed robot: findings from longitudinal therapeutic practices for autistic children. In: The 16th IEEE international symposium on robot and human interactive communication, 2007. RO-MAN 2007. IEEE, pp 599\u2013604","DOI":"10.1109\/ROMAN.2007.4415155"},{"key":"607_CR15","doi-asserted-by":"publisher","first-page":"516","DOI":"10.1016\/j.psychres.2018.12.032","volume":"271","author":"M Leng","year":"2018","unstructured":"Leng M, Liu P, Zhang P, Hu M, Zhou H, Li G, Yin H, Chen L (2018) Pet robot intervention for people with dementia: a systematic review and meta-analysis of randomized controlled trials. Psychiatry Res 271:516\u2013525","journal-title":"Psychiatry Res"},{"key":"607_CR16","unstructured":"Leyzberg D, Spaulding S, Toneva M, Scassellati B (2012) The physical presence of a robot tutor increases cognitive learning gains. In: Proceedings of the annual meeting of the cognitive science society, vol\u00a034"},{"key":"607_CR17","unstructured":"Marti P, Pollini A, Rullo A, Shibata T (2005) Engaging with artificial pets. In: Proceedings of the 2005 annual conference on European association of cognitive ergonomics. University of Athens, pp 99\u2013106"},{"key":"607_CR18","unstructured":"Milo (2019). Retrieved November 19, 2019, from https:\/\/robots4autism.com\/"},{"key":"607_CR19","doi-asserted-by":"crossref","unstructured":"Robins B, Dautenhahn K, Dubowski J (2004) Investigating autistic children\u2019s attitudes towards strangers with the theatrical robot\u2014a new experimental paradigm in human\u2013robot interaction studies. In: 13th IEEE international workshop on robot and human interactive communication, 2004. ROMAN 2004. IEEE, pp 557\u2013562","DOI":"10.1109\/ROMAN.2004.1374821"},{"issue":"3","key":"607_CR20","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1075\/is.7.3.16rob","volume":"7","author":"B Robins","year":"2006","unstructured":"Robins B, Dautenhahn K, Dubowski J (2006) Does appearance matter in the interaction of children with autism with a humanoid robot? Interact Stud 7(3):479\u2013512","journal-title":"Interact Stud"},{"key":"607_CR21","doi-asserted-by":"crossref","unstructured":"Robins B, Dautenhahn K, Wood L, Zaraki A (2017) Developing interaction scenarios with a humanoid robot to encourage visual perspective taking skills in children with autism\u2013preliminary proof of concept tests. In: International conference on social robotics. Springer, Cham, pp 147\u2013155","DOI":"10.1007\/978-3-319-70022-9_15"},{"issue":"4","key":"607_CR22","doi-asserted-by":"publisher","first-page":"534","DOI":"10.3102\/0034654307309920","volume":"77","author":"RD Roscoe","year":"2007","unstructured":"Roscoe RD, Chi MT (2007) Understanding tutor learning: knowledge-building and knowledge-telling in peer tutors\u2019 explanations and questions. Rev Educ Res 77(4):534\u2013574","journal-title":"Rev Educ Res"},{"issue":"2","key":"607_CR23","first-page":"3","volume":"2","author":"J Saldien","year":"2008","unstructured":"Saldien J, Goris K, Yilmazyildiz S, Verhelst W, Lefeber D (2008) On the design of the huggable robot probo. J Phys Agents 2(2):3\u201311","journal-title":"J Phys Agents"},{"key":"607_CR24","doi-asserted-by":"crossref","unstructured":"Skantze G, Al\u00a0Moubayed S (2012) Iristk: a statechart-based toolkit for multi-party face-to-face interaction. In: Proceedings of the 14th ACM international conference on Multimodal interaction. ACM, pp 69\u201376","DOI":"10.1145\/2388676.2388698"},{"key":"607_CR25","doi-asserted-by":"crossref","unstructured":"Stiehl WD, Lee JK, Breazeal C, Nalin M, Morandi A, Sanna A (2009) The huggable: a platform for research in robotic companions for pediatric care. In: Proceedings of the 8th international conference on interaction design and children. ACM, pp 317\u2013320","DOI":"10.1145\/1551788.1551872"},{"key":"607_CR26","volume-title":"Reinforcement learning: an introduction","author":"R Sutton","year":"1998","unstructured":"Sutton R, Barto A (1998) Reinforcement learning: an introduction. MIT Press, Cambridge"},{"issue":"1","key":"607_CR27","doi-asserted-by":"publisher","first-page":"78","DOI":"10.5898\/JHRI.1.1.Tanaka","volume":"1","author":"F Tanaka","year":"2012","unstructured":"Tanaka F, Matsuzoe S (2012) Children teach a care-receiving robot to promote their learning: field experiments in a classroom for vocabulary learning. J Hum Robot Interact 1(1):78\u201395","journal-title":"J Hum Robot Interact"},{"issue":"3","key":"607_CR28","doi-asserted-by":"publisher","first-page":"315","DOI":"10.1075\/is.13.3.01tap","volume":"13","author":"A Tapus","year":"2012","unstructured":"Tapus A, Peca A, Aly A, Pop C, Jisa L, Pintea S, Rusu AS, David DO (2012) Children with autism social engagement in interaction with nao, an imitative robot: a series of single case experiments. Interact Stud 13(3):315\u2013347","journal-title":"Interact Stud"},{"key":"607_CR29","doi-asserted-by":"publisher","first-page":"259","DOI":"10.3102\/0034654318821286","volume":"89","author":"R van den Berghe","year":"2018","unstructured":"van den Berghe R, Verhagen J, Oudgenoeg-Paz O, van der Ven S, Leseman P (2018) Social robots for language learning: a review. Rev Educ Res 89:259\u2013295","journal-title":"Rev Educ Res"},{"key":"607_CR30","doi-asserted-by":"publisher","first-page":"225","DOI":"10.3389\/fnbeh.2015.00225","volume":"9","author":"G Viejo","year":"2015","unstructured":"Viejo G, Khamassi M, Brovelli A, Girard B (2015) Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning. Front Behav Neurosci 9:225","journal-title":"Front Behav Neurosci"},{"issue":"3\u20134","key":"607_CR31","first-page":"279","volume":"8","author":"C Watkins","year":"1992","unstructured":"Watkins C, Dayan P (1992) Q-learning. Mach Learn 8(3\u20134):279\u2013292","journal-title":"Mach Learn"},{"key":"607_CR32","doi-asserted-by":"crossref","unstructured":"Wood L, Dautenhahn K, Robins B, Zaraki A (2017a) Developing child\u2013robot interaction scenarios with a humanoid robot to assist children with autism in developing visual respective taking skills. In: The 26th IEEE international symposium on robot and human interactive communication, RO-MAN 2017. Retrieved November 19, 2019, from https:\/\/ieeexplore.ieee.org\/document\/8172434","DOI":"10.1109\/ROMAN.2017.8172434"},{"key":"607_CR33","doi-asserted-by":"crossref","unstructured":"Wood LJ, Zaraki A, Walters ML, Novanda O, Robins B, Dautenhahn K (2017b) The iterative development of the humanoid robot kaspar: an assistive robot for children with autism. In: International conference on social robotics. Springer, pp 53\u201363","DOI":"10.1007\/978-3-319-70022-9_6"},{"key":"607_CR34","doi-asserted-by":"publisher","unstructured":"Wood LJ, Zaraki A, Robins B, Dautenhahn K (2019) Developing kaspar: a humanoid robot for children with autism. Int J Soc Robot 1\u201318. https:\/\/doi.org\/10.1007\/s12369-019-00563-6","DOI":"10.1007\/s12369-019-00563-6"},{"key":"607_CR35","unstructured":"Zaraki A, Dautenhahn K, Wood L, Novanda O, Robins B (2017) Toward autonomous child\u2013robot interaction: development of an interactive architecture for the humanoid kaspar robot. In: Proceedings 3rd workshop on child\u2013robot interaction at HRI 2017, vol\u00a03, pp 1\u20134"},{"key":"607_CR36","doi-asserted-by":"crossref","unstructured":"Zaraki A, Wood L, Robins B, Dautenhahn K (2018) Development of a semi-autonomous robotic system to assist children with autism in developing visual perspective taking skills. In: 2018 27th IEEE international symposium on robot and human interactive communication (RO-MAN), IEEE, pp 969\u2013976","DOI":"10.1109\/ROMAN.2018.8525681"}],"container-title":["International Journal of Social Robotics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-019-00607-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s12369-019-00607-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-019-00607-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,21]],"date-time":"2020-11-21T00:55:33Z","timestamp":1605920133000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s12369-019-00607-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,11,22]]},"references-count":36,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,7]]}},"alternative-id":["607"],"URL":"https:\/\/doi.org\/10.1007\/s12369-019-00607-x","relation":{},"ISSN":["1875-4791","1875-4805"],"issn-type":[{"value":"1875-4791","type":"print"},{"value":"1875-4805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,11,22]]},"assertion":[{"value":"8 November 2019","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 November 2019","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with Ethical Standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}