{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,13]],"date-time":"2026-06-13T07:23:00Z","timestamp":1781335380578,"version":"3.54.1"},"reference-count":58,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2018,10,31]],"date-time":"2018-10-31T00:00:00Z","timestamp":1540944000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1139078"],"award-info":[{"award-number":["1139078"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["J. Hum.-Robot Interact."],"published-print":{"date-parts":[[2018,10,31]]},"abstract":"<jats:p>The benefits of personalized social robots must be evaluated in real-world educational contexts over periods of time longer than a single session to understand their full potential to impact learning outcomes. In this work, we describe a personalization system designed for longer-term personalization that orders curriculum based on an adaptive Hidden Markov Model (HMM) that evaluates students\u2019 skill proficiencies. We present a study investigating the effectiveness of this system in a five-session interaction with a robot tutor, taking place over the course of 2 weeks. Our system is evaluated in the context of native Spanish-speaking first-graders interacting with a social robot tutor while completing an English Language Learning educational task. Participants either received lessons: (1) ordered by our adaptive HMM personalization system which selects a lesson based on a skill that the individual participant needs more practice with (\u201cpersonalized condition\u201d) or (2) ordered randomly from among the lessons the participant had not yet seen (\u201cnon-personalized condition\u201d). We found that participants who received personalized lessons from the robot tutor outperformed participants who received non-personalized lessons on a post-test by 2.0 standard deviations on average, corresponding to a mean learning gain in the 98th percentile.<\/jats:p>","DOI":"10.1145\/3283453","type":"journal-article","created":{"date-parts":[[2019,5,7]],"date-time":"2019-05-07T12:15:57Z","timestamp":1557231357000},"page":"1-19","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":55,"title":["The Effect of Personalization in Longer-Term Robot Tutoring"],"prefix":"10.1145","volume":"7","author":[{"given":"Daniel","family":"Leyzberg","sequence":"first","affiliation":[{"name":"Princeton University, NJ, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aditi","family":"Ramachandran","sequence":"additional","affiliation":[{"name":"Yale University, New Haven, CT, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Brian","family":"Scassellati","sequence":"additional","affiliation":[{"name":"Yale University, New Haven, CT, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,12,5]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1142\/S0219843614500224"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2008.4600749"},{"key":"e_1_2_1_3_1","doi-asserted-by":"crossref","unstructured":"R. S. Baker A. T. Corbett and K. R. Koedinger. 2004. Detecting student misuse of intelligent tutoring systems. In Intelligent Tutoring Systems. Springer 531--540. R. S. Baker A. T. Corbett and K. R. Koedinger. 2004. Detecting student misuse of intelligent tutoring systems. In Intelligent Tutoring Systems. Springer 531--540.","DOI":"10.1007\/978-3-540-30139-4_50"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0178126"},{"key":"e_1_2_1_5_1","doi-asserted-by":"crossref","unstructured":"Tony Belpaeme James Kennedy Aditi Ramachandran Brian Scassellati and Fumihide Tanaka. 2018. Social robots for education: A review. Sci. Robot. 3 21 (2018). http:\/\/robotics.sciencemag.org\/content\/3\/21\/eaat5954. Tony Belpaeme James Kennedy Aditi Ramachandran Brian Scassellati and Fumihide Tanaka. 2018. Social robots for education: A review. Sci. Robot. 3 21 (2018). http:\/\/robotics.sciencemag.org\/content\/3\/21\/eaat5954.","DOI":"10.1126\/scirobotics.aat5954"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-018-0467-6"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.3102\/00028312042002305"},{"key":"e_1_2_1_8_1","volume-title":"Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies","volume":"1","author":"Chen M.","year":"2002"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/DEVLRN.2015.7346164"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-009-9062-8"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.5898\/JHRI.5.1.Coninx"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01099821"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3171221.3171277"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-011-9106-8"},{"key":"e_1_2_1_15_1","volume-title":"Encyclopedia of the Sciences of Learning","author":"D\u2019Mello S."},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.specom.2009.04.005"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/PROC.1973.9030"},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201915)","author":"Gordon Goren","year":"2015"},{"key":"e_1_2_1_19_1","volume-title":"Proceedings of the AAAI Conference on Artificial Intelligence (AAAI\u201916)","author":"Gordon Goren","year":"2016"},{"key":"e_1_2_1_20_1","volume-title":"Proceedings of the AAAI Fall Symposium on Artificial Intelligence and Human-Robot Interaction (AI-HRI\u201914)","author":"Greczek Jillian","year":"2014"},{"key":"e_1_2_1_21_1","unstructured":"K. E. Hogan and M. E. Pressley. 1997. Scaffolding Student Learning: Instructional Approaches and Issues. Brookline Books. K. E. Hogan and M. E. Pressley. 1997. Scaffolding Student Learning: Instructional Approaches and Issues. Brookline Books."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2559636.2559667"},{"key":"e_1_2_1_23_1","volume-title":"Overview of Race and Hispanic Origin","author":"Humes K.","year":"2010"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-0285(89)90003-0"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-017-0458-z"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1901%262_4"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-25554-5_33"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/2906831.2906873"},{"key":"e_1_2_1_29_1","volume-title":"Proceedings of the Annual Meeting of the North American Chapter of the International Group for the Psychology of Mathematics Education. ERIC, 21--49","author":"Koedinger Kenneth R.","year":"2002"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543060002265"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0958344010000273"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-34103-8_30"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s12369-014-0227-1"},{"key":"e_1_2_1_34_1","doi-asserted-by":"crossref","unstructured":"M. Levy. 1997. Computer-Assisted Language Learning: Context and Conceptualization. ERIC. M. Levy. 1997. Computer-Assisted Language Learning: Context and Conceptualization. ERIC.","DOI":"10.1093\/oso\/9780198236320.001.0001"},{"key":"e_1_2_1_35_1","doi-asserted-by":"crossref","unstructured":"M. Levy and G. Stockwell. 2013. CALL Dimensions: Options and Issues in Computer-assisted Language Learning. Routledge. M. Levy and G. Stockwell. 2013. CALL Dimensions: Options and Issues in Computer-assisted Language Learning. Routledge.","DOI":"10.4324\/9780203708200"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/2559636.2559671"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 34th Annual Conference of the Cognitive Science Society. Cognitive Science Society","author":"Leyzberg D."},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797613504302"},{"key":"e_1_2_1_39_1","volume-title":"Computers: Analysing Productive Interaction","author":"Littleton K.","year":"1999"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0203_2"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog0000_14"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1037\/1076-898X.14.2.101"},{"key":"e_1_2_1_43_1","volume-title":"Proceedings of the 7th International Joint Conference on Autonomous Agents and Multiagent Systems","volume":"3","author":"Pereira Andr\u00e9","year":"2008"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/1228716.1228736"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020209"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.5555\/2906831.2906875"},{"key":"e_1_2_1_47_1","volume-title":"Bilingual Children: From Birth to Teens. ERIC.","author":"Saunders G.","year":"1988"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1145\/2909824.3020222"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/HUMANOIDS.2014.7041511"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2207676.2207679"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0707769104"},{"key":"e_1_2_1_52_1","unstructured":"Muhammad Tanveer. 2007. Investigation of the factors that cause language anxiety for ESL\/EFL learners in learning speaking skills and the influence it casts on communication in the target language. Master's thesis. University of Glasgow Scotland UK. Muhammad Tanveer. 2007. Investigation of the factors that cause language anxiety for ESL\/EFL learners in learning speaking skills and the influence it casts on communication in the target language. Master's thesis. University of Glasgow Scotland UK."},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1109\/ROMAN.2009.5326211"},{"key":"e_1_2_1_54_1","unstructured":"Wayne P. Thomas and Virginia P. Collier. 2002. A National Study of School Effectiveness for Language Minority Students' Long-Term Academic Achievement. Technical Report. University of California at Santa Cruz Center for Research on Education Diversity and Excellence. Wayne P. Thomas and Virginia P. Collier. 2002. A National Study of School Effectiveness for Language Minority Students' Long-Term Academic Achievement. Technical Report. University of California at Santa Cruz Center for Research on Education Diversity and Excellence."},{"key":"e_1_2_1_55_1","unstructured":"U.S. Census Bureau. 2011. 2010 Census. U.S. Department of Commerce. U.S. Census Bureau. 2011. 2010 Census. U.S. Department of Commerce."},{"key":"e_1_2_1_56_1","volume-title":"Proceedings of the 16th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN\u201907)","author":"Wainer Joshua"},{"key":"e_1_2_1_57_1","first-page":"10","article-title":"Hidden Markov models and the Baum-Welch algorithm","volume":"53","author":"Welch L. R.","year":"2003","journal-title":"IEEE Inf. Theory Soc. Newslett."},{"key":"e_1_2_1_58_1","volume-title":"Proceedings of the 4th International Conference of the Learning Sciences. 115--120","author":"Williams S. M."}],"container-title":["ACM Transactions on Human-Robot Interaction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3283453","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3283453","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:58:06Z","timestamp":1750208286000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3283453"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,10,31]]},"references-count":58,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2018,10,31]]}},"alternative-id":["10.1145\/3283453"],"URL":"https:\/\/doi.org\/10.1145\/3283453","relation":{},"ISSN":["2573-9522"],"issn-type":[{"value":"2573-9522","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,10,31]]},"assertion":[{"value":"2017-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-12-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}