{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T04:55:50Z","timestamp":1777092950074,"version":"3.51.4"},"reference-count":43,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2024,6,6]],"date-time":"2024-06-06T00:00:00Z","timestamp":1717632000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,6]],"date-time":"2024-06-06T00:00:00Z","timestamp":1717632000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J of Soc Robotics"],"published-print":{"date-parts":[[2024,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Active or engaged learning is often seen as a way to improve students\u2019 performance concerning STEM topics. When following such a form of self-directed learning, students often need to receive feedback on their progress. Giving real-time feedback on an individual basis is usually beyond the teacher\u2019s capacity; in digital learning environments, this opens the door for exploring automated feedback. In the current study, a posttest only design was used to investigate the effect of providing students with different forms of automated feedback while they were creating a concept map about photosynthesis in an online inquiry learning environment. Participants were high school students (<jats:italic>N<\/jats:italic>\u2009=\u2009138), divided over two experimental groups. In one group, feedback was given by a humanoid robot and in the other group via an avatar. The effects of the different feedback forms were compared for the two groups in terms of the frequency with which students consulted the feedback, concept map quality, and students\u2019 attitudes. Results showed that the robot group consulted feedback more often than the avatar group. Moreover, the robot group had higher scores on a scale measuring enjoyment than the avatar group. Both of these differences were statistically significant. However, the average quality of the concept maps created by both groups was similar.<\/jats:p>","DOI":"10.1007\/s12369-024-01144-y","type":"journal-article","created":{"date-parts":[[2024,6,6]],"date-time":"2024-06-06T09:02:20Z","timestamp":1717664540000},"page":"1783-1796","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Does giving students feedback on their concept maps through an on-screen avatar or a humanoid robot make a difference?"],"prefix":"10.1007","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7472-279X","authenticated-orcid":false,"given":"Burak","family":"Sisman","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5120-7891","authenticated-orcid":false,"given":"Johannes","family":"Steinr\u00fccke","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0416-4304","authenticated-orcid":false,"given":"Ton","family":"de Jong","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2024,6,6]]},"reference":[{"key":"1144_CR1","doi-asserted-by":"crossref","unstructured":"Kroeze KA, Van Den Berg SM, Veldkamp BP,  De Jong T\n(2021) Automated assessment of and feedback on concept maps during inquiry learning. IEEE Trans Learn Technol 14(4):460\u2013473","DOI":"10.1109\/TLT.2021.3103331"},{"key":"1144_CR2","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s12369-010-0082-7","volume":"3","author":"WA Bainbridge","year":"2011","unstructured":"Bainbridge WA, Hart JW, Kim ES, Scassellati B (2011) The benefits of interactions with physically present robots over video-displayed agents. Int J Soc Robot 3:41\u201352. https:\/\/doi.org\/10.1007\/s12369-010-0082-7","journal-title":"Int J Soc Robot"},{"issue":"3","key":"1144_CR3","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1007\/s10798-007-9043-3","volume":"19","author":"M Barak","year":"2009","unstructured":"Barak M, Zadok Y (2009) Robotics projects and learning concepts in science, technology and problem solving. Int J Technol Des Educ 19(3):289\u2013307. https:\/\/doi.org\/10.1007\/s10798-007-9043-3","journal-title":"Int J Technol Des Educ"},{"key":"1144_CR4","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0178126","author":"P Baxter","year":"2017","unstructured":"Baxter P, Ashurst E, Read R, Kennedy J, Belpaeme T (2017) Robot education peers in a situated primary school study: personalisation promotes child learning. Plos One. https:\/\/doi.org\/10.1371\/journal.pone.0178126","journal-title":"Plos One"},{"key":"1144_CR5","doi-asserted-by":"publisher","DOI":"10.1126\/scirobotics.aat5954","author":"T Belpaeme","year":"2018","unstructured":"Belpaeme T, Kennedy J, Ramachandran A, Scassellati B, Tanaka F (2018) Social robots for education: a review. Sci Robot. https:\/\/doi.org\/10.1126\/scirobotics.aat5954","journal-title":"Sci Robot"},{"key":"1144_CR6","doi-asserted-by":"crossref","unstructured":"Breazeal C, Kidd CD, Thomaz AL, Hoffman G, Berlin M (2005) Effects of nonverbal communication on efficiency and robustness in human-robot teamwork. In 2005 IEEE\/RSJ international conference on intelligent robots and systems. IEEE. pp 708\u2013713","DOI":"10.1109\/IROS.2005.1545011"},{"issue":"3","key":"1144_CR7","doi-asserted-by":"publisher","first-page":"845","DOI":"10.1007\/s12369-021-00831-4","volume":"14","author":"M Carradore","year":"2022","unstructured":"Carradore M (2022) People\u2019s attitudes towards the use of robots in the social services: a multilevel analysis using eurobarometer data. Int J Soc Robot 14(3):845\u2013858. https:\/\/doi.org\/10.1007\/s12369-021-00831-4","journal-title":"Int J Soc Robot"},{"key":"1144_CR8","doi-asserted-by":"publisher","first-page":"75","DOI":"10.1007\/978-3-319-22368-1_8","volume":"37","author":"A Causo","year":"2016","unstructured":"Causo A, Vo GT, Chen IM, Yeo SH (2016) Design of robots used as education companion and tutor. Robot Mech 37:75\u201384. https:\/\/doi.org\/10.1007\/978-3-319-22368-1_8","journal-title":"Robot Mech"},{"issue":"4","key":"1144_CR9","first-page":"711","volume":"22","author":"E Cejka","year":"2006","unstructured":"Cejka E, Rogers C, Portsmore M (2006) Kindergarten robotics: Using robotics to motivate math, science, and engineering literacy in elementary school. Int J Eng Educ 22(4):711\u2013722","journal-title":"Int J Eng Educ"},{"issue":"2","key":"1144_CR10","first-page":"918","volume":"33","author":"MA Conde","year":"2017","unstructured":"Conde MA, Sanchez-Gonzalez L, Matellan-Olivera V, Rodriguez-Lera FJ (2017) Application of peer review techniques in engineering education. Int J Eng Educ 33(2):918\u2013926","journal-title":"Int J Eng Educ"},{"issue":"03","key":"1144_CR11","doi-asserted-by":"publisher","first-page":"1850006","DOI":"10.1142\/s0219843618500068","volume":"15","author":"S Costa","year":"2018","unstructured":"Costa S, Brunete A, Bae B-C, Mavridis N (2018) Emotional storytelling using virtual and robotic agents. Int J Humanoid Rob 15(03):1850006. https:\/\/doi.org\/10.1142\/s0219843618500068","journal-title":"Int J Humanoid Rob"},{"key":"1144_CR12","first-page":"107","volume-title":"Dealing with complexity in learning environments","author":"T de Jong","year":"2006","unstructured":"de Jong T (2006) Scaffolds for scientific discovery learning. In: Elen J, Clark RE (eds) Dealing with complexity in learning environments. Elsevier Science Publishers, Netherlands, pp 107\u2013128"},{"issue":"2","key":"1144_CR13","doi-asserted-by":"publisher","first-page":"153","DOI":"10.1111\/jcal.12337","volume":"35","author":"T de Jong","year":"2019","unstructured":"de Jong T (2019) Moving towards engaged learning in STEM domains; there is no simple answer, but clearly a road ahead. J Comput Assist Learn 35(2):153\u2013167. https:\/\/doi.org\/10.1111\/jcal.12337","journal-title":"J Comput Assist Learn"},{"key":"1144_CR14","first-page":"394","volume-title":"The Cambridge handbook of multimedia learning","author":"T de Jong","year":"2022","unstructured":"de Jong T (2022) The guided inquiry learning principle in multimedia learning. In: Mayer RE, Fiorella L (eds) The Cambridge handbook of multimedia learning, 3rd edn. Cambridge University Press, Cambridge, pp 394\u2013402","edition":"3"},{"key":"1144_CR15","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1007\/s11423-020-09904-z","volume":"69","author":"T de Jong","year":"2021","unstructured":"de Jong T, Gillet D, Rodr\u00edguez-Triana MJ, Hovardas T, Dikke D, Doran R, Dziabenko O, Koslowsky J, Korventausta M, Law E, Pedaste M, Tasiopoulou E, Vidal G, Zacharia Z (2021) Understanding teacher design practices for digital inquiry-based science learning: the case of Go-Lab. Educ Tech Res Dev 69:417\u2013444. https:\/\/doi.org\/10.1007\/s11423-020-09904-z","journal-title":"Educ Tech Res Dev"},{"issue":"3","key":"1144_CR16","doi-asserted-by":"publisher","first-page":"420","DOI":"10.1007\/s10956-020-09884-y","volume":"30","author":"N Dmoshinskaia","year":"2021","unstructured":"Dmoshinskaia N, Gijlers H, de Jong T (2021) Giving feedback on peers\u2019 concept maps in an inquiry learning context: the effect of providing assessment criteria. J Sci Educ Technol 30(3):420\u2013430. https:\/\/doi.org\/10.1007\/s10956-020-09884-y","journal-title":"J Sci Educ Technol"},{"issue":"4","key":"1144_CR17","doi-asserted-by":"publisher","first-page":"583","DOI":"10.1080\/10508406.2011.611776","volume":"21","author":"THS Eysink","year":"2012","unstructured":"Eysink THS, de Jong T (2012) Does instructional approach matter? How elaboration plays a crucial role in multimedia learning. J Learn Sci 21(4):583\u2013625. https:\/\/doi.org\/10.1080\/10508406.2011.611776","journal-title":"J Learn Sci"},{"issue":"3\u20134","key":"1144_CR18","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1016\/S0921-8890(02)00372-X","volume":"42","author":"T Fong","year":"2003","unstructured":"Fong T, Nourbakhsh I, Dautenhahn K (2003) A survey of socially interactive robots. Robot Auton Syst 42(3\u20134):143\u2013166. https:\/\/doi.org\/10.1016\/S0921-8890(02)00372-X","journal-title":"Robot Auton Syst"},{"issue":"5","key":"1144_CR19","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1002\/jaal.576","volume":"60","author":"N Frey","year":"2017","unstructured":"Frey N, Fisher D, Hattie J (2017) Surface, deep, and transfer? Considering the role of content literacy instructional strategies. J Adolesc Health 60(5):567\u2013575. https:\/\/doi.org\/10.1002\/jaal.576","journal-title":"J Adolesc Health"},{"key":"1144_CR20","doi-asserted-by":"publisher","first-page":"16013","DOI":"10.1038\/npjscilearn.2016.13","volume":"1","author":"JAC Hattie","year":"2016","unstructured":"Hattie JAC, Donoghue GM (2016) Learning strategies: a synthesis and conceptual model. npj Sci Learn 1:16013. https:\/\/doi.org\/10.1038\/npjscilearn.2016.13","journal-title":"npj Sci Learn"},{"issue":"1","key":"1144_CR21","doi-asserted-by":"publisher","first-page":"1","DOI":"10.17762\/turcomat.v9i1.169","volume":"9","author":"T Horzum","year":"2018","unstructured":"Horzum T (2018) The investigation of preservice mathematics teachers\u2019 knowledge about quadrilaterals through concept maps. Turk J Comput Math Educ 9(1):1\u201330. https:\/\/doi.org\/10.17762\/turcomat.v9i1.169","journal-title":"Turk J Comput Math Educ"},{"issue":"2","key":"1144_CR22","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1080\/15391523.2010.10782564","volume":"43","author":"D Ifenthaler","year":"2010","unstructured":"Ifenthaler D (2010) Bridging the gap between expert-novice differences. J Res Technol Educ 43(2):103\u2013117. https:\/\/doi.org\/10.1080\/15391523.2010.10782564","journal-title":"J Res Technol Educ"},{"key":"1144_CR23","unstructured":"Kanda T, and Ishiguro H (2005) Communication robots for elementary schools. In: Proceedings of the symposium on robot companions: hard problems and open challenges in robot-human interaction. AISB. pp 54\u201363"},{"key":"1144_CR24","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1016\/j.learninstruc.2018.01.011","volume":"115","author":"X Kuang","year":"2022","unstructured":"Kuang X, Eysink THS, de Jong T (2022) Effects of providing domain information on facilitating hypothesis generation in inquiry learning. J Educ Res 115:285\u2013297. https:\/\/doi.org\/10.1016\/j.learninstruc.2018.01.011","journal-title":"J Educ Res"},{"issue":"1","key":"1144_CR25","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1037\/xap0000111","volume":"23","author":"A Lachner","year":"2017","unstructured":"Lachner A, Burkhart C, N\u00fcckles M (2017) Mind the gap! Automated concept map feedback supports students in writing cohesive explanations. J Exp Psychol Appl 23(1):29\u201346. https:\/\/doi.org\/10.1037\/xap0000111","journal-title":"J Exp Psychol Appl"},{"issue":"2","key":"1144_CR26","doi-asserted-by":"publisher","first-page":"108","DOI":"10.47893\/IJCCT.2013.1177","volume":"4","author":"M Lalwani","year":"2013","unstructured":"Lalwani M, Bagmar N, Parikh S (2013) Efficient algorithm for auto correction using n-gram indexing. Intl J Comput Commun Technol (IJCCT) 4(2):108\u2013112. https:\/\/doi.org\/10.47893\/IJCCT.2013.1177","journal-title":"Intl J Comput Commun Technol (IJCCT)"},{"issue":"3","key":"1144_CR27","doi-asserted-by":"publisher","first-page":"681","DOI":"10.3102\/0034654315627366","volume":"86","author":"AW Lazonder","year":"2016","unstructured":"Lazonder AW, Harmsen R (2016) Meta-analysis of inquiry-based learning: effects of guidance. Rev Educ Res 86(3):681\u2013718. https:\/\/doi.org\/10.3102\/0034654315627366","journal-title":"Rev Educ Res"},{"key":"1144_CR28","unstructured":"Leyzberg D, Spaulding S, Toneva M and Scassellati B (2012) The physical presence of a robot tutor increases cognitive learning gains. In: Proceedings of the annual meeting of the cognitive science society"},{"issue":"8","key":"1144_CR29","first-page":"1977","volume":"8","author":"A Mehta","year":"2021","unstructured":"Mehta A, Salgond V, Satra D, Sharma N (2021) Spell correction and suggestion using Levenshtein distance. Int Res J Eng Technol 8(8):1977\u20131981","journal-title":"Int Res J Eng Technol"},{"key":"1144_CR30","doi-asserted-by":"publisher","DOI":"10.1787\/9789264267510-en","volume-title":"PISA 2015 results (volume II): policies and practices for successful schools","author":"OECD","year":"2016","unstructured":"OECD (2016) PISA 2015 results (volume II): policies and practices for successful schools. OECD Publishing, Francia. https:\/\/doi.org\/10.1787\/9789264267510-en"},{"key":"1144_CR31","doi-asserted-by":"publisher","DOI":"10.1787\/53f23881-en","volume-title":"PISA 2022 results (Volume I): the state of learning and equity in education","author":"OECD","year":"2023","unstructured":"OECD (2023) PISA 2022 results (Volume I): the state of learning and equity in education. OECD Publishing, Francia. https:\/\/doi.org\/10.1787\/53f23881-en"},{"issue":"4","key":"1144_CR32","doi-asserted-by":"publisher","first-page":"1277","DOI":"10.1002\/cae.22508","volume":"30","author":"SB \u00d6zkan","year":"2022","unstructured":"\u00d6zkan SB, Toz M (2022) A review study on the investigation of the effects of using robots in education on metacognitive behaviors. Comput Appl Eng Educ 30(4):1277\u20131288","journal-title":"Comput Appl Eng Educ"},{"key":"1144_CR33","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2016.00012","author":"Y Pan","year":"2016","unstructured":"Pan Y, Steed A (2016) A comparison of avatar-, video-, and robot-mediated interaction on users\u2019 trust in expertise. Front Robot AI. https:\/\/doi.org\/10.3389\/frobt.2016.00012","journal-title":"Front Robot AI"},{"key":"1144_CR34","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1016\/j.edurev.2015.02.003","volume":"14","author":"M Pedaste","year":"2015","unstructured":"Pedaste M, M\u00e4eots M, Siiman LA, de Jong T, van Riesen SAN, Kamp ET, Manoli CC, Zacharia ZC, Tsourlidaki E (2015) Phases of inquiry-based learning: definitions and inquiry cycle. Educ Res Rev 14:47\u201361. https:\/\/doi.org\/10.1016\/j.edurev.2015.02.003","journal-title":"Educ Res Rev"},{"issue":"10","key":"1144_CR35","doi-asserted-by":"publisher","first-page":"787","DOI":"10.3109\/0142159x.2012.684916","volume":"34","author":"S Ramani","year":"2012","unstructured":"Ramani S, Krackov SK (2012) Twelve tips for giving feedback effectively in the clinical environment. Med Teach 34(10):787\u2013791. https:\/\/doi.org\/10.3109\/0142159x.2012.684916","journal-title":"Med Teach"},{"key":"1144_CR36","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.learninstruc.2018.01.011","volume":"54","author":"KM Roessger","year":"2018","unstructured":"Roessger KM, Daley BJ, Hafez DA (2018) Effects of teaching concept mapping using practice, feedback, and relational framing. Learn Instr 54:11\u201321. https:\/\/doi.org\/10.1016\/j.learninstruc.2018.01.011","journal-title":"Learn Instr"},{"issue":"3","key":"1144_CR37","doi-asserted-by":"publisher","first-page":"377","DOI":"10.1080\/10494820.2018.1474234","volume":"27","author":"B Sisman","year":"2019","unstructured":"Sisman B, Gunay D, Kucuk S (2019) Development and validation of an Educational Robot Attitude Scale (ERAS) for secondary school students. Interact Learn Environ 27(3):377\u2013388. https:\/\/doi.org\/10.1080\/10494820.2018.1474234","journal-title":"Interact Learn Environ"},{"key":"1144_CR38","unstructured":"Strautmane M (2012) Concept map-based knowledge assessment tasks and their scoring criteria: an overview. Concept maps: theory, methodology, technology. In: Proceedings of the fifth international conference on concept mapping"},{"key":"1144_CR39","doi-asserted-by":"publisher","unstructured":"Szafir D and Mutlu B (2012) Pay attention! Designing adaptive agents that monitor and improve user engagement. In: Proceedings of the SIGCHI conference on human factors in computing systems. pp 11\u201320. https:\/\/doi.org\/10.1145\/2207676.2207679","DOI":"10.1145\/2207676.2207679"},{"key":"1144_CR40","volume-title":"Using multivariate statistics","author":"BG Tabachnick","year":"2013","unstructured":"Tabachnick BG, Fidell LS (2013) Using multivariate statistics, 6th edn. Pearson, London","edition":"6"},{"key":"1144_CR41","doi-asserted-by":"publisher","unstructured":"van den Berghe R, Petersen H, Hellendoorn A, and van Keulen H (2020) Programming a robot or an avatar: a study on learning outcomes, motivation, and cooperation. In: 2020 ACM\/IEEE international conference on human-robot interaction, Cambridge, United Kingdom. https:\/\/doi.org\/10.1145\/3371382.3378239","DOI":"10.1145\/3371382.3378239"},{"key":"1144_CR42","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2021.104272","volume":"173","author":"A-M Velentza","year":"2021","unstructured":"Velentza A-M, Fachantidis N, Lefkos I (2021) Learn with surprize from a robot professor. Comput Educ 173:104272","journal-title":"Comput Educ"},{"key":"1144_CR43","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1007\/s11423-015-9370-0","volume":"63","author":"ZC Zacharia","year":"2015","unstructured":"Zacharia ZC, Manoli C, Xenofontos N, de Jong T, Pedaste M, van Riesen SAN, Kamp E, M\u00e4eots M, Siiman LA, Tsourlidaki E (2015) Identifying potential types of guidance for supporting student inquiry in using virtual and remote labs: a literature review. Educ Tech Res Dev 63:257\u2013302. https:\/\/doi.org\/10.1007\/s11423-015-9370-0","journal-title":"Educ Tech Res Dev"}],"container-title":["International Journal of Social Robotics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-024-01144-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s12369-024-01144-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s12369-024-01144-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,8,28]],"date-time":"2024-08-28T13:25:42Z","timestamp":1724851542000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s12369-024-01144-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,6]]},"references-count":43,"journal-issue":{"issue":"8","published-print":{"date-parts":[[2024,8]]}},"alternative-id":["1144"],"URL":"https:\/\/doi.org\/10.1007\/s12369-024-01144-y","relation":{},"ISSN":["1875-4791","1875-4805"],"issn-type":[{"value":"1875-4791","type":"print"},{"value":"1875-4805","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,6]]},"assertion":[{"value":"6 May 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 June 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}