{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,7]],"date-time":"2026-03-07T18:45:06Z","timestamp":1772909106020,"version":"3.50.1"},"reference-count":83,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T00:00:00Z","timestamp":1727222400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T00:00:00Z","timestamp":1727222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"BMBF"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Educ Inf Technol"],"published-print":{"date-parts":[[2025,4]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>As distance learning becomes increasingly important and artificial intelligence tools continue to advance, automated systems for individual learning have attracted significant attention. However, the scarcity of open-source online tools that are capable of providing personalized feedback has restricted the widespread implementation of research-based feedback systems. In this work, we present RATsApp, an open-source automated feedback system (AFS) that incorporates research-based features such as formative feedback. The system focuses on core STEM competencies such as mathematical competence, representational competence, and data literacy. It also allows lecturers to monitor students\u2019 progress. RATsApp can be used at different levels of STEM education or research, as it allows the creation and customization of the educational content. We present a specific case of its implementation in higher education, where we report the results of a usability survey (N=64), using the technology acceptance model 2 (TAM2), to evaluate the user experience of undergraduate students. Our findings confirm the applicability of the TAM2 framework, revealing that factors such as the relevance to the course of study, output quality, and ease of use significantly influence the perceived usefulness. We also found a linear relation between the perceived usefulness and the intention to use, which in turn is a significant predictor of the frequency of use. Moreover, the formative feedback feature of RATsApp received positive feedback, indicating its potential as an educational tool. Furthermore, as an open-source platform, RATsApp encourages public contributions to its ongoing development, fostering a collaborative approach to improve educational tools.<\/jats:p>","DOI":"10.1007\/s10639-024-13025-y","type":"journal-article","created":{"date-parts":[[2024,9,25]],"date-time":"2024-09-25T21:04:40Z","timestamp":1727298280000},"page":"6019-6060","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["Lessons learned from designing an open-source automated feedback system for STEM education"],"prefix":"10.1007","volume":"30","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-6364-934X","authenticated-orcid":false,"given":"Steffen","family":"Steinert","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6294-2915","authenticated-orcid":false,"given":"Lars","family":"Krupp","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2087-3592","authenticated-orcid":false,"given":"Karina E.","family":"Avila","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1701-1876","authenticated-orcid":false,"given":"Anke S.","family":"Janssen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Verena","family":"Ruf","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David","family":"Dzsotjan","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christian De","family":"Schryver","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jakob","family":"Karolus","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stefan","family":"Ruzika","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Karen","family":"Joisten","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"Lukowicz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jochen","family":"Kuhn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Norbert","family":"Wehn","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2729-1592","authenticated-orcid":false,"given":"Stefan","family":"K\u00fcchemann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2024,9,25]]},"reference":[{"key":"13025_CR1","unstructured":"Abrassart, C., Bengio, Y., Chicoisne, G., de Marcellis-Warin, N., Dilhac, M- A., Gambs, S.. Voarino, N. (2018). Montr\u00e9al declaration for a responsible development of artificial intelligence. Universit\u00e9 de Montr\u00e9al."},{"key":"13025_CR2","unstructured":"Anderson, T. (2003). Modes of interaction in distance education: Recent developments and research questions. Handbook of Distance Education, 129\u2013144"},{"issue":"1","key":"13025_CR3","doi-asserted-by":"publisher","first-page":"3","DOI":"10.3200\/JECE.35.1.3-23","volume":"35","author":"CL Ballard","year":"2004","unstructured":"Ballard, C. L., & Johnson, M. F. (2004). Basic math skills and performance in an introductory economics class. The Journal of Economic Education, 35(1), 3\u201323. https:\/\/doi.org\/10.3200\/JECE.35.1.3-23","journal-title":"The Journal of Economic Education"},{"issue":"2","key":"13025_CR4","doi-asserted-by":"publisher","first-page":"213","DOI":"10.3102\/00346543061002213","volume":"61","author":"RL Bangert-Drowns","year":"1991","unstructured":"Bangert-Drowns, R. L., Kulik, C.-L.C., Kulik, J. A., & Morgan, M. (1991). The instructional effect of feedback in test-like events. Review of Educational Research, 61(2), 213\u2013238. https:\/\/doi.org\/10.3102\/00346543061002213","journal-title":"Review of Educational Research"},{"key":"13025_CR5","doi-asserted-by":"publisher","unstructured":"Bannert, M., & Mengelkamp, C. (2013). Scaffolding hypermedia learning through metacognitive prompts. International Handbook of Metacognition and Learning Technologies, 171\u2013186,. https:\/\/doi.org\/10.1007\/978-1-4419-5546-3_12","DOI":"10.1007\/978-1-4419-5546-3_12"},{"key":"13025_CR6","doi-asserted-by":"publisher","unstructured":"Beauchamp, T., & Childress, J. (2019). Principles of biomedical ethics: Marking its fortieth anniversary. The American Journal of Bioethics, 19(11), 9\u20131. https:\/\/doi.org\/10.1080\/15265161.2019.1665402","DOI":"10.1080\/15265161.2019.1665402"},{"issue":"1","key":"13025_CR7","doi-asserted-by":"publisher","first-page":"5","DOI":"10.1080\/0969594X.2010.513678","volume":"18","author":"RE Bennett","year":"2011","unstructured":"Bennett, R. E. (2011). Formative assessment: A critical review. Assessment in Education: Principles, Policy & Practice, 18(1), 5\u201325. https:\/\/doi.org\/10.1080\/0969594X.2010.513678","journal-title":"Assessment in Education: Principles, Policy & Practice"},{"issue":"4","key":"13025_CR8","doi-asserted-by":"publisher","first-page":"336","DOI":"10.1002\/sce.3730450409","volume":"45","author":"RH Blumenthal","year":"1961","unstructured":"Blumenthal, R. H. (1961). Multiple instruction and other factors related to achievement in college physics. Science Education, 45(4), 336\u2013342. https:\/\/doi.org\/10.1002\/sce.3730450409","journal-title":"Science Education"},{"key":"13025_CR9","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1007\/bf02461643","volume":"28","author":"GM Bowen","year":"1998","unstructured":"Bowen, G. M., & Roth, W.-M. (1998). Lecturing graphing: What features of lectures contribute to student difficulties in learning to interpret graph? Research in Science Education, 28, 77\u201390. https:\/\/doi.org\/10.1007\/bf02461643","journal-title":"Research in Science Education"},{"key":"13025_CR10","unstructured":"Brookhart, S.M. (2017). How to give effective feedback to your students. Ascd."},{"issue":"3","key":"13025_CR11","doi-asserted-by":"publisher","first-page":"245","DOI":"10.3102\/00346543065003245","volume":"65","author":"DL Butler","year":"1995","unstructured":"Butler, D. L., & Winne, P. H. (1995). Feedback and self-regulated learning: A theoretical synthesis. Review of Educational Research, 65(3), 245\u2013281. https:\/\/doi.org\/10.3102\/00346543065003245","journal-title":"Review of Educational Research"},{"issue":"3","key":"13025_CR12","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1080\/15228053.2021.1980848","volume":"23","author":"S Chandra","year":"2021","unstructured":"Chandra, S., & Palvia, S. (2021). Online education next wave: Peer to peer learning. Journal of Information Technology Case and Application Research, 23(3), 157\u2013172.","journal-title":"Journal of Information Technology Case and Application Research"},{"issue":"3","key":"13025_CR13","doi-asserted-by":"publisher","first-page":"215824402311921","DOI":"10.1177\/21582440231192151","volume":"13","author":"L Chen","year":"2023","unstructured":"Chen, L., Geng, X., Lu, M., Shimada, A., & Yamada, M. (2023). How students use learning analytics dashboards in higher education: A learning performance perspective. SAGE Open, 13(3), 21582440231192150. https:\/\/doi.org\/10.1177\/21582440231192151","journal-title":"SAGE Open"},{"key":"13025_CR14","doi-asserted-by":"publisher","unstructured":"Deeva, G., Bogdanova, D., Serral, E., Snoeck, M., & De Weerdt, J. (2021). A review of automated feedback systems for learners: Classification framework, challenges and opportunities. Computers & Education, 162[SPACE]https:\/\/doi.org\/10.1016\/j.compedu.2020.104094","DOI":"10.1016\/j.compedu.2020.104094"},{"key":"13025_CR15","unstructured":"Duval, E., Klerkx, J., Verbert, K., Nagel, T., Govaerts, S., Parra\u00a0Chico, G.A.. Vandeputte, B. (2012). Learning dashboards & learnscapes. Educational Interfaces, Software, and Technology, 1\u20135,"},{"issue":"1","key":"13025_CR16","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1186\/s40594-023-00435-6","volume":"10","author":"PA Edelsbrunner","year":"2023","unstructured":"Edelsbrunner, P. A., Malone, S., Hofer, S. I., K\u00fcchemann, S., Kuhn, J., Schmid, R., & Lichtenberger, A. (2023). The relation of representational competence and conceptual knowledge in female and male undergraduates. International Journal of STEM Education, 10(1), 1\u201319. https:\/\/doi.org\/10.1186\/s40594-023-00435-6","journal-title":"International Journal of STEM Education"},{"key":"13025_CR17","doi-asserted-by":"publisher","unstructured":"Engel, C., Linhardt, L., & Schubert, M. (2024). Code is law: How compas affects the way the judiciary handles the risk of recidivism. Artificial Intelligence and Law. https:\/\/doi.org\/10.1007\/s10506-024-09389-8","DOI":"10.1007\/s10506-024-09389-8"},{"key":"13025_CR18","unstructured":"European Commission, Directorate-General for Communications Networks, Content and Technology (2019). Ethics guidelines for trustworthy AI. Publications Office. https:\/\/data.europa.eu\/doi\/10.2759\/346720"},{"key":"13025_CR19","unstructured":"European Commission, Directorate-General for Education, Youth, Sport and Culture (2022). Ethical guidelines on the use of artificial intelligence (AI) and data in teaching and learning for educators. Publications Office of the European Union. https:\/\/data.europa.eu\/doi\/10.2766\/153756"},{"issue":"23","key":"13025_CR20","doi-asserted-by":"publisher","first-page":"8410","DOI":"10.1073\/pnas.1319030111","volume":"111","author":"S Freeman","year":"2014","unstructured":"Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410\u20138415. https:\/\/doi.org\/10.1073\/pnas.1319030111","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"13025_CR21","unstructured":"Fuchs, T. (2020). Verteidigung des menschen: Grundfragen einer verk\u00f6rperten anthropologie. Suhrkamp Verlag."},{"key":"13025_CR22","unstructured":"Hake, R.R. (2002). Relationship of individual student normalized learning gains in mechanics with gender, high-school physics, and pretest scores on mathematics and spatial visualization. Physics education research conference 8, pp. 1\u201314"},{"key":"13025_CR23","doi-asserted-by":"publisher","unstructured":"Harasim, L. (2000). Shift happens: Online education as a new paradigm in learning. The Internet and Higher Education, 3(1\u20132), 41\u201361. https:\/\/doi.org\/10.1016\/S1096-7516(00)00032-4","DOI":"10.1016\/S1096-7516(00)00032-4"},{"key":"13025_CR24","unstructured":"Hartman, H.J. (2001). Metacognition in learning and instruction: Theory, research and practice 19 Springer Science & Business Media."},{"key":"13025_CR25","doi-asserted-by":"crossref","DOI":"10.4324\/9780203887332","volume-title":"Visible learning: A synthesis of over 800 meta-analyses relating to achievement","author":"J Hattie","year":"2008","unstructured":"Hattie, J. (2008). Visible learning: A synthesis of over 800 meta-analyses relating to achievement. Routledge."},{"issue":"1","key":"13025_CR26","doi-asserted-by":"publisher","first-page":"111","DOI":"10.1080\/0969595980050107","volume":"5","author":"J Hattie","year":"1998","unstructured":"Hattie, J., & Jaeger, R. (1998). Assessment and classroom learning: A deductive approach. Assessment in Education: Principles, Policy & Practice, 5(1), 111\u2013122. https:\/\/doi.org\/10.1080\/0969595980050107","journal-title":"Assessment in Education: Principles, Policy & Practice"},{"issue":"1","key":"13025_CR27","doi-asserted-by":"publisher","first-page":"81","DOI":"10.3102\/003465430298487","volume":"77","author":"J Hattie","year":"2007","unstructured":"Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81\u2013112. https:\/\/doi.org\/10.3102\/003465430298487","journal-title":"Review of Educational Research"},{"issue":"12","key":"13025_CR28","doi-asserted-by":"publisher","first-page":"1117","DOI":"10.1119\/1.12895","volume":"50","author":"H Hudson","year":"1982","unstructured":"Hudson, H., & Liberman, D. (1982). The combined effect of mathematics skills and formal operational reasoning on student performance in the general physics course. American Journal of Physics, 50(12), 1117\u20131119. https:\/\/doi.org\/10.1119\/1.12895","journal-title":"American Journal of Physics"},{"key":"13025_CR29","doi-asserted-by":"publisher","unstructured":"Joisten, K. (2004). Topik, kritik und geometrische methode die bedeutung von giambattista vicos \u201cliber metaphysicus.\u201d Deutsche Zeitschrift f\u00fcr Philosophie, 52(4), 541\u2013552. https:\/\/doi.org\/10.1524\/dzph.2004.52.4.541","DOI":"10.1524\/dzph.2004.52.4.541"},{"key":"13025_CR30","doi-asserted-by":"crossref","unstructured":"Joisten, K. (2006). Die Hauptstra\u00dfe verlassen. Oder: Mit Giambattista Vico auf einer anderen F\u00e4hrte. K.\u00a0Broese, A.\u00a0H\u00fctig, O.\u00a0Immel, and R.\u00a0Reschke (Eds.), Vernunft der Aufkl\u00e4rung - Aufkl\u00e4rung der Vernunft (pp. 53\u201362). Berlin: Akademie Verlag. [2023-03-31] https:\/\/doi.org\/10.1524\/9783050082073.53","DOI":"10.1524\/9783050082073.53"},{"key":"13025_CR31","unstructured":"Joisten, K. (2020a) Ethik und digitalisierung, oder: Ethik f\u00fcr ki-systeme. eine grundlegung. Zukunft der pflege, konferenzband zur 3. \u00f6ffentlichen konferenz des bmbf-clusters: Zukunft der pflege (pp. 11\u201314). PPZ N\u00fcrnberg."},{"key":"13025_CR32","doi-asserted-by":"crossref","unstructured":"Joisten, K. (2020b) Kulturphilosophische Zug\u00e4nge zur Medizin- und Informationstechnik. A.\u00a0Manzeschke and W.\u00a0Niederlag (Eds.), Ethische perspektiven auf biomedizinische technologie (pp. 91\u201399). De Gruyter.","DOI":"10.1515\/9783110645767-010"},{"key":"13025_CR33","doi-asserted-by":"crossref","unstructured":"Joisten, K., Thiemer, N., Renner, T., Janssen, A., Scheffler, A. (2022). Focusing on the ethical challenges of data breaches and applications. 2022 ieee international conference on assured autonomy (icaa) (pp. 74\u201382).","DOI":"10.1109\/ICAA52185.2022.00018"},{"key":"13025_CR34","doi-asserted-by":"crossref","unstructured":"Kaminski, A. (2020). Gr\u00fcnde geben. Maschinelles Lernen als Problem der Moralf\u00e4higkeit von Entscheidungen. K.\u00a0Wiegerling, M.\u00a0Nerurkar, and C.\u00a0Wadephul (Eds.), Datafizierung und big data: Ethische, anthropologische und wissenschaftstheoretische perspektiven (pp. 151\u2013174). Wiesbaden: Springer Fachmedien Wiesbaden. https:\/\/doi.org\/10.1007\/978-3-658-27149-7_6","DOI":"10.1007\/978-3-658-27149-7_6"},{"key":"13025_CR35","unstructured":"Kemp, P. (1992). Das unersetzliche: eine technologie-ethik. Wichern."},{"key":"13025_CR36","doi-asserted-by":"publisher","first-page":"21","DOI":"10.1016\/j.stueduc.2017.11.001","volume":"56","author":"WB Kippers","year":"2018","unstructured":"Kippers, W. B., Poortman, C. L., Schildkamp, K., & Visscher, A. J. (2018). Data literacy: What do educators learn and struggle with during a data use intervention? Studies in Educational Evaluation, 56, 21\u201331. https:\/\/doi.org\/10.1016\/j.stueduc.2017.11.001","journal-title":"Studies in Educational Evaluation"},{"issue":"3","key":"13025_CR37","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1111\/1467-8721.ep10772989","volume":"7","author":"AN Kluger","year":"1998","unstructured":"Kluger, A. N., & DeNisi, A. (1998). Feedback interventions: Toward the understanding of a double-edged sword. Current Directions in Psychological Science, 7(3), 67\u201372. https:\/\/doi.org\/10.1111\/1467-8721.ep10772989","journal-title":"Current Directions in Psychological Science"},{"key":"13025_CR38","doi-asserted-by":"publisher","unstructured":"Knoop-van Campen, C. A., Wise, A., & Molenaar, I. (2021). The equalizing effect of teacher dashboards on feedback in k-12 classrooms. Interactive Learning Environments, 1\u201317,. https:\/\/doi.org\/10.1080\/10494820.2021.1931346","DOI":"10.1080\/10494820.2021.1931346"},{"key":"13025_CR39","doi-asserted-by":"publisher","unstructured":"Kohl, P. B., & Finkelstein, N. D. (2006). Effect of instructional environment on physics students\u2019 representational skills. Physical Review Special Topics-Physics Education Research, 2(1). https:\/\/doi.org\/10.1103\/PhysRevSTPER.2.010102","DOI":"10.1103\/PhysRevSTPER.2.010102"},{"key":"13025_CR40","doi-asserted-by":"publisher","first-page":"1013","DOI":"10.1007\/s10763-014-9534-0","volume":"13","author":"H Korpershoek","year":"2015","unstructured":"Korpershoek, H., Kuyper, H., & van der Werf, G. (2015). The relation between students\u2019math and reading ability and their mathematics, physics, and chemistry examination grades in secondary education. International Journal of Science and Mathematics Education, 13, 1013\u20131037. https:\/\/doi.org\/10.1007\/s10763-014-9534-0","journal-title":"International Journal of Science and Mathematics Education"},{"key":"13025_CR41","doi-asserted-by":"publisher","unstructured":"K\u00fcchemann, S., Malone, S., Edelsbrunner, P., Lichtenberger, A., Stern, E., Schumacher, R., & Kuhn, J. (2021). Inventory for the assessment of representational competence of vector fields. Physical Review Physics Education Research, 17(2). https:\/\/doi.org\/10.1103\/PhysRevPhysEducRes.17.020126","DOI":"10.1103\/PhysRevPhysEducRes.17.020126"},{"key":"13025_CR42","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/BF01320096","volume":"1","author":"RW Kulhavy","year":"1989","unstructured":"Kulhavy, R. W., & Stock, W. A. (1989). Feedback in written instruction: The place of response certitude. Educational Psychology Review, 1, 279\u2013308. https:\/\/doi.org\/10.1007\/BF01320096","journal-title":"Educational Psychology Review"},{"issue":"226","key":"13025_CR43","first-page":"5","volume":"2013","author":"RM Lerner","year":"2013","unstructured":"Lerner, R. M. (2013). At the forge: Sqlalchemy. Linux Journal, 2013(226), 5.","journal-title":"At the forge: Sqlalchemy. Linux Journal"},{"key":"13025_CR44","doi-asserted-by":"publisher","unstructured":"Lin, T- C., Hsu, Y- S., Lin, S-S., Changlai, M-L., Yang, K- Y., Lai, T- L. (2012). A review of empirical evidence on scaffolding for science education. International Journal of Science and Mathematics Education, 10, 437\u2013455. https:\/\/doi.org\/10.1007\/s10763-011-9322-Z","DOI":"10.1007\/s10763-011-9322-Z"},{"key":"13025_CR45","doi-asserted-by":"publisher","unstructured":"Liu, M., & Yu, D. (2022). Towards intelligent e-learning systems. Education and Information Technologies, 1\u201332,. https:\/\/doi.org\/10.1007\/s10639-022-11479-6","DOI":"10.1007\/s10639-022-11479-6"},{"key":"13025_CR46","doi-asserted-by":"publisher","unstructured":"Llamas, A., Vila, F., Sanz, A. (2012). Mathematical skills in undergraduate students. A ten-year survey of a plant physiology course. Bioscience Education, 19(1), 1\u201310https:\/\/doi.org\/10.11120\/beej.2012.19000006","DOI":"10.11120\/beej.2012.19000006"},{"key":"13025_CR47","doi-asserted-by":"publisher","unstructured":"Meyer, W- U., Bachmann, M., Biermann, U., Hempelmann, M., Ploger, F-O., Spiller, H. (1979). The informational value of evaluative behavior: Influences of praise and blame on perceptions of ability. Journal of Educational Psychology, 71(2), 259. https:\/\/doi.org\/10.1037\/0022-0663.71.2.259","DOI":"10.1037\/0022-0663.71.2.259"},{"key":"13025_CR48","doi-asserted-by":"publisher","unstructured":"Mousavinasab, E., Zarifsanaiey, N., Niakan Kalhori, R., & S., Rakhshan, M., Keikha, L., Ghazi Saeedi, M. (2021). Intelligent tutoring systems: A systematic review of characteristics, applications, and evaluation methods. Interactive Learning Environments, 29(1), 142\u2013163. https:\/\/doi.org\/10.1080\/10494820.2018.1558257","DOI":"10.1080\/10494820.2018.1558257"},{"key":"13025_CR49","doi-asserted-by":"publisher","unstructured":"Muthuprasad, T., Aiswarya, S., Aditya, K., & Jha, G. K. (2021). Students\u2019 perception and preference for online education in India during covid-19 pandemic. Social Sciences & Humanities open, 3(1). https:\/\/doi.org\/10.1016\/j.ssaho.2020.100101","DOI":"10.1016\/j.ssaho.2020.100101"},{"issue":"2","key":"13025_CR50","first-page":"260","volume":"33","author":"DS Myers","year":"2017","unstructured":"Myers, D. S., & Chatlani, N. (2017). Implementing an adaptive tutorial system for coding literacy. Journal of Computing Sciences in Colleges, 33(2), 260\u2013267.","journal-title":"Journal of Computing Sciences in Colleges"},{"key":"13025_CR51","unstructured":"Narciss, S. (2008). Feedback strategies for interactive learning tasks. Handbook of research on educational communications and technology (pp. 125\u2013143). Routledge."},{"issue":"3","key":"13025_CR52","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1111\/j.1527-2001.2009.01053.x","volume":"24","author":"MC Nussbaum","year":"2009","unstructured":"Nussbaum, M. C. (2009). Creating capabilities: The human development approach and its implementation. Hypatia, 24(3), 211\u2013215. https:\/\/doi.org\/10.1111\/j.1527-2001.2009.01053.x","journal-title":"Hypatia"},{"key":"13025_CR53","unstructured":"OECD (2018). Pisa 2022 mathematics framework (draft). Paris, France. https:\/\/pisa2022-maths.oecd.org\/files\/PISA 2022 Mathematics Framework Draft.pdf (Accessed on 18 December 2022)"},{"key":"13025_CR54","doi-asserted-by":"publisher","first-page":"422","DOI":"10.3389\/fpsyg.2017.00422","volume":"8","author":"E Panadero","year":"2017","unstructured":"Panadero, E. (2017). A review of self-regulated learning: Six models and four directions for research. Frontiers in Psychology, 8, 422. https:\/\/doi.org\/10.3389\/fpsyg.2017.00422","journal-title":"Frontiers in Psychology"},{"key":"13025_CR55","doi-asserted-by":"crossref","unstructured":"Pardos, Z.A., Tang, M., Anastasopoulos, I., Sheel, S.K., Zhang, E. (2023). Oatutor: An open-source adaptive tutoring system and curated content library for learning sciences research. Proceedings of the 2023 chi conference on human factors in computing systems (pp. 1\u201317).","DOI":"10.1145\/3544548.3581574"},{"issue":"3","key":"13025_CR56","doi-asserted-by":"publisher","first-page":"423","DOI":"10.1207\/s15327809jls1303_6","volume":"13","author":"RD Pea","year":"2004","unstructured":"Pea, R. D. (2004). The social and technological dimensions of scaffolding and related theoretical concepts for learning, education, and human activity. The Journal of the Learning Sciences, 13(3), 423\u2013451. https:\/\/doi.org\/10.1207\/s15327809jls1303_6","journal-title":"The Journal of the Learning Sciences"},{"key":"13025_CR57","unstructured":"Pfeffer, J. (1982). Organizations and Organization Theory. Pitman Publishing."},{"issue":"2","key":"13025_CR58","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1257\/000282806777212486","volume":"96","author":"S Pozo","year":"2006","unstructured":"Pozo, S., & Stull, C. A. (2006). Requiring a math skills unit: Results of a randomized experiment. American Economic Review, 96(2), 437\u2013441. https:\/\/doi.org\/10.1257\/000282806777212486","journal-title":"American Economic Review"},{"issue":"4","key":"13025_CR59","doi-asserted-by":"publisher","first-page":"444","DOI":"10.1006\/ceps.1995.1030","volume":"20","author":"DR Pridemore","year":"1995","unstructured":"Pridemore, D. R., & Klein, J. D. (1995). Control of practice and level of feedback in computer-based instruction. Contemporary Educational Psychology, 20(4), 444\u2013450. https:\/\/doi.org\/10.1006\/ceps.1995.1030","journal-title":"Contemporary Educational Psychology"},{"key":"13025_CR60","doi-asserted-by":"publisher","unstructured":"Puntambekar, S. (2022). Distributed scaffolding: Scaffolding students in classroom environments. Educational Psychology Review, 34(1), 451\u2013472. https:\/\/doi.org\/10.1007\/s10648-021-09636-3","DOI":"10.1007\/s10648-021-09636-3"},{"issue":"3","key":"13025_CR61","doi-asserted-by":"publisher","first-page":"337","DOI":"10.1207\/s15327809jls1303_4","volume":"13","author":"C Quintana","year":"2004","unstructured":"Quintana, C., Reiser, B. J., Davis, E. A., Krajcik, J., Fretz, E., Duncan, R. G., & Soloway, E. (2004). A scaffolding design framework for software to support science inquiry. The Journal of the Learning Sciences, 13(3), 337\u2013386. https:\/\/doi.org\/10.1207\/s15327809jls1303_4","journal-title":"The Journal of the Learning Sciences"},{"key":"13025_CR62","doi-asserted-by":"crossref","unstructured":"Ryan, T., Henderson, M., Ryan, K., Kennedy, G. (2022). Feedback in higher education: Aligning academic intent and student sensemaking. Teaching in Higher Education, 29(4), 860\u2013875, https:\/\/doi.org\/10.1080\/13562517.2022.2029394","DOI":"10.1080\/13562517.2022.2029394"},{"key":"13025_CR63","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1007\/s40573-017-0065-4","volume":"1","author":"J Scheid","year":"2017","unstructured":"Scheid, J., M\u00fcller, A., Hettmannsperger, R., & Kuhn, J. (2017). Erhebung von repr\u00e4sentationaler koh\u00e4renzf\u00e4higkeit von sch\u00fclerinnen und sch\u00fclern im themenbereich strahlenoptik. Zeitschrift f\u00fcr Didaktik der Naturwissenschaften, 1, 181\u2013203. https:\/\/doi.org\/10.1007\/s40573-017-0065-4","journal-title":"Zeitschrift f\u00fcr Didaktik der Naturwissenschaften"},{"key":"13025_CR64","unstructured":"Sch\u00fcller, K., Busch, P., & Hindinger, C. (2019). Future skills: Ein framework f\u00fcr data literacy. Hochschulforum Digitalisierung, 46, 1\u2013128."},{"key":"13025_CR65","volume-title":"On ethics and economics","author":"A Sen","year":"1987","unstructured":"Sen, A. (1987). On ethics and economics. Oxford University Press."},{"key":"13025_CR66","volume-title":"Resources, values and development","author":"A Sen","year":"1997","unstructured":"Sen, A. (1997). Resources, values and development. Harvard University Press."},{"issue":"1","key":"13025_CR67","doi-asserted-by":"publisher","first-page":"153","DOI":"10.3102\/003465430731379","volume":"78","author":"VJ Shute","year":"2008","unstructured":"Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153\u2013189. https:\/\/doi.org\/10.3102\/003465430731379","journal-title":"Review of Educational Research"},{"key":"13025_CR68","doi-asserted-by":"publisher","unstructured":"Solanki, S., McPartlan, P., Xu, D., & Sato, B. K. (2019). Success with ease: Who benefits from a stem learning community? PloS One, 14(3). https:\/\/doi.org\/10.1371\/journal.pone.0213827","DOI":"10.1371\/journal.pone.0213827"},{"issue":"3","key":"13025_CR69","doi-asserted-by":"publisher","first-page":"792","DOI":"10.1073\/pnas.1811388115","volume":"116","author":"C Stadtfeld","year":"2019","unstructured":"Stadtfeld, C., V\u00f6r\u00f6s, A., Elmer, T., Boda, Z., & Raabe, I. J. (2019). Integration in emerging social networks explains academic failure and success. Proceedings of the National Academy of Sciences, 116(3), 792\u2013797. https:\/\/doi.org\/10.1073\/pnas.1811388115","journal-title":"Proceedings of the National Academy of Sciences"},{"key":"13025_CR70","doi-asserted-by":"crossref","unstructured":"Steinert, S., Avila, K.E., Ruzika, S., Kuhn, J., K\u00fcchemann, S. (2023). Harnessing large language models to enhance self-regulated learning via formative feedback. arXiv preprint, arXiv:2311.13984,","DOI":"10.1186\/s40561-024-00354-1"},{"key":"13025_CR71","doi-asserted-by":"crossref","unstructured":"Systems and Software Engineering Standards Committee, & Olszewska, J.I. (2021). Ieee standard model process for addressing ethical concerns during system design: Ieee standard 7000-2021. United States: IEEE. https:\/\/doi.org\/10.1109\/IEEESTD.2021.9536679","DOI":"10.1109\/IEEESTD.2021.9536679"},{"key":"13025_CR72","doi-asserted-by":"publisher","unstructured":"Toyokawa, Y., Majumdar, R., Kondo, T., Horikoshi, I., & Ogata, H. (2023). Active reading dashboard in a learning analytics enhanced language-learning environment: Effects on learning behavior and performance. Journal of Computers in Education, 1\u201328,. https:\/\/doi.org\/10.1007\/s40692-023-00267-x","DOI":"10.1007\/s40692-023-00267-x"},{"key":"13025_CR73","doi-asserted-by":"publisher","unstructured":"Van de Pol, J., Volman, M., Oort, F., & Beishuizen, J. (2015). The effects of scaffolding in the classroom: Support contingency and student independent working time in relation to student achievement, task effort and appreciation of support. Instructional Science, 43, 615\u2013641. https:\/\/doi.org\/10.1007\/s11251-015-9351-z","DOI":"10.1007\/s11251-015-9351-z"},{"key":"13025_CR74","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.compedu.2014.07.007","volume":"79","author":"A Van Leeuwen","year":"2014","unstructured":"Van Leeuwen, A., Janssen, J., Erkens, G., & Brekelmans, M. (2014). Supporting teachers in guiding collaborating students: Effects of learning analytics in cscl. Computers & Education, 79, 28\u201339. https:\/\/doi.org\/10.1016\/j.compedu.2014.07.007","journal-title":"Computers & Education"},{"issue":"2","key":"13025_CR75","doi-asserted-by":"publisher","first-page":"186","DOI":"10.1287\/mnsc.46.2.186.11926","volume":"46","author":"V Venkatesh","year":"2000","unstructured":"Venkatesh, V., & Davis, F. D. (2000). A theoretical extension of the technology acceptance model: Four longitudinal field studies. Management Science, 46(2), 186\u2013204. https:\/\/doi.org\/10.1287\/mnsc.46.2.186.11926","journal-title":"Management Science"},{"issue":"10","key":"13025_CR76","doi-asserted-by":"publisher","first-page":"1500","DOI":"10.1177\/0002764213479363","volume":"57","author":"K Verbert","year":"2013","unstructured":"Verbert, K., Duval, E., Klerkx, J., Govaerts, S., & Santos, J. L. (2013). Learning analytics dashboard applications. American Behavioral Scientist, 57(10), 1500\u20131509. https:\/\/doi.org\/10.1177\/0002764213479363","journal-title":"American Behavioral Scientist"},{"key":"13025_CR77","doi-asserted-by":"publisher","unstructured":"Verbert, K., Govaerts, S., Duval, E., Santos, J. L., Van Assche, F., Parra, G., & Klerkx, J. (2014). Learning dashboards: An overview and future research opportunities. Personal and Ubiquitous Computing, 18, 1499\u20131514. https:\/\/doi.org\/10.1007\/s00779-013-0751-2","DOI":"10.1007\/s00779-013-0751-2"},{"issue":"4","key":"13025_CR78","doi-asserted-by":"crossref","first-page":"641","DOI":"10.2298\/FID2104641W","volume":"32","author":"K Wiegerling","year":"2021","unstructured":"Wiegerling, K. (2021). Exposition einer theorie der widerst\u00e4ndigkeit. Filozofija i dru\u0161tvo, 32(4), 641\u2013661.","journal-title":"Filozofija i dru\u0161tvo"},{"key":"13025_CR79","unstructured":"Wilkinson, S.S. (1980). The relationship of teacher praise and student achievement: A meta-analysis of selected research. University of Florida."},{"key":"13025_CR80","doi-asserted-by":"publisher","first-page":"750","DOI":"10.1007\/s11162-015-9367-x","volume":"56","author":"D Wilson","year":"2015","unstructured":"Wilson, D., Jones, D., Bocell, F., Crawford, J., Kim, M. J., Veilleux, N., & Plett, M. (2015). Belonging and academic engagement among undergraduate stem students: A multi-institutional study. Research in Higher Education, 56, 750\u2013776. https:\/\/doi.org\/10.1007\/s11162-015-9367-x","journal-title":"Research in Higher Education"},{"key":"13025_CR81","doi-asserted-by":"publisher","first-page":"3087","DOI":"10.3389\/fpsyg.2019.03087","volume":"10","author":"B Wisniewski","year":"2020","unstructured":"Wisniewski, B., Zierer, K., & Hattie, J. (2020). The power of feedback revisited: A meta-analysis of educational feedback research. Frontiers in Psychology, 10, 3087. https:\/\/doi.org\/10.3389\/fpsyg.2019.03087","journal-title":"Frontiers in Psychology"},{"key":"13025_CR82","doi-asserted-by":"publisher","first-page":"754","DOI":"10.1007\/s10956-011-9363-7","volume":"21","author":"H-K Wu","year":"2012","unstructured":"Wu, H.-K., & Puntambekar, S. (2012). Pedagogical affordances of multiple external representations in scientific processes. Journal of Science Education and Technology, 21, 754\u2013767. https:\/\/doi.org\/10.1007\/s10956-011-9363-7","journal-title":"Journal of Science Education and Technology"},{"key":"13025_CR83","doi-asserted-by":"crossref","unstructured":"Zichy, M., & Alber, V.K. (2017). Menschenbilder: Eine grundlegung. Nomos Verlagsgesellschaft.","DOI":"10.5771\/9783495813737"}],"container-title":["Education and Information Technologies"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-024-13025-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10639-024-13025-y\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10639-024-13025-y.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,4,4]],"date-time":"2025-04-04T08:26:12Z","timestamp":1743755172000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10639-024-13025-y"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,25]]},"references-count":83,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2025,4]]}},"alternative-id":["13025"],"URL":"https:\/\/doi.org\/10.1007\/s10639-024-13025-y","relation":{},"ISSN":["1360-2357","1573-7608"],"issn-type":[{"value":"1360-2357","type":"print"},{"value":"1573-7608","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,9,25]]},"assertion":[{"value":"10 August 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 August 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 September 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}