{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T17:10:14Z","timestamp":1780506614076,"version":"3.54.1"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T00:00:00Z","timestamp":1739923200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T00:00:00Z","timestamp":1739923200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002322","name":"Coordena\u00e7\u00e3o de Aperfei\u00e7oamento de Pessoal de N\u00edvel Superior","doi-asserted-by":"publisher","award":["Finance Code - 001"],"award-info":[{"award-number":["Finance Code - 001"]}],"id":[{"id":"10.13039\/501100002322","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003593","name":"Conselho Nacional de Desenvolvimento Cient\u00edfico e Tecnol\u00f3gico","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100003593","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Smart Learn. Environ."],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Researchers are increasingly interested in enabling teachers to monitor and adapt gamification design in the context of intelligent tutoring systems (ITSs). These contributions rely on teachers\u2019 needs and preferences to adjust the gamification design according to student performance. This work extends previous studies on teachers\u2019 perception of their cognitive effort and dedication to creating and monitoring educational resource recommendations on a simulated gamified educational platform. This study compares teachers\u2019 perceptions of workload using one of three scenarios\u2014 manual, automated, and semi-automated\u2014to recommend educational resources through a randomized experiment. In this study, 151 participating teachers evaluated their perception of cognitive effort and time dedicated to creating recommendations for missions and monitoring students on the platform. The results indicate that the teachers\u2019 perception that the automated scenario has a lower workload than the manual scenario significantly raises the hypotheses. Our results also suggest that teachers\u2019 perception of the textbook scenario is different according to their level of knowledge about Information and Communication Technologies (ICT). For teachers with advanced ICT knowledge, the manual scenario is perceived as a scenario that indicates a more outstanding performance. According to the educational level of the teachers, the perception of mental demand for the automated scenario is significantly different. These significantly contribute to understanding teachers\u2019 perceptions when using educational platforms in their classes.\n<\/jats:p>","DOI":"10.1186\/s40561-025-00373-6","type":"journal-article","created":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T13:17:04Z","timestamp":1739971024000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Workload perception in educational resource recommendation supported by artificial intelligence: a controlled experiment with teachers"],"prefix":"10.1186","volume":"12","author":[{"given":"Alexandre","family":"Machado","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kamilla","family":"Ten\u00f3rio","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mateus Monteiro","family":"Santos","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Aristoteles Peixoto","family":"Barros","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0343-3701","authenticated-orcid":false,"given":"Luiz","family":"Rodrigues","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rafael Ferreira","family":"Mello","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ranilson","family":"Paiva","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Diego","family":"Dermeval","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,2,19]]},"reference":[{"key":"373_CR1","doi-asserted-by":"crossref","unstructured":"Auguste, D. (1985). Intelligent tutoring systems: D. sleeman and j.s. brown, (academic press, new york,. (1982). 345 pages. Artificial Intelligence, 26(2), 233\u2013238.","DOI":"10.1016\/0004-3702(85)90033-5"},{"issue":"2","key":"373_CR2","doi-asserted-by":"publisher","first-page":"600","DOI":"10.1007\/s40593-016-0105-0","volume":"26","author":"RS Baker","year":"2016","unstructured":"Baker, R. S. (2016). Stupid tutoring systems, intelligent humans. International Journal of Artificial Intelligence in Education, 26(2), 600\u2013614.","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"373_CR3","doi-asserted-by":"crossref","unstructured":"Brown, E., & Cairns, P. (2004). A grounded investigation of game immersion. In CHI\u201904 extended abstracts on Human factors in computing systems (pp. 1297\u20131300)","DOI":"10.1145\/985921.986048"},{"issue":"5","key":"373_CR4","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1109\/MIC.2013.90","volume":"17","author":"VG Cerf","year":"2013","unstructured":"Cerf, V. G. (2013). Augmented intelligence. IEEE Internet Computing, 17(5), 96\u201396.","journal-title":"IEEE Internet Computing"},{"issue":"3","key":"373_CR5","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1017\/S0958344011000152","volume":"23","author":"A Comas-Quinn","year":"2011","unstructured":"Comas-Quinn, A. (2011). Learning to teach online or learning to become an online teacher: An exploration of teachers\u2019 experiences in a blended learning course. ReCALL, 23(3), 218\u2013232.","journal-title":"ReCALL"},{"key":"373_CR6","unstructured":"Daniel, C. S. (2020). Assessing learning efficiency in narrative simulation delivered through interactive multimedia"},{"key":"373_CR7","doi-asserted-by":"crossref","unstructured":"Dermeval, D. (2016). Intelligent authoring of gamified intelligent tutoring system. In UMAP (Extended Proceedings), Citeseer","DOI":"10.5753\/cbie.wcbie.2017.14"},{"key":"373_CR8","doi-asserted-by":"crossref","unstructured":"Dermeval, D., Albuquerque, J., Bittencourt, I. I., Vassileva, J., Lemos, W., da\u00a0Silva, A. P., & Paiva, R. (2018a). Amplifying teachers intelligence in the design of gamified intelligent tutoring systems. In Artificial intelligence in education: 19th international conference, AIED 2018, London, UK, June 27\u201330, 2018, Proceedings, Part II 19, (pp. 68\u201373). Springer","DOI":"10.1007\/978-3-319-93846-2_13"},{"key":"373_CR9","doi-asserted-by":"crossref","unstructured":"Dermeval, D., Paiva, R., Bittencourt, I. I., Vassileva, J., & Borges, D. (2018). Authoring tools for designing intelligent tutoring systems: a systematic review of the literature. International Journal of Artificial Intelligence in Education, 28(3), 336\u2013384.","DOI":"10.1007\/s40593-017-0157-9"},{"key":"373_CR10","doi-asserted-by":"crossref","unstructured":"Dermeval, D., Lima, I., Castro, M., Couto, H., Gomes, D., Peixoto, A., & Bittencourt, I. I. (2019). Helping teachers design gamified intelligent tutoring systems. In 2019 IEEE 19th international conference on advanced learning technologies (ICALT), (vol. 2161, pp. 60\u201362). IEEE","DOI":"10.1109\/ICALT.2019.00024"},{"key":"373_CR11","doi-asserted-by":"crossref","unstructured":"Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011). From game design elements to gamefulness: Defining\" gamification\". In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments (pp. 9\u201315)","DOI":"10.1145\/2181037.2181040"},{"key":"373_CR12","unstructured":"Ermi, L. (2005). Fundamental components of the gameplay experience: Analysing immersion"},{"issue":"8","key":"373_CR13","doi-asserted-by":"publisher","first-page":"864","DOI":"10.1016\/j.knosys.2010.05.011","volume":"23","author":"H Escudero","year":"2010","unstructured":"Escudero, H., & Fuentes, R. (2010). Exchanging courses between different intelligent tutoring systems: A generic course generation authoring tool. Knowledge-Based Systems, 23(8), 864\u2013874.","journal-title":"Knowledge-Based Systems"},{"key":"373_CR14","unstructured":"Fardo, M. L. (2013). Kapp, karl m. the gamification of learning and instruction: game-based methods and strategies for training and education. san francisco: Pfeiffer, 2012. CONJECTURA: filosofia e educa\u00e7\u00e3o 18(1), 201\u2013206"},{"key":"373_CR15","doi-asserted-by":"crossref","unstructured":"Hart, S. G., & Staveland, L. E. (1988). Development of nasa-tlx (task load index): Results of empirical and theoretical research. In Advances in psychology (vol.\u00a052, pp. 139\u2013183). Elsevier","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"373_CR16","doi-asserted-by":"crossref","unstructured":"Herzig, P., Ameling, M., Wolf, B., & Schill, A. (2015). Implementing gamification: Requirements and gamification platforms. In Gamification in education and business (pp. 431\u2013450). Springer","DOI":"10.1007\/978-3-319-10208-5_22"},{"key":"373_CR17","unstructured":"Hunter, D., & Werbach, K. (2012). For the win (vol.\u00a02). Wharton Digital Press. https:\/\/vr-entertain. com\/wpcontent\/uploads\u00a0..."},{"issue":"3","key":"373_CR18","first-page":"157","volume":"19","author":"F Malekpour","year":"2014","unstructured":"Malekpour, F., Mehran, G., Mohammadian, Y., Mirzaee, V., & Malekpour, A. (2014). Assessment of mental workload in teachers of hashtrud city using nasa-tlx mental workload index. Pajoohandeh Journal, 19(3), 157\u2013161.","journal-title":"Pajoohandeh Journal"},{"key":"373_CR19","unstructured":"Moundridou, M., & Virvou, M. (2002). Wear: A web-based authoring tool for building intelligent tutoring systems. In Proceedings of the second Hellenic conference on artificial intelligence (pp. 203\u201314). Springer, Citeseer."},{"key":"373_CR20","doi-asserted-by":"crossref","unstructured":"Nkambou, R., Bourdeau, J., & Mizoguchi, R. (2010). Introduction: What are intelligent tutoring systems, and why this book? In Advances in intelligent tutoring systems (pp. 1\u201312). Springer","DOI":"10.1007\/978-3-642-14363-2_1"},{"issue":"1","key":"373_CR21","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1207\/S15326985EP3801_8","volume":"38","author":"F Paas","year":"2003","unstructured":"Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. (2003). Cognitive load measurement as a means to advance cognitive load theory. Educational Psychologist, 38(1), 63\u201371.","journal-title":"Educational Psychologist"},{"key":"373_CR22","doi-asserted-by":"crossref","unstructured":"Paiva, R., & Bittencourt, I. I. (2020). Helping teachers help their students: A human-ai hybrid approach. In International conference on artificial intelligence in education (pp. 448\u2013459). Springer","DOI":"10.1007\/978-3-030-52237-7_36"},{"key":"373_CR23","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1016\/j.chb.2016.07.048","volume":"64","author":"R Paiva","year":"2016","unstructured":"Paiva, R., Bittencourt, I. I., Ten\u00f3rio, T., Jaques, P., & Isotani, S. (2016). What do students do on-line? Modeling students\u2019 interactions to improve their learning experience. Computers in Human Behavior, 64, 769\u2013781.","journal-title":"Computers in Human Behavior"},{"key":"373_CR24","doi-asserted-by":"crossref","unstructured":"Sweller, J. (1988). Load during problem solving: On\/earn\/ng. Cognitive Science 12(2)","DOI":"10.1016\/0364-0213(88)90023-7"},{"key":"373_CR25","doi-asserted-by":"crossref","unstructured":"Sweller, J., Ayres, P., & Kalyuga, S. (2011). Measuring cognitive load. In Cognitive load theory (pp. 71\u201385). Springer","DOI":"10.1007\/978-1-4419-8126-4_6"},{"key":"373_CR26","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1007\/978-3-030-52240-7_57","volume-title":"Artificial intelligence in education","author":"K Ten\u00f3rio","year":"2020","unstructured":"Ten\u00f3rio, K., Chalco Challco, G., Dermeval, D., Lemos, B., Nascimento, P., Santos, R., & Pedro da Silva, A. (2020). Helping teachers assist their students in gamified adaptive educational systems: Towards a gamification analytics tool. In I. I. Bittencourt, M. Cukurova, K. Muldner, R. Luckin, & E. Mill\u00e1n (Eds.), Artificial intelligence in education (pp. 312\u2013317). Springer International Publishing."},{"key":"373_CR27","doi-asserted-by":"crossref","unstructured":"Ten\u00f3rio, K., Dermeval, D., & da\u00a0Silva, A. P. (2020b). Gamification analytics model for teachers. In Anais dos Workshops do IX Congresso Brasileiro de Inform\u00e1tica na Educa\u00e7\u00e3o (pp. 72\u201372). SBC","DOI":"10.5753\/cbie.wcbie.2020.72"},{"key":"373_CR28","doi-asserted-by":"crossref","unstructured":"Ten\u00f3rio, K., Dermeval, D., Monteiro, M., Peixoto, A., & Silva, A. Pd. (2021a). Exploring design concepts to enable teachers to monitor and adapt gamification in adaptive learning systems: A qualitative research approach. International Journal of Artificial Intelligence in Education, 1\u201325","DOI":"10.1007\/s40593-021-00274-y"},{"key":"373_CR29","doi-asserted-by":"crossref","unstructured":"Ten\u00f3rio, K., Lemos, B., Nascimento, P., Santos, R., Machado, A., Dermeval, D., Paiva, R., & Isotani, S. (2021b). Learning and gamification dashboards: A mixed-method study with teachers. In International conference on intelligent tutoring systems (pp. 406\u2013417). Springer","DOI":"10.1007\/978-3-030-80421-3_45"},{"issue":"4","key":"373_CR30","doi-asserted-by":"publisher","first-page":"867","DOI":"10.1007\/s40593-021-00274-y","volume":"32","author":"K Ten\u00f3rio","year":"2022","unstructured":"Ten\u00f3rio, K., Dermeval, D., Monteiro, M., Peixoto, A., & Silva, APd. (2022). Exploring design concepts to enable teachers to monitor and adapt gamification in adaptive learning systems: A qualitative research approach. International Journal of Artificial Intelligence in Education, 32(4), 867\u2013891.","journal-title":"International Journal of Artificial Intelligence in Education"},{"key":"373_CR31","doi-asserted-by":"publisher","first-page":"294","DOI":"10.1016\/j.ijinfomgt.2018.10.001","volume":"46","author":"AM Toda","year":"2019","unstructured":"Toda, A. M., do Carmo, R. M., da Silva, A. P., Bittencourt, I. I., & Isotani, S. (2019). An approach for planning and deploying gamification concepts with social networks within educational contexts. International Journal of Information Management, 46, 294\u2013303. https:\/\/doi.org\/10.1016\/j.ijinfomgt.2018.10.001","journal-title":"International Journal of Information Management"},{"key":"373_CR32","volume-title":"Artificial intelligence and tutoring systems: Computational and cognitive approaches to the communication of knowledge","author":"E Wenger","year":"2014","unstructured":"Wenger, E. (2014). Artificial intelligence and tutoring systems: Computational and cognitive approaches to the communication of knowledge. Morgan Kaufmann."},{"key":"373_CR33","unstructured":"Werbach, K. (2015). i hunter, d.(2012) for the win: How game thinking can revolutionize your business"},{"key":"373_CR34","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29044-2","volume-title":"Experimentation in software engineering","author":"C Wohlin","year":"2012","unstructured":"Wohlin, C., Runeson, P., Hst, M., Ohlsson, M. C., Regnell, B., & Wessln, A. (2012). Experimentation in software engineering. Incorporated: Springer Publishing Company."}],"container-title":["Smart Learning Environments"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-025-00373-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40561-025-00373-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40561-025-00373-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T13:17:25Z","timestamp":1739971045000},"score":1,"resource":{"primary":{"URL":"https:\/\/slejournal.springeropen.com\/articles\/10.1186\/s40561-025-00373-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,19]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["373"],"URL":"https:\/\/doi.org\/10.1186\/s40561-025-00373-6","relation":{},"ISSN":["2196-7091"],"issn-type":[{"value":"2196-7091","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,2,19]]},"assertion":[{"value":"20 November 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"30 January 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 February 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no Conflict of interest to declare that are relevant to the content of this article.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"20"}}