{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:40:54Z","timestamp":1760146854906,"version":"build-2065373602"},"reference-count":53,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T00:00:00Z","timestamp":1733961600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"State Investigation Agency. Ministry of Science, Innovation and Universities. Government of Spain","award":["PID2020-117111RB-I00","N\u00ba 1-13-03-2023"],"award-info":[{"award-number":["PID2020-117111RB-I00","N\u00ba 1-13-03-2023"]}]},{"name":"Vice-Rectorate for Teaching and Research Staff. University of Burgos (Spain)","award":["PID2020-117111RB-I00","N\u00ba 1-13-03-2023"],"award-info":[{"award-number":["PID2020-117111RB-I00","N\u00ba 1-13-03-2023"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Information"],"abstract":"<jats:p>The use of serious games on virtual learning platforms as a learning support resource is increasingly common. They are especially effective in helping students acquire mainly applied curricular content. However, a process is required to monitor the effectiveness and students\u2019 perceived satisfaction. The objectives of this study were to (1) identify the most significant characteristics; (2) determine the most relevant predictors of learning outcomes; (3) identify groupings with respect to the different serious game activities; and (4) to determine students\u2019 perceptions of the usefulness of the simple and complex serious game activities. We worked with a sample of 130 university students studying health sciences and biomedical engineering. The serious game activities were applied in a Moodle environment, UBUVirtual, and monitored using the UBUMonitor tool. The degree type and the type of serious game explained differing percentages of the variance in the learning results in the assessment tests (34.4%\u2014multiple choice tests [individual assessment]; 11.2%\u2014project performance [group assessment]; 25.6%\u2014project presentation [group assessment]). Different clusters were found depending on the group of students and the algorithm applied. The Adjusted Rang Index was applied to determine the most appropriate algorithm in each case. The student satisfaction was high in all the cases. However, they indicated complex serious games as being more useful than simple serious games as learning resources for the practical content in both health sciences and biomedical engineering degrees.<\/jats:p>","DOI":"10.3390\/info15120804","type":"journal-article","created":{"date-parts":[[2024,12,12]],"date-time":"2024-12-12T08:36:32Z","timestamp":1733992592000},"page":"804","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["Using Serious Game Techniques with Health Sciences and Biomedical Engineering Students: An Analysis Using Machine Learning Techniques"],"prefix":"10.3390","volume":"15","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1736-2089","authenticated-orcid":false,"given":"Mar\u00eda Consuelo","family":"S\u00e1iz-Manzanares","sequence":"first","affiliation":[{"name":"Department of Health Sciences, GIR DATAHES, UIC JCYL N\u00ba 348, Universidad de Burgos, 09001 Burgos, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2633-635X","authenticated-orcid":false,"given":"Ra\u00fal","family":"Marticorena-S\u00e1nchez","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Higher Polytechnic School, ADMIRABLE Research Group, Universidad de Burgos, 09006 Burgos, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2448-0267","authenticated-orcid":false,"given":"Mar\u00eda Camino","family":"Escolar-Llamazares","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, GIR DATAHES, UIC JCYL N\u00ba 348, Universidad de Burgos, 09001 Burgos, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1481-7172","authenticated-orcid":false,"given":"Irene","family":"Gonz\u00e1lez-D\u00edez","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, GIR DATAHES, Universidad de Burgos, 09001 Burgos, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5910-4133","authenticated-orcid":false,"given":"Rut","family":"Velasco-Saiz","sequence":"additional","affiliation":[{"name":"Department of Health Sciences, Universidad de Burgos, 09001 Burgos, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2024,12,12]]},"reference":[{"key":"ref_1","first-page":"35","article-title":"Student satisfaction with online teaching in times of COVID-19","volume":"70","author":"Casanova","year":"2022","journal-title":"Comunicar"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.ecns.2021.02.008","article-title":"Virtual Simulations to Replace Clinical Hours in a Family Assessment Course: Development Using H5P, Gamification, and Student Co-Creation","volume":"57","author":"Killam","year":"2021","journal-title":"Clin. Simul. Nurs."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1097\/NNE.0000000000001065","article-title":"Motivation and Engagement of Nursing Students in 2 Gamified Courses: A Mixed-Methods Study","volume":"46","author":"Killam","year":"2021","journal-title":"Nurse Educ."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Wehling, J., Volkenstein, S., Dazert, S., Wrobel, C., van Ackeren, K., Johannsen, K., and Dombrowski, T. (2021). Fast-track flipping: Flipped classroom framework development with open-source H5P interactive tools. BMC Med. Educ., 21.","DOI":"10.1186\/s12909-021-02784-8"},{"key":"ref_5","first-page":"383","article-title":"Using Flipped Classroom as an Active Teaching Method for Teaching Engineering Graphics","volume":"11","year":"2023","journal-title":"Balt. J. Mod. Comput."},{"key":"ref_6","unstructured":"S\u00e1iz-Manzanares, M.C., and Marticorena S\u00e1nchez, R. (2024). Manual for the Development of Self-Regulated Virtual Laboratories, Servicio de Publicaciones de la Universidad de Burgos."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"De Santos-Berbel, C., Hernando Garc\u00eda, J.I., and V\u00e1zquez-Greciano, A. (2024). H5P-Based Matching Game for Training Graphs of Internal Forces in Structural Analysis. Educ. Sci., 14.","DOI":"10.3390\/educsci14040359"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"012019","DOI":"10.1088\/1742-6596\/1387\/1\/012019","article-title":"Development of E-Learning Content with H5P and iSpring Features","volume":"1387","author":"Amali","year":"2019","journal-title":"J. Phys. Conf. Ser."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s41044-016-0014-0","article-title":"Big data preprocessing: Methods and prospects","volume":"1","author":"Luengo","year":"2016","journal-title":"Big Data Anal."},{"key":"ref_10","unstructured":"Pfennig, A. (2023, January 11\u201314). Developing A Flexible Materials Testing Curriculum for Future Engineers. Proceedings of the Annual Conference Engineering Education for Sustainability, Reflecting on the role of engineering and Technology Education for Sustainable World, Dublin, Ireland."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1007\/s12528-023-09361-6","article-title":"Effectiveness of H5P in improving student learning outcomes in an online tertiary education setting","volume":"36","author":"Jacob","year":"2024","journal-title":"J. Comput. High Educ."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"E57","DOI":"10.1097\/NNE.0000000000001117","article-title":"Effectiveness of immersive virtual reality in nursing education: Systematic review","volume":"47","author":"Choi","year":"2022","journal-title":"Nurse Educ."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.1108\/K-10-2020-0671","article-title":"Virtual medical learning: A comprehensive study on the role of new technologies","volume":"51","author":"Tang","year":"2022","journal-title":"Kybernetes"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1290","DOI":"10.1111\/bjet.13432","article-title":"Investigating pedagogical agents\u2019 scaffolding of self-regulated learning in relation to learners\u2019 subgoals","volume":"55","author":"Dever","year":"2024","journal-title":"Br. J. Educ. Technol."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1486","DOI":"10.1111\/bjet.13393","article-title":"Capturing self-regulated learning processes in virtual reality: Causal sequencing of multimodal data","volume":"55","author":"Sobocinski","year":"2024","journal-title":"Br. J. Educ. Technol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1544","DOI":"10.1109\/TLT.2024.3385641","article-title":"Exploring Manifestations of Learners\u2019 Self-Regulated Tactics and Strategies Across Blended Learning Courses","volume":"17","author":"Villalobos","year":"2024","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1007\/s11409-023-09364-9","article-title":"Introduction to special issue on facilitating self-regulated learning with scaffolds: Recent advances and future directions","volume":"18","author":"Taub","year":"2023","journal-title":"Metacognition Learn."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1579","DOI":"10.1007\/s40670-022-01635-5","article-title":"Incorporating Mixed Reality for Knowledge Retention in Physiology, Anatomy, Pathology, and Pharmacology Interdisciplinary Education: A Randomized Controlled Trial","volume":"32","author":"Veer","year":"2022","journal-title":"Med. Sci. Educ"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Riveros, L.F.R., Zamora, V.R.J., Sanabria, J.E.S., and Tristancho, V.H.B. (July, January 29). Development of a Clinical Simulator for Taking Arterial Gas Samples Based on Mixed Reality. Proceedings of the 2022 Congreso de Tecnolog\u00eda, Aprendizaje y Ense\u00f1anza de la Electr\u00f3nica XV Technologies Applied to Electronics Teaching Conference, Teruel, Spain.","DOI":"10.1109\/TAEE54169.2022.9840664"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"D\u00f6rner, R., G\u00f6bel, S., Kickmeier-Rust, M., Masuch, M., and Zweig, K. (2016). Games for Learning. Entertainment Computing and Serious Games, Available online: https:\/\/research.hanze.nl\/en\/publications\/games-for-learning.","DOI":"10.1007\/978-3-319-46152-6"},{"key":"ref_21","unstructured":"Kapp, K.M., Blair, L., and Mesch, R. (2014). The Gamification of Learning and Instruction Fieldbook\u2014Ideas into Practice, EUA, Wiley."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"070011","DOI":"10.1063\/5.0211135","article-title":"The impact of interactive H5P video learning on the understanding of stereoisomers based on learning management system","volume":"3116","author":"Kartimi","year":"2024","journal-title":"AIP Conf. Proc."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Amali, L.N., Katili, M.R., and Sugeha, A.P. (2024). Development of virtual tour reality using 360-degree panoramic images and Leaflet JavaScript. Indones. J. Electr. Eng. Comput. Sci., 35.","DOI":"10.11591\/ijeecs.v35.i1.pp655-664"},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Mutawa, A.M., Al Muttawa, J.A.K., and Sruthi, S. (2023). The Effectiveness of Using H5P for Undergraduate Students in the Asynchronous Distance Learning Environment. Appl. Sci., 13.","DOI":"10.3390\/app13084983"},{"key":"ref_25","unstructured":"Chen, L., Manwaring, P., Zakaria, G., Wilkie, S., and Loton, D. (December, January 29). Implementing H5P Online Interactive Activities at Scale. Proceedings of the 38th International Conference on Innovation, Practice and Research in the Use of Educational Technologies in Tertiary Education (ASCILITE \u201821), Armidale, Australia."},{"key":"ref_26","unstructured":"Botto-Tobar Cruz, H.M., and D\u00edaz Cadena, A. (2021). Using H5P Services to Enhance the Student Evaluation Process. Programming Courses at the Universidad Polit\u00e9cnica Salesiana (Guayaquil, Ecuador) BT-Artificial Intelligence, Computer and Software Engineering Advances, Springer International Publishing."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1152\/advan.00021.2020","article-title":"Reimagining Physiology Education with Interactive Content Developed in H5P","volume":"45","author":"Sinnayah","year":"2021","journal-title":"Adv. Physiol. Educ."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"66","DOI":"10.56059\/jl4d.v11i1.1135","article-title":"Effectiveness of Interactive Content with H5P for Moodle-Learning Management System in Blended Learning","volume":"11","author":"Rahmi","year":"2024","journal-title":"J. Learn. Dev."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1080\/00219266.2023.2192733","article-title":"L Investigating student experiences of botanical field work using a semi-immersive virtual botanical fieldtrip","volume":"58","author":"Bacon","year":"2023","journal-title":"J. Biol. Educ."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bansal, R., Singh, R., Singh, A., Chaudhary, K., and Rasul, T. (2023). Digital Tools for Interactive E-Content Development. Redefining Virtual Teaching Learning Pedagogy, Scrivener Publishing LLC.","DOI":"10.1002\/9781119867647"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Muangbangyung, S., and Srisawasdi, N. (2023). Design and Development of Interactive Moodle-Based E-Learning Platform for Competency Training. Eng. Proc., 38.","DOI":"10.3390\/engproc2023038011"},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Rahadiani, P., Kekalih, A., Soemantri, D., Hakim, R.W., Prasetyo, M.Y., and Krisnamurti, D.G.B. (2023, January 13\u201315). Development and Evaluation of An Interactive 360 Virtual Tour for Exhibition of Research and Education Facilities Using Limited Resources: A Study Case. Proceedings of the IMERI. 3rd International Conference on Intelligent Cybernetics Technology and Applications, ICICyTA 2023, Hybrid, Bali, Indonesia.","DOI":"10.1109\/ICICyTA60173.2023.10428930"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"015010","DOI":"10.1088\/1361-6552\/ac9ae0","article-title":"Collaboration and feeling of flow with an online interactive H5P video experiment on viscosity","volume":"58","author":"Kosmaca","year":"2023","journal-title":"Phys. Educ."},{"key":"ref_34","unstructured":"Clarkin, O.M., Morrissey, A., Obeidi, M.A., and Ryan, A. (2023). Assessment of Different Platforms For Online Virtual Lab Demonstrations. Eur. Soc. Eng. Educ. SEFI."},{"key":"ref_35","first-page":"59","article-title":"Students\u2019 perception of the use of interactive activities with H5P","volume":"14","year":"2023","journal-title":"Rev. Iberoam. Educ. Super."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"100792","DOI":"10.1016\/j.entcom.2024.100792","article-title":"Digital media entertainment technology based on artificial intelligence robot in art teaching simulation","volume":"52","author":"Liao","year":"2025","journal-title":"Entertain. Comput."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1494","DOI":"10.3390\/make6030071","article-title":"A Cognitive Load Theory (CLT) Analysis of Machine Learning Explainability, Transparency, Interpretability, and Shared Interpretability","volume":"6","author":"Fox","year":"2024","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"100819","DOI":"10.1016\/j.entcom.2024.100819","article-title":"Research on virtual entertainment robots based on machine learning algorithms providing psychological health services for college students","volume":"52","author":"Ma","year":"2025","journal-title":"Entertain. Comput."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"593","DOI":"10.3390\/make6010028","article-title":"Augmenting Deep Neural Networks with Symbolic Educational Knowledge: Towards Trustworthy and Interpretable AI for Education","volume":"6","author":"Hooshyar","year":"2024","journal-title":"Mach. Learn. Knowl. Extr."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gil-Garc\u00eda, I.C., and Fern\u00e1ndez-Guillam\u00f3n, A. (2024). SMART: Selection Model for Assessment Resources and Techniques. Educ. Sci., 14.","DOI":"10.3390\/educsci14010023"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Minissi, M.E., Altozano, A., Mar\u00edn-Morales, J., Giglioli, I.A.C., Mantovani, F., and Alca\u00f1iz, M. (2024). Biosignal comparison for autism assessment using machine learning models and virtual reality. Comput. Biol. Med., 171.","DOI":"10.1016\/j.compbiomed.2024.108194"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1007\/s11257-023-09373-y","article-title":"Improving the understanding of web user behaviors through machine learning analysis of eye-tracking data","volume":"34","author":"Castilla","year":"2024","journal-title":"User Model. User-Adapted Interact."},{"key":"ref_43","first-page":"e1458","article-title":"A review on data fusion in multimodal learning analytics and educational data mining. Wiley Interdiscip","volume":"12","author":"Chango","year":"2022","journal-title":"Rev. Data Min. Knowl. Discov."},{"key":"ref_44","unstructured":"Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention Is All You Need. arXiv."},{"key":"ref_45","unstructured":"Toy, J., MacAdam, J., and Tabor, P. (2024). Metacognition is all you need? Using Introspection in Generative Agents to Improve Goal-directed Behaviour. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Marticorena, R., L\u00f3pez-Nozal, C., Ji, Y.P., Pardo-Aguilar, C., and Arnaiz-Gonz\u00e1lez, \u00c1. (2022). UBUMonitor: An Open-Source Desktop Application for Visual E-Learning Analysis with Moodle. Electronics, 11.","DOI":"10.3390\/electronics11060954"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"101727","DOI":"10.1016\/j.softx.2024.101727","article-title":"UBUMonitor: Desktop application for visual e-learning student clustering with Moodle","volume":"26","author":"Marticorena","year":"2024","journal-title":"SoftwareX"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"S\u00e1iz-Manzanares, M.C., Ramos P\u00e9rez, I., Arnaiz-Rodr\u00edguez, \u00c1., Rodr\u00edguez-Arribas, S., Almeida, L., and Martin, C.F. (2021). Analysis of the learning process through eye tracking technology and feature selection techniques. Appl. Sci., 11.","DOI":"10.3390\/app11136157"},{"key":"ref_49","unstructured":"Kaufmann, M. (2016). The WEKA Workbench. Online Appendix for \u201cData Mining: Practical Machine Learning Tools and Techniques\u201d, [4th ed.]. Available online: https:\/\/www.goodreads.com\/book\/show\/36012530-the-weka-workbench-online-appendix-for-data-mining."},{"key":"ref_50","first-page":"2349","article-title":"Orange: Data Mining Toolbox in Python","volume":"14","author":"Curk","year":"2013","journal-title":"J. Mach. Learn. Res."},{"key":"ref_51","unstructured":"IBM Corp (2024). SPSS Statistical Package for the Social Sciences (SPSS), IBM. Version 28."},{"key":"ref_52","unstructured":"ATLAS (2024). ti Corp. Software Package Qualitative Data Analysis, Version 24, ATLAS.ti Corp."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Marcoulides, G.A., and Schumacker, R.E. (2001). Item parceling issues in structural equation modeling. New Development and Techniques in Structural Equation Modeling, Lawrence Erlbaum Associates.","DOI":"10.4324\/9781410601858"}],"container-title":["Information"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/804\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T16:53:38Z","timestamp":1760115218000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2078-2489\/15\/12\/804"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,12,12]]},"references-count":53,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2024,12]]}},"alternative-id":["info15120804"],"URL":"https:\/\/doi.org\/10.3390\/info15120804","relation":{},"ISSN":["2078-2489"],"issn-type":[{"type":"electronic","value":"2078-2489"}],"subject":[],"published":{"date-parts":[[2024,12,12]]}}}