{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T01:16:15Z","timestamp":1760058975521,"version":"build-2065373602"},"reference-count":39,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T00:00:00Z","timestamp":1747094400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"General Royalty System of Colombia (SGR\u2014Sistema General de Regal\u00edas)","award":["BPIN-2021000100186"],"award-info":[{"award-number":["BPIN-2021000100186"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Researchers have extensively explored learning analytics in online courses, primarily focusing on linear course structures where students progress sequentially through lessons and assessments. However, non-linear courses, which allow students to complete tasks in any order, present unique challenges for learning analytics due to the variability in course progression among students. This study proposes a method for applying learning analytics to non-linear, self-paced MOOC-style courses, addressing early performance prediction and online learning pattern detection. The novelty of our approach lies in introducing a personalized feature aggregation that adapts to each student\u2019s progress rather than being defined at fixed timelines. We evaluated three types of features\u2014engagement, behavior, and performance\u2014using data from a non-linear large-scale Moodle course designed to prepare high school students for a public university entrance exam. Our approach predicted early student performance, achieving an F1-score of 0.73 at a 20% cumulative weight assessment. Feature importance analysis revealed that performance and behavior were the strongest predictors, while engagement features, such as time spent on educational resources, also played a significant role. In addition to performance prediction, we conducted a clustering analysis that identified four distinct online learning patterns recurring across various cumulative weight assessments. These patterns provide valuable insights into student behavior and performance and have practical implications, enabling educators to deliver more personalized feedback and targeted interventions to meet individual student needs.<\/jats:p>","DOI":"10.3390\/a18050284","type":"journal-article","created":{"date-parts":[[2025,5,13]],"date-time":"2025-05-13T11:31:49Z","timestamp":1747135909000},"page":"284","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Learning Analytics in a Non-Linear Virtual Course"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0009-0000-4867-4352","authenticated-orcid":false,"given":"Jhon","family":"Mercado","sequence":"first","affiliation":[{"name":"Faculty of Engineering, Universidad de Antioquia, Medellin 050010, Colombia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carlos","family":"Mendoza-Cardenas","sequence":"additional","affiliation":[{"name":"Twitch Interactive Inc., San Francisco, CA 94104, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1294-137X","authenticated-orcid":false,"given":"Luis","family":"Fletscher","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Universidad de Antioquia, Medellin 050010, Colombia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Natalia","family":"Gaviria-Gomez","sequence":"additional","affiliation":[{"name":"Faculty of Engineering, Universidad de Antioquia, Medellin 050010, Colombia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,5,13]]},"reference":[{"key":"ref_1","unstructured":"Li, R., Singh, J., and Bunk, J. (2018). Technology tools in distance education: A review of faculty adoption. EdMedia+ Innovate Learning, Association for the Advancement of Computing in Education (AACE)."},{"key":"ref_2","unstructured":"Ellis, R.K. (2009). Learning Management Systems, American Society for Training & Development (ASTD)."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Llamas, M., Caeiro, M., Castro, M., Plaza, I., and Tovar, E. (2011, January 12\u201315). Use of LMS functionalities in engineering education. Proceedings of the 2011 Frontiers in Education Conference (FIE), Rapid City, SD, USA.","DOI":"10.1109\/FIE.2011.6142830"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Kloft, M., Stiehler, F., Zheng, Z., and Pinkwart, N. (2014, January 25). Predicting MOOC dropout over weeks using machine learning methods. Proceedings of the EMNLP 2014 Workshop on Analysis of Large Scale Social Interaction in MOOCs, Doha, Qatar.","DOI":"10.3115\/v1\/W14-4111"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"23","DOI":"10.21742\/JHSTI.2021.1.3.04","article-title":"Analysis of LMS Data of Distance Lifelong Learning Center Learners and Drop-out Prediction","volume":"1","author":"Seo","year":"2021","journal-title":"J. Hum.-Centric Sci. Technol. Innov."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1","DOI":"10.21315\/mjde2015.17.2.1","article-title":"Technology acceptance of massive open online courses in Malaysia","volume":"17","author":"Nordin","year":"2015","journal-title":"Malays. J. Distance Educ."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"103777","DOI":"10.1016\/j.compedu.2019.103777","article-title":"Adaptive learning path recommender approach using auxiliary learning objects","volume":"147","author":"Nabizadeh","year":"2020","journal-title":"Comput. Educ."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"3541","DOI":"10.1007\/s10639-020-10125-3","article-title":"The impact of an adaptive e-course on students\u2019 achievements based on the students\u2019 prior knowledge","volume":"25","author":"Alsadoon","year":"2020","journal-title":"Educ. Inf. Technol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1177\/0146621617697959","article-title":"Recommendation system for adaptive learning","volume":"42","author":"Chen","year":"2018","journal-title":"Appl. Psychol. Meas."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Mercado, J., Mendoza, C.H., Ramirez-Salazar, D.A., Valderrama, A., Gaviria-Gomez, N., Botero, J.F., and Fletscher, L. (2023, January 12\u201315). Work in progress: A didactic strategy based on Machine Learning for adaptive learning in virtual environments. Proceedings of the 2023 IEEE World Engineering Education Conference (EDUNINE), Bogota, Colombia.","DOI":"10.1109\/EDUNINE57531.2023.10102846"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vasquez Diaz, K.R., and Iqbal, J. (2024). Challenges Faced by International Students in Understanding British Accents and Their Mitigation Strategies\u2014A Mixed Methods Study. Educ. Sci., 14.","DOI":"10.3390\/educsci14070784"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Walker, A., Diaz, K.R.V., McKie, D., and Iqbal, J. (2024, January 19\u201322). Enquiry-Based Learning Pedagogy\u2014Design, Development and Delivery of a Reproducible Robotics Framework. Proceedings of the International Congress on Information and Communication Technology, London, UK.","DOI":"10.1007\/978-981-97-3289-0_30"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/TLT.2016.2616312","article-title":"Predicting student performance from LMS data: A comparison of 17 blended courses using Moodle LMS","volume":"10","author":"Conijn","year":"2016","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"7519","DOI":"10.1109\/ACCESS.2021.3049446","article-title":"Predicting at-risk students at different percentages of course length for early intervention using machine learning models","volume":"9","author":"Adnan","year":"2021","journal-title":"IEEE Access"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"103676","DOI":"10.1016\/j.compedu.2019.103676","article-title":"An overview and comparison of supervised data mining techniques for student exam performance prediction","volume":"143","author":"Tomasevic","year":"2020","journal-title":"Comput. Educ."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"118868","DOI":"10.1016\/j.eswa.2022.118868","article-title":"Early prediction of learners at risk in self-paced education: A neural network approach","volume":"213","author":"Waheed","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_17","unstructured":"Cohausz, L., Tschalzev, A., Bartelt, C., and Stuckenschmidt, H. (2023, January 11\u201314). Investigating the Importance of Demographic Features for EDM-Predictions. Proceedings of the 16th International Conference on Educational Data Mining, Bengaluru, India."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"104108","DOI":"10.1016\/j.compedu.2020.104108","article-title":"Massive LMS log data analysis for the early prediction of course-agnostic student performance","volume":"163","author":"Ortin","year":"2021","journal-title":"Comput. Educ."},{"key":"ref_19","unstructured":"Hoq, M., Brusilovsky, P., and Akram, B. (2023, January 11\u201314). Analysis of an Explainable Student Performance Prediction Model in an Introductory Programming Course. Proceedings of the 16th International Conference on Educational Data Mining, Bengaluru, India."},{"key":"ref_20","unstructured":"Rohani, N., Gal, K., Gallagher, M., and Manataki, A. (2023, January 11\u201314). Early prediction of student performance in a health data science MOOC. Proceedings of the 16th International Conference on Educational Data Mining, Bengaluru, India."},{"key":"ref_21","unstructured":"Mao, Y., Khoshnevisan, F., Price, T., Barnes, T., and Chi, M. (March, January 22). Cross-lingual adversarial domain adaptation for novice programming. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"222","DOI":"10.14742\/ajet.1336","article-title":"The search for learning community in learner paced distance education: Or, \u2018Having your cake and eating it, too!\u2019","volume":"21","author":"Anderson","year":"2005","journal-title":"Australas. J. Educ. Technol."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/sdata.2017.171","article-title":"Open university learning analytics dataset","volume":"4","author":"Kuzilek","year":"2017","journal-title":"Sci. Data"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1186\/s40561-022-00220-y","article-title":"Predicting Master\u2019s students\u2019 academic performance: An empirical study in Germany","volume":"9","author":"Alturki","year":"2022","journal-title":"Smart Learn. Environ."},{"key":"ref_25","first-page":"62","article-title":"Analysing student behaviour in a learning management system using a process mining approach","volume":"14","author":"Cenka","year":"2022","journal-title":"Knowl. Manag. E-Learn."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1108\/ITSE-08-2021-0148","article-title":"Exploring students digital activities and performances through their activities logged in learning management system using educational data mining approach","volume":"20","author":"Bessadok","year":"2023","journal-title":"Interact. Technol. Smart Educ."},{"key":"ref_27","unstructured":"Moodle Docs (2025, April 05). Database Schema Introduction. Available online: https:\/\/moodledev.io\/docs\/apis\/core\/dml\/database-schema."},{"key":"ref_28","unstructured":"Siemens, G., and Baker, R.S.d. (May, January 29). Learning analytics and educational data mining: Towards communication and collaboration. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, Vancouver, BC, Canada."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Mercado, J., Mendoza-Cardenas, C., Gaviria-Gomez, N., Botero, J.F., and Fletscher, L. (2024, January 22\u201323). Predicting Student Performance in a Non-linear Self-Paced Moodle Course. Proceedings of the 22nd Latin American and Caribbean Conference for Engineering and Technology (LACCEI), Zaragoza, Spain.","DOI":"10.18687\/LACCEI2024.1.1.1412"},{"key":"ref_30","unstructured":"LeCun, Y., Bottou, L., Orr, G.B., and M\u00fcller, K.R. (2002). Efficient backprop. Neural Networks: Tricks of the Trade, Springer."},{"key":"ref_31","unstructured":"Bishop, C.M. (2006). Pattern Recognition and Machine Learning, Springer."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"22","DOI":"10.4097\/kjae.2017.70.1.22","article-title":"Understanding one-way ANOVA using conceptual figures","volume":"70","author":"Kim","year":"2017","journal-title":"Korean J. Anesthesiol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"64","DOI":"10.1207\/s15430421tip4102_2","article-title":"Becoming a self-regulated learner: An overview","volume":"41","author":"Zimmerman","year":"2002","journal-title":"Theory Into Practice"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Viberg, O., Khalil, M., and Baars, M. (2020, January 23\u201327). Self-regulated learning and learning analytics in online learning environments: A review of empirical research. Proceedings of the Tenth International Conference on Learning Analytics & Knowledge (LAK \u201920), Frankfurt, Germany.","DOI":"10.1145\/3375462.3375483"},{"key":"ref_35","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_36","unstructured":"Joshi, P. (2016). Python Machine Learning Cookbook, Packt Publishing Ltd."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"272","DOI":"10.1007\/s42452-021-04148-9","article-title":"Comparison of feature importance measures as explanations for classification models","volume":"3","author":"Saarela","year":"2021","journal-title":"SN Appl. Sci."},{"key":"ref_38","first-page":"2079","article-title":"On over-fitting in model selection and subsequent selection bias in performance evaluation","volume":"11","author":"Cawley","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Trivedi, S., Pardos, Z.A., and Heffernan, N.T. (July, January 28). Clustering students to generate an ensemble to improve standard test score predictions. Proceedings of the Artificial Intelligence in Education: 15th International Conference, AIED 2011, Auckland, New Zealand.","DOI":"10.1007\/978-3-642-21869-9_49"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/5\/284\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:32:10Z","timestamp":1760031130000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/5\/284"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,13]]},"references-count":39,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2025,5]]}},"alternative-id":["a18050284"],"URL":"https:\/\/doi.org\/10.3390\/a18050284","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2025,5,13]]}}}