{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T15:41:48Z","timestamp":1782834108434,"version":"3.54.5"},"reference-count":24,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2024,6,9]],"date-time":"2024-06-09T00:00:00Z","timestamp":1717891200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computers"],"abstract":"<jats:p>The advent of Version Control Systems (VCS) in computer science education has significantly improved the learning experience. The Learning Analytics community has started to analyze the interactions between students and VCSs to evaluate the behavioral and cognitive aspects of the learning process. Within the aforesaid scope, a promising research direction is the use of Artificial Intelligence (AI) to predict students\u2019 exam outcomes early based on VCS usage data. Previous AI-based solutions have two main drawbacks: (i) They rely on static models, which disregard temporal changes in the student\u2013VCS interactions. (ii) AI reasoning is not transparent to end-users. This paper proposes a time-dependent approach to early predict student performance from VCS data. It applies and compares different classification models trained at various course stages. To gain insights into exam performance predictions it combines classification with explainable AI techniques. It visualizes the explanations of the time-varying performance predictors. The results of a real case study show that the effect of VCS-based features on the exam success rate is relevant much earlier than the end of the course, whereas the timely submission of the first lab assignment is a reliable predictor of the exam grade.<\/jats:p>","DOI":"10.3390\/computers13060150","type":"journal-article","created":{"date-parts":[[2024,6,10]],"date-time":"2024-06-10T08:49:03Z","timestamp":1718009343000},"page":"150","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["On Predicting Exam Performance Using Version Control Systems\u2019 Features"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7556-595X","authenticated-orcid":false,"given":"Lorenzo","family":"Canale","sequence":"first","affiliation":[{"name":"Dipartimento di Automatica e Informatica, Politecnico di Torino, Corso Duca degli Abruzzi, 24, 10129 Torino, Italy"},{"name":"Centre for Research and Technological Innovation, Radiotelevisione Italiana (RAI), Via Giovanni Carlo Cavalli 6, 10129 Torino, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7185-5247","authenticated-orcid":false,"given":"Luca","family":"Cagliero","sequence":"additional","affiliation":[{"name":"Dipartimento di Automatica e Informatica, Politecnico di Torino, Corso Duca degli Abruzzi, 24, 10129 Torino, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8614-4192","authenticated-orcid":false,"given":"Laura","family":"Farinetti","sequence":"additional","affiliation":[{"name":"Dipartimento di Automatica e Informatica, Politecnico di Torino, Corso Duca degli Abruzzi, 24, 10129 Torino, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5328-368X","authenticated-orcid":false,"given":"Marco","family":"Torchiano","sequence":"additional","affiliation":[{"name":"Dipartimento di Automatica e Informatica, Politecnico di Torino, Corso Duca degli Abruzzi, 24, 10129 Torino, Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2024,6,9]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Zagalsky, A., Feliciano, J., Storey, M.A., Zhao, Y., and Wang, W. (2015, January 14\u201318). The Emergence of GitHub as a Collaborative Platform for Education. Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW \u201915), Vancouver, BC, Canada.","DOI":"10.1145\/2675133.2675284"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Zakiah, A., and Fauzan, M. (2016, January 26\u201327). Collaborative Learning Model of Software Engineering using Github for informatics student. Proceedings of the 2016 4th International Conference on Cyber and IT Service Management, Bandung, Indonesia.","DOI":"10.1109\/CITSM.2016.7577521"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Feliciano, J., Storey, M., and Zagalsky, A. (2016, January 14\u201322). Student Experiences Using GitHub in Software Engineering Courses: A Case Study. Proceedings of the 2016 IEEE\/ACM 38th International Conference on Software Engineering Companion (ICSE-C), Austin, TX, USA.","DOI":"10.1145\/2889160.2889195"},{"key":"ref_4","unstructured":"Hsing, C., and Gennarelli, V. (March, January 27). Using GitHub in the Classroom Predicts Student Learning Outcomes and Classroom Experiences: Findings from a Survey of Students and Teachers. Proceedings of the 50th ACM Technical Symposium on Computer Science Education (SIGCSE \u201919), Minneapolis, MN, USA."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1186\/s41239-019-0176-8","article-title":"Mapping research in student engagement and educational technology in higher education: A systematic evidence map","volume":"17","author":"Bond","year":"2020","journal-title":"Int. J. Educ. Technol. High. Educ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1109\/TLT.2016.2616312","article-title":"Predicting Student Performance from LMS Data: A Comparison of 17 Blended Courses Using Moodle LMS","volume":"10","author":"Conijn","year":"2017","journal-title":"IEEE Trans. Learn. Technol."},{"key":"ref_7","unstructured":"Isacson, J., and Lindblom, E. (2017). Correlation of User Behaviour Patterns and Assignment Supplements in KTH-GitHub Repositories. [Bachelor\u2019s Thesis, KTH]."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Guerrero-Higueras, A., Llamas, C., S\u00e1nchez, L., Fern\u00e1ndez, A., Costales, G., and Conde-Gonz\u00e1lez, M. (2020). Academic Success Assessment through Version Control Systems. Appl. Sci., 10.","DOI":"10.3390\/app10041492"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"2522","DOI":"10.1038\/s42256-019-0138-9","article-title":"From local explanations to global understanding with explainable AI for trees","volume":"2","author":"Lundberg","year":"2020","journal-title":"Nat. Mach. Intell."},{"key":"ref_10","first-page":"74","article-title":"GitHub in the classroom: Not just for group projects","volume":"28","author":"Griffin","year":"2013","journal-title":"J. Comput. Sci. Coll."},{"key":"ref_11","first-page":"97","article-title":"Quantifying Introductory CS Students\u2019 Iterative Software Process by Mining Version Control System Repositories","volume":"31","author":"Baumstark","year":"2016","journal-title":"J. Comput. Sci. Coll."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1080\/08993408.2019.1696168","article-title":"Using GitHub in large software engineering classes. An exploratory case study","volume":"30","author":"Tushev","year":"2020","journal-title":"Comput. Sci. Educ."},{"key":"ref_13","first-page":"76","article-title":"Mining GitHub Classroom Commit Behavior in Elective and Introductory Computer Science Courses","volume":"35","author":"Sprint","year":"2019","journal-title":"J. Comput. Sci. Coll."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Guerrero-Higueras, A.M., DeCastro-Garc\u00eda, N., Matell\u00e1n, V., and Conde, M.A. (2018, January 24\u201326). Predictive Models of Academic Success: A Case Study with Version Control Systems. Proceedings of the Sixth International Conference on Technological Ecosystems for Enhancing Multiculturality (TEEM\u201918), Salamanca, Spain.","DOI":"10.1145\/3284179.3284235"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1515\/comp-2019-0012","article-title":"Predicting academic success through students\u2019 interaction with Version Control Systems","volume":"9","author":"RodriguezLera","year":"2019","journal-title":"Open Comput. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/1082983.1083150","article-title":"Mining Student CVS Repositories for Performance Indicators","volume":"30","author":"Mierle","year":"2005","journal-title":"SIGSOFT Softw. Eng. Notes"},{"key":"ref_17","unstructured":"IEEE-CS (2014). Software Engineering Competency Model, IEEE Computer Society Press. Technical Report."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1007\/s10869-010-9172-7","article-title":"Millennials in the Workplace: A Communication Perspective on Millennials\u2019 Organizational Relationships and Performance","volume":"25","author":"Myers","year":"2010","journal-title":"J. Bus. Psychol."},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Torchiano, M., and Bruno, G. (2018, January 2). Integrating software engineering key practices into an OOP massive in-classroom course: An experience report. Proceedings of the 2nd International Workshop on Software Engineering Education for Millennials (SEEM \u201918), Gothenburg, Sweden.","DOI":"10.1145\/3194779.3194786"},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Zaki, M.J., and Meira, W. (2020). Data Mining and Machine Learning: Fundamental Concepts and Algorithms, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/9781108564175"},{"key":"ref_21","unstructured":"Xavier, M., and Meneses, J. (2020, January 22\u201324). A Literature Review on the Definitions of Dropout in Online Higher Education. Proceedings of the EDEN 2020 Annual Conference, Virtual."},{"key":"ref_22","unstructured":"Canale, L. (2022). Artificial Intelligence Methodologies to Early Predict Student Outcome and Enrich Learning Material, Politecnico di Torino."},{"key":"ref_23","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Brodersen, K.H., Ong, C.S., Stephan, K.E., and Buhmann, J.M. (2010, January 23\u201326). The Balanced Accuracy and Its Posterior Distribution. Proceedings of the 20th International Conference on Pattern Recognition, ICPR 2010, Istanbul, Turkey.","DOI":"10.1109\/ICPR.2010.764"}],"container-title":["Computers"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/6\/150\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T14:56:06Z","timestamp":1760108166000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-431X\/13\/6\/150"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,9]]},"references-count":24,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2024,6]]}},"alternative-id":["computers13060150"],"URL":"https:\/\/doi.org\/10.3390\/computers13060150","relation":{},"ISSN":["2073-431X"],"issn-type":[{"value":"2073-431X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,9]]}}}