{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,21]],"date-time":"2026-05-21T22:26:03Z","timestamp":1779402363504,"version":"3.53.1"},"reference-count":117,"publisher":"Association for Computing Machinery (ACM)","issue":"1","funder":[{"name":"Deputyship for Research & Innovation, Ministry of Education in Saudi Arabia","award":["MoE-IF-UJ-R2-22-1167-1"],"award-info":[{"award-number":["MoE-IF-UJ-R2-22-1167-1"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2026,1,31]]},"abstract":"<jats:p>Massive Open Online Courses (MOOCs) have been proliferating, offering free or low-cost content for learners. Nevertheless, the certification rate of both free and paid courses has been low (between 4.5\u201313% and 1\u20133%, respectively). Thus, this study aims to survey MOOCs certification predictive models, synthesise results for a comprehensive and deep understanding of this field and explore how these models contributed to addressing the very low certification level. We adopted the Preferred Reporting Items for Systematic Review and Meta-analysis Protocols (PRISMA-P) for transparently conducting the present review and reporting the results from the works reviewed. Additionally, this SLR highlights several trends and limitations within the present predictive models, including some methodological concerns: the extent to which the present models are generalisable, the excessive filtration of the experimental population, the incompatibility of some experiments with real-time scenarios (nonrealistic modelling), and the shallow reporting of model performances. We have also discussed the replicability of the present models and ongoing efforts towards building a state-of-the-art predictive model. Finally, we highlight future research opportunities in the field of MOOC certification prediction that either deal with the limitations of the present models or address unanswered questions.<\/jats:p>","DOI":"10.1145\/3743671","type":"journal-article","created":{"date-parts":[[2025,6,20]],"date-time":"2025-06-20T07:42:37Z","timestamp":1750405357000},"page":"1-32","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":1,"title":["Prediction of Certification in MOOCs: A Systematic Literature Review"],"prefix":"10.1145","volume":"58","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9258-3503","authenticated-orcid":false,"given":"Ahmed","family":"Alamri","sequence":"first","affiliation":[{"name":"College of Computer Science and Engineering, Department of Information Systems and Technology, University of Jeddah","place":["Jeddah, Saudi Arabia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5482-1926","authenticated-orcid":false,"given":"Mohammad","family":"Alshehri","sequence":"additional","affiliation":[{"name":"College of Business at Alkamil, Department of Management Information Systems, University of Jeddah","place":["Jeddah, Saudi Arabia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-1405-2628","authenticated-orcid":false,"given":"Laila","family":"Alrajhi","sequence":"additional","affiliation":[{"name":"King Abdulaziz University","place":["Jeddah, Saudi Arabia"]}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1454-8822","authenticated-orcid":false,"given":"Alexandra","family":"Cristea","sequence":"additional","affiliation":[{"name":"Durham University","place":["Durham, United Kingdom"]}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2025,9]]},"reference":[{"key":"e_1_3_2_2_2","first-page":"34","article-title":"Origins of the modern MOOC (xMOOC)","author":"Ng A.","year":"2014","unstructured":"A. Ng and J. Widom. 2014. Origins of the modern MOOC (xMOOC). Hrsg. Fiona M. Hollands, Devayani Tirthali: MOOCs: Expectations and Reality: Full Report (2014), 34\u201347.","journal-title":"Hrsg. Fiona M. Hollands, Devayani Tirthali: MOOCs: Expectations and Reality: Full Report"},{"issue":"2","key":"e_1_3_2_3_2","first-page":"35","article-title":"MOOCS for development: Trends, challenges, and opportunities","volume":"11","author":"Castillo N. M.","year":"2015","unstructured":"N. M. Castillo, J. Lee, F. T. Zahra, and D. A. Wagner. 2015. MOOCS for development: Trends, challenges, and opportunities. International Technologies & International Development 11, 2 (2015), 35.","journal-title":"International Technologies & International Development"},{"key":"e_1_3_2_4_2","unstructured":"K. G. Robinson. 2016. New internationalization opportunities for higher education institutions: A strategic framework for the cross-border provision of massive open online courses (MOOCs). University of Puerto Rico at R\u00edo Piedras San Juan Puerto Rico. https:\/\/recursos.educoas.org\/sites\/default\/files\/VE16.573.pdf"},{"issue":"3","key":"e_1_3_2_5_2","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1179\/1477963314Z.00000000028","article-title":"The prehistory of MOOCs: Inclusive and exclusive access in the cyclical evolution of higher education","volume":"11","author":"Longstaff E.","year":"2014","unstructured":"E. Longstaff. 2014. The prehistory of MOOCs: Inclusive and exclusive access in the cyclical evolution of higher education. Journal of Organisational Transformation & Social Change 11, 3 (2014), 164\u2013184.","journal-title":"Journal of Organisational Transformation & Social Change"},{"issue":"1","key":"e_1_3_2_6_2","doi-asserted-by":"crossref","first-page":"682","DOI":"10.25082\/AMLER.2023.01.017","article-title":"Moocs 2012-2022: An overview","volume":"3","author":"Papadakis S.","year":"2023","unstructured":"S. Papadakis. 2023. Moocs 2012-2022: An overview. Advances in Mobile Learning Educational Research 3, 1 (2023), 682\u2013693.","journal-title":"Advances in Mobile Learning Educational Research"},{"issue":"2","key":"e_1_3_2_7_2","first-page":"92","article-title":"Why study on a MOOC? The motives of students and professionals","volume":"18","author":"Milligan C.","year":"2017","unstructured":"C. Milligan and A. Littlejohn. 2017. Why study on a MOOC? The motives of students and professionals. Int. Rev. Res. Open Distrib. Learn 18, 2 (2017), 92\u2013102.","journal-title":"Int. Rev. Res. Open Distrib. Learn"},{"key":"e_1_3_2_8_2","doi-asserted-by":"publisher","DOI":"10.1145\/3456295"},{"key":"e_1_3_2_9_2","first-page":"2022","volume-title":"The use of Deep Learning Techniques in E-Learning Systems and MOOCs","author":"Baarir N. F.","year":"2021","unstructured":"N. F. Baarir, S. Bourekkache, and A. Aloui. 2021. The use of Deep Learning Techniques in E-Learning Systems and MOOCs. IEEE, City, 2022."},{"key":"e_1_3_2_10_2","author":"Shah D.","year":"2021","unstructured":"D. Shah. 2021. By The Numbers: MOOCs in 2021. online, 2021.","journal-title":"By The Numbers: MOOCs in 2021"},{"issue":"5","key":"e_1_3_2_11_2","first-page":"177","article-title":"Democratizing higher education: Exploring MOOC use among those who cannot afford a formal education","volume":"15","author":"Dillahunt T.","year":"2014","unstructured":"T. Dillahunt, Z. Wang, and S. D. Teasley. 2014. Democratizing higher education: Exploring MOOC use among those who cannot afford a formal education. Int. Rev. Res. Open Distrib. Learn 15, 5 (2014), 177\u2013196.","journal-title":"Int. Rev. Res. Open Distrib. Learn"},{"key":"e_1_3_2_12_2","unstructured":"S. Lohr. 2020. Remember the MOOCs? After near-death they're booming. Retrieved from https:www.nytimes.com\/2020\/05\/26\/technology\/moocs-online-learning.html"},{"key":"e_1_3_2_13_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-020-09798-x"},{"key":"e_1_3_2_14_2","first-page":"1","article-title":"MOOC and MOOC degrees: New learning paradigm and its specifics","volume":"10","author":"Shcherbinin M.","year":"2019","unstructured":"M. Shcherbinin, S. V. Kruchinin, and A. G. Ivanov. 2019. MOOC and MOOC degrees: New learning paradigm and its specifics. Management Applied. Science Technologies 10 (2019), 1\u201314.","journal-title":"Management Applied. Science Technologies"},{"key":"e_1_3_2_15_2","volume-title":"2018 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM)","unstructured":"R. Cobos and L. Olmos. 2018. A learning analytics tool for predictive modeling of dropout and certificate acquisition on MOOCs for professional learning. In 2018 IEEE International Conference on Industrial Engineering and Engineering Management (IEEM). Bangkok, Thailand, 1533--1537. https:\/\/ieeexplore.ieee.org\/document\/8607541"},{"key":"e_1_3_2_16_2","doi-asserted-by":"crossref","unstructured":"I. Chuang A. Ho. 2016. HarvardX and MITx: Four years of open online courses--fall 2012-summer 2016. Retrieved from https:\/\/papers.ssrn.com\/sol3\/papers.cfm?abstract_id=2889436","DOI":"10.2139\/ssrn.2889436"},{"key":"e_1_3_2_17_2","doi-asserted-by":"crossref","first-page":"6423","DOI":"10.1126\/science.aav7958","article-title":"The MOOC pivot","volume":"363","author":"Reich J.","year":"2019","unstructured":"J. Reich and J. A. Ruip\u00e9rez-Valiente. 2019. The MOOC pivot. Science 363, 6423 (2019), 130\u2013131.","journal-title":"Science"},{"key":"e_1_3_2_18_2","author":"Clow D.","year":"2013","unstructured":"D. Clow. 2013. MOOCs and the Funnel of Participation. ACM, City, 2013.","journal-title":"MOOCs and the Funnel of Participation"},{"key":"e_1_3_2_19_2","first-page":"13","article-title":"Studying learning in the worldwide classroom research into edX's first MOOC","volume":"8","author":"Breslow L.","year":"2013","unstructured":"L. Breslow, D. E. Pritchard, J. DeBoer, G. S. Stump, A. D. Ho, and D. T. Seaton. 2013. Studying learning in the worldwide classroom research into edX's first MOOC. Research & Practice in Assessment 8 (2013), 13\u201325.","journal-title":"Research & Practice in Assessment"},{"key":"e_1_3_2_20_2","first-page":"2021","volume-title":"Predicting Certification in MOOCs Based on Students\u2019 Weekly Activities","author":"Alshehri M.","year":"2021","unstructured":"M. Alshehri, A. Alamri, and A. I. Cristea. 2021. Predicting Certification in MOOCs Based on Students\u2019 Weekly Activities. Springer, City, 2021."},{"key":"e_1_3_2_21_2","unstructured":"N. Gitinabard F. Khoshnevisan C. F. Lynch and E. Y. Wang. 2018. Your actions or your associates? Predicting certification and dropout in MOOCs with behavioral and social features. arXiv:1809.00052v1. Retrieved from https:\/\/arxiv.org\/abs\/1809.00052"},{"issue":"8","key":"e_1_3_2_22_2","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1145\/2492007.2492017","article-title":"Money models for MOOCs","volume":"56","author":"Dellarocas C.","year":"2012","unstructured":"C. Dellarocas and M. W. Van Alstyne. 2012. Money models for MOOCs. Communications of the ACM, August 56, 8 (2013), 25\u201328.","journal-title":"Communications of the ACM, August"},{"issue":"12","key":"e_1_3_2_23_2","article-title":"The year of the MOOC","volume":"2","author":"Pappano L.","year":"2012","unstructured":"L. Pappano. 2012. The year of the MOOC. The New York Times 2, 12 (2012).","journal-title":"The New York Times"},{"key":"e_1_3_2_24_2","article-title":"Effect of payment on user engagement in MOOCs","author":"Goli A.","year":"2019","unstructured":"A. Goli, P. K. Chintagunta, and S. Sriram. 2019. Effect of payment on user engagement in MOOCs. Available at SSRN 3414406 (2019).","journal-title":"Available at SSRN 3414406"},{"key":"e_1_3_2_25_2","unstructured":"F. Arslan K. Bagchi and S. Ryu. 2015. A preliminary evaluation of the determinants of certification success in MOOCs: A multi-level study. In AMCIS 2015 Proceedings 33 (2015). https:\/\/aisel.aisnet.org\/amcis2015\/ISEdu\/GeneralPresentations\/"},{"key":"e_1_3_2_26_2","doi-asserted-by":"publisher","DOI":"10.1155\/2016\/2174613"},{"key":"e_1_3_2_27_2","doi-asserted-by":"publisher","DOI":"10.3102\/0034654317740335"},{"key":"e_1_3_2_28_2","doi-asserted-by":"publisher","DOI":"10.1080\/10447318.2018.1543084"},{"key":"e_1_3_2_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2018.10.019"},{"issue":"4","key":"e_1_3_2_30_2","doi-asserted-by":"crossref","first-page":"853","DOI":"10.1007\/s10758-019-09433-6","article-title":"MOOCs: Origins, concept and didactic applications: A systematic review of the literature (2012\u20132019)","volume":"25","author":"Palacios Hidalgo F. J.","year":"2020","unstructured":"F. J. Palacios Hidalgo, C. A. Huertas Abril, and M. G\u00f3mez Parra. 2020. MOOCs: Origins, concept and didactic applications: A systematic review of the literature (2012\u20132019). Technology, Knowledge and Learning 25, 4 (2020), 853\u2013879.","journal-title":"Technology, Knowledge and Learning"},{"issue":"1","key":"e_1_3_2_31_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1186\/s41039-022-00181-3","article-title":"The role of motivation in MOOCs\u2019 retention rates: A systematic literature review","volume":"17","author":"Badali M.","year":"2022","unstructured":"M. Badali, J. Hatami, S. K. Banihashem, E. Rahimi, O. Noroozi, and Z. Eslami. 2022. The role of motivation in MOOCs\u2019 retention rates: A systematic literature review. Res. Pract. Technol. Enhanc. Learn 17, 1 (2022), 1\u201320.","journal-title":"Res. Pract. Technol. Enhanc. Learn"},{"key":"e_1_3_2_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11257-018-9203-z"},{"key":"e_1_3_2_33_2","doi-asserted-by":"publisher","DOI":"10.30476\/ijvlms.2022.94572.1138"},{"key":"e_1_3_2_34_2","author":"Dalipi F.","year":"2018","unstructured":"F. Dalipi, A. S. Imran, and Z. Kastrati. 2018. MOOC Dropout Prediction Using Machine Learning Techniques: Review and Research Challenges. IEEE, City, 2018.","journal-title":"MOOC Dropout Prediction Using Machine Learning Techniques: Review and Research Challenges"},{"key":"e_1_3_2_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/TLT.2018.2856808"},{"issue":"3","key":"e_1_3_2_36_2","first-page":"121","article-title":"An analysis of course characteristics, learner characteristics, and certification rates in MITx MOOCs","volume":"21","author":"Cagiltay N. E.","year":"2020","unstructured":"N. E. Cagiltay, K. Cagiltay, and B. Celik. 2020. An analysis of course characteristics, learner characteristics, and certification rates in MITx MOOCs. Int. Rev. Res. Open Distrib. Learn 21, 3 (2020), 121\u2013139.","journal-title":"Int. Rev. Res. Open Distrib. Learn"},{"key":"e_1_3_2_37_2","doi-asserted-by":"crossref","unstructured":"M. Alshehri A. Alamri A. I. Cristea and C. D. Stewart. 2021. Towards designing profitable courses: Predicting student purchasing behaviour in MOOCs. International Journal of Artificial Intelligence in Education 31 (2021) 215--233. https:\/\/www.semanticscholar.org\/paper\/Towards-Designing-Profitable-Courses%3A-Predicting-in-Alshehri-Alamri\/155e6844dfcb69ea1fa1201c0a68847229433e85","DOI":"10.1007\/s40593-021-00246-2"},{"key":"e_1_3_2_38_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-59044-8_31"},{"key":"e_1_3_2_39_2","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1016\/j.chb.2018.04.043","article-title":"Effect of uninterrupted time-on-task on students\u2019 success in massive open online courses (MOOCs)","volume":"86","author":"Lee Y.","year":"2014","unstructured":"Y. Lee. 2014. Effect of uninterrupted time-on-task on students\u2019 success in massive open online courses (MOOCs). Comput. Hum. Behav 86 (2018), 174\u2013180.","journal-title":"Comput. Hum. Behav"},{"key":"e_1_3_2_40_2","unstructured":"B. Nkuyubwatsi. 2014. Cultural translation in massive open online courses (MOOCs). Proceedings of the European MOOC Stakeholder Summit 37 (2014) 122--129."},{"issue":"4","key":"e_1_3_2_41_2","first-page":"6","article-title":"MOOCs in your future","volume":"42","author":"Paldy L. G.","year":"2013","unstructured":"L. G. Paldy. 2013. MOOCs in your future. Journal of College Science Teaching 42, 4 (2013), 6.","journal-title":"Journal of College Science Teaching"},{"key":"e_1_3_2_42_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sbspro.2015.01.685"},{"key":"e_1_3_2_43_2","volume-title":"On the use of MOOCs in Companies: A Panorama of Current Practices","author":"Cond\u00e9 J.","year":"2019","unstructured":"J. Cond\u00e9 and M. Cisel. 2019. On the use of MOOCs in Companies: A Panorama of Current Practices. Springer, City, (2019)."},{"key":"e_1_3_2_44_2","volume-title":"The Influence of Grades on Learning Behavior in MOOCs: Certification vs, Continued Participation","author":"Wang L.","year":"2019","unstructured":"L. Wang, E. Hemberg, and U.-M. O'Reilly. 2019. The Influence of Grades on Learning Behavior in MOOCs: Certification vs, Continued Participation. IEEE, City, (2019)."},{"key":"e_1_3_2_45_2","unstructured":"D. Shah. 2018. Six tiers of MOOC monetization. Retrieved from https:\/\/www.classcentral.com\/report\/six-tiers-mooc-monetization\/"},{"issue":"5","key":"e_1_3_2_46_2","first-page":"222","article-title":"MOOC providers and their strategies","volume":"3","author":"Taneja S.","year":"2014","unstructured":"S. Taneja and A. Goel. 2014. MOOC providers and their strategies. International Journal of Computer Science and Mobile Computing 3, 5 (2014), 222\u2013228.","journal-title":"International Journal of Computer Science and Mobile Computing"},{"key":"e_1_3_2_47_2","doi-asserted-by":"publisher","DOI":"10.2478\/eurodl-2019-0006"},{"key":"e_1_3_2_48_2","doi-asserted-by":"crossref","unstructured":"L. Pickard D. Shah and J. De Simone. 2018. Mapping microcredentials across MOOC platforms. Learning With MOOCS (LWMOOCS'18). 17--21. https:\/\/www.semanticscholar.org\/paper\/Mapping-Microcredentials-Across-MOOC-Platforms-Pickard-Shah\/cfe334902f943c374149b27ea681744d48372bc8","DOI":"10.1109\/LWMOOCS.2018.8534617"},{"key":"e_1_3_2_49_2","unstructured":"D. Shah. 2021. Massive List of MOOC-Based Microcredentials. Retrieved from https:\/\/www.classcentral.com\/report\/list-of-mooc-based-microcredentials\/"},{"issue":"1","key":"e_1_3_2_50_2","doi-asserted-by":"crossref","first-page":"36","DOI":"10.4018\/ijtem.2015010104","article-title":"Micro-credentials, nano degrees, and digital badges: New credentials for global higher education","volume":"5","author":"Lemoine P. A.","year":"2015","unstructured":"P. A. Lemoine and M. D. Richardson. 2015. Micro-credentials, nano degrees, and digital badges: New credentials for global higher education. International Journal of Technology and Educational Marketing (IJTEM) 5, 1 (2015), 36\u201349.","journal-title":"International Journal of Technology and Educational Marketing (IJTEM)"},{"key":"e_1_3_2_51_2","doi-asserted-by":"publisher","DOI":"10.12753\/2066-026X-17-000"},{"key":"e_1_3_2_52_2","volume-title":"MOOCs: What Motivates the Producers and Participants?","author":"White S.","year":"2014","unstructured":"S. White, H. Davis, K. Dickens, M. Le\u00f3n, and M. M. S\u00e1nchez-Vera. 2014. MOOCs: What Motivates the Producers and Participants? Springer, City, 2014."},{"key":"e_1_3_2_53_2","doi-asserted-by":"crossref","unstructured":"M. Calise C. D. Kloos J. Reich J. A. Ruiperez-Valiente and M. Wirsing. 2019. Digital education: At the MOOC crossroads where the interests of academia and business converge: 6th European MOOCs stakeholders summit EMOOCs 2019 Naples Italy May 20\u201322 2019 proceedings. Springer 2019.","DOI":"10.1007\/978-3-030-19875-6"},{"key":"e_1_3_2_54_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-19875-6_17"},{"key":"e_1_3_2_55_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.iheduc.2020.100759"},{"issue":"1","key":"e_1_3_2_56_2","doi-asserted-by":"crossref","first-page":"12","DOI":"10.3390\/publications9010012","article-title":"Web of science (WoS) and scopus: The titans of bibliographic information in today's academic world","volume":"9","author":"Pranckut\u0117 R.","year":"2021","unstructured":"R. Pranckut\u0117. 2021. Web of science (WoS) and scopus: The titans of bibliographic information in today's academic world. Publications 9, 1 (2021), 12.","journal-title":"Publications"},{"key":"e_1_3_2_57_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11192-020-03387-8"},{"key":"e_1_3_2_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/3027385.3027416"},{"key":"e_1_3_2_59_2","volume-title":"Learning Behavior Analysis and Dropout Rate Prediction Based on MOOCs Data","author":"Wang L.","year":"2019","unstructured":"L. Wang and H. Wang. 2019. Learning Behavior Analysis and Dropout Rate Prediction Based on MOOCs Data. IEEE, City, 2019."},{"key":"e_1_3_2_60_2","volume-title":"Predicting Learners' Multi-Question Performance Based on Neural Networks","author":"Liao P.","year":"2017","unstructured":"P. Liao, Y. Sun, S. Ye, X. Li, G. Su, and Y. Sun. 2017. Predicting Learners' Multi-Question Performance Based on Neural Networks. IEEE, City, (2017)."},{"key":"e_1_3_2_61_2","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2016.119"},{"key":"e_1_3_2_62_2","doi-asserted-by":"publisher","DOI":"10.1186\/s13643-016-0384-4"},{"issue":"3","key":"e_1_3_2_63_2","doi-asserted-by":"crossref","first-page":"275","DOI":"10.1002\/jrsm.1237","article-title":"Can abstract screening workload be reduced using text mining? User experiences of the tool rayyan","volume":"8","author":"Olofsson H.","year":"2017","unstructured":"H. Olofsson, A. Brolund, C. Hellberg, R. Silverstein, K. Stenstr\u00f6m, M. \u00d6sterberg, and J. Dagerhamn. 2017. Can abstract screening workload be reduced using text mining? User experiences of the tool rayyan. Research Synthesis Methods 8, 3 (2017), 275\u2013280.","journal-title":"Research Synthesis Methods"},{"key":"e_1_3_2_64_2","doi-asserted-by":"publisher","DOI":"10.11613\/BM.2012.031"},{"issue":"212","key":"e_1_3_2_65_2","first-page":"22","article-title":"The measurement of interrater agreement","volume":"2","author":"Fleiss J. L.","year":"1981","unstructured":"J. L. Fleiss, B. Levin, and M. C. Paik. 1981. The measurement of interrater agreement. Statistical Methods for Rates and Proportions 2, 212-236 (1981), 22-23.","journal-title":"Statistical Methods for Rates and Proportions"},{"issue":"1","key":"e_1_3_2_66_2","first-page":"57","article-title":"Astronomy for astronomical numbers: A worldwide massive open online class","volume":"16","author":"Impey C. D.","year":"2015","unstructured":"C. D. Impey, M. C. Wenger, and C. L. Austin. 2015. Astronomy for astronomical numbers: A worldwide massive open online class. Int. Rev. Res. Open Distrib. Learn 16, 1 (2015), 57\u201379.","journal-title":"Int. Rev. Res. Open Distrib. Learn"},{"key":"e_1_3_2_67_2","volume-title":"An Assessment Planner for MOOCs Based ODALA Approach","author":"Haddadi L.","year":"2016","unstructured":"L. Haddadi and F. B. Dahmani. An Assessment Planner for MOOCs Based ODALA Approach. IEEE, City, (2016)."},{"issue":"3","key":"e_1_3_2_68_2","article-title":"Are computer adaptive tests suitable for assessment in MOOCs","volume":"13","author":"Rossano V.","year":"2017","unstructured":"V. Rossano, E. Pesare, and T. Roselli. 2017. Are computer adaptive tests suitable for assessment in MOOCs. J. E-Learn. Knowl. Soc 13, 3 (2017).","journal-title":"J. E-Learn. Knowl. Soc"},{"key":"e_1_3_2_69_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-662-52925-6_7"},{"key":"e_1_3_2_70_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-6586-6"},{"key":"e_1_3_2_71_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-6586-6"},{"key":"e_1_3_2_72_2","volume-title":"Les Coulisses d'un Massive Open Online Course (MOOC) Sur le Diagnostic Des Cancers","author":"Gardair C.","year":"2016","unstructured":"C. Gardair, G. Bousquet, J. Lehmann-Che, C. de Bazelaire, P. de Cremoux, J. T. Van Nhieu, M. Sockeel, M. Battistella, J. Calvani, and J. Gervais. 2016. Les Coulisses d'un Massive Open Online Course (MOOC) Sur le Diagnostic Des Cancers. Elsevier, City, (2016)."},{"issue":"2","key":"e_1_3_2_73_2","first-page":"215","article-title":"Attention to Diversity in Moocs: A methodological proposal","volume":"20","author":"Garcia Barrera A.","year":"2017","unstructured":"A. Garcia Barrera, P. Gomez Hernandez, and C. Monge Lopez. 2017. Attention to Diversity in Moocs: A methodological proposal. Educacion XX1 20, 2 (2017), 215\u2013233.","journal-title":"Educacion XX1"},{"key":"e_1_3_2_74_2","author":"S\u00e1nchez M.","year":"2016","unstructured":"M. S\u00e1nchez. 2016. Assessing the Quality of MOOC Using ISO\/IEC 25010. IEEE, City, (2016).","journal-title":"Assessing the Quality of MOOC Using ISO\/IEC 25010"},{"key":"e_1_3_2_75_2","unstructured":"E. Vrillon. 2019. A new assessment of success in MOOCs based on individual usage records. Questions Vives. Retrieved from http:\/\/journals.openedition.org\/questionsvives\/3933"},{"issue":"1","key":"e_1_3_2_76_2","doi-asserted-by":"crossref","first-page":"149","DOI":"10.7202\/1087053ar","article-title":"Les liens entre les objectifs de formation, les facteurs sociodemographiques et la reussite chez des participants a un MOOC professionnalisant","volume":"56","author":"Njingang Mbadjoin T.","year":"2021","unstructured":"T. Njingang Mbadjoin and R. Chaker. 2021. Les liens entre les objectifs de formation, les facteurs sociodemographiques et la reussite chez des participants a un MOOC professionnalisant. McGill Journal of Education\/Revue des Sciences De l'\u00e9ducation de McGill 56, 1 (2021), 149\u2013170.","journal-title":"McGill Journal of Education\/Revue des Sciences De l'\u00e9ducation de McGill"},{"key":"e_1_3_2_77_2","doi-asserted-by":"publisher","DOI":"10.1108\/ILS-04-2019-0031"},{"issue":"4","key":"e_1_3_2_78_2","doi-asserted-by":"crossref","first-page":"52","DOI":"10.17718\/tojde.340381","article-title":"An examination of xMOOCS: An embedded single case study based on conole's 12 dimensions","volume":"18","author":"Kocdar S.","year":"2017","unstructured":"S. Kocdar, M. R. Okur, and A. Bozkurt. 2017. An examination of xMOOCS: An embedded single case study based on conole's 12 dimensions. Turk. Online J. Distance Educ 18, 4 (2017), 52\u201365.","journal-title":"Turk. Online J. Distance Educ"},{"issue":"3","key":"e_1_3_2_79_2","first-page":"552","article-title":"Application of blockchain technology in higher education","volume":"9","author":"Fedorova E. P.","year":"2020","unstructured":"E. P. Fedorova and E. I. Skobleva. 2020. Application of blockchain technology in higher education. European Journal of Contemporary Education 9, 3 (2020), 552\u2013571.","journal-title":"European Journal of Contemporary Education"},{"issue":"1","key":"e_1_3_2_80_2","first-page":"36","article-title":"Attendance to massive open online courses: Towards a solution to track online recorded lectures viewing","volume":"15","author":"Canessa E.","year":"2013","unstructured":"E. Canessa, L. Tenze, and E. Salvatori. 2013. Attendance to massive open online courses: Towards a solution to track online recorded lectures viewing. Bulletin of the IEEE Technical Committee on Learning Technology 15, 1 (2013), 36\u201339.","journal-title":"Bulletin of the IEEE Technical Committee on Learning Technology"},{"key":"e_1_3_2_81_2","volume-title":"Towards Cybersecurity MOOC Certification","author":"Beckerle M.","year":"2021","unstructured":"M. Beckerle, A. Chatzopoulou, and S. Fischer-H\u00fcbner. 2021. Towards Cybersecurity MOOC Certification. IEEE, City, (2021)."},{"key":"e_1_3_2_82_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-10-6586-6_13"},{"key":"e_1_3_2_83_2","doi-asserted-by":"publisher","DOI":"10.7326\/0003-4819-151-4-200908180-00135"},{"key":"e_1_3_2_84_2","article-title":"Cochrane handbook for systematic reviews of interventions","author":"Higgins J.","year":"2008","unstructured":"J. Higgins. 2008. Cochrane handbook for systematic reviews of interventions. Cochrane Collaboration and John Wiley & Sons Ltd (2008).","journal-title":"Cochrane Collaboration and John Wiley & Sons Ltd"},{"key":"e_1_3_2_85_2","doi-asserted-by":"publisher","DOI":"10.3102\/0002831215584621"},{"key":"e_1_3_2_86_2","doi-asserted-by":"publisher","DOI":"10.1108\/IJWIS-11-2018-0080"},{"key":"e_1_3_2_87_2","author":"Lim C. L.","year":"2017","unstructured":"C. L. Lim, S. F. Tang, and P. Ravichandran. 2017. A Study on the Mediation Effects of Intention to Enroll in MOOCs on its Actual Usage. City, 2017.","journal-title":"A Study on the Mediation Effects of Intention to Enroll in MOOCs on its Actual Usage"},{"key":"e_1_3_2_88_2","author":"Glance D. G.","year":"2014","unstructured":"D. G. Glance, P. H. R. Barrett, and R. Hugh. 2014. Attrition Patterns Amongst Participant Groups in Massive Open Online Courses. City, 2014.","journal-title":"Attrition Patterns Amongst Participant Groups in Massive Open Online Courses"},{"key":"e_1_3_2_89_2","volume-title":"Dropout Detection in MOOCs: An Exploratory Analysis","author":"Isidro C.","year":"2018","unstructured":"C. Isidro, R. M. Carro, and A. Ortigosa. 2018. Dropout Detection in MOOCs: An Exploratory Analysis. IEEE, City, (2018)."},{"issue":"3","key":"e_1_3_2_90_2","first-page":"614","article-title":"Learning behavior analysis and prediction based on MOOC data","volume":"52","author":"Jiang Z.","year":"2015","unstructured":"Z. Jiang, Y. Zhang, and X. Li. 2015. Learning behavior analysis and prediction based on MOOC data. Journal of Computer Research and Development 52, 3 (2015), 614.","journal-title":"Journal of Computer Research and Development"},{"key":"e_1_3_2_91_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2009.06.006"},{"issue":"1","key":"e_1_3_2_92_2","doi-asserted-by":"crossref","first-page":"e0245718","DOI":"10.1371\/journal.pone.0245718","article-title":"A survival model for course-course interactions in a massive open online course platform","volume":"16","author":"Wintermute E. H.","year":"2021","unstructured":"E. H. Wintermute, M. Cisel, and A. B. Lindner. 2021. A survival model for course-course interactions in a massive open online course platform. PLoS One 16, 1 (2021), e0245718.","journal-title":"PLoS One"},{"key":"e_1_3_2_93_2","author":"Joksimovi\u0107 S.","year":"2016","unstructured":"S. Joksimovi\u0107, A. Manataki, D. Ga\u0161evi\u0107, S. Dawson, V. Kovanovi\u0107, and I. F. De Kereki. 2016. Translating Network Position Into Performance: Importance of Centrality in Different Network Configurations. City, (2016).","journal-title":"Translating Network Position Into Performance: Importance of Centrality in Different Network Configurations"},{"key":"e_1_3_2_94_2","unstructured":"S. Jiang S. M. Fitzhugh and M. Warschauer. 2014. Social Positioning and Performance in MOOCs. CEUR Workshop Proceedings 55--58 (2014) 1183. https:\/\/www.researchgate.net\/publication\/287042418_Social_positioning_and_performance_in_MOOCs"},{"key":"e_1_3_2_95_2","doi-asserted-by":"crossref","unstructured":"H. Davis K. D. M. Leon M. Vera and S. White. 2013. MOOCs for universities and learners. An Analysis of Motivating Factors. In International Conference on Computer Supported Education 2 (2013) 105--116. SciTePress. https:\/\/www.scitepress.org\/PublishedPapers\/2014\/48449\/48449.pdf","DOI":"10.5220\/0004844901050116"},{"key":"e_1_3_2_96_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2016.03.016"},{"key":"e_1_3_2_97_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11528-014-0821-y"},{"issue":"3","key":"e_1_3_2_98_2","doi-asserted-by":"crossref","first-page":"223","DOI":"10.5944\/openpraxis.8.3.282","article-title":"Exploratory study of MOOC learners\u2019 demographics and motivation: The case of students involved in groups","volume":"8","author":"Bayeck R.","year":"2016","unstructured":"R. Bayeck. 2016. Exploratory study of MOOC learners\u2019 demographics and motivation: The case of students involved in groups. Open Prax 8, 3 (2016), 223\u2013233.","journal-title":"Open Prax"},{"key":"e_1_3_2_99_2","doi-asserted-by":"publisher","DOI":"10.2139\/ssrn.2350964"},{"issue":"1","key":"e_1_3_2_100_2","first-page":"1","article-title":"Studying learner behavior in online courses with free-certificate coupons: Results from two case studies","volume":"21","author":"Littenberg-Tobias J.","year":"2020","unstructured":"J. Littenberg-Tobias, J. A. Ruip\u00e9rez-Valiente, and J. Reich. 2020. Studying learner behavior in online courses with free-certificate coupons: Results from two case studies. Int. Rev. Res. Open Distrib. Learn 21, 1 (2020), 1\u201322.","journal-title":"Int. Rev. Res. Open Distrib. Learn"},{"key":"e_1_3_2_101_2","author":"Coleman C. A.","year":"2015","unstructured":"C. A. Coleman, D. T. Seaton, and I. Chuang. 2015. Probabilistic use Cases: Discovering Behavioral Patterns for Predicting Certification. City, 2015.","journal-title":"Probabilistic use Cases: Discovering Behavioral Patterns for Predicting Certification"},{"key":"e_1_3_2_102_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2021.3134787"},{"key":"e_1_3_2_103_2","unstructured":"S. Jiang A. Williams K. Schenke M. Warschauer and D. O'dowd. 2014. Predicting MOOC performance with week 1 behavior. In Educational Data Mining 2014. https:\/\/educationaldatamining.org\/EDM2014\/uploads\/procs2014\/short%20papers\/273_EDM-2014-Short.pdf"},{"key":"e_1_3_2_104_2","doi-asserted-by":"publisher","DOI":"10.1177\/0735633117753364"},{"key":"e_1_3_2_105_2","volume-title":"Modeling and Predicting Learning Behavior in MOOCs","author":"Qiu J.","year":"2016","unstructured":"J. Qiu, J. Tang, T. X. Liu, J. Gong, C. Zhang, Q. Zhang, and Y. Xue. 2016. Modeling and Predicting Learning Behavior in MOOCs. ACM, City, 2016."},{"key":"e_1_3_2_106_2","volume-title":"Predicting Learning Effect by Learner's Behavior in MOOCs","author":"Tian Y.","year":"2017","unstructured":"Y. Tian, Y. Wen, X. Yi, X. Yang, and Y. Miao. 2017. Predicting Learning Effect by Learner's Behavior in MOOCs. Springer, City, 2017."},{"key":"e_1_3_2_107_2","doi-asserted-by":"crossref","unstructured":"T. Aljohani and A. I. Cristea. 2021. Training temporal and NLP features via extremely randomised trees for educational level classification. Springer City 2021.","DOI":"10.1007\/978-3-030-80421-3_17"},{"issue":"2","key":"e_1_3_2_108_2","doi-asserted-by":"crossref","first-page":"170","DOI":"10.19173\/irrodl.v23i2.6023","article-title":"Fine-tuned BERT model for large scale and cognitive classification of MOOCs","volume":"23","author":"Sebbaq H.","year":"2022","unstructured":"H. Sebbaq. 2022. Fine-tuned BERT model for large scale and cognitive classification of MOOCs. The International Review of Research in Open and Distributed Learning 23, 2 (2022), 170\u2013190.","journal-title":"The International Review of Research in Open and Distributed Learning"},{"key":"e_1_3_2_109_2","volume-title":"2018 IEEE Global Engineering Education Conference (EDUCON)","unstructured":"R. Cobos and F. Jurado. 2018. An exploratory analysis on MOOCs retention and certification in two courses of different knowledge areas. In 2018 IEEE Global Engineering Education Conference (EDUCON). IEEE, 1659--1666. https:\/\/ieeexplore.ieee.org\/document\/8363434"},{"key":"e_1_3_2_110_2","doi-asserted-by":"publisher","DOI":"10.1145\/2460296.2460330"},{"key":"e_1_3_2_111_2","doi-asserted-by":"publisher","DOI":"10.1111\/bjet.12670"},{"key":"e_1_3_2_112_2","volume-title":"Study Effort and Student Success: A MOOC Case Study","author":"Samuelsen J.","year":"2018","unstructured":"J. Samuelsen and M. Khalil. 2018. Study Effort and Student Success: A MOOC Case Study. Springer, City, (2018)."},{"key":"e_1_3_2_113_2","doi-asserted-by":"crossref","unstructured":"T. Mullaney and J. Reich. 2015. Staggered versus all-at-once content release in massive open online courses: Evaluating a natural experiment. Retrieved from https:\/\/ssrn.com\/abstract=2499729","DOI":"10.2139\/ssrn.2499729"},{"key":"e_1_3_2_114_2","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_2_115_2","author":"Akiba T.","year":"2019","unstructured":"T. Akiba, S. Sano, T. Yanase, T. Ohta, and M. Koyama. 2019. Optuna: A Next-generation Hyperparameter Optimization Framework. City, 2019.","journal-title":"Optuna: A Next-generation Hyperparameter Optimization Framework"},{"key":"e_1_3_2_116_2","doi-asserted-by":"crossref","unstructured":"V. Swamy B. Radmehr N. Krco M. Marras and T. K\u00e4ser. 2022. Evaluating the explainers: Black-box explainable machine learning for student success prediction in MOOCs. arXiv:2207.00551. Retrieved from https:\/\/arxiv.org\/abs\/2207.00551.","DOI":"10.1145\/3491140.3528273"},{"key":"e_1_3_2_117_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11747-019-00710-5"},{"key":"e_1_3_2_118_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-031-11647-6_84"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3743671","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,1]],"date-time":"2025-09-01T12:53:54Z","timestamp":1756731234000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3743671"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9]]},"references-count":117,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1,31]]}},"alternative-id":["10.1145\/3743671"],"URL":"https:\/\/doi.org\/10.1145\/3743671","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9]]},"assertion":[{"value":"2022-11-15","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-05-28","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}