{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,13]],"date-time":"2025-11-13T07:17:29Z","timestamp":1763018249119,"version":"build-2065373602"},"reference-count":51,"publisher":"MDPI AG","issue":"20","license":[{"start":{"date-parts":[[2020,10,12]],"date-time":"2020-10-12T00:00:00Z","timestamp":1602460800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100010198","name":"Ministerio de Econom\u00eda, Industria y Competitividad, Gobierno de Espa\u00f1a","doi-asserted-by":"publisher","award":["TIN2014-54874-R"],"award-info":[{"award-number":["TIN2014-54874-R"]}],"id":[{"id":"10.13039\/501100010198","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100012818","name":"Comunidad de Madrid","doi-asserted-by":"publisher","award":["CM\/JIN\/2019-037"],"award-info":[{"award-number":["CM\/JIN\/2019-037"]}],"id":[{"id":"10.13039\/100012818","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Applied Sciences"],"abstract":"<jats:p>This paper analyzes the effects of gamification in the social network of a massive online course. An educational social-networking platform gathered information about the contributions of participants and about the social networks that were formed during the course. A gamification layer with three game elements (points, badges, and leaderboard) was then implemented in the online learning platform. Social network analysis (SNA) and principal component analysis (PCA) were used to analyze the differences between a treatment and a comparison group (N = 591 and N = 427), using a set of 20 variables for each participant which quantified contributions to the learning platform as well as position and influence in the social network. The results of SNA show that gamification influences the structure of the social network of the course. The results also suggest that the variables cluster similarly for each group and that the linear combination of variables called the first component (F1) is a good descriptor of students\u2019 work and position in the network. F1 can be used to build predictive models of course completion. The models show that the probability of passing the course increases more rapidly in the treatment (gamified) group.<\/jats:p>","DOI":"10.3390\/app10207065","type":"journal-article","created":{"date-parts":[[2020,10,12]],"date-time":"2020-10-12T10:18:00Z","timestamp":1602497880000},"page":"7065","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Gamifying Massive Online Courses: Effects on the Social Networks and Course Completion Rates"],"prefix":"10.3390","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0718-8774","authenticated-orcid":false,"given":"Luis","family":"de Marcos-Ortega","sequence":"first","affiliation":[{"name":"Departamento de Ciencias de la Computaci\u00f3n, Universidad de Alcal\u00e1, 28801 Alcal\u00e1 de Henares, Spain"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0298-3237","authenticated-orcid":false,"given":"Antonio","family":"Garcia-Cabot","sequence":"additional","affiliation":[{"name":"Departamento de Ciencias de la Computaci\u00f3n, Universidad de Alcal\u00e1, 28801 Alcal\u00e1 de Henares, Spain"}]},{"given":"Eva","family":"Garcia-Lopez","sequence":"additional","affiliation":[{"name":"Departamento de Ciencias de la Computaci\u00f3n, Universidad de Alcal\u00e1, 28801 Alcal\u00e1 de Henares, Spain"}]},{"given":"Raul","family":"Ramirez-Velarde","sequence":"additional","affiliation":[{"name":"Departamento de Ciencias Computaciones, Instituto Tecnol\u00f3gico y de Estudios Superiores de Monterrey, 64849 Monterrey, Mexico"}]},{"given":"Antonio","family":"Teixeira","sequence":"additional","affiliation":[{"name":"Department of Education and Distance Learning, Universidade Aberta, 1250-100 Lisbon, Portugal"}]},{"given":"Jos\u00e9-Javier","family":"Mart\u00ednez-Herr\u00e1iz","sequence":"additional","affiliation":[{"name":"Departamento de Ciencias de la Computaci\u00f3n, Universidad de Alcal\u00e1, 28801 Alcal\u00e1 de Henares, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2020,10,12]]},"reference":[{"doi-asserted-by":"crossref","unstructured":"Deterding, S., Dixon, D., Khaled, R., and Nacke, L. (2011, January 29\u201330). From game design elements to gamefulness: Defining \u201cgamification\u201d. Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments, Tampere, Finland.","key":"ref_1","DOI":"10.1145\/2181037.2181040"},{"unstructured":"Werbach, K., and Hunter, D. (2012). For the Win: How Game Thinking Can Revolutionize Your Business, Wharton Digital Press.","key":"ref_2"},{"doi-asserted-by":"crossref","unstructured":"Lieberoth, A. (2014). Shallow Gamification: Testing Psychological Effects of Framing an Activity as a Game. Games Cult.","key":"ref_3","DOI":"10.1177\/1555412014559978"},{"doi-asserted-by":"crossref","unstructured":"Mekler, E.D., Br\u00fchlmann, F., Opwis, K., and Tuch, A.N. (2013, January 2\u20134). Do points, levels and leaderboards harm intrinsic motivation? An empirical analysis of common gamification elements. Proceedings of the First International Conference on Gameful Design, Research, and Applications, Toronto, ON, Canada.","key":"ref_4","DOI":"10.1145\/2583008.2583017"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.compedu.2014.08.019","article-title":"Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance","volume":"80","author":"Hanus","year":"2015","journal-title":"Comput. Educ."},{"key":"ref_6","first-page":"485","article-title":"Why Gamification Fails in Education and How to Make it Successful: Introducing Nine Gamification Heuristics Based on Self-Determination Theory","volume":"Volume II","author":"Ma","year":"2017","journal-title":"Serious Games and Edutainment Application"},{"doi-asserted-by":"crossref","unstructured":"Hamari, J., Koivisto, J., and Sarsa, H. (2014, January 6\u20139). Does Gamification Work?\u2014A Literature Review of Empirical Studies on gamification. Proceedings of the 47th Hawaii International Conference on System Sciences, Waikoloa, HI, USA.","key":"ref_7","DOI":"10.1109\/HICSS.2014.377"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.ijhcs.2014.09.006","article-title":"Gamification in theory and action: A survey","volume":"74","author":"Seaborn","year":"2015","journal-title":"Int. J. Hum.-Comput. Stud."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1111\/jcal.12161","article-title":"The use of gamification in education: A bibliometric and text mining analysis","volume":"32","year":"2016","journal-title":"J. Comput. Assist. Learn."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1186\/s41239-017-0042-5","article-title":"Gamifying education: What is known, what is believed and what remains uncertain: A critical review","volume":"14","author":"Dichev","year":"2017","journal-title":"Int. J. Educ. Technol. High. Educ."},{"doi-asserted-by":"crossref","unstructured":"Kellogg, S., Booth, S., and Oliver, K. (2014). A social network perspective on peer supported learning in MOOCs for educators. Int. Rev. Res. Open Distrib. Learn., 15.","key":"ref_11","DOI":"10.19173\/irrodl.v15i5.1852"},{"doi-asserted-by":"crossref","unstructured":"Melesko, J., and Novickij, V. (2019). Computer Adaptive Testing Using Upper-Confidence Bound Algorithm for Formative Assessment. Appl. Sci., 9.","key":"ref_12","DOI":"10.3390\/app9204303"},{"doi-asserted-by":"crossref","unstructured":"Ortega-Arranz, A., Mu\u00f1oz-Crist\u00f3bal, J.A., Mart\u00ednez-Mon\u00e9s, A., Bote-Lorenzo, M.L., and Asensio-P\u00e9rez, J.I. (2017). How Gamification Is Being Implemented in MOOCs?, Springer. A Systematic Literature Review.","key":"ref_13","DOI":"10.1007\/978-3-319-66610-5_40"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s10648-014-9276-0","article-title":"Social Network Analysis in E-Learning Environments: A Preliminary Systematic Review","volume":"27","author":"Cela","year":"2014","journal-title":"Educ. Psychol. Rev."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/j.compedu.2003.06.001","article-title":"Combining qualitative evaluation and social network analysis for the study of classroom social interactions","volume":"41","author":"Dimitriadis","year":"2003","journal-title":"Comput. Educ."},{"doi-asserted-by":"crossref","unstructured":"\u0130\u015f, H., and Tuncer, T. (2019). Interaction-Based Behavioral Analysis of Twitter Social Network Accounts. Appl. Sci., 9.","key":"ref_16","DOI":"10.3390\/app9204448"},{"unstructured":"Antin, J., and Churchil, E.F. (2011). Badges in Social Media: A Social Psychological Perspective. Proceedings of the ACM CHI 2011 Conference on Human Factors in Computing Systems, Gamification Workshop Proceedings.","key":"ref_17"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1016\/j.compedu.2012.12.020","article-title":"Gamifying learning experiences: Practical implications and outcomes","volume":"63","year":"2013","journal-title":"Comput. Educ."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.compedu.2015.10.010","article-title":"Engaging Asian students through game mechanics: Findings from two experiment studies","volume":"92","author":"Hew","year":"2016","journal-title":"Comput. Educ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"769","DOI":"10.1177\/1046878114563662","article-title":"An Empirical Test of the Theory of Gamified Learning","volume":"45","author":"Landers","year":"2014","journal-title":"Simul. Gaming"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.compedu.2015.02.015","article-title":"Usage of a mobile social learning platform with virtual badges in a primary school","volume":"86","author":"Boticki","year":"2015","journal-title":"Comput. Educ."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1016\/j.compedu.2014.12.012","article-title":"Gamification in assessment: Do points affect test performance?","volume":"83","author":"Attali","year":"2015","journal-title":"Comput. Educ."},{"doi-asserted-by":"crossref","unstructured":"Shaojie, Q., Li, K., Wu, B., Zhang, S., and Wang, Y. (2019). Predicting Student Achievement Based on Temporal Learning Behavior in MOOCs. Appl. Sci., 9.","key":"ref_23","DOI":"10.3390\/app9245539"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1016\/j.chb.2016.12.033","article-title":"How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction","volume":"69","author":"Sailer","year":"2017","journal-title":"Comput. Hum. Behav."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"A60","DOI":"10.1016\/j.chb.2012.12.032","article-title":"The role of social media in higher education classes (real and virtual)\u2014A literature review","volume":"29","author":"Tess","year":"2013","journal-title":"Comput. Hum. Behav."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.iheduc.2015.02.004","article-title":"Understanding students\u2019 perceptions of the benefits of online social networking use for teaching and learning","volume":"26","author":"Hamid","year":"2015","journal-title":"Internet High. Educ."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.iheduc.2015.09.001","article-title":"Social network analysis of peer relationships and online interactions in a blended class using blogs","volume":"28","author":"Lee","year":"2016","journal-title":"Internet High. Educ."},{"key":"ref_28","first-page":"34","article-title":"An Analysis of Density and Degree-Centrality According to the Social Networking Structure Formed in an Online Learning Environment","volume":"19","author":"Usluel","year":"2016","journal-title":"Educ. Technol. Soc."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.compedu.2005.07.003","article-title":"Social networks, communication styles, and learning performance in a CSCL community","volume":"49","author":"Cho","year":"2007","journal-title":"Comput. Educ."},{"unstructured":"Paredes, W.C., and Chung, K.S.K. (May, January 29). Modelling Learning & Performance: A Social Networks Perspective. Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, Vancouver, BC, Canada.","key":"ref_30"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"17","DOI":"10.2190\/EC.39.1.b","article-title":"Using Social Network Analysis to Understand Sense of Community in an Online Learning Environment","volume":"39","author":"Shen","year":"2008","journal-title":"J. Educ. Comput. Res."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1","DOI":"10.24059\/olj.v7i3.1842","article-title":"Network Analysis of Knowledge Construction in Asynchronous Learning Networks","volume":"7","author":"Aviv","year":"2019","journal-title":"Online Learn."},{"key":"ref_33","first-page":"40","article-title":"Social Networks and the Building of Learning Communities: An Experimental Study of a Social MOOC","volume":"18","author":"Zorrilla","year":"2017","journal-title":"Int. Rev. Res. Open Distrib. Learn."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1016\/j.chb.2012.06.007","article-title":"A social gamification framework for a K-6 learning platform","volume":"29","author":"Redondo","year":"2013","journal-title":"Comput. Hum. Behav."},{"doi-asserted-by":"crossref","unstructured":"Thom, J., Millen, D.R., and DiMicco, J. (2012, January 11\u201315). Removing Gamification from an Enterprise SNS. Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW), Seattle, WA, USA.","key":"ref_35","DOI":"10.1145\/2145204.2145362"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"82","DOI":"10.1016\/j.compedu.2014.01.012","article-title":"An empirical study comparing gamification and social networking on e-learning","volume":"75","year":"2014","journal-title":"Comput. Educ."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1016\/j.compedu.2015.12.008","article-title":"On the effectiveness of game-like and social approaches in learning: Comparing educational gaming, gamification & social networking","volume":"95","year":"2016","journal-title":"Comput. Educ."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.chb.2016.02.052","article-title":"Social network analysis of a gamified e-learning course: Small-world phenomenon and network metrics as predictors of academic performance","volume":"60","author":"Diez","year":"2016","journal-title":"Comput. Hum. Behav."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1037\/0003-066X.55.1.68","article-title":"Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being","volume":"55","author":"Ryan","year":"2000","journal-title":"Am. Psychol."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/S0169-7552(98)00110-X","article-title":"The anatomy of a large-scale hypertextual Web search engine","volume":"30","author":"Brin","year":"1998","journal-title":"Comput. Netw. ISDN Syst."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"604","DOI":"10.1145\/324133.324140","article-title":"Authoritative sources in a hyperlinked environment","volume":"46","author":"Kleinberg","year":"1999","journal-title":"J. ACM"},{"unstructured":"Jolliffe, I.T. (2002). Principal Component Analysis, Springer.","key":"ref_42"},{"unstructured":"Bastian, M., Heymann, S., and Jacomy, M. (2009, January 17\u201319). Gephi: An Open Source Software for Exploring and Manipulating Networks. Proceedings of the Third International AAAI Conference on Web and Social Media, San Jos\u00e9, CA, USA. Available online: http:\/\/www.aaai.org\/ocs\/index.php\/ICWSM\/09\/paper\/view\/154.","key":"ref_43"},{"unstructured":"Wilks, S.S. (1962). Mathematical Statistics, John Wiley & Sons.","key":"ref_44"},{"unstructured":"Belyaev, E., Gilmutdinov, M., and Turlikov, A. (July, January 28). Binary Arithmetic Coding System with Adaptive Probability Estimation by \u201cVirtual Sliding Window\u201d. Proceedings of the IEEE Tenth International Symposium on Consumer Electronics, St. Petersburg, Russia.","key":"ref_45"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/TIT.1981.1056331","article-title":"The performance of universal encoding","volume":"27","author":"Krichevsky","year":"1981","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1109\/TIT.1986.1057250","article-title":"Estimating a probability using finite memory","volume":"32","author":"Leighton","year":"1986","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1145\/1132952.1132954","article-title":"Graph mining","volume":"38","author":"Chakrabarti","year":"2006","journal-title":"ACM Comput. Surv."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.tele.2014.09.008","article-title":"Social activity and structural centrality in online social networks","volume":"32","author":"Klein","year":"2015","journal-title":"Telemat. Inform."},{"key":"ref_50","first-page":"66","article-title":"Towards the Social Gamification of e-Learning: A Practical Experiment","volume":"33","year":"2017","journal-title":"Int. J. Eng. Educ."},{"doi-asserted-by":"crossref","unstructured":"Behera, R.K., Rath, S.K., Misra, S., Dama\u0161evi\u010dius, R., and Maskeli\u016bnas, R. (2017). Large Scale Community Detection Using a Small World Model. Appl. Sci., 7.","key":"ref_51","DOI":"10.3390\/app7111173"}],"container-title":["Applied Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3417\/10\/20\/7065\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:19:30Z","timestamp":1760177970000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3417\/10\/20\/7065"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,12]]},"references-count":51,"journal-issue":{"issue":"20","published-online":{"date-parts":[[2020,10]]}},"alternative-id":["app10207065"],"URL":"https:\/\/doi.org\/10.3390\/app10207065","relation":{},"ISSN":["2076-3417"],"issn-type":[{"type":"electronic","value":"2076-3417"}],"subject":[],"published":{"date-parts":[[2020,10,12]]}}}