{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,21]],"date-time":"2026-02-21T00:55:55Z","timestamp":1771635355994,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":41,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,3,7]],"date-time":"2018-03-07T00:00:00Z","timestamp":1520380800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,3,7]]},"DOI":"10.1145\/3170358.3170369","type":"proceedings-article","created":{"date-parts":[[2018,3,6]],"date-time":"2018-03-06T13:17:07Z","timestamp":1520342227000},"page":"71-78","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":26,"title":["Studying MOOC completion at scale using the MOOC replication framework"],"prefix":"10.1145","author":[{"given":"Juan Miguel L.","family":"Andres","sequence":"first","affiliation":[{"name":"University of Pennsylvania"}]},{"given":"Ryan S.","family":"Baker","sequence":"additional","affiliation":[{"name":"University of Pennsylvania"}]},{"given":"Dragan","family":"Ga\u0161evi\u0107","sequence":"additional","affiliation":[{"name":"University of Edinburgh, Edinburgh, UK"}]},{"given":"George","family":"Siemens","sequence":"additional","affiliation":[{"name":"University of Texas Arlington"}]},{"given":"Scott A.","family":"Crossley","sequence":"additional","affiliation":[{"name":"Georgia State University"}]},{"given":"Sre\u0107ko","family":"Joksimovi\u0107","sequence":"additional","affiliation":[{"name":"University of Edinburgh, Edinburgh, UK"}]}],"member":"320","published-online":{"date-parts":[[2018,3,7]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15(1)","author":"Jordan K.","year":"2014","unstructured":"Jordan , K. ( 2014 ). Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15(1) . Jordan, K. (2014). Initial trends in enrolment and completion of massive open online courses. The International Review of Research in Open and Distributed Learning, 15(1)."},{"key":"e_1_3_2_1_2_1","volume-title":"What makes a great MOOC? An interdisciplinary analysis of student retention in online courses","author":"Adamopoulos P.","year":"2013","unstructured":"Adamopoulos , P. ( 2013 ). What makes a great MOOC? An interdisciplinary analysis of student retention in online courses . Adamopoulos, P. (2013). What makes a great MOOC? An interdisciplinary analysis of student retention in online courses."},{"key":"e_1_3_2_1_3_1","volume-title":"Who's Benefiting from MOOCs, and Why. Harvard Business Review","author":"Zhenghao C.","year":"2015","unstructured":"Zhenghao , C. , Alcorn , B. , Christensen , G. , Eriksson , N. , Koller , D. , & Emanuel , E. ( 2015 ). Who's Benefiting from MOOCs, and Why. Harvard Business Review Zhenghao, C., Alcorn, B., Christensen, G., Eriksson, N., Koller, D., & Emanuel, E. (2015). Who's Benefiting from MOOCs, and Why. Harvard Business Review"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1145\/2460296.2460332"},{"key":"e_1_3_2_1_5_1","volume-title":"Proceedings of the 2013 NIPS Data-driven education Workshop (Vol. 11","author":"Yang D.","year":"2013","unstructured":"Yang , D. , Sinha , T. , Adamson , D. , & Rose , C. P. ( 2013 ). Turn on, tune in, drop out: Anticipating student dropouts in massive open online courses . In Proceedings of the 2013 NIPS Data-driven education Workshop (Vol. 11 , p. 14) Yang, D., Sinha, T., Adamson, D., & Rose, C. P. (2013). Turn on, tune in, drop out: Anticipating student dropouts in massive open online courses. In Proceedings of the 2013 NIPS Data-driven education Workshop (Vol. 11, p. 14)"},{"key":"e_1_3_2_1_6_1","volume-title":"Ljungskile","author":"Andersson U.","year":"2016","unstructured":"Andersson , U. , Arvemo , T. , & Gellerstedt , M. ( 2016 ). How well can completion of online courses be predicted using binary logistic regression?. In IRIS39-The 39th Information Systems Research Conference in Scandinavia , Ljungskile , Sweden , 7-10 August 2016. Andersson, U., Arvemo, T., & Gellerstedt, M. (2016). How well can completion of online courses be predicted using binary logistic regression?. In IRIS39-The 39th Information Systems Research Conference in Scandinavia, Ljungskile, Sweden, 7-10 August 2016."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724677"},{"key":"e_1_3_2_1_8_1","first-page":"406","volume-title":"Proceedings of the 9th International Conference on Educational Data Mining (No. EPFL-CONF-223613","author":"\u0141ukasz K.","year":"2016","unstructured":"\u0141ukasz , K. , Sharma , K. , Shirvani Boroujeni , M. , & Dillenbourg , P. ( 2016 ). On generalizability of MOOC models . In Proceedings of the 9th International Conference on Educational Data Mining (No. EPFL-CONF-223613 , pp. 406 -- 411 ). \u0141ukasz, K., Sharma, K., Shirvani Boroujeni, M., & Dillenbourg, P. (2016). On generalizability of MOOC models. In Proceedings of the 9th International Conference on Educational Data Mining (No. EPFL-CONF-223613, pp. 406--411)."},{"key":"e_1_3_2_1_9_1","unstructured":"Andres J.M.L. Baker R.S. Siemens G. Ga\u0161evi\u0107 D. & Spann C.A. (in press). Replicating 21 Findings on Student Success in Online Learning. Technology Instruction Cognition & Learning.  Andres J.M.L. Baker R.S. Siemens G. Ga\u0161evi\u0107 D. & Spann C.A. (in press). Replicating 21 Findings on Student Success in Online Learning. Technology Instruction Cognition & Learning."},{"key":"e_1_3_2_1_10_1","volume-title":"Facts are more important than novelty replication in the education sciences. Educational Researcher, 0013189X14545513","author":"Makel M. C.","year":"2014","unstructured":"Makel , M. C. , & Plucker , J. A. ( 2014 ). Facts are more important than novelty replication in the education sciences. Educational Researcher, 0013189X14545513 . Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty replication in the education sciences. Educational Researcher, 0013189X14545513."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556325.2566237"},{"key":"e_1_3_2_1_12_1","volume-title":"Beyond prediction: First steps toward automatic intervention in MOOC student stopout","author":"Whitehill J.","year":"2015","unstructured":"Whitehill , J. , Williams , J. J. , Lopez , G. , Coleman , C. A. , & Reich , J. ( 2015 ). Beyond prediction: First steps toward automatic intervention in MOOC student stopout . Whitehill, J., Williams, J. J., Lopez, G., Coleman, C. A., & Reich, J. (2015). Beyond prediction: First steps toward automatic intervention in MOOC student stopout."},{"key":"e_1_3_2_1_13_1","volume-title":"edX Research Guide. Retrieved from the edX website: http:\/\/edx.readthedocs.io\/projects\/devdata\/en\/latest\/","year":"2017","unstructured":"edX. ( 2017 ). edX Research Guide. Retrieved from the edX website: http:\/\/edx.readthedocs.io\/projects\/devdata\/en\/latest\/ edX. (2017). edX Research Guide. Retrieved from the edX website: http:\/\/edx.readthedocs.io\/projects\/devdata\/en\/latest\/"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724683"},{"key":"e_1_3_2_1_15_1","volume-title":"Methods of meta-analysis: Correcting error and bias in research findings","author":"Schmidt F. L.","year":"2014","unstructured":"Schmidt , F. L. , & Hunter , J. E. ( 2014 ). Methods of meta-analysis: Correcting error and bias in research findings . Sage publications. Schmidt, F. L., & Hunter, J. E. (2014). Methods of meta-analysis: Correcting error and bias in research findings. Sage publications."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1201\/b10274-6"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327051hci1204_5"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/0004-3702(87)90050-6"},{"key":"e_1_3_2_1_19_1","volume-title":"Jess, the expert system shell for the java platform.USA: Distributed Computing Systems","author":"Friedman-Hill E.","year":"2002","unstructured":"Friedman-Hill , E. ( 2002 ). Jess, the expert system shell for the java platform.USA: Distributed Computing Systems . Friedman-Hill, E. (2002). Jess, the expert system shell for the java platform.USA: Distributed Computing Systems."},{"key":"e_1_3_2_1_20_1","volume-title":"Your click decides your fate: Inferring information processing and attrition behavior from MOOC video clickstream interactions. arXiv preprint arXiv:1407.7131","author":"Sinha T.","year":"2014","unstructured":"Sinha , T. , Jermann , P. , Li , N. , & Dillenbourg , P. ( 2014 ). Your click decides your fate: Inferring information processing and attrition behavior from MOOC video clickstream interactions. arXiv preprint arXiv:1407.7131 . Sinha, T., Jermann, P., Li, N., & Dillenbourg, P. (2014). Your click decides your fate: Inferring information processing and attrition behavior from MOOC video clickstream interactions. arXiv preprint arXiv:1407.7131."},{"issue":"1","key":"e_1_3_2_1_21_1","first-page":"17","article-title":"Content or Platform: Why do students complete MOOCs","volume":"11","author":"Wang Y.","year":"2015","unstructured":"Wang , Y. Baker , R. ( 2015 ) Content or Platform: Why do students complete MOOCs ? MERLOT Journal of Online Learning and Teaching , 11 ( 1 ), 17 -- 30 . Wang, Y. Baker, R. (2015) Content or Platform: Why do students complete MOOCs? MERLOT Journal of Online Learning and Teaching, 11 (1), 17--30.","journal-title":"MERLOT Journal of Online Learning and Teaching"},{"key":"e_1_3_2_1_22_1","first-page":"0","volume-title":"Bringing student backgrounds online: MOOC user demographics, site usage, and online learning. engineer, 2","author":"DeBoer J.","year":"2013","unstructured":"DeBoer , J. , Ho , A. , Stump , G.S. , Pritchard , D.E. , Seaton , D. and Breslow , L . ( 2013 ). Bringing student backgrounds online: MOOC user demographics, site usage, and online learning. engineer, 2 , pp. 0 -- 81 . DeBoer, J., Ho, A., Stump, G.S., Pritchard, D.E., Seaton, D. and Breslow, L. (2013). Bringing student backgrounds online: MOOC user demographics, site usage, and online learning. engineer, 2, pp.0--81."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/170035.170072"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/253262.253325"},{"key":"e_1_3_2_1_25_1","volume-title":"Adjustment during Army Life","author":"Stouffer S.A.","year":"1949","unstructured":"Stouffer , S.A. , Suchman , E.A. , DeVinney , L.C. , Star , S.A. & Williams , R.M. Jr. ( 1949 ). The American Soldier , Vol. 1 : Adjustment during Army Life . Princeton University Press , Princeton . Stouffer, S.A., Suchman, E.A., DeVinney, L.C., Star, S.A. & Williams, R.M. Jr. (1949). The American Soldier, Vol. 1: Adjustment during Army Life. Princeton University Press, Princeton."},{"key":"e_1_3_2_1_26_1","volume-title":"Language to Completion: Success in an Educational Data Mining Massive Open Online Class","author":"Crossley S.","year":"2015","unstructured":"Crossley , S. , McNamara , D. S. , Baker , R. , Wang , Y. , Paquette , L. , Barnes , T. , & Bergner , Y. ( 2015 ). Language to Completion: Success in an Educational Data Mining Massive Open Online Class . International Educational Data Mining Society . Crossley, S., McNamara, D. S., Baker, R., Wang, Y., Paquette, L., Barnes, T., & Bergner, Y. (2015). Language to Completion: Success in an Educational Data Mining Massive Open Online Class. International Educational Data Mining Society."},{"key":"e_1_3_2_1_27_1","first-page":"1","volume-title":"NIPS Workshop on Data Driven Education (Vol. 2","author":"Ramesh A.","year":"2013","unstructured":"Ramesh , A. , Goldwasser , D. , Huang , B. , Daum\u00e9 III, H. & Getoor , L. ( 2013 , December). Modeling learner engagement in MOOCs using probabilistic soft logic . In NIPS Workshop on Data Driven Education (Vol. 2 , pp. 1 -- 7 ). Ramesh, A., Goldwasser, D., Huang, B., Daum\u00e9 III, H. & Getoor, L. (2013, December). Modeling learner engagement in MOOCs using probabilistic soft logic. In NIPS Workshop on Data Driven Education (Vol. 2, pp. 1--7)."},{"key":"e_1_3_2_1_28_1","volume-title":"Educational data mining","author":"Wen M.","year":"2014","unstructured":"Wen , M. , Yang , D. , & Rose , C. (2014, July ). Sentiment Analysis in MOOC Discussion Forums: What does it tell us? . In Educational data mining 2014 . Wen, M., Yang, D., & Rose, C. (2014, July). Sentiment Analysis in MOOC Discussion Forums: What does it tell us?. In Educational data mining 2014."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556325.2566240"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1002\/tesq.194"},{"key":"e_1_3_2_1_31_1","volume-title":"The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods","author":"Crossley S. A.","year":"2016","unstructured":"Crossley , S. A. , Kyle , K. , and McNamara , D. S. ( 2016 ). The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods . Crossley, S. A., Kyle, K., and McNamara, D. S. (2016). The tool for the automatic analysis of text cohesion (TAACO): Automatic assessment of local, global, and text cohesion. Behavior Research Methods."},{"key":"e_1_3_2_1_32_1","volume-title":"The teacher's word book of 30,000 words","author":"Thorndike E. L.","year":"1944","unstructured":"Thorndike , E. L. , & Lorge , I. ( 1944 ). The teacher's word book of 30,000 words . New York, NY : Teachers College, Columbia University . Thorndike, E. L., & Lorge, I. (1944). The teacher's word book of 30,000 words. New York, NY: Teachers College, Columbia University."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03200836"},{"key":"e_1_3_2_1_34_1","volume-title":"A corpus of English conversation. Lund","author":"Svartvik J.","year":"1980","unstructured":"Svartvik , J. , & Quirk , R. ( 1980 ). A corpus of English conversation. Lund , Sweden : Gleerup . Svartvik, J., & Quirk, R. (1980). A corpus of English conversation. Lund, Sweden: Gleerup."},{"key":"e_1_3_2_1_35_1","volume-title":"Computational analysis of present-day American English","author":"Kucera H.","year":"1967","unstructured":"Kucera , H. , & Francis , W. N. ( 1967 ). Computational analysis of present-day American English . Providence, RI : Brown University Press . Kucera, H., & Francis, W. N. (1967). Computational analysis of present-day American English. Providence, RI: Brown University Press."},{"key":"e_1_3_2_1_36_1","volume-title":"British National Corpus, version 3","author":"BNC Consortium","year":"2007","unstructured":"BNC Consortium . ( 2007 ), British National Corpus, version 3 (BNC XML ed.). Retrieved from www.natcorp.ox.ac.uk BNC Consortium. (2007), British National Corpus, version 3 (BNC XML ed.). Retrieved from www.natcorp.ox.ac.uk"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"crossref","unstructured":"Brysbaert M. & New B. (2009). Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Meth- ods 41 977--990.  Brysbaert M. & New B. (2009). Moving beyond Kucera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behavior Research Meth- ods 41 977--990.","DOI":"10.3758\/BRM.41.4.977"},{"key":"e_1_3_2_1_38_1","volume-title":"International Journal of Learning, Teaching and Educational Research, 12(1).","author":"Sharif A.","year":"2015","unstructured":"Sharif , A. , & Magrill , B. ( 2015 ). Discussion forums in MOOCs . International Journal of Learning, Teaching and Educational Research, 12(1). Sharif, A., & Magrill, B. (2015). Discussion forums in MOOCs. International Journal of Learning, Teaching and Educational Research, 12(1)."},{"issue":"2","key":"e_1_3_2_1_39_1","first-page":"149","article-title":"Patterns of engagement in connectivist MOOCs","volume":"9","author":"Milligan C.","year":"2013","unstructured":"Milligan , C. , Littlejohn , A. , & Margaryan , A. ( 2013 ). Patterns of engagement in connectivist MOOCs . Journal of Online Learning and Teaching , 9 ( 2 ), 149 . Milligan, C., Littlejohn, A., & Margaryan, A. (2013). Patterns of engagement in connectivist MOOCs. Journal of Online Learning and Teaching, 9(2), 149.","journal-title":"Journal of Online Learning and Teaching"},{"key":"e_1_3_2_1_40_1","volume-title":"Negativity in Massive Online Open Courses: Impacts on Learning and Teaching. InSight: A Journal of Scholarly Teaching, 10","author":"Comer D.","year":"2015","unstructured":"Comer , D. , Baker , R. , Wang , Y. ( 2015 ) Negativity in Massive Online Open Courses: Impacts on Learning and Teaching. InSight: A Journal of Scholarly Teaching, 10 . Comer, D., Baker, R., Wang, Y. (2015) Negativity in Massive Online Open Courses: Impacts on Learning and Teaching. InSight: A Journal of Scholarly Teaching, 10."},{"key":"e_1_3_2_1_41_1","volume-title":"Investigating How Student's Cognitive Behavior in MOOC Discussion Forums Affect Learning Gains","author":"Wang X.","year":"2015","unstructured":"Wang , X. , Yang , D. , Wen , M. , Koedinger , K. , & Ros\u00e9 , C. P. ( 2015 ). Investigating How Student's Cognitive Behavior in MOOC Discussion Forums Affect Learning Gains . International Educational Data Mining Society . Wang, X., Yang, D., Wen, M., Koedinger, K., & Ros\u00e9, C. P. (2015). Investigating How Student's Cognitive Behavior in MOOC Discussion Forums Affect Learning Gains. International Educational Data Mining Society."}],"event":{"name":"LAK '18: International Conference on Learning Analytics and Knowledge","location":"Sydney New South Wales Australia","acronym":"LAK '18"},"container-title":["Proceedings of the 8th International Conference on Learning Analytics and Knowledge"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3170358.3170369","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3170358.3170369","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:43:55Z","timestamp":1750207435000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3170358.3170369"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,7]]},"references-count":41,"alternative-id":["10.1145\/3170358.3170369","10.1145\/3170358"],"URL":"https:\/\/doi.org\/10.1145\/3170358.3170369","relation":{},"subject":[],"published":{"date-parts":[[2018,3,7]]},"assertion":[{"value":"2018-03-07","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}