{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,31]],"date-time":"2026-03-31T04:36:52Z","timestamp":1774931812989,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,8]],"date-time":"2021-06-08T00:00:00Z","timestamp":1623110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Office of Naval Research (ONR)","award":["N00014-18-1-2755"],"award-info":[{"award-number":["N00014-18-1-2755"]}]},{"name":"Natural Sciences and Engineering Research Council of Canada (NSERC)","award":["RGPIN-2019-06968"],"award-info":[{"award-number":["RGPIN-2019-06968"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,8]]},"DOI":"10.1145\/3430895.3460128","type":"proceedings-article","created":{"date-parts":[[2021,6,7]],"date-time":"2021-06-07T01:27:20Z","timestamp":1623029240000},"page":"15-26","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["The MOOClet Framework: Unifying Experimentation, Dynamic Improvement, and Personalization in Online Courses"],"prefix":"10.1145","author":[{"given":"Mohi","family":"Reza","sequence":"first","affiliation":[{"name":"University of Toronto, Toronto, ON, Canada"}]},{"given":"Juho","family":"Kim","sequence":"additional","affiliation":[{"name":"KAIST, Daejeon, South Korea"}]},{"given":"Ananya","family":"Bhattacharjee","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, ON, Canada"}]},{"given":"Anna N.","family":"Rafferty","sequence":"additional","affiliation":[{"name":"Carleton College, Northfield, MN, USA"}]},{"given":"Joseph Jay","family":"Williams","sequence":"additional","affiliation":[{"name":"University of Toronto, Toronto, ON, Canada"}]}],"member":"320","published-online":{"date-parts":[[2021,6,8]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"Proceedings of the 23rd ACM conference on the World Wide Web. ACM.","author":"Bakshy E.","unstructured":"E. Bakshy , D. Eckles , and M. S. Bernstein . 2014. Designing and Deploying Online Field Experiments . In Proceedings of the 23rd ACM conference on the World Wide Web. ACM. E. Bakshy, D. Eckles, and M. S. Bernstein. 2014. Designing and Deploying Online Field Experiments. In Proceedings of the 23rd ACM conference on the World Wide Web. ACM."},{"key":"e_1_3_2_2_2_1","first-page":"13","article-title":"Studying learning in the worldwide classroom research into edX's first MOOC","volume":"8","author":"Breslow Lori","year":"2013","unstructured":"Lori Breslow , David E Pritchard , Jennifer DeBoer , Glenda S Stump , Andrew D Ho , and Daniel T Seaton . 2013 . Studying learning in the worldwide classroom research into edX's first MOOC . Research & Practice in Assessment 8 (2013), 13 -- 25 . Lori Breslow, David E Pritchard, Jennifer DeBoer, Glenda S Stump, Andrew D Ho, and Daniel T Seaton. 2013. Studying learning in the worldwide classroom research into edX's first MOOC. Research & Practice in Assessment 8 (2013), 13--25.","journal-title":"Research & Practice in Assessment"},{"key":"e_1_3_2_2_3_1","volume-title":"An empirical evaluation of thompson sampling. Advances in neural information processing systems 24","author":"Chapelle Olivier","year":"2011","unstructured":"Olivier Chapelle and Lihong Li. 2011. An empirical evaluation of thompson sampling. Advances in neural information processing systems 24 ( 2011 ), 2249--2257. Olivier Chapelle and Lihong Li. 2011. An empirical evaluation of thompson sampling. Advances in neural information processing systems 24 (2011), 2249--2257."},{"key":"e_1_3_2_2_4_1","volume-title":"Multi-armed bandits for intelligent tutoring systems. arXiv preprint arXiv:1310.3174","author":"Clement Benjamin","year":"2013","unstructured":"Benjamin Clement , Didier Roy , Pierre-Yves Oudeyer , and Manuel Lopes . 2013. Multi-armed bandits for intelligent tutoring systems. arXiv preprint arXiv:1310.3174 ( 2013 ). Benjamin Clement, Didier Roy, Pierre-Yves Oudeyer, and Manuel Lopes. 2013. Multi-armed bandits for intelligent tutoring systems. arXiv preprint arXiv:1310.3174 (2013)."},{"key":"e_1_3_2_2_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3160489.3160492"},{"key":"e_1_3_2_2_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69132-7_44"},{"key":"e_1_3_2_2_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/SEAA.2018.00021"},{"key":"e_1_3_2_2_8_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-014-0024-x"},{"key":"e_1_3_2_2_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-012-9253-6"},{"key":"e_1_3_2_2_11_1","volume-title":"E-Learning personalization based on hybrid recommendation strategy and learning style identification. Computers & education 56, 3","author":"Mili\u0107evi\u0107 Aleksandra Klavs","year":"2011","unstructured":"Aleksandra Klavs nja- Mili\u0107evi\u0107 , Boban Vesin , Mirjana Ivanovi\u0107 , and Zoran Budimac . 2011. E-Learning personalization based on hybrid recommendation strategy and learning style identification. Computers & education 56, 3 ( 2011 ), 885--899. Aleksandra Klavs nja-Mili\u0107evi\u0107, Boban Vesin, Mirjana Ivanovi\u0107, and Zoran Budimac. 2011. E-Learning personalization based on hybrid recommendation strategy and learning style identification. Computers & education 56, 3 (2011), 885--899."},{"key":"e_1_3_2_2_12_1","volume-title":"Controlled experiments on the web: survey and practical guide. Data mining and knowledge discovery 18, 1","author":"Kohavi Ron","year":"2009","unstructured":"Ron Kohavi , Roger Longbotham , Dan Sommerfield , and Randal M Henne . 2009. Controlled experiments on the web: survey and practical guide. Data mining and knowledge discovery 18, 1 ( 2009 ), 140--181. Ron Kohavi, Roger Longbotham, Dan Sommerfield, and Randal M Henne. 2009. Controlled experiments on the web: survey and practical guide. Data mining and knowledge discovery 18, 1 (2009), 140--181."},{"key":"e_1_3_2_2_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1772690.1772758"},{"key":"e_1_3_2_2_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858036.2858425"},{"key":"e_1_3_2_2_15_1","unstructured":"MasteryPaths. Last accessed: 22-02--2021. MasteryPaths. https:\/\/community.canvaslms.com\/t5\/Instructor-Guide\/How-do-I-use-MasteryPaths-in-course-modules\/ta-p\/906. (Last accessed: 22-02--2021). https:\/\/community.canvaslms.com\/t5\/Instructor-Guide\/How-do-I-use-MasteryPaths-in-course-modules\/ta-p\/906  MasteryPaths. Last accessed: 22-02--2021. MasteryPaths. https:\/\/community.canvaslms.com\/t5\/Instructor-Guide\/How-do-I-use-MasteryPaths-in-course-modules\/ta-p\/906. (Last accessed: 22-02--2021). https:\/\/community.canvaslms.com\/t5\/Instructor-Guide\/How-do-I-use-MasteryPaths-in-course-modules\/ta-p\/906"},{"key":"e_1_3_2_2_16_1","volume-title":"Adaptive designs in clinical trials: why use them, and how to run and report them. BMC medicine 16, 1","author":"Pallmann Philip","year":"2018","unstructured":"Philip Pallmann , Alun W Bedding , Babak Choodari-Oskooei , Munyaradzi Dimairo , Laura Flight , Lisa V Hampson , Jane Holmes , Adrian P Mander , Matthew R Sydes , Sof'ia S Villar , and others. 2018. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC medicine 16, 1 ( 2018 ), 1--15. Philip Pallmann, Alun W Bedding, Babak Choodari-Oskooei, Munyaradzi Dimairo, Laura Flight, Lisa V Hampson, Jane Holmes, Adrian P Mander, Matthew R Sydes, Sof'ia S Villar, and others. 2018. Adaptive designs in clinical trials: why use them, and how to run and report them. BMC medicine 16, 1 (2018), 1--15."},{"key":"e_1_3_2_2_17_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40561-015-0013-z"},{"key":"e_1_3_2_2_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/3051457.3051471"},{"key":"e_1_3_2_2_19_1","volume-title":"Pier Giuseppe Rossi, and D\u00e9nes Zarka","author":"Paviotti Gigliola","year":"2012","unstructured":"Gigliola Paviotti , Pier Giuseppe Rossi, and D\u00e9nes Zarka . 2012 . Intelligent tutoring systems: an overview. Pensa Multimedia ( 2012). Gigliola Paviotti, Pier Giuseppe Rossi, and D\u00e9nes Zarka. 2012. Intelligent tutoring systems: an overview. Pensa Multimedia (2012)."},{"key":"e_1_3_2_2_20_1","unstructured":"Penzance. 2021. A\/B Tool GitHub Repository. https:\/\/github.com\/penzance\/ab-testing-tool\/wiki\/Getting-Started. (2021). Last accessed: 22-02--2021.  Penzance. 2021. A\/B Tool GitHub Repository. https:\/\/github.com\/penzance\/ab-testing-tool\/wiki\/Getting-Started. (2021). Last accessed: 22-02--2021."},{"key":"e_1_3_2_2_21_1","volume-title":"Statistical consequences of using multi-armed bandits to conduct adaptive educational experiments. JEDM| Journal of Educational Data Mining 11, 1","author":"Rafferty Anna","year":"2019","unstructured":"Anna Rafferty , Huiji Ying , and Joseph Williams . 2019. Statistical consequences of using multi-armed bandits to conduct adaptive educational experiments. JEDM| Journal of Educational Data Mining 11, 1 ( 2019 ), 47--79. Anna Rafferty, Huiji Ying, and Joseph Williams. 2019. Statistical consequences of using multi-armed bandits to conduct adaptive educational experiments. JEDM| Journal of Educational Data Mining 11, 1 (2019), 47--79."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"publisher","DOI":"10.1002\/asmb.2104"},{"key":"e_1_3_2_2_23_1","first-page":"839","article-title":"Systems and methods for website optimization. (Sept. 16 2014)","volume":"8","author":"Siroker Dan","year":"2014","unstructured":"Dan Siroker , Pete Koomen , Elliot Kim , and Eric Siroker . 2014 . Systems and methods for website optimization. (Sept. 16 2014) . US Patent 8 , 839 ,093. Dan Siroker, Pete Koomen, Elliot Kim, and Eric Siroker. 2014. Systems and methods for website optimization. (Sept. 16 2014). US Patent 8,839,093.","journal-title":"US Patent"},{"key":"e_1_3_2_2_24_1","volume-title":"2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 5545--5549","author":"Tekin Cem","unstructured":"Cem Tekin , Jonas Braun , and Mihaela van der Schaar. 2015. etutor: Online learning for personalized education . In 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 5545--5549 . Cem Tekin, Jonas Braun, and Mihaela van der Schaar. 2015. etutor: Online learning for personalized education. In 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE, 5545--5549."},{"key":"e_1_3_2_2_25_1","volume-title":"Mobile big data","author":"Vassakis Konstantinos","unstructured":"Konstantinos Vassakis , Emmanuel Petrakis , and Ioannis Kopanakis . 2018. Big data analytics: applications, prospects and challenges . In Mobile big data . Springer , 3--20. Konstantinos Vassakis, Emmanuel Petrakis, and Ioannis Kopanakis. 2018. Big data analytics: applications, prospects and challenges. In Mobile big data. Springer, 3--20."},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"publisher","DOI":"10.1007\/11564096_42"},{"key":"e_1_3_2_2_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2876042"},{"key":"e_1_3_2_2_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3173574.3173781"},{"key":"e_1_3_2_2_29_1","unstructured":"xAPI. 2021. xAPI. (2021). https:\/\/xapi.com\/overview\/ Last accessed: 22-02--2021.  xAPI. 2021. xAPI. (2021). https:\/\/xapi.com\/overview\/ Last accessed: 22-02--2021."}],"event":{"name":"L@S '21: Eighth (2021) ACM Conference on Learning @ Scale","location":"Virtual Event Germany","acronym":"L@S '21"},"container-title":["Proceedings of the Eighth ACM Conference on Learning @ Scale"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430895.3460128","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3430895.3460128","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:41Z","timestamp":1750195481000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3430895.3460128"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,8]]},"references-count":28,"alternative-id":["10.1145\/3430895.3460128","10.1145\/3430895"],"URL":"https:\/\/doi.org\/10.1145\/3430895.3460128","relation":{},"subject":[],"published":{"date-parts":[[2021,6,8]]},"assertion":[{"value":"2021-06-08","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}