{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,8]],"date-time":"2025-10-08T22:13:24Z","timestamp":1759961604460,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":48,"publisher":"ACM","license":[{"start":{"date-parts":[[2017,4,12]],"date-time":"2017-04-12T00:00:00Z","timestamp":1491955200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,4,12]]},"DOI":"10.1145\/3051457.3051461","type":"proceedings-article","created":{"date-parts":[[2017,4,14]],"date-time":"2017-04-14T12:18:54Z","timestamp":1492172334000},"page":"131-140","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":12,"title":["Learning about Learning at Scale"],"prefix":"10.1145","author":[{"given":"Frans","family":"van der Sluis","sequence":"first","affiliation":[{"name":"Leiden University, The Hague, Netherlands"}]},{"given":"Tim","family":"van der Zee","sequence":"additional","affiliation":[{"name":"Leiden University, Leiden, Netherlands"}]},{"given":"Jasper","family":"Ginn","sequence":"additional","affiliation":[{"name":"Leiden University, The Hague, Netherlands"}]}],"member":"320","published-online":{"date-parts":[[2017,4,12]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.newideapsych.2010.08.001"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2876035"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-2909.112.1.155"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"crossref","unstructured":"\"Open Science Collaboration\". 2015. Estimating the reproducibility of psychological science. Science 349 6251 (2015).  \"Open Science Collaboration\". 2015. Estimating the reproducibility of psychological science. Science 349 6251 (2015).","DOI":"10.1126\/science.aac4716"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01099821"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.iheduc.2006.06.007"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.actpsy.2014.02.001"},{"key":"e_1_3_2_1_8_1","unstructured":"Norman K Denzin. 1978. The research act: A theoretical orientation to sociological methods. (1978).  Norman K Denzin. 1978. The research act: A theoretical orientation to sociological methods. (1978)."},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X022004016"},{"key":"e_1_3_2_1_10_1","unstructured":"Andrew Gelman and Eric Loken. 2013. The garden of forking paths: Why multiple comparisons can be a problem even when there is no \"fishing expedition\" or \"p-hacking\" and the research hypothesis was posited ahead of time. Department of Statistics Columbia University (2013).  Andrew Gelman and Eric Loken. 2013. The garden of forking paths: Why multiple comparisons can be a problem even when there is no \"fishing expedition\" or \"p-hacking\" and the research hypothesis was posited ahead of time. Department of Statistics Columbia University (2013)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1992.10475256"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1053\/j.seminhematol.2008.04.003"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.32614\/RJ-2009-010"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556325.2566239"},{"key":"e_1_3_2_1_15_1","first-page":"1","article-title":"Misinterpretations of significance: A problem students share with their teachers","volume":"7","author":"Haller Heiko","year":"2002","journal-title":"Methods of Psychological Research"},{"key":"e_1_3_2_1_16_1","unstructured":"Sture Holm. 1979. A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics (1979) 65--70.  Sture Holm. 1979. A simple sequentially rejective multiple test procedure. Scandinavian journal of statistics (1979) 65--70."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pmed.0020124"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556325.2566237"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/2724660.2724669"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.3200\/PSFL.48.3.36-43"},{"key":"e_1_3_2_1_21_1","unstructured":"Margaret M. Bradley Lang Peter J. and Bruce N. Cuthbert. 2008. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report. University of Florida Gainesville FL.  Margaret M. Bradley Lang Peter J. and Bruce N. Cuthbert. 2008. International affective picture system (IAPS): Affective ratings of pictures and instruction manual. Technical Report. University of Florida Gainesville FL."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24258-3_15"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.2307\/2333251"},{"key":"e_1_3_2_1_24_1","unstructured":"Mark W Lipsey Kelly Puzio Cathy Yun Michael A Hebert Kasia Steinka-Fry Mikel W Cole Megan Roberts Karen S Anthony and Matthew D Busick. 2012. Translating the Statistical Representation of the Effects of Education Interventions into More Readily Interpretable Forms. National Center for Special Education Research (2012).  Mark W Lipsey Kelly Puzio Cathy Yun Michael A Hebert Kasia Steinka-Fry Mikel W Cole Megan Roberts Karen S Anthony and Matthew D Busick. 2012. Translating the Statistical Representation of the Effects of Education Interventions into More Readily Interpretable Forms. National Center for Special Education Research (2012)."},{"key":"e_1_3_2_1_25_1","unstructured":"J. Love R. Selker M. Marsman T. Jamil D. Dropmann A. J. Verhagen and E. J. Wagenmakers. 2015. JASP (Version 0.7)[Computer software]. (2015).  J. Love R. Selker M. Marsman T. Jamil D. Dropmann A. J. Verhagen and E. J. Wagenmakers. 2015. JASP (Version 0.7)[Computer software]. (2015)."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X017002013"},{"key":"e_1_3_2_1_27_1","first-page":"32","article-title":"Diversity and methodology in a changing world","volume":"30","author":"Maxwell Joseph A.","year":"1995","journal-title":"Pedagogia"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Richard D. Morey and Jeffrey N. Rouder. 2011. Bayes factor approaches for testing interval null hypotheses. Psychological methods 16 4 (2011) 406.  Richard D. Morey and Jeffrey N. Rouder. 2011. Bayes factor approaches for testing interval null hypotheses. Psychological methods 16 4 (2011) 406.","DOI":"10.1037\/a0024377"},{"key":"e_1_3_2_1_29_1","unstructured":"Richard D. Morey and Jeffrey N. Rouder. 2014. BayesFactor: Computation of Bayes Factors for Common Designs.  Richard D. Morey and Jeffrey N. Rouder. 2014. BayesFactor: Computation of Bayes Factors for Common Designs."},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1214\/16-EJS1146"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10648-006-9014-3"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s13347-015-0202-2"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1261627"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/2876034.2876045"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.2307\/2087508"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.3758\/PBR.16.2.225"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0015108"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jrp.2013.05.009"},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1080\/17439884.2014.921628"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/0956797611417632"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4102"},{"volume-title":"Proceedings of the Third (2016)","author":"van der Sluis Frans","key":"e_1_3_2_1_42_1"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1002\/asi.23095"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/2332858416657002"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1177\/0963721416643289"},{"key":"e_1_3_2_1_46_1","unstructured":"Eugene J. Webb Donald Thomas Campbell Richard D. Schwartz and Lee Sechrest. 1966. Unobtrusive measures: nonreactive research in the social sciences. Rand McNally sociology series Vol. 111. Rand McNally.  Eugene J. Webb Donald Thomas Campbell Richard D. Schwartz and Lee Sechrest. 1966. Unobtrusive measures: nonreactive research in the social sciences. Rand McNally sociology series Vol. 111. Rand McNally."},{"key":"e_1_3_2_1_47_1","doi-asserted-by":"crossref","unstructured":"Roel J. Wieringa. 2014. Design Science Methodology for Information Systems and Software Engineering. Springer Berlin Heidelberg Berlin Heidelberg Chapter Analogic Inference Design 201--211.  Roel J. Wieringa. 2014. Design Science Methodology for Information Systems and Software Engineering. Springer Berlin Heidelberg Berlin Heidelberg Chapter Analogic Inference Design 201--211.","DOI":"10.1007\/978-3-662-43839-8_15"},{"volume":"10","volume-title":"Proceedings of the 2013 NIPS Data-Driven Education Workshop","author":"Yang Diyi","key":"e_1_3_2_1_48_1"}],"event":{"name":"L@S 2017: Fourth (2017) ACM Conference on Learning @ Scale","sponsor":["ACM Association for Computing Machinery"],"location":"Cambridge Massachusetts USA","acronym":"L@S 2017"},"container-title":["Proceedings of the Fourth (2017) ACM Conference on Learning @ Scale"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3051457.3051461","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3051457.3051461","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:54:40Z","timestamp":1750222480000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3051457.3051461"}},"subtitle":["Methodological Challenges and Recommendations"],"short-title":[],"issued":{"date-parts":[[2017,4,12]]},"references-count":48,"alternative-id":["10.1145\/3051457.3051461","10.1145\/3051457"],"URL":"https:\/\/doi.org\/10.1145\/3051457.3051461","relation":{},"subject":[],"published":{"date-parts":[[2017,4,12]]},"assertion":[{"value":"2017-04-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}