{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,18]],"date-time":"2026-05-18T16:39:52Z","timestamp":1779122392933,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2015,3,14]],"date-time":"2015-03-14T00:00:00Z","timestamp":1426291200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["SBE-0836012"],"award-info":[{"award-number":["SBE-0836012"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2015,3,14]]},"DOI":"10.1145\/2724660.2724681","type":"proceedings-article","created":{"date-parts":[[2015,3,9]],"date-time":"2015-03-09T19:27:55Z","timestamp":1425929275000},"page":"111-120","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":190,"title":["Learning is Not a Spectator Sport"],"prefix":"10.1145","author":[{"given":"Kenneth R.","family":"Koedinger","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jihee","family":"Kim","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Julianna Zhuxin","family":"Jia","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Elizabeth A.","family":"McLaughlin","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Norman L.","family":"Bier","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, Pittsburgh, PA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2015,3,14]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0034155"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls0402_2"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.86.2.124"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327809jls1301_1"},{"key":"e_1_3_2_1_5_1","volume-title":"The State of E-Learning in Higher Education: An Eye toward Growth and Increased Access (Research Report)","author":"Bichsel J.","year":"2013","unstructured":"Bichsel , J. ( 2013 ). The State of E-Learning in Higher Education: An Eye toward Growth and Increased Access (Research Report) , Louisville, CO : EDUCAUSE Center for Analysis and Research . Available online: http:\/\/www.educause.edu\/ecar. Bichsel, J. (2013). The State of E-Learning in Higher Education: An Eye toward Growth and Increased Access (Research Report), Louisville, CO: EDUCAUSE Center for Analysis and Research. Available online: http:\/\/www.educause.edu\/ecar."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1002\/pam.21728"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2556325.2566250"},{"key":"e_1_3_2_1_8_1","first-page":"577","volume-title":"J.M. Spector, M.D. Merrill, J.J.G. van Merri\u00ebnboer, & M","author":"Clark R.E.","year":"2007","unstructured":"Clark , R.E. , Feldon , D. , van Merri\u00ebnboer , J. , Yates , K. , & Early , S. ( 2007 ). Cognitive task analysis . In J.M. Spector, M.D. Merrill, J.J.G. van Merri\u00ebnboer, & M .P. Driscoll (Eds.), Handbook of research on educational communications and technology ( 3 rd ed., pp. 577 -- 593 ). Mahwah, NJ : Lawrence Erlbaum Associates . Clark, R.E., Feldon, D., van Merri\u00ebnboer, J., Yates, K., & Early, S. (2007). Cognitive task analysis. In J.M. Spector, M.D. Merrill, J.J.G. van Merri\u00ebnboer, & M.P. Driscoll (Eds.), Handbook of research on educational communications and technology (3rd ed., pp. 577--593). Mahwah, NJ: Lawrence Erlbaum Associates.","edition":"3"},{"key":"e_1_3_2_1_9_1","unstructured":"Collins E.D. (2013) \"SJSU Plus augmented online learning environment: Pilot project report.\" The Research and Planning Group for California Community Colleges. Available online:http:\/\/www.sjsu.edu\/chemistry\/People\/Faculty\/Collins_Research_Page\/AOLE%20Report%20Final%20Version_Jan%201_2014.pdf  Collins E.D. (2013) \"SJSU Plus augmented online learning environment: Pilot project report.\" The Research and Planning Group for California Community Colleges. Available online:http:\/\/www.sjsu.edu\/chemistry\/People\/Faculty\/Collins_Research_Page\/AOLE%20Report%20Final%20Version_Jan%201_2014.pdf"},{"key":"e_1_3_2_1_10_1","volume-title":"L. B. Resnick. Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser (pp. 453--494).","author":"Collins A.","year":"1989","unstructured":"Collins , A. , Brown , J. S. , & Newman , S. E. ( 1989 ). Cognitive apprenticeship: Teaching the crafts of reading, writing, and mathematics . In L. B. Resnick. Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser (pp. 453--494). Hillsdale, NJ : Erlbaum . Collins, A., Brown, J. S., & Newman, S. E. (1989). Cognitive apprenticeship: Teaching the crafts of reading, writing, and mathematics. In L. B. Resnick. Knowing, Learning, and Instruction: Essays in Honor of Robert Glaser (pp. 453--494). Hillsdale, NJ: Erlbaum."},{"key":"e_1_3_2_1_11_1","volume-title":"(2007 edition). Democracy and Education","author":"Dewey J.","year":"1916","unstructured":"Dewey , J. ( 1916 ), (2007 edition). Democracy and Education , Teddington : Echo Library . Dewey, J. (1916), (2007 edition). Democracy and Education, Teddington: Echo Library."},{"key":"e_1_3_2_1_12_1","volume-title":"Emerging Student Patterns in MOOCs: A (Revised) Graphical View. e-literate. Available online: http:\/\/mfeldstein.com\/emerging-student-patterns-in-moocs-a-revised-graphical-view\/","author":"Hill P.","year":"2013","unstructured":"Hill , P. ( 2013 ). Emerging Student Patterns in MOOCs: A (Revised) Graphical View. e-literate. Available online: http:\/\/mfeldstein.com\/emerging-student-patterns-in-moocs-a-revised-graphical-view\/ Hill, P. (2013). Emerging Student Patterns in MOOCs: A (Revised) Graphical View. e-literate. Available online: http:\/\/mfeldstein.com\/emerging-student-patterns-in-moocs-a-revised-graphical-view\/"},{"key":"e_1_3_2_1_13_1","volume-title":"Open Learning Initiative Courses in Community Colleges: Evidence on Use and Effectiveness","author":"Kaufman J.","year":"2013","unstructured":"Kaufman , J. ; Ryan , R. ; Thille , C. and Bier , N . ( 2013 ) Open Learning Initiative Courses in Community Colleges: Evidence on Use and Effectiveness . Mellon University , Pittsburgh, PA . Available online: http:\/\/www.hewlett.org\/sites\/default\/files\/CCOLI_Report_Final_1.pdf Kaufman, J.; Ryan, R.; Thille, C. and Bier, N. (2013) Open Learning Initiative Courses in Community Colleges: Evidence on Use and Effectiveness. Mellon University, Pittsburgh, PA. Available online: http:\/\/www.hewlett.org\/sites\/default\/files\/CCOLI_Report_Final_1.pdf"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10648-007-9049-0"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1201\/b10274-6"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1238056"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1551-6709.2012.01245.x"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/2591682"},{"key":"e_1_3_2_1_19_1","volume-title":"Monitored design of an effective learning environment for algebraic problem solving. Technical report Carnegie Mellon University-HCII-14-102","author":"Koedinger K. R.","year":"2014","unstructured":"Koedinger , K. R. , & Sueker , E. L. F. ( 2014 ). Monitored design of an effective learning environment for algebraic problem solving. Technical report Carnegie Mellon University-HCII-14-102 . Koedinger, K. R., & Sueker, E. L. F. (2014). Monitored design of an effective learning environment for algebraic problem solving. Technical report Carnegie Mellon University-HCII-14-102."},{"key":"e_1_3_2_1_20_1","volume-title":"The Open Learning Initiative: Measuring the effectiveness of the OLI learning course in accelerating student learning. Journal of Interactive Media in Education","author":"Lovett M.","year":"2008","unstructured":"Lovett , M. , Meyer , O. , Thille , C. ( 2008 ). The Open Learning Initiative: Measuring the effectiveness of the OLI learning course in accelerating student learning. Journal of Interactive Media in Education . http:\/\/jime.open.ac.uk\/2008\/14\/. Lovett, M., Meyer, O., Thille, C. (2008). The Open Learning Initiative: Measuring the effectiveness of the OLI learning course in accelerating student learning. Journal of Interactive Media in Education. http:\/\/jime.open.ac.uk\/2008\/14\/."},{"key":"e_1_3_2_1_21_1","volume-title":"B. Phillips (Ed.) Proc. of the Sixth International Conference on Teaching Statistics.","author":"Meyer O.","year":"2002","unstructured":"Meyer , O. , & Lovett , M. C. ( 2002 ). Implementing a computerized tutor in a statistical reasoning Course: Getting the big picture . In B. Phillips (Ed.) Proc. of the Sixth International Conference on Teaching Statistics. Meyer, O., & Lovett, M. C. (2002). Implementing a computerized tutor in a statistical reasoning Course: Getting the big picture. In B. Phillips (Ed.) Proc. of the Sixth International Conference on Teaching Statistics."},{"key":"e_1_3_2_1_22_1","volume-title":"What Course Elements Correlate with Improvement on Tests in Introductory Newtonian Mechanics? National Association for Research in Science Teaching -- NARST- 2002 Conference","author":"Morote E.","year":"2002","unstructured":"Morote , E. & Pritchard , D. E. ( 2002 ). What Course Elements Correlate with Improvement on Tests in Introductory Newtonian Mechanics? National Association for Research in Science Teaching -- NARST- 2002 Conference . Morote, E. & Pritchard, D. E. (2002). What Course Elements Correlate with Improvement on Tests in Introductory Newtonian Mechanics? National Association for Research in Science Teaching -- NARST- 2002 Conference."},{"key":"e_1_3_2_1_23_1","volume-title":"Origins of the Modern MOOC","author":"Ng A.","year":"2014","unstructured":"Ng , A. and Widom J . ( 2014 ). Origins of the Modern MOOC . http:\/\/www.cs.stanford.edu\/people\/ang\/papers\/mooc14-OriginsOfModernMOOC.pdf Ng, A. and Widom J. (2014). Origins of the Modern MOOC. http:\/\/www.cs.stanford.edu\/people\/ang\/papers\/mooc14-OriginsOfModernMOOC.pdf"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.3102\/0162373713507480"},{"key":"e_1_3_2_1_25_1","unstructured":"Pappano L. (2012 November 2). The year of the MOOC. The New York Times.  Pappano L. (2012 November 2). The year of the MOOC. The New York Times."},{"key":"e_1_3_2_1_26_1","volume-title":"Organizing Instruction and Study to Improve Student Learning (NCER 2007-2004)","author":"Pashler H.","year":"2007","unstructured":"Pashler , H. , Bain , P. , Bottge , B. , Graesser , A. , Koedinger , K. , McDaniel , M. , & Metcalfe , J. ( 2007 ). Organizing Instruction and Study to Improve Student Learning (NCER 2007-2004) . Washington, DC : National Center for Education Research, Institute of Education Sciences, U.S. Department of Education . Pashler, H., Bain, P., Bottge, B., Graesser, A., Koedinger, K., McDaniel, M., & Metcalfe, J. (2007). Organizing Instruction and Study to Improve Student Learning (NCER 2007-2004). Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.3758\/BF03194060"},{"key":"e_1_3_2_1_28_1","volume-title":"Instructional Design Theories and Models: A New Paradigm of Instructional Theory (Vol. II) (pp.161--181).","author":"Schank R. C.","year":"1999","unstructured":"Schank , R. C. , Berman , T. R. & Macperson , K. A. ( 1999 ). Learning by doing . In C. M. Reigeluth (Ed.), Instructional Design Theories and Models: A New Paradigm of Instructional Theory (Vol. II) (pp.161--181). Mahwah, NJ : Lawrence Erlbaum Associates . Schank, R. C., Berman, T. R. & Macperson, K. A. (1999). Learning by doing. In C. M. Reigeluth (Ed.), Instructional Design Theories and Models: A New Paradigm of Instructional Theory (Vol. II) (pp.161--181). Mahwah, NJ: Lawrence Erlbaum Associates."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1237223"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/W14-4102"},{"key":"e_1_3_2_1_31_1","volume-title":"Game Changers: Education and Information Technologies (201--213). Educause.","author":"Strader R.","year":"2012","unstructured":"Strader , R. & Thille , C. ( 2012 ). The Open Learning Initiative: Enacting Instruction Online . In Oblinger, D.G. (Ed.) Game Changers: Education and Information Technologies (201--213). Educause. Strader, R. & Thille, C. (2012). The Open Learning Initiative: Enacting Instruction Online. In Oblinger, D.G. (Ed.) Game Changers: Education and Information Technologies (201--213). Educause."},{"key":"e_1_3_2_1_32_1","unstructured":"Tetrad IV. http:\/\/www.phil.cmu.edu\/tetrad.  Tetrad IV. http:\/\/www.phil.cmu.edu\/tetrad."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601337"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/1435351.1435353"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1080\/00461520.2011.611369"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.93.3.1346"}],"event":{"name":"L@S 2015: Second (2015) ACM Conference on Learning @ Scale","location":"Vancouver BC Canada","acronym":"L@S 2015","sponsor":["ACM Ed Board ACM Ed Board"]},"container-title":["Proceedings of the Second (2015) ACM Conference on Learning @ Scale"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2724660.2724681","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2724660.2724681","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T06:12:12Z","timestamp":1750227132000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2724660.2724681"}},"subtitle":["Doing is Better than Watching for Learning from a MOOC"],"short-title":[],"issued":{"date-parts":[[2015,3,14]]},"references-count":36,"alternative-id":["10.1145\/2724660.2724681","10.1145\/2724660"],"URL":"https:\/\/doi.org\/10.1145\/2724660.2724681","relation":{},"subject":[],"published":{"date-parts":[[2015,3,14]]},"assertion":[{"value":"2015-03-14","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}