{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T14:01:20Z","timestamp":1781877680697,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":37,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,4,12]],"date-time":"2021-04-12T00:00:00Z","timestamp":1618185600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,4,12]]},"DOI":"10.1145\/3448139.3448209","type":"proceedings-article","created":{"date-parts":[[2021,4,5]],"date-time":"2021-04-05T22:29:58Z","timestamp":1617661798000},"page":"632-638","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Exploring Metrics for the Analysis of Code Submissions in an Introductory Data Science Course"],"prefix":"10.1145","author":[{"given":"Huy","family":"Nguyen","sequence":"first","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michelle","family":"Lim","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Steven","family":"Moore","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Eric","family":"Nyberg","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Majd","family":"Sakr","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"John","family":"Stamper","sequence":"additional","affiliation":[{"name":"Carnegie Mellon University, United States"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,4,12]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"[n.d.]. Radon. https:\/\/github.com\/rubik\/radon.  [n.d.]. Radon. https:\/\/github.com\/rubik\/radon."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2839509.2844568"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/820127.820183"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2016.05.513"},{"key":"e_1_3_2_1_5_1","volume-title":"Data Science Thinking","author":"Cao Longbing","unstructured":"Longbing Cao . 2018. Data Science Thinking . In Data Science Thinking . Springer , 59\u201390. Longbing Cao. 2018. Data Science Thinking. In Data Science Thinking. Springer, 59\u201390."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/32.295895"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-statistics-060116-053930"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3027385.3027441"},{"key":"e_1_3_2_1_9_1","unstructured":"Tom\u00e1\u0161 Effenberger Jaroslav Cech\u00e1k and Radek Pel\u00e1nek. 2019. Difficulty and Complexity of Introductory Programming Problems. (2019).  Tom\u00e1\u0161 Effenberger Jaroslav Cech\u00e1k and Radek Pel\u00e1nek. 2019. Difficulty and Complexity of Introductory Programming Problems. (2019)."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3330430.3333641"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1145\/3304221.3319757"},{"key":"e_1_3_2_1_12_1","volume-title":"Elements of software science. Vol.\u00a07","author":"Maurice\u00a0Howard","unstructured":"Maurice\u00a0Howard Halstead 1977. Elements of software science. Vol.\u00a07 . Elsevier New York . Maurice\u00a0Howard Halstead 1977. Elements of software science. Vol.\u00a07. Elsevier New York."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2793107.2793128"},{"key":"e_1_3_2_1_14_1","volume-title":"Ralf Gommers, Pauli Virtanen, David Cournapeau, Eric Wieser, Julian Taylor","author":"Harris R","year":"2020","unstructured":"Charles\u00a0 R Harris , K\u00a0Jarrod Millman , St\u00e9fan\u00a0J van\u00a0der Walt , Ralf Gommers, Pauli Virtanen, David Cournapeau, Eric Wieser, Julian Taylor , Sebastian Berg , Nathaniel\u00a0 J Smith, 2020 . Array programming with NumPy. Nature 585, 7825 (2020), 357\u2013362. Charles\u00a0R Harris, K\u00a0Jarrod Millman, St\u00e9fan\u00a0J van\u00a0der Walt, Ralf Gommers, Pauli Virtanen, David Cournapeau, Eric Wieser, Julian Taylor, Sebastian Berg, Nathaniel\u00a0J Smith, 2020. Array programming with NumPy. Nature 585, 7825 (2020), 357\u2013362."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2019.924"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2858796.2858798"},{"key":"e_1_3_2_1_17_1","unstructured":"Thomas Kluyver Benjamin Ragan-Kelley Fernando P\u00e9rez Brian\u00a0E Granger Matthias Bussonnier Jonathan Frederic Kyle Kelley Jessica\u00a0B Hamrick Jason Grout Sylvain Corlay 2016. Jupyter Notebooks-a publishing format for reproducible computational workflows.. In ELPUB. 87\u201390.  Thomas Kluyver Benjamin Ragan-Kelley Fernando P\u00e9rez Brian\u00a0E Granger Matthias Bussonnier Jonathan Frederic Kyle Kelley Jessica\u00a0B Hamrick Jason Grout Sylvain Corlay 2016. Jupyter Notebooks-a publishing format for reproducible computational workflows.. In ELPUB. 87\u201390."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1155\/2013\/805963"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1145\/3290605.3300493"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/3013499.3013500"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11213-018-9446-y"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339420"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSE.1976.233837"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-92bf1922-00a"},{"key":"e_1_3_2_1_25_1","volume-title":"Using Knowledge Component Modeling to Increase Domain Understanding in a Digital Learning Game","author":"Nguyen Huy","year":"2019","unstructured":"Huy Nguyen , Yeyu Wang , John Stamper , and Bruce\u00a0 M McLaren . 2019. Using Knowledge Component Modeling to Increase Domain Understanding in a Digital Learning Game . International Educational Data Mining Society ( 2019 ). Huy Nguyen, Yeyu Wang, John Stamper, and Bruce\u00a0M McLaren. 2019. Using Knowledge Component Modeling to Increase Domain Understanding in a Digital Learning Game.International Educational Data Mining Society (2019)."},{"key":"e_1_3_2_1_26_1","unstructured":"Vu Nguyen Sophia Deeds-Rubin Thomas Tan and Barry Boehm. 2007. A SLOC counting standard. In Cocomo ii forum Vol.\u00a02007. Citeseer 1\u201316.  Vu Nguyen Sophia Deeds-Rubin Thomas Tan and Barry Boehm. 2007. A SLOC counting standard. In Cocomo ii forum Vol.\u00a02007. Citeseer 1\u201316."},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3059026"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366967"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2019.1612679"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40593-015-0070-z"},{"key":"e_1_3_2_1_31_1","volume-title":"Big Data science education: A case study of a project-focused introductory course. Themes in science and technology education 8, 2","author":"Saltz Jeffrey","year":"2016","unstructured":"Jeffrey Saltz and Robert Heckman . 2016. Big Data science education: A case study of a project-focused introductory course. Themes in science and technology education 8, 2 ( 2016 ), 85\u201394. Jeffrey Saltz and Robert Heckman. 2016. Big Data science education: A case study of a project-focused introductory course. Themes in science and technology education 8, 2 (2016), 85\u201394."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3159450.3159483"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-92bf1922-011"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-21869-9_46"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.3233\/EFI-160977"},{"key":"e_1_3_2_1_36_1","volume-title":"Proceedings of the 50th ACM Technical Symposium on Computer Science Education. 738\u2013744","author":"Charles Wallace C","year":"2019","unstructured":"Leo\u00a0 C Ureel\u00a0II and Charles Wallace . 2019 . Automated Critique of Early Programming Antipatterns . In Proceedings of the 50th ACM Technical Symposium on Computer Science Education. 738\u2013744 . Leo\u00a0C Ureel\u00a0II and Charles Wallace. 2019. Automated Critique of Early Programming Antipatterns. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education. 738\u2013744."},{"key":"e_1_3_2_1_37_1","volume-title":"fundamental algorithms for scientific computing in Python. Nature methods 17, 3","author":"Virtanen Pauli","year":"2020","unstructured":"Pauli Virtanen , Ralf Gommers , Travis\u00a0 E Oliphant , Matt Haberland , Tyler Reddy , David Cournapeau , Evgeni Burovski , Pearu Peterson , Warren Weckesser , Jonathan Bright , 2020. SciPy 1.0 : fundamental algorithms for scientific computing in Python. Nature methods 17, 3 ( 2020 ), 261\u2013272. Pauli Virtanen, Ralf Gommers, Travis\u00a0E Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, 2020. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature methods 17, 3 (2020), 261\u2013272."}],"event":{"name":"LAK21: 11th International Learning Analytics and Knowledge Conference","location":"Irvine CA USA","acronym":"LAK21"},"container-title":["LAK21: 11th International Learning Analytics and Knowledge Conference"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448139.3448209","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3448139.3448209","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:25:00Z","timestamp":1750195500000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3448139.3448209"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,4,12]]},"references-count":37,"alternative-id":["10.1145\/3448139.3448209","10.1145\/3448139"],"URL":"https:\/\/doi.org\/10.1145\/3448139.3448209","relation":{},"subject":[],"published":{"date-parts":[[2021,4,12]]},"assertion":[{"value":"2021-04-12","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}