{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,20]],"date-time":"2026-03-20T01:15:49Z","timestamp":1773969349762,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":27,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,6,15]],"date-time":"2020-06-15T00:00:00Z","timestamp":1592179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["1660871 DGE-1746045"],"award-info":[{"award-number":["1660871 DGE-1746045"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,6,15]]},"DOI":"10.1145\/3341525.3387379","type":"proceedings-article","created":{"date-parts":[[2020,6,3]],"date-time":"2020-06-03T04:15:40Z","timestamp":1591157740000},"page":"473-479","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":19,"title":["If They Build It, Will They Understand It? Exploring the Relationship between Student Code and Performance"],"prefix":"10.1145","author":[{"given":"Jean","family":"Salac","sequence":"first","affiliation":[{"name":"University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diana","family":"Franklin","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2020,6,15]]},"reference":[{"key":"e_1_3_2_1_1_1","first-page":"643","article-title":"What do students learn about programming from game, music video, and storytelling projects?","volume":"2012","author":"Adams Joel C","unstructured":"Joel C Adams and Andrew R Webster . \" What do students learn about programming from game, music video, and storytelling projects? \" In: Proceedings of the 43rd ACM technical symposium on Computer Science Education. ACM. 2012 ,pp. 643 -- 648 . Joel C Adams and Andrew R Webster. \"What do students learn about programming from game, music video, and storytelling projects?\" In: Proceedings of the 43rd ACM technical symposium on Computer Science Education. ACM. 2012,pp. 643--648.","journal-title":"ACM."},{"key":"e_1_3_2_1_2_1","first-page":"1269","volume-title":"Proceedings of the 50th ACM technical symposium on Computer science education. ACM.","author":"Assessing Middle School Students' W. Wiebe E.","year":"2019","unstructured":"Min- W. Wiebe E. Mott B. Boyer K. E. Lester J. Akram B. \" Assessing Middle School Students' Computational Thinking Through Programming Trajectory Analysis\". In: Proceedings of the 50th ACM technical symposium on Computer science education. ACM. 2019 , p. 1269 . Min-W. Wiebe E. Mott B. Boyer K. E. Lester J. Akram B. \"Assessing Middle School Students' Computational Thinking Through Programming Trajectory Analysis\". In: Proceedings of the 50th ACM technical symposium on Computer science education. ACM. 2019, p. 1269."},{"issue":"3","key":"e_1_3_2_1_3_1","doi-asserted-by":"crossref","first-page":"507","DOI":"10.54870\/1551-3440.1228","article-title":"Conceptualizations and issues related to learning progressions, learning trajectories, and levels of sophistication","volume":"8","author":"Battista Michael T","year":"2011","unstructured":"Michael T Battista . \" Conceptualizations and issues related to learning progressions, learning trajectories, and levels of sophistication \". In: The Mathematics Enthusiast 8 . 3 ( 2011 ), pp. 507 -- 570 . Michael T Battista. \"Conceptualizations and issues related to learning progressions, learning trajectories, and levels of sophistication\". In: The Mathematics Enthusiast 8.3 (2011), pp. 507--570.","journal-title":"The Mathematics Enthusiast"},{"key":"e_1_3_2_1_4_1","first-page":"215","volume-title":"Proceeding of the 44th ACM Technical Symposium on Computer Science Education. SIGCSE '13","author":"Bryce","year":"2013","unstructured":"Bryce Boe et al. \"Hairball: Lint-inspired Static Analysis of Scratch Projects \". In: Proceeding of the 44th ACM Technical Symposium on Computer Science Education. SIGCSE '13 . Denver, Colorado, USA: ACM , 2013 , pp. 215 -- 220 . isbn: 978--1--4503--1868--6. doi: 10.1145\/2445196.2445265. url: http:\/\/doi.acm.org\/10.1145\/2445196.2445265. 10.1145\/2445196.2445265 Bryce Boe et al. \"Hairball: Lint-inspired Static Analysis of Scratch Projects\". In: Proceeding of the 44th ACM Technical Symposium on Computer Science Education. SIGCSE '13. Denver, Colorado, USA: ACM, 2013, pp. 215--220. isbn: 978--1--4503--1868--6. doi: 10.1145\/2445196.2445265. url: http:\/\/doi.acm.org\/10.1145\/2445196.2445265."},{"key":"e_1_3_2_1_5_1","first-page":"25","volume-title":"Proceedings of the 2012 annual meeting of the American Educational Research Association","volume":"1","author":"Brennan Karen","year":"2012","unstructured":"Karen Brennan and Mitchel Resnick . \"New frameworks for studying and assessing the development of computational thinking \". In: Proceedings of the 2012 annual meeting of the American Educational Research Association , Vancouver,Canada. Vol. 1 . 2012 , p. 25 . Karen Brennan and Mitchel Resnick. \"New frameworks for studying and assessing the development of computational thinking\". In: Proceedings of the 2012 annual meeting of the American Educational Research Association, Vancouver,Canada. Vol. 1. 2012, p. 25."},{"key":"e_1_3_2_1_6_1","unstructured":"Creative Computing. An introductory computing curriculum using Scratch.  Creative Computing. An introductory computing curriculum using Scratch."},{"key":"e_1_3_2_1_7_1","unstructured":"CS for ALL. url: https:\/\/www.csforall.org\/.  CS for ALL. url: https:\/\/www.csforall.org\/."},{"key":"e_1_3_2_1_8_1","first-page":"1","volume-title":"Proceedings of the 12th International Conference on Interaction Design and Children. ACM.","author":"Louise","year":"2013","unstructured":"Louise P Flannery et al. \"Designing Scratch Jr: support for early childhood learning through computer programming \". In: Proceedings of the 12th International Conference on Interaction Design and Children. ACM. 2013 , pp. 1 -- 10 . Louise P Flannery et al. \"Designing Scratch Jr: support for early childhood learning through computer programming\". In: Proceedings of the 12th International Conference on Interaction Design and Children. ACM. 2013, pp. 1--10."},{"key":"e_1_3_2_1_9_1","first-page":"371","volume-title":"ACM.","author":"Diana","year":"2013","unstructured":"Diana Franklin et al. \"Assessment of computer science learning in a scratch-based outreach program\". In:Proceeding of the 44th ACM technical symposium on Computer science education . ACM. 2013 , pp. 371 -- 376 . Diana Franklin et al. \"Assessment of computer science learning in a scratch-based outreach program\". In:Proceeding of the 44th ACM technical symposium on Computer science education. ACM. 2013, pp. 371--376."},{"key":"e_1_3_2_1_10_1","first-page":"231","volume-title":"Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education. ACM.","author":"Diana","year":"2017","unstructured":"Diana Franklin et al. \"Using upper-elementary student performance to under-stand conceptual sequencing in a blocks-based curriculum \". In: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education. ACM. 2017 , pp. 231 -- 236 . Diana Franklin et al. \"Using upper-elementary student performance to under-stand conceptual sequencing in a blocks-based curriculum\". In: Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education. ACM. 2017, pp. 231--236."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1002\/sce.21165"},{"key":"e_1_3_2_1_12_1","volume-title":"Applied statistics for the behavioral sciences\". In","author":"Hinkle Dennis E","year":"1988","unstructured":"Dennis E Hinkle , William Wiersma , Stephen G Jurs , \" Applied statistics for the behavioral sciences\". In : ( 1988 ). Dennis E Hinkle, William Wiersma, Stephen G Jurs, et al. \"Applied statistics for the behavioral sciences\". In: (1988)."},{"key":"e_1_3_2_1_13_1","first-page":"65","volume-title":"Proceedings of the 2015 ITiCSE on working group reports. ACM.","author":"Peter","year":"2015","unstructured":"Peter Hubwieser et al. \"A global snapshot of computer science education in K-12 schools \". In: Proceedings of the 2015 ITiCSE on working group reports. ACM. 2015 , pp. 65 -- 83 . Peter Hubwieser et al. \"A global snapshot of computer science education in K-12 schools\". In: Proceedings of the 2015 ITiCSE on working group reports. ACM. 2015, pp. 65--83."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1076\/csed.11.3.221.3831"},{"key":"e_1_3_2_1_15_1","first-page":"133","volume-title":"Proceedings of the third international workshop on Computing education research. ACM.","author":"Gary","year":"2007","unstructured":"Gary Lewandowski et al. \"Commonsense computing (episode 3): concurrency and concert tickets \". In: Proceedings of the third international workshop on Computing education research. ACM. 2007 , pp. 133 -- 144 . Gary Lewandowski et al. \"Commonsense computing (episode 3): concurrency and concert tickets\". In: Proceedings of the third international workshop on Computing education research. ACM. 2007, pp. 133--144."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157156"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1145\/3230977.3230984","volume-title":"Proceedings of the 2018 ACM Conference on International Computing Education Research. ACM.","author":"Eva Marinus","year":"2018","unstructured":"Eva Marinus et al. \" Unravelling the Cognition of Coding in 3-to-6-year Olds: The development of an assessment tool and the relation between coding abilityand cognitive compiling of syntax in natural language \". In: Proceedings of the 2018 ACM Conference on International Computing Education Research. ACM. 2018 , pp. 133 -- 141 . Eva Marinus et al. \"Unravelling the Cognition of Coding in 3-to-6-year Olds: The development of an assessment tool and the relation between coding abilityand cognitive compiling of syntax in natural language\". In: Proceedings of the 2018 ACM Conference on International Computing Education Research. ACM. 2018, pp. 133--141."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2013.832022"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3992.2006.00075.x"},{"key":"e_1_3_2_1_20_1","first-page":"2788","volume-title":"Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. CHI EA '17","author":"Jes\u00fas","year":"2017","unstructured":"Jes\u00fas Moreno-Le\u00f3n et al. \"On the Automatic Assessment of Computational Thinking Skills: A Comparison with Human Experts \". In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. CHI EA '17 . Denver, Colorado, USA: ACM , 2017 , pp. 2788 -- 2795 .isbn: 978--1--4503--4656--6.doi: 10.1145\/3027063.3053216. url: http:\/\/doi.acm.org\/10.1145\/3027063.3053216. 10.1145\/3027063.3053216 Jes\u00fas Moreno-Le\u00f3n et al. \"On the Automatic Assessment of Computational Thinking Skills: A Comparison with Human Experts\". In: Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. CHI EA '17. Denver, Colorado, USA: ACM, 2017, pp. 2788--2795.isbn: 978--1--4503--4656--6.doi: 10.1145\/3027063.3053216. url: http:\/\/doi.acm.org\/10.1145\/3027063.3053216."},{"key":"e_1_3_2_1_21_1","volume-title":"Children, computers, and powerful ideas","author":"Papert Seymour","year":"1980","unstructured":"Seymour Papert . Mindstorms : Children, computers, and powerful ideas . BasicBooks, Inc. , 1980 . Seymour Papert. Mindstorms: Children, computers, and powerful ideas. BasicBooks, Inc., 1980."},{"key":"e_1_3_2_1_22_1","first-page":"305","volume-title":"ACM SIGCSE Bulletin.","author":"Repenning Alexander","year":"2008","unstructured":"Alexander Repenning and Andri Ioannidou . \" Broadening participation throughscalable game design\". In: ACM SIGCSE Bulletin. Vol. 40 . 1. ACM. 2008 , pp. 305 -- 309 . Alexander Repenning and Andri Ioannidou. \"Broadening participation throughscalable game design\". In: ACM SIGCSE Bulletin. Vol. 40. 1. ACM. 2008, pp. 305--309."},{"key":"e_1_3_2_1_23_1","first-page":"182","volume-title":"Proceedings of the 2017 ACM Conference on International Computing Education Research. ACM.","author":"Kathryn","year":"2017","unstructured":"Kathryn M Rich et al. \"K-8 learning trajectories derived from research literature:Sequence, repetition, conditionals \". In: Proceedings of the 2017 ACM Conference on International Computing Education Research. ACM. 2017 , pp. 182 -- 190 . Kathryn M Rich et al. \"K-8 learning trajectories derived from research literature:Sequence, repetition, conditionals\". In: Proceedings of the 2017 ACM Conference on International Computing Education Research. ACM. 2017, pp. 182--190."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/1404520.1404535"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1145\/2483710.2483713","article-title":"Notional Machines and Introductory Programming Education","volume":"13","author":"Sorva Juha","year":"2013","unstructured":"Juha Sorva . \" Notional Machines and Introductory Programming Education \". In: ACM Transactions on Computing Education 13 ( June 2013 ), 8: 1 -- 8 :31. doi:10.1145\/2483710.2483713. 10.1145\/2483710.2483713 Juha Sorva. \"Notional Machines and Introductory Programming Education\". In: ACM Transactions on Computing Education 13 (June 2013), 8:1--8:31. doi:10.1145\/2483710.2483713.","journal-title":"ACM Transactions on Computing Education"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734297"},{"key":"e_1_3_2_1_27_1","volume-title":"Poster presented at the 42nd ACM Technical Symposium on Computer Science Education","author":"Wolz Ursula","year":"2011","unstructured":"Ursula Wolz , Christopher Hallberg , and Brett Taylor . \"Scrape : A tool for visualizing the code of Scratch programs \". In: Poster presented at the 42nd ACM Technical Symposium on Computer Science Education , Dallas , TX. 2011 . Ursula Wolz, Christopher Hallberg, and Brett Taylor. \"Scrape: A tool for visualizing the code of Scratch programs\". In: Poster presented at the 42nd ACM Technical Symposium on Computer Science Education, Dallas, TX. 2011."}],"event":{"name":"ITiCSE '20: Innovation and Technology in Computer Science Education","location":"Trondheim Norway","acronym":"ITiCSE '20","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3341525.3387379","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3341525.3387379","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:12:58Z","timestamp":1750201978000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3341525.3387379"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,6,15]]},"references-count":27,"alternative-id":["10.1145\/3341525.3387379","10.1145\/3341525"],"URL":"https:\/\/doi.org\/10.1145\/3341525.3387379","relation":{},"subject":[],"published":{"date-parts":[[2020,6,15]]},"assertion":[{"value":"2020-06-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}