{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,6]],"date-time":"2026-01-06T02:23:17Z","timestamp":1767666197378,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":24,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"United States Department of Education","award":["U411C190092"],"award-info":[{"award-number":["U411C190092"]}]},{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1923136"],"award-info":[{"award-number":["1923136"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,3]]},"DOI":"10.1145\/3408877.3432376","type":"proceedings-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T18:49:39Z","timestamp":1614970179000},"page":"10-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Development and Preliminary Validation of the Assessment of Computing for Elementary Students (ACES)"],"prefix":"10.1145","author":[{"given":"Miranda C.","family":"Parker","sequence":"first","affiliation":[{"name":"University of California, Irvine, Irvine, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yvonne S.","family":"Kao","sequence":"additional","affiliation":[{"name":"WestEd, Redwood City, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dana","family":"Saito-Stehberger","sequence":"additional","affiliation":[{"name":"University of California, Irvine, Irvine, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diana","family":"Franklin","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Susan","family":"Krause","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Debra","family":"Richardson","sequence":"additional","affiliation":[{"name":"University of California, Irvine, Irvine, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mark","family":"Warschauer","sequence":"additional","affiliation":[{"name":"University of California, Irvine, Irvine, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.54870\/1551-3440.1228"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2017.03.001"},{"key":"e_1_3_2_1_3_1","unstructured":"CodeSpark. [n.d.]. CodeSpark Academy. https:\/\/codespark.com\/  CodeSpark. [n.d.]. CodeSpark Academy. https:\/\/codespark.com\/"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11858-014-0598-7"},{"volume-title":"Computational thinking","author":"Curzon Paul","key":"e_1_3_2_1_5_1","unstructured":"Paul Curzon , Tim Bell , Jane Waite , and Mark Dorling . 2018. Computational thinking . Springer . Paul Curzon, Tim Bell, Jane Waite, and Mark Dorling. 2018. Computational thinking .Springer."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-69924-8_2"},{"volume-title":"Informatics in Schools: Improvement of Informatics Knowledge and Perception , , Andrej Brodnik and Francc oise Tort (Eds.)","author":"Dagien Valentina","key":"e_1_3_2_1_7_1","unstructured":"Valentina Dagien .e and Sue Sentance . 2016. It's Computational Thinking! Bebras Tasks in the Curriculum . In Informatics in Schools: Improvement of Informatics Knowledge and Perception , , Andrej Brodnik and Francc oise Tort (Eds.) . Springer International Publishing , Cham , 28--39. Valentina Dagien.e and Sue Sentance. 2016. It's Computational Thinking! Bebras Tasks in the Curriculum. In Informatics in Schools: Improvement of Informatics Knowledge and Perception , , Andrej Brodnik and Francc oise Tort (Eds.). Springer International Publishing, Cham, 28--39."},{"volume-title":"Proceedings of the 50th ACM Technical Symposium on Computer Science Education","author":"Decker Adrienne","key":"e_1_3_2_1_8_1","unstructured":"Adrienne Decker and Monica M . McGill. 2019. A Topical Review of Evaluation Instruments for Computing Education . In Proceedings of the 50th ACM Technical Symposium on Computer Science Education ( Minneapolis, MN, USA) (SIGCSE '19). Association for Computing Machinery, New York, NY, USA, 558--564. https:\/\/doi.org\/10.1145\/3287324.3287393 10.1145\/3287324.3287393 Adrienne Decker and Monica M. McGill. 2019. A Topical Review of Evaluation Instruments for Computing Education. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (Minneapolis, MN, USA) (SIGCSE '19). Association for Computing Machinery, New York, NY, USA, 558--564. https:\/\/doi.org\/10.1145\/3287324.3287393"},{"key":"e_1_3_2_1_9_1","unstructured":"Computing for ANyOne (CANON) Lab. [n.d.]. Scratch Act 1. https:\/\/www.canonlab.org\/scratchact1modules  Computing for ANyOne (CANON) Lab. [n.d.]. Scratch Act 1. https:\/\/www.canonlab.org\/scratchact1modules"},{"key":"e_1_3_2_1_10_1","unstructured":"International Society for Technology in Education and Computer Science Teachers Association. [n.d.]. https:\/\/id.iste.org\/docs\/ct-documents\/computational-thinking-operational-definition-flyer.pdf  International Society for Technology in Education and Computer Science Teachers Association. [n.d.]. https:\/\/id.iste.org\/docs\/ct-documents\/computational-thinking-operational-definition-flyer.pdf"},{"key":"e_1_3_2_1_11_1","volume-title":"Science Education 99","volume":"3","author":"Hammer D.","year":"2015","unstructured":"D. Hammer and T. Sikorski . 2015. Implications of complexity for research on learning progressions . Science Education 99 , Vol. 3 ( 2015 ), 424--431. D. Hammer and T. Sikorski. 2015. Implications of complexity for research on learning progressions. Science Education 99, Vol. 3 (2015), 424--431."},{"key":"e_1_3_2_1_12_1","unstructured":"K-12 Computer Science Framework Steering Committee et al. 2016. K-12 computer science framework .  K-12 Computer Science Framework Steering Committee et al. 2016. K-12 computer science framework ."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094428105284919"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366821"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11858-011-0326-5"},{"key":"e_1_3_2_1_16_1","unstructured":"ScratchJr. [n.d.]. ScratchJr. https:\/\/www.scratchjr.org\/  ScratchJr. [n.d.]. ScratchJr. https:\/\/www.scratchjr.org\/"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.2307\/749205"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734297"},{"volume-title":"Informatics in Schools","author":"Van\u00edvcek Jivr","key":"e_1_3_2_1_19_1","unstructured":"Jivr \u00ed Van\u00edvcek . 2014. Bebras Informatics Contest: Criteria for Good Tasks Revised . In Informatics in Schools . Teaching and Learning Perspectives, Yasemin G\u00fclbahar and Erincc Karatacs (Eds.). Springer International Publishing , Cham , 17--28. Jivr \u00ed Van\u00edvcek. 2014. Bebras Informatics Contest: Criteria for Good Tasks Revised. In Informatics in Schools. Teaching and Learning Perspectives, Yasemin G\u00fclbahar and Erincc Karatacs (Eds.). Springer International Publishing, Cham, 17--28."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787721"},{"volume-title":"SIGCSE 2019 - Proceedings of the 50th ACM Technical Symposium on Computer Science Education. Association for Computing Machinery, Inc, 456--461","author":"Wiebe Eric","key":"e_1_3_2_1_21_1","unstructured":"Eric Wiebe , Bradford W. Mott , Jennifer London , Kristy Elizabeth Boyer , Osman Aksit , and James C. Lester . 2019. Development of a lean computational thinking abilities assessment for middle grades students . In SIGCSE 2019 - Proceedings of the 50th ACM Technical Symposium on Computer Science Education. Association for Computing Machinery, Inc, 456--461 . https:\/\/doi.org\/10.1145\/3287324.3287390 10.1145\/3287324.3287390 Eric Wiebe, Bradford W. Mott, Jennifer London, Kristy Elizabeth Boyer, Osman Aksit, and James C. Lester. 2019. Development of a lean computational thinking abilities assessment for middle grades students. In SIGCSE 2019 - Proceedings of the 50th ACM Technical Symposium on Computer Science Education. Association for Computing Machinery, Inc, 456--461. https:\/\/doi.org\/10.1145\/3287324.3287390"},{"volume-title":"Cognitive interviewing: A tool for improving questionnaire design","author":"Willis Gordon B","key":"e_1_3_2_1_22_1","unstructured":"Gordon B Willis . 2004. Cognitive interviewing: A tool for improving questionnaire design . Sage publications. Gordon B Willis. 2004. Cognitive interviewing: A tool for improving questionnaire design. Sage publications."},{"volume-title":"Analysis of the cognitive interview in questionnaire design","author":"Willis Gordon B","key":"e_1_3_2_1_23_1","unstructured":"Gordon B Willis . 2015. Analysis of the cognitive interview in questionnaire design . Oxford University Press . Gordon B Willis. 2015. Analysis of the cognitive interview in questionnaire design .Oxford University Press."},{"key":"e_1_3_2_1_24_1","unstructured":"Cameron Wilson Chris Stephenson and Mark Stehlik. 2010. Running on Empty: The Failure to Teach K-12 Computer Science in the Digital Age The Association for Computing Machinery The Computer Science Teachers Association The Computer Science Teachers Association Member of ACM's Education Policy Committee Association for Computing Machinery. Technical Report. http:\/\/www.acm.org\/Runningonempty\/http:\/\/csta.acm.org\/Runningonempty\/  Cameron Wilson Chris Stephenson and Mark Stehlik. 2010. Running on Empty: The Failure to Teach K-12 Computer Science in the Digital Age The Association for Computing Machinery The Computer Science Teachers Association The Computer Science Teachers Association Member of ACM's Education Policy Committee Association for Computing Machinery. Technical Report. http:\/\/www.acm.org\/Runningonempty\/http:\/\/csta.acm.org\/Runningonempty\/"}],"event":{"name":"SIGCSE '21: The 52nd ACM Technical Symposium on Computer Science Education","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Virtual Event USA","acronym":"SIGCSE '21"},"container-title":["Proceedings of the 52nd ACM Technical Symposium on Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432376","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3408877.3432376","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3408877.3432376","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:36Z","timestamp":1750195896000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432376"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":24,"alternative-id":["10.1145\/3408877.3432376","10.1145\/3408877"],"URL":"https:\/\/doi.org\/10.1145\/3408877.3432376","relation":{},"subject":[],"published":{"date-parts":[[2021,3,3]]},"assertion":[{"value":"2021-03-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}