{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T21:20:27Z","timestamp":1770240027971,"version":"3.49.0"},"reference-count":118,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2019,12,13]],"date-time":"2019-12-13T00:00:00Z","timestamp":1576195200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["CNS 1738758"],"award-info":[{"award-number":["CNS 1738758"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2020,3,31]]},"abstract":"<jats:p>In response to the growing call to bring the powerful ideas of computer science to all learners, education decision makers, including teachers and administrators, are tasked with making consequential decisions on what curricula to use. Often, these decision makers have not been trained in computer science and are unfamiliar with the concepts taught and tools used. This is especially true in K\u201312 contexts where computer science expertise is less prevalent. To aid in the decision-making process around computing curricula, this article introduces the TEC Rubric. The TEC Rubric is composed of three main categories: Teacher Accessibility, Equity, and Content designed to support educational decision makers and designers when it comes to computing instruction. Along with presenting the full rubric and the process used in its creation, this article describes two examples of the rubric in action. First, the TEC Rubric is used to evaluate two widespread computer science curricula to demonstrate its evaluative capacity highlighting differences between the two curricula. Second, we show how the TEC Rubric can be used to help inform the design of new K\u201312 computing curricula. Overall, the TEC Rubric is designed to serve as a useful resource in the ongoing quest to bring effective, equitable, and engaging computing instruction into schools around the world.<\/jats:p>","DOI":"10.1145\/3371155","type":"journal-article","created":{"date-parts":[[2019,12,13]],"date-time":"2019-12-13T14:08:57Z","timestamp":1576246137000},"page":"1-30","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":24,"title":["The Teacher Accessibility, Equity, and Content (TEC) Rubric for Evaluating Computing Curricula"],"prefix":"10.1145","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3009-3899","authenticated-orcid":false,"given":"David","family":"Weintrop","sequence":"first","affiliation":[{"name":"University of Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Merijke","family":"Coenraad","sequence":"additional","affiliation":[{"name":"University of Maryland, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jen","family":"Palmer","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diana","family":"Franklin","sequence":"additional","affiliation":[{"name":"University of Chicago, Chicago, IL, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2019,12,13]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"AchieveNJ. 2016. The New Jersey Student Learning Standards for Science. https:\/\/www.state.nj.us\/education\/aps\/cccs\/science\/ScienceInstructionCompanion.pdf.  AchieveNJ. 2016. The New Jersey Student Learning Standards for Science. https:\/\/www.state.nj.us\/education\/aps\/cccs\/science\/ScienceInstructionCompanion.pdf."},{"key":"e_1_2_1_2_1","volume-title":"Association for Computing Machinery","author":"Joint Task Force on Computing Curricula","year":"2013","unstructured":"Joint Task Force on Computing Curricula , Association for Computing Machinery ( ACM) and IEEE Computer Society . 2013 . Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science. ACM, New York, NY, USA. Joint Task Force on Computing Curricula, Association for Computing Machinery (ACM) and IEEE Computer Society. 2013. Computer Science Curricula 2013: Curriculum Guidelines for Undergraduate Degree Programs in Computer Science. ACM, New York, NY, USA."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.3200\/CTCH.53.1.27-31"},{"key":"e_1_2_1_4_1","volume-title":"Tech: The Facts","author":"Ashcraft C.","year":"2016","unstructured":"C. Ashcraft 2016 . Women in Tech: The Facts . National Center for Women & Technology (NCWIT) . https:\/\/www.ncwit.org\/sites\/default\/files\/resources\/ncwit_women-in-it_2016-full-report_final-web06012016.pdf. C. Ashcraft et al. 2016. Women in Tech: The Facts. National Center for Women & Technology (NCWIT). https:\/\/www.ncwit.org\/sites\/default\/files\/resources\/ncwit_women-in-it_2016-full-report_final-web06012016.pdf."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953193"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.5555\/1862219.1862223"},{"key":"#cr-split#-e_1_2_1_7_1.1","unstructured":"S. Bocconi A. Chioccariello G. Dettori A. Ferrari and K. Engelhardt. 2016. Developing computational thinking in compulsory education -- Implications for policy and practice. EUR 28295 EN. DOI: 10.2791\/792158 10.2791\/792158"},{"key":"#cr-split#-e_1_2_1_7_1.2","unstructured":"S. Bocconi A. Chioccariello G. Dettori A. Ferrari and K. Engelhardt. 2016. Developing computational thinking in compulsory education -- Implications for policy and practice. EUR 28295 EN. DOI: 10.2791\/792158"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X033008003"},{"key":"e_1_2_1_9_1","first-page":"1","article-title":"All roads lead to computing: Making, participatory simulations, and social computing as pathways to computer science","volume":"60","author":"Brady C.","year":"2016","unstructured":"C. Brady 2016 . All roads lead to computing: Making, participatory simulations, and social computing as pathways to computer science . IEEE Trans. Educ. 60 , 99 (2016), 1 -- 8 . DOI:https:\/\/doi.org\/10.1109\/TE.2016.2622680 10.1109\/TE.2016.2622680 C. Brady et al. 2016. All roads lead to computing: Making, participatory simulations, and social computing as pathways to computer science. IEEE Trans. Educ. 60, 99 (2016), 1--8. DOI:https:\/\/doi.org\/10.1109\/TE.2016.2622680","journal-title":"IEEE Trans. Educ."},{"key":"e_1_2_1_10_1","unstructured":"K. Brennan and M. Resnick. 2012. New frameworks for studying and assessing the development of computational thinking. American Educational Research Association Vancouver Canada. http:\/\/web.media.mit.edu\/&sim;kbrennan\/files\/Brennan_Resnick_AERA2012_CT.pdf.  K. Brennan and M. Resnick. 2012. New frameworks for studying and assessing the development of computational thinking. American Educational Research Association Vancouver Canada. http:\/\/web.media.mit.edu\/&sim;kbrennan\/files\/Brennan_Resnick_AERA2012_CT.pdf."},{"key":"e_1_2_1_11_1","volume-title":"Curriculum materials matter: Evaluating the evaluation process","author":"Briars D. J.","year":"2014","unstructured":"D. J. Briars . 2014. Curriculum materials matter: Evaluating the evaluation process . National Council of Teachers of Mathematics . ( 2014 ). https:\/\/www.nctm.org\/News-and-Calendar\/Messages-from-the-President\/Archive\/Diane-Briars\/Curriculum-Materials-Matter_-Evaluating-the-Evaluation-Process\/. D. J. Briars. 2014. Curriculum materials matter: Evaluating the evaluation process. National Council of Teachers of Mathematics. (2014). https:\/\/www.nctm.org\/News-and-Calendar\/Messages-from-the-President\/Archive\/Diane-Briars\/Curriculum-Materials-Matter_-Evaluating-the-Evaluation-Process\/."},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1357054.1357123"},{"key":"e_1_2_1_13_1","unstructured":"R. Bybee and C. Chopyak. 2017. Instructional Materials and Implementation of NGSS: Demand Supply and Strategic Opportunities. A report for the Carnegie Corporation of New York. https:\/\/www.carnegie.org\/media\/filer_public\/6b\/57\/6b57c995-e6c7-485d-ad17-dcd807a19926\/ngss_report_carnegie_corp_72017.pdf.  R. Bybee and C. Chopyak. 2017. Instructional Materials and Implementation of NGSS: Demand Supply and Strategic Opportunities. A report for the Carnegie Corporation of New York. https:\/\/www.carnegie.org\/media\/filer_public\/6b\/57\/6b57c995-e6c7-485d-ad17-dcd807a19926\/ngss_report_carnegie_corp_72017.pdf."},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899449"},{"key":"e_1_2_1_15_1","unstructured":"C. E. Coburn W. R. Penuel and K. E. Geil. 2013. Research-Practice Partnerships: A Strategy for Leveraging Research for Educational Improvement in School Districts. William T. Grant Foundation New York NY.  C. E. Coburn W. R. Penuel and K. E. Geil. 2013. Research-Practice Partnerships: A Strategy for Leveraging Research for Educational Improvement in School Districts. William T. Grant Foundation New York NY."},{"key":"e_1_2_1_16_1","unstructured":"CodeHS. 2019. https:\/\/codehs.com\/.  CodeHS. 2019. https:\/\/codehs.com\/."},{"key":"e_1_2_1_17_1","unstructured":"Computer Science Teaching Rubric. 2019. https:\/\/sites.google.com\/sfusd.edu\/csplc\/resources\/teaching-rubric.  Computer Science Teaching Rubric. 2019. https:\/\/sites.google.com\/sfusd.edu\/csplc\/resources\/teaching-rubric."},{"key":"e_1_2_1_18_1","volume-title":"Proceedings of the 11th Koli Calling International Conference on Computing Education Research -- (Koli Calling\u201911)","author":"Crick T.","unstructured":"T. Crick and S. Sentance . 2011. Computing at school: Stimulating computing education in the UK . In Proceedings of the 11th Koli Calling International Conference on Computing Education Research -- (Koli Calling\u201911) . 122. T. Crick and S. Sentance. 2011. Computing at school: Stimulating computing education in the UK. In Proceedings of the 11th Koli Calling International Conference on Computing Education Research -- (Koli Calling\u201911). 122."},{"key":"e_1_2_1_19_1","volume-title":"CSTA K--12 Computer Science Standards (Revised","author":"CSTA Standards Task Force","year":"2016","unstructured":"CSTA Standards Task Force . 2016. CSTA K--12 Computer Science Standards (Revised 2016 ). Association for Computing Machinery . https:\/\/drive.google.com\/open?id&equals;1-dPTAI1yk2HYPKUWZ6DqaM6aVUDa9iby. CSTA Standards Task Force. 2016. CSTA K--12 Computer Science Standards (Revised 2016). Association for Computing Machinery. https:\/\/drive.google.com\/open?id&equals;1-dPTAI1yk2HYPKUWZ6DqaM6aVUDa9iby."},{"key":"e_1_2_1_20_1","volume-title":"Revised","author":"Computer Science Teachers Association","year":"2017","unstructured":"Computer Science Teachers Association . 2017. CSTA K-12 Computer Science Standards , Revised 2017 . Retrieved from http:\/\/www.csteachers.org\/standards. Computer Science Teachers Association. 2017. CSTA K-12 Computer Science Standards, Revised 2017. Retrieved from http:\/\/www.csteachers.org\/standards."},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2011.191"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2809795"},{"key":"e_1_2_1_23_1","first-page":"44","article-title":"Teacher quality and student achievement: A review of state policy evidence","volume":"8","author":"Darling-Hammond L.","year":"2000","unstructured":"L. Darling-Hammond . 2000 . Teacher quality and student achievement: A review of state policy evidence . Educ. Pol. Anal. Arch. 8 , 1 (2000), 44 . L. Darling-Hammond. 2000. Teacher quality and student achievement: A review of state policy evidence. Educ. Pol. Anal. Arch. 8, 1 (2000), 44.","journal-title":"Educ. Pol. Anal. Arch."},{"key":"e_1_2_1_24_1","unstructured":"L. A. Delyser etal 2018. Priming the computer science teacher pump. (2018) 62. https:\/\/drive.google.com\/file\/d\/1DXgpLjl_k87TVpQ0cLusfdjnYySIgIjT\/view?usp&equals;sharing.  L. A. Delyser et al. 2018. Priming the computer science teacher pump. (2018) 62. https:\/\/drive.google.com\/file\/d\/1DXgpLjl_k87TVpQ0cLusfdjnYySIgIjT\/view?usp&equals;sharing."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/2.19833"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1080\/10508406.2014.893434"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 41st ACM Technical Symposium on Computer Science Education. 477--477","author":"Donathan K.","unstructured":"K. Donathan and P. Tymann . 2010. The development and use of scoring rubrics:(or how to grade thousands of exams without losing your mind) . In Proceedings of the 41st ACM Technical Symposium on Computer Science Education. 477--477 . K. Donathan and P. Tymann. 2010. The development and use of scoring rubrics:(or how to grade thousands of exams without losing your mind). In Proceedings of the 41st ACM Technical Symposium on Computer Science Education. 477--477."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538905"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/2483852.2483864"},{"key":"e_1_2_1_30_1","unstructured":"EQuIP. 2013. EQuIP Rubric for Lessons & Units: ELA\/Literacy (Grades 3--5) and ELA (Grades 6--12). http:\/\/www.achieve.org\/files\/EQuIP-ELArubric-06-24-13-FINAL.pdf.  EQuIP. 2013. EQuIP Rubric for Lessons & Units: ELA\/Literacy (Grades 3--5) and ELA (Grades 6--12). http:\/\/www.achieve.org\/files\/EQuIP-ELArubric-06-24-13-FINAL.pdf."},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/2994607"},{"key":"e_1_2_1_32_1","volume-title":"Proceedings of the 49th ACM Technical Symposium on Computer Science Education. ACM","author":"Fancsali C.","unstructured":"C. Fancsali , L. Tigani , P. Toro Isaza , and R. Cole . 2018. A landscape study of computer science education in NYC: early findings and implications for policy and practice . In Proceedings of the 49th ACM Technical Symposium on Computer Science Education. ACM , New York, NY, USA, 44--49. C. Fancsali, L. Tigani, P. Toro Isaza, and R. Cole. 2018. A landscape study of computer science education in NYC: early findings and implications for policy and practice. In Proceedings of the 49th ACM Technical Symposium on Computer Science Education. ACM, New York, NY, USA, 44--49."},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1080\/10665684.2018.1436998"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/1839594.1839613"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953295"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366912"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017760"},{"key":"e_1_2_1_38_1","first-page":"13","article-title":"Why teachers must become change agents","volume":"50","author":"Fullan M. G.","year":"1993","unstructured":"M. G. Fullan . 1993 . Why teachers must become change agents . Educ. Leader. 50 , 6 (1993), 13 . M. G. Fullan. 1993. Why teachers must become change agents. Educ. Leader. 50, 6 (1993), 13.","journal-title":"Educ. Leader."},{"key":"e_1_2_1_39_1","volume-title":"Shut down or restart? The way forward for computing in UK schools","author":"Furber S.","year":"2012","unstructured":"S. Furber . 2012. Shut down or restart? The way forward for computing in UK schools . The Royal Society , London . ( 2012 ). https:\/\/royalsociety.org\/&sim;\/media\/education\/computing-in-schools\/2012-01-12-computing-in-schools.pdf. S. Furber. 2012. Shut down or restart? The way forward for computing in UK schools. The Royal Society, London. (2012). https:\/\/royalsociety.org\/&sim;\/media\/education\/computing-in-schools\/2012-01-12-computing-in-schools.pdf."},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1145\/1721933.1721953"},{"key":"e_1_2_1_41_1","volume-title":"Culturally responsive teaching principles, practices, and effects. Handbook of Urban Education","author":"Gay G.","unstructured":"G. Gay . 2014. Culturally responsive teaching principles, practices, and effects. Handbook of Urban Education . Routledge , 353--372. G. Gay. 2014. Culturally responsive teaching principles, practices, and effects. Handbook of Urban Education. Routledge, 353--372."},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/2189835.2189851"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/1734263.1734272"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538948"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.2190\/2102-5G77-QL77-5506"},{"key":"e_1_2_1_46_1","unstructured":"Google and Gallup. 2015. Images of Computer Science: Perceptions Among Students Parents and Educators in the U.S. https:\/\/services.google.com\/fh\/files\/misc\/images-of-computer-science-report.pdf.  Google and Gallup. 2015. Images of Computer Science: Perceptions Among Students Parents and Educators in the U.S. https:\/\/services.google.com\/fh\/files\/misc\/images-of-computer-science-report.pdf."},{"key":"e_1_2_1_47_1","unstructured":"Google Inc. and Gallup Inc. 2016. Trends in the State of Computer Science in U.S. K--12 Schools. https:\/\/services.google.com\/fh\/files\/misc\/trends-in-the-state-of-computer-science-report.pdf.  Google Inc. and Gallup Inc. 2016. Trends in the State of Computer Science in U.S. K--12 Schools. https:\/\/services.google.com\/fh\/files\/misc\/trends-in-the-state-of-computer-science-report.pdf."},{"key":"e_1_2_1_48_1","volume-title":"Proceedings of the ACM SIGCSE Technical Symposium on Computer Science Education. 267--272","author":"Grover S.","unstructured":"S. Grover and S. Basu . 2017. Measuring student learning in introductory block-based programming: Examining misconceptions of loops, variables, and Boolean logic . In Proceedings of the ACM SIGCSE Technical Symposium on Computer Science Education. 267--272 . S. Grover and S. Basu. 2017. Measuring student learning in introductory block-based programming: Examining misconceptions of loops, variables, and Boolean logic. In Proceedings of the ACM SIGCSE Technical Symposium on Computer Science Education. 267--272."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X12463051"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2602488"},{"key":"e_1_2_1_51_1","doi-asserted-by":"crossref","unstructured":"O. Hazzan etal 2008. A model for high school computer science education: The four key elements that make it! ACM SIGCSE Bull. 40 1 (2008) 281--285.  O. Hazzan et al. 2008. A model for high school computer science education: The four key elements that make it! ACM SIGCSE Bull. 40 1 (2008) 281--285.","DOI":"10.1145\/1352322.1352233"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the 2019 Research on Equity and Sustained Participation in Engineering, Computing, and Technology (RESPECT'19)","author":"Henrick E.","unstructured":"E. Henrick , S. McGee , R. Greenberg , L. Dettori , A. Rasmussen , D. Yanek , and D. Reed . 2019. Assessing the effectiveness of computer science RPPs: The case of CAFE CS . In Proceedings of the 2019 Research on Equity and Sustained Participation in Engineering, Computing, and Technology (RESPECT'19) . E. Henrick, S. McGee, R. Greenberg, L. Dettori, A. Rasmussen, D. Yanek, and D. Reed. 2019. Assessing the effectiveness of computer science RPPs: The case of CAFE CS. In Proceedings of the 2019 Research on Equity and Sustained Participation in Engineering, Computing, and Technology (RESPECT'19)."},{"key":"e_1_2_1_53_1","volume-title":"\u201cways of knowing","author":"Holbert N.","year":"2016","unstructured":"N. Holbert . 2016. Leveraging cultural values and \u201cways of knowing \u201d to increase diversity in maker activities. Int. J. Child-Comput. Interact . 9--10 ( 2016 ), 33--39. DOI:https:\/\/doi.org\/10.1016\/j.ijcci.2016.10.002 10.1016\/j.ijcci.2016.10.002 N. Holbert. 2016. Leveraging cultural values and \u201cways of knowing\u201d to increase diversity in maker activities. Int. J. Child-Comput. Interact. 9--10 (2016), 33--39. DOI:https:\/\/doi.org\/10.1016\/j.ijcci.2016.10.002"},{"key":"e_1_2_1_54_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10649-013-9512-4"},{"key":"e_1_2_1_55_1","unstructured":"L. Hoogstra etal 2011. Wisconsin CREATE Initiative: Year 2 Evaluation. Learning Point Associates. https:\/\/www.air.org\/sites\/default\/files\/downloads\/report\/CREATE_Year_2_Evaluation_Report-September_2011_FINAL_0.pdf.  L. Hoogstra et al. 2011. Wisconsin CREATE Initiative: Year 2 Evaluation. Learning Point Associates. https:\/\/www.air.org\/sites\/default\/files\/downloads\/report\/CREATE_Year_2_Evaluation_Report-September_2011_FINAL_0.pdf."},{"key":"e_1_2_1_56_1","first-page":"471","article-title":"School-embedded and district-wide instructional coaching in K--8 computer science: Implications for including students with disabilities","volume":"26","author":"Israel M.","year":"2018","unstructured":"M. Israel 2018 . School-embedded and district-wide instructional coaching in K--8 computer science: Implications for including students with disabilities . J. Technol. Teach. Educ. 26 , 3 (2018), 471 -- 501 . M. Israel et al. 2018. School-embedded and district-wide instructional coaching in K--8 computer science: Implications for including students with disabilities. J. Technol. Teach. Educ. 26, 3 (2018), 471--501.","journal-title":"J. Technol. Teach. Educ."},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2014.11.022"},{"key":"e_1_2_1_58_1","unstructured":"S. P. Jones etal 2011. Computing at school. Int. Compar. 7 (2011).  S. P. Jones et al. 2011. Computing at school. Int. Compar. 7 (2011)."},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1080\/02602938.2013.875117"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.edurev.2007.05.002"},{"key":"e_1_2_1_61_1","unstructured":"K--12 Computer Science Framework. 2016. http:\/\/www.k12cs.org.  K--12 Computer Science Framework. 2016. http:\/\/www.k12cs.org."},{"key":"e_1_2_1_62_1","first-page":"60","article-title":"What is technological pedagogical content knowledge (TPACK)","volume":"9","author":"Koehler M.","year":"2009","unstructured":"M. Koehler and P. Mishra . 2009 . What is technological pedagogical content knowledge (TPACK) ? Contemp. Iss. Technol. Teach. Educ. 9 , 1 (2009), 60 -- 70 . M. Koehler and P. Mishra. 2009. What is technological pedagogical content knowledge (TPACK)? Contemp. Iss. Technol. Teach. Educ. 9, 1 (2009), 60--70.","journal-title":"Contemp. Iss. Technol. Teach. Educ."},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2018.1429062"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1145\/2971329"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.2307\/2529310"},{"key":"e_1_2_1_66_1","volume-title":"Proceedings of the ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u201917)","author":"Leake M.","unstructured":"M. Leake and C. M. Lewis . 2017. Recommendations for designing CS resource sharing sites for all teachers . In Proceedings of the ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u201917) . 357--362. M. Leake and C. M. Lewis. 2017. Recommendations for designing CS resource sharing sites for all teachers. In Proceedings of the ACM SIGCSE Technical Symposium on Computer Science Education (SIGCSE\u201917). 357--362."},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1145\/2684721.2684736"},{"key":"e_1_2_1_68_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2012.721663"},{"key":"e_1_2_1_69_1","unstructured":"R. B. Lindsey etal 2008. Culturally Proficient Inquiry: A Lens for Identifying and Examining Educational Gaps. Corwin Press.  R. B. Lindsey et al. 2008. Culturally Proficient Inquiry: A Lens for Identifying and Examining Educational Gaps. Corwin Press."},{"key":"e_1_2_1_70_1","first-page":"19","article-title":"Writing standards-based rubrics for technology education classrooms: The use of rubrics goes beyond the simple need for objective grading in classrooms","volume":"65","author":"Loveland T. R.","year":"2005","unstructured":"T. R. Loveland . 2005 . Writing standards-based rubrics for technology education classrooms: The use of rubrics goes beyond the simple need for objective grading in classrooms . Technol. Teach. 65 , 2 (2005), 19 -- 23 . T. R. Loveland. 2005. Writing standards-based rubrics for technology education classrooms: The use of rubrics goes beyond the simple need for objective grading in classrooms. Technol. Teach. 65, 2 (2005), 19--23.","journal-title":"Technol. Teach."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/1352322.1352260"},{"key":"e_1_2_1_72_1","volume-title":"Stuck in the Shallow End: Education, Race, and Computing","author":"Margolis J.","unstructured":"J. Margolis . 2008. Stuck in the Shallow End: Education, Race, and Computing . The MIT Press . J. Margolis. 2008. Stuck in the Shallow End: Education, Race, and Computing. The MIT Press."},{"key":"e_1_2_1_73_1","volume-title":"Clubhouse: Women in Computing","author":"Margolis J.","year":"2003","unstructured":"J. Margolis and A. Fisher . 2003 . Unlocking the Clubhouse: Women in Computing . The MIT Press . J. Margolis and A. Fisher. 2003. Unlocking the Clubhouse: Women in Computing. The MIT Press."},{"key":"e_1_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10763-009-9174-y"},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1145\/384266.299751"},{"key":"e_1_2_1_76_1","volume-title":"Proceedings of the 19th Conference on Software Engineering Education and Training Workshops (CSEETW\u201906)","author":"Mitchell S. M.","unstructured":"S. M. Mitchell and W. G. Lutters . 2006. Assessing the value of computer science course material repositories . In Proceedings of the 19th Conference on Software Engineering Education and Training Workshops (CSEETW\u201906) . 2--2. S. M. Mitchell and W. G. Lutters. 2006. Assessing the value of computer science course material repositories. In Proceedings of the 19th Conference on Software Engineering Education and Training Workshops (CSEETW\u201906). 2--2."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1080\/00405849209543534"},{"key":"e_1_2_1_78_1","first-page":"71","article-title":"Scoring rubric development: Validity and reliability","volume":"7","author":"Moskal B. M.","year":"2000","unstructured":"B. M. Moskal and J. A. Leydens . 2000 . Scoring rubric development: Validity and reliability . Pract. Assess., Res. Eval. 7 , 10 (2000), 71 -- 81 . B. M. Moskal and J. A. Leydens. 2000. Scoring rubric development: Validity and reliability. Pract. Assess., Res. Eval. 7, 10 (2000), 71--81.","journal-title":"Pract. Assess., Res. Eval."},{"key":"e_1_2_1_79_1","volume-title":"Engineering, and Medicine","author":"National Academies of Sciences","year":"2018","unstructured":"National Academies of Sciences , Engineering, and Medicine . 2018 . Design, Selection , and Implementation of Instructional Materials for the Next Generation Science Standards: Proceedings of a Workshop. The National Academies Press , Washington, DC. https:\/\/doi.org\/10.17226\/25001 10.17226\/25001 National Academies of Sciences, Engineering, and Medicine. 2018. Design, Selection, and Implementation of Instructional Materials for the Next Generation Science Standards: Proceedings of a Workshop. The National Academies Press, Washington, DC. https:\/\/doi.org\/10.17226\/25001"},{"key":"e_1_2_1_80_1","volume-title":"What Matters Most: Teaching for America's Future. Report of the National Commission on Teaching 8 America's Future. National Commission on Teaching and America's Future","author":"National Commission on Teaching and America's Future. 1996.","unstructured":"National Commission on Teaching and America's Future. 1996. What Matters Most: Teaching for America's Future. Report of the National Commission on Teaching 8 America's Future. National Commission on Teaching and America's Future , Woodbridge, VA . National Commission on Teaching and America's Future. 1996. What Matters Most: Teaching for America's Future. Report of the National Commission on Teaching 8 America's Future. National Commission on Teaching and America's Future, Woodbridge, VA."},{"key":"e_1_2_1_81_1","volume-title":"Proceedings of the 43rd ACM Technical Symposium on Computer Science Education (SIGCSE\u201912)","author":"Ni L.","unstructured":"L. Ni and M. Guzdial . 2012. Who AM I?: Understanding high school computer science teachers\u2019 professional identity . In Proceedings of the 43rd ACM Technical Symposium on Computer Science Education (SIGCSE\u201912) . 499. L. Ni and M. Guzdial. 2012. Who AM I?: Understanding high school computer science teachers\u2019 professional identity. In Proceedings of the 43rd ACM Technical Symposium on Computer Science Education (SIGCSE\u201912). 499."},{"key":"e_1_2_1_82_1","doi-asserted-by":"publisher","DOI":"10.1145\/1965724.1965737"},{"key":"e_1_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.edurev.2013.01.002"},{"key":"e_1_2_1_84_1","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1080\/0969594X.2013.877872","article-title":"To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy","volume":"21","author":"Panadero E.","year":"2014","unstructured":"E. Panadero and M. Romero . 2014 . To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy . Assess. Educ.: Princ., Polic. Pract. 21 , 2 (2014), 133 -- 148 . E. Panadero and M. Romero. 2014. To rubric or not to rubric? The effects of self-assessment on self-regulation, performance and self-efficacy. Assess. Educ.: Princ., Polic. Pract. 21, 2 (2014), 133--148.","journal-title":"Assess. Educ.: Princ., Polic. Pract."},{"key":"e_1_2_1_85_1","unstructured":"W. R. Penuel and D. J. Gallagher. 2017. Creating Research Practice Partnerships in Education. Harvard Education Press.  W. R. Penuel and D. J. Gallagher. 2017. Creating Research Practice Partnerships in Education. Harvard Education Press."},{"key":"e_1_2_1_86_1","volume-title":"US: Computer science deserves a designated high school teacher preparation! In Proceedings of the 41st ACM Technical Symposium on Computer Science Education. 401--405.","author":"Ragonis N.","year":"2010","unstructured":"N. Ragonis 2010 . A survey of computer science teacher preparation programs in Israel tells US: Computer science deserves a designated high school teacher preparation! In Proceedings of the 41st ACM Technical Symposium on Computer Science Education. 401--405. N. Ragonis et al. 2010. A survey of computer science teacher preparation programs in Israel tells US: Computer science deserves a designated high school teacher preparation! In Proceedings of the 41st ACM Technical Symposium on Computer Science Education. 401--405."},{"key":"e_1_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1145\/2716325"},{"key":"e_1_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592761.1592779"},{"key":"e_1_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287396"},{"key":"e_1_2_1_90_1","doi-asserted-by":"publisher","DOI":"10.1145\/3230977.3230979"},{"key":"e_1_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1145\/3105726.3106166"},{"key":"e_1_2_1_92_1","doi-asserted-by":"crossref","unstructured":"R. Roque etal 2016. Supporting diverse and creative collaboration in the scratch online community. Mass Collaboration and Education. Springer 241--256.  R. Roque et al. 2016. Supporting diverse and creative collaboration in the scratch online community. Mass Collaboration and Education. Springer 241--256.","DOI":"10.1007\/978-3-319-13536-6_12"},{"key":"e_1_2_1_93_1","doi-asserted-by":"publisher","DOI":"10.1177\/016264340001500407"},{"key":"e_1_2_1_94_1","volume-title":"Digital Age: Universal Design for Learning.","author":"Rose D. H.","year":"2002","unstructured":"D. H. Rose and A. Meyer . 2002 . Teaching Every Student in the Digital Age: Universal Design for Learning. D. H. Rose and A. Meyer. 2002. Teaching Every Student in the Digital Age: Universal Design for Learning."},{"key":"e_1_2_1_95_1","doi-asserted-by":"publisher","DOI":"10.1080\/17439884.2013.756514"},{"key":"e_1_2_1_96_1","volume-title":"Proceedings of the 9th International ACM Conference on International Computing Education Research. 59--66","author":"Seiter L.","unstructured":"L. Seiter and B. Foreman . 2013. Modeling the learning progressions of computational thinking of primary grade students . In Proceedings of the 9th International ACM Conference on International Computing Education Research. 59--66 . L. Seiter and B. Foreman. 2013. Modeling the learning progressions of computational thinking of primary grade students. In Proceedings of the 9th International ACM Conference on International Computing Education Research. 59--66."},{"key":"e_1_2_1_97_1","doi-asserted-by":"publisher","DOI":"10.1145\/2481449.2481469"},{"key":"e_1_2_1_98_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10639-016-9482-0"},{"key":"e_1_2_1_99_1","doi-asserted-by":"publisher","DOI":"10.1145\/2325296.2325306"},{"key":"e_1_2_1_100_1","doi-asserted-by":"publisher","DOI":"10.3102\/0013189X015002004"},{"key":"e_1_2_1_101_1","unstructured":"M. Singer and J. Tuomi. 1999. Selecting Instructional Materials. National Academies Press.  M. Singer and J. Tuomi. 1999. Selecting Instructional Materials. National Academies Press."},{"key":"e_1_2_1_102_1","volume-title":"Rubrics: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning","author":"Stevens D. D.","year":"2013","unstructured":"D. D. Stevens and A. J. Levi . 2013 . Introduction to Rubrics: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning . Stylus Publishing , LLC. D. D. Stevens and A. J. Levi. 2013. Introduction to Rubrics: An Assessment Tool to Save Grading Time, Convey Effective Feedback, and Promote Student Learning. Stylus Publishing, LLC."},{"key":"e_1_2_1_103_1","unstructured":"The College Board. 2018. About AP Scores. https:\/\/apstudents.collegeboard.org\/about-ap-scores.  The College Board. 2018. About AP Scores. https:\/\/apstudents.collegeboard.org\/about-ap-scores."},{"key":"e_1_2_1_104_1","unstructured":"The College Board. 2017. AP National Summary Report. https:\/\/research.collegeboard.org\/programs\/ap\/data.  The College Board. 2017. AP National Summary Report. https:\/\/research.collegeboard.org\/programs\/ap\/data."},{"key":"e_1_2_1_105_1","unstructured":"The Framework for Teaching Evaluation Instrument. 2013. https:\/\/danielsongroup.org\/framework\/framework-teaching.  The Framework for Teaching Evaluation Instrument. 2013. https:\/\/danielsongroup.org\/framework\/framework-teaching."},{"key":"e_1_2_1_106_1","volume-title":"Strategic Planning Tool for School Districts","year":"2018","unstructured":"The SCRIPT : Strategic Planning Tool for School Districts . 2018 . https:\/\/www.csforall.org\/projects_and_programs\/script\/. The SCRIPT: Strategic Planning Tool for School Districts. 2018. https:\/\/www.csforall.org\/projects_and_programs\/script\/."},{"key":"e_1_2_1_107_1","doi-asserted-by":"publisher","DOI":"10.1145\/2445196.2445272"},{"key":"e_1_2_1_108_1","volume-title":"Proceedings of the 2017 ACM Conference on International Computing Education Research (ICER'17)","author":"Wang J.","unstructured":"J. Wang , S. H. Moghadam , and J. Tiffany-Morales . 2017. Social perceptions in computer science and implications for diverse students . In Proceedings of the 2017 ACM Conference on International Computing Education Research (ICER'17) . ACM, New York, NY, USA, 47--55. DOI: https:\/\/doi.org\/10.1145\/3105726.3106175 10.1145\/3105726.3106175 J. Wang, S. H. Moghadam, and J. Tiffany-Morales. 2017. Social perceptions in computer science and implications for diverse students. In Proceedings of the 2017 ACM Conference on International Computing Education Research (ICER'17). ACM, New York, NY, USA, 47--55. DOI: https:\/\/doi.org\/10.1145\/3105726.3106175"},{"key":"e_1_2_1_109_1","volume-title":"Proceedings of the 2020 ACM SIGCSE Technical Symposium on Computer Science Education. ACM","author":"Wheeler E.","unstructured":"E. Wheeler , J. Wachen , A. Rasmussen , D. Franklin , and D. Weintrop . 2020. Introducing computer science into K-8 classrooms: Teachers' perspectives from a large, urban school district . In Proceedings of the 2020 ACM SIGCSE Technical Symposium on Computer Science Education. ACM , New York, NY, USA. DOI: https:\/\/doi.org\/10.1145\/3328778.3372612 10.1145\/3328778.3372612 E. Wheeler, J. Wachen, A. Rasmussen, D. Franklin, and D. Weintrop. 2020. Introducing computer science into K-8 classrooms: Teachers' perspectives from a large, urban school district. In Proceedings of the 2020 ACM SIGCSE Technical Symposium on Computer Science Education. ACM, New York, NY, USA. DOI: https:\/\/doi.org\/10.1145\/3328778.3372612"},{"key":"e_1_2_1_110_1","volume-title":"Proceedings of the ASEE Conference and Exposition.","author":"White V.","year":"2018","unstructured":"V. White 2018 . Illuminating the computing pathway for girls in Mississippi . In Proceedings of the ASEE Conference and Exposition. V. White et al. 2018. Illuminating the computing pathway for girls in Mississippi. In Proceedings of the ASEE Conference and Exposition."},{"key":"e_1_2_1_111_1","volume-title":"Empty: The Failure to Teach K--12 Computer Science in the Digital Age","author":"Wilson C.","year":"2010","unstructured":"C. Wilson 2010 . Running on Empty: The Failure to Teach K--12 Computer Science in the Digital Age . The Association for Computing Machinery and the Computer Science Teachers Association . C. Wilson et al. 2010. Running on Empty: The Failure to Teach K--12 Computer Science in the Digital Age. The Association for Computing Machinery and the Computer Science Teachers Association."},{"key":"e_1_2_1_112_1","doi-asserted-by":"publisher","DOI":"10.1145\/1118178.1118215"},{"key":"e_1_2_1_113_1","doi-asserted-by":"publisher","DOI":"10.1145\/2576872"},{"key":"e_1_2_1_114_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2016.1257418"},{"key":"e_1_2_1_115_1","article-title":"Not all rubrics are equal: A review of rubrics for evaluating the quality of open educational resources","volume":"16","author":"Yuan M.","year":"2015","unstructured":"M. Yuan and M. Recker . 2015 . Not all rubrics are equal: A review of rubrics for evaluating the quality of open educational resources . Int. Rev. Res. Open Distrib. Learn. 16 , 5 (2015). DOI:https:\/\/doi.org\/10.19173\/irrodl.v16i5.2389 10.19173\/irrodl.v16i5.2389 M. Yuan and M. Recker. 2015. Not all rubrics are equal: A review of rubrics for evaluating the quality of open educational resources. Int. Rev. Res. Open Distrib. Learn. 16, 5 (2015). DOI:https:\/\/doi.org\/10.19173\/irrodl.v16i5.2389","journal-title":"Int. Rev. Res. Open Distrib. Learn."},{"key":"e_1_2_1_116_1","first-page":"47","article-title":"2017 Taulbee survey","volume":"30","author":"Zweben S.","year":"2018","unstructured":"S. Zweben and B. Bizot . 2018 . 2017 Taulbee survey . Comput. Res. News 30 , 5 (2018), 47 . S. Zweben and B. Bizot. 2018. 2017 Taulbee survey. Comput. Res. News 30, 5 (2018), 47.","journal-title":"Comput. Res. News"},{"key":"e_1_2_1_117_1","unstructured":"Achieve and National Science Teachers Association. 2016. EQuIP Rubric for Lessons 8 Units: Science Version 3.0. https:\/\/www.nextgenscience.org\/resources\/equip-rubric-science.  Achieve and National Science Teachers Association. 2016. EQuIP Rubric for Lessons 8 Units: Science Version 3.0. https:\/\/www.nextgenscience.org\/resources\/equip-rubric-science."}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3371155","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3371155","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3371155","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T19:05:44Z","timestamp":1750273544000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3371155"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,13]]},"references-count":118,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2020,3,31]]}},"alternative-id":["10.1145\/3371155"],"URL":"https:\/\/doi.org\/10.1145\/3371155","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,13]]},"assertion":[{"value":"2019-05-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-12-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}