{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:33:56Z","timestamp":1750221236087,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":15,"publisher":"ACM","license":[{"start":{"date-parts":[[2018,7,2]],"date-time":"2018-07-02T00:00:00Z","timestamp":1530489600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["1542922, 1252376"],"award-info":[{"award-number":["1542922, 1252376"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2018,7,2]]},"DOI":"10.1145\/3197091.3197134","type":"proceedings-article","created":{"date-parts":[[2018,6,20]],"date-time":"2018-06-20T20:15:46Z","timestamp":1529525746000},"page":"63-68","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":4,"title":["Creation and validation of low-stakes rubrics for K-12 computer science"],"prefix":"10.1145","author":[{"given":"Veronica","family":"Catet\u00e9","sequence":"first","affiliation":[{"name":"North Carolina State University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Lytle","sequence":"additional","affiliation":[{"name":"North Carolina State University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tiffany","family":"Barnes","sequence":"additional","affiliation":[{"name":"North Carolina State University, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2018,7,2]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.stueduc.2006.04.006"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3059042"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899449"},{"key":"e_1_3_2_1_4_1","volume-title":"criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment 6, 4","author":"Cicchetti Domenic V","year":"1994","unstructured":"Domenic V Cicchetti . 1994. Guidelines , criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment 6, 4 ( 1994 ), 284. Domenic V Cicchetti. 1994. Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychological assessment 6, 4 (1994), 284."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3059009.3072989"},{"key":"e_1_3_2_1_6_1","unstructured":"A.L. Delbecq A.H. Van de Ven and D.H. Gustafson. 1986. Group techniques for program planning: a guide to nominal group and Delphi processes. Green Briar Press Middleton WI.  A.L. Delbecq A.H. Van de Ven and D.H. Gustafson. 1986. Group techniques for program planning: a guide to nominal group and Delphi processes. Green Briar Press Middleton WI."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2670757.2670781"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/0030-5073(73)90052-4"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2493394.2493408"},{"key":"e_1_3_2_1_10_1","volume-title":"Tully","author":"McMillan Sara S.","year":"2016","unstructured":"Sara S. McMillan , Michelle King , and Mary P . Tully . 2016 . How to use the nominal group and Delphi techniques. IJ of Clinical Pharmacy 38, 3 (01 Jun 2016), 655\u2013662. Sara S. McMillan, Michelle King, and Mary P. Tully. 2016. How to use the nominal group and Delphi techniques. IJ of Clinical Pharmacy 38, 3 (01 Jun 2016), 655\u2013662."},{"key":"e_1_3_2_1_11_1","unstructured":"Sammuel Messick. 1996. Techinical Issues in Large-Scale Performance Assessment. ERIC Reports-descriptive Validity of Performance Assessments.  Sammuel Messick. 1996. Techinical Issues in Large-Scale Performance Assessment. ERIC Reports-descriptive Validity of Performance Assessments."},{"key":"e_1_3_2_1_12_1","volume-title":"Prepare and Support Computer Science (CS) Teachers: Understanding CS Teachers\u2019 Professional Identity. In American Educational Research Association (AERA) Annual Meeting.","author":"Ni Lijun","year":"2001","unstructured":"Lijun Ni and Mark Guzdial . 2001 . Prepare and Support Computer Science (CS) Teachers: Understanding CS Teachers\u2019 Professional Identity. In American Educational Research Association (AERA) Annual Meeting. Lijun Ni and Mark Guzdial. 2001. Prepare and Support Computer Science (CS) Teachers: Understanding CS Teachers\u2019 Professional Identity. In American Educational Research Association (AERA) Annual Meeting."},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2674683.2674702"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999541.2999555"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2818048.2819953"}],"event":{"name":"ITiCSE '18: 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Larnaca Cyprus","acronym":"ITiCSE '18"},"container-title":["Proceedings of the 23rd Annual ACM Conference on Innovation and Technology in Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197091.3197134","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3197091.3197134","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3197091.3197134","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T02:07:15Z","timestamp":1750212435000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3197091.3197134"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,7,2]]},"references-count":15,"alternative-id":["10.1145\/3197091.3197134","10.1145\/3197091"],"URL":"https:\/\/doi.org\/10.1145\/3197091.3197134","relation":{},"subject":[],"published":{"date-parts":[[2018,7,2]]},"assertion":[{"value":"2018-07-02","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}