{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:19:43Z","timestamp":1750220383084,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":34,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,2,22]],"date-time":"2022-02-22T00:00:00Z","timestamp":1645488000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["1348866"],"award-info":[{"award-number":["1348866"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,2,22]]},"DOI":"10.1145\/3478431.3499315","type":"proceedings-article","created":{"date-parts":[[2022,2,23]],"date-time":"2022-02-23T00:53:28Z","timestamp":1645577608000},"page":"64-70","source":"Crossref","is-referenced-by-count":0,"title":["Multilingual CS Education Pathways"],"prefix":"10.1145","author":[{"given":"Yvonne","family":"Kao","sequence":"first","affiliation":[{"name":"WestEd, San Francisco, CA, USA"}]},{"given":"David","family":"Weintrop","sequence":"additional","affiliation":[{"name":"University of Maryland, College Park, MD, USA"}]}],"member":"320","published-online":{"date-parts":[[2022,2,22]]},"reference":[{"volume-title":"Rules of the Mind","author":"Anderson John R.","key":"e_1_3_2_1_1_1","unstructured":"John R. Anderson . 1993. Rules of the Mind . Lawrence Erlbaum Associates , Hillsdale, NJ . John R. Anderson. 1993. Rules of the Mind .Lawrence Erlbaum Associates, Hillsdale, NJ."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/2677087"},{"key":"e_1_3_2_1_3_1","article-title":"From Scratch to \"Real","volume":"14","author":"Armoni Michal","year":"2015","unstructured":"Michal Armoni , Orni Meerbaum-Salant , and Mordechai Ben-Ari . 2015 b. From Scratch to \"Real \" Programming. ACM Trans. Comput. Educ. , Vol. 14 , 4, Article 25 (Feb. 2015), bibinfonumpages15 pages. https:\/\/doi.org\/10.1145\/2677087 Michal Armoni, Orni Meerbaum-Salant, and Mordechai Ben-Ari. 2015b. From Scratch to \"Real\" Programming. ACM Trans. Comput. Educ. , Vol. 14, 4, Article 25 (Feb. 2015), bibinfonumpages15 pages. https:\/\/doi.org\/10.1145\/2677087","journal-title":"Programming. ACM Trans. Comput. Educ."},{"key":"e_1_3_2_1_4_1","volume-title":"American Psychological Association, and National Council on Measurement in Education","author":"American Educational Research Association","year":"2014","unstructured":"American Educational Research Association , American Psychological Association, and National Council on Measurement in Education . 2014 . Standards for Educational and Psychological Testing .AERA, Washington, DC. American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. 2014. Standards for Educational and Psychological Testing .AERA, Washington, DC."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2017.03.001"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/FIE.2008.4720254"},{"key":"e_1_3_2_1_7_1","unstructured":"Smarter Balanced Assessment Consortium. 2019. Interpretive Guide for English Language Arts\/Literacy and Mathematics Assessments . https:\/\/portal.smarterbalanced.org\/library\/en\/reporting-system-interpretive-guide.pdf  Smarter Balanced Assessment Consortium. 2019. Interpretive Guide for English Language Arts\/Literacy and Mathematics Assessments . https:\/\/portal.smarterbalanced.org\/library\/en\/reporting-system-interpretive-guide.pdf"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157148"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157180"},{"volume-title":"Proceedings of the 50th ACM Technical Symposium on Computer Science Education","author":"Decker Adrienne","key":"e_1_3_2_1_10_1","unstructured":"Adrienne Decker and Monica M . McGill. 2019. A Topical Review of Evaluation Instruments for Computing Education . In Proceedings of the 50th ACM Technical Symposium on Computer Science Education ( Minneapolis, MN, USA) (SIGCSE '19). Association for Computing Machinery, New York, NY, USA, 558--564. https:\/\/doi.org\/10.1145\/3287324.3287393 Adrienne Decker and Monica M. McGill. 2019. A Topical Review of Evaluation Instruments for Computing Education. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (Minneapolis, MN, USA) (SIGCSE '19). Association for Computing Machinery, New York, NY, USA, 558--564. https:\/\/doi.org\/10.1145\/3287324.3287393"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953200"},{"volume-title":"Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education","author":"Farghally Mohammed F.","key":"e_1_3_2_1_13_1","unstructured":"Mohammed F. Farghally , Kyu Han Koh , Jeremy V. Ernst , and Clifford A. Shaffer . 2017. Towards a Concept Inventory for Algorithm Analysis Topics . In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education ( Seattle, Washington, USA) (SIGCSE '17). Association for Computing Machinery, New York, NY, USA, 207--212. https:\/\/doi.org\/10.1145\/3017680.3017756 Mohammed F. Farghally, Kyu Han Koh, Jeremy V. Ernst, and Clifford A. Shaffer. 2017. Towards a Concept Inventory for Algorithm Analysis Topics. In Proceedings of the 2017 ACM SIGCSE Technical Symposium on Computer Science Education (Seattle, Washington, USA) (SIGCSE '17). Association for Computing Machinery, New York, NY, USA, 207--212. https:\/\/doi.org\/10.1145\/3017680.3017756"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1145\/3328778.3366912"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/2835184"},{"key":"e_1_3_2_1_16_1","unstructured":"Mark Guzdial. 2019. We Should Stop Saying 'Language Independent.' We Don't Know How To Do That . https:\/\/cacm.acm.org\/blogs\/blog-cacm\/238782-we-should-stop-saying-language-independent-we-dont-know-how-to-do-that\/fulltext  Mark Guzdial. 2019. We Should Stop Saying 'Language Independent.' We Don't Know How To Do That . https:\/\/cacm.acm.org\/blogs\/blog-cacm\/238782-we-should-stop-saying-language-independent-we-dont-know-how-to-do-that\/fulltext"},{"key":"e_1_3_2_1_17_1","volume-title":"Proc. Constructionism","author":"Harvey Brian","year":"2010","unstructured":"Brian Harvey and Jens M\u00f6nig . 2010 . Bringing \"no ceiling\" to scratch: Can one language serve kids and computer scientists . Proc. Constructionism (2010), 1--10. Brian Harvey and Jens M\u00f6nig. 2010. Bringing \"no ceiling\" to scratch: Can one language serve kids and computer scientists. Proc. Constructionism (2010), 1--10."},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094428105284919"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40692-018-0101-5"},{"key":"e_1_3_2_1_21_1","volume-title":"Bernstein","author":"Nunnally Jum","year":"1994","unstructured":"Jum Nunnally and Ira H . Bernstein . 1994 . Psychometric Theory: 3 rd Edition .McGraw-Hill Education . Jum Nunnally and Ira H. Bernstein. 1994. Psychometric Theory: 3rd Edition .McGraw-Hill Education.","edition":"3"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960316"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408877.3432376"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1145\/3291279.3339404"},{"key":"e_1_3_2_1_25_1","article-title":"Development and validation of the middle grades computer science concept inventory (MG-CSCI) assessment","volume":"16","author":"Rachmatullah Arif","year":"2020","unstructured":"Arif Rachmatullah , Bita Akram , Danielle Boulden , Bradford Mott , Kristy Boyer , James Lester , and Eric Wiebe . 2020 . Development and validation of the middle grades computer science concept inventory (MG-CSCI) assessment . Eurasia Journal of Mathematics, Science and Technology Education , Vol. 16 , 5 (2020). https:\/\/doi.org\/10.29333\/ejmste\/116600 Arif Rachmatullah, Bita Akram, Danielle Boulden, Bradford Mott, Kristy Boyer, James Lester, and Eric Wiebe. 2020. Development and validation of the middle grades computer science concept inventory (MG-CSCI) assessment. Eurasia Journal of Mathematics, Science and Technology Education , Vol. 16, 5 (2020). https:\/\/doi.org\/10.29333\/ejmste\/116600","journal-title":"Eurasia Journal of Mathematics, Science and Technology Education"},{"key":"e_1_3_2_1_26_1","first-page":"2017.1.0270","volume-title":"Educational Sciences: Theory & Practice","volume":"17","author":"Sahin Alper","year":"2017","unstructured":"Alper Sahin and Duygu Anil . 2017 . The effects of test length and sample size on item parameters in item response theory . Educational Sciences: Theory & Practice , Vol. 17 , 1 (2017). https:\/\/doi.org\/10.12738\/estp. 2017.1.0270 Alper Sahin and Duygu Anil. 2017. The effects of test length and sample size on item parameters in item response theory. Educational Sciences: Theory & Practice , Vol. 17, 1 (2017). https:\/\/doi.org\/10.12738\/estp.2017.1.0270"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538901"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1080\/10447319009525970"},{"key":"e_1_3_2_1_29_1","unstructured":"Exploring Computer Science. [n.d.]. What is ECS? http:\/\/www.exploringcs.org\/  Exploring Computer Science. [n.d.]. What is ECS? http:\/\/www.exploringcs.org\/"},{"volume-title":"Visual program simulation in introductory programming education","author":"Sorva Juha","key":"e_1_3_2_1_30_1","unstructured":"Juha Sorva . 2012. Visual program simulation in introductory programming education ; Visuaalinen ohjelmasimulaatio ohjelmoinnin alkeisopetuksessa . G4 Monografiav\u00e4it\u00f6skirja . http:\/\/urn.fi\/URN:ISBN:978--952--60--4626--6 Juha Sorva. 2012. Visual program simulation in introductory programming education; Visuaalinen ohjelmasimulaatio ohjelmoinnin alkeisopetuksessa . G4 Monografiav\u00e4it\u00f6skirja. http:\/\/urn.fi\/URN:ISBN:978--952--60--4626--6"},{"volume-title":"Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education","author":"Vivian Rebecca","key":"e_1_3_2_1_31_1","unstructured":"Rebecca Vivian , Diana Franklin , Dave Frye , Alan Peterfreund , Jason Ravitz , Florence Sullivan , Melissa Zeitz , and Monica M . McGill. 2020. Evaluation and Assessment Needs of Computing Education in Primary Grades . In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education ( Trondheim, Norway) (ITiCSE '20). Association for Computing Machinery, New York, NY, USA, 124--130. https:\/\/doi.org\/10.1145\/3341525.3387371 Rebecca Vivian, Diana Franklin, Dave Frye, Alan Peterfreund, Jason Ravitz, Florence Sullivan, Melissa Zeitz, and Monica M. McGill. 2020. Evaluation and Assessment Needs of Computing Education in Primary Grades. In Proceedings of the 2020 ACM Conference on Innovation and Technology in Computer Science Education (Trondheim, Norway) (ITiCSE '20). Association for Computing Machinery, New York, NY, USA, 124--130. https:\/\/doi.org\/10.1145\/3341525.3387371"},{"key":"e_1_3_2_1_32_1","volume-title":"13th International Conference of the Learning Sciences (ICLS) 2018","author":"Weintrop David","year":"2018","unstructured":"David Weintrop , Heather Killen , and Baker E Franke . 2018 . Blocks or Text? How programming language modality makes a difference in assessing underrepresented populations. In Rethinking Learning in the Digital Age: Making the Learning Sciences Count , 13th International Conference of the Learning Sciences (ICLS) 2018 . International Society of the Learning Sciences. https:\/\/doi.org\/10.22318\/cscl 2018.328 David Weintrop, Heather Killen, and Baker E Franke. 2018. Blocks or Text? How programming language modality makes a difference in assessing underrepresented populations. In Rethinking Learning in the Digital Age: Making the Learning Sciences Count, 13th International Conference of the Learning Sciences (ICLS) 2018. International Society of the Learning Sciences. https:\/\/doi.org\/10.22318\/cscl2018.328"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1145\/2787622.2787721"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compedu.2019.103646"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2157136.2157200"},{"volume-title":"Proceedings of the 50th ACM Technical Symposium on Computer Science Education","author":"Wiebe Eric","key":"e_1_3_2_1_36_1","unstructured":"Eric Wiebe , Jennifer London , Osman Aksit , Bradford W. Mott , Kristy Elizabeth Boyer , and James C. Lester . 2019. Development of a Lean Computational Thinking Abilities Assessment for Middle Grades Students . In Proceedings of the 50th ACM Technical Symposium on Computer Science Education ( Minneapolis, MN, USA) (SIGCSE '19). Association for Computing Machinery, New York, NY, USA, 456--461. https:\/\/doi.org\/10.1145\/3287324.3287390 Eric Wiebe, Jennifer London, Osman Aksit, Bradford W. Mott, Kristy Elizabeth Boyer, and James C. Lester. 2019. Development of a Lean Computational Thinking Abilities Assessment for Middle Grades Students. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education (Minneapolis, MN, USA) (SIGCSE '19). Association for Computing Machinery, New York, NY, USA, 456--461. https:\/\/doi.org\/10.1145\/3287324.3287390"}],"event":{"name":"SIGCSE 2022: The 53rd ACM Technical Symposium on Computer Science Education","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"],"location":"Providence RI USA","acronym":"SIGCSE 2022"},"container-title":["Proceedings of the 53rd ACM Technical Symposium on Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478431.3499315","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3478431.3499315","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:26Z","timestamp":1750191506000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3478431.3499315"}},"subtitle":["Implications for Vertically-Scaled Assessment"],"short-title":[],"issued":{"date-parts":[[2022,2,22]]},"references-count":34,"alternative-id":["10.1145\/3478431.3499315","10.1145\/3478431"],"URL":"https:\/\/doi.org\/10.1145\/3478431.3499315","relation":{},"subject":[],"published":{"date-parts":[[2022,2,22]]}}}