{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T16:05:02Z","timestamp":1784822702370,"version":"3.55.0"},"reference-count":63,"publisher":"Association for Computing Machinery (ACM)","issue":"1","license":[{"start":{"date-parts":[[2021,1,19]],"date-time":"2021-01-19T00:00:00Z","timestamp":1611014400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Korea Education and Research Service (KERIS)"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Comput. Educ."],"published-print":{"date-parts":[[2021,3,31]]},"abstract":"<jats:p>As Information and Communication Technology (ICT) literacy education has recently shifted to fostering computing thinking ability as well as ICT use, many countries are conducting research on national curriculum and evaluation. In this study, we measured Korean students\u2019 ICT literacy levels by using the national measurement tool that assesses abilities of the IT (Information Technology) area and the CT (Computational Thinking) area. A research team revised an existing ICT literacy assessment tool for the IT test and developed a new CT test environment in which students could perform actual coding through a web-based programming tool such as Scratch. Additionally, after assessing ICT literacy levels, differences in ICT literacy levels by gender and grade were analyzed to provide evidence for national education policies. Approximately 23,000 elementary and middle school students participated in the 2018 national assessment of ICT literacy, accounting for 1% of the national population of students. The findings demonstrated that female students had higher literacy levels in most sub-factors of IT and CT areas. Additionally, in the areas of strengths and weaknesses, the ratio of below-basic achievement among male students was at least two times greater than that of female students. Nonetheless, male students scored higher on CT automation, a coding item that involved problem solving using Scratch. Looking at the difference according to grade level, the level improved as the school year increased in elementary school, but there was no difference in middle school. When analyzing the detailed elements of middle school students, the automation factor of seventh grade students was found to be higher than eighth and ninth grade students. Based on these results, this study discussed some implications for ICT and computing education in elementary and middle schools.<\/jats:p>","DOI":"10.1145\/3427596","type":"journal-article","created":{"date-parts":[[2021,1,20]],"date-time":"2021-01-20T05:03:51Z","timestamp":1611119031000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Extending Computational Thinking into Information and Communication Technology Literacy Measurement"],"prefix":"10.1145","volume":"21","author":[{"given":"Han Sung","family":"Kim","sequence":"first","affiliation":[{"name":"Software Policy and Research Institute, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Soohwan","family":"Kim","sequence":"additional","affiliation":[{"name":"Chongshin University, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Wooyoul","family":"Na","sequence":"additional","affiliation":[{"name":"Konkuk University, Seoul, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Woon Jee","family":"Lee","sequence":"additional","affiliation":[{"name":"Daejeon Institute of Science and Technology, Daejeon, Republic of Korea"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,1,19]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.14352\/jkaie.20.3.303"},{"key":"e_1_2_1_2_1","volume-title":"Because it's boring, irrelevant and I don't like computers: Why high school girls avoid professionally-oriented ICT subjects. Computers 8 Education 50, 4","author":"Anderson Neil","year":"2008","unstructured":"Neil Anderson , Colin Lankshear , Carolyn Timms , and Lyn Courtney . 2008. Because it's boring, irrelevant and I don't like computers: Why high school girls avoid professionally-oriented ICT subjects. Computers 8 Education 50, 4 ( 2008 ), 1304--1318. DOI:10.1016\/j.compedu.2006.12.003 10.1016\/j.compedu.2006.12.003 Neil Anderson, Colin Lankshear, Carolyn Timms, and Lyn Courtney. 2008. Because it's boring, irrelevant and I don't like computers: Why high school girls avoid professionally-oriented ICT subjects. Computers 8 Education 50, 4 (2008), 1304--1318. DOI:10.1016\/j.compedu.2006.12.003"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1108\/EUM0000000007083"},{"key":"#cr-split#-e_1_2_1_4_1.1","unstructured":"Stefania Bocconi Augusto Chioccariello Giuliana Dettori Anusca Ferrari and Katja Engelhardt. 2016. Developing computational thinking in compulsory education-Implications for policy and practice. JRC Science for Policy Report EUR 28295 EN. DOI:10.2791\/792158 10.2791\/792158"},{"key":"#cr-split#-e_1_2_1_4_1.2","unstructured":"Stefania Bocconi Augusto Chioccariello Giuliana Dettori Anusca Ferrari and Katja Engelhardt. 2016. Developing computational thinking in compulsory education-Implications for policy and practice. JRC Science for Policy Report EUR 28295 EN. DOI:10.2791\/792158"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-8624.2012.01849.x"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cmpb.2005.02.007"},{"key":"e_1_2_1_7_1","volume-title":"Retrieved on","author":"Columbia British","year":"2017","unstructured":"British Columbia . 2017 . BC's digital literacy framework . Retrieved on March 08, 2020 from http:\/\/www2.gov.bc.ca\/assets\/gov\/education\/kindergarten-to-grade-12\/teach\/teaching-tools\/digital-literacy-framework.pdf. British Columbia. 2017. BC's digital literacy framework. Retrieved on March 08, 2020 from http:\/\/www2.gov.bc.ca\/assets\/gov\/education\/kindergarten-to-grade-12\/teach\/teaching-tools\/digital-literacy-framework.pdf."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1852786.1852824"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.2190\/GW1P-7BBK-DVWR-W3TU"},{"key":"e_1_2_1_10_1","volume-title":"Are young generation in secondary school digitally competent? A study on Italian teenagers. Computers 8 Education 58","author":"Calvani Antonio","year":"2012","unstructured":"Antonio Calvani , Antonio Fini , Maria Ranieri , and Patrizia Picci . 2012. Are young generation in secondary school digitally competent? A study on Italian teenagers. Computers 8 Education 58 ( 2012 ), 797--807. DOI:10.1016\/j.compedu.2011.10.004 10.1016\/j.compedu.2011.10.004 Antonio Calvani, Antonio Fini, Maria Ranieri, and Patrizia Picci. 2012. Are young generation in secondary school digitally competent? A study on Italian teenagers. Computers 8 Education 58 (2012), 797--807. DOI:10.1016\/j.compedu.2011.10.004"},{"key":"e_1_2_1_11_1","volume-title":"The digital competence framework for citizens with eight proficiency levels and examples of use","author":"Carretero Stephanie","unstructured":"Stephanie Carretero , Riina Vuorikari , and Yves Punie . 2017. DigComp 2.1 : The digital competence framework for citizens with eight proficiency levels and examples of use . Publications Office of the European Union . DOI:10.2760\/38842 10.2760\/38842 Stephanie Carretero, Riina Vuorikari, and Yves Punie. 2017. DigComp 2.1: The digital competence framework for citizens with eight proficiency levels and examples of use. Publications Office of the European Union. DOI:10.2760\/38842"},{"key":"e_1_2_1_12_1","volume-title":"Dai Yong Kwon, Han Sung Kim, Seung Bum Kim, Ja Mee Kim, Young Ae Kim, Sun Gwan Han, Soon Sik Seo, Woo Cheon Jun, Hyun Cheol Kim, and Won Gyu Lee.","author":"Cha Seung Eun","year":"2011","unstructured":"Seung Eun Cha , Soo Jin Ju , Dai Yong Kwon, Han Sung Kim, Seung Bum Kim, Ja Mee Kim, Young Ae Kim, Sun Gwan Han, Soon Sik Seo, Woo Cheon Jun, Hyun Cheol Kim, and Won Gyu Lee. 2011 . Measuring achievement of ICT competency for students in Korea. Computers 8 Education 56, 4 (2011), 990--1002. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2010.11.003 10.1016\/j.compedu.2010.11.003 Seung Eun Cha, Soo Jin Ju, Dai Yong Kwon, Han Sung Kim, Seung Bum Kim, Ja Mee Kim, Young Ae Kim, Sun Gwan Han, Soon Sik Seo, Woo Cheon Jun, Hyun Cheol Kim, and Won Gyu Lee. 2011. Measuring achievement of ICT competency for students in Korea. Computers 8 Education 56, 4 (2011), 990--1002. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2010.11.003"},{"key":"e_1_2_1_13_1","first-page":"100","article-title":"Computer literacy: Necessity or buzzword? Faculty Publications","volume":"90","author":"Childers Scott","year":"2003","unstructured":"Scott Childers . 2003 . Computer literacy: Necessity or buzzword? Faculty Publications . UNL Libraries 90 (2003), 100 -- 104 . Scott Childers. 2003. Computer literacy: Necessity or buzzword? Faculty Publications. UNL Libraries 90 (2003), 100--104.","journal-title":"UNL Libraries"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.9708\/jksci.2016.21.10.183"},{"key":"e_1_2_1_15_1","volume-title":"Ignacio Jara, J. Enrique Hinostroza, Susana Valenzuela, Flavio Cortes, and Miguel Nussbaum.","author":"Claro Magdalena","year":"2012","unstructured":"Magdalena Claro , David D. Preiss , Ernesto San Mart\u00edn , Ignacio Jara, J. Enrique Hinostroza, Susana Valenzuela, Flavio Cortes, and Miguel Nussbaum. 2012 . Assessment of 21st century ICT skills in Chile : Test design and results from high school level students. Computers 8 Education 59 (2012), 1042--1053. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2012.04.004 10.1016\/j.compedu.2012.04.004 Magdalena Claro, David D. Preiss, Ernesto San Mart\u00edn, Ignacio Jara, J. Enrique Hinostroza, Susana Valenzuela, Flavio Cortes, and Miguel Nussbaum. 2012. Assessment of 21st century ICT skills in Chile: Test design and results from high school level students. Computers 8 Education 59 (2012), 1042--1053. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2012.04.004"},{"key":"e_1_2_1_16_1","volume-title":"Statistical Power Analysis for the Behavioral Sciences","author":"Cohen Jacob","unstructured":"Jacob Cohen . 1988. Statistical Power Analysis for the Behavioral Sciences . Routledge Academic , New York, NY . Jacob Cohen. 1988. Statistical Power Analysis for the Behavioral Sciences. Routledge Academic, New York, NY."},{"key":"e_1_2_1_17_1","volume-title":"Retrieved on","author":"Cueto Santiago","year":"2012","unstructured":"Santiago Cueto and Juan Leon . 2012 . Psychometric characteristics of cognitive development and achievement instruments in Round 3 of Young Lives. Young Lives Technical Note, 25 (2012) . Retrieved on March 08, 2020 from https:\/\/www.younglives.org.uk\/content\/psychometric-characteristics-cognitive-development-and-achievement-instruments-round-3-young. Santiago Cueto and Juan Leon. 2012. Psychometric characteristics of cognitive development and achievement instruments in Round 3 of Young Lives. Young Lives Technical Note, 25 (2012). Retrieved on March 08, 2020 from https:\/\/www.younglives.org.uk\/content\/psychometric-characteristics-cognitive-development-and-achievement-instruments-round-3-young."},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2010.527691"},{"key":"e_1_2_1_19_1","volume-title":"Preparing for life in a digital age\u2014The IEA international computer and information literacy study international report","author":"Fraillon Julian","unstructured":"Julian Fraillon , John Ainley , Wolfram Schulz , Tim Friedman , and Eveline Gebhardt . 2014. Preparing for life in a digital age\u2014The IEA international computer and information literacy study international report . Springer , Heidelberg, New York, Dordrecht, London. Julian Fraillon, John Ainley, Wolfram Schulz, Tim Friedman, and Eveline Gebhardt. 2014. Preparing for life in a digital age\u2014The IEA international computer and information literacy study international report. Springer, Heidelberg, New York, Dordrecht, London."},{"key":"#cr-split#-e_1_2_1_20_1.1","unstructured":"Francisco Garc\u00eda-Pe\u00f1alvo Daniela Reimann Maire Tuul Angela Gerrard and Ilkka Jormanainen. 2016. An overview of the most relevant literature on coding and computational thinking with emphasis on the relevant issues for teachers. TACCLE3 Consortium Belgium. DOI:10.5281\/zenodo.165123 10.5281\/zenodo.165123"},{"key":"#cr-split#-e_1_2_1_20_1.2","unstructured":"Francisco Garc\u00eda-Pe\u00f1alvo Daniela Reimann Maire Tuul Angela Gerrard and Ilkka Jormanainen. 2016. An overview of the most relevant literature on coding and computational thinking with emphasis on the relevant issues for teachers. TACCLE3 Consortium Belgium. DOI:10.5281\/zenodo.165123"},{"key":"e_1_2_1_21_1","volume-title":"Measuring information and communication technology literacy using a performance assessment: Validation of the student tool for technology literacy (ST2L). Computers 8 Education 77","author":"Huggins Anne Corinne","year":"2014","unstructured":"Anne Corinne Huggins , Albert D. Ritzhaupt , and Kara Dawson . 2014. Measuring information and communication technology literacy using a performance assessment: Validation of the student tool for technology literacy (ST2L). Computers 8 Education 77 ( 2014 ), 1--12. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.04.005 10.1016\/j.compedu.2014.04.005 Anne Corinne Huggins, Albert D. Ritzhaupt, and Kara Dawson. 2014. Measuring information and communication technology literacy using a performance assessment: Validation of the student tool for technology literacy (ST2L). Computers 8 Education 77 (2014), 1--12. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.04.005"},{"key":"e_1_2_1_22_1","volume-title":"Ginsburg and Sylvia Opper","author":"Herbert","year":"1987","unstructured":"Herbert P. Ginsburg and Sylvia Opper . 1987 . Piaget's theory of intellectual development ( 3 rd ed.). Pearson . Herbert P. Ginsburg and Sylvia Opper. 1987. Piaget's theory of intellectual development (3rd ed.). Pearson.","edition":"3"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11528-016-0098-4"},{"key":"e_1_2_1_24_1","volume-title":"Brendan Luyt, Sei-Ching Joanna Sin, and Rebecca P. Ang.","author":"Guo Yan Ru","year":"2015","unstructured":"Yan Ru Guo , Dion Hoe-Lian Goh , Brendan Luyt, Sei-Ching Joanna Sin, and Rebecca P. Ang. 2015 . The effectiveness and acceptance of an affective information literacy tutorial. Computers 8 Education 87 (2015), 368--384. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2015.07.015 10.1016\/j.compedu.2015.07.015 Yan Ru Guo, Dion Hoe-Lian Goh, Brendan Luyt, Sei-Ching Joanna Sin, and Rebecca P. Ang. 2015. The effectiveness and acceptance of an affective information literacy tutorial. Computers 8 Education 87 (2015), 368--384. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2015.07.015"},{"key":"e_1_2_1_25_1","first-page":"63","article-title":"Analysis of 2015 revised SW curriculum in elementary and middle school based on core competency","volume":"5","author":"Youngjoon Shin Ha","year":"2019","unstructured":"Ji-hoon Ha and Youngjoon Shin . 2019 . Analysis of 2015 revised SW curriculum in elementary and middle school based on core competency . Journal of Creative Information Culture 5 , 1 (2019), 63 -- 70 . DOI:https:\/\/doi.org\/10.15267\/keses.2016.35.4.426 10.15267\/keses.2016.35.4.426 Ji-hoon Ha and Youngjoon Shin. 2019. Analysis of 2015 revised SW curriculum in elementary and middle school based on core competency. Journal of Creative Information Culture 5, 1 (2019), 63--70. DOI:https:\/\/doi.org\/10.15267\/keses.2016.35.4.426","journal-title":"Journal of Creative Information Culture"},{"key":"e_1_2_1_26_1","volume-title":"Anderson","author":"Hair Joseph F.","year":"1998","unstructured":"Joseph F. Hair , Jr., William C. Black , Barry J. Babin , and Rolph E . Anderson . 1998 . Multivariate data analysis. Prentice Hall , Upper Saddle River, NJ. Joseph F. Hair, Jr., William C. Black, Barry J. Babin, and Rolph E. Anderson. 1998. Multivariate data analysis. Prentice Hall, Upper Saddle River, NJ."},{"key":"e_1_2_1_27_1","volume-title":"Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale. Computers 8 Education 113","author":"Hatlevik Ove E.","year":"2017","unstructured":"Ove E. Hatlevik , Ronny Scherer , and Knut-Andreas Christophersen . 2017. Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale. Computers 8 Education 113 ( 2017 ), 280--293. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2017.06.003 10.1016\/j.compedu.2017.06.003 Ove E. Hatlevik, Ronny Scherer, and Knut-Andreas Christophersen. 2017. Moving beyond the study of gender differences: An analysis of measurement invariance and differential item functioning of an ICT literacy scale. Computers 8 Education 113 (2017), 280--293. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2017.06.003"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11423-013-9304-7"},{"key":"e_1_2_1_29_1","volume-title":"Supporting all learners in school-wide computational thinking: A cross-case qualitative analysis. Computers 8 Education 82","author":"Israel Maya","year":"2015","unstructured":"Maya Israel , Jamie N. Pearson , Tanya Tapia , Quentin M. Wherfel , and George Reese . 2015. Supporting all learners in school-wide computational thinking: A cross-case qualitative analysis. Computers 8 Education 82 ( 2015 ), 263--279. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.11.022 10.1016\/j.compedu.2014.11.022 Maya Israel, Jamie N. Pearson, Tanya Tapia, Quentin M. Wherfel, and George Reese. 2015. Supporting all learners in school-wide computational thinking: A cross-case qualitative analysis. Computers 8 Education 82 (2015), 263--279. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.11.022"},{"key":"e_1_2_1_30_1","volume-title":"Retrieved on","author":"ISTE","year":"2011","unstructured":"ISTE and CSTA. 2011 . Operational definition of computational thinking for K--12 education . Retrieved on March 08, 2020 from https:\/\/id.iste.org\/docs\/ct-documents\/computational-thinking-operational- definition-flyer.pdf. ISTE and CSTA. 2011. Operational definition of computational thinking for K--12 education. Retrieved on March 08, 2020 from https:\/\/id.iste.org\/docs\/ct-documents\/computational-thinking-operational- definition-flyer.pdf."},{"key":"e_1_2_1_31_1","volume-title":"Sports Science, and Technology","author":"Education Japanese Ministry","year":"2016","unstructured":"Japanese Ministry of Education , Culture , Sports Science, and Technology . 2016 . Improvement of necessary instruction in kindergarten, elementary school, junior high school, high school and special support school, etc. and necessary measures. Japanese Ministry of Education, Culture, Sports Science, and Technology . Japanese Ministry of Education, Culture, Sports Science, and Technology. 2016. Improvement of necessary instruction in kindergarten, elementary school, junior high school, high school and special support school, etc. and necessary measures. Japanese Ministry of Education, Culture, Sports Science, and Technology."},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s40299-018-0428-8"},{"key":"e_1_2_1_33_1","volume-title":"An analysis of variables affecting the ICT literacy level of Korean elementary school students. Computers 8 Education 77","author":"Kim Hye-Sook","year":"2014","unstructured":"Hye-Sook Kim , Hye-Ji Kil , and Anna Shin . 2014. An analysis of variables affecting the ICT literacy level of Korean elementary school students. Computers 8 Education 77 ( 2014 ), 29--38. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.04.009 10.1016\/j.compedu.2014.04.009 Hye-Sook Kim, Hye-Ji Kil, and Anna Shin. 2014. An analysis of variables affecting the ICT literacy level of Korean elementary school students. Computers 8 Education 77 (2014), 29--38. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.04.009"},{"key":"e_1_2_1_34_1","first-page":"415","article-title":"Similarities and differences of influencing factors of elementary and middle school students\u2019 ICT literacy using multilevel models","volume":"24","author":"Kim Chong M.","year":"2018","unstructured":"Chong M. Kim , Han S. Kim , Hyunjung Lim , and Sung H. Ahn . 2018 . Similarities and differences of influencing factors of elementary and middle school students\u2019 ICT literacy using multilevel models . The Journal of Educational Information and Media , 24 , 2 (2018), 415 -- 440 . DOI:https:\/\/doi.org\/10.15833\/KAFEIAM.24.2.415 10.15833\/KAFEIAM.24.2.415 Chong M. Kim, Han S. Kim, Hyunjung Lim, and Sung H. Ahn. 2018. Similarities and differences of influencing factors of elementary and middle school students\u2019 ICT literacy using multilevel models. The Journal of Educational Information and Media, 24, 2 (2018), 415--440. DOI:https:\/\/doi.org\/10.15833\/KAFEIAM.24.2.415","journal-title":"The Journal of Educational Information and Media"},{"key":"e_1_2_1_35_1","volume-title":"Meanings of criteria and norms: Analyses and comparisons of ICT literacy competencies of middle school students. Computers 8 Education 64","author":"Kim Jamee","year":"2013","unstructured":"Jamee Kim and Wongyu Lee . 2013. Meanings of criteria and norms: Analyses and comparisons of ICT literacy competencies of middle school students. Computers 8 Education 64 ( 2013 ), 81--94. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2012.12.018 10.1016\/j.compedu.2012.12.018 Jamee Kim and Wongyu Lee. 2013. Meanings of criteria and norms: Analyses and comparisons of ICT literacy competencies of middle school students. Computers 8 Education 64 (2013), 81--94. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2012.12.018"},{"key":"e_1_2_1_36_1","first-page":"301","article-title":"The analysis of gender differential item functioning on the information and communications technology literacy tests","volume":"29","author":"Min Kim C.","year":"2015","unstructured":"Kim C. Min , Lee M. Soo , and Ahn S. Hun . 2015 . The analysis of gender differential item functioning on the information and communications technology literacy tests . Journal of Educational Evaluation 29 , 2 (2015), 301 -- 324 . Kim C. Min, Lee M. Soo, and Ahn S. Hun. 2015. The analysis of gender differential item functioning on the information and communications technology literacy tests. Journal of Educational Evaluation 29, 2 (2015), 301--324.","journal-title":"Journal of Educational Evaluation"},{"key":"e_1_2_1_37_1","volume-title":"Development of ICT Literacy Measurement for Elementary School Students. KR 2007-18","author":"Research Information Service Korea Education","year":"2007","unstructured":"Korea Education 8 Research Information Service . 2007 . Development of ICT Literacy Measurement for Elementary School Students. KR 2007-18 , KERIS. Korea Education 8 Research Information Service. 2007. Development of ICT Literacy Measurement for Elementary School Students. KR 2007-18, KERIS."},{"key":"e_1_2_1_38_1","volume-title":"KR 2014-2, KERIS.","author":"Research Information Service Korea Education","year":"2014","unstructured":"Korea Education 8 Research Information Service . 2014 . Analyzing the ICT Literacy test in Korea: Elementary and secondary school . KR 2014-2, KERIS. Korea Education 8 Research Information Service. 2014. Analyzing the ICT Literacy test in Korea: Elementary and secondary school. KR 2014-2, KERIS."},{"key":"e_1_2_1_39_1","volume-title":"KR 2015-05","author":"Research Information Service Korea Education","year":"2015","unstructured":"Korea Education 8 Research Information Service . 2015 . Analyzing the ICT Literacy test in Korea: Elementary and secondary school . KR 2015-05 , KERIS. Korea Education 8 Research Information Service. 2015. Analyzing the ICT Literacy test in Korea: Elementary and secondary school. KR 2015-05, KERIS."},{"key":"e_1_2_1_40_1","volume-title":"RR 2016-8, KERIS.","author":"Research Information Service Korea Education","year":"2016","unstructured":"Korea Education 8 Research Information Service . 2016 . Analyzing the ICT Literacy test in Korea: Elementary and secondary school . RR 2016-8, KERIS. Korea Education 8 Research Information Service. 2016. Analyzing the ICT Literacy test in Korea: Elementary and secondary school. RR 2016-8, KERIS."},{"key":"e_1_2_1_41_1","unstructured":"Korean Ministry of Education. 2015. 2015 revised curriculum of Korea: Informatics curriculum. Korean Ministry of Education.  Korean Ministry of Education. 2015. 2015 revised curriculum of Korea: Informatics curriculum. Korean Ministry of Education."},{"key":"e_1_2_1_42_1","unstructured":"Korean Ministry of Education. 2019. Result of national academic achievement level assessment. Korean Ministry of Education.  Korean Ministry of Education. 2019. Result of national academic achievement level assessment. Korean Ministry of Education."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/2999541.2999565"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1975.tb01393.x"},{"key":"e_1_2_1_45_1","volume-title":"Howard C. Mizel, K. Baum, and Richard J. Patz.","author":"Lewis Daniel M.","year":"1998","unstructured":"Daniel M. Lewis , Donald Ross Green , Howard C. Mizel, K. Baum, and Richard J. Patz. 1998 . The bookmark standard setting procedure: Methodology and recent implementations. Paper presented at the National Council for Measurement in Education Annual Meeting, San Diego, CA. Daniel M. Lewis, Donald Ross Green, Howard C. Mizel, K. Baum, and Richard J. Patz. 1998. The bookmark standard setting procedure: Methodology and recent implementations. Paper presented at the National Council for Measurement in Education Annual Meeting, San Diego, CA."},{"key":"e_1_2_1_46_1","first-page":"201","article-title":"Developing a digital literacy curriculum framework","volume":"40","author":"Jee Lee Woon","year":"2019","unstructured":"Lee Woon Jee , Lee Eunhwan , and Kim, Soohwan. 2019 . Developing a digital literacy curriculum framework . CNU Journal of Educational Studies 40 , 3 (2019), 201 -- 221 . Lee Woon Jee, Lee Eunhwan, and Kim, Soohwan. 2019. Developing a digital literacy curriculum framework. CNU Journal of Educational Studies 40, 3 (2019), 201--221.","journal-title":"CNU Journal of Educational Studies"},{"key":"e_1_2_1_47_1","volume-title":"Jacobson","author":"Mackey Thomas P.","year":"2011","unstructured":"Thomas P. Mackey and Trudi E . Jacobson . 2011 . Reframing information literacy as a metaliteracy. College 8 Research Libraries 72, 1 (2011), 62--78. DOI:https:\/\/doi.org\/10.5860\/crl-76r1 10.5860\/crl-76r1 Thomas P. Mackey and Trudi E. Jacobson. 2011. Reframing information literacy as a metaliteracy. College 8 Research Libraries 72, 1 (2011), 62--78. DOI:https:\/\/doi.org\/10.5860\/crl-76r1"},{"key":"e_1_2_1_48_1","volume-title":"Retrieved on","year":"2016","unstructured":"MediaSmarts. 2016 . Use, understand, and create: A digital literacy framework for Canadian schools . Retrieved on March 08, 2020 from http:\/\/ mediasmarts.ca\/teacher-resources\/digital-literacy-framework. MediaSmarts. 2016. Use, understand, and create: A digital literacy framework for Canadian schools. Retrieved on March 08, 2020 from http:\/\/ mediasmarts.ca\/teacher-resources\/digital-literacy-framework."},{"key":"e_1_2_1_49_1","volume-title":"Retrieved on","author":"Ministry","year":"2019","unstructured":"Ministry of Education of the People's Republic of China. 2018. Education Informationization 2.0 Action Plan . Retrieved on February 15, 2019 , from https:\/\/blog.hackerrank.com\/which-countries-have-the-most-skilled-female-developers. Ministry of Education of the People's Republic of China. 2018. Education Informationization 2.0 Action Plan. Retrieved on February 15, 2019, from https:\/\/blog.hackerrank.com\/which-countries-have-the-most-skilled-female-developers."},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.5392\/JKCA.2016.16.10.018"},{"key":"e_1_2_1_51_1","volume-title":"PISA 2015 results (Volume III): Students\u2019 well-being, PISA. Paris: OECD Publishing. DOI:http:\/\/dx.doi.org\/10","author":"OECD.","year":"2017","unstructured":"OECD. 2017 . PISA 2015 results (Volume III): Students\u2019 well-being, PISA. Paris: OECD Publishing. DOI:http:\/\/dx.doi.org\/10 .1787\/9789264273856-en 10.1787\/9789264273856-en OECD. 2017. PISA 2015 results (Volume III): Students\u2019 well-being, PISA. Paris: OECD Publishing. DOI:http:\/\/dx.doi.org\/10.1787\/9789264273856-en"},{"key":"e_1_2_1_52_1","doi-asserted-by":"publisher","DOI":"10.5220\/0006794203030308"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1145\/1592761.1592779"},{"key":"e_1_2_1_54_1","volume-title":"Hackerrank. Retrieved on","author":"Trikha Ritika","year":"2017","unstructured":"Ritika Trikha . 2017 . Which countries have the most female developers ? Hackerrank. Retrieved on March 08, 2020 from https:\/\/blog.hackerrank.com\/which-countries-have-the-most-skilled-female-developers. Ritika Trikha. 2017. Which countries have the most female developers? Hackerrank. Retrieved on March 08, 2020 from https:\/\/blog.hackerrank.com\/which-countries-have-the-most-skilled-female-developers."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1080\/15391523.2013.10782607"},{"key":"e_1_2_1_56_1","volume-title":"Madridb","author":"Rubio Miguel A.","year":"2015","unstructured":"Miguel A. Rubio , Rocio Romero-Zaliza , Carolina Ma\u00f1osob , and Angel P . Madridb . 2015 . Closing the gender gap in an introductory programming course. Computers 8 Education 82 (2015), 409--420. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.12.003 10.1016\/j.compedu.2014.12.003 Miguel A. Rubio, Rocio Romero-Zaliza, Carolina Ma\u00f1osob, and Angel P. Madridb. 2015. Closing the gender gap in an introductory programming course. Computers 8 Education 82 (2015), 409--420. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.12.003"},{"key":"e_1_2_1_57_1","volume-title":"Yuen","author":"Lau Wilfred W.","year":"2014","unstructured":"Wilfred W. Lau and Allan H . Yuen . 2014 . Developing and validating of a perceived ICT literacy scale for junior secondary school students: Pedagogical and educational contributions. Computers 8 Education 109 (2014), 11--37. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.04.016 10.1016\/j.compedu.2014.04.016 Wilfred W. Lau and Allan H. Yuen. 2014. Developing and validating of a perceived ICT literacy scale for junior secondary school students: Pedagogical and educational contributions. Computers 8 Education 109 (2014), 11--37. DOI:https:\/\/doi.org\/10.1016\/j.compedu.2014.04.016"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1109\/TE.2016.2535207"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.17232\/KSET.32.4.987"},{"key":"e_1_2_1_60_1","volume-title":"Proceedings of the 47th ACM Technical Symposium on Computing Science Education (SIGCSE\u201916)","author":"Tsan Jennifer","unstructured":"Jennifer Tsan , Kristy Elizabeth Boyer , and Collin F. Lynch . 2016. How early does the CS gender gap emerge?: A study of collaborative problem solving in 5th grade computer science . In Proceedings of the 47th ACM Technical Symposium on Computing Science Education (SIGCSE\u201916) , New York, 388--393. DOI:https:\/\/doi.org\/10.1145\/2839509.2844605 10.1145\/2839509.2844605 Jennifer Tsan, Kristy Elizabeth Boyer, and Collin F. Lynch. 2016. How early does the CS gender gap emerge?: A study of collaborative problem solving in 5th grade computer science. In Proceedings of the 47th ACM Technical Symposium on Computing Science Education (SIGCSE\u201916), New York, 388--393. DOI:https:\/\/doi.org\/10.1145\/2839509.2844605"},{"key":"e_1_2_1_61_1","volume-title":"A systematic review of learning computational thinking through scratch in K-9. Computers 8 Education 141","author":"Zhang LeChen","year":"2019","unstructured":"LeChen Zhang and Jalal Nouri . 2019. A systematic review of learning computational thinking through scratch in K-9. Computers 8 Education 141 ( 2019 ), 103607. DOI:10.1016\/j.compedu.2019.103607 10.1016\/j.compedu.2019.103607 LeChen Zhang and Jalal Nouri. 2019. A systematic review of learning computational thinking through scratch in K-9. Computers 8 Education 141 (2019), 103607. DOI:10.1016\/j.compedu.2019.103607"}],"container-title":["ACM Transactions on Computing Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427596","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3427596","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:24:40Z","timestamp":1750195480000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3427596"}},"subtitle":["Gender and Grade Issues"],"short-title":[],"issued":{"date-parts":[[2021,1,19]]},"references-count":63,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,3,31]]}},"alternative-id":["10.1145\/3427596"],"URL":"https:\/\/doi.org\/10.1145\/3427596","relation":{},"ISSN":["1946-6226"],"issn-type":[{"value":"1946-6226","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1,19]]},"assertion":[{"value":"2020-03-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-09-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-01-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}