{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,14]],"date-time":"2026-02-14T05:07:20Z","timestamp":1771045640224,"version":"3.50.1"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,3,3]],"date-time":"2021-03-03T00:00:00Z","timestamp":1614729600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"National Science Foundation","award":["1735123"],"award-info":[{"award-number":["1735123"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,3,3]]},"DOI":"10.1145\/3408877.3432397","type":"proceedings-article","created":{"date-parts":[[2021,3,5]],"date-time":"2021-03-05T18:49:39Z","timestamp":1614970179000},"page":"1142-1148","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Investigating Item Bias in a CS1 Exam with Differential Item Functioning"],"prefix":"10.1145","author":[{"given":"Matt J.","family":"Davidson","sequence":"first","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brett","family":"Wortzman","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amy J.","family":"Ko","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min","family":"Li","sequence":"additional","affiliation":[{"name":"University of Washington, Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2021,3,5]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"American Psychological Association, and National Council on Measurement in Education","author":"American Educational Research Association","year":"2014","unstructured":"American Educational Research Association , American Psychological Association, and National Council on Measurement in Education . 2014 . Standards for educational and psychological testing. American Educational Research Association . American Educational Research Association, American Psychological Association, and National Council on Measurement in Education. 2014. Standards for educational and psychological testing. American Educational Research Association."},{"key":"e_1_3_2_1_2_1","volume-title":"Measurement theory and applications for the social sciences","author":"Bandalos Deborah L.","unstructured":"Deborah L. Bandalos . 2018. Measurement theory and applications for the social sciences . Guilford Press . Deborah L. Bandalos. 2018. Measurement theory and applications for the social sciences. Guilford Press."},{"key":"e_1_3_2_1_3_1","volume-title":"Testing Differential Item Functioning in Small Samples. Multivariate Behavioral Research (Oct","author":"Belzak William C. M.","year":"2019","unstructured":"William C. M. Belzak . 2019. Testing Differential Item Functioning in Small Samples. Multivariate Behavioral Research (Oct 2019 ), 1--26. https:\/\/doi.org\/10.1080\/00273171.2019.1671162 William C. M. Belzak. 2019. Testing Differential Item Functioning in Small Samples. Multivariate Behavioral Research (Oct 2019), 1--26. https:\/\/doi.org\/10.1080\/00273171.2019.1671162"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.2517-6161.1995.tb02031.x"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3287324.3287372"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v048.i06"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3017680.3017704"},{"key":"e_1_3_2_1_8_1","volume-title":"Use of item response theory in the study of group differences in trace lines. Test validity","author":"David Thissen Howard Wainer","year":"1988","unstructured":"Howard Wainer David Thissen , Lynne Steinberg . 1988. Use of item response theory in the study of group differences in trace lines. Test validity ( 1988 ), 147. Howard Wainer David Thissen, Lynne Steinberg. 1988. Use of item response theory in the study of group differences in trace lines. Test validity (1988), 147."},{"key":"e_1_3_2_1_9_1","volume-title":"The theory and practice of item response theory","author":"De Ayala R. J.","unstructured":"R. J. De Ayala . 2009. The theory and practice of item response theory . Guilford Press . R. J. De Ayala. 2009. The theory and practice of item response theory .Guilford Press."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.1986.tb00255.x"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1145\/2538862.2538937"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/2839509.2844623"},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1080\/08957347.2015.1102916"},{"key":"e_1_3_2_1_15_1","unstructured":"Google and Gallup. 2015. Images of Computer Science: Perceptions Among Students Parents and Educators in the U.S. (2015).  Google and Gallup. 2015. Images of Computer Science: Perceptions Among Students Parents and Educators in the U.S. (2015)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1080\/08993408.2014.970781"},{"key":"e_1_3_2_1_17_1","volume-title":"Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied measurement in education","author":"Jodoin Michael G","year":"2001","unstructured":"Michael G Jodoin and Mark J Gierl . 2001. Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied measurement in education , Vol. 14 , 4 ( 2001 ), 329--349. Michael G Jodoin and Mark J Gierl. 2001. Evaluating type I error and power rates using an effect size measure with the logistic regression procedure for DIF detection. Applied measurement in education, Vol. 14, 4 (2001), 329--349."},{"key":"e_1_3_2_1_18_1","volume-title":"Herman","author":"Kaczmarczyk Lisa C.","year":"2010","unstructured":"Lisa C. Kaczmarczyk , Elizabeth R. Petrick , J. Philip East , and Geoffrey L . Herman . 2010 . Identifying student misconceptions of programming. In Proceedings of the 41st ACM technical symposium on Computer science education - SIGCSE '10. ACM Press , 107. https:\/\/doi.org\/10.1145\/1734263.1734299 Lisa C. Kaczmarczyk, Elizabeth R. Petrick, J. Philip East, and Geoffrey L. Herman. 2010. Identifying student misconceptions of programming. In Proceedings of the 41st ACM technical symposium on Computer science education - SIGCSE '10. ACM Press, 107. https:\/\/doi.org\/10.1145\/1734263.1734299"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12000"},{"key":"e_1_3_2_1_20_1","volume-title":"Principles and practice of structural equation modeling","author":"Kline Rex B","unstructured":"Rex B Kline . 2015. Principles and practice of structural equation modeling . Guilford publications. Rex B Kline. 2015. Principles and practice of structural equation modeling .Guilford publications."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1177\/0146621616668015"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3758\/BRM.42.3.847"},{"key":"e_1_3_2_1_23_1","volume-title":"Price","author":"Martinkov\u00e1 Patr\u00edcia","year":"2017","unstructured":"Patr\u00edcia Martinkov\u00e1 , Ad\u00e9la Drabinov\u00e1 , Yuan-Ling Liaw , Elizabeth A. Sanders , Jenny L. McFarland , and Rebecca M . Price . 2017 . Checking Equity : Why Differential Item Functioning Analysis Should Be a Routine Part of Developing Conceptual Assessments. CBE?Life Sciences Education , Vol. 16 , 2 (Jun 2017), rm2. https:\/\/doi.org\/10.1187\/cbe.16--10-0307 Patr\u00edcia Martinkov\u00e1, Ad\u00e9la Drabinov\u00e1, Yuan-Ling Liaw, Elizabeth A. Sanders, Jenny L. McFarland, and Rebecca M. Price. 2017. Checking Equity: Why Differential Item Functioning Analysis Should Be a Routine Part of Developing Conceptual Assessments. CBE?Life Sciences Education, Vol. 16, 2 (Jun 2017), rm2. https:\/\/doi.org\/10.1187\/cbe.16--10-0307"},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0018966"},{"key":"e_1_3_2_1_25_1","volume-title":"Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American psychologist","author":"Messick Samuel","year":"1995","unstructured":"Samuel Messick . 1995. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American psychologist , Vol. 50 , 9 ( 1995 ), 741. Samuel Messick. 1995. Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American psychologist, Vol. 50, 9 (1995), 741."},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the 19th Koli Calling International Conference on Computing Education Research. ACM, 1--10","author":"Nelson Greg L.","unstructured":"Greg L. Nelson , Andrew Hu , Benjamin Xie , and Amy J. Ko . 2019. Towards validity for a formative assessment for language-specific program tracing skills . In Proceedings of the 19th Koli Calling International Conference on Computing Education Research. ACM, 1--10 . https:\/\/doi.org\/10.1145\/3364510.3364525 Greg L. Nelson, Andrew Hu, Benjamin Xie, and Amy J. Ko. 2019. Towards validity for a formative assessment for language-specific program tracing skills. In Proceedings of the 19th Koli Calling International Conference on Computing Education Research. ACM, 1--10. https:\/\/doi.org\/10.1145\/3364510.3364525"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/2899415.2899435"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/2960310.2960316"},{"key":"e_1_3_2_1_29_1","volume-title":"R: A Language and Environment for Statistical Computing","author":"Team R Core","year":"2020","unstructured":"R Core Team . 2020 . R: A Language and Environment for Statistical Computing . R Foundation for Statistical Computing , Vienna, Austria . https:\/\/www.R-project.org\/ R Core Team. 2020. R: A Language and Environment for Statistical Computing . R Foundation for Statistical Computing, Vienna, Austria. https:\/\/www.R-project.org\/"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-008-9102-z"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.18637\/jss.v048.i02"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11336-008-9101-0"},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11205-010-9682-8"},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3372782.3406281"},{"key":"e_1_3_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1186\/s40536-014-0004-5"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11165-016-9602-2"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/MC.2013.259"},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/1953163.1953200"},{"key":"e_1_3_2_1_39_1","volume-title":"Alvarado","author":"Trizano-Hermosilla Italo","year":"2016","unstructured":"Italo Trizano-Hermosilla and Jes\u00fas M . Alvarado . 2016 . Best Alternatives to Cronbach's Alpha Reliability in Realistic Conditions : Congeneric and Asymmetrical Measurements. Frontiers in Psychology , Vol. 7 (May 2016). https:\/\/doi.org\/10.3389\/fpsyg.2016.00769 Italo Trizano-Hermosilla and Jes\u00fas M. Alvarado. 2016. Best Alternatives to Cronbach's Alpha Reliability in Realistic Conditions: Congeneric and Asymmetrical Measurements. Frontiers in Psychology, Vol. 7 (May 2016). https:\/\/doi.org\/10.3389\/fpsyg.2016.00769"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1177\/0734282911406666"},{"key":"e_1_3_2_1_41_1","volume-title":"Ko","author":"Xie Benjamin","year":"2019","unstructured":"Benjamin Xie , Matthew J. Davidson , Min Li , and Andrew J . Ko . 2019 . An Item Response Theory Evaluation of a Language-Independent CS1 Knowledge Assessment. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education - SIGCSE '19. ACM Press , 699--705. https:\/\/doi.org\/10.1145\/3287324.3287370 Benjamin Xie, Matthew J. Davidson, Min Li, and Andrew J. Ko. 2019. An Item Response Theory Evaluation of a Language-Independent CS1 Knowledge Assessment. In Proceedings of the 50th ACM Technical Symposium on Computer Science Education - SIGCSE '19. ACM Press, 699--705. https:\/\/doi.org\/10.1145\/3287324.3287370"},{"key":"e_1_3_2_1_42_1","unstructured":"Bruno D Zumbo. 1999. A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression modeling as a Unitary Framework for Binary and Likert-Type (Ordinal) Item Scores. 57 pages.  Bruno D Zumbo. 1999. A Handbook on the Theory and Methods of Differential Item Functioning (DIF): Logistic Regression modeling as a Unitary Framework for Binary and Likert-Type (Ordinal) Item Scores. 57 pages."},{"key":"e_1_3_2_1_43_1","volume-title":"Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going. Language assessment quarterly","author":"Zumbo Bruno D","year":"2007","unstructured":"Bruno D Zumbo . 2007. Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going. Language assessment quarterly , Vol. 4 , 2 ( 2007 ), 223--233. Bruno D Zumbo. 2007. Three generations of DIF analyses: Considering where it has been, where it is now, and where it is going. Language assessment quarterly, Vol. 4, 2 (2007), 223--233."},{"key":"e_1_3_2_1_44_1","series-title":"ETS Research Report Series","volume-title":"A review of ETS differential item functioning assessment procedures: Flagging rules, minimum sample size requirements, and criterion refinement","author":"Zwick Rebecca","year":"2012","unstructured":"Rebecca Zwick . 2012. A review of ETS differential item functioning assessment procedures: Flagging rules, minimum sample size requirements, and criterion refinement . ETS Research Report Series , Vol. 2012 , 1 ( 2012 ), i--30. Rebecca Zwick. 2012. A review of ETS differential item functioning assessment procedures: Flagging rules, minimum sample size requirements, and criterion refinement. ETS Research Report Series, Vol. 2012, 1 (2012), i--30."}],"event":{"name":"SIGCSE '21: The 52nd ACM Technical Symposium on Computer Science Education","location":"Virtual Event USA","acronym":"SIGCSE '21","sponsor":["SIGCSE ACM Special Interest Group on Computer Science Education"]},"container-title":["Proceedings of the 52nd ACM Technical Symposium on Computer Science Education"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432397","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3408877.3432397","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:37Z","timestamp":1750195897000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3408877.3432397"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,3,3]]},"references-count":43,"alternative-id":["10.1145\/3408877.3432397","10.1145\/3408877"],"URL":"https:\/\/doi.org\/10.1145\/3408877.3432397","relation":{},"subject":[],"published":{"date-parts":[[2021,3,3]]},"assertion":[{"value":"2021-03-05","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}