{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T16:07:34Z","timestamp":1791389254924,"version":"4.3.3"},"reference-count":40,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T00:00:00Z","timestamp":1738108800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T00:00:00Z","timestamp":1738108800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Med Educ"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Background<\/jats:title>\n                    <jats:p>A common practice in assessment development, fundamental for fairness and consequently the validity of test score interpretations and uses, is to ascertain whether test items function equally across test-taker groups. Accordingly, we conducted differential item functioning (DIF) analysis, a psychometric procedure for detecting potential item bias, for three preclinical medical school foundational courses based on students\u2019 sex and race.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>The sample included 520, 519, and 344 medical students for anatomy, histology, and physiology, respectively, collected from 2018 to 2020. To conduct DIF analysis, we used the Wald test based on the two-parameter logistic model as utilized in the IRTPRO software.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The three assessments had as many as one-fifth of the items that functioned statistically differentially across one or more of the variables sex and race: 10 out of 49 items (20%), six out of 40 items (15%), 5 out of 45 items (11%)\u00a0showed statistically significant DIF for\n                      <jats:italic>Anatomy<\/jats:italic>\n                      ,\n                      <jats:italic>Histology<\/jats:italic>\n                      , and\n                      <jats:italic>Physiology<\/jats:italic>\n                      courses, respectively. Measurement specialists and subject matter experts independently reviewed the items to identify construct-irrelevant factors as potential sources for DIF as demonstrated in Appendix A. Most identified items were generally poorly written or had unclear images.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>The validity of score-based inferences, particularly for group comparisons, requires test items to function equally across test-taker groups. In the present study, we found DIF of some items for sex and race in three content areas. The present approach should be utilized in other medical schools to address the generalizability of the present findings. Item level DIF should also be routinely conducted as part of psychometric analyses for basic sciences courses and other assessments.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Clinical trial number<\/jats:title>\n                    <jats:p>Not applicable.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1186\/s12909-024-06540-6","type":"journal-article","created":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T09:43:07Z","timestamp":1738143787000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Are medical school preclinical tests biased for sex and race? A differential item functioning analysis"],"prefix":"10.1186","volume":"25","author":[{"given":"Esther Dasari","family":"Dale","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5397-8817","authenticated-orcid":false,"given":"Mohammed A. A.","family":"Abulela","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Jia","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7551-5621","authenticated-orcid":false,"given":"Claudio","family":"Violato","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,1,29]]},"reference":[{"issue":"2","key":"6540_CR1","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1080\/08957347.2022.2067542","volume":"35","author":"MAA Abulela","year":"2022","unstructured":"Abulela MAA, Rios JA. Comparing the robustness of three nonparametric DIF procedures to differential rapid guessing. Appl Meas Educ. 2022;35(2):81\u201394.","journal-title":"Appl Meas Educ"},{"issue":"5","key":"6540_CR2","doi-asserted-by":"publisher","first-page":"718","DOI":"10.1097\/ACM.0000000000004567","volume":"97","author":"J Rubright","year":"2022","unstructured":"Rubright J, Jodoin M, Woodward S, Barone M. Differential item functioning analysis of United States Medical licensing examination step 1 items. Acad Med. 2022;97(5):718\u201322.","journal-title":"Acad Med"},{"key":"6540_CR3","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1186\/s12909-019-1605-z","volume":"19","author":"A Ghaffari-Rafi","year":"2019","unstructured":"Ghaffari-Rafi A, Lee RE, Fang R, Miles JD. Multivariable analysis of factors associated with USMLE scores across U.S. medical schools. BMC Med Educ. 2019;19:154.","journal-title":"BMC Med Educ"},{"issue":"11","key":"6540_CR4","doi-asserted-by":"publisher","first-page":"1492","DOI":"10.1097\/ACM.0000000000001171","volume":"91","author":"L Konopasek","year":"2016","unstructured":"Konopasek L, Norcini J, Krupat E. Focusing on the formative: building an assessment system aimed at student growth and development. Acad Med. 2016;91(11):1492\u201397.","journal-title":"Acad Med"},{"issue":"1","key":"6540_CR5","first-page":"17","volume":"25","author":"CPM Van der Vleuten","year":"2013","unstructured":"Van der Vleuten CPM, Swanson DB. Assessment of clinical skills with standardized patients: state of the art revisited. Teach Learn Med. 2013;25(1):17\u201325.","journal-title":"Teach Learn Med"},{"issue":"1","key":"6540_CR6","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1002\/chp.20052","volume":"30","author":"L Baig","year":"2010","unstructured":"Baig L, Violato C, Crutcher R. A construct validity study of clinical competence: a multitrait multimethod matrix approach. J Contin Educ Health Prof. 2010;30(1):19\u201325.","journal-title":"J Contin Educ Health Prof"},{"issue":"3","key":"6540_CR7","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1097\/ACM.0b013e3181637925","volume":"83","author":"N Ratanawongsa","year":"2008","unstructured":"Ratanawongsa N, Thomas PA, Marinopoulos SS, Dorman T, Wilson LM, Ashar BH, Magaziner JL, Miller RG, Prokopowicz GP, Qayyum R, Bass EB. The reported validity and reliability of methods for evaluating continuing medical education: a systematic review. Acad Med. 2008;83(3):274\u201383.","journal-title":"Acad Med"},{"issue":"8","key":"6540_CR8","first-page":"574","volume":"40","author":"JL Turner","year":"2008","unstructured":"Turner JL, Dankoski ME. Objective structured clinical exams: a critical review. Fam Med. 2008;40(8):574\u20138.","journal-title":"Fam Med"},{"issue":"4","key":"6540_CR9","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1177\/0734282911406666","volume":"29","author":"CM Walker","year":"2011","unstructured":"Walker CM. What\u2019s the DIF? Why differential item functioning analyses are an important part of instrument development and validation. J Psychoeduc Assess. 2011;29(4):364\u201376.","journal-title":"J Psychoeduc Assess"},{"key":"6540_CR10","unstructured":"Libarkin J. Concept inventories in higher education science. In: Natl Res Council. 2008."},{"issue":"1","key":"6540_CR11","first-page":"33","volume":"17","author":"D Dixon","year":"2007","unstructured":"Dixon D. Gender differences in academic qualifications and medical school performance of osteopathic medical students. Med Sci Educ. 2007;17(1):33\u20137.","journal-title":"Med Sci Educ"},{"issue":"3","key":"6540_CR12","doi-asserted-by":"publisher","first-page":"197","DOI":"10.1023\/A:1009829611335","volume":"5","author":"SA Haist","year":"2000","unstructured":"Haist SA, Wilson JF, Elam CL, Blue AV, Fosson SE. The Effect of gender and age on medical school performance: an important interaction. Adv Health Sci Educ Theory Pract. 2000;5(3):197\u2013205.","journal-title":"Adv Health Sci Educ Theory Pract"},{"issue":"Suppl 1","key":"6540_CR13","doi-asserted-by":"publisher","first-page":"S78","DOI":"10.3109\/0142159X.2013.765545","volume":"35","author":"A Nuzhat","year":"2013","unstructured":"Nuzhat A, Salem RO, Hamdan NA, Ashour N. Gender differences in learning styles and academic performance of medical students in Saudi Arabia. Med Teach. 2013;35(Suppl 1):S78\u201382.","journal-title":"Med Teach"},{"issue":"5","key":"6540_CR14","doi-asserted-by":"publisher","first-page":"593","DOI":"10.1097\/ACM.0b013e318286803a","volume":"88","author":"D Davis","year":"2013","unstructured":"Davis D, Dorsey JK, Franks RD, Sackett PR, Searcy CA, Zhao X. Do racial and ethnic group differences in performance on the MCAT exam reflect test bias? Acad Med. 2013;88(5):593\u2013602.","journal-title":"Acad Med"},{"key":"6540_CR15","doi-asserted-by":"publisher","first-page":"d901","DOI":"10.1136\/bmj.d901","volume":"342","author":"K Woolf","year":"2011","unstructured":"Woolf K, Potts HWW, McManus IC. Ethnicity and academic performance in UK trained doctors and medical students: systematic review and meta-analysis. BMJ. 2011;342:d901.","journal-title":"BMJ"},{"key":"6540_CR16","doi-asserted-by":"crossref","unstructured":"Isik U, Wouters A, Ter Wee MM, Croiset G, Kusurkar RA. Motivation and academic performance of medical students from ethnic minorities and majority: a comparative study. BMC Med Educ. 2017;17:233.","DOI":"10.1186\/s12909-017-1079-9"},{"issue":"9","key":"6540_CR17","doi-asserted-by":"publisher","first-page":"932","DOI":"10.1111\/medu.12236","volume":"47","author":"GD Miller","year":"2013","unstructured":"Miller GD, Kemmelmeier M, Dupey P. Gender differences in worry during medical school. Med Educ. 2013;47(9):932\u201341.","journal-title":"Med Educ"},{"issue":"6","key":"6540_CR18","doi-asserted-by":"publisher","first-page":"756","DOI":"10.1001\/jama.288.6.756","volume":"288","author":"DL Roter","year":"2002","unstructured":"Roter DL, Hall JA, Aoki Y. Physician gender effects in medical communication: a meta-analytic review. JAMA. 2002;288(6):756\u201364.","journal-title":"JAMA"},{"key":"6540_CR19","doi-asserted-by":"crossref","unstructured":"Cooper-Patrick L, Gallo JJ, Gonzales JJ, Vu HT, Powe NR, Nelson C, Ford DE. Race, gender, and partnership in the patient-physician relationship. JAMA. 1999; 11;282(6):583-9.","DOI":"10.1001\/jama.282.6.583"},{"issue":"2","key":"6540_CR20","doi-asserted-by":"publisher","first-page":"ar23","DOI":"10.1187\/cbe.15-12-0246","volume":"15","author":"CD Wright","year":"2016","unstructured":"Wright CD, Eddy SL, Wenderoth MP, Abshire E, Blankenbiller M, Brownell SE. Cognitive difficulty and format of exams predicts gender and socioeconomic gaps in exam performance of students in introductory biology courses. CBE Life Sci Educ. 2016;15(2):ar23.","journal-title":"CBE Life Sci Educ"},{"issue":"1","key":"6540_CR21","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1111\/j.1745-3984.1992.tb00368.x","volume":"29","author":"TA Ackerman","year":"1992","unstructured":"Ackerman TA. A didactic explanation of item bias, item impact, and item validity from a multidimensional perspective. J Educ Meas. 1992;29(1):67\u201391.","journal-title":"J Educ Meas"},{"issue":"4","key":"6540_CR22","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1177\/014662169602000404","volume":"20","author":"L Roussos","year":"1996","unstructured":"Roussos L, Stout W. A multidimensionality-based DIF analysis paradigm. Appl Psychol Meas. 1996;20(4):355\u201371.","journal-title":"Appl Psychol Meas"},{"key":"6540_CR23","doi-asserted-by":"publisher","DOI":"10.4324\/9780203357811","volume-title":"Differential item functioning","author":"PW Holland","year":"2012","unstructured":"Holland PW, Wainer H. Differential item functioning. New York: Routledge; 2012."},{"issue":"2","key":"6540_CR24","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1080\/15434300701375832","volume":"4","author":"BD Zumbo","year":"2007","unstructured":"Zumbo BD. Three generations of DIF analyses: considering where it has been, where it is now, and where it is going. Lang Assess Q. 2007;4(2):223\u201333.","journal-title":"Lang Assess Q"},{"issue":"3","key":"6540_CR25","doi-asserted-by":"publisher","first-page":"847","DOI":"10.3758\/BRM.42.3.847","volume":"42","author":"D Magis","year":"2010","unstructured":"Magis D, B\u00e9land S, Tuerlinckx F, de Boeck PA. A general framework and an R package for the detection of dichotomous differential item functioning. Behav Res Methods. 2010;42(3):847\u201362.","journal-title":"Behav Res Methods"},{"issue":"2","key":"6540_CR26","doi-asserted-by":"publisher","first-page":"rm2","DOI":"10.1187\/cbe.16-10-0307","volume":"16","author":"P Martinkov\u00e1","year":"2017","unstructured":"Martinkov\u00e1 P, Drabinov\u00e1 A, Liaw Y-L, Sanders EA, McFarland JL, Price RM. Checking equity: why differential item functioning analysis should be a routine part of developing conceptual assessments. CBE Life Sci Educ. 2017;16(2):rm2.","journal-title":"CBE Life Sci Educ"},{"issue":"1","key":"6540_CR27","doi-asserted-by":"publisher","first-page":"51","DOI":"10.1111\/j.1745-3984.2001.tb01116.x","volume":"38","author":"J Bielinski","year":"2001","unstructured":"Bielinski J, Davison ML. A sex difference by item difficulty interaction in multiple-choice mathematics items administered to national probability samples. J Educ Meas. 2001;38(1):51\u201377.","journal-title":"J Educ Meas"},{"issue":"1","key":"6540_CR28","doi-asserted-by":"publisher","first-page":"6","DOI":"10.54870\/1551-3440.1482","volume":"17","author":"SKSSN Shanmugam","year":"2020","unstructured":"Shanmugam SKSSN. Gender-related differential item functioning of mathematics computation items among non-native speakers of English. Math Enthus. 2020;17(1):6.","journal-title":"Math Enthus"},{"issue":"3","key":"6540_CR29","doi-asserted-by":"publisher","first-page":"299","DOI":"10.1111\/j.1471-6402.1990.tb00022.x","volume":"14","author":"JS Hyde","year":"1990","unstructured":"Hyde JS, Fennema E, Ryan M, Frost LA, Hopp C. Gender comparisons of mathematics attitudes and affect: a meta-analysis. Psychol Women Q. 1990;14(3):299\u2013324.","journal-title":"Psychol Women Q"},{"issue":"7","key":"6540_CR30","doi-asserted-by":"publisher","first-page":"769","DOI":"10.1016\/0883-0355(89)90027-X","volume":"13","author":"DL Nuttall","year":"1989","unstructured":"Nuttall DL, Goldstein H, Prosser R, Rasbash J. Differential school effectiveness. Int J Educ Res. 1989;13(7):769\u201376.","journal-title":"Int J Educ Res"},{"key":"6540_CR31","unstructured":"019 FACTS. Applicants and matriculants data. In: Association of American Medical Colleges; 2019."},{"issue":"19","key":"6540_CR32","doi-asserted-by":"publisher","first-page":"2103","DOI":"10.1001\/archinte.167.19.2103","volume":"167","author":"LN Dyrbye","year":"2007","unstructured":"Dyrbye LN, Thomas MR, Eacker A, Harper W, Massie FS Jr, Power DV, Huschka M, Novotny PJ, Sloan JA, Shanafelt TD. Race, ethnicity, and medical student well-being in the United States. Arch Intern Med. 2007;167(19):2103\u20139.","journal-title":"Arch Intern Med"},{"key":"6540_CR33","volume-title":"H. C. IRTPRO for windows (Version 5)","author":"L Cai","year":"2020","unstructured":"Cai L, Thissen D, du Toit S. H. C. IRTPRO for windows (Version 5). Lincolnwood: Scientific Software International; 2020."},{"issue":"Pt 2","key":"6540_CR34","doi-asserted-by":"publisher","first-page":"309","DOI":"10.1348\/000711007X249603","volume":"61","author":"L Cai","year":"2008","unstructured":"Cai L. SEM of another flavour: two new applications of the supplemented EM algorithm. Br J Math Stat Psychol. 2008;61(Pt 2):309\u201329.","journal-title":"Br J Math Stat Psychol"},{"issue":"2\u20133","key":"6540_CR35","doi-asserted-by":"publisher","first-page":"170","DOI":"10.1080\/13803611.2013.767621","volume":"19","author":"SG Sireci","year":"2013","unstructured":"Sireci SG, Rios JR. Decisions that make a difference in detecting differential item functioning. Educ Res Eval. 2013;19(2\u20133):170\u201387.","journal-title":"Educ Res Eval"},{"issue":"2","key":"6540_CR36","first-page":"22","volume":"5","author":"SG Sireci","year":"1994","unstructured":"Sireci SG, Mullane LA. Evaluating test fairness in licensure testing: the sensitivity review process. CLEAR exam rev. 1994;5(2):22\u20138.","journal-title":"CLEAR exam rev"},{"key":"6540_CR37","doi-asserted-by":"crossref","unstructured":"Maccoby EE, Jacklin CN. The psychology of sex differences. Stanford University Press; 1974.","DOI":"10.1515\/9781503620780"},{"issue":"1","key":"6540_CR38","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1007\/s10648-012-9215-x","volume":"25","author":"Y Maeda","year":"2013","unstructured":"Maeda Y, Yoon SY. A meta-analysis on gender differences in mental rotation ability measured by the Purdue spatial visualization tests: visualization of rotations (PSVT:R). Educ Psychol Rev. 2013;25(1):69\u201394.","journal-title":"Educ Psychol Rev"},{"issue":"6","key":"6540_CR39","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1002\/ase.1510","volume":"8","author":"K Yammine","year":"2015","unstructured":"Yammine K, Violato C. A meta-analysis of the educational effectiveness of three-dimensional visualization technologies in teaching anatomy. Anat Sci Educ. 2015;8(6):525\u201338.","journal-title":"Anat Sci Educ"},{"issue":"5","key":"6540_CR40","first-page":"387","volume":"48","author":"T Donnon","year":"2005","unstructured":"Donnon T, DesC\u00f4teaux JG, Violato C. Impact of cognitive imaging and sex differences on the development of laparoscopic suturing skills. Can J Surg. 2005;48(5):387\u201393.","journal-title":"Can J Surg"}],"container-title":["BMC Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-024-06540-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12909-024-06540-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12909-024-06540-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,29]],"date-time":"2025-01-29T09:43:24Z","timestamp":1738143804000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmededuc.biomedcentral.com\/articles\/10.1186\/s12909-024-06540-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,1,29]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["6540"],"URL":"https:\/\/doi.org\/10.1186\/s12909-024-06540-6","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-4087802\/v1","asserted-by":"object"}]},"ISSN":["1472-6920"],"issn-type":[{"value":"1472-6920","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1,29]]},"assertion":[{"value":"1 September 2023","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 December 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 January 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"Informed consent was obtained from all subjects as the study was approved by the Institutional Review Board, University of Minnesota. The assessment data was de-identified by the Medical Education Outcomes Center, University of Minnesota.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"146"}}