{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T14:17:33Z","timestamp":1788358653446,"version":"build-2803163510"},"reference-count":26,"publisher":"Walter de Gruyter GmbH","issue":"1","license":[{"start":{"date-parts":[[2024,7,18]],"date-time":"2024-07-18T00:00:00Z","timestamp":1721260800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2024,12,20]]},"abstract":"Abstract<\/jats:title>\n \n Context<\/jats:title>\n Osteopathic (Doctor of Osteopathic Medicine [DO]) medical students account for more than 25 % of all medical students in the United States.<\/jats:p>\n <\/jats:sec>\n \n Objectives<\/jats:title>\n This study examined the predictive validity of Medical College Admission Test (MCAT) total scores and cumulative undergraduate grade point averages (UGPAs) for performance on the Comprehensive Osteopathic Medical Licensing Examination of the United States (COMLEX-USA) Level 1 and Level 2-CE (Cognitive Evaluation) licensure examinations administered by the National Board of Osteopathic Medical Examiners (NBOME). Additionally, the study examined the degree to which MCAT total scores and UGPAs provide comparable prediction of student performance by key sociodemographic variables.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n This study involved a collaborative effort between the Association of American Medical Colleges (AAMC), the American Association of Colleges of Osteopathic Medicine (AACOM) and the NBOME. Data were examined for 39 accredited DO-granting medical schools in the United States during the 2017 application cycle. Researchers utilized three regression models that included MCAT total scores, cumulative UGPA, and combined MCAT total scores and cumulative UGPA to determine predictive validity. Researchers also examined the comparability of prediction for sociodemographic variables by examining the differences between observed and predicted error for both scores and pass\/fail success rates.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Medium to large correlations were discernible between MCAT total scores, UGPA, and COMLEX-USA examination outcomes. For both COMLEX-USA Level 1 and Level 2-CE scores and pass\/fail outcomes, MCAT scores alone provided superior predictive value to UGPA alone. However, MCAT scores and UGPA utilized in conjunction provided the best predictive value. When predicting both licensure examination scores and pass\/fail outcomes by sociodemographic variables, all three models provided comparable predictive accuracy.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n Findings from this comprehensive study of DO-granting medical schools provide evidence for the value-added benefit of taking MCAT scores and UGPA into consideration, particularly when these measures are utilized in conjunction. Further, findings provide evidence indicating that individuals from different sociodemographic backgrounds who enter medical school with similar MCAT scores and UGPA perform similarly on licensure examination outcome measures.<\/jats:p>\n <\/jats:sec>","DOI":"10.1515\/jom-2023-0265","type":"journal-article","created":{"date-parts":[[2024,7,17]],"date-time":"2024-07-17T03:55:57Z","timestamp":1721188557000},"page":"9-18","source":"Crossref","is-referenced-by-count":8,"title":["The predictive validity of MCAT scores and undergraduate GPA for COMLEX-USA licensure exam performance of students enrolled in osteopathic medical schools"],"prefix":"10.1515","volume":"125","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5508-1480","authenticated-orcid":false,"given":"Kenneth D.","family":"Royal","sequence":"first","affiliation":[{"name":"Director of MCAT Research and Data Science , 8352 Association of American Medical Colleges , Washington , DC , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Christian","family":"Meyer","sequence":"additional","affiliation":[{"name":"Psychometric Intern , Association of American Medical Colleges , Washington , DC , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8748-9114","authenticated-orcid":false,"given":"Erik","family":"Guercio","sequence":"additional","affiliation":[{"name":"Senior Director of Research , American Association of Colleges of Osteopathic Medicine , Bethesda , MD , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5273-8299","authenticated-orcid":false,"given":"Mark","family":"Speicher","sequence":"additional","affiliation":[{"name":"Senior Vice President for Learning, Innovation and Research , American Association of Colleges of Osteopathic Medicine , Bethesda , MD , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Joseph","family":"Flamini","sequence":"additional","affiliation":[{"name":"Vice President for Administration\/Chief Operating Officer , National Board of Osteopathic Medical Examiners , Chicago , IL , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jeanne M.","family":"Sandella","sequence":"additional","affiliation":[{"name":"Vice President for Professional Development Initiatives and Communications , National Board of Osteopathic Medical Examiners , Conshohocken , PA , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tsung-Hsun","family":"Tsai","sequence":"additional","affiliation":[{"name":"Associate Vice President for Assessment Services and Research , National Board of Osteopathic Medical Examiners , Chicago , IL , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cynthia A.","family":"Searcy","sequence":"additional","affiliation":[{"name":"Senior Director of MCAT Science Strategy and Solutions , Association of American Medical Colleges , Washington , DC , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"374","published-online":{"date-parts":[[2024,7,18]]},"reference":[{"key":"2026090213570306016_j_jom-2023-0265_ref_001","doi-asserted-by":"crossref","unstructured":"Conrad, SS, Addams, AN, Young, GH. Holistic review in medical school admissions and selection: a strategic, mission-driven response to shifting societal needs. Acad Med 2016;91:1472\u20134. https:\/\/doi.org\/10.1097\/acm.0000000000001403.","DOI":"10.1097\/ACM.0000000000001403"},{"key":"2026090213570306016_j_jom-2023-0265_ref_002","doi-asserted-by":"crossref","unstructured":"Terregino, CA, Saguil, A, Price-Johnson, T, Anachebe, NF, Goodell, K. The diversity and success of medical school applicants with scores in the middle third of the MCAT score scale. Acad Med 2020;95:344\u201350. https:\/\/doi.org\/10.1097\/acm.0000000000002941.","DOI":"10.1097\/ACM.0000000000002941"},{"key":"2026090213570306016_j_jom-2023-0265_ref_003","unstructured":"Association of American Medical Colleges. Admissions officers survey; 2021. Unpublished data."},{"key":"2026090213570306016_j_jom-2023-0265_ref_004","unstructured":"Association of American Medical Colleges. Using MCAT data in 2023 medical student selection. Washington, DC: Association of American Medical Colleges; 2022."},{"key":"2026090213570306016_j_jom-2023-0265_ref_005","doi-asserted-by":"crossref","unstructured":"Hanson, JT, Busche, K, Elks, ML, Jackson-Williams, LE, Liotta, RA, Miller, C, et al.. The validity of MCAT scores in predicting students\u2019 performance and progress in medical school: results from a multisite study. Acad Med 2022;97:1374\u201384. https:\/\/doi.org\/10.1097\/acm.0000000000004754.","DOI":"10.1097\/ACM.0000000000004754"},{"key":"2026090213570306016_j_jom-2023-0265_ref_006","unstructured":"American Osteopathic Association. Osteopathic medical profession report; 2022. https:\/\/osteopathic.org\/wp-content\/uploads\/2022-AOA-OMP-Report.pdf [Accessed 22 Mar 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_007","unstructured":"American Association of Colleges of Osteopathic Medicine. Quick facts 2022. https:\/\/www.aacom.org\/become-a-doctor\/about-osteopathic-medicine\/quick-facts [Accessed 22 Mar 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_008","doi-asserted-by":"crossref","unstructured":"Cohen, J. The separate osteopathic medical education pathway: isn\u2019t it time we got our acts together? Counterpoint. Acad Med 2009;84:696. https:\/\/doi.org\/10.1097\/acm.0b013e3181a3ddaa.","DOI":"10.1097\/ACM.0b013e3181a3ddaa"},{"key":"2026090213570306016_j_jom-2023-0265_ref_009","unstructured":"Knight, V. American medical students less likely to choose to become primary care doctors. KFF Health News. https:\/\/kffhealthnews.org\/news\/american-medical-students-less-likely-to-choose-to-become-primary-care-doctors\/.[Accessed 27 Sep 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_010","unstructured":"American Association of Colleges of Osteopathic Medicine. 2021-2022 Academic year entering student survey summary report. 2021-2022-academic-year-entering-student-survey-summary-report.pdf (aacom.org) [Accessed 27 Sep 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_011","unstructured":"Association of American Medical Colleges. Matriculating student questionnaire (MSQ). https:\/\/www.aamc.org\/media\/57926\/download [Accessed 27 Sep 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_012","doi-asserted-by":"crossref","unstructured":"Agahi, F, Speicher, MR, Cisek, G. Association between undergraduate performance predictors and academic and clinical performance of osteopathic medical students. J Am Osteopath Assoc 2018;118:106\u201314. https:\/\/doi.org\/10.7556\/jaoa.2018.025.","DOI":"10.7556\/jaoa.2018.025"},{"key":"2026090213570306016_j_jom-2023-0265_ref_013","doi-asserted-by":"crossref","unstructured":"Steed, KS, Kadavakollu, S. How to prepare for the medical college admissions test (MCAT): six important tips for pre-medical students from rural areas. Med Sci Educ 2019;29:1147\u201353. https:\/\/doi.org\/10.1007\/s40670-019-00823-0.","DOI":"10.1007\/s40670-019-00823-0"},{"key":"2026090213570306016_j_jom-2023-0265_ref_014","unstructured":"Wolla, SA, Sullivan, J. Education, income, and wealth. Page One Economics; 2017. https:\/\/research.stlouisfed.org\/publications\/page1-econ\/2017\/01\/03\/education-income-and-wealth [Accessed 22 Mar 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_015","unstructured":"National Board of Osteopathic Medical Examiners. COMLEX-USA level 1; 2022a. https:\/\/www.nbome.org\/assessments\/comlex-usa\/comlex-usa-level-1 [Accessed 22 Mar 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_016","unstructured":"National Board of Osteopathic Medical Examiners. COMLEX-USA level 2-CE; 2022b. https:\/\/www.nbome.org\/assessments\/comlex-usa\/comlex-usa-level-2-ce [Accessed 22 Mar 2023]."},{"key":"2026090213570306016_j_jom-2023-0265_ref_017","doi-asserted-by":"crossref","unstructured":"Sackett, PR, Yang, H. Correction for range restriction: an expanded typology. J Appl Psychol 2000;85:112\u201318. https:\/\/doi.org\/10.1037\/\/0021-9010.85.1.112.","DOI":"10.1037\/0021-9010.85.1.112"},{"key":"2026090213570306016_j_jom-2023-0265_ref_018","unstructured":"Cohen, D. Statistical power analysis for the behavioral sciences, 2nd ed Hillsdale, NJ: Lawrence Erlbaum Associates; 1988."},{"key":"2026090213570306016_j_jom-2023-0265_ref_019","doi-asserted-by":"crossref","unstructured":"Lucey, CR, Saguil, A. The consequences of structural racism on MCAT scores and medical school admissions: the past is prologue. Acad Med 2020;95:351\u20136. https:\/\/doi.org\/10.1097\/acm.0000000000002939.","DOI":"10.1097\/ACM.0000000000002939"},{"key":"2026090213570306016_j_jom-2023-0265_ref_020","doi-asserted-by":"crossref","unstructured":"Busche, K, Elks, ML, Hanson, JT, Jackson-Williams, L, Manuel, RS, Parsons, WL, et al.. The validity of scores from the new MCAT exam in predicting student performance: results from a multisite study. Acad Med 2020;95:387\u201395. https:\/\/doi.org\/10.1097\/acm.0000000000002942.","DOI":"10.1097\/ACM.0000000000002942"},{"key":"2026090213570306016_j_jom-2023-0265_ref_021","doi-asserted-by":"crossref","unstructured":"Davis, D, Dorsey, JK, Franks, RD, Sackett, PR, Searcy, CA, Zhao, X. Do racial and ethnic group differences in performance on the MCAT exam reflect test bias? Acad Med 2013;88:593\u2013602. https:\/\/doi.org\/10.1097\/acm.0b013e318286803a.","DOI":"10.1097\/ACM.0b013e318286803a"},{"key":"2026090213570306016_j_jom-2023-0265_ref_022","unstructured":"American Educational Research Association, American Psychological Association, National Council on Measurement in Education. Standards for educational and psychological testing. Washington, DC: American Psychological Association; 2014."},{"key":"2026090213570306016_j_jom-2023-0265_ref_023","unstructured":"Kane, M. Validation strategies: delineating and validating proposed interpretations and uses of test scores. In: Lane, S, Raymond, MR, Haladyna, TM, editors. Handbook of test development. New York, NY: Routledge; 2015:80\u201396 pp."},{"key":"2026090213570306016_j_jom-2023-0265_ref_024","doi-asserted-by":"crossref","unstructured":"Kane, M. The argument-based approach to validation. Sch Psychol Rev 2013;42:448\u201357. https:\/\/doi.org\/10.1080\/02796015.2013.12087465.","DOI":"10.1080\/02796015.2013.12087465"},{"key":"2026090213570306016_j_jom-2023-0265_ref_025","doi-asserted-by":"crossref","unstructured":"Messick, S. Validity of psychological assessment: validation of inferences from persons\u2019 responses and performances as scientific inquiry into score meaning. Am Psychol 1995;50:741\u20139. https:\/\/doi.org\/10.1037\/0003-066x.50.9.741.","DOI":"10.1037\/0003-066X.50.9.741"},{"key":"2026090213570306016_j_jom-2023-0265_ref_026","unstructured":"National Board of Osteopathic Medical Examiners. COMLEX-USA Level 1 to eliminate numeric scores; 2022c. https:\/\/www.nbome.org\/news\/comlex-usa-level-1-to-eliminate-numeric-scores [Accessed 22 Mar 2023]."}],"container-title":["Journal of Osteopathic Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jom-2023-0265\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jom-2023-0265\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,2]],"date-time":"2026-09-02T13:57:08Z","timestamp":1788357428000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jom-2023-0265\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,7,18]]},"references-count":26,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,7,18]]},"published-print":{"date-parts":[[2024,12,20]]}},"alternative-id":["10.1515\/jom-2023-0265"],"URL":"https:\/\/doi.org\/10.1515\/jom-2023-0265","relation":{},"ISSN":["2702-3648"],"issn-type":[{"value":"2702-3648","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,7,18]]}}}