{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,10]],"date-time":"2026-01-10T08:33:12Z","timestamp":1768033992416,"version":"3.49.0"},"reference-count":20,"publisher":"Oxford University Press (OUP)","issue":"suppl_4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,4,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n               <jats:p>Purpose: To determine if there is an association between several commonly obtained premedical school and medical school measures and board certification performance. We specifically included measures from our institution for which we have predictive validity evidence into the internship year. We hypothesized that board certification would be most likely to be associated with clinical measures of performance during medical school, and with scores on standardized tests, whether before or during medical school. Methods: Achieving board certification in an American Board of Medical Specialties specialty was used as our outcome measure for a 7-year cohort of graduates (1995\u20132002). Age at matriculation, Medical College Admissions Test (MCAT) score, undergraduate college grade point average (GPA), undergraduate college science GPA, Uniformed Services University (USU) cumulative GPA, USU preclerkship GPA, USU clerkship year GPA, departmental competency committee evaluation, Internal Medicine (IM) clerkship clinical performance rating (points), IM total clerkship points, history of Student Promotion Committee review, and United States Medical Licensing Examination (USMLE) Step 1 score and USMLE Step 2 clinical knowledge score were associated with this outcome. Results: Ninety-three of 1,155 graduates were not certified, resulting in an average rate of board certification of 91.9% for the study cohort. Significant small correlations were found between board certification and IM clerkship points (r = 0.117), IM clerkship grade (r = 0.108), clerkship year GPA (r = 0.078), undergraduate college science GPA (r = 0.072), preclerkship GPA and medical school GPA (r = 0.068 for both), USMLE Step 1 (r = 0.066), undergraduate college total GPA (r = 0.062), and age at matriculation (r = \u22120.061). In comparing the two groups (board certified and not board certified cohorts), significant differences were seen for all included variables with the exception of MCAT and USMLE Step 2 clinical knowledge scores. All the variables put together could explain 4.1% of the variance of board certification by logistic regression. Conclusions: This investigation provides some additional validity evidence that measures collected for purposes of student evaluation before and during medical school are warranted.<\/jats:p>","DOI":"10.7205\/milmed-d-14-00569","type":"journal-article","created":{"date-parts":[[2015,4,6]],"date-time":"2015-04-06T13:12:10Z","timestamp":1428325930000},"page":"18-23","source":"Crossref","is-referenced-by-count":15,"title":["Are Commonly Used Premedical School or Medical School Measures Associated With Board Certification?"],"prefix":"10.1093","volume":"180","author":[{"given":"Steven J.","family":"Durning","sequence":"first","affiliation":[{"name":"Department of Medicine, Uniformed Services University of the Health Sciences,4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting","family":"Dong","sequence":"first","affiliation":[{"name":"Department of Medicine, Uniformed Services University of the Health Sciences,4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul A.","family":"Hemmer","sequence":"first","affiliation":[{"name":"Department of Medicine, Uniformed Services University of the Health Sciences,4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William R.","family":"Gilliland","sequence":"first","affiliation":[{"name":"F. Edward H\u00e9bert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"David F.","family":"Cruess","sequence":"first","affiliation":[{"name":"Department of Preventive Medicine and Biometrics, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John R.","family":"Boulet","sequence":"first","affiliation":[{"name":"Foundation for Advancement of International Medical Education and Research (FAIMER), 3634 Market Street, Philadelphia, PA 19104."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louis N.","family":"Pangaro","sequence":"first","affiliation":[{"name":"Department of Medicine, Uniformed Services University of the Health Sciences,4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","reference":[{"key":"2020051807182199600_bib1","doi-asserted-by":"crossref","first-page":"719","DOI":"10.7326\/0003-4819-110-9-719","article-title":"Predictive validity of certification by the American Board of Internal Medicine","volume":"110","author":"Ramsey","year":"1989","journal-title":"Ann Intern Med"},{"key":"2020051807182199600_bib2","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1001\/jama.298.9.993","article-title":"Physician scores on a national clinical skills examination as predictors of complaints to medical regulatory authorities","volume":"298","author":"Tamblyn","year":"2007","journal-title":"JAMA"},{"key":"2020051807182199600_bib3","doi-asserted-by":"crossref","first-page":"1396","DOI":"10.1001\/archinte.168.13.1396","article-title":"Associations between maintenance of certification examinations scores and quality of care for medicine beneficiaries","volume":"168","author":"Holmboe","year":"2008","journal-title":"Arch Intern Med"},{"issue":"12","key":"2020051807182199600_bib4","doi-asserted-by":"crossref","first-page":"1379","DOI":"10.1001\/jama.2010.1378","article-title":"Putting the secure examination to the test","volume":"304","author":"Lipner","year":"2010","journal-title":"JAMA"},{"key":"2020051807182199600_bib5","volume-title":"A Framework for Medical License Renewal. Federation of State Medical Boards","author":"Maintenance of Licensure (MOL)"},{"issue":"1","key":"2020051807182199600_bib6","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1097\/ALN.0b013e3181c62e2f","article-title":"Predicting success on the certification examinations of the American Board of Anesthesiology","volume":"112","author":"McClintock","year":"2010","journal-title":"Anesthesiology"},{"issue":"2","key":"2020051807182199600_bib7","doi-asserted-by":"crossref","first-page":"262","DOI":"10.4300\/JGME-D-12-00088.1","article-title":"Relationship between performance on child and adolescent psychiatry in-training and certification examinations","volume":"5","author":"Juul","year":"2013","journal-title":"J Grad Med Educ"},{"issue":"9","key":"2020051807182199600_bib8","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1001\/archsurg.2010.177","article-title":"Predicting performance on the American Board of Surgery qualifying and certifying examinations: a multi-institutional study","volume":"145","author":"de Virgilio","year":"2010","journal-title":"Arch Surg"},{"key":"2020051807182199600_bib9","doi-asserted-by":"crossref","first-page":"86","DOI":"10.1007\/BF02599990","article-title":"NBME Examination Part I as a predictor of clinical and ABIM certifying examination performances","volume":"8","author":"Sosenko","year":"1993","journal-title":"J Gen Intern Med"},{"key":"2020051807182199600_bib10","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1097\/00001888-199310000-00005","article-title":"Use of the USMLE to select residents","volume":"68","author":"Berner","year":"1993","journal-title":"Acad Med"},{"issue":"11","key":"2020051807182199600_bib11","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1097\/00001888-199911000-00012","article-title":"A new vocabulary and other innovations for improving descriptive in-training evaluations","volume":"74","author":"Pangaro","year":"1999","journal-title":"Acad Med"},{"issue":"12","key":"2020051807182199600_bib12","doi-asserted-by":"crossref","first-page":"1216","DOI":"10.1097\/00001888-200012000-00021","article-title":"Using formal evaluation sessions for case-based faculty development during clinical clerkships","volume":"75","author":"Hemmer","year":"2000","journal-title":"Acad Med"},{"issue":"10 Suppl","key":"2020051807182199600_bib13","doi-asserted-by":"crossref","first-page":"S36","DOI":"10.1097\/00001888-200310001-00012","article-title":"Intersite consistency as a measurement of programmatic evaluation in a medicine clerkship with multiple, geographically separated sites","volume":"78","author":"Durning","year":"2003","journal-title":"Acad Med"},{"issue":"9","key":"2020051807182199600_bib14","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1097\/00001888-199809000-00021","article-title":"Internship ratings as a validity outcome measure for an evaluation system to identify inadequate clerkship performance","volume":"73","author":"Lavin","year":"1998","journal-title":"Acad Med"},{"issue":"4 Suppl","key":"2020051807182199600_bib15","doi-asserted-by":"crossref","first-page":"47","DOI":"10.7205\/MILMED-D-14-00567","article-title":"The association of students requiring remediation in the internal medicine clerkship with poor performance during internship","volume":"180","author":"Hemann","year":"2015","journal-title":"Mil Med"},{"issue":"3","key":"2020051807182199600_bib16","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1080\/10401330802199609","article-title":"Does student promotions committee appearance predict below-average performance during internship? A seven-year study","volume":"20","author":"Durning","year":"2008","journal-title":"Teach Learn Med"},{"issue":"6","key":"2020051807182199600_bib17","doi-asserted-by":"crossref","first-page":"640","DOI":"10.7205\/MILMED.172.6.640","article-title":"Do U.S. medical licensure examination step 1 scores correlate with council on resident education in obstetrics and gynecology in-training examination scores and American board of obstetrics and gynecology written examination performance?","volume":"172","author":"Armstrong","year":"2007","journal-title":"Mil Med"},{"key":"2020051807182199600_bib18","doi-asserted-by":"crossref","first-page":"668","DOI":"10.3389\/fpsyg.2013.00668","article-title":"Narrative descriptions should replace grades and numerical ratings for clinical performance in medical education in the United States","volume":"4","author":"Hanson","year":"2013","journal-title":"Front Psychol"},{"issue":"10 Suppl","key":"2020051807182199600_bib19","doi-asserted-by":"crossref","first-page":"S55","DOI":"10.1097\/00001888-200510001-00016","article-title":"Does group discussion of student clerkship performance at an education committee affect an individual committee member's decisions?","volume":"80","author":"Gaglione","year":"2005","journal-title":"Acad Med"},{"key":"2020051807182199600_bib20","volume-title":"ACGME Common Program Requirements","author":"ACGME"}],"container-title":["Military Medicine"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/milmed\/article-pdf\/180\/suppl_4\/18\/33225620\/milmed-d-14-00569.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/milmed\/article-pdf\/180\/suppl_4\/18\/33225620\/milmed-d-14-00569.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,5,18]],"date-time":"2020-05-18T11:22:54Z","timestamp":1589800974000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/milmed\/article\/180\/suppl_4\/18\/4210194"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,1]]},"references-count":20,"journal-issue":{"issue":"suppl_4","published-print":{"date-parts":[[2015,4,1]]}},"URL":"https:\/\/doi.org\/10.7205\/milmed-d-14-00569","relation":{},"ISSN":["1930-613X","0026-4075"],"issn-type":[{"value":"1930-613X","type":"electronic"},{"value":"0026-4075","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,4]]},"published":{"date-parts":[[2015,4,1]]}}}