{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2023,5,8]],"date-time":"2023-05-08T14:55:21Z","timestamp":1683557721635},"reference-count":19,"publisher":"Oxford University Press (OUP)","issue":"suppl_4","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2015,4,1]]},"abstract":"<jats:title>ABSTRACT<\/jats:title>\n               <jats:p>Purpose: To determine whether the Uniformed Services University (USU) system of workplace performance assessment for students in the internal medicine clerkship at the USU continues to be a sensitive predictor of subsequent poor performance during internship, when compared with assessments in other USU third year clerkships. Method: Utilizing Program Director survey results from 2007 through 2011 and U.S. Medical Licensing Examination (USMLE) Step 3 examination results as the outcomes of interest, we compared performance during internship for students who had less than passing performance in the internal medicine clerkship and required remediation, against students whose performance in the internal medicine clerkship was successful. We further analyzed internship ratings for students who received less than passing grades during the same time period on other third year clerkships such as general surgery, pediatrics, obstetrics and gynecology, family medicine, and psychiatry to evaluate whether poor performance on other individual clerkships were associated with future poor performance at the internship level. Results for this recent cohort of graduates were compared with previously published findings. Results: The overall survey response rate for this 5 year cohort was 81% (689\/853). Students who received a less than passing grade in the internal medicine clerkship and required further remediation were 4.5 times more likely to be given poor ratings in the domain of medical expertise and 18.7 times more likely to demonstrate poor professionalism during internship. Further, students requiring internal medicine remediation were 8.5 times more likely to fail USMLE Step 3. No other individual clerkship showed any statistically significant associations with performance at the intern level. On the other hand, 40% of students who successfully remediated and did graduate were not identified during internship as having poor performance. Conclusions: Unsuccessful clinical performance which requires remediation in the third year internal medicine clerkship at Uniformed Services University of the Health Sciences continues to be strongly associated with poor performance at the internship level. No significant associations existed between any of the other clerkships and poor performance during internship and Step 3 failure. The strength of this association with the internal medicine clerkship is most likely because of an increased level of sensitivity in detecting poor performance.<\/jats:p>","DOI":"10.7205\/milmed-d-14-00567","type":"journal-article","created":{"date-parts":[[2015,4,6]],"date-time":"2015-04-06T13:12:10Z","timestamp":1428325930000},"page":"47-53","source":"Crossref","is-referenced-by-count":7,"title":["The Association of Students Requiring Remediation in the Internal Medicine Clerkship With Poor Performance During Internship"],"prefix":"10.1093","volume":"180","author":[{"given":"Brian A.","family":"Hemann","sequence":"first","affiliation":[{"name":"Department of Medicine, F. Edward H\u00e9bert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Steven J.","family":"Durning","sequence":"first","affiliation":[{"name":"Department of Medicine, F. Edward H\u00e9bert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"William F.","family":"Kelly","sequence":"first","affiliation":[{"name":"Department of Medicine, F. Edward H\u00e9bert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ting","family":"Dong","sequence":"first","affiliation":[{"name":"Department of Medicine, F. Edward H\u00e9bert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Louis N.","family":"Pangaro","sequence":"first","affiliation":[{"name":"Department of Medicine, F. Edward H\u00e9bert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul A.","family":"Hemmer","sequence":"first","affiliation":[{"name":"Department of Medicine, F. Edward H\u00e9bert School of Medicine, Uniformed Services University of the Health Sciences, 4301 Jones Bridge Road, Bethesda, MD 20814."}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"286","reference":[{"issue":"7","key":"2020051807182098100_bib1","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1097\/ACM.0b013e3181a82013","article-title":"Internal medicine clerkship characteristics associated with enhanced student examination performance","volume":"84","author":"Griffith","year":"2009","journal-title":"Acad Med"},{"issue":"1","key":"2020051807182098100_bib2","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1111\/j.1365-2929.2006.02647.x","article-title":"Effectiveness of medical school admissions criteria in predicting residency ranking four years later","volume":"41","author":"Peskun","year":"2007","journal-title":"Med Educ"},{"issue":"10 Suppl","key":"2020051807182098100_bib3","doi-asserted-by":"crossref","first-page":"S21","DOI":"10.1097\/00001888-200510001-00009","article-title":"What predicts USMLE Step 3 performance?","volume":"80","author":"Andriole","year":"2005","journal-title":"Acad Med"},{"issue":"9","key":"2020051807182098100_bib4","doi-asserted-by":"crossref","first-page":"998","DOI":"10.1097\/00001888-199809000-00021","article-title":"Internship ratings as a validity outcome measure for an evaluation system to identify inadequate clerkship performance","volume":"73","author":"Lavin","year":"1998","journal-title":"Acad Med"},{"issue":"12","key":"2020051807182098100_bib5","doi-asserted-by":"crossref","first-page":"1711","DOI":"10.1007\/s11606-007-0405-z","article-title":"Identifying medical students likely to exhibit poor professionalism and knowledge during internship","volume":"22","author":"Greenburg","year":"2007","journal-title":"J Gen Intern Med"},{"issue":"25","key":"2020051807182098100_bib6","doi-asserted-by":"crossref","first-page":"2673","DOI":"10.1056\/NEJMsa052596","article-title":"Disciplinary action by medical boards and prior behavior in medical school","volume":"353","author":"Papadakis","year":"2005","journal-title":"N Engl J Med"},{"issue":"10 Suppl","key":"2020051807182098100_bib7","doi-asserted-by":"crossref","first-page":"S55","DOI":"10.1097\/00001888-200510001-00016","article-title":"Does group discussion of student clerkship performance at an education committee affect an individual committee member's decisions?","volume":"80","author":"Gaglione","year":"2005","journal-title":"Acad Med"},{"issue":"10","key":"2020051807182098100_bib8","doi-asserted-by":"crossref","first-page":"964","DOI":"10.1097\/00001888-200510000-00018","article-title":"The feasibility, reliability, and validity of a program director's (supervisor's) evaluation form for medical school graduates","volume":"80","author":"Durning","year":"2005","journal-title":"Acad Med"},{"issue":"4 Suppl","key":"2020051807182098100_bib9","doi-asserted-by":"crossref","first-page":"97","DOI":"10.7205\/MILMED-D-14-00551","article-title":"Development and initial validation of a program director's evaluation form for medical school graduates","volume":"180","author":"Dong","year":"2015","journal-title":"Mil Med"},{"issue":"11","key":"2020051807182098100_bib10","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1097\/00001888-199911000-00012","article-title":"A new vocabulary and other innovations for improving descriptive in-training evaluations","volume":"74","author":"Pangaro","year":"1999","journal-title":"Acad Med"},{"issue":"6","key":"2020051807182098100_bib11","doi-asserted-by":"crossref","first-page":"580","DOI":"10.1080\/014215901200901023","article-title":"Assessing the effectiveness of combining evaluation methods for the early identification of students with inadequate knowledge during a clerkship","volume":"23","author":"Hemmer","year":"2001","journal-title":"Med Teach"},{"issue":"10 Suppl","key":"2020051807182098100_bib12","doi-asserted-by":"crossref","first-page":"S36","DOI":"10.1097\/00001888-200310001-00012","article-title":"Intersite consistency as a measurement of programmatic evaluation in a medicine clerkship with multiple, geographically separated sites","volume":"78","author":"Durning","year":"2003","journal-title":"Acad Med"},{"issue":"5","key":"2020051807182098100_bib13","doi-asserted-by":"crossref","first-page":"766","DOI":"10.1542\/peds.2014-0418","article-title":"Writing medical student and resident performance evaluations: beyond \u201cperformed as expected.\u201d","volume":"133","author":"Holmes","year":"2014","journal-title":"Pediatrics"},{"issue":"6","key":"2020051807182098100_bib14","doi-asserted-by":"crossref","first-page":"e1197","DOI":"10.3109\/0142159X.2013.788789","article-title":"Frameworks for learner assessment in medicine: AMEE Guide No. 78","volume":"35","author":"Pangaro","year":"2013","journal-title":"Med Teach"},{"issue":"4","key":"2020051807182098100_bib15","first-page":"353","article-title":"A system for evaluating and counseling marginal students during clinical clerkships","volume":"62","author":"Noel","year":"1987","journal-title":"J Med Educ"},{"issue":"7","key":"2020051807182098100_bib16","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1097\/00001888-199707000-00018","article-title":"The effectiveness of formal evaluation sessions during clinical clerkships in better identifying students with marginal funds of knowledge","volume":"72","author":"Hemmer","year":"1997","journal-title":"Acad Med"},{"issue":"2","key":"2020051807182098100_bib17","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1097\/00001888-200002000-00016","article-title":"Assessing how well three evaluation methods detect deficiencies in medical students' professionalism in two settings of an internal medicine clerkship","volume":"75","author":"Hemmer","year":"2000","journal-title":"Acad Med"},{"issue":"7","key":"2020051807182098100_bib18","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1097\/00001888-199307000-00019","article-title":"A process for identifying marginal performers among students in a clerkship","volume":"68","author":"Parenti","year":"1993","journal-title":"Acad Med"},{"issue":"4","key":"2020051807182098100_bib19","doi-asserted-by":"crossref","first-page":"488","DOI":"10.1097\/ACM.0b013e31820dc384","article-title":"Perspective: viewing \u201cstrugglers\u201d through a different lens: how a self-regulated learning perspective can help medical educators with assessment and remediation","volume":"86","author":"Durning","year":"2011","journal-title":"Acad Med"}],"container-title":["Military Medicine"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/academic.oup.com\/milmed\/article-pdf\/180\/suppl_4\/47\/33225691\/milmed-d-14-00567.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/academic.oup.com\/milmed\/article-pdf\/180\/suppl_4\/47\/33225691\/milmed-d-14-00567.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,5,18]],"date-time":"2020-05-18T11:22:28Z","timestamp":1589800948000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/milmed\/article\/180\/suppl_4\/47\/4210192"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,4,1]]},"references-count":19,"journal-issue":{"issue":"suppl_4","published-print":{"date-parts":[[2015,4,1]]}},"URL":"https:\/\/doi.org\/10.7205\/milmed-d-14-00567","relation":{},"ISSN":["1930-613X","0026-4075"],"issn-type":[{"value":"1930-613X","type":"electronic"},{"value":"0026-4075","type":"print"}],"subject":[],"published-other":{"date-parts":[[2015,4]]},"published":{"date-parts":[[2015,4,1]]}}}