{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,17]],"date-time":"2026-09-17T17:15:58Z","timestamp":1789665358339,"version":"4.0.1"},"reference-count":49,"publisher":"Wiley","issue":"11","license":[{"start":{"date-parts":[[2020,8,3]],"date-time":"2020-08-03T00:00:00Z","timestamp":1596412800000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["asmepublications.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Medical Education"],"published-print":{"date-parts":[[2020,11]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Context<\/jats:title>\n                    <jats:p>Residency programmes invest considerable time and resources in candidate interviews as a result of their perceived ability to reveal important social traits. However, studies examining the ability of interviews to predict resident performance have shown mixed findings, and the role of the interview in candidate evaluation remains unclear. This mixed\u2010methods study, conducted in an anaesthesiology residency programme at a large academic medical centre, examined how interviews contributed to candidate assessment and whether the addition of behavioural questions to interviews altered their role in the evaluation process.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>During the 2018\u20102019 residency selection season in the Department of Anesthesiology and Critical Care at the University of Pennsylvania, independent ratings for each interviewee were collected from faculty interviewers. Consensus ratings subsequently established by committee were also collected. Committee meetings were audiorecorded and transcribed for qualitative analysis. Behavioural questions were integrated into half of interview days. Ratings of candidates interviewed on behavioural question days were compared statistically with those of candidates interviewed on non\u2010behavioural question days.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Qualitative analysis showed that interviewers heavily emphasised candidates\u2019 application files in evaluating the interviews. Interviewers focused on candidates\u2019 academic records and favoured candidates whose interview behaviours were consistent with their applications and whose applications demonstrated similarities to interviewers\u2019 traits. The addition of behavioural questions demonstrated little ability to alter these dynamics. Quantitatively, there were no significant differences in candidate rating outcomes between behavioural and non\u2010behavioural interviewing days, whereas a higher medical school rating and higher score on the United States Medical Licensing Examination Step\u00a01 were associated with a more favourable consensus rating.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusions<\/jats:title>\n                    <jats:p>Residency candidates\u2019 application files predisposed interviewers\u2019 experience and evaluation of interviews, preventing the interviews from providing discrete assessments of interpersonal qualities, even when behavioural questions were included. In the continued effort to perform well\u2010rounded assessments of residency candidates, further research and reflection on the role of interviewing in evaluation are necessary.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1111\/medu.14248","type":"journal-article","created":{"date-parts":[[2020,5,20]],"date-time":"2020-05-20T17:54:37Z","timestamp":1589997277000},"page":"1029-1039","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":10,"title":["The role of the interview in residency selection: A mixed\u2010methods study"],"prefix":"10.1111","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7931-7013","authenticated-orcid":false,"given":"Emily K. B.","family":"Gordon","sequence":"first","affiliation":[{"name":"Department of Anesthesiology and Critical Care Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Justin T.","family":"Clapp","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Critical Care Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Penn Center for Perioperative Outcomes Research and Transformation Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Leonard Davis Institute of Health Economics University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Sarah J.","family":"Heins","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Critical Care Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Timothy G.","family":"Gaulton","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Critical Care Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Penn Center for Perioperative Outcomes Research and Transformation Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Leonard Davis Institute of Health Economics University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Meghan B.","family":"Lane\u2010Fall","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Critical Care Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Penn Center for Perioperative Outcomes Research and Transformation Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Leonard Davis Institute of Health Economics University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8474-3682","authenticated-orcid":false,"given":"Jaya","family":"Aysola","sequence":"additional","affiliation":[{"name":"Leonard Davis Institute of Health Economics University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Department of Medicine Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dimitri Y.","family":"Baranov","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Critical Care Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lee A.","family":"Fleisher","sequence":"additional","affiliation":[{"name":"Department of Anesthesiology and Critical Care Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Penn Center for Perioperative Outcomes Research and Transformation Perelman School of Medicine University of Pennsylvania Philadelphia Pennsylvania USA"},{"name":"Leonard Davis Institute of Health Economics University of Pennsylvania Philadelphia Pennsylvania USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2020,8,3]]},"reference":[{"key":"e_1_2_10_2_1","first-page":"1","volume-title":"Results and Data: 2019 Main Residency Match\u00ae","author":"National Resident Matching Program","year":"2019"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.amjmed.2013.03.018"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1097\/SAP.0b013e3181b4bcf5"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.2.4471.357"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2014.993600"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.5694\/mja17.01224"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.tate.2007.06.001"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2019.1703919"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.13450"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.7861\/clinmedicine.16-4-339"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1553-2712.2000.tb01892.x"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2010.10.003"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.4300\/JGME-D-14-00236.1"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjopen-2018-026424"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-199610000-00017"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7028.15.1.18"},{"key":"e_1_2_10_18_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.1984.tb01284.x"},{"key":"e_1_2_10_19_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15327043hup1001_3"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004424-199205000-00013"},{"issue":"1","key":"e_1_2_10_21_1","article-title":"The behavioral interview, a method to evaluate ACGME competencies in resident selection: a pilot project","volume":"7","author":"Easdown LJ","year":"2005","journal-title":"J Educ Perioper Med"},{"key":"e_1_2_10_22_1","unstructured":"Association of American Medical Colleges.Holistic review. [Internet]. AAMC; 2019.https:\/\/www.aamc.org\/services\/member\u2010capacity\u2010building\/holistic\u2010review. Accessed November 21 2019."},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1744-6570.1997.tb00709.x"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1037\/0021-9010.67.5.577"},{"key":"e_1_2_10_25_1","unstructured":"US News & World Report.2021 Best Medical Schools: Research. [Internet]. US News & World Report; 2019.https:\/\/www.usnews.com\/best\u2010graduate\u2010schools\/top\u2010medical\u2010schools\/research\u2010rankings. Accessed October 22 2019."},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.1177\/1525822X980100020301"},{"key":"e_1_2_10_27_1","volume-title":"The Collected Papers of Charles Sanders Peirce, Vols V and VI. Pragmatism and Pragmaticism and Scientific Metaphysics","author":"Peirce CS","year":"1935"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.7208\/chicago\/9780226180458.001.0001"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1177\/0735275112457914"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.5465\/amr.2007.26586822"},{"issue":"4","key":"e_1_2_10_31_1","first-page":"417","article-title":"Controlling bias in observational studies: a review","volume":"35","author":"Cochran WG","year":"1973","journal-title":"Sankhy\u0101 Indian J Stat Ser A"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e3181b6a9af"},{"key":"e_1_2_10_33_1","doi-asserted-by":"publisher","DOI":"10.1037\/1089-2680.2.2.175"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1097\/00004424-199007000-00018"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.185.4157.1124"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-017-9779-9"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-199506000-00015"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.1067\/mob.2001.109868"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-200303000-00016"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.1023\/B:AHSE.0000027479.14637.6c"},{"key":"e_1_2_10_41_1","doi-asserted-by":"publisher","DOI":"10.1037\/a0036260"},{"key":"e_1_2_10_42_1","doi-asserted-by":"publisher","DOI":"10.1037\/xge0000179"},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jesp.2012.06.003"},{"key":"e_1_2_10_44_1","doi-asserted-by":"publisher","DOI":"10.1177\/1745691611416993"},{"key":"e_1_2_10_45_1","doi-asserted-by":"publisher","DOI":"10.1080\/13284200410001707553"},{"key":"e_1_2_10_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.copsyc.2016.04.019"},{"issue":"5","key":"e_1_2_10_47_1","first-page":"565\u2010579","article-title":"A meta\u2010analysis of interrater and internal consistency reliability of selection interviews","volume":"80","author":"Conway JM","year":"1996","journal-title":"J Appl Psychol"},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000002705"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.1097\/AOG.0000000000003432"},{"key":"e_1_2_10_50_1","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-199108000-00012"}],"container-title":["Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fmedu.14248","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/medu.14248","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/medu.14248","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asmepublications.onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/medu.14248","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T13:12:06Z","timestamp":1762261926000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmepublications.onlinelibrary.wiley.com\/doi\/10.1111\/medu.14248"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,8,3]]},"references-count":49,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2020,11]]}},"alternative-id":["10.1111\/medu.14248"],"URL":"https:\/\/doi.org\/10.1111\/medu.14248","archive":["Portico"],"relation":{},"ISSN":["0308-0110","1365-2923"],"issn-type":[{"value":"0308-0110","type":"print"},{"value":"1365-2923","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,8,3]]},"assertion":[{"value":"2020-03-12","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-05-13","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-08-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}