{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,3]],"date-time":"2026-09-03T23:44:20Z","timestamp":1788479060424,"version":"build-2803163510"},"reference-count":11,"publisher":"Wiley","issue":"12","license":[{"start":{"date-parts":[[2009,11,17]],"date-time":"2009-11-17T00:00:00Z","timestamp":1258416000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["asmepublications.onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Medical Education"],"published-print":{"date-parts":[[2009,12]]},"abstract":"<jats:p>\n                    <jats:bold>Context\u2002<\/jats:bold>\n                    Some medical schools have recently replaced the medical school pre\u2010admission interview (MSPI) with the multiple mini\u2010interview (MMI), which utilises objective structured clinical examination (OSCE)\u2010style measurement techniques. Their motivation for doing so stems from the superior reliabilities obtained with the OSCE\u2010style measures. Other institutions, however, are hesitant to embrace the MMI format because of the time and costs involved in restructuring recruitment and admission procedures.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Objectives\u2002<\/jats:bold>\n                    To shed light on the aetiology of the MMI\u2019s increased reliability and to explore the potential of an alternative, lower\u2010cost interview format, this study examined the relative contributions of two facets (raters, occasions) to interview score reliability.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Methods\u2002<\/jats:bold>\n                    Institutional review board approval was obtained to conduct a study of all students who completed one or more MSPIs at a large Midwestern medical college during 2003\u20132007. Within this dataset, we identified 168 applicants who were interviewed twice in consecutive years and thus provided the requisite data for generalisability (G) and decision (D) studies examining these issues.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Results\u2002<\/jats:bold>\n                    Increasing the number of interview occasions contributed much more to score reliability than did increasing the number of raters.\n                  <\/jats:p>\n                  <jats:p>\n                    <jats:bold>Conclusions\u2002<\/jats:bold>\n                    Replicating a number of interviews, each with one rater, is likely to be superior to the often recommended panel interview approach and may offer a practical, low\u2010cost method for enhancing MSPI reliability. Whether such a method will ultimately enhance MSPI validity warrants further investigation.\n                  <\/jats:p>","DOI":"10.1111\/j.1365-2923.2009.03537.x","type":"journal-article","created":{"date-parts":[[2009,11,17]],"date-time":"2009-11-17T06:42:38Z","timestamp":1258440158000},"page":"1198-1202","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":28,"title":["Rater and occasion impacts on the reliability of pre\u2010admission assessments"],"prefix":"10.1111","volume":"43","author":[{"given":"Rick D","family":"Axelson","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Clarence D","family":"Kreiter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"311","published-online":{"date-parts":[[2009,11,17]]},"reference":[{"key":"e_1_2_10_2_2","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2004.01776.x"},{"key":"e_1_2_10_3_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2929.2007.02682.x"},{"key":"e_1_2_10_4_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2008.03018.x"},{"key":"e_1_2_10_5_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2929.2007.02709.x"},{"key":"e_1_2_10_6_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2007.02767.x"},{"key":"e_1_2_10_7_2","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2008.03161.x"},{"key":"e_1_2_10_8_2","doi-asserted-by":"publisher","DOI":"10.1097\/00001888-200410001-00012"},{"key":"e_1_2_10_9_2","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-006-9029-z"},{"key":"e_1_2_10_10_2","first-page":"1","volume-title":"Validity Generalization: a Critical Review","author":"Murphy KR","year":"2003"},{"key":"e_1_2_10_11_2","doi-asserted-by":"publisher","DOI":"10.1023\/B:AHSE.0000027464.22411.0f"},{"key":"e_1_2_10_12_2","first-page":"75","volume-title":"Assessment in Health Professions Education","author":"Kreiter CD","year":"2009"}],"container-title":["Medical Education"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fj.1365-2923.2009.03537.x","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/asmepublications.onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/j.1365-2923.2009.03537.x","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T11:47:32Z","timestamp":1762256852000},"score":1,"resource":{"primary":{"URL":"https:\/\/asmepublications.onlinelibrary.wiley.com\/doi\/10.1111\/j.1365-2923.2009.03537.x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,11,17]]},"references-count":11,"journal-issue":{"issue":"12","published-print":{"date-parts":[[2009,12]]}},"alternative-id":["10.1111\/j.1365-2923.2009.03537.x"],"URL":"https:\/\/doi.org\/10.1111\/j.1365-2923.2009.03537.x","archive":["Portico"],"relation":{},"ISSN":["0308-0110","1365-2923"],"issn-type":[{"value":"0308-0110","type":"print"},{"value":"1365-2923","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,11,17]]},"assertion":[{"value":"2009-11-17","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}