{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T00:24:27Z","timestamp":1792801467974,"version":"4.5.0"},"reference-count":25,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T00:00:00Z","timestamp":1758585600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T00:00:00Z","timestamp":1758585600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Peking Union Medical College, Graduate Education and Teaching Reform Project in 2024","award":["2024yjsjg006"],"award-info":[{"award-number":["2024yjsjg006"]}],"id":[{"id":"https:\/\/ror.org\/02drdmm93","id-type":"ROR","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Insights Imaging"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Objective<\/jats:title>\n                    <jats:p>This study aimed to evaluate the long-term systematic effectiveness and reliability of the Objective Structured Clinical Examination (OSCE) in radiology resident training, from the perspectives of both examiners and examinees.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>\n                      This retrospective observational study analyzed subjective evaluations and objective examination data collected over 6 years (2018\u20132021, 2023, and 2024). Subjective evaluations were gathered via questionnaires from 198 examiners and 818 examinees to assess the difficulty and satisfaction with the OSCE. Objective data, including examination scores, difficulty indices, and discrimination indices, for each OSCE station were analyzed using correlation analysis and\n                      <jats:italic>t<\/jats:italic>\n                      -tests.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>\n                      The OSCE demonstrated stable performance over 6 years, with consistent difficulty levels and discrimination ability across all stations. The average scores for individual stations varied; however, the overall final scores remained stable. Strong correlations between the station and final scores indicate good discrimination. Examinees rated the overall difficulty higher than examiners, but the objective indices aligned with examiner assessments. Over 6 years (198 examiners, 818 examinees), OSCE scores stabilized (85.48\u201388.48), with improved consistency (station range narrowed to 85.51\u201393.9 by 2024). Difficulty (0.12\u20130.15) and discrimination indices remained stable (most\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.05). Examinees rated it harder than examiners (\n                      <jats:italic>p<\/jats:italic>\n                      \u2009&lt;\u20090.001).\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The OSCE is a reliable, valid, and effective assessment tool in radiology. Evaluating the OSCE from both subjective and objective perspectives ensured the robustness and validity of the examination.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Critical relevance statement<\/jats:title>\n                    <jats:p>\n                      This 6-year study evaluates the Objective Structured Clinical Examination (OSCE) in radiology training through multidimensional analysis of examination metrics (difficulty indices and discrimination coefficients) and stakeholder feedback (\n                      <jats:italic>n<\/jats:italic>\n                      \u2009=\u2009198 examiners, 818 examinees), demonstrating its consistency for clinical competency assessment.\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Key Points<\/jats:title>\n                    <jats:p>\n                      <jats:list list-type=\"bullet\">\n                        <jats:list-item>\n                          <jats:p>The radiology OSCE demonstrated consistent reliability, stable difficulty indices, and strong score correlations.<\/jats:p>\n                        <\/jats:list-item>\n                        <jats:list-item>\n                          <jats:p>Examinees overestimated exam difficulty compared to examiners, likely due to stress-related perception bias.<\/jats:p>\n                        <\/jats:list-item>\n                        <jats:list-item>\n                          <jats:p>Standardized examiner training improved scoring consistency and enhanced overall OSCE assessment quality.<\/jats:p>\n                        <\/jats:list-item>\n                      <\/jats:list>\n                    <\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Graphical Abstract<\/jats:title>\n                  <\/jats:sec>","DOI":"10.1186\/s13244-025-02024-3","type":"journal-article","created":{"date-parts":[[2025,9,23]],"date-time":"2025-09-23T20:18:17Z","timestamp":1758658697000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Enhancing OSCE reliability and effectiveness in radiology resident training with long-term systemic evaluation"],"prefix":"10.1186","volume":"16","author":[{"given":"Ning","family":"Ding","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xinyu","family":"Gao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hao","family":"Sun","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lan","family":"Song","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuan","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yu","family":"Chen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1874-0862","authenticated-orcid":false,"given":"Daming","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhengyu","family":"Jin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Huadan","family":"Xue","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,9,23]]},"reference":[{"key":"2024_CR1","doi-asserted-by":"publisher","first-page":"447","DOI":"10.1136\/bmj.1.5955.447","volume":"1","author":"RM Harden","year":"1975","unstructured":"Harden RM, Stevenson M, Downie WW, Wilson GM (1975) Assessment of clinical competence using objective structured examination. Br Med J 1:447\u2013451","journal-title":"Br Med J"},{"key":"2024_CR2","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.rxeng.2022.09.006","volume":"65","author":"AV P\u00e9rez Baena","year":"2023","unstructured":"P\u00e9rez Baena AV, Sendra Portero F (2023) The objective structured clinical examination (OSCE): main aspects and the role of imaging. Radiologia (Engl Ed) 65:55\u201365","journal-title":"Radiologia (Engl Ed)"},{"key":"2024_CR3","doi-asserted-by":"publisher","first-page":"83","DOI":"10.4103\/0971-3026.63040","volume":"20","author":"A Agarwal","year":"2010","unstructured":"Agarwal A, Batra B, Sood A et al (2010) Objective structured clinical examination in radiology. Indian J Radiol Imaging 20:83\u201388","journal-title":"Indian J Radiol Imaging"},{"key":"2024_CR4","doi-asserted-by":"publisher","first-page":"e15444","DOI":"10.2196\/15444","volume":"6","author":"PV Staziaki","year":"2020","unstructured":"Staziaki PV, Sarangi R, Parikh UN, Brooks JG, LeBedis CA, Shaffer K (2020) An objective structured clinical examination for medical student radiology clerkships: reproducibility study. JMIR Med Educ 6:e15444","journal-title":"JMIR Med Educ"},{"key":"2024_CR5","doi-asserted-by":"publisher","DOI":"10.1590\/1807-2577.02719","volume":"48","author":"FAM De Oliveira","year":"2019","unstructured":"De Oliveira FAM, Porto FR, Ribeiro CG, Haddad AE, De Oliveira RG, Ferraz AML (2019) Objective structured clinical examination, OSCEs: an advance in the teaching and learning process in the student\u2019s perception. Rev Odontol UNESP 48:e20190027","journal-title":"Rev Odontol UNESP"},{"key":"2024_CR6","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-023-04582-w","volume":"23","author":"N Ding","year":"2023","unstructured":"Ding N, Hu G, Wang X et al (2023) Simulation video: a tool to evaluate communications skills in radiologist residents. BMC Med Educ 23:586","journal-title":"BMC Med Educ"},{"key":"2024_CR7","first-page":"220","volume":"8","author":"AA Elbilgahy","year":"2020","unstructured":"Elbilgahy AA, Eltaib FA, Mohamed RK (2020) Implementation of objective structured clinical examination (OSCE): perceiving nursing students and teachers attitude & satisfaction. Am J Nurs 8:220\u2013226","journal-title":"Am J Nurs"},{"key":"2024_CR8","doi-asserted-by":"publisher","first-page":"886","DOI":"10.4236\/ce.2016.76093","volume":"7","author":"AE Omu","year":"2016","unstructured":"Omu AE, Al-Azemi MK, Omu FE, Al-Harmi J, Diejomaoh MFE (2016) Attitudes of academic staff and students towards the objective structured clinical examination (OSCE) in obstetrics and gynaecology. Creat Educ 7:886","journal-title":"Creat Educ"},{"key":"2024_CR9","doi-asserted-by":"publisher","first-page":"387","DOI":"10.2147\/AMEP.S197275","volume":"10","author":"MAA Majumder","year":"2019","unstructured":"Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B (2019) An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract 10:387\u2013397","journal-title":"Adv Med Educ Pract"},{"key":"2024_CR10","doi-asserted-by":"publisher","first-page":"447","DOI":"10.3109\/0142159X.2011.564682","volume":"33","author":"M Tavakol","year":"2011","unstructured":"Tavakol M, Dennick R (2011) Post-examination analysis of objective tests. Med Teach 33:447\u2013458","journal-title":"Med Teach"},{"key":"2024_CR11","doi-asserted-by":"publisher","first-page":"32389","DOI":"10.3402\/meo.v21.32389","volume":"21","author":"K Reid","year":"2016","unstructured":"Reid K, Smallwood D, Collins M, Sutherland R, Dodds A (2016) Taking OSCE examiner training on the road: reaching the masses. Med Educ Online 21:32389","journal-title":"Med Educ Online"},{"key":"2024_CR12","doi-asserted-by":"publisher","first-page":"344","DOI":"10.1111\/medu.14357","volume":"55","author":"BS Malau-Aduli","year":"2021","unstructured":"Malau-Aduli BS, Hays RB, D\u2019Souza K et al (2021) Examiners\u2019 decision-making processes in observation-based clinical examinations. Med Educ 55:344\u2013353","journal-title":"Med Educ"},{"key":"2024_CR13","first-page":"00100","volume":"4","author":"HJJMO Jeong","year":"2016","unstructured":"Jeong HJJMO (2016) The level of collapse we are allowed: comparison of different response scales in safety attitudes questionnaire. Biom Biostat Int J 4:00100","journal-title":"Biom Biostat Int J"},{"key":"2024_CR14","unstructured":"Taherdoost H (2019) What is the best response scale for survey and questionnaire design; review of different lengths of rating scale \/ attitude scale \/ Likert scale. Int J Acad Res Manag 8:1\u201310"},{"key":"2024_CR15","doi-asserted-by":"crossref","unstructured":"Yeates P, Maluf A, Kinston R et al (2025) A realist evaluation of how, why and when objective structured clinical exams (OSCEs) are experienced as an authentic assessment of clinical preparedness. Med Teach 47:458\u2013466","DOI":"10.1080\/0142159X.2024.2339413"},{"key":"2024_CR16","doi-asserted-by":"publisher","first-page":"608","DOI":"10.3109\/0142159X.2015.1042443","volume":"37","author":"RM Harden","year":"2015","unstructured":"Harden RM (2015) Misconceptions and the OSCE. Med Teach 37:608\u2013610","journal-title":"Med Teach"},{"key":"2024_CR17","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1111\/j.1365-2923.1979.tb00918.x","volume":"13","author":"RM Harden","year":"1979","unstructured":"Harden RM, Gleeson FA (1979) Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 13:41\u201354","journal-title":"Med Educ"},{"key":"2024_CR18","doi-asserted-by":"publisher","first-page":"225","DOI":"10.1006\/jsre.1996.0252","volume":"63","author":"DA Sloan","year":"1996","unstructured":"Sloan DA, Donnelly MB, Schwartz RW, Felts JL, Blue AV, Strodel WE (1996) The use of objective structured clinical examination (OSCE) for evaluation and instruction in graduate medical education. J Surg Res 63:225\u2013230","journal-title":"J Surg Res"},{"key":"2024_CR19","doi-asserted-by":"publisher","first-page":"183","DOI":"10.1080\/01421590701302290","volume":"29","author":"A Jefferies","year":"2007","unstructured":"Jefferies A, Simmons B, Tabak D et al (2007) Using an objective structured clinical examination (OSCE) to assess multiple physician competencies in postgraduate training. Med Teach 29:183\u2013191","journal-title":"Med Teach"},{"key":"2024_CR20","unstructured":"Wong WY (2018) Consistency of examiner judgements in medical education: a case study of competency-based assessment. University of Queensland, Brisbane"},{"key":"2024_CR21","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1080\/01421590310001002836","volume":"25","author":"B Hodges","year":"2003","unstructured":"Hodges B (2003) Validity and the OSCE. Med Teach 25:250\u2013254","journal-title":"Med Teach"},{"key":"2024_CR22","doi-asserted-by":"publisher","first-page":"52","DOI":"10.1080\/10401334.2015.1107487","volume":"28","author":"S Humphrey-Murto","year":"2016","unstructured":"Humphrey-Murto S, Mihok M, Pugh D, Touchie C, Halman S, Wood TJ (2016) Feedback in the OSCE: what do residents remember? Teach Learn Med 28:52\u201360","journal-title":"Teach Learn Med"},{"key":"2024_CR23","doi-asserted-by":"publisher","first-page":"139","DOI":"10.7899\/JCE-14-17","volume":"29","author":"N Zhang","year":"2015","unstructured":"Zhang N, Rabatsky A (2015) Effects of test stress during an objective structured clinical examination. J Chiropr Educ 29:139\u2013144","journal-title":"J Chiropr Educ"},{"key":"2024_CR24","doi-asserted-by":"publisher","first-page":"S59","DOI":"10.1097\/00001888-200510001-00017","volume":"80","author":"S Humphrey-Murto","year":"2005","unstructured":"Humphrey-Murto S, Smee S, Touchie C, Wood TJ, Blackmore DE (2005) A comparison of physician examiners and trained assessors in a high-stakes OSCE setting. Acad Med 80:S59\u2013S62","journal-title":"Acad Med"},{"key":"2024_CR25","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1111\/j.1365-2929.2007.02744.x","volume":"41","author":"CP Tan","year":"2007","unstructured":"Tan CP, Azila NM (2007) Improving OSCE examiner skills in a Malaysian setting. Med Educ 41:517","journal-title":"Med Educ"}],"container-title":["Insights into Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13244-025-02024-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s13244-025-02024-3\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s13244-025-02024-3.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,24]],"date-time":"2025-09-24T13:14:47Z","timestamp":1758719687000},"score":1,"resource":{"primary":{"URL":"https:\/\/insightsimaging.springeropen.com\/articles\/10.1186\/s13244-025-02024-3"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,9,23]]},"references-count":25,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2025,12]]}},"alternative-id":["2024"],"URL":"https:\/\/doi.org\/10.1186\/s13244-025-02024-3","relation":{},"ISSN":["1869-4101"],"issn-type":[{"value":"1869-4101","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,9,23]]},"assertion":[{"value":"17 March 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 September 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The Institutional Review Board of Peking Union Medical College Hospital approved this retrospective study and waived the requirement for informed consent (No. S-K2067).","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethics approval and consent to participate"}},{"value":"Waived due to the retrospective nature of the study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for publication"}},{"value":"The authors declare that they have no competing interests.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"203"}}