{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T12:37:43Z","timestamp":1758285463255,"version":"3.44.0"},"reference-count":37,"publisher":"Walter de Gruyter GmbH","issue":"10","license":[{"start":{"date-parts":[[2025,4,8]],"date-time":"2025-04-08T00:00:00Z","timestamp":1744070400000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,9,22]]},"abstract":"Abstract<\/jats:title>\n \n Context<\/jats:title>\n Clinically based performance assessments, including those employing standardized patients (SPs), have been utilized to educate and assess medical students and graduates. Starting in the 1990s, demonstrating competency on these types of assessments became part of the medical licensure pathway in some countries, and was re-added to the licensure pathway in the United\u00a0States in 2004. Studies have been published to support the validity of the scores and associated pass\/fail decisions obtained from SP assessments. With the onset of the COVID-19 pandemic, testing organizations were forced to suspend many of their in-person clinical skills assessments. There is widespread recognition that clinical skills are necessary for high-quality patient care. Nevertheless, there has been disparate interest in reestablishing national assessments of these skills.<\/jats:p>\n <\/jats:sec>\n \n Objectives<\/jats:title>\n Based on the recommendations of the Special Commission on Osteopathic Medical Licensure Assessment, the National Board of Osteopathic Medical Examiners (NBOME) established the Core Competency Capstone for Doctors of Osteopathic Medicine (C3DO). The objectives of this study were to describe the assessment and to ascertain the feasibility of administering it at multiple colleges of osteopathic medicine (COMs).<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n Surveys of osteopathic medical school personnel and students taking the assessment were conducted to gather data on the feasibility of administering the C3DO, the challenges associated with a distributed model, and the educational value of the assessment. Reports submitted by the medical schools provided information on the cost of the assessment. Some psychometrics analyses of Phase 1 C3DO pilot data were conducted, including the quantification of measurement errors.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n The NBOME, in collaboration of the COMs, was able to administer the C3DO to almost the entire class at four osteopathic medical schools. Although there were challenges, including data transfer from the schools, summary scores were derived for a total of 811 students, including nine repeat test takers. Medical students across sites indicated that the C3DO was a valuable educational assessment activity. The reliability of the ratings derived from the checklists (history building [HB], physical examination [PE]) and Communication and Respectfulness Evaluation (CARE) tool were adequate. Based on a variance components analysis, there was some evidence to suggest that at a given school, the choice of an SP portraying and scoring the case could have an impact on the student scores.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n The C3DO-distributed site model, which includes centrally developed cases, standardized training of SPs, and independent scoring of osteopathic manipulative treatment (OMT), provides the means to assess the clinical skills of osteoapthic medical students at different testing sites. The implementation of a distributed, school-based model for the assessment of osteopathic clinical skills is feasible, potentially economically advantageous, and if rigorously developed and administered, should provide for comparable student scores and associated competency decisions. Additional Phase 2 (2024-2025) and Phase 3 (2025-2026) studies are underway to establish the psychometric rigor of the assessment more fully.<\/jats:p>\n <\/jats:sec>","DOI":"10.1515\/jom-2024-0225","type":"journal-article","created":{"date-parts":[[2025,4,8]],"date-time":"2025-04-08T04:13:02Z","timestamp":1744085582000},"page":"469-476","source":"Crossref","is-referenced-by-count":0,"title":["Assessing fundamental clinical skills of osteopathic medical students"],"prefix":"10.1515","volume":"125","author":[{"given":"John R.","family":"Boulet","sequence":"first","affiliation":[{"name":"Senior Research Consultant, National Board of Osteopathic Medical Examiners , Chicago , IL , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeanne M.","family":"Sandella","sequence":"additional","affiliation":[{"name":"Vice President for Professional Development Initiatives , National Board of Osteopathic Medical Examiners , Conshohocken , PA , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Gimpel","sequence":"additional","affiliation":[{"name":"President and CEO, National Board of Osteopathic Medical Examiners , Chicago , IL , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"suffix":"II","given":"Richard","family":"LaBaere","sequence":"additional","affiliation":[{"name":"Associate Dean for Graduate Medical Education and DIO, Department for the Advancement of Osteopathic Education and Still OPTI , A.T. Still University-Kirksville College of Osteopathic Medicine , Kirksville , MO , USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"374","published-online":{"date-parts":[[2025,4,8]]},"reference":[{"key":"2025091909024746557_j_jom-2024-0225_ref_001","doi-asserted-by":"crossref","unstructured":"Harden, RMG, Stevenson, M, Downie, WW, Wilson, GM, Stevenson, M, Wilson, GM. Assessment of clinical competence using objective structured examination. Br Med J 1975;1:447\u201351. https:\/\/doi.org\/10.1136\/bmj.1.5955.447.","DOI":"10.1136\/bmj.1.5955.447"},{"key":"2025091909024746557_j_jom-2024-0225_ref_002","doi-asserted-by":"crossref","unstructured":"Harden, RM, Gleeson, FA. Assessment of clinical competence using an objective structured clinical examination (OSCE). Med Educ 1979;13:39\u201354. https:\/\/doi.org\/10.1111\/j.1365-2923.1979.tb00918.x.","DOI":"10.1111\/j.1365-2923.1979.tb00918.x"},{"key":"2025091909024746557_j_jom-2024-0225_ref_003","doi-asserted-by":"crossref","unstructured":"Boulet, JR, Smee, SM, Dillon, GF, Gimpel, JR. The use of standardized patient assessments for certification and licensure decisions. Simul Healthc 2009;4:35\u201342. https:\/\/doi.org\/10.1097\/SIH.0b013e318182fc6c.","DOI":"10.1097\/SIH.0b013e318182fc6c"},{"key":"2025091909024746557_j_jom-2024-0225_ref_004","unstructured":"Medical Council of Canada. NAC examination annual technical report - september 2020. 2020. https:\/\/mcc.ca\/research-and-development\/technical-reports\/[Accessed 9 May 2024]."},{"key":"2025091909024746557_j_jom-2024-0225_ref_005","doi-asserted-by":"crossref","unstructured":"Gotzmann, A, Boulet, J, Zhang, Y, McCormick, J, Wojcik, M, Bartman, I, et al.. Conducting an objective structured clinical examination under COVID-restricted conditions. BMC Med Educ 2024;24:1\u201310. https:\/\/doi.org\/10.1186\/s12909-024-05774-8.","DOI":"10.1186\/s12909-024-05774-8"},{"key":"2025091909024746557_j_jom-2024-0225_ref_006","doi-asserted-by":"crossref","unstructured":"Kunutsor, SK, Metcalf, EP, Westacott, R, Revell, L, Blythe, A. Are remote clinical assessments a feasible and acceptable method of assessment? A systematic review. Med Teach 2022;44:300\u20138. https:\/\/doi.org\/10.1080\/0142159X.2021.1987403.","DOI":"10.1080\/0142159X.2021.1987403"},{"key":"2025091909024746557_j_jom-2024-0225_ref_007","doi-asserted-by":"crossref","unstructured":"Blythe, J, Patel, NSA, Spiring, W, Easton, G, Evans, D, Meskevicius-Sadler, E, et al.. Undertaking a high stakes virtual OSCE (\u201cVOSCE\u201d) during Covid-19. BMC Med Educ 2021;21:1\u20137. https:\/\/doi.org\/10.1186\/s12909-021-02660-5.","DOI":"10.1186\/s12909-021-02660-5"},{"key":"2025091909024746557_j_jom-2024-0225_ref_008","doi-asserted-by":"crossref","unstructured":"Cartledge, S, Ward, D, Stack, R, Terry, E. Adaptations in clinical examinations of medical students in response to the COVID-19 pandemic: a systematic review. BMC Med Educ 2022;22:1\u201318. https:\/\/doi.org\/10.1186\/s12909-022-03662-7.","DOI":"10.1186\/s12909-022-03662-7"},{"key":"2025091909024746557_j_jom-2024-0225_ref_009","doi-asserted-by":"crossref","unstructured":"Touchie, C, Pugh, D. Cancel culture: exploring the unintended consequences of cancelling the Canadian national licensing clinical examination. Can Med Educ J. Published online 2022:62\u20137. https:\/\/doi.org\/10.36834\/cmej.73889.","DOI":"10.36834\/cmej.73889"},{"key":"2025091909024746557_j_jom-2024-0225_ref_010","doi-asserted-by":"crossref","unstructured":"Lehman, EPI, Guercio, JR. The step 2 clinical skills exam \u2013\u00a0a poor value proposition. N\u00a0Engl J Med 2013;368:889\u201391. https:\/\/doi.org\/10.1056\/nejmp1213760.","DOI":"10.1056\/NEJMp1213760"},{"key":"2025091909024746557_j_jom-2024-0225_ref_011","doi-asserted-by":"crossref","unstructured":"First, LR, Chaudhry, HJ, Melnick, DE. Quality, cost, and value of clinical skills assessment. N\u00a0Engl J Med 2013;368:963\u20134. https:\/\/doi.org\/10.1056\/nejmc1301008.","DOI":"10.1056\/NEJMc1301008"},{"key":"2025091909024746557_j_jom-2024-0225_ref_012","unstructured":"Turner, JL, Dankoski, ME. Objective structured clinical exams: a critical review. Fam Med 2008;40:574\u20138. http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/18988044."},{"key":"2025091909024746557_j_jom-2024-0225_ref_013","doi-asserted-by":"crossref","unstructured":"Malau-Aduli, BS, Jones, K, Saad, S, Richmond, C. Has the OSCE met its final demise? Rebalancing clinical assessment approaches in the peri-pandemic world. Front Med 2022;9:825502. https:\/\/doi.org\/10.3389\/fmed.2022.825502.","DOI":"10.3389\/fmed.2022.825502"},{"key":"2025091909024746557_j_jom-2024-0225_ref_014","doi-asserted-by":"crossref","unstructured":"Archer, J, Lynn, N, Coombes, L, Roberts, M, Gale, T, Price, T, et al.. The impact of large scale licensing examinations in highly developed countries: a systematic review. BMC Med Educ 2016;16. https:\/\/doi.org\/10.1186\/s12909-016-0729-7.","DOI":"10.1186\/s12909-016-0729-7"},{"key":"2025091909024746557_j_jom-2024-0225_ref_015","doi-asserted-by":"crossref","unstructured":"Boulet, J, van Zanten, M. Ensuring high-quality patient care: the role of accreditation, licensure, specialty certification and revalidation in medicine. Med Educ 2014;48:75\u201386. https:\/\/doi.org\/10.1111\/medu.12286.","DOI":"10.1111\/medu.12286"},{"key":"2025091909024746557_j_jom-2024-0225_ref_016","doi-asserted-by":"crossref","unstructured":"Kreptul, D, Thomas, RE. Family medicine resident OSCEs: a systematic review. Educ Prim Care 2016;27. https:\/\/doi.org\/10.1080\/14739879.2016.1205835.","DOI":"10.1080\/14739879.2016.1205835"},{"key":"2025091909024746557_j_jom-2024-0225_ref_017","doi-asserted-by":"crossref","unstructured":"Felthun, JZ, Taylor, S, Shulruf, B, Allen, DW. Assessment methods and the validity and reliability of measurement tools in online objective structured clinical examinations: a systematic scoping review. J\u00a0Educ Eval Health Prof 2021;18. https:\/\/doi.org\/10.3352\/JEEHP.2021.18.11.","DOI":"10.3352\/jeehp.2021.18.11"},{"key":"2025091909024746557_j_jom-2024-0225_ref_018","doi-asserted-by":"crossref","unstructured":"Bobos, P, Pouliopoulou, DVS, Harriss, A, Sadi, J, Rushton, A, MacDermid, JC. A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems. PLoS One 2021;16. https:\/\/doi.org\/10.1371\/journal.pone.0255696.","DOI":"10.1371\/journal.pone.0255696"},{"key":"2025091909024746557_j_jom-2024-0225_ref_019","doi-asserted-by":"crossref","unstructured":"Wenghofer, E, Boulet, J. Medical Council of Canada qualifying examinations and performance in future practice. Can Med Educ J. 2022;2022. https:\/\/doi.org\/10.36834\/cmej.73770.","DOI":"10.36834\/cmej.73770"},{"key":"2025091909024746557_j_jom-2024-0225_ref_020","unstructured":"Gimpel, JR, Boulet, JR, Errichetti, AM. Evaluating the clinical skills of osteopathic medical students. J\u00a0Am Osteopath Assoc 2003;103:267\u201379. pm:12834100."},{"key":"2025091909024746557_j_jom-2024-0225_ref_021","doi-asserted-by":"crossref","unstructured":"Brannick, MT, Erol-Korkmaz, HT, Prewett, M. A systematic review of the reliability of objective structured clinical examination scores. Med Educ 2011;45:1181\u20139. https:\/\/doi.org\/10.1111\/j.1365-2923.2011.04075.x.","DOI":"10.1111\/j.1365-2923.2011.04075.x"},{"key":"2025091909024746557_j_jom-2024-0225_ref_022","doi-asserted-by":"crossref","unstructured":"Khan, KZ, Ramachandran, S, Gaunt, K, Pushkar, P. The objective structured clinical examination (OSCE): AMEE guide No. 81. Part I: an historical and theoretical perspective. Med Teach 2013;35. https:\/\/doi.org\/10.3109\/0142159X.2013.818634.","DOI":"10.3109\/0142159X.2013.818634"},{"key":"2025091909024746557_j_jom-2024-0225_ref_023","unstructured":"Boulet, JR, Gimpel, JR, Errichetti, AM, Meoli, FG. Using National Medical Care Survey data to validate examination content on a performance-based clinical skills assessment for osteopathic physicians. J\u00a0Am Osteopath Assoc 2003;103:225\u201331. http:\/\/www.ncbi.nlm.nih.gov\/pubmed\/12776763."},{"key":"2025091909024746557_j_jom-2024-0225_ref_024","doi-asserted-by":"crossref","unstructured":"John, JT, Gowda, D, Schlair, S, Hojsak, J, Milan, F, Auerbach, L. After the discontinuation of step 2 CS: a collaborative statement from the Directors of clinical skills education (DOCS). Teach Learn Med 2022;35:218\u201323. https:\/\/doi.org\/10.1080\/10401334.2022.2039154.","DOI":"10.1080\/10401334.2022.2039154"},{"key":"2025091909024746557_j_jom-2024-0225_ref_025","doi-asserted-by":"crossref","unstructured":"Katsufrakis, PJ, Chaudhry, HJ. Evolution of clinical skills assessment in the USMLE: looking to the future after step 2 CS discontinuation. Acad Med 2021;96:1236\u20138. https:\/\/doi.org\/10.1097\/ACM.0000000000004214.","DOI":"10.1097\/ACM.0000000000004214"},{"key":"2025091909024746557_j_jom-2024-0225_ref_026","doi-asserted-by":"crossref","unstructured":"Howley, LD, Engle, DL. Discontinuation of the USMLE step 2 clinical skills examination: studying the past to define the future. Acad Med 2021;96:1247\u20139. https:\/\/doi.org\/10.1097\/ACM.0000000000004217.","DOI":"10.1097\/ACM.0000000000004217"},{"key":"2025091909024746557_j_jom-2024-0225_ref_027","doi-asserted-by":"crossref","unstructured":"Phillips, A, Hauer, KE, Carrie Chen, H, Wray, A, Watanaskul, S, Boscardin, CK. The consequences of step 2 clinical skills examination discontinuation for medical schools and sustainability plans for clinical skills assessment. Acad Med 2023;98:717\u201322. https:\/\/doi.org\/10.1097\/ACM.0000000000005138.","DOI":"10.1097\/ACM.0000000000005138"},{"key":"2025091909024746557_j_jom-2024-0225_ref_028","unstructured":"National Board of Osteopathic Medical Examiners. Bulletin of information. https:\/\/www.nbome.org\/assessments\/comlex-usa\/bulletin\/ [Accessed 30 November 2023]."},{"key":"2025091909024746557_j_jom-2024-0225_ref_029","unstructured":"Commission on Osteopathic College Accreditation of Colleges of Osteopathic Medicine. COM continuing accreditation standards. Published online; 2023 https:\/\/osteopathic.org\/index.php?aam-media=\/wp-content\/uploads\/2023-COM-Continuing-Standards-Updates-for-Public-Comment.pdf [Accessed 9 May 2024]."},{"key":"2025091909024746557_j_jom-2024-0225_ref_030","unstructured":"National Board of Osteopathic Medical Examiners. The special commission on osteopathic medical licensure assessment final report - NBOME. https:\/\/www.nbome.org\/special-commission-on-osteopathic-medical-licensure-assessment\/final-report\/[Accessed 12 January 2023]."},{"key":"2025091909024746557_j_jom-2024-0225_ref_031","unstructured":"National Board of Osteopathic Medical Examiners. COMLEX-USA master blueprint \u2013\u00a0NBOME. https:\/\/www.nbome.org\/assessments\/comlex-usa\/master-blueprint\/[Accessed 6 December 2022]."},{"key":"2025091909024746557_j_jom-2024-0225_ref_032","doi-asserted-by":"crossref","unstructured":"Khan, KZ, Gaunt, K, Ramachandran, S, Pushkar, P. The objective structured clinical examination (OSCE): AMEE guide No. 81. Part II: organisation & administration. Med Teach 2013;35:142\u201359. https:\/\/doi.org\/10.3109\/0142159X.2013.818635.","DOI":"10.3109\/0142159X.2013.818635"},{"key":"2025091909024746557_j_jom-2024-0225_ref_033","doi-asserted-by":"crossref","unstructured":"Kogan, JR, Hauer, KE, Holmboe, ES. The dissolution of the Step 2 Clinical Skills Examination and the duty of medical educators to step up the effectiveness of clinical skills assessment. Acad Med 2021;96:1242\u20136. https:\/\/doi.org\/10.1097\/ACM.0000000000004216.","DOI":"10.1097\/ACM.0000000000004216"},{"key":"2025091909024746557_j_jom-2024-0225_ref_034","doi-asserted-by":"crossref","unstructured":"Chan, SCC, Choa, G, Kelly, J, Maru, D, Rashid, MA. Implementation of virtual OSCE in health professions education: a systematic review. Med Educ 2023;57:833\u201343. https:\/\/doi.org\/10.1111\/medu.15089.","DOI":"10.1111\/medu.15089"},{"key":"2025091909024746557_j_jom-2024-0225_ref_035","unstructured":"National Board of Medical Examiners. NBME assessment alliance | NBME. https:\/\/www.nbme.org\/research\/research-collaborations\/assessment-alliance [Accessed 9 May 2024]."},{"key":"2025091909024746557_j_jom-2024-0225_ref_036","unstructured":"Educational Commission for Foreign Medical Graduates. Requirements for ECFMG certification for 2024 match. https:\/\/www.ecfmg.org\/certification-pathways\/[Accessed 9 May 2024]."},{"key":"2025091909024746557_j_jom-2024-0225_ref_037","doi-asserted-by":"crossref","unstructured":"Tsichlis, JT, Del Re, AM, Carmody, JB. The past, present, and future of the United\u00a0States medical licensing examination step 2 clinical skills examination. Cureus 2021;13. https:\/\/doi.org\/10.7759\/cureus.17157.","DOI":"10.7759\/cureus.17157"}],"container-title":["Journal of Osteopathic Medicine"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jom-2024-0225\/xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jom-2024-0225\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,19]],"date-time":"2025-09-19T09:03:30Z","timestamp":1758272610000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.degruyterbrill.com\/document\/doi\/10.1515\/jom-2024-0225\/html"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,8]]},"references-count":37,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,5,23]]},"published-print":{"date-parts":[[2025,9,22]]}},"alternative-id":["10.1515\/jom-2024-0225"],"URL":"https:\/\/doi.org\/10.1515\/jom-2024-0225","relation":{},"ISSN":["2702-3648"],"issn-type":[{"type":"electronic","value":"2702-3648"}],"subject":[],"published":{"date-parts":[[2025,4,8]]}}}