{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,1]],"date-time":"2026-04-01T17:52:11Z","timestamp":1775065931846,"version":"3.50.1"},"reference-count":16,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc-nd\/4.0\/"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["AEM Education and Training"],"published-print":{"date-parts":[[2022,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>Trainee supervision and teaching are distinct skills that both require faculty physician competence to ensure patient safety. No standard approach exists to teach physician supervisory competence, resulting in variable trainee oversight and safety threats. The Objective Structured Teaching Evaluation (OSTE) does not adequately incorporate the specific skills required for effective supervision. To address this continuing medical education gap, the authors aimed to develop and identify validity evidence for an \u201cObjective Structured Supervision Evaluation\u201d (OSSE) for attending physicians, conceptually modeled on the historic OSTE.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>An expert panel used an iterative process to create an OSSE instrument, which was a checklist of key supervision items to be evaluated during a simulated endotracheal intubation scenario. Three trained \u201cstandardized residents\u201d scored faculty participants' performance using the instrument. Validity testing modeled a contemporary approach using Kane's framework. Participants underwent simulation\u2010based mastery learning (SBML) with deliberate practice until meeting a minimum passing standard (MPS).<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>The final instrument contained 19 items, including three global rating measures. Testing domains included <jats:italic>supervision climate<\/jats:italic>, participant <jats:italic>control of patient care<\/jats:italic>, trainee <jats:italic>evaluation<\/jats:italic>, <jats:italic>instructional skills<\/jats:italic>, <jats:italic>case\u2010specific measures<\/jats:italic>, and <jats:italic>overall supervisor rating<\/jats:italic>. Reliability of the assessment tool was excellent (ICC range 0.84\u20130.89). The assessment tool had good internal consistency (Cronbach's <jats:italic>\u03b1<\/jats:italic>\u00a0=\u20090.813). Out of 24 faculty participants, 17 (70.8%) met the MPS on initial assessment. All met the MPS after SBML and average score increased by 19.5% (95% CI of the difference 10.3%\u201328.8%, p\u00a0=\u00a00.002).<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><\/jats:sec><jats:sec><jats:title>The OSSE is a promising tool to assess faculty supervision performance. Further study should evaluate the effect of OSSE training on supervision in the clinical environment, which may have measurable changes in patient\u2010centered outcomes and resident teaching.<\/jats:title><\/jats:sec>","DOI":"10.1002\/aet2.10784","type":"journal-article","created":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T09:54:45Z","timestamp":1658483685000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["The <scp>OSSE<\/scp>: Development and validation of an \u201cObjective Structured Supervision Evaluation\u201d"],"prefix":"10.1002","volume":"6","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3033-3995","authenticated-orcid":false,"given":"Nicholas","family":"Pokrajac","sequence":"first","affiliation":[{"name":"Department of Emergency Medicine Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kelly N.","family":"Roszczynialski","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ashley","family":"Rider","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0461-1071","authenticated-orcid":false,"given":"Cori Mc Clure","family":"Poffenberger","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sarah","family":"Williams","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mc Kenzie","family":"Eakin","sequence":"additional","affiliation":[{"name":"Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2381-0300","authenticated-orcid":false,"given":"Richard W.","family":"Sapp","sequence":"additional","affiliation":[{"name":"Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Eric","family":"Jenkins","sequence":"additional","affiliation":[{"name":"Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6800-3932","authenticated-orcid":false,"given":"Michael A.","family":"Gisondi","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Stanford University School of Medicine  Palo Alto California USA"},{"name":"The Precision Education and Assessment Research Lab, Department of Emergency Medicine Stanford University  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4375-8180","authenticated-orcid":false,"given":"Kimberly","family":"Schertzer","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Stanford University School of Medicine  Palo Alto California USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/01421590701210907"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e3181eab0ec"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11606-007-0179-3"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.13588"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000000735"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.4300\/JGME-D-09-00015.1"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1002\/chp.20001"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/10401334.2012.641476"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1513\/AnnalsATS.201406-237BC"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e31824822cc"},{"key":"e_1_2_10_12_1","doi-asserted-by":"crossref","unstructured":"OsmanC DembitzerA ZabarS TewksburyL.Using Objective Structured Teaching Exercises for faculty development. MedEdPORTAL;2015Oct 28.10.15766\/mep_2374-8265.10258","DOI":"10.15766\/mep_2374-8265.10258"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.311.7001.376"},{"key":"e_1_2_10_14_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.12678"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-34811-3"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000000887"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.12391"}],"container-title":["AEM Education and Training"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aet2.10784","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/aet2.10784","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aet2.10784","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,22]],"date-time":"2023-08-22T16:47:05Z","timestamp":1692722825000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/aet2.10784"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,22]]},"references-count":16,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2022,8]]}},"alternative-id":["10.1002\/aet2.10784"],"URL":"https:\/\/doi.org\/10.1002\/aet2.10784","archive":["Portico"],"relation":{},"ISSN":["2472-5390","2472-5390"],"issn-type":[{"value":"2472-5390","type":"print"},{"value":"2472-5390","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,22]]},"assertion":[{"value":"2021-10-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-06-14","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-07-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e10784"}}