{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T23:32:49Z","timestamp":1762299169734,"version":"build-2065373602"},"reference-count":60,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2019,12,18]],"date-time":"2019-12-18T00:00:00Z","timestamp":1576627200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"funder":[{"name":"Southeastern Ontario Academic Medical Organization Innovation Fund"},{"name":"The Kingston Resuscitation Institute"},{"name":"The University of Saskatchewan College of Medicine"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["Evaluation Clinical Practice"],"published-print":{"date-parts":[[2020,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Purpose<\/jats:title><jats:p>Within competency\u2010based medical education, self\u2010regulated learning (SRL) requires residents to leverage self\u2010assessment and faculty feedback. We sought to investigate the potential for competency\u2010based assessments to foster SRL by quantifying the relationship between faculty feedback and entrustment ratings as well as the congruence between faculty assessment and resident self\u2010assessment.<\/jats:p><\/jats:sec><jats:sec><jats:title>Materials and methods<\/jats:title><jats:p>We collected comments in (a) an emergency medicine objective structured clinical examination group (objective structured clinical examinations [OSCE] and emergency medicine OSCE group [EMOG]) and (b) a first\u2010year resident multidisciplinary resuscitation \u201cNightmares\u201d course assessment group (NCAG) and OSCE group (NOG). We assessed comments across five domains including Initial Assessment (IA), Diagnostic Action (DA), Therapeutic Action (TA), Communication (COM), and entrustment. Analyses included structured qualitative coding and (non)parametric and descriptive analyses.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>In the EMOG, faculty's positive comments in the entrustment domain corresponded to lower entrustment score Mean Ranks (MRs) for IA (&lt;11.1), DA (&lt;11.2), and entrustment (&lt;11.6). In NOG, faculty's negative comments resulted in lower entrustment score MRs for TA (&lt;11.8 and &lt;10) and DA (&lt;12.4), and positive comments resulted in higher entrustment score MRs for IA (&gt;15.4) and COM (&gt;17.6). In the NCAG, faculty's positive IA comments were negatively correlated with entrustment scores (<jats:italic>\u03c1<\/jats:italic> = \u2212.27, <jats:italic>P<\/jats:italic> = .04). Across programs, faculty and residents made similar domain\u2010specific comments 13% of the time.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>Minimal and inconsistent associations were found between narrative and numerical feedback. Performance monitoring accuracy and feedback should be included in assessment validation.<\/jats:p><\/jats:sec>","DOI":"10.1111\/jep.13338","type":"journal-article","created":{"date-parts":[[2019,12,18]],"date-time":"2019-12-18T19:34:38Z","timestamp":1576697678000},"page":"1105-1113","update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["A case for feedback and monitoring assessment in competency\u2010based medical education"],"prefix":"10.1111","volume":"26","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0859-8409","authenticated-orcid":false,"given":"Rylan","family":"Egan","sequence":"first","affiliation":[{"name":"School of Nursing, Health Quality Programs, Faculty of Health Sciences Queen's University  Kingston Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Timothy","family":"Chaplin","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Adam","family":"Szulewski","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Heather","family":"Braund","sequence":"additional","affiliation":[{"name":"Office of Professional Development and Educational Scholarship, Faculty of Health Sciences Queen's University  Kingston Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicholas","family":"Cofie","sequence":"additional","affiliation":[{"name":"Office of Professional Development and Educational Scholarship, Faculty of Health Sciences Queen's University  Kingston Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Tamara","family":"McColl","sequence":"additional","affiliation":[{"name":"Educational Scholarship, Department of Emergency Medicine University of Manitoba  Winnipeg Manitoba Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andrew K.","family":"Hall","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Damon","family":"Dagnone","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine Queen's University  Kingston Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Leah","family":"Kelley","sequence":"additional","affiliation":[{"name":"Institute for Health System Solutions and Virtual Care Women's College Hospital  Toronto Ontario Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Brent","family":"Thoma","sequence":"additional","affiliation":[{"name":"Department of Emergency Medicine, College of Medicine University of Saskatchewan  Saskatoon Saskatchewan Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2019,12,18]]},"reference":[{"key":"e_1_2_10_2_1","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2017.1315071"},{"key":"e_1_2_10_3_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2010.500703"},{"key":"e_1_2_10_4_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000002066"},{"key":"e_1_2_10_5_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2010.500704"},{"key":"e_1_2_10_6_1","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2017.1315082"},{"key":"e_1_2_10_7_1","doi-asserted-by":"publisher","DOI":"10.1017\/S1460396918000468"},{"key":"e_1_2_10_8_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000002661"},{"key":"e_1_2_10_9_1","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2018.1485886"},{"key":"e_1_2_10_10_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2012.04337.x"},{"key":"e_1_2_10_11_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2011.04100.x"},{"key":"e_1_2_10_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2017.1407868"},{"key":"e_1_2_10_13_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.82.1.33"},{"volume-title":"Issues Meas Metacognition","year":"2000","author":"Pintrich P","key":"e_1_2_10_14_1"},{"key":"e_1_2_10_15_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326985ep3004_4"},{"key":"e_1_2_10_16_1","doi-asserted-by":"publisher","DOI":"10.1207\/s15326985ep2501_2"},{"key":"e_1_2_10_17_1","doi-asserted-by":"publisher","DOI":"10.1037\/0022-0663.81.3.329"},{"key":"e_1_2_10_18_1","first-page":"89","article-title":"Designing assessments of self\u2010regulated learning","author":"Winne PH","year":"2011","journal-title":"Assess High Order Think Ski"},{"issue":"1","key":"e_1_2_10_19_1","first-page":"1","article-title":"The potentials of educational data mining for researching metacognition, motivation and self\u2010regulated learning","volume":"5","author":"Winne PH","year":"2013","journal-title":"JEDM \u2010 J Educ Data min"},{"key":"e_1_2_10_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.learninstruc.2012.10.001"},{"key":"e_1_2_10_21_1","doi-asserted-by":"publisher","DOI":"10.4300\/JGME-D-17-00827.1"},{"key":"e_1_2_10_22_1","doi-asserted-by":"publisher","DOI":"10.1053\/j.nainr.2010.12.012"},{"key":"e_1_2_10_23_1","doi-asserted-by":"publisher","DOI":"10.1097\/SIH.0000000000000136"},{"key":"e_1_2_10_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ecns.2013.05.007"},{"key":"e_1_2_10_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/0959-4752(91)90016-2"},{"key":"e_1_2_10_26_1","doi-asserted-by":"publisher","DOI":"10.3102\/00346543065003245"},{"key":"e_1_2_10_27_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11251-005-1272-9"},{"key":"e_1_2_10_28_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2729.2006.00157.x"},{"key":"e_1_2_10_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/03075070600572090"},{"key":"e_1_2_10_30_1","doi-asserted-by":"publisher","DOI":"10.1503\/cmaj.121772"},{"key":"e_1_2_10_31_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2013.801939"},{"key":"e_1_2_10_32_1","doi-asserted-by":"publisher","DOI":"10.3402\/meo.v19.25141"},{"issue":"1","key":"e_1_2_10_33_1","first-page":"41","article-title":"Self\u2010assessment through videotaping compared with peer and trainer feedback","volume":"25","author":"Avsar UZ","year":"2015","journal-title":"J Coll Physicians Surg\u2014Pak JCPSP"},{"key":"e_1_2_10_34_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jsurg.2015.05.016"},{"key":"e_1_2_10_35_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-016-0562-z"},{"key":"e_1_2_10_36_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e31822a603d"},{"key":"e_1_2_10_37_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e31820dc384"},{"key":"e_1_2_10_38_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2011.595434"},{"key":"e_1_2_10_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.annemergmed.2018.03.005"},{"key":"e_1_2_10_40_1","doi-asserted-by":"publisher","DOI":"10.4300\/JGME-D-16-00462.1"},{"key":"e_1_2_10_41_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e3182677805"},{"key":"e_1_2_10_42_1","doi-asserted-by":"publisher","DOI":"10.1186\/s41077-019-0099-4"},{"key":"e_1_2_10_43_1","doi-asserted-by":"publisher","DOI":"10.1097\/SIH.0000000000000076"},{"volume-title":"How Does Resuscitation Performance in the Simulation Setting Relate to Performance in the Real World? A Direct Comparison of Entrustment Scoring of Emergency Medicine Residents","year":"2018","author":"Weersink K","key":"e_1_2_10_44_1"},{"volume-title":"Discovering Statistics Using IBM SPSS Statistics","year":"2017","author":"Field A","key":"e_1_2_10_45_1"},{"volume-title":"CanMEDS 2015: from Manager to Leader","year":"2015","author":"Dath D","key":"e_1_2_10_46_1"},{"key":"e_1_2_10_47_1","first-page":"1","article-title":"Discriminating features of narrative evaluations of communication skills during an OSCE","volume":"31","author":"Wilby KJ","year":"2019","journal-title":"Teach Learn Med February"},{"key":"e_1_2_10_48_1","doi-asserted-by":"publisher","DOI":"10.1093\/scan\/nsy014"},{"key":"e_1_2_10_49_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.13158"},{"key":"e_1_2_10_50_1","doi-asserted-by":"publisher","DOI":"10.1037\/0003-066X.37.8.911"},{"key":"e_1_2_10_51_1","doi-asserted-by":"publisher","DOI":"10.1080\/0969594X.2015.1060192"},{"key":"e_1_2_10_52_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1745-3984.2001.tb01130.x"},{"key":"e_1_2_10_53_1","doi-asserted-by":"publisher","DOI":"10.1111\/jedm.12000"},{"key":"e_1_2_10_54_1","doi-asserted-by":"publisher","DOI":"10.1111\/medu.12678"},{"key":"e_1_2_10_55_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-017-9800-3"},{"key":"e_1_2_10_56_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000001175"},{"key":"e_1_2_10_57_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11934-018-0799-7"},{"key":"e_1_2_10_58_1","doi-asserted-by":"publisher","DOI":"10.18203\/2349-2902.isj20185112"},{"key":"e_1_2_10_59_1","doi-asserted-by":"publisher","DOI":"10.1089\/end.2017.0650"},{"key":"e_1_2_10_60_1","doi-asserted-by":"publisher","DOI":"10.1136\/bmjstel-2018-000391"},{"key":"e_1_2_10_61_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-90518-1_11"}],"container-title":["Journal of Evaluation in Clinical Practice"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Fjep.13338","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jep.13338","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1111\/jep.13338","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1111\/jep.13338","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,9,5]],"date-time":"2023-09-05T13:12:53Z","timestamp":1693919573000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1111\/jep.13338"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,18]]},"references-count":60,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2020,8]]}},"alternative-id":["10.1111\/jep.13338"],"URL":"https:\/\/doi.org\/10.1111\/jep.13338","archive":["Portico"],"relation":{},"ISSN":["1356-1294","1365-2753"],"issn-type":[{"type":"print","value":"1356-1294"},{"type":"electronic","value":"1365-2753"}],"subject":[],"published":{"date-parts":[[2019,12,18]]},"assertion":[{"value":"2019-08-02","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-11-29","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2019-12-18","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}