{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T02:43:05Z","timestamp":1778553785903,"version":"3.51.4"},"reference-count":29,"publisher":"Wiley","issue":"4","license":[{"start":{"date-parts":[[2021,11,25]],"date-time":"2021-11-25T00:00:00Z","timestamp":1637798400000},"content-version":"vor","delay-in-days":55,"URL":"http:\/\/onlinelibrary.wiley.com\/termsAndConditions#vor"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["AEM Education and Training"],"published-print":{"date-parts":[[2021,10]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Objectives<\/jats:title><jats:p>It is critical to assess competency of medical students and residents in emergency medicine (EM) during undergraduate and graduate medical education. However, very few valid tools exist to assess both technical and nontechnical skills in the specific context of EM. Three Acute Care Assessment Tools (ACAT 1, 2, and 3) have been previously developed for three acute care conditions: cardiac arrest (1), coma (2), and acute respiratory failure (3). This study aimed to evaluate the reproducibility of the tools.<\/jats:p><\/jats:sec><jats:sec><jats:title>Methods<\/jats:title><jats:p>The tool was tested using recorded videos of simulation sessions of fourth year medical students and first year residents in EM. Raters independently reviewed the videos two times in a 3\u2010month interval, and interrater and intrarater reliability using intraclass correlation (ICC) was calculated. Secondary endpoints included the completeness rate and relevance of the ACAT.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>Sixty\u2010two sessions were recorded and 48 videos analyzed (18 for CA and 15 for both respiratory failure and coma. The learners were residents in 32 (66%) of videos. Interrater reliability was excellent (ICC &gt;0.9 for all three contexts) and so was the intrarater reliability (&gt;0.88), both upon first review (month 0, M0) and at 3\u00a0months (M3). The usability of the ACAT was good, with a completeness of the items that ranged from 96% to 100%. Only one item of the ACAT 1 had a relevance of 27%, as it could not be completed in 13 scenarios out of 18.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>The results demonstrate educators can evaluate students similarly utilizing video recordings of simulated medical scenario. The excellent completeness of the rated items advocated for good usability. The three ACATs can be utilized to assess for completeness of predefined tasks in three acute care broad scenario in a competency\u2010based medical education framework.<\/jats:p><\/jats:sec>","DOI":"10.1002\/aet2.10704","type":"journal-article","created":{"date-parts":[[2021,10,20]],"date-time":"2021-10-20T22:19:22Z","timestamp":1634768362000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Usability and reproducibility of three tools to assess medical students and residents in emergency medicine"],"prefix":"10.1002","volume":"5","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3962-9266","authenticated-orcid":false,"given":"Anne\u2010Laure","family":"Philippon","sequence":"first","affiliation":[{"name":"Laboratoire Interuniversitaire de Sciences de l\u2019Education (LISEC) Learning Sciences Department Universit\u00e9 de Strasbourg Strasbourg France"},{"name":"Emergency Department H\u00f4pital Piti\u00e9\u2010Salp\u00eatri\u00e8re Assistance Publique \u2013 H\u00f4pitaux de Paris Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aurelien","family":"Baud","sequence":"additional","affiliation":[{"name":"Emergency Department H\u00f4pital Tenon Assistance Publique \u2013 H\u00f4pitaux de Paris Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Margaux","family":"Dumont","sequence":"additional","affiliation":[{"name":"Emergency Department H\u00f4pital Piti\u00e9\u2010Salp\u00eatri\u00e8re Assistance Publique \u2013 H\u00f4pitaux de Paris Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sidi Ahmed","family":"Remini","sequence":"additional","affiliation":[{"name":"Centre de Simulation ILumens Paris Diderot Universit\u00e9 de Paris Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeremy","family":"Leroy","sequence":"additional","affiliation":[{"name":"Facult\u00e9 de M\u00e9decine Sorbonne Universit\u00e9 Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jennifer","family":"Truchot","sequence":"additional","affiliation":[{"name":"Emergency Department H\u00f4pital Cochin Assistance Publique \u2013 H\u00f4pitaux de Paris Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Emmanuel","family":"Triby","sequence":"additional","affiliation":[{"name":"Laboratoire Interuniversitaire de Sciences de l\u2019Education (LISEC) Learning Sciences Department Universit\u00e9 de Strasbourg Strasbourg France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0262-3848","authenticated-orcid":false,"given":"Yonathan","family":"Freund","sequence":"additional","affiliation":[{"name":"Emergency Department H\u00f4pital Piti\u00e9\u2010Salp\u00eatri\u00e8re Assistance Publique \u2013 H\u00f4pitaux de Paris Paris France"},{"name":"Facult\u00e9 de M\u00e9decine Sorbonne Universit\u00e9 Paris France"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2021,11,25]]},"reference":[{"key":"e_1_2_9_2_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e3181b17ae6"},{"key":"e_1_2_9_3_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000002080"},{"key":"e_1_2_9_4_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0b013e31820cb2a7"},{"key":"e_1_2_9_5_1","doi-asserted-by":"publisher","DOI":"10.1056\/NEJMra054784"},{"key":"e_1_2_9_6_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.287.2.226"},{"key":"e_1_2_9_7_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2015.1060308"},{"issue":"2","key":"e_1_2_9_8_1","first-page":"150","article-title":"Newly formed French residents in pediatrics are not well prepared for conducting pediatric resuscitation after medical school","volume":"23","author":"Drummond D","year":"2016","journal-title":"Arch Pediatr Organe Off Soc Francaise Pediatr"},{"key":"e_1_2_9_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2014.08.040"},{"key":"e_1_2_9_10_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000000192"},{"key":"e_1_2_9_11_1","doi-asserted-by":"publisher","DOI":"10.1001\/jama.2013.282081"},{"key":"e_1_2_9_12_1","doi-asserted-by":"publisher","DOI":"10.1097\/MEJ.0b013e32835c2bbd"},{"key":"e_1_2_9_13_1","doi-asserted-by":"publisher","DOI":"10.1111\/acem.13257"},{"key":"e_1_2_9_14_1","doi-asserted-by":"publisher","DOI":"10.1186\/s12909-016-0808-9"},{"key":"e_1_2_9_15_1","first-page":"16244","article-title":"A cognitive task analysis for an emergency management serious game","volume":"2016","author":"Dass S","year":"2016","journal-title":"Interserv Ind Train Simul Educ Conf"},{"key":"e_1_2_9_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2015.11.024"},{"key":"e_1_2_9_17_1","doi-asserted-by":"publisher","DOI":"10.4172\/2161\u2010105X.1000346"},{"key":"e_1_2_9_18_1","doi-asserted-by":"publisher","DOI":"10.1097\/SIH.0b013e31824a5c20"},{"key":"e_1_2_9_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2011.03.009"},{"key":"e_1_2_9_20_1","doi-asserted-by":"publisher","DOI":"10.2310\/8000.2012.110385"},{"key":"e_1_2_9_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2009.11.011"},{"key":"e_1_2_9_22_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2923.2003.01594.x"},{"key":"e_1_2_9_23_1","doi-asserted-by":"publisher","DOI":"10.3166\/afmu-2019-0199"},{"key":"e_1_2_9_24_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10459-013-9458-4"},{"key":"e_1_2_9_25_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000001896"},{"key":"e_1_2_9_26_1","doi-asserted-by":"publisher","DOI":"10.3109\/0142159X.2010.501190"},{"key":"e_1_2_9_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2015.07.032"},{"key":"e_1_2_9_28_1","doi-asserted-by":"publisher","DOI":"10.1097\/ACM.0000000000002071"},{"key":"e_1_2_9_29_1","doi-asserted-by":"publisher","DOI":"10.1080\/0142159X.2017.1315066"},{"key":"e_1_2_9_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2923.2009.03454.x"}],"container-title":["AEM Education and Training"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aet2.10704","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1002\/aet2.10704","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1002\/aet2.10704","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,8,28]],"date-time":"2023-08-28T08:06:55Z","timestamp":1693210015000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1002\/aet2.10704"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,10]]},"references-count":29,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,10]]}},"alternative-id":["10.1002\/aet2.10704"],"URL":"https:\/\/doi.org\/10.1002\/aet2.10704","archive":["Portico"],"relation":{},"ISSN":["2472-5390","2472-5390"],"issn-type":[{"value":"2472-5390","type":"print"},{"value":"2472-5390","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,10]]},"assertion":[{"value":"2021-06-21","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-18","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-11-25","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"e10704"}}