{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,23]],"date-time":"2026-09-23T03:25:19Z","timestamp":1790133919045,"version":"4.0.1"},"reference-count":32,"publisher":"BMJ","issue":"7","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["BMJ Qual Saf"],"accepted":{"date-parts":[[2013,1,16]]},"published-print":{"date-parts":[[2013,7]]},"abstract":"<jats:sec>\n                  <jats:title>Background<\/jats:title>\n                  <jats:p>A lack of non-technical skills is increasingly recognised as an important underlying cause of adverse events in healthcare. The nature and number of things professionals communicate to each other can be perceived as a product of their use of non-technical skills. This paper describes the development and reliability of an instrument to measure and quantify the use of non-technical skills by direct observations of explicit professional oral communication (EPOC) in the clinical situation.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Methods<\/jats:title>\n                  <jats:p>In an iterative process we translated, tested and refined an existing checklist from the aviation industry, called self, human interaction, aircraft, procedures and environment, in the context of healthcare, notably emergency departments (ED) and intensive care units (ICU). The EPOC comprises six dimensions: assertiveness, working with others; task-oriented leadership; people-oriented leadership; situational awareness; planning and anticipation. Each dimension is specified into several concrete items reflecting verbal behaviours. The EPOC was evaluated in four ED and six ICU.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>In the ED and ICU, respectively, 378 and 1144 individual and 51 and 68 contemporaneous observations of individual staff members were conducted. All EPOC dimensions occur frequently, apart from assertiveness, which was hardly observed. Intraclass correlations for the overall EPOC score ranged between 0.85 and 0.91 and for underlying EPOC dimensions between 0.53 and 0.95.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Conclusions<\/jats:title>\n                  <jats:p>The EPOC is a new instrument for evaluating the use of non-technical skills in healthcare, which is reliable in two highly different settings. By quantifying professional behaviour the instrument facilitates measurement of behavioural change over time. The results suggest that EPOC can also be translated to other settings.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1136\/bmjqs-2012-001451","type":"journal-article","created":{"date-parts":[[2013,2,14]],"date-time":"2013-02-14T21:55:34Z","timestamp":1360878934000},"page":"586-595","source":"Crossref","is-referenced-by-count":17,"title":["Development and reliability of the explicit professional oral communication observation tool to quantify the use of non-technical skills in healthcare"],"prefix":"10.1136","volume":"22","author":[{"given":"Peter F","family":"Kemper","sequence":"first","affiliation":[{"name":"Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Inge","family":"van Noord","sequence":"additional","affiliation":[{"name":"Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Martine","family":"de Bruijne","sequence":"additional","affiliation":[{"name":"Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dirk L","family":"Knol","sequence":"additional","affiliation":[{"name":"Department of Epidemiology and Biostatistics, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cordula","family":"Wagner","sequence":"additional","affiliation":[{"name":"Department of Public and Occupational Health, EMGO Institute for Health and Care Research, VU University Medical Center, Amsterdam, The Netherlands"},{"name":"The Netherlands Institute of Health Services Research (NIVEL), Utrecht, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Cathy","family":"van Dyck","sequence":"additional","affiliation":[{"name":"Faculty of Social Sciences, Department of Organizational Science, VU University, Amsterdam, The Netherlands"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"239","published-online":{"date-parts":[[2013,2,14]]},"reference":[{"key":"2025090410141279000_22.7.586.1","doi-asserted-by":"publisher","DOI":"10.1136\/bmj.320.7237.781"},{"key":"2025090410141279000_22.7.586.2","doi-asserted-by":"publisher","DOI":"10.1186\/cc7787"},{"key":"2025090410141279000_22.7.586.3","doi-asserted-by":"publisher","DOI":"10.1093\/bja\/aeq134"},{"key":"2025090410141279000_22.7.586.4","doi-asserted-by":"publisher","DOI":"10.1093\/bja\/ael067"},{"key":"2025090410141279000_22.7.586.5","doi-asserted-by":"publisher","DOI":"10.1016\/j.surg.2005.06.017"},{"key":"2025090410141279000_22.7.586.6","doi-asserted-by":"crossref","unstructured":"Helmreich RL Foushee HC . Why crew resource management? Empirical and theoretical bases of human factors training in aviation. In: Wiener EL Kanki BG Helmreich RL .eds. Cockpit resource management. San Francisco: Academic Press Inc, 1993: 3\u201345.","DOI":"10.1016\/B978-0-12-812995-1.00001-4"},{"key":"2025090410141279000_22.7.586.7","doi-asserted-by":"publisher","DOI":"10.1097\/SLA.0b013e3181642ec8"},{"key":"2025090410141279000_22.7.586.8","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2004.009993"},{"key":"2025090410141279000_22.7.586.9","doi-asserted-by":"crossref","first-page":"96","DOI":"10.1097\/01.JPN.0000319095.59673.6c","article-title":"Crew resource management in healthcare: the evolution of teamwork training and MedTeams","volume":"22","author":"McConaughey","year":"2008","journal-title":"J Perinat Neonatal Nurs"},{"key":"2025090410141279000_22.7.586.10","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.bpa.2011.02.003","article-title":"Simulation and CRM","volume":"25","author":"Ostergaard","year":"2011","journal-title":"Best Pract Res Clin Anaesthesiol"},{"key":"2025090410141279000_22.7.586.11","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2009.037184"},{"key":"2025090410141279000_22.7.586.12","doi-asserted-by":"publisher","DOI":"10.1001\/archsurg.2009.207"},{"key":"2025090410141279000_22.7.586.13","doi-asserted-by":"publisher","DOI":"10.1001\/archsurg.2008.545"},{"key":"2025090410141279000_22.7.586.14","doi-asserted-by":"publisher","DOI":"10.1007\/s00268-005-0488-9"},{"key":"2025090410141279000_22.7.586.15","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2007.024760"},{"key":"2025090410141279000_22.7.586.16","doi-asserted-by":"publisher","DOI":"10.1007\/s00268-007-9320-z"},{"key":"2025090410141279000_22.7.586.17","first-page":"133","article-title":"Does teamwork improve performance in the operating room? A multilevel evaluation","volume":"36","author":"Weaver","year":"2010","journal-title":"Jt Comm J Qual Patient Saf"},{"key":"2025090410141279000_22.7.586.18","doi-asserted-by":"publisher","DOI":"10.1136\/qshc.2008.032045"},{"key":"2025090410141279000_22.7.586.19","unstructured":"Antersijn PAM Verhoef MC . Assessment of non-technical skills: is it possible? In: McDonald N Johnston N Fuller R .eds. Applications of psychology to the aviation system: Proceedings of the 21st Conference of the European Association for Aviation Psychology (EAAP), Vol. 1. Aldershot, UK: Avebury Aviation, 1995: 243\u201350."},{"key":"2025090410141279000_22.7.586.20","unstructured":"Klampfer B Flin R Helmreich R . Group interactions in high risk environments: behavioural markers workshop. 2001. homepage.psy.utexas.edu\/homepage\/group\/helmreichlab\/publications\/pubfiles\/pub262.pdf (accessed 10 Mar 2012)."},{"key":"2025090410141279000_22.7.586.21","doi-asserted-by":"crossref","unstructured":"Hart SG Staveland LE . Development of the NASA-TLX (task load index): results of empirical and theoretical research. In: Hancock A Meshkati N .eds. Human mental workload. Amsterdam: North Holland Press, 1988.","DOI":"10.1016\/S0166-4115(08)62386-9"},{"key":"2025090410141279000_22.7.586.22","doi-asserted-by":"publisher","DOI":"10.1186\/1472-6963-11-304"},{"key":"2025090410141279000_22.7.586.23","doi-asserted-by":"publisher","DOI":"10.1037\/1082-989X.1.1.30"},{"key":"2025090410141279000_22.7.586.24","doi-asserted-by":"crossref","first-page":"1010","DOI":"10.1016\/j.jclinepi.2006.09.014","article-title":"Reliability studies can be designed more efficiently by using variance components estimates from different sources","volume":"60","author":"Euser","year":"2007","journal-title":"J Clin Epidemiol"},{"key":"2025090410141279000_22.7.586.25","doi-asserted-by":"publisher","DOI":"10.1080\/10543400701329448"},{"key":"2025090410141279000_22.7.586.26","doi-asserted-by":"publisher","DOI":"10.1016\/j.jclinepi.2010.02.006"},{"key":"2025090410141279000_22.7.586.27","doi-asserted-by":"crossref","unstructured":"De Vet HC Terwee CB Mokkink LB . Measurement in medicine. Cambridge: Cambridge University Press, 2011.","DOI":"10.1017\/CBO9780511996214"},{"key":"2025090410141279000_22.7.586.28","doi-asserted-by":"publisher","DOI":"10.1177\/096228029800700306"},{"key":"2025090410141279000_22.7.586.29","doi-asserted-by":"crossref","unstructured":"Altman DG . Practical statistics for medical research. London: Chapman & Hall, 1991.","DOI":"10.1201\/9780429258589"},{"key":"2025090410141279000_22.7.586.30","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2929.2006.02610.x"},{"key":"2025090410141279000_22.7.586.31","doi-asserted-by":"publisher","DOI":"10.1037\/a0016903"},{"key":"2025090410141279000_22.7.586.32","unstructured":"Flin R O'Conner P Crichton M . Safety at the sharp end: a guide to non-technical skills. Farnham: Ashgate, 2008."}],"container-title":["BMJ Quality &amp; Safety"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjqs-2012-001451","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,4]],"date-time":"2025-09-04T17:14:29Z","timestamp":1757006069000},"score":1,"resource":{"primary":{"URL":"https:\/\/qualitysafety.bmj.com\/lookup\/doi\/10.1136\/bmjqs-2012-001451"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,2,14]]},"references-count":32,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2013,6,18]]},"published-print":{"date-parts":[[2013,7]]}},"alternative-id":["10.1136\/bmjqs-2012-001451"],"URL":"https:\/\/doi.org\/10.1136\/bmjqs-2012-001451","relation":{},"ISSN":["2044-5415","2044-5423"],"issn-type":[{"value":"2044-5415","type":"print"},{"value":"2044-5423","type":"electronic"}],"subject":[],"published":{"date-parts":[[2013,2,14]]}}}