{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T10:14:00Z","timestamp":1766398440366,"version":"3.48.0"},"reference-count":18,"publisher":"BMJ","issue":"4","license":[{"start":{"date-parts":[[2025,12,15]],"date-time":"2025-12-15T00:00:00Z","timestamp":1765756800000},"content-version":"unspecified","delay-in-days":75,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001691","name":"Japan Society for the Promotion of Science","doi-asserted-by":"publisher","award":["22H03318\/23K24576"],"award-info":[{"award-number":["22H03318\/23K24576"]}],"id":[{"id":"10.13039\/501100001691","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["bmj.com"],"crossmark-restriction":true},"short-container-title":["BMJ Open Qual"],"accepted":{"date-parts":[[2025,11,26]]},"published-print":{"date-parts":[[2025,10]]},"abstract":"<jats:sec>\n                    <jats:title>Introduction<\/jats:title>\n                    <jats:p>Healthcare team performance directly impacts the quality and safety of medical care. However, measuring the performance of teams is challenging and requires methodologies to investigate different contributing elements. This study proposes an AI(artificial intelligence)-driven multimodal approach to visualising gaze (ie, joint visual attention) and speech in medical team performance and examines how these might differ across medical expertise, using eye-trackers and our own automatic gaze annotation programme.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Method<\/jats:title>\n                    <jats:p>Four simulation sessions, two in Japan and another two in the UK, were filmed with eye-trackers worn by a clinician and a nurse. In each site, one session was conducted with an experienced pair (UK_Ex and JP_Ex) and the other with a less experienced pair (UK_LessEx and JP_LessEx). The scenarios were a difficult intubation in Japan and a urine infection, with a family member present, in the UK. The numbers of occurrences and the time lengths of joint attention and individuals\u2019 speeches in the four data sets were compared in total and in 15\u2009s time ranges to see the correlations.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Result<\/jats:title>\n                    <jats:p>The Ex pairs in both contexts paid joint visual attention more frequently and longer and spoke more than the LessEx pairs. In the JP_Ex, the positive correlation was found between the numbers of joint attention and the total speech durations (r=0.81). That indicates the team members verbally coordinated each other\u2019s attentional objects, which is termed coregulative attentional engagement. In contrast, in the UK_Ex, the correlation was negative (r=\u22120.70), where they visually monitored each other\u2019s actions while talking to the patient\u2019s family, which we call coinfluential attentional engagement. These tendencies were weak in the LessEx pairs.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>Although the accuracy of automatic annotation (approximately. 40%\u201360%) should be improved before applying it to medical training, the research method could provide preliminary insight into elements of good team performance.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1136\/bmjoq-2025-003658","type":"journal-article","created":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T10:10:15Z","timestamp":1766398215000},"page":"e003658","update-policy":"https:\/\/doi.org\/10.1136\/crossmarkpolicy","source":"Crossref","is-referenced-by-count":0,"title":["Developing an AI-driven multimodal approach to visualising resilient team performance: joint attentional engagement with gaze and speech in simulated emergency scenarios"],"prefix":"10.1136","volume":"14","author":[{"given":"Atsushi","family":"Miyazaki","sequence":"first","affiliation":[{"name":"Yokohama City University Medical Center, Yokohama, Kanagawa Prefecture, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frank","family":"Coffey","sequence":"additional","affiliation":[{"name":"Nottingham University Hospitals NHS Trust, Nottingham, UK"},{"name":"Nottingham Trent University, Nottingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1115-047X","authenticated-orcid":false,"given":"Hitoshi","family":"Sato","sequence":"additional","affiliation":[{"name":"Yokohama City University Medical Center, Yokohama, Kanagawa Prefecture, Japan"},{"name":"The University of Osaka Hospital, Suita, Osaka Prefecture, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6818-2838","authenticated-orcid":false,"given":"Andrew K","family":"Mackenzie","sequence":"additional","affiliation":[{"name":"Nottingham Trent University, Nottingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3162-7765","authenticated-orcid":false,"given":"Kyota","family":"Nakamura","sequence":"additional","affiliation":[{"name":"Yokohama City University Medical Center, Yokohama, Kanagawa Prefecture, Japan"},{"name":"The University of Osaka Hospital, Suita, Osaka Prefecture, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kazuya","family":"Bise","sequence":"additional","affiliation":[{"name":"Kyushu Institute of Technology, Kitakyushu, Fukuoka Prefecture, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Takeshi","family":"Saitoh","sequence":"additional","affiliation":[{"name":"Kyushu Institute of Technology, Kitakyushu, Fukuoka Prefecture, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3496-1953","authenticated-orcid":false,"given":"Takeru","family":"Abe","sequence":"additional","affiliation":[{"name":"Yokohama City University Medical Center, Yokohama, Kanagawa Prefecture, Japan"},{"name":"Fukushima Medical University, Fukushima, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-2483-9462","authenticated-orcid":false,"given":"Miharu","family":"Fuyuno","sequence":"additional","affiliation":[{"name":"Kyushu University, Fukuoka, Fukuoka, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Timmons","sequence":"additional","affiliation":[{"name":"Nottingham University Business School, Nottingham, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0635-6062","authenticated-orcid":false,"given":"Keiko","family":"Tsuchiya","sequence":"additional","affiliation":[{"name":"Yokohama City University, Yokohama, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"239","published-online":{"date-parts":[[2025,12,22]]},"reference":[{"key":"2025122202100364000_14.4.e003658.1","first-page":"43","article-title":"Teaming Is a Verb","volume":"13","author":"Edmondson","year":"2013","journal-title":"Reflections"},{"key":"2025122202100364000_14.4.e003658.2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1558\/cam.32569","article-title":"Editorial: Team work and team talk as distributed and coordinated action in healthcare delivery","volume":"13","author":"Sarangi","year":"2016","journal-title":"Commun Med"},{"key":"2025122202100364000_14.4.e003658.3","doi-asserted-by":"crossref","unstructured":"Nakamura K , Nakajima S , Abe T , et al . Cross-boundary teaming to establish resilience among isolated \u2018silos. In: Rapport F , Braithwaite J , eds. Transforming healthcare with qualitative research. Routledge: Abingdon, 2020: 147\u201356.","DOI":"10.4324\/9780429299797-18"},{"key":"2025122202100364000_14.4.e003658.4","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X05000129"},{"key":"2025122202100364000_14.4.e003658.5","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9507.1995.tb00063.x"},{"key":"2025122202100364000_14.4.e003658.6","doi-asserted-by":"publisher","DOI":"10.1016\/j.resuscitation.2019.12.008"},{"key":"2025122202100364000_14.4.e003658.7","doi-asserted-by":"crossref","DOI":"10.1136\/bmjopen-2024-095803","article-title":"Enhancing the quality and safety of central venous catheter insertion using projection mapping: a prospective observational simulation study with eye-tracking glasses","volume":"15","author":"Miyazaki","year":"2025","journal-title":"BMJ Open"},{"key":"2025122202100364000_14.4.e003658.8","doi-asserted-by":"crossref","unstructured":"Di Paolo EA , Cuffari EC , De Jaegher H . Linguistic Bodies: The Continuity between Life and Language. The MIT Press, 2018.","DOI":"10.7551\/mitpress\/11244.001.0001"},{"key":"2025122202100364000_14.4.e003658.9","unstructured":"iMotions A\/S. iMotions 9.4, 2024. Available: https:\/\/imotions.com"},{"key":"2025122202100364000_14.4.e003658.10","doi-asserted-by":"publisher","DOI":"10.1136\/bmjqs-2016-005816"},{"key":"2025122202100364000_14.4.e003658.11","doi-asserted-by":"crossref","unstructured":"Adolphs S , Carter R . Spoken corpus linguistics: from monomodal to multimodal. Routledge: Abingdon, 2013.","DOI":"10.4324\/9780203526149"},{"key":"2025122202100364000_14.4.e003658.12","doi-asserted-by":"crossref","unstructured":"Coffey F , Reilly J-J , Mackenzie A , et al . 2238\u2005When a doctor and a nurse share their view in a simulated emergency care interaction: developing an automatic gaze annotation method for multiple eye-tracking data analysis. RCEM Annual Scientific Conference Glasgow 2023 Meeting Abstracts; December 2023:881\u20132. doi:10.1136\/emj-2023-RCEM.35","DOI":"10.1136\/emj-2023-RCEM.35"},{"key":"2025122202100364000_14.4.e003658.13","doi-asserted-by":"crossref","unstructured":"Bise K , Saitoh T , Tsuchiya K , et al . Joint attention detection using first-person points-of-view video. 2024 2nd International Conference on Computer Graphics and Image Processing (CGIP); Kyoto, Japan, 2024:1\u20136. doi:10.1109\/CGIP62525.2024.00029","DOI":"10.1109\/CGIP62525.2024.00029"},{"key":"2025122202100364000_14.4.e003658.14","unstructured":"ELAN . ELAN (version 5.9). 2001. Available: https:\/\/archive.mpi.nl\/tla\/elan"},{"key":"2025122202100364000_14.4.e003658.15","unstructured":"Mizumoto A . Langtest.jp. 2025. 2025. Available: https:\/\/langtest.jp"},{"key":"2025122202100364000_14.4.e003658.16","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.3758\/s13428-021-01679-2","article-title":"The Multiple Object Avoidance (MOA) task measures attention for action: Evidence from driving and sport","volume":"54","author":"Mackenzie","year":"2022","journal-title":"Behav Res"},{"key":"2025122202100364000_14.4.e003658.17","doi-asserted-by":"crossref","unstructured":"Furuya Y , Saitoh T , Tsuchiya K , et al . Efficient construction of face image dataset for head pose estimation. 2024 2nd International Conference on Computer Graphics and Image Processing (CGIP); Kyoto, Japan, 2024:175\u201380. doi:10.1109\/CGIP62525.2024.00038","DOI":"10.1109\/CGIP62525.2024.00038"},{"key":"2025122202100364000_14.4.e003658.18","unstructured":"Hollnagel E , Braithwaite J , Wears R . Resilient health care. Farnham: Ashgate Publishing Limited, 2013."}],"container-title":["BMJ Open Quality"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1136\/bmjoq-2025-003658","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,22]],"date-time":"2025-12-22T10:10:18Z","timestamp":1766398218000},"score":1,"resource":{"primary":{"URL":"https:\/\/qir.bmj.com\/lookup\/doi\/10.1136\/bmjoq-2025-003658"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10]]},"references-count":18,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2025,12,22]]},"published-print":{"date-parts":[[2025,10]]}},"alternative-id":["10.1136\/bmjoq-2025-003658"],"URL":"https:\/\/doi.org\/10.1136\/bmjoq-2025-003658","relation":{},"ISSN":["2399-6641"],"issn-type":[{"value":"2399-6641","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10]]}}}