{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,10]],"date-time":"2026-02-10T18:31:47Z","timestamp":1770748307060,"version":"3.49.0"},"reference-count":29,"publisher":"Springer Science and Business Media LLC","issue":"4","license":[{"start":{"date-parts":[[2019,2,7]],"date-time":"2019-02-07T00:00:00Z","timestamp":1549497600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,2,7]],"date-time":"2019-02-07T00:00:00Z","timestamp":1549497600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000780","name":"European Commission","doi-asserted-by":"crossref","award":["INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB). Project: Centre for Personalised Medicine \u2013 Clinical Decision Making and Patient Safety."],"award-info":[{"award-number":["INTERREG VA Programme, managed by the Special EU Programmes Body (SEUPB). Project: Centre for Personalised Medicine \u2013 Clinical Decision Making and Patient Safety."]}],"id":[{"id":"10.13039\/501100000780","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Northern Ireland Department of the Economy","award":["PhD Scholarship"],"award-info":[{"award-number":["PhD Scholarship"]}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EPSRC Image Guided Therapies Network+ Proof of Concept Grant"],"award-info":[{"award-number":["EPSRC Image Guided Therapies Network+ Proof of Concept Grant"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"published-print":{"date-parts":[[2019,4,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Introduction<\/jats:title>\n                <jats:p>Unobtrusive metrics that can auto-assess performance during clinical procedures are of value. Three approaches to deriving wearable technology-based metrics are explored: (1) eye tracking, (2) psychophysiological measurements [e.g. electrodermal activity (EDA)] and (3) arm and hand movement via accelerometry. We also measure attentional capacity by tasking the operator with an additional task to track an unrelated object during the procedure.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>Two aspects of performance are measured: (1) using eye gaze and psychophysiology metrics and (2) measuring attentional capacity via an additional unrelated task (to monitor a visual stimulus\/playing cards). The aim was to identify metrics that can be used to automatically discriminate between levels of performance or at least between novices and experts. The study was conducted using two groups: (1) novice operators and (2) expert operators. Both groups made two attempts at a coronary angiography procedure using a full-physics virtual reality simulator. Participants wore eye tracking glasses and an E4 wearable wristband. Areas of interest were defined to track visual attention on display screens, including: (1) X-ray, (2) vital signs, (3) instruments and (4) the stimulus screen (for measuring attentional capacity).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>Experts provided greater dwell time (63% vs 42%, <jats:italic>p<\/jats:italic>\u2009=\u20090.03) and fixations (50% vs 34%, <jats:italic>p<\/jats:italic>\u2009=\u20090.04) on display screens. They also provided greater dwell time (11% vs 5%, <jats:italic>p<\/jats:italic>\u2009=\u20090.006) and fixations (9% vs 4%, <jats:italic>p<\/jats:italic>\u2009=\u20090.007) when selecting instruments. The experts\u2019 performance for tracking the unrelated object during the visual stimulus task negatively correlated with total errors (<jats:italic>r<\/jats:italic>\u2009=\u2009\u2212\u20090.95, <jats:italic>p<\/jats:italic>\u2009=\u20090.0009). Experts also had a higher standard deviation of EDA (2.52\u00a0\u00b5S vs 0.89\u00a0\u00b5S, <jats:italic>p<\/jats:italic>\u2009=\u20090.04).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>Eye tracking metrics may help discriminate between a novice and expert operator, by showing that experts maintain greater visual attention on the display screens. In addition, the visual stimulus study shows that an unrelated task can measure attentional capacity.<\/jats:p>\n                <jats:p><jats:italic>Trial registration<\/jats:italic> This work is registered through clinicaltrials.gov, a service of the U.S. National Health Institute, and is identified by the trial reference: NCT02928796.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-019-01918-0","type":"journal-article","created":{"date-parts":[[2019,2,7]],"date-time":"2019-02-07T10:56:43Z","timestamp":1549537003000},"page":"645-657","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":16,"title":["Wearable technology-based metrics for predicting operator performance during cardiac catheterisation"],"prefix":"10.1007","volume":"14","clinical-trial-number":[{"clinical-trial-number":"nct02928796","registry":"10.18810\/clinical-trials-gov"}],"author":[{"given":"Jonathan","family":"Currie","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1078-2232","authenticated-orcid":false,"given":"Raymond R.","family":"Bond","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Paul","family":"McCullagh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pauline","family":"Black","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Dewar D.","family":"Finlay","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Gallagher","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Peter","family":"Kearney","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Aaron","family":"Peace","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Colin D.","family":"Bicknell","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Stephen","family":"Leslie","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Anthony G.","family":"Gallagher","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2019,2,7]]},"reference":[{"key":"1918_CR1","volume-title":"To Err is human: building a safer health system","author":"L Kohn","year":"2000","unstructured":"Kohn L, Corrigan J, Donaldson M (2000) To Err is human: building a safer health system. National Academies Press, USA"},{"issue":"6 Suppl","key":"1918_CR2","doi-asserted-by":"publisher","first-page":"S75","DOI":"10.1197\/jamia.M1232","volume":"9","author":"J Zhang","year":"2002","unstructured":"Zhang J, Patel VL, Johnson TR (2002) Medical error: is the solution medical or cognitive? J Am Med Inform Assoc 9(6 Suppl):S75\u2013S77","journal-title":"J Am Med Inform Assoc"},{"issue":"3","key":"1918_CR3","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1037\/0033-295X.100.3.363","volume":"100","author":"KA Ericsson","year":"1993","unstructured":"Ericsson KA, Krampe RT, Tesch-R\u00f6mer C (1993) The role of deliberate practice in the acquisition of expert performance. Psychol Rev 100(3):363\u2013406","journal-title":"Psychol Rev"},{"issue":"10","key":"1918_CR4","doi-asserted-by":"publisher","first-page":"1872","DOI":"10.1016\/j.arthro.2015.06.021","volume":"31","author":"RA Pedowitz","year":"2015","unstructured":"Pedowitz RA, Nicandri GT, Angelo RL, Ryu RKN, Gallagher AG (2015) Objective assessment of knot-tying proficiency with the fundamentals of arthroscopic surgery training program workstation and knot tester. Arthroscopy 31(10):1872\u20131879","journal-title":"Arthroscopy"},{"issue":"10","key":"1918_CR5","doi-asserted-by":"publisher","first-page":"1854","DOI":"10.1016\/j.arthro.2015.07.001","volume":"31","author":"RL Angelo","year":"2015","unstructured":"Angelo RL, Ryu RKN, Pedowitz RA, Beach W, Burns J, Dodds J, Field L, Getelman M, Hobgood R, McIntyre L, Gallagher AG (2015) A proficiency-based progression training curriculum coupled with a model simulator results in the acquisition of a superior arthroscopic bankart skill set. Arthroscopy 31(10):1854\u20131871","journal-title":"Arthroscopy"},{"issue":"12","key":"1918_CR6","doi-asserted-by":"publisher","first-page":"1435","DOI":"10.1016\/j.nedt.2014.08.001","volume":"34","author":"RP Cant","year":"2014","unstructured":"Cant RP, Cooper SJ (2014) Simulation in the Internet age: the place of Web-based simulation in nursing education: an integrative review. Nurse Educ Today 34(12):1435\u20131442","journal-title":"Nurse Educ Today"},{"key":"1918_CR7","doi-asserted-by":"crossref","unstructured":"Sliney A, Murphy D (2008) JDoc: a serious game for medical learning. In: Proceedings of the first international conference on advanced computer interaction ACHI 2008, pp 131\u2013136","DOI":"10.1109\/ACHI.2008.50"},{"issue":"6","key":"1918_CR8","doi-asserted-by":"publisher","first-page":"579","DOI":"10.1016\/j.nepr.2014.05.004","volume":"14","author":"J Persson","year":"2014","unstructured":"Persson J, Dalholm EH, Wallerg\u00e5rd M, Johansson G (2014) Evaluating interactive computer-based scenarios designed for learning medical technology. Nurse Educ Pract 14(6):579\u2013585","journal-title":"Nurse Educ Pract"},{"issue":"11","key":"1918_CR9","doi-asserted-by":"publisher","first-page":"1467","DOI":"10.1002\/bjs.10275","volume":"103","author":"R Lear","year":"2016","unstructured":"Lear R, Riga C, Godfrey AD, Falaschetti E, Cheshire NJ, Van Herzeele I, Norton C, Vincent C, Darzi AW, Bicknell CD, LEAP Study Collaborators (2016) Multicentre observational study of surgical system failures in aortic procedures and their effect on patient outcomes. Br J Surg 103(11):1467\u20131475","journal-title":"Br J Surg"},{"issue":"6","key":"1918_CR10","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1093\/jamia\/ocv196","volume":"23","author":"A Fong","year":"2016","unstructured":"Fong A, Hoffman DJ, Zachary Hettinger A, Fairbanks RJ, Bisantz AM (2016) Identifying visual search patterns in eye gaze data; gaining insights into physician visual workflow. J Am Med Inform Assoc 23(6):196","journal-title":"J Am Med Inform Assoc"},{"issue":"5","key":"1918_CR11","doi-asserted-by":"publisher","first-page":"673","DOI":"10.1016\/j.amjsurg.2011.01.016","volume":"201","author":"B Zheng","year":"2011","unstructured":"Zheng B, Tien G, Atkins SM, Swindells C, Tanin H, Meneghetti A, Qayumi KA, Panton ONM (2011) Surgeon\u2019s vigilance in the operating room. Am J Surg 201(5):673\u2013677","journal-title":"Am J Surg"},{"key":"1918_CR12","doi-asserted-by":"crossref","unstructured":"Zhou S, Gali R, Paasche-Orlow M, Bickmore TW (2014) Afraid to ask: proactive assistance with healthcare documents using eye tracking. In: Proceedings of the extended abstracts 32nd annual ACM conference on human factors in computing systems\u2014CHI EA\u201914, pp 1669\u20131674","DOI":"10.1145\/2559206.2581218"},{"issue":"6","key":"1918_CR13","doi-asserted-by":"publisher","first-page":"922","DOI":"10.1016\/j.jelectrocard.2014.08.008","volume":"47","author":"CJ Breen","year":"2014","unstructured":"Breen CJ, Bond R, Finlay D (2014) An evaluation of eye tracking technology in the assessment of 12 lead electrocardiography interpretation. J Electrocardiol 47(6):922\u2013929","journal-title":"J Electrocardiol"},{"issue":"2","key":"1918_CR14","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1016\/j.ienj.2014.11.001","volume":"23","author":"P O\u2019Meara","year":"2015","unstructured":"O\u2019Meara P, Munro G, Williams B, Cooper S, Bogossian F, Ross L, Sparkes L, Browning M, McClounan M (2015) Developing situation awareness amongst nursing and paramedicine students utilizing eye tracking technology and video debriefing techniques: a proof of concept paper. Int Emerg Nurs 23(2):94\u201399","journal-title":"Int Emerg Nurs"},{"issue":"4","key":"1918_CR15","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1037\/0033-295X.87.4.329","volume":"87","author":"MA Just","year":"1980","unstructured":"Just MA, Carpenter PA (1980) A theory of reading: from eye fixations to comprehension. Psychol Rev 87(4):329\u2013354","journal-title":"Psychol Rev"},{"issue":"5","key":"1918_CR16","doi-asserted-by":"publisher","first-page":"329","DOI":"10.1097\/SIH.0000000000000116","volume":"10","author":"MP Stiegler","year":"2015","unstructured":"Stiegler MP, Gaba DM (2015) Eye tracking to acquire insight into the cognitive processes of clinicians. Simul Healthc J Soc Simul Healthc 10(5):329\u2013330","journal-title":"Simul Healthc J Soc Simul Healthc"},{"issue":"1","key":"1918_CR17","doi-asserted-by":"publisher","first-page":"e5","DOI":"10.2196\/humanfactors.4062","volume":"2","author":"O Asan","year":"2015","unstructured":"Asan O, Yang Y (2015) Using eye trackers for usability evaluation of health information technology: a systematic literature review. JMIR Hum Factors 2(1):e5","journal-title":"JMIR Hum Factors"},{"issue":"1","key":"1918_CR18","doi-asserted-by":"publisher","first-page":"53","DOI":"10.4236\/ojn.2016.61006","volume":"6","author":"N Suetsugu","year":"2016","unstructured":"Suetsugu N, Ohki M, Kaku T (2016) Quantitative analysis of nursing observation employing a portable eye-tracker. Open J Nurs 6(1):53\u201361","journal-title":"Open J Nurs"},{"key":"1918_CR19","volume-title":"Cognitive psychology: a student handbook","author":"M Esysenc","year":"1995","unstructured":"Esysenc M, Keane M (1995) Cognitive psychology: a student handbook. Earlbaum, Hove"},{"key":"1918_CR20","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/0010-0277(81)90024-X","volume":"10","author":"D Broadbent","year":"1981","unstructured":"Broadbent D (1981) Selective and control processes. Cognition 10:53\u201358","journal-title":"Cognition"},{"issue":"3","key":"1918_CR21","doi-asserted-by":"publisher","first-page":"e60","DOI":"10.1097\/SLA.0b013e318296c473","volume":"261","author":"A Gallagher","year":"2015","unstructured":"Gallagher A, Satava R, O\u2019Sullivan G (2015) Attentional capacity: an essential aspect of surgeon performance. Ann Surg 261(3):e60\u2013e61","journal-title":"Ann Surg"},{"issue":"1","key":"1918_CR22","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1038\/scientificamerican0749-11","volume":"181","author":"W Weaver","year":"1949","unstructured":"Weaver W (1949) The mathematics of communication. Sci Am 181(1):11\u20135","journal-title":"Sci Am"},{"issue":"2","key":"1918_CR23","doi-asserted-by":"publisher","first-page":"85","DOI":"10.1080\/03033910.1992.10557870","volume":"13","author":"HV Smith","year":"1992","unstructured":"Smith HV (1992) Is there a magical number 7\u2009\u00b1\u20092? The role of exposure duration and information content in immediate recall. Irish J Psychol 13(2):85\u201397","journal-title":"Irish J Psychol"},{"key":"1918_CR24","volume-title":"Eye tracking: a comprehensive guide to methods and measures","author":"K Holmqvist","year":"2011","unstructured":"Holmqvist K et al (2011) Eye tracking: a comprehensive guide to methods and measures. Oxford University Press, Oxford"},{"issue":"2","key":"1918_CR25","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1109\/THMS.2017.2754880","volume":"48","author":"J Currie","year":"2018","unstructured":"Currie J, Bond RR, McCullagh P, Black P, Finlay DD, Peace A (2018) Eye tracking the visual attention of nurses interpreting simulated vital signs scenarios: mining metrics to discriminate between performance level. IEEE Trans Hum Mach Syst 48(2):113\u2013124","journal-title":"IEEE Trans Hum Mach Syst"},{"key":"1918_CR26","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/j.ijmedinf.2017.03.001","volume":"105","author":"L McLaughlin","year":"2017","unstructured":"McLaughlin L, Bond R, Hughes C, McConnell J, McFadden S (2017) Computing eye gaze metrics for the automatic assessment of radiographer performance during X-ray image interpretation. Int J Med Inform 105:11\u201321","journal-title":"Int J Med Inform"},{"issue":"6","key":"1918_CR27","doi-asserted-by":"publisher","first-page":"895","DOI":"10.1016\/j.jelectrocard.2014.07.011","volume":"47","author":"RR Bond","year":"2014","unstructured":"Bond RR, Zhu T, Finlay DD, Drew B, Kligfield PD, Guldenring D, Breen C, Gallagher AG, Daly MJ, Clifford GD (2014) Assessing computerized eye tracking technology for gaining insight into expert interpretation of the 12-lead electrocardiogram: an objective quantitative approach. J Electrocardiol 47(6):895\u2013906","journal-title":"J Electrocardiol"},{"key":"1918_CR28","unstructured":"Bond RR, Finlay DD, Breen C, Boyd K, Nugent CD, Black ND, Macfarlane PW, Guldenring D (2012) Eye tracking in the assessment of electrocardiogram interpretation techniques. In: Computing in cardiology (CinC). IEEE, pp 581\u2013584"},{"key":"1918_CR29","doi-asserted-by":"publisher","first-page":"1121","DOI":"10.1007\/s11548-016-1391-6","volume":"11","author":"EB Mazomenos","year":"2016","unstructured":"Mazomenos EB, Chang P-L, Rippel RA, Rolls A, Hawkes DJ, Bicknell CD et al (2016) Catheter manipulation analysis for objective performance and technical skills assessment in transcatheter aortic valve implantation. Int J Comput Assist Radiol Surg 11:1121\u20131131","journal-title":"Int J Comput Assist Radiol Surg"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-019-01918-0\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-019-01918-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-019-01918-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,8,10]],"date-time":"2021-08-10T16:02:12Z","timestamp":1628611332000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-019-01918-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,7]]},"references-count":29,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2019,4,1]]}},"alternative-id":["1918"],"URL":"https:\/\/doi.org\/10.1007\/s11548-019-01918-0","relation":{},"ISSN":["1861-6410","1861-6429"],"issn-type":[{"value":"1861-6410","type":"print"},{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,2,7]]},"assertion":[{"value":"12 August 2018","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 January 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 February 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Ethical approval for this study was granted across the island of Ireland: (1) Ulster University (ref: FCEEFC 20160630), (2) University College Cork (ref: ECM 4 (g) 09\/08\/16).","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"All subjects received informed consent as approved by ethics committee.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}