{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,7,15]],"date-time":"2025-07-15T03:48:04Z","timestamp":1752551284265,"version":"3.37.3"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T00:00:00Z","timestamp":1658448000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"SURGENT under the umbrella of University Medicine Zurich\/Hochschulmedizin Z\u00fcrich"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Musculoskelet Disord"],"published-print":{"date-parts":[[2022,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Background<\/jats:title>\n                <jats:p>Safe and accurate execution of surgeries to date mainly rely on preoperative plans generated based on preoperative imaging. Frequent intraoperative interaction with such patient images during the intervention is needed, which is currently a cumbersome process given that such images are generally displayed on peripheral two-dimensional (2D) monitors and controlled through interface devices that are outside the sterile filed. This study proposes a new medical image control concept based on a Brain Computer Interface (BCI) that allows for hands-free and direct image manipulation without relying on gesture recognition methods or voice commands.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Method<\/jats:title>\n                <jats:p>A software environment was designed for displaying three-dimensional (3D) patient images onto external monitors, with the functionality of hands-free image manipulation based on the user\u2019s brain signals detected by the BCI device (i.e., visually evoked signals). In a user study, ten orthopedic surgeons completed a series of standardized image manipulation tasks to navigate and locate predefined 3D points in a Computer Tomography (CT) image using the developed interface. Accuracy was assessed as the mean error between the predefined locations (ground truth) and the navigated locations by the surgeons. All surgeons rated the performance and potential intraoperative usability in a standardized survey using a five-point Likert scale (1\u2009=\u2009strongly disagree to 5\u2009=\u2009strongly agree).<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>When using the developed interface, the mean image control error was 15.51\u00a0mm (SD: 9.57). The user's acceptance was rated with a Likert score of 4.07 (SD: 0.96) while the overall impressions of the interface was rated as 3.77 (SD: 1.02) by the users. We observed a significant correlation between the users' overall impression and the calibration score they achieved.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusions<\/jats:title>\n                <jats:p>The use of the developed BCI, that allowed for a purely brain-guided medical image control, yielded promising results, and showed its potential for future intraoperative applications. The major limitation to overcome was noted as the interaction delay.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1186\/s12891-022-05384-9","type":"journal-article","created":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T10:03:14Z","timestamp":1658484194000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Introducing a brain-computer interface to facilitate intraoperative medical imaging control \u2013 a feasibility study"],"prefix":"10.1186","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2572-1798","authenticated-orcid":false,"given":"Hooman","family":"Esfandiari","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Pascal","family":"Troxler","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sandro","family":"Hodel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Daniel","family":"Suter","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mazda","family":"Farshad","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"name":"Collaboration Group","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nicola","family":"Cavalcanti","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oliver","family":"Wetzel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sylvano","family":"Mania","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Frederic","family":"Cornaz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Farah","family":"Selman","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Method","family":"Kabelitz","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Christoph","family":"Zindel","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sabrina","family":"Weber","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Samuel","family":"Haupt","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Philipp","family":"F\u00fcrnstahl","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2022,7,22]]},"reference":[{"key":"5384_CR1","first-page":"267","volume":"119","author":"W Korb","year":"2006","unstructured":"Korb W, Bohn S, Burgert O, Dietz A, Jacobs S, Falk V, et al. Surgical PACS for the Digital Operating Room. Systems Engineering and Specification of User Requirements. Stud Health Technol Inform. 2006;119:267\u201372.","journal-title":"Stud Health Technol Inform"},{"issue":"2","key":"5384_CR2","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1016\/j.ejrad.2010.05.030","volume":"78","author":"HU Lemke","year":"2011","unstructured":"Lemke HU, Berliner L. PACS for surgery and interventional radiology: Features of a Therapy Imaging and Model Management System (TIMMS). Eur J Radiol. 2011;78(2):239\u201342.","journal-title":"Eur J Radiol"},{"key":"5384_CR3","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1016\/j.ics.2005.03.279","volume":"1281","author":"K Cleary","year":"2005","unstructured":"Cleary K, Kinsella A, Mun SK. OR 2020 Workshop Report: Operating Room of the Future. Int Congr Ser. 2005;1281:832\u20138.","journal-title":"Int Congr Ser"},{"key":"5384_CR4","doi-asserted-by":"publisher","unstructured":"Watts I, Boulanger P, Kawchuk G.\u00a0ProjectDR: augmented reality system for displaying medical images directly onto a patient. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology (VRST '17).\u00a0New York: Association for Computing Machinery; 2017. Article 70, 1\u20132.\u00a0https:\/\/doi.org\/10.1145\/3139131.3141198.","DOI":"10.1145\/3139131.3141198"},{"issue":"1","key":"5384_CR5","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1023\/B:JOCM.0000025279.27084.39","volume":"18","author":"B Hartmann","year":"2003","unstructured":"Hartmann B, Benson M, Junger A, Quinzio L, R\u00f6hrig R, Fengler B, et al. Computer Keyboard and Mouse as a Reservoir of Pathogens in an Intensive Care Unit. J Clin Monit Comput. 2003;18(1):7\u201312.","journal-title":"J Clin Monit Comput"},{"key":"5384_CR6","doi-asserted-by":"publisher","unstructured":"Johnson R, O\u2019Hara K, Sellen A, Cousins C, Criminisi A.\u00a0Exploring the potential for touchless interaction in image-guided 10.1186\/s12891-022-05384-9 interventional radiology. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11).\u00a0New York: Association for Computing Machinery; 2011. p 3323\u20133332.\u00a0https:\/\/doi.org\/10.1145\/1978942.1979436.","DOI":"10.1145\/1978942.1979436"},{"issue":"1","key":"5384_CR7","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1145\/2541883.2541899","volume":"57","author":"K O\u2019Hara","year":"2014","unstructured":"O\u2019Hara K, Gonzalez G, Sellen A, Penney G, Varnavas A, Mentis H, et al. Touchless Interaction in Surgery. Commun ACM. 2014;57(1):70\u20137.","journal-title":"Commun ACM"},{"issue":"2","key":"5384_CR8","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1145\/1897816.1897838","volume":"54","author":"JP Wachs","year":"2011","unstructured":"Wachs JP, K\u00f6lsch M, Stern H, Edan Y. Vision-Based Hand-Gesture Applications. Commun ACM. 2011;54(2):60\u201371.","journal-title":"Commun ACM"},{"issue":"3","key":"5384_CR9","first-page":"245","volume":"12","author":"C Gr\u00e4tzel","year":"2004","unstructured":"Gr\u00e4tzel C, Fong T, Grange S, Baur C. A Non-Contact Mouse for Surgeon-Computer Interaction. Technol Health Care Off J Eur Soc Eng Med. 2004;12(3):245\u201357.","journal-title":"Technol Health Care Off J Eur Soc Eng Med"},{"issue":"3","key":"5384_CR10","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1197\/jamia.M2410","volume":"15","author":"JP Wachs","year":"2008","unstructured":"Wachs JP, Stern HI, Edan Y, Gillam M, Handler J, Feied C, et al. A Gesture-based Tool for Sterile Browsing of Radiology Images. J Am Med Inform Assoc JAMIA. 2008;15(3):321\u20133.","journal-title":"J Am Med Inform Assoc JAMIA"},{"key":"5384_CR11","doi-asserted-by":"publisher","first-page":"140","DOI":"10.1016\/j.jbi.2017.07.009","volume":"72","author":"DS Lopes","year":"2017","unstructured":"Lopes DS, Parreira PD De F, Paulo SF, Nunes V, Rego PA, Neves MC, et al. On the Utility of 3D Hand Cursors to Explore Medical Volume Datasets with a Touchless Interface. J Biomed Inform. 2017;72:140\u20139.","journal-title":"J Biomed Inform"},{"key":"5384_CR12","doi-asserted-by":"publisher","first-page":"196","DOI":"10.1016\/j.patrec.2013.05.024","volume":"36","author":"MG Jacob","year":"2014","unstructured":"Jacob MG, Wachs JP. Context-Based Hand Gesture Recognition for the Operating Room. Pattern Recogn Lett. 2014;36:196\u2013203.","journal-title":"Pattern Recogn Lett"},{"issue":"3","key":"5384_CR13","doi-asserted-by":"publisher","first-page":"301","DOI":"10.1177\/1553350611425508","volume":"19","author":"LC Ebert","year":"2012","unstructured":"Ebert LC, Hatch G, Ampanozi G, Thali MJ, Ross S. You Can\u2019t Touch This: Touch-free Navigation Through Radiological Images. Surg Innov. 2012;19(3):301\u20137.","journal-title":"Surg Innov"},{"issue":"3","key":"5384_CR14","doi-asserted-by":"publisher","first-page":"E1","DOI":"10.1503\/cjs.035311","volume":"56","author":"M Strickland","year":"2013","unstructured":"Strickland M, Tremaine J, Brigley G, Law C. Using a Depth-Sensing Infrared Camera System to Access and Manipulate Medical Imaging from Within the Sterile Operating Field. Can J Surg J Can Chir. 2013;56(3):E1\u20136.","journal-title":"Can J Surg J Can Chir"},{"key":"5384_CR15","doi-asserted-by":"publisher","unstructured":"Tan JH, Chao C, Zawaideh M, Roberts AC, Kinney TB.\u00a0Informatics in Radiology: developing a touchless user interface for intraoperative image control during interventional radiology procedures. Radiographics. 2013 Mar-Apr;33(2):E61\u201370.\u00a0 https:\/\/doi.org\/10.1148\/rg.332125101","DOI":"10.1148\/rg.332125101"},{"key":"5384_CR16","doi-asserted-by":"publisher","first-page":"103316","DOI":"10.1016\/j.jbi.2019.103316","volume":"100","author":"SF Paulo","year":"2019","unstructured":"Paulo SF, Relvas F, Nicolau H, Rekik Y, Machado V, Botelho J, et al. Touchless Interaction with Medical Images Based on 3D Hand Cursors Supported by Single-Foot Input: A Case Study in Dentistry. J Biomed Inform. 2019;100:103316.","journal-title":"J Biomed Inform"},{"issue":"3","key":"5384_CR17","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1145\/1744161.1744163","volume":"17","author":"DA Norman","year":"2010","unstructured":"Norman DA. Natural User Interfaces are Not Natural. Interactions. 2010;17(3):6\u201310.","journal-title":"Interactions"},{"key":"5384_CR18","doi-asserted-by":"crossref","unstructured":"MA M, Fallavollita P, Habert S, Weidert S, Navab N. Device- and System-Independent Personal Touchless User Interface for Operating Rooms. Int J Comput Assist Radiol Surg 2016;11(6):853\u2013861.","DOI":"10.1007\/s11548-016-1375-6"},{"key":"5384_CR19","volume-title":"Touchless Measurement of Medical Image Data for Interventional Support. 2017-Tagungsband","author":"P Saalfeld","year":"2017","unstructured":"Saalfeld P, Kasper D, Preim B, Hansen C. Touchless Measurement of Medical Image Data for Interventional Support. 2017-Tagungsband; 2017."},{"issue":"2","key":"5384_CR20","doi-asserted-by":"publisher","first-page":"155","DOI":"10.5624\/isd.2014.44.2.155","volume":"44","author":"GM Rosa","year":"2014","unstructured":"Rosa GM, Elizondo ML. Use of a Gesture User Interface as a Touchless Image Navigation System in Dental Surgery: Case Series Report. Imaging Sci Dent. 2014;44(2):155\u201360.","journal-title":"Imaging Sci Dent"},{"key":"5384_CR21","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1007\/978-3-642-23623-5_17","volume-title":"Medical Image Computing and Computer-Assisted Intervention \u2013 MICCAI 2011","author":"LA Schwarz","year":"2011","unstructured":"Schwarz LA, Bigdelou A, Navab N. Learning Gestures for Customizable Human-Computer Interaction in the Operating Room. In: Fichtinger G, Martel A, Peters T, editors. Medical Image Computing and Computer-Assisted Intervention \u2013 MICCAI 2011. Berlin, Heidelberg: Springer Berlin Heidelberg; 2011. p. 129\u201336. (Lecture Notes in Computer Science; vol. 6891)."},{"key":"5384_CR22","doi-asserted-by":"publisher","unstructured":"Giv MD, Sani KG, Alizadeh M, Valinejadi A, Majdabadi HA.\u00a0Evaluation of noise pollution level in the operating rooms of hospitals: A study in Iran. Interv Med Appl Sci. 2017;9(2):61\u201366. https:\/\/doi.org\/10.1556\/1646.9.2017.2.15.","DOI":"10.1556\/1646.9.2017.2.15"},{"issue":"6","key":"5384_CR23","doi-asserted-by":"publisher","first-page":"767","DOI":"10.1016\/S1388-2457(02)00057-3","volume":"113","author":"JR Wolpaw","year":"2002","unstructured":"Wolpaw JR, Birbaumer N, McFarland DJ, Pfurtscheller G, Vaughan TM. Brain\u2013Computer Interfaces for Communication and Control. Clin Neurophysiol. 2002;113(6):767\u201391.","journal-title":"Clin Neurophysiol"},{"key":"5384_CR24","doi-asserted-by":"publisher","unstructured":"Aznan NKN, Bonner S, Connolly JD, Moubayed NA, Breckon TP.\u00a0\"On the Classification of SSVEP-Based Dry-EEG Signals via Convolutional Neural Networks,\" 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).2018 p. 3726\u20133731. https:\/\/doi.org\/10.1109\/SMC.2018.00631.","DOI":"10.1109\/SMC.2018.00631"},{"issue":"6","key":"5384_CR25","doi-asserted-by":"publisher","first-page":"3366","DOI":"10.1109\/JSEN.2019.2958210","volume":"20","author":"P Autthasan","year":"2020","unstructured":"Autthasan P, Du X, Arnin J, Lamyai S, Perera M, Itthipuripat S, et al. A Single-Channel Consumer-Grade EEG Device for Brain-Computer Interface: Enhancing Detection of SSVEP and Its Amplitude Modulation. IEEE Sensors J. 2020;20(6):3366\u201378.","journal-title":"IEEE Sensors J"},{"issue":"1","key":"5384_CR26","doi-asserted-by":"publisher","first-page":"14708","DOI":"10.1038\/s41598-018-32283-8","volume":"8","author":"X Xing","year":"2018","unstructured":"Xing X, Wang Y, Pei W, Guo X, Liu Z, Wang F, et al. A High-Speed SSVEP-Based BCI Using Dry EEG Electrodes. Sci Rep. 2018;8(1):14708.","journal-title":"Sci Rep"},{"key":"5384_CR27","doi-asserted-by":"publisher","unstructured":"Rashid M, Sulaiman N, PP Abdul Majeed A, Musa RM, Ab. Nasir AF, Bari BS.\u00a0Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review. Front Neurorobot. 2020;14:25\u00a0https:\/\/doi.org\/10.3389\/fnbot.2020.00025.","DOI":"10.3389\/fnbot.2020.00025"},{"issue":"2","key":"5384_CR28","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.3390\/s120201211","volume":"12","author":"LF Nicolas-Alonso","year":"2012","unstructured":"Nicolas-Alonso LF, Gomez-Gil J. Brain Computer Interfaces, a Review. Sensors. 2012;12(2):1211\u201379.","journal-title":"Sensors"},{"key":"5384_CR29","doi-asserted-by":"crossref","unstructured":"Bockbrader MA, Francisco G, Lee R, Olson J, Solinsky R, Boninger ML. Brain Computer Interfaces in Rehabilitation Medicine. PM&R. 2018;10(9S2):S233\u201343.","DOI":"10.1016\/j.pmrj.2018.05.028"},{"key":"5384_CR30","doi-asserted-by":"publisher","unstructured":"Sebasti\u00e1n-Romagosa M, Cho W, Ortner R, Murovec N, Von Oertzen T, Kamada K, et al.\u00a0Brain Computer Interface Treatment for Motor Rehabilitation of Upper Extremity of Stroke Patients-A Feasibility Study. Front Neurosci. 2020;14:591435.\u00a0https:\/\/doi.org\/10.3389\/fnins.2020.591435.","DOI":"10.3389\/fnins.2020.591435"},{"issue":"4","key":"5384_CR31","doi-asserted-by":"publisher","first-page":"255","DOI":"10.1136\/bjo.74.4.255-a","volume":"74","author":"NR Galloway","year":"1990","unstructured":"Galloway NR. Human Brain Electrophysiology: Evoked Potentials and Evoked Magnetic Fields in Science and Medicine. Br J Ophthalmol. 1990;74(4):255.","journal-title":"Br J Ophthalmol"},{"issue":"2","key":"5384_CR32","doi-asserted-by":"publisher","first-page":"234","DOI":"10.1109\/TNSRE.2006.875576","volume":"14","author":"Y Wang","year":"2006","unstructured":"Wang Y, Wang R, Gao X, Hong B, Gao S. A Practical VEP-Based Brain-Computer Interface. IEEE Trans Neural Syst Rehabil Eng Publ IEEE Eng Med Biol Soc. 2006;14(2):234\u20139.","journal-title":"IEEE Trans Neural Syst Rehabil Eng Publ IEEE Eng Med Biol Soc"},{"key":"5384_CR33","unstructured":"Kouider S, Zerafa R, Steinmetz N, Barascud N. Brain-Computer Interface. WO2021140247A1. 2021."}],"container-title":["BMC Musculoskeletal Disorders"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12891-022-05384-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s12891-022-05384-9\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s12891-022-05384-9.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,7,22]],"date-time":"2022-07-22T10:04:19Z","timestamp":1658484259000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcmusculoskeletdisord.biomedcentral.com\/articles\/10.1186\/s12891-022-05384-9"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,22]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2022,12]]}},"alternative-id":["5384"],"URL":"https:\/\/doi.org\/10.1186\/s12891-022-05384-9","relation":{},"ISSN":["1471-2474"],"issn-type":[{"type":"electronic","value":"1471-2474"}],"subject":[],"published":{"date-parts":[[2022,7,22]]},"assertion":[{"value":"29 December 2021","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"29 April 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 July 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"According to our national institutional guidelines, ethical approval from the respective ethics committee (Cantonal Ethics Committee of Zurich) was not required for this study as it included medical professionals who consented to participate. These experiments did not fall under the umbrella of the Human Research Act (HRA, ) and according to the same guidelines, oral consent was obtained from the participants of the user study. The human CT scan used in this study was acquired from an anonymized public dataset available at as a sample dataset in the 3D Slicer software ().","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical Approval and Consent to Participate"}},{"value":"Not applicable.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent for Publication"}},{"value":"The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}],"article-number":"701"}}