{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,13]],"date-time":"2026-05-13T17:37:30Z","timestamp":1778693850127,"version":"3.51.4"},"reference-count":16,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2020,4,24]],"date-time":"2020-04-24T00:00:00Z","timestamp":1587686400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,4,24]],"date-time":"2020-04-24T00:00:00Z","timestamp":1587686400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000761","name":"Imperial College London","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100000761","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"published-print":{"date-parts":[[2020,5]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>In the last decade, there has been a great effort to bring mixed reality (MR) into the operating room to assist surgeons intraoperatively. However, progress towards this goal is still at an early stage. The aim of this paper is to propose a MR visualisation platform which projects multiple imaging modalities to assist intraoperative surgical guidance.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methodology<\/jats:title>\n                <jats:p>In this work, a MR visualisation platform has been developed for the Microsoft HoloLens. The platform contains three visualisation components, namely a 3D organ model, volumetric data, and tissue morphology captured with intraoperative imaging modalities. Furthermore, a set of novel interactive functionalities have been designed including scrolling through volumetric data and adjustment of the virtual objects\u2019 transparency. A pilot user study has been conducted to evaluate the usability of the proposed platform in the operating room. The participants were allowed to interact with the visualisation components and test the different functionalities. Each surgeon answered a questionnaire on the usability of the platform and provided their feedback and suggestions.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The analysis of the surgeons\u2019 scores showed that the 3D model is the most popular MR visualisation component and neurosurgery is the most relevant speciality for this platform. The majority of the surgeons found the proposed visualisation platform intuitive and would use it in their operating rooms for intraoperative surgical guidance. Our platform has several promising potential clinical applications, including vascular neurosurgery.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>The presented pilot study verified the potential of the proposed visualisation platform and its usability in the operating room. Our future work will focus on enhancing the platform by incorporating the surgeons\u2019 suggestions and conducting extensive evaluation on a large group of surgeons.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-020-02165-4","type":"journal-article","created":{"date-parts":[[2020,4,24]],"date-time":"2020-04-24T20:03:28Z","timestamp":1587758608000},"page":"819-826","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":63,"title":["Multimodal mixed reality visualisation for intraoperative surgical guidance"],"prefix":"10.1007","volume":"15","author":[{"given":"Jo\u00e3o","family":"Cartucho","sequence":"first","affiliation":[]},{"given":"David","family":"Shapira","sequence":"additional","affiliation":[]},{"given":"Hutan","family":"Ashrafian","sequence":"additional","affiliation":[]},{"given":"Stamatia","family":"Giannarou","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2020,4,24]]},"reference":[{"issue":"5","key":"2165_CR1","doi-asserted-by":"publisher","first-page":"706","DOI":"10.1097\/SLA.0000000000002448","volume":"266","author":"IM Sauer","year":"2017","unstructured":"Sauer IM, Queisner M, Tang P, Moosburner S, Hoepfner O, Horner R, Lohmann R, Pratschke J (2017) Mixed reality in visceral surgery: development of a suitable workflow and evaluation of intraoperative use-cases. Ann Surg 266(5):706\u2013712","journal-title":"Ann Surg"},{"issue":"5","key":"2165_CR2","doi-asserted-by":"publisher","first-page":"551","DOI":"10.1093\/ons\/opx279","volume":"15","author":"K Maruyama","year":"2018","unstructured":"Maruyama K, Watanabe E, Kin T, Saito K, Kumakiri A, Noguchi A, Nagane M, Shiokawa Y (2018) Smart glasses for neurosurgical navigation by augmented reality. Oper Neurosurg 15(5):551\u2013556","journal-title":"Oper Neurosurg"},{"issue":"suppl1","key":"2165_CR3","doi-asserted-by":"publisher","first-page":"S138","DOI":"10.1227\/NEU.0000000000000113","volume":"73","author":"FJ Bova","year":"2013","unstructured":"Bova FJ, Rajon DA, Friedman WA, Murad GJ, Hoh DJ, Jacob RP, Lampotang S, Lizdas DE, Lombard G, Lister JR (2013) Mixed-reality simulation for neurosurgical procedures. Neurosurgery 73(suppl1):S138\u2013S145","journal-title":"Neurosurgery"},{"issue":"1","key":"2165_CR4","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11596-019-1992-8","volume":"39","author":"H-Z Hu","year":"2019","unstructured":"Hu H-Z, Feng X-B, Shao Z-W, Xie M, Xu S, Wu X-H, Ye Z-W (2019) Application and prospect of mixed reality technology in medical field. Curr Med Sci 39(1):1\u20136","journal-title":"Curr Med Sci"},{"issue":"2","key":"2165_CR5","doi-asserted-by":"publisher","first-page":"98","DOI":"10.1016\/j.compmedimag.2013.01.009","volume":"37","author":"M Kersten-Oertel","year":"2013","unstructured":"Kersten-Oertel M, Jannin P, Collins DL (2013) The state of the art of visualization in mixed reality image guided surgery. Comput Med Imaging Graph 37(2):98\u2013112","journal-title":"Comput Med Imaging Graph"},{"issue":"8","key":"2165_CR6","doi-asserted-by":"publisher","first-page":"812","DOI":"10.1097\/MNM.0000000000000524","volume":"37","author":"NS van den Berg","year":"2016","unstructured":"van den Berg NS, Engelen T, Brouwer OR, Math\u00e9ron HM, Vald\u00e9s-Olmos RA, Nieweg OE, van Leeuwen FW (2016) A pilot study of spect\/ct-based mixed-reality navigation towards the sentinel node in patients with melanoma or merkel cell carcinoma of a lower extremity. Nuclear Med Commun 37(8):812\u2013817","journal-title":"Nuclear Med Commun"},{"issue":"5","key":"2165_CR7","doi-asserted-by":"publisher","first-page":"1066","DOI":"10.1097\/PRS.0000000000003802","volume":"140","author":"OM Tepper","year":"2017","unstructured":"Tepper OM, Rudy HL, Lefkowitz A, Weimer KA, Marks SM, Stern CS, Garfein ES (2017) Mixed reality with hololens: where virtual reality meets augmented reality in the operating room. Plast Reconstr Surg 140(5):1066\u20131070","journal-title":"Plast Reconstr Surg"},{"issue":"5","key":"2165_CR8","doi-asserted-by":"publisher","first-page":"480","DOI":"10.1080\/17453674.2018.1506974","volume":"89","author":"TM Gregory","year":"2018","unstructured":"Gregory TM, Gregory J, Sledge J, Allard R, Mir O (2018) Surgery guided by mixed reality: presentation of a proof of concept. Acta Orthop 89(5):480\u2013483","journal-title":"Acta Orthop"},{"key":"2165_CR9","doi-asserted-by":"publisher","first-page":"e422","DOI":"10.1016\/j.wneu.2018.06.208","volume":"118","author":"F Incekara","year":"2018","unstructured":"Incekara F, Smits M, Dirven C, Vincent A (2018) Clinical feasibility of a wearable mixed-reality device in neurosurgery. World Neurosurg 118:e422\u2013e427","journal-title":"World Neurosurg"},{"issue":"1","key":"2165_CR10","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1186\/s41747-017-0033-2","volume":"2","author":"P Pratt","year":"2018","unstructured":"Pratt P, Ives M, Lawton G, Simmons J, Radev N, Spyropoulou L, Amiras D (2018) Through the hololens\u2019 looking glass: augmented reality for extremity reconstruction surgery using 3d vascular models with perforating vessels. Eur Radiol Exp 2(1):2","journal-title":"Eur Radiol Exp"},{"key":"2165_CR11","first-page":"1","volume":"1","author":"Y Li","year":"2018","unstructured":"Li Y, Chen X, Wang N, Zhang W, Li D, Zhang L, Qu X, Cheng W, Xu Y, Chen W, Yang Q (2018) A wearable mixed-reality holographic computer for guiding external ventricular drain insertion at the bedside. J Neurosurg 1:1\u20138","journal-title":"J Neurosurg"},{"issue":"1","key":"2165_CR12","doi-asserted-by":"publisher","first-page":"298","DOI":"10.1097\/PRS.0000000000002307","volume":"138","author":"JC Sinkin","year":"2016","unstructured":"Sinkin JC, Rahman OF, Nahabedian MY (2016) Google glass in the operating room: the plastic surgeon perspective. Plast Reconstr Surg 138(1):298\u2013302","journal-title":"Plast Reconstr Surg"},{"issue":"6","key":"2165_CR13","doi-asserted-by":"publisher","first-page":"1195","DOI":"10.14733\/cadaps.2019.1195-1208","volume":"16","author":"L Bergonzi","year":"2019","unstructured":"Bergonzi L, Colombo G, Redaelli D, Lorusso M (2019) An augmented reality approach to visualize biomedical images. Comput-Aided Des Appl 16(6):1195\u20131208","journal-title":"Comput-Aided Des Appl"},{"key":"2165_CR14","doi-asserted-by":"publisher","first-page":"1045","DOI":"10.1007\/s10278-013-9622-7","volume":"26","author":"K Clark","year":"2013","unstructured":"Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F (2013) The cancer imaging archive (tcia): Maintaining and operating a public information repository. J Digital Imaging 26:1045\u20131057","journal-title":"J Digital Imaging"},{"key":"2165_CR15","unstructured":"James M, Ellison M (2019) Treatment of vascular dementia, Retrieved 1 Nov 2019, from https:\/\/www.brightfocus.org\/alzheimers\/article\/treatment-vascular-dementia"},{"key":"2165_CR16","unstructured":"Nischita (2019) Move, resize and rotate objects in your hololens apps. Retrieved 10 Aug 2019, from https:\/\/codeholo.com\/2018\/05\/06\/move-resize-and-rotate-objects-in-your-hololens-apps\/"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-020-02165-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-020-02165-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-020-02165-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,4,25]],"date-time":"2021-04-25T04:41:49Z","timestamp":1619325709000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-020-02165-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,24]]},"references-count":16,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2020,5]]}},"alternative-id":["2165"],"URL":"https:\/\/doi.org\/10.1007\/s11548-020-02165-4","relation":{},"ISSN":["1861-6410","1861-6429"],"issn-type":[{"value":"1861-6410","type":"print"},{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,4,24]]},"assertion":[{"value":"16 November 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"6 April 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 April 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Compliance with ethical standards"}},{"value":"Jo\u00e3o Cartucho, David Shapira, Hutan Ashrafian, and Stamatia Giannarou declare that they have no conflict of interest to disclose.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"All human and animal studies have been approved and performed in accordance with ethical standards.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"This article does not contain patient data.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}