{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,20]],"date-time":"2026-01-20T00:27:44Z","timestamp":1768868864503,"version":"3.49.0"},"reference-count":31,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2023,2,23]],"date-time":"2023-02-23T00:00:00Z","timestamp":1677110400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Imaging"],"abstract":"<jats:p>The \u201cRemote Interactive Surgery Platform\u201d (RISP) is an augmented reality (AR)-based platform for surgical telementoring. It builds upon recent advances of mixed reality head-mounted displays (MR-HMD) and associated immersive visualization technologies to assist the surgeon during an operation. It enables an interactive, real-time collaboration with a remote consultant by sharing the operating surgeon\u2019s field of view through the Microsoft (MS) HoloLens2 (HL2). Development of the RISP started during the Medical Augmented Reality Summer School 2021 and is currently still ongoing. It currently includes features such as three-dimensional annotations, bidirectional voice communication and interactive windows to display radiographs within the sterile field. This manuscript provides an overview of the RISP and preliminary results regarding its annotation accuracy and user experience measured with ten participants.<\/jats:p>","DOI":"10.3390\/jimaging9030056","type":"journal-article","created":{"date-parts":[[2023,2,24]],"date-time":"2023-02-24T02:32:12Z","timestamp":1677205932000},"page":"56","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Remote Interactive Surgery Platform (RISP): Proof of Concept for an Augmented-Reality-Based Platform for Surgical Telementoring"],"prefix":"10.3390","volume":"9","author":[{"given":"Yannik","family":"Kalbas","sequence":"first","affiliation":[{"name":"Department of Trauma Surgery and Harald-Tscherne Laboratory, University Hospital Zurich, Ramistr. 100, 8091 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hoijoon","family":"Jung","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Sydney, Camperdown, NSW 2006, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"John","family":"Ricklin","sequence":"additional","affiliation":[{"name":"Department of Trauma Surgery and Harald-Tscherne Laboratory, University Hospital Zurich, Ramistr. 100, 8091 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ge","family":"Jin","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Sydney, Camperdown, NSW 2006, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mingjian","family":"Li","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Sydney, Camperdown, NSW 2006, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4775-1103","authenticated-orcid":false,"given":"Thomas","family":"Rauer","sequence":"additional","affiliation":[{"name":"Department of Trauma Surgery and Harald-Tscherne Laboratory, University Hospital Zurich, Ramistr. 100, 8091 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2250-239X","authenticated-orcid":false,"given":"Shervin","family":"Dehghani","sequence":"additional","affiliation":[{"name":"TUM School of Computation, Information and Technology, Technische Universit\u00e4t M\u00fcnchen, 85748 M\u00fcnchen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nassir","family":"Navab","sequence":"additional","affiliation":[{"name":"TUM School of Computation, Information and Technology, Technische Universit\u00e4t M\u00fcnchen, 85748 M\u00fcnchen, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinman","family":"Kim","sequence":"additional","affiliation":[{"name":"School of Computer Science, University of Sydney, Camperdown, NSW 2006, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hans-Christoph","family":"Pape","sequence":"additional","affiliation":[{"name":"Department of Trauma Surgery and Harald-Tscherne Laboratory, University Hospital Zurich, Ramistr. 100, 8091 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6085-2315","authenticated-orcid":false,"given":"Sandro-Michael","family":"Heining","sequence":"additional","affiliation":[{"name":"Department of Trauma Surgery and Harald-Tscherne Laboratory, University Hospital Zurich, Ramistr. 100, 8091 Zurich, Switzerland"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,2,23]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1016\/j.ijoa.2015.09.006","article-title":"Global Surgery 2030: Evidence and solutions for achieving health, welfare, and economic development","volume":"25","author":"Meara","year":"2016","journal-title":"Int. J. Obstet. Anesth."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Wang, S., Parsons, M., Stone-McLean, J., Rogers, P., Boyd, S., Hoover, K., Meruvia-Pastor, O., Gong, M., and Smith, A. (2017). Augmented Reality as a Telemedicine Platform for Remote Procedural Training. Sens., 17.","DOI":"10.3390\/s17102294"},{"key":"ref_3","unstructured":"ITU Development (2018). Thematic Report: ICTs, LDCs and the SDGs\u2014Achieving Universal and Affordable Internet in the Least Developed Countries, ITU Development."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1177\/1553350618813250","article-title":"Telementoring of Surgeons: A Systematic Review","volume":"26","author":"Erridge","year":"2019","journal-title":"Surg. Innov."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1007\/s10439-020-02538-5","article-title":"A Wearable Augmented Reality Navigation System for Surgical Telementoring Based on Microsoft HoloLens","volume":"49","author":"Liu","year":"2021","journal-title":"Ann. Biomed. Eng."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Rojas-Mu\u00f1oz, E., Lin, C., Sanchez-Tamayo, N., Cabrera, M.E., Andersen, D., Popescu, V., Barragan, J.A., Zarzaur, B., Murphy, P., and Anderson, K. (2020). Evaluation of an augmented reality platform for austere surgical telementoring: A randomized controlled crossover study in cricothyroidotomies. NPJ Digit. Med., 3.","DOI":"10.1038\/s41746-020-0284-9"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Cofano, F., Di Perna, G., Bozzaro, M., Longo, A., Marengo, N., Zenga, F., Zullo, N., Cavalieri, M., Damiani, L., and Boges, D.J. (2021). Augmented Reality in Medical Practice: From Spine Surgery to Remote Assistance. Front. Surg., 8.","DOI":"10.3389\/fsurg.2021.657901"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Gasques, D., Johnson, J.G., Sharkey, T., Feng, Y., Wang, R., Xu, Z.R., Zavala, E., Zhang, Y., Xie, W., and Zhang, X. (2021, January 8\u201313). ARTEMIS: A Collaborative Mixed-Reality System for Immersive Surgical Telementoring. Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama, Japan.","DOI":"10.1145\/3411764.3445576"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"973","DOI":"10.1007\/s11701-021-01330-4","article-title":"Evaluating the ability of students to learn and utilize a novel telepresence platform, Proximie","volume":"16","author":"Patel","year":"2022","journal-title":"J. Robot Surg."},{"key":"ref_10","unstructured":"Microsoft (2021, September 13). Remote Assist. Available online: https:\/\/dynamics.microsoft.com\/en-us\/mixed-reality\/remote-assist\/."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Birlo, M., Edwards, P.J.E., Clarkson, M., and Stoyanov, D. (2022). Utility of optical see-through head mounted displays in augmented reality-assisted surgery: A systematic review. Med. Image Anal., 77.","DOI":"10.1016\/j.media.2022.102361"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"169","DOI":"10.4174\/jkss.2013.85.4.169","article-title":"The cutoff value of saphenous vein diameter to predict reflux","volume":"85","author":"Joh","year":"2013","journal-title":"J. Korean Surg. Soc."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Hughes, C.L., Fidopiastis, C., Stanney, K.M., Bailey, P.S., and Ruiz, E. (2020). The Psychometrics of Cybersickness in Augmented Reality. Front. Virtual Real., 1.","DOI":"10.3389\/frvir.2020.602954"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dennler, C., Bauer, D.E., Scheibler, A.-G., Spirig, J., G\u00f6tschi, T., F\u00fcrnstahl, P., and Farshad, M. (2021). Augmented reality in the operating room: A clinical feasibility study. BMC Musculoskelet. Disord., 22.","DOI":"10.1186\/s12891-021-04339-w"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1302\/2046-3758.63.BJR-2016-0289.R1","article-title":"Augmented reality in bone tumour resection: An experimental study","volume":"6","author":"Cho","year":"2017","journal-title":"Bone Joint. Res."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1109\/2945.817351","article-title":"The ball-pivoting algorithm for surface reconstruction","volume":"5","author":"Bernardini","year":"1999","journal-title":"IEEE Trans. Vis. Comput. Graph."},{"key":"ref_17","unstructured":"Microsoft (2021, September 14). Spatial Mapping. Available online: https:\/\/learn.microsoft.com\/en-us\/windows\/mixed-reality\/design\/spatial-mapping."},{"key":"ref_18","first-page":"282","article-title":"Evaluating the Microsoft HoloLens through an augmented reality assembly application","volume":"10197","author":"Evans","year":"2017","journal-title":"Degrad. Environ. Sens. Process. Disp."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1741","DOI":"10.1007\/s00170-020-05768-y","article-title":"Mitigation of the Microsoft HoloLens\u2019 hardware limitations for a controlled product assembly process","volume":"109","author":"Miller","year":"2020","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_20","first-page":"190","article-title":"Neurosurgical burr hole placement using the Microsoft HoloLens","volume":"10576","author":"Rae","year":"2018","journal-title":"Med. Imaging 2018: Image-Guided Proced. Robot. Interv. Model."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Sch\u00fctt, P., Schwarz, M., and Behnke, S. (2019). Semantic Interaction in Augmented Reality Environments for Microsoft Hololens, IEEE.","DOI":"10.1109\/ECMR.2019.8870937"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1823","DOI":"10.1007\/s00586-020-06495-4","article-title":"Use of augmented reality for image-guided spine procedures","volume":"29","author":"Gibby","year":"2020","journal-title":"Eur. Spine J."},{"key":"ref_23","first-page":"1","article-title":"Smart glasses display device for fluoroscopically guided minimally invasive spinal instrumentation surgery: A preliminary study","volume":"34","author":"Matsukawa","year":"2020","journal-title":"J. Neurosurg. Spine"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1080\/21681163.2020.1835556","article-title":"Feasibility of image-based augmented reality guidance of total shoulder arthroplasty using microsoft HoloLens 1","volume":"9","author":"Gu","year":"2021","journal-title":"Comput. Methods Biomech. Biomed. Eng. Imaging Vis."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1447","DOI":"10.1007\/s00402-020-03542-z","article-title":"Augmented reality for base plate component placement in reverse total shoulder arthroplasty: A feasibility study","volume":"141","author":"Kriechling","year":"2021","journal-title":"Arch. Orthop. Trauma Surg."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1553","DOI":"10.1007\/s11548-019-02035-8","article-title":"Co-localized augmented human and X-ray observers in collaborative surgical ecosystem","volume":"14","author":"Fotouhi","year":"2019","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"143","DOI":"10.1049\/htl.2018.5066","article-title":"Augmented reality-based feedback for technician-in-the-loop C-arm repositioning","volume":"5","author":"Unberath","year":"2018","journal-title":"Healthc. Technol. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jud, L., Fotouhi, J., Andronic, O., Aichmair, A., Osgood, G., Navab, N., and Farshad, M. (2020). Applicability of augmented reality in orthopedic surgery\u2014A systematic review. BMC Musculoskelet. Disord., 21.","DOI":"10.1186\/s12891-020-3110-2"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Condino, S., Turini, G., Parchi, P.D., Viglialoro, R.M., Piolanti, N., Gesi, M., Ferrari, M., and Ferrari, V. (2018). How to Build a Patient-Specific Hybrid Simulator for Orthopaedic Open Surgery: Benefits and Limits of Mixed-Reality Using the Microsoft HoloLens. J. Healthc. Eng., 2018.","DOI":"10.1155\/2018\/5435097"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1642","DOI":"10.1007\/s00268-015-3067-8","article-title":"Ethical Issues in the Introduction of New Technologies: From Mis to POEM","volume":"39","author":"Ferreres","year":"2015","journal-title":"World J. Surg."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Bichlmeier, C., Ockert, B., Heining, S.M., Ahmadi, A., and Navab, N. (2008, January 15\u201318). Stepping into the Operating Theater: ARAV\u2014Augmented Reality Aided Vertebroplasty. Proceedings of the 2008 7th IEEE\/ACM International Symposium on Mixed and Augmented Reality, Cambridge, UK.","DOI":"10.1109\/ISMAR.2008.4637348"}],"container-title":["Journal of Imaging"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/3\/56\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:41:01Z","timestamp":1760121661000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2313-433X\/9\/3\/56"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,2,23]]},"references-count":31,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2023,3]]}},"alternative-id":["jimaging9030056"],"URL":"https:\/\/doi.org\/10.3390\/jimaging9030056","relation":{},"ISSN":["2313-433X"],"issn-type":[{"value":"2313-433X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,2,23]]}}}