{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T17:45:47Z","timestamp":1792863947046,"version":"4.5.0"},"reference-count":35,"publisher":"MDPI AG","issue":"14","license":[{"start":{"date-parts":[[2022,7,17]],"date-time":"2022-07-17T00:00:00Z","timestamp":1658016000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health (NIH)","doi-asserted-by":"publisher","award":["R01EB020667"],"award-info":[{"award-number":["R01EB020667"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Mitacs Globalink Research Award (GRA)","award":["R01EB020667"],"award-info":[{"award-number":["R01EB020667"]}]},{"name":"Johns Hopkins University internal funds","award":["R01EB020667"],"award-info":[{"award-number":["R01EB020667"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Developing image-guided robotic systems requires access to flexible, open-source software. For image guidance, the open-source medical imaging platform 3D Slicer is one of the most adopted tools that can be used for research and prototyping. Similarly, for robotics, the open-source middleware suite robot operating system (ROS) is the standard development framework. In the past, there have been several \u201cad hoc\u201d attempts made to bridge both tools; however, they are all reliant on middleware and custom interfaces. Additionally, none of these attempts have been successful in bridging access to the full suite of tools provided by ROS or 3D Slicer. Therefore, in this paper, we present the SlicerROS2 module, which was designed for the direct use of ROS2 packages and libraries within 3D Slicer. The module was developed to enable real-time visualization of robots, accommodate different robot configurations, and facilitate data transfer in both directions (between ROS and Slicer). We demonstrate the system on multiple robots with different configurations, evaluate the system performance and discuss an image-guided robotic intervention that can be prototyped with this module. This module can serve as a starting point for clinical system development that reduces the need for custom interfaces and time-intensive platform setup.<\/jats:p>","DOI":"10.3390\/s22145336","type":"journal-article","created":{"date-parts":[[2022,7,18]],"date-time":"2022-07-18T01:53:22Z","timestamp":1658109202000},"page":"5336","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Bridging 3D Slicer and ROS2 for Image-Guided Robotic Interventions"],"prefix":"10.3390","volume":"22","author":[{"given":"Laura","family":"Connolly","sequence":"first","affiliation":[{"name":"Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"},{"name":"School of Computing, Queen\u2019s University, Kingston, ON K7L 3N6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Anton","family":"Deguet","sequence":"additional","affiliation":[{"name":"Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6429-4755","authenticated-orcid":false,"given":"Simon","family":"Leonard","sequence":"additional","affiliation":[{"name":"Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2358-7484","authenticated-orcid":false,"given":"Junichi","family":"Tokuda","sequence":"additional","affiliation":[{"name":"Brigham and Women\u2019s Hospital, Boston, MA 02115, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4743-0609","authenticated-orcid":false,"given":"Tamas","family":"Ungi","sequence":"additional","affiliation":[{"name":"School of Computing, Queen\u2019s University, Kingston, ON K7L 3N6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Axel","family":"Krieger","sequence":"additional","affiliation":[{"name":"Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6117-5467","authenticated-orcid":false,"given":"Peter","family":"Kazanzides","sequence":"additional","affiliation":[{"name":"Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Parvin","family":"Mousavi","sequence":"additional","affiliation":[{"name":"School of Computing, Queen\u2019s University, Kingston, ON K7L 3N6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6354-262X","authenticated-orcid":false,"given":"Gabor","family":"Fichtinger","sequence":"additional","affiliation":[{"name":"School of Computing, Queen\u2019s University, Kingston, ON K7L 3N6, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Russell H.","family":"Taylor","sequence":"additional","affiliation":[{"name":"Whiting School of Engineering, Johns Hopkins University, Baltimore, MD 21218, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,7,17]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1016\/j.athoracsur.2005.08.030","article-title":"Experience with the \u201cda Vinci\u201d robotic system for thymectomy in patients with myasthenia gravis: Report of 33 cases","volume":"81","author":"Rea","year":"2006","journal-title":"Ann. Thorac. Surg."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1201","DOI":"10.1177\/02783649922067807","article-title":"A steady-hand robotic system for microsurgical augmentation","volume":"18","author":"Taylor","year":"1999","journal-title":"Int. J. Robot. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1146\/annurev-bioeng-060418-052502","article-title":"Frontiers of medical robotics: From concept to systems to clinical translation","volume":"21","author":"Troccaz","year":"2019","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"DiMaio, S., Hanuschik, M., and Kreaden, U. (2011). The da Vinci surgical system. Surgical Robotics, Springer.","DOI":"10.1007\/978-1-4419-1126-1_9"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"2043","DOI":"10.1007\/s00402-021-04208-0","article-title":"The MAKO robotic-arm knee arthroplasty system","volume":"141","author":"Roche","year":"2021","journal-title":"Arch. Orthop. Trauma Surg."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"433","DOI":"10.1177\/153303461000900502","article-title":"The CyberKnife\u00ae robotic radiosurgery system in 2010","volume":"9","author":"Kilby","year":"2010","journal-title":"Technol. Cancer Res. Treat."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1146\/annurev-bioeng-070909-105249","article-title":"Image-guided interventions: Technology review and clinical applications","volume":"12","author":"Cleary","year":"2010","journal-title":"Annu. Rev. Biomed. Eng."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"501","DOI":"10.1007\/s00423-013-1059-4","article-title":"Navigation in surgery","volume":"398","author":"Mezger","year":"2013","journal-title":"Langenbeck\u2019s Arch. Surg."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"600","DOI":"10.1109\/TBME.2015.2466591","article-title":"Navigated breast tumor excision using electromagnetically tracked ultrasound and surgical instruments","volume":"63","author":"Ungi","year":"2015","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_10","first-page":"29","article-title":"Total knee replacement with iASSIST navigation system","volume":"24","author":"Lo","year":"2018","journal-title":"J. Orthop. Trauma Rehabil."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1451","DOI":"10.1007\/s11548-017-1618-1","article-title":"ROS-IGTL-Bridge: An open network interface for image-guided therapy using the ROS environment","volume":"12","author":"Frank","year":"2017","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1097\/MOU.0b013e32834d4ce5","article-title":"Image-guided robotic surgery: Update on research and potential applications in urologic surgery","volume":"22","author":"Herrell","year":"2012","journal-title":"Curr. Opin. Urol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.procs.2015.09.115","article-title":"The optimization of intelligent control interfaces using Versatile Intelligent Portable Robot Platform","volume":"65","author":"Vladareanu","year":"2015","journal-title":"Procedia Comput. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Berger, E., Wheeler, R., and Ng, A.Y. (2009, January 12\u201317). ROS: An open-source Robot Operating System. Proceedings of the ICRA Workshop on Open Source Software, Kobe, Japan.","DOI":"10.1109\/MRA.2010.936956"},{"key":"ref_15","unstructured":"Chen, Z., Deguet, A., Vozar, S., Munawar, A., Fischer, G., and Kazanzides, P. (2015, January 26\u201330). Interfacing the da Vinci Research Kit (dVRK) with the Robot Operating System (ROS). Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"285","DOI":"10.1007\/s11548-014-1081-1","article-title":"OpenIGTLink interface for state control and visualisation of a robot for image-guided therapy systems","volume":"10","author":"Tauscher","year":"2015","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.media.2016.06.011","article-title":"Open-source platforms for navigated image-guided interventions","volume":"33","author":"Ungi","year":"2016","journal-title":"Med. Image Anal."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Pieper, S., Halle, M., and Kikinis, R. (2004, January 15\u201318). 3D Slicer. Proceedings of the 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821), Arlington, VA, USA.","DOI":"10.1109\/ISBI.2004.1398617"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Kikinis, R., and Pieper, S. (September, January 30). 3D Slicer as a tool for interactive brain tumor segmentation. Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Boston, MA, USA.","DOI":"10.1109\/IEMBS.2011.6091765"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"531","DOI":"10.1007\/s11548-017-1684-4","article-title":"Real-time wireless tumor tracking during breast conserving surgery","volume":"13","author":"Janssen","year":"2018","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1023\/B:NEON.0000033364.43142.bf","article-title":"Volume reconstruction techniques improve the correlation between histological and in vivo tumor volume measurements in mouse models of human gliomas","volume":"68","author":"Schmidt","year":"2004","journal-title":"J. Neuro-Oncol."},{"key":"ref_22","first-page":"410","article-title":"DeepInfer: Open-source deep learning deployment toolkit for image-guided therapy","volume":"Volume 10135","author":"Mehrtash","year":"2017","journal-title":"Proceedings of the Medical Imaging 2017: Image-Guided Procedures, Robotic Interventions, and Modeling"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"423","DOI":"10.1002\/rcs.274","article-title":"OpenIGTLink: An open network protocol for image-guided therapy environment","volume":"5","author":"Tokuda","year":"2009","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Connolly, L., Deguet, A., Sunderland, K., Lasso, A., Ungi, T., Rudan, J.F., Taylor, R.H., Mousavi, P., and Fichtinger, G. (2021, January 11\u201313). An open-source platform for cooperative, semi-autonomous robotic surgery. Proceedings of the 2021 IEEE International Conference on Autonomous Systems (ICAS), Montreal, QC, Canada.","DOI":"10.1109\/ICAS49788.2021.9551149"},{"key":"ref_25","unstructured":"Klotzb\u00fccher, M., Soetens, P., and Bruyninckx, H. (2010, January 15\u201318). Orocos RTT-Lua: An execution environment for building real-time robotic domain specific languages. Proceedings of the International Workshop on Dynamic languages for Robotic and Sensors, Darmstadt, Germany."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Stavrinos, G. (2021). ROS2 For ROS1 Users. Robot Operating System (ROS), Springer.","DOI":"10.1007\/978-3-030-45956-7_2"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gering, D.T., Nabavi, A., Kikinis, R., Grimson, W.E.L., Hata, N., Everett, P., Jolesz, F., and Wells, W.M. (1999, January 19\u201322). An integrated visualization system for surgical planning and guidance using image fusion and interventional imaging. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Cambridge, UK.","DOI":"10.1007\/10704282_88"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Foote, T. (2013, January 22\u201323). tf: The transform library. Proceedings of the 2013 IEEE Conference on Technologies for Practical Robot Applications (TePRA), Woburn, MA, USA.","DOI":"10.1109\/TePRA.2013.6556373"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Kunze, L., Roehm, T., and Beetz, M. (2011, January 9\u201313). Towards semantic robot description languages. Proceedings of the 2011 IEEE International Conference on Robotics and Automation, Shanghai, China.","DOI":"10.1109\/ICRA.2011.5980170"},{"key":"ref_30","unstructured":"Kazanzides, P., Chen, Z., Deguet, A., Fischer, G.S., Taylor, R.H., and DiMaio, S.P. (June, January 31). An open-source research kit for the da Vinci\u00ae Surgical System. Proceedings of the IEEE International Conference on Robotics and Automation, Hong Kong, China."},{"key":"ref_31","unstructured":"Fontanelli, G., Ficuciello, F., Villani, L., and Siciliano, B. (2017, January 24\u201328). Da Vinci research kit: PSM and MTM dynamic modelling. Proceedings of the IROS Workshop on Shared Platforms for Medical Robotics Research, Vancouver, BC, Canada."},{"key":"ref_32","unstructured":"Li, M., and Taylor, R.H. (2005, January 18\u201322). Performance of surgical robots with automatically generated spatial virtual fixtures. Proceedings of the 2005 IEEE International Conference on Robotics and Automation, Barcelona, Spain."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1438","DOI":"10.1056\/NEJMoa1600249","article-title":"Breast-cancer tumor size, overdiagnosis, and mammography screening effectiveness","volume":"375","author":"Welch","year":"2016","journal-title":"N. Engl. J. Med."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"D\u2019Ettorre, C., Mariani, A., Stilli, A., Valdastri, P., Deguet, A., Kazanzides, P., Taylor, R.H., Fischer, G.S., DiMaio, S.P., and Menciassi, A. (2021). Accelerating surgical robotics research: Reviewing 10 years of research with the dvrk. arXiv.","DOI":"10.1109\/MRA.2021.3101646"},{"key":"ref_35","unstructured":"Attig, C., Rauh, N., Franke, T., and Krems, J.F. (, January 9\u201314). System latency guidelines then and now\u2014Is zero latency really considered necessary?. Proceedings of the International Conference on Engineering Psychology and Cognitive Ergonomics, Vancouver, BC, Canada."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5336\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T23:52:16Z","timestamp":1760140336000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/14\/5336"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,7,17]]},"references-count":35,"journal-issue":{"issue":"14","published-online":{"date-parts":[[2022,7]]}},"alternative-id":["s22145336"],"URL":"https:\/\/doi.org\/10.3390\/s22145336","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,17]]}}}