{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,25]],"date-time":"2026-07-25T16:02:05Z","timestamp":1784995325566,"version":"3.55.0"},"reference-count":27,"publisher":"Springer Science and Business Media LLC","issue":"6","license":[{"start":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T00:00:00Z","timestamp":1741737600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T00:00:00Z","timestamp":1741737600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100005713","name":"Technische Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005713","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:sec>\n            <jats:title>Purpose<\/jats:title>\n            <jats:p>The multi-modality imaging system offers optimal fused images for safe and precise interventions in modern clinical practices, such as computed tomography-ultrasound (CT-US) guidance for needle insertion. However, the limited dexterity and mobility of current imaging devices hinder their integration into standardized workflows and the advancement toward fully autonomous intervention systems. In this paper, we present a novel clinical setup where robotic cone beam computed tomography (CBCT) and robotic US are pre-calibrated and dynamically co-registered, enabling new clinical applications. This setup allows registration-free rigid registration, facilitating multi-modal guided procedures in the absence of tissue deformation.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Methods<\/jats:title>\n            <jats:p>First, a one-time pre-calibration is performed between the systems. To ensure a safe insertion path by highlighting critical vasculature on the 3D CBCT, SAM2 segments vessels from B-mode images, using the Doppler signal as an autonomously generated prompt. Based on the registration, the Doppler image or segmented vessel masks are then mapped onto the CBCT, creating an optimally fused image with comprehensive detail. To validate the system, we used a specially designed phantom, featuring lesions covered by ribs and multiple vessels with simulated moving flow.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Results<\/jats:title>\n            <jats:p>The mapping error between US and CBCT resulted in an average deviation of <jats:inline-formula>\n                <jats:alternatives>\n                  <jats:tex-math>$$1.72\\pm 0.62$$<\/jats:tex-math>\n                  <mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mn>1.72<\/mml:mn>\n                      <mml:mo>\u00b1<\/mml:mo>\n                      <mml:mn>0.62<\/mml:mn>\n                    <\/mml:mrow>\n                  <\/mml:math>\n                <\/jats:alternatives>\n              <\/jats:inline-formula> mm. A user study demonstrated the effectiveness of CBCT-US fusion for needle insertion guidance, showing significant improvements in time efficiency, accuracy, and success rate. Needle intervention performance improved by approximately 50% compared to the conventional US-guided workflow.<\/jats:p>\n          <\/jats:sec>\n          <jats:sec>\n            <jats:title>Conclusion<\/jats:title>\n            <jats:p>We present the first robotic dual-modality imaging system designed to guide clinical applications. The results show significant performance improvements compared to traditional manual interventions.\n<\/jats:p>\n          <\/jats:sec>","DOI":"10.1007\/s11548-025-03336-x","type":"journal-article","created":{"date-parts":[[2025,3,12]],"date-time":"2025-03-12T12:06:11Z","timestamp":1741781171000},"page":"1049-1057","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":8,"title":["Robotic CBCT meets robotic ultrasound"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2717-8274","authenticated-orcid":false,"given":"Feng","family":"Li","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuan","family":"Bi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dianye","family":"Huang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongliang","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nassir","family":"Navab","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,3,12]]},"reference":[{"key":"3336_CR1","doi-asserted-by":"crossref","unstructured":"Gardiazabal J, Esposito M, Matthies P, Okur A, Vogel J, Kraft S, Frisch B, Lasser T, Navab N (2014) Towards personalized interventional spect-ct imaging. In: Medical image computing and computer-assisted intervention\u2014MICCAI 2014: 17th international conference, Boston, MA, USA, September 14\u201318, 2014, Proceedings, Part I 17, pp 504\u2013511. Springer","DOI":"10.1007\/978-3-319-10404-1_63"},{"issue":"1","key":"3336_CR2","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1080\/02656736.2018.1509237","volume":"35","author":"L Monfardini","year":"2018","unstructured":"Monfardini L, Orsi F, Caserta R, Sallemi C, Della Vigna P, Bonomo G, Varano G, Solbiati L, Mauri G (2018) Ultrasound and cone beam CT fusion for liver ablation. Int J Hyperth 35(1):500\u2013504","journal-title":"Int J Hyperth"},{"key":"3336_CR3","doi-asserted-by":"publisher","first-page":"7523","DOI":"10.1007\/s00330-021-07930-w","volume":"31","author":"L Monfardini","year":"2021","unstructured":"Monfardini L, Gennaro N, Orsi F, Della Vigna P, Bonomo G, Varano G, Solbiati L, Mauri G (2021) Real-time us\/cone-beam CT fusion imaging for percutaneous ablation of small renal tumours: a technical note. Eur Radiol 31:7523\u20137528","journal-title":"Eur Radiol"},{"issue":"3","key":"3336_CR4","doi-asserted-by":"publisher","first-page":"685","DOI":"10.1016\/j.ijrobp.2019.03.003","volume":"104","author":"SA Mason","year":"2019","unstructured":"Mason SA, White IM, O\u2019Shea T, McNair HA, Alexander S, Kalaitzaki E, Bamber JC, Harris EJ, Lalondrelle S (2019) Combined ultrasound and cone beam CT improves target segmentation for image guided radiation therapy in uterine cervix cancer. Int J Radiat Oncol Biol Phys 104(3):685\u2013693","journal-title":"Int J Radiat Oncol Biol Phys"},{"issue":"1","key":"3336_CR5","doi-asserted-by":"publisher","first-page":"395","DOI":"10.1109\/TMECH.2018.2890744","volume":"24","author":"MD Kim","year":"2019","unstructured":"Kim MD, Lee K-H, Lee S-M, Koo JC, Ji S-H (2019) Design and development of a mobile robotic CT system for intraoperative use. IEEE\/ASME Trans Mechatron 24(1):395\u2013405","journal-title":"IEEE\/ASME Trans Mechatron"},{"key":"3336_CR6","doi-asserted-by":"crossref","unstructured":"Weir VJ, Zhang J, Bruner AP (2015) Dosimetric characterization and image quality evaluation of the AIRO mobile CT scanner. J Xray Sci Technol 23(3):373\u2013381","DOI":"10.3233\/XST-150496"},{"issue":"1","key":"3336_CR7","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1097\/WCO.0000000000000165","volume":"28","author":"M Ebinger","year":"2015","unstructured":"Ebinger M, Fiebach JB, Audebert HJ (2015) Mobile computed tomography: prehospital diagnosis and treatment of stroke. Curr Opin Neurol 28(1):4\u20139","journal-title":"Curr Opin Neurol"},{"key":"3336_CR8","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1007\/s11701-015-0532-1","volume":"9","author":"RK Tsang","year":"2015","unstructured":"Tsang RK, Sorger JM, Azizian M, Holsinger CF (2015) Real-time navigation in transoral robotic nasopharyngectomy utilizing on table fluoroscopy and image overlay software: a cadaveric feasibility study. J Robot Surg 9:311\u2013314","journal-title":"J Robot Surg"},{"issue":"5","key":"3336_CR9","doi-asserted-by":"publisher","first-page":"1504","DOI":"10.1177\/21925682221147867","volume":"14","author":"M Tanaka","year":"2024","unstructured":"Tanaka M, Schol J, Sakai D, Sako K, Yamamoto K, Yanagi K, Hiyama A, Katoh H, Sato M, Watanabe M (2024) Low radiation protocol for intraoperative robotic c-arm can enhance adolescent idiopathic scoliosis deformity correction accuracy and safety. Glob Spine J 14(5):1504\u20131514","journal-title":"Glob Spine J"},{"key":"3336_CR10","doi-asserted-by":"crossref","unstructured":"Karius A, Leifeld LM, Strnad V, Fietkau R, Bert C (2024) First implementation of an innovative infra-red camera system integrated into a mobile CBCT scanner for applicator tracking in brachytherapy-initial performance characterization. J Appl Clin Med Phys 14364","DOI":"10.1002\/acm2.14364"},{"key":"3336_CR11","unstructured":"Li C, Huang D, Karlas A, Navab N, Jiang Z (2024) Invisible needle detection in ultrasound: leveraging mechanism-induced vibration. arXiv preprint arXiv:2403.14523"},{"key":"3336_CR12","doi-asserted-by":"crossref","unstructured":"Jiang Z, Li X, Chu X, Karlas A, Bi Y, Cheng Y, Au KS, Navab N (2024) Needle segmentation using GAN: restoring thin instrument visibility in robotic ultrasound. IEEE Trans Instrum Meas","DOI":"10.1109\/TIM.2024.3451569"},{"key":"3336_CR13","doi-asserted-by":"crossref","unstructured":"Jiang Z, Salcudean SE, Navab N (2023) Robotic ultrasound imaging: state-of-the-art and future perspectives. Med Image Anal 102878","DOI":"10.1016\/j.media.2023.102878"},{"key":"3336_CR14","doi-asserted-by":"crossref","unstructured":"Bi Y, Jiang Z, Duelmer F, Huang D, Navab N Machine learning in robotic ultrasound imaging: challenges and perspectives. Annu Rev Control Robot Auton Syst 7","DOI":"10.1146\/annurev-control-091523-100042"},{"key":"3336_CR15","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s43154-020-00037-y","volume":"2","author":"F Haxthausen","year":"2021","unstructured":"Haxthausen F, B\u00f6ttger S, Wulff D, Hagenah J, Garc\u00eda-V\u00e1zquez V, Ipsen S (2021) Medical robotics for ultrasound imaging: current systems and future trends. Curr Robot Rep 2:55\u201371","journal-title":"Curr Robot Rep"},{"key":"3336_CR16","doi-asserted-by":"crossref","unstructured":"Huang Q, Gao B, Wang M (2024) Robot-assisted autonomous ultrasound imaging for carotid artery. IEEE Trans Instrum Meas","DOI":"10.1109\/TIM.2024.3353836"},{"key":"3336_CR17","unstructured":"Li M-D, Lin X-X, Ruan SM, Ke W-P, Zhang H-R, Huang H, Wu S-H, Cheng M-Q, Tong W-J, Hu H-T et al Autonomous robotic ultrasound scanning system: a key to enhancing image analysis reproducibility and observer consistency in ultrasound imaging. Front Robot AI 12:1527686"},{"issue":"7","key":"3336_CR18","doi-asserted-by":"publisher","first-page":"7064","DOI":"10.1109\/TIE.2021.3095787","volume":"69","author":"Z Jiang","year":"2021","unstructured":"Jiang Z, Li Z, Grimm M, Zhou M, Esposito M, Wein W, Stechele W, Wendler T, Navab N (2021) Autonomous robotic screening of tubular structures based only on real-time ultrasound imaging feedback. IEEE Trans Industr Electron 69(7):7064\u20137075","journal-title":"IEEE Trans Industr Electron"},{"issue":"3","key":"3336_CR19","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1109\/70.34770","volume":"5","author":"RY Tsai","year":"1989","unstructured":"Tsai RY, Lenz RK et al (1989) A new technique for fully autonomous and efficient 3d robotics hand\/eye calibration. IEEE Trans Robot Autom 5(3):345\u2013358","journal-title":"IEEE Trans Robot Autom"},{"key":"3336_CR20","doi-asserted-by":"crossref","unstructured":"Jiang Z, Duelmer F, Navab N (2023) Dopus-net: quality-aware robotic ultrasound imaging based on doppler signal. IEEE Trans Autom Sci Eng","DOI":"10.1109\/TASE.2023.3277331"},{"issue":"3","key":"3336_CR21","doi-asserted-by":"publisher","first-page":"494","DOI":"10.1016\/j.media.2009.02.003","volume":"13","author":"S Nicolau","year":"2009","unstructured":"Nicolau S, Pennec X, Soler L, Buy X, Gangi A, Ayache N, Marescaux J (2009) An augmented reality system for liver thermal ablation: design and evaluation on clinical cases. Med Image Anal 13(3):494\u2013506","journal-title":"Med Image Anal"},{"key":"3336_CR22","doi-asserted-by":"publisher","first-page":"22557","DOI":"10.1109\/ACCESS.2018.2828641","volume":"6","author":"Y Sun","year":"2018","unstructured":"Sun Y, Jiang Z, Qi X, Hu Y, Li B, Zhang J (2018) Robot-assisted decompressive laminectomy planning based on 3d medical image. IEEE Access 6:22557\u201322569","journal-title":"IEEE Access"},{"key":"3336_CR23","doi-asserted-by":"crossref","unstructured":"Jiang Z, Kang Y, Bi Y, Li X, Li C, Navab N (2024) Class-aware cartilage segmentation for autonomous US-CT registration in robotic intercostal ultrasound imaging. IEEE Trans Autom Sci Eng","DOI":"10.1109\/TASE.2024.3411784"},{"key":"3336_CR24","doi-asserted-by":"crossref","unstructured":"Jiang Z, Danis N, Bi Y, Zhou M, Kroenke M, Wendler T, Navab N (2022) Precise repositioning of robotic ultrasound: improving registration-based motion compensation using ultrasound confidence optimization. IEEE Trans Instrum Meas 71:1\u201311","DOI":"10.1109\/TIM.2022.3200360"},{"key":"3336_CR25","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2023.102923","volume":"90","author":"Z Jiang","year":"2023","unstructured":"Jiang Z, Zhou Y, Cao D, Navab N (2023) Defcor-net: physics-aware ultrasound deformation correction. Med Image Anal 90:102923","journal-title":"Med Image Anal"},{"issue":"3","key":"3336_CR26","doi-asserted-by":"publisher","first-page":"6638","DOI":"10.1109\/LRA.2022.3176112","volume":"7","author":"Y Bi","year":"2022","unstructured":"Bi Y, Jiang Z, Gao Y, Wendler T, Karlas A, Navab N (2022) Vesnet-rl: simulation-based reinforcement learning for real-world us probe navigation. IEEE Robot Autom Lett 7(3):6638\u20136645","journal-title":"IEEE Robot Autom Lett"},{"key":"3336_CR27","doi-asserted-by":"crossref","unstructured":"Jiang Z, Bi Y, Zhou M, Hu Y, Burke M, Navab N (2024) Intelligent robotic sonographer: mutual information-based disentangled reward learning from few demonstrations. Int J Robot Res 43(7):981\u20131002","DOI":"10.1177\/02783649231223547"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03336-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-025-03336-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03336-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,14]],"date-time":"2025-06-14T11:34:21Z","timestamp":1749900861000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-025-03336-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,3,12]]},"references-count":27,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["3336"],"URL":"https:\/\/doi.org\/10.1007\/s11548-025-03336-x","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,3,12]]},"assertion":[{"value":"12 January 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 March 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"Informed consent was obtained from all individual participants included in the study.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Informed consent"}}]}}