{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T15:35:29Z","timestamp":1777131329576,"version":"3.51.4"},"reference-count":19,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T00:00:00Z","timestamp":1777075200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T00:00:00Z","timestamp":1777075200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"German Federal Ministry of Research, Technology, and Space","award":["13GW0473A"],"award-info":[{"award-number":["13GW0473A"]}]},{"DOI":"10.13039\/501100008530","name":"European Regional Development Fund","doi-asserted-by":"publisher","award":["ZS\/2023\/12\/182010"],"award-info":[{"award-number":["ZS\/2023\/12\/182010"]}],"id":[{"id":"10.13039\/501100008530","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100012320","name":"Otto-von-Guericke-Universit\u00e4t Magdeburg","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100012320","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"Abstract<\/jats:title>\n \n \n Purpose:<\/jats:bold>\n <\/jats:title>\n In CT-guided interventions, instrument tracking reduces patient risk while improving the overall outcome. Though useful, marker-based tracking systems suffer from occlusion, are complex to set up, and fail when needles deflect. A marker-less tracking system could overcome these challenges, enabling streamlined integration.<\/jats:p>\n <\/jats:sec>\n \n \n Methods:<\/jats:bold>\n <\/jats:title>\n We developed and evaluated a proof-of-concept system combining standard RGB cameras with a U-Net-ConvNeXt architecture for needle detection and tracking. We compiled a fully annotated dataset of 35,000 frames, spanning multiple needle types and scenarios. We evaluated tracking accuracy against state-of-the-art marker-based systems, utilizing an IR-based and an image-based system on static positioning, dynamic movement, and needle-deflection scenarios. Moreover, our marker-less system was evaluated using both known and unknown needle types.<\/jats:p>\n <\/jats:sec>\n \n \n Results:<\/jats:bold>\n <\/jats:title>\n \n Our proof-of-concept system demonstrated a 3D tracking error of\n \n \n $$2.70\\,\\pm \\,1.07$$<\/jats:tex-math>\n \n \n 2.70<\/mml:mn>\n \n \u00b1<\/mml:mo>\n \n 1.07<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n \u00a0mm at 25\u00a0FPS with 3 cameras, outperforming ArUco marker-based tracking (\n \n \n $$5.29\\,\\pm \\,1.85$$<\/jats:tex-math>\n \n \n 5.29<\/mml:mn>\n \n \u00b1<\/mml:mo>\n \n 1.85<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n \u00a0mm). Tracking accuracy remained consistent for unknown needle types not included in the training data, suggesting strong generalization. The system maintained a 99.4\u00a0% needle-tip detection rate across all frames with robust performance during needle deflection, while marker-based systems failed under identical conditions. With only 2 cameras, the tracking error of our system increased modestly (\n \n \n $$4.81\\,\\pm \\,2.38$$<\/jats:tex-math>\n \n \n 4.81<\/mml:mn>\n \n \u00b1<\/mml:mo>\n \n 2.38<\/mml:mn>\n <\/mml:mrow>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n \u00a0mm).\n <\/jats:p>\n <\/jats:sec>\n \n \n Conclusion:<\/jats:bold>\n <\/jats:title>\n Our proof-of-concept demonstrates the feasibility of marker-less needle tracking, suggesting potential for clinically relevant accuracy, reliability, and reduced complexity while exhibiting robustness to needle deflection and varying needle appearances. These preliminary results indicate promising directions for future clinical development.<\/jats:p>\n <\/jats:sec>","DOI":"10.1007\/s11548-026-03622-2","type":"journal-article","created":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T14:39:52Z","timestamp":1777127992000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Real-time marker-less needle tracking for CT-guided interventions using multiple RGB cameras"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0979-0905","authenticated-orcid":false,"given":"Max","family":"Steiger","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2363-2460","authenticated-orcid":false,"given":"Tonia","family":"Mielke","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9199-7333","authenticated-orcid":false,"given":"Oleksii","family":"Bashkanov","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0826-0734","authenticated-orcid":false,"given":"Oliver S.","family":"Grosser","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7140-6775","authenticated-orcid":false,"given":"Maciej","family":"Pech","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5734-7529","authenticated-orcid":false,"given":"Christian","family":"Hansen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marko","family":"Rak","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2026,4,25]]},"reference":[{"key":"3622_CR1","doi-asserted-by":"crossref","unstructured":"Aghaloo T, Hadaya D, Schoenbaum TR, Pratt L, Favagehi M (2023) Guided and navigation implant surgery: A systematic review. The International Journal of Oral and Maxillofacial Implants 38: 7\u201315. https:\/\/doi.org\/10.11607\/jomi.10465","DOI":"10.11607\/jomi.10465"},{"key":"3622_CR2","doi-asserted-by":"publisher","unstructured":"Jong TL, Berg NJ, Tas L, Moelker A, Dankelman J, Dobbelsteen JJ (2018) Needle placement errors: do we need steerable needles in interventional radiology? Medical Devices (Auckland, N.Z.) 11, 259\u2013265 https:\/\/doi.org\/10.2147\/MDER.S160444","DOI":"10.2147\/MDER.S160444"},{"key":"3622_CR3","doi-asserted-by":"publisher","first-page":"212","DOI":"10.1109\/RBME.2019.2939091","volume":"13","author":"A Sorriento","year":"2020","unstructured":"Sorriento A, Porfido MB, Mazzoleni S, Calvosa G, Tenucci M, Ciuti G, Dario P (2020) Optical and electromagnetic tracking systems for biomedical applications: A critical review on potentialities and limitations. IEEE Rev Biomed Eng 13:212\u2013232. https:\/\/doi.org\/10.1109\/RBME.2019.2939091","journal-title":"IEEE Rev Biomed Eng"},{"key":"3622_CR4","doi-asserted-by":"publisher","unstructured":"Agethen N, Rosskamp J, Koller TL, Klein J, Zachmann G (2025) Recurrent multi-view 6DoF pose estimation for marker-less surgical tool tracking. Int J Comput Assist Radiol Surg. https:\/\/doi.org\/10.1007\/s11548-025-03436-8","DOI":"10.1007\/s11548-025-03436-8"},{"key":"3622_CR5","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2025.103613","volume":"103","author":"J Hein","year":"2025","unstructured":"Hein J, Cavalcanti N, Suter D, Zingg L, Carrillo F, Calvet L, Farshad M, Navab N, Pollefeys M, Furnstahl P (2025) Next-generation surgical navigation: Marker-less multi-view 6DoF pose estimation of surgical instruments. Med Image Anal 103:103613. https:\/\/doi.org\/10.1016\/j.media.2025.103613","journal-title":"Med Image Anal"},{"key":"3622_CR6","doi-asserted-by":"publisher","unstructured":"Trojak M, Stanuch M, Kurzyna M, Darocha S, Skalski A (2024) Mixed reality biopsy navigation system utilizing markerless needle tracking and imaging data superimposition. Cancers 16(10) https:\/\/doi.org\/10.3390\/cancers16101894","DOI":"10.3390\/cancers16101894"},{"key":"3622_CR7","doi-asserted-by":"publisher","unstructured":"Steiger M, Spiegel J, Hansen C (2025). A Multi-View RGB Dataset for Marker-less Needle Tracking. https:\/\/doi.org\/10.6084\/m9.figshare.30374035.v1","DOI":"10.6084\/m9.figshare.30374035.v1"},{"key":"3622_CR8","doi-asserted-by":"publisher","DOI":"10.1016\/j.media.2021.101994","volume":"70","author":"MK Hasan","year":"2021","unstructured":"Hasan MK, Calvet L, Rabbani N, Bartoli A (2021) Detection, segmentation, and 3D pose estimation of surgical tools using convolutional neural networks and algebraic geometry. Med Image Anal 70:101994. https:\/\/doi.org\/10.1016\/j.media.2021.101994","journal-title":"Med Image Anal"},{"key":"3622_CR9","doi-asserted-by":"publisher","unstructured":"Chiu ZY, Liao AZ, Richter F, Johnson B, Yip MC (2022) Markerless suture needle 6D pose tracking with robust uncertainty estimation for autonomous minimally invasive robotic surgery. In: 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5286\u20135292. IEEE, Kyoto, Japan . https:\/\/doi.org\/10.1109\/IROS47612.2022.9981966","DOI":"10.1109\/IROS47612.2022.9981966"},{"issue":"6","key":"3622_CR10","doi-asserted-by":"publisher","first-page":"2280","DOI":"10.1016\/j.patcog.2014.01.005","volume":"47","author":"S Garrido-Jurado","year":"2014","unstructured":"Garrido-Jurado S, Mu\u00f1oz-Salinas R, Madrid-Cuevas FJ, Mar\u00edn-Jim\u00e9nez MJ (2014) Automatic generation and detection of highly reliable fiducial markers under occlusion. Pattern Recogn 47(6):2280\u20132292. https:\/\/doi.org\/10.1016\/j.patcog.2014.01.005","journal-title":"Pattern Recogn"},{"issue":"13\u201314","key":"3622_CR11","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1016\/S0262-8856(02)00112-9","volume":"20","author":"C Sun","year":"2002","unstructured":"Sun C (2002) Fast optical flow using 3D shortest path techniques. Image Vis Comput 20(13\u201314):981\u2013991. https:\/\/doi.org\/10.1016\/S0262-8856(02)00112-9","journal-title":"Image Vis Comput"},{"key":"3622_CR12","doi-asserted-by":"publisher","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-Net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention \u2013 MICCAI 2015. Lecture Notes in Computer Science, vol. 9351, pp. 234\u2013241. Springer, Cham . https:\/\/doi.org\/10.1007\/978-3-319-24574-4_28","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"3622_CR13","doi-asserted-by":"publisher","unstructured":"Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 779\u2013788. IEEE, Las Vegas, Nevada, USA . https:\/\/doi.org\/10.1109\/CVPR.2016.91","DOI":"10.1109\/CVPR.2016.91"},{"key":"3622_CR14","doi-asserted-by":"publisher","unstructured":"Liu Z, Mao H, Wu CY, Feichtenhofer C, Darrell T, Xie S (2022) A ConvNet for the 2020s. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11976\u201311986. IEEE, New Orleans, Louisiana, USA . https:\/\/doi.org\/10.1109\/CVPR52688.2022.01167","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"3622_CR15","doi-asserted-by":"publisher","unstructured":"Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) ImageNet: A large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248\u2013255. IEEE, Miami, Florida, USA . https:\/\/doi.org\/10.1109\/CVPR.2009.5206848","DOI":"10.1109\/CVPR.2009.5206848"},{"key":"3622_CR16","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2023.120743","volume":"230","author":"L Chen","year":"2023","unstructured":"Chen L, Ma L, Zhang F, Yang X, Sun L (2023) An intelligent tracking system for surgical instruments in complex surgical environment. Expert Syst Appl 230:120743. https:\/\/doi.org\/10.1016\/j.eswa.2023.120743","journal-title":"Expert Syst Appl"},{"key":"3622_CR17","doi-asserted-by":"publisher","unstructured":"Stone NN, Mouraviev V, Schechter D, Goetz J, Lucia MS, Smith EE, Crawford ED (2017) Deflection analysis of different needle designs for prostate biopsy and focal therapy. Technology in Cancer Research & Treatment 16(5):654\u2013661. https:\/\/doi.org\/10.1177\/1533034616671007","DOI":"10.1177\/1533034616671007"},{"key":"3622_CR18","unstructured":"Loshchilov I, Hutter F (2019) Decoupled weight decay regularization. In: 7th International Conference on Learning Representations (ICLR), New Orleans, Louisiana, USA"},{"key":"3622_CR19","doi-asserted-by":"publisher","unstructured":"Seitel A, Bellemann N, Hafezi M, Franz AM, Servatius M, Saffari A, Kilgus T, Schlemmer H-P, Mehrabi A, Radeleff BA, Maier-Hein L (2016) Towards markerless navigation for percutaneous needle insertions. Int J Comput Assist Radiol Surg 11(1):107\u2013117. https:\/\/doi.org\/10.1007\/s11548-015-1156-7","DOI":"10.1007\/s11548-015-1156-7"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03622-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-026-03622-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03622-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,25]],"date-time":"2026-04-25T14:39:54Z","timestamp":1777127994000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-026-03622-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,25]]},"references-count":19,"alternative-id":["3622"],"URL":"https:\/\/doi.org\/10.1007\/s11548-026-03622-2","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,25]]},"assertion":[{"value":"29 October 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"26 March 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"25 April 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no known competing financial interests or personal relationships that could have influenced the work reported in this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}