{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T15:16:29Z","timestamp":1783696589909,"version":"3.55.0"},"reference-count":23,"publisher":"Springer Science and Business Media LLC","issue":"5","license":[{"start":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T00:00:00Z","timestamp":1777248000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T00:00:00Z","timestamp":1777248000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100010269","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["203148\/A\/16\/Z"],"award-info":[{"award-number":["203148\/A\/16\/Z"]}],"id":[{"id":"10.13039\/100010269","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/R513064\/1"],"award-info":[{"award-number":["EP\/R513064\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"name":"MRC IAA 2021 Kings College London","award":["MR\/X502923\/1"],"award-info":[{"award-number":["MR\/X502923\/1"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose:<\/jats:title>\n                    <jats:p>Mechanical thrombectomy (MT) improves stroke outcomes, but is limited by a lack of local treatment access. Widespread distribution of reinforcement learning (RL)-based robotic systems can be used to alleviate this challenge through autonomous navigation, but current RL methods require live device tip coordinate tracking to function. This paper aims to develop and evaluate a real-time catheter tip tracking pipeline under fluoroscopy, addressing challenges such as low contrast, noise, and device occlusion.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods:<\/jats:title>\n                    <jats:p>A multi-threaded pipeline was designed, incorporating frame reading, preprocessing, inference, and post-processing. Deep learning segmentation models, including U-Net, U-Net+Transformer, and SegFormer, were trained and benchmarked using two-class and three-class formulations. Post-processing involved two-step component filtering, one-pixel medial skeletonization, and greedy arc-length path following with contour fall-back.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results:<\/jats:title>\n                    <jats:p>On manually labeled moderate complexity fluoroscopic video data, the two-class SegFormer achieved a mean absolute error of 4.44\u00a0mm, outperforming U-Net (4.60\u00a0mm), U-Net+Transformer (6.20\u00a0mm) and all three-class models (5.19\u22127.74\u00a0mm). On segmentation benchmarks, the system exceeded state-of-the-art CathAction results with improvements of up to +5% in Dice scores for three-segmentation.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion:<\/jats:title>\n                    <jats:p>The results demonstrate that the proposed multi-threaded tracking framework maintains stable performance under challenging imaging conditions, outperforming prior benchmarks, while providing a reliable and efficient foundation for RL-based autonomous MT navigation.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s11548-026-03647-7","type":"journal-article","created":{"date-parts":[[2026,4,27]],"date-time":"2026-04-27T14:58:51Z","timestamp":1777301931000},"page":"1071-1079","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Toward real-time autonomous navigation: transformer-based catheter tip tracking in fluoroscopy"],"prefix":"10.1007","volume":"21","author":[{"given":"Harry","family":"Robertshaw","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yanghe","family":"Hao","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weiyuan","family":"Deng","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Benjamin","family":"Jackson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S. M. Hadi","family":"Sadati","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nikola","family":"Fischer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Vercauteren","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alejandro","family":"Granados","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas C.","family":"Booth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,4,27]]},"reference":[{"key":"3647_CR1","doi-asserted-by":"publisher","first-page":"S126","DOI":"10.1212\/WNL.0000000000012801","volume":"97","author":"AP Jadhav","year":"2021","unstructured":"Jadhav AP, Desai SM, Jovin TG (2021) Indications for mechanical thrombectomy for acute ischemic stroke: current guidelines and beyond. Neurology 97:S126\u2013S136","journal-title":"Neurology"},{"key":"3647_CR2","doi-asserted-by":"publisher","first-page":"1279","DOI":"10.1001\/jama.2016.13647","volume":"316","author":"JL Saver","year":"2016","unstructured":"Saver JL et al (2016) Time to treatment with endovascular thrombectomy and outcomes from ischemic stroke: ameta-analysis. JAMA - J American Med Assoc 316:1279\u20131288","journal-title":"JAMA - J American Med Assoc"},{"key":"3647_CR3","unstructured":"Sentinel Stroke National Audit Programme, Ssnap annual report 2024, Healthcare Quality Improvement Partnership, 11 2024, [Online]. Available: https:\/\/www.hqip.org.uk\/resource\/ssnap-nov24\/. Accessed 5 March 2025"},{"key":"3647_CR4","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1056\/NEJMoa1411587","volume":"372","author":"OA Berkhemer","year":"2015","unstructured":"Berkhemer OA, Fransen PSS, Beumer D, van den Berg LA, Lingsma HF, Yoo AJ, Schonewille WJ, Vos JA, Nederkoorn PJ, Wermer MJH, van Walderveen MAA, Staals J, Hofmeijer J, van Oostayen JA, Nijeholt GJLA, Boiten J, Brouwer PA, Emmer BJ, de Bruijn SF, van Dijk LC, Kappelle LJ, Lo RH, van Dijk EJ, de Vries J, de Kort PLM, van Rooij WJJ, van den Berg JSP, van Hasselt BAAM, Aerden LAM, Dallinga RJ, Visser MC, Bot JCJ, Vroomen PC, Eshghi O, Schreuder THCML, Heijboer RJJ, Keizer K, Tielbeek AV, den Hertog HM, Gerrits DG, van den Berg-Vos RM, Karas GB, Steyerberg EW, Flach HZ, Marquering HA, Sprengers MES, Jenniskens SFM, Beenen LFM, van den Berg R, Koudstaal PJ, van Zwam WH, Roos YBWEM, van der Lugt A, van Oostenbrugge RJ, Majoie CBLM, Dippel DWJ (2015) A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med 372:11\u201320","journal-title":"N Engl J Med"},{"key":"3647_CR5","first-page":"538","volume":"250","author":"LW Klein","year":"2009","unstructured":"Klein LW, Miller DL, Balter S, Laskey W, Haines D, Norbash A, Mauro MA, Goldstein JA (2009) Occupational health hazards in the interventional laboratory: time for a safer environment. Soc Intervent Radiol 250:538\u2013544","journal-title":"Soc Intervent Radiol"},{"key":"3647_CR6","doi-asserted-by":"publisher","first-page":"190","DOI":"10.1016\/j.carrev.2016.12.011","volume":"18","author":"RD Madder","year":"2017","unstructured":"Madder RD, VanOosterhout S, Mulder A, Elmore M, Campbell J, Borgman A, Parker J, Wohns D (2017) Impact of robotics and a suspended lead suit on physician radiation exposure during percutaneous coronary intervention. Cardiovasc Revasc Med 18:190\u2013196","journal-title":"Cardiovasc Revasc Med"},{"key":"3647_CR7","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1136\/neurintsurg-2021-018096","volume":"14","author":"W Crinnion","year":"2022","unstructured":"Crinnion W, Jackson B, Sood A, Lynch J, Bergeles C, Liu H, Rhode K, Pereira VM, Booth TC (2022) Robotics in neurointerventional surgery: a systematic review of the literature. J Neurointervent Surg 14:539\u2013545","journal-title":"J Neurointervent Surg"},{"key":"3647_CR8","doi-asserted-by":"publisher","first-page":"477","DOI":"10.3934\/Neuroscience.2021025","volume":"8","author":"M Mofatteh","year":"2021","unstructured":"Mofatteh M (2021) Neurosurgery and artificial intelligence. AIMS Neurosci 8:477\u2013495","journal-title":"AIMS Neurosci"},{"issue":"8","key":"3647_CR9","doi-asserted-by":"publisher","first-page":"1569","DOI":"10.1007\/s11548-024-03208-w","volume":"19","author":"H Robertshaw","year":"2024","unstructured":"Robertshaw H, Karstensen L, Jackson B, Granados A, Booth TC (2024) Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning. Int J CARS 19(8):1569\u20131578","journal-title":"Int J CARS"},{"issue":"6","key":"3647_CR10","doi-asserted-by":"publisher","first-page":"1077","DOI":"10.1007\/s11548-025-03339-8","volume":"20","author":"H Robertshaw","year":"2025","unstructured":"Robertshaw H, Jackson B, Wang J, Sadati H, Karstensen L, Granados A, Booth TC (2025) Reinforcement learning for safe autonomous two-device navigation of cerebral vessels in mechanical thrombectomy. Int J CARS 20(6):1077\u20131086","journal-title":"Int J CARS"},{"key":"3647_CR11","doi-asserted-by":"publisher","first-page":"1239374","DOI":"10.3389\/fnhum.2023.1239374","volume":"17","author":"H Robertshaw","year":"2023","unstructured":"Robertshaw H, Karstensen L, Jackson B, Sadati H, Rhode K, Ourselin S, Granados A, Booth TC (2023) Artificial intelligence in the autonomous navigation of endovascular interventions: a systematic review. Front Hum Neurosci 17:1239374","journal-title":"Front Hum Neurosci"},{"key":"3647_CR12","first-page":"234","volume":"2015","author":"O Ronneberger","year":"2015","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-Net: convolutional networks for biomedical image segmentation. Med Image Comput Comput-Assist Intervent 2015:234\u2013241","journal-title":"Med Image Comput Comput-Assist Intervent"},{"key":"3647_CR13","doi-asserted-by":"crossref","unstructured":"Ambrosini P, Ruijters D, Niessen W, Moelker A, van Walsum T (2017) Fully automatic and real-time catheter segmentation in x-ray fluoroscopy. Medical Image Computing and Computer-Assisted Intervention 2017","DOI":"10.1007\/978-3-319-66185-8_65"},{"key":"3647_CR14","doi-asserted-by":"crossref","unstructured":"Nguyen A, Kundrat D, Dagnino G, Chi W, Abdelaziz MEMK, Guo Y, Ma Y, Kwok TMY, Riga C, Yang G-Z (2020) End-to-end real-time catheter segmentation with optical flow-guided warping during endovascular intervention, In: IEEE International conference on robotics and automation (ICRA) 2020, pp 9967\u20139973","DOI":"10.1109\/ICRA40945.2020.9197307"},{"key":"3647_CR15","unstructured":"Vlontzos A, Mikolajczyk K (2018) Deep segmentation and registration in x-ray angiography video. In: British machine vision conference, 2018:267"},{"key":"3647_CR16","first-page":"679","volume":"2013","author":"M Demoustier","year":"2023","unstructured":"Demoustier M, Zhang Y, Murthy V, Ghesu F, Comaniciu D (2023) Contrack: contextual transformer for device tracking in x-ray. Med Image Comput Comput-Assist Intervent 2013:679\u2013688","journal-title":"Med Image Comput Comput-Assist Intervent"},{"key":"3647_CR17","unstructured":"Huang B, Vo T, Kongtongvattana C, Dagnino G, Kundrat D, Chi W, Abdelaziz M, Kwok T, Jianu T, Do T, Le H, Nguyen M, Nguyen H, Tjiputra E, Tran Q, Xie J, Meng Y, Bhattarai B, Tan Z, Liu H, Gan HS, Wang W, Yang X, Wang Q, Su J, Huang K, Stefanidis A, Guo M, Du B, Tao R, Vu M, Zheng G, Zheng Y, Vasconcelos F, Stoyanov D, Elson D, Baena FRY, Nguyen A (2024) Cathaction: a benchmark for endovascular intervention understanding. Tech Rep [Online]. Available: https:\/\/arxiv.org\/abs\/2408.13126"},{"key":"3647_CR18","doi-asserted-by":"publisher","first-page":"10","DOI":"10.1016\/j.media.2024.103280","volume":"97","author":"J Chen","year":"2024","unstructured":"Chen J, Mei J, Li X, Lu Y, Qingyue Wei QY, Luo X, Xie Y, Adeli E, Wang Y, Lungren MP, Zhang S, Xing L, Lu L, Yuille A, Zhou Y (2024) Transunet: rethinking the U-Net architecture design for medical image segmentation through the lens of transformers. Med Image Anal 97:10","journal-title":"Med Image Anal"},{"key":"3647_CR19","first-page":"205","volume":"14","author":"H Cao","year":"2023","unstructured":"Cao H, Wang Y, Chen J, Jiang D, Zhang X, Tian Q, Wang M (2023) Swin-UNet: UNet-like pure transformer for medical image segmentation. Computer Vision\u2013 ECCV 2022 Workshops 14:205\u2013218","journal-title":"Computer Vision\u2013 ECCV 2022 Workshops"},{"key":"3647_CR20","doi-asserted-by":"crossref","unstructured":"Zhang B, Tian Z, Tang Q, Chu X, Wei X, Shen C, Liu Y (2022) Segvit: semantic segmentation with plain vision transformers. In: 36th Conference on neural information processing systems, 10","DOI":"10.52202\/068431-0359"},{"issue":"3","key":"3647_CR21","doi-asserted-by":"publisher","first-page":"971","DOI":"10.1109\/TMRB.2024.3421256","volume":"6","author":"T Jianu","year":"2024","unstructured":"Jianu T, Huang B, Vu MN, Abdelaziz MEMK, Fichera S, Lee C-Y, Berthet-Rayne P, Baena FRY, Nguyen A (2024) Cathsim: an open-source simulator for endovascular intervention. IEEE Trans Med Robot Bionics 6(3):971\u2013979","journal-title":"IEEE Trans Med Robot Bionics"},{"key":"3647_CR22","doi-asserted-by":"publisher","first-page":"105420","DOI":"10.1016\/j.cmpb.2020.105420","volume":"192","author":"M Gherardini","year":"2020","unstructured":"Gherardini M, Mazomenos E, Menciassi A, Stoyanov D (2020) Catheter segmentation in x-ray fluoroscopy using synthetic data and transfer learning with light U-Nets. Comput Methods Programs Biomed 192:105420","journal-title":"Comput Methods Programs Biomed"},{"key":"3647_CR23","first-page":"12 077","volume":"34","author":"E Xie","year":"2021","unstructured":"Xie E, Wang W, Yu Z, Anandkumar A, Alvarez JM, Luo P (2021) Segformer: simple and efficient design for semantic segmentation with transformers. Adv Neural Inf Process Syst 34:12 077-12 090","journal-title":"Adv Neural Inf Process Syst"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03647-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-026-03647-7","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03647-7.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,7,10]],"date-time":"2026-07-10T14:55:48Z","timestamp":1783695348000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-026-03647-7"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,4,27]]},"references-count":23,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2026,5]]}},"alternative-id":["3647"],"URL":"https:\/\/doi.org\/10.1007\/s11548-026-03647-7","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,4,27]]},"assertion":[{"value":"26 February 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"7 April 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"27 April 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors have no conflict of interest to declare.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}