{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T12:11:41Z","timestamp":1790251901677,"version":"4.1.0"},"reference-count":34,"publisher":"Springer Science and Business Media LLC","license":[{"start":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T00:00:00Z","timestamp":1790208000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T00:00:00Z","timestamp":1790208000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/Y009827\/1"],"award-info":[{"award-number":["EP\/Y009827\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>\n                      <jats:bold>Purpose:<\/jats:bold>\n                    <\/jats:title>\n                    <jats:p>Accurate 6 DoF pose estimation of surgical tools is critical for automation, robotic proprioception, and safe interaction with the tissue operated on. Kinematics-based approaches suffer from accumulated errors due to the cable-driven nature of robotic arms, while vision-based methods often rely on external markers or trackers. Although more recent vision-based advances have been proposed, these two-stage pose estimation methods often lack real-time robustness due to accumulated errors and computational overhead.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>\n                      <jats:bold>Methods:<\/jats:bold>\n                    <\/jats:title>\n                    <jats:p>We propose a novel end-to-end trainable model, PICO. Our model employs a multi-task learning architecture to predict segmentation and depth maps, alongside regression of translation and rotation parameters. We define two proxy tasks that enforce geometric consistency in both 2D and 3D spaces, improving accuracy and robustness. For this, we propose a projection loss, and a point-to-point loss.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>\n                      <jats:bold>Results:<\/jats:bold>\n                    <\/jats:title>\n                    <jats:p>We evaluate our method on the SurgRIPE dataset, benchmarking its performance against state-of-the-art approaches using standard 6DoF pose estimation metrics. Our results demonstrate consistently strong performance across all four subsets, specifically in rotation, ranking second even under occlusion. It also demonstrates comparable translational performance, remaining competitive, especially in occluded cases.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>\n                      <jats:bold>Conclusion:<\/jats:bold>\n                    <\/jats:title>\n                    <jats:p>PICO demonstrates the effectiveness of multi-task learning and geometry-aware proxy tasks for robust and reliable surgical tool pose estimation, especially in occluded scenarios, highlighting potential for future applications.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s11548-026-03802-0","type":"journal-article","created":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T11:50:19Z","timestamp":1790250619000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["PICO: Projection-Informed Consistency Optimisation for 6DoF surgical tool pose estimation"],"prefix":"10.1007","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-4102-1684","authenticated-orcid":false,"given":"Lucy","family":"Fothergill","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Pietro","family":"Valdastri","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Dominic","family":"Jones","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Duygu","family":"Sarikaya","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,9,24]]},"reference":[{"key":"3802_CR1","doi-asserted-by":"publisher","DOI":"10.1109\/MRA.2023.3310863","author":"Z Cui","year":"2022","unstructured":"Cui Z, Cartucho J, Giannarou S, Baena FRY (2022) Caveats on the first-generation da vinci research kit: Latent technical constraints and essential calibrations. IEEE Robot Autom Mag. https:\/\/doi.org\/10.1109\/MRA.2023.3310863","journal-title":"IEEE Robot Autom Mag"},{"key":"3802_CR2","doi-asserted-by":"publisher","unstructured":"Chiu Z-Y, Liao AZ, Richter F, Johnson B, Yip MC (2022) Markerless suture needle 6d pose tracking with robust uncertainty estimation for autonomous minimally invasive robotic surgery. In: 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5286\u20135292. https:\/\/doi.org\/10.1109\/IROS47612.2022.9981966","DOI":"10.1109\/IROS47612.2022.9981966"},{"key":"3802_CR3","doi-asserted-by":"publisher","unstructured":"Chiu Z-Y, Liao AZ, Richter F, Johnson B, Yip MC (2022) Markerless suture needle 6d pose tracking with robust uncertainty estimation for autonomous minimally invasive robotic surgery. In: 2022 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 5286\u20135292. https:\/\/doi.org\/10.1109\/IROS47612.2022.9981966","DOI":"10.1109\/IROS47612.2022.9981966"},{"key":"3802_CR4","doi-asserted-by":"publisher","unstructured":"Xu H, Weld A, Xu C, Roddan A, Cartucho J, Karaoglu MA, Ladikos A, Li Y, Li Y, Shen D, al (2025) Surgripe challenge: Benchmark of surgical robot instrument pose estimation. Medical Image Analysis 105, 103674 https:\/\/doi.org\/10.1016\/j.media.2025.103674","DOI":"10.1016\/j.media.2025.103674"},{"key":"3802_CR5","doi-asserted-by":"crossref","unstructured":"Peng S, Liu Y, Huang Q, Zhou X, Bao H (2019) Pvnet: Pixel-wise voting network for 6dof pose estimation. CVPR,","DOI":"10.1109\/CVPR.2019.00469"},{"issue":"6","key":"3802_CR6","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1049\/htl2.12100","volume":"11","author":"H Xu","year":"2024","unstructured":"Xu H, Giannarou S (2024) Occlusion-robust markerless surgical instrument pose estimation. Healthcare Technology Letters 11(6):327\u2013335. https:\/\/doi.org\/10.1049\/htl2.12100","journal-title":"Healthcare Technology Letters"},{"issue":"11","key":"3802_CR7","doi-asserted-by":"publisher","first-page":"3355","DOI":"10.3390\/s24113355","volume":"24","author":"L Hu","year":"2024","unstructured":"Hu L, Feng S, Wang B (2024) Weakly supervised pose estimation of surgical instrument from a single endoscopic image. Sensors 24(11):3355. https:\/\/doi.org\/10.3390\/s24113355","journal-title":"Sensors"},{"key":"3802_CR8","doi-asserted-by":"crossref","unstructured":"Moon S, Son H, Hur D, Kim S (2025) Co-op: Correspondence-based novel object pose estimation. IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp 11622\u201311632","DOI":"10.1109\/CVPR52734.2025.01085"},{"key":"3802_CR9","unstructured":"Hodan T BOP: Benchmark for 6D Object Pose Estimation. https:\/\/bop.felk.cvut.cz\/leaderboards\/"},{"key":"3802_CR10","unstructured":"Liu L, Lin J, Liu Z, Jia K (2025) Picopose: Progressive pixel-to-pixel correspondence learning for novel object pose estimation. arXiv preprint arXiv:2504.02617"},{"key":"3802_CR11","unstructured":"Labb\u00e9 Y, Manuelli L, Mousavian A, Tyree S, Birchfield S, Tremblay J, Carpentier J, Aubry M, Fox D, Sivic J (2022) Megapose: 6d pose estimation of novel objects via render & compare. In: Proceedings of the 6th Conference on Robot Learning (CoRL)"},{"key":"3802_CR12","doi-asserted-by":"crossref","unstructured":"Nguyen VN, Groueix T, Salzmann M, Lepetit V (2024) Gigapose: Fast and robust novel object pose estimation via one correspondence. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition","DOI":"10.1109\/CVPR52733.2024.00945"},{"key":"3802_CR13","doi-asserted-by":"publisher","unstructured":"Moon S, Son H, Hur D, Kim S (2024) Genflow: Generalizable recurrent flow for 6d pose refinement of novel objects. In: Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 10039\u201310049. https:\/\/doi.org\/10.1109\/CVPR52733.2024.00957","DOI":"10.1109\/CVPR52733.2024.00957"},{"issue":"7","key":"3802_CR14","doi-asserted-by":"publisher","first-page":"5742","DOI":"10.1109\/tpami.2025.3553485","volume":"47","author":"X Liu","year":"2025","unstructured":"Liu X, Zhang R, Zhang C, Wang G, Tang J, Li Z, Ji X (2025) Gdrnpp: A geometry-guided and fully learning-based object pose estimator. IEEE Trans Pattern Anal Mach Intell 47(7):5742\u20135759. https:\/\/doi.org\/10.1109\/tpami.2025.3553485","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"3802_CR15","doi-asserted-by":"publisher","unstructured":"Spektor R, Friedman T, Or I, Bolotin G, Laufer S (2025) Monocular pose estimation of articulated open surgery tools\u2013in the wild. Medical Image Analysis 103, 103618 https:\/\/doi.org\/10.1016\/j.media.2025.103618","DOI":"10.1016\/j.media.2025.103618"},{"key":"3802_CR16","doi-asserted-by":"publisher","unstructured":"Hasan MK, Calvet L, Rabbani N, Bartoli A (2021) Detection, segmentation, and 3d pose estimation of surgical tools using convolutional neural networks and algebraic geometry. Medical Image Analysis 70, 101994 https:\/\/doi.org\/10.1016\/j.media.2021.101994","DOI":"10.1016\/j.media.2021.101994"},{"issue":"6","key":"3802_CR17","doi-asserted-by":"publisher","first-page":"327","DOI":"10.1049\/htl2.12100","volume":"11","author":"H Xu","year":"2024","unstructured":"Xu H, Giannarou S (2024) Occlusion?robust markerless surgical instrument pose estimation. Healthcare Technology Letters 11(6):327\u2013335. https:\/\/doi.org\/10.1049\/htl2.12100","journal-title":"Healthcare Technology Letters"},{"key":"3802_CR18","doi-asserted-by":"crossref","unstructured":"Lipson L, Teed Z, Deng J (2021) Raft-stereo: Multilevel recurrent field transforms for stereo matching. In: International Conference on 3D Vision (3DV)","DOI":"10.1109\/3DV53792.2021.00032"},{"key":"3802_CR19","doi-asserted-by":"publisher","unstructured":"Rai U, Xu H, Giannarou S (2025) Surgpose: Generalisable surgical instrument pose estimation using zero-shot learning and stereo vision. In: Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pp. 6875\u20136881. https:\/\/doi.org\/10.1109\/ICRA55743.2025.11128521","DOI":"10.1109\/ICRA55743.2025.11128521"},{"key":"3802_CR20","doi-asserted-by":"crossref","unstructured":"Wen B, Yang W, Kautz J, Birchfield S (2024) FoundationPose: Unified 6d pose estimation and tracking of novel objects. CVPR,","DOI":"10.1109\/CVPR52733.2024.01692"},{"key":"3802_CR21","doi-asserted-by":"crossref","unstructured":"Lin J, Liu L, Lu D, Jia K (2023) Sam-6d: Segment anything model meets zero-shot 6d object pose estimation.arXiv:2311.15707 arXiv preprint","DOI":"10.1109\/CVPR52733.2024.02636"},{"issue":"4","key":"3802_CR22","doi-asserted-by":"publisher","first-page":"1458","DOI":"10.1109\/TMRB.2024.3464089","volume":"6","author":"K Fan","year":"2024","unstructured":"Fan K, Chen Z, Liu Q, Ferrigno G, Momi ED (2024) A reinforcement learning approach for real-time articulated surgical instrument 3-d pose reconstruction. IEEE Transactions on Medical Robotics and Bionics 6(4):1458\u20131467. https:\/\/doi.org\/10.1109\/TMRB.2024.3464089","journal-title":"IEEE Transactions on Medical Robotics and Bionics"},{"key":"3802_CR23","doi-asserted-by":"crossref","unstructured":"Haugaard RL, Buch AG (2022) Surfemb: Dense and continuous correspondence distributions for object pose estimation with learnt surface embeddings. Proceedings of the IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). pp 6749\u20136758","DOI":"10.1109\/CVPR52688.2022.00663"},{"key":"3802_CR24","unstructured":"Bukschat Y, Vetter M (2020) EfficientPose: An efficient, accurate and scalable end-to-end 6D multi object pose estimation approach"},{"key":"3802_CR25","doi-asserted-by":"crossref","unstructured":"Chen L-C, Zhu Y, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation.arXiv:1802.02611","DOI":"10.1007\/978-3-030-01234-2_49"},{"key":"3802_CR26","doi-asserted-by":"publisher","unstructured":"Liu Z, Mao H, Wu C-Y, Feichtenhofer C, Darrell T, Xie S (2022) A convnet for the 2020s. In: 2022 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11966\u201311976. https:\/\/doi.org\/10.1109\/CVPR52688.2022.01167","DOI":"10.1109\/CVPR52688.2022.01167"},{"key":"3802_CR27","doi-asserted-by":"crossref","unstructured":"Shaker A, Maaz M, Rasheed H, Khan S, Yang M-H, Khan FS (2023) Swiftformer: Efficient additive attention for transformer-based real-time mobile vision applications. In: Proceedings of the IEEE\/CVF International Conference on Computer Vision (ICCV)","DOI":"10.1109\/ICCV51070.2023.01598"},{"key":"3802_CR28","doi-asserted-by":"crossref","unstructured":"Xiang Y, Schmidt T, Narayanan V, Fox D (2018) Posecnn: A convolutional neural network for 6d object pose estimation in cluttered scenes","DOI":"10.15607\/RSS.2018.XIV.019"},{"key":"3802_CR29","doi-asserted-by":"publisher","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention (MICCAI). Lecture Notes in Computer Science, vol. 9351, pp. 234\u2013241. Springer, ???. https:\/\/doi.org\/10.1007\/978-3-319-24574-4_28","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"3802_CR30","doi-asserted-by":"publisher","unstructured":"He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770\u2013778. https:\/\/doi.org\/10.1109\/CVPR.2016.90","DOI":"10.1109\/CVPR.2016.90"},{"key":"3802_CR31","unstructured":"Eigen D, Puhrsch C, Fergus R (2014) Depth map prediction from a single image using a multi-scale deep network. CoRR abs\/1406.2283"},{"issue":"2","key":"3802_CR32","doi-asserted-by":"publisher","first-page":"155","DOI":"10.1007\/s10851-009-0161-2","volume":"35","author":"DQ Huynh","year":"2009","unstructured":"Huynh DQ (2009) Metrics for 3d rotations: Comparison and analysis. Journal of Mathematical Imaging and Vision 35(2):155\u2013164. https:\/\/doi.org\/10.1007\/s10851-009-0161-2","journal-title":"Journal of Mathematical Imaging and Vision"},{"issue":"2","key":"3802_CR33","doi-asserted-by":"publisher","first-page":"470","DOI":"10.1109\/TMI.2018.2866442","volume":"38","author":"SS Mohseni Salehi","year":"2019","unstructured":"Mohseni Salehi SS, Khan S, Erdogmus D, Gholipour A (2019) Real-time deep pose estimation with geodesic loss for image-to-template rigid registration. IEEE Trans Med Imaging 38(2):470\u2013481. https:\/\/doi.org\/10.1109\/TMI.2018.2866442","journal-title":"IEEE Trans Med Imaging"},{"key":"3802_CR34","doi-asserted-by":"publisher","unstructured":"Jocher G, Chaurasia A, Stoken A, Borovec J, NanoCode012 Kwon Y, Michael K, Xie T, Fang J, imyhxy Lorna Zeng Y, Wong CVA, Montes D, Wang Z, Fati C, Nadar J, Laughing Jain M (2022) ultralytics\/yolov5: v7.0 - YOLOv5 SOTA Realtime Instance Segmentation. Zenodo. https:\/\/doi.org\/10.5281\/zenodo.7347926","DOI":"10.5281\/zenodo.7347926"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03802-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-026-03802-0","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-026-03802-0.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,9,24]],"date-time":"2026-09-24T11:50:29Z","timestamp":1790250629000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-026-03802-0"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,9,24]]},"references-count":34,"alternative-id":["3802"],"URL":"https:\/\/doi.org\/10.1007\/s11548-026-03802-0","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,9,24]]},"assertion":[{"value":"22 January 2026","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 September 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 September 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors have no relevant conflicts of interest to declare.","order":1,"name":"Ethics","label":"Competing interests","group":{"name":"EthicsHeading","label":"Declarations"}}]}}