{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,23]],"date-time":"2026-07-23T15:36:01Z","timestamp":1784820961634,"version":"3.55.0"},"reference-count":30,"publisher":"Springer Science and Business Media LLC","issue":"10","license":[{"start":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T00:00:00Z","timestamp":1750723200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T00:00:00Z","timestamp":1750723200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004721","name":"The University of Tokyo","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100004721","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"Abstract<\/jats:title>\n \n Purpose<\/jats:title>\n Robotic microsurgery enhances the dexterity and stability of the surgeon to perform precise and delicate surgical procedures at microscopic level. Accurate needle pose estimation is critical for robotic micro-suturing, enabling optimized insertion trajectories and facilitating autonomous control. However, accurately estimating the pose of a needle during manipulation, particularly under monocular vision, remains a challenge. This study proposes a convolutional neural network-based method to estimate the pose of a suture needle from monocular images.<\/jats:p>\n <\/jats:sec>\n \n Methods<\/jats:title>\n The 3D pose of the needle is estimated using keypoints information from 2D images. A convolutional neural network was trained to estimate the positions of keypoints on the needle, specifically the tip, middle and end point. A hybrid dataset comprising images from both real-world and synthetic simulated environments was developed to train the model. Subsequently, an algorithm was designed to estimate the 3D positions of these keypoints. The 2D keypoint detection and 3D orientation estimation were evaluated by translation and orientation error metrics, respectively.<\/jats:p>\n <\/jats:sec>\n \n Results<\/jats:title>\n Experiments conducted on synthetic data showed that the average translation error of tip point, middle point and end point being 0.107 mm, 0.118 mm and 0.098 mm, and the average orientation angular error was 12.75\n \n $$^{\\circ }$$<\/jats:tex-math>\n \n \n \n \n \u2218<\/mml:mo>\n <\/mml:mmultiscripts>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula> for normal vector and 15.55\n \n $$^{\\circ }$$<\/jats:tex-math>\n \n \n \n \n \u2218<\/mml:mo>\n <\/mml:mmultiscripts>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula> for direction vector. When evaluated on real data, the method demonstrated 2D translation errors averaging 0.047 mm, 0.052 mm and 0.049 mm for the respective keypoints, with 93.85% of detected keypoints having errors below 4 pixels.<\/jats:p>\n <\/jats:sec>\n \n Conclusions<\/jats:title>\n This study presents a CNN-based method, augmented with synthetic images, to estimate the pose of a suture needle in monocular vision. Experimental results indicate that the method effectively estimates the 2D positions and 3D orientations of the suture needle in synthetic images. The model also shows reasonable performance with real data, highlighting its promise for real-time application in robotic microsurgery.<\/jats:p>\n <\/jats:sec>","DOI":"10.1007\/s11548-025-03467-1","type":"journal-article","created":{"date-parts":[[2025,6,24]],"date-time":"2025-06-24T02:31:23Z","timestamp":1750732283000},"page":"2019-2030","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Monocular suture needle pose detection using synthetic data augmented convolutional neural network"],"prefix":"10.1007","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0009-0004-2869-1736","authenticated-orcid":false,"given":"Yifan","family":"Wang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Saul Alexis Heredia","family":"Perez","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kanako","family":"Harada","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2025,6,24]]},"reference":[{"issue":"20","key":"3467_CR1","doi-asserted-by":"publisher","first-page":"8503","DOI":"10.3390\/s23208503","volume":"23","author":"T Wang","year":"2023","unstructured":"Wang T, Li H, Pu T, Yang L (2023) Microsurgery robots: applications, design, and development. Sensors 23(20):8503","journal-title":"Sensors"},{"key":"3467_CR2","doi-asserted-by":"crossref","unstructured":"Schwaner KL, Dall\u2019Alba D, Jensen PT, Fiorini P, Savarimuthu TR (2021) Autonomous needle manipulation for robotic surgical suturing based on skills learned from demonstration. In: 2021 IEEE 17th international conference on automation science and engineering (CASE). IEEE, pp 235\u2013241","DOI":"10.1109\/CASE49439.2021.9551569"},{"issue":"2","key":"3467_CR3","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1109\/TRO.2020.3031236","volume":"37","author":"SA Pedram","year":"2020","unstructured":"Pedram SA, Shin C, Ferguson PW, Ma J, Dutson EP, Rosen J (2020) Autonomous suturing framework and quantification using a cable-driven surgical robot. IEEE Trans Robot 37(2):404\u2013417","journal-title":"IEEE Trans Robot"},{"issue":"2","key":"3467_CR4","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1109\/TASE.2016.2515161","volume":"13","author":"T Liu","year":"2016","unstructured":"Liu T, Cavusoglu MC (2016) Needle grasp and entry port selection for automatic execution of suturing tasks in robotic minimally invasive surgery. IEEE Trans Autom Sci Eng 13(2):552\u2013563","journal-title":"IEEE Trans Autom Sci Eng"},{"key":"3467_CR5","doi-asserted-by":"crossref","unstructured":"Wilcox A, Kerr J, Thananjeyan B, Ichnowski J, Hwang M, Paradis S, Fer D, Goldberg K (2022) Learning to localize, grasp, and hand over unmodified surgical needles. In: 2022 international conference on robotics and automation (ICRA). IEEE, pp 9637\u20139643","DOI":"10.1109\/ICRA46639.2022.9812393"},{"issue":"3","key":"3467_CR6","doi-asserted-by":"publisher","first-page":"2669","DOI":"10.1109\/LRA.2019.2913082","volume":"4","author":"F Zhong","year":"2019","unstructured":"Zhong F, Wang Y, Wang Z, Liu Y-H (2019) Dual-arm robotic needle insertion with active tissue deformation for autonomous suturing. IEEE Robot Autom Lett 4(3):2669\u20132676","journal-title":"IEEE Robot Autom Lett"},{"key":"3467_CR7","doi-asserted-by":"crossref","unstructured":"Jackson RC, Desai V, Castillo JP, \u00c7avu\u015fo\u011flu MC (2016) Needle-tissue interaction force state estimation for robotic surgical suturing. In: 2016 IEEE\/RSJ international conference on intelligent robots and systems (IROS). IEEE, pp 3659\u20133664","DOI":"10.1109\/IROS.2016.7759539"},{"issue":"2","key":"3467_CR8","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1093\/asj\/sjz036","volume":"39","author":"M Byrne","year":"2019","unstructured":"Byrne M, Aly A (2019) The surgical suture. Aesthet Surg J 39(2):67\u201372","journal-title":"Aesthet Surg J"},{"key":"3467_CR9","doi-asserted-by":"publisher","first-page":"60","DOI":"10.1016\/j.surge.2023.10.001","volume":"22","author":"ME McMahon","year":"2023","unstructured":"McMahon ME, O\u2019Brien L, Heary T, Potter S, O\u2019Sullivan B (2023) Management of the intraoperative loss of microsurgical needles: a literature review and clinical survey. Surgeon 22:60","journal-title":"Surgeon"},{"key":"3467_CR10","doi-asserted-by":"crossref","unstructured":"Andersen JKH, Schwaner KL, Savarimuthu TR (2021) Real-time segmentation of surgical tools and needle using a mobile-u-net. In: 2021 20th international conference on advanced robotics (ICAR). IEEE, pp 148\u2013154","DOI":"10.1109\/ICAR53236.2021.9659326"},{"key":"3467_CR11","first-page":"70","volume-title":"Medical imaging 2015: image-guided procedures, robotic interventions, and modeling","author":"S Speidel","year":"2015","unstructured":"Speidel S, Kroehnert A, Bodenstedt S, Kenngott H, Mueller-Stich B, Dillmann R (2015) Image-based tracking of the suturing needle during laparoscopic interventions. Medical imaging 2015: image-guided procedures, robotic interventions, and modeling, vol 9415. SPIE, Bellingham, pp 70\u201375"},{"key":"3467_CR12","doi-asserted-by":"crossref","unstructured":"\u00d6zg\u00fcner O, Hao R, Jackson RC, Shkurti T, Newman W, Cavusoglu MC (2018) Three-dimensional surgical needle localization and tracking using stereo endoscopic image streams. In: 2018 IEEE international conference on robotics and automation (ICRA). IEEE, pp 6617\u20136624","DOI":"10.1109\/ICRA.2018.8460867"},{"key":"3467_CR13","first-page":"698","volume-title":"Medical imaging 2018: image-guided procedures, robotic interventions, and modeling","author":"Y Chen","year":"2018","unstructured":"Chen Y, Marinho MM, Kurose Y, Nakazawa A, Deie K, Harada K, Mitsuishi M (2018) Towards robust needle segmentation and tracking in pediatric endoscopic surgery. Medical imaging 2018: image-guided procedures, robotic interventions, and modeling, vol 10576. SPIE, Bellingham, pp 698\u2013705"},{"key":"3467_CR14","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1007\/s11548-019-02050-9","volume":"15","author":"A Nakazawa","year":"2020","unstructured":"Nakazawa A, Harada K, Mitsuishi M, Jannin P (2020) Real-time surgical needle detection using region-based convolutional neural networks. Int J Comput Assist Radiol Surg 15:41\u201347","journal-title":"Int J Comput Assist Radiol Surg"},{"key":"3467_CR15","doi-asserted-by":"crossref","unstructured":"Jiang Y, Zhou H, Fischer GS (2023) Markerless suture needle tracking from a robotic endoscope based on deep learning. In: 2023 international symposium on medical robotics (ISMR). IEEE, pp 1\u20137","DOI":"10.1109\/ISMR57123.2023.10130199"},{"key":"3467_CR16","doi-asserted-by":"crossref","unstructured":"Ronneberger O, Fischer P, Brox T (2015) U-net: convolutional networks for biomedical image segmentation. In: Medical image computing and computer-assisted intervention\u2013MICCAI 2015: 18th international conference, Munich, Germany, October 5\u20139, 2015, proceedings, Part III 18. Springer, pp 234\u2013241","DOI":"10.1007\/978-3-319-24574-4_28"},{"issue":"1","key":"3467_CR17","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3603618","volume":"56","author":"C Zheng","year":"2023","unstructured":"Zheng C, Wu W, Chen C, Yang T, Zhu S, Shen J, Kehtarnavaz N, Shah M (2023) Deep learning-based human pose estimation: a survey. ACM Comput Surv 56(1):1\u201337","journal-title":"ACM Comput Surv"},{"key":"3467_CR18","unstructured":"Tompson JJ, Jain A, LeCun Y, Bregler C (2014) Joint training of a convolutional network and a graphical model for human pose estimation. In: Advances in neural information processing systems, vol 27"},{"key":"3467_CR19","doi-asserted-by":"crossref","unstructured":"Frid-Adar M, Klang E, Amitai M, Goldberger J, Greenspan H (2018) Synthetic data augmentation using GAN for improved liver lesion classification. In: 2018 IEEE 15th international symposium on biomedical imaging (ISBI 2018). IEEE, pp 289\u2013293","DOI":"10.1109\/ISBI.2018.8363576"},{"key":"3467_CR20","doi-asserted-by":"crossref","unstructured":"Bongini F, Berlincioni L, Bertini M, Del\u00a0Bimbo A (2021) Partially fake it till you make it: mixing real and fake thermal images for improved object detection. In: Proceedings of the 29th ACM international conference on multimedia, pp 5482\u20135490","DOI":"10.1145\/3474085.3475679"},{"issue":"1","key":"3467_CR21","doi-asserted-by":"publisher","first-page":"281","DOI":"10.3390\/app12010281","volume":"12","author":"J Jang","year":"2021","unstructured":"Jang J, Lee H, Kim J-C (2021) Carfree: hassle-free object detection dataset generation using Carla autonomous driving simulator. Appl Sci 12(1):281","journal-title":"Appl Sci"},{"key":"3467_CR22","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11633-022-1411-7","volume":"21","author":"A Mumuni","year":"2024","unstructured":"Mumuni A, Mumuni F, Gerrar NK (2024) A survey of synthetic data augmentation methods in machine vision. Mach Intell Res 21:1\u201339","journal-title":"Mach Intell Res"},{"issue":"2","key":"3467_CR23","doi-asserted-by":"publisher","first-page":"180","DOI":"10.1002\/rcs.1434","volume":"9","author":"M Mitsuishi","year":"2013","unstructured":"Mitsuishi M, Morita A, Sugita N, Sora S, Mochizuki R, Tanimoto K, Baek YM, Takahashi H, Harada K (2013) Master-slave robotic platform and its feasibility study for micro-neurosurgery. Int J Med Robot Comput Assist Surg 9(2):180\u2013189","journal-title":"Int J Med Robot Comput Assist Surg"},{"key":"3467_CR24","doi-asserted-by":"crossref","unstructured":"Silva AJ, Ramirez OAD, Vega VP, Oliver JPO (2009) Phantom omni haptic device: kinematic and manipulability. In: 2009 electronics, robotics and automotive mechanics conference (CERMA). IEEE, pp 193\u2013198","DOI":"10.1109\/CERMA.2009.55"},{"key":"3467_CR25","doi-asserted-by":"crossref","unstructured":"Terven J, Cordova-Esparza D-M, Romero-Gonz\u00e1lez J-A, Ram\u00edrez-Pedraza A, Ch\u00e1vez-Urbiola E (2025) A comprehensive survey of loss functions and metrics in deep learning. Artif Intell Rev 58(7):195","DOI":"10.1007\/s10462-025-11198-7"},{"key":"3467_CR26","unstructured":"Diederik K (2014) Adam: a method for stochastic optimization (No Title)"},{"issue":"12","key":"3467_CR27","doi-asserted-by":"publisher","first-page":"2878","DOI":"10.1109\/TPAMI.2012.261","volume":"35","author":"Y Yang","year":"2012","unstructured":"Yang Y, Ramanan D (2012) Articulated human detection with flexible mixtures of parts. IEEE Trans Pattern Anal Mach Intell 35(12):2878\u20132890","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"issue":"5","key":"3467_CR28","doi-asserted-by":"publisher","first-page":"865","DOI":"10.1016\/j.eururo.2008.09.045","volume":"56","author":"SG Kroeze","year":"2009","unstructured":"Kroeze SG, Mayer EK, Chopra S, Aggarwal R, Darzi A, Patel A (2009) Assessment of laparoscopic suturing skills of urology residents: a pan-European study. Eur Urol 56(5):865\u2013873","journal-title":"Eur Urol"},{"key":"3467_CR29","doi-asserted-by":"crossref","unstructured":"Guni A, Raison N, Challacombe B, Khan S, Dasgupta P, Ahmed K (2018) Development of a technical checklist for the assessment of suturing in robotic surgery. Surg Endosc 32:4402\u20134407","DOI":"10.1007\/s00464-018-6407-6"},{"key":"3467_CR30","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1016\/j.neucom.2020.12.089","volume":"438","author":"Y Ming","year":"2021","unstructured":"Ming Y, Meng X, Fan C, Yu H (2021) Deep learning for monocular depth estimation: a review. Neurocomputing 438:14\u201333","journal-title":"Neurocomputing"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03467-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-025-03467-1\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-025-03467-1.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T17:09:12Z","timestamp":1760375352000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-025-03467-1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6,24]]},"references-count":30,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["3467"],"URL":"https:\/\/doi.org\/10.1007\/s11548-025-03467-1","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6,24]]},"assertion":[{"value":"27 December 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"9 June 2025","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 June 2025","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}