{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T17:27:47Z","timestamp":1780507667888,"version":"3.54.1"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T00:00:00Z","timestamp":1716336000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T00:00:00Z","timestamp":1716336000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100020194","name":"Wellcome \/ EPSRC Centre for Interventional and Surgical Sciences","doi-asserted-by":"publisher","award":["203145\/Z\/16\/Z"],"award-info":[{"award-number":["203145\/Z\/16\/Z"]}],"id":[{"id":"10.13039\/501100020194","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000266","name":"Engineering and Physical Sciences Research Council","doi-asserted-by":"publisher","award":["EP\/P027938\/1, EP\/R004080\/1, EP\/P012841\/1"],"award-info":[{"award-number":["EP\/P027938\/1, EP\/R004080\/1, EP\/P012841\/1"]}],"id":[{"id":"10.13039\/501100000266","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Royal Academy of Engineering Chair in Emerging Technologies Scheme","award":["CiET1819\/2\/36"],"award-info":[{"award-number":["CiET1819\/2\/36"]}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Int J CARS"],"abstract":"<jats:title>Abstract<\/jats:title><jats:sec>\n                <jats:title>Purpose<\/jats:title>\n                <jats:p>In robotic-assisted minimally invasive surgery, surgeons often use intra-operative ultrasound to visualise endophytic structures and localise resection margins. This must be performed by a highly skilled surgeon. Automating this subtask may reduce the cognitive load for the surgeon and improve patient outcomes.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Methods<\/jats:title>\n                <jats:p>We demonstrate vision-based shape sensing of the pneumatically attachable flexible (PAF) rail by using colour-dependent image segmentation. The shape-sensing framework is evaluated on known curves ranging from <jats:inline-formula><jats:alternatives><jats:tex-math>$$r = 30$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mi>r<\/mml:mi>\n                      <mml:mo>=<\/mml:mo>\n                      <mml:mn>30<\/mml:mn>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> to <jats:inline-formula><jats:alternatives><jats:tex-math>$$r = 110$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mi>r<\/mml:mi>\n                      <mml:mo>=<\/mml:mo>\n                      <mml:mn>110<\/mml:mn>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> mm, replicating curvatures in a human kidney. The shape sensing is then used to inform path planning of a collaborative robot arm paired with an intra-operative ultrasound probe. We execute 15 autonomous ultrasound scans of a tumour-embedded kidney phantom and retrieve viable ultrasound images, as well as seven freehand ultrasound scans for comparison.\n<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Results<\/jats:title>\n                <jats:p>The vision-based sensor is shown to have comparable sensing accuracy with FBGS-based systems. We find the RMSE of the vision-based shape sensing of the PAF rail compared with ground truth to be <jats:inline-formula><jats:alternatives><jats:tex-math>$$0.4975 \\pm 0.4169$$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\">\n                    <mml:mrow>\n                      <mml:mn>0.4975<\/mml:mn>\n                      <mml:mo>\u00b1<\/mml:mo>\n                      <mml:mn>0.4169<\/mml:mn>\n                    <\/mml:mrow>\n                  <\/mml:math><\/jats:alternatives><\/jats:inline-formula> mm. The ultrasound images acquired by the robot and by the human were evaluated by two independent clinicians. The median score across all criteria for both readers was \u20183\u2014good\u2019 for human and \u20184\u2014very good\u2019 for robot.<\/jats:p>\n              <\/jats:sec><jats:sec>\n                <jats:title>Conclusion<\/jats:title>\n                <jats:p>We have proposed a framework for autonomous intra-operative US scanning using vision-based shape sensing to inform path planning. Ultrasound images were evaluated by clinicians for sharpness of image, clarity of structures visible, and contrast of solid and fluid areas. Clinicians evaluated that robot-acquired images were superior to human-acquired images in all metrics. Future work will translate the framework to a da Vinci surgical robot.<\/jats:p>\n              <\/jats:sec>","DOI":"10.1007\/s11548-024-03178-z","type":"journal-article","created":{"date-parts":[[2024,5,22]],"date-time":"2024-05-22T17:01:36Z","timestamp":1716397296000},"page":"1391-1398","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Autonomous control of an ultrasound probe for intra-operative ultrasonography using vision-based shape sensing of pneumatically attachable flexible rails"],"prefix":"10.1007","volume":"19","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3674-2156","authenticated-orcid":false,"given":"Aoife","family":"McDonald-Bowyer","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tom","family":"Syer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Adam","family":"Retter","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Danail","family":"Stoyanov","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Agostino","family":"Stilli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,5,22]]},"reference":[{"issue":"11","key":"3178_CR1","doi-asserted-by":"publisher","first-page":"1376","DOI":"10.1111\/ijcp.12492","volume":"68","author":"A Hussain","year":"2014","unstructured":"Hussain A, Malik A, Halim MU, Ali AM (2014) The use of robotics in surgery: a review. Int J Clin Pract 68(11):1376\u20131382","journal-title":"Int J Clin Pract"},{"issue":"9","key":"3178_CR2","volume":"14","author":"S Bramhe","year":"2022","unstructured":"Bramhe S, Pathak SS (2022) Robotic surgery: a narrative review. Cureus 14(9):e29179","journal-title":"Cureus"},{"issue":"1","key":"3178_CR3","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1002\/bjs5.50235","volume":"4","author":"NA Soomro","year":"2020","unstructured":"Soomro NA, Hashimoto DA, Porteous AJ, Ridley CJA, Marsh WJ, Ditto R, Roy S (2020) Systematic review of learning curves in robot-assisted surgery. BJS Open 4(1):27\u201344","journal-title":"BJS Open"},{"issue":"4","key":"3178_CR4","doi-asserted-by":"publisher","first-page":"19","DOI":"10.1016\/j.amjsurg.2004.08.020","volume":"188","author":"EJ Hanly","year":"2004","unstructured":"Hanly EJ, Talamini MA (2004) Robotic abdominal surgery. Am J Surg 188(4):19\u201326","journal-title":"Am J Surg"},{"issue":"5","key":"3178_CR5","doi-asserted-by":"publisher","first-page":"815","DOI":"10.1016\/j.eururo.2010.01.011","volume":"57","author":"BM Benway","year":"2010","unstructured":"Benway BM, Bhayani SB, Rogers CG, Porter JR, Buffi NM, Figenshau RS, Mottrie A (2010) Robot-assisted partial nephrectomy: an international experience. Eur Urol 57(5):815\u2013820","journal-title":"Eur Urol"},{"issue":"3","key":"3178_CR6","doi-asserted-by":"publisher","first-page":"455","DOI":"10.1007\/s11255-020-02664-y","volume":"53","author":"Y Sun","year":"2021","unstructured":"Sun Y, Wang W, Zhang Q, Zhao X, Xu L, Guo H (2021) Intraoperative ultrasound: technique and clinical experience in robotic-assisted renal partial nephrectomy for endophytic renal tumors. Int Urol Nephrol 53(3):455\u2013463","journal-title":"Int Urol Nephrol"},{"key":"3178_CR7","doi-asserted-by":"crossref","unstructured":"Ettorre CD, Stilli A, Dwyer G, Neves JB, Tran M, Stoyanov D (2019) Semi-autonomous interventional manipulation using pneumatically attachable flexible rails. In: IEEE international conference on intelligent robots and systems, pp 1347\u20131354","DOI":"10.1109\/IROS40897.2019.8967789"},{"issue":"2","key":"3178_CR8","doi-asserted-by":"publisher","first-page":"1208","DOI":"10.1109\/LRA.2019.2894499","volume":"4","author":"A Stilli","year":"2019","unstructured":"Stilli A, Dimitrakakis E, D\u2019ettorre C, Tran M, Stoyanov D (2019) Pneumatically attachable flexible rails for track-guided ultrasound scanning in robotic-assisted partial nephrectomy - a preliminary design study. IEEE Robot Autom Lett 4(2):1208\u20131215","journal-title":"IEEE Robot Autom Lett"},{"key":"3178_CR9","doi-asserted-by":"publisher","first-page":"1099275","DOI":"10.3389\/frobt.2022.1099275","volume":"9","author":"A McDonald-Bowyer","year":"2023","unstructured":"McDonald-Bowyer A, Dietsch S, Dimitrakakis E, Coote JM, Lindenroth L, Stoyanov D, Stilli A (2023) Organ curvature sensing using pneumatically attachable flexible rails in robotic-assisted laparoscopic surgery. Front Robot AI 9:1099275","journal-title":"Front Robot AI"},{"key":"3178_CR10","doi-asserted-by":"crossref","unstructured":"Mcdonald-Bowyer A, Dietsch S, Dimitrakakis E, Coote J, Lindenroth L, Stoyanov D, Stilli A, Mcdonald-Bowyer A, Dietsch S, Dimitrakakis E, Coote J, Lindenroth L, Stoyanov D, Stilli A (2022) Towards autonomous robotic ultrasound scanning using pneumatically attachable flexible rails. EasyChair","DOI":"10.31256\/HSMR2022.19"},{"key":"3178_CR11","doi-asserted-by":"crossref","unstructured":"Dietsch S, McDonald-Bowyer A, Dimitrakakis E, Coote JM, Lindenroth L, Stilli A, Stoyanov D (2022) Localization of interaction using fibre-optic shape sensing in soft-robotic surgery tools. In: IEEE international conference on intelligent robots and systems 2022-October, pp 8057\u20138063","DOI":"10.1109\/IROS47612.2022.9981765"},{"issue":"3","key":"3178_CR12","doi-asserted-by":"publisher","first-page":"285","DOI":"10.1016\/S1361-8415(99)80025-5","volume":"3","author":"F Pierrot","year":"1999","unstructured":"Pierrot F, Dombre E, D\u00e9goulange E, Urbain L, Caron P, Boudet S, Gari\u00e9py J, M\u00e9gnien JL (1999) Hippocrate: a safe robot arm for medical applications with force feedback. Med Image Anal 3(3):285\u2013300. https:\/\/doi.org\/10.1016\/S1361-8415(99)80025-5","journal-title":"Med Image Anal"},{"key":"3178_CR13","doi-asserted-by":"publisher","unstructured":"Elek R, Nagy TD, Nagy DA, Takacs B, Galambos P, Rudas I, Haidegger T (2017) Robotic platforms for ultrasound diagnostics and treatment. In: 2017 IEEE international conference on systems, man, and cybernetics, SMC 2017 2017-January, 1752\u20131757 . https:\/\/doi.org\/10.1109\/SMC.2017.8122869","DOI":"10.1109\/SMC.2017.8122869"},{"issue":"2","key":"3178_CR14","doi-asserted-by":"publisher","first-page":"3671","DOI":"10.1109\/LRA.2021.3064283","volume":"6","author":"Y Huang","year":"2021","unstructured":"Huang Y, Xiao W, Wang C, Liu H, Huang R, Sun Z (2021) Towards fully autonomous ultrasound scanning robot with imitation learning based on clinical protocols. IEEE Robot Autom Lett 6(2):3671\u20133678. https:\/\/doi.org\/10.1109\/LRA.2021.3064283","journal-title":"IEEE Robot Autom Lett"},{"key":"3178_CR15","doi-asserted-by":"publisher","unstructured":"Pratt P, Hughes-Hallett A, Zhang L, Patel N, Mayer E, Darzi A, Yang GZ (2015) Autonomous ultrasound-guided tissue dissection. Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics) 9349:249\u2013257. https:\/\/doi.org\/10.1007\/978-3-319-24553-9_31\/COVER","DOI":"10.1007\/978-3-319-24553-9_31\/COVER"},{"issue":"2","key":"3178_CR16","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1109\/TBME.2015.2453173","volume":"63","author":"C Schneider","year":"2016","unstructured":"Schneider C, Nguan C, Rohling R, Salcudean S (2016) Tracked \u201cpick-Up\u2019\u2019 ultrasound for robot-assisted minimally invasive surgery. IEEE Trans Biomed Eng 63(2):260\u2013268. https:\/\/doi.org\/10.1109\/TBME.2015.2453173","journal-title":"IEEE Trans Biomed Eng"},{"key":"3178_CR17","doi-asserted-by":"publisher","DOI":"10.3389\/frobt.2022.940062","volume":"9","author":"N Marahrens","year":"2022","unstructured":"Marahrens N, Scaglioni B, Jones D, Prasad R, Biyani CS, Valdastri P (2022) Towards autonomous robotic minimally invasive ultrasound scanning and vessel reconstruction on non-planar surfaces. Front Robot AI 9:940062","journal-title":"Front Robot AI"},{"key":"3178_CR18","doi-asserted-by":"publisher","unstructured":"Jiang Z, Li Z, Grimm M, Zhou M, Esposito M, Wein W, Stechele W, Wendler T, Navab N (2022) Autonomous robotic screening of tubular structures based only on real-time ultrasound imaging feedback. IEEE Trans Ind Electron 69(7), 7064\u20137075. arXiv:2011.00099. https:\/\/doi.org\/10.1109\/TIE.2021.3095787","DOI":"10.1109\/TIE.2021.3095787"},{"key":"3178_CR19","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2023.126790","volume":"559","author":"Q Huang","year":"2023","unstructured":"Huang Q, Zhou J, Li Z (2023) Review of robot-assisted medical ultrasound imaging systems: technology and clinical applications. Neurocomputing 559:126790","journal-title":"Neurocomputing"},{"key":"3178_CR20","doi-asserted-by":"crossref","unstructured":"Camarillo DB, Loewke KE, Carlson CR, Salisbury JK (2008) Vision based 3-D shape sensing of flexible manipulators. In: Proceedings - IEEE international conference on robotics and automation, pp 2940\u20132947","DOI":"10.1109\/ROBOT.2008.4543656"},{"issue":"9","key":"3178_CR21","doi-asserted-by":"publisher","first-page":"795","DOI":"10.1177\/02783640022067184","volume":"19","author":"NJ Ferrier","year":"2000","unstructured":"Ferrier NJ, Brockett RW (2000) Reconstructing the shape of a deformable membrane from image data. Int J Robot Res 19(9):795\u2013816","journal-title":"Int J Robot Res"},{"issue":"3","key":"3178_CR22","doi-asserted-by":"publisher","first-page":"5296","DOI":"10.3390\/s140305296","volume":"14","author":"S Stassi","year":"2014","unstructured":"Stassi S, Cauda V, Canavese G, Pirri CF (2014) Flexible tactile sensing based on piezoresistive composites: a review. Sensors 14(3):5296\u20135332","journal-title":"Sensors"},{"key":"3178_CR23","doi-asserted-by":"publisher","DOI":"10.1088\/0964-1726\/24\/12\/125024","volume":"24","author":"S Sareh","year":"2015","unstructured":"Sareh S, Noh Y, Li M, Ranzani T, Liu H, Althoefer K (2015) Macrobend optical sensing for pose measurement in soft robot arms. Smart Mater Struct 24:125024","journal-title":"Smart Mater Struct"},{"issue":"8","key":"3178_CR24","doi-asserted-by":"publisher","first-page":"4565","DOI":"10.1109\/JSEN.2015.2424228","volume":"15","author":"S Song","year":"2015","unstructured":"Song S, Li Z, Yu H, Ren H (2015) Electromagnetic positioning for tip tracking and shape sensing of flexible robots. IEEE Sens J 15(8):4565\u20134575","journal-title":"IEEE Sens J"},{"key":"3178_CR25","doi-asserted-by":"crossref","unstructured":"Kamiyama K, Vlack K, Mizota T, Kajimoto H, Kawakami N, Tachi S (2005) Vision-based sensor for real-time measuring of surface traction fields. IEEE Comput Graphics Appl 25(1):68\u201375","DOI":"10.1109\/MCG.2005.27"},{"key":"3178_CR26","doi-asserted-by":"crossref","unstructured":"Chorley C, Melhuish C, Pipe T, Rossiter J (2010) Tactile edge detection. In: Proceedings of IEEE sensors, pp 2593\u20132598","DOI":"10.1109\/ICSENS.2010.5690181"},{"issue":"2","key":"3178_CR27","doi-asserted-by":"publisher","first-page":"3382","DOI":"10.1109\/LRA.2020.2975709","volume":"5","author":"R Wang","year":"2020","unstructured":"Wang R, Wang S, Du S, Xiao E, Yuan W, Feng C (2020) Real-time soft body 3D proprioception via deep vision-based sensing. IEEE Robot Autom Lett 5(2):3382\u20133389","journal-title":"IEEE Robot Autom Lett"},{"key":"3178_CR28","doi-asserted-by":"crossref","unstructured":"Zhang Z, Dequidt J, Duriez C (2018) Vision-based sensing of external forces acting on soft robots using finite element method. IEEE Robot Autom Lett 3(3):1529\u20131536","DOI":"10.1109\/LRA.2018.2800781"},{"key":"3178_CR29","unstructured":"Stilli A, Dimitrakakis E, Tran M, Stoyanov D (2018) Track-guided ultrasound scanning for tumour margins outlining in robot-assisted partial nephrectomy. In: Althoefer K, Vander Poorten E (eds) Proceedings of the 8th joint workshop on new technology for computer\/robot assisted surgery (CRAS). CRAS, London (2018)"},{"issue":"7","key":"3178_CR30","doi-asserted-by":"publisher","first-page":"1075","DOI":"10.1007\/s11548-020-02180-5","volume":"15","author":"S Thompson","year":"2020","unstructured":"Thompson S, Dowrick T, Ahmad M, Xiao G, Koo B, Bonmati E, Kahl K, Clarkson MJ (2020) SciKit-surgery: compact libraries for surgical navigation. Int J Comput Assist Radiol Surg 15(7):1075\u20131084","journal-title":"Int J Comput Assist Radiol Surg"},{"issue":"1","key":"3178_CR31","doi-asserted-by":"publisher","first-page":"154","DOI":"10.24908\/pocus.v7i1.15052","volume":"7","author":"N Salimi","year":"2022","unstructured":"Salimi N, Gonzalez-Fiol A, Yanez D, Fardelmann K, Harmon E, Kohari K, Abdel-Razeq S, Magriples U, Alian A (2022) Ultrasound image quality comparison between a handheld ultrasound transducer and mid-range ultrasound machine. POCUS J 7(1):154\u2013159","journal-title":"POCUS J"}],"container-title":["International Journal of Computer Assisted Radiology and Surgery"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03178-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11548-024-03178-z\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11548-024-03178-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,7,8]],"date-time":"2024-07-08T17:16:43Z","timestamp":1720459003000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11548-024-03178-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,22]]},"references-count":31,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2024,7]]}},"alternative-id":["3178"],"URL":"https:\/\/doi.org\/10.1007\/s11548-024-03178-z","relation":{},"ISSN":["1861-6429"],"issn-type":[{"value":"1861-6429","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,22]]},"assertion":[{"value":"3 March 2024","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 May 2024","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"22 May 2024","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that they have no conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}},{"value":"This article does not contain any studies with human participants or animals performed by any of the authors.","order":3,"name":"Ethics","group":{"name":"EthicsHeading","label":"Ethical approval"}},{"value":"Not applicable.","order":4,"name":"Ethics","group":{"name":"EthicsHeading","label":"Consent"}}]}}