{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T17:23:33Z","timestamp":1780507413669,"version":"3.54.1"},"reference-count":33,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2024,5,7]],"date-time":"2024-05-07T00:00:00Z","timestamp":1715040000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Robot. AI"],"abstract":"<jats:p>In traditional cardiac ultrasound diagnostics, the process of planning scanning paths and adjusting the ultrasound window relies solely on the experience and intuition of the physician, a method that not only affects the efficiency and quality of cardiac imaging but also increases the workload for physicians. To overcome these challenges, this study introduces a robotic system designed for autonomous cardiac ultrasound scanning, with the goal of advancing both the degree of automation and the quality of imaging in cardiac ultrasound examinations. The system achieves autonomous functionality through two key stages: initially, in the autonomous path planning stage, it utilizes a camera posture adjustment method based on the human body\u2019s central region and its planar normal vectors to achieve automatic adjustment of the camera\u2019s positioning angle; precise segmentation of the human body point cloud is accomplished through efficient point cloud processing techniques, and precise localization of the region of interest (ROI) based on keypoints of the human body. Furthermore, by applying isometric path slicing and B-spline curve fitting techniques, it independently plans the scanning path and the initial position of the probe. Subsequently, in the autonomous scanning stage, an innovative servo control strategy based on cardiac image edge correction is introduced to optimize the quality of the cardiac ultrasound window, integrating position compensation through admittance control to enhance the stability of autonomous cardiac ultrasound imaging, thereby obtaining a detailed view of the heart\u2019s structure and function. A series of experimental validations on human and cardiac models have assessed the system\u2019s effectiveness and precision in the correction of camera pose, planning of scanning paths, and control of cardiac ultrasound imaging quality, demonstrating its significant potential for clinical ultrasound scanning applications.<\/jats:p>","DOI":"10.3389\/frobt.2024.1383732","type":"journal-article","created":{"date-parts":[[2024,5,7]],"date-time":"2024-05-07T04:38:01Z","timestamp":1715056681000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":9,"title":["Autonomous ultrasound scanning robotic system based on human posture recognition and image servo control: an application for cardiac imaging"],"prefix":"10.3389","volume":"11","author":[{"given":"Xiuhong","family":"Tang","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hongbo","family":"Wang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jingjing","family":"Luo","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinlei","family":"Jiang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fan","family":"Nian","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lizhe","family":"Qi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lingfeng","family":"Sang","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhongxue","family":"Gan","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2024,5,7]]},"reference":[{"key":"B1","first-page":"3441","article-title":"Confidence-driven control of an ultrasound probe: target-specific acoustic window optimization","author":"Chatelain","year":"2016"},{"key":"B2","doi-asserted-by":"publisher","first-page":"1410","DOI":"10.1109\/TRO.2017.2723618","article-title":"Confidence-driven control of an ultrasound probe","volume":"33","author":"Chatelain","year":"2017","journal-title":"Ieee T Robot."},{"key":"B3","unstructured":"HigherHRNet: scale-aware representation learning for bottom-up human pose estimation\n            ChengB.\n            XiaoB.\n            WangJ.\n            ShiH.\n            HuangT. S.\n            ZhangL.\n          2020"},{"key":"B4","doi-asserted-by":"publisher","first-page":"1056055","DOI":"10.3389\/fcvm.2023.1056055","article-title":"Assisted probe guidance in cardiac ultrasound: a review","volume":"10","author":"Ferraz","year":"2023","journal-title":"Front. Cardiovasc Med."},{"key":"B5","first-page":"736","article-title":"Robotic ultrasound trajectory planning for volume of interest coverage","author":"Graumann","year":"2016"},{"key":"B6","doi-asserted-by":"publisher","first-page":"307","DOI":"10.1007\/s13534-023-00338-z","article-title":"Development and preliminary testing of a prior knowledge-based visual navigation system for cardiac ultrasound scanning","volume":"14","author":"Hao","year":"2024","journal-title":"Biomed. Eng. Lett."},{"key":"B7","doi-asserted-by":"publisher","first-page":"1173","DOI":"10.1109\/TII.2018.2871864","article-title":"Robotic arm based automatic ultrasound scanning for three-dimensional imaging","volume":"15","author":"Huang","year":"2019","journal-title":"IEEE Trans. Industrial Inf."},{"key":"B8","doi-asserted-by":"publisher","first-page":"426","DOI":"10.1109\/TBCAS.2017.2782815","article-title":"Fully automatic three-dimensional ultrasound imaging based on conventional B-scan","volume":"12","author":"Huang","year":"2018","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"B9","doi-asserted-by":"publisher","first-page":"094002","DOI":"10.1088\/1361-6560\/abf277","article-title":"Towards automated ultrasound imaging\u2014robotic image acquisition in liver and prostate for long-term motion monitoring","volume":"66","author":"Ipsen","year":"2021","journal-title":"Phys. Med. Biol."},{"key":"B10","doi-asserted-by":"publisher","first-page":"62","DOI":"10.3390\/act13020062","article-title":"Force tracking control method for robotic ultrasound scanning system under soft uncertain environment","volume":"13","author":"Jiang","year":"2024","journal-title":"Actuators"},{"key":"B11","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1109\/TIM.2022.3200360","article-title":"Precise repositioning of robotic ultrasound: improving registration-based motion compensation using ultrasound confidence optimization","volume":"71","author":"Jiang","year":"2022","journal-title":"IEEE Trans. Instrum. Meas."},{"key":"B12","doi-asserted-by":"publisher","first-page":"1342","DOI":"10.1109\/LRA.2020.2967682","article-title":"Automatic normal positioning of robotic ultrasound probe based only on confidence map optimization and force measurement","volume":"5","author":"Jiang","year":"2020","journal-title":"IEEE Robotics Automation Lett."},{"key":"B13","doi-asserted-by":"publisher","first-page":"102878","DOI":"10.1016\/j.media.2023.102878","article-title":"Robotic ultrasound imaging: state-of-the-art and future perspectives","volume":"89","author":"Jiang","year":"2023","journal-title":"Med. Image Anal."},{"key":"B14","doi-asserted-by":"publisher","first-page":"1003","DOI":"10.1007\/s11548-017-1561-1","article-title":"On the reproducibility of expert-operated and robotic ultrasound acquisitions","volume":"12","author":"Kojcev","year":"2017","journal-title":"Int. J. CARS"},{"key":"B15","first-page":"1","article-title":"Automatic three-dimensional ultrasound scanning system based on RGB-D camera","author":"Lan","year":"2018"},{"key":"B16","doi-asserted-by":"publisher","first-page":"116","DOI":"10.1007\/s40846-017-0292-7","article-title":"Automated conformal ultrasound scanning for breast screening","volume":"38","author":"Lee","year":"2018","journal-title":"J. Med. Biol. Eng."},{"key":"B17","doi-asserted-by":"publisher","first-page":"510","DOI":"10.1109\/TMRB.2021.3072190","article-title":"An overview of systems and techniques for autonomous robotic ultrasound acquisitions","volume":"3","author":"Li","year":"2021","journal-title":"IEEE Trans. Med. Robotics Bionics"},{"key":"B18","doi-asserted-by":"crossref","DOI":"10.1109\/IROS51168.2021.9635902","article-title":"Autonomous scanning target localization for robotic lung ultrasound imaging","author":"Ma","year":"2021"},{"key":"B19","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1109\/MRA.2005.1577023","article-title":"ViSP for visual servoing: a generic software platform with a wide class of robot control skills","volume":"12","author":"Marchand","year":"2005","journal-title":"IEEE Robotics Automation Mag."},{"key":"B20","first-page":"804","article-title":"Development of robotic system for autonomous liver screening using ultrasound scanning device","author":"Mustafa","year":"2013"},{"key":"B21","doi-asserted-by":"publisher","first-page":"449","DOI":"10.1007\/s11548-023-03019-5","article-title":"Rib region detection for scanning path planning for fully automated robotic abdominal ultrasonography","volume":"19","author":"Okuzaki","year":"2024","journal-title":"Int. J. Comput. Ass Rad."},{"key":"B22","doi-asserted-by":"publisher","first-page":"863","DOI":"10.1109\/TMRB.2022.3201651","article-title":"Robotic ultrasonography for autonomous non-invasive diagnosis\u2014a systematic literature review","volume":"4","author":"Roshan","year":"2022","journal-title":"IEEE Trans. Med. Robotics Bionics"},{"key":"B23","doi-asserted-by":"publisher","first-page":"15008","DOI":"10.1038\/s41598-023-42263-2","article-title":"An AI-powered navigation framework to achieve an automated acquisition of cardiac ultrasound images","volume":"13","author":"Soemantoro","year":"2023","journal-title":"Sci. Rep-uk"},{"key":"B24","doi-asserted-by":"publisher","first-page":"67456","DOI":"10.1109\/ACCESS.2021.3077037","article-title":"RobUSt\u2013an autonomous robotic ultrasound system for medical imaging","volume":"9","author":"Suligoj","year":"2021","journal-title":"IEEE Access"},{"key":"B25","doi-asserted-by":"publisher","first-page":"976","DOI":"10.1109\/TMRB.2022.3214493","article-title":"Automatic generation of autonomous ultrasound scanning trajectory based on 3-D point cloud","volume":"4","author":"Tan","year":"2022","journal-title":"IEEE Trans. Med. Robotics Bionics"},{"key":"B26","first-page":"669","article-title":"Point cloud segmentation of breast ultrasound regions to be scanned by fusing 2D image instance segmentation and keypoint detection","author":"Tan","year":"2023"},{"key":"B27","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s43154-020-00037-y","article-title":"Medical robotics for ultrasound imaging: current systems and future trends","volume":"2","author":"von Haxthausen","year":"2021","journal-title":"Curr. Robot. Rep."},{"key":"B28","doi-asserted-by":"publisher","first-page":"5966","DOI":"10.1109\/LRA.2023.3300592","article-title":"Compliant joint based robotic ultrasound scanning system for imaging human spine","volume":"8","author":"Wang","year":"","journal-title":"Ieee Robot. Autom. Let."},{"key":"B29","doi-asserted-by":"publisher","first-page":"7051","DOI":"10.1109\/TIE.2022.3204967","article-title":"Full-coverage path planning and stable interaction control for automated robotic breast ultrasound scanning","volume":"70","author":"Wang","year":"","journal-title":"IEEE Trans. Industrial Electron."},{"key":"B30","first-page":"9946","article-title":"Automated robotic breast ultrasound acquisition using ultrasound feedback","author":"Welleweerd","year":"2020"},{"key":"B31","doi-asserted-by":"publisher","first-page":"426","DOI":"10.1109\/TMRB.2021.3075750","article-title":"A flexible ultrasound scanning system for minimally invasive spinal surgery navigation","volume":"3","author":"Zhang","year":"2021","journal-title":"IEEE Trans. Med. Robotics Bionics"},{"key":"B32","first-page":"1","article-title":"Research on path planning of breast ultrasound examination robot","author":"Zhang","year":"2023"},{"key":"B33","doi-asserted-by":"publisher","first-page":"85384","DOI":"10.1109\/ACCESS.2022.3196774","article-title":"Scanning path planning of the robot for breast ultrasound examination based on binocular vision and NURBS","volume":"10","author":"Zhang","year":"2022","journal-title":"IEEE Access"}],"container-title":["Frontiers in Robotics and AI"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1383732\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,7]],"date-time":"2024-05-07T04:38:04Z","timestamp":1715056684000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/frobt.2024.1383732\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,7]]},"references-count":33,"alternative-id":["10.3389\/frobt.2024.1383732"],"URL":"https:\/\/doi.org\/10.3389\/frobt.2024.1383732","relation":{},"ISSN":["2296-9144"],"issn-type":[{"value":"2296-9144","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,5,7]]},"article-number":"1383732"}}