{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,14]],"date-time":"2026-01-14T18:05:01Z","timestamp":1768413901666,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2023,4,16]],"date-time":"2023-04-16T00:00:00Z","timestamp":1681603200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["52005036"],"award-info":[{"award-number":["52005036"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Beijing Institute of Technology Research Fund Program for Young Scholars","award":["52005036"],"award-info":[{"award-number":["52005036"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>The clinical success of vascular interventional surgery relies heavily on a surgeon\u2019s catheter\/guidewire manipulation skills and strategies. An objective and accurate assessment method plays a critical role in evaluating the surgeon\u2019s technical manipulation skill level. Most of the existing evaluation methods incorporate the use of information technology to find more objective assessment models based on various metrics. However, in these models, sensors are often attached to the surgeon\u2019s hands or to interventional devices for data collection, which constrains the surgeon\u2019s operational movements or exerts an influence on the motion trajectory of interventional devices. In this paper, an image information-based assessment method is proposed for the evaluation of the surgeon\u2019s manipulation skills without the requirement of attaching sensors to the surgeon or catheters\/guidewires. Surgeons are allowed to use their natural bedside manipulation skills during the data collection process. Their manipulation features during different catheterization tasks are derived from the motion analysis of the catheter\/guidewire in video sequences. Notably, data relating to the number of speed peaks, slope variations, and the number of collisions are included in the assessment. Furthermore, the contact forces, resulting from interactions between the catheter\/guidewire and the vascular model, are sensed by a 6-DoF F\/T sensor. A support vector machine (SVM) classification framework is developed to discriminate the surgeon\u2019s catheterization skill levels. The experimental results demonstrate that the proposed SVM-based assessment method can obtain an accuracy of 97.02% to distinguish between the expert and novice manipulations, which is higher than that of other existing research achievements. The proposed method has great potential to facilitate skill assessment and training of novice surgeons in vascular interventional surgery.<\/jats:p>","DOI":"10.3390\/s23084031","type":"journal-article","created":{"date-parts":[[2023,4,17]],"date-time":"2023-04-17T02:26:02Z","timestamp":1681698362000},"page":"4031","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["An Image Information-Based Objective Assessment Method of Technical Manipulation Skills for Intravascular Interventions"],"prefix":"10.3390","volume":"23","author":[{"given":"Jin","family":"Guo","sequence":"first","affiliation":[{"name":"School of Life Science, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Maoxun","family":"Li","sequence":"additional","affiliation":[{"name":"China Academy of Electronics and Information Technology, Beijing 100041, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yue","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Life Science, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0607-9798","authenticated-orcid":false,"given":"Shuxiang","family":"Guo","sequence":"additional","affiliation":[{"name":"School of Life Science, Beijing Institute of Technology, Beijing 100081, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,16]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1016\/j.ejvs.2008.11.008","article-title":"Treatment of Complex Aneurysmal Disease with Fenestrated and Branched Stent Grafts","volume":"37","author":"Bicknell","year":"2009","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_2","first-page":"697","article-title":"Current and Emerging Robot-Assisted Endovascular Catheterization Technologies: A Review","volume":"42","author":"Payne","year":"2013","journal-title":"Ann. Biomed. Eng."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1109\/TASE.2018.2817644","article-title":"Ultrasound-Assisted Guidance with Force Cues for Intravascular Interventions","volume":"16","author":"Guo","year":"2019","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"289","DOI":"10.2214\/ajr.175.2.1750289","article-title":"Endovascular Repair of Abdominal Aortic Aneurysms: Current Status and Future Directions","volume":"175","author":"Kaufman","year":"2000","journal-title":"Am. J. Roentgenol."},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Chen, X., Chen, Y., Duan, W., Akinyemi, T.O., Yi, G., Jiang, J., Du, W., and Omisore, O.M. (2022). Design and Evaluation of a Learning-Based Vascular Interventional Surgery Robot. Fibers, 10.","DOI":"10.3390\/fib10120106"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Song, C., Xia, S., Zhang, H., Zhang, L., Li, X., Wang, K., and Lu, Q. (2022). Novel Endovascular Interventional Surgical Robotic System Based on Biomimetic Manipulation. Micromachines, 13.","DOI":"10.3390\/mi13101587"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"677","DOI":"10.1002\/bjs.6240","article-title":"A meta-analysis of 21,178 patients undergoing open or endovascular repair of abdominal aortic aneurysm","volume":"95","author":"Lovegrove","year":"2008","journal-title":"Br. J. Surg."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1016\/j.amjsurg.2005.08.008","article-title":"Carotid artery stenting with neuroprotection: Assessing the learning curve and treatment outcome","volume":"190","author":"Lin","year":"2005","journal-title":"Am. J. Surg."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1177\/1531003508323733","article-title":"Carotid Artery Stenting: Technical Issues and Role of Operators\u2019 Experience","volume":"20","author":"Verzini","year":"2008","journal-title":"Perspect. Vasc. Surg. Endovasc. Ther."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1161\/CIRCINTERVENTIONS.110.960864","article-title":"Characterization of Operator Learning Curve for Transradial Coronary Interventions","volume":"4","author":"Ball","year":"2011","journal-title":"Circ. Cardiovasc. Interv."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1707","DOI":"10.1007\/s11517-020-02195-9","article-title":"Machine learning\u2013based operation skills assessment with vascular difficulty index for vascular intervention surgery","volume":"58","author":"Guo","year":"2020","journal-title":"Med. Biol. Eng. Comput."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1873","DOI":"10.1109\/TMECH.2022.3174520","article-title":"Multiphysical Analytical Modeling and Design of a Magnetically Steerable Robotic Catheter for Treatment of Peripheral Artery Disease","volume":"27","author":"Liu","year":"2022","journal-title":"IEEE\/ASME Trans. Mechatron."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Lu, Q., Sun, Z., Zhang, J., Zhang, J., Zheng, J., and Qian, F. (2022). A Novel Remote-Controlled Vascular Interventional Robotic System Based on Hollow Ultrasonic Motor. Micromachines, 13.","DOI":"10.3390\/mi13030410"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Dagnino, G., Liu, J., Abdelaziz, M.E.M.K., Chi, W., Riga, C., and Yang, G. (2018, January 1\u20135). Haptic Feedback and Dynamic Active Constraints for Robot-Assisted Endovascular Catheterization. Proceedings of the 2018 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Madrid, Spain.","DOI":"10.1109\/IROS.2018.8593628"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"1632","DOI":"10.1016\/j.jvir.2010.07.008","article-title":"Clinical Practice Guidelines for Endovascular Abdominal Aortic Aneurysm Repair","volume":"21","author":"Walker","year":"2010","journal-title":"J. Vasc. Interv. Radiol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"226","DOI":"10.1016\/S0002-9610(97)89597-9","article-title":"Testing technical skill via an innovative \u201cbench station\u201d examination","volume":"173","author":"Reznick","year":"1997","journal-title":"Am. J. Surg."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1112","DOI":"10.1016\/j.jvs.2004.09.028","article-title":"Computer simulation as a component of catheter-based training","volume":"40","author":"Dayal","year":"2004","journal-title":"J. Vasc. Surg."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1007\/s00270-006-0161-1","article-title":"Porcine Transfer Study: Virtual Reality Simulator Training Compared with Porcine Training in Endovascular Novices","volume":"30","author":"Berry","year":"2007","journal-title":"CardioVascular Interv. Radiol."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"457","DOI":"10.1007\/s10459-011-9322-3","article-title":"Comparing the use of global rating scale with checklists for the assessment of central venous catheterization skills using simulation","volume":"17","author":"Ma","year":"2012","journal-title":"Adv. Health Sci. Educ."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"642","DOI":"10.1097\/01.sla.0000243601.36582.18","article-title":"Nature of human error: Implications of surgical practice","volume":"244","author":"Cuschieri","year":"2006","journal-title":"Ann. Surg."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1016\/S0002-9610(05)80843-8","article-title":"Teaching and testing technical skills","volume":"165","author":"Reznick","year":"1993","journal-title":"Am. J. Surg."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ejvs.2009.03.008","article-title":"Validation of Video-based Skill Assessment in Carotid Artery Stenting","volume":"38","author":"Aggarwal","year":"2009","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1016\/j.ejvs.2007.12.017","article-title":"Experienced Endovascular Interventionalists Objectively Improve their Skills by Attending Carotid Artery Stent Training Courses","volume":"35","author":"Aggarwal","year":"2008","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"137","DOI":"10.1016\/j.ejvs.2018.02.035","article-title":"Assessment of EVAR Competence: Validity of a Novel Rating Scale (EVARATE) in a Simulated Setting","volume":"56","author":"Konge","year":"2018","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"431","DOI":"10.1016\/j.ejvs.2008.12.021","article-title":"Assessing Endovascular Skills using the Simulator for Testing and Rating Endovascular Skills (STRESS) Machine","volume":"37","author":"Willems","year":"2009","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1016\/j.ejvs.2013.02.004","article-title":"A Pilot Study of Video-motion Analysis in Endovascular Surgery: Development of Real-time Discriminatory Skill Metrics","volume":"45","author":"Rolls","year":"2013","journal-title":"Eur. J. Vasc. Endovasc. Surg."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1016\/j.jvs.2014.10.104","article-title":"Kinematics effectively delineate accomplished users of endovascular robotics with a physical training model","volume":"61","author":"Duran","year":"2015","journal-title":"J. Vasc. Surg."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Estrada, S., O\u2019Malley, M.K., Duran, C., Schulz, D., and Bismuth, J. (2014, January 5\u20138). On the development of objective metrics for surgical skills evaluation based on tool motion. Proceedings of the 2014 IEEE International Conference on Systems, Man, and Cybernetics, San Diego, CA, USA.","DOI":"10.1109\/SMC.2014.6974411"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1109\/THMS.2016.2545247","article-title":"Smoothness of Surgical Tool Tip Motion Correlates to Skill in Endovascular Tasks","volume":"46","author":"Estrada","year":"2016","journal-title":"IEEE Trans. Hum.-Mach. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1007\/s11548-016-1391-6","article-title":"Catheter manipulation analysis for objective performance and technical skills assessment in transcatheter aortic valve implantation","volume":"11","author":"Mazomenos","year":"2016","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1274","DOI":"10.1016\/j.jvs.2017.01.072","article-title":"Electromagnetic tracking of flexible robotic catheters enables \u201cassisted navigation\u201d and brings automation to endovascular navigation in an in vitro study","volume":"67","author":"Schwein","year":"2018","journal-title":"J. Vasc. Surg."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"102584","DOI":"10.1016\/j.media.2022.102584","article-title":"A survey of catheter tracking concepts and methodologies","volume":"82","author":"Ramadani","year":"2022","journal-title":"Med. Image Anal."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e25","DOI":"10.1002\/rcs.1467","article-title":"Technical skills measurement based on a cyber-physical system for endovascular surgery simulation","volume":"9","author":"Tercero","year":"2013","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Kodama, H., Tercero, C., Ooe, K., Shi, C., Ikeda, S., Fukuda, T., Arai, F., Negoro, M., Takahashi, I., and Kwon, G. (2012, January 7\u201312). 2-D Optical Encoding of Catheter Motion and Cyber-Physical System for Technical Skills Measurement and Quantitative Evaluation in Endovascular Surgery. Proceedings of the 2012 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Vilamoura, Portugal.","DOI":"10.1109\/IROS.2012.6385755"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"160","DOI":"10.1002\/rcs.301","article-title":"Design and fabrication of a robotic mechanism for remote steering and positioning of interventional devices","volume":"6","author":"Srimathveeravalli","year":"2010","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1109\/TBME.2019.2913431","article-title":"Qualitative and Quantitative Assessment of Technical Skills in Percutaneous Coronary Intervention: In Vivo Porcine Studies","volume":"67","author":"Zhou","year":"2020","journal-title":"IEEE Trans. Biomed. Eng."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"2565","DOI":"10.1109\/TCYB.2020.3004653","article-title":"A Multilayer and Multimodal-Fusion Architecture for Simultaneous Recognition of Endovascular Manipulations and Assessment of Technical Skills","volume":"52","author":"Zhou","year":"2022","journal-title":"IEEE Trans. Cybern."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1109\/TMRB.2022.3190211","article-title":"Exploring Operators\u2019 Natural Behaviors to Predict Catheterization Trial Outcomes in Robot-Assisted Intravascular Interventions","volume":"4","author":"Du","year":"2022","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"53750","DOI":"10.1109\/ACCESS.2020.2980579","article-title":"Exploration of Interventionists\u2019 Technical Manipulation Skills for Robot-Assisted Intravascular PCI Catheterization","volume":"8","author":"Du","year":"2020","journal-title":"IEEE Access"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Zhou, T., Omisore, O.M., Du, W., Duan, W., Zhang, Y., and Wang, L. (2019, January 8\u201311). A Preliminary Study on Surface Electromyography Signal Analysis for Motion Characterization During Catheterization. Proceedings of the 2019 International Conference on Intelligent Robotics and Applications, Shenyang, China.","DOI":"10.1007\/978-3-030-27535-8_55"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"673","DOI":"10.1109\/TITB.2009.2029614","article-title":"Development of a Wireless Sensor Glove for Surgical Skills Assessment","volume":"13","author":"King","year":"2009","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Rafii-Tari, H., Payne, C., Riga, C., Bicknell, C., Lee, S.L., and Yang, G. (2012, January 1\u20135). Assessment of navigation cues with proximal force sensing during endovascular catheterization. Proceedings of the 15th International Conference Medical Image Computing and Computer-Assisted Intervention, Nice, France.","DOI":"10.1007\/978-3-642-33418-4_69"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1007\/s10439-017-1791-y","article-title":"Objective Assessment of Endovascular Navigation Skills with Force Sensing","volume":"45","author":"Payne","year":"2017","journal-title":"Ann. Biomed. Eng."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Rafii-Tari, H., Liu, J., Lee, S.L., Bicknell, C., and Yang, G. (2013, January 22\u201326). Learning-Based Modeling of Endovascular Navigation for Collaborative Robotic Catheterization. Proceedings of the 16th International Conference of Medical Image Computing and Computer-Assisted Intervention, Nagoya, Japan.","DOI":"10.1007\/978-3-642-40763-5_46"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2237","DOI":"10.3390\/mi13122237","article-title":"A Deep-Learning-Based Guidewire Compliant Control Method for the Endovascular Surgery Robot","volume":"13","author":"Lyu","year":"2022","journal-title":"Micromachines"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1007\/s10544-018-0261-0","article-title":"A cooperation of catheters and guidewires-based novel remote-controlled vascular interventional robot","volume":"20","author":"Bao","year":"2018","journal-title":"Biomed. Microdevices"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/8\/4031\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:16:51Z","timestamp":1760123811000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/23\/8\/4031"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,16]]},"references-count":46,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["s23084031"],"URL":"https:\/\/doi.org\/10.3390\/s23084031","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,16]]}}}