{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,10]],"date-time":"2026-11-10T02:09:14Z","timestamp":1794276554979,"version":"4.9.0"},"reference-count":40,"publisher":"MDPI AG","issue":"21","license":[{"start":{"date-parts":[[2022,11,3]],"date-time":"2022-11-03T00:00:00Z","timestamp":1667433600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100003399","name":"Shanghai Municipal Science and Technology Commission","doi-asserted-by":"publisher","award":["20511105205"],"award-info":[{"award-number":["20511105205"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003399","name":"Shanghai Municipal Science and Technology Commission","doi-asserted-by":"publisher","award":["U20A20199"],"award-info":[{"award-number":["U20A20199"]}],"id":[{"id":"10.13039\/501100003399","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["20511105205"],"award-info":[{"award-number":["20511105205"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U20A20199"],"award-info":[{"award-number":["U20A20199"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Pedicle screw insertion with robot assistance dramatically improves surgical accuracy and safety when compared with manual implantation. In developing such a system, hand\u2013eye calibration is an essential component that aims to determine the transformation between a position tracking and robot-arm systems. In this paper, we propose an effective hand\u2013eye calibration method, namely registration-based hand\u2013eye calibration (RHC), which estimates the calibration transformation via point set registration without the need to solve the AX=XB equation. Our hand\u2013eye calibration method consists of tool-tip pivot calibrations in two-coordinate systems, in addition to paired-point matching, where the point pairs are generated via the steady movement of the robot arm in space. After calibration, our system allows for robot-assisted, image-guided pedicle screw insertion. Comprehensive experiments are conducted to verify the efficacy of the proposed hand\u2013eye calibration method. A mean distance deviation of 0.70 mm and a mean angular deviation of 0.68\u00b0 are achieved by our system when the proposed hand\u2013eye calibration method is used. Further experiments on drilling trajectories are conducted on plastic vertebrae as well as pig vertebrae. A mean distance deviation of 1.01 mm and a mean angular deviation of 1.11\u00b0 are observed when the drilled trajectories are compared with the planned trajectories on the pig vertebrae.<\/jats:p>","DOI":"10.3390\/s22218446","type":"journal-article","created":{"date-parts":[[2022,11,3]],"date-time":"2022-11-03T03:53:07Z","timestamp":1667447587000},"page":"8446","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["A Novel Point Set Registration-Based Hand\u2013Eye Calibration Method for Robot-Assisted Surgery"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6049-7843","authenticated-orcid":false,"given":"Wenyuan","family":"Sun","sequence":"first","affiliation":[{"name":"Institute of Medical Robotics, School of Medical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0639-5950","authenticated-orcid":false,"given":"Jihao","family":"Liu","sequence":"additional","affiliation":[{"name":"Institute of Medical Robotics, School of Medical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0422-6077","authenticated-orcid":false,"given":"Yuyun","family":"Zhao","sequence":"additional","affiliation":[{"name":"Institute of Medical Robotics, School of Medical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4173-0379","authenticated-orcid":false,"given":"Guoyan","family":"Zheng","sequence":"additional","affiliation":[{"name":"Institute of Medical Robotics, School of Medical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,11,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1007\/s00264-009-0792-3","article-title":"Image-guided pedicle screw insertion accuracy: A meta-analysis","volume":"33","author":"Tian","year":"2009","journal-title":"Int. Orthop."},{"key":"ref_2","first-page":"5960","article-title":"Comparison of accuracy of pedicle screw insertion among 4 guided technologies in spine surgery","volume":"23","author":"Fan","year":"2017","journal-title":"Med. Sci. Monit. Int. Med. J. Exp. Clin. Res."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"350","DOI":"10.1016\/j.jocn.2019.12.067","article-title":"Machine vision augmented reality for pedicle screw insertion during spine surgery","volume":"72","author":"Nguyen","year":"2020","journal-title":"J. Clin. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"E13","DOI":"10.3171\/2017.3.FOCUS1710","article-title":"Robotic versus fluoroscopy-guided pedicle screw insertion for metastatic spinal disease: A matched-cohort comparison","volume":"42","author":"Solomiichuk","year":"2017","journal-title":"Neurosurg. Focus"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"E14","DOI":"10.3171\/2017.3.FOCUS179","article-title":"Accuracy of robot-guided versus freehand fluoroscopy-assisted pedicle screw insertion in thoracolumbar spinal surgery","volume":"42","author":"Molliqaj","year":"2017","journal-title":"Neurosurg. Focus"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"e1779","DOI":"10.1002\/rcs.1779","article-title":"A prospective, randomized, controlled trial of robot-assisted vs freehand pedicle screw fixation in spine surgery","volume":"13","author":"Kim","year":"2017","journal-title":"Int. J. Med. Robot. Comput. Assist. Surg."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"187","DOI":"10.21037\/jss.2018.04.01","article-title":"Accuracy of robot-assisted pedicle screw insertion in adolescent idiopathic scoliosis: Is triggered electromyographic pedicle screw stimulation necessary?","volume":"4","author":"Shaw","year":"2018","journal-title":"J. Spine Surg."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1109\/TASE.2016.2517674","article-title":"Finding the kinematic base frame of a robot by hand-eye calibration using 3D position data","volume":"14","author":"Wu","year":"2016","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1080\/24699322.2016.1240314","article-title":"Space calibration of the cranial and maxillofacial robotic system in surgery","volume":"21","author":"Liu","year":"2016","journal-title":"Comput. Assist. Surg."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"16","DOI":"10.1109\/70.88014","article-title":"Calibration of wrist-mounted robotic sensors by solving homogeneous transform equations of the form AX= XB","volume":"5","author":"Shiu","year":"1989","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1109\/70.34770","article-title":"A new technique for fully autonomous and efficient 3 d robotics hand\/eye calibration","volume":"5","author":"Tsai","year":"1989","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1109\/70.134271","article-title":"Extrinsic calibration of a vision sensor mounted on a robot","volume":"8","author":"Wang","year":"1992","journal-title":"Ieee Trans. Robot. Autom."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"240","DOI":"10.1177\/027836499101000305","article-title":"Finding the position and orientation of a sensor on a robot manipulator using quaternions","volume":"10","author":"Chou","year":"1991","journal-title":"Int. J. Robot. Res."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"286","DOI":"10.1177\/02783649922066213","article-title":"Hand-eye calibration using dual quaternions","volume":"18","author":"Daniilidis","year":"1999","journal-title":"Int. J. Robot. Res."},{"key":"ref_15","unstructured":"Andreff, N., Horaud, R., and Espiau, B. (1999, January 8). On-line hand-eye calibration. Proceedings of the Second International Conference on 3-D Digital Imaging and Modeling (Cat. No. PR00062), Ottawa, ON, Canada."},{"key":"ref_16","unstructured":"Lu, Y.C., and Chou, J.C. (1995, January 22\u201325). Eight-space quaternion approach for robotic hand-eye calibration. Proceedings of the 1995 IEEE International Conference on Systems, Man and Cybernetics. Intelligent Systems for the 21st Century, Vancouver, BC, Canada."},{"key":"ref_17","unstructured":"Zhao, Z., and Liu, Y. (2006, January 20\u201324). Hand-eye calibration based on screw motions. Proceedings of the 18th International Conference on Pattern Recognition (ICPR\u201906), Hong Kong, China."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1109\/21.247898","article-title":"A noise-tolerant algorithm for robotic hand-eye calibration with or without sensor orientation measurement","volume":"23","author":"Zhuang","year":"1993","journal-title":"IEEE Trans. Syst. Man, Cybern."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1109\/70.660864","article-title":"Active self-calibration of robotic eyes and hand-eye relationships with model identification","volume":"14","author":"Wei","year":"1998","journal-title":"IEEE Trans. Robot. Autom."},{"key":"ref_20","unstructured":"Mao, J., Huang, X., and Jiang, L. (2010, January 11\u201313). A flexible solution to AX= XB for robot hand-eye calibration. Proceedings of the 10th WSEAS International Conference on Robotics, Control and Manufacturing Technology, Hangzhou, China."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1775","DOI":"10.1007\/s11548-017-1646-x","article-title":"A computationally efficient method for hand\u2013eye calibration","volume":"12","author":"Zhang","year":"2017","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1109\/LRA.2015.2506663","article-title":"Simultaneous hand-eye and robot-world calibration by solving the AX = YB problem without correspondence","volume":"1","author":"Li","year":"2015","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_23","unstructured":"Ma, Q., Li, H., and Chirikjian, G.S. (2016, January 16\u201321). New probabilistic approaches to the AX= XB hand-eye calibration without correspondence. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden."},{"key":"ref_24","first-page":"1530","article-title":"Simultaneous robot-world and hand-eye calibration using dual-quaternions and Kronecker product","volume":"5","author":"Aiguo","year":"2010","journal-title":"Int. J. Phys. Sci."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Ali, I., Suominen, O., Gotchev, A., and Morales, E.R. (2019). Methods for simultaneous robot-world-hand\u2013eye calibration: A comparative study. Sensors, 19.","DOI":"10.20944\/preprints201906.0182.v1"},{"key":"ref_26","unstructured":"Hirsh, R.L., DeSouza, G.N., and Kak, A.C. (2001, January 21\u201326). An iterative approach to the hand-eye and base-world calibration problem. Proceedings of the 2001 ICRA, IEEE International Conference on Robotics and Automation (Cat. No. 01CH37164), Seoul, Korea."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Strobl, K.H., and Hirzinger, G. (2006, January 9\u201315). Optimal hand-eye calibration. Proceedings of the 2006 IEEE\/RSJ International Conference on Intelligent Robots and Systems, Beijing, China.","DOI":"10.1109\/IROS.2006.282250"},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Shah, M., Eastman, R.D., and Hong, T. (2012, January 19\u201321). An overview of robot-sensor calibration methods for evaluation of perception systems. Proceedings of the Workshop on Performance Metrics for Intelligent Systems, Gaithersburg, MD, USA.","DOI":"10.1145\/2393091.2393095"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1141","DOI":"10.1007\/s11548-017-1590-9","article-title":"Hand-eye calibration for surgical cameras: A procrustean perspective-n-point solution","volume":"12","author":"Morgan","year":"2017","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2154","DOI":"10.1109\/TASE.2020.2986503","article-title":"Camera-robot calibration for the da vinci robotic surgery system","volume":"17","author":"Shkurti","year":"2020","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"569","DOI":"10.1109\/TMRB.2020.3033670","article-title":"Improving rigid 3-d calibration for robotic surgery","volume":"2","author":"Roberti","year":"2020","journal-title":"IEEE Trans. Med. Robot. Bionics"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"2061","DOI":"10.1007\/s11548-020-02245-5","article-title":"Vision-based hand\u2013eye calibration for robot-assisted minimally invasive surgery","volume":"15","author":"Sun","year":"2020","journal-title":"Int. J. Comput. Assist. Radiol. Surg."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"118573","DOI":"10.1016\/j.eswa.2022.118573","article-title":"Fruit detection and positioning technology for a Camellia oleifera C. Abel orchard based on improved YOLOv4-tiny model and binocular stereo vision","volume":"211","author":"Tang","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_34","unstructured":"Valassakis, E., Dreczkowski, K., and Johns, E. (2021, January 8\u201311). Learning Eye-in-Hand Camera Calibration from a Single Image. Proceedings of the Conference on Robot Learning, PMLR, London, UK."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"110563","DOI":"10.1016\/j.measurement.2021.110563","article-title":"Feature points extraction of defocused images using deep learning for camera calibration","volume":"188","author":"Huo","year":"2022","journal-title":"Measurement"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Kim, H.S., Kuc, T.Y., and Lee, K.H. (2020, January 1\u20133). Hand-eye calibration using images restored by deep learning. Proceedings of the 2020 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), Seoul, Korea.","DOI":"10.1109\/ICCE-Asia49877.2020.9277421"},{"key":"ref_37","first-page":"1","article-title":"Linear least-squares optimization for point-to-plane icp surface registration","volume":"4","author":"Low","year":"2004","journal-title":"Chapel Hill Univ. North Carol."},{"key":"ref_38","doi-asserted-by":"crossref","unstructured":"Khamene, A., and Sauer, F. (2005, January 26\u201329). A novel phantom-less spatial and temporal ultrasound calibration method. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Palm Springs, CA, USA.","DOI":"10.1007\/11566489_9"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Petersen, P. (2012). Linear Algebra, Springer Science & Business Media.","DOI":"10.1007\/978-1-4614-3612-6"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"031007","DOI":"10.1115\/1.4024473","article-title":"Solving the robot-world\/hand-eye calibration problem using the Kronecker product","volume":"5","author":"Shah","year":"2013","journal-title":"J. Mech. Robot."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8446\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:09:45Z","timestamp":1760144985000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/21\/8446"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,3]]},"references-count":40,"journal-issue":{"issue":"21","published-online":{"date-parts":[[2022,11]]}},"alternative-id":["s22218446"],"URL":"https:\/\/doi.org\/10.3390\/s22218446","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,3]]}}}