{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,18]],"date-time":"2026-03-18T04:56:44Z","timestamp":1773809804753,"version":"3.50.1"},"reference-count":16,"publisher":"MDPI AG","issue":"5","license":[{"start":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T00:00:00Z","timestamp":1646179200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100004663","name":"Ministry of Science and Technology","doi-asserted-by":"publisher","award":["2019YFE0125200"],"award-info":[{"award-number":["2019YFE0125200"]}],"id":[{"id":"10.13039\/501100004663","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>Precisely imitating human motions in real-time poses a challenge for the robots due to difference in their physical structures. This paper proposes a human\u2013computer interaction method for remotely manipulating life-size humanoid robots with a new metrics for evaluating motion similarity. First, we establish a motion capture system to acquire the operator\u2019s motion data and retarget it to the standard bone model. Secondly, we develop a fast mapping algorithm, by mapping the BVH (BioVision Hierarchy) data collected by the motion capture system to each joint motion angle of the robot to realize the imitated motion control of the humanoid robot. Thirdly, a DTW (Dynamic Time Warping)-based trajectory evaluation method is proposed to quantitatively evaluate the difference between robot trajectory and human motion, and meanwhile, visualization terminals render it more convenient to make comparisons between two different but simultaneous motion systems. We design a complex gesture simulation experiment to verify the feasibility and real-time performance of the control method. The proposed human-in-the-loop imitation control method addresses a prominent non-isostructural retargeting problem between human and robot, enhances robot interaction capability in a more natural way, and improves robot adaptability to uncertain and dynamic environments.<\/jats:p>","DOI":"10.3390\/s22051968","type":"journal-article","created":{"date-parts":[[2022,3,2]],"date-time":"2022-03-02T22:53:25Z","timestamp":1646261605000},"page":"1968","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Motion Similarity Evaluation between Human and a Tri-Co Robot during Real-Time Imitation with a Trajectory Dynamic Time Warping Model"],"prefix":"10.3390","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0265-1192","authenticated-orcid":false,"given":"Liang","family":"Gong","sequence":"first","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0275-3746","authenticated-orcid":false,"given":"Binhao","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Wenbin","family":"Xu","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chengliang","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xudong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Zelin","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lujie","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,2]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"852","DOI":"10.1016\/j.measurement.2016.09.026","article-title":"Gesture imitation and recognition using Kinect sensor and extreme learning machines","volume":"94","year":"2016","journal-title":"Measurement"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Xu, W., Li, X., Xu, W., Gong, L., Huang, Y., Zhao, Z., Zhao, L., Chen, B., Yang, H., and Cao, L. (2018, January 18\u201320). Human-robot Interaction Oriented Human-in-the-loop Real-time Motion Imitation on a Humanoid Tri-Co Robot. Proceedings of the 2018 3rd International Conference on Advanced Robotics and Mechatronics (ICARM), Singapore.","DOI":"10.1109\/ICARM.2018.8610806"},{"key":"ref_3","unstructured":"Riley, M., Ude, A., Wade, K., and Atkeson, C.G. (2003, January 14\u201319). Enabling real-time full-body imitation: A natural way of transferring human movement to humanoids. Proceedings of the IEEE International Conference on Robotics and Automation, ICRA, Taipei, Taiwan."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Durdu, A., Cetin, H., and Komur, H. (2015, January 5\u20137). Robot imitation of human arm via Artificial Neural Network. Proceedings of the International Conference on Mechatronics-Mechatronika, Brno, Czech Republic.","DOI":"10.1109\/MECHATRONIKA.2014.7018286"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"884","DOI":"10.1109\/TRO.2007.904896","article-title":"Full-Body Compliant Human\u2013Humanoid Interaction: Balancing in the Presence of Unknown External Forces","volume":"23","author":"Hyon","year":"2007","journal-title":"IEEE Trans. Robot."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Ding, I.J., Chang, C.W., and He, C.J. (2014, January 26\u201328). A kinect-based gesture command control method for human action imitations of humanoid robots. Proceedings of the International Conference on Fuzzy Theory and ITS Applications, Yilan, Taiwan.","DOI":"10.1109\/iFUZZY.2014.7091261"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Bindal, A., Kumar, A., Sharma, H., and Kumar, W.K. (2015, January 12\u201313). Design and implementation of a shadow bot for mimicking the basic motion of a human leg. Proceedings of the International Conference on Recent Developments in Control, Automation and Power Engineering, Noida, India.","DOI":"10.1109\/RDCAPE.2015.7281425"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Koenig, A., Rodriguez Y Baena, F., and Secoli, R. (2021, January 8\u201312). Gesture-based teleoperated grasping for educational robotics. Proceedings of the 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), Vancouver, BC, Canada.","DOI":"10.1109\/RO-MAN50785.2021.9515390"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Rolley-Parnell, E.J., Kanoulas, D., Laurenzi, A., Delhaisse, B., Rozo, L., Caldwell, D., and Tsagarakis, N. (2018, January 18\u201321). Bi-Manual Articulated Robot Teleoperation using an External RGB-D Range Sensor. Proceedings of the 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), Singapore.","DOI":"10.1109\/ICARCV.2018.8581174"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Gobee, S., Muller, M., Durairajah, V., and Kassoo, R. (2017, January 27\u201329). Humanoid robot upper limb control using microsoft kinect. Proceedings of the 2017 International Conference on Robotics, Automation and Sciences (ICORAS), Melaka, Malaysia.","DOI":"10.1109\/ICORAS.2017.8308046"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"6977","DOI":"10.1109\/LRA.2021.3096475","article-title":"Miniature Tangible Cube: Concept and Design of Target-Object-Oriented User Interface for Dual-Arm Telemanipulation","volume":"6","author":"Kitagawa","year":"2021","journal-title":"IEEE Robot. Autom. Lett."},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Meng, X., Pan, J., and Qin, H. (2017, January 20\u201322). Motion Capture and Retargeting of Fish by Monocular Camera. Proceedings of the International Conference on Cyberworlds, Chester, UK.","DOI":"10.1109\/CW.2017.16"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Dai, H., Cai, B., Song, J., and Zhang, D. (2010, January 25\u201326). Skeletal Animation Based on BVH Motion Data. Proceedings of the 2010 2nd International Conference on Information Engineering and Computer Science, Wuhan, China.","DOI":"10.1109\/ICIECS.2010.5678292"},{"key":"ref_14","unstructured":"Rodriguez, N.E.N., Carbone, G., and Ceccarelli, M. (2006, January 20\u201322). Antropomorphic Design and Operation of a New Low-Cost Humanoid Robot. Proceedings of the IEEE\/RAS-Embs International Conference on Biomedical Robotics and Biomechatronics, Pisa, Italy."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gong, L., Gong, C., Ma, Z., Zhao, L., Wang, Z., Li, X., Jing, X., Yang, H., and Liu, C. (2017, January 27\u201331). Real-time human-in-the-loop remote control for a life-size traffic police robot with multiple augmented reality aided display terminals. Proceedings of the 2017 2nd International Conference on Advanced Robotics and Mechatronics (ICARM), Tai\u2019an, China.","DOI":"10.1109\/ICARM.2017.8273199"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Wang, Z., Gong, L., Chen, Q., Li, Y., Liu, C., and Huang, Y. (2016). Rapid Developing the Simulation and Control Systems for a Multifunctional Autonomous Agricultural Robot with ROS, Springer International Publishing.","DOI":"10.1007\/978-3-319-43506-0_3"}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1968\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:30:58Z","timestamp":1760135458000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/22\/5\/1968"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,2]]},"references-count":16,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["s22051968"],"URL":"https:\/\/doi.org\/10.3390\/s22051968","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,2]]}}}