{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,11]],"date-time":"2026-05-11T23:40:08Z","timestamp":1778542808429,"version":"3.51.4"},"reference-count":46,"publisher":"MDPI AG","issue":"11","license":[{"start":{"date-parts":[[2023,10,24]],"date-time":"2023-10-24T00:00:00Z","timestamp":1698105600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Project of Shandong High-end Medical Device Innovation and Entrepreneurship Community","award":["2022-SGTTXM-018"],"award-info":[{"award-number":["2022-SGTTXM-018"]}]},{"name":"Project of Shandong High-end Medical Device Innovation and Entrepreneurship Community","award":["CMNM-KF202103"],"award-info":[{"award-number":["CMNM-KF202103"]}]},{"name":"Open Project Program of Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Ministry of Education, Changchun University of Science and Technology","award":["2022-SGTTXM-018"],"award-info":[{"award-number":["2022-SGTTXM-018"]}]},{"name":"Open Project Program of Key Laboratory for Cross-Scale Micro and Nano Manufacturing, Ministry of Education, Changchun University of Science and Technology","award":["CMNM-KF202103"],"award-info":[{"award-number":["CMNM-KF202103"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Bioengineering"],"abstract":"<jats:p>The main goal of this research is to develop a highly advanced anthropomorphic control system utilizing multiple sensor technologies to achieve precise control of a robotic arm. Combining Kinect and IMU sensors, together with a data glove, we aim to create a multimodal sensor system for capturing rich information of human upper body movements. Specifically, the four angles of upper limb joints are collected using the Kinect sensor and IMU sensor. In order to improve the accuracy and stability of motion tracking, we use the Kalman filter method to fuse the Kinect and IMU data. In addition, we introduce data glove technology to collect the angle information of the wrist and fingers in seven different directions. The integration and fusion of multiple sensors provides us with full control over the robotic arm, giving it flexibility with 11 degrees of freedom. We successfully achieved a variety of anthropomorphic movements, including shoulder flexion, abduction, rotation, elbow flexion, and fine movements of the wrist and fingers. Most importantly, our experimental results demonstrate that the anthropomorphic control system we developed is highly accurate, real-time, and operable. In summary, the contribution of this study lies in the creation of a multimodal sensor system capable of capturing and precisely controlling human upper limb movements, which provides a solid foundation for the future development of anthropomorphic control technologies. This technology has a wide range of application prospects and can be used for rehabilitation in the medical field, robot collaboration in industrial automation, and immersive experience in virtual reality environments.<\/jats:p>","DOI":"10.3390\/bioengineering10111243","type":"journal-article","created":{"date-parts":[[2023,10,24]],"date-time":"2023-10-24T11:34:47Z","timestamp":1698147287000},"page":"1243","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Sensor Fusion-Based Anthropomorphic Control of a Robotic Arm"],"prefix":"10.3390","volume":"10","author":[{"given":"Furong","family":"Chen","sequence":"first","affiliation":[{"name":"Department of Mechanical Engineering, College of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130012, China"},{"name":"Key Laboratory of Bionic Engineering, Ministry of Education, Jilin University, Changchun 130022, China"},{"name":"Weihai Institute for Bionics, Jilin University, Weihai 264402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0003-0556-258X","authenticated-orcid":false,"given":"Feilong","family":"Wang","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, College of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130012, China"},{"name":"Key Laboratory of Bionic Engineering, Ministry of Education, Jilin University, Changchun 130022, China"},{"name":"Weihai Institute for Bionics, Jilin University, Weihai 264402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanling","family":"Dong","sequence":"additional","affiliation":[{"name":"School of Foreign Languages & Literature, Shandong University, Jinan 250000, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Qi","family":"Yong","sequence":"additional","affiliation":[{"name":"ESIEE Paris, 2 Boulevard Blaise Pascal, 93160 Noisy-le-Grand, France"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9612-8572","authenticated-orcid":false,"given":"Xiaolong","family":"Yang","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, College of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130012, China"},{"name":"Key Laboratory of Bionic Engineering, Ministry of Education, Jilin University, Changchun 130022, China"},{"name":"Weihai Institute for Bionics, Jilin University, Weihai 264402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Long","family":"Zheng","sequence":"additional","affiliation":[{"name":"Key Laboratory of Bionic Engineering, Ministry of Education, Jilin University, Changchun 130022, China"},{"name":"Weihai Institute for Bionics, Jilin University, Weihai 264402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yi","family":"Gao","sequence":"additional","affiliation":[{"name":"Department of Mechanical Engineering, College of Mechanical and Electrical Engineering, Changchun University of Science and Technology, Changchun 130012, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6877-6783","authenticated-orcid":false,"given":"Hang","family":"Su","sequence":"additional","affiliation":[{"name":"Weihai Institute for Bionics, Jilin University, Weihai 264402, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2023,10,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"347","DOI":"10.1007\/s12369-014-0267-6","article-title":"Anthropomorphism: Opportunities and challenges in human-robot interaction","volume":"7","author":"Proudfoot","year":"2015","journal-title":"Int. J. Soc. Robot."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Phillips, E., Zhao, X., Ullman, D., and Malle, B.F. (2018, January 5\u20138). What is human-like? Decomposing robots\u2019 human-like appearance using the anthropomorphic robot (abot) database. Proceedings of the 2018 ACM\/IEEE International Conference on Human-Robot Interaction, Chicago, IL, USA.","DOI":"10.1145\/3171221.3171268"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1864","DOI":"10.1109\/TII.2020.3036693","article-title":"An incremental learning framework for human-like redundancy optimization of anthropomorphic manipulators","volume":"18","author":"Su","year":"2020","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1002\/rob.21918","article-title":"A survey of deep learning techniques for autonomous driving","volume":"37","author":"Grigorescu","year":"2020","journal-title":"J. Field Robot."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1023\/A:1024172417914","article-title":"Survey of intelligent control techniques for humanoid robots","volume":"37","year":"2003","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"124207","DOI":"10.1109\/ACCESS.2019.2937380","article-title":"Deep neural network approach in human-like redundancy optimization for anthropomorphic manipulators","volume":"7","author":"Su","year":"2019","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3822","DOI":"10.1109\/TII.2017.2785415","article-title":"Mind control of a robotic arm with visual fusion technology","volume":"14","author":"Yang","year":"2017","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"582","DOI":"10.1109\/TITB.2010.2040832","article-title":"An emg-based robot control scheme robust to time-varying emg signal features","volume":"14","author":"Artemiadis","year":"2010","journal-title":"IEEE Trans. Inf. Technol. Biomed."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Athanasiou, A., Xygonakis, I., Pandria, N., Kartsidis, P., Arfaras, G., Kavazidi, K.R., Foroglou, N., Astaras, A., and Bamidis, P.D. (2017). Towards rehabilitation robotics: Off-the-shelf bci control of anthropomorphic robotic arms. BioMed Res. Int., 2017.","DOI":"10.1155\/2017\/5708937"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"239","DOI":"10.1016\/j.ifacol.2018.06.383","article-title":"Flexible architecture for transparency of a bilateral tele-operation system implemented in mobile anthropomorphic robots for the oil and gas industry","volume":"51","author":"Naranjo","year":"2018","journal-title":"IFAC-PapersOnLine"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Yurova, V.A., Velikoborets, G., and Vladyko, A. (2022). Design and implementation of an anthropomorphic robotic arm prosthesis. Technologies, 10.","DOI":"10.3390\/technologies10050103"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Scalera, L., Seriani, S., Gallina, P., Lentini, M., and Gasparetto, A. (2021). Human\u2013robot interaction through eye tracking for artistic drawing. Robotics, 10.","DOI":"10.3390\/robotics10020054"},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Chen, L., Swikir, A., and Haddadin, S. (2021). Drawing Elon Musk: A Robot Avatar for Remote Manipulation, IEEE.","DOI":"10.1109\/IROS51168.2021.9635879"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1002\/rob.21702","article-title":"Walk-man: A high-performance humanoid platform for realistic environments","volume":"34","author":"Tsagarakis","year":"2017","journal-title":"J. Field Robot."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Y\u00fcksel, B., Mahboubi, S., Secchi, C., B\u00fclthoff, H.H., and Franchi, A. (2015). Design, Identification and Experimental Testing of A Light-Weight Flexible-Joint Arm for Aerial Physical Interaction, IEEE.","DOI":"10.1109\/ICRA.2015.7139280"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"248","DOI":"10.1016\/j.mechatronics.2018.02.009","article-title":"Survey on human\u2013robot collaboration in industrial settings: Safety, intuitive interfaces and applications","volume":"55","author":"Villani","year":"2018","journal-title":"Mechatronics"},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Noccaro, A., Cordella, F., Zollo, L., Pino, G.D., Guglielmelli, E., and Formica, D. (2017). A Teleoperated Control Approach for Anthropomorphic Manipulator Using Magneto-Inertial Sensors, IEEE.","DOI":"10.1109\/ROMAN.2017.8172295"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Cer\u00f3n, J.C., Sunny, M.S.H., Brahmi, B., Mendez, L.M., Fareh, R., Ahmed, H.U., and Rahman, M.H. (2023). A novel multi-modal teleoperation of a humanoid assistive robot with real-time motion mimic. Micromachines, 14.","DOI":"10.3390\/mi14020461"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.sna.2010.10.025","article-title":"Development of a bioinspired mems based capacitive tactile sensor for a robotic finger","volume":"165","author":"Muhammad","year":"2011","journal-title":"Sens. Actuators A Phys."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1109\/TOH.2014.2309142","article-title":"Exploring teleimpedance and tactile feedback for intuitive control of the pisa\/iit softhand","volume":"7","author":"Ajoudani","year":"2014","journal-title":"IEEE Trans. Haptics"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"222ra19","DOI":"10.1126\/scitranslmed.3006820","article-title":"Restoring natural sensory feedback in real-time bidirectional hand prostheses","volume":"6","author":"Raspopovic","year":"2014","journal-title":"Sci. Transl. Med."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1007\/s11023-019-09506-6","article-title":"The rhetoric and reality of anthropomorphism in artificial intelligence","volume":"29","author":"Watson","year":"2019","journal-title":"Minds Mach."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1016\/S0921-8890(02)00374-3","article-title":"Anthropomorphism and the social robot","volume":"42","author":"Duffy","year":"2003","journal-title":"Robot. Auton. Syst."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"811","DOI":"10.1109\/TNSRE.2017.2694553","article-title":"A human\u2013robot co-manipulation approach based on human sensorimotor information","volume":"25","author":"Peternel","year":"2017","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Rakita, D., Mutlu, B., and Gleicher, M. (2017, January 6\u20139). A motion retargeting method for effective mimicry-based teleoperation of robot arms. Proceedings of the 2017 ACM\/IEEE International Conference on Human-Robot Interaction, Vienna, Austria.","DOI":"10.1145\/2909824.3020254"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"456","DOI":"10.1109\/TNSRE.2006.881565","article-title":"Kinematic design to improve ergonomics in human machine interaction","volume":"14","author":"Schiele","year":"2006","journal-title":"IEEE Trans. Neural Syst. Rehabil. Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/0021-9290(69)90018-9","article-title":"A computerized biomechanical model\u2014Development of and use in studying gross body actions","volume":"2","author":"Chaffin","year":"1969","journal-title":"J. Biomech."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"484","DOI":"10.1109\/TASE.2020.3045655","article-title":"Toward teaching by demonstration for robot-assisted minimally invasive surgery","volume":"18","author":"Su","year":"2021","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1729881418814695","DOI":"10.1177\/1729881418814695","article-title":"Online human-like redundancy optimization for tele-operated anthropomorphic manipulators","volume":"15","author":"Su","year":"2018","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1108","DOI":"10.1007\/s12555-021-0882-6","article-title":"Output-feedback robust tracking control of uncertain systems via adaptive learning","volume":"21","author":"Zhao","year":"2023","journal-title":"Int. J. Control. Autom. Syst."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2007428","DOI":"10.1002\/adfm.202007428","article-title":"Wearable soft technologies for haptic sensing and feedback","volume":"31","author":"Yin","year":"2021","journal-title":"Adv. Funct. Mater."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TASE.2014.2333754","article-title":"A sensor-based dual-arm tele-robotic system","volume":"12","author":"Kruse","year":"2014","journal-title":"IEEE Trans. Autom. Sci. Eng."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Su, H., Zhang, J., Fu, J., Ovur, S.E., Qi, W., Li, G., Hu, Y., and Li, Z. (2021). Sensor Fusion-Based Anthropomorphic Control of Under-Actuated Bionic Hand in Dynamic Environment, IEEE.","DOI":"10.1109\/IROS51168.2021.9636436"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"156","DOI":"10.3389\/fnhum.2014.00156","article-title":"Methodological aspects of eeg and body dynamics measurements during motion","volume":"8","author":"Reis","year":"2014","journal-title":"Front. Hum. Neurosci."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/j.inffus.2021.11.006","article-title":"Multi-sensor information fusion based on machine learning for real applications in human activity recognition: State-of-the-art and research challenges","volume":"80","author":"Qiu","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"04015008","DOI":"10.1061\/(ASCE)CO.1943-7862.0000979","article-title":"Risk assessment of work-related musculoskeletal disorders in construction: State-of-the-art review","volume":"141","author":"Wang","year":"2015","journal-title":"J. Constr. Eng. Manag."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"110040","DOI":"10.1016\/j.asoc.2023.110040","article-title":"Egnn: Graph structure learning based on evolutionary computation helps more in graph neural networks","volume":"2023","author":"Liu","year":"2023","journal-title":"Appl. Soft Comput."},{"key":"ref_38","first-page":"1","article-title":"Heterogeneous network representation learning approach for ethereum identity identification","volume":"2022","author":"Wang","year":"2022","journal-title":"IEEE Trans. Comput. Soc. Syst."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1016\/j.inffus.2017.09.014","article-title":"Geometrical kinematic modeling on human motion using method of multi-sensor fusion","volume":"41","author":"Xu","year":"2018","journal-title":"Inf. Fusion"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1109\/5.554206","article-title":"Sensor fusion potential exploitation-innovative architectures and illustrative applications","volume":"85","author":"Dasarathy","year":"1997","journal-title":"Proc. IEEE"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4317","DOI":"10.1007\/s00542-018-3769-6","article-title":"An imu-compensated skeletal tracking system using kinect for the upper limb","volume":"24","author":"Du","year":"2018","journal-title":"Microsyst. Technol."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"6450","DOI":"10.1109\/JSEN.2020.2965580","article-title":"Static and dynamic human arm\/hand gesture capturing and recognition via multiinformation fusion of flexible strain sensors","volume":"20","author":"Zhang","year":"2020","journal-title":"IEEE Sens. J."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Yang, X., Chen, F., Wang, F., Zheng, L., Wang, S., Qi, W., and Su, H. (2023). Sensor fusion-based teleoperation control of anthropomorphic robotic arm. Biomimetics, 8.","DOI":"10.3390\/biomimetics8020169"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"156","DOI":"10.1080\/21642583.2017.1300109","article-title":"Teleoperation control of baxter robot using kalman filter-based sensor fusion","volume":"5","author":"Li","year":"2017","journal-title":"Syst. Sci. Control Eng."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"2026","DOI":"10.1109\/TMECH.2022.3170800","article-title":"Larg: A lightweight robotic gripper with 3-d topology optimized adaptive fingers","volume":"27","author":"Sun","year":"2022","journal-title":"IEEE\/ASME Trans. Mechatronics"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"6108","DOI":"10.1109\/TIE.2018.2872005","article-title":"Design and implementation of a soft robotic arm driven by sma coils","volume":"66","author":"Yang","year":"2018","journal-title":"IEEE Trans. Ind. Electron."}],"container-title":["Bioengineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2306-5354\/10\/11\/1243\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T21:11:07Z","timestamp":1760130667000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2306-5354\/10\/11\/1243"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,10,24]]},"references-count":46,"journal-issue":{"issue":"11","published-online":{"date-parts":[[2023,11]]}},"alternative-id":["bioengineering10111243"],"URL":"https:\/\/doi.org\/10.3390\/bioengineering10111243","relation":{},"ISSN":["2306-5354"],"issn-type":[{"value":"2306-5354","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,10,24]]}}}