{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T10:24:34Z","timestamp":1769163874157,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"17","license":[{"start":{"date-parts":[[2020,9,3]],"date-time":"2020-09-03T00:00:00Z","timestamp":1599091200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"the Major Research Plan of the National Natural Science Foundation of China","award":["91948201"],"award-info":[{"award-number":["91948201"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Sensors"],"abstract":"<jats:p>In order to analyze the complex interactive behaviors between the robot and two humans, this paper presents an adaptive optimal control framework for human-robot-human physical interaction. N-player linear quadratic differential game theory is used to describe the system under study. N-player differential game theory can not be used directly in actual scenerie, since the robot cannot know humans\u2019 control objectives in advance. In order to let the robot know humans\u2019 control objectives, the paper presents an online estimation method to identify unknown humans\u2019 control objectives based on the recursive least squares algorithm. The Nash equilibrium solution of human-robot-human interaction is obtained by solving the coupled Riccati equation. Adaptive optimal control can be achieved during the human-robot-human physical interaction. The effectiveness of the proposed method is demonstrated by rigorous theoretical analysis and simulations. The simulation results show that the proposed controller can achieve adaptive optimal control during the interaction between the robot and two humans. Compared with the LQR controller, the proposed controller has more superior performance.<\/jats:p>","DOI":"10.3390\/s20175005","type":"journal-article","created":{"date-parts":[[2020,9,3]],"date-time":"2020-09-03T08:40:26Z","timestamp":1599122426000},"page":"5005","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["A Framework for Human-Robot-Human Physical Interaction Based on N-Player Game Theory"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-3918-9010","authenticated-orcid":false,"given":"Rui","family":"Zou","sequence":"first","affiliation":[{"name":"State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yubin","family":"Liu","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jie","family":"Zhao","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Hegao","family":"Cai","sequence":"additional","affiliation":[{"name":"State Key Laboratory of Robotics and Systems, Harbin Institute of Technology, Harbin 150001, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"253","DOI":"10.1016\/j.mechmachtheory.2007.03.003","article-title":"An atlas of physical human-robot interaction","volume":"43","author":"Siciliano","year":"2008","journal-title":"Mech. Mach. Theory"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1016\/j.mechatronics.2010.04.005","article-title":"A survey of environment-, operator-, and task-adapted controllers for teleoperation systems","volume":"20","author":"Carolina","year":"2010","journal-title":"Mechatronics"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"010804","DOI":"10.1115\/1.4039145","article-title":"A review of intent detection, arbitration, and communication aspects of shared control for physical human-robot interaction","volume":"70","author":"Losey","year":"2018","journal-title":"Appl. Mech. Rev."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1007\/s12206-007-1109-3","article-title":"Safe physical human robot interaction-past, present and future","volume":"22","author":"Aslam","year":"2008","journal-title":"J. Mech. Sci. Technol."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1007","DOI":"10.1109\/TMECH.2013.2264533","article-title":"Human\u2013robot collaboration based on motion intention estimation","volume":"19","author":"Li","year":"2013","journal-title":"IEEE-ASME Trans. Mechatron."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1260","DOI":"10.1017\/S0263574714002240","article-title":"Force tracking control for motion synchronization in human-robot collaboration","volume":"34","author":"Li","year":"2016","journal-title":"Robotica"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1109\/JPROC.2011.2175150","article-title":"Human-oriented control for haptic teleoperation","volume":"100","author":"Sandra","year":"2012","journal-title":"Proc. IEEE"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"746","DOI":"10.1109\/TIE.2019.2898587","article-title":"Adaptive fuzzy backstepping control for stable nonlinear bilateral teleoperation manipulators with enhanced transparency performance","volume":"67","author":"Chen","year":"2019","journal-title":"IEEE Trans. Ind. Electron."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Liu, C., and Masayoshi, T. (2014, January 14\u201318). Modeling and controller design of cooperative robots in workspace sharing human-robot assembly teams. Proceedings of the IROS 2014, Chicago, IL, USA.","DOI":"10.1109\/IROS.2014.6942738"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"3934","DOI":"10.1109\/TII.2018.2882741","article-title":"Prediction of human activity patterns for human-robot collaborative assembly tasks","volume":"15","author":"Zanchettin","year":"2018","journal-title":"IEEE Trans. Ind. Inform."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"1656","DOI":"10.1177\/0278364912455366","article-title":"The role of roles: Physical cooperation between humans and robots","volume":"31","author":"Alexander","year":"2012","journal-title":"Int. J. Robot. Res."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2663","DOI":"10.1007\/s00170-019-03356-3","article-title":"A structured methodology for the design of a human-robot collaborative assembly workplace","volume":"102","author":"Costa","year":"2019","journal-title":"Int. J. Adv. Manuf. Technol."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/j.rcim.2018.05.002","article-title":"A problem design and constraint modelling approach for collaborative assembly line planning","volume":"55","author":"Daniel","year":"2019","journal-title":"Robot. Comput. Integr. Manuf."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/j.arcontrol.2017.09.017","article-title":"Control sharing in human-robot team interaction","volume":"44","author":"Selma","year":"2017","journal-title":"Annu. Rev. Control"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"927","DOI":"10.1007\/s10514-018-9764-z","article-title":"A dynamical system approach to task-adaptation in physical human-robot interaction","volume":"43","author":"Mahdi","year":"2019","journal-title":"Auton. Robot."},{"key":"ref_16","unstructured":"Colombo, R., and Sanguineti, V. (2018). Rehabilitation Robotics: Technology and Applications. Rehabilitation Robotics, Academic Press."},{"key":"ref_17","unstructured":"Colgate, J.E., Decker, P.F., Klostermeyer, S.H., Makhlin, A., Meer, D., Santos-Munne, J., Peshkin, M.A., and Robie, M. (2007). Methods and Apparatus for Manipulation of Heavy Payloads with Intelligent Assist Devices. (7,185,774), U.S. Patent."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1109\/TMECH.2006.871087","article-title":"Biomechanical design of the Berkeley lower extremity exoskeleton (BLEEX)","volume":"11","author":"Zoss","year":"2006","journal-title":"IEEE-ASME Trans. Mechatron."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"36","DOI":"10.1038\/s42256-018-0010-3","article-title":"Differential game theory for versatile physical human-robot interaction","volume":"1","author":"Li","year":"2019","journal-title":"Nat. Mach. Intell."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1408","DOI":"10.1109\/TRO.2016.2597322","article-title":"A framework of human-robot coordination based on game theory and policy iteration","volume":"32","author":"Li","year":"2016","journal-title":"IEEE Trans. Robot."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Nathana\u00ebl, J., Themistoklis, C., and Etienne, B. (2012). A framework to describe, analyze and generate interactive motor behaviors. PLoS ONE, 7.","DOI":"10.1371\/journal.pone.0049945"},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Li, Y., Tee, K.P., Yan, R., Chan, W.L., Wu, Y., and Limbu, D.K. (October, January 28). Adaptive optimal control for coordination in physical human-robot interaction. Proceedings of the 2015 IEEE\/RSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany.","DOI":"10.1109\/IROS.2015.7353109"},{"key":"ref_23","unstructured":"Kirk, D.E. (2004). Optimal control theory: An introduction. Optimal Control Theory, Dover Publications."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"672","DOI":"10.1109\/TRO.2015.2419873","article-title":"Continuous role adaptation for human-robot shared control","volume":"31","author":"Li","year":"2015","journal-title":"IEEE Trans. Robot."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"32","DOI":"10.1109\/MCAS.2009.933854","article-title":"Reinforcement learning and adaptive dynamic programming for feedback control","volume":"9","author":"Lewis","year":"2009","journal-title":"IEEE Circuits Syst. Mag."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1556","DOI":"10.1016\/j.automatica.2011.03.005","article-title":"Multi-player non-zero-sum games: Online adaptive learning solution of coupled Hamilton\u2013Jacobi equations","volume":"47","author":"Vamvoudakis","year":"2011","journal-title":"Automatica"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1016\/j.automatica.2010.10.033","article-title":"An iterative adaptive dynamic programming method for solving a class of nonlinear zero-sum differential games","volume":"47","author":"Zhang","year":"2011","journal-title":"Automatica"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1015","DOI":"10.1109\/TSMC.2013.2295351","article-title":"Online synchronous approximate optimal learning algorithm for multi-player non-zero-sum games with unknown dynamics","volume":"44","author":"Liu","year":"2014","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.arcontrol.2019.10.002","article-title":"Modeling cyber-physical human systems via an interplay between reinforcement learning and game theory","volume":"48","author":"Albaba","year":"2019","journal-title":"Annu. Rev. Control"},{"key":"ref_30","unstructured":"Music, S., and Hirche, S. (2020, January 12\u201317). Haptic Shared Control for Human-Robot Collaboration: A Game-Theoretical Approach. Proceedings of the 21st IFAC World Congress, Berlin, Germany."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"151","DOI":"10.1007\/s12369-018-0487-2","article-title":"Human-like motion planning based on game theoretic decision making","volume":"11","author":"Turnwald","year":"2019","journal-title":"Int. J. Soc. Robot."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.procir.2018.03.172","article-title":"Human-robot collaborative manufacturing using cooperative game: Framework and implementation","volume":"72","author":"Liu","year":"2018","journal-title":"Procedia CIRP"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Bansal, S., Xu, J., Howard, A., and Isbell, C. (2020). A Bayesian Framework for Nash Equilibrium Inference in Human-Robot Parallel Play. arXiv.","DOI":"10.15607\/RSS.2020.XVI.042"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Antonelli, G., Chiaverini, S., and Marino, A. (2012, January 14\u201318). A coordination strategy for multi-robot sampling of dynamic fields. Proceedings of the 2012 IEEE International Conference on Robotics and Automation, Saint Paul, MN, USA.","DOI":"10.1109\/ICRA.2012.6224698"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"399","DOI":"10.5772\/57313","article-title":"A survey and analysis of multi-robot coordination","volume":"10","author":"Yan","year":"2013","journal-title":"Int. J. Adv. Robot. Syst."},{"key":"ref_36","unstructured":"Martina, L., Alessandro, M., and Stefano, C. (2019, January 6\u20139). A distributed approach to human multi-robot physical interaction. Proceedings of the 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), Bari, Italy."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kim, W., Marta, L., Balatti, P., Wu, Y., and Arash, A. (2019, January 3\u20138). Towards ergonomic control of collaborative effort in multi-human mobile-robot teams. Proceedings of the IEEE\/RSJ International Conference on Intelligent Robots and Systems, Macau, China.","DOI":"10.1109\/IROS40897.2019.8967628"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"184","DOI":"10.1007\/BF00929443","article-title":"Nonzero-sum differential games","volume":"3","author":"Starr","year":"1969","journal-title":"J. Optim. Theory Appl."},{"key":"ref_39","first-page":"259","article-title":"Noncooperative game theory for industrial organization: An introduction and overview","volume":"1","author":"Fudenberg","year":"1989","journal-title":"Handb. Ind. Organ."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1115\/1.3140702","article-title":"Impedance Control: An Approach To Manipulation: Part I-Theory Part II-Implementation Part III-Applications","volume":"107","author":"Hegan","year":"1985","journal-title":"J. Dyn. Syst. Meas. Control"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1177\/0278364913517728","article-title":"Task-dependent impedance and implications for upper-limb prosthesis control","volume":"33","author":"Blank","year":"2014","journal-title":"Int. J. Robot. Res."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"763","DOI":"10.1177\/0278364914561535","article-title":"An assistive decision-and-control architecture for force-sensitive hand\u2013arm systems driven by human\u2013machine interfaces","volume":"34","author":"Vogel","year":"2015","journal-title":"Int. J. Robot. Res."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Basar, T., and Olsder, G.J. (1999). Dynamic Noncooperative Game Theory, The Math Works Inc.. [2nd ed.].","DOI":"10.1137\/1.9781611971132"},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Shima, T., and Rasmussen, S. (2009). UAV cooperative decision and control: Challenges and practical approaches. UAV Cooperative Decision and Control, SIAM.","DOI":"10.1137\/1.9780898718584"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1177\/1548512910382002","article-title":"Online adaptive learning for team strategies in multi-agent systems","volume":"9","author":"Hudas","year":"2012","journal-title":"J. Def. Model. Simul."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"198","DOI":"10.1109\/TCSI.2019.2944221","article-title":"A New Variable Forgetting Factor-Based Bias-Compensated RLS Algorithm for Identification of FIR Systems With Input Noise and Its Hardware Implementation","volume":"67","author":"Tan","year":"2019","journal-title":"IEEE Trans. Circuits Syst. I Regul. Pap."}],"container-title":["Sensors"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/5005\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:06:25Z","timestamp":1760177185000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1424-8220\/20\/17\/5005"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,3]]},"references-count":46,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["s20175005"],"URL":"https:\/\/doi.org\/10.3390\/s20175005","relation":{},"ISSN":["1424-8220"],"issn-type":[{"value":"1424-8220","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,9,3]]}}}