{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T01:46:01Z","timestamp":1760147161295,"version":"build-2065373602"},"reference-count":43,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2023,1,10]],"date-time":"2023-01-10T00:00:00Z","timestamp":1673308800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"European Regional Development Fund","award":["KK.01.1.1.04.0092"],"award-info":[{"award-number":["KK.01.1.1.04.0092"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>This paper presents an approach for the solution of a zero-sum differential game associated with a nonlinear state-feedback H\u221e control problem. Instead of using the approximation methods for solving the corresponding Hamilton\u2013Jacobi\u2013Isaacs (HJI) partial differential equation, we propose an algorithm that calculates the explicit inputs to the dynamic system by directly performing minimization with simultaneous maximization of the same objective function. In order to achieve numerical robustness and stability, the proposed algorithm uses: quasi-Newton method, conjugate gradient method, line search method with Wolfe conditions, Adams approximation method for time discretization and complex-step calculation of derivatives. The algorithm is evaluated in computer simulations on examples of first- and second-order nonlinear systems with analytical solutions of H\u221e control problem.<\/jats:p>","DOI":"10.3390\/a16010048","type":"journal-article","created":{"date-parts":[[2023,1,11]],"date-time":"2023-01-11T03:40:35Z","timestamp":1673408435000},"page":"48","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["An Algorithm for Solving Zero-Sum Differential Game Related to the Nonlinear H\u221e Control Problem"],"prefix":"10.3390","volume":"16","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6869-0816","authenticated-orcid":false,"given":"Vladimir","family":"Mili\u0107","sequence":"first","affiliation":[{"name":"Faculty of Mechanical Engineering and Naval Architecture, University of Zagreb, HR-10000 Zagreb, Croatia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6071-0368","authenticated-orcid":false,"given":"Josip","family":"Kasa\u0107","sequence":"additional","affiliation":[{"name":"Faculty of Mechanical Engineering and Naval Architecture, University of Zagreb, HR-10000 Zagreb, Croatia"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2477-4281","authenticated-orcid":false,"given":"Marin","family":"Lukas","sequence":"additional","affiliation":[{"name":"Faculty of Mechanical Engineering and Naval Architecture, University of Zagreb, HR-10000 Zagreb, Croatia"}]}],"member":"1968","published-online":{"date-parts":[[2023,1,10]]},"reference":[{"key":"ref_1","unstructured":"Helton, J.W., and James, M.R. (1999). Extending H\u221e Control to Nonlinear Systems, SIAM."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1109\/9.256331","article-title":"L2-gain analysis of nonlinear systems and nonlinear state feedback H\u221e control","volume":"37","year":"1992","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Basar, T., and Olsder, G.J. (1999). Dynamic Noncooperative Game Theory, SIAM.","DOI":"10.1137\/1.9781611971132"},{"key":"ref_4","unstructured":"Basar, T., and Bernard, P. (1995). H\u221e Optimal Control and Related Minimax Design Problems, Second Edition, Birkhuser."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"111554","DOI":"10.1109\/ACCESS.2022.3216290","article-title":"An LMI-based control strategy for large-scale systems with applications to interconnected microgrid clusters","volume":"10","author":"Khanbaghi","year":"2022","journal-title":"IEEE Access"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"62011","DOI":"10.1109\/ACCESS.2022.3180166","article-title":"Stochastic robust H\u221e decentralized network formation tracking control of large-scale team satellites via event-triggered mechanism","volume":"10","author":"Chen","year":"2022","journal-title":"IEEE Access"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Chatavi, M., Vu, M.T., Mobayen, S., and Fekih, A. (2022). H\u221e robust LMI-based nonlinear state feedback controller of uncertain nonlinear systems with external disturbances. Mathematics, 10.","DOI":"10.3390\/math10193518"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"9150","DOI":"10.1016\/j.jfranklin.2017.01.035","article-title":"Robust feedback control of the underactuated inertia wheel inverted pendulum under parametric uncertainties and subject to external disturbances: LMI formulation","volume":"355","author":"Gritli","year":"2018","journal-title":"J. Frankl. Inst."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Xi, A., and Cai, Y. (2022). A nonlinear finite-time robust differential game guidance law. Sensors, 22.","DOI":"10.3390\/s22176650"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1109\/TSMC.2020.3042876","article-title":"Adaptive dynamic programming for control: A survey and recent advances","volume":"51","author":"Liu","year":"2021","journal-title":"IEEE Trans. Syst. Man Cybern. Syst."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2568","DOI":"10.2514\/1.G003516","article-title":"Min-max differential dynamic programming: Continuous and discrete time formulations","volume":"41","author":"Sun","year":"2018","journal-title":"J. Guid. Control. Dyn."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"33","DOI":"10.1109\/MCS.2016.2621461","article-title":"Game theory-based control system algorithms with real-time reinforcement learning: How to solve multiplayer games online","volume":"37","author":"Vamvoudakis","year":"2017","journal-title":"IEEE Control Syst. Mag."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Ivanov, I.G., and Bogdanova, B.C. (2016). The iterative solution to discrete-time H\u221e control problems for periodic systems. Algorithms, 9.","DOI":"10.3390\/a9010020"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4960","DOI":"10.1109\/TAC.2020.3046559","article-title":"A hybrid control approach to H\u221e problem of nonlinear descriptor systems with actuator saturation","volume":"66","author":"Lu","year":"2021","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_15","first-page":"2917","article-title":"Prescribed finite-time H\u221e control for nonlinear descriptor systems","volume":"68","author":"Lu","year":"2021","journal-title":"IEEE Trans. Circuits Syst. II Express Briefs"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"2625","DOI":"10.1080\/00207721.2020.1799109","article-title":"An improved iterative computational approach to the solution of the Hamilton-Jacobi equation in optimal control problems of affine nonlinear systems with application","volume":"51","author":"Aliyu","year":"2020","journal-title":"Int. J. Syst. Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2639","DOI":"10.1007\/s11071-018-4713-0","article-title":"Approximate-optimal control algorithm for constrained zero-sum differential games through event-triggering mechanism","volume":"95","author":"Mu","year":"2019","journal-title":"Nonlinear Dyn."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Peretz, Y. (2018). A Randomized Algorithm for Optimal PID Controllers. Algorithms, 11.","DOI":"10.3390\/a11060081"},{"key":"ref_19","unstructured":"Graham, A. (1981). Kronecker Products and Matrix Calculus: With Applications, Ellis Horwood Limited."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"772","DOI":"10.1109\/TCS.1978.1084534","article-title":"Kronecker products and matrix calculus in system theory","volume":"25","author":"Brewer","year":"1978","journal-title":"IEEE Trans. Circuits Syst."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Van Der Schaft, A. (1996). L2-Gain and Passivity Techniques in Nonlinear Control, Springer.","DOI":"10.1007\/3-540-76074-1"},{"key":"ref_22","unstructured":"Isaacs, R. (1965). Differential Games. A Mathematical Theory with Application to Warfare and Pursuit, Control and Optimization, John Wiley and Sons, Inc."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"727","DOI":"10.1002\/(SICI)1099-1239(199711)7:7<727::AID-RNC286>3.0.CO;2-8","article-title":"Singular H\u221e control for nonlinear systems","volume":"7","author":"Astolfi","year":"1997","journal-title":"Int. J. Robust Nonlinear Control"},{"key":"ref_24","unstructured":"Maas, W.C.A., and Van der Schaft, A.J. (1994, January 14\u201316). Singular nonlinear H\u221e optimal control by state feedback. Proceedings of the The 33rd IEEE Conference on Decision and Control, Lake Buena Vista, FL, USA."},{"key":"ref_25","unstructured":"Courant, R., and Hilbert, D. (1966). Methods of Mathematical Physics: Volume 1, Interscience Publishers, Inc."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"303","DOI":"10.1007\/BF02551274","article-title":"Approximation by superpositions of a sigmoidal function","volume":"2","author":"Cybenko","year":"1989","journal-title":"Math. Control. Signals Syst."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"930","DOI":"10.1109\/18.256500","article-title":"Universal approximation bounds for superpositions of a sigmoidal function","volume":"39","author":"Barron","year":"1993","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"863","DOI":"10.1109\/81.704826","article-title":"Notes on uniform approximation of time-varying systems on finite time intervals","volume":"45","author":"Sandberg","year":"1998","journal-title":"IEEE Trans. Circuits Syst. I Fundam. Theory Appl."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"1631","DOI":"10.1109\/TCSI.2004.832735","article-title":"Uniform approximation of periodically-varying systems","volume":"51","author":"Sandberg","year":"2004","journal-title":"IEEE Trans. Circuits Syst. I Regul. Pap."},{"key":"ref_30","unstructured":"Adams, R.A., and Fournier, J.J.F. (2003). Sobolev Spaces, Elsevier Science. Pure and Applied Mathematics."},{"key":"ref_31","unstructured":"Davis, P.J. (1975). Interpolation and Approximation, Dover Publications Inc."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Meinardus, G. (1967). Approximation of Functions: Theory and Numerical Methods, Larry, L., Transed, Schumaker Springer.","DOI":"10.1007\/978-3-642-85643-3"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"107","DOI":"10.1016\/S0377-0427(98)00064-8","article-title":"Inexact generalized Newton methods for second order C-differentiable optimization","volume":"93","author":"Pu","year":"1998","journal-title":"J. Comput. Appl. Math."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1016\/S0167-6377(97)00012-6","article-title":"On superlinear convergence of quasi-Newton methods for nonsmooth equations","volume":"20","author":"Qi","year":"1997","journal-title":"Oper. Res. Lett."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1137\/0803021","article-title":"Nonsmooth equations: Motivation and algorithms","volume":"3","author":"Pang","year":"1993","journal-title":"SIAM J. Optim."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1007\/BF01581275","article-title":"A nonsmooth version of Newton\u2019s method","volume":"58","author":"Qi","year":"1993","journal-title":"Math. Program."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1137\/S1052623497318992","article-title":"A nonlinear conjugate gradient method with a strong global convergence property","volume":"10","author":"Dai","year":"1999","journal-title":"SIAM J. Optim."},{"key":"ref_38","unstructured":"Nocedal, J., and Wright, S.J. (2006). Numerical Optimization, Springer Science + Business Media, LLC."},{"key":"ref_39","unstructured":"Hairer, E., N\u00f8rsett, S.P., and Wanner, G. (2008). Solving Ordinary Differential Equations I\u2014Nonstiff Problems, Second Revised Edition, Springer."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Pesterev, D., Druzhina, O., Pchelintsev, A., Nepomuceno, E., and Butusov, D. (2022). Numerical integration schemes based on composition of adjoint multistep methods. Algorithms, 15.","DOI":"10.3390\/a15120463"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1137\/S003614459631241X","article-title":"Using complex variables to estimate derivatives of real functions","volume":"40","author":"Squire","year":"1998","journal-title":"SIAM Rev."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1145\/355972.355979","article-title":"Numerical differentiation of analytic functions","volume":"7","author":"Fornberg","year":"1981","journal-title":"ACM Trans. Math. Softw."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Dierks, T., and Jagannathan, S. (2010, January 15\u201317). Optimal control of affine nonlinear continuous-time systems using an online Hamilton-Jacobi-Isaacs formulation. Proceedings of the 49th IEEE Conference on Decision and Control, Atlanta, GA, USA.","DOI":"10.1109\/CDC.2010.5717676"}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/1\/48\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T18:05:57Z","timestamp":1760119557000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/16\/1\/48"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,1,10]]},"references-count":43,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2023,1]]}},"alternative-id":["a16010048"],"URL":"https:\/\/doi.org\/10.3390\/a16010048","relation":{},"ISSN":["1999-4893"],"issn-type":[{"type":"electronic","value":"1999-4893"}],"subject":[],"published":{"date-parts":[[2023,1,10]]}}}