{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,18]],"date-time":"2026-09-18T16:18:32Z","timestamp":1789748312987,"version":"4.0.1"},"reference-count":50,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"3","funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["DMS 2406762"],"award-info":[{"award-number":["DMS 2406762"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000893","name":"Simons Foundation","doi-asserted-by":"publisher","award":["949877"],"award-info":[{"award-number":["949877"]}],"id":[{"id":"10.13039\/100000893","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Control Optim."],"published-print":{"date-parts":[[2026,6,30]]},"abstract":"<jats:p>Abstract.<\/jats:p>\n                  <jats:p>We study dynamic finite-player and mean-field stochastic games within the framework of Markov perfect equilibria (MPE). Our focus is on discrete time and space structures without monotonicity. Unlike their continuous-time analogues, discrete-time finite-player games generally do not admit unique MPE. However, we show that uniqueness is remarkably recovered when the time steps are sufficiently small, and we provide examples demonstrating the necessity of this assumption. This result, established without relying on any monotonicity conditions, underscores the importance of inertia in dynamic games. In both the finite-player and mean-field settings, we show that MPE correspond to solutions of the Nash\u2013Lasry\u2013Lions equation, which is known as the master equation in the mean-field case. We exploit this connection to establish the convergence of discrete-time finite-player games to their mean-field counterpart in short time. Finally, we prove the convergence of discrete-time finite-player games to their continuous-time version on every time horizon.<\/jats:p>","DOI":"10.1137\/25m1799155","type":"journal-article","created":{"date-parts":[[2026,5,12]],"date-time":"2026-05-12T08:02:07Z","timestamp":1778572927000},"page":"1327-1356","source":"Crossref","is-referenced-by-count":1,"title":["Markov Perfect Equilibria in Discrete Finite-Player and Mean-Field Games"],"prefix":"10.1137","volume":"64","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-5845-5840","authenticated-orcid":true,"given":"Felix","family":"H\u00f6fer","sequence":"first","affiliation":[{"name":"Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08540 USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0824-1808","authenticated-orcid":true,"given":"H. Mete","family":"Soner","sequence":"additional","affiliation":[{"name":"Department of Operations Research and Financial Engineering, Princeton University, Princeton, NJ 08540 USA."}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Atilla","family":"Yilmaz","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Temple University, Philadelphia, PA 19122 USA."}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2026,5,12]]},"reference":[{"key":"ref1","doi-asserted-by":"publisher","DOI":"10.1137\/120882421"},{"key":"ref2","doi-asserted-by":"publisher","DOI":"10.1287\/opre.2013.1192"},{"key":"ref3","doi-asserted-by":"publisher","DOI":"10.1090\/tran\/8760"},{"key":"ref4","doi-asserted-by":"publisher","DOI":"10.1051\/cocv\/2018026"},{"key":"ref5","doi-asserted-by":"crossref","unstructured":"T. Ba\u015far and G. J. Olsder, Dynamic Noncooperative Game Theory, SIAM, Philadelphia, 1998.","DOI":"10.1137\/1.9781611971132"},{"key":"ref6","doi-asserted-by":"publisher","DOI":"10.1137\/17M113887X"},{"key":"ref7","doi-asserted-by":"publisher","DOI":"10.1090\/proc\/15046"},{"key":"ref8","doi-asserted-by":"crossref","unstructured":"A. Beck, First-Order Methods in Optimization, SIAM, Philadelphia, 2017.","DOI":"10.1137\/1.9781611974997"},{"key":"ref9","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-023-01934-8"},{"key":"ref10","doi-asserted-by":"publisher","DOI":"10.4171\/jems\/1227"},{"key":"ref11","volume-title":"The Master Equation and the Convergence Problem in Mean Field Games","author":"Cardaliaguet P.","year":"2019"},{"key":"ref12","doi-asserted-by":"publisher","DOI":"10.1137\/21M1450008"},{"key":"ref13","unstructured":"R. Carmona, Applications of Mean Field Games in Financial Engineering and Economic Theory, preprint, https:\/\/arxiv.org\/abs\/2012.05237, 2020."},{"key":"ref14","doi-asserted-by":"publisher","DOI":"10.1080\/03605302.2023.2264611"},{"key":"ref15","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-56436-4"},{"key":"ref16","doi-asserted-by":"publisher","DOI":"10.1007\/s13235-019-00315-1"},{"key":"ref17","doi-asserted-by":"publisher","DOI":"10.1080\/03605302.2021.1955256"},{"key":"ref18","volume":"315","author":"Cecchin A.","year":"2025","journal-title":"Weak Solutions to the Master Equation of Potential Mean Field Games"},{"key":"ref19","doi-asserted-by":"publisher","DOI":"10.1016\/j.spa.2018.12.002"},{"key":"ref20","doi-asserted-by":"publisher","DOI":"10.1137\/18M1222454"},{"key":"ref21","series-title":"Mem. Amer. Math. Soc. 280","volume-title":"A Probabilistic Approach to Classical Solutions of the Master Equation for Large Population Equilibria","author":"Chassagneux J.-F.","year":"2022"},{"key":"ref22","first-page":"598","volume":"7","author":"Delarue F.","year":"2019","journal-title":"Stoch. Partial Differ. Equ. Anal. Comput."},{"key":"ref23","doi-asserted-by":"publisher","DOI":"10.1016\/j.spa.2019.04.005"},{"key":"ref24","doi-asserted-by":"publisher","DOI":"10.1214\/20-AAP1655"},{"key":"ref25","unstructured":"J. Dianetti, M. Nendel, L. Tangpi, and S. Wang, Pasting of Equilibria and Donsker-Type Results for Mean Field Games, preprint, https:\/\/arxiv.org\/abs\/2411.00633, 2024."},{"key":"ref26","doi-asserted-by":"publisher","DOI":"10.3934\/jdg.2019016"},{"key":"ref27","volume-title":"Game Theory","author":"Fudenberg D.","year":"1991"},{"key":"ref28","doi-asserted-by":"publisher","DOI":"10.1002\/cpa.22069"},{"key":"ref29","doi-asserted-by":"publisher","DOI":"10.1016\/j.jde.2015.08.001"},{"key":"ref30","unstructured":"N. Garcia, R. Sircar, and H. M. Soner, Mean Field Games of Control and Cryptocurrency Mining, preprint, https:\/\/arxiv.org\/abs\/2504.15526, 2025."},{"key":"ref31","doi-asserted-by":"publisher","DOI":"10.1016\/j.matpur.2009.10.010"},{"key":"ref32","doi-asserted-by":"publisher","DOI":"10.1007\/s00245-013-9202-8"},{"key":"ref33","doi-asserted-by":"publisher","DOI":"10.1016\/j.jfa.2023.110095"},{"key":"ref34","volume":"32","author":"Guo X.","year":"2019","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref35","doi-asserted-by":"publisher","DOI":"10.1016\/j.matpur.2019.02.006"},{"key":"ref36","doi-asserted-by":"crossref","unstructured":"B. Hajek and M. Livesay, On non-unique solutions in mean field games, in Proceedings of the 58th Conference on Decision and Control (CDC), IEEE, 2019, pp. 1219\u20131224.","DOI":"10.1109\/CDC40024.2019.9029906"},{"key":"ref37","author":"H\u00f6fer F.","year":"2025","journal-title":"Synchronization games"},{"key":"ref38","doi-asserted-by":"crossref","unstructured":"M. Huang, P. E. Caines, and R. P. Malham\u00e9, Individual and mass behaviour in large population stochastic wireless power control problems: Centralized and Nash equilibrium solutions, in Proceedings of the 42nd International Conference on Decision and Control, Vol. 1, IEEE, 2003, pp. 98\u2013103.","DOI":"10.1109\/CDC.2003.1272542"},{"key":"ref39","doi-asserted-by":"publisher","DOI":"10.1007\/s11424-007-9015-4"},{"key":"ref40","doi-asserted-by":"publisher","DOI":"10.1109\/TAC.2007.904450"},{"key":"ref41","doi-asserted-by":"crossref","unstructured":"M. Huang, P. E. Caines, and R. P. Malham\u00e9, The Nash certainty equivalence principle and McKean-Vlasov systems: An invariance principle and entry adaptation, in Proceedings of the 46th Conference on Decision and Control, IEEE, 2007, pp. 121\u2013126.","DOI":"10.1109\/CDC.2007.4434627"},{"key":"ref42","doi-asserted-by":"publisher","DOI":"10.1016\/j.crma.2006.09.019"},{"key":"ref43","doi-asserted-by":"publisher","DOI":"10.1016\/j.crma.2006.09.018"},{"key":"ref44","doi-asserted-by":"publisher","DOI":"10.1007\/s11537-007-0657-8"},{"key":"ref45","doi-asserted-by":"publisher","DOI":"10.4171\/jems\/1455"},{"key":"ref46","doi-asserted-by":"publisher","DOI":"10.1016\/j.matpur.2024.02.002"},{"key":"ref47","doi-asserted-by":"crossref","unstructured":"S. Perrin, M. Lauri\u00e8re, J. P\u00e9rolat, M. Geist, R. \u00c9lie, and O. Pietquin, Mean Field Games Flock! The Reinforcement Learning Way, preprint, https:\/\/arxiv.org\/abs\/2105.07933, 2021.","DOI":"10.24963\/ijcai.2021\/50"},{"key":"ref48","doi-asserted-by":"publisher","DOI":"10.1137\/17M1112583"},{"key":"ref49","doi-asserted-by":"publisher","DOI":"10.3982\/ECTA6158"},{"key":"ref50","unstructured":"J. Yang, X. Ye, R. Trivedi, H. Xu, and H. Zha, Learning Deep Mean Field Games for Modeling Large Population Behavior, preprint, https:\/\/arxiv.org\/abs\/1711.03156, 2017."}],"container-title":["SIAM Journal on Control and Optimization"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/25M1799155","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T13:22:41Z","timestamp":1787318561000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/25M1799155"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,5,12]]},"references-count":50,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2026,6,30]]}},"alternative-id":["10.1137\/25M1799155"],"URL":"https:\/\/doi.org\/10.1137\/25m1799155","relation":{},"ISSN":["0363-0129","1095-7138"],"issn-type":[{"value":"0363-0129","type":"print"},{"value":"1095-7138","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,5,12]]}}}