{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,14]],"date-time":"2026-05-14T08:43:33Z","timestamp":1778748213938,"version":"3.51.4"},"publisher-location":"New York, NY, USA","reference-count":25,"publisher":"ACM","license":[{"start":{"date-parts":[[2022,10,26]],"date-time":"2022-10-26T00:00:00Z","timestamp":1666742400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"NSF","award":["DMS-1814091, DMS-1953035"],"award-info":[{"award-number":["DMS-1814091, DMS-1953035"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2022,11,2]]},"DOI":"10.1145\/3533271.3561743","type":"proceedings-article","created":{"date-parts":[[2022,10,20]],"date-time":"2022-10-20T22:20:22Z","timestamp":1666304422000},"page":"369-376","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Reinforcement Learning for Intra-and-Inter-Bank Borrowing and Lending Mean Field Control Game"],"prefix":"10.1145","author":[{"given":"Andrea","family":"Angiuli","sequence":"first","affiliation":[{"name":"Prime Machine Learning Team, Amazon, US"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Nils","family":"Detering","sequence":"additional","affiliation":[{"name":"Department of Statistics and Applied Probability, University of California, Santa Barbara, US"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jean-Pierre","family":"Fouque","sequence":"additional","affiliation":[{"name":"Department of Statistics and Applied Probability, University of California, Santa Barbara, US"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mathieu","family":"Lauri\u00e8re","sequence":"additional","affiliation":[{"name":"Mathematics and Data Science, NYU Shanghai, CN"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jimin","family":"Lin","sequence":"additional","affiliation":[{"name":"Department of Statistics and Applied Probability, University of California, Santa Barbara, US"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2022,10,26]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10957-019-01619-3"},{"key":"e_1_3_2_1_2_1","volume-title":"Mean Field Control Games. In preparation","author":"Angiuli Andrea","year":"2022","unstructured":"Andrea Angiuli , Nils Detering , Jean-Pierre Fouque , Mathieu Lauri\u00e8re , and Jimin Lin . 2022. Mean Field Control Games. In preparation ( 2022 ). Andrea Angiuli, Nils Detering, Jean-Pierre Fouque, Mathieu Lauri\u00e8re, and Jimin Lin. 2022. Mean Field Control Games. In preparation (2022)."},{"key":"e_1_3_2_1_3_1","unstructured":"Andrea Angiuli Nils Detering Jean-Pierre Fouque and Jimin Lin. 2022. Reinforcement Learning Algorithm for Mixed Mean Field Control Games. arXiv preprint arXiv:2205.02330(2022).  Andrea Angiuli Nils Detering Jean-Pierre Fouque and Jimin Lin. 2022. Reinforcement Learning Algorithm for Mixed Mean Field Control Games. arXiv preprint arXiv:2205.02330(2022)."},{"key":"e_1_3_2_1_4_1","unstructured":"Andrea Angiuli Jean-Pierre Fouque and Mathieu Lauri\u00e8re. 2022. Reinforcement Learning for Mean Field Games with Applications to Economics. To appear in Machine Learning in Financial Markets: A guide to contemporary practices. arXiv:2106.13755(2022).  Andrea Angiuli Jean-Pierre Fouque and Mathieu Lauri\u00e8re. 2022. Reinforcement Learning for Mean Field Games with Applications to Economics. To appear in Machine Learning in Financial Markets: A guide to contemporary practices. arXiv:2106.13755(2022)."},{"key":"e_1_3_2_1_5_1","volume-title":"Unified reinforcement Q-learning for mean field game and control problems. Mathematics of Control, Signals, and Systems","author":"Angiuli Andrea","year":"2022","unstructured":"Andrea Angiuli , Jean-Pierre Fouque , and Mathieu Lauri\u00e8re . 2022. Unified reinforcement Q-learning for mean field game and control problems. Mathematics of Control, Signals, and Systems ( 2022 ), 1\u201355. Andrea Angiuli, Jean-Pierre Fouque, and Mathieu Lauri\u00e8re. 2022. Unified reinforcement Q-learning for mean field game and control problems. Mathematics of Control, Signals, and Systems (2022), 1\u201355."},{"key":"e_1_3_2_1_6_1","volume-title":"Mean field games and mean field type control theory. Vol.\u00a0101","author":"Bensoussan Alain","unstructured":"Alain Bensoussan , Jens Frehse , Phillip Yam , 2013. Mean field games and mean field type control theory. Vol.\u00a0101 . Springer . Alain Bensoussan, Jens Frehse, Phillip Yam, 2013. Mean field games and mean field type control theory. Vol.\u00a0101. Springer."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11579-017-0206-z"},{"key":"e_1_3_2_1_8_1","unstructured":"Ren\u00e9 Carmona. 2020. Applications of mean field games in financial engineering and economic theory. arXiv preprint arXiv:2012.05237(2020).  Ren\u00e9 Carmona. 2020. Applications of mean field games in financial engineering and economic theory. arXiv preprint arXiv:2012.05237(2020)."},{"key":"e_1_3_2_1_9_1","volume-title":"Probabilistic Theory of Mean Field Games with Applications I-II","author":"Carmona Ren\u00e9","unstructured":"Ren\u00e9 Carmona and Fran\u00e7ois Delarue . 2018. Probabilistic Theory of Mean Field Games with Applications I-II . Springer . Ren\u00e9 Carmona and Fran\u00e7ois Delarue. 2018. Probabilistic Theory of Mean Field Games with Applications I-II. Springer."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.4310\/CMS.2015.v13.n4.a4"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00245-014-9269-x"},{"key":"e_1_3_2_1_12_1","unstructured":"Boualem Djehiche Alain Tcheukam and Hamidou Tembine. 2016. Mean-field-type games in engineering. arXiv preprint arXiv:1605.03281(2016).  Boualem Djehiche Alain Tcheukam and Hamidou Tembine. 2016. Mean-field-type games in engineering. arXiv preprint arXiv:1605.03281(2016)."},{"key":"e_1_3_2_1_13_1","volume-title":"On the Convergence of Model Free Learning in Mean Field Games. In proc. of AAAI.","author":"Elie Romuald","year":"2020","unstructured":"Romuald Elie , Julien Perolat , Mathieu Lauri\u00e8re , Matthieu Geist , and Olivier Pietquin . 2020 . On the Convergence of Model Free Learning in Mean Field Games. In proc. of AAAI. Romuald Elie, Julien Perolat, Mathieu Lauri\u00e8re, Matthieu Geist, and Olivier Pietquin. 2020. On the Convergence of Model Free Learning in Mean Field Games. In proc. of AAAI."},{"key":"e_1_3_2_1_14_1","first-page":"1","article-title":"Learning rates for Q-learning","author":"Even-Dar Eyal","year":"2003","unstructured":"Eyal Even-Dar and Yishay Mansour . 2003 . Learning rates for Q-learning . Journal of machine learning Research 5 , Dec (2003), 1 \u2013 25 . Eyal Even-Dar and Yishay Mansour. 2003. Learning rates for Q-learning. Journal of machine learning Research 5, Dec (2003), 1\u201325.","journal-title":"Journal of machine learning Research 5"},{"key":"e_1_3_2_1_15_1","volume-title":"Paris-Princeton lectures on mathematical finance","author":"Gu\u00e9ant Olivier","year":"2010","unstructured":"Olivier Gu\u00e9ant , Jean-Michel Lasry , and Pierre-Louis Lions . 2011. Mean field games and applications . In Paris-Princeton lectures on mathematical finance 2010 . Springer , 205\u2013266. Olivier Gu\u00e9ant, Jean-Michel Lasry, and Pierre-Louis Lions. 2011. Mean field games and applications. In Paris-Princeton lectures on mathematical finance 2010. Springer, 205\u2013266."},{"key":"e_1_3_2_1_16_1","unstructured":"Xin Guo Anran Hu Renyuan Xu and Junzi Zhang. 2019. Learning mean-field games. In Advances in Neural Information Processing Systems. 4966\u20134976.  Xin Guo Anran Hu Renyuan Xu and Junzi Zhang. 2019. Learning mean-field games. In Advances in Neural Information Processing Systems. 4966\u20134976."},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.4310\/CIS.2006.v6.n3.a5"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.5555\/1622737.1622748"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1007\/3-540-49116-3_38"},{"key":"e_1_3_2_1_20_1","unstructured":"Volodymyr Kuleshov and Doina Precup. 2014. Algorithms for multi-armed bandit problems. arXiv preprint arXiv:1402.6028(2014).  Volodymyr Kuleshov and Doina Precup. 2014. Algorithms for multi-armed bandit problems. arXiv preprint arXiv:1402.6028(2014)."},{"key":"e_1_3_2_1_21_1","volume-title":"Mean field games. Japanese journal of mathematics 2, 1","author":"Lasry Jean-Michel","year":"2007","unstructured":"Jean-Michel Lasry and Pierre-Louis Lions . 2007. Mean field games. Japanese journal of mathematics 2, 1 ( 2007 ), 229\u2013260. Jean-Michel Lasry and Pierre-Louis Lions. 2007. Mean field games. Japanese journal of mathematics 2, 1 (2007), 229\u2013260."},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11586"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.5555\/3306127.3331700"},{"key":"e_1_3_2_1_24_1","unstructured":"Sebastian\u00a0B Thrun. 1992. Efficient exploration in reinforcement learning. (1992).  Sebastian\u00a0B Thrun. 1992. Efficient exploration in reinforcement learning. (1992)."},{"key":"e_1_3_2_1_25_1","volume-title":"Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior: From Animals to Animats, Vol.\u00a06. MIT Press Cambridge, MA, 223\u2013228","author":"Wiering Marco","year":"1998","unstructured":"Marco Wiering and J\u00fcrgen Schmidhuber . 1998 . Efficient model-based exploration . In Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior: From Animals to Animats, Vol.\u00a06. MIT Press Cambridge, MA, 223\u2013228 . Marco Wiering and J\u00fcrgen Schmidhuber. 1998. Efficient model-based exploration. In Proceedings of the Sixth International Conference on Simulation of Adaptive Behavior: From Animals to Animats, Vol.\u00a06. MIT Press Cambridge, MA, 223\u2013228."}],"event":{"name":"ICAIF '22: 3rd ACM International Conference on AI in Finance","location":"New York NY USA","acronym":"ICAIF '22","sponsor":["ACM Association for Computing Machinery"]},"container-title":["Proceedings of the Third ACM International Conference on AI in Finance"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3533271.3561743","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3533271.3561743","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3533271.3561743","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T19:00:39Z","timestamp":1750186839000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3533271.3561743"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,10,26]]},"references-count":25,"alternative-id":["10.1145\/3533271.3561743","10.1145\/3533271"],"URL":"https:\/\/doi.org\/10.1145\/3533271.3561743","relation":{},"subject":[],"published":{"date-parts":[[2022,10,26]]},"assertion":[{"value":"2022-10-26","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}