{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T16:09:50Z","timestamp":1780589390672,"version":"3.54.1"},"publisher-location":"California","reference-count":0,"publisher":"International Joint Conferences on Artificial Intelligence Organization","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2022,7]]},"abstract":"<jats:p>Modeling the dynamics of multi-agent learning has long been an important research topic. The focus of previous research has been either on 2-agent settings or well-mixed infinitely large agent populations. In this paper, we consider the scenario where n Q-learning agents locate on regular graphs, such that agents can only interact with their neighbors. We examine the local interactions between individuals and their neighbors, and derive a formal model to capture the Q-value dynamics of the entire population. Through comparisons with agent-based simulations on different types of regular graphs, we show that our model describes the agent learning dynamics in an exact manner.<\/jats:p>","DOI":"10.24963\/ijcai.2022\/28","type":"proceedings-article","created":{"date-parts":[[2022,7,16]],"date-time":"2022-07-16T02:55:56Z","timestamp":1657940156000},"page":"194-200","source":"Crossref","is-referenced-by-count":25,"title":["A Formal Model for Multiagent Q-Learning Dynamics on Regular Graphs"],"prefix":"10.24963","author":[{"given":"Chen","family":"Chu","sequence":"first","affiliation":[{"name":"School of Statistics and Mathematics, Yunnan University of Finance and Economics"},{"name":"School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Software, Yunnan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jinzhuo","family":"Liu","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University"},{"name":"School of Software, Yunnan University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shuyue","family":"Hu","sequence":"additional","affiliation":[{"name":"Shanghai Artificial Intelligence Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xuelong","family":"Li","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Zhen","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University"},{"name":"School of Cybersecurity, Northwestern Polytechnical University"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"10584","event":{"name":"Thirty-First International Joint Conference on Artificial Intelligence {IJCAI-22}","theme":"Artificial Intelligence","location":"Vienna, Austria","acronym":"IJCAI-2022","number":"31","sponsor":["International Joint Conferences on Artificial Intelligence Organization (IJCAI)"],"start":{"date-parts":[[2022,7,23]]},"end":{"date-parts":[[2022,7,29]]}},"container-title":["Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence"],"original-title":[],"deposited":{"date-parts":[[2022,7,18]],"date-time":"2022-07-18T11:07:18Z","timestamp":1658142438000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.ijcai.org\/proceedings\/2022\/28"}},"subtitle":[],"proceedings-subject":"Artificial Intelligence Research Articles","short-title":[],"issued":{"date-parts":[[2022,7]]},"references-count":0,"URL":"https:\/\/doi.org\/10.24963\/ijcai.2022\/28","relation":{},"subject":[],"published":{"date-parts":[[2022,7]]}}}