{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T22:03:31Z","timestamp":1765231411123,"version":"3.46.0"},"reference-count":44,"publisher":"World Scientific Pub Co Pte Ltd","issue":"06","funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"crossref","award":["72131001","T2121002"],"award-info":[{"award-number":["72131001","T2121002"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Asia Pac. J. Oper. Res."],"published-print":{"date-parts":[[2025,12]]},"abstract":"<jats:p>While reinforcement learning has significant applications in smart manufacturing, effectively coordinating multiple agents with limited communication remains a significant challenge. In this paper, we propose a localized multi-agent reinforcement learning approach specifically designed for serial supply chains. We formulate the supply chain management problem as a Markov decision process and uncover the exponential decay property of the [Formula: see text]-functions, which allows each agent to approximate the [Formula: see text]-functions using local observations and communications. Then, we propose the scalable natural actor\u2013critic (SNAC) algorithm to solve the problem. The SNAC algorithm leverages localized coordination and reduces reliance on global information, thus addressing the challenges of large-scale and dynamic supply chain environments. Additionally, we conduct numerical experiments to demonstrate the effectiveness of SNAC in managing serial supply chains.<\/jats:p>","DOI":"10.1142\/s021759592540010x","type":"journal-article","created":{"date-parts":[[2025,8,8]],"date-time":"2025-08-08T10:24:44Z","timestamp":1754648684000},"source":"Crossref","is-referenced-by-count":1,"title":["Localized Multi-Agent Reinforcement Learning for Cooperative Management of Supply Chains"],"prefix":"10.1142","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5618-3190","authenticated-orcid":false,"given":"Rongjinzi","family":"Wang","sequence":"first","affiliation":[{"name":"College of Engineering, Peking University, Beijing 100871, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1486-9930","authenticated-orcid":false,"given":"Ruiyang","family":"Jin","sequence":"additional","affiliation":[{"name":"Department of Systems Engineering, City University of Hong Kong, Kowloon, Hong Kong, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-4916-8272","authenticated-orcid":false,"given":"Jie","family":"Song","sequence":"additional","affiliation":[{"name":"College of Engineering, Peking University, Beijing 100871, P. R. China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"219","published-online":{"date-parts":[[2025,8,28]]},"reference":[{"issue":"98","key":"S021759592540010XBIB001","first-page":"1","volume":"22","author":"Agarwal A","year":"2021","journal-title":"Journal of Machine Learning Research"},{"key":"S021759592540010XBIB002","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpe.2006.12.052"},{"key":"S021759592540010XBIB003","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2021.07.016"},{"key":"S021759592540010XBIB004","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.45.8.1076"},{"key":"S021759592540010XBIB005","doi-asserted-by":"publisher","DOI":"10.1080\/00207543.2020.1845915"},{"key":"S021759592540010XBIB006","unstructured":"Chu, T, S Chinchali and S Katti (2020). Multi-agent reinforcement learning for networked system control. arXiv:2004.01339."},{"key":"S021759592540010XBIB007","doi-asserted-by":"publisher","DOI":"10.1287\/opre.38.6.937"},{"key":"S021759592540010XBIB008","doi-asserted-by":"publisher","DOI":"10.1287\/opre.48.2.216.12376"},{"key":"S021759592540010XBIB009","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2024.02.062"},{"key":"S021759592540010XBIB010","doi-asserted-by":"publisher","DOI":"10.24251\/HICSS.2018.157"},{"key":"S021759592540010XBIB011","doi-asserted-by":"publisher","DOI":"10.1016\/S0925-5273(00)00156-0"},{"key":"S021759592540010XBIB012","doi-asserted-by":"publisher","DOI":"10.1287\/msom.2021.1064"},{"key":"S021759592540010XBIB013","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.41.2.263"},{"key":"S021759592540010XBIB014","doi-asserted-by":"publisher","DOI":"10.1007\/s10479-014-1635-1"},{"key":"S021759592540010XBIB015","doi-asserted-by":"publisher","DOI":"10.1287\/mnsc.42.1.1"},{"key":"S021759592540010XBIB016","unstructured":"Hubbs, CD, HD Perez, O Sarwar, NV Sahinidis, IE Grossmann and JM Wassick (2020). OR-Gym: A reinforcement learning library for operations research problems. arXiv:2008.06319."},{"key":"S021759592540010XBIB017","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2010.12.009"},{"key":"S021759592540010XBIB018","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.08.046"},{"key":"S021759592540010XBIB019","first-page":"4193","volume-title":"Proc. 31st Int. Conf. Neural Information Processing Systems","author":"Lanctot M","year":"2017"},{"key":"S021759592540010XBIB020","doi-asserted-by":"publisher","DOI":"10.1287\/moor.1060.0205"},{"key":"S021759592540010XBIB021","doi-asserted-by":"publisher","DOI":"10.1287\/opre.2013.1162"},{"key":"S021759592540010XBIB022","first-page":"7825","volume-title":"Proc. 35th Int. Conf. Neural Information Processing Systems","author":"Lin Y","year":"2021"},{"key":"S021759592540010XBIB023","doi-asserted-by":"publisher","DOI":"10.1109\/CDC40024.2019.9029257"},{"key":"S021759592540010XBIB024","doi-asserted-by":"crossref","unstructured":"Liu, X, M Hu, Y Peng and Y Yang (2022). Multi-agent deep reinforcement learning for multi-echelon inventory management. Rotman School of Management Working Paper No. 4262186, Available at SSRN: http:\/\/dx.doi.org\/10.2139\/ssrn.4262186.","DOI":"10.2139\/ssrn.4262186"},{"key":"S021759592540010XBIB025","first-page":"6382","volume-title":"Proc. 31st Int. Conf. Neural Information Processing Systems","author":"Lowe R","year":"2017"},{"issue":"1","key":"S021759592540010XBIB026","first-page":"1","volume":"9","author":"Maina J","year":"2020","journal-title":"Journal of Logistics Management"},{"key":"S021759592540010XBIB027","doi-asserted-by":"publisher","DOI":"10.1016\/j.omega.2019.102110"},{"key":"S021759592540010XBIB028","doi-asserted-by":"crossref","unstructured":"Mousa, M, D van de Berg, N Kotecha, EA del Rio-Chanona and M Mowbray (2023). An analysis of multi-agent reinforcement learning for decentralized inventory control systems. arXiv:2307.11432.","DOI":"10.1016\/j.compchemeng.2024.108783"},{"key":"S021759592540010XBIB029","doi-asserted-by":"publisher","DOI":"10.1287\/msom.2020.0939"},{"key":"S021759592540010XBIB030","doi-asserted-by":"publisher","DOI":"10.3390\/pr9010102"},{"key":"S021759592540010XBIB031","doi-asserted-by":"publisher","DOI":"10.1515\/9781503619883"},{"key":"S021759592540010XBIB032","first-page":"2074","volume-title":"Proc. 34th Int. Conf. Neural Information Processing Systems","author":"Qu G","year":"2020"},{"key":"S021759592540010XBIB033","doi-asserted-by":"publisher","DOI":"10.1287\/opre.2021.2226"},{"key":"S021759592540010XBIB034","doi-asserted-by":"publisher","DOI":"10.1080\/00207543.2022.2140221"},{"volume-title":"Inventory Management and Production Planning and Scheduling","year":"1998","author":"Silver EA","key":"S021759592540010XBIB035"},{"key":"S021759592540010XBIB036","unstructured":"Sultana, NN, H Meisheri, V Baniwal, S Nath, B Ravindran and H Khadilkar (2020). Reinforcement learning for multi-product multi-node inventory management in supply chains. arXiv:2006.04037."},{"key":"S021759592540010XBIB037","doi-asserted-by":"publisher","DOI":"10.1016\/j.compind.2020.103239"},{"key":"S021759592540010XBIB038","doi-asserted-by":"publisher","DOI":"10.1287\/opre.2020.2019"},{"key":"S021759592540010XBIB039","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijpe.2021.108120"},{"key":"S021759592540010XBIB040","doi-asserted-by":"publisher","DOI":"10.1021\/ie800257x"},{"key":"S021759592540010XBIB041","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2018.05.011"},{"issue":"1","key":"S021759592540010XBIB042","first-page":"1","volume":"7","author":"Zhang Y","year":"2023","journal-title":"Proceedings of the ACM on Measurement and Analysis of Computing Systems"},{"key":"S021759592540010XBIB043","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-60990-0_12"},{"key":"S021759592540010XBIB044","first-page":"5872","volume-title":"Proc. 35th Int. Conf. Machine Learning","author":"Zhang K","year":"2018"}],"container-title":["Asia-Pacific Journal of Operational Research"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.worldscientific.com\/doi\/pdf\/10.1142\/S021759592540010X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,12,8]],"date-time":"2025-12-08T09:11:58Z","timestamp":1765185118000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.worldscientific.com\/doi\/10.1142\/S021759592540010X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,8,28]]},"references-count":44,"journal-issue":{"issue":"06","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["10.1142\/S021759592540010X"],"URL":"https:\/\/doi.org\/10.1142\/s021759592540010x","relation":{},"ISSN":["0217-5959","1793-7019"],"issn-type":[{"type":"print","value":"0217-5959"},{"type":"electronic","value":"1793-7019"}],"subject":[],"published":{"date-parts":[[2025,8,28]]},"article-number":"2540010"}}