{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T20:21:50Z","timestamp":1773001310806,"version":"3.50.1"},"reference-count":34,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T00:00:00Z","timestamp":1761868800000},"content-version":"vor","delay-in-days":303,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2025,1,1]],"date-time":"2025-01-01T00:00:00Z","timestamp":1735689600000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/doi.wiley.com\/10.1002\/tdm_license_1.1"}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Intelligent Systems"],"published-print":{"date-parts":[[2025,1]]},"abstract":"<jats:p>Recently, deep reinforcement learning (DRL) has been employed for intelligent traffic\u2010light control and demonstrated promising results. However, state\u2010of\u2010the\u2010art DRL\u2010based systems still rely on discrete decision\u2010making, which can lead to unsafe driving practices. Additionally, existing feature representations of the environment often fail to capture the complex dynamics of traffic flows, resulting in imprecise predictions of traffic conditions. To address these issues, we propose a novel DRL framework based on the multiagent deep deterministic policy gradient algorithm. Our method offers several key innovations: it suggests employing a transitional phase before changing the current phase for safer traffic management, integrates local road network topology into feature representation to enhance the accuracy of traffic flow predictions, and uses two\u2010layer regional features to improve coordination among agents within the region. Our extensive evaluations using simulation of urban mobility, a widely used multimodal traffic simulation package, demonstrated that the proposed method outperformed previous methods and reduced the number of emergency stops, queue lengths, and waiting times.<\/jats:p>","DOI":"10.1155\/int\/8496354","type":"journal-article","created":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T10:16:13Z","timestamp":1761905773000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Towards Smarter and Safer Traffic Signal Control via Multiagent Deep Reinforcement Learning"],"prefix":"10.1155","volume":"2025","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-3025-4856","authenticated-orcid":false,"given":"Jiajing","family":"Shen","sequence":"first","affiliation":[]},{"given":"Bingquan","family":"Yu","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1765-1171","authenticated-orcid":false,"given":"Qinpei","family":"Zhao","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6644-0349","authenticated-orcid":false,"given":"Weixiong","family":"Rao","sequence":"additional","affiliation":[]}],"member":"311","published-online":{"date-parts":[[2025,10,31]]},"reference":[{"key":"e_1_2_12_1_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2013.01.007"},{"key":"e_1_2_12_2_2","doi-asserted-by":"crossref","unstructured":"DiX. XiaoY. ZhuC. DengY. ZhaoQ. andRaoW. Traffic Congestion Prediction by Spatiotemporal Propagation Patterns 20th IEEE International Conference on Mobile Data Management MDM 2019 June 2019 Hong Kong SAR China 298\u2013303 https:\/\/doi.org\/10.1109\/mdm.2019.00-45 2-s2.0-85071007755.","DOI":"10.1109\/MDM.2019.00-45"},{"key":"e_1_2_12_3_2","doi-asserted-by":"crossref","unstructured":"WeiH. ZhengG. YaoH. andLiZ. Intellilight: A Reinforcement Learning Approach for Intelligent Traffic Light Control Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining KDD 2018 August 2018 London UK 2496\u20132505.","DOI":"10.1145\/3219819.3220096"},{"key":"e_1_2_12_4_2","unstructured":"KipfT. N.andWellingM. Semi-Supervised Classification With Graph Convolutional Networks 5th International Conference on Learning Representations ICLR 2017 April 2017 Toulon France."},{"key":"e_1_2_12_5_2","doi-asserted-by":"publisher","DOI":"10.1007\/s13244-018-0639-9"},{"key":"e_1_2_12_6_2","doi-asserted-by":"publisher","DOI":"10.1080\/15472450.2013.810991"},{"key":"e_1_2_12_7_2","doi-asserted-by":"publisher","DOI":"10.1049\/iet-its.2017.0153"},{"key":"e_1_2_12_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/tvt.2018.2890726"},{"key":"e_1_2_12_9_2","doi-asserted-by":"crossref","unstructured":"WeiH. XuN. ZhangH.et al. Colight: Learning Network-Level Cooperation for Traffic Signal Control Proceedings of the 28th ACM International Conference on Information and Knowledge Management Proceedings of the 28th ACM International Conference on Information and Knowledge Management CIKM 2019 November 2019 Beijing China 1913\u20131922 https:\/\/doi.org\/10.1145\/3357384.3357902.","DOI":"10.1145\/3357384.3357902"},{"key":"e_1_2_12_10_2","article-title":"Deep Deterministic Policy Gradient for Urban Traffic Light Control","author":"Casas N.","year":"2017","journal-title":"CoRR"},{"key":"e_1_2_12_11_2","doi-asserted-by":"crossref","unstructured":"MaJ.andWuF. Feudal Multi-Agent Deep Reinforcement Learning for Traffic Signal Control Proceedings of the 19th International Conference on Autonomous Agents and Multiagent Systems AAMAS\u201920 May 2020 Auckland New Zealand 816\u2013824.","DOI":"10.65109\/UXZA9095"},{"key":"e_1_2_12_12_2","doi-asserted-by":"crossref","unstructured":"XuB. WangY. WangZ. JiaH. andLuZ. Hierarchically and Cooperatively Learning Traffic Signal Control Proceedings of the AAAI Conference on Artificial Intelligence 35 Thirty-Fifth AAAI Conference on Artificial Intelligence AAAI 2021 Thirty-Third Conference on Innovative Applications of Artificial Intelligence IAAI 2021 The Eleventh Symposium on Educational Advances in Artificial Intelligence EAAI 2021 Virtual Event February 2021 no. 1 669\u2013677 https:\/\/doi.org\/10.1609\/aaai.v35i1.16147.","DOI":"10.1609\/aaai.v35i1.16147"},{"key":"e_1_2_12_13_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2021.3062072"},{"key":"e_1_2_12_14_2","article-title":"Transyt-A Traffic Network Study Tool","author":"Robertson D. I.","year":"1969","journal-title":"Report No TRRL-LR-253 (Transport and Road Research Laboratory, Crowthorne)"},{"key":"e_1_2_12_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/t-vt.1980.23833"},{"key":"e_1_2_12_16_2","article-title":"Scoot\u2014A Traffic Responsive Method of Coordinating Signals","author":"Hunt P.","year":"1981","journal-title":"Transport and Road Research Lab Crowthorne, UK"},{"key":"e_1_2_12_17_2","doi-asserted-by":"publisher","DOI":"10.1038\/nature14539"},{"key":"e_1_2_12_18_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2006.874712"},{"key":"e_1_2_12_19_2","first-page":"653","article-title":"Traffic Flow Prediction for Road Transportation Networks with Limited Traffic Data","volume":"16","author":"Abadi A.","year":"2015","journal-title":"IEEE Transactions on Intelligent Transportation Systems"},{"key":"e_1_2_12_20_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2006.874716"},{"key":"e_1_2_12_21_2","unstructured":"WeiW.andZhangY. FL-FN Based Traffic Signal Control Proceedings of the 2002 IEEE International Conference on Fuzzy Systems FUZZ-IEEE\u201902 Honolulu Hawaii USA May 2002 296\u2013300."},{"key":"e_1_2_12_22_2","doi-asserted-by":"publisher","DOI":"10.1109\/jas.2016.7508798"},{"key":"e_1_2_12_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2021.102374"},{"key":"e_1_2_12_24_2","doi-asserted-by":"crossref","unstructured":"DuW. YeJ. GuJ. LiJ. WeiH. andWangG. Safelight: A Reinforcement Learning Method Toward Collision-Free Traffic Signal Control Thirty-Seventh AAAI Conference on Artificial Intelligence AAAI 2023 Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence IAAI 2023 Thirteenth Symposium on Educational Advances in Artificial Intelligence EAAI 2023 February 2023 Washington DC USA 14801\u201314810 https:\/\/doi.org\/10.1609\/aaai.v37i12.26729.","DOI":"10.1609\/aaai.v37i12.26729"},{"key":"e_1_2_12_25_2","doi-asserted-by":"publisher","DOI":"10.1061\/(asce)0733-947x(2003)129:3(278)"},{"key":"e_1_2_12_26_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2010.2091408"},{"key":"e_1_2_12_27_2","doi-asserted-by":"crossref","unstructured":"MannionP. DugganJ. andHowleyE. Parallel Reinforcement Learning for Traffic Signal Control Proceedings of the 6th International Conference on Ambient Systems Networks and Technologies (ANT 2015) the 5th International Conference on Sustainable Energy Information Technology (SEIT-2015) June 2015 London UK 956\u2013961 https:\/\/doi.org\/10.1016\/j.procs.2015.05.172 2-s2.0-84939168316.","DOI":"10.1016\/j.procs.2015.05.172"},{"key":"e_1_2_12_28_2","doi-asserted-by":"crossref","unstructured":"LiC. YanH. andZhaoQ. Efficient Policy Transfer in Large-Scale Traffic Light Control via Multi-Agent Hierarchical Reinforcement Learning 19th IEEE International Conference on Automation Science and Engineering CASE 2023 August 2023 Auckland New Zealand IEEE 1\u20136.","DOI":"10.1109\/CASE56687.2023.10260400"},{"key":"e_1_2_12_29_2","doi-asserted-by":"publisher","DOI":"10.1016\/J.ESWA.2023.121111"},{"key":"e_1_2_12_30_2","doi-asserted-by":"crossref","unstructured":"LiuY. LuoG. YuanQ.et al. Gplight: Grouped Multi-Agent Reinforcement Learning for Large-Scale Traffic Signal Control Proceedings of the Thirty-Second International Joint Conference on Artificial Intelligence IJCAI 2023 August 2023 Macao SAR China 199\u2013207.","DOI":"10.24963\/ijcai.2023\/23"},{"key":"e_1_2_12_31_2","unstructured":"NgA. Y. JordanM. I. andWeissY. On Spectral Clustering: Analysis and an Algorithm Advances in Neural Information Processing Systems 14 Neural Information Processing Systems: Natural and Synthetic NIPS 2001 December 2001 Vancouver British Columbia Canada 849\u2013856."},{"key":"e_1_2_12_32_2","unstructured":"da SilvaA. B. C. de OliveriaD. andBassoE. Adaptive Traffic Control With Reinforcement Learning Proceedings of the 4th Workshop on Agents in Traffic and Transportation (AAMAS 2006) May 2006 80\u201386."},{"key":"e_1_2_12_33_2","doi-asserted-by":"crossref","unstructured":"LoboS. C. NeumeierS. Fern\u00e1ndezE. M. G. andFacchiC. L\u00f3pezP. \u00c1. BuenoO. A. B. ArmelliniM. G.et al. Intas-The Ingolstadt Traffic Scenario for SUMO SUMO User Conference 2020 October 2020 Virtual Event TIB Open Publishing 73\u201392.","DOI":"10.52825\/scp.v1i.102"},{"key":"e_1_2_12_34_2","article-title":"Multi-Agent Deep Reinforcement Learning for Large-Scale Traffic Signal Control","author":"Chu T.","year":"2019","journal-title":"CoRR"}],"container-title":["International Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/int\/8496354","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/full-xml\/10.1155\/int\/8496354","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/int\/8496354","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,8]],"date-time":"2026-03-08T17:57:45Z","timestamp":1772992665000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/int\/8496354"}},"subtitle":[],"editor":[{"given":"Richard","family":"Murray","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2025,1]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,1]]}},"alternative-id":["10.1155\/int\/8496354"],"URL":"https:\/\/doi.org\/10.1155\/int\/8496354","archive":["Portico"],"relation":{},"ISSN":["0884-8173","1098-111X"],"issn-type":[{"value":"0884-8173","type":"print"},{"value":"1098-111X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,1]]},"assertion":[{"value":"2025-04-25","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-09-25","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2025-10-31","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"8496354"}}