{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,11]],"date-time":"2026-03-11T18:45:24Z","timestamp":1773254724455,"version":"3.50.1"},"reference-count":34,"publisher":"Wiley","issue":"1","license":[{"start":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T00:00:00Z","timestamp":1729209600000},"content-version":"vor","delay-in-days":291,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012226","name":"Fundamental Research Funds for the Central Universities","doi-asserted-by":"publisher","award":["2023JBMC055"],"award-info":[{"award-number":["2023JBMC055"]}],"id":[{"id":"10.13039\/501100012226","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["62372021"],"award-info":[{"award-number":["62372021"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003787","name":"Natural Science Foundation of Hebei Province","doi-asserted-by":"publisher","award":["F2023105005"],"award-info":[{"award-number":["F2023105005"]}],"id":[{"id":"10.13039\/501100003787","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["onlinelibrary.wiley.com"],"crossmark-restriction":true},"short-container-title":["International Journal of Intelligent Systems"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:p>Intelligent traffic signal systems, crucial for intelligent transportation systems, have been widely studied and deployed to enhance vehicle traffic efficiency and reduce air pollution. Unfortunately, intelligent traffic signal systems are at risk of data spoofing attack, causing traffic delays, congestion, and even paralysis. In this paper, we reveal a multivehicle collaborative data spoofing attack to intelligent traffic signal systems and propose a collaborative attack sequence generation model based on multiagent reinforcement learning (RL), aiming to explore efficient and stealthy attacks. Specifically, we first model the spoofing attack based on Partially Observable Markov Decision Process (POMDP) at single and multiple intersections. This involves constructing the state space, action space, and defining a reward function for the attack. Then, based on the attack modeling, we propose an automated approach for generating collaborative attack sequences using the Multi\u2010Actor\u2010Attention\u2010Critic (MAAC) algorithm, a mainstream multiagent RL algorithm. Experiments conducted on the multimodal traffic simulation (VISSIM) platform demonstrate a 15% increase in delay time (DT) and a 40% reduction in attack ratio (AR) compared to the single\u2010vehicle attack, confirming the effectiveness and stealthiness of our collaborative attack.<\/jats:p>","DOI":"10.1155\/2024\/4734030","type":"journal-article","created":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T13:34:47Z","timestamp":1729258487000},"update-policy":"https:\/\/doi.org\/10.1002\/crossmark_policy","source":"Crossref","is-referenced-by-count":4,"title":["Collaborative Attack Sequence Generation Model Based on Multiagent Reinforcement Learning for Intelligent Traffic Signal System"],"prefix":"10.1155","volume":"2024","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-0891-1904","authenticated-orcid":false,"given":"Yalun","family":"Wu","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8679-7000","authenticated-orcid":false,"given":"Yingxiao","family":"Xiang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5166-4873","authenticated-orcid":false,"given":"Thar","family":"Baker","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0348-2108","authenticated-orcid":false,"given":"Endong","family":"Tong","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4776-4932","authenticated-orcid":false,"given":"Ye","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0001-1693-2473","authenticated-orcid":false,"given":"Xiaoshu","family":"Cui","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-8371-010X","authenticated-orcid":false,"given":"Zhenguo","family":"Zhang","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3688-873X","authenticated-orcid":false,"given":"Zhen","family":"Han","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1147-4327","authenticated-orcid":false,"given":"Jiqiang","family":"Liu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4706-4266","authenticated-orcid":false,"given":"Wenjia","family":"Niu","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","published-online":{"date-parts":[[2024,10,18]]},"reference":[{"key":"e_1_2_13_1_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2018.2815678"},{"key":"e_1_2_13_2_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2022.3177692"},{"key":"e_1_2_13_3_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2022.3171913"},{"key":"e_1_2_13_4_2","unstructured":"Usdot: Multi-Modal Intelligent Traffic Safety System (Mmitss) 2023 https:\/\/www.its.dot.gov\/researcharchives\/dma\/bundle\/mmitssplan.htm."},{"key":"e_1_2_13_5_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2022.3224395"},{"key":"e_1_2_13_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/tits.2020.3018375"},{"key":"e_1_2_13_7_2","doi-asserted-by":"crossref","unstructured":"ChenQ. A. YinY. FengY. MaoZ. M. andLiuH. X. Exposing Congestion Attack on Emerging Connected Vehicle Based Traffic Signal Control Network and Distributed System Security Symposium February 2018 San Diego CA.","DOI":"10.14722\/ndss.2018.23222"},{"key":"e_1_2_13_8_2","unstructured":"JeskeT. Floating Car Data from Smartphones: What Google and Waze Know about You and How Hackers Can Control Traffic 2012 https:\/\/media.blackhat.com\/eu-13\/briefings\/Jeske\/bh-eu-13-floating-car-data-jeske-wp.pdf."},{"key":"e_1_2_13_9_2","doi-asserted-by":"publisher","DOI":"10.1109\/mcom.2015.7120028"},{"key":"e_1_2_13_10_2","doi-asserted-by":"publisher","DOI":"10.1287\/trsc.31.1.5"},{"key":"e_1_2_13_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2015.01.007"},{"key":"e_1_2_13_12_2","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/8823300"},{"key":"e_1_2_13_13_2","doi-asserted-by":"crossref","unstructured":"WangX. XiangY. NiuW. TongE. andLiuJ. Explainable Congestion Attack Prediction and Software-Level Reinforcement in Intelligent Traffic Signal System 26th IEEE International Conference on Parallel and Distributed Systems ICPADS 2020 December 2020 Hong Kong China IEEE 667\u2013672.","DOI":"10.1109\/ICPADS51040.2020.00094"},{"key":"e_1_2_13_14_2","doi-asserted-by":"crossref","unstructured":"GuptaM.andSandhuR. S. Authorization Framework for Secure Cloud Assisted Connected Cars and Vehicular Internet of Things Proceedings of the 23nd ACM on Symposium on Access Control Models and Technologies SACMAT 2018 June 2018 Indianapolis IN ACM 193\u2013204.","DOI":"10.1145\/3205977.3205994"},{"key":"e_1_2_13_15_2","doi-asserted-by":"publisher","DOI":"10.1109\/mnet.2018.1700324"},{"key":"e_1_2_13_16_2","doi-asserted-by":"publisher","DOI":"10.1109\/mnet.2018.1700327"},{"key":"e_1_2_13_17_2","doi-asserted-by":"publisher","DOI":"10.1109\/jiot.2019.2892009"},{"key":"e_1_2_13_18_2","unstructured":"HaarnojaT. ZhouA. AbbeelP. andLevineS. Soft Actor-Critic: Offpolicy Maximum Entropy Deep Reinforcement Learning With a Stochastic Actor International conference on machine learning July 2018 Stockholm Sweden PMLR 1861\u20131870."},{"key":"e_1_2_13_19_2","unstructured":"IqbalS.andShaF. Actor-Attention-Critic for Multi-Agent Reinforcement Learning International Conference on Machine Learning June 2019 Long Beach CA PMLR 2961\u20132970."},{"key":"e_1_2_13_20_2","unstructured":"Ptv Vissim 2023 https:\/\/www.myptv.com\/en\/mobility-software\/ptv-vissim."},{"key":"e_1_2_13_21_2","doi-asserted-by":"publisher","DOI":"10.1109\/tii.2019.2944850"},{"key":"e_1_2_13_22_2","unstructured":"Us Department of Transportation Hopes to Mandate V2v Communications 2024 https:\/\/www.cnet.com\/roadshow\/news\/us-department-of-transportation-hopes-to-mandate-v2v-communications."},{"key":"e_1_2_13_23_2","doi-asserted-by":"publisher","DOI":"10.1109\/jproc.2011.2132790"},{"key":"e_1_2_13_24_2","doi-asserted-by":"crossref","unstructured":"PatelR. K.andSeymourE. J. The National Transportation Communication for its Protocol (Ntcip) for Transportation Interoperability Proceedings of Conference on Intelligent Transportation Systems Proceedings of Conference on Intelligent Transportation Systems November 1997 Boston MA 543\u2013548 https:\/\/doi.org\/10.1109\/itsc.1997.660532.","DOI":"10.1109\/ITSC.1997.660532"},{"key":"e_1_2_13_25_2","doi-asserted-by":"publisher","DOI":"10.1109\/tii.2021.3084753"},{"key":"e_1_2_13_26_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.cose.2021.102249"},{"key":"e_1_2_13_27_2","doi-asserted-by":"publisher","DOI":"10.1007\/s12083-020-01020-2"},{"key":"e_1_2_13_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/s0004-3702(98)00023-x"},{"key":"e_1_2_13_29_2","unstructured":"CassandraA. R. Exact and Approximate Algorithms for Partially Observable Markov Decision Processes 1998 Brown University Providence RI PhD thesis."},{"key":"e_1_2_13_30_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-27645-3_12"},{"key":"e_1_2_13_31_2","doi-asserted-by":"publisher","DOI":"10.1287\/moor.27.4.819.297"},{"key":"e_1_2_13_32_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-28929-8"},{"key":"e_1_2_13_33_2","doi-asserted-by":"publisher","DOI":"10.1155\/2021\/1632825"},{"key":"e_1_2_13_34_2","doi-asserted-by":"publisher","DOI":"10.1002\/9780470661314"}],"container-title":["International Journal of Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/pdf\/10.1155\/2024\/4734030","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,18]],"date-time":"2024-10-18T13:34:58Z","timestamp":1729258498000},"score":1,"resource":{"primary":{"URL":"https:\/\/onlinelibrary.wiley.com\/doi\/10.1155\/2024\/4734030"}},"subtitle":[],"editor":[{"given":"Konglin","family":"Zhu","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2024,1]]},"references-count":34,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2024,1]]}},"alternative-id":["10.1155\/2024\/4734030"],"URL":"https:\/\/doi.org\/10.1155\/2024\/4734030","archive":["Portico"],"relation":{},"ISSN":["0884-8173","1098-111X"],"issn-type":[{"value":"0884-8173","type":"print"},{"value":"1098-111X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,1]]},"assertion":[{"value":"2024-06-20","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-09-09","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2024-10-18","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}],"article-number":"4734030"}}