{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,7]],"date-time":"2026-05-07T20:30:40Z","timestamp":1778185840066,"version":"3.51.4"},"reference-count":54,"publisher":"Wiley","license":[{"start":{"date-parts":[[2020,11,20]],"date-time":"2020-11-20T00:00:00Z","timestamp":1605830400000},"content-version":"unspecified","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Key Special Project of Beijing City","award":["Z181100003918011"],"award-info":[{"award-number":["Z181100003918011"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Complexity"],"published-print":{"date-parts":[[2020,11,20]]},"abstract":"<jats:p>Improving the resilience of urban road networks suffering from various disruptions has been a central focus for urban emergence management. However, to date the effective methods which may mitigate the negative impacts caused by the disruptions, such as road accidents and natural disasters, on urban road networks is highly insufficient. This study proposes a novel adaptive signal control strategy based on a doubly dynamic learning framework, which consists of deep reinforcement learning and day-to-day traffic dynamic learning, to improve the network performance by adjusting red\/green time split. In this study, red time split is regarded as extra traffic flow to discourage drivers to use affected roads, so as to reduce congestion and improve the resilience when urban road networks are subject to different levels of disruptions. In addition, we utilize the convolution neural network as Q-network to approximate Q values, link flow distribution and link capacity are regarded as the state space, and actions are denoted as red\/green time split. A small network is utilized as a numerical example, and a fixed time signal control and other two adaptive signal controls are employed for the comparisons with the proposed one. The results show that the proposed adaptive signal control based on deep reinforcement learning can achieve better resilience in most of the cases, particularly in the scenarios of moderate and severe disruptions. This study may shed light on the advantages of the proposed adaptive signal control dealing with major emergencies compared to others.<\/jats:p>","DOI":"10.1155\/2020\/8841317","type":"journal-article","created":{"date-parts":[[2020,11,21]],"date-time":"2020-11-21T23:20:08Z","timestamp":1606000808000},"page":"1-19","source":"Crossref","is-referenced-by-count":30,"title":["Resilience Analysis of Urban Road Networks Based on Adaptive Signal Controls: Day-to-Day Traffic Dynamics with Deep Reinforcement Learning"],"prefix":"10.1155","volume":"2020","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-9162-901X","authenticated-orcid":true,"given":"Wen-Long","family":"Shang","sequence":"first","affiliation":[{"name":"Beijing Key Laboratory of Traffic Engineering, College of Metropolitan Transportation, Beijing University of Technology, Beijing 100124, China"},{"name":"School of Traffic and Transportation, Beijing Jiaotong University, Beijing SW7 2AZ, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yanyan","family":"Chen","sequence":"additional","affiliation":[{"name":"Beijing Key Laboratory of Traffic Engineering, College of Metropolitan Transportation, Beijing University of Technology, Beijing 100124, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5956-0999","authenticated-orcid":true,"given":"Xingang","family":"Li","sequence":"additional","affiliation":[{"name":"School of Traffic and Transportation, Beijing Jiaotong University, Beijing SW7 2AZ, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Washington Y.","family":"Ochieng","sequence":"additional","affiliation":[{"name":"Centre for Transport Studies, Imperial College London, London SW7 2AZ, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"311","reference":[{"key":"1","unstructured":"ShangW. L.Robustness and resilience analysis of Urban Road Networks2017London, EnglandImperial College LondonPhD Thesis"},{"key":"2","first-page":"1","article-title":"A global multi-hazard risk analysis of road and railway infrastructure assets","author":"E. E. Koks","year":"2019","journal-title":"Nature Communications"},{"key":"3","volume-title":"Road-user Cost Due to Unavailability of Interstate 35W Mississippi River Crossing at Minneapolis, Minnesota","author":"Minnesota Department of Transportation","year":"2007"},{"key":"4","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4614-0947-2_2","article-title":"Disruptions to transportation networks: a review","volume-title":"Network Reliability in Practice, Transportation Research, Economics and Policy","author":"S. Zhu","year":"2012"},{"key":"5","author":"China News","year":"2012"},{"key":"6","doi-asserted-by":"publisher","DOI":"10.1007\/s10021-001-0045-9"},{"key":"7","volume-title":"Building a Resilient Business","author":"E. Hoffman","year":"2007"},{"key":"8","doi-asserted-by":"publisher","DOI":"10.1109\/jsyst.2009.2019148"},{"key":"9","doi-asserted-by":"publisher","DOI":"10.1193\/1.2431396"},{"issue":"1","key":"10","first-page":"22","article-title":"Critical infrastructure, interdependencies, and resilience","volume":"37","author":"T. D. O\u2019Rourke","year":"2007","journal-title":"Bridge,Washington-National Academy Of Engineering"},{"key":"11","doi-asserted-by":"publisher","DOI":"10.5194\/nhess-13-221-2013"},{"key":"12","doi-asserted-by":"publisher","DOI":"10.1080\/23249935.2015.1087234"},{"key":"13","first-page":"1","article-title":"Measuring the resilience of transport infrastructure","volume":"546","author":"J. Hughes","year":"2014","journal-title":"NZ Transport Agency Research Report"},{"key":"14","doi-asserted-by":"publisher","DOI":"10.1109\/access.2020.2999129"},{"key":"15","doi-asserted-by":"publisher","DOI":"10.1155\/2020\/5875803"},{"key":"16","doi-asserted-by":"crossref","first-page":"291","DOI":"10.1007\/978-3-540-68056-7_14","article-title":"Moving from protection to resiliency: a path to securing critical infrastructure","volume-title":"Critical Infrastructure Reliability and Vulnerability","author":"L. Schintler","year":"2007"},{"key":"17","doi-asserted-by":"publisher","DOI":"10.1007\/s11069-017-3112-z"},{"key":"18","doi-asserted-by":"publisher","DOI":"10.1504\/ijise.2013.052605"},{"key":"19","doi-asserted-by":"publisher","DOI":"10.1080\/23249935.2015.1087230"},{"key":"20","article-title":"Dynamic restricted equilibrium model to determine statistically the resilience of a traffic network to extreme weather events","author":"M. Nogal"},{"key":"21","doi-asserted-by":"publisher","DOI":"10.1016\/j.trb.2014.08.007"},{"key":"22","volume-title":"Traffic Signal Settings","author":"F. V. Webster","year":"1958"},{"key":"23","first-page":"276","article-title":"TRANSYT method for area traafic control","volume":"11","author":"Robertson","year":"1969","journal-title":"Traffic Engineering and Control"},{"key":"24","first-page":"345","article-title":"Some possibilities for using traffic control to influence trip distribution and route choice","author":"R. ., E. Allsop"},{"key":"25","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-48123-9_15"},{"key":"26","doi-asserted-by":"publisher","DOI":"10.1016\/0191-2615(79)90022-5"},{"key":"27","doi-asserted-by":"publisher","DOI":"10.1016\/0191-2615(79)90021-3"},{"key":"28","doi-asserted-by":"publisher","DOI":"10.1016\/0191-2615(81)90012-6"},{"key":"29","volume-title":"Stochastic User Equilibrium Assignment with Traffic \u2013responsive Signal Control","author":"C. Meneguzzer","year":"1998"},{"key":"30","doi-asserted-by":"publisher","DOI":"10.1016\/s0191-2615(00)00017-5"},{"key":"31","first-page":"11","article-title":"A local traffic control policy which automatically maximises the overall travel capacity of an urban road network","author":"M. J. Smith"},{"key":"32","doi-asserted-by":"publisher","DOI":"10.1023\/a:1025398302560"},{"key":"33","article-title":"An agent-based day-to-day traffic evolution model with information percolation","author":"W. Shang","year":"2017","journal-title":"Transportmetrica A: Transport Science"},{"key":"34","doi-asserted-by":"publisher","DOI":"10.1287\/trsc.18.3.245"},{"key":"35","doi-asserted-by":"publisher","DOI":"10.1287\/opre.42.6.1120"},{"key":"36","doi-asserted-by":"publisher","DOI":"10.1287\/trsc.29.4.305"},{"key":"37","doi-asserted-by":"publisher","DOI":"10.1016\/s0191-2615(98)00033-2"},{"key":"38","doi-asserted-by":"publisher","DOI":"10.1016\/0191-2615(95)00034-8"},{"key":"39","doi-asserted-by":"publisher","DOI":"10.1016\/s0005-1098(02)00179-6"},{"key":"40","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1561\/2200000071","article-title":"An introduction to deep reinforcement learning","volume":"11","author":"F.-L. Vincent","year":"2018","journal-title":"Foundations and Trends in Machine Learning"},{"key":"41","article-title":"Design of reinforcement learning parameters for seamless application of adaptive traffic signal control","author":"S. El-Tantawy","year":"2014","journal-title":"Journal of Intelligent Transportation Systems"},{"key":"42","article-title":"Asymmetric actor critic for image-based robot learning","author":"L. Pinto","year":"2017"},{"key":"43","first-page":"11.1","article-title":"Virtual to real reinforcement learning for autonomous driving","volume-title":"Proceedings of the British Machine Vision Conference (BMVC)","author":"X. Pan","year":"2017"},{"key":"44","doi-asserted-by":"publisher","DOI":"10.1109\/tnnls.2016.2522401"},{"key":"45","doi-asserted-by":"publisher","DOI":"10.1016\/0928-4869(93)90017-k"},{"key":"46","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1016\/S0191-2615(98)00033-2","article-title":"Stability of the stochastic equilibrium assignment problem- a dynamical systems approach","volume":"33","author":"D. Walting","year":"1999","journal-title":"Transportation Research Part B"},{"key":"47","doi-asserted-by":"publisher","DOI":"10.1016\/j.trb.2009.06.007"},{"key":"48","doi-asserted-by":"publisher","DOI":"10.1016\/s0191-2615(99)00025-9"},{"key":"49","doi-asserted-by":"publisher","DOI":"10.1287\/trsc.11.3.253"},{"key":"50","volume-title":"Traffic Assignment Manual","author":"Bureau of Public Roads","year":"1964"},{"key":"51","doi-asserted-by":"publisher","DOI":"10.1002\/atr.1199"},{"key":"52","doi-asserted-by":"publisher","DOI":"10.1016\/j.trb.2015.03.012"},{"key":"53","article-title":"Robustness and topology analysis of european air traffic network using complex network theory","author":"W. Shang"},{"key":"54","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2015.05.016"}],"container-title":["Complexity"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/8841317.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/8841317.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/downloads.hindawi.com\/journals\/complexity\/2020\/8841317.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2020,11,21]],"date-time":"2020-11-21T23:20:15Z","timestamp":1606000815000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.hindawi.com\/journals\/complexity\/2020\/8841317\/"}},"subtitle":[],"editor":[{"given":"Zhile","family":"Yang","sequence":"additional","affiliation":[],"role":[{"role":"editor","vocabulary":"crossref"}]}],"short-title":[],"issued":{"date-parts":[[2020,11,20]]},"references-count":54,"alternative-id":["8841317","8841317"],"URL":"https:\/\/doi.org\/10.1155\/2020\/8841317","relation":{},"ISSN":["1099-0526","1076-2787"],"issn-type":[{"value":"1099-0526","type":"electronic"},{"value":"1076-2787","type":"print"}],"subject":[],"published":{"date-parts":[[2020,11,20]]}}}