{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,24]],"date-time":"2026-03-24T14:17:03Z","timestamp":1774361823502,"version":"3.50.1"},"reference-count":41,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2022,11,8]],"date-time":"2022-11-08T00:00:00Z","timestamp":1667865600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2022,11,8]],"date-time":"2022-11-08T00:00:00Z","timestamp":1667865600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"name":"Fujian Province Science and Technology Plan","award":["2020H0016"],"award-info":[{"award-number":["2020H0016"]}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61802133"],"award-info":[{"award-number":["61802133"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Complex Intell. Syst."],"published-print":{"date-parts":[[2023,4]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>With the increasing traffic congestion in cities, the priority of public transit has become a consensus for the development and management of urban transportation. The traffic pre-signal mechanism, which gives priority in time and space to buses by optimizing road right-of-way allocation, has gained wide attention and application. In order to broaden the action exploration range of the agent and avoid the pre-signal decision from falling into suboptimal strategy or local optimal strategy. For the exploration strategy of the DDQN algorithm, this paper reduces the probability of directly selecting the local optimal action and increases the probability of selecting non-greedy actions based on the principle that \u201cthe action with a larger value function is more likely to be selected.\u201d This paper addresses the problem that the existing urban traffic pre-signal mechanism cannot adaptively adjust the advance time, and proposes a traffic pre-signal adaptive timing mechanism based on a Hybrid Exploration Strategy Double Deep Q Network (HES-DDQN) by combining the<jats:inline-formula><jats:alternatives><jats:tex-math>$$\\epsilon $$<\/jats:tex-math><mml:math xmlns:mml=\"http:\/\/www.w3.org\/1998\/Math\/MathML\"><mml:mi>\u03f5<\/mml:mi><\/mml:math><\/jats:alternatives><\/jats:inline-formula>-greedy strategy and Boltzmann strategy. We have used the traffic simulation software VISSIM to conduct simulation experiments on an intersection. The experimental results show that, compared with the method of setting no pre-signal and the formula method of setting pre-signal, the HES-DDQN pre-signal mechanism can significantly reduce the average delay of buses, the waiting queue length, and the number of stops of social vehicles.<\/jats:p>","DOI":"10.1007\/s40747-022-00903-6","type":"journal-article","created":{"date-parts":[[2022,11,8]],"date-time":"2022-11-08T07:42:39Z","timestamp":1667893359000},"page":"2129-2145","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["An adaptive timing mechanism for urban traffic pre-signal based on hybrid exploration strategy to improve double deep Q network"],"prefix":"10.1007","volume":"9","author":[{"given":"Minglei","family":"Liu","sequence":"first","affiliation":[]},{"given":"Huizhen","family":"Zhang","sequence":"additional","affiliation":[]},{"given":"Youqing","family":"Chen","sequence":"additional","affiliation":[]},{"given":"Hui","family":"Xie","sequence":"additional","affiliation":[]},{"given":"Yubiao","family":"Pan","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,11,8]]},"reference":[{"issue":"5","key":"903_CR1","doi-asserted-by":"publisher","first-page":"1929","DOI":"10.1109\/TITS.2019.2908521","volume":"21","author":"M Seredynski","year":"2019","unstructured":"Seredynski M, Laskaris G, Viti F (2019) Analysis of cooperative bus priority at traffic signals. IEEE Trans Intell Transp Syst 21(5):1929\u20131940","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"903_CR2","doi-asserted-by":"publisher","DOI":"10.1016\/j.trc.2021.103211","volume":"128","author":"W Gu","year":"2021","unstructured":"Gu W, Mei Y, Chen H, Xuan Y, Luo X (2021) An integrated intersection design for promoting bus and car traffic. Transp Res Part C: Emerg Technol 128:103211","journal-title":"Transp Res Part C: Emerg Technol"},{"key":"903_CR3","doi-asserted-by":"publisher","first-page":"2","DOI":"10.1016\/j.trb.2019.01.016","volume":"132","author":"P Anderson","year":"2020","unstructured":"Anderson P, Daganzo CF (2020) Effect of transit signal priority on bus service reliability. Transp Res Part B: Methodol 132:2\u201314","journal-title":"Transp Res Part B: Methodol"},{"key":"903_CR4","first-page":"298","volume":"160","author":"A Russo","year":"2022","unstructured":"Russo A, Adler MW, van Ommeren JN (2022) Dedicated bus lanes, bus speed and traffic congestion in rome. Transp Res Part A: Policy Pract 160:298\u2013310","journal-title":"Transp Res Part A: Policy Pract"},{"key":"903_CR5","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1016\/j.trc.2019.12.001","volume":"111","author":"LO Seman","year":"2020","unstructured":"Seman LO, Koehler LA, Camponogara E, Kraus W Jr (2020) Integrated headway and bus priority control in transit corridors with bidirectional lane segments. Transp Res Part C: Emerg Technol 111:114\u2013134","journal-title":"Transp Res Part C: Emerg Technol"},{"issue":"8","key":"903_CR6","first-page":"563","volume":"32","author":"J Wu","year":"1998","unstructured":"Wu J, Hounsell N (1998) Bus priority using pre-signals. Transp Res Part A: Policy Pract 32(8):563\u2013583","journal-title":"Transp Res Part A: Policy Pract"},{"key":"903_CR7","unstructured":"Oakes J, Metzger D (1995) Park view pre-signals in uxbridge road, ealing. Traffic engineering & control 36(2)"},{"issue":"2","key":"903_CR8","first-page":"127","volume":"15","author":"DA Benerrlli","year":"2005","unstructured":"Benerrlli DA (2005) Bus pre-signals assessment and design guidance. Transit Cooper Res Program Transp Res Board Natl Res Council 15(2):127\u2013138","journal-title":"Transit Cooper Res Program Transp Res Board Natl Res Council"},{"key":"903_CR9","unstructured":"Guler SI, Menendez M (2013) Empirical evaluation of bus and car delays at pre-signals. In: Swiss Transport Research Conference (STRC), Ascona, Switzerland, pp. 1\u201311. SPIE"},{"key":"903_CR10","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1016\/j.trb.2014.03.004","volume":"64","author":"SI Guler","year":"2014","unstructured":"Guler SI, Menendez M (2014) Analytical formulation and empirical evaluation of pre-signals for bus priority. Transp Res Part B: Methodol 64:41\u201353","journal-title":"Transp Res Part B: Methodol"},{"issue":"1","key":"903_CR11","doi-asserted-by":"publisher","first-page":"11","DOI":"10.3141\/2418-02","volume":"2418","author":"SI Guler","year":"2014","unstructured":"Guler SI, Menendez M (2014) Evaluation of presignals at oversaturated signalized intersections. Transp Res Rec 2418(1):11\u201319","journal-title":"Transp Res Rec"},{"issue":"3","key":"903_CR12","doi-asserted-by":"publisher","first-page":"339","DOI":"10.1007\/s12469-015-0104-9","volume":"7","author":"SI Guler","year":"2015","unstructured":"Guler SI, Menendez M (2015) Pre-signals for bus priority: basic guidelines for implementation. Public Transport 7(3):339\u2013354","journal-title":"Public Transport"},{"key":"903_CR13","doi-asserted-by":"publisher","first-page":"28","DOI":"10.1016\/j.trc.2016.01.009","volume":"64","author":"H He","year":"2016","unstructured":"He H, Guler SI, Menendez M (2016) Adaptive control algorithm to provide bus priority with a pre-signal. Transportation Research Part C: Emerging Technologies 64:28\u201344","journal-title":"Transportation Research Part C: Emerging Technologies"},{"issue":"3","key":"903_CR14","doi-asserted-by":"publisher","first-page":"646","DOI":"10.1177\/0361198119835810","volume":"2673","author":"K Bhattacharyya","year":"2019","unstructured":"Bhattacharyya K, Maitra B, Boltze M (2019) Implementation of bus priority with queue jump lane and pre-signal at urban intersections with mixed traffic operations: lessons learned? Transp Res Rec 2673(3):646\u2013657","journal-title":"Transp Res Rec"},{"issue":"8","key":"903_CR15","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1111\/mice.12281","volume":"32","author":"J Zhao","year":"2017","unstructured":"Zhao J, Ma W, Xu H (2017) Increasing the capacity of the intersection downstream of the freeway off-ramp using presignals. Computer-Aided Civil and Infrastructure Engineering 32(8):674\u2013690","journal-title":"Computer-Aided Civil and Infrastructure Engineering"},{"issue":"5","key":"903_CR16","doi-asserted-by":"publisher","first-page":"0217741","DOI":"10.1371\/journal.pone.0217741","volume":"14","author":"Y Li","year":"2019","unstructured":"Li Y, Nan S, Gong X, Ma R (2019) A geometric design method for intersections with pre-signal systems using a phase swap sorting strategy. PLoS ONE 14(5):0217741","journal-title":"PLoS ONE"},{"issue":"6","key":"903_CR17","doi-asserted-by":"crossref","first-page":"04020044","DOI":"10.1061\/JTEPBS.0000360","volume":"146","author":"Y Bie","year":"2020","unstructured":"Bie Y, Liu Z, Wang H (2020) Integrating bus priority and presignal method at signalized intersection: Algorithm development and evaluation. Journal of Transportation Engineering, Part A: Systems 146(6):04020044","journal-title":"Journal of Transportation Engineering, Part A: Systems"},{"key":"903_CR18","doi-asserted-by":"crossref","unstructured":"Zhang Y (2020) An adaptive pre-signal setting to provide bus priority under a coordinated traffic-responsive network. In: 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pp. 1\u20136. IEEE","DOI":"10.1109\/ITSC45102.2020.9294380"},{"issue":"11","key":"903_CR19","first-page":"20","volume":"34","author":"L Jia","year":"2007","unstructured":"Jia L, Mei-Lan S, Han-Hui H (2007) Study on bus priority using pre-signal based on traffic simulation. Journal of Hunan University Natural Sciences(in Chinese) 34(11):20\u201324","journal-title":"Journal of Hunan University Natural Sciences(in Chinese)"},{"key":"903_CR20","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/j.trc.2019.04.028","volume":"104","author":"J Wu","year":"2019","unstructured":"Wu J, Liu P, Qin X, Zhou H, Yang Z (2019) Developing an actuated signal control strategy to improve the operations of contraflow left-turn lane design at signalized intersections. Transportation research part C: emerging technologies 104:53\u201365","journal-title":"Transportation research part C: emerging technologies"},{"issue":"4","key":"903_CR21","first-page":"115","volume":"33","author":"A Shi","year":"2020","unstructured":"Shi A, Lang S, Jian W, Ya-qing W, Xiao-wei H (2020) Main and pre-signal control scheme optimization of turning left by using bus lanes. China Journal of Highway and Transport(in Chinese) 33(4):115","journal-title":"China Journal of Highway and Transport(in Chinese)"},{"key":"903_CR22","unstructured":"Jing X (2020) Research on priority control method of bus signal at intersection based on pre-signal. Master\u2019s thesis, Chongqing Jiaotong University"},{"key":"903_CR23","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1016\/j.physa.2018.02.170","volume":"503","author":"J Huang","year":"2018","unstructured":"Huang J, Hu M-B, Jiang R, Li M (2018) Effect of pre-signals in a manhattan-like urban traffic network. Physica A 503:71\u201385","journal-title":"Physica A"},{"issue":"8","key":"903_CR24","first-page":"36","volume":"39","author":"M Deng","year":"2020","unstructured":"Deng M, Chen J, Yao Y (2020) Intersection signal control based on bus priority and comprehensive approach area. Journal of Chongqing Jiaotong University(Natural Science)(in Chinese) 39(8):36\u201344","journal-title":"Journal of Chongqing Jiaotong University(Natural Science)(in Chinese)"},{"key":"903_CR25","unstructured":"Wang B, Wang Y (2020) Simulation of intersection signal optimization control method based on pre-signal. Computer Simulation(in Chinese) 3"},{"key":"903_CR26","unstructured":"Wang Y, Zhang W (2019) Application of pre-signal in subright bus lane. China Transportation Review(in Chinese), 74\u201379"},{"issue":"2","key":"903_CR27","doi-asserted-by":"publisher","first-page":"168","DOI":"10.1080\/15472450.2020.1797505","volume":"26","author":"J Zhao","year":"2022","unstructured":"Zhao J, Kigen KK, Xia X (2022) An alternative design for traffic intersections with work zones by using pre-signals. Journal of Intelligent Transportation Systems 26(2):168\u2013182","journal-title":"Journal of Intelligent Transportation Systems"},{"key":"903_CR28","doi-asserted-by":"crossref","unstructured":"Liu Y (2021) Research on optimization of bus priority pre-signal control. In: Fifth International Conference on Traffic Engineering and Transportation System (ICTETS 2021), vol. 12058, pp. 451\u2013455. SPIE","DOI":"10.1117\/12.2619659"},{"key":"903_CR29","unstructured":"Li Y (2017) Research of intended bus priority approach based pre-signal adaptive control system. Master\u2019s thesis, Chang\u2019an University"},{"issue":"8","key":"903_CR30","doi-asserted-by":"publisher","first-page":"8243","DOI":"10.1109\/TVT.2020.2997896","volume":"69","author":"T Wu","year":"2020","unstructured":"Wu T, Zhou P, Liu K, Yuan Y, Wang X, Huang H, Wu DO (2020) Multi-agent deep reinforcement learning for urban traffic light control in vehicular networks. IEEE Trans Veh Technol 69(8):8243\u20138256","journal-title":"IEEE Trans Veh Technol"},{"key":"903_CR31","doi-asserted-by":"crossref","unstructured":"Nishi T, Otaki K, Hayakawa K, Yoshimura T (2018) Traffic signal control based on reinforcement learning with graph convolutional neural nets. In: 2018 21st International Conference on Intelligent Transportation Systems (ITSC), pp. 877\u2013883. IEEE","DOI":"10.1109\/ITSC.2018.8569301"},{"issue":"8","key":"903_CR32","doi-asserted-by":"publisher","first-page":"4919","DOI":"10.1109\/TITS.2020.2984033","volume":"22","author":"N Kumar","year":"2020","unstructured":"Kumar N, Rahman SS, Dhakad N (2020) Fuzzy inference enabled deep reinforcement learning-based traffic light control for intelligent transportation system. IEEE Trans Intell Transp Syst 22(8):4919\u20134928","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"903_CR33","doi-asserted-by":"crossref","unstructured":"Shabestray SMA, Abdulhai B (2019) Multimodal intelligent deep (mind) traffic signal controller. In: 2019 IEEE Intelligent Transportation Systems Conference (ITSC), pp. 4532\u20134539. IEEE","DOI":"10.1109\/ITSC.2019.8917493"},{"key":"903_CR34","doi-asserted-by":"crossref","unstructured":"Zeng J, Hu J, Zhang Y (2018) Adaptive traffic signal control with deep recurrent q-learning. In: 2018 IEEE Intelligent Vehicles Symposium (IV), pp. 1215\u20131220. IEEE","DOI":"10.1109\/IVS.2018.8500414"},{"issue":"3","key":"903_CR35","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1109\/JAS.2016.7508798","volume":"3","author":"L Li","year":"2016","unstructured":"Li L, Lv Y, Wang F-Y (2016) Traffic signal timing via deep reinforcement learning. IEEE\/CAA Journal of Automatica Sinica 3(3):247\u2013254","journal-title":"IEEE\/CAA Journal of Automatica Sinica"},{"issue":"5","key":"903_CR36","doi-asserted-by":"publisher","first-page":"1622","DOI":"10.3390\/app10051622","volume":"10","author":"J Gu","year":"2020","unstructured":"Gu J, Fang Y, Sheng Z, Wen P (2020) Double deep q-network with a dual-agent for traffic signal control. Appl Sci 10(5):1622","journal-title":"Appl Sci"},{"issue":"1","key":"903_CR37","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1109\/TITS.2019.2958859","volume":"22","author":"R Zhang","year":"2020","unstructured":"Zhang R, Ishikawa A, Wang W, Striner B, Tonguz OK (2020) Using reinforcement learning with partial vehicle detection for intelligent traffic signal control. IEEE Trans Intell Transp Syst 22(1):404\u2013415","journal-title":"IEEE Trans Intell Transp Syst"},{"key":"903_CR38","doi-asserted-by":"crossref","unstructured":"Van Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double q-learning. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 30","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"903_CR39","doi-asserted-by":"crossref","unstructured":"dos Santos Mignon A, da Rocha RLdA (2017) An adaptive implementation of $$\\varepsilon $$-greedy in reinforcement learning. Procedia Computer Science 109:1146\u20131151","DOI":"10.1016\/j.procs.2017.05.431"},{"key":"903_CR40","doi-asserted-by":"crossref","unstructured":"Lipton Z, Li X, Gao J, Li L, Ahmed F, Deng L (2018) Bbq-networks: Efficient exploration in deep reinforcement learning for task-oriented dialogue systems. Proceedings of the AAAI Conference on Artificial Intelligence 32(1):5237\u20135244","DOI":"10.1609\/aaai.v32i1.11946"},{"key":"903_CR41","first-page":"355","volume":"30","author":"N Cesa-Bianchi","year":"2017","unstructured":"Cesa-Bianchi N, Gentile C, Lugosi G, Neu G (2017) Boltzmann exploration done right. Adv Neural Inf Process Syst 30:355\u2013362","journal-title":"Adv Neural Inf Process Syst"}],"container-title":["Complex &amp; Intelligent Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00903-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s40747-022-00903-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s40747-022-00903-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,10,7]],"date-time":"2024-10-07T17:38:55Z","timestamp":1728322735000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s40747-022-00903-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,11,8]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,4]]}},"alternative-id":["903"],"URL":"https:\/\/doi.org\/10.1007\/s40747-022-00903-6","relation":{},"ISSN":["2199-4536","2198-6053"],"issn-type":[{"value":"2199-4536","type":"print"},{"value":"2198-6053","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,11,8]]},"assertion":[{"value":"20 June 2022","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 October 2022","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"8 November 2022","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare that there is no conflict of interest regarding the publication of this paper.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}