{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,29]],"date-time":"2026-09-29T17:28:52Z","timestamp":1790702932286,"version":"4.1.0"},"publisher-location":"New York, NY, USA","reference-count":39,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T00:00:00Z","timestamp":1603065600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,19]]},"DOI":"10.1145\/3340531.3411859","type":"proceedings-article","created":{"date-parts":[[2020,10,19]],"date-time":"2020-10-19T06:32:45Z","timestamp":1603089165000},"page":"1783-1792","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":45,"title":["GeneraLight: Improving Environment Generalization of Traffic Signal Control via Meta Reinforcement Learning"],"prefix":"10.1145","author":[{"given":"Huichu","family":"Zhang","sequence":"first","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chang","family":"Liu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Weinan","family":"Zhang","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Guanjie","family":"Zheng","sequence":"additional","affiliation":[{"name":"The Pennsylvania State University, University Park, PA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yong","family":"Yu","sequence":"additional","affiliation":[{"name":"Shanghai Jiao Tong University, Shanghai, China"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2020,10,19]]},"reference":[{"key":"e_1_3_2_2_1_1","volume-title":"An agent-based learning towards decentralized and coordinated traffic signal control","author":"El-Tantawy Samah","unstructured":"Samah El-Tantawy and Baher Abdulhai . 2010. An agent-based learning towards decentralized and coordinated traffic signal control . In IEEE ITSC. Samah El-Tantawy and Baher Abdulhai. 2010. An agent-based learning towards decentralized and coordinated traffic signal control. In IEEE ITSC."},{"key":"e_1_3_2_2_2_1","volume-title":"JTE","volume":"129","author":"Abdulhai","year":"2003","unstructured":"Abdulhai Baher et al. 2003. Reinforcement learning for true adaptive traffic signal control . JTE , Vol. 129 , 3 ( 2003 ). Abdulhai Baher et al. 2003. Reinforcement learning for true adaptive traffic signal control. JTE, Vol. 129, 3 (2003)."},{"key":"e_1_3_2_2_3_1","unstructured":"Abhishek Gupta et al. 2018a. Meta-Reinforcement Learning of Structured Exploration Strategies. In NeurIPS.  Abhishek Gupta et al. 2018a. Meta-Reinforcement Learning of Structured Exploration Strategies. In NeurIPS."},{"key":"e_1_3_2_2_4_1","unstructured":"Abhishek Gupta et al. 2018b. Unsupervised Meta-Learning for Reinforcement Learning. ArXiv Vol. abs\/1806.04640 (2018).  Abhishek Gupta et al. 2018b. Unsupervised Meta-Learning for Reinforcement Learning. ArXiv Vol. abs\/1806.04640 (2018)."},{"key":"e_1_3_2_2_5_1","unstructured":"Aravind Rajeswaran et al. 2017a. EPOpt: Learning Robust Neural Network Policies Using Model Ensembles. ArXiv Vol. abs\/1610.01283 (2017).  Aravind Rajeswaran et al. 2017a. EPOpt: Learning Robust Neural Network Policies Using Model Ensembles. ArXiv Vol. abs\/1610.01283 (2017)."},{"key":"e_1_3_2_2_6_1","unstructured":"Benjamin Eysenbach et al. 2018c. Diversity is All You Need: Learning Skills without a Reward Function. ArXiv Vol. abs\/1802.06070 (2018).  Benjamin Eysenbach et al. 2018c. Diversity is All You Need: Learning Skills without a Reward Function. ArXiv Vol. abs\/1802.06070 (2018)."},{"key":"e_1_3_2_2_7_1","unstructured":"Chacha Chen et al. [n.d.]. Toward A Thousand Lights: Decentralized Deep Reinforcement Learning for Large-Scale Traffic Signal Control. ( [n. d.]).  Chacha Chen et al. [n.d.]. Toward A Thousand Lights: Decentralized Deep Reinforcement Learning for Large-Scale Traffic Signal Control. ( [n. d.])."},{"key":"e_1_3_2_2_8_1","unstructured":"Chelsea Finn et al. 2017b. Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. In ICML.  Chelsea Finn et al. 2017b. Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. In ICML."},{"key":"e_1_3_2_2_9_1","volume-title":"2019 a. Wasserstein Distributionally Robust Optimization: Theory and Applications in Machine Learning. ArXiv","author":"Daniel Kuhn","year":"2019","unstructured":"Daniel Kuhn et al. 2019 a. Wasserstein Distributionally Robust Optimization: Theory and Applications in Machine Learning. ArXiv , Vol. abs\/ 1908 .08729 ( 2019 ). Daniel Kuhn et al. 2019 a. Wasserstein Distributionally Robust Optimization: Theory and Applications in Machine Learning. ArXiv, Vol. abs\/1908.08729 (2019)."},{"key":"e_1_3_2_2_10_1","volume-title":"2019 b. Hierarchically Structured Meta-learning. ArXiv","author":"Huaxiu Yao","year":"2019","unstructured":"Huaxiu Yao et al. 2019 b. Hierarchically Structured Meta-learning. ArXiv , Vol. abs\/ 1905 .05301 ( 2019 ). Huaxiu Yao et al. 2019 b. Hierarchically Structured Meta-learning. ArXiv, Vol. abs\/1905.05301 (2019)."},{"key":"e_1_3_2_2_11_1","volume-title":"Goodfellow et al","author":"Ian","year":"2014","unstructured":"Ian J. Goodfellow et al . 2014 . Generative Adversarial Networks. ArXiv , Vol. abs\/ 1406 .2661 (2014). Ian J. Goodfellow et al. 2014. Generative Adversarial Networks. ArXiv, Vol. abs\/1406.2661 (2014)."},{"key":"e_1_3_2_2_12_1","volume-title":"Wang et al","author":"Jane","year":"2017","unstructured":"Jane X. Wang et al . 2017 c. Learning to reinforcement learn. ArXiv , Vol. abs\/ 1611 .05763 (2017). Jane X. Wang et al. 2017c. Learning to reinforcement learn. ArXiv, Vol. abs\/1611.05763 (2017)."},{"key":"e_1_3_2_2_13_1","volume-title":"2019 c. Improving Generalization in Meta Reinforcement Learning using Learned Objectives. ArXiv","author":"Louis Kirsch","year":"2019","unstructured":"Louis Kirsch et al. 2019 c. Improving Generalization in Meta Reinforcement Learning using Learned Objectives. ArXiv , Vol. abs\/ 1910 .04098 ( 2019 ). Louis Kirsch et al. 2019 c. Improving Generalization in Meta Reinforcement Learning using Learned Objectives. ArXiv, Vol. abs\/1910.04098 (2019)."},{"key":"e_1_3_2_2_14_1","unstructured":"Lerrel Pinto et al. 2017 d. Robust Adversarial Reinforcement Learning. In ICML.  Lerrel Pinto et al. 2017 d. Robust Adversarial Reinforcement Learning. In ICML."},{"key":"e_1_3_2_2_15_1","volume-title":"2017 e. Wasserstein GAN. ArXiv","author":"Mart\u00edn Arjovsky","year":"2017","unstructured":"Mart\u00edn Arjovsky et al. 2017 e. Wasserstein GAN. ArXiv , Vol. abs\/ 1701 .07875 ( 2017 ). Mart\u00edn Arjovsky et al. 2017 e. Wasserstein GAN. ArXiv, Vol. abs\/1701.07875 (2017)."},{"key":"e_1_3_2_2_16_1","unstructured":"Nikhil Mishra et al. 2018 d. A Simple Neural Attentive Meta-Learner. In ICLR.  Nikhil Mishra et al. 2018 d. A Simple Neural Attentive Meta-Learner. In ICLR."},{"key":"e_1_3_2_2_17_1","unstructured":"Rein Houthooft et al. 2018 e. Evolved Policy Gradients. In NeurIPS.  Rein Houthooft et al. 2018 e. Evolved Policy Gradients. In NeurIPS."},{"key":"e_1_3_2_2_18_1","unstructured":"Roess Roger P et al. 2004. Traffic engineering .Pearson\/Prentice Hall.  Roess Roger P et al. 2004. Traffic engineering .Pearson\/Prentice Hall."},{"key":"e_1_3_2_2_19_1","volume-title":"2018 f. Toward Multimodal Model-Agnostic Meta-Learning. ArXiv","author":"Risto Vuorio","year":"2018","unstructured":"Risto Vuorio et al. 2018 f. Toward Multimodal Model-Agnostic Meta-Learning. ArXiv , Vol. abs\/ 1812 .07172 ( 2018 ). Risto Vuorio et al. 2018 f. Toward Multimodal Model-Agnostic Meta-Learning. ArXiv, Vol. abs\/1812.07172 (2018)."},{"key":"e_1_3_2_2_20_1","volume-title":"Lillicrap et al","author":"Timothy","year":"2015","unstructured":"Timothy P. Lillicrap et al . 2015 a. Continuous control with deep reinforcement learning. CoRR , Vol. abs\/ 1509 .02971 (2015). Timothy P. Lillicrap et al. 2015a. Continuous control with deep reinforcement learning. CoRR, Vol. abs\/1509.02971 (2015)."},{"key":"e_1_3_2_2_21_1","volume-title":"Nature","volume":"518","author":"Volodymyr","year":"2015","unstructured":"Volodymyr Mnih et al. 2015b. Human-level control through deep reinforcement learning . Nature , Vol. 518 ( 2015 ). Volodymyr Mnih et al. 2015b. Human-level control through deep reinforcement learning. Nature, Vol. 518 (2015)."},{"key":"e_1_3_2_2_22_1","doi-asserted-by":"crossref","unstructured":"Wei Hua et al. 2018 g. Intellilight: A reinforcement learning approach for intelligent traffic light control. In SIGKDD. 2496--2505.  Wei Hua et al. 2018 g. Intellilight: A reinforcement learning approach for intelligent traffic light control. In SIGKDD. 2496--2505.","DOI":"10.1145\/3219819.3220096"},{"key":"e_1_3_2_2_23_1","doi-asserted-by":"crossref","unstructured":"Wei Hua et al. 2019 d. Colight: Learning network-level cooperation for traffic signal control. In CIKM. 1913--1922.  Wei Hua et al. 2019 d. Colight: Learning network-level cooperation for traffic signal control. In CIKM. 1913--1922.","DOI":"10.1145\/3357384.3357902"},{"key":"e_1_3_2_2_24_1","volume-title":"2019 e","author":"Wei Hua","unstructured":"Wei Hua et al. 2019 e . PressLight: Learning Max Pressure Control to Coordinate Traffic Signals in Arterial Network. In SIGKDD. Wei Hua et al. 2019 e. PressLight: Learning Max Pressure Control to Coordinate Traffic Signals in Arterial Network. In SIGKDD."},{"key":"e_1_3_2_2_25_1","doi-asserted-by":"crossref","unstructured":"Xiong Yuanhao et al. 2019 f. Learning Traffic Signal Control from Demonstrations.  Xiong Yuanhao et al. 2019 f. Learning Traffic Signal Control from Demonstrations.","DOI":"10.1145\/3357384.3358079"},{"key":"e_1_3_2_2_26_1","doi-asserted-by":"crossref","unstructured":"Xinshi Zang et al. 2020. MetaLight: Value-based Meta-reinforcement Learning for Traffic Signal Control. In AAAI.  Xinshi Zang et al. 2020. MetaLight: Value-based Meta-reinforcement Learning for Traffic Signal Control. In AAAI.","DOI":"10.1609\/aaai.v34i01.5467"},{"key":"e_1_3_2_2_27_1","unstructured":"Yan Duan et al. 2016. $RL^2$: Fast Reinforcement Learning via Slow Reinforcement Learning. ArXiv Vol. abs\/1611.02779 (2016).  Yan Duan et al. 2016. $RL^2$: Fast Reinforcement Learning via Slow Reinforcement Learning. ArXiv Vol. abs\/1611.02779 (2016)."},{"key":"e_1_3_2_2_28_1","unstructured":"Yesmina Ja\u00e2fr et al. 2019 g. Robust Reinforcement Learning for Autonomous Driving. In DeepRLStructPred@ICLR.  Yesmina Ja\u00e2fr et al. 2019 g. Robust Reinforcement Learning for Autonomous Driving. In DeepRLStructPred@ICLR."},{"key":"e_1_3_2_2_29_1","unstructured":"Zheng Guanjie et al. 2019 h. Learning phase competition for traffic signal control. In CIKM. 1963--1972.  Zheng Guanjie et al. 2019 h. Learning phase competition for traffic signal control. In CIKM. 1963--1972."},{"key":"e_1_3_2_2_30_1","doi-asserted-by":"crossref","unstructured":"Zhang Huichu et al. 2019 i. Cityflow: A multi-agent reinforcement learning environment for large scale city traffic scenario. In WWW.  Zhang Huichu et al. 2019 i. Cityflow: A multi-agent reinforcement learning environment for large scale city traffic scenario. In WWW.","DOI":"10.1145\/3308558.3314139"},{"key":"e_1_3_2_2_31_1","unstructured":"James B. MacQueen. 1967. Some methods for classification and analysis of multivariate observations.  James B. MacQueen. 1967. Some methods for classification and analysis of multivariate observations."},{"key":"e_1_3_2_2_32_1","volume-title":"Mannion","author":"Patrick","year":"2016","unstructured":"Patrick et al. Mannion . 2016 . An experimental review of reinforcement learning algorithms for adaptive traffic signal control. In Autonomic road transport support systems. Springer , 47--66. Patrick et al. Mannion. 2016. An experimental review of reinforcement learning algorithms for adaptive traffic signal control. In Autonomic road transport support systems. Springer, 47--66."},{"key":"e_1_3_2_2_33_1","volume-title":"JORS","volume":"14","author":"Miller Alan J","year":"1963","unstructured":"Alan J Miller . 1963 . Settings for fixed-cycle traffic signals . JORS , Vol. 14 , 4 (1963). Alan J Miller. 1963. Settings for fixed-cycle traffic signals. JORS, Vol. 14, 4 (1963)."},{"key":"e_1_3_2_2_34_1","volume-title":"Transportation Research","volume":"9","author":"Mirchandani Pitu","year":"2001","unstructured":"Pitu Mirchandani and Larry Head . 2001 . A real-time traffic signal control system: architecture, algorithms, and analysis . Transportation Research , Vol. 9 , 6 (2001). Pitu Mirchandani and Larry Head. 2001. A real-time traffic signal control system: architecture, algorithms, and analysis. Transportation Research, Vol. 9, 6 (2001)."},{"key":"e_1_3_2_2_35_1","article-title":"Reinforcement Learning: An Introduction","volume":"16","author":"Sutton Richard S.","year":"1998","unstructured":"Richard S. Sutton and Andrew G. Barto . 1998 . Reinforcement Learning: An Introduction . IEEE Trans. Neural Networks , Vol. 16 (1998). Richard S. Sutton and Andrew G. Barto. 1998. Reinforcement Learning: An Introduction. IEEE Trans. Neural Networks, Vol. 16 (1998).","journal-title":"IEEE Trans. Neural Networks"},{"key":"e_1_3_2_2_36_1","unstructured":"A\"aron van den Oord et al. 2016. WaveNet: A Generative Model for Raw Audio. ArXiv Vol. abs\/1609.03499 (2016).  A\"aron van den Oord et al. 2016. WaveNet: A Generative Model for Raw Audio. ArXiv Vol. abs\/1609.03499 (2016)."},{"key":"e_1_3_2_2_37_1","volume-title":"Velivc kovi\u0107","author":"Petar","year":"2017","unstructured":"Petar et al. Velivc kovi\u0107 . 2017 . Graph attention networks. arXiv:1710.10903 (2017). Petar et al. Velivc kovi\u0107. 2017. Graph attention networks. arXiv:1710.10903 (2017)."},{"key":"e_1_3_2_2_38_1","volume-title":"A Survey on Traffic Signal Control Methods. ArXiv","author":"Wei Hua","year":"2019","unstructured":"Hua Wei , Guanjie Zheng , Vikash V. Gayah , and Zhenhui Li. 2019. A Survey on Traffic Signal Control Methods. ArXiv , Vol. abs\/ 1904 .08117 ( 2019 ). Hua Wei, Guanjie Zheng, Vikash V. Gayah, and Zhenhui Li. 2019. A Survey on Traffic Signal Control Methods. ArXiv, Vol. abs\/1904.08117 (2019)."},{"key":"e_1_3_2_2_39_1","unstructured":"MA Wiering. 2000. Multi-agent reinforcement learning for traffic light control. In ICML. 1151--1158.  MA Wiering. 2000. Multi-agent reinforcement learning for traffic light control. In ICML. 1151--1158."}],"event":{"name":"CIKM '20: The 29th ACM International Conference on Information and Knowledge Management","location":"Virtual Event Ireland","acronym":"CIKM '20","sponsor":["SIGWEB ACM Special Interest Group on Hypertext, Hypermedia, and Web","SIGIR ACM Special Interest Group on Information Retrieval"]},"container-title":["Proceedings of the 29th ACM International Conference on Information & Knowledge Management"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340531.3411859","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3340531.3411859","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T00:25:49Z","timestamp":1750206349000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3340531.3411859"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,19]]},"references-count":39,"alternative-id":["10.1145\/3340531.3411859","10.1145\/3340531"],"URL":"https:\/\/doi.org\/10.1145\/3340531.3411859","relation":{},"subject":[],"published":{"date-parts":[[2020,10,19]]},"assertion":[{"value":"2020-10-19","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}