{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T21:35:13Z","timestamp":1767908113934,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":28,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,3,30]],"date-time":"2020-03-30T00:00:00Z","timestamp":1585526400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Google"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,3,30]]},"DOI":"10.1145\/3372780.3378174","type":"proceedings-article","created":{"date-parts":[[2020,3,20]],"date-time":"2020-03-20T21:30:19Z","timestamp":1584739819000},"page":"3-7","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":29,"title":["Placement Optimization with Deep Reinforcement Learning"],"prefix":"10.1145","author":[{"given":"Anna","family":"Goldie","sequence":"first","affiliation":[{"name":"Google Brain, Mountain View, CA, USA"}]},{"given":"Azalia","family":"Mirhoseini","sequence":"additional","affiliation":[{"name":"Google Brain, Mountain View, CA, USA"}]}],"member":"320","published-online":{"date-parts":[[2020,3,30]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"Joan Bruna Wojciech Zaremba Arthur Szlam and Yann LeCun. 2013. Spectral Networks and Locally Connected Networks on Graphs. arXiv:cs.LG\/1312.6203  Joan Bruna Wojciech Zaremba Arthur Szlam and Yann LeCun. 2013. Spectral Networks and Locally Connected Networks on Graphs. arXiv:cs.LG\/1312.6203"},{"key":"e_1_3_2_1_2_1","volume-title":"2009 46th ACM\/IEEE Design Automation Conference. 442--447","author":"Chakraborty A."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2018.2859220"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.1987.1270337"},{"key":"e_1_3_2_1_5_1","unstructured":"Micha\u00ebl Defferrard Xavier Bresson and Pierre Vandergheynst. 2016. Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering. arXiv:cs.LG\/1606.09375  Micha\u00ebl Defferrard Xavier Bresson and Pierre Vandergheynst. 2016. Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering. arXiv:cs.LG\/1606.09375"},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/EURDAC.1992.246265"},{"key":"e_1_3_2_1_7_1","volume-title":"Graph Echo State Networks. In The 2010 International Joint Conference on Neural Networks (IJCNN). 1--8. https:\/\/doi.org\/ 10","author":"Gallicchio C.","year":"2010"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/IJCNN.2005.1555942"},{"key":"e_1_3_2_1_9_1","unstructured":"Tuomas Haarnoja Aurick Zhou Pieter Abbeel and Sergey Levine. 2018. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. arXiv:cs.LG\/1801.01290  Tuomas Haarnoja Aurick Zhou Pieter Abbeel and Sergey Levine. 2018. Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor. arXiv:cs.LG\/1801.01290"},{"key":"e_1_3_2_1_10_1","unstructured":"Mikael Henaff Joan Bruna and Yann LeCun. 2015. Deep Convolutional Networks on Graph-Structured Data. arXiv:cs.LG\/1506.05163  Mikael Henaff Joan Bruna and Yann LeCun. 2015. Deep Convolutional Networks on Graph-Structured Data. arXiv:cs.LG\/1506.05163"},{"key":"e_1_3_2_1_11_1","unstructured":"Michael Janner Justin Fu Marvin Zhang and Sergey Levine. 2019. When to Trust Your Model: Model-Based Policy Optimization. arXiv:cs.LG\/1906.08253  Michael Janner Justin Fu Marvin Zhang and Sergey Levine. 2019. When to Trust Your Model: Model-Based Policy Optimization. arXiv:cs.LG\/1906.08253"},{"key":"e_1_3_2_1_12_1","volume-title":"Proceedings of the International Conference on Computer-Aided Design","author":"Kim Myung-Chul"},{"key":"e_1_3_2_1_13_1","unstructured":"S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by Simulated Annealing. Science 220 4598 (1983) 671--680. https:\/\/doi.org\/10.1126\/science. 220.4598.671 arXiv:https:\/\/science.sciencemag.org\/content\/220\/4598\/671.full.pdf  S. Kirkpatrick C. D. Gelatt and M. P. Vecchi. 1983. Optimization by Simulated Annealing. Science 220 4598 (1983) 671--680. https:\/\/doi.org\/10.1126\/science. 220.4598.671 arXiv:https:\/\/science.sciencemag.org\/content\/220\/4598\/671.full.pdf"},{"key":"e_1_3_2_1_14_1","volume-title":"Proceedings of the 56th Annual Design Automation Conference 2019 (DAC '19)","author":"Lin Yibo"},{"key":"e_1_3_2_1_15_1","volume-title":"Chin-Chi Teng, and Chung-Kuan Cheng.","author":"Lu Jingwei","year":"2015"},{"key":"e_1_3_2_1_16_1","unstructured":"Azalia Mirhoseini Anna Goldie Hieu Pham Benoit Steiner Quoc V Le and Jeff Dean. 2018. A Hierarchical Model for Device Placement. In ICLR.  Azalia Mirhoseini Anna Goldie Hieu Pham Benoit Steiner Quoc V Le and Jeff Dean. 2018. A Hierarchical Model for Device Placement. In ICLR."},{"key":"e_1_3_2_1_17_1","unstructured":"Azalia Mirhoseini Hieu Pham Quoc V. Le Benoit Steiner Rasmus Larsen Yuefeng Zhou Naveen Kumar Mohammad Norouzi Samy Bengio and Jeff Dean. 2017. Device Placement Optimization with Reinforcement Learning. In ICML.  Azalia Mirhoseini Hieu Pham Quoc V. Le Benoit Steiner Rasmus Larsen Yuefeng Zhou Naveen Kumar Mohammad Norouzi Samy Bengio and Jeff Dean. 2017. Device Placement Optimization with Reinforcement Learning. In ICML."},{"key":"e_1_3_2_1_18_1","volume-title":"Mehdi Mirza, Alex Graves, Timothy P. Lillicrap, Tim Harley, David Silver, and Koray Kavukcuoglu.","author":"Mnih Volodymyr","year":"2016"},{"key":"e_1_3_2_1_19_1","unstructured":"OpenAI. [n.d.]. OpenAI Five. https:\/\/blog.openai.com\/openai-five\/.  OpenAI. [n.d.]. OpenAI Five. https:\/\/blog.openai.com\/openai-five\/."},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNN.2008.2005605"},{"key":"e_1_3_2_1_21_1","unstructured":"John Schulman Sergey Levine Philipp Moritz Michael I. Jordan and Pieter Abbeel. 2015. Trust Region Policy Optimization. arXiv:cs.LG\/1502.05477  John Schulman Sergey Levine Philipp Moritz Michael I. Jordan and Pieter Abbeel. 2015. Trust Region Policy Optimization. arXiv:cs.LG\/1502.05477"},{"key":"e_1_3_2_1_22_1","unstructured":"John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal Policy Optimization Algorithms. arXiv:cs.LG\/1707.06347  John Schulman Filip Wolski Prafulla Dhariwal Alec Radford and Oleg Klimov. 2017. Proximal Policy Optimization Algorithms. arXiv:cs.LG\/1707.06347"},{"key":"e_1_3_2_1_23_1","volume-title":"Mastering the game of Go with deep neural networks and tree search. Nature","author":"Silver A. Maddison C","year":"2016"},{"key":"e_1_3_2_1_24_1","unstructured":"Oriol Vinyals Igor Babuschkin Junyoung Chung Michael Mathieu Max Jaderberg Wojtek Czarnecki Andrew Dudzik Aja Huang Petko Georgiev Richard Powell Timo Ewalds Dan Horgan Manuel Kroiss Ivo Danihelka John Agapiou Junhyuk Oh Valentin Dalibard David Choi Laurent Sifre Yury Sulsky Sasha Vezhnevets James Molloy Trevor Cai David Budden Tom Paine Caglar Gulcehre Ziyu Wang Tobias Pfaff Toby Pohlen Dani Yogatama Julia Cohen Katrina McKinney Oliver Smith Tom Schaul Timothy Lillicrap Chris Apps Koray Kavukcuoglu Demis Hassabis and David Silver. 2019. AlphaStar: Mastering the Real-Time Strategy Game StarCraft II. https:\/\/deepmind.com\/blog\/alphastarmastering- real-time-strategy-game-starcraft-ii\/.  Oriol Vinyals Igor Babuschkin Junyoung Chung Michael Mathieu Max Jaderberg Wojtek Czarnecki Andrew Dudzik Aja Huang Petko Georgiev Richard Powell Timo Ewalds Dan Horgan Manuel Kroiss Ivo Danihelka John Agapiou Junhyuk Oh Valentin Dalibard David Choi Laurent Sifre Yury Sulsky Sasha Vezhnevets James Molloy Trevor Cai David Budden Tom Paine Caglar Gulcehre Ziyu Wang Tobias Pfaff Toby Pohlen Dani Yogatama Julia Cohen Katrina McKinney Oliver Smith Tom Schaul Timothy Lillicrap Chris Apps Koray Kavukcuoglu Demis Hassabis and David Silver. 2019. AlphaStar: Mastering the Real-Time Strategy Game StarCraft II. https:\/\/deepmind.com\/blog\/alphastarmastering- real-time-strategy-game-starcraft-ii\/."},{"key":"e_1_3_2_1_25_1","volume-title":"Simple statistical gradient-following algorithms for connectionist reinforcement learning. Mach Learn","author":"Williams R.J.","year":"1992"},{"key":"e_1_3_2_1_26_1","volume-title":"Yu","author":"Wu Zonghan","year":"2019"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"crossref","unstructured":"Jinjun Xiong Yiu-Chung Wong Egino Sarto and Lei He1. 2006. Constraint Driven I\/O Planning and Placement for Chip-package Co-design. In APSDAC.  Jinjun Xiong Yiu-Chung Wong Egino Sarto and Lei He1. 2006. Constraint Driven I\/O Planning and Placement for Chip-package Co-design. In APSDAC.","DOI":"10.1145\/1118299.1118356"},{"key":"e_1_3_2_1_28_1","volume-title":"GDP: Generalized Device Placement for Dataflow Graphs. arXiv:cs.LG\/1910.01578","author":"Zhou Yanqi","year":"2019"}],"event":{"name":"ISPD '20: International Symposium on Physical Design","location":"Taipei Taiwan","acronym":"ISPD '20","sponsor":["SIGDA ACM Special Interest Group on Design Automation"]},"container-title":["Proceedings of the 2020 International Symposium on Physical Design"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3372780.3378174","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3372780.3378174","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:16Z","timestamp":1750203856000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3372780.3378174"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,3,30]]},"references-count":28,"alternative-id":["10.1145\/3372780.3378174","10.1145\/3372780"],"URL":"https:\/\/doi.org\/10.1145\/3372780.3378174","relation":{},"subject":[],"published":{"date-parts":[[2020,3,30]]},"assertion":[{"value":"2020-03-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}