{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T23:22:55Z","timestamp":1781911375222,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":30,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T00:00:00Z","timestamp":1637107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100006227","name":"Lawrence Livermore National Laboratory","doi-asserted-by":"publisher","award":["LDRD 20-SI-005"],"award-info":[{"award-number":["LDRD 20-SI-005"]}],"id":[{"id":"10.13039\/100006227","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11,17]]},"DOI":"10.1145\/3486611.3488732","type":"proceedings-article","created":{"date-parts":[[2021,11,18]],"date-time":"2021-11-18T01:24:25Z","timestamp":1637198665000},"page":"333-337","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":10,"title":["Collaborative energy demand response with decentralized actor and centralized critic"],"prefix":"10.1145","author":[{"given":"Ruben","family":"Glatt","sequence":"first","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Felipe Leno da","family":"Silva","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Braden","family":"Soper","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"William A.","family":"Dawson","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Edward","family":"Rusu","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ryan A.","family":"Goldhahn","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,11,17]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2012.2206060"},{"key":"e_1_3_2_1_2_1","volume-title":"A survey of utility experience with real time pricing","author":"Barbose Galen","unstructured":"Galen Barbose , Charles Goldman , and Bernie Neenan . 2004. A survey of utility experience with real time pricing . Technical Report. Lawrence Berkeley National Lab.(LBNL), Berkeley, CA (United States) . Galen Barbose, Charles Goldman, and Bernie Neenan. 2004. A survey of utility experience with real time pricing. Technical Report. Lawrence Berkeley National Lab.(LBNL), Berkeley, CA (United States)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10846-014-0169-8"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCNS.2019.2929648"},{"key":"e_1_3_2_1_5_1","volume-title":"Openai gym. arXiv preprint arXiv:1606.01540","author":"Brockman Greg","year":"2016","unstructured":"Greg Brockman , Vicki Cheung , Ludwig Pettersson , Jonas Schneider , John Schulman , Jie Tang , and Wojciech Zaremba . 2016. Openai gym. arXiv preprint arXiv:1606.01540 ( 2016 ). Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. Openai gym. arXiv preprint arXiv:1606.01540 (2016)."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSMCC.2007.913919"},{"key":"e_1_3_2_1_7_1","volume-title":"Multi-agent reinforcement learning: An overview. Innovations in multi-agent systems and applications-1","author":"Bu\u015foniu Lucian","year":"2010","unstructured":"Lucian Bu\u015foniu , Robert Babu\u0161ka , and Bart De Schutter . 2010. Multi-agent reinforcement learning: An overview. Innovations in multi-agent systems and applications-1 ( 2010 ), 183--221. Lucian Bu\u015foniu, Robert Babu\u0161ka, and Bart De Schutter. 2010. Multi-agent reinforcement learning: An overview. Innovations in multi-agent systems and applications-1 (2010), 183--221."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2019.2952331"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2020.113420"},{"key":"e_1_3_2_1_10_1","volume-title":"International conference on machine learning. PMLR","author":"Haarnoja Tuomas","year":"2018","unstructured":"Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , and Sergey Levine . 2018 . Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor . In International conference on machine learning. PMLR , 1861--1870. Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, and Sergey Levine. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In International conference on machine learning. PMLR, 1861--1870."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSCPES.2015.7115406"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3091574.3091594"},{"key":"e_1_3_2_1_13_1","volume-title":"Multi-agent actor-critic for mixed cooperative-competitive environments. arXiv preprint arXiv:1706.02275","author":"Lowe Ryan","year":"2017","unstructured":"Ryan Lowe , Yi Wu , Aviv Tamar , Jean Harb , Pieter Abbeel , and Igor Mordatch . 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. arXiv preprint arXiv:1706.02275 ( 2017 ). Ryan Lowe, Yi Wu, Aviv Tamar, Jean Harb, Pieter Abbeel, and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. arXiv preprint arXiv:1706.02275 (2017)."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2019.07.019"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"crossref","unstructured":"Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski etal 2015. Human-level control through deep reinforcement learning. nature 518 7540 (2015) 529--533.  Volodymyr Mnih Koray Kavukcuoglu David Silver Andrei A Rusu Joel Veness Marc G Bellemare Alex Graves Martin Riedmiller Andreas K Fidjeland Georg Ostrovski et al. 2015. Human-level control through deep reinforcement learning. nature 518 7540 (2015) 529--533.","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2017.2720471"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/MSCPES.2017.8064542"},{"key":"e_1_3_2_1_18_1","volume-title":"Increasing performance of electric vehicles in ride-hailing services using deep reinforcement learning. arXiv preprint arXiv:1912.03408","author":"Pettit Jacob F","year":"2019","unstructured":"Jacob F Pettit , Ruben Glatt , Jonathan R Donadee , and Brenden K Petersen . 2019. Increasing performance of electric vehicles in ride-hailing services using deep reinforcement learning. arXiv preprint arXiv:1912.03408 ( 2019 ). Jacob F Pettit, Ruben Glatt, Jonathan R Donadee, and Brenden K Petersen. 2019. Increasing performance of electric vehicles in ride-hailing services using deep reinforcement learning. arXiv preprint arXiv:1912.03408 (2019)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.energy.2021.120725"},{"key":"e_1_3_2_1_20_1","volume-title":"Markov decision processes: discrete stochastic dynamic programming","author":"Puterman Martin L","unstructured":"Martin L Puterman . 2014. Markov decision processes: discrete stochastic dynamic programming . John Wiley & Sons . Martin L Puterman. 2014. Markov decision processes: discrete stochastic dynamic programming. John Wiley & Sons."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2021.116940"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.3390\/en11030631"},{"key":"e_1_3_2_1_23_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","unstructured":"Richard S Sutton and Andrew G Barto . 2018. Reinforcement learning: An introduction . MIT press . Richard S Sutton and Andrew G Barto. 2018. Reinforcement learning: An introduction. MIT press."},{"key":"e_1_3_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.5555\/3091529.3091572"},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.scs.2018.05.027"},{"key":"e_1_3_2_1_26_1","volume-title":"CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management. CoRR abs\/2012.10504","author":"V\u00e1zquez-Canteli Jos\u00e9 R.","year":"2020","unstructured":"Jos\u00e9 R. V\u00e1zquez-Canteli , Sourav Dey , Gregor Henze , and Zolt\u00e1n Nagy . 2020. CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management. CoRR abs\/2012.10504 ( 2020 ). arXiv:2012.10504 https:\/\/arxiv.org\/abs\/2012.10504 Jos\u00e9 R. V\u00e1zquez-Canteli, Sourav Dey, Gregor Henze, and Zolt\u00e1n Nagy. 2020. CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management. CoRR abs\/2012.10504 (2020). arXiv:2012.10504 https:\/\/arxiv.org\/abs\/2012.10504"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408308.3427604"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"crossref","unstructured":"Jose R Vazquez-Canteli Zoltan Nagy Gregor Henze and Sourav Dey. 2021. The CityLearn Challenge. https:\/\/sites.google.com\/view\/citylearnchallenge\/home  Jose R Vazquez-Canteli Zoltan Nagy Gregor Henze and Sourav Dey. 2021. The CityLearn Challenge. https:\/\/sites.google.com\/view\/citylearnchallenge\/home","DOI":"10.1145\/3408308.3431122"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2020.115036"},{"key":"e_1_3_2_1_30_1","volume-title":"Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control","author":"Zhang Kaiqing","year":"2021","unstructured":"Kaiqing Zhang , Zhuoran Yang , and Tamer Ba\u015far . 2021. Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control ( 2021 ), 321--384. Kaiqing Zhang, Zhuoran Yang, and Tamer Ba\u015far. 2021. Multi-agent reinforcement learning: A selective overview of theories and algorithms. Handbook of Reinforcement Learning and Control (2021), 321--384."}],"event":{"name":"BuildSys '21: The 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation","location":"Coimbra Portugal","acronym":"BuildSys '21","sponsor":["SIGEnergy ACM Special Interest Group on Energy Systems and Informatics"]},"container-title":["Proceedings of the 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486611.3488732","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3486611.3488732","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3486611.3488732","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:05Z","timestamp":1750191125000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486611.3488732"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,11,17]]},"references-count":30,"alternative-id":["10.1145\/3486611.3488732","10.1145\/3486611"],"URL":"https:\/\/doi.org\/10.1145\/3486611.3488732","relation":{},"subject":[],"published":{"date-parts":[[2021,11,17]]},"assertion":[{"value":"2021-11-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}