{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,20]],"date-time":"2026-06-20T21:43:09Z","timestamp":1781991789607,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":32,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,11,17]],"date-time":"2021-11-17T00:00:00Z","timestamp":1637107200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Spanish Ministry of Science, Innovation and Universities","award":["TIN2017-91223- EXP"],"award-info":[{"award-number":["TIN2017-91223- EXP"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,11,17]]},"DOI":"10.1145\/3486611.3488729","type":"proceedings-article","created":{"date-parts":[[2021,11,18]],"date-time":"2021-11-18T01:24:25Z","timestamp":1637198665000},"page":"319-323","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":40,"title":["Sinergym"],"prefix":"10.1145","author":[{"given":"Javier","family":"Jim\u00e9nez-Raboso","sequence":"first","affiliation":[{"name":"Universidad de Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Alejandro","family":"Campoy-Nieves","sequence":"additional","affiliation":[{"name":"Universidad de Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antonio","family":"Manjavacas-Lucas","sequence":"additional","affiliation":[{"name":"Universidad de Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Juan","family":"G\u00f3mez-Romero","sequence":"additional","affiliation":[{"name":"Universidad de Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Miguel","family":"Molina-Solana","sequence":"additional","affiliation":[{"name":"Universidad de Granada, Spain"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,11,17]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1080\/1350486042000271638"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.3384\/ecp12076173"},{"key":"e_1_3_2_1_3_1","unstructured":"Greg Brockman Vicki Cheung Ludwig Pettersson Jonas Schneider John Schulman Jie Tang and Wojciech Zaremba. 2016. OpenAI Gym. arXiv:arXiv:1606.01540  Greg Brockman Vicki Cheung Ludwig Pettersson Jonas Schneider John Schulman Jie Tang and Wojciech Zaremba. 2016. OpenAI Gym. arXiv:arXiv:1606.01540"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.arcontrol.2018.09.005"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1145\/3360322.3360849"},{"key":"e_1_3_2_1_6_1","volume-title":"EnergyPlus: Energy Simulation Program. Ashrae Journal 42 (04","author":"Crawley Drury","year":"2000","unstructured":"Drury Crawley , Curtis Pedersen , Linda Lawrie , and Frederick Winkelmann . 2000. EnergyPlus: Energy Simulation Program. Ashrae Journal 42 (04 2000 ), 49--56. Drury Crawley, Curtis Pedersen, Linda Lawrie, and Frederick Winkelmann. 2000. EnergyPlus: Energy Simulation Program. Ashrae Journal 42 (04 2000), 49--56."},{"key":"e_1_3_2_1_7_1","volume-title":"Procs. of Building Simulation 2019: 16th Conference of IBPSA","author":"Blum David","unstructured":"David Blum , Filip Jorissen , Sen Huang , Yan Chen , Javier Arroyo , Kyle Benne , Yanfei Li , Valentin Gavan , Lisa Rivalin , Lieve Helsen , Draguna Vrabie , Michael Wetter , and Marina Sofos . 2019. Prototyping the BOPTEST Framework for Simulation-Based Testing of Advanced Control Strategies in Buildings . In Procs. of Building Simulation 2019: 16th Conference of IBPSA . IBPSA , Rome, Italy , 2737--2744. David Blum, Filip Jorissen, Sen Huang, Yan Chen, Javier Arroyo, Kyle Benne, Yanfei Li, Valentin Gavan, Lisa Rivalin, Lieve Helsen, Draguna Vrabie, Michael Wetter, and Marina Sofos. 2019. Prototyping the BOPTEST Framework for Simulation-Based Testing of Advanced Control Strategies in Buildings. In Procs. of Building Simulation 2019: 16th Conference of IBPSA. IBPSA, Rome, Italy, 2737--2744."},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408308.3427986"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"crossref","unstructured":"Hao Dong Zihan Ding and Shanghang Zhang (Eds.). 2020. Deep Reinforcement Learning: Fundamentals Research and Applications. Springer Singapore.  Hao Dong Zihan Ding and Shanghang Zhang (Eds.). 2020. Deep Reinforcement Learning: Fundamentals Research and Applications. Springer Singapore.","DOI":"10.1007\/978-981-15-4095-0"},{"key":"e_1_3_2_1_10_1","unstructured":"Gabriel Dulac-Arnold Nir Levine Daniel J. Mankowitz Jerry Li Cosmin Paduraru Sven Gowal and Todd Hester. 2020. An Empirical Investigation of the Challenges of Real-World Reinforcement Learning. arXiv:2003.11881 http:\/\/arxiv.org\/abs\/2003.11881  Gabriel Dulac-Arnold Nir Levine Daniel J. Mankowitz Jerry Li Cosmin Paduraru Sven Gowal and Todd Hester. 2020. An Empirical Investigation of the Challenges of Real-World Reinforcement Learning. arXiv:2003.11881 http:\/\/arxiv.org\/abs\/2003.11881"},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2015.12.115"},{"key":"e_1_3_2_1_12_1","volume-title":"TensorBoard: TensorFlow's visualization toolkit. https:\/\/www.tensorflow.org\/tensorboard. (Accessed on","year":"2021","unstructured":"Google. 2016. TensorBoard: TensorFlow's visualization toolkit. https:\/\/www.tensorflow.org\/tensorboard. (Accessed on 6 September 2021 ). Google. 2016. TensorBoard: TensorFlow's visualization toolkit. https:\/\/www.tensorflow.org\/tensorboard. (Accessed on 6 September 2021)."},{"key":"e_1_3_2_1_13_1","volume-title":"Deep Reinforcement Learning That Matters. In AAAI Conference on Artificial Intelligence. AAAI Press","author":"Henderson Peter","year":"2018","unstructured":"Peter Henderson , Riashat Islam , Philip Bachman , Joelle Pineau , Doina Precup , and David Meger . 2018 . Deep Reinforcement Learning That Matters. In AAAI Conference on Artificial Intelligence. AAAI Press , New Orleans, Louisiana, USA, 3207--3214. https:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI18\/paper\/view\/16669\/16677 Peter Henderson, Riashat Islam, Philip Bachman, Joelle Pineau, Doina Precup, and David Meger. 2018. Deep Reinforcement Learning That Matters. In AAAI Conference on Artificial Intelligence. AAAI Press, New Orleans, Louisiana, USA, 3207--3214. https:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI18\/paper\/view\/16669\/16677"},{"key":"e_1_3_2_1_14_1","volume-title":"Tensorforce: a TensorFlow library for applied reinforcement learning. https:\/\/github.com\/tensorforce\/tensorforce. (Accessed on","author":"Kuhnle Alexander","year":"2021","unstructured":"Alexander Kuhnle , Michael Schaarschmidt , and Kai Fricke . 2017. Tensorforce: a TensorFlow library for applied reinforcement learning. https:\/\/github.com\/tensorforce\/tensorforce. (Accessed on 4 September 2021 ). Alexander Kuhnle, Michael Schaarschmidt, and Kai Fricke. 2017. Tensorforce: a TensorFlow library for applied reinforcement learning. https:\/\/github.com\/tensorforce\/tensorforce. (Accessed on 4 September 2021)."},{"key":"e_1_3_2_1_15_1","volume-title":"https:\/\/simulationresearch.lbl.gov\/bcvtb\/ (Accessed on","author":"Lawrence Berkeley National Laboratory. 2016.","year":"2021","unstructured":"Lawrence Berkeley National Laboratory. 2016. Building Controls Virtual Test Bed. https:\/\/simulationresearch.lbl.gov\/bcvtb\/ (Accessed on 4 September 2021 ). Lawrence Berkeley National Laboratory. 2016. Building Controls Virtual Test Bed. https:\/\/simulationresearch.lbl.gov\/bcvtb\/ (Accessed on 4 September 2021)."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2019.2927410"},{"key":"e_1_3_2_1_17_1","unstructured":"Antoine Marot Benjamin Donnot Gabriel Dulac-Arnold Adrian Kelly A\u00efdan O'Sullivan Jan Viebahn Mariette Awad Isabelle Guyon Patrick Panciatici and Camilo Romero. 2021. Learning to run a Power Network Challenge: a Retrospective Analysis. arXiv:2103.03104 [cs.LG]  Antoine Marot Benjamin Donnot Gabriel Dulac-Arnold Adrian Kelly A\u00efdan O'Sullivan Jan Viebahn Mariette Awad Isabelle Guyon Patrick Panciatici and Camilo Romero. 2021. Learning to run a Power Network Challenge: a Retrospective Analysis. arXiv:2103.03104 [cs.LG]"},{"key":"e_1_3_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.compeleceng.2019.07.019"},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/S1474-6670(17)43628-7"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature14236"},{"key":"e_1_3_2_1_21_1","volume-title":"Michiaki Tatsubori, Tu-Hoa Pham, Asim Munawar, and Ryuki Tachibana.","author":"Moriyama Takao","year":"2018","unstructured":"Takao Moriyama , Giovanni De Magistris , Michiaki Tatsubori, Tu-Hoa Pham, Asim Munawar, and Ryuki Tachibana. 2018 . Reinforcement Learning Testbed for Power-Consumption Optimization. In Methods and Applications for Modeling and Simulation of Complex Systems. Springer Singapore , Singapore, 45--59. Takao Moriyama, Giovanni De Magistris, Michiaki Tatsubori, Tu-Hoa Pham, Asim Munawar, and Ryuki Tachibana. 2018. Reinforcement Learning Testbed for Power-Consumption Optimization. In Methods and Applications for Modeling and Simulation of Complex Systems. Springer Singapore, Singapore, 45--59."},{"key":"e_1_3_2_1_22_1","volume-title":"https:\/\/github.com\/DLR-RM\/stable-baselines3. (Accessed on","author":"Raffin Antonin","year":"2021","unstructured":"Antonin Raffin , Ashley Hill , Maximilian Ernestus , Adam Gleave , Anssi Kanervisto , and Noah Dormann . 2019. Stable Baselines3. https:\/\/github.com\/DLR-RM\/stable-baselines3. (Accessed on 4 September 2021 ). Antonin Raffin, Ashley Hill, Maximilian Ernestus, Adam Gleave, Anssi Kanervisto, and Noah Dormann. 2019. Stable Baselines3. https:\/\/github.com\/DLR-RM\/stable-baselines3. (Accessed on 4 September 2021)."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.3390\/app11083518"},{"key":"e_1_3_2_1_24_1","volume-title":"Mastering the game of Go without human knowledge. Nature 550, 7676","author":"Silver David","year":"2017","unstructured":"David Silver , Julian Schrittwieser , Karen Simonyan , Ioannis Antonoglou , Aja Huang , Arthur Guez , Thomas Hubert , Lucas Baker , Matthew Lai , Adrian Bolton , Yutian Chen , Timothy Lillicrap , Fan Hui , Laurent Sifre , George van den Driessche , Thore Graepel , and Demis Hassabis . 2017. Mastering the game of Go without human knowledge. Nature 550, 7676 ( 2017 ), 354--359. David Silver, Julian Schrittwieser, Karen Simonyan, Ioannis Antonoglou, Aja Huang, Arthur Guez, Thomas Hubert, Lucas Baker, Matthew Lai, Adrian Bolton, Yutian Chen, Timothy Lillicrap, Fan Hui, Laurent Sifre, George van den Driessche, Thore Graepel, and Demis Hassabis. 2017. Mastering the game of Go without human knowledge. Nature 550, 7676 (2017), 354--359."},{"key":"e_1_3_2_1_25_1","volume-title":"TMY3 Weather Files. https:\/\/www.energycodes.gov\/prototype-building-models#Weather (Accessed on","author":"U.S. Department of Energy. 2021.","year":"2021","unstructured":"U.S. Department of Energy. 2021. TMY3 Weather Files. https:\/\/www.energycodes.gov\/prototype-building-models#Weather (Accessed on 1 September 2021 ). U.S. Department of Energy. 2021. TMY3 Weather Files. https:\/\/www.energycodes.gov\/prototype-building-models#Weather (Accessed on 1 September 2021)."},{"key":"e_1_3_2_1_26_1","unstructured":"Jos\u00e9 R Vazquez-Canteli Sourav Dey Gregor Henze and Zoltan Nagy. 2020. CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management. arXiv:2012.10504 [cs.LG]  Jos\u00e9 R Vazquez-Canteli Sourav Dey Gregor Henze and Zoltan Nagy. 2020. CityLearn: Standardizing Research in Multi-Agent Reinforcement Learning for Demand Response and Urban Energy Management. arXiv:2012.10504 [cs.LG]"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2018.11.002"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3061639.3062224"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408308.3427614"},{"key":"e_1_3_2_1_30_1","unstructured":"Liang Yu Shuqi Qin Meng Zhang Chao Shen Tao Jiang and Xiaohong Guan. 2020. Deep Reinforcement Learning for Smart Building Energy Management: A Survey. arXiv:2008.05074 http:\/\/arxiv.org\/abs\/2008.05074  Liang Yu Shuqi Qin Meng Zhang Chao Shen Tao Jiang and Xiaohong Guan. 2020. Deep Reinforcement Learning for Smart Building Energy Management: A Survey. arXiv:2008.05074 http:\/\/arxiv.org\/abs\/2008.05074"},{"key":"e_1_3_2_1_31_1","first-page":"39","article-title":"Accelerating the Machine Learning Lifecycle with MLflow","volume":"41","author":"Zaharia Matei","year":"2018","unstructured":"Matei Zaharia , Andrew Chen , Aaron Davidson , Ali Ghodsi , Sue Ann Hong , Andy Konwinski , Siddharth Murching , Tomas Nykodym , Paul Ogilvie , Mani Parkhe , Fen Xie , and Corey Zumar . 2018 . Accelerating the Machine Learning Lifecycle with MLflow . IEEE Data Eng. Bull. 41 (2018), 39 -- 45 . Matei Zaharia, Andrew Chen, Aaron Davidson, Ali Ghodsi, Sue Ann Hong, Andy Konwinski, Siddharth Murching, Tomas Nykodym, Paul Ogilvie, Mani Parkhe, Fen Xie, and Corey Zumar. 2018. Accelerating the Machine Learning Lifecycle with MLflow. IEEE Data Eng. Bull. 41 (2018), 39--45.","journal-title":"IEEE Data Eng. Bull."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/3276774.3276775"}],"event":{"name":"BuildSys '21: The 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation","location":"Coimbra Portugal","acronym":"BuildSys '21","sponsor":["SIGEnergy ACM Special Interest Group on Energy Systems and Informatics"]},"container-title":["Proceedings of the 8th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486611.3488729","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3486611.3488729","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:12:05Z","timestamp":1750191125000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3486611.3488729"}},"subtitle":["a building simulation and control framework for training reinforcement learning agents"],"short-title":[],"issued":{"date-parts":[[2021,11,17]]},"references-count":32,"alternative-id":["10.1145\/3486611.3488729","10.1145\/3486611"],"URL":"https:\/\/doi.org\/10.1145\/3486611.3488729","relation":{},"subject":[],"published":{"date-parts":[[2021,11,17]]},"assertion":[{"value":"2021-11-17","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}