{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,19]],"date-time":"2026-06-19T23:15:21Z","timestamp":1781910921352,"version":"3.54.5"},"publisher-location":"New York, NY, USA","reference-count":40,"publisher":"ACM","license":[{"start":{"date-parts":[[2021,6,22]],"date-time":"2021-06-22T00:00:00Z","timestamp":1624320000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100000038","name":"Natural Sciences and Engineering Research Council of Canada","doi-asserted-by":"publisher","award":["530852-18"],"award-info":[{"award-number":["530852-18"]}],"id":[{"id":"10.13039\/501100000038","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2021,6,22]]},"DOI":"10.1145\/3447555.3464855","type":"proceedings-article","created":{"date-parts":[[2021,6,23]],"date-time":"2021-06-23T04:49:35Z","timestamp":1624423775000},"page":"60-72","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":13,"title":["On the Joint Control of Multiple Building Systems with Reinforcement Learning"],"prefix":"10.1145","author":[{"given":"Tianyu","family":"Zhang","sequence":"first","affiliation":[{"name":"University of Alberta"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Gaby","family":"Baasch","sequence":"additional","affiliation":[{"name":"University of Victoria"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omid","family":"Ardakanian","sequence":"additional","affiliation":[{"name":"University of Alberta"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Ralph","family":"Evins","sequence":"additional","affiliation":[{"name":"University of Victoria"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,6,22]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Ergonomics of the thermal environment-Analytical determination and interpretation of thermal comfort using calculation of the PMV and PPD indices and local thermal comfort criteria","author":"ISO","unstructured":"ISO 7730. 2005. Ergonomics of the thermal environment-Analytical determination and interpretation of thermal comfort using calculation of the PMV and PPD indices and local thermal comfort criteria . International Organization for Standardization . ISO 7730. 2005. Ergonomics of the thermal environment-Analytical determination and interpretation of thermal comfort using calculation of the PMV and PPD indices and local thermal comfort criteria. International Organization for Standardization."},{"key":"e_1_3_2_1_2_1","unstructured":"U.S. Energy Information Administration. 2012. Commercial buildings energy consumption survey. U.S. Government Printing Office Chapter Consumption & Expenditures.  U.S. Energy Information Administration. 2012. Commercial buildings energy consumption survey. U.S. Government Printing Office Chapter Consumption & Expenditures."},{"key":"e_1_3_2_1_3_1","volume-title":"Annual Energy Outlook","author":"U.S. Energy Information Administration","year":"2020","unstructured":"U.S. Energy Information Administration . 2020. Annual Energy Outlook 2020 . U.S. Government Printing Office, Chapter Commercial Sector Indicators and Consumption . U.S. Energy Information Administration. 2020. Annual Energy Outlook 2020. U.S. Government Printing Office, Chapter Commercial Sector Indicators and Consumption."},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2018.09.033"},{"key":"e_1_3_2_1_5_1","volume-title":"Energy Use Data Handbook","author":"Canada Natural Resources","year":"1990","unstructured":"Natural Resources Canada . 2019. Energy Use Data Handbook , 1990 to 2017. Natural Resources Canada . Natural Resources Canada. 2019. Energy Use Data Handbook, 1990 to 2017. Natural Resources Canada."},{"key":"e_1_3_2_1_6_1","volume-title":"Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19)","author":"Bingqing","unstructured":"Bingqing Chen et al. 2019. Gnu-RL: A Precocial Reinforcement Learning Solution for Building HVAC Control Using a Differentiable MPC Policy . In Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19) . ACM, 316--325. Bingqing Chen et al. 2019. Gnu-RL: A Precocial Reinforcement Learning Solution for Building HVAC Control Using a Differentiable MPC Policy. In Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19). ACM, 316--325."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2018.03.051"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2016.05.067"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0378-7788(00)00114-6"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2006.07.010"},{"key":"e_1_3_2_1_11_1","volume-title":"Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19)","author":"Xianzhong","unstructured":"Xianzhong Ding et al. 2019. OCTOPUS: Deep Reinforcement Learning for Holistic Smart Building Control . In Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19) . ACM, 326--335. Xianzhong Ding et al. 2019. OCTOPUS: Deep Reinforcement Learning for Holistic Smart Building Control. In Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19). ACM, 326--335."},{"key":"e_1_3_2_1_12_1","volume-title":"Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '20)","author":"Xianzhong","unstructured":"Xianzhong Ding et al. 2020. MB2C: Model-Based Deep Reinforcement Learning for Multi-Zone Building Control . In Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '20) . ACM, 50--59. Xianzhong Ding et al. 2020. MB2C: Model-Based Deep Reinforcement Learning for Multi-Zone Building Control. In Proceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '20). ACM, 50--59."},{"key":"e_1_3_2_1_13_1","volume-title":"Thermal Comfort: Analysis and Applications in Environmental Engineering","author":"Fanger P.O.","year":"1970","unstructured":"P.O. Fanger (Ed.). 1970 . Thermal Comfort: Analysis and Applications in Environmental Engineering . Danish Technical Press , Copenhagen, Denmark . P.O. Fanger (Ed.). 1970. Thermal Comfort: Analysis and Applications in Environmental Engineering. Danish Technical Press, Copenhagen, Denmark."},{"key":"e_1_3_2_1_14_1","doi-asserted-by":"crossref","unstructured":"P. M. Ferreira etal 2012. Neural networks based predictive control for thermal comfort and energy savings in public buildings. Energy and buildings 55 (2012) 238--251.  P. M. Ferreira et al. 2012. Neural networks based predictive control for thermal comfort and energy savings in public buildings. Energy and buildings 55 (2012) 238--251.","DOI":"10.1016\/j.enbuild.2012.08.002"},{"key":"e_1_3_2_1_15_1","unstructured":"Guanyu Gao et al. 2019. Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning. (2019). arXiv:arXiv:1901.04693  Guanyu Gao et al. 2019. Energy-Efficient Thermal Comfort Control in Smart Buildings via Deep Reinforcement Learning. (2019). arXiv:arXiv:1901.04693"},{"key":"e_1_3_2_1_16_1","volume-title":"Proceedings of the Ninth International Conference on Future Energy Systems (e-Energy '18)","author":"Shadan","unstructured":"Shadan Golestan et al. 2018. Data-Driven Models for Building Occupancy Estimation . In Proceedings of the Ninth International Conference on Future Energy Systems (e-Energy '18) . ACM, 277--281. Shadan Golestan et al. 2018. Data-Driven Models for Building Occupancy Estimation. In Proceedings of the Ninth International Conference on Future Energy Systems (e-Energy '18). ACM, 277--281."},{"key":"e_1_3_2_1_17_1","volume-title":"2011 50th IEEE Conference on Decision and Control and European Control Conference. IEEE, 181--186","author":"Siddharth","unstructured":"Siddharth Goyal et al. 2011. Identification of multi-zone building thermal interaction model from data . In 2011 50th IEEE Conference on Decision and Control and European Control Conference. IEEE, 181--186 . Siddharth Goyal et al. 2011. Identification of multi-zone building thermal interaction model from data. In 2011 50th IEEE Conference on Decision and Control and European Control Conference. IEEE, 181--186."},{"key":"e_1_3_2_1_18_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning","volume":"80","author":"Tuomas","year":"1861","unstructured":"Tuomas Haarnoja et al. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor . In Proceedings of the 35th International Conference on Machine Learning , Vol. 80 . PMLR, 1861 --1870. Tuomas Haarnoja et al. 2018. Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In Proceedings of the 35th International Conference on Machine Learning, Vol. 80. PMLR, 1861--1870."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2015.03.045"},{"key":"e_1_3_2_1_20_1","volume-title":"Lighting handbook","author":"IES IESNA.","unstructured":"IES IESNA. 2000. Lighting handbook . Illuminating Engineering Society of North America , New York, USA. IES IESNA. 2000. Lighting handbook. Illuminating Engineering Society of North America, New York, USA."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0952-1976(02)00090-8"},{"key":"e_1_3_2_1_22_1","volume-title":"Proceedings of the Eleventh ACM International Conference on Future Energy Systems (e-Energy '20)","author":"Srinarayana","unstructured":"Srinarayana Nagarathinam et al. 2020. MARCO - Multi-Agent Reinforcement Learning Based COntrol of Building HVAC Systems . In Proceedings of the Eleventh ACM International Conference on Future Energy Systems (e-Energy '20) . ACM, 57--67. Srinarayana Nagarathinam et al. 2020. MARCO - Multi-Agent Reinforcement Learning Based COntrol of Building HVAC Systems. In Proceedings of the Eleventh ACM International Conference on Future Energy Systems (e-Energy '20). ACM, 57--67."},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.7250\/itms-2018-0004"},{"key":"e_1_3_2_1_24_1","volume-title":"Thermal environmental conditions for human occupancy","author":"American Society of Heating, Refrigerating, Air-Conditioning Engineers, and American National Standards Institute. 2004.","unstructured":"American Society of Heating, Refrigerating, Air-Conditioning Engineers, and American National Standards Institute. 2004. Thermal environmental conditions for human occupancy . Vol. 55 . American Society of Heating , Refrigerating and Air-Conditioning Engineers. American Society of Heating, Refrigerating, Air-Conditioning Engineers, and American National Standards Institute. 2004. Thermal environmental conditions for human occupancy. Vol. 55. American Society of Heating, Refrigerating and Air-Conditioning Engineers."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2010.10.022"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.epsr.2020.106543"},{"key":"e_1_3_2_1_27_1","unstructured":"John Schulman et al. 2017. Proximal policy optimization algorithms. (2017). arXiv:arXiv:1707.06347  John Schulman et al. 2017. Proximal policy optimization algorithms. (2017). arXiv:arXiv:1707.06347"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.buildenv.2014.04.028"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"crossref","unstructured":"Arash Tavakoli et al. 2018. Action Branching Architectures for Deep Reinforcement Learning. https:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI18\/paper\/view\/17222  Arash Tavakoli et al. 2018. Action Branching Architectures for Deep Reinforcement Learning. https:\/\/www.aaai.org\/ocs\/index.php\/AAAI\/AAAI18\/paper\/view\/17222","DOI":"10.1609\/aaai.v32i1.11798"},{"key":"e_1_3_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.3390\/en13205396"},{"key":"e_1_3_2_1_31_1","volume-title":"Proceedings of the 10th ACM International Conference on Future Energy Systems (e-Energy '19)","author":"Arun","unstructured":"Arun Vishwanath et al. 2019. Experimental Evaluation of a Data Driven Cooling Optimization Framework for HVAC Control in Commercial Buildings . In Proceedings of the 10th ACM International Conference on Future Energy Systems (e-Energy '19) . ACM, 78--88. Arun Vishwanath et al. 2019. Experimental Evaluation of a Data Driven Cooling Optimization Framework for HVAC Control in Commercial Buildings. In Proceedings of the 10th ACM International Conference on Future Energy Systems (e-Energy '19). ACM, 78--88."},{"key":"e_1_3_2_1_32_1","volume-title":"Dueling Network Architectures for Deep Reinforcement Learning. In Proceedings of the 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"2003","author":"Ziyu","unstructured":"Ziyu Wang et al. 2016 . Dueling Network Architectures for Deep Reinforcement Learning. In Proceedings of the 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 48), Maria Florina Balcan and Kilian Q. Weinberger (Eds.). PMLR, 1995-- 2003 . Ziyu Wang et al. 2016. Dueling Network Architectures for Deep Reinforcement Learning. In Proceedings of the 33rd International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 48), Maria Florina Balcan and Kilian Q. Weinberger (Eds.). PMLR, 1995--2003."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2020.115036"},{"key":"e_1_3_2_1_34_1","volume-title":"OFFICE: Optimization Framework For Improved Comfort Efficiency. In 2020 19th ACM\/IEEE International Conference on Information Processing in Sensor Networks(IPSN). 265--276","author":"Winkler D.A.","year":"2020","unstructured":"D.A. Winkler 2020 . OFFICE: Optimization Framework For Improved Comfort Efficiency. In 2020 19th ACM\/IEEE International Conference on Information Processing in Sensor Networks(IPSN). 265--276 . D.A. Winkler et al. 2020. OFFICE: Optimization Framework For Improved Comfort Efficiency. In 2020 19th ACM\/IEEE International Conference on Information Processing in Sensor Networks(IPSN). 265--276."},{"key":"e_1_3_2_1_35_1","unstructured":"David W\u00f6lfle et al. 2020. A Guide for the Design of Benchmark Environments for Building Energy Optimization (BuildSys '20). ACM 220--229.  David W\u00f6lfle et al. 2020. A Guide for the Design of Benchmark Environments for Building Energy Optimization (BuildSys '20). ACM 220--229."},{"key":"e_1_3_2_1_36_1","volume-title":"Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19)","author":"Chi","unstructured":"Chi Zhang et al. 2019. Building HVAC Scheduling Using Reinforcement Learning via Neural Network Based Model Approximation . In Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19) . ACM, 287--296. Chi Zhang et al. 2019. Building HVAC Scheduling Using Reinforcement Learning via Neural Network Based Model Approximation. In Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation (BuildSys '19). ACM, 287--296."},{"key":"e_1_3_2_1_37_1","volume-title":"Proceedings of the Tenth ACM International Conference on Future Energy Systems (e-Energy '19)","author":"Tianyu","unstructured":"Tianyu Zhang et al. 2019. ODToolkit: A Toolkit for Building Occupancy Detection . In Proceedings of the Tenth ACM International Conference on Future Energy Systems (e-Energy '19) . ACM, 35--46. Tianyu Zhang et al. 2019. ODToolkit: A Toolkit for Building Occupancy Detection. In Proceedings of the Tenth ACM International Conference on Future Energy Systems (e-Energy '19). ACM, 35--46."},{"key":"e_1_3_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1145\/3408308.3431119"},{"key":"e_1_3_2_1_39_1","volume-title":"Proceedings of the 9th International Conference on Future Energy Systems (e-Energy '18)","author":"Zimu","unstructured":"Zimu Zheng et al. 2018. Data Driven Chiller Sequencing for Reducing HVAC Electricity Consumption in Commercial Buildings . In Proceedings of the 9th International Conference on Future Energy Systems (e-Energy '18) . ACM, 236--248. Zimu Zheng et al. 2018. Data Driven Chiller Sequencing for Reducing HVAC Electricity Consumption in Commercial Buildings. In Proceedings of the 9th International Conference on Future Energy Systems (e-Energy '18). ACM, 236--248."},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.23919\/ACC.2017.7963391"}],"event":{"name":"e-Energy '21: The Twelfth ACM International Conference on Future Energy Systems","location":"Virtual Event Italy","acronym":"e-Energy '21"},"container-title":["Proceedings of the Twelfth ACM International Conference on Future Energy Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447555.3464855","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3447555.3464855","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T20:18:32Z","timestamp":1750191512000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3447555.3464855"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,6,22]]},"references-count":40,"alternative-id":["10.1145\/3447555.3464855","10.1145\/3447555"],"URL":"https:\/\/doi.org\/10.1145\/3447555.3464855","relation":{},"subject":[],"published":{"date-parts":[[2021,6,22]]},"assertion":[{"value":"2021-06-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}