{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,21]],"date-time":"2026-01-21T03:48:27Z","timestamp":1768967307556,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":34,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,11,13]],"date-time":"2019-11-13T00:00:00Z","timestamp":1573603200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,11,13]]},"DOI":"10.1145\/3360322.3360857","type":"proceedings-article","created":{"date-parts":[[2019,11,5]],"date-time":"2019-11-05T18:56:15Z","timestamp":1572980175000},"page":"326-335","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":96,"title":["OCTOPUS"],"prefix":"10.1145","author":[{"given":"Xianzhong","family":"Ding","sequence":"first","affiliation":[{"name":"University of California, Merced"}]},{"given":"Wan","family":"Du","sequence":"additional","affiliation":[{"name":"University of California, Merced"}]},{"given":"Alberto","family":"Cerpa","sequence":"additional","affiliation":[{"name":"University of California, Merced"}]}],"member":"320","published-online":{"date-parts":[[2019,11,13]]},"reference":[{"key":"e_1_3_2_1_1_1","unstructured":"2018. sketchup. https:\/\/www.sketchup.com  2018. sketchup. https:\/\/www.sketchup.com"},{"key":"e_1_3_2_1_2_1","unstructured":"2019. https:\/\/www.geze.com\/en\/discover\/topics\/natural-ventilation\/  2019. https:\/\/www.geze.com\/en\/discover\/topics\/natural-ventilation\/"},{"key":"e_1_3_2_1_3_1","unstructured":"2019. https:\/\/www.buildings.com\/article-details\/articleid\/12969\/title\/operable-windows-for-operating-efficiency  2019. https:\/\/www.buildings.com\/article-details\/articleid\/12969\/title\/operable-windows-for-operating-efficiency"},{"key":"e_1_3_2_1_4_1","unstructured":"ANSI\/ASHRAE Standard 62.1. 2016. Ventilation for Acceptable Indoor Air Quality.  ANSI\/ASHRAE Standard 62.1. 2016. Ventilation for Acceptable Indoor Air Quality."},{"key":"e_1_3_2_1_5_1","volume-title":"Standard 55","author":"Refrigerating American Society of Heating and Air-Conditioning Engineers.","year":"2017","unstructured":"Refrigerating American Society of Heating and Air-Conditioning Engineers. Standard 55 . 2017 . Thermal Environmental Conditions for Human Occupancy . Refrigerating American Society of Heating and Air-Conditioning Engineers. Standard 55. 2017. Thermal Environmental Conditions for Human Occupancy."},{"key":"e_1_3_2_1_6_1","doi-asserted-by":"crossref","unstructured":"Alex Beltran and Alberto E Cerpa. 2014. Optimal HVAC building control with occupancy prediction. In ACM BuildSys.  Alex Beltran and Alberto E Cerpa. 2014. Optimal HVAC building control with occupancy prediction. In ACM BuildSys.","DOI":"10.1145\/2674061.2674072"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/2528282.2528301"},{"key":"e_1_3_2_1_8_1","volume-title":"Satisfaction based Q-learning for integrated lighting and blind control. Energy and Buildings","author":"Cheng Zhijin","year":"2016","unstructured":"Zhijin Cheng , Qianchuan Zhao , Fulin Wang , Yi Jiang , Li Xia , and Jinlei Ding . 2016. Satisfaction based Q-learning for integrated lighting and blind control. Energy and Buildings ( 2016 ). Zhijin Cheng, Qianchuan Zhao, Fulin Wang, Yi Jiang, Li Xia, and Jinlei Ding. 2016. Satisfaction based Q-learning for integrated lighting and blind control. Energy and Buildings (2016)."},{"key":"e_1_3_2_1_9_1","volume-title":"Reinforcement learning for energy conservation and comfort in buildings. Building and environment","author":"Dalamagkidis Konstantinos","year":"2007","unstructured":"Konstantinos Dalamagkidis , Denia Kolokotsa , Konstantinos Kalaitzakis , and George S Stavrakakis . 2007. Reinforcement learning for energy conservation and comfort in buildings. Building and environment ( 2007 ). Konstantinos Dalamagkidis, Denia Kolokotsa, Konstantinos Kalaitzakis, and George S Stavrakakis. 2007. Reinforcement learning for energy conservation and comfort in buildings. Building and environment (2007)."},{"key":"e_1_3_2_1_10_1","volume-title":"Practical implementation and evaluation of model predictive control for an office building in Brussels. Energy and Buildings","author":"Coninck Roel De","year":"2016","unstructured":"Roel De Coninck and Lieve Helsen . 2016. Practical implementation and evaluation of model predictive control for an office building in Brussels. Energy and Buildings ( 2016 ). Roel De Coninck and Lieve Helsen. 2016. Practical implementation and evaluation of model predictive control for an office building in Brussels. Energy and Buildings (2016)."},{"key":"e_1_3_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Steven J Emmerich and Andrew K Persily. 2001. State-of-the-art review of CO2 demand controlled ventilation technology and application. Citeseer.  Steven J Emmerich and Andrew K Persily. 2001. State-of-the-art review of CO2 demand controlled ventilation technology and application. Citeseer.","DOI":"10.6028\/NIST.IR.6729"},{"key":"e_1_3_2_1_12_1","volume-title":"Moderate thermal environments Determination of the PMV and PPD indices and specification of the conditions for thermal comfort. ISO 7730","author":"Fanger PO","year":"1984","unstructured":"PO Fanger . 1984. Moderate thermal environments Determination of the PMV and PPD indices and specification of the conditions for thermal comfort. ISO 7730 ( 1984 ). PO Fanger. 1984. Moderate thermal environments Determination of the PMV and PPD indices and specification of the conditions for thermal comfort. ISO 7730 (1984)."},{"key":"e_1_3_2_1_13_1","unstructured":"Poul O Fanger etal 1970. Thermal comfort. Analysis and applications in environmental engineering. Thermal comfort. Analysis and applications in environmental engineering. (1970).  Poul O Fanger et al. 1970. Thermal comfort. Analysis and applications in environmental engineering. Thermal comfort. Analysis and applications in environmental engineering. (1970)."},{"key":"e_1_3_2_1_14_1","unstructured":"Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS.  Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In AISTATS."},{"key":"e_1_3_2_1_15_1","unstructured":"Xavier Glorot Antoine Bordes and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In AISTATS.  Xavier Glorot Antoine Bordes and Yoshua Bengio. 2011. Deep sparse rectifier neural networks. In AISTATS."},{"key":"e_1_3_2_1_16_1","volume-title":"Measurement of Energy and Demand Savings","author":"Guideline ASHRAE","year":"2002","unstructured":"ASHRAE Guideline . 2002. Guideline 14-2002 , Measurement of Energy and Demand Savings . American Society of Heating , Ventilating , and Air Conditioning Engineers, Atlanta, Georgia ( 2002 ). ASHRAE Guideline. 2002. Guideline 14-2002, Measurement of Energy and Demand Savings. American Society of Heating, Ventilating, and Air Conditioning Engineers, Atlanta, Georgia (2002)."},{"key":"e_1_3_2_1_17_1","unstructured":"Kazufumi Ito and Karl Kunisch. 2008. Lagrange multiplier approach to variational problems and applications. Siam.  Kazufumi Ito and Karl Kunisch. 2008. Lagrange multiplier approach to variational problems and applications. Siam."},{"key":"e_1_3_2_1_18_1","volume-title":"Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980","author":"Kingma Diederik P","year":"2014","unstructured":"Diederik P Kingma and Jimmy Ba . 2014 . Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014). Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"crossref","unstructured":"D Kolokotsa GS Stavrakakis K Kalaitzakis and D Agoris. 2002. Genetic algorithms optimized fuzzy controller for the indoor environmental management in buildings implemented using PLC and local operating networks. Engineering Applications of Artificial Intelligence (2002).  D Kolokotsa GS Stavrakakis K Kalaitzakis and D Agoris. 2002. Genetic algorithms optimized fuzzy controller for the indoor environmental management in buildings implemented using PLC and local operating networks. Engineering Applications of Artificial Intelligence (2002).","DOI":"10.1016\/S0952-1976(02)00090-8"},{"key":"e_1_3_2_1_20_1","volume-title":"A multi-grid reinforcement learning method for energy conservation and comfort of HVAC in buildings","author":"Li Bocheng","unstructured":"Bocheng Li and Li Xia . 2015. A multi-grid reinforcement learning method for energy conservation and comfort of HVAC in buildings . In IEEE CASE. Bocheng Li and Li Xia. 2015. A multi-grid reinforcement learning method for energy conservation and comfort of HVAC in buildings. In IEEE CASE."},{"key":"e_1_3_2_1_21_1","unstructured":"Oswaldo Lucon Diana \u00dcrge-Vorsatz A Zain Ahmed Hashem Akbari Paolo Bertoldi Luisa F Cabeza Nicholas Eyre Ashok Gadgil LD Harvey Yi Jiang etal 2014. Buildings. (2014).  Oswaldo Lucon Diana \u00dcrge-Vorsatz A Zain Ahmed Hashem Akbari Paolo Bertoldi Luisa F Cabeza Nicholas Eyre Ashok Gadgil LD Harvey Yi Jiang et al. 2014. Buildings. (2014)."},{"key":"e_1_3_2_1_22_1","unstructured":"U.S. Department of Energy. 2016. EnergyPlus 8.6.0. https:\/\/energyplus.net\/  U.S. Department of Energy. 2016. EnergyPlus 8.6.0. https:\/\/energyplus.net\/"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"crossref","unstructured":"David Christopher Pritchard. 2014. Lighting. Routledge.  David Christopher Pritchard. 2014. Lighting. Routledge.","DOI":"10.4324\/9781315839264"},{"key":"e_1_3_2_1_24_1","volume-title":"PID controller for temperature control with multiple actuators in cyber-physical home system","author":"Shein Wai Wai","unstructured":"Wai Wai Shein , Yasuo Tan , and Azman Osman Lim . 2012. PID controller for temperature control with multiple actuators in cyber-physical home system . In IEEE NBiS. Wai Wai Shein, Yasuo Tan, and Azman Osman Lim. 2012. PID controller for temperature control with multiple actuators in cyber-physical home system. In IEEE NBiS."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"crossref","unstructured":"Zhihao Shen Kang Yang Wan Du Xi Zhao and Jianhua Zou. 2019. DeepAPP: A Deep Reinforcement Learning Framework for Mobile Application Usage Prediction. In ACM SenSys.  Zhihao Shen Kang Yang Wan Du Xi Zhao and Jianhua Zou. 2019. DeepAPP: A Deep Reinforcement Learning Framework for Mobile Application Usage Prediction. In ACM SenSys.","DOI":"10.1145\/3356250.3360038"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"crossref","unstructured":"Arash Tavakoli Fabio Pardo and Petar Kormushev. 2018. Action branching architectures for deep reinforcement learning. In AAAI.  Arash Tavakoli Fabio Pardo and Petar Kormushev. 2018. Action branching architectures for deep reinforcement learning. In AAAI.","DOI":"10.1609\/aaai.v32i1.11798"},{"key":"e_1_3_2_1_27_1","volume-title":"The impact of shading design and control on building cooling and lighting demand. Solar energy","author":"Tzempelikos Athanassios","year":"2007","unstructured":"Athanassios Tzempelikos and Andreas K Athienitis . 2007. The impact of shading design and control on building cooling and lighting demand. Solar energy ( 2007 ). Athanassios Tzempelikos and Andreas K Athienitis. 2007. The impact of shading design and control on building cooling and lighting demand. Solar energy (2007)."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.5555\/3016100.3016191"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.enbuild.2015.01.060"},{"key":"e_1_3_2_1_30_1","unstructured":"Tianshu Wei Yanzhi Wang and Qi Zhu. 2017. Deep reinforcement learning for building HVAC control. In ACM DAC.  Tianshu Wei Yanzhi Wang and Qi Zhu. 2017. Deep reinforcement learning for building HVAC control. In ACM DAC."},{"key":"e_1_3_2_1_31_1","volume-title":"Co-simulation of building energy and control systems with the Building Controls Virtual Test Bed. Journal of Building Performance Simulation","author":"Wetter Michael","year":"2011","unstructured":"Michael Wetter . 2011. Co-simulation of building energy and control systems with the Building Controls Virtual Test Bed. Journal of Building Performance Simulation ( 2011 ). Michael Wetter. 2011. Co-simulation of building energy and control systems with the Building Controls Virtual Test Bed. Journal of Building Performance Simulation (2011)."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"crossref","unstructured":"Daniel A Winkler Alex Beltran Niloufar P Esfahani Paul P Maglio and Alberto E Cerpa. 2016. FORCES: feedback and control for occupants to refine comfort and energy savings. In ACM UbiComp.  Daniel A Winkler Alex Beltran Niloufar P Esfahani Paul P Maglio and Alberto E Cerpa. 2016. FORCES: feedback and control for occupants to refine comfort and energy savings. In ACM UbiComp.","DOI":"10.1145\/2971648.2971700"},{"key":"e_1_3_2_1_33_1","volume-title":"2018 Building Performance Analysis Conference and SimBuild.","author":"Zhang Zhiang","year":"2018","unstructured":"Zhiang Zhang , Adrian Chong , Yuqi Pan , Chenlu Zhang , Siliang Lu , and Khee Poh Lam . 2018 . A deep reinforcement learning approach to using whole building energy model for hvac optimal control . In 2018 Building Performance Analysis Conference and SimBuild. Zhiang Zhang, Adrian Chong, Yuqi Pan, Chenlu Zhang, Siliang Lu, and Khee Poh Lam. 2018. A deep reinforcement learning approach to using whole building energy model for hvac optimal control. In 2018 Building Performance Analysis Conference and SimBuild."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"crossref","unstructured":"Zhiang Zhang and Khee Poh Lam. 2018. Practical implementation and evaluation of deep reinforcement learning control for a radiant heating system. In ACM BuildSys.  Zhiang Zhang and Khee Poh Lam. 2018. Practical implementation and evaluation of deep reinforcement learning control for a radiant heating system. In ACM BuildSys.","DOI":"10.1145\/3276774.3276775"}],"event":{"name":"BuildSys '19: The 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation","location":"New York NY USA","acronym":"BuildSys '19","sponsor":["SIGEnergy ACM Special Interest Group on Energy Systems and Informatics"]},"container-title":["Proceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3360322.3360857","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3360322.3360857","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:44:29Z","timestamp":1750203869000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3360322.3360857"}},"subtitle":["Deep Reinforcement Learning for Holistic Smart Building Control"],"short-title":[],"issued":{"date-parts":[[2019,11,13]]},"references-count":34,"alternative-id":["10.1145\/3360322.3360857","10.1145\/3360322"],"URL":"https:\/\/doi.org\/10.1145\/3360322.3360857","relation":{},"subject":[],"published":{"date-parts":[[2019,11,13]]},"assertion":[{"value":"2019-11-13","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}