{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,9]],"date-time":"2026-08-09T21:17:41Z","timestamp":1786310261699,"version":"build-2736575974"},"publisher-location":"New York, NY, USA","reference-count":43,"publisher":"ACM","license":[{"start":{"date-parts":[[2024,5,31]],"date-time":"2024-05-31T00:00:00Z","timestamp":1717113600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"Agentschap Innoveren & Ondernemen (VLAIO)","award":["InduFlexControl-2"],"award-info":[{"award-number":["InduFlexControl-2"]}]},{"name":"FOD Economy","award":["FlexMyHeat"],"award-info":[{"award-number":["FlexMyHeat"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2024,6,4]]},"DOI":"10.1145\/3632775.3661948","type":"proceedings-article","created":{"date-parts":[[2024,7,9]],"date-time":"2024-07-09T15:31:37Z","timestamp":1720539097000},"page":"123-133","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":6,"title":["Control Policy Correction Framework for Reinforcement Learning-based Energy Arbitrage Strategies"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-8072-4532","authenticated-orcid":false,"given":"Seyed soroush","family":"Karimi madahi","sequence":"first","affiliation":[{"name":"IDLab Ghent University ? imec, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1451-397X","authenticated-orcid":false,"given":"Gargya","family":"Gokhale","sequence":"additional","affiliation":[{"name":"IDLab Ghent University ? imec, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0007-9656-7907","authenticated-orcid":false,"given":"Marie-Sophie","family":"Verwee","sequence":"additional","affiliation":[{"name":"IDLab Ghent University ? imec, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0006-6116-1483","authenticated-orcid":false,"given":"Bert","family":"Claessens","sequence":"additional","affiliation":[{"name":"Beebop, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-2707-4176","authenticated-orcid":false,"given":"Chris","family":"Develder","sequence":"additional","affiliation":[{"name":"IDLab Ghent University ? imec, Belgium"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2024,5,31]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"International conference on machine learning. PMLR, 22\u201331","author":"Achiam Joshua","year":"2017","unstructured":"Joshua Achiam, David Held, Aviv Tamar, and Pieter Abbeel. 2017. Constrained policy optimization. In International conference on machine learning. PMLR, 22\u201331."},{"key":"e_1_3_2_1_2_1","volume-title":"Differentiable convex optimization layers. Advances in neural information processing systems 32","author":"Agrawal Akshay","year":"2019","unstructured":"Akshay Agrawal, Brandon Amos, Shane Barratt, Stephen Boyd, Steven Diamond, and J\u00a0Zico Kolter. 2019. Differentiable convex optimization layers. Advances in neural information processing systems 32 (2019)."},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v32i1.11797"},{"key":"e_1_3_2_1_4_1","volume-title":"Large scale distributed neural network training through online distillation. arXiv preprint arXiv:1804.03235","author":"Anil Rohan","year":"2018","unstructured":"Rohan Anil, Gabriel Pereyra, Alexandre Passos, Robert Ormandi, George\u00a0E Dahl, and Geoffrey\u00a0E Hinton. 2018. Large scale distributed neural network training through online distillation. arXiv preprint arXiv:1804.03235 (2018)."},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/EEM49802.2020.9221978"},{"key":"e_1_3_2_1_6_1","volume-title":"International conference on machine learning. PMLR, 449\u2013458","author":"Bellemare G","year":"2017","unstructured":"Marc\u00a0G Bellemare, Will Dabney, and R\u00e9mi Munos. 2017. A distributional perspective on reinforcement learning. In International conference on machine learning. PMLR, 449\u2013458."},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPWRS.2019.2940756"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.35833\/MPCE.2020.000552"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2020.2986333"},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447555.3464874"},{"key":"e_1_3_2_1_11_1","volume-title":"Safe exploration in continuous action spaces. arXiv preprint arXiv:1801.08757","author":"Dalal Gal","year":"2018","unstructured":"Gal Dalal, Krishnamurthy Dvijotham, Matej Vecerik, Todd Hester, Cosmin Paduraru, and Yuval Tassa. 2018. Safe exploration in continuous action spaces. arXiv preprint arXiv:1801.08757 (2018)."},{"key":"e_1_3_2_1_12_1","volume-title":"Distributional soft actor-critic: Off-policy reinforcement learning for addressing value estimation errors","author":"Duan Jingliang","year":"2021","unstructured":"Jingliang Duan, Yang Guan, Shengbo\u00a0Eben Li, Yangang Ren, Qi Sun, and Bo Cheng. 2021. Distributional soft actor-critic: Off-policy reinforcement learning for addressing value estimation errors. IEEE transactions on neural networks and learning systems 33, 11 (2021), 6584\u20136598."},{"key":"e_1_3_2_1_13_1","volume-title":"Explanatory document to all TSOs","author":"Transmission System European Network","year":"2017","unstructured":"European Network of Transmission System Operators for Electricity. 2018. Explanatory document to all TSOs\u2019 proposal to further specify and harmonise imbalance settlement in accordance with Article 52(2) of Commission Regulation (EU) 2017\/2195 of 23 November 2017, establishing a guideline on electricity balancing. (2018)."},{"key":"e_1_3_2_1_14_1","volume-title":"Stability constrained reinforcement learning for decentralized real-time voltage control","author":"Feng Jie","year":"2023","unstructured":"Jie Feng, Yuanyuan Shi, Guannan Qu, Steven\u00a0H Low, Anima Anandkumar, and Adam Wierman. 2023. Stability constrained reinforcement learning for decentralized real-time voltage control. IEEE Transactions on Control of Network Systems (2023)."},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.5555\/2789272.2886795"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11263-021-01453-z"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3575813.3597351"},{"key":"e_1_3_2_1_18_1","volume-title":"Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531","author":"Hinton Geoffrey","year":"2015","unstructured":"Geoffrey Hinton, Oriol Vinyals, and Jeff Dean. 2015. Distilling the knowledge in a neural network. arXiv preprint arXiv:1503.02531 (2015)."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.rser.2020.110467"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCST.2020.3016077"},{"key":"e_1_3_2_1_21_1","volume-title":"International Conference on Machine Learning. PMLR, 5714\u20135724","author":"Lee Hankook","year":"2020","unstructured":"Hankook Lee, Sung\u00a0Ju Hwang, and Jinwoo Shin. 2020. Self-supervised label augmentation via input transformations. In International Conference on Machine Learning. PMLR, 5714\u20135724."},{"key":"e_1_3_2_1_22_1","volume-title":"NeurIPS 2022 Workshop on Tackling Climate Change with Machine Learning.","author":"Li Jinhao","year":"2022","unstructured":"Jinhao Li, Changlong Wang, Yanru Zhang, and Hao Wang. 2022. Learn to bid: Deep reinforcement learning with transformer for energy storage bidding in energy and contingency reserve markets. In NeurIPS 2022 Workshop on Tackling Climate Change with Machine Learning."},{"key":"e_1_3_2_1_23_1","volume-title":"Distributional Reinforcement Learning-based Energy Arbitrage Strategies in Imbalance Settlement Mechanism. arXiv preprint arXiv:2401.00015","author":"Soroush\u00a0Karimi Madahi Seyed","year":"2023","unstructured":"Seyed Soroush\u00a0Karimi Madahi, Bert Claessens, and Chris Develder. 2023. Distributional Reinforcement Learning-based Energy Arbitrage Strategies in Imbalance Settlement Mechanism. arXiv preprint arXiv:2401.00015 (2023)."},{"key":"e_1_3_2_1_24_1","volume-title":"Human-level control through deep reinforcement learning. nature 518, 7540","author":"Mnih Volodymyr","year":"2015","unstructured":"Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Andrei\u00a0A Rusu, Joel Veness, Marc\u00a0G Bellemare, Alex Graves, Martin Riedmiller, Andreas\u00a0K Fidjeland, Georg Ostrovski, 2015. Human-level control through deep reinforcement learning. nature 518, 7540 (2015), 529\u2013533."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/SP.2016.41"},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i15.17610"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307772.3328279"},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1145\/3563357.3564067"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2016.2517211"},{"key":"e_1_3_2_1_30_1","volume-title":"Trial without error: Towards safe reinforcement learning via human intervention. arXiv preprint arXiv:1707.05173","author":"Saunders William","year":"2017","unstructured":"William Saunders, Girish Sastry, Andreas Stuhlmueller, and Owain Evans. 2017. Trial without error: Towards safe reinforcement learning via human intervention. arXiv preprint arXiv:1707.05173 (2017)."},{"key":"e_1_3_2_1_31_1","first-page":"27209","article-title":"Is bang-bang control all you need? solving continuous control with bernoulli policies","volume":"34","author":"Seyde Tim","year":"2021","unstructured":"Tim Seyde, Igor Gilitschenski, Wilko Schwarting, Bartolomeo Stellato, Martin Riedmiller, Markus Wulfmeier, and Daniela Rus. 2021. Is bang-bang control all you need? solving continuous control with bernoulli policies. Advances in Neural Information Processing Systems 34 (2021), 27209\u201327221.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TEMPR.2023.3267552"},{"key":"e_1_3_2_1_33_1","volume-title":"Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1","author":"Srivastava Nitish","year":"2014","unstructured":"Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The journal of machine learning research 15, 1 (2014), 1929\u20131958."},{"key":"e_1_3_2_1_34_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton S","unstructured":"Richard\u00a0S Sutton and Andrew\u00a0G Barto. 2018. Reinforcement learning: An introduction. MIT Press."},{"key":"e_1_3_2_1_35_1","volume-title":"Understanding and improving knowledge distillation. arXiv preprint arXiv:2002.03532","author":"Tang Jiaxi","year":"2020","unstructured":"Jiaxi Tang, Rakesh Shivanna, Zhe Zhao, Dong Lin, Anima Singh, Ed\u00a0H Chi, and Sagar Jain. 2020. Understanding and improving knowledge distillation. arXiv preprint arXiv:2002.03532 (2020)."},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.3390\/a16070325"},{"key":"e_1_3_2_1_37_1","volume-title":"HomeLabGym: A real-world testbed for home energy management systems. arXiv preprint arXiv:2404.14110","author":"Van\u00a0Puyvelde Toon","year":"2024","unstructured":"Toon Van\u00a0Puyvelde, Marie-Sophie Verwee, Gargya Gokhale, Mehran\u00a0Zareh Eshghdoust, and Chris Develder. 2024. HomeLabGym: A real-world testbed for home energy management systems. arXiv preprint arXiv:2404.14110 (2024)."},{"key":"e_1_3_2_1_38_1","volume-title":"Integrated Forecasting and Scheduling of Implicit Demand Response in Balancing Markets Using Inverse Optimization. In 2023 19th International Conference on the European Energy Market (EEM). IEEE, 1\u20136.","author":"Vatandoust Behzad","year":"2023","unstructured":"Behzad Vatandoust, Bashir\u00a0Bakhshideh Zad, Fran\u00e7ois Vall\u00e9e, Jean-Fran\u00e7ois Toubeau, and Kenneth Bruninx. 2023. Integrated Forecasting and Scheduling of Implicit Demand Response in Balancing Markets Using Inverse Optimization. In 2023 19th International Conference on the European Energy Market (EEM). IEEE, 1\u20136."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apenergy.2024.122915"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1609\/aaai.v35i12.17272"},{"key":"e_1_3_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.754"},{"key":"e_1_3_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447555.3464855"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.est.2023.107080"}],"event":{"name":"e-Energy '24: The 15th ACM International Conference on Future and Sustainable Energy Systems","location":"Singapore Singapore","acronym":"e-Energy '24"},"container-title":["The 15th ACM International Conference on Future and Sustainable Energy Systems"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3632775.3661948","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3632775.3661948","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T17:34:50Z","timestamp":1755884090000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3632775.3661948"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,5,31]]},"references-count":43,"alternative-id":["10.1145\/3632775.3661948","10.1145\/3632775"],"URL":"https:\/\/doi.org\/10.1145\/3632775.3661948","relation":{},"subject":[],"published":{"date-parts":[[2024,5,31]]},"assertion":[{"value":"2024-05-31","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}