{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:27:42Z","timestamp":1750220862002,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":9,"publisher":"ACM","license":[{"start":{"date-parts":[[2019,10,22]],"date-time":"2019-10-22T00:00:00Z","timestamp":1571702400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2019,10,22]]},"DOI":"10.1145\/3365871.3365911","type":"proceedings-article","created":{"date-parts":[[2019,11,6]],"date-time":"2019-11-06T14:25:56Z","timestamp":1573050356000},"page":"1-4","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["IoT Sensor Gym"],"prefix":"10.1145","author":[{"given":"Abdulmajid","family":"Murad","sequence":"first","affiliation":[{"name":"Norwegian University of Science and Technology, NTNU, Trondheim, Norway"}]},{"given":"Kerstin","family":"Bach","sequence":"additional","affiliation":[{"name":"Norwegian University of Science and Technology, NTNU, Trondheim, Norway"}]},{"given":"Frank Alexander","family":"Kraemer","sequence":"additional","affiliation":[{"name":"Norwegian University of Science and Technology, NTNU, Trondheim, Norway"}]},{"given":"Gavin","family":"Taylor","sequence":"additional","affiliation":[{"name":"United States Naval Academy, USNA, Annapolis, USA"}]}],"member":"320","published-online":{"date-parts":[[2019,10,22]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.5555\/2566972.2566979"},{"key":"e_1_3_2_1_2_1","volume-title":"Towards Cognitive IoT: Autonomous Prediction Model Selection for Solar-Powered Nodes. In Int. Congress on Internet of Things (ICIOT). IEEE, https:\/\/doi.org\/10","author":"Braten Anders Eivind","year":"2018","unstructured":"Anders Eivind Braten and Frank Alexander Kraemer . 2018 . Towards Cognitive IoT: Autonomous Prediction Model Selection for Solar-Powered Nodes. In Int. Congress on Internet of Things (ICIOT). IEEE, https:\/\/doi.org\/10 .1109\/ICIOT.2018.00023 10.1109\/ICIOT.2018.00023 Anders Eivind Braten and Frank Alexander Kraemer. 2018. Towards Cognitive IoT: Autonomous Prediction Model Selection for Solar-Powered Nodes. In Int. Congress on Internet of Things (ICIOT). IEEE, https:\/\/doi.org\/10.1109\/ICIOT.2018.00023"},{"key":"e_1_3_2_1_3_1","volume-title":"arXiv.org abs\/1606.01540","author":"Brockman Greg","year":"2016","unstructured":"Greg Brockman , Vicki Cheung , Ludwig Pettersson , Jonas Schneider , John Schulman , Jie Tang , and Wojciech Zaremba . 2016. Open AI Gym . arXiv.org abs\/1606.01540 ( 2016 ), 4. arXiv:arXiv: 1606.01540 Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. OpenAI Gym. arXiv.org abs\/1606.01540 (2016), 4. arXiv:arXiv: 1606.01540"},{"key":"e_1_3_2_1_4_1","unstructured":"Prafulla Dhariwal Christopher Hesse Oleg Klimov Alex Nichol Matthias Plappert Alec Radford John Schulman Szymon Sidor Yuhuai Wu and Peter Zhokhov. 2017. OpenAI Baselines. https:\/\/github.com\/openai\/baselines.  Prafulla Dhariwal Christopher Hesse Oleg Klimov Alex Nichol Matthias Plappert Alec Radford John Schulman Szymon Sidor Yuhuai Wu and Peter Zhokhov. 2017. OpenAI Baselines. https:\/\/github.com\/openai\/baselines."},{"key":"e_1_3_2_1_5_1","volume-title":"Benchmarking Deep Reinforcement Learning for Continuous Control. In 33rd Int. Conf. on Machine Learning (ICML'16)","author":"Duan Yan","year":"2016","unstructured":"Yan Duan , Xi Chen , Rein Houthooft , John Schulman , and Pieter Abbeel . 2016 . Benchmarking Deep Reinforcement Learning for Continuous Control. In 33rd Int. Conf. on Machine Learning (ICML'16) . JMLR.org, 1329--1338. Yan Duan, Xi Chen, Rein Houthooft, John Schulman, and Pieter Abbeel. 2016. Benchmarking Deep Reinforcement Learning for Continuous Control. In 33rd Int. Conf. on Machine Learning (ICML'16). JMLR.org, 1329--1338."},{"key":"e_1_3_2_1_6_1","first-page":"3279760","article-title":"Scaling Configuration of Energy Harvesting Sensors With Reinforcement Learning. In 6th","volume":"1145","author":"Fraternali Francesco","year":"2018","unstructured":"Francesco Fraternali , Bharathan Balaji , and Rajesh Gupta . 2018 . Scaling Configuration of Energy Harvesting Sensors With Reinforcement Learning. In 6th Int. Ws. on Energy Harvesting & Energy-Neutral Sensing Systems. ACM, 7--13. https:\/\/doi.org\/10. 1145\/3279755 . 3279760 10.1145\/3279755.3279760 Francesco Fraternali, Bharathan Balaji, and Rajesh Gupta. 2018. Scaling Configuration of Energy Harvesting Sensors With Reinforcement Learning. In 6th Int. Ws. on Energy Harvesting & Energy-Neutral Sensing Systems. ACM, 7--13. https:\/\/doi.org\/10.1145\/3279755.3279760","journal-title":"Int. Ws. on Energy Harvesting & Energy-Neutral Sensing Systems. ACM, 7--13. https:\/\/doi.org\/10."},{"key":"e_1_3_2_1_7_1","volume-title":"Nattachart Tamkittikhun, and David Palma.","author":"Kraemer Frank Alexander","year":"2017","unstructured":"Frank Alexander Kraemer , Doreid Ammar , Anders Eivind Braten , Nattachart Tamkittikhun, and David Palma. 2017 . Solar Energy Prediction for Constrained IoT Nodes Based on Public Weather Forecasts. In IoT '17 Proceedings of the Seventh International Conference on the Internet of Things. ACM , 1--8. https:\/\/doi.org\/10.1145\/3131542.3131544 10.1145\/3131542.3131544 Frank Alexander Kraemer, Doreid Ammar, Anders Eivind Braten, Nattachart Tamkittikhun, and David Palma. 2017. Solar Energy Prediction for Constrained IoT Nodes Based on Public Weather Forecasts. In IoT '17 Proceedings of the Seventh International Conference on the Internet of Things. ACM, 1--8. https:\/\/doi.org\/10.1145\/3131542.3131544"},{"key":"e_1_3_2_1_8_1","volume-title":"Autonomous Management of Energy-Harvesting IoT Nodes Using Deep Reinforcement Learning. In SASO 2019","author":"Murad Abdulmajid","year":"2019","unstructured":"Abdulmajid Murad , Frank Alexander Kraemer , Kerstin Bach , and Gavin Taylor . 2019 . Autonomous Management of Energy-Harvesting IoT Nodes Using Deep Reinforcement Learning. In SASO 2019 , IEEE, https:\/\/doi.org\/10.1109\/SASO.2019.00015 10.1109\/SASO.2019.00015 Abdulmajid Murad, Frank Alexander Kraemer, Kerstin Bach, and Gavin Taylor. 2019. Autonomous Management of Energy-Harvesting IoT Nodes Using Deep Reinforcement Learning. In SASO 2019, IEEE, https:\/\/doi.org\/10.1109\/SASO.2019.00015"},{"key":"e_1_3_2_1_9_1","volume-title":"Proximal Policy Optimization Algorithms. ArXiv abs\/1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . 2017. Proximal Policy Optimization Algorithms. ArXiv abs\/1707.06347 ( 2017 ), 12. John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal Policy Optimization Algorithms. ArXiv abs\/1707.06347 (2017), 12."}],"event":{"name":"IoT 2019: 9th International Conference on the Internet of Things","acronym":"IoT 2019","location":"Bilbao Spain"},"container-title":["Proceedings of the 9th International Conference on the Internet of Things"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3365871.3365911","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3365871.3365911","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T23:23:37Z","timestamp":1750202617000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3365871.3365911"}},"subtitle":["Training Autonomous IoT Devices with Deep Reinforcement Learning"],"short-title":[],"issued":{"date-parts":[[2019,10,22]]},"references-count":9,"alternative-id":["10.1145\/3365871.3365911","10.1145\/3365871"],"URL":"https:\/\/doi.org\/10.1145\/3365871.3365911","relation":{},"subject":[],"published":{"date-parts":[[2019,10,22]]},"assertion":[{"value":"2019-10-22","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}