{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,19]],"date-time":"2026-01-19T02:03:27Z","timestamp":1768788207794,"version":"3.49.0"},"publisher-location":"New York, NY, USA","reference-count":36,"publisher":"ACM","license":[{"start":{"date-parts":[[2020,10,6]],"date-time":"2020-10-06T00:00:00Z","timestamp":1601942400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2020,10,6]]},"DOI":"10.1145\/3410992.3411001","type":"proceedings-article","created":{"date-parts":[[2021,2,21]],"date-time":"2021-02-21T01:25:42Z","timestamp":1613870742000},"page":"1-8","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":18,"title":["Information-driven adaptive sensing based on deep reinforcement learning"],"prefix":"10.1145","author":[{"given":"Abdulmajid","family":"Murad","sequence":"first","affiliation":[{"name":"NTNU, Trondheim, Norway"}]},{"given":"Frank Alexander","family":"Kraemer","sequence":"additional","affiliation":[{"name":"NTNU, Trondheim, Norway"}]},{"given":"Kerstin","family":"Bach","sequence":"additional","affiliation":[{"name":"NTNU, Trondheim, Norway"}]},{"given":"Gavin","family":"Taylor","sequence":"additional","affiliation":[{"name":"United States Naval Academy"}]}],"member":"320","published-online":{"date-parts":[[2020,10,6]]},"reference":[{"key":"e_1_3_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3390\/s18020375"},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1109\/AHS.2009.51"},{"key":"e_1_3_2_1_3_1","volume-title":"Aces-automatic configuration of energy harvesting sensors with reinforcement learning. arXiv preprint arXiv:1909.01968","author":"Fraternali Francesco","year":"2019","unstructured":"Francesco Fraternali , Bharathan Balaji , Yuvraj Agarwal , and Rajesh K Gupta . Aces-automatic configuration of energy harvesting sensors with reinforcement learning. arXiv preprint arXiv:1909.01968 , 2019 . Francesco Fraternali, Bharathan Balaji, Yuvraj Agarwal, and Rajesh K Gupta. Aces-automatic configuration of energy harvesting sensors with reinforcement learning. arXiv preprint arXiv:1909.01968, 2019."},{"key":"e_1_3_2_1_4_1","volume-title":"Online learning of timeout policies for dynamic power management. ACM Transactions on Embedded Computing Systems (TECS), 13(4):1--25","author":"Khan Umair Ali","year":"2014","unstructured":"Umair Ali Khan and Bernhard Rinner . Online learning of timeout policies for dynamic power management. ACM Transactions on Embedded Computing Systems (TECS), 13(4):1--25 , 2014 . Umair Ali Khan and Bernhard Rinner. Online learning of timeout policies for dynamic power management. ACM Transactions on Embedded Computing Systems (TECS), 13(4):1--25, 2014."},{"issue":"2","key":"e_1_3_2_1_5_1","first-page":"1","article-title":"an Energy Manager Based on Reinforcement Learning for Energy Harvesting Wireless Sensor Networks","volume":"2","author":"Aoudia Faycal Ait","year":"2018","unstructured":"Faycal Ait Aoudia , Matthieu Gautier , and Olivier Berder . RLMan : an Energy Manager Based on Reinforcement Learning for Energy Harvesting Wireless Sensor Networks . IEEE Transactions on Green Communications and Networking , 2 ( 2 ): 1 -- 1 , 2018 . Faycal Ait Aoudia, Matthieu Gautier, and Olivier Berder. RLMan: an Energy Manager Based on Reinforcement Learning for Energy Harvesting Wireless Sensor Networks. IEEE Transactions on Green Communications and Networking, 2(2):1--1, 2018.","journal-title":"IEEE Transactions on Green Communications and Networking"},{"issue":"1","key":"e_1_3_2_1_6_1","article-title":"Dynamic power management strategis for a sensor node optimised by reinforcement learning","volume":"13","author":"Lei Zhou","year":"2016","unstructured":"Zhou Lei , Hao Tang , Huizi Li , and Qi Jiang . Dynamic power management strategis for a sensor node optimised by reinforcement learning . Int. J. Computational Science and Engineering , 13 ( 1 ), 2016 . Zhou Lei, Hao Tang, Huizi Li, and Qi Jiang. Dynamic power management strategis for a sensor node optimised by reinforcement learning. Int. J. Computational Science and Engineering, 13(1), 2016.","journal-title":"Int. J. Computational Science and Engineering"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3279755.3279760"},{"key":"e_1_3_2_1_8_1","volume-title":"International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems","volume":"5579","author":"Hsu Roy Chaoming","year":"2009","unstructured":"Roy Chaoming Hsu , Cheng Ting Liu , and Wei Ming Lee . Reinforcement learning-based dynamic power management for energy harvesting wireless sensor network . In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems , volume 5579 LNAI. Springer , 2009 . Roy Chaoming Hsu, Cheng Ting Liu, and Wei Ming Lee. Reinforcement learning-based dynamic power management for energy harvesting wireless sensor network. In International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems, volume 5579 LNAI. Springer, 2009."},{"key":"e_1_3_2_1_9_1","volume-title":"Adaptive power management in solar energy harvesting sensor node using reinforcement learning. ACM Transactions on Embedded Computing Systems (TECS), 16(5s):1--21","author":"Shresthamali Shaswot","year":"2017","unstructured":"Shaswot Shresthamali , Masaaki Kondo , and Hiroshi Nakamura . Adaptive power management in solar energy harvesting sensor node using reinforcement learning. ACM Transactions on Embedded Computing Systems (TECS), 16(5s):1--21 , 2017 . Shaswot Shresthamali, Masaaki Kondo, and Hiroshi Nakamura. Adaptive power management in solar energy harvesting sensor node using reinforcement learning. ACM Transactions on Embedded Computing Systems (TECS), 16(5s):1--21, 2017."},{"key":"e_1_3_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/SASO.2019.00015"},{"key":"e_1_3_2_1_11_1","volume-title":"Decentralized control of adaptive sampling in wireless sensor networks. ACM Transactions on Sensor Networks (TOSN), 5(3):1--35","author":"Kho Johnsen","year":"2009","unstructured":"Johnsen Kho , Alex Rogers , and Nicholas R Jennings . Decentralized control of adaptive sampling in wireless sensor networks. ACM Transactions on Sensor Networks (TOSN), 5(3):1--35 , 2009 . Johnsen Kho, Alex Rogers, and Nicholas R Jennings. Decentralized control of adaptive sampling in wireless sensor networks. ACM Transactions on Sensor Networks (TOSN), 5(3):1--35, 2009."},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/TGCN.2017.2703855"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/WF-IoT.2016.7845391"},{"key":"e_1_3_2_1_14_1","volume-title":"Adaptive sampling of lion accelerometer data","author":"Cobb Adam","year":"2016","unstructured":"Adam Cobb and Andrew Markham . Adaptive sampling of lion accelerometer data . Oxford , 2016 . Adam Cobb and Andrew Markham. Adaptive sampling of lion accelerometer data. Oxford, 2016."},{"key":"e_1_3_2_1_15_1","volume-title":"Thirtieth AAAI Conference on Artificial Intelligence","author":"Ling Chun Kai","year":"2016","unstructured":"Chun Kai Ling , Kian Hsiang Low , and Patrick Jaillet . Gaussian process planning with lipschitz continuous reward functions: Towards unifying bayesian optimization, active learning, and beyond . In Thirtieth AAAI Conference on Artificial Intelligence , 2016 . Chun Kai Ling, Kian Hsiang Low, and Patrick Jaillet. Gaussian process planning with lipschitz continuous reward functions: Towards unifying bayesian optimization, active learning, and beyond. In Thirtieth AAAI Conference on Artificial Intelligence, 2016."},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCC.2006.23"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-57186-7_27"},{"key":"e_1_3_2_1_18_1","volume-title":"Real-time information processing of environmental sensor network data using bayesian gaussian processes. ACM Transactions on Sensor Networks (TOSN), 9(1):1--32","author":"Osborne Michael A","year":"2012","unstructured":"Michael A Osborne , Stephen J Roberts , Alex Rogers , and Nicholas R Jennings . Real-time information processing of environmental sensor network data using bayesian gaussian processes. ACM Transactions on Sensor Networks (TOSN), 9(1):1--32 , 2012 . Michael A Osborne, Stephen J Roberts, Alex Rogers, and Nicholas R Jennings. Real-time information processing of environmental sensor network data using bayesian gaussian processes. ACM Transactions on Sensor Networks (TOSN), 9(1):1--32, 2012."},{"key":"e_1_3_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/IWCMC.2013.6583769"},{"key":"e_1_3_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISCC.2017.8024689"},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TII.2017.2776082"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1109\/NOMS.2016.7502890"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3365871.3365885"},{"key":"e_1_3_2_1_24_1","first-page":"1","volume-title":"Acoustics --- description, measurement and assessment of environmental noise --- part 1: Basic quantities and assessment procedures","author":"ISO","year":"2016","unstructured":"ISO 1996-1:2016. Acoustics --- description, measurement and assessment of environmental noise --- part 1: Basic quantities and assessment procedures . International Organization for Standardization , pages 1 -- 47 , 2016 . ISO 1996-1:2016. Acoustics --- description, measurement and assessment of environmental noise --- part 1: Basic quantities and assessment procedures. International Organization for Standardization, pages 1--47, 2016."},{"key":"e_1_3_2_1_25_1","volume-title":"Gaussian processes for machine learning","author":"Williams Christopher KI","year":"2006","unstructured":"Christopher KI Williams and Carl Edward Rasmussen . Gaussian processes for machine learning , volume 2 . MIT press Cambridge , MA , 2006 . Christopher KI Williams and Carl Edward Rasmussen. Gaussian processes for machine learning, volume 2. MIT press Cambridge, MA, 2006."},{"key":"e_1_3_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICIF.2006.301766"},{"key":"e_1_3_2_1_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICSAI.2016.7811042"},{"key":"e_1_3_2_1_28_1","volume-title":"Sequential decentralized parameter estimation under randomly observed fisher information","author":"Yilmaz Yasin","year":"2013","unstructured":"Yasin Yilmaz and Xiaodong Wang . Sequential decentralized parameter estimation under randomly observed fisher information . IEEE transactions on information theory, 60(2):1281--1300, 2013 . Yasin Yilmaz and Xiaodong Wang. Sequential decentralized parameter estimation under randomly observed fisher information. IEEE transactions on information theory, 60(2):1281--1300, 2013."},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1145\/3365871.3365911"},{"key":"e_1_3_2_1_30_1","volume-title":"Reinforcement learning: An introduction","author":"Sutton Richard S","year":"2011","unstructured":"Richard S Sutton and Andrew G Barto . Reinforcement learning: An introduction . Cambridge, MA : MIT Press , 2011 . Richard S Sutton and Andrew G Barto. Reinforcement learning: An introduction. Cambridge, MA: MIT Press, 2011."},{"key":"e_1_3_2_1_31_1","first-page":"1","volume-title":"Proximal Policy Optimization Algorithms. arXiv preprint arXiv:1707.06347","author":"Schulman John","year":"2017","unstructured":"John Schulman , Filip Wolski , Prafulla Dhariwal , Alec Radford , and Oleg Klimov . Proximal Policy Optimization Algorithms. arXiv preprint arXiv:1707.06347 , pages 1 -- 12 , 2017 . John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. Proximal Policy Optimization Algorithms. arXiv preprint arXiv:1707.06347, pages 1--12, 2017."},{"key":"e_1_3_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1162\/089976602317250933"},{"key":"e_1_3_2_1_33_1","first-page":"682","volume-title":"Advances in neural information processing systems","author":"Williams Christopher KI","year":"2001","unstructured":"Christopher KI Williams and Matthias Seeger . Using the nystr\u00f6m methodto speed up kernel machines . In Advances in neural information processing systems , pages 682 -- 688 , 2001 . Christopher KI Williams and Matthias Seeger. Using the nystr\u00f6m methodto speed up kernel machines. In Advances in neural information processing systems, pages 682--688, 2001."},{"key":"e_1_3_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.5555\/3122009.3176848"},{"key":"e_1_3_2_1_35_1","first-page":"567","volume-title":"Artificial Intelligence and Statistics","author":"Titsias Michalis","year":"2009","unstructured":"Michalis Titsias . Variational learning of inducing variables in sparse gaussian processes . In Artificial Intelligence and Statistics , pages 567 -- 574 , 2009 . Michalis Titsias. Variational learning of inducing variables in sparse gaussian processes. In Artificial Intelligence and Statistics, pages 567--574, 2009."},{"key":"e_1_3_2_1_36_1","unstructured":"GPy. GPy: A gaussian process framework in python. http:\/\/github.com\/SheffieldML\/GPy since 2012.  GPy. GPy: A gaussian process framework in python. http:\/\/github.com\/SheffieldML\/GPy since 2012."}],"event":{"name":"IoT '20: 10th International Conference on the Internet of Things","location":"Malm\u00f6 Sweden","acronym":"IoT '20"},"container-title":["Proceedings of the 10th International Conference on the Internet of Things"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3410992.3411001","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3410992.3411001","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T21:31:56Z","timestamp":1750195916000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3410992.3411001"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,10,6]]},"references-count":36,"alternative-id":["10.1145\/3410992.3411001","10.1145\/3410992"],"URL":"https:\/\/doi.org\/10.1145\/3410992.3411001","relation":{},"subject":[],"published":{"date-parts":[[2020,10,6]]},"assertion":[{"value":"2020-10-06","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}