{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,29]],"date-time":"2025-09-29T08:16:40Z","timestamp":1759133800748,"version":"3.41.0"},"reference-count":50,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2014,3,10]],"date-time":"2014-03-10T00:00:00Z","timestamp":1394409600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100004955","name":"\u00d6sterreichische Forschungsf\u00f6rderungsgesellschaft","doi-asserted-by":"publisher","award":["825840"],"award-info":[{"award-number":["825840"]}],"id":[{"id":"10.13039\/501100004955","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Embed. Comput. Syst."],"published-print":{"date-parts":[[2014,12,5]]},"abstract":"<jats:p>Dynamic power management (DPM) refers to strategies which selectively change the operational states of a device during runtime to reduce the power consumption based on the past usage pattern, the current workload, and the given performance constraint. The power management problem becomes more challenging when the workload exhibits nonstationary behavior which may degrade the performance of any single or static DPM policy.<\/jats:p>\n          <jats:p>This article presents a reinforcement learning (RL)-based DPM technique for optimal selection of timeout values in the different device states. Each timeout period determines how long the device will remain in a particular state before the transition decision is taken. The timeout selection is based on workload estimates derived from a Multilayer Artificial Neural Network (ML-ANN) and an objective function given by weighted performance and power parameters. Our DPM approach is further able to adapt the power-performance weights online to meet user-specified power and performance constraints, respectively. We have completely implemented our DPM algorithm on our embedded traffic surveillance platform and performed long-term experiments using real traffic data to demonstrate the effectiveness of the DPM. Our results show that the proposed learning algorithm not only adequately explores the power-performance trade-off with nonstationary workload but can also successfully perform online adjustment of the trade-off parameter in order to meet the user-specified constraint.<\/jats:p>","DOI":"10.1145\/2529992","type":"journal-article","created":{"date-parts":[[2014,3,18]],"date-time":"2014-03-18T12:09:07Z","timestamp":1395144547000},"page":"1-25","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":21,"title":["Online learning of timeout policies for dynamic power management"],"prefix":"10.1145","volume":"13","author":[{"given":"Umair Ali","family":"Khan","sequence":"first","affiliation":[{"name":"Alpen-Adria Universit\u00e4t Klagenfurt, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bernhard","family":"Rinner","sequence":"additional","affiliation":[{"name":"Alpen-Adria Universit\u00e4t Klagenfurt, Austria"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2014,3,10]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"ACPI. 2011. Advanced Configuration and Power Interface Specification (ACPI). ACPI Specification Document 5. http:\/\/www.acpi.info.  ACPI. 2011. Advanced Configuration and Power Interface Specification (ACPI). ACPI Specification Document 5. http:\/\/www.acpi.info."},{"key":"e_1_2_1_2_1","first-page":"154","article-title":"Internet in the development of future road-traffic control systems","volume":"20","author":"Barrero F.","year":"2010","journal-title":"Int. Res."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/43.766730"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/92.845896"},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/EUC.2010.35"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/MIS.2010.28"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1109\/MDT.2010.142"},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2011.2111270"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCPS.2011.14"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/NOCS.2012.32"},{"volume-title":"Proceedings of the IEEE\/ACM International Conference on Computer-Aided Design. 274--279","author":"Chung E. Y.","key":"e_1_2_1_11_1"},{"volume-title":"Proceedings of the IEEE\/IFIP 20th International Conference on VLSI and System-on-Chip (VLSI-SoC). 147--152","author":"David R.","key":"e_1_2_1_12_1"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1233501.1233656"},{"key":"e_1_2_1_14_1","first-page":"4","article-title":"Adaptive disk spin-down policies for mobile computers","volume":"8","author":"Douglis F.","year":"1995","journal-title":"Comput. Syst."},{"key":"e_1_2_1_15_1","doi-asserted-by":"crossref","unstructured":"J. Durand S. Girard and V. Ciriza. 2012. Optimization of power consumption and device availability based on point process modelling of the request sequence. J. Royal Stat. Soci. 3.  J. Durand S. Girard and V. Ciriza. 2012. Optimization of power consumption and device availability based on point process modelling of the request sequence. J. Royal Stat. Soci. 3.","DOI":"10.1111\/j.1467-9876.2012.01053.x"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2002.1047758"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/MWC.2007.4407226"},{"volume-title":"Proceedings of the IMACS Multiconference on Computational Engineering in Systems Applications. 1437--1443","author":"Fei K.","key":"e_1_2_1_18_1"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCD.2012.6378625"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1145\/335043.335046"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCAD.2010.2059270"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/860176.860180"},{"key":"e_1_2_1_23_1","first-page":"1","article-title":"A control-theoretic approach to power management in embedded processors","volume":"9","author":"Kandasamy N.","year":"2004","journal-title":"Proceedings of Informatics"},{"volume-title":"Proceedings of the ITS World Congress.","author":"Khan U. A.","key":"e_1_2_1_25_1"},{"volume-title":"Proceedings of the 9th Workshop on Intelligent Solutions in Embedded Systems. 47--52","author":"Khan U. A.","key":"e_1_2_1_26_1"},{"volume-title":"Proceedings of the IEEE Real Time and Embedded Technology and Applications Symposium.","author":"Khan U. A.","key":"e_1_2_1_27_1"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/GreenCom.2012.85"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1109\/54.914592"},{"key":"e_1_2_1_30_1","first-page":"299","article-title":"Machine learning for adaptive power management","volume":"10","author":"Mannor S.","year":"2006","journal-title":"Auton. Comput."},{"volume-title":"Proceedings of the Design Automation Conference (ASP-DAC). IEEE, 81--88","author":"Moser C.","key":"e_1_2_1_31_1"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1102351.1102427"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1109\/TVLSI.2008.2011229"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TMC.2006.103"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1166\/asl.2013.4634"},{"volume-title":"Proceedings of the Internet Conference.","author":"Phit T.","key":"e_1_2_1_36_1"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/AVSS.2012.63"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1155\/2007\/65478"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1145\/309847.309997"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2005.66"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.comnet.2011.10.005"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1145\/345910.345914"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1109\/43.931003"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/92.486080"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.5555\/101883.102055"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1145\/1687399.1687486"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024724.2024735"},{"key":"e_1_2_1_48_1","first-page":"881","article-title":"Cyber physical systems","volume":"32","author":"Wang Z.","year":"2011","journal-title":"J. Chinese Comput. Syst."},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF00992698"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCE.2010.5505992"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2009.10.021"}],"container-title":["ACM Transactions on Embedded Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2529992","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/2529992","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T08:09:52Z","timestamp":1750234192000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/2529992"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,3,10]]},"references-count":50,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2014,12,5]]}},"alternative-id":["10.1145\/2529992"],"URL":"https:\/\/doi.org\/10.1145\/2529992","relation":{},"ISSN":["1539-9087","1558-3465"],"issn-type":[{"type":"print","value":"1539-9087"},{"type":"electronic","value":"1558-3465"}],"subject":[],"published":{"date-parts":[[2014,3,10]]},"assertion":[{"value":"2013-02-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2013-08-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2014-03-10","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}