{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T23:17:40Z","timestamp":1761952660605,"version":"build-2065373602"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"3-4","license":[{"start":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T00:00:00Z","timestamp":1752451200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T00:00:00Z","timestamp":1752451200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100011914","name":"M\u00e4lardalen University","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100011914","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Real-Time Syst"],"published-print":{"date-parts":[[2025,12]]},"abstract":"Abstract<\/jats:title>\n \n In scheduling real-time tasks, we face the challenge of meeting hard deadlines while optimizing for some other objective, such as minimizing energy consumption. Formulating the optimization as a Multi-Armed Bandit (MAB) problem allows us to use MAB strategies to balance the exploitation of good choices based on observed data with the exploration of potentially better options. In this paper, we integrate hard real-time constraints with MAB strategies for resource management of a Stochastic Parallel Synchronous Task. On a platform with\n \n \n $$M$$<\/jats:tex-math>\n \n M<\/mml:mi>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n cores available for the task,\n \n \n $$m\\le M$$<\/jats:tex-math>\n \n \n m<\/mml:mi>\n \u2264<\/mml:mo>\n M<\/mml:mi>\n <\/mml:mrow>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n cores are initially assigned. Prior work has shown how to compute a virtual deadline such that assigning all\n \n \n $$M$$<\/jats:tex-math>\n \n M<\/mml:mi>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n cores to the task if it has not completed by this virtual deadline guarantees that the deadline will be met. An MAB strategy is used to select the value of\n \n \n $$m$$<\/jats:tex-math>\n \n m<\/mml:mi>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n . A Dynamic Power Management (DPM) energy model considering CPU sockets and sleep states is described. Experimental evaluation shows that MAB strategies learn consistently suitable\n \n \n $$m$$<\/jats:tex-math>\n \n m<\/mml:mi>\n <\/mml:math>\n <\/jats:alternatives>\n <\/jats:inline-formula>\n , and perform well compared to binary exponential search and greedy methods.\n <\/jats:p>","DOI":"10.1007\/s11241-025-09454-8","type":"journal-article","created":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T18:17:37Z","timestamp":1752517057000},"page":"359-402","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Resource Management for Stochastic Parallel Synchronous Tasks: Bandits to the Rescue"],"prefix":"10.1007","volume":"61","author":[{"given":"Anna","family":"Friebe","sequence":"first","affiliation":[]},{"given":"Alberto","family":"Marchetti-Spaccamela","sequence":"additional","affiliation":[]},{"given":"Tommaso","family":"Cucinotta","sequence":"additional","affiliation":[]},{"given":"Alessandro Vittorio","family":"Papadopoulos","sequence":"additional","affiliation":[]},{"given":"Thomas","family":"Nolte","sequence":"additional","affiliation":[]},{"given":"Sanjoy","family":"Baruah","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2025,7,14]]},"reference":[{"issue":"4","key":"9454_CR1","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3674734","volume":"21","author":"G Antoniou","year":"2024","unstructured":"Antoniou G, Bartolini D, Volos H, Kleanthous M, Wang Z, Kalaitzidis K, Rollet T, Li Z, Mutlu O, Sazeides Y et al (2024) Agile C-states: a core C-state architecture for latency critical applications optimizing both transition and cold-start latency. ACM Transactions on Architecture and Code Optimization 21(4):1\u201326","journal-title":"ACM Transactions on Architecture and Code Optimization"},{"key":"9454_CR2","doi-asserted-by":"publisher","unstructured":"Abeni L, Cucinotta T (2020) Adaptive partitioning of real-time tasks on multiple processors. In: Proceedings of the 35th Annual ACM Symposium on Applied Computing. SAC \u201920, pp. 572\u2013579. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3341105.3373937","DOI":"10.1145\/3341105.3373937"},{"key":"9454_CR3","doi-asserted-by":"crossref","unstructured":"Aydin H, Melhem R, Mosse D, Mejia-Alvarez P (2001) Determining optimal processor speeds for periodic real-time tasks with different power characteristics. In: Proceedings 13th Euromicro Conference on Real-Time Systems, pp. 225\u2013232. IEEE","DOI":"10.1109\/EMRTS.2001.934038"},{"issue":"133","key":"9454_CR4","first-page":"1","volume":"22","author":"A Bietti","year":"2021","unstructured":"Bietti A, Agarwal A, Langford J (2021) A contextual bandit bake-off. Journal of Machine Learning Research 22(133):1\u201349","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"9454_CR5","doi-asserted-by":"publisher","first-page":"74","DOI":"10.5626\/JCSE.2008.2.1.074","volume":"2","author":"A Burns","year":"2008","unstructured":"Burns A, Baruah SK et al (2008) Sustainability in real-time scheduling. J. Comput. Sci. Eng. 2(1):74\u201397","journal-title":"J. Comput. Sci. Eng."},{"key":"9454_CR6","doi-asserted-by":"crossref","unstructured":"Baruah S, Bonifaci V, Marchetti-Spaccamela A, Stougie L, Wiese A (2012) A generalized parallel task model for recurrent real-time processes. In: 2012 IEEE 33rd Real-Time Systems Symposium, pp. 63\u201372. IEEE","DOI":"10.1109\/RTSS.2012.59"},{"issue":"4","key":"9454_CR7","doi-asserted-by":"publisher","first-page":"1952","DOI":"10.1109\/TCNS.2017.2774046","volume":"5","author":"VS Borkar","year":"2017","unstructured":"Borkar VS, Kasbekar GS, Pattathil S, Shetty PY (2017) Opportunistic scheduling as restless bandits. IEEE Transactions on Control of Network Systems 5(4):1952\u20131961","journal-title":"IEEE Transactions on Control of Network Systems"},{"issue":"1","key":"9454_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/2808231","volume":"15","author":"M Bambagini","year":"2016","unstructured":"Bambagini M, Marinoni M, Aydin H, Buttazzo G (2016) Energy-aware scheduling for real-time systems: A survey. ACM Transactions on Embedded Computing Systems (TECS) 15(1):1\u201334","journal-title":"ACM Transactions on Embedded Computing Systems (TECS)"},{"key":"9454_CR9","doi-asserted-by":"crossref","unstructured":"Bouneffouf D, Rish I, Aggarwal C (2020) Survey on applications of multi-armed and contextual bandits. In: 2020 IEEE Congress on Evolutionary Computation (CEC), pp. 1\u20138. IEEE","DOI":"10.1109\/CEC48606.2020.9185782"},{"key":"9454_CR10","doi-asserted-by":"crossref","unstructured":"Chou C-H, Bhuyan LN, Wong D (2019) $$\\mu $$DPM: Dynamic power management for the microsecond era. In: 2019 IEEE International Symposium on High Performance Computer Architecture (HPCA), pp. 120\u2013132. IEEE","DOI":"10.1109\/HPCA.2019.00032"},{"issue":"9","key":"9454_CR11","doi-asserted-by":"publisher","first-page":"6151","DOI":"10.1109\/TIT.2022.3177891","volume":"68","author":"G Chen","year":"2022","unstructured":"Chen G, Liew SC, Shao Y (2022) Uncertainty-of-information scheduling: A restless multiarmed bandit framework. IEEE Transactions on Information Theory 68(9):6151\u20136173","journal-title":"IEEE Transactions on Information Theory"},{"issue":"4","key":"9454_CR12","first-page":"371","volume":"75","author":"AP Chandrakasan","year":"1992","unstructured":"Chandrakasan AP, Sheng S, Brodersen RW (1992) Low-power CMOS digital design. IEICE Transactions on Electronics 75(4):371\u2013382","journal-title":"IEICE Transactions on Electronics"},{"issue":"2","key":"9454_CR13","doi-asserted-by":"publisher","first-page":"215824401985167","DOI":"10.1177\/2158244019851675","volume":"9","author":"D Eckles","year":"2019","unstructured":"Eckles D, Kaptein M (2019) Bootstrap Thompson sampling and sequential decision problems in the behavioral sciences. Sage Open 9(2):2158244019851675","journal-title":"Sage Open"},{"key":"9454_CR14","doi-asserted-by":"crossref","unstructured":"Fonseca JC, N\u00e9lis V, Raravi G, Pinho LM (2015) A multi-DAG model for real-time parallel applications with conditional execution. In: Proceedings of the 30th Annual ACM Symposium on Applied Computing, pp. 1925\u20131932","DOI":"10.1145\/2695664.2695808"},{"issue":"2","key":"9454_CR15","doi-asserted-by":"publisher","first-page":"416","DOI":"10.1137\/0117039","volume":"17","author":"RL Graham","year":"1969","unstructured":"Graham RL (1969) Bounds on multiprocessing timing anomalies. SIAM journal on Applied Mathematics 17(2):416\u2013429","journal-title":"SIAM journal on Applied Mathematics"},{"key":"9454_CR16","unstructured":"Le Sueur E, Heiser G (2010) Dynamic voltage and frequency scaling: The laws of diminishing returns. In: Proceedings of the 2010 International Conference on Power Aware Computing and Systems, pp. 1\u20138"},{"key":"9454_CR17","doi-asserted-by":"publisher","unstructured":"Melani A, Bertogna M, Bonifaci V, Marchetti-Spaccamela A, Buttazzo GC (2015) Response-time analysis of conditional DAG tasks in multiprocessor systems. In: 2015 27th Euromicro Conference on Real-Time Systems, pp. 211\u2013221. https:\/\/doi.org\/10.1109\/ECRTS.2015.26","DOI":"10.1109\/ECRTS.2015.26"},{"key":"9454_CR18","doi-asserted-by":"publisher","unstructured":"Mascitti A, Cucinotta T (2021) Dynamic partitioned scheduling of real-time DAG tasks on arm big.LITTLE architectures*. In: Proceedings of the 29th International Conference on Real-Time Networks and Systems. RTNS \u201921, pp. 1\u201311. Association for Computing Machinery, New York, NY, USA. https:\/\/doi.org\/10.1145\/3453417.3453442","DOI":"10.1145\/3453417.3453442"},{"key":"9454_CR19","doi-asserted-by":"publisher","DOI":"10.1016\/j.jss.2020.110886","volume":"173","author":"A Mascitti","year":"2021","unstructured":"Mascitti A, Cucinotta T, Marinoni M, Abeni L (2021) Dynamic partitioned scheduling of real-time tasks on arm big.LITTLE architectures. Journal of Systems and Software 173:110886. https:\/\/doi.org\/10.1016\/j.jss.2020.110886","journal-title":"Journal of Systems and Software"},{"key":"9454_CR20","unstructured":"Oza NC, Russell SJ (2001) Online bagging and boosting. In: International Workshop on Artificial Intelligence and Statistics, pp. 229\u2013236. PMLR"},{"key":"9454_CR21","doi-asserted-by":"crossref","unstructured":"Papadopoulos AV, Agrawal K, Bini E, Baruah S (2022) Feedback-based resource management for multi-threaded applications. Real-Time Systems, 1\u201334","DOI":"10.1007\/s11241-022-09386-7"},{"key":"9454_CR22","doi-asserted-by":"crossref","unstructured":"Pillai P, Shin KG (2001) Real-time dynamic voltage scaling for low-power embedded operating systems. In: Proceedings of the Eighteenth ACM Symposium on Operating Systems Principles, pp. 89\u2013102","DOI":"10.1145\/502034.502044"},{"key":"9454_CR23","doi-asserted-by":"crossref","unstructured":"Raghunathan V, Borkar V, Cao M, Kumar PR (2008) Index policies for real-time multicast scheduling for wireless broadcast systems. In: IEEE INFOCOM 2008-The 27th Conference on Computer Communications, pp. 1570\u20131578. IEEE","DOI":"10.1109\/INFOCOM.2008.217"},{"key":"9454_CR24","doi-asserted-by":"crossref","unstructured":"Rubin DB (1981) The Bayesian bootstrap. The annals of statistics, 130\u2013134","DOI":"10.1214\/aos\/1176345338"},{"issue":"1","key":"9454_CR25","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2200000070","volume":"11","author":"DJ Russo","year":"2018","unstructured":"Russo DJ, Van Roy B, Kazerouni A, Osband I, Wen Z et al (2018) A tutorial on Thompson sampling. Foundations and Trends\u00ae in Machine Learning 11(1):1\u201396","journal-title":"Foundations and Trends\u00ae in Machine Learning"},{"key":"9454_CR26","doi-asserted-by":"crossref","unstructured":"Sharafzadeh E, Kohroudi SAS, Asyabi E, Sharifi M (2019) Yawn: A CPU idle-state governor for datacenter applications. In: Proceedings of the 10th ACM SIGOPS Asia-Pacific Workshop on Systems, pp. 91\u201398","DOI":"10.1145\/3343737.3343740"},{"key":"9454_CR27","doi-asserted-by":"publisher","first-page":"404","DOI":"10.1007\/s11241-012-9166-9","volume":"49","author":"A Saifullah","year":"2013","unstructured":"Saifullah A, Li J, Agrawal K, Lu C, Gill C (2013) Multi-core real-time scheduling for generalized parallel task models. Real-Time Systems 49:404\u2013435","journal-title":"Real-Time Systems"},{"issue":"1\u20132","key":"9454_CR28","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1561\/2200000068","volume":"12","author":"A Slivkins","year":"2019","unstructured":"Slivkins A (2019) Introduction to multi-armed bandits. Foundations and Trends\u00ae in Machine Learning 12(1\u20132):1\u2013286. https:\/\/doi.org\/10.1561\/2200000068","journal-title":"Foundations and Trends\u00ae in Machine Learning"},{"key":"9454_CR29","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1007\/s00450-014-0270-z","volume":"30","author":"R Sch\u00f6ne","year":"2015","unstructured":"Sch\u00f6ne R, Molka D, Werner M (2015) Wake-up latencies for processor idle states on current x86 processors. Computer Science-Research and Development 30:219\u2013227","journal-title":"Computer Science-Research and Development"},{"issue":"6","key":"9454_CR30","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3291387","volume":"17","author":"SZ Sheikh","year":"2018","unstructured":"Sheikh SZ, Pasha MA (2018) Energy-efficient multicore scheduling for hard real-time systems: A survey. ACM Transactions on Embedded Computing Systems (TECS) 17(6):1\u201326","journal-title":"ACM Transactions on Embedded Computing Systems (TECS)"},{"key":"9454_CR31","unstructured":"Vasilakis E (2015) An instruction level energy characterization of ARM processors. Foundation of Research and Technology Hellas, Inst. of Computer Science, Tech. Rep. FORTH-ICS\/TR-450"},{"issue":"A","key":"9454_CR32","doi-asserted-by":"publisher","first-page":"287","DOI":"10.2307\/3214163","volume":"25","author":"P Whittle","year":"1988","unstructured":"Whittle P (1988) Restless bandits: Activity allocation in a changing world. Journal of applied probability 25(A):287\u2013298","journal-title":"Journal of applied probability"},{"issue":"1","key":"9454_CR33","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1109\/TSUSC.2021.3057983","volume":"7","author":"G Xie","year":"2021","unstructured":"Xie G, Xiao X, Peng H, Li R, Li K (2021) A survey of low-energy parallel scheduling algorithms. IEEE Transactions on Sustainable Computing 7(1):27\u201346","journal-title":"IEEE Transactions on Sustainable Computing"},{"issue":"8","key":"9454_CR34","doi-asserted-by":"publisher","first-page":"2343","DOI":"10.1109\/TAC.2018.2807924","volume":"63","author":"Z Yu","year":"2018","unstructured":"Yu Z, Xu Y, Tong L (2018) Deadline scheduling as restless bandits. IEEE Transactions on Automatic Control 63(8):2343\u20132358","journal-title":"IEEE Transactions on Automatic Control"},{"issue":"1","key":"9454_CR35","doi-asserted-by":"publisher","first-page":"6","DOI":"10.1109\/LCA.2016.2537802","volume":"16","author":"X Zhan","year":"2016","unstructured":"Zhan X, Azimi R, Kanev S, Brooks D, Reda S (2016) CARB: A C-state power management arbiter for latency-critical workloads. IEEE Computer Architecture Letters 16(1):6\u20139","journal-title":"IEEE Computer Architecture Letters"}],"container-title":["Real-Time Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11241-025-09454-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11241-025-09454-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11241-025-09454-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,31]],"date-time":"2025-10-31T23:14:00Z","timestamp":1761952440000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11241-025-09454-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,14]]},"references-count":35,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2025,12]]}},"alternative-id":["9454"],"URL":"https:\/\/doi.org\/10.1007\/s11241-025-09454-8","relation":{},"ISSN":["0922-6443","1573-1383"],"issn-type":[{"type":"print","value":"0922-6443"},{"type":"electronic","value":"1573-1383"}],"subject":[],"published":{"date-parts":[[2025,7,14]]},"assertion":[{"value":"26 June 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"14 July 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The authors declare no Conflict of interest.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of interest"}}]}}