{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,5]],"date-time":"2026-03-05T22:50:13Z","timestamp":1772751013311,"version":"3.50.1"},"reference-count":13,"publisher":"Springer Science and Business Media LLC","issue":"2","license":[{"start":{"date-parts":[[2025,6,1]],"date-time":"2025-06-01T00:00:00Z","timestamp":1748736000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2025,6,5]],"date-time":"2025-06-05T00:00:00Z","timestamp":1749081600000},"content-version":"vor","delay-in-days":4,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/100005156","name":"Alexander von Humboldt-Stiftung","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100005156","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100005713","name":"Technische Universit\u00e4t M\u00fcnchen","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100005713","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Real-Time Syst"],"published-print":{"date-parts":[[2025,6]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>Many real-time problems can be characterized as combinatorial optimization problems where exact solutions are infeasible at scale. As problem complexity grows, handcrafted heuristics become increasingly difficult to design. Reinforcement learning (RL) has emerged as a promising alternative, enabling the discovery of decision-making policies without requiring explicit supervision. While RL does not guarantee optimality, it provides adaptive heuristics to solve complex problems. This paper explores the potential of RL for real-time resource management, outlining key principles, demonstrating an application to directed acyclic graph (DAG) scheduling, and identifying open challenges for future research.<\/jats:p>","DOI":"10.1007\/s11241-025-09443-x","type":"journal-article","created":{"date-parts":[[2025,6,5]],"date-time":"2025-06-05T02:50:24Z","timestamp":1749091824000},"page":"288-293","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Position paper: deep reinforcement learning for real-time resource management"],"prefix":"10.1007","volume":"61","author":[{"given":"Mirco","family":"Theile","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Binqi","family":"Sun","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Marco","family":"Caccamo","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2025,6,5]]},"reference":[{"issue":"1","key":"9443_CR1","doi-asserted-by":"publisher","first-page":"39","DOI":"10.1016\/S0020-0190(00)00165-4","volume":"79","author":"NC Audsley","year":"2001","unstructured":"Audsley NC (2001) On priority assignment in fixed priority scheduling. Inf Process Lett 79(1):39\u201344","journal-title":"Inf Process Lett"},{"key":"9443_CR2","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1007\/s11241-010-9106-5","volume":"47","author":"RI Davis","year":"2011","unstructured":"Davis RI, Burns A (2011) Improved priority assignment for global fixed priority pre-emptive scheduling in multiprocessor real-time systems. Real-Time Syst 47:1\u201340","journal-title":"Real-Time Syst"},{"key":"9443_CR3","unstructured":"Haarnoja T, Zhou A, Abbeel P, Levine S (2018) Soft actor-critic: Off-policy maximum entropy deep reinforcement learning with a stochastic actor. In: International Conference on Machine Learning (ICML), pp 1861\u20131870"},{"key":"9443_CR4","unstructured":"Lillicrap TP, Hunt JJ, Pritzel A, Heess N, Erez T, Tassa Y, Silver D, Wierstra D (2015) Continuous control with deep reinforcement learning. arXiv preprint arXiv:1509.02971"},{"issue":"1","key":"9443_CR5","doi-asserted-by":"publisher","first-page":"46","DOI":"10.1145\/321738.321743","volume":"20","author":"CL Liu","year":"1973","unstructured":"Liu CL, Layland JW (1973) Scheduling algorithms for multiprogramming in a hard-real-time environment. J ACM 20(1):46\u201361","journal-title":"J ACM"},{"key":"9443_CR6","unstructured":"Schulman J, Wolski F, Dhariwal P, Radford A, Klimov O (2017) Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347"},{"issue":"4","key":"9443_CR7","doi-asserted-by":"publisher","first-page":"1034","DOI":"10.1109\/TC.2024.3350243","volume":"73","author":"B Sun","year":"2024","unstructured":"Sun B, Theile M, Qin Z, Bernardini D, Roy D, Bastoni A, Caccamo M (2024) Edge generation scheduling for dag tasks using deep reinforcement learning. IEEE Trans Comput 73(4):1034\u20131047","journal-title":"IEEE Trans Comput"},{"key":"9443_CR8","doi-asserted-by":"crossref","unstructured":"Sun B, Kloda T, Chen J, Lu C, Caccamo M (2025) Response time analysis and optimal priority assignment for global non-preemptive fixed-priority rigid gang scheduling. In: IEEE Transactions on Parallel and Distributed Systems","DOI":"10.1109\/TPDS.2025.3529218"},{"key":"9443_CR9","doi-asserted-by":"crossref","unstructured":"Sun B, Kloda T, Wu C-g, Caccamo M (2024) Partitioned scheduling and parallelism assignment for real-time dnn inference tasks on multi-tpu. In: Proceedings of the 61st ACM\/IEEE Design Automation Conference (DAC), pp 1\u20136","DOI":"10.1145\/3649329.3655979"},{"key":"9443_CR10","volume-title":"Reinforcement learning: an introduction","author":"RS Sutton","year":"1998","unstructured":"Sutton RS, Barto AG (1998) Reinforcement learning: an introduction. MIT Press, Cambridge"},{"issue":"3","key":"9443_CR11","doi-asserted-by":"publisher","first-page":"260","DOI":"10.1109\/71.993206","volume":"13","author":"H Topcuoglu","year":"2002","unstructured":"Topcuoglu H, Hariri S, Wu M-Y (2002) Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Trans Parallel Distrib Syst 13(3):260\u2013274","journal-title":"IEEE Trans Parallel Distrib Syst"},{"key":"9443_CR12","doi-asserted-by":"crossref","unstructured":"Van\u00a0Hasselt H, Guez A, Silver D (2016) Deep reinforcement learning with double q-learning. In: Proceedings of the AAAI Conference on Artificial Intelligence","DOI":"10.1609\/aaai.v30i1.10295"},{"key":"9443_CR13","doi-asserted-by":"crossref","unstructured":"Zou B, Sun B, Hu Y, Kloda T, Caccamo M, Abdelzaher T (2024) A performance prediction-based dnn partitioner for edge tpu pipelining. In: IEEE Military Communications Conference (MILCOM), pp 1\u20136","DOI":"10.1109\/MILCOM61039.2024.10773756"}],"container-title":["Real-Time Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11241-025-09443-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s11241-025-09443-x\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s11241-025-09443-x.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,9,6]],"date-time":"2025-09-06T17:52:50Z","timestamp":1757181170000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s11241-025-09443-x"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,6]]},"references-count":13,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,6]]}},"alternative-id":["9443"],"URL":"https:\/\/doi.org\/10.1007\/s11241-025-09443-x","relation":{},"ISSN":["0922-6443","1573-1383"],"issn-type":[{"value":"0922-6443","type":"print"},{"value":"1573-1383","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,6]]},"assertion":[{"value":"9 May 2025","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 June 2025","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}