{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T22:10:05Z","timestamp":1755900605583,"version":"3.44.0"},"reference-count":66,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2025,5,27]],"date-time":"2025-05-27T00:00:00Z","timestamp":1748304000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["Proc. ACM Meas. Anal. Comput. Syst."],"published-print":{"date-parts":[[2025,5,27]]},"abstract":"<jats:p>In this paper, we introduce DiffNEST, a diffusion-based surrogate framework for scalable, learning-driven optimization in complex computing environments. The growing complexity of modern systems often renders traditional optimization techniques inefficient, while reinforcement learning (RL)-based methods struggle with high data collection costs and hardware constraints. DiffNEST employs a diffusion model to generate realistic, continuous system traces, enabling optimization without reliance on physical hardware. DiffNEST generates realistic traces that reflect diverse workload characteristics, facilitating rapid exploration of large optimization search spaces. A case study demonstrates that DiffNEST can accelerate real-world optimization tasks, achieving up to 50% improvement in task-aware adaptive DVFS and 16% in multi-core cache allocation compared to RL approaches trained directly on physical hardware. Through fine-tuning, we show that DiffNEST can also be reused across multiple optimization tasks and workload domains, indicating its potential as a general-purpose surrogate modeling framework for system-level optimization. The code is publicly available to facilitate further research and development. https:\/\/github.com\/leejunyoung8631\/DiffNest.git<\/jats:p>","DOI":"10.1145\/3727112","type":"journal-article","created":{"date-parts":[[2025,6,4]],"date-time":"2025-06-04T09:43:35Z","timestamp":1749030215000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["Diffusion-Based Generative System Surrogates for Scalable Learning-Driven Optimization in Virtual Playgrounds"],"prefix":"10.1145","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0009-0005-8080-2082","authenticated-orcid":false,"given":"Junyoung","family":"Lee","sequence":"first","affiliation":[{"name":"DGIST, Daegu, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9702-0642","authenticated-orcid":false,"given":"Seohyun","family":"Kim","sequence":"additional","affiliation":[{"name":"DGIST, Daegu, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0008-0378-3801","authenticated-orcid":false,"given":"Shinhyoung","family":"Jang","sequence":"additional","affiliation":[{"name":"DGIST, Daegu, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3898-838X","authenticated-orcid":false,"given":"Jongho","family":"Park","sequence":"additional","affiliation":[{"name":"DGIST, Daegu, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5947-9632","authenticated-orcid":false,"given":"Yeseong","family":"Kim","sequence":"additional","affiliation":[{"name":"DGIST, Daegu, Republic of Korea"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2025,6,3]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.3390\/sym12101705"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1145\/3502287"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2017.299"},{"key":"e_1_2_1_4_1","volume-title":"Neural combinatorial optimization with reinforcement learning. arXiv preprint arXiv:1611.09940","author":"Bello Irwan","year":"2016","unstructured":"Irwan Bello, Hieu Pham, Quoc V Le, Mohammad Norouzi, and Samy Bengio. 2016. Neural combinatorial optimization with reinforcement learning. arXiv preprint arXiv:1611.09940 (2016)."},{"key":"e_1_2_1_5_1","unstructured":"Christopher Berner Greg Brockman Brooke Chan Vicki Cheung Przemys\u0142aw D\u0119biak Christy Dennison David Farhi Quirin Fischer Shariq Hashme Chris Hesse et al. 2019. Dota 2 with large scale deep reinforcement learning. arXiv preprint arXiv:1912.06680 (2019)."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2011.03.007"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1609\/icaps.v29i1.3528"},{"key":"e_1_2_1_8_1","doi-asserted-by":"crossref","unstructured":"Nathan Binkert Bradford Beckmann Gabriel Black Steven K Reinhardt Ali Saidi Arkaprava Basu Joel Hestness Derek R Hower Tushar Krishna Somayeh Sardashti et al. 2011. The gem5 simulator. ACM SIGARCH computer architecture news Vol. 39 2 (2011) 1--7.","DOI":"10.1145\/2024716.2024718"},{"key":"e_1_2_1_9_1","volume-title":"Openai gym. arXiv preprint arXiv:1606.01540","author":"Brockman Greg","year":"2016","unstructured":"Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. Openai gym. arXiv preprint arXiv:1606.01540 (2016)."},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/3185768.3185771"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TSG.2022.3154718"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1109\/90.490743"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.5555\/3014904.3014950"},{"volume-title":"Deep Reinforcement Learning","author":"Dong Hao","key":"e_1_2_1_14_1","unstructured":"Hao Dong, Hao Dong, Zihan Ding, Shanghang Zhang, and T Chang. 2020. Deep Reinforcement Learning. Springer."},{"key":"e_1_2_1_15_1","volume-title":"Henk Sips, Lilun Zhang, Yonggang Che, and Chuanfu Xu.","author":"Fang Jianbin","year":"2013","unstructured":"Jianbin Fang, Ana Lucia Varbanescu, Henk Sips, Lilun Zhang, Yonggang Che, and Chuanfu Xu. 2013. An empirical study of intel xeon phi. arXiv preprint arXiv:1310.5842 (2013)."},{"key":"e_1_2_1_16_1","volume-title":"Priyansh Arora, Victor Casamayor Pujol, David Haunschild, Ajith Kumar Parlikad, Oktay Cetinkaya, Hanan Lutfiyya, et al.","author":"Gill Sukhpal Singh","year":"2024","unstructured":"Sukhpal Singh Gill, Huaming Wu, Panos Patros, Carlo Ottaviani, Priyansh Arora, Victor Casamayor Pujol, David Haunschild, Ajith Kumar Parlikad, Oktay Cetinkaya, Hanan Lutfiyya, et al. 2024. Modern computing: Vision and challenges. Telematics and Informatics Reports (2024), 100116."},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447545.3451192"},{"key":"e_1_2_1_18_1","volume-title":"Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems","author":"Heusel Martin","year":"2017","unstructured":"Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. Gans trained by a two time-scale update rule converge to a local nash equilibrium. Advances in neural information processing systems, Vol. 30 (2017)."},{"key":"e_1_2_1_19_1","volume-title":"Denoising Diffusion Probabilistic Models. arxiv","author":"Ho Jonathan","year":"2006","unstructured":"Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising Diffusion Probabilistic Models. arxiv: 2006.11239 [cs.LG] https:\/\/arxiv.org\/abs\/2006.11239"},{"key":"e_1_2_1_20_1","unstructured":"Intel Corporation. 2014. Top-Down Microarchitecture Analysis Method. https:\/\/www.intel.com\/content\/www\/us\/en\/docs\/vtune-profiler\/cookbook\/2023-0\/top-down-microarchitecture-analysis-method.html Accessed: 2024-08-07."},{"key":"e_1_2_1_21_1","unstructured":"Intel Corporation. 2023. Intel\u00ae 64 and IA-32 Architectures Software Developer's Manual. https:\/\/www.intel.com\/content\/dam\/www\/public\/us\/en\/documents\/manuals\/64-ia-32-architectures-software-developer-vol-3a-part-1-manual.pdf Accessed: 2025-01--23."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1145\/1394608.1382172"},{"volume-title":"Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR).","author":"Isola Phillip","key":"e_1_2_1_23_1","unstructured":"Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A. Efros. 2017. Image-To-Image Translation With Conditional Adversarial Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)."},{"key":"e_1_2_1_24_1","volume-title":"Taeyoung Lee, Kyunghwan Son, and Yung Yi.","author":"Kim Daewoo","year":"2019","unstructured":"Daewoo Kim, Sangwoo Moon, David Hostallero, Wan Ju Kang, Taeyoung Lee, Kyunghwan Son, and Yung Yi. 2019a. Learning to schedule communication in multi-agent reinforcement learning. arXiv preprint arXiv:1902.01554 (2019)."},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCAD.2017.8203843"},{"key":"e_1_2_1_26_1","volume-title":"Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 1285--1288","author":"Kim Yeseong","year":"2019","unstructured":"Yeseong Kim, Ankit More, Emily Shriver, and Tajana Rosing. 2019b. Application performance prediction and optimization under cache allocation technology. In 2019 Design, Automation & Test in Europe Conference & Exhibition (DATE). IEEE, 1285--1288."},{"key":"e_1_2_1_27_1","volume-title":"On information and sufficiency. The annals of mathematical statistics","author":"Kullback Solomon","year":"1951","unstructured":"Solomon Kullback and Richard A Leibler. 1951. On information and sufficiency. The annals of mathematical statistics, Vol. 22, 1 (1951), 79--86."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1109\/ACCT.2014.73"},{"key":"e_1_2_1_29_1","volume-title":"Reinforcement learning with augmented data. Advances in neural information processing systems","author":"Laskin Misha","year":"2020","unstructured":"Misha Laskin, Kimin Lee, Adam Stooke, Lerrel Pinto, Pieter Abbeel, and Aravind Srinivas. 2020. Reinforcement learning with augmented data. Advances in neural information processing systems, Vol. 33 (2020), 19884--19895."},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2017.19"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1109\/PES.2011.6039675"},{"key":"e_1_2_1_32_1","volume-title":"Optimization methods applied to power systems: current practices and challenges. Classical and recent aspects of power system optimization","author":"Lin Jeremy","year":"2018","unstructured":"Jeremy Lin, Fernando Magnago, and Juan Manuel Alemany. 2018. Optimization methods applied to power systems: current practices and challenges. Classical and recent aspects of power system optimization (2018), 1--18."},{"key":"e_1_2_1_33_1","first-page":"5775","article-title":"Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps","volume":"35","author":"Lu Cheng","year":"2022","unstructured":"Cheng Lu, Yuhao Zhou, Fan Bao, Jianfei Chen, Chongxuan Li, and Jun Zhu. 2022. Dpm-solver: A fast ode solver for diffusion probabilistic model sampling in around 10 steps. Advances in Neural Information Processing Systems, Vol. 35 (2022), 5775--5787.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1145\/3005745.3005750"},{"key":"e_1_2_1_35_1","volume-title":"International conference on machine learning. PMLR, 2430--2439","author":"Mirhoseini Azalia","year":"2017","unstructured":"Azalia Mirhoseini, Hieu Pham, Quoc V Le, Benoit Steiner, Rasmus Larsen, Yuefeng Zhou, Naveen Kumar, Mohammad Norouzi, Samy Bengio, and Jeff Dean. 2017. Device placement optimization with reinforcement learning. In International conference on machine learning. PMLR, 2430--2439."},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.5742"},{"key":"e_1_2_1_37_1","unstructured":"Ashvin Nair Bob McGrew Marcin Andrychowicz Wojciech Zaremba and Pieter Abbeel. 2018. Overcoming Exploration in Reinforcement Learning with Demonstrations. arxiv: 1709.10089 [cs.LG] https:\/\/arxiv.org\/abs\/1709.10089"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0220135"},{"key":"e_1_2_1_39_1","volume-title":"Youngkook Kim, and Jinkyoo Park.","author":"Park Junyoung","year":"2021","unstructured":"Junyoung Park, Jaehyeong Chun, Sang Hun Kim, Youngkook Kim, and Jinkyoo Park. 2021. Learning to schedule job-shop problems: representation and policy learning using graph neural network and reinforcement learning. International journal of production research, Vol. 59, 11 (2021), 3360--3377."},{"key":"e_1_2_1_40_1","unstructured":"Aditya Ramesh Mikhail Pavlov Gabriel Goh Scott Gray Chelsea Voss Alec Radford Mark Chen and Ilya Sutskever. 2021. Zero-Shot Text-to-Image Generation. arxiv: 2102.12092 [cs.CV] https:\/\/arxiv.org\/abs\/2102.12092"},{"key":"e_1_2_1_41_1","unstructured":"Robin Rombach Andreas Blattmann Dominik Lorenz Patrick Esser and Bj\u00f6rn Ommer. 2022. High-Resolution Image Synthesis with Latent Diffusion Models. arxiv: 2112.10752 [cs.CV] https:\/\/arxiv.org\/abs\/2112.10752"},{"key":"e_1_2_1_42_1","volume-title":"U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention--MICCAI 2015: 18th international conference","author":"Ronneberger Olaf","year":"2015","unstructured":"Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In Medical image computing and computer-assisted intervention--MICCAI 2015: 18th international conference, Munich, Germany, October 5--9, 2015, proceedings, part III 18. Springer, 234--241."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-27308-2_56"},{"key":"e_1_2_1_44_1","series-title":"Journal of Physics: Conference Series","volume-title":"Software challenges in extreme scale systems","author":"Sarkar Vivek","year":"2045","unstructured":"Vivek Sarkar, William Harrod, and Allan E Snavely. 2009. Software challenges in extreme scale systems. In Journal of Physics: Conference Series, Vol. 180. IOP Publishing, 012045."},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1145\/3446374"},{"key":"e_1_2_1_46_1","volume-title":"Development as change of system dynamics: Stability, instability, and emergence. Toward a unified theory of development: Connectionism and dynamic systems theory re-considered","author":"Sch\u00f6ner Gregor","year":"2009","unstructured":"Gregor Sch\u00f6ner. 2009. Development as change of system dynamics: Stability, instability, and emergence. Toward a unified theory of development: Connectionism and dynamic systems theory re-considered (2009), 25--47."},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1002\/etep.2203"},{"key":"e_1_2_1_48_1","volume-title":"Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al.","author":"Silver David","year":"2016","unstructured":"David Silver, Aja Huang, Chris J Maddison, Arthur Guez, Laurent Sifre, George Van Den Driessche, Julian Schrittwieser, Ioannis Antonoglou, Veda Panneershelvam, Marc Lanctot, et al. 2016. Mastering the game of Go with deep neural networks and tree search. nature, Vol. 529, 7587 (2016), 484--489."},{"key":"e_1_2_1_49_1","volume-title":"Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502","author":"Song Jiaming","year":"2020","unstructured":"Jiaming Song, Chenlin Meng, and Stefano Ermon. 2020. Denoising diffusion implicit models. arXiv preprint arXiv:2010.02502 (2020)."},{"key":"e_1_2_1_50_1","unstructured":"Bradly C. Stadie Sergey Levine and Pieter Abbeel. 2015. Incentivizing Exploration In Reinforcement Learning With Deep Predictive Models. arxiv: 1507.00814 [cs.AI] https:\/\/arxiv.org\/abs\/1507.00814"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR.2015.7298594"},{"key":"e_1_2_1_52_1","volume-title":"Proceedings of the IEEE\/CVF International Conference on Computer Vision. 10521--10530","author":"Teterwak Piotr","year":"2019","unstructured":"Piotr Teterwak, Aaron Sarna, Dilip Krishnan, Aaron Maschinot, David Belanger, Ce Liu, and William T Freeman. 2019. Boundless: Generative adversarial networks for image extension. In Proceedings of the IEEE\/CVF International Conference on Computer Vision. 10521--10530."},{"key":"e_1_2_1_53_1","doi-asserted-by":"crossref","unstructured":"Oriol Vinyals Igor Babuschkin Wojciech M Czarnecki Micha\u00ebl Mathieu Andrew Dudzik Junyoung Chung David H Choi Richard Powell Timo Ewalds Petko Georgiev et al. 2019. Grandmaster level in StarCraft II using multi-agent reinforcement learning. nature Vol. 575 7782 (2019) 350--354.","DOI":"10.1038\/s41586-019-1724-z"},{"key":"e_1_2_1_54_1","volume-title":"Proceedings of the European Conference on Computer Vision (ECCV) Workshops.","author":"Wang Xintao","year":"2018","unstructured":"Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, and Chen Change Loy. 2018. ESRGAN: Enhanced Super-Resolution Generative Adversarial Networks. In Proceedings of the European Conference on Computer Vision (ECCV) Workshops."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1109\/TC.2019.2938956"},{"key":"e_1_2_1_56_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPSW.2016.78"},{"key":"e_1_2_1_57_1","doi-asserted-by":"publisher","DOI":"10.1145\/3190508.3190511"},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-46493-0_47"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1109\/SOSE.2016.73"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.procs.2013.05.250"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCV.2019.01066"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPASS.2014.6844459"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/820"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPASS.2009.4919635"},{"key":"e_1_2_1_65_1","doi-asserted-by":"publisher","DOI":"10.1145\/1618525.1618530"},{"key":"e_1_2_1_66_1","volume-title":"Garnett (Eds.)","volume":"30","author":"Zhu Jun-Yan","year":"2017","unstructured":"Jun-Yan Zhu, Richard Zhang, Deepak Pathak, Trevor Darrell, Alexei A Efros, Oliver Wang, and Eli Shechtman. 2017. Toward Multimodal Image-to-Image Translation. In Advances in Neural Information Processing Systems, I. Guyon, U. Von Luxburg, S. Bengio, H. Wallach, R. Fergus, S. Vishwanathan, and R. Garnett (Eds.), Vol. 30. Curran Associates, Inc. https:\/\/proceedings.neurips.cc\/paper_files\/paper\/2017\/file\/819f46e52c25763a55cc642422644317-Paper.pdf"}],"container-title":["Proceedings of the ACM on Measurement and Analysis of Computing Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727112","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3727112","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,8,22]],"date-time":"2025-08-22T21:32:14Z","timestamp":1755898334000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3727112"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,27]]},"references-count":66,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2025,5,27]]}},"alternative-id":["10.1145\/3727112"],"URL":"https:\/\/doi.org\/10.1145\/3727112","relation":{},"ISSN":["2476-1249"],"issn-type":[{"type":"electronic","value":"2476-1249"}],"subject":[],"published":{"date-parts":[[2025,5,27]]},"assertion":[{"value":"2025-06-03","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}