{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T04:08:46Z","timestamp":1750219726456,"version":"3.41.0"},"publisher-location":"New York, NY, USA","reference-count":92,"publisher":"ACM","license":[{"start":{"date-parts":[[2023,11,11]],"date-time":"2023-11-11T00:00:00Z","timestamp":1699660800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"European High-Performance Computing Joint Undertaking","award":["956560"],"award-info":[{"award-number":["956560"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2023,11,12]]},"DOI":"10.1145\/3581784.3607083","type":"proceedings-article","created":{"date-parts":[[2023,11,14]],"date-time":"2023-11-14T21:47:06Z","timestamp":1699998426000},"page":"1-16","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["High Throughput Training of Deep Surrogates from Large Ensemble Runs"],"prefix":"10.1145","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-5386-5997","authenticated-orcid":false,"given":"Lucas Thibaut","family":"Meyer","sequence":"first","affiliation":[{"name":"Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LIG, Grenoble, France"},{"name":"Industrial AI Laboratory SINCLAIR, EDF Lab Paris-Saclay, Palaiseau, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3708-4135","authenticated-orcid":false,"given":"Marc","family":"Schouler","sequence":"additional","affiliation":[{"name":"Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LIG, Grenoble, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5618-8629","authenticated-orcid":false,"given":"Robert Alexander","family":"Caulk","sequence":"additional","affiliation":[{"name":"Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LIG, Grenoble, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6141-2146","authenticated-orcid":false,"given":"Alejandro","family":"Ribes","sequence":"additional","affiliation":[{"name":"Industrial AI Laboratory SINCLAIR, EDF Lab Paris-Saclay, Palaiseau, France"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-7980-4946","authenticated-orcid":false,"given":"Bruno","family":"Raffin","sequence":"additional","affiliation":[{"name":"Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LIG, Grenoble, France"}]}],"member":"320","published-online":{"date-parts":[[2023,11,11]]},"reference":[{"key":"e_1_3_2_1_1_1","volume-title":"Syed Haider Abidi, Asmaa Aboulhorma, Halina Abramowicz, Henso Abreu, et al.","author":"Aad Georges","year":"2022","unstructured":"Georges Aad , Brad Abbott , Dale C Abbott , A Abed Abud , Kira Abeling , Deshan Kavishka Abhayasinghe , Syed Haider Abidi, Asmaa Aboulhorma, Halina Abramowicz, Henso Abreu, et al. 2022 . AtlFast3: the next generation of fast simulation in ATLAS. Computing and software for big science 6, 1 (2022), 7. Georges Aad, Brad Abbott, Dale C Abbott, A Abed Abud, Kira Abeling, Deshan Kavishka Abhayasinghe, Syed Haider Abidi, Asmaa Aboulhorma, Halina Abramowicz, Henso Abreu, et al. 2022. AtlFast3: the next generation of fast simulation in ATLAS. Computing and software for big science 6, 1 (2022), 7."},{"key":"e_1_3_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2015.06.001"},{"key":"e_1_3_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.future.2020.04.006"},{"key":"e_1_3_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9005703"},{"key":"e_1_3_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1177\/10943420211029302"},{"key":"e_1_3_2_1_6_1","unstructured":"Kelsey R Allen Tatiana Lopez-Guavara Kim Stachenfeld Alvaro Sanchez-Gonzalez Peter Battaglia Jessica B Hamrick and Tobias Pfaff. 2022. Inverse Design for Fluid-Structure Interactions using Graph Network Simulators. In Advances in Neural Information Processing Systems Alice H. Oh Alekh Agarwal Danielle Belgrave and Kyunghyun Cho (Eds.). https:\/\/openreview.net\/forum?id=HaZuqj0Gvp2  Kelsey R Allen Tatiana Lopez-Guavara Kim Stachenfeld Alvaro Sanchez-Gonzalez Peter Battaglia Jessica B Hamrick and Tobias Pfaff. 2022. Inverse Design for Fluid-Structure Interactions using Graph Network Simulators. In Advances in Neural Information Processing Systems Alice H. Oh Alekh Agarwal Danielle Belgrave and Kyunghyun Cho (Eds.). https:\/\/openreview.net\/forum?id=HaZuqj0Gvp2"},{"key":"e_1_3_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1175\/2009BAMS2618.1"},{"key":"e_1_3_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/3307681.3325400"},{"key":"e_1_3_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/s42979-020-0081-1"},{"key":"e_1_3_2_1_10_1","unstructured":"Vivek Balasubramanian Shantenu Jha Andre Merzky and Matteo Turilli. 2019. RADICAL-Cybertools: Middleware Building Blocks for Scalable Science. https:\/\/arxiv.org\/abs\/1904.03085  Vivek Balasubramanian Shantenu Jha Andre Merzky and Matteo Turilli. 2019. RADICAL-Cybertools: Middleware Building Blocks for Scalable Science. https:\/\/arxiv.org\/abs\/1904.03085"},{"key":"e_1_3_2_1_11_1","first-page":"536","article-title":"Harnessing the Power of Many","volume":"2018","author":"Balasubramanian Vivek","year":"2018","unstructured":"Vivek Balasubramanian , Matteo Turilli , Weiming Hu , Matthieu Lefebvre , Wenjie Lei , Guido Cervone , Jeroen Tromp , and Shantenu Jha . 2018 . Harnessing the Power of Many : Extensible Toolkit for Scalable Ensemble Applications. In IPDPS 2018. 536 -- 545 . Vivek Balasubramanian, Matteo Turilli, Weiming Hu, Matthieu Lefebvre, Wenjie Lei, Guido Cervone, Jeroen Tromp, and Shantenu Jha. 2018. Harnessing the Power of Many: Extensible Toolkit for Scalable Ensemble Applications. In IPDPS 2018. 536--545.","journal-title":"Extensible Toolkit for Scalable Ensemble Applications. In IPDPS"},{"key":"e_1_3_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.5555\/3071534.3071590"},{"key":"e_1_3_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356180"},{"key":"e_1_3_2_1_14_1","unstructured":"Christopher Berner Greg Brockman Brooke Chan Vicki Cheung Przemys\u0142aw D\u0119biak Christy Dennison David Farhi Quirin Fischer Shariq Hashme Chris Hesse etal 2019. Dota 2 with large scale deep reinforcement learning. ArXiv preprint abs\/1912.06680 (2019). https:\/\/arxiv.org\/abs\/1912.06680  Christopher Berner Greg Brockman Brooke Chan Vicki Cheung Przemys\u0142aw D\u0119biak Christy Dennison David Farhi Quirin Fischer Shariq Hashme Chris Hesse et al. 2019. Dota 2 with large scale deep reinforcement learning. ArXiv preprint abs\/1912.06680 (2019). https:\/\/arxiv.org\/abs\/1912.06680"},{"key":"e_1_3_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-77977-1_39"},{"key":"e_1_3_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1137\/16M1080173"},{"key":"e_1_3_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS53621.2022.00083"},{"key":"e_1_3_2_1_18_1","volume-title":"Message Passing Neural PDE Solvers. In The Tenth International Conference on Learning Representations, ICLR 2022","author":"Brandstetter Johannes","year":"2022","unstructured":"Johannes Brandstetter , Daniel E. Worrall , and Max Welling . 2022 . Message Passing Neural PDE Solvers. In The Tenth International Conference on Learning Representations, ICLR 2022 , Virtual Event, April 25--29 , 2022. OpenReview.net. https:\/\/openreview.net\/forum?id=vSix3HPYKSU Johannes Brandstetter, Daniel E. Worrall, and Max Welling. 2022. Message Passing Neural PDE Solvers. In The Tenth International Conference on Learning Representations, ICLR 2022, Virtual Event, April 25--29, 2022. OpenReview.net. https:\/\/openreview.net\/forum?id=vSix3HPYKSU"},{"key":"e_1_3_2_1_19_1","volume-title":"Machine learning for fluid mechanics. Annual review of fluid mechanics 52","author":"Brunton Steven L","year":"2020","unstructured":"Steven L Brunton , Bernd R Noack , and Petros Koumoutsakos . 2020. Machine learning for fluid mechanics. Annual review of fluid mechanics 52 ( 2020 ), 477--508. Steven L Brunton, Bernd R Noack, and Petros Koumoutsakos. 2020. Machine learning for fluid mechanics. Annual review of fluid mechanics 52 (2020), 477--508."},{"key":"e_1_3_2_1_20_1","volume-title":"IEEE International Symposium on Cluster Computing and the Grid","volume":"2","author":"Capit Nicolas","year":"2005","unstructured":"Nicolas Capit , Georges Da Costa , Yiannis Georgiou , Guillaume Huard , Cyrille Martin , Gr\u00e9gory Mouni\u00e9 , Pierre Neyron , and Olivier Richard . 2005 . A batch scheduler with high level components. In CCGrid 2005 . IEEE International Symposium on Cluster Computing and the Grid , 2005., Vol. 2 . IEEE, 776--783. Nicolas Capit, Georges Da Costa, Yiannis Georgiou, Guillaume Huard, Cyrille Martin, Gr\u00e9gory Mouni\u00e9, Pierre Neyron, and Olivier Richard. 2005. A batch scheduler with high level components. In CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005., Vol. 2. IEEE, 776--783."},{"key":"e_1_3_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1912789117"},{"key":"e_1_3_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/N19-1423"},{"key":"e_1_3_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1145\/3458817.3476181"},{"key":"e_1_3_2_1_24_1","volume-title":"Weighted random sampling with a reservoir. Information processing letters 97, 5","author":"Efraimidis Pavlos S","year":"2006","unstructured":"Pavlos S Efraimidis and Paul G Spirakis . 2006. Weighted random sampling with a reservoir. Information processing letters 97, 5 ( 2006 ), 181--185. Pavlos S Efraimidis and Paul G Spirakis. 2006. Weighted random sampling with a reservoir. Information processing letters 97, 5 (2006), 181--185."},{"key":"e_1_3_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICCSE.2012.24"},{"key":"e_1_3_2_1_26_1","volume-title":"Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13--18","volume":"3071","author":"Fedus William","year":"2020","unstructured":"William Fedus , Prajit Ramachandran , Rishabh Agarwal , Yoshua Bengio , Hugo Larochelle , Mark Rowland , and Will Dabney . 2020 . Revisiting Fundamentals of Experience Replay . In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13--18 July 2020, Virtual Event (Proceedings of Machine Learning Research , Vol. 119). PMLR, 3061-- 3071 . http:\/\/proceedings.mlr.press\/v119\/fedus20a.html William Fedus, Prajit Ramachandran, Rishabh Agarwal, Yoshua Bengio, Hugo Larochelle, Mark Rowland, and Will Dabney. 2020. Revisiting Fundamentals of Experience Replay. In Proceedings of the 37th International Conference on Machine Learning, ICML 2020, 13--18 July 2020, Virtual Event (Proceedings of Machine Learning Research, Vol. 119). PMLR, 3061--3071. http:\/\/proceedings.mlr.press\/v119\/fedus20a.html"},{"key":"e_1_3_2_1_27_1","volume-title":"An elastic framework for ensemble-based large-scale data assimilation. The international journal of high performance computing applications 36, 4","author":"Friedemann Sebastian","year":"2022","unstructured":"Sebastian Friedemann and Bruno Raffin . 2022. An elastic framework for ensemble-based large-scale data assimilation. The international journal of high performance computing applications 36, 4 ( 2022 ), 543--563. Sebastian Friedemann and Bruno Raffin. 2022. An elastic framework for ensemble-based large-scale data assimilation. The international journal of high performance computing applications 36, 4 (2022), 543--563."},{"key":"e_1_3_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1017\/jfm.2020.948"},{"key":"e_1_3_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2020.100561"},{"key":"e_1_3_2_1_30_1","volume-title":"large minibatch sgd: Training imagenet in 1 hour. ArXiv preprint abs\/1706.02677","author":"Goyal Priya","year":"2017","unstructured":"Priya Goyal , Piotr Doll\u00e1r , Ross Girshick , Pieter Noordhuis , Lukasz Wesolowski , Aapo Kyrola , Andrew Tulloch , Yangqing Jia , and Kaiming He. 2017. Accurate , large minibatch sgd: Training imagenet in 1 hour. ArXiv preprint abs\/1706.02677 ( 2017 ). https:\/\/arxiv.org\/abs\/1706.02677 Priya Goyal, Piotr Doll\u00e1r, Ross Girshick, Pieter Noordhuis, Lukasz Wesolowski, Aapo Kyrola, Andrew Tulloch, Yangqing Jia, and Kaiming He. 2017. Accurate, large minibatch sgd: Training imagenet in 1 hour. ArXiv preprint abs\/1706.02677 (2017). https:\/\/arxiv.org\/abs\/1706.02677"},{"key":"e_1_3_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-77977-1_36"},{"volume-title":"ZeroMQ: messaging for many applications. \" O'Reilly Media","author":"Hintjens Pieter","key":"e_1_3_2_1_32_1","unstructured":"Pieter Hintjens . 2013. ZeroMQ: messaging for many applications. \" O'Reilly Media , Inc .\". Pieter Hintjens. 2013. ZeroMQ: messaging for many applications. \" O'Reilly Media, Inc.\"."},{"key":"e_1_3_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2021.04.112"},{"key":"e_1_3_2_1_34_1","volume-title":"6th International Conference on Learning Representations, ICLR","author":"Horgan Dan","year":"2018","unstructured":"Dan Horgan , John Quan , David Budden , Gabriel Barth-Maron , Matteo Hessel , Hado van Hasselt , and David Silver . 2018. Distributed Prioritized Experience Replay . In 6th International Conference on Learning Representations, ICLR 2018 , Vancouver, BC , Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview .net. https:\/\/openreview.net\/forum?id=H1Dy-0Z Dan Horgan, John Quan, David Budden, Gabriel Barth-Maron, Matteo Hessel, Hado van Hasselt, and David Silver. 2018. Distributed Prioritized Experience Replay. In 6th International Conference on Learning Representations, ICLR 2018, Vancouver, BC, Canada, April 30 - May 3, 2018, Conference Track Proceedings. OpenReview.net. https:\/\/openreview.net\/forum?id=H1Dy-0Z"},{"key":"e_1_3_2_1_35_1","volume-title":"Proceedings of Machine Learning and Systems 2019","author":"Jia Zhihao","year":"2019","unstructured":"Zhihao Jia , Matei Zaharia , and Alex Aiken . 2019 . Beyond Data and Model Parallelism for Deep Neural Networks . In Proceedings of Machine Learning and Systems 2019 , MLSys 2019, Stanford, CA, USA, March 31 - April 2, 2019, Ameet Talwalkar, Virginia Smith, and Matei Zaharia (Eds.). mlsys.org. https:\/\/proceedings.mlsys.org\/book\/265.pdf Zhihao Jia, Matei Zaharia, and Alex Aiken. 2019. Beyond Data and Model Parallelism for Deep Neural Networks. In Proceedings of Machine Learning and Systems 2019, MLSys 2019, Stanford, CA, USA, March 31 - April 2, 2019, Ameet Talwalkar, Virginia Smith, and Matei Zaharia (Eds.). mlsys.org. https:\/\/proceedings.mlsys.org\/book\/265.pdf"},{"key":"e_1_3_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42254-021-00314-5"},{"key":"e_1_3_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1088\/2632-2153\/ac3ffa"},{"key":"e_1_3_2_1_38_1","volume-title":"Deep Fluids: A Generative Network for Parameterized Fluid Simulations. Computer Graphics Forum (Proc. Eurographics) 38, 2","author":"Kim Byungsoo","year":"2019","unstructured":"Byungsoo Kim , Vinicius C. Azevedo , Nils Thuerey , Theodore Kim , Markus Gross , and Barbara Solenthaler . 2019 . Deep Fluids: A Generative Network for Parameterized Fluid Simulations. Computer Graphics Forum (Proc. Eurographics) 38, 2 (2019). Byungsoo Kim, Vinicius C. Azevedo, Nils Thuerey, Theodore Kim, Markus Gross, and Barbara Solenthaler. 2019. Deep Fluids: A Generative Network for Parameterized Fluid Simulations. Computer Graphics Forum (Proc. Eurographics) 38, 2 (2019)."},{"key":"e_1_3_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1611835114"},{"key":"e_1_3_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.2101784118"},{"key":"e_1_3_2_1_41_1","volume-title":"Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021","author":"Krishnapriyan Aditi S.","year":"2021","unstructured":"Aditi S. Krishnapriyan , Amir Gholami , Shandian Zhe , Robert M. Kirby , and Michael W. Mahoney . 2021. Characterizing possible failure modes in physics-informed neural networks . In Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021 , NeurIPS 2021 , December 6--14, 2021, virtual, Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan (Eds.). 26548--26560. https:\/\/proceedings.neurips.cc\/paper\/2021\/hash\/df438e5206f31600e6ae4af72f2725f1-Abstract.html Aditi S. Krishnapriyan, Amir Gholami, Shandian Zhe, Robert M. Kirby, and Michael W. Mahoney. 2021. Characterizing possible failure modes in physics-informed neural networks. In Advances in Neural Information Processing Systems 34: Annual Conference on Neural Information Processing Systems 2021, NeurIPS 2021, December 6--14, 2021, virtual, Marc'Aurelio Ranzato, Alina Beygelzimer, Yann N. Dauphin, Percy Liang, and Jennifer Wortman Vaughan (Eds.). 26548--26560. https:\/\/proceedings.neurips.cc\/paper\/2021\/hash\/df438e5206f31600e6ae4af72f2725f1-Abstract.html"},{"key":"e_1_3_2_1_42_1","unstructured":"Alexander Lavin David Krakauer Hector Zenil Justin Gottschlich Tim Mattson Johann Brehmer Anima Anandkumar Sanjay Choudry Kamil Rocki At\u0131l\u0131m G\u00fcne\u015f Baydin Carina Prunkl Brooks Paige Olexandr Isayev Erik Peterson Peter L. McMahon Jakob Macke Kyle Cranmer Jiaxin Zhang Haruko Wainwright Adi Hanuka Manuela Veloso Samuel Assefa Stephan Zheng and Avi Pfeffer. 2021. Simulation Intelligence: Towards a New Generation of Scientific Methods. https:\/\/arxiv.org\/abs\/2112.03235  Alexander Lavin David Krakauer Hector Zenil Justin Gottschlich Tim Mattson Johann Brehmer Anima Anandkumar Sanjay Choudry Kamil Rocki At\u0131l\u0131m G\u00fcne\u015f Baydin Carina Prunkl Brooks Paige Olexandr Isayev Erik Peterson Peter L. McMahon Jakob Macke Kyle Cranmer Jiaxin Zhang Haruko Wainwright Adi Hanuka Manuela Veloso Samuel Assefa Stephan Zheng and Avi Pfeffer. 2021. Simulation Intelligence: Towards a New Generation of Scientific Methods. https:\/\/arxiv.org\/abs\/2112.03235"},{"key":"e_1_3_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1145\/3468267.3470573"},{"key":"e_1_3_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1109\/DLS49591.2019.00007"},{"key":"e_1_3_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.14778\/3415478.3415530"},{"key":"e_1_3_2_1_46_1","volume-title":"Fourier Neural Operator for Parametric Partial Differential Equations. In 9th International Conference on Learning Representations, ICLR 2021","author":"Li Zongyi","year":"2021","unstructured":"Zongyi Li , Nikola Borislavov Kovachki , Kamyar Azizzadenesheli , Burigede Liu , Kaushik Bhattacharya , Andrew M. Stuart , and Anima Anandkumar . 2021 . Fourier Neural Operator for Parametric Partial Differential Equations. In 9th International Conference on Learning Representations, ICLR 2021 , Virtual Event, Austria, May 3--7 , 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=c8P9NQVtmnO Zongyi Li, Nikola Borislavov Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew M. Stuart, and Anima Anandkumar. 2021. Fourier Neural Operator for Parametric Partial Differential Equations. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3--7, 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=c8P9NQVtmnO"},{"key":"e_1_3_2_1_47_1","volume-title":"Transformer for Partial Differential Equations' Operator Learning. Transactions on Machine Learning Research","author":"Li Zijie","year":"2023","unstructured":"Zijie Li , Kazem Meidani , and Amir Barati Farimani . 2023. Transformer for Partial Differential Equations' Operator Learning. Transactions on Machine Learning Research ( 2023 ). https:\/\/openreview.net\/forum?id=EPPqt3uERT Zijie Li, Kazem Meidani, and Amir Barati Farimani. 2023. Transformer for Partial Differential Equations' Operator Learning. Transactions on Machine Learning Research (2023). https:\/\/openreview.net\/forum?id=EPPqt3uERT"},{"key":"e_1_3_2_1_48_1","volume-title":"Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan","author":"Liang Eric","year":"2018","unstructured":"Eric Liang , Richard Liaw , Robert Nishihara , Philipp Moritz , Roy Fox , Ken Goldberg , Joseph Gonzalez , Michael I. Jordan , and Ion Stoica . 2018 . RLlib: Abstractions for Distributed Reinforcement Learning . In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan , Stockholm, Sweden, July 10--15 , 2018 (Proceedings of Machine Learning Research, Vol. 80), Jennifer G. Dy and Andreas Krause (Eds.). PMLR, 3059--3068. http:\/\/proceedings.mlr.press\/v80\/liang18b.html Eric Liang, Richard Liaw, Robert Nishihara, Philipp Moritz, Roy Fox, Ken Goldberg, Joseph Gonzalez, Michael I. Jordan, and Ion Stoica. 2018. RLlib: Abstractions for Distributed Reinforcement Learning. In Proceedings of the 35th International Conference on Machine Learning, ICML 2018, Stockholmsm\u00e4ssan, Stockholm, Sweden, July 10--15, 2018 (Proceedings of Machine Learning Research, Vol. 80), Jennifer G. Dy and Andreas Krause (Eds.). PMLR, 3059--3068. http:\/\/proceedings.mlr.press\/v80\/liang18b.html"},{"key":"e_1_3_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2022.111022"},{"key":"e_1_3_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2021.114264"},{"key":"e_1_3_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevFluids.5.104401"},{"key":"e_1_3_2_1_52_1","volume-title":"Radical-pilot: Scalable execution of heterogeneous and dynamic workloads on supercomputers. CoRR, abs\/1512.08194","author":"Merzky Andre","year":"2015","unstructured":"Andre Merzky , Mark Santcroos , Matteo Turilli , and Shantenu Jha . 2015 . Radical-pilot: Scalable execution of heterogeneous and dynamic workloads on supercomputers. CoRR, abs\/1512.08194 (2015). Andre Merzky, Mark Santcroos, Matteo Turilli, and Shantenu Jha. 2015. Radical-pilot: Scalable execution of heterogeneous and dynamic workloads on supercomputers. CoRR, abs\/1512.08194 (2015)."},{"key":"e_1_3_2_1_53_1","volume-title":"Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research","volume":"24630","author":"Meyer Lucas Thibaut","year":"2023","unstructured":"Lucas Thibaut Meyer , Marc Schouler , Robert Alexander Caulk , Alejandro Ribes , and Bruno Raffin . 2023 . Training Deep Surrogate Models with Large Scale Online Learning . In Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research , Vol. 202), Andreas Krause, Emma Brun-skill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 24614-- 24630 . https:\/\/proceedings.mlr.press\/v202\/meyer23b.html Lucas Thibaut Meyer, Marc Schouler, Robert Alexander Caulk, Alejandro Ribes, and Bruno Raffin. 2023. Training Deep Surrogate Models with Large Scale Online Learning. In Proceedings of the 40th International Conference on Machine Learning (Proceedings of Machine Learning Research, Vol. 202), Andreas Krause, Emma Brun-skill, Kyunghyun Cho, Barbara Engelhardt, Sivan Sabato, and Jonathan Scarlett (Eds.). PMLR, 24614--24630. https:\/\/proceedings.mlr.press\/v202\/meyer23b.html"},{"key":"e_1_3_2_1_54_1","volume-title":"ArXiv preprint abs\/1811.05233","author":"Mikami Hiroaki","year":"2018","unstructured":"Hiroaki Mikami , Hisahiro Suganuma , Pongsakorn U.- Chupala , Yoshiki Tanaka , and Yuichi Kageyama . 2018. ImageNet\/ResNet-50 Training in 224 Seconds . ArXiv preprint abs\/1811.05233 ( 2018 ). https:\/\/arxiv.org\/abs\/1811.05233 Hiroaki Mikami, Hisahiro Suganuma, Pongsakorn U.-Chupala, Yoshiki Tanaka, and Yuichi Kageyama. 2018. ImageNet\/ResNet-50 Training in 224 Seconds. ArXiv preprint abs\/1811.05233 (2018). https:\/\/arxiv.org\/abs\/1811.05233"},{"key":"e_1_3_2_1_55_1","volume-title":"Direct numerical simulation: a tool in turbulence research. Annual review of fluid mechanics 30, 1","author":"Moin Parviz","year":"1998","unstructured":"Parviz Moin and Krishnan Mahesh . 1998. Direct numerical simulation: a tool in turbulence research. Annual review of fluid mechanics 30, 1 ( 1998 ), 539--578. Parviz Moin and Krishnan Mahesh. 1998. Direct numerical simulation: a tool in turbulence research. Annual review of fluid mechanics 30, 1 (1998), 539--578."},{"key":"e_1_3_2_1_56_1","volume-title":"Proceedings of the 13th USENIX conference on Operating Systems Design and Implementation (OSDI'18)","author":"Moritz Philipp","year":"2018","unstructured":"Philipp Moritz , Robert Nishihara , Stephanie Wang , Alexey Tumanov , Richard Liaw , Eric Liang , Melih Elibol , Zongheng Yang , William Paul , Michael I. Jordan , and Ion Stoica . 2018 . Ray: a distributed framework for emerging AI applications . In Proceedings of the 13th USENIX conference on Operating Systems Design and Implementation (OSDI'18) . USENIX Association, Carlsbad, CA, USA, 561--577. Philipp Moritz, Robert Nishihara, Stephanie Wang, Alexey Tumanov, Richard Liaw, Eric Liang, Melih Elibol, Zongheng Yang, William Paul, Michael I. Jordan, and Ion Stoica. 2018. Ray: a distributed framework for emerging AI applications. In Proceedings of the 13th USENIX conference on Operating Systems Design and Implementation (OSDI'18). USENIX Association, Carlsbad, CA, USA, 561--577."},{"key":"e_1_3_2_1_57_1","volume-title":"Vedavyas Panneershelvam, Mustafa Suleyman, Charles Beattie, Stig Petersen, et al.","author":"Nair Arun","year":"2015","unstructured":"Arun Nair , Praveen Srinivasan , Sam Blackwell , Cagdas Alcicek , Rory Fearon , Alessandro De Maria , Vedavyas Panneershelvam, Mustafa Suleyman, Charles Beattie, Stig Petersen, et al. 2015 . Massively parallel methods for deep reinforcement learning. ArXiv preprint abs\/1507.04296 (2015). https:\/\/arxiv.org\/abs\/1507.04296 Arun Nair, Praveen Srinivasan, Sam Blackwell, Cagdas Alcicek, Rory Fearon, Alessandro De Maria, Vedavyas Panneershelvam, Mustafa Suleyman, Charles Beattie, Stig Petersen, et al. 2015. Massively parallel methods for deep reinforcement learning. ArXiv preprint abs\/1507.04296 (2015). https:\/\/arxiv.org\/abs\/1507.04296"},{"key":"e_1_3_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cageo.2012.03.026"},{"key":"e_1_3_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2019.01.012"},{"key":"e_1_3_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1109\/MASCOTS53633.2021.9614303"},{"key":"e_1_3_2_1_61_1","volume-title":"Learning Mesh-Based Simulation with Graph Networks. In 9th International Conference on Learning Representations, ICLR 2021","author":"Pfaff Tobias","year":"2021","unstructured":"Tobias Pfaff , Meire Fortunato , Alvaro Sanchez-Gonzalez , and Peter W. Battaglia . 2021 . Learning Mesh-Based Simulation with Graph Networks. In 9th International Conference on Learning Representations, ICLR 2021 , Virtual Event, Austria, May 3--7 , 2021 . OpenReview.net. https:\/\/openreview.net\/forum?id=roNqYL0_XP Tobias Pfaff, Meire Fortunato, Alvaro Sanchez-Gonzalez, and Peter W. Battaglia. 2021. Learning Mesh-Based Simulation with Graph Networks. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3--7, 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=roNqYL0_XP"},{"key":"e_1_3_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1145\/2063384.2063465"},{"key":"e_1_3_2_1_63_1","volume-title":"Universal differential equations for scientific machine learning. ArXiv preprint abs\/2001.04385","author":"Rackauckas Christopher","year":"2020","unstructured":"Christopher Rackauckas , Yingbo Ma , Julius Martensen , Collin Warner , Kirill Zubov , Rohit Supekar , Dominic Skinner , Ali Ramadhan , and Alan Edelman . 2020. Universal differential equations for scientific machine learning. ArXiv preprint abs\/2001.04385 ( 2020 ). https:\/\/arxiv.org\/abs\/2001.04385 Christopher Rackauckas, Yingbo Ma, Julius Martensen, Collin Warner, Kirill Zubov, Rohit Supekar, Dominic Skinner, Ali Ramadhan, and Alan Edelman. 2020. Universal differential equations for scientific machine learning. ArXiv preprint abs\/2001.04385 (2020). https:\/\/arxiv.org\/abs\/2001.04385"},{"key":"e_1_3_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2018.10.045"},{"key":"e_1_3_2_1_65_1","volume-title":"Conference on Robot Learning. PMLR, 1736--1744","author":"Riedmiller Martin","year":"2022","unstructured":"Martin Riedmiller , Jost Tobias Springenberg , Roland Hafner , and Nicolas Heess . 2022 . Collect & infer-a fresh look at data-efficient reinforcement learning . In Conference on Robot Learning. PMLR, 1736--1744 . Martin Riedmiller, Jost Tobias Springenberg, Roland Hafner, and Nicolas Heess. 2022. Collect & infer-a fresh look at data-efficient reinforcement learning. In Conference on Robot Learning. PMLR, 1736--1744."},{"key":"e_1_3_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.25080\/Majora-7b98e3ed-013"},{"key":"e_1_3_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-24574-4_28"},{"key":"e_1_3_2_1_68_1","volume-title":"Leonardo Bautista Gomez, and Julien Bigot","author":"Roussel Corentin","year":"2017","unstructured":"Corentin Roussel , Kai Keller , Mohamed Gaalich , Leonardo Bautista Gomez, and Julien Bigot . 2017 . PDI, an approach to decouple I\/O concerns from high-performance simulation codes. (2017). https:\/\/hal.archives-ouvertes.fr\/hal-01587075 working paper or preprint. Corentin Roussel, Kai Keller, Mohamed Gaalich, Leonardo Bautista Gomez, and Julien Bigot. 2017. PDI, an approach to decouple I\/O concerns from high-performance simulation codes. (2017). https:\/\/hal.archives-ouvertes.fr\/hal-01587075 working paper or preprint."},{"key":"e_1_3_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2018\/369"},{"key":"e_1_3_2_1_70_1","volume-title":"Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18--24","volume":"9332","author":"Satorras Victor Garcia","year":"2021","unstructured":"Victor Garcia Satorras , Emiel Hoogeboom , and Max Welling . 2021 . E(n) Equivariant Graph Neural Networks . In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18--24 July 2021, Virtual Event (Proceedings of Machine Learning Research , Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 9323-- 9332 . http:\/\/proceedings.mlr.press\/v139\/satorras21a.html Victor Garcia Satorras, Emiel Hoogeboom, and Max Welling. 2021. E(n) Equivariant Graph Neural Networks. In Proceedings of the 38th International Conference on Machine Learning, ICML 2021, 18--24 July 2021, Virtual Event (Proceedings of Machine Learning Research, Vol. 139), Marina Meila and Tong Zhang (Eds.). PMLR, 9323--9332. http:\/\/proceedings.mlr.press\/v139\/satorras21a.html"},{"key":"e_1_3_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.05291"},{"key":"e_1_3_2_1_72_1","volume-title":"Megatron-lm: Training multi-billion parameter language models using model parallelism. ArXiv preprint abs\/1909.08053","author":"Shoeybi Mohammad","year":"2019","unstructured":"Mohammad Shoeybi , Mostofa Patwary , Raul Puri , Patrick LeGresley , Jared Casper , and Bryan Catanzaro . 2019 . Megatron-lm: Training multi-billion parameter language models using model parallelism. ArXiv preprint abs\/1909.08053 (2019). https:\/\/arxiv.org\/abs\/1909.08053 Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, and Bryan Catanzaro. 2019. Megatron-lm: Training multi-billion parameter language models using model parallelism. ArXiv preprint abs\/1909.08053 (2019). https:\/\/arxiv.org\/abs\/1909.08053"},{"key":"e_1_3_2_1_73_1","doi-asserted-by":"publisher","DOI":"10.1038\/nature24270"},{"key":"e_1_3_2_1_74_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2018.08.029"},{"key":"e_1_3_2_1_75_1","volume-title":"Katherine Yelick, and David Brown.","author":"Stevens Rick","year":"2020","unstructured":"Rick Stevens , Valerie Taylor , Jeff Nichols , Arthur Barney Maccabe , Katherine Yelick, and David Brown. 2020 . AI for Science: Report on the Department of Energy (DOE) Town Halls on Artificial Intelligence (AI) for Science. Technical Report. Argonne National Lab.(ANL), Argonne, IL (United States). Rick Stevens, Valerie Taylor, Jeff Nichols, Arthur Barney Maccabe, Katherine Yelick, and David Brown. 2020. AI for Science: Report on the Department of Energy (DOE) Town Halls on Artificial Intelligence (AI) for Science. Technical Report. Argonne National Lab.(ANL), Argonne, IL (United States)."},{"key":"e_1_3_2_1_76_1","first-page":"1596","article-title":"PDEBench: An extensive benchmark for scientific machine learning","volume":"35","author":"Takamoto Makoto","year":"2022","unstructured":"Makoto Takamoto , Timothy Praditia , Raphael Leiteritz , Daniel MacKinlay , Francesco Alesiani , Dirk Pfl\u00fcger , and Mathias Niepert . 2022 . PDEBench: An extensive benchmark for scientific machine learning . Advances in Neural Information Processing Systems 35 (2022), 1596 -- 1611 . Makoto Takamoto, Timothy Praditia, Raphael Leiteritz, Daniel MacKinlay, Francesco Alesiani, Dirk Pfl\u00fcger, and Mathias Niepert. 2022. PDEBench: An extensive benchmark for scientific machine learning. Advances in Neural Information Processing Systems 35 (2022), 1596--1611.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2020.109456"},{"key":"e_1_3_2_1_78_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342015594678"},{"key":"e_1_3_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1145\/3126908.3126922"},{"key":"e_1_3_2_1_80_1","volume-title":"9th International Conference on Learning Representations, ICLR 2021","author":"Wandel Nils","year":"2021","unstructured":"Nils Wandel , Michael Weinmann , and Reinhard Klein . 2021 . Learning Incompressible Fluid Dynamics from Scratch - Towards Fast, Differentiable Fluid Models that Generalize . In 9th International Conference on Learning Representations, ICLR 2021 , Virtual Event, Austria, May 3--7 , 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=KUDUoRsEphu Nils Wandel, Michael Weinmann, and Reinhard Klein. 2021. Learning Incompressible Fluid Dynamics from Scratch - Towards Fast, Differentiable Fluid Models that Generalize. In 9th International Conference on Learning Representations, ICLR 2021, Virtual Event, Austria, May 3--7, 2021. OpenReview.net. https:\/\/openreview.net\/forum?id=KUDUoRsEphu"},{"key":"e_1_3_2_1_81_1","doi-asserted-by":"publisher","DOI":"10.1145\/3394486.3403198"},{"key":"e_1_3_2_1_82_1","volume-title":"Massive computational acceleration by using neural networks to emulate mechanism-based biological models. Nature communications 10, 1","author":"Wang Shangying","year":"2019","unstructured":"Shangying Wang , Kai Fan , Nan Luo , Yangxiaolu Cao , Feilun Wu , Carolyn Zhang , Katherine A Heller , and Lingchong You . 2019. Massive computational acceleration by using neural networks to emulate mechanism-based biological models. Nature communications 10, 1 ( 2019 ), 1--9. Shangying Wang, Kai Fan, Nan Luo, Yangxiaolu Cao, Feilun Wu, Carolyn Zhang, Katherine A Heller, and Lingchong You. 2019. Massive computational acceleration by using neural networks to emulate mechanism-based biological models. Nature communications 10, 1 (2019), 1--9."},{"key":"e_1_3_2_1_83_1","doi-asserted-by":"publisher","DOI":"10.1109\/MLHPC54614.2021.00007"},{"key":"e_1_3_2_1_84_1","first-page":"22409","article-title":"Envpool: A highly parallel reinforcement learning environment execution engine","volume":"35","author":"Weng Jiayi","year":"2022","unstructured":"Jiayi Weng , Min Lin , Shengyi Huang , Bo Liu , Denys Makoviichuk , Viktor Makoviychuk , Zichen Liu , Yufan Song , Ting Luo , Yukun Jiang , 2022 . Envpool: A highly parallel reinforcement learning environment execution engine . Advances in Neural Information Processing Systems 35 (2022), 22409 -- 22421 . Jiayi Weng, Min Lin, Shengyi Huang, Bo Liu, Denys Makoviichuk, Viktor Makoviychuk, Zichen Liu, Yufan Song, Ting Luo, Yukun Jiang, et al. 2022. Envpool: A highly parallel reinforcement learning environment execution engine. Advances in Neural Information Processing Systems 35 (2022), 22409--22421.","journal-title":"Advances in Neural Information Processing Systems"},{"key":"e_1_3_2_1_85_1","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00216"},{"key":"e_1_3_2_1_86_1","doi-asserted-by":"crossref","unstructured":"H. Yashiro K. Terasaki Y. Kawai S. Kudo T. Miyoshi T. Imamura K. Minami H. Inoue T. Nishiki T. Saji M. Satoh and H. Tomita. 2020. A 1024-Member Ensemble Data Assimilation with 3.5-Km Mesh Global Weather Simulations. In Supercomputing 2020: International Conference for High Performance Computing Networking Storage and Analysis (SC). IEEE Computer Society Los Alamitos CA USA 1--10.  H. Yashiro K. Terasaki Y. Kawai S. Kudo T. Miyoshi T. Imamura K. Minami H. Inoue T. Nishiki T. Saji M. Satoh and H. Tomita. 2020. A 1024-Member Ensemble Data Assimilation with 3.5-Km Mesh Global Weather Simulations. In Supercomputing 2020: International Conference for High Performance Computing Networking Storage and Analysis (SC). IEEE Computer Society Los Alamitos CA USA 1--10.","DOI":"10.1109\/SC41405.2020.00005"},{"key":"e_1_3_2_1_87_1","doi-asserted-by":"publisher","DOI":"10.1007\/10968987_3"},{"key":"e_1_3_2_1_88_1","doi-asserted-by":"publisher","DOI":"10.1145\/3447818.3460370"},{"key":"e_1_3_2_1_89_1","doi-asserted-by":"publisher","DOI":"10.24963\/ijcai.2019\/589"},{"key":"e_1_3_2_1_90_1","volume-title":"Proceedings of the 2nd Workshop on Scaling Up Reinforcement Learning (SURL), International Joint Conference on Artificial Intelligence (IJCAI).","author":"Zhang Linjing","year":"2019","unstructured":"Linjing Zhang , Zongzhang Zhang , Zhiyuan Pan , Yingfeng Chen , Jiangcheng Zhu , Zhaorong Wang , Meng Wang , and Changjie Fan . 2019 . A framework of dual replay buffer: balancing forgetting and generalization in reinforcement learning . In Proceedings of the 2nd Workshop on Scaling Up Reinforcement Learning (SURL), International Joint Conference on Artificial Intelligence (IJCAI). Linjing Zhang, Zongzhang Zhang, Zhiyuan Pan, Yingfeng Chen, Jiangcheng Zhu, Zhaorong Wang, Meng Wang, and Changjie Fan. 2019. A framework of dual replay buffer: balancing forgetting and generalization in reinforcement learning. In Proceedings of the 2nd Workshop on Scaling Up Reinforcement Learning (SURL), International Joint Conference on Artificial Intelligence (IJCAI)."},{"key":"e_1_3_2_1_91_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2019.05.024"},{"key":"e_1_3_2_1_92_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.sysarc.2020.101810"}],"event":{"name":"SC '23: International Conference for High Performance Computing, Networking, Storage and Analysis","sponsor":["SIGHPC ACM Special Interest Group on High Performance Computing, Special Interest Group on High Performance Computing","IEEE CS"],"location":"Denver CO USA","acronym":"SC '23"},"container-title":["Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis"],"original-title":[],"link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3581784.3607083","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3581784.3607083","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T16:36:23Z","timestamp":1750178183000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3581784.3607083"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,11,11]]},"references-count":92,"alternative-id":["10.1145\/3581784.3607083","10.1145\/3581784"],"URL":"https:\/\/doi.org\/10.1145\/3581784.3607083","relation":{},"subject":[],"published":{"date-parts":[[2023,11,11]]},"assertion":[{"value":"2023-11-11","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}