{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,9,21]],"date-time":"2025-09-21T18:28:04Z","timestamp":1758479284988,"version":"3.38.0"},"reference-count":60,"publisher":"SAGE Publications","issue":"6","license":[{"start":{"date-parts":[[2021,9,27]],"date-time":"2021-09-27T00:00:00Z","timestamp":1632700800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100004944","name":"Department of Energy, Labor and Economic Growth","doi-asserted-by":"publisher","award":["Exascale Computing Project (17-SC-20-SC)"],"award-info":[{"award-number":["Exascale Computing Project (17-SC-20-SC)"]}],"id":[{"id":"10.13039\/100004944","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2021,11]]},"abstract":"<jats:p> Rapid growth in data, computational methods, and computing power is driving a remarkable revolution in what variously is termed machine learning (ML), statistical learning, computational learning, and artificial intelligence. In addition to highly visible successes in machine-based natural language translation, playing the game Go, and self-driving cars, these new technologies also have profound implications for computational and experimental science and engineering, as well as for the exascale computing systems that the Department of Energy (DOE) is developing to support those disciplines. Not only do these learning technologies open up exciting opportunities for scientific discovery on exascale systems, they also appear poised to have important implications for the design and use of exascale computers themselves, including high-performance computing (HPC) for ML and ML for HPC. The overarching goal of the ExaLearn co-design project is to provide exascale ML software for use by Exascale Computing Project (ECP) applications, other ECP co-design centers, and DOE experimental facilities and leadership class computing facilities. <\/jats:p>","DOI":"10.1177\/10943420211029302","type":"journal-article","created":{"date-parts":[[2021,9,28]],"date-time":"2021-09-28T04:48:32Z","timestamp":1632804512000},"page":"598-616","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":13,"title":["Co-design Center for Exascale Machine Learning Technologies (ExaLearn)"],"prefix":"10.1177","volume":"35","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-9848-555X","authenticated-orcid":false,"given":"Francis J","family":"Alexander","sequence":"first","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]},{"given":"James","family":"Ang","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Jenna A","family":"Bilbrey","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Jan","family":"Balewski","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA, USA"}]},{"given":"Tiernan","family":"Casey","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, Albuquerque, NM, USA"}]},{"given":"Ryan","family":"Chard","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL, USA"}]},{"given":"Jong","family":"Choi","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN, USA"}]},{"given":"Sutanay","family":"Choudhury","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Bert","family":"Debusschere","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, Albuquerque, NM, USA"}]},{"given":"Anthony M","family":"DeGennaro","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]},{"given":"Nikoli","family":"Dryden","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratories, Livermore, CA, USA"},{"name":"ETH Zurich, Zurich, Switzerland"}]},{"given":"J Austin","family":"Ellis","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, Albuquerque, NM, USA"}]},{"given":"Ian","family":"Foster","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL, USA"}]},{"given":"Cristina Garcia","family":"Cardona","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN, USA"}]},{"given":"Sayan","family":"Ghosh","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Peter","family":"Harrington","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA, USA"}]},{"given":"Yunzhi","family":"Huang","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Shantenu","family":"Jha","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]},{"given":"Travis","family":"Johnston","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Ai","family":"Kagawa","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]},{"given":"Ramakrishnan","family":"Kannan","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Neeraj","family":"Kumar","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Zhengchun","family":"Liu","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL, USA"}]},{"given":"Naoya","family":"Maruyama","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratories, Livermore, CA, USA"}]},{"given":"Satoshi","family":"Matsuoka","sequence":"additional","affiliation":[{"name":"RIKEN Center for Computational Science, Kobe, Japan"},{"name":"Tokyo Institute of Technology, Tokyo, Japan"}]},{"given":"Erin","family":"McCarthy","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratories, Livermore, CA, USA"},{"name":"University of Oregon, Eugene, OR, USA"}]},{"given":"Jamaludin","family":"Mohd-Yusof","sequence":"additional","affiliation":[{"name":"Los Alamos National Laboratory, Los Alamos, NM, USA"}]},{"given":"Peter","family":"Nugent","sequence":"additional","affiliation":[{"name":"Lawrence Berkeley National Laboratory, Berkeley, CA, USA"}]},{"given":"Yosuke","family":"Oyama","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratories, Livermore, CA, USA"},{"name":"Tokyo Institute of Technology, Tokyo, Japan"}]},{"given":"Thomas","family":"Proffen","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN, USA"}]},{"given":"David","family":"Pugmire","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN, USA"}]},{"given":"Sivasankaran","family":"Rajamanickam","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, Albuquerque, NM, USA"}]},{"given":"Vinay","family":"Ramakrishniah","sequence":"additional","affiliation":[{"name":"Los Alamos National Laboratory, Los Alamos, NM, USA"}]},{"given":"Malachi","family":"Schram","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Sudip K","family":"Seal","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Ganesh","family":"Sivaraman","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL, USA"}]},{"given":"Christine","family":"Sweeney","sequence":"additional","affiliation":[{"name":"Los Alamos National Laboratory, Los Alamos, NM, USA"}]},{"given":"Li","family":"Tan","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]},{"given":"Rajeev","family":"Thakur","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL, USA"}]},{"given":"Brian","family":"Van Essen","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratories, Livermore, CA, USA"}]},{"given":"Logan","family":"Ward","sequence":"additional","affiliation":[{"name":"Argonne National Laboratory, Lemont, IL, USA"}]},{"given":"Paul","family":"Welch","sequence":"additional","affiliation":[{"name":"Los Alamos National Laboratory, Los Alamos, NM, USA"}]},{"given":"Michael","family":"Wolf","sequence":"additional","affiliation":[{"name":"Sandia National Laboratories, Albuquerque, NM, USA"}]},{"given":"Sotiris S","family":"Xantheas","sequence":"additional","affiliation":[{"name":"Pacific Northwest National Laboratory, Richland, WA, USA"}]},{"given":"Kevin G","family":"Yager","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]},{"given":"Shinjae","family":"Yoo","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]},{"given":"Byung-Jun","family":"Yoon","sequence":"additional","affiliation":[{"name":"Brookhaven National Laboratory, Upton, NY, USA"}]}],"member":"179","published-online":{"date-parts":[[2021,9,27]]},"reference":[{"key":"bibr1-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1098\/rsta.2019.0056"},{"key":"bibr2-10943420211029302","first-page":"1","volume-title":"Practice and Experience in Advanced Research Computing","author":"Allcock WE","year":"2019"},{"volume-title":"Wasserstein GAN","year":"2017","author":"Arjovsky M","key":"bibr3-10943420211029302"},{"key":"bibr4-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1145\/3307681.3325400"},{"key":"bibr5-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1063\/5.0009933"},{"key":"bibr6-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1557\/mrc.2019.118"},{"volume-title":"Openai Gym","year":"2016","author":"Brockman G","key":"bibr7-10943420211029302"},{"key":"bibr8-10943420211029302","doi-asserted-by":"crossref","unstructured":"Chard K, Tuecke S, Foster I (2016) Globus: recent enhancements and future plans. In: XSEDE16 conference on diversity, big data, and science at scale, Miami USA, July 17\u201321 2016, pp. 1\u20138.","DOI":"10.1145\/2949550.2949554"},{"key":"bibr9-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1145\/3369583.3392683"},{"key":"bibr10-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1109\/IPDPS.2019.00038"},{"key":"bibr11-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1021\/jz502319n"},{"key":"bibr12-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1109\/MSP.2017.2765202"},{"key":"bibr13-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1021\/acs.jpca.0c01777"},{"key":"bibr14-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1016\/j.commatsci.2016.11.041"},{"key":"bibr15-10943420211029302","doi-asserted-by":"crossref","unstructured":"Dryden N, Maruyama N, Benson T, et al. (2019) Improving strong-scaling of CNN training by exploiting finer-grained parallelism. In: International parallel and distributed processing symposium, Rio de Janeiro, Brazil, 20\u201324 May 2019.","DOI":"10.1109\/IPDPS.2019.00031"},{"key":"bibr16-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1088\/2515-7639\/ab0c3d"},{"key":"bibr17-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1016\/j.combustflame.2014.12.011"},{"volume-title":"MiniGAN","year":"2020","author":"Ellis J","key":"bibr18-10943420211029302"},{"volume-title":"SEED RL: Scalable and Efficient Deep-RL with Accelerated Central Inference","year":"2019","author":"Espeholt L","key":"bibr19-10943420211029302"},{"volume-title":"Impala: Scalable Distributed Deep-RL with Importance Weighted Actor-Learner Architectures","year":"2018","author":"Espeholt L","key":"bibr20-10943420211029302"},{"key":"bibr21-10943420211029302","doi-asserted-by":"crossref","unstructured":"Foster I, Ainsworth M, Allen B, et al. (2017) Computing just what you need: Online data analysis and reduction at extreme scales. In: European conference on parallel processing, Jaipur, India, 18\u201321 December 2017, pp. 3\u201319.","DOI":"10.1109\/HiPC.2017.00042"},{"key":"bibr22-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1177\/10943420211023549"},{"key":"bibr23-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1137\/070693424"},{"key":"bibr24-10943420211029302","unstructured":"Gal Y, Ghahramani Z (2016) Dropout as a Bayesian approximation: Representing model uncertainty in deep learning. In: International conference on machine learning, New York, NY, 19\u201324 June 2016, pp. 1050\u20131059."},{"key":"bibr25-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1109\/BigData47090.2019.9005968"},{"volume-title":"NIPS 2016 Tutorial: Generative Adversarial Networks","year":"2016","author":"Goodfellow I","key":"bibr26-10943420211029302"},{"key":"bibr27-10943420211029302","first-page":"2672","volume-title":"Advances in Neural Information Processing Systems","volume":"27","author":"Goodfellow I","year":"2014"},{"key":"bibr28-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-2966.2011.18820.x"},{"volume-title":"Improving Performance via Mini-Applications","year":"2009","author":"Heroux MA","key":"bibr29-10943420211029302"},{"key":"bibr30-10943420211029302","first-page":"1099","volume-title":"Advances in Neural Information Processing Systems","volume":"31","author":"Jiang S","year":"2018"},{"volume-title":"Junction Tree Variational Autoencoder for Molecular Graph generation","year":"2018","author":"Jin W","key":"bibr31-10943420211029302"},{"key":"bibr32-10943420211029302","first-page":"64","volume":"147","author":"Li Z","year":"2020","journal-title":"Journal of Parallel and Distributed Processing"},{"key":"bibr33-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-99465-9"},{"key":"bibr34-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1088\/0953-8984\/28\/40\/403002"},{"key":"bibr35-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2018.00068"},{"key":"bibr36-10943420211029302","unstructured":"Moritz P, Nishihara R, Wang S, et al. (2017) Ray: a distributed framework for emerging ai applications."},{"key":"bibr37-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1186\/s40668-019-0029-9"},{"key":"bibr38-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1186\/s40668-019-0029-9"},{"key":"bibr39-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-020-57887-x"},{"key":"bibr40-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-48114-3"},{"key":"bibr41-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1002\/admi.201901679"},{"volume-title":"The Case for Strong Scaling in Deep Learning: Training Large 3D CNNs with Hybrid Parallelism","year":"2020","author":"Oyama Y","key":"bibr42-10943420211029302"},{"volume-title":"NIPS-W","year":"2017","author":"Paszke A","key":"bibr43-10943420211029302"},{"key":"bibr44-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1016\/j.automatica.2007.05.016"},{"key":"bibr45-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1007\/s11280-018-0565-2"},{"volume-title":"Quantitative Performance Assessment of Proxy Apps and Parents","year":"2020","author":"Richards D","key":"bibr46-10943420211029302"},{"volume-title":"Horovod: Fast and Easy Distributed Deep Learning in TensorFlow","year":"2018","author":"Sergeev A","key":"bibr47-10943420211029302"},{"volume-title":"Active Learning Literature Survey","year":"2009","author":"Settles B","key":"bibr48-10943420211029302"},{"key":"bibr49-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1002\/wcms.1491"},{"key":"bibr50-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1088\/1742-6596\/1452\/1\/012071"},{"key":"bibr51-10943420211029302","volume-title":"Reinforcement Learning: An Introduction","volume":"1","author":"Sutton RS","year":"1998"},{"volume-title":"Wand Elt BD and Zaldarriaga MsCOLA: The N-Body COLA Method Extended to the Spatial Domain","year":"2015","author":"Tassev S","key":"bibr52-10943420211029302"},{"key":"bibr53-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1088\/1475-7516\/2013\/06\/036"},{"key":"bibr54-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1107\/S0021889813003531"},{"key":"bibr55-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1145\/2834892.2834897"},{"key":"bibr56-10943420211029302","doi-asserted-by":"publisher","DOI":"10.3847\/1538-4357\/aafad1"},{"key":"bibr57-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1557\/mrc.2019.107"},{"key":"bibr58-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1186\/s12859-018-2508-4"},{"key":"bibr59-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1109\/TSP.2013.2251336"},{"key":"bibr60-10943420211029302","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-019-47148-x"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420211029302","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420211029302","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420211029302","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,2]],"date-time":"2025-03-02T01:43:26Z","timestamp":1740879806000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420211029302"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,9,27]]},"references-count":60,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2021,11]]}},"alternative-id":["10.1177\/10943420211029302"],"URL":"https:\/\/doi.org\/10.1177\/10943420211029302","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"type":"print","value":"1094-3420"},{"type":"electronic","value":"1741-2846"}],"subject":[],"published":{"date-parts":[[2021,9,27]]}}}