{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:55:20Z","timestamp":1777676120462,"version":"3.51.4"},"reference-count":75,"publisher":"SAGE Publications","issue":"4","license":[{"start":{"date-parts":[[2026,4,21]],"date-time":"2026-04-21T00:00:00Z","timestamp":1776729600000},"content-version":"vor","delay-in-days":365,"URL":"http:\/\/www.sagepub.com\/licence-information-for-chorus"},{"start":{"date-parts":[[2025,4,21]],"date-time":"2025-04-21T00:00:00Z","timestamp":1745193600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["17-SC-20-SC"],"award-info":[{"award-number":["17-SC-20-SC"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["DE-AC02- 06CH11357"],"award-info":[{"award-number":["DE-AC02- 06CH11357"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["DE-AC05-00OR22725"],"award-info":[{"award-number":["DE-AC05-00OR22725"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["DE-SC-0019700"],"award-info":[{"award-number":["DE-SC-0019700"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100006132","name":"Office of Science","doi-asserted-by":"publisher","award":["DE-SC-0022511"],"award-info":[{"award-number":["DE-SC-0022511"]}],"id":[{"id":"10.13039\/100006132","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000104","name":"National Aeronautics and Space Administration","doi-asserted-by":"crossref","award":["80NSSC24PB401"],"award-info":[{"award-number":["80NSSC24PB401"]}],"id":[{"id":"10.13039\/100000104","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2025,7]]},"abstract":"<jats:p>\n                    The TAU Performance System\n                    <jats:sup>\u00ae<\/jats:sup>\n                    is a portable profiling and tracing toolkit for performance analysis of parallel programs written in Fortran, C, C++, UPC, Java, Python. TAU (Tuning and Analysis Utilities) is capable of gathering performance information through instrumentation of functions, methods, basic blocks, and statements as well as event-based sampling. All C++ language features are supported including templates and namespaces. The API also provides selection of profiling groups for organizing and controlling instrumentation. The instrumentation can be inserted in the source code using an automatic instrumentation tool based on the Program Database Toolkit (PDT), dynamically using binary modification, at runtime in the Java Virtual Machine, or manually using the instrumentation API. Under the Exascale Computing Program (ECP), the TAU project was funded to prepare the software for exascale systems and beyond. Many new features and optimizations were added to TAU, including support for the new exascale system architectures and their preferred programming models. The new features include OpenMP Tools support, updated or newly implemented CUDA, HIP, and SYCL support, updated OpenACC and Clacc support, MPI updates, a new plugin API and several plugins, instrumentation updates, support for the Kokkos and Raja profiling interfaces, updated support for Python, PyTorch, TensorFlow, and Horovod, and removed threading limitations. In this paper, we will discuss these updates and more, and demonstrate the features with ECP Proxy Applications and full ECP applications.\n                  <\/jats:p>","DOI":"10.1177\/10943420251334456","type":"journal-article","created":{"date-parts":[[2025,4,21]],"date-time":"2025-04-21T08:04:41Z","timestamp":1745222681000},"page":"532-552","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":3,"title":["Preparing the TAU performance system for exascale and beyond"],"prefix":"10.1177","volume":"39","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7064-8417","authenticated-orcid":false,"given":"Kevin A.","family":"Huck","sequence":"first","affiliation":[{"name":"University of Oregon, Eugene, OR, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sameer","family":"Shende","sequence":"additional","affiliation":[{"name":"University of Oregon, Eugene, OR, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Allen D.","family":"Malony","sequence":"additional","affiliation":[{"name":"University of Oregon, Eugene, OR, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Camille","family":"Coti","sequence":"additional","affiliation":[{"name":"\u00c9cole de Technologie Sup\u00e9rieure, Montreal, QC, Canada"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0009-0005-9704-7642","authenticated-orcid":false,"given":"Wyatt","family":"Spear","sequence":"additional","affiliation":[{"name":"University of Oregon, Eugene, OR, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jordi","family":"Alcaraz","sequence":"additional","affiliation":[{"name":"University of Oregon, Eugene, OR, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1453-5906","authenticated-orcid":false,"given":"Dewi","family":"Yokelson","sequence":"additional","affiliation":[{"name":"University of Oregon, Eugene, OR, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Srinivasan","family":"Ramesh","sequence":"additional","affiliation":[{"name":"NVIDIA, San Jose, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Monil Mohammad","family":"Alaul Haque","sequence":"additional","affiliation":[{"name":"Oak Ridge National Laboratory, Oak Ridge, TN, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chad","family":"Wood","sequence":"additional","affiliation":[{"name":"Stability AI, London, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7807-7620","authenticated-orcid":false,"given":"Nick","family":"Chaimov","sequence":"additional","affiliation":[{"name":"ParaTools, Inc, Eugene, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cameron","family":"Durbin","sequence":"additional","affiliation":[{"name":"ParaTools, Inc, Eugene, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Alister","family":"Johnson","sequence":"additional","affiliation":[{"name":"University of Oregon, Eugene, OR, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jacob","family":"Lambert","sequence":"additional","affiliation":[{"name":"Advanced Micro Devices (AMD), Seattle, WA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-9506-504X","authenticated-orcid":false,"given":"Izaak","family":"Beekman","sequence":"additional","affiliation":[{"name":"ParaTools, Inc, Eugene, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2025,4,21]]},"reference":[{"key":"e_1_3_3_2_1","unstructured":"Abadi M Agarwal A Barham P et al. (2015) TensorFlow: large-scale machine learning on heterogeneous systems. https:\/\/www.tensorflow.org\/.Softwareavailablefromtensorflow.org"},{"key":"e_1_3_3_3_1","unstructured":"Abhyankar S Brown J Constantinescu EM et al. (2018) PETSc\/TS: a modern scalable ODE\/DAE solver library. arXiv preprint arXiv:180601437 2018."},{"key":"e_1_3_3_4_1","unstructured":"AMD (2021) AMD CDNA\u21222 architecture. https:\/\/www.amd.com\/content\/dam\/amd\/en\/documents\/instinct-business-docs\/white-papers\/amd-cdna2-white-paper.pdf"},{"key":"e_1_3_3_5_1","author":"AMD ROCTX","year":"2025","unstructured":"AMD ROCTX (2025) Application Code Annotation. Available at: https:\/\/docs.amd.com\/bundle\/ROCTracer-User-Guide-v5.0-\/page\/ROCTX_Application_Code_Annotation.html.","journal-title":"Application Code Annotation"},{"key":"e_1_3_3_6_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.02260"},{"key":"e_1_3_3_7_1","volume-title":"The Aurora supercomputer","author":"Argonne National Laboratory","year":"2025","unstructured":"Argonne National Laboratory (2025) The Aurora supercomputer. Available at: https:\/\/www.anl.gov\/aurora."},{"key":"e_1_3_3_8_1","doi-asserted-by":"publisher","DOI":"10.1109\/P3HPC49587.2019.00012"},{"key":"e_1_3_3_9_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45209-6_7"},{"key":"e_1_3_3_10_1","doi-asserted-by":"publisher","DOI":"10.1145\/2024569.2024572"},{"key":"e_1_3_3_11_1","unstructured":"Berris DM Veitch A Heintze N et al. (2016) Xray: a function call tracing system."},{"key":"e_1_3_3_12_1","doi-asserted-by":"publisher","DOI":"10.1147\/JRD.2012.2227580"},{"key":"e_1_3_3_13_1","doi-asserted-by":"publisher","DOI":"10.1109\/ProTools49597.2019.00010"},{"key":"e_1_3_3_14_1","doi-asserted-by":"publisher","DOI":"10.1177\/109434200001400404"},{"key":"e_1_3_3_15_1","doi-asserted-by":"publisher","DOI":"10.1109\/HiPC.2013.6799106"},{"key":"e_1_3_3_16_1","unstructured":"Chollet F (2015) Keras. https:\/\/keras.io"},{"key":"e_1_3_3_17_1","doi-asserted-by":"publisher","DOI":"10.1109\/HUSTProtools51951.2020.00012"},{"key":"e_1_3_3_18_1","doi-asserted-by":"publisher","DOI":"10.1109\/LLVM-HPC.2018.8639349"},{"key":"e_1_3_3_19_1","unstructured":"Duffy EB Malloy BA Schaub S (2014) Exploiting the Clang AST for analysis of C++ applications. In Proceedings of the 52nd Annual ACM Southeast Conference March 28\u201329 2014."},{"key":"e_1_3_3_20_1","article-title":"The extreme-scale scientific","author":"E4S Project","year":"2025","unstructured":"E4S Project (2025) The extreme-scale scientific. Software Stack. https:\/\/e4s-project.github.io\/","journal-title":"Software Stack"},{"key":"e_1_3_3_21_1","unstructured":"Edison Design Group (2025) Edison design group C++ frontend. https:\/\/www.edg.com\/c"},{"key":"e_1_3_3_22_1","volume-title":"International Conference on Parallel Computing","author":"Eschweiler D","year":"2011","unstructured":"Eschweiler D, Wagner M, Geimer M, et al. (2011) Open Trace Format 2: the next generation of scalable trace formats and support libraries. In International Conference on Parallel Computing. https:\/\/api.semanticscholar.org\/CorpusID:37062839"},{"key":"e_1_3_3_23_1","unstructured":"The Exascale Computing Project (2025) ECP proxy applications: miniQMC. https:\/\/proxyapps.exascaleproject.org\/app\/miniqmc\/"},{"key":"e_1_3_3_24_1","doi-asserted-by":"crossref","unstructured":"Gamblin T LeGendre M Collette MR et al. (2015) The Spack package manager: bringing order to HPC software chaos. In Supercomputing 2015 (SC\u201915). Supercomputing 2015 (SC\u201915). Austin Texas USA.","DOI":"10.1145\/2807591.2807623"},{"key":"e_1_3_3_25_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.softx.2020.100561"},{"key":"e_1_3_3_26_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cpc.2019.01.006"},{"key":"e_1_3_3_27_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPP.2005.29"},{"key":"e_1_3_3_28_1","doi-asserted-by":"publisher","DOI":"10.1155\/2008\/985194"},{"key":"e_1_3_3_29_1","unstructured":"Intel Corporation (2025) Level Zero. https:\/\/dgpu-docs.intel.com\/technologies\/level-zero.html"},{"key":"e_1_3_3_30_1","doi-asserted-by":"crossref","unstructured":"Karlin I Keasler J Neely R. (2013) Lulesh 2.0 updates and changes. Technical Report LLNL-TR-641973.","DOI":"10.2172\/1090032"},{"key":"e_1_3_3_31_1","doi-asserted-by":"publisher","DOI":"10.1145\/3426462.3426465"},{"key":"e_1_3_3_32_1","doi-asserted-by":"publisher","DOI":"10.1145\/1296907.1296909"},{"key":"e_1_3_3_33_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-68564-7_9"},{"key":"e_1_3_3_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/CGO.2004.1281665"},{"key":"e_1_3_3_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPASS.2010.5452024"},{"key":"e_1_3_3_36_1","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2000.10052"},{"key":"e_1_3_3_37_1","doi-asserted-by":"publisher","DOI":"10.1109\/PDP.2014.38"},{"key":"e_1_3_3_38_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPP.2011.71"},{"key":"e_1_3_3_39_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1015741304337"},{"key":"e_1_3_3_40_1","unstructured":"NVIDIA (2020b) NVIDIA management library (NVML). https:\/\/developer.nvidia.com\/nvidia-management-library-nvml"},{"key":"e_1_3_3_41_1","unstructured":"NVIDIA (2025a) Cuda profiling tools interface. https:\/\/docs.nvidia.com\/cuda\/cupti\/index.html"},{"key":"e_1_3_3_42_1","unstructured":"NVIDIA (2025) NVIDIA tools extension (NVTX). https:\/\/docs.nvidia.com\/nvtx\/index.html"},{"key":"e_1_3_3_43_1","unstructured":"Oak Ridge National Laboratory. (2025) Frontier. https:\/\/www.olcf.ornl.gov\/olcf-resources\/compute-systems\/frontier\/"},{"key":"e_1_3_3_44_1","unstructured":"Oak Ridge National Laboratory (2023) The Frontier supercomputer. https:\/\/www.olcf.ornl.gov\/frontier\/"},{"key":"e_1_3_3_45_1","unstructured":"ParaTools Inc (2025) SALT: an LLVM-based source analysis Tookit for HPC. https:\/\/github.com\/ParaToolsInc\/salt"},{"key":"e_1_3_3_46_1","volume-title":"PyTorch: An Imperative Style, High-Performance Deep Learning Library","author":"Paszke A","year":"2019","unstructured":"Paszke A, Gross S, Massa F, et al. (2019) PyTorch: An Imperative Style, High-Performance Deep Learning Library. Red Hook, NY, USA: Curran Associates Inc."},{"key":"e_1_3_3_47_1","volume-title":"Physical Plan Instrumentation in Databases: Mechanisms and Applications","author":"Psallidas F","year":"2019","unstructured":"Psallidas F (2019) Physical Plan Instrumentation in Databases: Mechanisms and Applications. [PhD Thesis]. Columbia University."},{"key":"e_1_3_3_48_1","unstructured":"PyTorch Profiler. (2025) Kineto PyTorch profiler. https:\/\/github.com\/pytorch\/kineto"},{"key":"e_1_3_3_49_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2018.05.003"},{"key":"e_1_3_3_50_1","doi-asserted-by":"publisher","DOI":"10.1109\/HiPC53243.2021.00047"},{"key":"e_1_3_3_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.parco.2018.05.003"},{"key":"e_1_3_3_52_1","doi-asserted-by":"crossref","unstructured":"Rosales C Cazes J Milfeld K et al. (2016) A comparative study of application performance and scalability on the Intel Knights Landing processor. In High Performance Computing: ISC High Performance 2016 International Workshops ExaComm E-MuCoCoS HPC-IODC IXPUG IWOPH P 3MA VHPC WOPSSS Frankfurt Germany June 19\u201323 2016 pp. 307\u2013318.","DOI":"10.1007\/978-3-319-46079-6_22"},{"key":"e_1_3_3_53_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11390-020-9802-0"},{"key":"e_1_3_3_54_1","doi-asserted-by":"publisher","DOI":"10.1002\/we.2886"},{"key":"e_1_3_3_55_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342006064482"},{"key":"e_1_3_3_56_1","doi-asserted-by":"publisher","DOI":"10.21105\/joss.04115"},{"key":"e_1_3_3_57_1","doi-asserted-by":"publisher","DOI":"10.1177\/10943420211019119"},{"key":"e_1_3_3_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-11261-4_11"},{"key":"e_1_3_3_59_1","unstructured":"The Exascale Computing Project. (2025a) The exascale computing project. https:\/\/www.exascaleproject.org\/"},{"key":"e_1_3_3_60_1","unstructured":"The Exascale Computing Project. (2025b) Proteas-tune. https:\/\/www.exascaleproject.org\/research-project\/proteas-tune\/"},{"key":"e_1_3_3_61_1","unstructured":"The Exascale Computing Project. (2025c) The exascale computing project applications. https:\/\/www.exascaleproject.org\/research\/#application"},{"key":"e_1_3_3_62_1","unstructured":"The Exascale Computing Project. (2025d) The exascale computing project software technology. https:\/\/www.exascaleproject.org\/research\/#software"},{"key":"e_1_3_3_63_1","unstructured":"The Exascale Computing Project. (2025e) ExaFel. https:\/\/www.exascaleproject.org\/research-project\/exafel\/"},{"key":"e_1_3_3_64_1","unstructured":"The Exascale Computing Project (2025f) Adaptave mesh refinement. https:\/\/www.exascaleproject.org\/research-project\/adaptive-mesh-refinement\/"},{"key":"e_1_3_3_65_1","unstructured":"The Exascale Computing Project. (2025g) Candle. https:\/\/www.exascaleproject.org\/research-project\/candle\/"},{"key":"e_1_3_3_66_1","unstructured":"The Exascale Computing Project (2025h) Particle based applications. https:\/\/www.exascaleproject.org\/research-project\/particle-based-applications\/"},{"key":"e_1_3_3_67_1","unstructured":"The Exascale Computing Project. (2025i) WDMApp. https:\/\/www.exascaleproject.org\/research-project\/wdmapp\/"},{"key":"e_1_3_3_68_1","unstructured":"The Exascale Computing Project. (2025j) ExaWind. https:\/\/www.exascaleproject.org\/research-project\/exawind\/"},{"key":"e_1_3_3_69_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICPPW.2010.38"},{"key":"e_1_3_3_70_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2021.3097283"},{"key":"e_1_3_3_71_1","unstructured":"WDMApp (2024) Camtimers. https:\/\/github.com\/wdmapp\/camtimers"},{"key":"e_1_3_3_72_1","first-page":"1","volume-title":"Tools for High Performance Computing","author":"Williams WR","year":"2015","unstructured":"Williams WR, Meng X, Welton B, et al. (2015) Dyninst and MRNet: foundational infrastructure for parallel tools. In: Kn\u00fcpfer A, Hilbrich T, Niethammer C, et al. (eds) Tools for High Performance Computing. Cham: Springer International Publishing, pp. 1\u201316."},{"key":"e_1_3_3_73_1","first-page":"07747","article-title":"Fashion-MNIST: a novel image dataset for benchmarking machine learning algorithms","volume":"1708","author":"Xiao H","year":"2017","unstructured":"Xiao H, Rasul K, Vollgraf R (2017) Fashion-MNIST: a novel image dataset for benchmarking machine learning algorithms. Axiv 1708: 07747.","journal-title":"Axiv"},{"key":"e_1_3_3_74_1","doi-asserted-by":"publisher","unstructured":"Yokelson D Lappi O Ramesh S et al. (2024a) SOMA: observability monitoring and in situ analytics for exascale applications. Concurrency and Computation: Practice and Experience 3636: 2024; (19):e8141. DOI: 10.1002\/cpe.8141.","DOI":"10.1002\/cpe.8141"},{"key":"e_1_3_3_75_1","doi-asserted-by":"crossref","unstructured":"Yokelson D Titov M Ramesh S et al. (2024b) Enabling performance observability for heterogeneous hpc workflows with SOMA. In International Conference on Parallel Processing Gotland Sweden August 12\u201315 2024.","DOI":"10.1145\/3673038.3673100"},{"key":"e_1_3_3_76_1","unstructured":"Younge AJ Gamblin T (2019) ECP packaging technologies. https:\/\/www.osti.gov\/biblio\/1646052"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420251334456","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420251334456","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420251334456","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420251334456","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:17:44Z","timestamp":1777450664000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420251334456"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,4,21]]},"references-count":75,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,7]]}},"alternative-id":["10.1177\/10943420251334456"],"URL":"https:\/\/doi.org\/10.1177\/10943420251334456","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,4,21]]}}}