{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T17:31:33Z","timestamp":1769189493549,"version":"3.49.0"},"reference-count":30,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T00:00:00Z","timestamp":1761436800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"},{"start":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T00:00:00Z","timestamp":1761436800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"funder":[{"name":"U.S. Department of Energy by Lawrence Livermore National Laboratory","award":["DE-AC52-07NA27344"],"award-info":[{"award-number":["DE-AC52-07NA27344"]}]},{"name":"U.S. Department of Energy by Lawrence Livermore National Laboratory","award":["24-SI-005 (LLNL-JRNL-2001672)"],"award-info":[{"award-number":["24-SI-005 (LLNL-JRNL-2001672)"]}]}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2026,1]]},"abstract":"<jats:p>\n                    The field of High-Performance Computing (HPC) is defined by providing computing devices with highest performance for a variety of demanding scientific users. The tight co-design relationship between HPC providers and users propels the field forward, paired with technological improvements, achieving continuously higher performance and resource utilization. A key device for system architects, architecture researchers, and scientific users are benchmarks, allowing for well-defined assessment of hardware, software, and algorithms. Many benchmarks exist in the community, from individual niche benchmarks testing specific features, to large-scale benchmark suites for whole procurements. We survey the available HPC benchmarks, summarizing them in table form with key details and concise categorization, also through an interactive website. For categorization, we present a\n                    <jats:italic toggle=\"yes\">benchmark taxonomy<\/jats:italic>\n                    for well-defined characterization of benchmarks.\n                  <\/jats:p>","DOI":"10.1177\/10943420251351424","type":"journal-article","created":{"date-parts":[[2025,10,26]],"date-time":"2025-10-26T17:45:46Z","timestamp":1761500746000},"page":"42-51","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["An HPC benchmark survey and taxonomy for characterization"],"prefix":"10.1177","volume":"40","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-7150-2505","authenticated-orcid":false,"given":"Andreas","family":"Herten","sequence":"first","affiliation":[{"name":"Forschungszentrum J\u00fclich"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1904-9627","authenticated-orcid":false,"given":"Olga","family":"Pearce","sequence":"additional","affiliation":[{"name":"Center for Applied Scientific Computing, Lawrence Livermore National Laboratory"},{"name":"Department of Computer Science and Engineering, Texas A&M University"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5618-6727","authenticated-orcid":false,"given":"Filipe S. M.","family":"Guimar\u00e3es","sequence":"additional","affiliation":[{"name":"Forschungszentrum J\u00fclich"}]}],"member":"179","published-online":{"date-parts":[[2025,10,26]]},"reference":[{"key":"e_1_3_6_2_1","doi-asserted-by":"crossref","unstructured":"Beckingsale DA Scogland TR Burmark J et al. (2019a) RAJA: portable performance for large-scale scientific applications. In: 2019 IEEE\/ACM International Workshop on Performance Portability and Productivity in HPC (P3HPC) Denver CO USA 22 November 2019.","DOI":"10.1109\/P3HPC49587.2019.00012"},{"key":"e_1_3_6_3_1","doi-asserted-by":"crossref","unstructured":"Beckingsale DA Scogland TR Burmark J et al. (2019b) Raja: portable performance for large-scale scientific applications. In: 2019 IEEE\/ACM International Workshop on Performance Portability and Productivity in HPC (P3HPC) Denver CO USA 22 November 2019.","DOI":"10.1109\/P3HPC49587.2019.00012"},{"key":"e_1_3_6_4_1","doi-asserted-by":"publisher","DOI":"10.1016\/0010-4655(95)00042-E"},{"key":"e_1_3_6_5_1","unstructured":"Breuer T L\u00fchrs S Smolenko A et al. (2022) Jube. (Version 2.5.1); 2.5.1. https:\/\/juser.fz-juelich.de\/record\/917408"},{"key":"e_1_3_6_6_1","doi-asserted-by":"crossref","unstructured":"Che S Boyer M Meng J et al. (2009) Rodinia: a benchmark suite for heterogeneous computing. In: 2009 IEEE International Symposium on Workload Characterization (IISWC) Austin TX USA 4\u20136 October 2009.","DOI":"10.1109\/IISWC.2009.5306797"},{"key":"e_1_3_6_7_1","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356215"},{"key":"e_1_3_6_8_1","doi-asserted-by":"publisher","DOI":"10.1504\/IJCSE.2018.095847"},{"key":"e_1_3_6_9_1","doi-asserted-by":"publisher","DOI":"10.1145\/141868.141871"},{"key":"e_1_3_6_10_1","doi-asserted-by":"publisher","DOI":"10.1177\/1094342015593158"},{"key":"e_1_3_6_11_1","doi-asserted-by":"crossref","unstructured":"Herten A Achilles S Alvarez D et al. (2024) Application-driven exascale: the JUPITER benchmark suite. In: SC24: International Conference for High Performance Computing Networking Storage and Analysis Los Alamitos CA USA 17\u201322 November 2024.","DOI":"10.1109\/SC41406.2024.00038"},{"key":"e_1_3_6_12_1","unstructured":"Herten A Pearce O Guimaraes F (2025) Benchmarks survey GitHub. https:\/\/github.com\/FZJ-JSC\/benchmark-survey"},{"key":"e_1_3_6_13_1","doi-asserted-by":"crossref","unstructured":"Hornung R Keasler J Gokhale M (2011) Hydrodynamics challenge problem. https:\/\/doi.org\/10.2172\/1117905","DOI":"10.2172\/1117905"},{"key":"e_1_3_6_14_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-94437-7_7"},{"key":"e_1_3_6_15_1","doi-asserted-by":"publisher","DOI":"10.1145\/3624062.3624132"},{"key":"e_1_3_6_16_1","doi-asserted-by":"publisher","DOI":"10.1109\/ISPASS57527.2023.00041"},{"key":"e_1_3_6_17_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-44728-1_3"},{"key":"e_1_3_6_18_1","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-246X.2002.01653.x"},{"key":"e_1_3_6_19_1","unstructured":"LANL Pre-Team (2019) Pavilion framework. https:\/\/github.com\/hpc\/pavilion2"},{"key":"e_1_3_6_20_1","first-page":"1","article-title":"The hpc challenge (Hpcc) benchmark suite","volume":"213","author":"Luszczek PR","year":"2006","unstructured":"Luszczek PR, Bailey DH, Dongarra JJ, et al. (2006) The hpc challenge (Hpcc) benchmark suite. Proceedings of the 2006 ACM\/IEEE conference on Supercomputing 213: 1.","journal-title":"Proceedings of the 2006 ACM\/IEEE conference on Supercomputing"},{"key":"e_1_3_6_21_1","unstructured":"Madec G Bell M Blaker A et al. (2023) Nemo ocean engine reference manual. https:\/\/zenodo.org\/record\/8167700"},{"key":"e_1_3_6_22_1","first-page":"336","article-title":"MLPerf training benchmark","volume":"2","author":"Mattson P","year":"2020","unstructured":"Mattson P, Cheng C, Diamos G, Coleman C, et al. (2020) MLPerf training benchmark. Proceedings of Machine Learning and Systems 2: 336\u2013349.","journal-title":"Proceedings of Machine Learning and Systems"},{"key":"e_1_3_6_23_1","first-page":"19","volume-title":"IEEE Computer Society Technical Committee on Computer Architecture (TCCA)","author":"McCalpin JD","year":"1995","unstructured":"McCalpin JD (1995) Memory bandwidth and machine balance in current high performance computers. IEEE Computer Society Technical Committee on Computer Architecture (TCCA). New York, NY: IEEE, 19\u201325."},{"key":"e_1_3_6_24_1","unstructured":"ML Commons (2023) MLPerf. https:\/\/mlcommons.org\/en\/"},{"key":"e_1_3_6_25_1","doi-asserted-by":"publisher","DOI":"10.1145\/3624062.3624135"},{"key":"e_1_3_6_26_1","first-page":"1206","volume-title":"Proceedings of the SC \u201924 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis","author":"Pearce O","year":"2025","unstructured":"Pearce O, Burmark J, Hornung R, et al. (2025) Raja performance suite: performance portability analysis with caliper and thicket. Proceedings of the SC \u201924 Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis. New York, NY: IEEE Press, 1206\u20131218."},{"key":"e_1_3_6_27_1","doi-asserted-by":"publisher","DOI":"10.1063\/5.0014475"},{"key":"e_1_3_6_28_1","doi-asserted-by":"crossref","unstructured":"Plimpton S Brightwell R Vaughan C et al. (2006) A simple synchronous distributed-memory algorithm for the hpcc randomaccess benchmark. In: 2006 IEEE International Conference on Cluster Computing Barcelona Spain 25\u201328 September 2006.","DOI":"10.1109\/CLUSTR.2006.311859"},{"key":"e_1_3_6_29_1","doi-asserted-by":"publisher","DOI":"10.1093\/mnras\/stab1855"},{"key":"e_1_3_6_30_1","doi-asserted-by":"publisher","DOI":"10.1038\/s42254-022-00441-7"},{"key":"e_1_3_6_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32813-9_5"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420251351424","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420251351424","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420251351424","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,1,23]],"date-time":"2026-01-23T15:36:17Z","timestamp":1769182577000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420251351424"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,26]]},"references-count":30,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2026,1]]}},"alternative-id":["10.1177\/10943420251351424"],"URL":"https:\/\/doi.org\/10.1177\/10943420251351424","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,10,26]]}}}