{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T22:54:02Z","timestamp":1777676042975,"version":"3.51.4"},"reference-count":18,"publisher":"SAGE Publications","issue":"3-4","license":[{"start":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T00:00:00Z","timestamp":1684800000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":["journals.sagepub.com"],"crossmark-restriction":true},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2023,7]]},"abstract":"<jats:p>In this work, we develop novel data science methodologies for ensemble performance data that have the potential to uncover orders of magnitude of performance that is unknowingly being left on the table. Building on years of successful performance tool design and tool integration into million-line codes at Lawrence Livermore National Laboratory (Caliper ( Boehme et al. 2016 ), Hatchet ( Bhatele et al. 2019 ; Brink et al. 2020 ))\u2014successes highlighted as key deliverables in meeting LLNL\u2019s L1 and L2 milestones ( Rieben and Weiss 2020 )\u2014we design a data science methodology for integrating multi-dimensional, multi-scale, multi-architecture, and multi-tool performance data, and provide data analytics and interactive visualization capabilities for further analysis and exploration of the data. Our work provides developers with a comprehensive multi-dimensional performance landscape, enabling enhanced capabilities for pinpointing performance bottlenecks on emerging hardware platforms composed of heterogeneous elements.<\/jats:p>","DOI":"10.1177\/10943420231175687","type":"journal-article","created":{"date-parts":[[2023,5,23]],"date-time":"2023-05-23T07:09:24Z","timestamp":1684825764000},"page":"434-441","update-policy":"https:\/\/doi.org\/10.1177\/sage-journals-update-policy","source":"Crossref","is-referenced-by-count":0,"title":["Finding the forest in the trees: Enabling performance optimization on heterogeneous architectures through data science analysis of ensemble performance data"],"prefix":"10.1177","volume":"37","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1904-9627","authenticated-orcid":false,"given":"Olga","family":"Pearce","sequence":"first","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"},{"name":"College Station, Texas A and M University, San Marcos, TX, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1458-8453","authenticated-orcid":false,"given":"Stephanie","family":"Brink","sequence":"additional","affiliation":[{"name":"Lawrence Livermore National Laboratory, Livermore, CA, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2023,5,23]]},"reference":[{"key":"bibr1-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1109\/CLUSTER.2018.00037"},{"issue":"6","key":"bibr2-10943420231175687","doi-asserted-by":"crossref","first-page":"685","DOI":"10.1002\/cpe.1553","volume":"22","author":"Adhianto L","year":"2010","journal-title":"Concurrency and Computation: Practice and Experience"},{"key":"bibr3-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1145\/3295500.3356219"},{"key":"bibr4-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2016.46"},{"key":"bibr5-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1109\/HUSTProtools51951.2020.00013"},{"key":"bibr6-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1177\/109434200001400303"},{"key":"bibr7-10943420231175687","author":"Dongarra J","year":"2004","journal-title":"Future Generation Computer Systems - FGCS"},{"key":"bibr8-10943420231175687","doi-asserted-by":"publisher","DOI":"10.2172\/1169830"},{"key":"bibr9-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1109\/ProTools49597.2019.00015"},{"key":"bibr10-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1109\/SC.2016.45"},{"key":"bibr11-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1109\/SC.1999.10029"},{"key":"bibr12-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-31476-6_7"},{"key":"bibr13-10943420231175687","volume-title":"5th International Workshop on Automatic Performance Analysis (APART)","author":"Mellor-Crummey J","year":"2003"},{"key":"bibr14-10943420231175687","volume-title":"ATDM FY20 L1 Report","author":"Rieben R","year":"2020"},{"key":"bibr15-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1177\/1094342006064482"},{"key":"bibr16-10943420231175687","unstructured":"The Open SpeedShop Team (2006) Open SpeedShop for Linux. URL http:\/\/www.openspeedshop.org."},{"key":"bibr17-10943420231175687","volume-title":"Exploratory data analysis","author":"Tukey JW","year":"1977"},{"key":"bibr18-10943420231175687","doi-asserted-by":"publisher","DOI":"10.1109\/P3HPC.2018.00005"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231175687","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/full-xml\/10.1177\/10943420231175687","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/10943420231175687","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:17:29Z","timestamp":1777450649000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/10943420231175687"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,5,23]]},"references-count":18,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2023,7]]}},"alternative-id":["10.1177\/10943420231175687"],"URL":"https:\/\/doi.org\/10.1177\/10943420231175687","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"value":"1094-3420","type":"print"},{"value":"1741-2846","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,5,23]]}}}