{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,6,19]],"date-time":"2025-06-19T04:53:43Z","timestamp":1750308823638,"version":"3.41.0"},"reference-count":21,"publisher":"Association for Computing Machinery (ACM)","issue":"4","license":[{"start":{"date-parts":[[2011,3,29]],"date-time":"2011-03-29T00:00:00Z","timestamp":1301356800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["SIGMETRICS Perform. Eval. Rev."],"published-print":{"date-parts":[[2011,3,29]]},"abstract":"<jats:p>With the advent of heterogeneous computing systems consisting of multi-core CPUs and many-core GPUs, robust methods are needed to facilitate fair benchmark comparisons between different systems. In this paper we present a benchmarking methodology for measuring a number of performance metrics for heterogeneous systems. Methods for comparing performance and energy efficiency are included. Consideration is given to further metrics, such as associated runnings costs and even carbon emissions. We give a case study for these metrics applied to BUDE, a molecular mechanics-based docking application that has been ported to OpenCL at the University of Bristol.<\/jats:p>","DOI":"10.1145\/1964218.1964233","type":"journal-article","created":{"date-parts":[[2011,4,1]],"date-time":"2011-04-01T15:54:25Z","timestamp":1301673265000},"page":"88-94","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":5,"title":["Energy-aware metrics for benchmarking heterogeneous systems"],"prefix":"10.1145","volume":"38","author":[{"given":"Simon","family":"McIntosh-Smith","sequence":"first","affiliation":[{"name":"University of Bristol, Woodland Road, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Terry","family":"Wilson","sequence":"additional","affiliation":[{"name":"University of Bristol, Woodland Road, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jon","family":"Crisp","sequence":"additional","affiliation":[{"name":"University of Bristol, Woodland Road, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amaurys \u00c1vila","family":"Ibarra","sequence":"additional","affiliation":[{"name":"University of Bristol, Woodland Road, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Richard B.","family":"Sessions","sequence":"additional","affiliation":[{"name":"University of Bristol, Woodland Road, Bristol, UK"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"320","published-online":{"date-parts":[[2011,3,29]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"http:\/\/www.ideasproject.info\/.  http:\/\/www.ideasproject.info\/."},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.20290"},{"volume-title":"University of Bristol","year":"2009","author":"Crisp J.","key":"e_1_2_1_3_1"},{"key":"e_1_2_1_4_1","unstructured":"Electronic Educational Devices. Watts up? Pro datasheet.  Electronic Educational Devices. Watts up? Pro datasheet."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPDS.2009.76"},{"key":"e_1_2_1_6_1","doi-asserted-by":"crossref","unstructured":"N. Gibbs A. R. Clarke and R. B. Sessions. Ab initio protein structure prediction using physicochemical potentials and a simplified off-lattice model. Proteins: Structure Function and Bioinformatics 43(2):186--202 2001.  N. Gibbs A. R. Clarke and R. B. Sessions. Ab initio protein structure prediction using physicochemical potentials and a simplified off-lattice model. Proteins: Structure Function and Bioinformatics 43(2):186--202 2001.","DOI":"10.1002\/1097-0134(20010501)43:2<186::AID-PROT1030>3.0.CO;2-L"},{"key":"e_1_2_1_7_1","unstructured":"M. Harris. http:\/\/gpgpu.org\/about 2002.  M. Harris. http:\/\/gpgpu.org\/about 2002."},{"key":"e_1_2_1_8_1","unstructured":"Khronos Group. OpenCL - the open standard for parallel programming of heterogeneous systems November 2010.  Khronos Group. OpenCL - the open standard for parallel programming of heterogeneous systems November 2010."},{"volume-title":"International Supercomputing","year":"2008","author":"McIntosh-Smith S.","key":"e_1_2_1_9_1"},{"key":"e_1_2_1_10_1","unstructured":"H. Meuer. http:\/\/www.top500.org\/.  H. Meuer. http:\/\/www.top500.org\/."},{"key":"e_1_2_1_11_1","article-title":"Cramming more components onto integrated circuits","author":"Moore G.","year":"1965","journal-title":"Electronics Magazine"},{"key":"e_1_2_1_12_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1009062107"},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1002\/bip.10219"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/1898699.1898827"},{"volume-title":"University of Bristol","year":"2005","author":"Smith S.","key":"e_1_2_1_15_1"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.20829"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1145\/1513895.1513898"},{"issue":"3","key":"e_1_2_1_18_1","article-title":"The free lunch is over: A fundamental turn toward concurrency in software","volume":"30","author":"Sutter H.","year":"2005","journal-title":"Dr. Dobb's Journal"},{"key":"e_1_2_1_19_1","unstructured":"H. Sutter. The free lunch is over online: http:\/\/www.gotw.ca\/publications\/concurrencyddj.htm August 2009.  H. Sutter. The free lunch is over online: http:\/\/www.gotw.ca\/publications\/concurrencyddj.htm August 2009."},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1002\/jcc.20291"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1021\/bi00507a030"}],"container-title":["ACM SIGMETRICS Performance Evaluation Review"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1964218.1964233","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/1964218.1964233","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T20:26:47Z","timestamp":1750278407000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/1964218.1964233"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,3,29]]},"references-count":21,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2011,3,29]]}},"alternative-id":["10.1145\/1964218.1964233"],"URL":"https:\/\/doi.org\/10.1145\/1964218.1964233","relation":{},"ISSN":["0163-5999"],"issn-type":[{"type":"print","value":"0163-5999"}],"subject":[],"published":{"date-parts":[[2011,3,29]]},"assertion":[{"value":"2011-03-29","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}