{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,5,1]],"date-time":"2026-05-01T23:03:00Z","timestamp":1777676580988,"version":"3.51.4"},"reference-count":51,"publisher":"SAGE Publications","issue":"3","license":[{"start":{"date-parts":[[1989,9,1]],"date-time":"1989-09-01T00:00:00Z","timestamp":620611200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of Supercomputing Applications"],"published-print":{"date-parts":[[1989,9]]},"abstract":"<jats:p>This report presents a methodology for measuring the performance of supercomputers. It includes 13 Fortran programs that total over 50,000 lines of source code. They represent applications in several areas of engi neering and scientific computing, and in many cases the codes are currently being used by computational re search and development groups. We also present the PERFECT Fortran standard, a set of guidelines that allow portability to several types of machines. Furthermore, we present some performance measures and a method ology for recording and sharing results among diverse users on different machines. The results presented in this paper should not be used to compare machines, except in a preliminary sense. Rather, they are presented to show how the methodology has been applied, and to encourage others to join us in this effort. The results should be regarded as the first step toward our objec tive, which is to develop a publicly accessible data base of performance information of this type.<\/jats:p>","DOI":"10.1177\/109434208900300302","type":"journal-article","created":{"date-parts":[[2007,3,18]],"date-time":"2007-03-18T01:39:00Z","timestamp":1174181940000},"page":"5-40","source":"Crossref","is-referenced-by-count":213,"title":["The Perfect Club Benchmarks: Effective Performance Evaluation of Supercomputers"],"prefix":"10.1177","volume":"3","author":[{"given":"M.","family":"Berry","sequence":"first","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Chen","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P.","family":"Koss","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Kuck","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S.","family":"Lo","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Y.","family":"Pang","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"L.","family":"Pointer","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R.","family":"Roloff","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"A.","family":"Sameh","sequence":"additional","affiliation":[{"name":"Center for Supercomputing Research and Development,\rUniversity of Illinois at Urbana-Champaign, Urbana, Illinois"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"E.","family":"Clementi","sequence":"additional","affiliation":[{"name":"IBM, Kingston, New York"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S.","family":"Chin","sequence":"additional","affiliation":[{"name":"IBM, Kingston, New York"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Schneider","sequence":"additional","affiliation":[{"name":"IBM, Kingston, New York"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"G.","family":"Fox","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, Califomia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"P.","family":"Messina","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, Califomia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"D.","family":"Walker","sequence":"additional","affiliation":[{"name":"California Institute of Technology, Pasadena, Califomia"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C.","family":"Hsiung","sequence":"additional","affiliation":[{"name":"Cray Research, Inc., Chippewa Falls, Wisconsin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Schwarzmeier","sequence":"additional","affiliation":[{"name":"Cray Research, Inc., Chippewa Falls, Wisconsin"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"K.","family":"Lue","sequence":"additional","affiliation":[{"name":"Princeton University, Princeton, New Jersey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"S.","family":"Orszag","sequence":"additional","affiliation":[{"name":"Princeton University, Princeton, New Jersey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"F.","family":"Seidl","sequence":"additional","affiliation":[{"name":"Princeton University, Princeton, New Jersey"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"O.","family":"Johnson","sequence":"additional","affiliation":[{"name":"University of Houston and Houston Area Research Center\r(HARC)"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"R.","family":"Goodrum","sequence":"additional","affiliation":[{"name":"HNSX Supercomputers, Inc., Houston, Texas"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"J.","family":"Martin","sequence":"additional","affiliation":[{"name":"IBM T. J. Watson Research Center, Yorktown Heights,\rNew York"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[1989,9,1]]},"reference":[{"key":"atypb1","volume-title":"The UCLA Atmospheric Circulation Model","author":"Arakawa, A.","year":"1974"},{"key":"atypb2","volume":"86711","author":"Bailey, D.","year":"1985","journal-title":"NASA Technical Memorandum"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1063\/1.438069"},{"key":"atypb4","volume-title":"An implicit finite","author":"Beam, R.","year":"1976"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1016\/0021-9991(76)90110-8"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0493(1974)102<0687:AMLSMI>2.0.CO;2"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1016\/0370-2693(82)90696-7"},{"key":"atypb8","volume-title":"Hydrodynamic mesoscale modeling of atmospheric transport and pollutant deposition in the vicinity of a lake. Ph.D. thesis, Atmospheric and Oceanic Science Department","author":"Christidis, Z.","year":"1986"},{"key":"atypb9","volume-title":"Parallel implementation of a pseudo-spectral method on a loosely coupled array of processors. Technical Report KGN-143","author":"Christidis, Z.","year":"1987"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1017\/S0022112084001968"},{"key":"atypb11","unstructured":"Denning, J., and Adams, G. 1988. Research questions for performance analysis of supercomputers . In Performance evaluation of supercomputers , edited by J. Martin. Amsterdam: North-Holland, p. 403."},{"key":"atypb12","volume-title":"Performance of various computers using standard linear equations software in a Fortran environment. Technical Report MCS-RM-23","author":"Dongarra, J.","year":"1987"},{"key":"atypb13","volume":"38","author":"Dongarra, J.","year":"1987","journal-title":"IEEE Spectrum"},{"issue":"2","key":"atypb14","volume":"8","author":"Dupuis, M.","year":"1988","journal-title":"Quantum Chemistry Program Exchange Bulletin"},{"key":"atypb15","volume-title":"On a numerical method for integration of the hydrodynamic equations with a spectral representation of the horizontal fields. Report No. 2","author":"Eliasen, E.","year":"1970"},{"key":"atypb16","volume-title":"Hough functions. Technical Report 20","author":"Flattery, T.","year":"1967"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1137\/0908086"},{"key":"atypb18","volume-title":"Numerical initial value problems in ordinary differential equations","author":"Gear, C.","year":"1971"},{"key":"atypb19","volume-title":"Presented at the third conf. on hypercube concurrent computers and applications","author":"Gottschalk, T."},{"key":"atypb20","volume-title":"Presented at the third conf. on hypercube concurrent computers and applications","author":"Gottschalk, T."},{"key":"atypb21","volume-title":"An agenda for improved evaluation of supercomputer performance","author":"Infante, E. (Committee Chairman).","year":"1986"},{"key":"atypb22","first-page":"327","volume":"13","author":"Jameson, A.","year":"1983","journal-title":"Appl. Math. Comput."},{"key":"atypb23","unstructured":"Jamieson, L. 1988. Using algorithm characteristics to evaluate parallel architectures . In Performance evaluation of supercomputers , edited by J. Martin. Amsterdam: North-Holland, p. 21."},{"key":"atypb24","volume-title":"Presented at the first internal, conf. on supercomputing","author":"Kuck, D."},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0469(1965)022<0040:OFAIOT>2.0.CO;2"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevA.33.2679"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0469(1963)020<0130:DNF>2.0.CO;2"},{"key":"atypb28","volume-title":"Supercomputer performance: the theory, practice, and results. Technical Report LA-11204-MS. Los Alamos, N.M","author":"Lubeck, O.","year":"1988"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1109\/MC.1985.1662769"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1007\/BF00138607"},{"key":"atypb31","first-page":"9","volume":"21","author":"Martin, J.","year":"1988","journal-title":"IEEE Comput."},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1063\/1.432402"},{"key":"atypb33","unstructured":"McMahon, F. 1988. The Livermore Fortran kernels test of the numerical performance range. In Performance evaluation of supercomputers , edited by J. Martin. Amsterdam : North-Holland, p. 143."},{"key":"atypb34","volume-title":"Performance comparisons among several parallel and vector computers on a set of fluid flow problems","author":"Mueller-Wichards, D.","year":"1982"},{"key":"atypb35","volume-title":"SPICE2: a computer program to simulate semiconductor circuits","author":"Nagel, L.","year":"1975"},{"key":"atypb36","volume-title":"Proceedings of the second internat. conf. on supercomputing","author":"Neves, K."},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1109\/T-ED.1983.21275"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1016\/0045-7825(76)90035-9"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1108\/eb023626"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0469(1970)027<0890:TMFTCO>2.0.CO;2"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1002\/sapm1971504293"},{"key":"atypb42","volume-title":"Lattice gauge theory benchmarks. Report C3P-405R","author":"Otto, S.","year":"1987"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.2514\/3.50745"},{"key":"atypb44","doi-asserted-by":"crossref","unstructured":"Pulliam, T., and Steger, J. 1985. Recent improvements in efficiency, accuracy, and convergence for implicit approximate factorization algorithms. AIAA-85-0360. Presented at the 23rd aerospace science meeting, January 14\u201417, Reno, Nevada.","DOI":"10.2514\/6.1985-360"},{"key":"atypb45","author":"Reshef, M.","year":"1989","journal-title":"Geophysics"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1175\/1520-0493(1980)108<1279:SMATNM>2.0.CO;2"},{"key":"atypb47","author":"Sela, J.","year":"1982","journal-title":"Administration"},{"key":"atypb48","volume-title":"BIOMOL\u2014a molecular dynamics simulation package for nucleic add hydration","author":"Swamy, K.","year":"1987"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1002\/bip.360261106"},{"key":"atypb50","volume-title":"On benchmarks: dynamically improving experimental comparisons. Computer Sciences Technical Report No. 571","author":"Uhr, L.","year":"1984"},{"key":"atypb51","volume-title":"Towards efficient parallel computation of correlated wave functions. Implementation of the two-electron integral transformation on the LCAP parallel supercomputer. Technical Report KGN-100","author":"Watts, J.","year":"1987"}],"container-title":["The International Journal of Supercomputing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/109434208900300302","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/109434208900300302","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T08:19:30Z","timestamp":1777450770000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/109434208900300302"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[1989,9]]},"references-count":51,"journal-issue":{"issue":"3","published-print":{"date-parts":[[1989,9]]}},"alternative-id":["10.1177\/109434208900300302"],"URL":"https:\/\/doi.org\/10.1177\/109434208900300302","relation":{},"ISSN":["0890-2720"],"issn-type":[{"value":"0890-2720","type":"print"}],"subject":[],"published":{"date-parts":[[1989,9]]}}}