{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T18:10:19Z","timestamp":1738001419856,"version":"3.33.0"},"reference-count":33,"publisher":"SAGE Publications","issue":"1","license":[{"start":{"date-parts":[[2008,2,1]],"date-time":"2008-02-01T00:00:00Z","timestamp":1201824000000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["The International Journal of High Performance Computing Applications"],"published-print":{"date-parts":[[2008,2]]},"abstract":"<jats:p> BlueGene\/L (BG\/L), developed through a partnership between IBM and Lawrence Livermore National Laboratory (LLNL), is currently the world's largest system both in terms of scale, with 131,072 processors, and absolute performance, with a peak rate of 367 Tflop\/s. BG\/L has led the last four Top500 lists with a Linpack rate of 280.6 Tflop\/s for the full machine installed at LLNL and is expected to remain the fastest computer in the next few editions. However, the real value of a machine such as BG\/L derives from the scientific breakthroughs that real applications can produce by successfully using its unprecedented scale and computational power. In this paper, we describe our experiences with eight large scale applications on BG\/ L from several application domains, ranging from molecular dynamics to dislocation dynamics and turbulence simulations to searches in semantic graphs. We also discuss the challenges we faced when scaling these codes and present several successful optimization techniques. All applications show excellent scaling behavior, even at very large processor counts, with one code even achieving a sustained performance of more than 100 Tflop\/s, clearly demonstrating the real success of the BG\/L design. <\/jats:p>","DOI":"10.1177\/1094342007085025","type":"journal-article","created":{"date-parts":[[2008,2,4]],"date-time":"2008-02-04T16:12:20Z","timestamp":1202141540000},"page":"33-51","source":"Crossref","is-referenced-by-count":3,"title":["BlueGene\/L applications: Parallelism On a Massive Scale"],"prefix":"10.1177","volume":"22","author":[{"given":"Bronis R.","family":"de Supinski","sequence":"first","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA,"}]},{"given":"Martin","family":"Schulz","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Vasily V.","family":"Bulatov","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"William","family":"Cabot","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Bor","family":"Chan","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Andrew W.","family":"Cook","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Erik W.","family":"Draeger","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"James N.","family":"Glosli","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Jeffrey A.","family":"Greenough","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Keith","family":"Henderson","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Alison","family":"Kubota","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Steve","family":"Louis","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Brian J.","family":"Miller","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Mehul V.","family":"Patel","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Thomas E.","family":"Spelce","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Frederick H.","family":"Streitz","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Peter L.","family":"Williams","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Robert K.","family":"Yates","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"Andy","family":"Yoo","sequence":"additional","affiliation":[{"name":"LAWRENCE LIVERMORE NATIONAL LABORATORY, LIVERMORE, CA 94551, USA"}]},{"given":"George","family":"Almasi","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"Gyan","family":"Bhanot","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"Alan","family":"Gara","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"John A.","family":"Gunnels","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"Manish","family":"Gupta","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"Jose","family":"Moreira","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"James","family":"Sexton","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"Bob","family":"Walkup","sequence":"additional","affiliation":[{"name":"IBM THOMAS J. WATSON RESEARCH CENTER"}]},{"given":"Charles","family":"Archer","sequence":"additional","affiliation":[{"name":"IBM SYSTEMS AND TECHNOLOGY GROUP"}]},{"given":"Francois","family":"Gygi","sequence":"additional","affiliation":[{"name":"UNIVERSITY OF CALIFORNIA, DAVIS"}]},{"given":"Timothy C.","family":"Germann","sequence":"additional","affiliation":[{"name":"LOS ALAMOS NATIONAL LABORATORY"}]},{"given":"Kai","family":"Kadau","sequence":"additional","affiliation":[{"name":"LOS ALAMOS NATIONAL LABORATORY"}]},{"given":"Peter S.","family":"Lomdahl","sequence":"additional","affiliation":[{"name":"LOS ALAMOS NATIONAL LABORATORY"}]},{"given":"Charles","family":"Rendleman","sequence":"additional","affiliation":[{"name":"LAWRENCE BERKELEY NATIONAL LABORATORY"}]},{"given":"Michael L.","family":"Welcome","sequence":"additional","affiliation":[{"name":"LAWRENCE BERKELEY NATIONAL LABORATORY"}]},{"given":"William","family":"McLendon","sequence":"additional","affiliation":[{"name":"SANDIA NATIONAL LABORATORIES"}]},{"given":"Bruce","family":"Hendrickson","sequence":"additional","affiliation":[{"name":"SANDIA NATIONAL LABORATORIES"}]},{"given":"Franz","family":"Franchetti","sequence":"additional","affiliation":[{"name":"CARNEGIE MELLON UNIVERSITY"}]},{"given":"Stefan","family":"Kral","sequence":"additional","affiliation":[{"name":"VIENNA UNIVERSITY OF TECHNOLOGY"}]},{"given":"J\u00fcrgen","family":"Lorenz","sequence":"additional","affiliation":[{"name":"VIENNA UNIVERSITY OF TECHNOLOGY"}]},{"given":"Christoph W.","family":"\u00dcberhuber","sequence":"additional","affiliation":[{"name":"VIENNA UNIVERSITY OF TECHNOLOGY"}]},{"given":"Edmond","family":"Chow","sequence":"additional","affiliation":[{"name":"D. E. SHAW RESEARCH AND DEVELOPMENT"}]},{"given":"\u00dcmit","family":"\u00c7ataly\u00fcrek","sequence":"additional","affiliation":[{"name":"OHIO STATE UNIVERSITY"}]}],"member":"179","published-online":{"date-parts":[[2008,2,1]]},"reference":[{"volume-title":"Proceedings of IEEE\/ACM Supercomputing '02, November","author":"Adiga, N.","key":"atypb1"},{"volume-title":"Proceedings of the 2004 International Conference on Parallel Architectures and Compilation Techniques, September","author":"Bachega, L.","key":"atypb2"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898719642"},{"volume-title":"Proceedings of IEEE\/ACM Supercomputing '04, November","author":"Bulatov, V.","key":"atypb4"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.55.2471"},{"volume-title":"Center for Computational Sciences and Engineering","author":"Ccse-Lbnl","key":"atypb6"},{"volume-title":"Proceedings of IEEE\/ACM Supercomputing","author":"Cook, A.","key":"atypb7"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1007\/BFb0055823"},{"volume-title":"Proceedings of IEEE\/ACM Supercomputing '04, November","author":"Davis, K.","key":"atypb9"},{"volume-title":"Presented at Blue Gene\/L: Applications, Architecture and Software Workshop","author":"DelSignore, J.","key":"atypb10"},{"issue":"2","key":"atypb11","doi-asserted-by":"crossref","first-page":"409","DOI":"10.1109\/JPROC.2004.840491","volume":"92","author":"Franchetti, F.","year":"2005","journal-title":"Proceedings of the IEEE: Special Issue on Program Generation, Optimization, and Adaptation"},{"volume-title":"Proceedings of ICASSP","author":"Frigo, M.","key":"atypb12"},{"volume-title":"Proceedings of IEEE\/ACM Supercomputing","author":"Germann, T.","key":"atypb13"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1287\/ijoc.7.4.365"},{"volume-title":"phPerformance of a block structured, hierarchical adaptive mesh refinement code on the 64K Node IBM BlueGene\/L computer, Technical Report LBNL-57500","year":"2005","author":"Greenough, J.","key":"atypb15"},{"volume-title":"phQbox: a large-scale parallel implementation of first-principles molecular dynamics, LLNL preprint","year":"2005","author":"Gygi, F.","key":"atypb16"},{"volume-title":"Proceedings of IEEE\/ACM Supercomputing '05, November","author":"Gygi, F.","key":"atypb17"},{"volume-title":"ACM Symposium on Parallel Algorithms and Architectures","author":"Han, Y.","key":"atypb18"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1006\/jagm.1997.0888"},{"volume-title":"SLURM: Simple Linux Utility for Resource Management","year":"2005","author":"Llnl","key":"atypb20"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1147\/rd.492.0437"},{"key":"atypb22","doi-asserted-by":"crossref","unstructured":"Moriarty, J.\n                 (1990). Physics Review B, 42:\n            1609.","DOI":"10.1103\/PhysRevB.42.1609"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.49.12431"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1088\/0953-8984\/14\/11\/305"},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1016\/S0038-1098(96)00723-5"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1007\/PL00013544"},{"volume-title":"Proceedings of the Workshop on Binary Instrumentation and Applications","author":"Schulz, M.","key":"atypb27"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevB.57.10340"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1103\/PhysRevLett.96.225701"},{"volume-title":"Proceedings of IEEE\/ACM Supercomputing '05, November","author":"Streitz, F.","key":"atypb30"},{"volume-title":"TOP500 Supercomputing Sites","author":"University of Mannheim, University of Tennessee, and NERSC\/LBNL","key":"atypb31"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1002\/cpe.892"},{"volume-title":"Proceedings of IEEE\/ACM Supercomputing '05, November","author":"Yoo, A.","key":"atypb33"}],"container-title":["The International Journal of High Performance Computing Applications"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342007085025","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1094342007085025","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,1,27]],"date-time":"2025-01-27T17:43:19Z","timestamp":1737999799000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1094342007085025"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,2]]},"references-count":33,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2008,2]]}},"alternative-id":["10.1177\/1094342007085025"],"URL":"https:\/\/doi.org\/10.1177\/1094342007085025","relation":{},"ISSN":["1094-3420","1741-2846"],"issn-type":[{"type":"print","value":"1094-3420"},{"type":"electronic","value":"1741-2846"}],"subject":[],"published":{"date-parts":[[2008,2]]}}}