{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,2]],"date-time":"2026-10-02T21:17:45Z","timestamp":1790975865708,"version":"4.1.0"},"reference-count":46,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"5","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2006,1]]},"abstract":"<jats:p>The increasing gap between processor performance and memory access time warrants the re-examination of data movement in iterative linear solver algorithms. For this reason, we explore and establish the feasibility of modifying a standard iterative linear solver algorithm in a manner that reduces the movement of data through memory. In particular, we present an alternative to the restarted GMRES algorithm for solving a single right-hand side linear system $Ax=b$ based on solving the block linear system $AX=B$. Algorithm performance, i.e., time to solution, is improved by using the matrix A in operations on groups of vectors. Experimental results demonstrate the importance of implementation choices on data movement as well as the effectiveness of the new method on a variety of problems from different application areas.<\/jats:p>","DOI":"10.1137\/040608088","type":"journal-article","created":{"date-parts":[[2006,2,4]],"date-time":"2006-02-04T21:00:21Z","timestamp":1139086821000},"page":"1608-1626","source":"Crossref","is-referenced-by-count":46,"title":["On Improving Linear Solver Performance: A Block Variant of GMRES"],"prefix":"10.1137","volume":"27","author":[{"given":"A. H.","family":"Baker","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J. M.","family":"Dennis","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"E. R.","family":"Jessup","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2006,7,26]]},"reference":[{"key":"R1","unstructured":"W. K. Anderson, W. D. Gropp, D. K. Kaushik, D. E. Keyes, and B. F. Smith,\n                      Achieving high sustained performance in an unstructured mesh CFD application\n                      , in Proceedings of Supercomputing \u201999, 1999."},{"key":"R1","unstructured":"Also published as Mathematics and Computer Science Division, Argonne National Laboratory, Technical Report ANL\/MCS\u2010P776\u20100899."},{"key":"R2","doi-asserted-by":"publisher","DOI":"10.1137\/0727091"},{"key":"R3","unstructured":"A. H. Baker,\n                      On Improving the Performance of the Linear Solver Restarted GMRES\n                      , Ph.D. thesis, University of Colorado, Boulder, CO, 2003."},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479803422014"},{"key":"R5","unstructured":"S. Balay, K. Buschelman, W. D. Gropp, D. Kaushik, M. Knepley, L. C. McInnes, B. F. Smith, and H. Zhang,\n                      PETSc Users Manual\n                      , Tech. Report ANL\u201095\/11\u2014Revision 2.1.5, Mathematics and Computer Science Division, Argonne National Laboratory, Argonne, IL, 2003."},{"key":"R6","unstructured":"S. Balay, K. Buschelman, W. D. Gropp, D. Kaushik, L. C. McInnes, and B. F. Smith,\n                      PETSc Home Page\n                      , http:\/\/www.mcs.anl.gov\/petsc (2001)."},{"key":"R7","unstructured":"S. Behling, R. Bell, P. Farrell, H. Holthoff, F. O\u2019Connell, and W. Weir,\n                      The POWER 4 Processor Introduction and Tuning Guide\n                      , IBM Redbooks, 2001."},{"key":"R8","unstructured":"S. Carr and K. Kennedy,\n                      Blocking linear algebra codes for memory hierarchies\n                      , in Proceedings of the Fourth SIAM Conference on Parallel Processing for Scientific Computing, J. Dongarra, P. Messina, D. C. Sorensen, and R. G. Voigt, eds., SIAM, 1990, pp. 400\u2013405."},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1099-1506(199701\/02)4:1<43::AID-NLA99>3.3.CO;2-Q"},{"key":"R10","unstructured":"E. H. Cuthill and J. McKee,\n                      Reducing the bandwidth of sparse symmetric matrices\n                      , in Proceedings 24th Nat. Conf. Assoc. Comp. Mach., ACM Publications, New York, 1969, pp. 157\u2013172."},{"key":"R11","unstructured":"T. Davis,\n                      University of Florida Sparse Matrix Collection\n                      , http:\/\/ www.cise.ufl.edu\/ research\/ sparse\/ matrices (2002)."},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1137\/S0036142997315950"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1002\/nla.1680020208"},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.1145\/77626.79170"},{"key":"R15","unstructured":"J. Dongarra and V. Eijkhout,\n                      Self\u2010Adapting Numerical Software for Next Generation Applications\n                      , Tech. Report ICU\u2010UT\u201002\u201007, LAPACK Working Note 157, 2002."},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1016\/0377-0427(89)90367-1"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.1016\/S0377-0427(00)00398-8"},{"key":"R18","unstructured":"B. B. Fraguela, R. Doalla, and E. L. Zapata,\n                      Cache misses prediction for high performance sparse algorithms\n                      , in Proceedings of the Fourth International Euro\u2010Par Conference (Euro\u2010Par \u201998), 1998, pp. 224\u2013233. Also published as University of Malaga, Department of Computer Architecture, Technical Report UNMA\u2010DAC\u201098\/22."},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1177\/109434208800200103"},{"key":"R20","unstructured":"W. D. Gropp, D. K. Kaushik, D. E. Keyes, and B. F. Smith,\n                      Toward realistic performance bounds for implicit CFD codes\n                      , in Proceedings of Parallel CFD\u201999, D. Keyes, A. Ecer, J. Periaux, N. Satofuka, and P. Fox, eds., Elsevier, New York, 1999, pp. 233\u2013240."},{"key":"R21","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(00)00075-2"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1016\/S0096-3003(99)00294-5"},{"key":"R23","unstructured":"M. S. Lam, E. E. Rothberg, and M. E. Wolf,\n                      The cache performance and optimizations of blocked algorithms\n                      , in Proceedings of the Fourth International Conference on Architectural Support for Programming Languages and Operating Systems, 1991."},{"key":"R24","unstructured":"B. C. Lee, R. W. Vuduc, J. W. Demmel, K. A. Yelick, M. de Lorimier, and L. Zhong,\n                      Performance Optimizations and Bounds for Sparse Symmetric Matrix\u2010Multiple Vector Multiply\n                      , Tech. Report UCB\u2010CSD\u201003\u20101297, Computer Science Division, University of California, Berkeley, 2003."},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.1016\/S0167-8191(97)00004-5"},{"key":"R26","unstructured":"J. D. McCalpin,\n                      Memory bandwidth and machine balance in current high performance computers\n                      , IEEE Computer Society Technical Committee on Computer Architecture Newsletter, (1995)."},{"key":"R27","unstructured":"J. D. McCalpin,\n                      STREAM: Sustainable Memory Bandwidth in High Performance Computers\n                      , http:\/\/ www.cs.virginia.edu\/ stream (2003)."},{"key":"R28","unstructured":"S. McKee and W. Wulf,\n                      Access order and memory\u2010conscious cache utilization\n                      , in First Symposium on High Performance Computer Architecture (HPCA1), Raleigh, NC, 1995."},{"key":"R29","unstructured":"R. Morgan,\n                      GMRES with deflated restarting and multiple right\u2010hand sides\n                      , presentation at the Seventh Copper Mountain Conference on Iterative Methods, 2002."},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479893253975"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827599364659"},{"key":"R32","unstructured":"S. Naffziger and G. Hammond,\n                      The implementation of the next generation 64b Itanium microprocessor\n                      , in Proceedings of the IEEE International Solid\u2010State Circuits Conference, Vol. 2, 2002, pp. 276\u2013504."},{"key":"R33","unstructured":"National Institute of Standards and Technology, Mathematical and Computational Sciences Division,\n                      Matrix Market\n                      , http:\/\/math.nist.gov\/MatrixMarket (2002)."},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.1016\/0024-3795(80)90247-5"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.1109\/40.592312"},{"key":"R36","unstructured":"A. Pinar and M. T. Heath,\n                      Improving performance of sparse matrix\u2010vector multiplication\n                      , in Proceedings of Supercomputing \u201999, 1999."},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898718003"},{"key":"R38","doi-asserted-by":"publisher","DOI":"10.1137\/0907058"},{"key":"R39","doi-asserted-by":"publisher","DOI":"10.1137\/0916053"},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.1016\/0024-3795(95)00093-3"},{"key":"R41","doi-asserted-by":"publisher","DOI":"10.1147\/rd.416.0711"},{"key":"R42","doi-asserted-by":"publisher","DOI":"10.1002\/nla.1680010404"},{"key":"R43","unstructured":"B. Vital,\n                      Etude de quelques m\u00e9thodes de r\u00e9solution de probl\u00e8mes lin\u00e9aires de grande taille sur multi\u2010processeur\n                      , Ph.D. thesis, Universit\u00e9 de Rennes I, Rennes, France, 1990."},{"key":"R44","unstructured":"R. Vuduc, J. Demmel, K. A. Yelick, S. Kamil, R. Nishtala, and B. Lee,\n                      Performance optimizations and bounds for sparse matrix\u2010vector multiply\n                      , in Proceedings of Supercomputing \u201902, Baltimore, MD, 2002."},{"key":"R45","unstructured":"W. A. Wulf and S. A. McKee,\n                      Hitting the Wall: Implications of the Obvious\n                      Tech. Report CS\u201094\u201048, University of Virginia, Charlottesville, VA, 1994."}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/040608088","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T17:49:39Z","timestamp":1787334579000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/040608088"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2006,1]]},"references-count":46,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2006,1]]}},"alternative-id":["10.1137\/040608088"],"URL":"https:\/\/doi.org\/10.1137\/040608088","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2006,1]]}}}