{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,3]],"date-time":"2026-10-03T20:15:32Z","timestamp":1791058532792,"version":"4.1.0"},"reference-count":41,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"2","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2005,1]]},"abstract":"<jats:p>Large-scale optimization of systems governed by partial differential equations (PDEs) is a frontier problem in scientific computation. Reduced quasi-Newton sequential quadratic programming (SQP) methods are state-of-the-art approaches for such problems. These methods take full advantage of existing PDE solver technology and parallelize well. However, their algorithmic scalability is questionable; for certain problem classes they can be very slow to converge. In this two-part article we propose a new method for steady-state PDE-constrained optimization, based on the idea of using a full space Newton solver combined with an approximate reduced space quasi-Newton SQP preconditioner. The basic components of the method are Newton solution of the first-order optimality conditions that characterize stationarity of the Lagrangian function; Krylov solution of the Karush--Kuhn--Tucker (KKT) linear systems arising at each Newton iteration using a symmetric quasi-minimum residual method; preconditioning of the KKT system using an approximate state\/decision variable decomposition that replaces the forward PDE Jacobians by their own preconditioners, and the decision space Schur complement (the reduced Hessian) by a BFGS approximation initialized by a two-step stationary method. Accordingly, we term the new method {\\it Lagrange--Newton--Krylov--Schur} (LNKS). It is fully parallelizable, exploits the structure of available parallel algorithms for the PDE forward problem, and is locally quadratically convergent. In part I of this two-part article, we investigate the effectiveness of the KKT linear system solver. We test our method on two optimal control problems in which the state constraints are described by the steady-state Stokes equations. The objective is to minimize dissipation or the deviation from a given velocity field; the control variables are the boundary velocities. Numerical experiments on up to 256 Cray T3E processors and on an SGI Origin 2000 include scalability and performance assessment of the LNKS algorithm and comparisons with reduced SQP for up to $1,000,000$ state and50,000 decision variables. In part II of the article, we address globalization and inexactness issues, and apply LNKS to the optimal control of the steady incompressible Navier--Stokes equations.<\/jats:p>","DOI":"10.1137\/s106482750241565x","type":"journal-article","created":{"date-parts":[[2005,11,21]],"date-time":"2005-11-21T21:00:27Z","timestamp":1132606827000},"page":"687-713","source":"Crossref","is-referenced-by-count":200,"title":["Parallel Lagrange--Newton--Krylov--Schur Methods for PDE-Constrained Optimization. Part I: The Krylov--Schur Solver"],"prefix":"10.1137","volume":"27","author":[{"given":"George","family":"Biros","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omar","family":"Ghattas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2006,7,25]]},"reference":[{"key":"R1","doi-asserted-by":"publisher","DOI":"10.1137\/0723011"},{"key":"R2","unstructured":"E. Arian and S. Ta\u2019asan,\n                      Analysis of the Hessian for Aerodynamic Optimization\n                      , Technical report 96\u201028, Institute for Computer Applications in Science and Engineering, Hampton, VA, 1996."},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511624100"},{"key":"R4","unstructured":"S. Balay, K. Buschelman, W. D. Gropp, D. Kaushik, L. C. McInnes, and B. F. Smith,\n                      PETSc home page\n                      , http:\/\/www.mcs.anl.gov\/petsc (2001)."},{"key":"R5","doi-asserted-by":"crossref","unstructured":"S. Balay, W. D. Gropp, L. C. McInnes, and B. F. Smith,\n                      Efficient management of parallelism in object oriented numerical software libraries\n                      , in Modern Software Tools in Scientific Computing, E. Arge, A. M. Bruaset, and H. P. Langtangen, eds., Birkh\u00e4user, Boston, 1997, pp. 163\u2013202.","DOI":"10.1007\/978-1-4612-1986-6_8"},{"key":"R6","unstructured":"S. Balay, W. D. Gropp, L. C. McInnes, and B. F. Smith,\n                      PETSc Users Manual\n                      , Technical report ANL\u201095\/11, Revision 2.1.1, Argonne National Laboratory, Argonne, IL, 2001."},{"key":"R7","doi-asserted-by":"crossref","unstructured":"A. Battermann, M. Heinkenschloss, Preconditioners for Karush\u2010Kuhn\u2010Tucker matrices arising in the optimal control of distributed systems, Internat. Ser. Numer. Math., Vol. 126, Birkh\u00e4user, Basel, 1998, 15\u20133299e:49042","DOI":"10.1007\/978-3-0348-8849-3_2"},{"key":"R8","doi-asserted-by":"publisher","DOI":"10.1137\/0805017"},{"key":"R9","doi-asserted-by":"crossref","unstructured":"G. Biros and O. Ghattas,\n                      Parallel Newton\u2010Krylov algorithms for PDE\u2010constrained optimization\n                      , in Proceedings of SC99, The SCxy Conference Series, Portland, OR, 1999, ACM\/IEEE.","DOI":"10.1145\/331532.331560"},{"key":"R10","doi-asserted-by":"crossref","unstructured":"G. Biros and O. Ghattas,\n                      Parallel preconditioners for KKT systems arising in optimal control of viscous incompressible flows\n                      , in Parallel Computational Fluid Dynamics 1999, D. E. Keyes, A. Ecer, J. Periaux, and N. Satofuka, eds., North\u2013Holland, Amsterdam, 1999.","DOI":"10.1016\/B978-044482851-4\/50017-7"},{"key":"R11","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827502415661"},{"key":"R12","doi-asserted-by":"publisher","DOI":"10.1007\/BF01588794"},{"key":"R13","doi-asserted-by":"publisher","DOI":"10.1137\/0913013"},{"key":"R14","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827595281575"},{"key":"R15","unstructured":"J. E. Dennis and R. M. Lewis,\n                      A Comparison of Nonlinear Programming Approaches to an Elliptic Inverse Problem and a New Domain Decomposition Approach\n                      , Technical report TR\u20109433, Department of Computational and Applied Mathematics, Rice University, Houston, TX, 1994."},{"key":"R16","unstructured":"C. Farhat, R. Tezaur, and R. Djellouli,\n                      On the Solution of Three Dimensional Inverse Obstacle Scattering Problems by a Regularized Newton Method\n                      , Technical report CU\u2010CAS\u201001\u201011, Center for Aerospace Structures, University of Colorado, Boulder, CO, 2001."},{"key":"R17","volume-title":"Practical methods of optimization","author":"Fletcher R.","year":"1987"},{"key":"R18","doi-asserted-by":"publisher","DOI":"10.1137\/0915022"},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1006\/jcph.1997.5744"},{"key":"R20","unstructured":"Omar Ghattas, Carlos Orozco, A parallel reduced Hessian SQP method for shape optimization, SIAM, Philadelphia, PA, 1997, 133\u2013152MR1438318"},{"key":"R21","volume-title":"Matrix computations","author":"Golub Gene","year":"1996"},{"key":"R22","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611970937"},{"key":"R23","volume-title":"Finite element methods for viscous incompressible flows","author":"Gunzburger Max","year":"1989"},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/17\/6\/319"},{"key":"R25","unstructured":"D. Keyes, How scalable is domain decomposition in practice? DDM.org, Augsburg, 1999, 286\u2013297MR1827428"},{"key":"R26","doi-asserted-by":"publisher","DOI":"10.1137\/0908020"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1137\/0729100"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.1137\/0729100"},{"key":"R29","unstructured":"I. Mal\u010devi\u0107,\n                      Large\u2010Scale Unstructured Mesh Shape Optimization on Parallel Computers\n                      , Master\u2019s thesis, Carnegie Mellon University, Pittsburgh, PA, 1997."},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1137\/S1052623497327854"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1137\/S0895479893245371"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.1007\/b98874"},{"key":"R33","doi-asserted-by":"publisher","DOI":"10.1016\/0956-0521(92)90116-Z"},{"key":"R34","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1097-0207(19970815)40:15<2759::AID-NME188>3.0.CO;2-T"},{"key":"R35","doi-asserted-by":"publisher","DOI":"10.1016\/S0045-7930(98)00050-4"},{"key":"R36","unstructured":"U. Ringertz,\n                      Optimal Design of Nonlinear Shell Structures\n                      , Technical report FFA TN 91\u201018, The Aeronautical Research Institute of Sweden, 1991."},{"key":"R37","doi-asserted-by":"publisher","DOI":"10.1002\/nme.1620380209"},{"key":"R38","unstructured":"Y. Saad,\n                      Iterative Methods for Sparse Linear Systems\n                      , PWS, Boston, 1996."},{"key":"R39","unstructured":"A. Salinger, R. Pawlowski, J. Shadid, B. van Bloemen Waanders, R. Barlett, G. Itle, and L. Biegler,\n                      RSQP optimization of large\u2010scale reacting flow applications with MPSalsa\n                      , in Proceedings of First Sandia Workshop on PDE\u2010Constrained Optimization, Santa Fe, NM, 2001."},{"key":"R40","doi-asserted-by":"publisher","DOI":"10.1007\/s007910050008"},{"key":"R41","doi-asserted-by":"crossref","unstructured":"Volker Schulz, Hans Bock, Partially reduced SQP methods for large\u2010scale nonlinear optimization problems, Proceedings of the Second World Congress of Nonlinear Analysts, Part 8 (Athens, 1996), Vol. 30, 1997, 4723\u20134734MR1725335","DOI":"10.1016\/S0362-546X(97)00198-3"}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/S106482750241565X","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T17:51:20Z","timestamp":1787334680000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/S106482750241565X"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2005,1]]},"references-count":41,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2005,1]]}},"alternative-id":["10.1137\/S106482750241565X"],"URL":"https:\/\/doi.org\/10.1137\/s106482750241565x","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2005,1]]}}}