{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T19:23:47Z","timestamp":1787340227443,"version":"build-2736575974"},"reference-count":91,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"4","funder":[{"DOI":"10.13039\/100000121","name":"Division of Mathematical Sciences","doi-asserted-by":"publisher","award":["DMS-2012453"],"award-info":[{"award-number":["DMS-2012453"]}],"id":[{"id":"10.13039\/100000121","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000893","name":"Simons Foundation","doi-asserted-by":"publisher","award":["560651"],"award-info":[{"award-number":["560651"]}],"id":[{"id":"10.13039\/100000893","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"U.S. Department of Energy","doi-asserted-by":"publisher","award":["DE-SC0019303"],"award-info":[{"award-number":["DE-SC0019303"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM\/ASA J. Uncertainty Quantification"],"published-print":{"date-parts":[[2021,1]]},"abstract":"<jats:p>We propose a fast and scalable optimization method to solve chance or probabilistic constrained optimization problems governed by partial differential equations (PDEs) with high-dimensional random parameters. To address the critical computational challenges of expensive PDE solution and high-dimensional uncertainty, we construct surrogates of the constraint function by Taylor approximation, which relies on efficient computation of the derivatives, low-rank approximation of the Hessian, and a randomized algorithm for eigenvalue decomposition. To tackle the difficulty of the nondifferentiability of the inequality chance constraint, we use a smooth approximation of the discontinuous indicator function involved in the chance constraint, and we apply a penalty method to transform the inequality constrained optimization problem to an unconstrained one. Moreover, we design a gradient-based optimization scheme that gradually increases smoothing and penalty parameters to achieve convergence, for which we present an efficient computation of the gradient of the approximate cost functional by the Taylor approximation. Based on numerical experiments for a problem in optimal groundwater management, we demonstrate the accuracy of the Taylor approximation, its ability to greatly accelerate constraint evaluations, the convergence of the continuation optimization scheme, and the scalability of the proposed method in terms of the number of PDE solves with increasing random parameter dimension from one thousand to hundreds of thousands.<\/jats:p>","DOI":"10.1137\/20m1381381","type":"journal-article","created":{"date-parts":[[2021,10,4]],"date-time":"2021-10-04T11:38:39Z","timestamp":1633347519000},"page":"1381-1410","source":"Crossref","is-referenced-by-count":19,"title":["Taylor Approximation for Chance Constrained Optimization Problems Governed by Partial Differential Equations with High-Dimensional Random Parameters"],"prefix":"10.1137","volume":"9","author":[{"given":"Peng","family":"Chen","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omar","family":"Ghattas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2021,10,4]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1137\/130933381"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1137\/140992564"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1137\/16M106306X"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1137\/20M131936X"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1137\/16M109870X"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1007\/s10444-018-9653-1"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1002\/nme.2100"},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1137\/15M1018502"},{"key":"atypb9","unstructured":"D. P. Bertsekas,\n                      Nonlinear Programming\n                      , Athena Scientific, Belmont, MA, 1999."},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1007\/s00791-010-0134-4"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1002\/gamm.201010017"},{"key":"atypb12","doi-asserted-by":"crossref","unstructured":"T. Bui-Thanh, C. Burstedde, O. Ghattas, J. Martin, G. Stadler, and L. C. Wilcox,\n                      Extreme-scale UQ for Bayesian inverse problems governed by PDEs\n                      , in SC12: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, 2012.","DOI":"10.1109\/SC.2012.56"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/28\/5\/055001"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/28\/5\/055002"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.3934\/ipi.2013.7.1139"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.3934\/ipi.2015.9.27"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1137\/12089586X"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1007\/BF01592244"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1051\/m2an\/2018012"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1615\/Int.J.UncertaintyQuantification.2019028753"},{"key":"atypb21","unstructured":"P. Chen and O. Ghattas,\n                      Sparse Polynomial Approximation for Optimal Control Problems Constrained by Elliptic PDEs with Lognormal Random Coefficients\n                      , preprint, arXiv:1903.05547 [math.NA], 2019,https:\/\/arxiv.org\/abs\/1903.05547."},{"key":"atypb22","unstructured":"P. Chen and O. Ghattas,\n                      Projected Stein variational gradient descent\n                      , in Proceedings of the 34th Conference on Neural Information Processing Systems, 2020."},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2021.110114"},{"key":"atypb24","doi-asserted-by":"publisher","DOI":"10.1137\/130940517"},{"key":"atypb25","doi-asserted-by":"publisher","DOI":"10.1137\/120884158"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1007\/s00211-015-0743-4"},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2017.08.016"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2019.01.047"},{"key":"atypb29","unstructured":"P. Chen, K. Wu, J. Chen, T. O'Leary-Roseberry, and O. Ghattas,\n                      Projected Stein variational Newton: A fast and scalable Bayesian inference method in high dimensions\n                      , in Proceedings of the 33rd Conference on Neural Information Processing Systems, 2019."},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2021.114020"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1137\/070702059"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1137\/090754315"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1137\/16M108313X"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6420\/aa6d8e"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1007\/s00158-020-02599-z"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1137\/140985913"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1007\/s11228-017-0452-5"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1137\/090780717"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1137\/19M125039X"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1137\/20M1316111"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1007\/s10589-020-00259-y"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1137\/19M1263297"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1051\/cocv\/2019077"},{"key":"atypb44","doi-asserted-by":"crossref","unstructured":"M. D. Gunzburger,\n                      Perspectives in Flow Control and Optimization\n                      , SIAM, Philadelphia, PA, 2003.","DOI":"10.1137\/1.9780898718720"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1137\/100801731"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1137\/15M1036592"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1137\/090771806"},{"key":"atypb48","doi-asserted-by":"crossref","unstructured":"M. Hinze, R. Pinnau, M. Ulbrich, and S. Ulbrich,\n                      Optimization with PDE Constraints\n                      , Math. Model. Theory Appl. 23, Springer, Cham, 2009,https:\/\/doi.org\/10.1007\/978-1-4020-8839-1,https:\/\/link.springer.com\/978-1-4020-8839-1.","DOI":"10.1007\/978-1-4020-8839-1"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1016\/j.jmaa.2010.07.036"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2015.04.047"},{"key":"atypb51","doi-asserted-by":"publisher","DOI":"10.1007\/s11081-018-9388-3"},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1137\/120892362"},{"key":"atypb53","doi-asserted-by":"publisher","DOI":"10.1137\/140954556"},{"key":"atypb54","doi-asserted-by":"publisher","DOI":"10.1137\/16M1086613"},{"key":"atypb55","doi-asserted-by":"publisher","DOI":"10.1137\/110847597"},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1137\/15M1041390"},{"key":"atypb57","doi-asserted-by":"publisher","DOI":"10.1137\/16M108269X"},{"key":"atypb58","doi-asserted-by":"publisher","DOI":"10.1137\/18M1181419"},{"key":"atypb59","doi-asserted-by":"publisher","DOI":"10.1007\/s11075-017-0371-4"},{"key":"atypb60","first-page":"423","volume":"73","author":"Lindgren F.","year":"2011","journal-title":"Methodol.)"},{"key":"atypb61","doi-asserted-by":"crossref","unstructured":"J. L. Lions,\n                      Optimal Control of Systems Governed by Partial Differential Equations\n                      , Grundlehren Math. Wiss. 170, Springer-Verlag, Berlin, 1971.","DOI":"10.1007\/978-3-642-65024-6"},{"key":"atypb62","doi-asserted-by":"crossref","unstructured":"A. Logg, K.A. Mardal, and G. Wells,\n                      Automated Solution of Differential Equations by the Finite Element Method: The FEniCS book\n                      , vol. 84, Springer Science & Business Media, New York, 2012.","DOI":"10.1007\/978-3-642-23099-8"},{"key":"atypb63","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2018.05.012"},{"key":"atypb64","doi-asserted-by":"publisher","DOI":"10.1137\/110845598"},{"key":"atypb65","unstructured":"M. Martin, F. Nobile, and P. Tsilifis,\n                      A Multilevel Stochastic Gradient Method for PDE-Constrained Optimal Control Problems with Uncertain Parameters\n                      , arXiv preprint,arXiv:1912.11900[math.OC], 2019."},{"key":"atypb66","doi-asserted-by":"publisher","DOI":"10.1145\/2049662.2049669"},{"key":"atypb67","doi-asserted-by":"publisher","DOI":"10.1002\/nme.4761"},{"key":"atypb68","unstructured":"J. Nocedal and S. J. Wright,\n                      Numerical Optimization\n                      , 2nd ed., Springer-Verlag, Berlin, 2006."},{"key":"atypb69","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2017.04.012"},{"key":"atypb70","doi-asserted-by":"publisher","DOI":"10.1137\/17M1122992"},{"key":"atypb71","doi-asserted-by":"publisher","DOI":"10.1137\/130934805"},{"key":"atypb72","doi-asserted-by":"crossref","unstructured":"L. Qi, D. Sun, and G. Zhou,\n                      A new look at smoothing Newton methods for nonlinear complementarity problems and box constrained variational inequalities\n                      , Math. program., 87 (2000), pp. 1-35.","DOI":"10.1007\/s101079900127"},{"key":"atypb73","doi-asserted-by":"publisher","DOI":"10.1109\/TPWRS.2017.2745410"},{"key":"atypb74","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2011.11.026"},{"key":"atypb75","doi-asserted-by":"publisher","DOI":"10.1007\/s11228-020-00558-w"},{"key":"atypb76","doi-asserted-by":"publisher","DOI":"10.1002\/nla.2026"},{"key":"atypb77","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/29\/6\/065011"},{"key":"atypb78","doi-asserted-by":"crossref","unstructured":"A. Shapiro, D. Dentcheva, and A. Ruszczynski,\n                      Lectures on Stochastic Programming: Modeling and Theory\n                      , SIAM, Philadelphia, PA, 2009.","DOI":"10.1137\/1.9780898718751"},{"key":"atypb79","doi-asserted-by":"publisher","DOI":"10.1017\/S0962492910000061"},{"key":"atypb80","doi-asserted-by":"publisher","DOI":"10.1137\/110835438"},{"key":"atypb81","doi-asserted-by":"crossref","unstructured":"F. Tr\u00f6ltzsch,\n                      Optimal Control of Partial Differential Equations: Theory, Methods, and Applications\n                      , American Mathematical Society, Providence, RI, 2010.","DOI":"10.1090\/gsm\/112\/07"},{"key":"atypb82","unstructured":"S. Uryasev,\n                      Probabilistic Constrained Optimization: Methodology and Applications\n                      , Springer Science & Business Media, New York, 2013."},{"key":"atypb83","doi-asserted-by":"publisher","DOI":"10.1080\/02331934.2019.1576670"},{"key":"atypb84","doi-asserted-by":"publisher","DOI":"10.1007\/s10107-018-1230-3"},{"key":"atypb85","doi-asserted-by":"publisher","DOI":"10.1137\/18M1181262"},{"key":"atypb86","doi-asserted-by":"publisher","DOI":"10.1137\/17M1155892"},{"key":"atypb87","doi-asserted-by":"crossref","unstructured":"U. Villa, N. Petra, and O. Ghattas,\n                      hIPPYlib: An extensible software framework for large-scale inverse problems governed by PDEs: Part I: Deterministic inversion and linearized Bayesian inference\n                      , ACM Trans. Math. Software (TOMS), 47 (2021), pp. 1-34.","DOI":"10.1145\/3428447"},{"key":"atypb88","unstructured":"K. Wu, P. Chen, and O. Ghattas,\n                      A Fast and Scalable Computational Framework for Large-Scale and High-Dimensional Bayesian Optimal Experimental Design\n                      , arXiv preprint,arXiv:2010.15196[math.NA], 2020."},{"key":"atypb89","doi-asserted-by":"publisher","DOI":"10.1061\/(ASCE)WR.1943-5452.0000715"},{"key":"atypb90","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2017.02.030"},{"key":"atypb91","doi-asserted-by":"publisher","DOI":"10.1137\/18M1220996"}],"container-title":["SIAM\/ASA Journal on Uncertainty Quantification"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/20M1381381","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T18:25:52Z","timestamp":1787336752000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/20M1381381"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,1]]},"references-count":91,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2021,1]]}},"alternative-id":["10.1137\/20M1381381"],"URL":"https:\/\/doi.org\/10.1137\/20m1381381","relation":{},"ISSN":["2166-2525"],"issn-type":[{"value":"2166-2525","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,1]]}}}