{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T19:26:13Z","timestamp":1791487573181,"version":"4.3.4"},"reference-count":32,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"1","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2011,1]]},"abstract":"<jats:p>We consider the problem of estimating the uncertainty in large-scale linear statistical inverse problems with high-dimensional parameter spaces within the framework of Bayesian inference. When the noise and prior probability densities are Gaussian, the solution to the inverse problem is also Gaussian and is thus characterized by the mean and covariance matrix of the posterior probability density. Unfortunately, explicitly computing the posterior covariance matrix requires as many forward solutions as there are parameters and is thus prohibitive when the forward problem is expensive and the parameter dimension is large. However, for many ill-posed inverse problems, the Hessian matrix of the data misfit term has a spectrum that collapses rapidly to zero. We present a fast method for computation of an approximation to the posterior covariance that exploits the low-rank structure of the preconditioned (by the prior covariance) Hessian of the data misfit. Analysis of an infinite-dimensional model convection-diffusion problem, and numerical experiments on large-scale three-dimensional convection-diffusion inverse problems with up to 1.5 million parameters, demonstrate that the number of forward PDE solves required for an accurate low-rank approximation is independent of the problem dimension. This permits scalable estimation of the uncertainty in large-scale ill-posed linear inverse problems at a small multiple (independent of the problem dimension) of the cost of solving the forward problem.<\/jats:p>","DOI":"10.1137\/090780717","type":"journal-article","created":{"date-parts":[[2011,2,24]],"date-time":"2011-02-24T18:32:14Z","timestamp":1298572334000},"page":"407-432","source":"Crossref","is-referenced-by-count":155,"title":["Fast Algorithms for Bayesian Uncertainty Quantification in Large-Scale Linear Inverse Problems Based on Low-Rank Partial Hessian Approximations"],"prefix":"10.1137","volume":"33","author":[{"given":"H. P.","family":"Flath","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"L. C.","family":"Wilcox","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"V.","family":"Ak\u00e7elik","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"J.","family":"Hill","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"B.","family":"van Bloemen Waanders","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"O.","family":"Ghattas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2011,2,24]]},"reference":[{"key":"R1","unstructured":"V. Ak\u00e7elik, G. Biros, A. Draganescu, O. Ghattas, J. Hill, and B. van Bloeman Waanders,\n                      Dynamic data-driven inversion for terascale simulations: Real-time identification of airborne contaminants\n                      , in Proceedings of the ACM\/IEEE SC2005 Conference on High Performance Networking and Computing, Seattle, WA, 2005."},{"key":"R2","unstructured":"V. Ak\u00e7elik, G. Biros, O. Ghattas, J. Hill, D. Keyes, and B. van Bloeman Waanders,\n                      Parallel PDE constrained optimization\n                      , in Parallel Processing for Scientific Computing, M. A. Heroux, P. Raghaven, and H. D. Simon, eds., SIAM, Philadelphia, 2006."},{"key":"R3","doi-asserted-by":"publisher","DOI":"10.1016\/S0168-874X(03)00054-4"},{"key":"R4","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.1968.tb00216.x"},{"key":"R5","unstructured":"S. Balay, K. Buschelman, V. Eijkhout, W. D. Gropp, D. Kaushik, M. G. Knepley, L. C. McInnes, B. F. Smith, and H. Zhang,\n                      PETSc Users Manual\n                      , Technical report ANL-95\/11 - Revision 3.1, Argonne National Laboratory, Argonne, IL, 2010."},{"key":"R6","unstructured":"S. Balay, K. Buschelman, W. D. Gropp, D. Kaushik, M. G. Knepley, L. C. McInnes, B. F. Smith, and H. Zhang,\n                      PETSc Web page\n                      , http:\/\/www.mcs.anl.gov\/petsc (2009)."},{"key":"R7","doi-asserted-by":"crossref","unstructured":"S. Balay, W. D. Gropp, L. C. McInnes, and B. F. Smith,\n                      Efficient management of parallelism in object oriented numerical software libraries\n                      , in Modern Software Tools for Scientific Computing, E. Arge, A. M. Bruaset, and H. P. Langtangen, eds., Birkh\u00e4user Boston, Boston, MA, 1997, pp. 163\u2013202.","DOI":"10.1007\/978-1-4612-1986-6_8"},{"key":"R8","doi-asserted-by":"crossref","unstructured":"H. T. Banks and K. Kunisch,\n                      Estimation Techniques for Distributed Parameter Systems\n                      , Systems Control Found. Appl. 1, Birkh\u00e4user-Verlag, Boston, Basel, Berlin, 1989.","DOI":"10.1007\/978-1-4612-3700-6"},{"key":"R9","doi-asserted-by":"publisher","DOI":"10.1023\/A:1010098523281"},{"key":"R10","doi-asserted-by":"publisher","DOI":"10.1023\/A:1011588308111"},{"key":"R11","doi-asserted-by":"crossref","unstructured":"L. T. Biegler, O. Ghattas, M. Heinkenschloss, and B. van Bloemen Waanders, eds.\n                      Large-Scale PDE-Constrained Optimization\n                      , Lect. Notes Comput. Sci. Eng. 30, Springer-Verlag, Heidelberg, 2003.","DOI":"10.1007\/978-3-642-55508-4"},{"key":"R12","doi-asserted-by":"crossref","unstructured":"L. Boschi,\n                      Measures of resolution in global body wave tomography\n                      , Geophys. Res. Lett., 30 (2003), SDE 2-1\u20132-4.","DOI":"10.1029\/2003GL018222"},{"key":"R13","unstructured":"T. Bui-Thanh, O. Ghattas, D. Higdon, Z. Lu, and L. Wilcox,\n                      Hessian-Informed Gaussian Process Response Surface Methods for Probability Density Approximation\n                      , manuscript, 2011."},{"key":"R14","unstructured":"C. Burstedde, O. Ghattas, J. Martin, and L. C. Wilcox,\n                      Uncertainty Quantification in Inverse Problems with Stochastic Newton MCMC\n                      , manuscript, 2011."},{"key":"R15","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-2478.2002.00341.x"},{"key":"R16","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/13\/2\/009"},{"key":"R17","doi-asserted-by":"publisher","DOI":"10.1029\/97JB02933"},{"key":"R18","unstructured":"V. Hernandez, J. E. Roman, A. Tomas, and V. Vidal,\n                      Lanczos Methods in SLEPc\n                      , Technical report STR-5, Universidad Polit\u00e9cnica de Valencia, Valencia, Spain, 2006; available online from http:\/\/www.grycap.upv.es\/slepc."},{"key":"R19","doi-asserted-by":"publisher","DOI":"10.1145\/1089014.1089019"},{"key":"R20","unstructured":"M. Hinze, R. Pinnau, M. Ulbrich, and S. Ulbrich,\n                      Optimization with PDE Constraints\n                      , Springer-Verlag, New York, 2009."},{"key":"R21","doi-asserted-by":"crossref","unstructured":"K. Ito and K. Kunisch,\n                      Lagrange Multiplier Approach to Variational Problems and Applications\n                      , SIAM, Philadelphia, 2008.","DOI":"10.1137\/1.9780898718614"},{"key":"R22","doi-asserted-by":"crossref","unstructured":"J. Kaipio and E. Somersalo,\n                      Statistical and Computational Inverse Problems\n                      , Appl. Math. Sci., 160, Springer-Verlag, New York, 2005.","DOI":"10.1007\/b138659"},{"key":"R23","unstructured":"O. Marques, T. Drummond, and D. Vasco,\n                      A computational strategy for the solution of large linear inverse problems in geophysics\n                      , in Proceedings of the 17th IEEE International Symposium on Parallel and Distributed Processing, 2003, p. 16.2."},{"key":"R24","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.1996.tb05295.x"},{"key":"R25","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-246x.1999.00858.x"},{"key":"R26","doi-asserted-by":"crossref","unstructured":"A. Tarantola,\n                      Inverse Problem Theory and Methods for Model Parameter Estimation\n                      , SIAM, Philadelphia, 2005.","DOI":"10.1137\/1.9780898717921"},{"key":"R27","doi-asserted-by":"publisher","DOI":"10.1190\/1.1444408"},{"key":"R28","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.1993.tb04654.x"},{"key":"R29","doi-asserted-by":"crossref","unstructured":"C. R. Vogel,\n                      Computational Methods for Inverse Problems\n                      , Frontiers Appl. Math. 23, SIAM, Philadelphia, 2002.","DOI":"10.1137\/1.9780898717570"},{"key":"R30","doi-asserted-by":"publisher","DOI":"10.1046\/j.1365-246x.1999.00925.x"},{"key":"R31","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.2007.03418.x"},{"key":"R32","doi-asserted-by":"publisher","DOI":"10.1111\/j.1365-246X.1995.tb05722.x"}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/090780717","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T15:21:36Z","timestamp":1787325696000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/090780717"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2011,1]]},"references-count":32,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2011,1]]}},"alternative-id":["10.1137\/090780717"],"URL":"https:\/\/doi.org\/10.1137\/090780717","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2011,1]]}}}