{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,25]],"date-time":"2026-10-25T02:35:01Z","timestamp":1792895701231,"version":"4.5.0"},"reference-count":47,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2012,1]]},"abstract":"<jats:p>We address the solution of large-scale statistical inverse problems in the framework of Bayesian inference. The Markov chain Monte Carlo (MCMC) method is the most popular approach for sampling the posterior probability distribution that describes the solution of the statistical inverse problem. MCMC methods face two central difficulties when applied to large-scale inverse problems: first, the forward models (typically in the form of partial differential equations) that map uncertain parameters to observable quantities make the evaluation of the probability density at any point in parameter space very expensive; and second, the high-dimensional parameter spaces that arise upon discretization of infinite-dimensional parameter fields make the exploration of the probability density function prohibitive. The challenge for MCMC methods is to construct proposal functions that simultaneously provide a good approximation of the target density while being inexpensive to manipulate. Here we present a so-called Stochastic Newton method in which MCMC is accelerated by constructing and sampling from a proposal density that builds a local Gaussian approximation based on local gradient and Hessian (of the log posterior) information. Thus, the method exploits tools (adjoint-based gradients and Hessians) that have been instrumental for fast (often mesh-independent) solution of deterministic inverse problems. Hessian manipulations (inverse, square root) are made tractable by a low-rank approximation that exploits the compact nature of the data misfit operator. This is analogous to a reduced model of the parameter-to-observable map. The method is applied to the Bayesian solution of an inverse medium problem governed by 1D seismic wave propagation. We compare the Stochastic Newton method with a reference black box MCMC method as well as a gradient-based Langevin MCMC method, and observe at least two orders of magnitude improvement in convergence for problems with up to 65 parameters. Numerical evidence suggests that a 1025 parameter problem converges at the same rate as the 65 parameter problem.<\/jats:p>","DOI":"10.1137\/110845598","type":"journal-article","created":{"date-parts":[[2012,6,6]],"date-time":"2012-06-06T18:51:02Z","timestamp":1339008662000},"page":"A1460-A1487","source":"Crossref","is-referenced-by-count":356,"title":["A Stochastic Newton MCMC Method for Large-Scale Statistical Inverse Problems with Application to Seismic Inversion"],"prefix":"10.1137","volume":"34","author":[{"given":"James","family":"Martin","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Lucas C.","family":"Wilcox","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carsten","family":"Burstedde","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omar","family":"Ghattas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2012,6,5]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898718133.ch16"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/j.physd.2006.06.009"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/22\/1\/010"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1002\/nme.1015"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827502415661"},{"key":"atypb6","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1080\/10618600.1998.10474787","volume":"7","author":"Brooks S.","year":"1998","journal-title":"J. Comput. Graph. Statist."},{"key":"atypb7","volume-title":"Proceedings of SC12","author":"Bui-Thanh T."},{"key":"atypb8","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/28\/5\/055002"},{"key":"atypb9","series-title":"SIAM J. Sci. Comput., submitted.","volume-title":"Adaptive Hessian-based non-stationary Gaussian process response surface method for probability density approximation with application to Bayesian solution of large-scale inverse problems","author":"Bui-Thanh T."},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.2514\/1.35850"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1190\/1.3237116"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1198\/106186005X76983"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1214\/10-BA603"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2006.03.012"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1137\/050628568"},{"key":"atypb16","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1002\/nme.2746","volume":"81","author":"Galbally D.","year":"2010","journal-title":"Internat. J. Numer. Methods Engrg."},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1080\/03610919908813583"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1081\/STA-120018828"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-3094-6"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2010.00765.x"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-006-9438-0"},{"key":"atypb22","first-page":"371","volume-title":"SPIE","author":"Hanson K. M.","year":"1998"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1198\/016214507000000888"},{"key":"atypb24","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1093\/oso\/9780198526155.003.0010","volume-title":"Bayesian Statistics 7","author":"Higdon D.","year":"2003"},{"key":"atypb25","first-page":"401","volume-title":"Handbook of Markov Chain Monte Carlo","author":"Higdon D.","year":"2010"},{"key":"atypb26","volume-title":"Optimization with PDE Constraints","author":"Hinze M.","year":"2009"},{"key":"atypb27","volume-title":"Appl. Math. Sci. 160","author":"Kaipio J.","year":"2005"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00294"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1137\/090775622"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.4208\/cicp.2009.v6.p826"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2008.11.024"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2006.10.010"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1063\/1.1699114"},{"key":"atypb34","first-page":"113","volume-title":"Handbook of Markov Chain Monte Carlo","author":"Neal R. M.","year":"2010"},{"key":"atypb35","doi-asserted-by":"crossref","unstructured":"N. C. Nguyen, G. Rozza, D. B. P. Huynh, and A. T. Patera,\n                      Reduced basis approximation and a posteriori error estimation for parametrized parabolic PDEs; Application to real-time Bayesian parameter estimation\n                      , in Large-Scale Inverse Problems and Quantification of Uncertainty, L. Biegler, G. Biros, O. Ghattas, M. Heinkenschloss, D. Keyes, B. Mallick, L. Tenorio, B. van Bloemen Waanders, and K. Willcox, eds., John Wiley & Sons, New York, 2011, pp. 151-178.","DOI":"10.1002\/9780470685853.ch8"},{"key":"atypb36","volume-title":"Proceedings of the First Cape Cod Workshop on Monte Carlo Methods","author":"Qi Y.","year":"2002"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-4145-2"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1015346320"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.2307\/3318418"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898718003"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1017\/S0962492910000061"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.4310\/CMS.2004.v2.n4.a7"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898717921"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1214\/aos\/1176325750"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898717570"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijheatmasstransfer.2004.08.009"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2008.01.019"}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/110845598","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T15:32:49Z","timestamp":1787326369000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/110845598"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,1]]},"references-count":47,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2012,1]]}},"alternative-id":["10.1137\/110845598"],"URL":"https:\/\/doi.org\/10.1137\/110845598","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,1]]}}}