{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T18:24:50Z","timestamp":1787336690045,"version":"build-2736575974"},"reference-count":66,"publisher":"Society for Industrial & Applied Mathematics (SIAM)","issue":"6","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["SIAM J. Sci. Comput."],"published-print":{"date-parts":[[2012,1]]},"abstract":"<jats:p>We develop an adaptive Hessian-based non-stationary Gaussian process (GP) response surface method for approximating a probability density function (pdf) that exploits its structure, particularly the Hessian of its negative logarithm. Of particular interest to us are pdfs that arise from the Bayesian solution of large-scale inverse problems, which imply very expensive-to-evaluate pdfs. The method can be considered as a piecewise adaptive Gaussian approximation in which a Gaussian tailored to the local Hessian of the negative log probability density is constructed for each subregion in high dimensional parameter space. The task of efficiently partitioning the parameter space into subregions is done implicitly through Hessian-informed membership probability functions. The GP machinery is then employed to glue all local Gaussian approximations into a global analytical response surface that is far cheaper to evaluate than the original expensive probability density. The resulting response surface is also equipped with an analytical variance estimate that can be used to assess the uncertainty of the approximation. One of the key components of our proposed approach is an adaptive sampling strategy for exploring the parameter space efficiently during the computer experimental design step, which aims to find training points with high probability density. The detailed construction and an analysis of the method are presented. We then demonstrate the accuracy and efficiency of the proposed method on several example problems, including inverse shape electromagnetic scattering in 24-dimensional parameter space.<\/jats:p>","DOI":"10.1137\/110851419","type":"journal-article","created":{"date-parts":[[2012,11,8]],"date-time":"2012-11-08T11:27:38Z","timestamp":1352374058000},"page":"A2837-A2871","source":"Crossref","is-referenced-by-count":21,"title":["Adaptive Hessian-Based Nonstationary Gaussian Process Response Surface Method for Probability Density Approximation with Application to Bayesian Solution of Large-Scale Inverse Problems"],"prefix":"10.1137","volume":"34","author":[{"given":"Tan","family":"Bui-Thanh","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omar","family":"Ghattas","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"David","family":"Higdon","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"351","published-online":{"date-parts":[[2012,11,8]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1016\/S0168-9274(98)00018-X"},{"key":"atypb2","unstructured":"P. Abrahamsen,\n                      A Review of Gaussian Random Fields and Correlation Functions\n                      , Tech. Report, 2nd ed., Norwegian Computing Center, Oslo, Norway, 1997."},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1145\/1048935.1050202"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898718133.ch16"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1515\/9781400874668"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1137\/S106482750241565X"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827502415661"},{"key":"atypb9","first-page":"227","volume-title":"Neuro-computing: Algorithms, Architectures and Applications","author":"Bridle J. S.","year":"1989"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511543241"},{"key":"atypb11","doi-asserted-by":"crossref","unstructured":"T. Bui-Thanh,\n                      Model-Constrained Optimization Methods for Reduction of Parameterized Large-Scale Systems\n                      , Ph.D. thesis, Department of Aeronautics and Astronautics, MIT, 2007.","DOI":"10.1016\/j.jcp.2006.10.026"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/28\/5\/055001"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/28\/5\/055002"},{"key":"atypb14","unstructured":"T. Bui-Thanh and O. Ghattas,\n                      Non-stationary Gaussian Process Response for Posterior Interpolation: A Comparative Study\n                      , manuscript, (2012)."},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1137\/070694855"},{"key":"atypb16","volume-title":"Introduction to Bayesian Scientific Computing: Ten Lectures on Subjective Computing","author":"Calvetti D.","year":"2007"},{"key":"atypb17","first-page":"300","volume":"1","author":"Cha S.-H.","year":"2007","journal-title":"Int. J. Math. Models Methods Appl. Sci."},{"key":"atypb18","unstructured":"A. Christen and B. Sanso,\n                      Advances in the Design of Gaussian Processes as Surrogate Models for Computer Experiments\n                      , Tech. Report 5, University of California, Santa Cruz, CA, 2008."},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1016\/0893-6080(95)00137-9"},{"key":"atypb20","volume-title":"Differential Calculus, and Optimization, Adv. Des. Control 22","author":"Delfour M. C.","year":"2011"},{"key":"atypb21","volume-title":"High-Dimensional Data Analysis: The curses and blessings of dimensionality. \\newblock Lecture at American Math","author":"Donoho D. L.","year":"2000"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/24\/3\/034015"},{"key":"atypb23","doi-asserted-by":"publisher","DOI":"10.1137\/090780717"},{"key":"atypb24","volume-title":"A New Class of Nonstationary Spatial Models, tech. report","author":"Fuentes M.","year":"2001"},{"key":"atypb25","doi-asserted-by":"crossref","first-page":"1581","DOI":"10.1002\/nme.2746","volume":"81","author":"Galbally D.","year":"2010","journal-title":"Int. J. Numer. Methods Eng."},{"key":"atypb26","unstructured":"M. N. Gibbs,\n                      Bayesian Gaussian Processes for regression and classification\n                      , Ph.D. thesis, Cavendish Laboratory, Cambridge University, 1997."},{"key":"atypb27","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015367"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1051\/m2an:2005006"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-006-9438-0"},{"key":"atypb30","volume-title":"Texts Appl. Math. 54","author":"Hesthaven J. S.","year":"2008"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1198\/016214507000000888"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1137\/S1064827503426693"},{"key":"atypb33","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1093\/oso\/9780198504856.003.0036","volume-title":"Bayesian Statistics 6","author":"Higdon D.","year":"1999"},{"key":"atypb34","volume-title":"Optimization with PDE Constraints","author":"Hinze M.","year":"2009"},{"key":"atypb36","volume-title":"Appl. Math. Sci. 160","author":"Kaipio J.","year":"2005"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00294"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1198\/016214504000002014"},{"key":"atypb39","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/4\/3\/013"},{"key":"atypb40","first-page":"235","volume":"9","author":"Krause A.","year":"2008","journal-title":"J. Machine Learning Res."},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1137\/090775622"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1162\/neco.1992.4.4.590"},{"key":"atypb43","first-page":"211","volume-title":"Models of Neural Networks III","author":"MacKay D. J. C.","year":"1994"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1023\/A:1007558615313"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1137\/110845598"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2008.11.024"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2006.10.010"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2006.00553.x"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.2514\/1.11292"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-0745-0"},{"key":"atypb52","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/89.4.819"},{"key":"atypb53","volume-title":"Geophysical Statistical Program","author":"Nychka D.","year":"1999"},{"key":"atypb54","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/asm031"},{"key":"atypb55","doi-asserted-by":"publisher","DOI":"10.1016\/j.ress.2005.11.025"},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1002\/env.785"},{"key":"atypb57","volume-title":"Proceedings of the ISBA Eighth World Meeting on Bayesian Statistics in Valencia","author":"Pfingsten T.","year":"2006"},{"key":"atypb58","volume-title":"Gaussian Processes for Machine Learning","author":"Rasmussen C. E.","year":"2006"},{"key":"atypb59","doi-asserted-by":"publisher","DOI":"10.1007\/BF02169154"},{"key":"atypb60","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1992.10475181"},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-3799-8"},{"key":"atypb62","doi-asserted-by":"publisher","DOI":"10.1111\/1467-9868.00413"},{"key":"atypb63","doi-asserted-by":"publisher","DOI":"10.1002\/9780470316849"},{"key":"atypb64","doi-asserted-by":"publisher","DOI":"10.1016\/S0169-7161(04)24009-3"},{"key":"atypb65","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-59802-9_4"},{"key":"atypb66","doi-asserted-by":"publisher","DOI":"10.1007\/PL00007198"},{"key":"atypb67","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/27\/10\/105004"},{"key":"atypb68","doi-asserted-by":"publisher","DOI":"10.1016\/j.ijheatmasstransfer.2004.08.009"},{"key":"atypb69","volume-title":"Wikipedia, The Free Encyclopedia","author":"Wikipedia","year":"2012"}],"container-title":["SIAM Journal on Scientific Computing"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/epubs.siam.org\/doi\/pdf\/10.1137\/110851419","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,21]],"date-time":"2026-08-21T17:26:35Z","timestamp":1787333195000},"score":1,"resource":{"primary":{"URL":"https:\/\/epubs.siam.org\/doi\/10.1137\/110851419"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,1]]},"references-count":66,"journal-issue":{"issue":"6","published-print":{"date-parts":[[2012,1]]}},"alternative-id":["10.1137\/110851419"],"URL":"https:\/\/doi.org\/10.1137\/110851419","relation":{},"ISSN":["1064-8275","1095-7197"],"issn-type":[{"value":"1064-8275","type":"print"},{"value":"1095-7197","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,1]]}}}