{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,30]],"date-time":"2026-09-30T01:41:53Z","timestamp":1790732513757,"version":"4.1.0"},"reference-count":32,"publisher":"Oxford University Press (OUP)","issue":"2","license":[{"start":{"date-parts":[[2016,5,5]],"date-time":"2016-05-05T00:00:00Z","timestamp":1462406400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2017,3,1]]},"abstract":"<jats:title>Summary<\/jats:title>\n               <jats:p>The paper considers the computer model calibration problem and provides a general frequentist solution. Under the framework proposed, the data model is semiparametric with a non-parametric discrepancy function which accounts for any discrepancy between physical reality and the computer model. In an attempt to solve a fundamentally important (but often ignored) identifiability issue between the computer model parameters and the discrepancy function, the paper proposes a new and identifiable parameterization of the calibration problem. It also develops a two-step procedure for estimating all the relevant quantities under the new parameterization. This estimation procedure is shown to enjoy excellent rates of convergence and can be straightforwardly implemented with existing software. For uncertainty quantification, bootstrapping is adopted to construct confidence regions for the quantities of interest. The practical performance of the methodology is illustrated through simulation examples and an application to a computational fluid dynamics model.<\/jats:p>","DOI":"10.1111\/rssb.12182","type":"journal-article","created":{"date-parts":[[2016,5,5]],"date-time":"2016-05-05T05:47:01Z","timestamp":1462427221000},"page":"635-648","source":"Crossref","is-referenced-by-count":74,"title":["A Frequentist Approach to Computer Model Calibration"],"prefix":"10.1093","volume":"79","author":[{"given":"Raymond K. W.","family":"Wong","sequence":"first","affiliation":[{"name":"Iowa State University , Ames , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Curtis B.","family":"Storlie","sequence":"additional","affiliation":[{"name":"Los Alamos National Laboratory \u00a0 USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Thomas C. M.","family":"Lee","sequence":"additional","affiliation":[{"name":"University of California at Davis \u00a0 USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2016,5,5]]},"reference":[{"key":"2023021709341819200_rssb12182-cit-0001","doi-asserted-by":"crossref","first-page":"138","DOI":"10.1198\/004017007000000092","article-title":"A framework for validation of computer models","volume":"49","author":"Bayarri","year":"2007","journal-title":"Technometrics"},{"key":"2023021709341819200_rssb12182-cit-0002","volume-title":"Summary of MFIX equations 2012-1","author":"Benyahia","year":"2012"},{"key":"2023021709341819200_rssb12182-cit-0003","doi-asserted-by":"crossref","first-page":"114007","DOI":"10.1088\/0266-5611\/30\/11\/114007","article-title":"Learning about physical parameters: the importance of model discrepancy","volume":"30","author":"Brynjarsd\u00f3ttir","year":"2014","journal-title":"Invrs. Prob."},{"key":"2023021709341819200_rssb12182-cit-0004","doi-asserted-by":"crossref","first-page":"663","DOI":"10.1093\/biomet\/asp028","article-title":"Gaussian process emulation of dynamic computer codes","volume":"96","author":"Conti","year":"2009","journal-title":"Biometrika"},{"key":"2023021709341819200_rssb12182-cit-0005","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1080\/01621459.1991.10475138","article-title":"Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments","volume":"86","author":"Currin","year":"1991","journal-title":"J. Am. Statist. Ass."},{"key":"2023021709341819200_rssb12182-cit-0006","doi-asserted-by":"crossref","first-page":"1527","DOI":"10.1198\/016214506000000898","article-title":"Empirical Bayesian analysis for computer experiments involving finite-difference codes","volume":"101","author":"Drignei","year":"2006","journal-title":"J. Am. Statist. Ass."},{"key":"2023021709341819200_rssb12182-cit-0007","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4899-4541-9","volume-title":"An Introduction to the Bootstrap","author":"Efron","year":"1993"},{"key":"2023021709341819200_rssb12182-cit-0008","volume-title":"Design and Modeling for Computer Experiments","author":"Fang","year":"2010"},{"key":"2023021709341819200_rssb12182-cit-0009","volume-title":"Empirical Processes in M-estimation","author":"van de Geer","year":"2000"},{"key":"2023021709341819200_rssb12182-cit-0010","doi-asserted-by":"crossref","first-page":"675","DOI":"10.1214\/aos\/1176348651","article-title":"Effect of bias estimation on coverage accuracy of bootstrap confidence intervals for a probability density","volume":"20","author":"Hall","year":"1992","journal-title":"Ann. Statist."},{"key":"2023021709341819200_rssb12182-cit-0011","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1214\/aos\/1176348652","article-title":"On bootstrap confidence intervals in nonparametric regression","volume":"20","author":"Hall","year":"1992","journal-title":"Ann. Statist."},{"key":"2023021709341819200_rssb12182-cit-0012","first-page":"102","article-title":"Bootstrapping in nonparametric regression: local adaptive smoothing and confidence bands","volume":"83","author":"H\u00e4rdle","year":"1988","journal-title":"J. Am. Statist. Ass."},{"key":"2023021709341819200_rssb12182-cit-0013","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1198\/016214507000000888","article-title":"Computer model validation using high-dimensional output","volume":"103","author":"Higdon","year":"2008","journal-title":"J. Am. Statist. Ass."},{"key":"2023021709341819200_rssb12182-cit-0014","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1137\/S1064827503426693","article-title":"Combining field data and computer simulations for calibration and prediction","volume":"26","author":"Higdon","year":"2004","journal-title":"SIAM J. Scient. Comput."},{"key":"2023021709341819200_rssb12182-cit-0015","doi-asserted-by":"crossref","first-page":"441","DOI":"10.1007\/s10898-005-2454-3","article-title":"Global optimization of stochastic black-box systems via sequential kriging meta-models","volume":"34","author":"Huang","year":"2006","journal-title":"J. Globl Optimizn"},{"key":"2023021709341819200_rssb12182-cit-0016","doi-asserted-by":"crossref","first-page":"455","DOI":"10.1023\/A:1008306431147","article-title":"Efficient global optimization of expensive black-box functions","volume":"13","author":"Jones","year":"1998","journal-title":"J. Globl Optimizn"},{"key":"2023021709341819200_rssb12182-cit-0017","doi-asserted-by":"crossref","first-page":"362","DOI":"10.1080\/00224065.2009.11917791","article-title":"Statistical adjustments to engineering models","volume":"41","author":"Joseph","year":"2009","journal-title":"J. Qual. Technol."},{"key":"2023021709341819200_rssb12182-cit-0018","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1111\/1467-9868.00294","article-title":"Bayesian calibration of computer models (with discussion)","volume":"63","author":"Kennedy","year":"2001","journal-title":"J. R. Statist. Soc."},{"key":"2023021709341819200_rssb12182-cit-0019","doi-asserted-by":"crossref","first-page":"388","DOI":"10.1016\/j.powtec.2015.11.021","article-title":"Hierarchical calibration and validation of computational fluid dynamics models for solid sorbent-based carbon capture","volume":"288","author":"Lai","year":"2016","journal-title":"Powd. Technol."},{"key":"2023021709341819200_rssb12182-cit-0020","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1016\/j.powtec.2013.11.037","article-title":"Numerical modeling and uncertainty quantification of a bubbling fluidized bed with immersed horizontal tubes","volume":"253","author":"Lane","year":"2014","journal-title":"Powd. Technol."},{"key":"2023021709341819200_rssb12182-cit-0021","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1146\/annurev-chembioeng-060713-040321","article-title":"Carbon capture simulation initiative: a case study in multi-scale modeling and new challenges","volume":"5","author":"Miller","year":"2014","journal-title":"A. Rev. Chem. Biomolec. Engng"},{"key":"2023021709341819200_rssb12182-cit-0022","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1111\/j.1467-9868.2004.05304.x","article-title":"Probabilistic sensitivity analysis of complex models: a Bayesian approach","volume":"66","author":"Oakley","year":"2004","journal-title":"J. R. Statist. Soc."},{"key":"2023021709341819200_rssb12182-cit-0023","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1198\/TECH.2009.0013","article-title":"Variable selection in Bayesian smoothing spline ANOVA models: application to deterministic computer codes","volume":"51","author":"Reich","year":"2009","journal-title":"Technometrics"},{"key":"2023021709341819200_rssb12182-cit-0024","doi-asserted-by":"crossref","DOI":"10.1017\/CBO9780511755453","volume-title":"Semiparametric Regression","author":"Ruppert","year":"2003"},{"key":"2023021709341819200_rssb12182-cit-0025","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3799-8","volume-title":"The Design and Analysis of Computer Experiments","author":"Santner","year":"2003"},{"key":"2023021709341819200_rssb12182-cit-0026","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1093\/pan\/7.1.187","article-title":"Genetic optimization using derivatives","volume":"7","author":"Sekhon","year":"1998","journal-title":"Polit. Anal."},{"key":"2023021709341819200_rssb12182-cit-0027","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1080\/01621459.2014.979993","article-title":"Calibration of computational models with categorical parameters and correlated outputs via Bayesian smoothing spline ANOVA","volume":"110","author":"Storlie","year":"2015","journal-title":"J. Am. Statist. Ass."},{"key":"2023021709341819200_rssb12182-cit-0028","doi-asserted-by":"crossref","first-page":"30","DOI":"10.1016\/j.ress.2012.11.018","article-title":"Analysis of computationally demanding models with continuous and categorical inputs","volume":"113","author":"Storlie","year":"2013","journal-title":"Reliab. Engng Syst. Safty"},{"key":"2023021709341819200_rssb12182-cit-0029","doi-asserted-by":"crossref","first-page":"1735","DOI":"10.1016\/j.ress.2009.05.007","article-title":"Implementation and evaluation of nonparametric regression procedures for sensitivity analysis of computationally demanding models","volume":"94","author":"Storlie","year":"2009","journal-title":"Reliab. Engng Syst. Safty"},{"key":"2023021709341819200_rssb12182-cit-0030","doi-asserted-by":"crossref","first-page":"1237","DOI":"10.1029\/WR023i007p01237","article-title":"Simultaneous confidence and prediction intervals for nonlinear regression models with application to a groundwater flow model","volume":"23","author":"Vecchia","year":"1987","journal-title":"Wat. Resour. Res."},{"key":"2023021709341819200_rssb12182-cit-0031","doi-asserted-by":"crossref","DOI":"10.1137\/1.9781611970128","volume-title":"Spline Models for Observational Data","author":"Wahba","year":"1990"},{"key":"2023021709341819200_rssb12182-cit-0032","doi-asserted-by":"crossref","first-page":"1621","DOI":"10.1016\/j.jspi.2013.05.013","article-title":"Bayesian inference with misspecified models","volume":"143","author":"Walker","year":"2013","journal-title":"J. Statist. Planng Inf."}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12182","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12182","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/79\/2\/635\/49232156\/jrsssb_79_2_635.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/79\/2\/635\/49232156\/jrsssb_79_2_635.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,17]],"date-time":"2023-02-17T09:56:40Z","timestamp":1676627800000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/79\/2\/635\/7041930"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2016,5,5]]},"references-count":32,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2016,5,5]]},"published-print":{"date-parts":[[2017,3,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12182","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,3]]},"published":{"date-parts":[[2016,5,5]]}}}