{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,7]],"date-time":"2026-10-07T23:44:39Z","timestamp":1791416679604,"version":"4.3.3"},"reference-count":73,"publisher":"Oxford University Press (OUP)","issue":"5","license":[{"start":{"date-parts":[[2013,12,9]],"date-time":"2013-12-09T00:00:00Z","timestamp":1386547200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/open_access\/funder_policies\/chorus\/standard_publication_model"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2014,11,1]]},"abstract":"<jats:title>Summary<\/jats:title><jats:p>Monotonic transformations are widely employed in statistics and data analysis. In computer experiments they are often used to gain accuracy in the estimation of global sensitivity statistics. However, one faces the question of interpreting results that are obtained on the transformed data back on the original data. The situation is even more complex in computer experiments, because transformations alter the model input\u2013output mapping and distort the estimators. This work demonstrates that the problem can be solved by utilizing statistics which are monotonic transformation invariant. To do so, we offer an investigation into the families of metrics either based on densities or on cumulative distribution functions that are monotonic transformation invariant and we introduce a new generalized family of metrics. Numerical experiments show that transformations allow numerical convergence in the estimates of global sensitivity statistics, both invariant and not, in cases in which it would otherwise be impossible to obtain convergence. However, one fully exploits the increased numerical accuracy if the global sensitivity statistic is monotonic transformation invariant. Conversely, estimators of measures that do not have this invariance property might lead to misleading deductions.<\/jats:p>","DOI":"10.1111\/rssb.12052","type":"journal-article","created":{"date-parts":[[2013,12,9]],"date-time":"2013-12-09T12:12:52Z","timestamp":1386591172000},"page":"925-947","source":"Crossref","is-referenced-by-count":75,"title":["Transformations and Invariance in the Sensitivity Analysis of Computer Experiments"],"prefix":"10.1093","volume":"76","author":[{"given":"E.","family":"Borgonovo","sequence":"first","affiliation":[{"name":"Bocconi University , Milan , Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"S.","family":"Tarantola","sequence":"additional","affiliation":[{"name":"Joint Research Centre of the European Commission , Ispra , Italy"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"E.","family":"Plischke","sequence":"additional","affiliation":[{"name":"Clausthal University of Technology , Clausthal-Zellerfeld , Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M. D.","family":"Morris","sequence":"additional","affiliation":[{"name":"Iowa State University , Ames , USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2013,12,9]]},"reference":[{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1214\/aoms\/1177729437","article-title":"Asymptotic theory of certain \u201cgoodness of fit\u201d criteria based on stochastic processes","volume":"23","author":"Anderson","year":"1952","journal-title":"Ann. Math. Statist."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","DOI":"10.1287\/mnsc.2013.1719","article-title":"Invariant probabilistic sensitivity analysis","author":"Baucells","year":"2013","journal-title":"Mangmnt Sci."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1198\/TECH.2009.514INTRO","article-title":"Special issue on computer modeling","volume":"51","author":"Bayarri","year":"2009","journal-title":"Technometrics"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1007\/s102030050005","article-title":"Decision analysis using targets instead of utility functions","volume":"23","author":"Bordley","year":"2000","journal-title":"Decsns Econ. Finan."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1016\/j.ress.2006.04.015","article-title":"A new uncertainty importance measure","volume":"92","author":"Borgonovo","year":"2007","journal-title":"Reliab. Engng Syst. Safty"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1111\/j.1539-6924.2010.01519.x","article-title":"Moment independent importance measures: new results and analytical test cases","volume":"31","author":"Borgonovo","year":"2011","journal-title":"Risk Anal."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1111\/j.2517-6161.1964.tb00553.x","article-title":"An analysis of transformations","volume":"26","author":"Box","year":"1964","journal-title":"J. R. Statist. Soc. B"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"978","DOI":"10.1016\/j.cpc.2010.12.039","article-title":"From screening to quantitative sensitivity analysis: a unified approach","volume":"4","author":"Campolongo","year":"2011","journal-title":"Comput. Phys. Communs"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1016\/j.envsoft.2012.04.017","article-title":"Sampling strategies in density-based sensitivity analysis","volume":"38","author":"Castaings","year":"2012","journal-title":"Environ. Modllng Softwr."},{"key":"2023031107151614200_","volume-title":"Practical Nonparametric Statistics","author":"Conover","year":"1971"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"124","DOI":"10.1080\/00031305.1981.10479327","article-title":"Rank transformations as a bridge between parametric and nonparametric statistics","volume":"35","author":"Conover","year":"1981","journal-title":"Am. Statistn"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"485","DOI":"10.1214\/08-STS275","article-title":"Principal fitted components for dimension reduction in regression","volume":"23","author":"Cook","year":"2008","journal-title":"Statist. Sci."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1561\/0100000004","article-title":"Information theory and statistics: a tutorial","volume":"1","author":"Csisz\u00e1r","year":"2004","journal-title":"Foundns Trends Communs Inform. Theor."},{"key":"2023031107151614200_","volume-title":"Personal Communication","author":"Delpuech","year":"2012"},{"key":"2023031107151614200_","volume-title":"Nonparametric Density Estimation: the L1 View","author":"Devroye","year":"1985"},{"key":"2023031107151614200_","article-title":"Dictionary of Distances","author":"Deza","year":"2006"},{"key":"2023031107151614200_","first-page":"239","article-title":"Rank-based robust analysis of linear models: I, Exposition and review","volume":"3","author":"Draper","year":"1988","journal-title":"Statist. Sci."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1214\/aos\/1176345462","article-title":"The jackknife estimate of variance","volume":"9","author":"Efron","year":"1981","journal-title":"Ann. Statist."},{"key":"2023031107151614200_","volume-title":"Impact assessment guidelines","author":"European Commission","year":"2009"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"375","DOI":"10.1080\/01621459.2000.10474207","article-title":"Risk assessment via a robust probit model, with application to toxicology","volume":"95","author":"Fine","year":"2000","journal-title":"J. Am. Statist. Ass."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"419","DOI":"10.1111\/j.1751-5823.2002.tb00178.x","article-title":"On choosing and bounding probability metrics","volume":"70","author":"Gibbs","year":"2002","journal-title":"Int. Statist. Rev."},{"key":"2023031107151614200_","volume-title":"Evaluating Derivatives, Principles and Techniques of Algorithmic Differentiation","author":"Griewank","year":"2000"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"1995","DOI":"10.1137\/S0036142994261439","article-title":"Quadrature error bounds with applications to lattice rules","volume":"33","author":"Hickernell","year":"1996","journal-title":"SIAM J. Numer. Anal."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1214\/aoms\/1177730196","article-title":"A class of statistics with asymptotically normal distribution","volume":"19","author":"Hoeffding","year":"1948","journal-title":"Ann. Math. Statist."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/0951-8320(96)00002-6","article-title":"Importance measures in global sensitivity analysis of nonlinear models","volume":"52","author":"Homma","year":"1996","journal-title":"Reliab. Engng Syst. Safty"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1111\/j.1539-6924.1990.tb00523.x","article-title":"A robust measure of uncertainty importance for use in fault tree system analysis","volume":"10","author":"Iman","year":"1990","journal-title":"Risk Anal."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"1277","DOI":"10.1111\/j.1539-6924.2005.00673.x","article-title":"Sensitivity analysis for computer model projections of hurricane losses","volume":"25","author":"Iman","year":"2005","journal-title":"Risk Anal."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1287\/ijoc.1050.0136","article-title":"A user's guide to the brave new world of designing simulation experiments","volume":"17","author":"Kleijnen","year":"2005","journal-title":"INFORMS J. Comput."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"860","DOI":"10.1080\/01621459.1999.10474191","article-title":"Tests of linear and logarithmic transformations for integrated processes","volume":"94","author":"Kobayashi","year":"1999","journal-title":"J. Am. Statist. Ass."},{"key":"2023031107151614200_","first-page":"38","article-title":"Tests concerning random points on a circle","volume":"63","author":"Kuiper","year":"1960","journal-title":"Proc. Koninkl. Neder. Akad. Wetensch. A"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"4394","DOI":"10.1109\/TIT.2006.881731","article-title":"On divergences and informations in statistics and information theory","volume":"52","author":"Liese","year":"2006","journal-title":"IEEE Trans. Inform. Theor."},{"key":"2023031107151614200_","first-page":"2272","article-title":"Component selection and smoothing in multivariate nonparametric regression","volume":"35","author":"Lin","year":"2006","journal-title":"Ann. Statist."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1198\/jasa.2009.0109","article-title":"Robust response transformations based on optimal prediction","volume":"104","author":"Marazzi","year":"2009","journal-title":"J. Am. Statist. Ass."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1214\/aos\/1176346259","article-title":"A modified Kolmogorov Smirnov test sensitive to tail alternatives","volume":"11","author":"Mason","year":"1983","journal-title":"Ann. Statist."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1214\/088342304000000279","article-title":"From unit root to Stein's estimator to Fisher's k statistics: if you have a moment, I can tell you more","volume":"20","author":"Meng","year":"2005","journal-title":"Statist. Sci."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1080\/00401706.1991.10484804","article-title":"Factorial sampling plans for preliminary computational experiments","volume":"33","author":"Morris","year":"1991","journal-title":"Technometrics"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"205","DOI":"10.1198\/004017008000000208","article-title":"Using orthogonal arrays in the sensitivity analysis of computer models","volume":"50","author":"Morris","year":"2008","journal-title":"Technometrics"},{"key":"2023031107151614200_","volume-title":"PSACOIN level E intercomparison: an international code inter-comparison exercise on a hypothetical safety assessment case study for radioactive waste disposal systems","author":"Nuclear Energy Agency","year":"1989"},{"key":"2023031107151614200_","volume-title":"PSACOIN level S intercomparison: an international code inter-comparison exercise on a hypothetical safety assessment case study for radioactive waste disposal systems","author":"Nuclear Energy Agency","year":"1993"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"121","DOI":"10.1198\/TECH.2009.0014","article-title":"Decision-theoretic sensitivity analysis for complex computer models","volume":"51","author":"Oakley","year":"2009","journal-title":"Technometrics"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"468","DOI":"10.1016\/j.jhealeco.2010.03.006","article-title":"Simulation sample sizes for Monte Carlo partial EVPI calculations","volume":"29","author":"Oakley","year":"2010","journal-title":"J. Hlth Econ."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1111\/j.1467-9868.2004.05304.x","article-title":"Probabilistic sensitivity analysis of complex models: a Bayesian approach","volume":"66","author":"Oakley","year":"2004","journal-title":"J. R. Statist. Soc. B"},{"key":"2023031107151614200_","first-page":"1","article-title":"The dimension distribution and quadrature test functions","volume":"13","author":"Owen","year":"2003","journal-title":"Statist. Sin."},{"key":"2023031107151614200_","volume-title":"Better estimation of small Sobol' sensitivity indices","author":"Owen","year":"2012"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1137\/120876782","article-title":"Variance components and generalized Sobol' indices","volume":"1","author":"Owen","year":"2013","journal-title":"J. Uncertnty Quantificn"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1093\/biomet\/50.3-4.315","article-title":"Comparison of tests for randomness of points on a line","volume":"50","author":"Pearson","year":"1963","journal-title":"Biometrika"},{"key":"2023031107151614200_","volume-title":"On the General Theory of Skew Correlation and Non-linear Regression","author":"Pearson","year":"1905"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"354","DOI":"10.1016\/j.ress.2009.11.005","article-title":"An effective algorithm for computing global sensitivity indices (EASI)","volume":"95","author":"Plischke","year":"2010","journal-title":"Reliab. Engng Syst. Safty"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"188","DOI":"10.1016\/j.envsoft.2012.03.004","article-title":"How to compute variance-based sensitivity indicators with your spreadsheet software","volume":"35","author":"Plischke","year":"2012","journal-title":"Environ. Modllng Softwr."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1016\/j.ejor.2012.11.047","article-title":"Global sensitivity measures from given data","volume":"226","author":"Plischke","year":"2013","journal-title":"Eur. J. Oper. Res."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1023\/A:1019188517934","article-title":"General foundations of high-dimensional model representations","volume":"25","author":"Rabitz","year":"1999","journal-title":"J. Math. Chem."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","DOI":"10.1002\/9781444392715","volume-title":"A Probability Metrics Approach to Financial Risk Measures","author":"Rachev","year":"2011"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.envsoft.2011.11.003","article-title":"Emulation techniques for the reduction and sensitivity analysis of complex environmental models","volume":"34","author":"Ratto","year":"2012","journal-title":"Environ. Modllng Softwr."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"280","DOI":"10.1016\/S0010-4655(02)00280-1","article-title":"Making best use of model evaluations to compute sensitivity indices","volume":"145","author":"Saltelli","year":"2002","journal-title":"Comput. Phys. Communs"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/j.cpc.2009.09.018","article-title":"Variance based sensitivity analysis of model output: design and estimator for the total sensitivity index","volume":"181","author":"Saltelli","year":"2010","journal-title":"Comput. Phys. Communs"},{"key":"2023031107151614200_","volume-title":"Global Sensitivity Analysis\u2014the Primer","author":"Saltelli","year":"2008"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"PR1","DOI":"10.1021\/cr200301u","article-title":"Update 1 of: Sensitivity analysis for chemical models","volume":"112","author":"Saltelli","year":"2012","journal-title":"Chem. Rev."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/0951-8320(95)00099-2","article-title":"About the use of rank transformation in the sensitivity analysis of model output. Reliab","volume":"50","author":"Saltelli","year":"1995","journal-title":"Engng Syst. Safty"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"702","DOI":"10.1198\/016214502388618447","article-title":"On the relative importance of input factors in mathematical models: safety assessment for nuclear waste disposal","volume":"97","author":"Saltelli","year":"2002","journal-title":"J. Am. Statist. Ass."},{"key":"2023031107151614200_","first-page":"377","article-title":"Sensitivity analysis as an ingredient of modelling","volume":"19","author":"Saltelli","year":"2000","journal-title":"Statist. Sci."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4757-3799-8","volume-title":"The Design and Analysis of Computer Experiments","author":"Santner","year":"2003"},{"key":"2023031107151614200_","volume-title":"The Foundations of Statistics","author":"Savage","year":"1954"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1214\/aoms\/1177730390","article-title":"A useful convergence theorem for probability distributions","volume":"18","author":"Scheff\u00e9","year":"1947","journal-title":"Ann. Math. Statist."},{"key":"2023031107151614200_","volume-title":"Multidimensional Quadrature Formulas and Haar Functions (in Russian)","author":"Sobol'","year":"1969"},{"key":"2023031107151614200_","first-page":"407","article-title":"Sensitivity estimates for nonlinear mathematical models","volume":"1","author":"Sobol'","year":"1993","journal-title":"Math. Modllng Computnl Exp."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"271","DOI":"10.1016\/S0378-4754(00)00270-6","article-title":"Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates","volume":"55","author":"Sobol'","year":"2001","journal-title":"Math. Comput. Simuln"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"1243","DOI":"10.1080\/01621459.1994.10476865","article-title":"Capturing the intangible concept of information","volume":"89","author":"Soofi","year":"1994","journal-title":"J. Am. Statist. Ass."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","DOI":"10.1515\/9783110850826","volume-title":"Mathematical Theory of Statistics","author":"Strasser","year":"1985"},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"755","DOI":"10.1177\/0272989X12465123","article-title":"An efficient method for computing single-parameter partial expected value of perfect information","volume":"33","author":"Strong","year":"2013","journal-title":"Med. Decsn Makng"},{"key":"2023031107151614200_","first-page":"25","article-title":"Managing structural uncertainty in health economic decision models: a discrepancy approach","volume":"61","author":"Strong","year":"2012","journal-title":"Appl. Statist."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"894","DOI":"10.1080\/01621459.1983.10477037","article-title":"Tensor analysis of ANOVA decomposition","volume":"78","author":"Takemura","year":"1983","journal-title":"J. Am. Statist. Ass."},{"key":"2023031107151614200_","doi-asserted-by":"crossref","first-page":"16471","DOI":"10.1073\/pnas.1008446107","article-title":"Statistical tests for whether a given set of independent, identically distributed draws comes from a specified probability density","volume":"107","author":"Tygert","year":"2010","journal-title":"Proc. Natn. Acad. Sci. USA"},{"key":"2023031107151614200_","volume-title":"Guidance on the development, evaluation, and application of environmental models","author":"US Environmental Protection Agency","year":"2009"}],"container-title":["Journal of the Royal Statistical Society Series B: Statistical Methodology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/api.wiley.com\/onlinelibrary\/tdm\/v1\/articles\/10.1111%2Frssb.12052","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/76\/5\/925\/49506915\/jrsssb_76_5_925.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jrsssb\/article-pdf\/76\/5\/925\/49506915\/jrsssb_76_5_925.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,5,21]],"date-time":"2024-05-21T06:45:26Z","timestamp":1716273926000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jrsssb\/article\/76\/5\/925\/7075927"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2013,12,9]]},"references-count":73,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2013,12,9]]},"published-print":{"date-parts":[[2014,11,1]]}},"URL":"https:\/\/doi.org\/10.1111\/rssb.12052","relation":{},"ISSN":["1369-7412","1467-9868"],"issn-type":[{"value":"1369-7412","type":"print"},{"value":"1467-9868","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2014,11]]},"published":{"date-parts":[[2013,12,9]]}}}