{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T02:41:42Z","timestamp":1769913702561,"version":"3.49.0"},"reference-count":42,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2018,3,12]],"date-time":"2018-03-12T00:00:00Z","timestamp":1520812800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In this paper, we examine two widely-used approaches, the polynomial chaos expansion (PCE) and Gaussian process (GP) regression, for the development of surrogate models. The theoretical differences between the PCE and GP approximations are discussed. A state-of-the-art PCE approach is constructed based on high precision quadrature points; however, the need for truncation may result in potential precision loss; the GP approach performs well on small datasets and allows a fine and precise trade-off between fitting the data and smoothing, but its overall performance depends largely on the training dataset. The reproducing kernel Hilbert space (RKHS) and Mercer\u2019s theorem are introduced to form a linkage between the two methods. The theorem has proven that the two surrogates can be embedded in two isomorphic RKHS, by which we propose a novel method named Gaussian process on polynomial chaos basis (GPCB) that incorporates the PCE and GP. A theoretical comparison is made between the PCE and GPCB with the help of the Kullback\u2013Leibler divergence. We present that the GPCB is as stable and accurate as the PCE method. Furthermore, the GPCB is a one-step Bayesian method that chooses the best subset of RKHS in which the true function should lie, while the PCE method requires an adaptive procedure. Simulations of 1D and 2D benchmark functions show that GPCB outperforms both the PCE and classical GP methods. In order to solve high dimensional problems, a random sample scheme with a constructive design (i.e., tensor product of quadrature points) is proposed to generate a valid training dataset for the GPCB method. This approach utilizes the nature of the high numerical accuracy underlying the quadrature points while ensuring the computational feasibility. Finally, the experimental results show that our sample strategy has a higher accuracy than classical experimental designs; meanwhile, it is suitable for solving high dimensional problems.<\/jats:p>","DOI":"10.3390\/e20030191","type":"journal-article","created":{"date-parts":[[2018,3,12]],"date-time":"2018-03-12T13:13:48Z","timestamp":1520860428000},"page":"191","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":20,"title":["Gaussian Processes and Polynomial Chaos Expansion for Regression Problem: Linkage via the RKHS and Comparison via the KL Divergence"],"prefix":"10.3390","volume":"20","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-2168-5470","authenticated-orcid":false,"given":"Liang","family":"Yan","sequence":"first","affiliation":[{"name":"College of Liberal Arts and Sciences, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Xiaojun","family":"Duan","sequence":"additional","affiliation":[{"name":"College of Liberal Arts and Sciences, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bowen","family":"Liu","sequence":"additional","affiliation":[{"name":"College of Liberal Arts and Sciences, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jin","family":"Xu","sequence":"additional","affiliation":[{"name":"College of Liberal Arts and Sciences, National University of Defense Technology, Changsha 410073, China"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2018,3,12]]},"reference":[{"key":"ref_1","unstructured":"Schwefel, H.P.P. (1993). Evolution and Optimum Seeking: The Sixth Generation, John Wiley & Sons, Inc."},{"key":"ref_2","unstructured":"Santner, T.J., Williams, B.J., and Notz, W.I. (2013). The Design and Analysis of Computer Experiments, Springer Science & Business Media."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/BF02736747","article-title":"Monte Carlo techniques in computational stochastic mechanics","volume":"5","author":"Hurtado","year":"1998","journal-title":"Arch. Comput. Methods Eng."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"640","DOI":"10.1016\/j.jspi.2009.08.006","article-title":"Bayesian emulation of complex multi-output and dynamic computer models","volume":"140","author":"Conti","year":"2010","journal-title":"J. Stat. Plan. Inference"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1198\/016214507000000888","article-title":"Computer model calibration using high-dimensional output","volume":"103","author":"Higdon","year":"2008","journal-title":"J. Am. Stat. Assoc."},{"key":"ref_6","unstructured":"Balci, O. (2003, January 7\u201310). Verification, validation, and certification of modeling and simulation applications. Proceedings of the 35th Conference on Winter Simulation: Driving Innovation, New Orleans, LA, USA."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Rubino, G., and Tuffin, B. (2009). Rare Event Simulation Using Monte Carlo Methods, John Wiley & Sons, Inc.","DOI":"10.1002\/9780470745403"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.strusafe.2016.05.001","article-title":"Surrogate-enhanced stochastic search algorithms to identify implicitly defined functions for reliability analysis","volume":"62","author":"Sundar","year":"2016","journal-title":"Struct. Saf."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1007\/s00158-009-0420-2","article-title":"Survey of modeling and optimization strategies to solve high-dimensional design problems with computationally-expensive black-box functions","volume":"41","author":"Shan","year":"2010","journal-title":"Struct. Multidiscip. Optim."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"511","DOI":"10.1016\/0017-9310(94)00175-U","article-title":"Uncertainties in parameter estimation: The inverse problem","volume":"38","author":"Fadale","year":"1995","journal-title":"Int. J. Heat Mass Transf."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1615\/Int.J.UncertaintyQuantification.v1.i2.30","article-title":"Error and uncertainty quantification and sensitivity analysis in mechanics computational models","volume":"1","author":"Liang","year":"2011","journal-title":"Int. J. Uncertain. Quantif."},{"key":"ref_12","unstructured":"De Cursi, E.S., and Sampaio, R. (2015). Uncertainty Quantification and Stochastic Modeling with Matlab, Elsevier."},{"key":"ref_13","first-page":"1","article-title":"Multivariate adaptive regression splines","volume":"19","author":"Friedman","year":"1991","journal-title":"An. Stat."},{"key":"ref_14","first-page":"155","article-title":"Support vector regression machines","volume":"9","author":"Drucker","year":"1997","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1016\/j.neunet.2017.09.003","article-title":"Robust artificial neural network for reliability and sensitivity analyses of complex non-linear systems","volume":"96","author":"Oparaji","year":"2017","journal-title":"Neural Netw."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"152","DOI":"10.1016\/j.ress.2016.09.003","article-title":"LIF: A new kriging based learning function and its application to structural reliability analysis","volume":"157","author":"Sun","year":"2017","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ghanem, R., and Spanos, P.D. (1991). Stochastic Finite Elements: A Spectral Approach, Springer.","DOI":"10.1007\/978-1-4612-3094-6"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1137\/S1064827501387826","article-title":"The Wiener\u2013Askey polynomial chaos for stochastic differential equations","volume":"24","author":"Xiu","year":"2002","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1118","DOI":"10.1137\/040615201","article-title":"High-order collocation methods for differential equations with random inputs","volume":"27","author":"Xiu","year":"2005","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Xiu, D. (2010). Numerical Methods for Stochastic Computations: A Spectral Method Approach, Princeton University Press.","DOI":"10.1515\/9781400835348"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1006\/jcph.2002.7104","article-title":"A stochastic projection method for fluid flow: II. Random process","volume":"181","author":"Reagan","year":"2002","journal-title":"J. Comput. Phys."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"66","DOI":"10.1061\/(ASCE)0733-9399(2002)128:1(66)","article-title":"Stochastic finite-element analysis of seismic soil-structure interaction","volume":"128","author":"Ghiocel","year":"2002","journal-title":"J. Eng. Mech."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1111\/1467-9868.00294","article-title":"Bayesian calibration of computer models","volume":"63","author":"Kennedy","year":"2001","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"},{"key":"ref_24","first-page":"105","article-title":"Statistics for spatial data: Wiley series in probability and statistics","volume":"15","author":"Cressie","year":"1993","journal-title":"Wiley-Intersci. N. Y."},{"key":"ref_25","first-page":"133","article-title":"Introduction to Gaussian processes","volume":"168","author":"MacKay","year":"1998","journal-title":"NATO ASI Ser. F Comput. Syst. Sci."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Rasmussen, C.E. (2004). Gaussian processes in machine learning. Advanced Lectures on Machine Learning, Springer.","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"A2118","DOI":"10.1137\/100816717","article-title":"Residual minimizing model interpolation for parameterized nonlinear dynamical systems","volume":"34","author":"Constantine","year":"2012","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_28","first-page":"1939","article-title":"A unifying view of sparse approximate Gaussian process regression","volume":"6","author":"Rasmussen","year":"2005","journal-title":"J. Mach. Learn. Res."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1615\/Int.J.UncertaintyQuantification.2015012467","article-title":"Polynomial-chaos-based kriging","volume":"5","author":"Schobi","year":"2015","journal-title":"Int. J. Uncertain. Quantif."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"D4016002","DOI":"10.1061\/AJRUA6.0000870","article-title":"Rare Event Estimation Using Polynomial-Chaos kriging","volume":"3","author":"Sudret","year":"2017","journal-title":"ASCE-ASME J. Risk Uncertain. Eng. Syst. Part A Civ. Eng."},{"key":"ref_31","unstructured":"Sch\u00f6bi, R., and Sudret, B. (2014, January 15\u201318). Combining polynomial chaos expansions and kriging for solving structural reliability problems. Proceedings of the 7th International Conference on Computational Stochastic Mechanics (CSM7), Santorini, Greece."},{"key":"ref_32","unstructured":"Sch\u00f6bi, R., and Sudret, B. (2014, January 3\u20137). PC-kriging: A new meta-modeling method and its applications to quantile estimation. Proceedings of the 17th IFIP Working Group 7.5 Conference on Reliability and Optimization of Structural Systems, Huangshan, China."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1090\/S0002-9947-1950-0051437-7","article-title":"Theory of reproducing kernels","volume":"68","author":"Aronszajn","year":"1950","journal-title":"Trans. Am. Math. Soc."},{"key":"ref_34","unstructured":"Kullback, S. (1997). Information Theory and Statistics, Courier Corporation."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.strusafe.2011.01.002","article-title":"AK-MCS: An active learning reliability method combining kriging and Monte Carlo simulation","volume":"33","author":"Echard","year":"2011","journal-title":"Struct. Saf."},{"key":"ref_36","unstructured":"Dubourg, V. (2011). Adaptive Surrogate Models for Reliability Analysis and Reliability-Based Design Optimization. [Ph.D. Thesis, Universit\u00e9 Blaise Pascal-Clermont-Ferrand II]."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1017\/S0305004100022313","article-title":"An extension of a theorem of Mehler\u2019s on Hermite polynomials","volume":"41","author":"Kibble","year":"1945","journal-title":"Math. Proc. Camb. Philos. Soc."},{"key":"ref_38","first-page":"3011","article-title":"Gaussian processes for machine learning (GPML) toolbox","volume":"11","author":"Rasmussen","year":"2010","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","unstructured":"Niederreiter, H. (2010). QuasiMonte Carlo Methods, John Wiley & Sons, Inc."},{"key":"ref_40","unstructured":"Ishigami, T., and Homma, T. (1990, January 3\u20135). An importance quantification technique in uncertainty analysis for computer models. Proceedings of the First International Symposium on Uncertainty Modeling and Analysis, College Park, MD, USA."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"4731","DOI":"10.1016\/j.csda.2008.03.026","article-title":"An efficient methodology for modeling complex computer codes with Gaussian processes","volume":"52","author":"Marrel","year":"2008","journal-title":"Comput. Stat. Data Anal."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1111\/j.1467-9868.2004.05304.x","article-title":"Probabilistic sensitivity analysis of complex models: A Bayesian approach","volume":"66","author":"Oakley","year":"2004","journal-title":"J. R. Stat. Soc. Ser. B (Stat. Methodol.)"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/3\/191\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T14:56:46Z","timestamp":1760194606000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/20\/3\/191"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,3,12]]},"references-count":42,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2018,3]]}},"alternative-id":["e20030191"],"URL":"https:\/\/doi.org\/10.3390\/e20030191","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,3,12]]}}}