{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,24]],"date-time":"2026-06-24T15:56:38Z","timestamp":1782316598800,"version":"3.54.5"},"reference-count":43,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T00:00:00Z","timestamp":1773878400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"German Federal Ministry of Education and Research","award":["13FH557KX0"],"award-info":[{"award-number":["13FH557KX0"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["MAKE"],"abstract":"<jats:p>In complex and unknown processes, global models are fitted over the entire input domain but often tend to perform poorly whenever the response surface exhibits non-stationary behavior and varying smoothness. A common approach is to use local models, which requires partitioning the input domain into subdomains and training multiple models, thereby adding significant complexity. Recognizing this limitation, this study addresses the need for models that represent the input\u2013output relationship consistently over the full domain while still adapting to local variations in the response. It introduces a novel machine learning approach: the Polynomial Chaos Expanded Gaussian Process (PCEGP), leveraging polynomial chaos expansion to calculate input-dependent hyperparameters of the Gaussian process (GP). This provides a mathematically interpretable approach that incorporates non-stationary covariance functions and heteroscedastic noise estimation to generate locally adapted models. The model performance is compared to different algorithms in benchmark tests for regression tasks. The results demonstrate low prediction errors of the PCEGP, highlighting model performance that is often competitive with or better than previous methods. A key advantage of the presented model is its interpretable hyperparameters along with training and prediction runtimes comparable to those of a standard GP.<\/jats:p>","DOI":"10.3390\/make8030078","type":"journal-article","created":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T11:50:36Z","timestamp":1773921036000},"page":"78","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Polynomial Chaos Expanded Gaussian Process"],"prefix":"10.3390","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0009-0007-0001-3556","authenticated-orcid":false,"given":"Dominik","family":"Polke","sequence":"first","affiliation":[{"name":"Engineering and Computer Science, University of Applied Sciences Niederrhein, 47805 Krefeld, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"K\u00f6sters","sequence":"additional","affiliation":[{"name":"Engineering and Computer Science, University of Applied Sciences Niederrhein, 47805 Krefeld, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0002-9645-2871","authenticated-orcid":false,"given":"Elmar","family":"Ahle","sequence":"additional","affiliation":[{"name":"Engineering and Computer Science, University of Applied Sciences Niederrhein, 47805 Krefeld, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8299-101X","authenticated-orcid":false,"given":"Dirk","family":"S\u00f6ffker","sequence":"additional","affiliation":[{"name":"Chair of Dynamics and Control, University of Duisburg-Essen, 47057 Duisburg, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2026,3,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Rasmussen, C., and Williams, C. (2006). Gaussian Process for Machine Learning, The MIT Press.","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"991","DOI":"10.1137\/17M1129179","article-title":"Warped Gaussian Processes and Derivative-Based Sequential Designs for Functions with Heterogeneous Variations","volume":"6","author":"Marmin","year":"2018","journal-title":"SIAM\/ASA J. Uncertain. Quantif."},{"key":"ref_3","unstructured":"Bitzer, M., Meister, M., and Zimmer, C. (2023, January 25\u201327). Hierarchical-Hyperplane Kernels for Actively Learning Gaussian Process Models of Nonstationary Systems. Proceedings of the 26th International Conference on Artificial Intelligence and Statistics, Valencia, Spain."},{"key":"ref_4","first-page":"732","article-title":"Non-Stationary Gaussian Process Regression with Hamiltonian Monte Carlo","volume":"Volume 51","author":"Gretton","year":"2016","journal-title":"Proceedings of the 19th International Conference on Artificial Intelligence and Statistics, Cadiz, Spain, 9\u201311 May 2016"},{"key":"ref_5","unstructured":"Cremanns, K. (2021). Probabilistic Machine Learning for Pattern Recognition and Design Exploration. [Ph.D. Thesis, RWTH Aachen University]."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Daelemans, W., Goethals, B., and Morik, K. (2008). Nonstationary Gaussian Process Regression Using Point Estimates of Local Smoothness. Proceedings of the Machine Learning and Knowledge Discovery in Databases, Antwerp, Belgium, 15\u201319 September 2008, Springer.","DOI":"10.1007\/978-3-540-87481-2"},{"key":"ref_7","unstructured":"Paciorek, C.J., and Schervish, M.J. (2003). Nonstationary Covariance Functions for Gaussian Process Regression. Proceedings of the 16th International Conference on Neural Information Processing Systems, NIPS\u201903, Vancouver, BC, Canada, 8\u201313 December 2003, MIT Press."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/s11081-020-09517-8","article-title":"Bayesian Optimization Using Deep Gaussian Processes with Applications to Aerospace System Design","volume":"22","author":"Hebbal","year":"2021","journal-title":"Optim. Eng."},{"key":"ref_9","first-page":"207","article-title":"Deep Gaussian Processes","volume":"Volume 31","author":"Carvalho","year":"2013","journal-title":"Proceedings of the 16th International Conference on Artificial Intelligence and Statistics, Scottsdale, AZ, USA, 29 April\u20131 May 2013"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1080\/00401706.2021.2008505","article-title":"Active Learning for Deep Gaussian Process Surrogates","volume":"65","author":"Sauer","year":"2023","journal-title":"Technometrics"},{"key":"ref_11","first-page":"2251","article-title":"Deep Structured Mixtures of Gaussian Processes","volume":"Volume 108","author":"Chiappa","year":"2020","journal-title":"Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics, Online, 26\u201328 August 2020"},{"key":"ref_12","unstructured":"Cremanns, K., and Roos, D. (2026, March 11). Deep Gaussian Covariance Network. Available online: http:\/\/arxiv.org\/pdf\/1710.06202v2."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.neucom.2020.08.011","article-title":"Explaining the Black-box Model: A Survey of Local Interpretation Methods for Deep Neural Networks","volume":"419","author":"Liang","year":"2021","journal-title":"Neurocomputing"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"601","DOI":"10.1016\/j.jcp.2019.03.039","article-title":"Data-driven Polynomial Chaos Expansion for Machine Learning Regression","volume":"388","author":"Torre","year":"2019","journal-title":"J. Comput. Phys."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"106732","DOI":"10.1016\/j.ymssp.2020.106732","article-title":"Arbitrary Polynomial Chaos Expansion Method for Uncertainty Quantification and Global Sensitivity Analysis in Structural Dynamics","volume":"142","author":"Wan","year":"2020","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"107795","DOI":"10.1016\/j.ress.2021.107795","article-title":"Polynomial Chaos Expansion for Sensitivity Analysis of Model Output With Dependent Inputs","volume":"214","author":"Mara","year":"2021","journal-title":"Reliab. Eng. Syst. Saf."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Ghanem, R.G., and Spanos, P.D. (1991). Stochastic Finite Elements: A Spectral Approach, Springer.","DOI":"10.1007\/978-1-4612-3094-6"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"749","DOI":"10.1016\/j.jmaa.2018.04.032","article-title":"A Polynomial Chaos Expansion in Dependent Random Variables","volume":"464","author":"Rahman","year":"2018","journal-title":"J. Math. Anal. Appl."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1137\/S1064827501387826","article-title":"The Wiener\u2013Askey Polynomial Chaos for Stochastic Differential Equations","volume":"24","author":"Xiu","year":"2002","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Sudret, B., Marelli, S., and Wiart, J. (2017). Surrogate Models for Uncertainty Quantification: An Overview. Proceedings of the 2017 11th European Conference on Antennas and Propagation (EUCAP), Paris, France, 19\u201324 March 2017, IEEE.","DOI":"10.23919\/EuCAP.2017.7928679"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"643","DOI":"10.1016\/j.cma.2019.03.049","article-title":"Polynomial Chaos Expansions for Dependent Random Variables","volume":"351","author":"Jakeman","year":"2019","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1038\/s43586-022-00184-w","article-title":"Principal Component Analysis","volume":"2","author":"Greenacre","year":"2022","journal-title":"Nat. Rev. Methods Prim."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1137\/20M1315774","article-title":"Sparse Polynomial Chaos Expansions: Literature Survey and Benchmark","volume":"9","author":"Marelli","year":"2021","journal-title":"SIAM\/ASA J. Uncertain. Quantif."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1016\/j.inffus.2021.11.005","article-title":"A Comprehensive Survey on Regularization Strategies in Machine Learning","volume":"80","author":"Tian","year":"2022","journal-title":"Inf. Fusion"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1615\/Int.J.UncertaintyQuantification.2015012467","article-title":"Polynomial-Chaos-based Kriging","volume":"5","author":"Sudret","year":"2015","journal-title":"Int. J. Uncertain. Quantif."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"131285","DOI":"10.1016\/j.cej.2021.131285","article-title":"Machine Learning Aided Supercritical Water Gasification for H2-rich Syngas Production with Process Optimization and Catalyst Screening","volume":"426","author":"Li","year":"2021","journal-title":"Chem. Eng. J."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"4909","DOI":"10.1109\/TITS.2021.3054625","article-title":"Deep Reinforcement Learning for Autonomous Driving: A Survey","volume":"23","author":"Kiran","year":"2022","journal-title":"IEEE Trans. Intell. Transp. Syst."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"110591","DOI":"10.1016\/j.rser.2020.110591","article-title":"A Deep Learning Framework for Building Energy Consumption Forecast","volume":"137","author":"Somu","year":"2021","journal-title":"Renew. Sustain. Energy Rev."},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Keogh, E., and Mueen, A. (2011). Curse of Dimensionality. Encyclopedia of Machine Learning, Springer.","DOI":"10.1007\/978-0-387-30164-8_192"},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Neal, R.M. (1996). Bayesian Learning for Neural Networks. Lecture Notes in Statistics, Springer.","DOI":"10.1007\/978-1-4612-0745-0"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Varunram, T.N., Shivaprasad, M.B., Aishwarya, K.H., Balraj, A., Savish, S.V., and Ullas, S. (2021, January 17\u201319). Analysis of Different Dimensionality Reduction Techniques and Machine Learning Algorithms for an Intrusion Detection System. Proceedings of the 2021 IEEE 6th International Conference on Computing, Communication and Automation (ICCCA), Arad, Romania.","DOI":"10.1109\/ICCCA52192.2021.9666265"},{"key":"ref_32","first-page":"1743","article-title":"Variable Selection for Gaussian Processes via Sensitivity Analysis of the Posterior Predictive Distribution","volume":"Volume 89","author":"Chaudhuri","year":"2019","journal-title":"Proceedings of the 22nd International Conference on Artificial Intelligence and Statistics, Naha, Japan, 16\u201318 April 2019"},{"key":"ref_33","unstructured":"Coello Coello, C.A. (2020). Multiobjective tree-structured parzen estimator for computationally expensive optimization problems. Proceedings of the 2020 Genetic and Evolutionary Computation Conference, Online, 8\u201312 July 2020, ACM."},{"key":"ref_34","unstructured":"Kingma, D.P., and Ba, J. (2015, January 7\u20139). Adam: A Method for Stochastic Optimization. Proceedings of the 3rd International Conference for Learning Representations, San Diego, CA, USA."},{"key":"ref_35","unstructured":"Dozat, T. (2016, January 2\u20134). Incorporating Nesterov Momentum into Adam. Proceedings of the 4th International Conference on Learning Representations, Workshop Track, San Juan, PR, USA."},{"key":"ref_36","unstructured":"Bengio, S., Wallach, H., Larochelle, H., Grauman, K., Cesa-Bianchi, N., and Garnett, R. (2018). GPyTorch: Blackbox Matrix-Matrix Gaussian Process Inference with GPU Acceleration. Proceedings of the Advances in Neural Information Processing Systems, Montr\u00e9al, QC, Canada, 2\u20138 December 2018, Curran Associates, Inc."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python","volume":"17","author":"Virtanen","year":"2020","journal-title":"Nat. Methods"},{"key":"ref_38","first-page":"2825","article-title":"Scikit-learn: Machine Learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"J. Mach. Learn. Res."},{"key":"ref_39","unstructured":"Novik, M. (2026, March 11). Torch-Optimizer\u2014Collection of Optimization Algorithms for PyTorch. Available online: https:\/\/github.com\/jettify\/pytorch-optimizer."},{"key":"ref_40","unstructured":"Teredesai, A., Kumar, V., Li, Y., Rosales, R., Terzi, E., and Karypis, G. (2019). Optuna: A Next-generation Hyperparameter Optimization Framework. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA, 4\u20138 August 2019, ACM."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1137\/16M1080173","article-title":"Optimization Methods for Large-Scale Machine Learning","volume":"60","author":"Bottou","year":"2018","journal-title":"SIAM Rev."},{"key":"ref_42","unstructured":"Abadi, M., Barham, P., Chen, J., Chen, Z., Davis, A., Dean, J., Devin, M., Ghemawat, S., Irving, G., and Isard, M. (2016, January 2\u20134). TensorFlow: A System for Large-Scale Machine Learning. Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), Savannah, GA, USA."},{"key":"ref_43","first-page":"1","article-title":"Gaussian Process Boosting","volume":"23","author":"Sigrist","year":"2022","journal-title":"J. Mach. Learn. Res."}],"container-title":["Machine Learning and Knowledge Extraction"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2504-4990\/8\/3\/78\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,19]],"date-time":"2026-03-19T12:29:19Z","timestamp":1773923359000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2504-4990\/8\/3\/78"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,19]]},"references-count":43,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2026,3]]}},"alternative-id":["make8030078"],"URL":"https:\/\/doi.org\/10.3390\/make8030078","relation":{},"ISSN":["2504-4990"],"issn-type":[{"value":"2504-4990","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,19]]}}}