{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T00:55:10Z","timestamp":1760057710884,"version":"build-2065373602"},"reference-count":56,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T00:00:00Z","timestamp":1739923200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"Gay\u2013Lussac Humboldt Research Award"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>Systems may depend on parameters that can be controlled, serve to optimise the system, are imposed externally, or are uncertain. This last case is taken as the \u201cLeitmotiv\u201d for the following discussion.A reduced-order model is produced from the full-order model through some kind of projection onto a relatively low-dimensional manifold or subspace. The parameter-dependent reduction process produces a function mapping the parameters to the manifold.One now wants to examine the relation between the full and the reduced state for all possible parameter values of interest. Similarly, in the field of machine learning, a function mapping the parameter set to the image space of the machine learning model is learned from a training set of samples, typically minimising the mean square error. This set may be seen as a sample from some probability distribution, and thus the training is an approximate computation of the expectation, giving an approximation of the conditional expectation\u2014a special case of Bayesian updating, where the Bayesian loss function is the mean square error. This offers the possibility of having a combined view of these methods and also of introducing more general loss functions.<\/jats:p>","DOI":"10.3390\/computation13020058","type":"journal-article","created":{"date-parts":[[2025,2,19]],"date-time":"2025-02-19T08:36:46Z","timestamp":1739954206000},"page":"58","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["Reduced-Order Models and Conditional Expectation: Analysing Parametric Low-Order Approximations"],"prefix":"10.3390","volume":"13","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8644-5574","authenticated-orcid":false,"given":"Hermann G.","family":"Matthies","sequence":"first","affiliation":[{"name":"Institute of Scientific Computing, TU Braunschweig, 38106 Braunschweig, Germany"}]}],"member":"1968","published-online":{"date-parts":[[2025,2,19]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"483","DOI":"10.1137\/130932715","article-title":"A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems","volume":"57","author":"Benner","year":"2015","journal-title":"SIAM Rev."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3270","DOI":"10.1137\/070694855","article-title":"Model reduction for large-scale systems with high-dimensional parametric input space","volume":"30","author":"Willcox","year":"2008","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"A937","DOI":"10.1137\/10081157X","article-title":"Reduced basis approximation for non-linear parametrized evolution equations based on empirical operator interpolation","volume":"34","author":"Drohmann","year":"2012","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Quarteroni, A., and Rozza, G. (2014). Reduced Order Methods for Modeling and Computational Reduction, Vol. 9, MS&A\u2014Modeling, Simulation & Applications, Springer.","DOI":"10.1007\/978-3-319-02090-7"},{"key":"ref_5","doi-asserted-by":"crossref","unstructured":"Benner, P., Ohlberger, M., Patera, A.T., Rozza, G., and Urban, K. (2017). Model Reduction of Parametrized Systems, Vol. 17, MS&A\u2014Modeling, Simulation & Applications, Springer.","DOI":"10.1007\/978-3-319-58786-8"},{"key":"ref_6","unstructured":"Stein, E., de Borst, R., and Hughes, T.J.R. (2017). Model Reduction Methods. Encyclopaedia of Computational Mechanics, John Wiley & Sons. [2nd ed.]. Part 1. Fundamentals. Encyclopaedia of Computational Mechanics."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"A1777","DOI":"10.1137\/17M1136924","article-title":"Weakly Intrusive Low-Rank Approximation Method for Nonlinear Parameter-Dependent Equations","volume":"41","author":"Giraldi","year":"2019","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Quarteroni, A., Manzoni, A., and Negri, F. (2015). Reduced Basis Methods for Partial Differential Equations: An Introduction, Springer.","DOI":"10.1007\/978-3-319-15431-2"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1017\/S0962492915000033","article-title":"Approximation of high-dimensional parametric PDEs","volume":"24","author":"Cohen","year":"2015","journal-title":"Acta Numer."},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Hesthaven, J.S., Rozza, G., and Stamm, B. (2016). Certified Reduced Basis Methods for Parametrized Partial Differential Equations, Springer.","DOI":"10.1007\/978-3-319-22470-1"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Chen, P., and Schwab, C. (2017). Model Order Reduction Methods in Computational Uncertainty Quantification. Handbook of Uncertainty Quantification, Springer.","DOI":"10.1007\/978-3-319-12385-1_70"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"2555","DOI":"10.1007\/s10444-019-09735-4","article-title":"Analysis of parametric models: Linear methods and approximations","volume":"45","author":"Matthies","year":"2019","journal-title":"Adv. Comput. Math."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1186\/s40323-020-00172-3","article-title":"Parametric Models Analysed with Linear Maps","volume":"7","author":"Matthies","year":"2020","journal-title":"Adv. Model. Simul. Eng. Sci."},{"key":"ref_14","first-page":"129","article-title":"Analysis of Probabilistic and Parametric Reduced Order Models","volume":"Volume 137","author":"Gunzburger","year":"2020","journal-title":"Quantification of Uncertainty: Improving Efficiency and Technology"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Dashti, M., and Stuart, A.M. (2017). The Bayesian Approach to Inverse Problems. Handbook of Uncertainty Quantification, Springer.","DOI":"10.1007\/978-3-319-12385-1_7"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1016\/j.engstruct.2012.12.029","article-title":"Parameter Identification in a Probabilistic Setting","volume":"50","author":"Pajonk","year":"2013","journal-title":"Eng. Struct."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"24","DOI":"10.1186\/s40323-016-0075-7","article-title":"Parameter estimation via conditional expectation: A Bayesian inversion","volume":"3","author":"Matthies","year":"2016","journal-title":"Adv. Model. Simul. Eng. Sci."},{"key":"ref_18","first-page":"245","article-title":"Inverse Problems in a Bayesian Setting","volume":"Volume 41","year":"2016","journal-title":"Computational Methods for Solids and Fluids\u2014Multiscale Analysis, Probability Aspects and Model Reduction"},{"key":"ref_19","unstructured":"Stein, E., de Borst, R., and Hughes, T.J.R. (2017). Uncertainty Quantification and Bayesian Inversion. Encyclopaedia of Computational Mechanics, John Wiley & Sons. [2nd ed.]. Part 1. Fundamentals. Encyclopaedia of Computational Mechanics."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bobrowski, A. (2005). Functional Analysis for Probability and Stochastic Processes, Cambridge University Press.","DOI":"10.1017\/CBO9780511614583"},{"key":"ref_21","unstructured":"Evensen, G. (2007). Data Assimilation: The Ensemble Kalman Filter, Springer."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"5761","DOI":"10.1016\/j.jcp.2012.04.044","article-title":"Sampling-free linear Bayesian update of polynomial chaos representations","volume":"231","author":"Litvinenko","year":"2012","journal-title":"J. Comput. Phys."},{"key":"ref_23","first-page":"775","article-title":"A Deterministic Filter for Non-Gaussian Bayesian Estimation\u2014Applications to dynamical system estimation with noisy measurements","volume":"241","author":"Pajonk","year":"2012","journal-title":"J. Phys."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Schmidhuber, J. (2014). Deep Learning in Neural Networks: An Overview. arXiv.","DOI":"10.1016\/j.neunet.2014.09.003"},{"key":"ref_25","unstructured":"Strang, G. (2019). Linear Algebra and Learning from Data, Wellesley-Cambridge Press."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"110","DOI":"10.1002\/nme.6202","article-title":"Physics-constrained non-Gaussian probabilistic learning on manifolds","volume":"121","author":"Soize","year":"2019","journal-title":"Int. J. Numer. Methods Eng."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"19","DOI":"10.1142\/S0219530518500203","article-title":"Deep learning in high dimension: Neural network expression rates for generalized polynomial chaos expansions in UQ","volume":"17","author":"Schwab","year":"2019","journal-title":"Anal. Appl."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"686","DOI":"10.1016\/j.jcp.2018.10.045","article-title":"Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations","volume":"378","author":"Raissi","year":"2019","journal-title":"J. Comput. Phys."},{"key":"ref_29","unstructured":"Fleuret, F. (2023). The Little Book of Deep Learning, v1.1.1 ed., Universit\u00e9 de Gen\u00e8ve."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Nelsen, N.H., and Stuart, A.M. (2024). Operator Learning using Random Features: A Tool for Scientific Computing. arXiv.","DOI":"10.1137\/24M1648703"},{"key":"ref_31","unstructured":"Murphy, K.P. (2012). Machine Learning: A Probabilistic Perspective, The MIT Press."},{"key":"ref_32","unstructured":"Kutyniok, G., Petersen, P., Raslan, M., and Schneider, R. (2019). A theoretical analysis of deep neural networks and parametric PDEs. arXiv."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Fresca, S., Dede, L., and Manzoni, A. (2020). A comprehensive deep learning-based approach to reduced order modeling of nonlinear time-dependent parametrized PDEs. arXiv.","DOI":"10.1007\/s10915-021-01462-7"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1137\/15M1025384","article-title":"Data assimilation in reduced modeling","volume":"5","author":"Binev","year":"2017","journal-title":"SIAM\/ASA J. Uncertain. Quantif."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"112883","DOI":"10.1016\/j.jcp.2024.112883","article-title":"Stochastic modelling of symmetric positive definite material tensors","volume":"505","author":"Shivanand","year":"2024","journal-title":"J. Comput. Phys."},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Berlinet, A., and Thomas-Agnan, C. (2004). Reproducing Kernel Hilbert Spaces in Probability and Statistics, Springer.","DOI":"10.1007\/978-1-4419-9096-9"},{"key":"ref_37","unstructured":"Stein, E., de Borst, R., and Hughes, T.J.R. (2007). Uncertainty Quantification with Stochastic Finite Elements. Encyclopaedia of Computational Mechanics, John Wiley & Sons. Part 1. Fundamentals. Encyclopaedia of Computational Mechanics."},{"key":"ref_38","unstructured":"Cohen, N., Sharir, O., and Shashua, A. (2016). On the Expressive Power of Deep Learning: A Tensor Analysis. arXiv."},{"key":"ref_39","unstructured":"Cohen, N., Sharir, O., Levine, Y., Tamari, R., Yakira, D., and Shashua, A. (2018). Analysis and Design of Convolutional Networks via Hierarchical Tensor Decompositions. arXiv."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Jaynes, E.T. (2003). Probability Theory, the Logic of Science, Cambridge University Press.","DOI":"10.1017\/CBO9780511790423"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"831","DOI":"10.1137\/23M1556435","article-title":"Bayesian inverse problems are usually well-posed","volume":"65","author":"Latz","year":"2023","journal-title":"SIAM Rev."},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Pollard, D. (2001). A User\u2019s Guide to Measure Theoretic Probability, Cambridge University Press.","DOI":"10.1017\/CBO9780511811555"},{"key":"ref_43","unstructured":"Matthies, H.G., Litvinenko, A., Rosi\u0107, B.V., and Zander, E. (2016). Bayesian Parameter Estimation via Filtering and Functional Approximations. arXiv."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"1349","DOI":"10.1137\/18M1196674","article-title":"Accurate computation of conditional expectation for highly non-linear problems","volume":"7","author":"Matthies","year":"2019","journal-title":"SIAM\/ASA J. Uncertain. Quantif."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1111\/1467-9868.00294","article-title":"Bayesian calibration of computer models","volume":"63","author":"Kennedy","year":"2001","journal-title":"J. R. Statist. Ser. B"},{"key":"ref_46","unstructured":"O\u2019Hagan, A., and West, M. (2010). The Oxford Handbook of Applied Bayesian Analysis, Oxford University Press."},{"key":"ref_47","doi-asserted-by":"crossref","unstructured":"Neal, R.M. (1995). Bayesian Learning for Neural Networks, Springer. LNS.","DOI":"10.1007\/978-1-4612-0745-0"},{"key":"ref_48","unstructured":"Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S.L., P\u00e9an, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., and Gomis, M.I. (2021). IPCC, 2021: Climate Change 2021: The Physical Science Basis, Cambridge University Press. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1016\/j.jmaa.2010.12.003","article-title":"A proper generalized decomposition for the solution of elliptic problems in abstract form by using a functional Eckart-Young approach","volume":"376","author":"Nouy","year":"2011","journal-title":"J. Math. Anal. Appl."},{"key":"ref_50","doi-asserted-by":"crossref","unstructured":"Batlle, P., Chen, Y., Hosseini, B., Owhadi, H., and Stuart, A.M. (2023). Error Analysis of Kernel\/GP Methods for Nonlinear and Parametric PDEs. arXiv.","DOI":"10.2139\/ssrn.4831053"},{"key":"ref_51","unstructured":"Yang, G., and Salman, H. (2020). A Fine-Grained Spectral Perspective on Neural Networks. arXiv."},{"key":"ref_52","unstructured":"Yang, G. (2021). Tensor Programs I: Wide Feedforward or Recurrent Neural Networks of Any Architecture are Gaussian Processes. arXiv."},{"key":"ref_53","doi-asserted-by":"crossref","unstructured":"Hackbusch, W. (2012). Tensor Spaces and Numerical Tensor Calculus, Springer.","DOI":"10.1007\/978-3-642-28027-6"},{"key":"ref_54","unstructured":"Dautray, R., and Lions, J.L. (1990). Spectral Theory and Applications, Springer. Mathematical Analysis and Numerical Methods for Science and Technology."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Kowalski, M.A., Sikorski, K.A., and Stenger, F. (1995). Selected Topics in Approximation and Computation, Oxford University Press.","DOI":"10.1093\/oso\/9780195080599.001.0001"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Floater, M.S., Manni, C., Sande, E., and Speleers, H. (2021). Best low-rank approximations and Kolmogorov n-widths. arXiv.","DOI":"10.1137\/20M1355720"}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/2\/58\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T16:38:00Z","timestamp":1760027880000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/13\/2\/58"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,2,19]]},"references-count":56,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2025,2]]}},"alternative-id":["computation13020058"],"URL":"https:\/\/doi.org\/10.3390\/computation13020058","relation":{},"ISSN":["2079-3197"],"issn-type":[{"type":"electronic","value":"2079-3197"}],"subject":[],"published":{"date-parts":[[2025,2,19]]}}}