{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,4]],"date-time":"2025-11-04T11:01:27Z","timestamp":1762254087124,"version":"build-2065373602"},"reference-count":41,"publisher":"MDPI AG","issue":"3","license":[{"start":{"date-parts":[[2022,3,11]],"date-time":"2022-03-11T00:00:00Z","timestamp":1646956800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000001","name":"National Science Foundation","doi-asserted-by":"publisher","award":["NSF-2108320, NSF-1808576 and NSF-CAREER-1845799;"],"award-info":[{"award-number":["NSF-2108320, NSF-1808576 and NSF-CAREER-1845799;"]}],"id":[{"id":"10.13039\/100000001","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000015","name":"United States Department of Energy","doi-asserted-by":"publisher","award":["DE-SC0018147 and DE-26083989"],"award-info":[{"award-number":["DE-SC0018147 and DE-26083989"]}],"id":[{"id":"10.13039\/100000015","id-type":"DOI","asserted-by":"publisher"}]},{"name":"UT-Portugal CoLab","award":["2020 ConTex"],"award-info":[{"award-number":["2020 ConTex"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Computation"],"abstract":"<jats:p>This paper presents a regularization framework that aims to improve the fidelity of Tikhonov inverse solutions. At the heart of the framework is the data-informed regularization idea that only data-uninformed parameters need to be regularized, while the data-informed parameters, on which data and forward model are integrated, should remain untouched. We propose to employ the active subspace method to determine the data-informativeness of a parameter. The resulting framework is thus called a data-informed (DI) active subspace (DIAS) regularization. Four proposed DIAS variants are rigorously analyzed, shown to be robust with the regularization parameter and capable of avoiding polluting solution features informed by the data. They are thus well suited for problems with small or reasonably small noise corruptions in the data. Furthermore, the DIAS approaches can effectively reuse any Tikhonov regularization codes\/libraries. Though they are readily applicable for nonlinear inverse problems, we focus on linear problems in this paper in order to gain insights into the framework. Various numerical results for linear inverse problems are presented to verify theoretical findings and to demonstrate advantages of the DIAS framework over the Tikhonov, truncated SVD, and the TSVD-based DI approaches.<\/jats:p>","DOI":"10.3390\/computation10030038","type":"journal-article","created":{"date-parts":[[2022,3,11]],"date-time":"2022-03-11T12:58:36Z","timestamp":1647003516000},"page":"38","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["DIAS: A Data-Informed Active Subspace Regularization Framework for Inverse Problems"],"prefix":"10.3390","volume":"10","author":[{"given":"Hai","family":"Nguyen","sequence":"first","affiliation":[{"name":"Department of Aerospace Engineering and Engineering Mechanics, UT Austin, Austin, TX 78712, USA"}]},{"given":"Jonathan","family":"Wittmer","sequence":"additional","affiliation":[{"name":"The Oden Institute of Computational Engineering and Sciences, UT Austin, Austin, TX 78712, USA"}]},{"given":"Tan","family":"Bui-Thanh","sequence":"additional","affiliation":[{"name":"Department of Aerospace Engineering and Engineering Mechanics, The Oden Institute for Computational Engineering and Sciences, UT Austin, Austin, TX 78712, USA"}]}],"member":"1968","published-online":{"date-parts":[[2022,3,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Natterer, F. (2001). The Mathematics of Computerized Tomography, SIAM.","DOI":"10.1137\/1.9780898719284"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Natterer, F., and W\u00fcbbeling, F. (2001). Mathematical Methods in Image Reconstruction, SIAM.","DOI":"10.1137\/1.9780898718324"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"217","DOI":"10.1137\/0323017","article-title":"Identification of parameters in distributed parameter systems by regularization","volume":"23","author":"Kravaris","year":"1985","journal-title":"SIAM J. Control. Optim."},{"key":"ref_4","unstructured":"Banks, H.T., and Kunisch, K. (2012). Estimation Techniques for Distributed Parameter Systems, Springer."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"A2494","DOI":"10.1137\/12089586X","article-title":"A computational framework for infinite-dimensional Bayesian inverse problems Part I: The linearized case, with application to global seismic inversion","volume":"35","author":"Ghattas","year":"2013","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Bui-Thanh, T., Burstedde, C., Ghattas, O., Martin, J., Stadler, G., and Wilcox, L.C. (2012, January 10\u201316). Extreme-scale UQ for Bayesian inverse problems governed by PDEs. Proceedings of the SC\u201912: International Conference on High Performance Computing, Networking, Storage and Analysis, Salt Lake City, UT, USA.","DOI":"10.1109\/SC.2012.56"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Colton, D., and Kress, R. (1998). Inverse Acoustic and Electromagnetic Scattering, Springer. [2nd ed.]. Applied Mathematical Sciences.","DOI":"10.1007\/978-3-662-03537-5"},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Hansen, P.C. (2010). Discrete Inverse Problems: Insight and Algorithms, SIAM.","DOI":"10.1137\/1.9780898718836"},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Mueller, J.L., and Siltanen, S. (2012). Linear and Nonlinear Inverse Problems with Practical Applications, Society for Industrial and Applied Mathematics.","DOI":"10.1137\/1.9781611972344"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"259","DOI":"10.1016\/0167-2789(92)90242-F","article-title":"Nonlinear total variation based noise removal algorithms","volume":"60","author":"Rudin","year":"1992","journal-title":"Physica D"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2419","DOI":"10.1109\/TIP.2009.2028250","article-title":"Fast Gradient-Based Algorithms for Constrained Total Variation Image Denoising and Deblurring Problems","volume":"18","author":"Beck","year":"2009","journal-title":"IEEE Trans. Image Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1023\/B:JMIV.0000035180.40477.bd","article-title":"Weakly Constrained Minimization: Application to the Estimation of Images and Signals Involving Constant Regions","volume":"21","author":"Nikolova","year":"2004","journal-title":"J. Math. Imaging Vis."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"323","DOI":"10.1137\/080725891","article-title":"The slit Bregman method for L1-regularized problems","volume":"2","author":"Goldstein","year":"2009","journal-title":"SIAM J. Imaging Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2157","DOI":"10.1118\/1.3560878","article-title":"Nonconvex prior image constrained compressed sensing (NCPICCS): Theory and simulations on perfusion CT","volume":"38","author":"Trzasko","year":"2011","journal-title":"Med. Phys."},{"key":"ref_15","unstructured":"Babacan, S.D., Mancera, L., Molina, R., and Katsaggelos, A.K. (2009, January 24\u201328). Non-convex priors in Bayesian compressed sensing. Proceedings of the 2009 17th European Signal Processing Conference, Glasgow, UK."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"960","DOI":"10.1137\/040619582","article-title":"Analysis of the recovery of edges in images and signals by minimizing nonconvex regularized least-squares","volume":"4","author":"Nikolova","year":"2005","journal-title":"Multiscale Model. Simul."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Chartrand, R., and Wohlberg, B. (2013, January 26\u201331). A Nonconvex ADMM Algorithm for Group Sparsity with Sparse Groups. Proceedings of the 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, Vancouver, BC, Canada.","DOI":"10.1109\/ICASSP.2013.6638818"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"2183","DOI":"10.1137\/120878951","article-title":"Local linear convergence of the alternating direction method of multipliers on quadratic or linear programs","volume":"23","author":"Boley","year":"2013","journal-title":"SIAM J. Optim."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1561\/2200000016","article-title":"Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers","volume":"3","author":"Boyd","year":"2010","journal-title":"Found. Trends Mach. Learn."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Chartrand, R., and Yin, W. (April, January 31). Iteratively reweighted algorithms for compressive sensing. Proceedings of the 2008 IEEE International Conference on Acoustics, Speech and Signal Processing, Las Vegas, NV, USA.","DOI":"10.1109\/ICASSP.2008.4518498"},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Wittmer, J., and Bui-Thanh, T. (2021). Data-Informed Regularization for Inverse and Imaging Problems. Handbook of Mathematical Models and Algorithms in Computer Vision and Imaging, Springer International Publishing.","DOI":"10.1007\/978-3-030-03009-4_77-1"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"A1500","DOI":"10.1137\/130916138","article-title":"Active subspace methods in theory and practice: Applications to kriging surfaces","volume":"36","author":"Constantine","year":"2014","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.jcp.2015.09.001","article-title":"Exploiting active subspaces to quantify uncertainty in the numerical simulation of the HyShot II scramjet","volume":"302","author":"Constantine","year":"2015","journal-title":"J. Comput. Phys."},{"key":"ref_24","first-page":"141","article-title":"A modified SEIR model for the spread of Ebola in Western Africa and metrics for resource allocation","volume":"324","author":"Diaz","year":"2018","journal-title":"Appl. Math. Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"264","DOI":"10.1002\/sam.11281","article-title":"Discovering an active subspace in a single-diode solar cell model","volume":"8","author":"Constantine","year":"2015","journal-title":"Stat. Anal. Data Mining Asa Data Sci. J."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1096","DOI":"10.1137\/19M1296070","article-title":"Active subspace of neural networks: Structural analysis and universal attacks","volume":"2","author":"Cui","year":"2020","journal-title":"SIAM J. Math. Data Sci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"A929","DOI":"10.1137\/18M1214123","article-title":"Multifidelity dimension reduction via active subspaces","volume":"42","author":"Lam","year":"2020","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"A2779","DOI":"10.1137\/15M1042127","article-title":"Accelerating Markov chain Monte Carlo with active subspaces","volume":"38","author":"Constantine","year":"2016","journal-title":"SIAM J. Sci. Comput."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1016\/j.crme.2019.11.012","article-title":"A non-intrusive approach for the reconstruction of POD modal coefficients through active subspaces","volume":"347","author":"Demo","year":"2019","journal-title":"Comptes Rendus M\u00e9canique"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"114199","DOI":"10.1016\/j.cma.2021.114199","article-title":"Derivative-informed projected neural networks for high-dimensional parametric maps governed by PDEs","volume":"388","author":"Villa","year":"2022","journal-title":"Comput. Methods Appl. Mech. Eng."},{"key":"ref_31","first-page":"473","article-title":"On Relationships between Uncentred and Column-Centred Principal Component Analysis","volume":"25","author":"Cadima","year":"2009","journal-title":"Pak. J. Stat."},{"key":"ref_32","unstructured":"Honeine, P. (2014). An eigenanalysis of data centering in machine learning. arXiv."},{"key":"ref_33","first-page":"20150202","article-title":"Principal component analysis: A review and recent developments","volume":"374","author":"Jolliffe","year":"2016","journal-title":"Philos. Trans. R. Soc. Math. Phys. Eng. Sci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1186\/s40965-017-0028-1","article-title":"Remote sensing of burned areas via PCA, Part 1; centering, scaling and EVD vs. SVD","volume":"2","author":"Alexandris","year":"2017","journal-title":"Open Geospat. Data Softw. Stand."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1137\/1015032","article-title":"Some Modified Matrix Eigenvalue Problems","volume":"15","author":"Golub","year":"1973","journal-title":"SIAM Rev."},{"key":"ref_36","unstructured":"Wilkinson, J. (1965). The Algebraic Eigenvalue Problem, Claredon Press."},{"key":"ref_37","doi-asserted-by":"crossref","unstructured":"Kirsch, A. (2011). An Introduction to the Mathematical Theory of Inverse Problems, Springer. [2nd ed.]. Applied Mathematical Sciences.","DOI":"10.1007\/978-1-4419-8474-6"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/s11075-007-9136-9","article-title":"Regularization tools version 4.0 for Matlab 7.3","volume":"46","author":"Hansen","year":"2007","journal-title":"Numer. Algorithms"},{"key":"ref_39","unstructured":"Calvetti, D., and Somersalo, E. (2007). An Introduction to Bayesian Scientific Computing: Ten Lectures on Subjective Computing, Springer."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1016\/0022-247X(72)90259-4","article-title":"Improvement of the resolution of an instrument by numerical solution of an integral equation","volume":"37","author":"Shaw","year":"1972","journal-title":"J. Math. Anal. Appl."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1016\/j.cam.2005.10.038","article-title":"Preconditioned iterative methods for linear discrete ill-posed problems from a Bayesian inversion perspective","volume":"2","author":"Calvetti","year":"2007","journal-title":"J. Comp. Appl. Math."}],"container-title":["Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2079-3197\/10\/3\/38\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:35:08Z","timestamp":1760135708000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2079-3197\/10\/3\/38"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,11]]},"references-count":41,"journal-issue":{"issue":"3","published-online":{"date-parts":[[2022,3]]}},"alternative-id":["computation10030038"],"URL":"https:\/\/doi.org\/10.3390\/computation10030038","relation":{},"ISSN":["2079-3197"],"issn-type":[{"type":"electronic","value":"2079-3197"}],"subject":[],"published":{"date-parts":[[2022,3,11]]}}}