{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,24]],"date-time":"2026-10-24T15:50:57Z","timestamp":1792857057214,"version":"4.5.0"},"reference-count":79,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2021,4,1]],"date-time":"2021-04-01T00:00:00Z","timestamp":1617235200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/100000185","name":"Defense Advanced Research Projects Agency","doi-asserted-by":"publisher","award":["W911NF-15-2-0121"],"award-info":[{"award-number":["W911NF-15-2-0121"]}],"id":[{"id":"10.13039\/100000185","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100000181","name":"Air Force Office of Scientific Research","doi-asserted-by":"crossref","award":["FA9550-12-1-81243"],"award-info":[{"award-number":["FA9550-12-1-81243"]}],"id":[{"id":"10.13039\/100000181","id-type":"DOI","asserted-by":"crossref"}]},{"name":"National Science Foundation","award":["ACI-1550593, ACI-1550547, CBET-1508713"],"award-info":[{"award-number":["ACI-1550593, ACI-1550547, CBET-1508713"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Math. Softw."],"published-print":{"date-parts":[[2021,6,30]]},"abstract":"<jats:p>We present an extensible software framework, hIPPYlib, for solution of large-scale deterministic and Bayesian inverse problems governed by partial differential equations (PDEs) with (possibly) infinite-dimensional parameter fields (which are high-dimensional after discretization). hIPPYlib overcomes the prohibitively expensive nature of Bayesian inversion for this class of problems by implementing state-of-the-art scalable algorithms for PDE-based inverse problems that exploit the structure of the underlying operators, notably the Hessian of the log-posterior. The key property of the algorithms implemented in hIPPYlib is that the solution of the inverse problem is computed at a cost, measured in linearized forward PDE solves, that is independent of the parameter dimension. The mean of the posterior is approximated by the MAP point, which is found by minimizing the negative log-posterior with an inexact matrix-free Newton-CG method. The posterior covariance is approximated by the inverse of the Hessian of the negative log posterior evaluated at the MAP point. The construction of the posterior covariance is made tractable by invoking a low-rank approximation of the Hessian of the log-likelihood. Scalable tools for sample generation are also discussed. hIPPYlib makes all of these advanced algorithms easily accessible to domain scientists and provides an environment that expedites the development of new algorithms.<\/jats:p>","DOI":"10.1145\/3428447","type":"journal-article","created":{"date-parts":[[2021,4,1]],"date-time":"2021-04-01T12:04:30Z","timestamp":1617278670000},"page":"1-34","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":86,"title":["hIPPYlib"],"prefix":"10.1145","volume":"47","author":[{"given":"Umberto","family":"Villa","sequence":"first","affiliation":[{"name":"Washington University in St. Louis, MO, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Noemi","family":"Petra","sequence":"additional","affiliation":[{"name":"University of California, Merced, CA, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Omar","family":"Ghattas","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, TX, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2021,4]]},"reference":[{"key":"e_1_2_1_1_1","unstructured":"Brian M. Adams W. J. Bohnhoff K. R. Dalbey J. P. Eddy M. S. Eldred D. M. Gay K. Haskell Patricia D. Hough and L. P. Swiler. 2009. DAKOTA A Multilevel Parallel Object-oriented Framework for Design Optimization Parameter Estimation Uncertainty Quantification and Sensitivity Analysis: Version 5.0 User\u2019s Manual. Technical Report."},{"key":"e_1_2_1_2_1","volume-title":"Parallel Processing for Scientific Computing","author":"Ak\u00e7elik Volkan","unstructured":"Volkan Ak\u00e7elik, George Biros, Omar Ghattas, Judith Hill, David Keyes, and Bart van Bloeman Waanders. 2006. Parallel PDE-constrained optimization. In Parallel Processing for Scientific Computing, M. Heroux, P. Raghaven, and H. Simon (Eds.). SIAM."},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.1137\/130933381"},{"key":"e_1_2_1_4_1","doi-asserted-by":"publisher","DOI":"10.1137\/140992564"},{"key":"e_1_2_1_5_1","volume-title":"Karl Rupp, Barry F. Smith, and Hong Zhang.","author":"Balay Satish","year":"2014","unstructured":"Satish Balay, Shrirang Abhyankar, Mark F. Adams, Jed Brown, Peter Brune, Kris Buschelman, Victor Eijkhout, William D. Gropp, Dinesh Kaushik, Matthew G. Knepley, Lois Curfman McInnes, Karl Rupp, Barry F. Smith, and Hong Zhang. 2014. PETSc Web page. http:\/\/www.mcs.anl.gov\/petsc."},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1145\/1268776.1268779"},{"key":"e_1_2_1_7_1","doi-asserted-by":"publisher","DOI":"10.1007\/s00607-008-0003-x"},{"key":"e_1_2_1_8_1","volume-title":"Finite Elements: An Introduction","author":"Becker E. B.","year":"1981","unstructured":"E. B. Becker, G. F. Carey, and J. T. Oden. 1981. Finite Elements: An Introduction, Vol I. Prentice Hall, Englewoods Cliffs, New Jersey."},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.apnum.2007.01.003"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2016.12.041"},{"key":"e_1_2_1_11_1","doi-asserted-by":"crossref","unstructured":"Alfio Borz\u00ec and Volker Schulz. 2012. Computational Optimization of Systems Governed by Partial Differential Equations. SIAM.","DOI":"10.1137\/1.9781611972054"},{"key":"e_1_2_1_12_1","volume-title":"Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC\u201912)","author":"Bui-Thanh Tan","unstructured":"Tan Bui-Thanh, Carsten Burstedde, Omar Ghattas, James Martin, Georg Stadler, and Lucas C. Wilcox. 2012. Extreme-scale UQ for Bayesian inverse problems governed by PDEs. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC\u201912). Gordon Bell Prize finalist."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/28\/5\/055002"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1137\/12089586X"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/30\/11\/114014"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1216\/jiea\/1181075914"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1137\/090778250"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2017.08.016"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2019.01.047"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1137\/130920587"},{"key":"e_1_2_1_21_1","unstructured":"COMSOL AB. 2009. COMSOL Multiphysics Reference Guide. http:\/\/www.comsol.com."},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1137\/18M1175239"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2015.10.008"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/30\/11\/114015"},{"key":"e_1_2_1_25_1","doi-asserted-by":"publisher","DOI":"10.1088\/0266-5611\/30\/11\/114015"},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.3934\/ipi.2018045"},{"key":"e_1_2_1_27_1","doi-asserted-by":"publisher","unstructured":"B. Debusschere K. Sargsyan C. Safta and K. Chowdhary. 2017. Uncertainty Quantification Toolkit (UQTk). Springer International Publishing 1807--1827. DOI:https:\/\/doi.org\/10.1007\/978-3-319-12385-1_56","DOI":"10.1007\/978-3-319-12385-1_56"},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1137\/0917003"},{"key":"e_1_2_1_29_1","volume-title":"Technical Report SAND2001-3796. Sandia National Laboratories.","author":"Eldred M. S.","year":"2002","unstructured":"M. S. Eldred, A. A. Giunta, B. G. van Bloemen Waanders, S. F. Wojkiewicz, W. E. Hart Jr., and M. P. Alleva. 2002. DAKOTA, A Multilevel Parallel Object-Oriented Framework for Design Optimization, Parameter Estimation, Uncertainty Quantification, and Sensitivity Analysis. Version 3.0 Reference Manual. Technical Report SAND2001-3796. Sandia National Laboratories."},{"key":"e_1_2_1_30_1","volume-title":"Regularization of Inverse Problems","author":"Engl Heinz W.","unstructured":"Heinz W. Engl, Martin Hanke, and Andreas Neubauer. 1996. Regularization of Inverse Problems. Springer Netherlands."},{"key":"e_1_2_1_31_1","doi-asserted-by":"crossref","unstructured":"M. Evans and T. Swartz. 2000. Approximating Integrals Via MOnte Carlo and Deterministic Methods. Vol. 20. OUP Oxford.","DOI":"10.1093\/oso\/9780198502784.001.0001"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1137\/120873558"},{"key":"e_1_2_1_33_1","unstructured":"Pearl H. Flath. 2013. Hessian-based Response Surface Approximations for Uncertainty Quantification in Large-scale Statistical Inverse Problems with Applications to Groundwater Flow. Ph.D. Dissertation. The University of Texas at Austin."},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1137\/090780717"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1137\/090771806"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1137\/0803005"},{"key":"e_1_2_1_37_1","doi-asserted-by":"publisher","DOI":"10.1145\/1089014.1089021"},{"key":"e_1_2_1_38_1","doi-asserted-by":"publisher","DOI":"10.1002\/2013JB010272"},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1016\/0045-7825(89)90111-4"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2015.04.047"},{"key":"e_1_2_1_41_1","volume-title":"Statistical and Computational Inverse Problems. Applied Mathematical Sciences","author":"Kaipio Jari","unstructured":"Jari Kaipio and Erkki Somersalo. 2005. Statistical and Computational Inverse Problems. Applied Mathematical Sciences, Vol. 160. Springer-Verlag, New York. xvi+339 pages."},{"key":"e_1_2_1_42_1","unstructured":"D. Kouri D. Ridzal and G. von Wickel. 2018. Rapid Optimization Library (ROL). https:\/\/trilinos.org\/packages\/rol\/."},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-52462-7"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2011.00777.x"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23099-8"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2015.03.021"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2013.02.017"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.cma.2014.12.008"},{"key":"e_1_2_1_49_1","unstructured":"B. R. Lowery and J. Langou. 2014. Stability analysis of QR factorization in an oblique inner product. ArXiv E-prints (jan 2014). arxiv:math.NA\/1401.5171"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1137\/110845598"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","unstructured":"D. McDougall N. Malaya and R. D. Moser. 2017. The Parallel C++ Statistical Library for Bayesian Inference: QUESO. Springer International Publishing 1829--1865. DOI:https:\/\/doi.org\/10.1007\/978-3-319-12385-1_57","DOI":"10.1007\/978-3-319-12385-1_57"},{"key":"e_1_2_1_52_1","article-title":"Docker: Lightweight Linux containers for consistent development and deployment","volume":"2014","author":"Merkel Dirk","year":"2014","unstructured":"Dirk Merkel. 2014. Docker: Lightweight Linux containers for consistent development and deployment. Linux Journal 2014, 239, Article 2 (2014). http:\/\/dl.acm.org\/citation.cfm?id&equals;2600239.2600241","journal-title":"Linux Journal"},{"key":"e_1_2_1_53_1","doi-asserted-by":"publisher","DOI":"10.1137\/110831404"},{"key":"e_1_2_1_54_1","unstructured":"M. Parno A. Davis P. Conrad and Y. M. Marzouk. 2012--2015. MIT Uncertainty Quantification (MUQ) library. https:\/\/bitbucket.org\/mituq\/muq."},{"key":"e_1_2_1_55_1","doi-asserted-by":"publisher","DOI":"10.1137\/130934805"},{"key":"e_1_2_1_56_1","doi-asserted-by":"crossref","unstructured":"Noemi Petra and Georg Stadler. 2011. Model Variational Inverse Problems Governed by Partial Differential Equations. Technical Report 11-05. The Institute for Computational Engineering and Sciences The University of Texas at Austin.","DOI":"10.21236\/ADA555315"},{"key":"e_1_2_1_57_1","volume-title":"Subjective and Objective Bayesian Statistics: Principles, Methods and Applications","author":"Press S. J.","unstructured":"S. J. Press. 2003. Subjective and Objective Bayesian Statistics: Principles, Methods and Applications. Wiley, New York."},{"key":"e_1_2_1_58_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-29737-3_44"},{"key":"e_1_2_1_59_1","doi-asserted-by":"publisher","DOI":"10.3934\/ipi.2014.8.561"},{"key":"e_1_2_1_60_1","doi-asserted-by":"publisher","DOI":"10.1137\/16M1081063"},{"key":"e_1_2_1_61_1","doi-asserted-by":"publisher","DOI":"10.1002\/nla.2026"},{"key":"e_1_2_1_62_1","doi-asserted-by":"publisher","DOI":"10.1051\/m2an\/2016005"},{"key":"e_1_2_1_63_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02591944"},{"key":"e_1_2_1_64_1","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177013620"},{"key":"e_1_2_1_65_1","unstructured":"G. Strang and G. J. Fix. 1988. An Analysis of the Finite Element Method. Wellesley-Cambridge Press Wellesley MA."},{"key":"e_1_2_1_66_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0962492910000061"},{"key":"e_1_2_1_67_1","doi-asserted-by":"publisher","DOI":"10.1002\/nla.779"},{"key":"e_1_2_1_68_1","volume-title":"Inverse Problem Theory and Methods for Model Parameter Estimation","author":"Tarantola Albert","unstructured":"Albert Tarantola. 2005. Inverse Problem Theory and Methods for Model Parameter Estimation. SIAM, Philadelphia, PA. xii+342 pages."},{"key":"e_1_2_1_69_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1986.10478240"},{"key":"e_1_2_1_70_1","unstructured":"A. N. Tikhonov and V. A. Arsenin. 1977. Solution of Ill-posed Problems. Winston & Sons."},{"key":"e_1_2_1_71_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-12385-1_53"},{"key":"e_1_2_1_72_1","doi-asserted-by":"publisher","DOI":"10.1090\/gsm\/112"},{"key":"e_1_2_1_73_1","doi-asserted-by":"publisher","unstructured":"Umberto Villa Noemi Petra and Omar Ghattas. 2020. hIPPYlib User Manual: Version 2. DOI:https:\/\/doi.org\/10.6084\/m9.figshare.12510578","DOI":"10.6084\/m9.figshare.12510578"},{"key":"e_1_2_1_74_1","volume-title":"Computational Methods for Inverse Problems","author":"Vogel Curt R.","unstructured":"Curt R. Vogel. 2002. Computational Methods for Inverse Problems. Society for Industrial and Applied Mathematics (SIAM), Philadelphia, PA. xvi+183 pages."},{"key":"e_1_2_1_75_1","doi-asserted-by":"publisher","DOI":"10.1137\/16M1060625"},{"key":"e_1_2_1_76_1","volume-title":"Probability with Martingales","author":"Williams David","unstructured":"David Williams. 1991. Probability with Martingales. Cambridge University Press."},{"key":"e_1_2_1_77_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898719260"},{"key":"e_1_2_1_78_1","unstructured":"Jennifer Worthen. 2012. Inverse Problems in Mantle Convection: Models Algorithms and Applications. Ph.D. Dissertation. The University of Texas at Austin."},{"key":"e_1_2_1_79_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.pepi.2014.06.006"}],"container-title":["ACM Transactions on Mathematical Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3428447","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3428447","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3428447","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,14]],"date-time":"2025-07-14T22:26:38Z","timestamp":1752531998000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3428447"}},"subtitle":["An Extensible Software Framework for Large-Scale Inverse Problems Governed by PDEs: Part I: Deterministic Inversion and Linearized Bayesian Inference"],"short-title":[],"issued":{"date-parts":[[2021,4]]},"references-count":79,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2021,6,30]]}},"alternative-id":["10.1145\/3428447"],"URL":"https:\/\/doi.org\/10.1145\/3428447","relation":{},"ISSN":["0098-3500","1557-7295"],"issn-type":[{"value":"0098-3500","type":"print"},{"value":"1557-7295","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,4]]},"assertion":[{"value":"2019-09-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2020-10-01","order":2,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-04-01","order":3,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}