{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,4]],"date-time":"2026-02-04T18:04:49Z","timestamp":1770228289076,"version":"3.49.0"},"reference-count":74,"publisher":"Association for Computing Machinery (ACM)","issue":"2","license":[{"start":{"date-parts":[[2023,6,15]],"date-time":"2023-06-15T00:00:00Z","timestamp":1686787200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"name":"U.S. National Science Foundation, Software Infrastructure for Sustained Innovation (SI2: SSE & SSI) Program","award":["ACI-1550593, ACI-1550547, and ACI-1550487"],"award-info":[{"award-number":["ACI-1550593, ACI-1550547, and ACI-1550487"]}]},{"name":"Division of Mathematical Sciences under the CAREER","award":["1654311"],"award-info":[{"award-number":["1654311"]}]},{"DOI":"10.13039\/100000006","name":"Office of Naval Research MURI","doi-asserted-by":"crossref","award":["N00014-20-1-2595"],"award-info":[{"award-number":["N00014-20-1-2595"]}],"id":[{"id":"10.13039\/100000006","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Department of Energy Advanced Scientific Computing Research","award":["DE-SC0021239 and DE-SC0019303"],"award-info":[{"award-number":["DE-SC0021239 and DE-SC0019303"]}]},{"name":"National Science Foundation","award":["ACI-1429783"],"award-info":[{"award-number":["ACI-1429783"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Math. Softw."],"published-print":{"date-parts":[[2023,6,30]]},"abstract":"<jats:p>Bayesian inference provides a systematic framework for integration of data with mathematical models to quantify the uncertainty in the solution of the inverse problem. However, the solution of Bayesian inverse problems governed by complex forward models described by<jats:bold>partial differential equations (PDEs)<\/jats:bold>remains prohibitive with black-box<jats:bold>Markov chain Monte Carlo (MCMC)<\/jats:bold>methods. We present hIPPYlib-MUQ, an extensible and scalable software framework that contains implementations of state-of-the art algorithms aimed to overcome the challenges of high-dimensional, PDE-constrained Bayesian inverse problems. These algorithms accelerate MCMC sampling by exploiting the geometry and intrinsic low-dimensionality of parameter space via derivative information and low rank approximation. The software integrates two complementary open-source software packages, hIPPYlib and MUQ. hIPPYlib solves PDE-constrained inverse problems using automatically-generated adjoint-based derivatives, but it lacks full Bayesian capabilities. MUQ provides a spectrum of powerful Bayesian inversion models and algorithms, but expects forward models to come equipped with gradients and Hessians to permit large-scale solution. By combining these two complementary libraries, we created a robust, scalable, and efficient software framework that realizes the benefits of each and allows us to tackle complex large-scale Bayesian inverse problems across a broad spectrum of scientific and engineering disciplines. To illustrate the capabilities of hIPPYlib-MUQ, we present a comparison of a number of MCMC methods available in the integrated software on several high-dimensional Bayesian inverse problems. These include problems characterized by both linear and nonlinear PDEs, various noise models, and different parameter dimensions. The results demonstrate that large (\u223c 50\u00d7) speedups over conventional black box and gradient-based MCMC algorithms can be obtained by exploiting Hessian information (from the log-posterior), underscoring the power of the integrated hIPPYlib-MUQ framework.<\/jats:p>","DOI":"10.1145\/3580278","type":"journal-article","created":{"date-parts":[[2023,2,9]],"date-time":"2023-02-09T13:46:20Z","timestamp":1675950380000},"page":"1-31","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":11,"title":["hIPPYlib-MUQ: A Bayesian Inference Software Framework for Integration of Data with Complex Predictive Models under Uncertainty"],"prefix":"10.1145","volume":"49","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5772-2317","authenticated-orcid":false,"given":"Ki-Tae","family":"Kim","sequence":"first","affiliation":[{"name":"University of California, Merced, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5142-2559","authenticated-orcid":false,"given":"Umberto","family":"Villa","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9419-2693","authenticated-orcid":false,"given":"Matthew","family":"Parno","sequence":"additional","affiliation":[{"name":"Dartmouth College, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8242-3290","authenticated-orcid":false,"given":"Youssef","family":"Marzouk","sequence":"additional","affiliation":[{"name":"Massachusetts Institute of Technology, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-7742-2509","authenticated-orcid":false,"given":"Omar","family":"Ghattas","sequence":"additional","affiliation":[{"name":"The University of Texas at Austin, USA"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9491-0034","authenticated-orcid":false,"given":"Noemi","family":"Petra","sequence":"additional","affiliation":[{"name":"University of California, Merced, USA"}]}],"member":"320","published-online":{"date-parts":[[2023,6,15]]},"reference":[{"key":"e_1_3_2_2_1","volume-title":"Parallel Processing for Scientific Computing","author":"Ak\u00e7elik Volkan","year":"2006","unstructured":"Volkan Ak\u00e7elik, George Biros, Omar Ghattas, Judith Hill, David Keyes, and Bart van Bloeman Waanders. 2006. Parallel PDE-constrained optimization. In Parallel Processing for Scientific Computing, M. Heroux, P. Raghaven, and H. Simon (Eds.). SIAM."},{"key":"e_1_3_2_3_1","doi-asserted-by":"publisher","DOI":"10.1137\/18M1189324"},{"key":"e_1_3_2_4_1","doi-asserted-by":"publisher","DOI":"10.1137\/19M1270367"},{"key":"e_1_3_2_5_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11009-006-8550-0"},{"key":"e_1_3_2_6_1","article-title":"PETSc Web page","author":"Balay Satish","year":"2018","unstructured":"Satish Balay, Shrirang Abhyankar, Mark F. Adams, Jed Brown, Peter Brune, Kris Buschelman, Lisandro Dalcin, Alp Dener, Victorand Eijkhout, William D. Gropp, Dinesh Kaushik, Matthew G. Knepley, Dave A. May, Lois Curfman McInnes, Richard Tran Mills, Todd Munson, Karl Rupp, Patrick Sanan, Barry F. Smith, Stefano Zampini, and Hong Zhang. 2018. PETSc Web page. http:\/\/www.mcs.anl.gov\/petsc. http:\/\/www.mcs.anl.gov\/petsc.","journal-title":"http:\/\/www.mcs.anl.gov\/petsc"},{"key":"e_1_3_2_7_1","article-title":"PETSc Web page","author":"Balay Satish","year":"2014","unstructured":"Satish Balay, Shrirang Abhyankar, Mark F. Adams, Jed Brown, Peter Brune, Kris Buschelman, Victor Eijkhout, William D. Gropp, Dinesh Kaushik, Matthew G. Knepley, Lois Curfman McInnes, Karl Rupp, Barry F. Smith, and Hong Zhang. 2014. PETSc Web page. http:\/\/www.mcs.anl.gov\/petsc. http:\/\/www.mcs.anl.gov\/petsc.","journal-title":"http:\/\/www.mcs.anl.gov\/petsc"},{"key":"e_1_3_2_8_1","doi-asserted-by":"publisher","DOI":"10.1137\/19M1245220"},{"key":"e_1_3_2_9_1","volume-title":"Finite Elements: An Introduction, Vol I","author":"Becker E. B.","year":"1981","unstructured":"E. B. Becker, G. F. Carey, and J. T. Oden. 1981. Finite Elements: An Introduction, Vol I. Prentice Hall, Englewoods Cliffs, New Jersey."},{"key":"e_1_3_2_10_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2016.12.041"},{"key":"e_1_3_2_11_1","doi-asserted-by":"publisher","DOI":"10.5555\/2181144"},{"key":"e_1_3_2_12_1","doi-asserted-by":"publisher","DOI":"10.1080\/10618600.1998.10474787"},{"key":"e_1_3_2_13_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10915-010-9396-8"},{"key":"e_1_3_2_14_1","doi-asserted-by":"publisher","DOI":"10.5555\/2388996.2389000"},{"key":"e_1_3_2_15_1","doi-asserted-by":"publisher","DOI":"10.1137\/12089586X"},{"key":"e_1_3_2_16_1","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1408184111"},{"issue":"3","key":"e_1_3_2_17_1","doi-asserted-by":"crossref","first-page":"167","DOI":"10.1080\/00031305.1992.10475878","article-title":"Explaining the Gibbs sampler","volume":"46","author":"Casella George","year":"1992","unstructured":"George Casella and Edward I. George. 1992. Explaining the Gibbs sampler. The American Statistician 46, 3 (1992), 167\u2013174.","journal-title":"The American Statistician"},{"key":"e_1_3_2_18_1","doi-asserted-by":"publisher","DOI":"10.1137\/120890715"},{"key":"e_1_3_2_19_1","doi-asserted-by":"crossref","unstructured":"S. L. Cotter G. O. Roberts A. M. Stuart and D. White. 2012. MCMC methods for functions: Modifying old algorithms to make them faster. (2012). submitted.","DOI":"10.1214\/13-STS421"},{"key":"e_1_3_2_20_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2015.10.008"},{"key":"e_1_3_2_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2016.03.055"},{"key":"e_1_3_2_22_1","doi-asserted-by":"publisher","DOI":"10.1088\/1361-6420\/abeafb"},{"key":"e_1_3_2_23_1","doi-asserted-by":"publisher","DOI":"10.3934\/ipi.2018045"},{"key":"e_1_3_2_24_1","doi-asserted-by":"publisher","DOI":"10.1137\/19M126966X"},{"key":"e_1_3_2_25_1","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780198502784.001.0001","volume-title":"Approximating Integrals via Monte Carlo and Deterministic Methods","author":"Evans M.","year":"2000","unstructured":"M. Evans and T. Swartz. 2000. Approximating Integrals via Monte Carlo and Deterministic Methods. Vol. 20. OUP Oxford."},{"key":"e_1_3_2_26_1","doi-asserted-by":"publisher","DOI":"10.1214\/09-AOS735"},{"key":"e_1_3_2_27_1","doi-asserted-by":"crossref","unstructured":"Andrew Gelman John B. Carlin Hal S. Stern and Donald B. Rubin. 2004. Bayesian data analysis.","DOI":"10.1201\/9780429258480"},{"key":"e_1_3_2_28_1","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177011136"},{"key":"e_1_3_2_29_1"},{"key":"e_1_3_2_30_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2010.00765.x"},{"key":"e_1_3_2_31_1","doi-asserted-by":"publisher","DOI":"10.5555\/248979"},{"key":"e_1_3_2_32_1","doi-asserted-by":"publisher","DOI":"10.2307\/3318737"},{"key":"e_1_3_2_33_1","doi-asserted-by":"publisher","DOI":"10.1214\/13-AAP982"},{"key":"e_1_3_2_34_1","doi-asserted-by":"publisher","DOI":"10.1137\/090771806"},{"key":"e_1_3_2_35_1","doi-asserted-by":"publisher","DOI":"10.1109\/MLSP.2010.5589113"},{"key":"e_1_3_2_36_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/57.1.97"},{"issue":"1","key":"e_1_3_2_37_1","first-page":"1593","article-title":"The no-U-turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo.","volume":"15","author":"Hoffman Matthew D.","year":"2014","unstructured":"Matthew D. Hoffman and Andrew Gelman. 2014. The no-U-turn sampler: Adaptively setting path lengths in Hamiltonian Monte Carlo. Journal of Machine Learning Research 15, 1 (2014), 1593\u20131623.","journal-title":"Journal of Machine Learning Research"},{"key":"e_1_3_2_38_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.jcp.2015.04.047"},{"key":"e_1_3_2_39_1","doi-asserted-by":"publisher","DOI":"10.1007\/b138659"},{"key":"e_1_3_2_40_1","doi-asserted-by":"publisher","DOI":"10.1111\/j.1467-9868.2011.00777.x"},{"key":"e_1_3_2_41_1","volume-title":"Notes on the p-Laplace Equation","author":"Lindqvist Peter","year":"2017","unstructured":"Peter Lindqvist. 2017. Notes on the p-Laplace Equation. Number 161. University of Jyv\u00e4skyl\u00e4."},{"key":"e_1_3_2_42_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-23099-8"},{"key":"e_1_3_2_43_1","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-011-9276-6"},{"key":"e_1_3_2_44_1","doi-asserted-by":"publisher","DOI":"10.1137\/110845598"},{"key":"e_1_3_2_45_1","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-319-11259-6_23-1"},{"issue":"239","key":"e_1_3_2_46_1","first-page":"2","article-title":"Docker: Lightweight Linux containers for consistent development and deployment","volume":"2014","author":"Merkel Dirk","year":"2014","unstructured":"Dirk Merkel. 2014. Docker: Lightweight Linux containers for consistent development and deployment. Linux J. 2014, 239, Article 2 (2014). http:\/\/dl.acm.org\/citation.cfm?id=2600239.2600241.","journal-title":"Linux J."},{"key":"e_1_3_2_47_1","doi-asserted-by":"publisher","DOI":"10.1063\/1.1699114"},{"issue":"3","key":"e_1_3_2_48_1","first-page":"231","article-title":"On Metropolis-Hastings algorithms with delayed rejection","volume":"59","author":"Mira Antonietta","year":"2001","unstructured":"Antonietta Mira et\u00a0al. 2001. On Metropolis-Hastings algorithms with delayed rejection. Metron 59, 3-4 (2001), 231\u2013241.","journal-title":"Metron"},{"key":"e_1_3_2_49_1","volume-title":"Handbook of Markov Chain Monte Carlo","author":"Neal R. M.","year":"2010","unstructured":"R. M. Neal. 2010. Handbook of Markov Chain Monte Carlo. Chapman & Hall\/CRC Press, Chapter MCMC using Hamiltonian dynamics."},{"key":"e_1_3_2_50_1","unstructured":"Art B. Owen. 2013. Monte Carlo theory methods and examples. (2013)."},{"key":"e_1_3_2_51_1","unstructured":"Matthew Parno Andrew Davis Patrick Conrad and Y. M. Marzouk. 2014. MIT Uncertainty Quantification (MUQ) Library. https:\/\/muq.mit.edu."},{"key":"e_1_3_2_52_1","doi-asserted-by":"publisher","DOI":"10.1137\/17M1134640"},{"key":"e_1_3_2_53_1","doi-asserted-by":"publisher","DOI":"10.1137\/130934805"},{"key":"e_1_3_2_54_1","doi-asserted-by":"publisher","DOI":"10.1137\/14098171X"},{"key":"e_1_3_2_55_1","volume-title":"Subjective and Objective Bayesian Statistics: Principles, Methods and Applications","author":"Press S. J.","year":"2003","unstructured":"S. J. Press. 2003. Subjective and Objective Bayesian Statistics: Principles, Methods and Applications. Wiley, New York."},{"key":"e_1_3_2_56_1","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/3206.001.0001"},{"key":"e_1_3_2_57_1","doi-asserted-by":"publisher","DOI":"10.5555\/1051451"},{"key":"e_1_3_2_58_1","doi-asserted-by":"publisher","DOI":"10.1214\/154957804100000024"},{"key":"e_1_3_2_59_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1023562417138"},{"key":"e_1_3_2_60_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10208-016-9340-x"},{"key":"e_1_3_2_61_1","doi-asserted-by":"publisher","DOI":"10.1214\/ss\/1177013620"},{"key":"e_1_3_2_62_1","volume-title":"An Analysis of the Finite Element Method","author":"Strang G.","year":"1988","unstructured":"G. Strang and G. J. Fix. 1988. An Analysis of the Finite Element Method. Wellesley-Cambridge Press, Wellesley, MA."},{"key":"e_1_3_2_63_1","doi-asserted-by":"publisher","DOI":"10.1017\/S0962492910000061"},{"key":"e_1_3_2_64_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898717921"},{"key":"e_1_3_2_65_1","doi-asserted-by":"publisher","DOI":"10.1080\/01621459.1986.10478240"},{"key":"e_1_3_2_66_1","volume-title":"The Trilinos Project Website","author":"Team The Trilinos Project","year":"2020","unstructured":"The Trilinos Project Team. 2020 (accessed May 22, 2020). The Trilinos Project Website. https:\/\/trilinos.github.io."},{"key":"e_1_3_2_67_1","doi-asserted-by":"publisher","DOI":"10.1090\/gsm\/112"},{"key":"e_1_3_2_68_1","doi-asserted-by":"publisher","DOI":"10.1093\/biomet\/asz002"},{"key":"e_1_3_2_69_1","doi-asserted-by":"publisher","DOI":"10.1214\/20-ba1221"},{"key":"e_1_3_2_70_1","doi-asserted-by":"publisher","DOI":"10.6084\/m9.figshare.12510578.v1"},{"key":"e_1_3_2_71_1","doi-asserted-by":"publisher","DOI":"10.1145\/3428447"},{"key":"e_1_3_2_72_1","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9780511813658"},{"key":"e_1_3_2_73_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0010-4655(03)00467-3"},{"key":"e_1_3_2_74_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9780898719260"},{"key":"e_1_3_2_75_1","doi-asserted-by":"publisher","DOI":"10.1090\/mcom\/3737"}],"container-title":["ACM Transactions on Mathematical Software"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580278","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3580278","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T17:49:19Z","timestamp":1750182559000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3580278"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,6,15]]},"references-count":74,"journal-issue":{"issue":"2","published-print":{"date-parts":[[2023,6,30]]}},"alternative-id":["10.1145\/3580278"],"URL":"https:\/\/doi.org\/10.1145\/3580278","relation":{},"ISSN":["0098-3500","1557-7295"],"issn-type":[{"value":"0098-3500","type":"print"},{"value":"1557-7295","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,6,15]]},"assertion":[{"value":"2021-11-29","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-12-15","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2023-06-15","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}