{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,9]],"date-time":"2026-04-09T23:14:59Z","timestamp":1775776499847,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010322","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,7,25]],"date-time":"2022-07-25T00:00:00Z","timestamp":1658707200000}}],"reference-count":58,"publisher":"Public Library of Science (PLoS)","issue":"7","license":[{"start":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T00:00:00Z","timestamp":1657670400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100004412","name":"Human Frontier Science Program","doi-asserted-by":"publisher","award":["LT000259\/2019-L1"],"award-info":[{"award-number":["LT000259\/2019-L1"]}],"id":[{"id":"10.13039\/100004412","id-type":"DOI","asserted-by":"publisher"}]},{"name":"National Cancer Institute","award":["U54-CA225088"],"award-info":[{"award-number":["U54-CA225088"]}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>\n                    Ordinary differential equation (ODE) models are widely used to study biochemical reactions in cellular networks since they effectively describe the temporal evolution of these networks using mass action kinetics. The parameters of these models are rarely known\n                    <jats:italic>a priori<\/jats:italic>\n                    and must instead be estimated by calibration using experimental data. Optimization-based calibration of ODE models on is often challenging, even for low-dimensional problems. Multiple hypotheses have been advanced to explain why biochemical model calibration is challenging, including non-identifiability of model parameters, but there are few comprehensive studies that test these hypotheses, likely because tools for performing such studies are also lacking. Nonetheless, reliable model calibration is essential for uncertainty analysis, model comparison, and biological interpretation.\n                  <\/jats:p>\n                  <jats:p>\n                    We implemented an established trust-region method as a modular Python framework (\n                    <jats:monospace>fides<\/jats:monospace>\n                    ) to enable systematic comparison of different approaches to ODE model calibration involving a variety of Hessian approximation schemes. We evaluated\n                    <jats:monospace>fides<\/jats:monospace>\n                    on a recently developed corpus of biologically realistic benchmark problems for which real experimental data are available. Unexpectedly, we observed high variability in optimizer performance among different implementations of the same mathematical instructions (algorithms). Analysis of possible sources of poor optimizer performance identified limitations in the widely used Gauss-Newton, BFGS and SR1 Hessian approximation schemes. We addressed these drawbacks with a novel hybrid Hessian approximation scheme that enhances optimizer performance and outperforms existing hybrid approaches. When applied to the corpus of test models, we found that\n                    <jats:monospace>fides<\/jats:monospace>\n                    was on average more reliable and efficient than existing methods using a variety of criteria. We expect\n                    <jats:monospace>fides<\/jats:monospace>\n                    to be broadly useful for ODE constrained optimization problems in biochemical models and to be a foundation for future methods development.\n                  <\/jats:p>","DOI":"10.1371\/journal.pcbi.1010322","type":"journal-article","created":{"date-parts":[[2022,7,13]],"date-time":"2022-07-13T13:42:45Z","timestamp":1657719765000},"page":"e1010322","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":39,"title":["Fides: Reliable trust-region optimization for parameter estimation of ordinary differential equation models"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5360-4292","authenticated-orcid":true,"given":"Fabian","family":"Fr\u00f6hlich","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3364-1838","authenticated-orcid":true,"given":"Peter K.","family":"Sorger","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,7,13]]},"reference":[{"issue":"6912","key":"pcbi.1010322.ref001","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1038\/nature01254","article-title":"Computational Systems Biology","volume":"420","author":"H Kitano","year":"2002","journal-title":"Nature"},{"key":"pcbi.1010322.ref002","doi-asserted-by":"crossref","DOI":"10.1002\/3527603603","volume-title":"Systems biology in practice","author":"E Klipp","year":"2005"},{"key":"pcbi.1010322.ref003","doi-asserted-by":"crossref","first-page":"385","DOI":"10.1007\/978-1-4939-8882-2_16","volume-title":"Gene Regulatory Networks: Methods and Protocols. Methods in Molecular Biology","author":"F Fr\u00f6hlich","year":"2019"},{"issue":"10","key":"pcbi.1010322.ref004","doi-asserted-by":"crossref","first-page":"1871","DOI":"10.1371\/journal.pcbi.0030189","article-title":"Universally sloppy parameter sensitivities in systems biology models","volume":"3","author":"RN Gutenkunst","year":"2007","journal-title":"PLOS Computational Biology"},{"issue":"11","key":"pcbi.1010322.ref005","doi-asserted-by":"crossref","first-page":"1195","DOI":"10.1038\/ncb1497","article-title":"Physicochemical modelling of cell signalling pathways","volume":"8","author":"BB Aldridge","year":"2006","journal-title":"Nature Cell Biology"},{"issue":"13","key":"pcbi.1010322.ref006","doi-asserted-by":"crossref","first-page":"i494","DOI":"10.1093\/bioinformatics\/bty229","article-title":"Bayesian parameter estimation for biochemical reaction networks using region-based adaptive parallel tempering","volume":"34","author":"B Ballnus","year":"2018","journal-title":"Bioinformatics"},{"issue":"25","key":"pcbi.1010322.ref007","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1093\/bioinformatics\/btp358","article-title":"Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood","volume":"25","author":"A Raue","year":"2009","journal-title":"Bioinformatics"},{"issue":"5","key":"pcbi.1010322.ref008","doi-asserted-by":"crossref","first-page":"593","DOI":"10.1016\/j.cels.2018.04.008","article-title":"A Hierarchical, Data-Driven Approach to Modeling Single-Cell Populations Predicts Latent Causes of Cell-To-Cell Variability","volume":"6","author":"C Loos","year":"2018","journal-title":"Cell Systems"},{"issue":"17","key":"pcbi.1010322.ref009","doi-asserted-by":"crossref","first-page":"i718","DOI":"10.1093\/bioinformatics\/btw461","article-title":"L1 regularization facilitates detection of cell type-specific parameters in dynamical systems","volume":"32","author":"B Steiert","year":"2016","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1010322.ref010","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1109\/4235.585893","article-title":"No free lunch theorems for optimization","volume":"1","author":"DH Wolpert","year":"1997","journal-title":"IEEE Transactions on Evolutionary Computation"},{"issue":"1","key":"pcbi.1010322.ref011","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1145\/200979.201043","article-title":"CUTE: constrained and unconstrained testing environment","volume":"21","author":"I Bongartz","year":"1995","journal-title":"ACM Transactions on Mathematical Software"},{"issue":"4","key":"pcbi.1010322.ref012","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1145\/962437.962439","article-title":"CUTEr and SifDec: A constrained and unconstrained testing environment, revisited","volume":"29","author":"NIM Gould","year":"2003","journal-title":"ACM Transactions on Mathematical Software"},{"issue":"3","key":"pcbi.1010322.ref013","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1007\/s10589-014-9687-3","article-title":"CUTEst: a Constrained and Unconstrained Testing Environment with safe threads for mathematical optimization","volume":"60","author":"NIM Gould","year":"2015","journal-title":"Computational Optimization and Applications"},{"issue":"8","key":"pcbi.1010322.ref014","article-title":"BioPreDyn-bench: a suite of benchmark problems for dynamic modelling in systems biology","volume":"9","author":"AF Villaverde","year":"2015","journal-title":"BMC Systems Biology"},{"issue":"17","key":"pcbi.1010322.ref015","doi-asserted-by":"crossref","first-page":"3073","DOI":"10.1093\/bioinformatics\/btz020","article-title":"Benchmark problems for dynamic modeling of intracellular processes","volume":"35","author":"H Hass","year":"2019","journal-title":"Bioinformatics"},{"key":"pcbi.1010322.ref016","doi-asserted-by":"crossref","first-page":"110026","DOI":"10.1016\/j.jcp.2020.110026","article-title":"Identification of parameters for large-scale kinetic models","volume":"429","author":"UG Abdulla","year":"2021","journal-title":"Journal of Computational Physics"},{"key":"pcbi.1010322.ref017","doi-asserted-by":"crossref","first-page":"133","DOI":"10.1016\/j.mbs.2018.09.004","article-title":"Identification of parameters in systems biology","volume":"305","author":"UG Abdulla","year":"2018","journal-title":"Mathematical Biosciences"},{"issue":"9","key":"pcbi.1010322.ref018","doi-asserted-by":"crossref","first-page":"e74335","DOI":"10.1371\/journal.pone.0074335","article-title":"Lessons learned from quantitative dynamical modeling in systems biology","volume":"8","author":"A Raue","year":"2013","journal-title":"PLoS ONE"},{"key":"pcbi.1010322.ref019","volume-title":"Numerical optimization","author":"J Nocedal","year":"2006"},{"issue":"132","key":"pcbi.1010322.ref020","doi-asserted-by":"crossref","first-page":"ra56","DOI":"10.1126\/scisignal.2000810","article-title":"Decoupling of Receptor and Downstream Signals in the Akt Pathway by Its Low-Pass Filter Characteristics","volume":"3","author":"KA Fujita","year":"2010","journal-title":"Science Signaling"},{"key":"pcbi.1010322.ref021","volume-title":"Model selection and multimodel inference: A practical information-theoretic approach","author":"KP Burnham","year":"2002","edition":"2"},{"issue":"1","key":"pcbi.1010322.ref022","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1186\/s13059-019-1887-9","article-title":"Guidelines for benchmarking of optimization-based approaches for fitting mathematical models","volume":"20","author":"C Kreutz","year":"2019","journal-title":"Genome Biology"},{"issue":"3","key":"pcbi.1010322.ref023","doi-asserted-by":"crossref","first-page":"036701","DOI":"10.1103\/PhysRevE.83.036701","article-title":"Geometry of nonlinear least squares with applications to sloppy models and optimization","volume":"83","author":"MK Transtrum","year":"2011","journal-title":"Physical Review E"},{"key":"pcbi.1010322.ref024","doi-asserted-by":"crossref","DOI":"10.3389\/fphy.2019.00149","article-title":"Optimal Paths Between Parameter Estimates in Non-linear ODE Systems Using the Nudged Elastic Band Method","volume":"7","author":"C T\u00f6nsing","year":"2019","journal-title":"Frontiers in Physics"},{"key":"pcbi.1010322.ref025","first-page":"2933","article-title":"Identifying and attacking the saddle point problem in high-dimensional non-convex optimization","volume":"26","author":"YN Dauphin","year":"2014","journal-title":"Advances in Neural Information Processing Systems"},{"issue":"1","key":"pcbi.1010322.ref026","doi-asserted-by":"crossref","first-page":"76","DOI":"10.1093\/imamat\/6.1.76","article-title":"The Convergence of a Class of Double-rank Minimization Algorithms 1. General Considerations","volume":"6","author":"CG Broyden","year":"1970","journal-title":"IMA Journal of Applied Mathematics"},{"issue":"3","key":"pcbi.1010322.ref027","doi-asserted-by":"crossref","first-page":"317","DOI":"10.1093\/comjnl\/13.3.317","article-title":"A new approach to variable metric algorithms","volume":"13","author":"R Fletcher","year":"1970","journal-title":"The Computer Journal"},{"issue":"109","key":"pcbi.1010322.ref028","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1090\/S0025-5718-1970-0258249-6","article-title":"A Family of Variable-Metric Methods Derived by Variational Means","volume":"24","author":"D Goldfarb","year":"1970","journal-title":"Mathematics of Computation"},{"issue":"111","key":"pcbi.1010322.ref029","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1090\/S0025-5718-1970-0274029-X","article-title":"Conditioning of quasi-Newton methods for function minimization","volume":"24","author":"DF Shanno","year":"1970","journal-title":"Mathematics of Computation"},{"issue":"1","key":"pcbi.1010322.ref030","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1007\/BF01594934","article-title":"Convergence of quasi-Newton matrices generated by the symmetric rank one update","volume":"50","author":"AR Conn","year":"1991","journal-title":"Mathematical Programming"},{"issue":"1","key":"pcbi.1010322.ref031","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1007\/BF01582221","article-title":"On the convergence of interior-reflective Newton methods for nonlinear minimization subject to bounds","volume":"67","author":"TF Coleman","year":"1994","journal-title":"Mathematical Programming"},{"issue":"3","key":"pcbi.1010322.ref032","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1145\/1089014.1089020","article-title":"SUNDIALS: Suite of Nonlinear and Differential\/Algebraic Equation Solvers","volume":"31","author":"AC Hindmarsh","year":"2005","journal-title":"ACM Transaction Mathematical Software"},{"issue":"5","key":"pcbi.1010322.ref033","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1093\/bioinformatics\/btw703","article-title":"Robust parameter estimation for dynamical systems from outlier-corrupted data","volume":"33","author":"C Maier","year":"2017","journal-title":"Bioinformatics"},{"issue":"21","key":"pcbi.1010322.ref034","doi-asserted-by":"crossref","first-page":"3558","DOI":"10.1093\/bioinformatics\/btv405","article-title":"Data2Dynamics: a modeling environment tailored to parameter estimation in dynamical systems","volume":"31","author":"A Raue","year":"2015","journal-title":"Bioinformatics"},{"issue":"20","key":"pcbi.1010322.ref035","doi-asserted-by":"crossref","first-page":"3676","DOI":"10.1093\/bioinformatics\/btab227","article-title":"AMICI: High-Performance Sensitivity Analysis for Large Ordinary Differential Equation Models","volume":"37","author":"F Fr\u00f6hlich","year":"2021","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1010322.ref036","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1005331","article-title":"Scalable parameter estimation for genome-scale biochemical reaction networks","volume":"13","author":"F Fr\u00f6hlich","year":"2017","journal-title":"PLoS Computational Biology"},{"issue":"13","key":"pcbi.1010322.ref037","doi-asserted-by":"crossref","first-page":"i151","DOI":"10.1093\/bioinformatics\/bty230","article-title":"Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis","volume":"34","author":"P Stapor","year":"2018","journal-title":"Bioinformatics"},{"key":"pcbi.1010322.ref038","volume-title":"Quantitative Dynamic Modeling: Theory and Application to Signal Transduction in the Erythropoietic System","author":"A Raue","year":"2013"},{"issue":"5","key":"pcbi.1010322.ref039","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1057\/jors.1985.68","article-title":"Variational Methods for Non-Linear Least-Squares","volume":"36","author":"M Al-Baali","year":"1985","journal-title":"Journal of the Operational Research Society"},{"issue":"5","key":"pcbi.1010322.ref040","doi-asserted-by":"crossref","first-page":"2422","DOI":"10.1137\/090748470","article-title":"Global Convergence of a New Hybrid Gauss\u2013Newton Structured BFGS Method for Nonlinear Least Squares Problems","volume":"20","author":"W Zhou","year":"2010","journal-title":"SIAM Journal on Optimization"},{"issue":"6","key":"pcbi.1010322.ref041","doi-asserted-by":"crossref","first-page":"949","DOI":"10.1137\/0718067","article-title":"Convergence Theorems for Least-Change Secant Update Methods","volume":"18","author":"E Dennis J J","year":"1981","journal-title":"SIAM Journal on Numerical Analysis"},{"issue":"2","key":"pcbi.1010322.ref042","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1007\/BF00962795","article-title":"Convergence theory for the structured BFGS secant method with an application to nonlinear least squares","volume":"61","author":"JE Dennis","year":"1989","journal-title":"Journal of Optimization Theory and Applications"},{"issue":"1","key":"pcbi.1010322.ref043","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1137\/0804005","article-title":"On the Use of Product Structure in Secant Methods for Nonlinear Least Squares Problems","volume":"4","author":"J Huschens","year":"1994","journal-title":"SIAM Journal on Optimization"},{"issue":"3","key":"pcbi.1010322.ref044","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1145\/355958.355966","article-title":"Algorithm 573: NL2SOL\u2014An Adaptive Nonlinear Least-Squares Algorithm","volume":"7","author":"JE Dennis","year":"1981","journal-title":"ACM Transactions on Mathematical Software"},{"issue":"3","key":"pcbi.1010322.ref045","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1093\/imanum\/7.3.371","article-title":"Hybrid Methods for Nonlinear Least Squares","volume":"7","author":"R Fletcher","year":"1987","journal-title":"IMA Journal of Numerical Analysis"},{"key":"pcbi.1010322.ref046","doi-asserted-by":"crossref","unstructured":"Mor\u00e9 JJ. The Levenberg-Marquardt algorithm: Implementation and theory. In: Lecture Notes in Mathematics. vol. 630. Springer Berlin Heidelberg; 1978. p. 105\u2013116.","DOI":"10.1007\/BFb0067700"},{"issue":"1","key":"pcbi.1010322.ref047","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1007\/BF01580735","article-title":"Approximate solution of the trust region problem by minimization over two-dimensional subspaces","volume":"40","author":"RH Byrd","year":"1988","journal-title":"Mathematical Programming"},{"issue":"2","key":"pcbi.1010322.ref048","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1137\/0806023","article-title":"An interior trust region approach for nonlinear minimization subject to bounds","volume":"6","author":"TF Coleman","year":"1996","journal-title":"SIAM Journal on Optimization"},{"issue":"5","key":"pcbi.1010322.ref049","doi-asserted-by":"crossref","first-page":"830","DOI":"10.1093\/bioinformatics\/bty736","article-title":"Benchmarking optimization methods for parameter estimation in large kinetic models","volume":"35","author":"AF Villaverde","year":"2019","journal-title":"Bioinformatics"},{"key":"pcbi.1010322.ref050","volume-title":"Theory of Probability","author":"H Jeffreys","year":"1961","edition":"3"},{"issue":"3","key":"pcbi.1010322.ref051","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1038\/s41592-019-0686-2","article-title":"SciPy 1.0: fundamental algorithms for scientific computing in Python","volume":"17","author":"P Virtanen","year":"2020","journal-title":"Nature Methods"},{"issue":"7825","key":"pcbi.1010322.ref052","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1038\/s41586-020-2649-2","article-title":"Array programming with NumPy","volume":"585","author":"CR Harris","year":"2020","journal-title":"Nature"},{"issue":"1","key":"pcbi.1010322.ref053","doi-asserted-by":"crossref","first-page":"e1008646","DOI":"10.1371\/journal.pcbi.1008646","article-title":"PEtab\u2014Interoperable specification of parameter estimation problems in systems biology","volume":"17","author":"L Schmiester","year":"2021","journal-title":"PLOS Computational Biology"},{"issue":"2","key":"pcbi.1010322.ref054","doi-asserted-by":"crossref","first-page":"594","DOI":"10.1093\/bioinformatics\/btz581","article-title":"Efficient parameterization of large-scale dynamic models based on relative measurements","volume":"36","author":"L Schmiester","year":"2020","journal-title":"Bioinformatics"},{"issue":"1","key":"pcbi.1010322.ref055","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1038\/s41540-017-0023-2","article-title":"Performance of objective functions and optimisation procedures for parameter estimation in system biology models","volume":"3","author":"A Degasperi","year":"2017","journal-title":"npj Systems Biology and Applications"},{"key":"pcbi.1010322.ref056","article-title":"Mechanistic model of MAPK signaling reveals how allostery and rewiring contribute to drug resistance","author":"F Fr\u00f6hlich","year":"2022","journal-title":"bioRxiv"},{"issue":"3","key":"pcbi.1010322.ref057","doi-asserted-by":"crossref","first-page":"481","DOI":"10.1007\/s10898-006-9075-3","article-title":"Scatter search for chemical and bio-process optimization","volume":"37","author":"JA Egea","year":"2007","journal-title":"Journal of Global Optimization"},{"issue":"6","key":"pcbi.1010322.ref058","doi-asserted-by":"crossref","first-page":"567","DOI":"10.1016\/j.cels.2018.10.013","article-title":"Efficient Parameter Estimation Enables the Prediction of Drug Response Using a Mechanistic Pan-Cancer Pathway Model","volume":"7","author":"F Fr\u00f6hlich","year":"2018","journal-title":"Cell Systems"}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010322","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2022,7,25]],"date-time":"2022-07-25T00:00:00Z","timestamp":1658707200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010322","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,2,11]],"date-time":"2023-02-11T09:06:35Z","timestamp":1676106395000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010322"}},"subtitle":[],"editor":[{"given":"Hugues","family":"Berry","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,7,13]]},"references-count":58,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2022,7,13]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010322","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2021.05.20.445065","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,7,13]]}}}