{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,9]],"date-time":"2026-07-09T23:49:14Z","timestamp":1783640954828,"version":"3.55.0"},"reference-count":47,"publisher":"Oxford University Press (OUP)","issue":"13","license":[{"start":{"date-parts":[[2018,6,27]],"date-time":"2018-06-27T00:00:00Z","timestamp":1530057600000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"German Research Foundation","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100004807","name":"DFG","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100004807","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Graduate School of Quantitative Biosciences Munich"},{"name":"QBM"},{"name":"European Union\u2019s Horizon 2020","award":["686282"],"award-info":[{"award-number":["686282"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,7,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Motivation<\/jats:title>\n                    <jats:p>Parameter estimation methods for ordinary differential equation (ODE) models of biological processes can exploit gradients and Hessians of objective functions to achieve convergence and computational efficiency. However, the computational complexity of established methods to evaluate the Hessian scales linearly with the number of state variables and quadratically with the number of parameters. This limits their application to low-dimensional problems.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>We introduce second order adjoint sensitivity analysis for the computation of Hessians and a hybrid optimization-integration-based approach for profile likelihood computation. Second order adjoint sensitivity analysis scales linearly with the number of parameters and state variables. The Hessians are effectively exploited by the proposed profile likelihood computation approach. We evaluate our approaches on published biological models with real measurement data. Our study reveals an improved computational efficiency and robustness of optimization compared to established approaches, when using Hessians computed with adjoint sensitivity analysis. The hybrid computation method was more than 2-fold faster than the best competitor. Thus, the proposed methods and implemented algorithms allow for the improvement of parameter estimation for medium and large scale ODE models.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Availability and implementation<\/jats:title>\n                    <jats:p>The algorithms for second order adjoint sensitivity analysis are implemented in the Advanced MATLAB Interface to CVODES and IDAS (AMICI, https:\/\/github.com\/ICB-DCM\/AMICI\/). The algorithm for hybrid profile likelihood computation is implemented in the parameter estimation toolbox (PESTO, https:\/\/github.com\/ICB-DCM\/PESTO\/). Both toolboxes are freely available under the BSD license.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Supplementary information<\/jats:title>\n                    <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1093\/bioinformatics\/bty230","type":"journal-article","created":{"date-parts":[[2018,4,12]],"date-time":"2018-04-12T15:32:51Z","timestamp":1523547171000},"page":"i151-i159","source":"Crossref","is-referenced-by-count":28,"title":["Optimization and profile calculation of ODE models using second order adjoint sensitivity analysis"],"prefix":"10.1093","volume":"34","author":[{"given":"Paul","family":"Stapor","sequence":"first","affiliation":[{"name":"Helmholtz Zentrum M\u00fcnchen\u2013German Research Center for Environmental Health, Institute of Computational Biology, Neuherberg, Germany"},{"name":"Technische Universit\u00e4t M\u00fcnchen, Center for Mathematics, Chair of Mathematical Modeling of Biological Systems, Garching, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Fabian","family":"Fr\u00f6hlich","sequence":"additional","affiliation":[{"name":"Helmholtz Zentrum M\u00fcnchen\u2013German Research Center for Environmental Health, Institute of Computational Biology, Neuherberg, Germany"},{"name":"Technische Universit\u00e4t M\u00fcnchen, Center for Mathematics, Chair of Mathematical Modeling of Biological Systems, Garching, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jan","family":"Hasenauer","sequence":"additional","affiliation":[{"name":"Helmholtz Zentrum M\u00fcnchen\u2013German Research Center for Environmental Health, Institute of Computational Biology, Neuherberg, Germany"},{"name":"Technische Universit\u00e4t M\u00fcnchen, Center for Mathematics, Chair of Mathematical Modeling of Biological Systems, Garching, Germany"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"286","published-online":{"date-parts":[[2018,6,27]]},"reference":[{"key":"2023051604250512800_bty230-B1","doi-asserted-by":"crossref","first-page":"570","DOI":"10.1016\/j.cam.2008.12.024","article-title":"Accelerated conjugate gradient algorithm with finite difference hessian\/vector product approximation for unconstrained optimization","volume":"230","author":"Andrei","year":"2009","journal-title":"J. Comput. Appl. Math"},{"key":"2023051604250512800_bty230-B48","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1186\/s12918-017-0433-1","article-title":"Comprehensive benchmarking of {Markov} chain {Monte} {Carlo} methods for dynamical systems","volume":"11","author":"Ballnus","year":"2001","journal-title":"BMC Syst. Biol"},{"key":"2023051604250512800_bty230-B2","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1016\/S0098-1354(01)00633-0","article-title":"Dynamic optimization of chemical and biochemical processes using restricted second-order information","volume":"25","author":"Balsa-Canto","year":"2001","journal-title":"Comput. Chem. Eng"},{"key":"2023051604250512800_bty230-B3","doi-asserted-by":"crossref","first-page":"1404","DOI":"10.1126\/science.1184913","article-title":"Covering a broad dynamic range: information processing at the erythropoietin receptor","volume":"328","author":"Becker","year":"2010","journal-title":"Science"},{"key":"2023051604250512800_bty230-B4","doi-asserted-by":"crossref","first-page":"125009.","DOI":"10.1088\/0266-5611\/32\/12\/125009","article-title":"Integration based profile likelihood calculation for PDE constrained parameter estimation problems","volume":"32","author":"Boiger","year":"2016","journal-title":"Inverse Prob"},{"key":"2023051604250512800_bty230-B5","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1007\/PL00011391","article-title":"A trust region method based on interior point techniques for nonlinear programming","volume":"89","author":"Byrd","year":"2000","journal-title":"Math. Program"},{"key":"2023051604250512800_bty230-B6","doi-asserted-by":"crossref","first-page":"700","DOI":"10.1016\/j.jcp.2014.11.030","article-title":"Second-order adjoint sensitivity analysis methodology (2nd-asam) for computing exactly and efficiently first- and second-order sensitivities in large-scale linear systems: ii. illustrative application to a paradigm particle diffusion problem","volume":"284","author":"Cacuci","year":"2015","journal-title":"J. Comput. Phys"},{"key":"2023051604250512800_bty230-B7","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1002\/bit.10288","article-title":"Dynamic modeling of the central carbon metabolism of Escherichia coli","volume":"79","author":"Chassagnole","year":"2002","journal-title":"Biotechnol. Bioeng"},{"key":"2023051604250512800_bty230-B8","doi-asserted-by":"crossref","first-page":"993","DOI":"10.1080\/01621459.1996.10476969","article-title":"The signed root deviance profile and confidence intervals in maximum likelihood analysis","volume":"91","author":"Chen","year":"1996","journal-title":"J. Am. Stat. Assoc"},{"key":"2023051604250512800_bty230-B9","doi-asserted-by":"crossref","first-page":"714","DOI":"10.1198\/106186002493","article-title":"Simple accurate approximation of likelihood profiles","volume":"11","author":"Chen","year":"2002","journal-title":"J. Comput. Graphical Statist"},{"key":"2023051604250512800_bty230-B10","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1137\/0806023","article-title":"An interior trust region approach for nonlinear minimization subject to bounds","volume":"6","author":"Coleman","year":"1996","journal-title":"SIAM J. Optim"},{"key":"2023051604250512800_bty230-B11","first-page":"2933","author":"Dauphin","year":"2014"},{"key":"2023051604250512800_bty230-B12","doi-asserted-by":"crossref","first-page":"369","DOI":"10.1145\/355958.355966","article-title":"Algorithm 573: nl2sol\u2014an adaptive nonlinear least-squares algorithm","volume":"7","author":"Dennis","year":"1981","journal-title":"ACM T. Math. Software"},{"key":"2023051604250512800_bty230-B13","doi-asserted-by":"crossref","first-page":"80","DOI":"10.1186\/s12918-016-0319-7","article-title":"Tailored parameter optimization methods for ordinary differential equation models with steady-state constraints","volume":"10","author":"Fiedler","year":"2016","journal-title":"BMC Syst. Biol"},{"key":"2023051604250512800_bty230-B14","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1098\/rsta.1922.0009","article-title":"On the mathematical foundations of theoretical statistics","volume":"222","author":"Fisher","year":"1922","journal-title":"Philos. Trans. R. Soc. London, Ser. A"},{"key":"2023051604250512800_bty230-B15","first-page":"61","author":"Fr\u00f6hlich","year":"2014"},{"key":"2023051604250512800_bty230-B16","doi-asserted-by":"crossref","first-page":"e1005030","DOI":"10.1371\/journal.pcbi.1005030","article-title":"Inference for stochastic chemical kinetics using moment equations and system size expansion","volume":"12","author":"Fr\u00f6hlich","year":"2016","journal-title":"PLoS Comput. Biol"},{"key":"2023051604250512800_bty230-B17","author":"Fr\u00f6hlich","year":"2017"},{"key":"2023051604250512800_bty230-B18","author":"Fr\u00f6hlich","year":"2017"},{"key":"2023051604250512800_bty230-B19","doi-asserted-by":"crossref","first-page":"e1005331","DOI":"10.1371\/journal.pcbi.1005331","article-title":"Scalable parameter estimation for genome-scale biochemical reaction networks","volume":"13","author":"Fr\u00f6hlich","year":"2017","journal-title":"PLoS Comput. Biol"},{"key":"2023051604250512800_bty230-B20","author":"Fr\u00f6hlich","year":"2018"},{"key":"2023051604250512800_bty230-B21","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1111\/j.1467-9868.2010.00765.x","article-title":"Riemann manifold Langevin and Hamiltonian Monte Carlo methods","volume":"73","author":"Girolami","year":"2011","journal-title":"J. R. Statist. Soc. B"},{"key":"2023051604250512800_bty230-B22","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1090\/S0025-5718-1970-0258249-6","article-title":"A family of variable-metric methods derived by variational means","volume":"24","author":"Goldfarb","year":"1970","journal-title":"Math. Comp"},{"key":"2023051604250512800_bty230-B23","doi-asserted-by":"crossref","first-page":"512","DOI":"10.1080\/00029890.2001.11919778","article-title":"Inverse problems light: numerical differentiation","volume":"108","author":"Hanke","year":"2001","journal-title":"Am. Math. Mon"},{"key":"2023051604250512800_bty230-B24","doi-asserted-by":"crossref","first-page":"e1003686.","DOI":"10.1371\/journal.pcbi.1003686","article-title":"ODE constrained mixture modelling: a method for unraveling subpopulation structures and dynamics","volume":"10","author":"Hasenauer","year":"2014","journal-title":"PLoS Comput. Biol"},{"key":"2023051604250512800_bty230-B25","doi-asserted-by":"crossref","first-page":"27.","DOI":"10.1038\/s41540-017-0030-3","article-title":"Predicting ligand-dependent tumors from multi-dimensional signaling features","volume":"3","author":"Hass","year":"2017","journal-title":"NPJ Syst. Biol. Appl"},{"key":"2023051604250512800_bty230-B26","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1145\/1089014.1089020","article-title":"SUNDIALS: suite of nonlinear and differential\/algebraic equation solvers","volume":"31","author":"Hindmarsh","year":"2005","journal-title":"ACM T. Math. Software"},{"key":"2023051604250512800_bty230-B27","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1016\/j.ymben.2006.04.003","article-title":"Exploiting the bootstrap method for quantifying parameter confidence intervals in dynamical systems","volume":"8","author":"Joshi","year":"2006","journal-title":"Metabolic Eng"},{"key":"2023051604250512800_bty230-B28","author":"Kaschek","year":"2016"},{"key":"2023051604250512800_bty230-B29","doi-asserted-by":"crossref","first-page":"2564","DOI":"10.1111\/febs.12276","article-title":"Profile likelihood in systems biology","volume":"280","author":"Kreutz","year":"2013","journal-title":"Febs J"},{"key":"2023051604250512800_bty230-B30","doi-asserted-by":"crossref","first-page":"045003.","DOI":"10.1088\/1478-3975\/9\/4\/045003","article-title":"State\u2013time spectrum of signal transduction logic models","volume":"9","author":"MacNamara","year":"2012","journal-title":"Phys. Biol"},{"key":"2023051604250512800_bty230-B31","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1007\/s10898-016-0475-8","article-title":"Cubic-regularization counterpart of a variable-norm trust-region method for unconstrained minimization","volume":"68","author":"Martinez","year":"2017","journal-title":"J. Global Optimization"},{"key":"2023051604250512800_bty230-B32","doi-asserted-by":"crossref","first-page":"770","DOI":"10.1137\/0721052","article-title":"Newton-type minimization via the Lanczos method","volume":"21","author":"Nash","year":"1984","journal-title":"SIAM J. Numerical Anal"},{"key":"2023051604250512800_bty230-B33","doi-asserted-by":"crossref","first-page":"1725","DOI":"10.1137\/030601582","article-title":"Cheap second order directional derivatives of stiff ODE embedded functionals","volume":"26","author":"\u00d6zyurt","year":"2005","journal-title":"SIAM J. Sci. Comput"},{"key":"2023051604250512800_bty230-B34","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1111\/j.1365-246X.2006.02978.x","article-title":"A review of the adjoint-state method for computing the gradient of a functional with geophysical applications","volume":"167","author":"Plessix","year":"2006","journal-title":"Geophys. J. Int"},{"key":"2023051604250512800_bty230-B35","author":"Raue","year":"2013"},{"key":"2023051604250512800_bty230-B36","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1093\/bioinformatics\/btp358","article-title":"Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood","volume":"25","author":"Raue","year":"2009","journal-title":"Bioinformatics"},{"key":"2023051604250512800_bty230-B38","doi-asserted-by":"crossref","first-page":"e74335.","DOI":"10.1371\/journal.pone.0074335","article-title":"Lessons learned from quantitative dynamical modeling in systems biology","volume":"8","author":"Raue","year":"2013","journal-title":"PLoS ONE"},{"key":"2023051604250512800_bty230-B39","doi-asserted-by":"crossref","first-page":"3558","DOI":"10.1093\/bioinformatics\/btv405","article-title":"Data2Dynamics: a modeling environment tailored to parameter estimation in dynamical systems","volume":"31","author":"Raue","year":"2015","journal-title":"Bioinformatics"},{"key":"2023051604250512800_bty230-B40","first-page":"363","article-title":"CVODES: an ODE solver with sensitivity analysis capabilities","volume":"31","author":"Serban","year":"2005","journal-title":"ACM Math. Software"},{"key":"2023051604250512800_bty230-B41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1137\/S1064827594276424","article-title":"The matlab ode suite","volume":"18","author":"Shampine","year":"1997","journal-title":"SIAM J. Sci. Comput"},{"key":"2023051604250512800_bty230-B42","doi-asserted-by":"crossref","first-page":"705","DOI":"10.1093\/bioinformatics\/btx676","article-title":"PESTO: parameter EStimation TOolbox","volume":"34","author":"Stapor","year":"2017","journal-title":"Bioinformatics"},{"key":"2023051604250512800_bty230-B43","author":"Stapor","year":"2018"},{"key":"2023051604250512800_bty230-B44","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.1073\/pnas.0237333100","article-title":"Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by databased modeling","volume":"100","author":"Swameye","year":"2003","journal-title":"Proc. Natl. Acad. Sci."},{"key":"2023051604250512800_bty230-B45","doi-asserted-by":"crossref","first-page":"3851","DOI":"10.1016\/S0009-2509(98)00432-1","article-title":"Second-order sensitivities of general dynamic systems with application to optimal control problems","volume":"54","author":"Vassiliadis","year":"1999","journal-title":"Chem. Eng. Sci"},{"key":"2023051604250512800_bty230-B46","doi-asserted-by":"crossref","first-page":"8.","DOI":"10.1186\/s12918-015-0144-4","article-title":"BioPreDyn-bench: a suite of benchmark problems for dynamic modelling in systems biology","volume":"9","author":"Villaverde","year":"2015","journal-title":"BMC Syst. Biol"},{"key":"2023051604250512800_bty230-B47","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1007\/s10107-004-0559-y","article-title":"On the implementation of an interior-point filter line-search algorithm for large-scale nonlinear programming","volume":"106","author":"W\u00e4chter","year":"2006","journal-title":"Math. Program"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/13\/i151\/50316247\/bioinformatics_34_13_i151.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/13\/i151\/50316247\/bioinformatics_34_13_i151.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,5,16]],"date-time":"2023-05-16T00:28:23Z","timestamp":1684196903000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/34\/13\/i151\/5045760"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,27]]},"references-count":47,"journal-issue":{"issue":"13","published-print":{"date-parts":[[2018,7,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/bty230","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/272005","asserted-by":"object"}]},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,7,1]]},"published":{"date-parts":[[2018,6,27]]}}}