{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,17]],"date-time":"2026-03-17T01:09:02Z","timestamp":1773709742939,"version":"3.50.1"},"reference-count":41,"publisher":"Oxford University Press (OUP)","issue":"11","license":[{"start":{"date-parts":[[2018,1,22]],"date-time":"2018-01-22T00:00:00Z","timestamp":1516579200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/journals\/pages\/about_us\/legal\/notices"}],"funder":[{"DOI":"10.13039\/501100002347","name":"Bundesministerium f\u00fcr Bildung und Forschung","doi-asserted-by":"publisher","award":["031L0080"],"award-info":[{"award-number":["031L0080"]}],"id":[{"id":"10.13039\/501100002347","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2018,6,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:sec>\n                  <jats:title>Motivation<\/jats:title>\n                  <jats:p>The feasibility of uniquely estimating parameters of dynamical systems from observations is a widely discussed aspect of mathematical modelling. Several approaches have been published for analyzing this so-called identifiability of model parameters. However, they are typically computationally demanding, difficult to perform and\/or not applicable in many application settings.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Results<\/jats:title>\n                  <jats:p>Here, an approach is presented which enables quickly testing of parameter identifiability. Numerical optimization with a penalty in radial direction enforcing displacement of the parameters is used to check whether estimated parameters are unique, or whether the parameters can be altered without loss of agreement with the data indicating non-identifiability. This Identifiability-Test by Radial Penalization (ITRP) can be employed for every model where optimization-based parameter estimation like least-squares or maximum likelihood is feasible and is therefore applicable for all typical systems biology models. The approach is illustrated and tested using 11 ordinary differential equation (ODE) models.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Availability and implementation<\/jats:title>\n                  <jats:p>The presented approach can be implemented without great efforts in any modelling framework. It is available within the free Matlab-based modelling toolbox Data2Dynamics. Source code is available at https:\/\/github.com\/Data2Dynamics.<\/jats:p>\n               <\/jats:sec>\n               <jats:sec>\n                  <jats:title>Supplementary information<\/jats:title>\n                  <jats:p>Supplementary data are available at Bioinformatics online.<\/jats:p>\n               <\/jats:sec>","DOI":"10.1093\/bioinformatics\/bty035","type":"journal-article","created":{"date-parts":[[2018,1,19]],"date-time":"2018-01-19T14:01:56Z","timestamp":1516370516000},"page":"1913-1921","source":"Crossref","is-referenced-by-count":34,"title":["An easy and efficient approach for testing identifiability"],"prefix":"10.1093","volume":"34","author":[{"given":"Clemens","family":"Kreutz","sequence":"first","affiliation":[{"name":"Center for Systems Biology (ZBSA), Habsburger Str. 49, University of Freiburg, Freiburg, Germany"},{"name":"Center for Data Analysis and Modelling (FDM), Eckerstr. 1, University of Freiburg, Freiburg, Germany"}]}],"member":"286","published-online":{"date-parts":[[2018,1,22]]},"reference":[{"key":"2023012713561248100_bty035-B1","doi-asserted-by":"crossref","first-page":"516","DOI":"10.1038\/msb.2011.50","article-title":"Division of labor by dual feedback regulators controls JAK2\/STAT5 signaling over broad ligand range","volume":"7","author":"Bachmann","year":"2011","journal-title":"Mol. Syst. Biol"},{"key":"2023012713561248100_bty035-B2","doi-asserted-by":"crossref","first-page":"1404","DOI":"10.1126\/science.1184913","article-title":"Covering a broad dynamic range: information processing at the erythropoietin receptor","volume":"328","author":"Becker","year":"2010","journal-title":"Science"},{"key":"2023012713561248100_bty035-B3","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/0025-5564(70)90132-X","article-title":"On structural identifiability","volume":"7","author":"Bellman","year":"1970","journal-title":"Math. Biosci"},{"key":"2023012713561248100_bty035-B4","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.cmpb.2007.07.002","article-title":"Daisy: a new software tool to test global identifiability of biological and physiological systems","volume":"88","author":"Bellu","year":"2007","journal-title":"Comp. Methods Progr. Biomed"},{"key":"2023012713561248100_bty035-B5","doi-asserted-by":"crossref","first-page":"5685","DOI":"10.1021\/pr5006923","article-title":"Identification of isoform-specific dynamics in phosphorylation-dependent stat5 dimerization by quantitative mass spectrometry and mathematical modeling","volume":"13","author":"Boehm","year":"2014","journal-title":"J. Proteome Res"},{"key":"2023012713561248100_bty035-B6","first-page":"5993","article-title":"Enzymatic study on AtCCD4 and AtCCD7 and their potential in forming acyclic regulatory metabolites","volume":"67","author":"Bruno","year":"2016","journal-title":"J. Exp. Biol"},{"key":"2023012713561248100_bty035-B7","doi-asserted-by":"crossref","first-page":"187","DOI":"10.1093\/biomet\/84.1.187","article-title":"Detecting parameter redunancy","volume":"84","author":"Catchpole","year":"1997","journal-title":"Biometrika"},{"key":"2023012713561248100_bty035-B8","doi-asserted-by":"crossref","first-page":"e27755.","DOI":"10.1371\/journal.pone.0027755","article-title":"Structural identifiability of systems biology models: a critical comparison of methods","volume":"6","author":"Chis","year":"2011","journal-title":"Plos One"},{"key":"2023012713561248100_bty035-B9","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1137\/0806023","article-title":"An interior, trust region approach for nonlinear minimization subject to bounds","volume":"6","author":"Coleman","year":"1996","journal-title":"SIAM J. Optim"},{"key":"2023012713561248100_bty035-B10","doi-asserted-by":"crossref","first-page":"61","DOI":"10.20982\/tqmp.09.2.p061","article-title":"Improving maximum likelihood estimation using prior probabilities: a tutorial on maximum a posteriori estimation and an examination of the weibull distribution","volume":"9","author":"Cousineau","year":"2013","journal-title":"Tutorials Quant. Methods Psychol"},{"key":"2023012713561248100_bty035-B11","volume-title":"Theoretical Statistics","author":"Cox","year":"1994"},{"key":"2023012713561248100_bty035-B12","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.mbs.2014.08.008","article-title":"Determining identifiable parameter combinations using subset profiling","volume":"256","author":"Eisenberg","year":"2014","journal-title":"Math. Biosci"},{"key":"2023012713561248100_bty035-B13","doi-asserted-by":"crossref","first-page":"2612","DOI":"10.1093\/bioinformatics\/btm382","article-title":"Data-based identifiability analysis of non-linear dynamical models","volume":"23","author":"Hengl","year":"2007","journal-title":"Bioinformatics"},{"key":"2023012713561248100_bty035-B14","doi-asserted-by":"crossref","first-page":"339","DOI":"10.2166\/wst.2001.0443","article-title":"A numerical identifiability test for state-space models\u2013application to optimal experimental design","volume":"43","author":"Hidalgo","year":"2001","journal-title":"Water Sci. Technol"},{"key":"2023012713561248100_bty035-B15","doi-asserted-by":"crossref","first-page":"941","DOI":"10.3182\/20120711-3-BE-2027.00381","article-title":"An efficient method for structural identifiability analysis of large dynamic systems*","volume":"45","author":"Karlsson","year":"2012","journal-title":"IFAC Proc. Vol"},{"key":"2023012713561248100_bty035-B16","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/j.ifacol.2016.12.104","article-title":"New concepts for evaluating the performance of computational methods","volume":"49","author":"Kreutz","year":"2016","journal-title":"IFAC-PapersOnLine"},{"key":"2023012713561248100_bty035-B17","doi-asserted-by":"crossref","first-page":"923","DOI":"10.1111\/j.1742-4658.2008.06843.x","article-title":"Systems biology: experimental design","volume":"276","author":"Kreutz","year":"2009","journal-title":"FEBS J"},{"key":"2023012713561248100_bty035-B18","doi-asserted-by":"crossref","DOI":"10.1186\/1752-0509-6-120","article-title":"Likelihood based observability analysis and confidence intervals for predictions of dynamic models","volume-title":"BMC Systems Biology","author":"Kreutz","year":"2012"},{"key":"2023012713561248100_bty035-B19","doi-asserted-by":"crossref","first-page":"2564","DOI":"10.1111\/febs.12276","article-title":"Profile likelihood in systems biology","volume":"280","author":"Kreutz","year":"2013","journal-title":"FEBS J"},{"key":"2023012713561248100_bty035-B20","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1145\/42288.46156","article-title":"The simultaneous solution and sensitivity analysis of systems described by ordinary differential equations","volume":"14","author":"Leis","year":"1988","journal-title":"ACM T. Math. Softw"},{"key":"2023012713561248100_bty035-B21","doi-asserted-by":"crossref","first-page":"e8915","DOI":"10.1371\/journal.pone.0008915","article-title":"Parameter identifiability and redundancy: theoretical considerations","volume":"5","author":"Little","year":"2010","journal-title":"Plos One"},{"key":"2023012713561248100_bty035-B22","volume-title":"System Identification","author":"Ljung","year":"1999"},{"key":"2023012713561248100_bty035-B23","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/0005-1098(94)90029-9","article-title":"On global identifiability for arbitrary model parameterizations","volume":"30","author":"Ljung","year":"1994","journal-title":"Automatica"},{"key":"2023012713561248100_bty035-B24","doi-asserted-by":"crossref","first-page":"012920.","DOI":"10.1103\/PhysRevE.92.012920","article-title":"Higher-order lie-symmetries in identifiability and predictability analysis of dynamic models","volume":"92","author":"Merkt","year":"2015","journal-title":"Phys. Rev. E,"},{"key":"2023012713561248100_bty035-B25","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1137\/090757009","article-title":"On identifiability of nonlinear ode models and applications in viral dynamics","volume":"53","author":"Miao","year":"2011","journal-title":"SIAM Rev"},{"key":"2023012713561248100_bty035-B26","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1016\/S0005-1098(02)00302-3","article-title":"Parameter identifiability of nonlinear systems: the role of initial conditions","volume":"39","author":"Pia Saccomani","year":"2003","journal-title":"Automatica"},{"key":"2023012713561248100_bty035-B27","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1016\/0025-5564(78)90063-9","article-title":"System identifiability based on power-series expansion of solution","volume":"41","author":"Pohjanpalo","year":"1978","journal-title":"Math. Biosci"},{"key":"2023012713561248100_bty035-B28","doi-asserted-by":"crossref","first-page":"693","DOI":"10.1158\/0008-5472.CAN-10-2987","article-title":"Dynamic mathematical modeling of IL13-induced signaling in hodgkin and primary mediastinal b-cell lymphoma allows prediction of therapeutic targets","volume":"71","author":"Raia","year":"2011","journal-title":"Cancer Res"},{"key":"2023012713561248100_bty035-B29","doi-asserted-by":"crossref","first-page":"032314.","DOI":"10.1103\/PhysRevE.95.032314","article-title":"Delineating parameter unidentifiabilities in complex models","volume":"95","author":"Raman","year":"2017","journal-title":"Phys. Rev. E"},{"key":"2023012713561248100_bty035-B30","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1093\/bioinformatics\/btp358","article-title":"Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood","volume":"25","author":"Raue","year":"2009","journal-title":"Bioinformatics"},{"key":"2023012713561248100_bty035-B31","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1049\/iet-syb.2010.0061","article-title":"Addressing parameter identifiability by model-based experimentation","volume":"5","author":"Raue","year":"2011","journal-title":"IET Syst. Biol"},{"key":"2023012713561248100_bty035-B32","doi-asserted-by":"crossref","first-page":"e74335.","DOI":"10.1371\/journal.pone.0074335","article-title":"Lessons learned from quantitative dynamical modeling in systems biology","volume":"8","author":"Raue","year":"2013","journal-title":"Plos One"},{"key":"2023012713561248100_bty035-B33","doi-asserted-by":"crossref","first-page":"3558","DOI":"10.1093\/bioinformatics\/btv405","article-title":"Data2Dynamics: a modeling environment tailored to parameter estimation in dynamical systems","volume":"31","author":"Raue","year":"2015","journal-title":"Bioinformatics"},{"key":"2023012713561248100_bty035-B34","doi-asserted-by":"crossref","first-page":"e0133653.","DOI":"10.1371\/journal.pone.0133653","article-title":"Representative sinusoids for hepatic four-scale pharmacokinetics simulations","volume":"10","author":"Schwen","year":"2015","journal-title":"Plos One"},{"key":"2023012713561248100_bty035-B35","doi-asserted-by":"crossref","first-page":"1028","DOI":"10.1073\/pnas.0237333100","article-title":"Identification of nucleocytoplasmic cycling as a remote sensor in cellular signaling by data-based modeling","volume":"100","author":"Swameye","year":"2003","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"2023012713561248100_bty035-B36","author":"The MathWorks","year":"2016"},{"key":"2023012713561248100_bty035-B37","article-title":"Profile likelihood based analyses of infectious disease models","author":"T\u00f6nsing","year":"2017","journal-title":"Stat. Methods Med. Res"},{"key":"2023012713561248100_bty035-B38","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1016\/0025-5564(81)90052-3","article-title":"On structural identification","volume":"56","author":"Travis","year":"1981","journal-title":"Math. Biosci"},{"key":"2023012713561248100_bty035-B39","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/0025-5564(81)90012-2","article-title":"Structural equivalence of linear systems and compartment models","volume":"55","author":"Vajda","year":"1981","journal-title":"Math. Biosci"},{"key":"2023012713561248100_bty035-B40","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1002\/(SICI)1521-4036(199807)40:3<313::AID-BIMJ313>3.0.CO;2-2","article-title":"Parameter identifiability and model selection in capture-recapture models: a numerical approach","volume":"40","author":"Viallefont","year":"1998","journal-title":"Biometric. J"},{"key":"2023012713561248100_bty035-B41","doi-asserted-by":"crossref","first-page":"472","DOI":"10.1016\/0378-4754(82)90645-0","article-title":"Global approaches to identifiability testing for linear and nonlinear state space models","volume":"24","author":"Walter","year":"1982","journal-title":"Math. Comp. Simul"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/11\/1913\/48937746\/bioinformatics_34_11_1913.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/34\/11\/1913\/48937746\/bioinformatics_34_11_1913.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,27]],"date-time":"2023-01-27T14:28:20Z","timestamp":1674829700000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/34\/11\/1913\/4820336"}},"subtitle":[],"editor":[{"given":"Bonnie","family":"Berger","sequence":"additional","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2018,1,22]]},"references-count":41,"journal-issue":{"issue":"11","published-print":{"date-parts":[[2018,6,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/bty035","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2018,6,1]]},"published":{"date-parts":[[2018,1,22]]}}}