{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,8]],"date-time":"2026-01-08T06:20:27Z","timestamp":1767853227493,"version":"3.49.0"},"reference-count":43,"publisher":"Oxford University Press (OUP)","issue":"23","license":[{"start":{"date-parts":[[2016,10,2]],"date-time":"2016-10-02T00:00:00Z","timestamp":1475366400000},"content-version":"vor","delay-in-days":1454,"URL":"http:\/\/creativecommons.org\/licenses\/by-nc\/3.0"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2012,12,1]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>Motivation: Biochemical reaction networks in the form of coupled ordinary differential equations (ODEs) provide a powerful modeling tool for understanding the dynamics of biochemical processes. During the early phase of modeling, scientists have to deal with a large pool of competing nonlinear models. At this point, discrimination experiments can be designed and conducted to obtain optimal data for selecting the most plausible model. Since biological ODE models have widely distributed parameters due to, e.g. biologic variability or experimental variations, model responses become distributed. Therefore, a robust optimal experimental design (OED) for model discrimination can be used to discriminate models based on their response probability distribution functions (PDFs).<\/jats:p><jats:p>Results: In this work, we present an optimal control-based methodology for designing optimal stimulus experiments aimed at robust model discrimination. For estimating the time-varying model response PDF, which results from the nonlinear propagation of the parameter PDF under the ODE dynamics, we suggest using the sigma-point approach. Using the model overlap (expected likelihood) as a robust discrimination criterion to measure dissimilarities between expected model response PDFs, we benchmark the proposed nonlinear design approach against linearization with respect to prediction accuracy and design quality for two nonlinear biological reaction networks. As shown, the sigma-point outperforms the linearization approach in the case of widely distributed parameter sets and\/or existing multiple steady states. Since the sigma-point approach scales linearly with the number of model parameter, it can be applied to large systems for robust experimental planning.<\/jats:p><jats:p>Availability: An implementation of the method in MATLAB\/AMPL is available at http:\/\/www.uni-magdeburg.de\/ivt\/svt\/person\/rf\/roed.html.<\/jats:p><jats:p>Contact: flassig@mpi-magdeburg.mpg.de<\/jats:p><jats:p>Supplementary information: Supplementary data are are available at Bioinformatics online.<\/jats:p>","DOI":"10.1093\/bioinformatics\/bts585","type":"journal-article","created":{"date-parts":[[2012,10,10]],"date-time":"2012-10-10T08:45:27Z","timestamp":1349858727000},"page":"3089-3096","source":"Crossref","is-referenced-by-count":25,"title":["Optimal design of stimulus experiments for robust discrimination of biochemical reaction networks"],"prefix":"10.1093","volume":"28","author":[{"given":"R. J.","family":"Flassig","sequence":"first","affiliation":[]},{"given":"K.","family":"Sundmacher","sequence":"additional","affiliation":[]}],"member":"286","published-online":{"date-parts":[[2012,10,9]]},"reference":[{"key":"2023062411495520600_bts585-B1","doi-asserted-by":"crossref","first-page":"e30","DOI":"10.1371\/journal.pcbi.0040030","article-title":"Stimulus design for model selection and validation in cell signaling","volume":"4","author":"Apgar","year":"2008","journal-title":"PLoS Comput. Biol."},{"key":"2023062411495520600_bts585-B2","doi-asserted-by":"crossref","first-page":"545","DOI":"10.1016\/S0959-1524(01)00020-8","article-title":"Designing robust optimal dynamic experiments","volume":"12","author":"Asprey","year":"2002","journal-title":"J. Process Control"},{"key":"2023062411495520600_bts585-B4","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1049\/iet-syb:20070069","article-title":"Computational procedures for optimal experimental design in biological systems","volume":"2","author":"Balsa-Canto","year":"2008","journal-title":"IET Syst. Biol."},{"key":"2023062411495520600_bts585-B5","doi-asserted-by":"crossref","first-page":"e1000558","DOI":"10.1371\/journal.pcbi.1000558","article-title":"Optimal experimental design for parameter estimation of a cell signaling model","volume":"5","author":"Bandara","year":"2009","journal-title":"PLoS Comput. Biol."},{"key":"2023062411495520600_bts585-B6","doi-asserted-by":"crossref","first-page":"806","DOI":"10.1529\/biophysj.107.107516","article-title":"Mathematical and computational analysis of adaptation via feedback inhibition in signal transduction pathways","volume":"93","author":"Behar","year":"2007","journal-title":"Biophys. J."},{"key":"2023062411495520600_bts585-B7","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1016\/j.cmpb.2007.07.002","article-title":"DAISY: a new software tool to test global identifiability of biological and physiological Systems","volume":"88","author":"Bellu","year":"2007","journal-title":"Comput. Methods Programs Biomed."},{"key":"2023062411495520600_bts585-B8","doi-asserted-by":"crossref","first-page":"1043","DOI":"10.1016\/j.cep.2006.06.021","article-title":"An overview of simultaneous strategies for dynamic optimization","volume":"46","author":"Biegler","year":"2007","journal-title":"Chem. Eng. Process."},{"key":"2023062411495520600_bts585-B9","doi-asserted-by":"crossref","first-page":"211","DOI":"10.1111\/j.2517-6161.1964.tb00553.x","article-title":"An analysis of transformations","volume":"26","author":"Box","year":"1964","journal-title":"J. Roy. Stat. Soc. B"},{"key":"2023062411495520600_bts585-B10","doi-asserted-by":"crossref","first-page":"57","DOI":"10.1080\/00401706.1967.10490441","article-title":"Discrimination among mechanistic models","volume":"9","author":"Box","year":"1967","journal-title":"Technometrics"},{"key":"2023062411495520600_bts585-B11","doi-asserted-by":"crossref","first-page":"1379","DOI":"10.1021\/ie0203025","article-title":"On the design of optimally informative dynamic experiments for model discrimination in multiresponse nonlinear situations","volume":"42","author":"Chen","year":"2003","journal-title":"Ind. Eng. Chem. Res."},{"key":"2023062411495520600_bts585-B12","doi-asserted-by":"crossref","first-page":"20","DOI":"10.1016\/j.chemolab.2011.06.008","article-title":"Performance assessment of the anticipatory approach to optimal experimental design for model discrimination","volume":"110","author":"Donckels","year":"2012","journal-title":"Chemometr. Intell. Lab."},{"key":"2023062411495520600_bts585-B13","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1287\/ijoc.6.2.207","article-title":"CONOPT\u2014a large-scale grg code","volume":"6","author":"Drud","year":"1994","journal-title":"INFORMS J. Comput."},{"key":"2023062411495520600_bts585-B14","volume-title":"Minimax and Applications (Nonconvex Optimization and Its Applications)","author":"Du","year":"1995"},{"key":"2023062411495520600_bts585-B15","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s10898-008-9332-8","article-title":"A review of recent advances in global optimization","volume":"45","author":"Floudas","year":"2009","journal-title":"J. Global Optim."},{"key":"2023062411495520600_bts585-B16","first-page":"473","article-title":"Practical Markov chain Monte Carlo","volume":"7","author":"Geyer","year":"1992","journal-title":"Stat. Sci."},{"key":"2023062411495520600_bts585-B17","doi-asserted-by":"crossref","DOI":"10.1109\/ICASSP.2008.4518435","article-title":"On nonlinear transformations of stochastic variables and its application to nonlinear filtering","volume-title":"IEEE International Conference on Acoustics, Speech and Signal Processing","author":"Gustafsson","year":"2008"},{"key":"2023062411495520600_bts585-B18","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1162\/106365601750190398","article-title":"Completely derandomized self-adaptation in evolution strategies","volume":"9","author":"Hansen","year":"2001","journal-title":"Evol. Comput."},{"key":"2023062411495520600_bts585-B19","doi-asserted-by":"crossref","first-page":"4873","DOI":"10.1016\/j.ces.2008.01.030","article-title":"Derivative-free optimal experimental design","volume":"63","author":"Heine","year":"2008","journal-title":"Chem. Eng. Sci."},{"key":"2023062411495520600_bts585-B20","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4615-0015-5","volume-title":"Introduction to Global Optimization. Nonconvex Optimization and its Applications","author":"Horst","year":"2000"},{"key":"2023062411495520600_bts585-B21","first-page":"819","article-title":"Probability product kernels","volume":"5","author":"Jebara","year":"2004","journal-title":"J. Mach. Learn. Res."},{"key":"2023062411495520600_bts585-B22","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1093\/biomet\/36.1-2.149","article-title":"Systems of frequency curves generated by methods of translation","volume":"36","author":"Johnson","year":"1949","journal-title":"Biometrika"},{"key":"2023062411495520600_bts585-B23","doi-asserted-by":"crossref","first-page":"477","DOI":"10.1109\/9.847726","article-title":"A new method for the nonlinear transformation of means and covariances in filters and estimators","volume":"45","author":"Julier","year":"2000","journal-title":"IEEE Trans. Automat. Contr."},{"key":"2023062411495520600_bts585-B24","doi-asserted-by":"crossref","first-page":"1773","DOI":"10.1101\/gr.1226004","article-title":"A benchmark for methods in reverse engineering and model discrimination: problem formulation and solutions","volume":"14","author":"Kremling","year":"2004","journal-title":"Genome Res."},{"key":"2023062411495520600_bts585-B25","doi-asserted-by":"crossref","first-page":"1384","DOI":"10.1002\/jcc.20674","article-title":"Discrimination of dynamical system models for biological and chemical processes","volume":"28","author":"Lorenz","year":"2007","journal-title":"J. Comput. Chem."},{"key":"2023062411495520600_bts585-B26","doi-asserted-by":"crossref","first-page":"38","DOI":"10.1186\/1752-0509-4-38","article-title":"Discriminating between rival biochemical network models: three approaches to optimal experiment design","volume":"4","author":"Melykuti","year":"2010","journal-title":"BMC Syst. Biol."},{"key":"2023062411495520600_bts585-B27","doi-asserted-by":"crossref","first-page":"913","DOI":"10.1021\/ie900903u","article-title":"Optimal experimental design for discriminating numerous model candidates: the AWDC criterion","volume":"49","author":"Michalik","year":"2010","journal-title":"Ind. Eng. Chem. Res."},{"key":"2023062411495520600_bts585-B28","volume-title":"Constrained control of nonlinear systems","author":"Nevistic","year":"1997"},{"key":"2023062411495520600_bts585-B29","first-page":"153","article-title":"Mitogen-activated protein (MAP) kinase pathways: regulation and physiological functions","volume":"22","author":"Pearson","year":"2001","journal-title":"Endocr. Rev."},{"key":"2023062411495520600_bts585-B30","first-page":"161","article-title":"A cybernetic perspective of microbial growth","volume-title":"Foundations of Biochemical Engineering: Kinetics and Thermodynamics in Biological Systems","author":"Ramkrishna","year":"1982"},{"key":"2023062411495520600_bts585-B31","doi-asserted-by":"crossref","first-page":"1923","DOI":"10.1093\/bioinformatics\/btp358","article-title":"Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood","volume":"25","author":"Raue","year":"2009","journal-title":"Bioinformatics"},{"key":"2023062411495520600_bts585-B32","doi-asserted-by":"crossref","first-page":"045105","DOI":"10.1063\/1.3528102","article-title":"Identifiability and observability analysis for experimental design in nonlinear dynamical models","volume":"20","author":"Raue","year":"2010","journal-title":"Chaos"},{"key":"2023062411495520600_bts585-B33","doi-asserted-by":"crossref","first-page":"10","DOI":"10.1049\/iet-syb:20080094","article-title":"Optimal experimental design with the sigma point method","volume":"3","author":"Schenkendorf","year":"2009","journal-title":"IET Syst. Biol."},{"key":"2023062411495520600_bts585-B34","article-title":"Optimal experimental design and model selection by a sigma point approach","volume-title":"Proceedings MATHMOD, Vienna, Austria","author":"Schenkendorf","year":"2009"},{"key":"2023062411495520600_bts585-B35","doi-asserted-by":"crossref","first-page":"147","DOI":"10.1007\/BF01379769","article-title":"Chemical reaction models for non-equilibrium phase transitions","volume":"253","author":"Schl\u00f6gl","year":"1972","journal-title":"Z.f.Physik"},{"key":"2023062411495520600_bts585-B36","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1205\/026387698525360","article-title":"On establishing the credibility of a model for a system","volume":"76","author":"Singh","year":"1998","journal-title":"Chem. Eng. Res. Des."},{"key":"2023062411495520600_bts585-B37","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1093\/bioinformatics\/btq074","article-title":"An optimal experimental design approach to model discrimination in dynamic biochemical systems","volume":"26","author":"Skanda","year":"2010","journal-title":"Bioinformatics"},{"key":"2023062411495520600_bts585-B38","article-title":"A robust optimization approach to experimental design for model discrimination of dynamical systems","author":"Skanda","year":"2012","journal-title":"Math. Program"},{"key":"2023062411495520600_bts585-B39","first-page":"407","article-title":"Sensitivity analysis for nonlinear mathematical models","volume":"1","author":"Sobol\u2019","year":"1993","journal-title":"Math. Mod. Com. Exp."},{"key":"2023062411495520600_bts585-B40","doi-asserted-by":"crossref","first-page":"1602","DOI":"10.1109\/18.850703","article-title":"Some inequalities for information divergence and related measures of discrimination","volume":"46","author":"Topsoe","year":"2000","journal-title":"IEEE Trans. Inform. Theory"},{"key":"2023062411495520600_bts585-B41","doi-asserted-by":"crossref","first-page":"925","DOI":"10.1098\/rsif.2008.0476","article-title":"Stochastic dynamics and non-equilibrium thermodynamics of a bistable chemical system: the Schl\u00f6gl model revisited","volume":"6","author":"Vellela","year":"2009","journal-title":"J. R. Soc. Interface"},{"key":"2023062411495520600_bts585-B42","doi-asserted-by":"crossref","first-page":"1136","DOI":"10.1093\/bioinformatics\/bts092","article-title":"A Bayesian approach to targeted experiment design","volume":"28","author":"Vanlier","year":"2012","journal-title":"Bioinformatics"},{"key":"2023062411495520600_bts585-B43","volume-title":"Identification of Parametric Models from Experimental Data. Communications and Control Engineering","author":"Walter","year":"1997"},{"key":"2023062411495520600_bts585-B44","volume-title":"Stochastic Adaptive Search for Global Optimization. Nonconvex Optimization and Its Applications","author":"Zabinsky","year":"2003"}],"container-title":["Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/28\/23\/3089\/50694596\/bioinformatics_28_23_3089.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article-pdf\/28\/23\/3089\/50694596\/bioinformatics_28_23_3089.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,30]],"date-time":"2024-04-30T05:03:51Z","timestamp":1714453431000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/bioinformatics\/article\/28\/23\/3089\/194080"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,10,9]]},"references-count":43,"journal-issue":{"issue":"23","published-print":{"date-parts":[[2012,12,1]]}},"URL":"https:\/\/doi.org\/10.1093\/bioinformatics\/bts585","relation":{},"ISSN":["1367-4803","1367-4811"],"issn-type":[{"value":"1367-4803","type":"print"},{"value":"1367-4811","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2012,12]]},"published":{"date-parts":[[2012,10,9]]}}}