{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,9]],"date-time":"2026-01-09T16:33:13Z","timestamp":1767976393190,"version":"3.49.0"},"reference-count":31,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2012,5,1]],"date-time":"2012-05-01T00:00:00Z","timestamp":1335830400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/2.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["BMC Bioinformatics"],"published-print":{"date-parts":[[2012,12]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:sec><jats:title>Background<\/jats:title><jats:p>A prerequisite for the mechanistic simulation of a biochemical system is detailed knowledge of its kinetic parameters. Despite recent experimental advances, the estimation of unknown parameter values from observed data is still a bottleneck for obtaining accurate simulation results. Many methods exist for parameter estimation in deterministic biochemical systems; methods for discrete stochastic systems are less well developed. Given the probabilistic nature of stochastic biochemical models, a natural approach is to choose parameter values that maximize the probability of the observed data with respect to the unknown parameters, a.k.a. the maximum likelihood parameter estimates (MLEs). MLE computation for all but the simplest models requires the simulation of many system trajectories that are consistent with experimental data. For models with unknown parameters, this presents a computational challenge, as the generation of consistent trajectories can be an extremely rare occurrence.<\/jats:p><\/jats:sec><jats:sec><jats:title>Results<\/jats:title><jats:p>We have developed Monte Carlo Expectation-Maximization with Modified Cross-Entropy Method (MCEM<jats:sup>2<\/jats:sup>): an accelerated method for calculating MLEs that combines advances in rare event simulation with a computationally efficient version of the Monte Carlo expectation-maximization (MCEM) algorithm. Our method requires no prior knowledge regarding parameter values, and it automatically provides a multivariate parameter uncertainty estimate. We applied the method to five stochastic systems of increasing complexity, progressing from an analytically tractable pure-birth model to a computationally demanding model of yeast-polarization. Our results demonstrate that MCEM<jats:sup>2<\/jats:sup>substantially accelerates MLE computation on all tested models when compared to a stand-alone version of MCEM. Additionally, we show how our method identifies parameter values for certain classes of models more accurately than two recently proposed computationally efficient methods.<\/jats:p><\/jats:sec><jats:sec><jats:title>Conclusions<\/jats:title><jats:p>This work provides a novel, accelerated version of a likelihood-based parameter estimation method that can be readily applied to stochastic biochemical systems. In addition, our results suggest opportunities for added efficiency improvements that will further enhance our ability to mechanistically simulate biological processes.<\/jats:p><\/jats:sec>","DOI":"10.1186\/1471-2105-13-68","type":"journal-article","created":{"date-parts":[[2012,5,1]],"date-time":"2012-05-01T10:14:30Z","timestamp":1335867270000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":50,"title":["Accelerated maximum likelihood parameter estimation for stochastic biochemical systems"],"prefix":"10.1186","volume":"13","author":[{"suffix":"Jr","given":"Bernie J","family":"Daigle","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Min K","family":"Roh","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Linda R","family":"Petzold","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jarad","family":"Niemi","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2012,5,1]]},"reference":[{"issue":"5","key":"5434_CR1","doi-asserted-by":"publisher","first-page":"343","DOI":"10.1039\/b618473c","volume":"3","author":"C Tan","year":"2007","unstructured":"Tan C, Song H, Niemi J, You L: A synthetic biology challenge: making cells compute. Mol Biosyst 2007, 3(5):343\u201353. 10.1039\/b618473c","journal-title":"Mol Biosyst"},{"key":"5434_CR2","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1186\/1471-2105-11-414","volume":"11","author":"SK Poovathingal","year":"2010","unstructured":"Poovathingal SK, Gunawan R: Global parameter estimation methods for stochastic biochemical systems. BMC Bioinf 2010, 11: 414. 10.1186\/1471-2105-11-414","journal-title":"BMC Bioinf"},{"issue":"11","key":"5434_CR3","doi-asserted-by":"publisher","first-page":"2467","DOI":"10.1101\/gr.1262503","volume":"13","author":"CG Moles","year":"2003","unstructured":"Moles CG, Mendes P, Banga JR: Parameter estimation in biochemical pathways: a comparison of global optimization methods. Genome Res 2003, 13(11):2467\u201374. 10.1101\/gr.1262503","journal-title":"Genome Res"},{"key":"5434_CR4","doi-asserted-by":"publisher","first-page":"99","DOI":"10.1186\/1752-0509-4-99","volume":"4","author":"Y Wang","year":"2010","unstructured":"Wang Y, Christley S, Mjolsness E, Xie X: Parameter inference for discretely observed stochastic kinetic models using stochastic gradient descent. BMC Syst Biol 2010, 4: 99. 10.1186\/1752-0509-4-99","journal-title":"BMC Syst Biol"},{"issue":"3","key":"5434_CR5","doi-asserted-by":"publisher","first-page":"814","DOI":"10.1073\/pnas.94.3.814","volume":"94","author":"HH McAdams","year":"1997","unstructured":"McAdams HH, Arkin A: Stochastic mechanisms in gene expression. Proc Natl Acad Sci USA 1997, 94(3):814\u20139. 10.1073\/pnas.94.3.814","journal-title":"Proc Natl Acad Sci USA"},{"issue":"2","key":"5434_CR6","doi-asserted-by":"publisher","first-page":"65","DOI":"10.1016\/S0168-9525(98)01659-X","volume":"15","author":"HH McAdams","year":"1999","unstructured":"McAdams HH, Arkin A: It\u2019s a noisy business! Genetic regulation at the nanomolar scale. Trends Genet 1999, 15(2):65\u20139. 10.1016\/S0168-9525(98)01659-X","journal-title":"Trends Genet"},{"issue":"11","key":"5434_CR7","doi-asserted-by":"publisher","first-page":"842","DOI":"10.1038\/nchembio.218","volume":"5","author":"C Tan","year":"2009","unstructured":"Tan C, Marguet P, You L: Emergent bistability by a growth-modulating positive feedback circuit. Nat Chem Biol 2009, 5(11):842\u20138. 10.1038\/nchembio.218","journal-title":"Nat Chem Biol"},{"issue":"9","key":"5434_CR8","doi-asserted-by":"publisher","first-page":"5988","DOI":"10.1073\/pnas.092133899","volume":"99","author":"JMG Vilar","year":"2002","unstructured":"Vilar JMG, Kueh HY, Barkai N, Leibler S: Mechanisms of noise-resistance in genetic oscillators. Proc Natl Acad Sci U S A 2002, 99(9):5988\u201392. 10.1073\/pnas.092133899","journal-title":"Proc Natl Acad Sci U S A"},{"key":"5434_CR9","first-page":"2382","volume-title":"Decision and Control, 2006 45th IEEE Conference on","author":"H El-Samad","year":"2006","unstructured":"El-Samad H, Khammash M: Coherence Resonance: A Mechanism for Noise Induced Stable Oscillations in Gene Regulatory Networks. Decision and Control, 2006 45th IEEE Conference on 2006, 2382\u20132387."},{"issue":"6","key":"5434_CR10","doi-asserted-by":"publisher","first-page":"356","DOI":"10.1049\/iet-syb.2010.0013","volume":"4","author":"B Munsky","year":"2010","unstructured":"Munsky B, Khammash M: Identification from stochastic cell-to-cell variation: a genetic switch case study. IET Syst Biol 2010, 4(6):356\u201366. 10.1049\/iet-syb.2010.0013","journal-title":"IET Syst Biol"},{"issue":"25","key":"5434_CR11","doi-asserted-by":"publisher","first-page":"2340","DOI":"10.1021\/j100540a008","volume":"81","author":"DT Gillespie","year":"1977","unstructured":"Gillespie DT: Exact stochastic simulation of coupled chemical reactions. J Phys Chem 1977, 81(25):2340\u20132361. 10.1021\/j100540a008","journal-title":"J Phys Chem"},{"key":"5434_CR12","doi-asserted-by":"publisher","first-page":"84","DOI":"10.1093\/bioinformatics\/btl552","volume":"23","author":"T Tian","year":"2007","unstructured":"Tian T, Xu S, Gao J, Burrage K: Simulated maximum likelihood method for estimating kinetic rates in gene expression. Bioinformatics 2007, 23: 84\u201391. 10.1093\/bioinformatics\/btl552","journal-title":"Bioinformatics"},{"key":"5434_CR13","first-page":"713","volume-title":"BMEI (1)","author":"A Horv\u00e1th","year":"2008","unstructured":"Horv\u00e1th A, Manini D: Parameter Estimation of Kinetic Rates in Stochastic Reaction Networks by the EM Method. BMEI (1) 2008, 713\u2013717."},{"issue":"2","key":"5434_CR14","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/s11222-007-9043-x","volume":"18","author":"RJ Boys","year":"2008","unstructured":"Boys RJ, Wilkinson DJ, Kirkwood TBL: Bayesian inference for a discretely observed stochastic kinetic model. Stat Comput 2008, 18(2):125\u2013135. 10.1007\/s11222-007-9043-x","journal-title":"Stat Comput"},{"key":"5434_CR15","doi-asserted-by":"publisher","first-page":"89","DOI":"10.1016\/S0377-2217(96)00385-2","volume":"99","author":"RY Rubinstein","year":"1997","unstructured":"Rubinstein RY: Optimization of computer simulation models with rare events. Eur J Operational Res 1997, 99: 89\u2013112. 10.1016\/S0377-2217(96)00385-2","journal-title":"Eur J Operational Res"},{"issue":"4","key":"5434_CR16","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1287\/opre.47.4.585","volume":"47","author":"P Glasserman","year":"1999","unstructured":"Glasserman P, Heidelberger P, Shahabuddin P, Zajic T: Multilevel splitting for estimating rare event probabilities. Operations Res 1999, 47(4):585\u2013600. 10.1287\/opre.47.4.585","journal-title":"Operations Res"},{"key":"5434_CR17","doi-asserted-by":"publisher","DOI":"10.1002\/9780470745403","volume-title":"Rare Event Simulation Using Monte Carlo methods","author":"G Rubino","year":"2009","unstructured":"Rubino G, Tuffin B: Rare Event Simulation Using Monte Carlo methods. Wiley, Chichester; 2009."},{"issue":"4","key":"5434_CR18","doi-asserted-by":"publisher","first-page":"044110","DOI":"10.1063\/1.3522769","volume":"134","author":"BJ Daigle Jr","year":"2011","unstructured":"Daigle Jr BJ, Roh MK, Gillespie DT, Petzold LR: Automated estimation of rare event probabilities in biochemical systems. J Chem Phys 2011, 134(4):044110. 10.1063\/1.3522769","journal-title":"J Chem Phys"},{"issue":"2","key":"5434_CR19","doi-asserted-by":"publisher","first-page":"235","DOI":"10.1111\/j.1467-9868.2005.00499.x","volume":"67","author":"BS Caffo","year":"2005","unstructured":"Caffo BS, Jank W, Jones GL: Ascent-based Monte Carlo expectation-maximization. J R Stat Soc Ser B 2005, 67(2):235\u2013251. 10.1111\/j.1467-9868.2005.00499.x","journal-title":"J R Stat Soc Ser B"},{"key":"5434_CR20","doi-asserted-by":"publisher","first-page":"35","DOI":"10.1146\/annurev.physchem.58.032806.104637","volume":"58","author":"DT Gillespie","year":"2007","unstructured":"Gillespie DT: Stochastic simulation of chemical kinetics. Annu Rev Phys Chem 2007, 58: 35\u201355. 10.1146\/annurev.physchem.58.032806.104637","journal-title":"Annu Rev Phys Chem"},{"key":"5434_CR21","doi-asserted-by":"crossref","DOI":"10.1201\/9781420010664","volume-title":"Stochastic modelling for systems biology","author":"DJ Wilkinson","year":"2006","unstructured":"Wilkinson DJ: Stochastic modelling for systems biology. Chapman and Hall\/CRC mathematical and computational biology series, Boca Raton: Taylor and Francis; 2006."},{"key":"5434_CR22","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.2517-6161.1977.tb01600.x","volume":"39","author":"AP Dempster","year":"1977","unstructured":"Dempster AP, Laird NM, Rubin DB: Maximum likelihood from incomplete data via the EM Algorithm. J R Stat Soc Series B (Methodological) 1977, 39: 1\u201338.","journal-title":"J R Stat Soc Series B (Methodological)"},{"key":"5434_CR23","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-4145-2","volume-title":"Monte Carlo Statistical Methods","author":"CP Robert","year":"2004","unstructured":"Robert CP, Casella G: Monte Carlo Statistical Methods. Springer, New York; 2004."},{"issue":"411","key":"5434_CR24","doi-asserted-by":"publisher","first-page":"699","DOI":"10.1080\/01621459.1990.10474930","volume":"85","author":"G Wei","year":"1990","unstructured":"Wei G, Tanner M: A Monte-Carlo implementation of the EM Algorithm and the poor man\u2019s data Augmentation Algorithms. J Am Stat Assoc 1990, 85(411):699\u2013704. 10.1080\/01621459.1990.10474930","journal-title":"J Am Stat Assoc"},{"key":"5434_CR25","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4757-4321-0","volume-title":"The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning","author":"RY Rubinstein","year":"2004","unstructured":"Rubinstein RY, Kroese DP: The Cross-Entropy Method: A Unified Approach to Combinatorial Optimization, Monte-Carlo Simulation, and Machine Learning. Springer, New York; 2004."},{"key":"5434_CR26","volume-title":"Rare event estimation for static models via cross-entropy and importance sampling","author":"T Homem-de Mello","year":"2002","unstructured":"Homem-de Mello T, Rubinstein RY: Rare event estimation for static models via cross-entropy and importance sampling.. Ohio State University; 2002."},{"issue":"49","key":"5434_CR27","doi-asserted-by":"publisher","first-page":"18438","DOI":"10.1073\/pnas.0603181103","volume":"103","author":"EL Ionides","year":"2006","unstructured":"Ionides EL, Bret\u00f3 C, King AA: Inference for nonlinear dynamical systems. Proc Natl Acad Sci USA 2006, 103(49):18438\u201343. 10.1073\/pnas.0603181103","journal-title":"Proc Natl Acad Sci USA"},{"key":"5434_CR28","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-4024-2","volume-title":"Tools for statistical inference: methods for the exploration of posterior distributions and likelihood functions","author":"MA Tanner","year":"1996","unstructured":"Tanner MA: Tools for statistical inference: methods for the exploration of posterior distributions and likelihood functions. Springer, New York; 1996."},{"issue":"4","key":"5434_CR29","doi-asserted-by":"publisher","first-page":"1716","DOI":"10.1063\/1.1378322","volume":"115","author":"DT Gillespie","year":"2001","unstructured":"Gillespie DT: Approximate accelerated stochastic simulation of chemically reacting systems. J Chem Phys 2001, 115(4):1716\u20131733. 10.1063\/1.1378322","journal-title":"J Chem Phys"},{"issue":"7","key":"5434_CR30","doi-asserted-by":"publisher","first-page":"074101","DOI":"10.1063\/1.3310809","volume":"132","author":"B Drawert","year":"2010","unstructured":"Drawert B, Lawson MJ, Petzold L, Khammash M: The diffusive finite state projection algorithm for efficient simulation of the stochastic reaction-diffusion master equation. J Chem Phys 2010, 132(7):074101. 10.1063\/1.3310809","journal-title":"J Chem Phys"},{"issue":"31","key":"5434_CR31","doi-asserted-by":"publisher","first-page":"187","DOI":"10.1098\/rsif.2008.0172","volume":"6","author":"T Toni","year":"2009","unstructured":"Toni T, Welch D, Strelkowa N, Ipsen A, Stumpf MPH: Approximate Bayesian computation scheme for parameter inference and model selection in dynamical systems. J R Soc Interface 2009, 6(31):187\u2013202. 10.1098\/rsif.2008.0172","journal-title":"J R Soc Interface"}],"container-title":["BMC Bioinformatics"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-13-68.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1186\/1471-2105-13-68\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/1471-2105-13-68.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2024,4,24]],"date-time":"2024-04-24T02:13:10Z","timestamp":1713924790000},"score":1,"resource":{"primary":{"URL":"https:\/\/bmcbioinformatics.biomedcentral.com\/articles\/10.1186\/1471-2105-13-68"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,5,1]]},"references-count":31,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2012,12]]}},"alternative-id":["5434"],"URL":"https:\/\/doi.org\/10.1186\/1471-2105-13-68","relation":{},"ISSN":["1471-2105"],"issn-type":[{"value":"1471-2105","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,5,1]]},"assertion":[{"value":"8 August 2011","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 May 2012","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"1 May 2012","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}],"article-number":"68"}}