{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:35:00Z","timestamp":1760240100803,"version":"build-2065373602"},"reference-count":63,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2019,2,14]],"date-time":"2019-02-14T00:00:00Z","timestamp":1550102400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In this paper first, we review the physical root bases of chemical reaction networks as a Markov process in multidimensional vector space. Then we study the chemical reactions from a microscopic point of view, to obtain the expression for the propensities for the different reactions that can happen in the network. These chemical propensities, at a given time, depend on the system state at that time, and do not depend on the state at an earlier time indicating that we are dealing with Markov processes. Then the Chemical Master Equation (CME) is deduced for an arbitrary chemical network from a probability balance and it is expressed in terms of the reaction propensities. This CME governs the dynamics of the chemical system. Due to the difficulty to solve this equation two methods are studied, the first one is the probability generating function method or z-transform, which permits to obtain the evolution of the factorial moment of the system with time in an easiest way or after some manipulation the evolution of the polynomial moments. The second method studied is the expansion of the CME in terms of an order parameter (system volume). In this case we study first the expansion of the CME using the propensities obtained previously and splitting the molecular concentration into a deterministic part and a random part. An expression in terms of multinomial coefficients is obtained for the evolution of the probability of the random part. Then we study how to reconstruct the probability distribution from the moments using the maximum entropy principle. Finally, the previous methods are applied to simple chemical networks and the consistency of these methods is studied.<\/jats:p>","DOI":"10.3390\/e21020181","type":"journal-article","created":{"date-parts":[[2019,2,14]],"date-time":"2019-02-14T11:54:13Z","timestamp":1550145253000},"page":"181","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Chemical Kinetics Roots and Methods to Obtain the Probability Distribution Function Evolution of Reactants and Products in Chemical Networks Governed by a Master Equation"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4512-7991","authenticated-orcid":false,"given":"Jos\u00e9-Luis","family":"Mu\u00f1oz-Cobo","sequence":"first","affiliation":[{"name":"Department of Chemical and Nuclear Engineering, Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"},{"name":"Instituto Universitario de Ingenier\u00eda Energ\u00e9tica, Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}]},{"given":"Cesar","family":"Berna","sequence":"additional","affiliation":[{"name":"Instituto Universitario de Ingenier\u00eda Energ\u00e9tica, Universitat Polit\u00e8cnica de Val\u00e8ncia, 46022 Valencia, Spain"}]}],"member":"1968","published-online":{"date-parts":[[2019,2,14]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"413","DOI":"10.2307\/3212214","article-title":"Stochastic Approach to Chemical Kinetics","volume":"4","year":"1967","journal-title":"J. Appl. Probab."},{"key":"ref_2","unstructured":"Montroll, E.W. (1967). Stochastic Processes in Chemical Kinetics. Energetics in Metallurgical Phenomena III, Gordon and Breach."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2632","DOI":"10.1063\/1.1672388","article-title":"Fluctuations in Open Systems","volume":"51","author":"Nicolis","year":"1969","journal-title":"J. Chem. Phys."},{"key":"ref_4","unstructured":"Nicolis, G., and Prigogine, I. (1977). Self-Organization in Non-Equilibrium Systems, Wiley Inter-Science."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1007\/BF01012838","article-title":"A Master Equation Description of Local Fluctuations","volume":"13","author":"Nicolis","year":"1975","journal-title":"J. Stat. Phys."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1016\/0378-4371(92)90283-V","article-title":"A Rigorous Derivation of the Chemical Master Equation","volume":"188","author":"Gillespie","year":"1992","journal-title":"Phys. A: Stat. Mech. Appl."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1146\/annurev.physchem.58.032806.104637","article-title":"Stochastic Simulation of Chemical Kinetics","volume":"58","author":"Gillespie","year":"2007","journal-title":"Annu. Rev. Phys. Chem."},{"key":"ref_8","doi-asserted-by":"crossref","unstructured":"Van Kampen, N.G. (2007). Stochastic Processes in Physics and Chemistry, Elsevier Science & Technology Books. [3rd ed.].","DOI":"10.1016\/B978-044452965-7\/50006-4"},{"key":"ref_9","first-page":"229","article-title":"The Reaction F + H2 \u2192 HF + H","volume":"Volume 41","author":"Prigogine","year":"1980","journal-title":"Advances in Chemical Physics"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"054103","DOI":"10.1063\/1.1835951","article-title":"Accurate hybrid stochastic simulation of a system of coupled chemical or biochemical reactions","volume":"122","author":"Salis","year":"2005","journal-title":"J. Chem. Phys."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"014116","DOI":"10.1063\/1.1824902","article-title":"The Slow Scale Stochastic Simulation Algorithm","volume":"122","author":"Cao","year":"2005","journal-title":"J. Chem. Phys."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"044104","DOI":"10.1063\/1.2145882","article-title":"The Finite State Projection Algorithm for the solution of the CME","volume":"124","author":"Munsky","year":"2006","journal-title":"J. Chem. Phys."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"612","DOI":"10.1016\/j.ces.2012.08.031","article-title":"Efficient Moment Matrix Generation for Arbitrary Chemical Networks","volume":"84","author":"Smadbeck","year":"2012","journal-title":"Chem. Eng. Sci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"268","DOI":"10.1016\/j.ces.2010.10.024","article-title":"Analytical Derivation of Moments Equations in Stochastic Chemical Kinetics","volume":"66","author":"Sotiropoulos","year":"2011","journal-title":"Chem. Eng. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"52","DOI":"10.1049\/iet-syb:20070031","article-title":"Moment-closure approximations for mass-action models","volume":"3","author":"Gillespie","year":"2009","journal-title":"IET Syst. Biol."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"154105","DOI":"10.1063\/1.3702848","article-title":"A study of the accuracy of moment-closure approximations for stochastic chemical kinetics","volume":"136","author":"Grima","year":"2012","journal-title":"J. Chem. Phys."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"042124","DOI":"10.1103\/PhysRevE.92.042124","article-title":"Linear-noise approximation and the chemical master equation agree up to second-order moments, for a class of chemical systems","volume":"92","author":"Grima","year":"2015","journal-title":"Phys. Rev. E"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"035101","DOI":"10.1063\/1.3454685","article-title":"An effective rate equation approach to reaction kinetics in small volumes: Theory and application to biochemical reactions in nonequilibrium steady state conditions","volume":"133","author":"Grima","year":"2010","journal-title":"J. Chem. Phys"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"185101","DOI":"10.1063\/1.4934990","article-title":"Comparison of different moment-closure approximations for stochastic chemical kinetics","volume":"143","author":"Schnoerr","year":"2015","journal-title":"J. Chem. Phys."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"093001","DOI":"10.1088\/1751-8121\/aa54d9","article-title":"Approximation and inference methods for stochastic biochemical kinetics\u2014A tutorial review","volume":"50","author":"Schnoerr","year":"2017","journal-title":"J. Phys. A Math. Theor."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1007\/s00285-013-0711-5","article-title":"Method of conditional moments (MCM) for the chemical master equation","volume":"69","author":"Hasenauer","year":"2014","journal-title":"J. Math. Biol."},{"key":"ref_22","unstructured":"Kazeroonian, A., Theis, F.J., and Hasenauer, J. (2014, January 24\u201329). Modelling of stochastic Biological Processes with Non-Polynomial Propensities Using Non-Central Conditional Moment Equations. Proceedings of the 19th World Congress of the International Federation of Automatic Control, Cape Town, South Africa."},{"key":"ref_23","doi-asserted-by":"crossref","unstructured":"Singh, A., and Hespanha, J.P. (2006, January 13\u201315). Lognormal moment closures for biochemical reactions. Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, CA, USA.","DOI":"10.1109\/CDC.2006.376994"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"414","DOI":"10.1109\/TAC.2010.2088631","article-title":"Approximate Moment Dynamics for Chemically Reacting Systems","volume":"56","author":"Singh","year":"2011","journal-title":"IEEE Trans. Autom. Control"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"165102","DOI":"10.1063\/1.3654135","article-title":"Moment estimation for chemically reacting systems by extended Kalman filtering","volume":"135","author":"Ruess","year":"2011","journal-title":"J. Chem. Phys."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Kazeroonian, A., Fr\u00f6hlich, F., Raue, A., Theis, F.J., and Hasenauer, J. (2016). CERENA: Chemical Reaction Network Analyzer\u2014A Toolbox for the Simulation and Analysis of Stochastic Chemical Kinetics. PLoS ONE, 11.","DOI":"10.1371\/journal.pone.0146732"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication\u2013Introduction","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1002\/j.1538-7305.1948.tb00917.x","article-title":"A Mathematical Theory of Communication\u2013Part III: Mathematical preliminaries","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1103\/PhysRev.106.620","article-title":"Information Theory and Statistical Mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Phys. Rev."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"939","DOI":"10.1109\/PROC.1982.12425","article-title":"On the rationale of maximum-entropy methods","volume":"70","author":"Jaynes","year":"1982","journal-title":"Proc. IEEE"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"2404","DOI":"10.1063\/1.526446","article-title":"Maximum Entropy in the problem of Moments","volume":"25","author":"Mead","year":"1984","journal-title":"J. Math. Phys."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1007\/BF01012708","article-title":"Maximum Entropy Formalism, Fractals, Scaling Phenomena, and 1\/f Noise: A Tale of Tails","volume":"32","author":"Montroll","year":"1983","journal-title":"J. Stat. Phys."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TIT.1980.1056144","article-title":"Axiomatic Derivation of the Principle of Maximum Entropy and the Principle of Minimum Cross-Entropy","volume":"26","author":"Sore","year":"1980","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Mu\u00f1oz-Cobo, J.L., Mendiz\u00e1bal, R., Miquel, A., Berna, C., and Escriv\u00e1, A. (2017). Use of the Principles of Maximum Entropy and Maximum Relative Entropy for the Determination of Uncertain Parameter Distributions in Engineering Applications. Entropy, 19.","DOI":"10.3390\/e19090486"},{"key":"ref_35","unstructured":"Woods, L.C. (1975). The Thermodynamics of Fluid Systems, Clarendon Press."},{"key":"ref_36","unstructured":"Landau, L.D., and Lifshitz, E.M. (1980). Course of Theoretical Physics. Statistical Physics, Butterworth-Heinemann. [3rd ed.]."},{"key":"ref_37","unstructured":"Kondepudi, D., and Prigogine, I. (1999). Modern Thermodynamics, John Willey and Sons."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"605","DOI":"10.1103\/RevModPhys.67.605","article-title":"Riemannian geometry in thermodynamic fluctuation theory","volume":"67","author":"Ruppeiner","year":"1995","journal-title":"Rev. Mod. Phys."},{"key":"ref_39","unstructured":"Abramowitz, M., and Stegun, I.A. (1972). Handbook of Mathematical Functions, Dover Publications. [9th ed.]."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Gardiner, C.W. (1997). Handbook of Stochastic Methods for Physics, Chemistry and the Natural Sciences, Second Edition 1985, Springer.","DOI":"10.1007\/978-3-662-02452-2"},{"key":"ref_41","first-page":"054111","article-title":"Validity conditions for stochastic chemical kinetics in diffusion-limited systems","volume":"140","author":"Gillespie","year":"2014","journal-title":"Chem. Phys."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"37","DOI":"10.1098\/rstb.1952.0012","article-title":"The Chemical Basis of Morphogenesis","volume":"237","author":"Turing","year":"1952","journal-title":"Philos. Trans. R. Soc. Lond. Sect. B"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"2953","DOI":"10.1103\/PhysRevLett.64.2953","article-title":"Experimental evidence of a sustained Turing-type non-equilibrium chemical pattern","volume":"64","author":"Castets","year":"1990","journal-title":"Phys. Rev. Lett."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"3601","DOI":"10.1039\/a702602a","article-title":"Spatial pattern formation in chemical and biological systems","volume":"93","author":"Maini","year":"1997","journal-title":"J. Chem. Soc. Faraday Trans."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1186\/s12976-015-0001-6","article-title":"The Spatial Chemical Langevin Equation and Reaction Diffusion Master Equations: Moments and Qualitative Solutions","volume":"12","author":"Ghosh","year":"2015","journal-title":"Theor. Biol. Med. Model."},{"key":"ref_46","unstructured":"Van Den Broeck, C. (1985). The Master Equation and Some Applications in Physics. Stochastic Processes Applied to Physics, World Scientific."},{"key":"ref_47","unstructured":"Medhi, J. (1982). Stochastic Processes: Theory and Applications, John Willey and Sons."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"1235","DOI":"10.1038\/nbt1253","article-title":"Deviant effects in molecular reaction pathways","volume":"24","author":"Samoilov","year":"2006","journal-title":"Nat. Biotechnol."},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Andreychenko, A., Bortolussi, L., Grima, R., Thomas, P., and Wolff, V. (2017). Distribution Approximations for the Chemical Master Equation: Comparison of the Method of Moments and the system Size Expansion. Modelling Cellular Systems, Springer International Publishing.","DOI":"10.1007\/978-3-319-45833-5_2"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"2524","DOI":"10.1103\/PhysRevA.34.2524","article-title":"Stimulated Recombination in Open Systems","volume":"34","year":"1986","journal-title":"Phys. Rev. A"},{"key":"ref_51","doi-asserted-by":"crossref","unstructured":"Koshy, T. (2004). Discrete Mathematics with Applications, AC Press.","DOI":"10.1016\/B978-012421180-3\/50008-5"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"035104","DOI":"10.1063\/1.4736721","article-title":"Steady-state fluctuations of a genetic feedback loop: An exact solution","volume":"137","author":"Grima","year":"2012","journal-title":"J. Chem. Phys."},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"3315","DOI":"10.1063\/1.1287273","article-title":"An analytical solution of the stochastic master equation for reversible bimolecular reaction kinetics","volume":"113","author":"Laurenzi","year":"2000","journal-title":"J. Chem. Phys."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/j.cageo.2003.09.001","article-title":"A Fortran Program to Produce Minimum Relative Entropy Distributions","volume":"30","author":"Woodbury","year":"2004","journal-title":"Comput. Geosci."},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Caticha, A., and Preuss, R. (2004). Maximum Entropy and Bayesian Data Analysis: Entropic Prior Distributions. Phys. Rev. E Stat. Nonlinear Soft Matter Phys., 70.","DOI":"10.1103\/PhysRevE.70.046127"},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Risken, H. (1996). The Fokker-Planck Equation: Methods of Solution and Applications, Springe.","DOI":"10.1007\/978-3-642-61544-3"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"5493","DOI":"10.1021\/jp110924w","article-title":"Michaelis-Menten Equation and Detailed Balance in Enzymatic Networks","volume":"115","author":"Cao","year":"2011","journal-title":"J. Phys. Chem. B"},{"key":"ref_58","first-page":"17018","article-title":"Beyond the Michaelis-Menten equation: Accurate and efficient estimation of enzyme kinetic parameters","volume":"7","author":"Choi","year":"2018","journal-title":"Sci. Rep. Nat."},{"key":"ref_59","doi-asserted-by":"crossref","unstructured":"Smadbeck, P. (2014). Chemical Master Equations for Non-linear Stochastic Reaction Networks: Closure Schemes and Implications for Discovery in the Biological Sciences. [Ph.D. Thesis, University of Minnesota].","DOI":"10.1016\/j.coche.2014.07.001"},{"key":"ref_60","doi-asserted-by":"crossref","unstructured":"Vlysidis, M., and Kaznessis, Y.N. (2018). On Differences between Deterministic and Stochastic Models of Chemical Reactions: Schl\u00f6gl Solved with ZI-Closure. Entropy, 20.","DOI":"10.3390\/e20090678"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"024109","DOI":"10.1063\/1.2408422","article-title":"Mass fluctuation kinetics: Capturing stochastic effects in systems of chemical reactions through coupled mean-variance computations","volume":"126","author":"Verghese","year":"2007","journal-title":"J. Chem. Phys."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Mu\u00f1oz-Cobo, J.L., and Sancho, J. (1988). Noise and NonLinear Phenomena in Nuclear System, Plenum.","DOI":"10.1007\/978-1-4684-5613-4"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"1876","DOI":"10.1021\/jp993732q","article-title":"Efficient stochastic simulation of chemical system with many species and many channels","volume":"104","author":"Gibson","year":"2000","journal-title":"J. Phys. Chem. A"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/2\/181\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:32:14Z","timestamp":1760185934000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/2\/181"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,2,14]]},"references-count":63,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2019,2]]}},"alternative-id":["e21020181"],"URL":"https:\/\/doi.org\/10.3390\/e21020181","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2019,2,14]]}}}