{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:25:02Z","timestamp":1760243102394,"version":"build-2065373602"},"reference-count":69,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2015,10,8]],"date-time":"2015-10-08T00:00:00Z","timestamp":1444262400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Biological networks are open systems that can utilize nutrients and energy from their environment for use in their metabolic processes, and produce metabolic products. System entropy is defined as the difference between input and output signal entropy, i.e., the net signal entropy of the biological system. System entropy is an important indicator for living or non-living biological systems, as biological systems can maintain or decrease their system entropy. In this study, system entropy is determined for the first time for stochastic biological networks, and a computation method is proposed to measure the system entropy of nonlinear stochastic biological networks that are subject to intrinsic random fluctuations and environmental disturbances. We find that intrinsic random fluctuations could increase the system entropy, and that the system entropy is inversely proportional to the robustness and stability of the biological networks. It is also determined that adding feedback loops to shift all eigenvalues to the farther left-hand plane of the complex s-domain could decrease the system entropy of a biological network.<\/jats:p>","DOI":"10.3390\/e17106801","type":"journal-article","created":{"date-parts":[[2015,10,8]],"date-time":"2015-10-08T11:48:57Z","timestamp":1444304937000},"page":"6801-6833","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":13,"title":["On the Calculation of System Entropy in Nonlinear Stochastic Biological Networks"],"prefix":"10.3390","volume":"17","author":[{"given":"Bor-Sen","family":"Chen","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, National Tsing Hua University, Hsinchu 30013, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Shang-Wen","family":"Wong","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Tsing Hua University, Hsinchu 30013, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Cheng-Wei","family":"Li","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, National Tsing Hua University, Hsinchu 30013, Taiwan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,10,8]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"463","DOI":"10.1126\/science.1146747","article-title":"Microbiology. Necessary noise","volume":"317","author":"Mettetal","year":"2007","journal-title":"Science"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1965","DOI":"10.1126\/science.1109090","article-title":"Noise propagation in gene networks","volume":"307","author":"Pedraza","year":"2005","journal-title":"Science"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"7304","DOI":"10.1073\/pnas.0509874103","article-title":"Predicting stochastic gene expression dynamics in single cells","volume":"103","author":"Mettetal","year":"2006","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"158701","DOI":"10.1103\/PhysRevLett.98.158701","article-title":"Basin Entropy in Boolean Network Ensembles","volume":"98","author":"Krawitz","year":"2007","journal-title":"Phys. Rev. Lett."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"036115","DOI":"10.1103\/PhysRevE.76.036115","article-title":"Entropy of complex relevant components of Boolean networks","volume":"76","author":"Krawitz","year":"2007","journal-title":"Phys. Rev. E"},{"key":"ref_6","unstructured":"Johansson, R. (1993). System Modeling and Identification, Springer."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1006\/jtbi.2000.2106","article-title":"Thermodynamics and evolution","volume":"206","author":"Demetrius","year":"2000","journal-title":"J. Theor. Biol."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1071","DOI":"10.3390\/e12051071","article-title":"On the Interplay between Entropy and Robustness of Gene Regulatory Networks","volume":"12","author":"Chen","year":"2010","journal-title":"Entropy"},{"key":"ref_9","unstructured":"Schr\u00f6dinger, E. What is Life?. Available online: http:\/\/159.226.251.229\/videoplayer\/What-is-Life.pdf?ich_u_r_i=79fe139669467dd24cdc11542b4e002f&ich_s_t_a_r_t=0&ich_e_n_d=0&ich_k_e_y=1545108906750663172441&ich_t_y_p_e=1&ich_d_i_s_k_i_d=3&ich_u_n_i_t=1."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1016\/j.physa.2006.10.059","article-title":"Irreversible entropy variation and the problem of the trend to equilibrium","volume":"376","author":"Lucia","year":"2007","journal-title":"Phys. A"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4025","DOI":"10.1016\/j.physa.2009.06.027","article-title":"Irreversibility, entropy and incomplete information","volume":"388","author":"Lucia","year":"2009","journal-title":"Phys. A"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"4558","DOI":"10.1016\/j.physa.2010.06.047","article-title":"Maximum entropy generation and kappa-exponential model","volume":"389","author":"Lucia","year":"2010","journal-title":"Phys. A"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"5717","DOI":"10.3390\/en7095717","article-title":"The Gouy-Stodola Theorem in Bioenergetic Analysis of Living Systems (Irreversibility in Bioenergetics of Living Systems)","volume":"7","author":"Lucia","year":"2014","journal-title":"Energies"},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"246","DOI":"10.1016\/j.physa.2015.05.046","article-title":"A thermodynamic approach to the \u2018mitosis\/apoptosis\u2019 ratio in cancer","volume":"436","author":"Lucia","year":"2015","journal-title":"Phys. A"},{"key":"ref_15","unstructured":"Boyd, S.P., Barratt, C.H., Boyd, S.P., and Boyd, S.P. (1991). Linear Controller Design: Limits of Performance, Prentice-Hall."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"25","DOI":"10.1109\/TSMCB.2007.906975","article-title":"Robust H\u221e stabilization design in gene networks under stochastic molecular noises: Fuzzy-interpolation approach","volume":"38","author":"Chen","year":"2008","journal-title":"IEEE Trans. Syst. Man Cybern B Cybern."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"D\u00edaz, J., and Alvarez-Buylla, E.R. (2009). Information flow during gene activation by signaling molecules: Ethylene transduction in Arabidopsis cells as a study system. BMC Syst. Biol., 3.","DOI":"10.1186\/1752-0509-3-48"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"19033","DOI":"10.1073\/pnas.0609152103","article-title":"Using the principle of entropy maximization to infer genetic interaction networks from gene expression patterns","volume":"103","author":"Lezon","year":"2006","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1098\/rsif.2006.0140","article-title":"An entropic characterization of protein interaction networks and cellular robustness","volume":"3","author":"Manke","year":"2006","journal-title":"J. R. Soc. Interface"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"65","DOI":"10.1016\/S0168-9525(98)01659-X","article-title":"It\u2019s a noisy business! Genetic regulation at the nanomolar scale","volume":"15","author":"McAdams","year":"1999","journal-title":"Trends Genet."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"1503","DOI":"10.1142\/S0218127405012636","article-title":"Robust dependencies and structures in stem cell differentiation","volume":"15","author":"Nagarajan","year":"2005","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"011917","DOI":"10.1103\/PhysRevE.76.011917","article-title":"Representing perturbed dynamics in biological network models","volume":"76","author":"Stoll","year":"2007","journal-title":"Phys. Rev. E Stat. Nonlin. Soft Matter. Phys."},{"key":"ref_23","first-page":"562","article-title":"Maximum entropy principle and population genetic equilibrium","volume":"29","author":"Wang","year":"2002","journal-title":"Acta. Genet. Sin."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"338","DOI":"10.1016\/j.ymben.2006.01.007","article-title":"The fractional contributions of elementary modes to the metabolism of Escherichia coli and their estimation from reaction entropies","volume":"8","author":"Wlaschin","year":"2006","journal-title":"Metab. Eng."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2841","DOI":"10.1016\/S0006-3495(03)70013-7","article-title":"Feedback regulation in the lactose operon: A mathematical modeling study and comparison with experimental data","volume":"84","author":"Yildirim","year":"2003","journal-title":"Biophys. J."},{"key":"ref_26","doi-asserted-by":"crossref","unstructured":"Boyd, S.P., El Ghaoui, L., Feron, E., and Balakrishnan, V. (1994). Linear Matrix Inequalities in System and Control Theory, SIAM.","DOI":"10.1137\/1.9781611970777"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"826","DOI":"10.1038\/nrg1471","article-title":"Biological robustness","volume":"5","author":"Kitano","year":"2004","journal-title":"Nat. Rev. Genet."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"12271","DOI":"10.1073\/pnas.0800579105","article-title":"Potential landscape and flux framework of nonequilibrium networks: Robustness, dissipation, and coherence of biochemical oscillations","volume":"105","author":"Wang","year":"2008","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_29","doi-asserted-by":"crossref","unstructured":"Krantz, M., Ahmadpour, D., Ottosson, L.G., Warringer, J., Waltermann, C., Nordlander, B., Klipp, E., Blomberg, A., Hohmann, S., and Kitano, H. (2009). Robustness and fragility in the yeast high osmolarity glycerol (HOG) signal-transduction pathway. Mol. Syst. Biol., 5.","DOI":"10.1038\/msb.2009.36"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"2150","DOI":"10.1016\/j.cub.2006.09.013","article-title":"An entropic mechanism to generate highly cooperative and specific binding from protein phosphorylations","volume":"16","author":"Lenz","year":"2006","journal-title":"Curr. Biol."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Chen, B.-S., and Chang, Y.-T. (2008). A systematic molecular circuit design method for gene networks under biochemical time delays and molecular noises. BMC Syst. Biol., 2.","DOI":"10.1186\/1752-0509-2-103"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"114","DOI":"10.1109\/TBCAS.2008.926728","article-title":"Robust Engineered Circuit Design Principles for Stochastic Biochemical Networks With Parameter Uncertainties and Disturbances","volume":"2","author":"Chen","year":"2008","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"92","DOI":"10.1016\/j.mbs.2009.09.004","article-title":"On the estimation of robustness and filtering ability of dynamic biochemical networks under process delays, internal parametric perturbations and external disturbances","volume":"222","author":"Chen","year":"2009","journal-title":"Math. Biosci."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"224","DOI":"10.1038\/nature01257","article-title":"Engineered gene circuits","volume":"420","author":"Hasty","year":"2002","journal-title":"Nature"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"6039","DOI":"10.1073\/pnas.0708708105","article-title":"Intrinsic noise, dissipation cost, and robustness of cellular networks: The underlying energy landscape of MAPK signal transduction","volume":"105","author":"Lapidus","year":"2008","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"2415","DOI":"10.1093\/bioinformatics\/btm362","article-title":"Robustness analysis and tuning of synthetic gene networks","volume":"23","author":"Batt","year":"2007","journal-title":"Bioinformatics"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1038\/nrg1615","article-title":"Stochasticity in gene expression: From theories to phenotypes","volume":"6","author":"Elston","year":"2005","journal-title":"Nat. Rev. Genet."},{"key":"ref_38","unstructured":"Voit, E.O. (2000). Computational Analysis of Biochemical Systems: A Practical Guide for Biochemists and Molecular Biologists, Cambridge University Press."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"1737","DOI":"10.1162\/neco.2010.07-09-1057","article-title":"On the noise enhancing of stochastic Hodgkin-Hurley neuron systems","volume":"22","author":"Chen","year":"2012","journal-title":"Neural Comput."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1109\/TBCAS.2007.907060","article-title":"On the Robust Circuit Design Schemes of Biochemical Networks: Steady-State Approach","volume":"1","author":"Chen","year":"2007","journal-title":"IEEE Trans. Biomed. Circuits Syst."},{"key":"ref_41","first-page":"191","article-title":"Stochastic Spatio-Temporal Dynamic Model for Gene\/Protein Interaction Network in Early Drosophila Development","volume":"3","author":"Chen","year":"2009","journal-title":"Gene Regul Syst. Biol."},{"key":"ref_42","first-page":"245","article-title":"Underlying Principles of Natural Selection in Network Evolution: Systems Biology Approach","volume":"3","author":"Chen","year":"2007","journal-title":"Evol. Bioinfom."},{"key":"ref_43","first-page":"27","article-title":"On the Adaptive Design Rules of Biochemical Networks in Evolution","volume":"3","author":"Chen","year":"2007","journal-title":"Evol. Bioinfom."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"17","DOI":"10.4137\/EBO.S13227","article-title":"The stochastic evolutionary game for a population of biological networks under natural selection","volume":"10","author":"Chen","year":"2014","journal-title":"Evol. Bioinform. Online"},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1109\/TAC.2003.821400","article-title":"Stochastic H2\/H\u221e Control With State-Dependent Noise","volume":"49","author":"Chen","year":"2004","journal-title":"IEEE Trans. Auto. Cont."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1038\/nature01546","article-title":"Noise in eukaryotic gene expression","volume":"422","author":"Blake","year":"2003","journal-title":"Nature"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"814","DOI":"10.1073\/pnas.94.3.814","article-title":"Stochastic mechanisms in gene expression","volume":"94","author":"Arkin","year":"1997","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_48","unstructured":"Freeman, S., and Herron, J.C. (2004). Evolutionary Analysis, 3rd ed, Pearson Prentice Hall."},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1038\/35042500","article-title":"Feedback control of intercellular signalling in development","volume":"408","author":"Freeman","year":"2000","journal-title":"Nature"},{"key":"ref_50","unstructured":"Lynch, M., and Walsh, B. (1998). Genetics and Analysis of Quantitative Traits, Sinauer Associates. [1st ed.]."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"201","DOI":"10.4137\/EBO.S8123","article-title":"On the Interplay between the Evolvability and Network Robustness in an Evolutionary Biological Network: A Systems Biology Approach","volume":"7","author":"Chen","year":"2011","journal-title":"Evol. Bioinform. Online"},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"675","DOI":"10.3390\/e16020675","article-title":"New Methods of Entropy-Robust Estimation for Randomized Models under Limited Data","volume":"16","author":"Popkov","year":"2014","journal-title":"Entropy"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"1567","DOI":"10.3390\/e15051567","article-title":"Kernel Spectral Clustering for Big Data Networks","volume":"15","author":"Mall","year":"2013","journal-title":"Entropy"},{"key":"ref_54","doi-asserted-by":"crossref","unstructured":"Chen, B.-S., and Wang, Y.-C. (2006). On the attenuation and amplification of molecular noise in genetic regulatory networks. BMC Bioinform., 7.","DOI":"10.1186\/1471-2105-7-52"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"2698","DOI":"10.1093\/bioinformatics\/bti348","article-title":"A new measure of the robustness of biochemical networks","volume":"21","author":"Chen","year":"2005","journal-title":"Bioinformatics"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"342","DOI":"10.1016\/j.mbs.2007.11.002","article-title":"Robust filtering circuit design for stochastic gene networks under intrinsic and extrinsic molecular noises","volume":"211","author":"Chen","year":"2008","journal-title":"Math. Biosci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"1973","DOI":"10.1137\/S0363012903423727","article-title":"State Feedback H\u221e Control for a Class of Nonlinear Stochastic Systems","volume":"44","author":"Zhang","year":"2006","journal-title":"SIAM J. Control Optim."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1016\/j.automatica.2003.07.002","article-title":"On stabilizability and exact observability of stochastic systems with their applications","volume":"40","author":"Zhang","year":"2004","journal-title":"Automatica"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"571","DOI":"10.1109\/91.797980","article-title":"Robustness Design of Nonlinear Dynamic Systems via Fuzzy Linear Control","volume":"7","author":"Chen","year":"1999","journal-title":"IEEE Fuzzy Syst."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1109\/91.855915","article-title":"Mixed H2\/H\u221e Fuzzy Output Feedback Control Design for Nonlinear Dynamic Systems: An LMI Approach","volume":"8","author":"Chen","year":"2000","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_61","first-page":"43","article-title":"A Unifying Mathematical Framework for Genetic Robustness, Environmental Robustness, Network Robustness and their Trade-off on Phenotype Robustness in Biological Networks Part I: Gene Regulatory Networks in Systems and Evolutionary Biology","volume":"9","author":"Chen","year":"2013","journal-title":"Evol. Bioinform. Online"},{"key":"ref_62","first-page":"69","article-title":"A Unifying Mathematical Framework for Genetic Robustness, Environmental Robustness, Network Robustness and their Trade-offs on Phenotype Robustness in Biological Networks. Part II: Ecological networks","volume":"9","author":"Chen","year":"2013","journal-title":"Evol. Bioinform. Online"},{"key":"ref_63","first-page":"87","article-title":"A Unifying Mathematical Framework for Genetic Robustness, Environmental Robustness, Network Robustness and their Trade-offs on Phenotype Robustness in Biological Networks. Part III: Synthetic Gene Networks in Synthetic Biology","volume":"9","author":"Chen","year":"2013","journal-title":"Evol. Bioinform. Online"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Klipp, E., Herwig, R., Kowald, A., Wierling, C., and Lehrach, H. (2005). Systems Biology in Practice: Concepts, Implementation and Applcation, Wiley.","DOI":"10.1002\/3527603603"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Murray, J.D. (2003). Mathematical Biology, Springer. [3rd ed].","DOI":"10.1007\/b98869"},{"key":"ref_66","doi-asserted-by":"crossref","first-page":"589","DOI":"10.1109\/TSP.2004.840724","article-title":"Robust H\u221e Filtering for Nonlinear Stochastic Systems","volume":"53","author":"Zhang","year":"2005","journal-title":"IEEE Trans. Sig. Process"},{"key":"ref_67","doi-asserted-by":"crossref","first-page":"1891","DOI":"10.1016\/j.automatica.2006.05.025","article-title":"Stochastic H2\/H\u221e control with (x, u, v)-dependent noise: Finite horizon case","volume":"42","author":"Zhang","year":"2006","journal-title":"Automatica"},{"key":"ref_68","doi-asserted-by":"crossref","first-page":"3009","DOI":"10.1109\/TAC.2012.2197074","article-title":"H-Representation and Applications to Generalized Lyapunov Equations and Linear Stochastic Systems","volume":"57","author":"Zhang","year":"2012","journal-title":"IEEE Trans. Auto. Cont."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1155\/2012\/750841","article-title":"Robust H2\/H\u221e Filter Design for a Class of Nonlinear Stochastic Systems with State-Dependent Noise","volume":"2012","author":"Zhang","year":"2012","journal-title":"Math. Probl. Eng."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/10\/6801\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:49:45Z","timestamp":1760215785000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/10\/6801"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,10,8]]},"references-count":69,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2015,10]]}},"alternative-id":["e17106801"],"URL":"https:\/\/doi.org\/10.3390\/e17106801","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2015,10,8]]}}}