{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,16]],"date-time":"2026-06-16T21:20:25Z","timestamp":1781644825485,"version":"3.54.5"},"reference-count":59,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2014,6,20]],"date-time":"2014-06-20T00:00:00Z","timestamp":1403222400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"funder":[{"DOI":"10.13039\/100000183","name":"Army Research Office","doi-asserted-by":"publisher","award":["61386-EG"],"award-info":[{"award-number":["61386-EG"]}],"id":[{"id":"10.13039\/100000183","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Inferring the coupling structure of complex systems from time series data in general by means of statistical and information-theoretic techniques is a challenging problem in applied science. The reliability of statistical inferences requires the construction of suitable information-theoretic measures that take into account both direct and indirect influences, manifest in the form of information flows, between the components within the system. In this work, we present an application of the optimal causation entropy (oCSE) principle to identify the coupling structure of a synthetic biological system, the repressilator. Specifically, when the system reaches an equilibrium state, we use a stochastic perturbation approach to extract time series data that approximate a linear stochastic process. Then, we present and jointly apply the aggregative discovery and progressive removal algorithms based on the oCSE principle to infer the coupling structure of the system from the measured data. Finally, we show that the success rate of our coupling inferences not only improves with the amount of available data, but it also increases with a higher frequency of sampling and is especially immune to false positives.<\/jats:p>","DOI":"10.3390\/e16063416","type":"journal-article","created":{"date-parts":[[2014,6,20]],"date-time":"2014-06-20T11:34:08Z","timestamp":1403264048000},"page":"3416-3433","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":39,"title":["Identifying the Coupling Structure in Complex Systems through the Optimal Causation Entropy Principle"],"prefix":"10.3390","volume":"16","author":[{"given":"Jie","family":"Sun","sequence":"first","affiliation":[{"name":"Department of Mathematics, Clarkson University, 8 Clarkson Ave, Potsdam, NY 13699-5815, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Carlo","family":"Cafaro","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Clarkson University, 8 Clarkson Ave, Potsdam, NY 13699-5815, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik","family":"Bollt","sequence":"additional","affiliation":[{"name":"Department of Mathematics, Clarkson University, 8 Clarkson Ave, Potsdam, NY 13699-5815, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2014,6,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Fitzpatrick, R. (2012). An Introduction to Celestial Mechanics, Cambridge University Press.","DOI":"10.1017\/CBO9781139152310"},{"key":"ref_2","unstructured":"Atkins, P., and de Paula, J. (2010). Physical Chemistry, W. H. Freeman Publishers. [9th ed.]."},{"key":"ref_3","unstructured":"Mankiw, N.G. (2011). Principles of Economics, Cengage Learning. [6th ed.]."},{"key":"ref_4","first-page":"417","article-title":"Equations of motions from a data series","volume":"1","author":"Crutchfield","year":"1987","journal-title":"Complex Syst"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1016\/j.physd.2006.12.006","article-title":"Modeling and nonlinear parameter estimation with Kronecker product representation for coupled oscillators and spatiotemporal systems","volume":"227","author":"Yao","year":"2007","journal-title":"Phys. Nonlinear Phenom"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"046125","DOI":"10.1103\/PhysRevE.83.046125","article-title":"Judging model reduction of complex systems","volume":"83","author":"Sun","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"48006","DOI":"10.1209\/0295-5075\/94\/48006","article-title":"Time-series based prediction of complex oscillator networks via compressive sensing","volume":"94","author":"Wang","year":"2011","journal-title":"Europhys. Lett"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"120503","DOI":"10.1103\/PhysRevLett.108.120503","article-title":"Extracting dynamical equations from experimental data is NP hard","volume":"108","author":"Cubitt","year":"2012","journal-title":"Phys. Rev. Lett"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"358","DOI":"10.1037\/h0055425","article-title":"Social perception and phenomenal causality","volume":"51","author":"Heider","year":"1944","journal-title":"Psychol. Rev"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"425","DOI":"10.2307\/1912791","article-title":"Investigating causal relations by econometric models and cross-spectral methods","volume":"37","author":"Granger","year":"1969","journal-title":"Econometrica"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1016\/0304-4076(88)90045-0","article-title":"Some recent developments in a concept of causality","volume":"39","author":"Granger","year":"1988","journal-title":"J. Econom"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Spirtes, P., Glymour, C.N., and Scheines, R. (2000). Causation, Prediction, and Search, MIT Press. [2nd ed.].","DOI":"10.7551\/mitpress\/1754.001.0001"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"S144","DOI":"10.2105\/AJPH.2004.059204","article-title":"Causation and causal inference in epidemiology","volume":"95","author":"Rothman","year":"2005","journal-title":"Am. J. Public Health"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Caticha, A., and Cafaro, C. (2007, January 8\u201313). From information geometry to Newtonian dynamics.","DOI":"10.1063\/1.2821259"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"204101","DOI":"10.1103\/PhysRevLett.99.204101","article-title":"Partial mutual information for coupling analysis of multivariate time series","volume":"99","author":"Frenzel","year":"2007","journal-title":"Phys. Rev. Lett"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physrep.2006.12.004","article-title":"Causality detection based on information-theoretic approaches in time series analysis","volume":"441","author":"Vejmelka","year":"2007","journal-title":"Phys. Rep"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1016\/j.jneumeth.2008.04.011","article-title":"Partial Granger causality\u2014Eliminating exogenous inputs and latent variables","volume":"172","author":"Guo","year":"2008","journal-title":"J. Neurosci. Methods"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1751-5823.2007.00024.x","article-title":"Econometric causality","volume":"76","author":"Heckman","year":"2008","journal-title":"Int. Stat. Rev"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Pearl, J. (2009). Causality: Models, Reasoning and Inference, Cambridge University Press. [2nd ed.].","DOI":"10.1017\/CBO9780511803161"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1280","DOI":"10.1016\/j.neuroimage.2010.08.071","article-title":"Evaluation of effective connectivity of motor areas during motor imagery and execution using conditional Granger causality","volume":"54","author":"Gao","year":"2011","journal-title":"NeuroImage"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s10827-010-0262-3","article-title":"Transfer entropy\u2014A model-free measure of effective connectivity for the neurosciences","volume":"30","author":"Vicente","year":"2011","journal-title":"J. Comput. Neurosci"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"258701","DOI":"10.1103\/PhysRevLett.108.258701","article-title":"Escaping the curse of dimensionality in estimating multivariate transfer entropy","volume":"108","author":"Runge","year":"2012","journal-title":"Phys. Rev. Lett"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"061121","DOI":"10.1103\/PhysRevE.86.061121","article-title":"Quantifying causal coupling strength: A lag-specific measure for multivariate time series related to transfer entropy","volume":"86","author":"Runge","year":"2012","journal-title":"Phys. Rev. E"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.physd.2013.07.001","article-title":"Causation entropy identifies indirect influences, dominance of neighbors and anticipatory couplings","volume":"267","author":"Sun","year":"2014","journal-title":"Phys. Nonlinear Phenom"},{"key":"ref_25","unstructured":"Sun, J., Taylor, D., and Bollt, E.M. (2014). Causal network inference by optimal causation entropy, arXiv, 1401.7574."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring information transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/S0167-2789(02)00432-3","article-title":"Information transfer in continuous processes","volume":"166","author":"Kaiser","year":"2002","journal-title":"Phys. Nonlinear Phenom"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"046211","DOI":"10.1103\/PhysRevE.63.046211","article-title":"Synchronization as adjustment of information rates: Detection from bivariate time series","volume":"63","author":"Palus","year":"2001","journal-title":"Phys. Rev. E"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"026214","DOI":"10.1103\/PhysRevE.77.026214","article-title":"Inferring the directionality of coupling with conditional mutual information","volume":"77","author":"Vejmelka","year":"2008","journal-title":"Phys. Rev. E"},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"1250261","DOI":"10.1142\/S0218127412502616","article-title":"Synchronization as a process of sharing and transferring information","volume":"22","author":"Bollt","year":"2012","journal-title":"Int. J. Bifurc. Chaos"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"042917","DOI":"10.1103\/PhysRevE.87.042917","article-title":"Spurious causalities with transfer entropy","volume":"87","author":"Smirnov","year":"2013","journal-title":"Phys. Rev. E"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"261","DOI":"10.1016\/S1469-0292(01)00033-4","article-title":"The influence of crowd noise and experience upon refereeing decisions in football","volume":"3","author":"Nevill","year":"2002","journal-title":"Psychol. Sport Exer"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"041907","DOI":"10.1103\/PhysRevE.81.041907","article-title":"Multivariate granger causality and generalized variance","volume":"81","author":"Barrett","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"2635","DOI":"10.3390\/e15072635","article-title":"Simulation study of direct causality measures in multivariate time series","volume":"15","author":"Papana","year":"2013","journal-title":"Entropy"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"303601:1","DOI":"10.1155\/2012\/303601","article-title":"Causal information approach to partial conditioning in multivariate data sets","volume":"2012","author":"Marinazzo","year":"2012","journal-title":"Comput. Math. Methods Med"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"530","DOI":"10.1016\/S0378-4371(03)00073-6","article-title":"Diffusion and memory effects for stochastic processes and fractional Langevin equations","volume":"324","author":"Bazzani","year":"2003","journal-title":"Phys. A"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"1997","DOI":"10.1016\/j.spa.2007.12.004","article-title":"Weakly dependent chains with infinite memory","volume":"118","author":"Doukhan","year":"2008","journal-title":"Stoch. Processes Appl"},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/s00440-011-0345-8","article-title":"Graphical modelling of multivariate time series","volume":"153","author":"Eichler","year":"2012","journal-title":"Probab. Theor. Relat. Field"},{"key":"ref_39","first-page":"90","article-title":"Remarks on non-Markov processes","volume":"28","year":"1998","journal-title":"Braz. J. Phys"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J"},{"key":"ref_41","unstructured":"Cover, T.M., and Thomas, J.A. (2006). Elements of Information Theory, John Wiley & Son, Inc. [2nd ed.]."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"016207","DOI":"10.1103\/PhysRevE.82.016207","article-title":"Nonuniform state-space reconstruction and coupling detection","volume":"82","author":"Vlachos","year":"2010","journal-title":"Phys. Rev. E"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"12697","DOI":"10.1016\/j.eswa.2012.05.014","article-title":"Nearest neighbor estimate of conditional mutual information in feature selection","volume":"39","author":"Tsimpiris","year":"2012","journal-title":"Expert Syst. Appl"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Murray, J.D. (2002). Mathematical Biology: I. An Introduction, Springer.","DOI":"10.1007\/b98868"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1230","DOI":"10.1126\/science.1519060","article-title":"Controlling cardiac chaos","volume":"257","author":"Garfinkel","year":"1992","journal-title":"Science"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1038\/370615a0","article-title":"Controlling chaos in the brain","volume":"370","author":"Schiff","year":"1994","journal-title":"Nature"},{"key":"ref_48","first-page":"467","article-title":"Chaos in biology","volume":"99","author":"Lesne","year":"2006","journal-title":"Riv. Biol"},{"key":"ref_49","doi-asserted-by":"crossref","first-page":"051122","DOI":"10.1103\/PhysRevE.83.051122","article-title":"Momentary information transfer as a coupling measure of time series","volume":"83","author":"Pompe","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1109\/18.30996","article-title":"Entropy expressions and their estimators for multivariate distributions","volume":"35","author":"Ahmed","year":"1989","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"238701","DOI":"10.1103\/PhysRevLett.103.238701","article-title":"Granger causality and transfer entropy are equivalent for gaussian variables","volume":"103","author":"Barnett","year":"2009","journal-title":"Phys. Rev. Lett"},{"key":"ref_52","doi-asserted-by":"crossref","unstructured":"Ellner, S.P., and Guckenheimer, J. (2006). Dynamic Models in Biology, Princeton University Press.","DOI":"10.1515\/9781400840960"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"335","DOI":"10.1038\/35002125","article-title":"A synthetic oscillatory network of transcriptional regulators","volume":"403","author":"Elowitz","year":"2000","journal-title":"Nature"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"148103","DOI":"10.1103\/PhysRevLett.99.148103","article-title":"Multistability and clustering in a population of synthetic genetic oscillators via phase-repulsive cell-to-cell communication","volume":"99","author":"Ullner","year":"2007","journal-title":"Phys. Rev. Lett"},{"key":"ref_55","doi-asserted-by":"crossref","unstructured":"Gallager, R.G. (2013). Stochastic Processes, Theory for Applications, Cambridge University Press.","DOI":"10.1017\/CBO9781139626514"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"707","DOI":"10.2140\/pjm.1955.5.707","article-title":"On chains of infinite order","volume":"5","author":"Harris","year":"1955","journal-title":"Pac. J. Math"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"243","DOI":"10.1007\/BF00319986","article-title":"Chains with infinite connections: Uniqueness and Markov representation","volume":"76","author":"Berbee","year":"1987","journal-title":"Probab. Theor. Relat. Field"},{"key":"ref_58","first-page":"1","article-title":"Markov approximations of chains of infinite order","volume":"33","author":"Galves","year":"2002","journal-title":"Bull. Braz. Math. Soc"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"555","DOI":"10.1007\/s10955-004-8821-5","article-title":"Chains with complete connections: General theory, uniqueness, loss of memory and mixing properties","volume":"118","author":"Maillard","year":"2005","journal-title":"J. Stat. Phys"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/6\/3416\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:12:47Z","timestamp":1760217167000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/16\/6\/3416"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2014,6,20]]},"references-count":59,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2014,6]]}},"alternative-id":["e16063416"],"URL":"https:\/\/doi.org\/10.3390\/e16063416","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2014,6,20]]}}}