{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,12,26]],"date-time":"2025-12-26T07:12:06Z","timestamp":1766733126290,"version":"build-2065373602"},"reference-count":62,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,1,28]],"date-time":"2022-01-28T00:00:00Z","timestamp":1643328000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Information theory is a well-established method for the study of many phenomena and more than 70 years after Claude Shannon first described it in A Mathematical Theory of Communication it has been extended well beyond Shannon\u2019s initial vision. It is now an interdisciplinary tool that is used from \u2018causal\u2019 information flow to inferring complex computational processes and it is common to see it play an important role in fields as diverse as neuroscience, artificial intelligence, quantum mechanics, and astrophysics. In this article, I provide a selective review of a specific aspect of information theory that has received less attention than many of the others: as a tool for understanding, modelling, and detecting non-linear phenomena in finance and economics. Although some progress has been made in this area, it is still an under-developed area that I argue has considerable scope for further development.<\/jats:p>","DOI":"10.3390\/e24020210","type":"journal-article","created":{"date-parts":[[2022,1,29]],"date-time":"2022-01-29T01:41:59Z","timestamp":1643420519000},"page":"210","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Entropy, Economics, and Criticality"],"prefix":"10.3390","volume":"24","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2199-2515","authenticated-orcid":false,"given":"Michael S.","family":"Harr\u00e9","sequence":"first","affiliation":[{"name":"Complex Systems Research Group, Faculty of Engineering, The University of Sydney, Sydney 2006, Australia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2022,1,28]]},"reference":[{"key":"ref_1","first-page":"3","article-title":"Three approaches to the definition of the concept \u201cquantity of information\u201d","volume":"1","author":"Kolmogorov","year":"1965","journal-title":"Probl. Peredachi Informatsii"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"459","DOI":"10.1287\/mnsc.15.9.459","article-title":"On the use of information theory concepts in the analysis of financial statements","volume":"15","author":"Theil","year":"1969","journal-title":"Manag. Sci."},{"key":"ref_3","first-page":"108","article-title":"The use of entropy maximising models, in the theory of trip distribution, mode split and route split","volume":"3","author":"Wilson","year":"1969","journal-title":"J. Transp. Econ. Policy"},{"key":"ref_4","unstructured":"Georgescu-Roegen, N. (1993). The entropy law and the economic problem. Valuing the Earth: Economics, Ecology, Ethics, MIT Press."},{"key":"ref_5","unstructured":"Aoki, M. (1998). New Approaches to Macroeconomic Modeling. Cambridge Books, Cambridge University Press."},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Harr\u00e9, M.S. (2021). Information Theory for Agents in Artificial Intelligence, Psychology, and Economics. Entropy, 23.","DOI":"10.3390\/e23030310"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Jakimowicz, A. (2020). The role of entropy in the development of economics. Entropy, 22.","DOI":"10.3390\/e22040452"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1140\/epjb\/e2014-41003-0","article-title":"Information theory applied to econophysics: Stock market behaviors","volume":"87","author":"Vogel","year":"2014","journal-title":"Eur. Phys. J. B"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/S0370-1573(02)00634-8","article-title":"Critical market crashes","volume":"378","author":"Sornette","year":"2003","journal-title":"Phys. Rep."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"180863","DOI":"10.1098\/rsos.180863","article-title":"On critical dynamics and thermodynamic efficiency of urban transformations","volume":"5","author":"Crosato","year":"2018","journal-title":"R. Soc. Open Sci."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"20200514","DOI":"10.1098\/rspa.2020.0514","article-title":"The polycentric dynamics of Melbourne and Sydney: Suburb attractiveness divides a city at the home ownership level","volume":"477","author":"Crosato","year":"2021","journal-title":"Proc. R. Soc. A"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"60005","DOI":"10.1209\/0295-5075\/131\/60005","article-title":"Phase transitions in optimal betting strategies","volume":"131","author":"Dinis","year":"2020","journal-title":"Europhys. Lett."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1111\/acfi.12390","article-title":"Information flow around stock market collapse","volume":"58","author":"Bossomaier","year":"2018","journal-title":"Account. Financ."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Harr\u00e9, M. (2015). Entropy and Transfer Entropy: The Dow Jones and the Build Up to the 1997 Asian Crisis. Proceedings of the International Conference on Social Modeling and Simulation, Plus Econophysics Colloquium 2014, Springer.","DOI":"10.1007\/978-3-319-20591-5_2"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"18009","DOI":"10.1209\/0295-5075\/87\/18009","article-title":"Phase-transition\u2013like behaviour of information measures in financial markets","volume":"87","author":"Bossomaier","year":"2009","journal-title":"Europhys. Lett."},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Harr\u00e9, M.S., Eremenko, A., Glavatskiy, K., Hopmere, M., Pinheiro, L., Watson, S., and Crawford, L. (2021). Complexity Economics in a Time of Crisis: Heterogeneous Agents, Interconnections, and Contagion. Systems, 9.","DOI":"10.3390\/systems9040073"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"036102","DOI":"10.1103\/PhysRevE.85.036102","article-title":"Hysteresis effects of changing the parameters of noncooperative games","volume":"85","author":"Wolpert","year":"2012","journal-title":"Phys. Rev. E"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1140\/epjb\/e2013-31064-x","article-title":"Simple nonlinear systems and navigating catastrophes","volume":"86","author":"Atkinson","year":"2013","journal-title":"Eur. Phys. J. B"},{"key":"ref_19","doi-asserted-by":"crossref","unstructured":"Glavatskiy, K.S., Prokopenko, M., Carro, A., Ormerod, P., and Harr\u00e9, M. (2020). Explaining herding and volatility in the cyclical price dynamics of urban housing markets using a large scale agent-based model. arXiv.","DOI":"10.1007\/s43546-021-00077-2"},{"key":"ref_20","first-page":"1","article-title":"The impact of social influence in Australian real estate: Market forecasting with a spatial agent-based model","volume":"22","author":"Evans","year":"2021","journal-title":"J. Econ. Interact. Coord."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1080\/00031305.1988.10475578","article-title":"Information-theoretic measures of fit for univariate and multivariate linear regressions","volume":"42","author":"Theil","year":"1988","journal-title":"Am. Stat."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"53","DOI":"10.1038\/nature08227","article-title":"Early-warning signals for critical transitions","volume":"461","author":"Scheffer","year":"2009","journal-title":"Nature"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"238701","DOI":"10.1103\/PhysRevLett.103.238701","article-title":"Granger causality and transfer entropy are equivalent for Gaussian variables","volume":"103","author":"Barnett","year":"2009","journal-title":"Phys. Rev. Lett."},{"key":"ref_24","first-page":"424","article-title":"Investigating causal relations by econometric models and cross-spectral methods","volume":"37","author":"Granger","year":"1969","journal-title":"Econom. J. Econom. Soc."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"177203","DOI":"10.1103\/PhysRevLett.111.177203","article-title":"Information flow in a kinetic Ising model peaks in the disordered phase","volume":"111","author":"Barnett","year":"2013","journal-title":"Phys. Rev. Lett."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"839","DOI":"10.1007\/BF02330576","article-title":"Mutual information of Ising systems","volume":"35","author":"Matsuda","year":"1996","journal-title":"Int. J. Theor. Phys."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gourieroux, C., and Monfort, A. (1995). Statistics and Econometric Models, Cambridge University Press.","DOI":"10.1017\/CBO9780511751950"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"041116","DOI":"10.1103\/PhysRevE.84.041116","article-title":"Relating Fisher information to order parameters","volume":"84","author":"Prokopenko","year":"2011","journal-title":"Phys. Rev. E"},{"key":"ref_29","first-page":"20150610","article-title":"Fisher transfer entropy: Quantifying the gain in transient sensitivity","volume":"471","author":"Prokopenko","year":"2015","journal-title":"Proc. R. Soc. A Math. Phys. Eng. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"247","DOI":"10.1016\/S0378-4371(02)01882-4","article-title":"Dynamic asset trees and Black Monday","volume":"324","author":"Onnela","year":"2003","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"260","DOI":"10.1016\/S0378-4371(02)00740-9","article-title":"Ferromagnetic phase transition in Barab\u00e1si\u2013Albert networks","volume":"310","author":"Aleksiejuk","year":"2002","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"1040","DOI":"10.1109\/JSTSP.2016.2593099","article-title":"Estimating tipping points in feedback-driven financial networks","volume":"10","author":"Stanley","year":"2016","journal-title":"IEEE J. Sel. Top. Signal Process."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"1824","DOI":"10.1016\/j.jedc.2009.04.004","article-title":"Can a stochastic cusp catastrophe model explain stock market crashes?","volume":"33","author":"Vosvrda","year":"2009","journal-title":"J. Econ. Dyn. Control"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"959","DOI":"10.1080\/14697688.2014.950319","article-title":"Realizing stock market crashes: Stochastic cusp catastrophe model of returns under time-varying volatility","volume":"15","author":"Barunik","year":"2015","journal-title":"Quant. Financ."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"68","DOI":"10.1016\/j.jedc.2016.05.008","article-title":"Can a stochastic cusp catastrophe model explain housing market crashes?","volume":"69","author":"Diks","year":"2016","journal-title":"J. Econ. Dyn. Control"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"360","DOI":"10.1002\/bs.3830230407","article-title":"Stochastic catastrophe models and multimodal distributions","volume":"23","author":"Cobb","year":"1978","journal-title":"Syst. Res. Behav. Sci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"263","DOI":"10.1016\/j.physd.2005.08.014","article-title":"Transformation invariant stochastic catastrophe theory","volume":"211","author":"Wagenmakers","year":"2005","journal-title":"Phys. D Nonlinear Phenom."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"3255","DOI":"10.1016\/j.jedc.2006.09.013","article-title":"The rise and fall of catastrophe theory applications in economics: Was the baby thrown out with the bathwater?","volume":"31","author":"Rosser","year":"2007","journal-title":"J. Econ. Dyn. Control"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"21384","DOI":"10.1073\/pnas.1219844110","article-title":"Thresholds for boreal biome transitions","volume":"109","author":"Scheffer","year":"2012","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"344","DOI":"10.1126\/science.1225244","article-title":"Anticipating critical transitions","volume":"338","author":"Scheffer","year":"2012","journal-title":"Science"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"e2106140118","DOI":"10.1073\/pnas.2106140118","article-title":"Deep learning for early warning signals of tipping points","volume":"118","author":"Bury","year":"2021","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"e2024192118","DOI":"10.1073\/pnas.2024192118","article-title":"Critical slowing down suggests that the western Greenland Ice Sheet is close to a tipping point","volume":"118","author":"Boers","year":"2021","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/j.neucom.2004.10.042","article-title":"Examining methods for estimating mutual information in spiking neural systems","volume":"65","author":"Rozell","year":"2005","journal-title":"Neurocomputing"},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s10827-010-0262-3","article-title":"Transfer entropy\u2014A model-free measure of effective connectivity for the neurosciences","volume":"30","author":"Vicente","year":"2011","journal-title":"J. Comput. Neurosci."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Wollstadt, P., Mart\u00ednez-Zarzuela, M., Vicente, R., D\u00edaz-Pernas, F.J., and Wibral, M. (2014). Efficient transfer entropy analysis of non-stationary neural time series. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0102833"},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Zbili, M., and Rama, S. (2021). A quick and easy way to estimate entropy and mutual information for neuroscience. bioRxiv.","DOI":"10.1101\/2020.08.04.236174"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"11","DOI":"10.3389\/frobt.2014.00011","article-title":"JIDT: An information-theoretic toolkit for studying the dynamics of complex systems","volume":"1","author":"Lizier","year":"2014","journal-title":"Front. Robot. AI"},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Lindner, M., Vicente, R., Priesemann, V., and Wibral, M. (2011). TRENTOOL: A Matlab open source toolbox to analyse information flow in time series data with transfer entropy. BMC Neurosci., 12.","DOI":"10.1186\/1471-2202-12-119"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Wollstadt, P., Lizier, J.T., Vicente, R., Finn, C., Martinez-Zarzuela, M., Mediano, P., Novelli, L., and Wibral, M. (2018). IDTxl: The Information Dynamics Toolkit xl: A Python package for the efficient analysis of multivariate information dynamics in networks. arXiv.","DOI":"10.21105\/joss.01081"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physa.2006.04.029","article-title":"Worrying trends in econophysics","volume":"370","author":"Gallegati","year":"2006","journal-title":"Phys. A Stat. Mech. Its Appl."},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"13047","DOI":"10.1038\/s41598-021-92170-7","article-title":"Information dynamics in neuromorphic nanowire networks","volume":"11","author":"Zhu","year":"2021","journal-title":"Sci. Rep."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"012415","DOI":"10.1103\/PhysRevE.103.012415","article-title":"Statistical complexity is maximized close to criticality in cortical dynamics","volume":"103","author":"Lotfi","year":"2021","journal-title":"Phys. Rev. E"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1103\/PhysRevA.38.364","article-title":"Self-organized criticality","volume":"38","author":"Bak","year":"1988","journal-title":"Phys. Rev. A"},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"031003","DOI":"10.1088\/2632-072X\/ac2071","article-title":"Brain criticality beyond avalanches: Open problems and how to approach them","volume":"2","year":"2021","journal-title":"J. Phys. Complex."},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"181","DOI":"10.3390\/dynamics1020011","article-title":"Self-Organised Critical Dynamics as a Key to Fundamental Features of Complexity in Physical, Biological, and Social Networks","volume":"1","author":"Melnik","year":"2021","journal-title":"Dynamics"},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1007\/s001910050067","article-title":"Markets as evolving computational entities","volume":"8","author":"Mirowski","year":"1998","journal-title":"J. Evol. Econ."},{"key":"ref_57","doi-asserted-by":"crossref","unstructured":"Axtell, R.L. (2003). Economics as distributed computation. Meeting the Challenge of Social Problems via Agent-Based Simulation, Springer.","DOI":"10.1007\/978-4-431-67863-2_1"},{"key":"ref_58","doi-asserted-by":"crossref","unstructured":"Hertz, J., Krogh, A., and Palmer, R.G. (2018). Introduction to the Theory of Neural Computation, CRC Press.","DOI":"10.1201\/9780429499661"},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"20190040","DOI":"10.1098\/rstb.2019.0040","article-title":"Liquid brains, solid brains","volume":"374","author":"Moses","year":"2019","journal-title":"Philos. Trans. R. Soc. B"},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1080\/00107514.2014.929308","article-title":"Micro and macro benefits of random investments in financial markets","volume":"55","author":"Biondo","year":"2014","journal-title":"Contemp. Phys."},{"key":"ref_61","first-page":"02601079211039321","article-title":"Causal Entropic Forces, Narratives and Self-organisation of Capital Markets","volume":"30","author":"Bocher","year":"2021","journal-title":"J. Interdiscip. Econ."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Turiel, J.D., and Aste, T. (2021). Self-organised criticality in high frequency finance: The case of flash crashes. arXiv.","DOI":"10.3390\/e24020257"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/210\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:10:15Z","timestamp":1760134215000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/210"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,1,28]]},"references-count":62,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020210"],"URL":"https:\/\/doi.org\/10.3390\/e24020210","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2022,1,28]]}}}