{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T16:46:37Z","timestamp":1754153197099,"version":"3.41.2"},"reference-count":46,"publisher":"MIT Press","issue":"8","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2025,7,17]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Emergent effect is crucial to understanding the properties of complex systems that do not appear in their basic units, but there has been a lack of theories to measure and understand its mechanisms. In this letter, we consider emergence as a kind of structural nonlinearity, discuss a framework based on homological algebra that encodes emergence as the mathematical structure of cohomologies, and then apply it to network models to develop a computational measure of emergence. This framework ties the potential for emergent effects of a system to its network topology and local structures, paving the way to predict and understand the cause of emergent effects. We show in our numerical experiment that our measure of emergence correlates with the existing information-theoretic measure of emergence.<\/jats:p>","DOI":"10.1162\/neco_a_01766","type":"journal-article","created":{"date-parts":[[2025,7,8]],"date-time":"2025-07-08T13:23:13Z","timestamp":1751980993000},"page":"1409-1438","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":0,"title":["A Categorical Framework for Quantifying Emergent Effects in Network Topology"],"prefix":"10.1162","volume":"37","author":[{"given":"Johnny Jingze","family":"Li","sequence":"first","affiliation":[{"name":"Center for Engineered Natural Intelligence and Department of Mathematics, University of California San Diego, La Jolla, CA 92093, U.S.A. jil164@ucsd.edu"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sebastian","family":"Pardo-Guerra","sequence":"additional","affiliation":[{"name":"Center for Engineered Natural Intelligence and Departments of Mathematics and Bioengineering, University of California San Diego, La Jolla, CA 92093, U.S.A. seb.pardog@gmail.com"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Kalyan","family":"Basu","sequence":"additional","affiliation":[{"name":"Center for Engineered Natural Intelligence, University of California San Diego, La Jolla, CA 92093, U.S.A. ksbasu@msn.com"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Gabriel A.","family":"Silva","sequence":"additional","affiliation":[{"name":"Center for Engineered Natural Intelligence and Departments of Bioengineering and Neurosciences, University of California San Diego, La Jolla, CA 92093, U.S.A. gsilva@ucsd.edu"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","published-online":{"date-parts":[[2025,7,17]]},"reference":[{"volume-title":"Systems, generativity and interactional effects","year":"2017","author":"Adam","key":"2025072212155227300_bib1"},{"key":"2025072212155227300_bib2","doi-asserted-by":"publisher","first-page":"393","DOI":"10.1126\/science.177.4047.393","article-title":"More is different: Broken symmetry and the nature of the hierarchical structure of science","volume":"177","author":"Anderson","year":"1972","journal-title":"Science"},{"key":"2025072212155227300_bib3","doi-asserted-by":"publisher","DOI":"10.3390\/math9243216","article-title":"The representation theory of neural networks","volume":"9","author":"Armenta","year":"2021","journal-title":"Mathematics"},{"key":"2025072212155227300_bib4","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1038\/nrg1272","article-title":"Network biology: Understanding the cell\u2019s functional organization","volume":"5","author":"Barabasi","year":"2004","journal-title":"Nature Reviews Genetics"},{"key":"2025072212155227300_bib5","doi-asserted-by":"publisher","first-page":"15","DOI":"10.1002\/cplx.20029","article-title":"A mathematical theory of strong emergence using multiscale variety","volume":"9","author":"Bar-Yam","year":"2004","journal-title":"Complexity"},{"journal-title":"What is applied category theory?","year":"2018","author":"Bradley","key":"2025072212155227300_bib6"},{"volume-title":"Homological algebra","year":"1999","author":"Cartan","key":"2025072212155227300_bib7"},{"key":"2025072212155227300_bib8","doi-asserted-by":"publisher","DOI":"10.3389\/fphy.2020.00035","article-title":"Metrics of emergence, self-organization, and complexity for EWOM research","volume":"8","author":"Correa","year":"2020","journal-title":"Frontiers in Physics"},{"key":"2025072212155227300_bib9","doi-asserted-by":"publisher","first-page":"11","DOI":"10.1016\/0167-2789(94)90273-9","article-title":"The calculi of emergence: Computation, dynamics and induction","volume":"75","author":"Crutchfield","year":"1994","journal-title":"Physica D: Nonlinear Phenomena"},{"key":"2025072212155227300_bib11","doi-asserted-by":"crossref","DOI":"10.1090\/gsm\/184","volume-title":"An introduction to quiver representations","author":"Derksen","year":"2017"},{"journal-title":"Understanding emergent abilities of language models from the loss perspective","year":"2024","author":"Du","key":"2025072212155227300_bib12"},{"journal-title":"Seven sketches in compositionality: An invitation to applied category theory","year":"2018","author":"Fong","key":"2025072212155227300_bib13"},{"key":"2025072212155227300_bib14","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/0167-2789(90)90063-U","article-title":"Emergent computation: Self-organizing, collective, and cooperative phenomena in natural and artificial computing networks: Introduction to the Proceedings of the Ninth Annual CNLS Conference","volume":"42","author":"Forrest","year":"1990","journal-title":"Physica D: Nonlinear Phenomena"},{"volume-title":"Abelian categories","year":"1964","author":"Freyd","key":"2025072212155227300_bib15"},{"journal-title":"On a categorical theory for emergence","year":"2018","author":"Gadioli La Guardia","key":"2025072212155227300_bib16"},{"journal-title":"Quiver neural networks","year":"2022","author":"Ganev","key":"2025072212155227300_bib17"},{"volume-title":"Methods of homological algebra","year":"2013","author":"Gelfand","key":"2025072212155227300_bib18"},{"key":"2025072212155227300_bib19","first-page":"1","article-title":"Classification of random Boolean networks","volume-title":"Artificial Life VIII, Proceedings of the Eighth International Conference on Artificial Life","author":"Gershenson","year":"2003"},{"journal-title":"Introduction to random Boolean networks","year":"2004","author":"Gershenson","key":"2025072212155227300_bib20"},{"key":"2025072212155227300_bib21","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1002\/cplx.21424","article-title":"Complexity and information: Measuring emergence, self-organization, and homeostasis at multiple scales","volume":"18","author":"Gershenson","year":"2012","journal-title":"Complexity"},{"key":"2025072212155227300_bib22","doi-asserted-by":"crossref","DOI":"10.1201\/9780429493492","volume-title":"Lectures on phase transitions and the renormalization group","author":"Goldenfeld","year":"2018"},{"key":"2025072212155227300_bib23","first-page":"1","article-title":"Emergence in complex networks of simple agents","author":"Green","year":"2023","journal-title":"Journal of Economic Interaction and Coordination"},{"issue":"6","key":"2025072212155227300_bib24","first-page":"1","article-title":"Ka\u00e4hler geometry of framed quiver moduli and machine learning","volume":"23","author":"Jeffreys","year":"2022","journal-title":"Foundations of Computational Mathematics"},{"key":"2025072212155227300_bib25","doi-asserted-by":"publisher","first-page":"224","DOI":"10.1080\/10919392.2020.1748977","article-title":"Emergence phenomena in self-organizing systems: A systematic literature review of concepts, researches, and future prospects","volume":"30","author":"Kalantari","year":"2020","journal-title":"Journal of Organizational Computing and Electronic Commerce"},{"key":"2025072212155227300_bib26","doi-asserted-by":"publisher","first-page":"437","DOI":"10.1016\/0022-5193(69)90015-0","article-title":"Metabolic stability and epigenesis in randomly constructed genetic nets","volume":"22","author":"Kauffman","year":"1969","journal-title":"Journal of Theoretical Biology"},{"key":"2025072212155227300_bib27","doi-asserted-by":"crossref","DOI":"10.1093\/oso\/9780195079517.001.0001","volume-title":"The origins of order: Self-organization and selection in evolution","author":"Kauffman","year":"1993"},{"key":"2025072212155227300_bib28","doi-asserted-by":"crossref","DOI":"10.1090\/gsm\/174","volume-title":"Quiver representations and quiver varieties","author":"Kirillov Jr.","year":"2016"},{"volume-title":"Categories for the working mathematician","year":"2013","author":"Mac Lane","key":"2025072212155227300_bib29"},{"key":"2025072212155227300_bib30","article-title":"Greater than the parts: A review of the information decomposition approach to causal emergence","volume":"380","author":"Mediano","year":"2022","journal-title":"Philosophical Transactions of the Royal Society A"},{"key":"2025072212155227300_bib31","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004829","article-title":"The evolutionary origins of hierarchy","volume":"12","author":"Mengistu","year":"2016","journal-title":"PLOS Computational Biology"},{"key":"2025072212155227300_bib32","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1007\/s41469-021-00093-4","article-title":"Ant colonies: Building complex organizations with minuscule brains and no leaders","volume":"10","author":"Moffett","year":"2021","journal-title":"Journal of Organization Design"},{"issue":"2","key":"2025072212155227300_bib33","doi-asserted-by":"publisher","first-page":"757","DOI":"10.1016\/j.jksuci.2023.01.014","article-title":"A comprehensive review on ensemble deep learning: Opportunities and challenges","volume":"35","author":"Mohammed","year":"2023","journal-title":"Journal of King Saud University-Computer and Information Sciences"},{"key":"2025072212155227300_bib34","doi-asserted-by":"publisher","DOI":"10.3390\/e21121234","article-title":"Mathematics and the brain: A category theoretical approach to go beyond the neural correlates of consciousness","volume":"21","author":"Northoff","year":"2019","journal-title":"Entropy"},{"key":"2025072212155227300_bib35","article-title":"Emergent properties","author":"O\u2019Connor","year":"2021","journal-title":"Stanford encyclopedia of philosophy"},{"journal-title":"Quiver signal processing (QSP)","year":"2020","author":"Parada-Mayorga","key":"2025072212155227300_bib36"},{"key":"2025072212155227300_bib37","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1080\/03081079.2024.2348665","article-title":"On preradicals, persistence, and the flow of information","volume":"53","author":"Pardo-Guerra","year":"2024","journal-title":"International Journal of General Systems"},{"key":"2025072212155227300_bib38","doi-asserted-by":"publisher","first-page":"907","DOI":"10.1017\/S0954579497001491","article-title":"Emergent properties of neural systems: How focal molecular neurobiological alterations can affect behavior","volume":"9","author":"Post","year":"1997","journal-title":"Development and Psychopathology"},{"journal-title":"Software in the natural world: A computational approach to emergence in complex multi-level systems","year":"2024","author":"Rosas","key":"2025072212155227300_bib39"},{"key":"2025072212155227300_bib40","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1007\/BF02478302","article-title":"Relational theory of biological systems","volume":"20","author":"Rosen","year":"1958","journal-title":"Bulletin of Mathematical Biophysics"},{"key":"2025072212155227300_bib41","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1007\/BF02477890","article-title":"The representation of biological systems from the standpoint of the theory of categories","volume":"20","author":"Rosen","year":"1958","journal-title":"Bulletin of Mathematical Biophysics"},{"key":"2025072212155227300_bib42","doi-asserted-by":"crossref","DOI":"10.1007\/b98977","volume-title":"An introduction to homological algebra","author":"Rotman","year":"2009"},{"key":"2025072212155227300_bib43","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-319-09204-1","volume-title":"Quiver representations","author":"Schiffler","year":"2014"},{"key":"2025072212155227300_bib45","doi-asserted-by":"crossref","first-page":"146","DOI":"10.18653\/v1\/2022.bigscience-1.11","article-title":"Emergent structures and training dynamics in large language models","author":"Teehan","year":"2022","journal-title":"Proceedings of Big Science Episode #5\u2013Workshop on Challenges and Perspectives in Creating Large Language Models"},{"key":"2025072212155227300_bib46","doi-asserted-by":"crossref","first-page":"910","DOI":"10.1111\/tops.12442","article-title":"Hierarchical structure in sequence processing: How to measure it and determine its neural implementation","volume":"12","author":"Udd\u00e9n","year":"2020","journal-title":"Topics in Cognitive Science"},{"journal-title":"Emergent abilities of large language models","year":"2022","author":"Wei","key":"2025072212155227300_bib48"},{"key":"2025072212155227300_bib49","first-page":"24824","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume-title":"Advances in neural information processing systems","author":"Wei","year":"2022"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/37\/8\/1409\/2531736\/neco_a_01766.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/direct.mit.edu\/neco\/article-pdf\/37\/8\/1409\/2531736\/neco_a_01766.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,22]],"date-time":"2025-07-22T16:16:02Z","timestamp":1753200962000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/37\/8\/1409\/131382\/A-Categorical-Framework-for-Quantifying-Emergent"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,7,17]]},"references-count":46,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2025,7,17]]},"published-print":{"date-parts":[[2025,7,17]]}},"URL":"https:\/\/doi.org\/10.1162\/neco_a_01766","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"type":"print","value":"0899-7667"},{"type":"electronic","value":"1530-888X"}],"subject":[],"published-other":{"date-parts":[[2025,8]]},"published":{"date-parts":[[2025,7,17]]}}}