{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,2]],"date-time":"2026-06-02T13:23:50Z","timestamp":1780406630290,"version":"3.54.1"},"reference-count":48,"publisher":"MDPI AG","issue":"2","license":[{"start":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T00:00:00Z","timestamp":1643932800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"name":"JST Strategic Basic Research Programs","award":["JPMJCR17A4"],"award-info":[{"award-number":["JPMJCR17A4"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>The focus of this article is the self-organization of neural systems under constraints. In 2016, we proposed a theory for self-organization with constraints to clarify the neural mechanism of functional differentiation. As a typical application of the theory, we developed evolutionary reservoir computers that exhibit functional differentiation of neurons. Regarding the self-organized structure of neural systems, Warren McCulloch described the neural networks of the brain as being \u201cheterarchical\u201d, rather than hierarchical, in structure. Unlike the fixed boundary conditions in conventional self-organization theory, where stationary phenomena are the target for study, the neural networks of the brain change their functional structure via synaptic learning and neural differentiation to exhibit specific functions, thereby adapting to nonstationary environmental changes. Thus, the neural network structure is altered dynamically among possible network structures. We refer to such changes as a dynamic heterarchy. Through the dynamic changes of the network structure under constraints, such as physical, chemical, and informational factors, which act on the whole system, neural systems realize functional differentiation or functional parcellation. Based on the computation results of our model for functional differentiation, we propose hypotheses on the neuronal mechanism of functional differentiation. Finally, using the Kolmogorov\u2013Arnold\u2013Sprecher superposition theorem, which can be realized by a layered deep neural network, we propose a possible scenario of functional (including cell) differentiation.<\/jats:p>","DOI":"10.3390\/e24020240","type":"journal-article","created":{"date-parts":[[2022,2,4]],"date-time":"2022-02-04T11:35:17Z","timestamp":1643974517000},"page":"240","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["On the Nature of Functional Differentiation: The Role of Self-Organization with Constraints"],"prefix":"10.3390","volume":"24","author":[{"given":"Ichiro","family":"Tsuda","sequence":"first","affiliation":[{"name":"Chubu University Academy of Emerging Sciences, Chubu University, Aichi, Kasugai 487-8501, Japan"},{"name":"Center for Mathematical Science and Artificial Intelligence, Chubu University, Aichi, Kasugai 487-8501, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiroshi","family":"Watanabe","sequence":"additional","affiliation":[{"name":"Center for Mathematical Science and Artificial Intelligence, Chubu University, Aichi, Kasugai 487-8501, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Hiromichi","family":"Tsukada","sequence":"additional","affiliation":[{"name":"Center for Mathematical Science and Artificial Intelligence, Chubu University, Aichi, Kasugai 487-8501, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1739-3387","authenticated-orcid":false,"given":"Yutaka","family":"Yamaguti","sequence":"additional","affiliation":[{"name":"Faculty of Information Engineering, Fukuoka Institute of Technology, Fukuoka 811-0295, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2022,2,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Tsuda, I., Yamaguti, Y., and Watanabe, H. (2016). Self-organization with constraints\u2015A mathematical model for functional differentiation. Entropy, 18.","DOI":"10.3390\/e18030074"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"013137","DOI":"10.1063\/5.0019116","article-title":"Functional differentiations in evolutionary reservoir computing networks","volume":"31","author":"Yamaguti","year":"2021","journal-title":"Chaos"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1016\/j.neures.2020.02.003","article-title":"A mathematical model for neuronal differentiation in terms of an evolved dynamical system","volume":"156","author":"Watanabe","year":"2020","journal-title":"Neurosci. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"89","DOI":"10.1007\/BF02478457","article-title":"A heterarchy of values determined by the topology of nervous nets","volume":"7","author":"McCulloch","year":"1945","journal-title":"B. Math. Biophys."},{"key":"ref_5","unstructured":"von Claus Pias, H. (2003). Cybernetics\u2014Kybernetik, the Macy\u2013Conferences 1946\u20131953, Diaphanes."},{"key":"ref_6","unstructured":"Nicolis, G., and Prigogine, I. (1977). Self-Organization in Nonequilibrium Systems, Wiley."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Haken, H. (1983). Advanced Synergetics, Springer.","DOI":"10.1007\/978-3-642-45553-7"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1016\/j.neunet.2012.09.003","article-title":"Outline of a general theory of behavior and brain coordination","volume":"37","author":"Kelso","year":"2013","journal-title":"Neural. Netw."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"35","DOI":"10.1016\/j.neuron.2013.12.022","article-title":"The metastable brain","volume":"81","author":"Tognoli","year":"2014","journal-title":"Neuron"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"1692","DOI":"10.1038\/srep01692","article-title":"Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction","volume":"3","author":"Kawasaki","year":"2013","journal-title":"Sci. Rep."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.neures.2014.10.007","article-title":"Study of the neural dynamics for understanding communication in terms of complex hetero systems","volume":"90","author":"Tsuda","year":"2015","journal-title":"Neurosci. Res."},{"key":"ref_12","first-page":"259","article-title":"Visual Cortex","volume":"Volume 3","author":"Peters","year":"1985","journal-title":"Cerebral Cortex"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/0166-2236(90)90165-7","article-title":"Cross-modal plasticity in cortical development: Differentiation and specification of sensory neocortex","volume":"13","author":"Sur","year":"1990","journal-title":"Trends Neurosci."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1007\/978-3-540-27862-7_3","article-title":"Phase transitions that made us mammals","volume":"3146","author":"Treves","year":"2004","journal-title":"Lect. Notes Comput. Sci."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/0140-1750(89)90030-4","article-title":"Self-organization in the nervous system","volume":"12","author":"Szentagothai","year":"1989","journal-title":"J. Soc. Biol. Struct."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1016\/S0140-1750(78)80007-4","article-title":"The complementarity principle in biological and social structures","volume":"1","author":"Pattee","year":"1978","journal-title":"J. Soc. Biol. Struct."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"622","DOI":"10.1016\/j.tree.2016.04.009","article-title":"Heterarchies: Reconciling networks and hierarchies","volume":"31","author":"Cumming","year":"2016","journal-title":"Trends Ecol."},{"key":"ref_18","first-page":"20122863","article-title":"The evolutionary origins of modularity","volume":"280","author":"Clune","year":"2013","journal-title":"Proc. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1093\/cercor\/1.1.1","article-title":"Distributed hierarchical processing in the primate cerebral cortex","volume":"1","author":"Felleman","year":"1991","journal-title":"Cere. Cor."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"71","DOI":"10.1098\/rstb.2000.0550","article-title":"Hierarchical organization of macaque and cat cortical sensory systems explored with a novel network processor","volume":"355","author":"Hilgetag","year":"2000","journal-title":"Philos. Trans. R. Soc. London. Ser. B Biol. Sci."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"12827","DOI":"10.1073\/pnas.1705120114","article-title":"Brain network dynamics are hierarchically organized in time","volume":"114","author":"Vidaurre","year":"2017","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"1238406","DOI":"10.1126\/science.1238406","article-title":"Cortical high-density counterstream architectures","volume":"342","author":"Markov","year":"2013","journal-title":"Science"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1038\/nature18933","article-title":"A multi-modal parcellation of human cerebral cortex","volume":"536","author":"Glasser","year":"2016","journal-title":"Nature"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1405","DOI":"10.1088\/0305-4470\/21\/6\/016","article-title":"Calculation of information flow rate from mutual information","volume":"21","author":"Matsumoto","year":"1988","journal-title":"J. Phys. A Math. Gen."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1016\/j.conb.2014.08.011","article-title":"Chaotic itinerancy and its roles in cognitive neurodynamics","volume":"31","author":"Tsuda","year":"2015","journal-title":"Curr. Opin. Neurobiol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1","DOI":"10.3389\/fncom.2013.00044","article-title":"Biophysically based computational models of astrocyte~ neuron coupling and their functional significance","volume":"7","author":"Wade","year":"2013","journal-title":"Front. Comput. Neurosci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2531","DOI":"10.1162\/089976602760407955","article-title":"Real-time computing without stable states: A new framework for neural computation based on perturbations","volume":"14","author":"Maass","year":"2002","journal-title":"Neural Comput."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1126\/science.1091277","article-title":"Harnessing nonlinearity: Predicting chaotic systems and saving energy in wireless communication","volume":"304","author":"Jaeger","year":"2004","journal-title":"Science"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1162\/jocn.1995.7.3.311","article-title":"A model of corticostriatal plasticity for learning oculomotor associations and sequences","volume":"7","author":"Dominey","year":"1995","journal-title":"Cognit. Neurosci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.neunet.2007.04.004","article-title":"The cerebellum as a liquid state machine","volume":"20","author":"Yamazaki","year":"2007","journal-title":"Neural Netw."},{"key":"ref_31","unstructured":"Nakajima, K., and Fischer, I. (2021). Cortico-Striatal Origin of Reservoir Computing, Mixed Selectivity, and Higher Cognitive Function. Reservoir Computing: Theory, Physical Implementations, and Applications, Springer Nature."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"539","DOI":"10.1002\/hipo.10187","article-title":"Computational constraints between retrieving the past and predicting the future, and the CA3-CA1 differentiation","volume":"14","author":"Treves","year":"2004","journal-title":"Hippocampus"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"e39349","DOI":"10.7554\/eLife.37349","article-title":"Sparse recurrent excitatory connectivity in the microcircuit of the adult mouse and human cortex","volume":"7","author":"Seeman","year":"2018","journal-title":"eLife"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1038\/4580","article-title":"Predictive coding in the visual cortex: A functional interpretation of some extra-classical receptive-field effects","volume":"2","author":"Rao","year":"1999","journal-title":"Nat. Neurosci."},{"key":"ref_35","first-page":"427","article-title":"Predictive coding: A fresh view of inhibition in the retina","volume":"216","author":"Srinivasan","year":"1982","journal-title":"Proc. R. Soc. Lond. Ser. B Biol. Sci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1068\/p030123","article-title":"Inductive inference, coding, perception, and language","volume":"3","author":"Barlow","year":"1974","journal-title":"Perception"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1152\/jn.1987.57.1.162","article-title":"Temporal encoding of two-dimensional patterns by single units in primate inferior cortex. II Information theoretic analysis","volume":"57","author":"Optican","year":"1987","journal-title":"J. Neurophysiol."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"257","DOI":"10.1146\/annurev.ne.13.030190.001353","article-title":"Perceptual neural organization: Some approaches based on network models and information theory","volume":"13","author":"Linsker","year":"1990","journal-title":"Ann. Rev. Neurosci."},{"key":"ref_39","first-page":"179","article-title":"On the representation of continuous functions of several variables by superposition of continuous functions of one variable and addition","volume":"114","author":"Kolmogorov","year":"1957","journal-title":"Russ. Acad. Sci."},{"key":"ref_40","first-page":"679","article-title":"On functions of three variables","volume":"114","author":"Arnold","year":"1957","journal-title":"Russ. Acad. Sci."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"208","DOI":"10.1016\/0022-247X(72)90129-1","article-title":"An improvement in the superposition theorem of Kolmogorov","volume":"38","author":"Sprecher","year":"1972","journal-title":"J. Math. Anal. Appl."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neunet.2019.12.013","article-title":"Error bounds for deep ReLU networks using the Kolmogorov\u2013Arnold superposition theorem","volume":"129","author":"Montanelli","year":"2020","journal-title":"Neural Netw."},{"key":"ref_43","doi-asserted-by":"crossref","unstructured":"Dorronsoro, J.R. (2002). On the training of Kolomogorov Network. International Conference on Artificial Neural Networks, Springer.","DOI":"10.1007\/3-540-46084-5"},{"key":"ref_44","unstructured":"Hecht-Nielsen, R. (1987, January 21\u201324). Kolmogorov mapping neural network existence theorem. Proceedings of the IEEE First International Conference on Neural Networks, San Diego, CA, USA."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/0893-6080(89)90003-8","article-title":"On the approximate realization of continuous mappings by neural networks","volume":"2","author":"Funahashi","year":"1989","journal-title":"Neural Netw."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1203","DOI":"10.1126\/science.1242366","article-title":"Oscillatory control of factors determining multipotency and fate in mouse neural progenitors","volume":"342","author":"Imayoshi","year":"2013","journal-title":"Science"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"215","DOI":"10.1126\/science.1224311","article-title":"A dynamical-systems view of stem cell biology","volume":"338","author":"Furusawa","year":"2012","journal-title":"Science"},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1038\/150563a0","article-title":"Canalization of development and the inheritance of acquired characters","volume":"150","author":"Waddington","year":"1942","journal-title":"Nature"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/240\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T22:13:57Z","timestamp":1760134437000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/24\/2\/240"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,2,4]]},"references-count":48,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2022,2]]}},"alternative-id":["e24020240"],"URL":"https:\/\/doi.org\/10.3390\/e24020240","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,2,4]]}}}