{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:38:01Z","timestamp":1760243881118,"version":"build-2065373602"},"reference-count":15,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2010,1,22]],"date-time":"2010-01-22T00:00:00Z","timestamp":1264118400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In this paper, an entropy based associative memory model will be proposed and applied to memory retrievals with an orthogonal learning model so as to compare with the conventional model based on the quadratic Lyapunov functional to be minimized during the retrieval process. In the present approach, the updating dynamics will be constructed on the basis of the entropy minimization strategy which may be reduced asymptotically to the above-mentioned conventional dynamics as a special case ignoring the higher-order correlations. According to the introduction of the entropy functional, one may involve higer-order correlation effects between neurons in a self-contained manner without any heuristic coupling coefficients as in the conventional manner. In fact we shall show such higher order coupling tensors are to be uniquely determined in the framework of the entropy based approach. From numerical results, it will be found that the presently proposed novel approach realizes much larger memory capacity than that of the quadratic Lyapunov functional approach, e.g., associatron.<\/jats:p>","DOI":"10.3390\/e12010136","type":"journal-article","created":{"date-parts":[[2010,1,25]],"date-time":"2010-01-25T02:53:55Z","timestamp":1264388035000},"page":"136-147","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":1,"title":["On the Entropy Based Associative Memory Model with Higher-Order Correlations"],"prefix":"10.3390","volume":"12","author":[{"given":"Masahiro","family":"Nakagawa","sequence":"first","affiliation":[{"name":"Department of Electrical Engineering, Faculty of Engineering, Nagaoka University of Technology, Kamitomioka 1603-1, Nagaoka, Niigata 940-21, Japan"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2010,1,22]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1016\/0025-5564(72)90075-2","article-title":"A simple neural network generating interactive memory","volume":"14","author":"Anderson","year":"1972","journal-title":"Math. Biosci."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1109\/TC.1972.5008975","article-title":"Correlation matrix memories","volume":"C-21","author":"Kohonen","year":"1972","journal-title":"IEEE Trans. Comput."},{"key":"ref_3","first-page":"381","article-title":"Associatron-a model of associative memory","volume":"SMC-2","author":"Nakano","year":"1972","journal-title":"IEEE Trans."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"175","DOI":"10.1007\/BF00365229","article-title":"Neural Theory of association and concept formation","volume":"26","author":"Amari","year":"1977","journal-title":"Biol. Cybern."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1530","DOI":"10.1103\/PhysRevLett.55.1530","article-title":"Storing infinite numbers of patterns in a spin-glass model of neural networks","volume":"55","author":"Amit","year":"1985","journal-title":"Phys. Rev. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1088\/0305-4470\/19\/16\/017","article-title":"Structure of metastable states in the Hopfield model","volume":"19","author":"Gardner","year":"1986","journal-title":"J. Phys. A: Math. Gen."},{"key":"ref_7","first-page":"701","article-title":"Representation of associated pairs by matrix operators","volume":"22","author":"Kohonen","year":"1973","journal-title":"IEEE Trans."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"63","DOI":"10.1016\/0893-6080(88)90022-6","article-title":"Statistical Neurodynamics of associative memory","volume":"1","author":"Amari","year":"1988","journal-title":"Neural Networks"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1016\/S0893-6080(05)80076-0","article-title":"Associative memory with nonmonotone dynamics","volume":"6","author":"Morita","year":"1993","journal-title":"Neural Networks"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"803","DOI":"10.1109\/72.508925","article-title":"Auto-associative Memory with two-stage dynamics of non-monotonic neurons","volume":"7","author":"Yanai","year":"1996","journal-title":"IEEE Trans. Neural Networks"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2095","DOI":"10.1103\/PhysRevE.57.2095","article-title":"Random and systematic dilutions of synaptic connections in a neural network with a nonmonotonic response functions","volume":"57","author":"Okada","year":"1998","journal-title":"Phys. Rev. E"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Nakagawa, M. (1999). Chaos and Fractals in Engineering, World Scientific Inc.","DOI":"10.1142\/4067"},{"key":"ref_13","first-page":"1299","article-title":"Associative ability of higher order neural networks","volume":"2","author":"Yatsuki","year":"1997","journal-title":"Neural Networks"},{"key":"ref_14","first-page":"1311","article-title":"Higher order orthogonal tensor networks: Information capacity and reliability","volume":"2","author":"Gorban","year":"1997","journal-title":"Proc. Neural Networks"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"397","DOI":"10.1007\/11893028_45","article-title":"Entropy based associative model","volume":"4232\/2006","author":"Nakagawa","year":"2006","journal-title":"Lect. Notes Comput. Sci."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/12\/1\/136\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T22:01:17Z","timestamp":1760220077000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/12\/1\/136"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,1,22]]},"references-count":15,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2010,1]]}},"alternative-id":["e12010136"],"URL":"https:\/\/doi.org\/10.3390\/e12010136","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2010,1,22]]}}}