{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T03:15:27Z","timestamp":1760238927674,"version":"build-2065373602"},"reference-count":27,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T00:00:00Z","timestamp":1599696000000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>We analyze the loss of information and the loss of learning capability inside an arrangement of neural networks. Our method is based on the formulation of the Bogoliubov transformations in order to connect the information between different points of the arrangement. Similar methods translated to the physics of black-holes, reproduce the Hawking radiation effect. From this perspective we can conclude that the black-holes are objects reproducing naturally the bottleneck effect, which is fundamental in neural networks in order to perceive the useful information, eliminating in this way the noise.<\/jats:p>","DOI":"10.3390\/sym12091484","type":"journal-article","created":{"date-parts":[[2020,9,10]],"date-time":"2020-09-10T22:58:01Z","timestamp":1599778681000},"page":"1484","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["On the Loss of Learning Capability Inside an Arrangement of Neural Networks: The Bottleneck Effect in Black-Holes"],"prefix":"10.3390","volume":"12","author":[{"given":"Ivan","family":"Arraut","sequence":"first","affiliation":[{"name":"School of Science and Technology and IIBG, The Open University of Hong Kong, 30 Good Shepherd St., Kowloon, Hong Kong, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Diana","family":"Diaz","sequence":"additional","affiliation":[{"name":"Department of Computer Science, University of Illinois at Chicago, 851 South Morgan Street, Chicago, IL 60607-7053, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,9,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"115","DOI":"10.1007\/BF02478259","article-title":"A Logical Calculus of Ideas Immanent in Nervous Activity","volume":"5","author":"McCulloch","year":"1943","journal-title":"Bull. Math. Biophys."},{"unstructured":"Hebb, D. (1949). The Organization of Behavior, Wiley.","key":"ref_2"},{"key":"ref_3","first-page":"76","article-title":"Simulation of Self-Organizing Systems by Digital Computer","volume":"4","author":"Farley","year":"1954","journal-title":"IRE Trans. Inform. Theory"},{"unstructured":"Nielsen, M. (2019, August 31). Neural Networks and Deep Learning. Available online: http:\/\/neuralnetworksanddeeplearning.com\/.","key":"ref_4"},{"unstructured":"Goudet, O., Duval, B., and Hao, J.K. (2019). Gradient Descent based Weight Learning for Grouping Problems: Application on Graph Coloring and Equitable Graph Coloring. arXiv.","key":"ref_5"},{"unstructured":"Harvey, N.J.A., Liaw, C., and Randhawa, S. (2019). Simple and optimal high-probability bounds for strongly-convex stochastic gradient descent. arXiv.","key":"ref_6"},{"unstructured":"Xie, Y., Wu, X., and Ward, R. (2019). Linear Convergence of Adaptive Stochastic Gradient Descent. arXiv.","key":"ref_7"},{"doi-asserted-by":"crossref","unstructured":"Tishby, N., and Zaslavsky, N. (2015). Deep Learning and the Information Bottleneck Principle. arXiv.","key":"ref_8","DOI":"10.1109\/ITW.2015.7133169"},{"unstructured":"Shwartz-Ziv, R., and Tishby, N. (2017). Opening the Black Box of Deep Neural Networks via Information. arXiv.","key":"ref_9"},{"unstructured":"Susskind, L. (2008). The Black Hole War: My Battle with Stephen Hawking to Make the World Safe for Quantum Mechanics, Little Brown and Company, Hachette Book Group USA.","key":"ref_10"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1007\/BF02345020","article-title":"Particle creation by black holes","volume":"43","author":"Hawking","year":"1975","journal-title":"Commun. Math. Phys."},{"unstructured":"Dvali, G. (2017). Critically excited states with enhanced memory and pattern recognition capacities in quantum brain networks: Lesson from black holes. arXiv.","key":"ref_12"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"105005","DOI":"10.1103\/PhysRevD.97.105005","article-title":"Area law microstate entropy from criticality and spherical symmetry","volume":"97","author":"Dvali","year":"2018","journal-title":"Phys. Rev. D"},{"doi-asserted-by":"crossref","unstructured":"Dvali, G. (2018). Black Holes as Brains: Neural Networks with Area Law Entropy. arXiv.","key":"ref_14","DOI":"10.1002\/prop.201800007"},{"unstructured":"DVali, G. (2018). Classicalization Clearly: Quantum Transition into States of Maximal Memory Storage Capacity. arXiv.","key":"ref_15"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1140\/epjqt\/s40507-019-0071-1","article-title":"Finding Critical States of Enhanced Memory Capacity in Attractive Cold Bosons","volume":"6","author":"Dvali","year":"2019","journal-title":"EPJ Quantum Technol."},{"unstructured":"Dvali, G. (2018). A Microscopic Model of Holography: Survival by the Burden of Memory. arXiv.","key":"ref_17"},{"unstructured":"Dvali, G., Eisemann, L., Michel, M., and Zell, S. (2006). Black Hole Metamorphosis and Stabilization by Memory Burden. arXiv.","key":"ref_18"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"50002","DOI":"10.1209\/0295-5075\/124\/50002","article-title":"Black-hole evaporation from the perspective of neural networks","volume":"124","author":"Arraut","year":"2018","journal-title":"EPL"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1776","DOI":"10.1103\/PhysRev.164.1776","article-title":"Event Horizons in Static Vacuum Space-Times","volume":"164","author":"Israel","year":"1967","journal-title":"Phys. Rev."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1007\/BF02745589","article-title":"Comments on the theory of superconductivity","volume":"7","author":"Valatin","year":"1958","journal-title":"Il Nuovo Cimento"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1007\/BF02745585","article-title":"On a new method in the theory of superconductivity","volume":"7","author":"Bogoliubov","year":"1958","journal-title":"Il Nuovo Cimento"},{"unstructured":"Arraut, I. (2006). Black-Hole evaporation and Quantum-depletion in Bose-Einstein condensates. arXiv.","key":"ref_23"},{"doi-asserted-by":"crossref","unstructured":"Peskin, M.E., and Schroeder, D.V. (2018). An Introduction to Quantum Field Theory, CRC Press\/Taylor and Francis Group.","key":"ref_24","DOI":"10.1201\/9780429503559"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"765","DOI":"10.1007\/BF02980631","article-title":"\u00dcber den Zusammenhang des Abschlusses der Elektronengruppen im Atom mit der Komplexstruktur der Spektren","volume":"31","author":"Pauli","year":"1925","journal-title":"Z. Phys."},{"unstructured":"Pathria, R.K., and de Beale, P. (1996). Statistical Mechanics, Elsevier.","key":"ref_26"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1016\/j.physletb.2005.03.034","article-title":"Bogoliubov transformations for amplitudes in black-hole evaporation","volume":"613","author":"Farley","year":"2005","journal-title":"Phys. Lett. B"}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/9\/1484\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T10:08:31Z","timestamp":1760177311000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/9\/1484"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,9,10]]},"references-count":27,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2020,9]]}},"alternative-id":["sym12091484"],"URL":"https:\/\/doi.org\/10.3390\/sym12091484","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,9,10]]}}}