{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T06:34:59Z","timestamp":1763966099378,"version":"3.45.0"},"reference-count":32,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T00:00:00Z","timestamp":1763942400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Comput. Neurosci."],"abstract":"<jats:p>The big strides seen in generative AI are not based on somewhat obscure algorithms, but due to clearly defined generative principles. The resulting concrete implementations have proven themselves in large numbers of applications. We suggest that it is imperative to thoroughly investigate which of these generative principles may be operative also in the brain, and hence relevant for cognitive neuroscience. In addition, ML research led to a range of interesting characterizations of neural information processing systems. We discuss five examples, the shortcomings of world modeling, the generation of thought processes, attention, neural scaling laws, and quantization, that illustrate how much neuroscience could potentially learn from ML research.<\/jats:p>","DOI":"10.3389\/fncom.2025.1718778","type":"journal-article","created":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T06:30:04Z","timestamp":1763965804000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":0,"title":["From generative AI to the brain: five takeaways"],"prefix":"10.3389","volume":"19","author":[{"given":"Claudius","family":"Gros","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1965","published-online":{"date-parts":[[2025,11,24]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"167","DOI":"10.1146\/annurev-psych-022024-103901","article-title":"Cognitive control","volume":"76","author":"Badre","year":"2024","journal-title":"Annu. Rev. Psychol"},{"key":"B2","doi-asserted-by":"publisher","first-page":"27381","DOI":"10.5555\/3540261.3542358","article-title":"Flow network based generative models for non-iterative diverse candidate generation","volume":"34","author":"Bengio","year":"2021","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B3","doi-asserted-by":"publisher","first-page":"8273","DOI":"10.1523\/JNEUROSCI.0614-17.2017","article-title":"Information-theoretic evidence for predictive coding in the face-processing system","volume":"37","author":"Brodski-Guerniero","year":"2017","journal-title":"J. Neurosci"},{"key":"B4","doi-asserted-by":"publisher","first-page":"430","DOI":"10.1038\/s41562-022-01516-2","article-title":"Evidence of a predictive coding hierarchy in the human brain listening to speech","volume":"7","author":"Caucheteux","year":"2023","journal-title":"Nat. Human Behav"},{"key":"B5","doi-asserted-by":"publisher","first-page":"R850","DOI":"10.1016\/j.cub.2004.09.041","article-title":"Visual attention: bottom-up versus top-down","volume":"14","author":"Connor","year":"2004","journal-title":"Curr. Biol"},{"key":"B6","doi-asserted-by":"publisher","first-page":"6037","DOI":"10.1007\/s10462-022-10148-x","article-title":"Attention, please! A survey of neural attention models in deep learning","volume":"55","author":"de Santana Correia","year":"2022","journal-title":"Artif. Intellig. Rev"},{"key":"B7","doi-asserted-by":"publisher","first-page":"107856","DOI":"10.1016\/j.neunet.2025.107856","article-title":"A survey of low-bit large language models: Basics, systems, and algorithms","volume":"192","author":"Gong","year":"2025","journal-title":"Neural Netw"},{"key":"B8","doi-asserted-by":"publisher","first-page":"96","DOI":"10.3758\/BF03202365","article-title":"Minerva 2: A simulation model of human memory","volume":"16","author":"Hintzman","year":"1984","journal-title":"Behav. Res. Methods, Instrum. Comp"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2203.15556","article-title":"Training compute-optimal large language models","author":"Hoffmann","year":"2022","journal-title":"arXiv [Preprint]"},{"key":"B10","doi-asserted-by":"publisher","first-page":"2288","DOI":"10.3758\/s13414-019-01846-w","article-title":"No one knows what attention is","volume":"81","author":"Hommel","year":"2019","journal-title":"Attent. Percept. Psychophys"},{"key":"B11","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1080\/17588928.2017.1284775","article-title":"Introduction to special issue: attention & plasticity","volume":"8","author":"Hopfinger","year":"2017","journal-title":"Cogn. Neurosci"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2001.08361","article-title":"Scaling laws for neural language models","author":"Kaplan","year":"2020","journal-title":"arXiv [Preprint]"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2507.18391","article-title":"Revisiting llm reasoning via information bottleneck","author":"Lei","year":"2025","journal-title":"arXiv [Preprint]"},{"key":"B14","doi-asserted-by":"publisher","first-page":"29","DOI":"10.3389\/fncom.2020.00029","article-title":"Attention in psychology, neuroscience, and machine learning","volume":"14","author":"Lindsay","year":"2020","journal-title":"Front. Comput. Neurosci"},{"key":"B15","doi-asserted-by":"publisher","first-page":"20160328","DOI":"10.1098\/rstb.2016.0328","article-title":"Gradation (approx. 10 size states) of synaptic strength by quantal addition of structural modules","volume":"372","author":"Liu","year":"2017","journal-title":"Philos. Trans. R. Soc. Lond. B. Biol Sci"},{"key":"B16","doi-asserted-by":"publisher","first-page":"1006","DOI":"10.1162\/NECO_a_00424","article-title":"A self-organized neural comparator","volume":"25","author":"Ludue na","year":"2013","journal-title":"Neural Comput"},{"key":"B17","doi-asserted-by":"publisher","first-page":"28699","DOI":"10.5555\/3666122.3667370","article-title":"The quantization model of neural scaling","volume":"36","author":"Michaud","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B18","doi-asserted-by":"publisher","first-page":"47","DOI":"10.1146\/annurev-psych-122414-033400","article-title":"Neural mechanisms of selective visual attention","volume":"68","author":"Moore","year":"2017","journal-title":"Annu. Rev. Psychol"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2210.00849","article-title":"Scaling laws for a multi-agent reinforcement learning model","author":"Neumann","year":"2022","journal-title":"arXiv [Preprint]"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2412.11979","article-title":"Alphazero neural scaling and zipf's law: a tale of board games and power laws","author":"Neumann","year":"2024","journal-title":"arXiv [Preprint]"},{"key":"B21","doi-asserted-by":"publisher","first-page":"369","DOI":"10.31219\/osf.io\/z7c98","article-title":"A neuro-mimetic realization of the common model of cognition via hebbian learning and free energy minimization","volume":"2","author":"Ororbia","year":"2023","journal-title":"Proc. AAAI Symposium Series"},{"key":"B22","doi-asserted-by":"publisher","first-page":"71","DOI":"10.1007\/7854_2020_133","article-title":"Cholinergic signaling dynamics and cognitive control of attention","volume":"45","author":"Parikh","year":"2020","journal-title":"Behav. Pharmacol. Cholinerg. Syst"},{"key":"B23","doi-asserted-by":"publisher","first-page":"4732","DOI":"10.1073\/pnas.95.8.4732","article-title":"All-or-none potentiation at CA3-CA1 synapses","volume":"95","author":"Petersen","year":"1998","journal-title":"Proc. Nat. Acad. Sci"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2008.02217","article-title":"Hopfield networks is all you need","author":"Ramsauer","year":"2020","journal-title":"arXiv [Preprint]"},{"key":"B25","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/ITW.2015.7133169","article-title":"\u201cDeep learning and the information bottleneck principle,\u201d","volume-title":"2015 IEEE Information Theory Workshop (ITW)","author":"Tishby","year":"2015"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.1706.03762","article-title":"Attention is all you need","author":"Vaswani","year":"2017","journal-title":"arXiv [Preprint]"},{"key":"B27","doi-asserted-by":"publisher","first-page":"24824","DOI":"10.5555\/3600270.3602070","article-title":"Chain-of-thought prompting elicits reasoning in large language models","volume":"35","author":"Wei","year":"2022","journal-title":"Adv. Neural Inf. Process. Syst"},{"key":"B28","doi-asserted-by":"publisher","first-page":"7445","DOI":"10.3390\/app14177445","article-title":"Advances in the neural network quantization: a comprehensive review","volume":"14","author":"Wei","year":"2024","journal-title":"Appl. Sci"},{"key":"B29","doi-asserted-by":"publisher","first-page":"304","DOI":"10.1016\/j.tics.2023.11.007","article-title":"We know what attention is!","volume":"28","author":"Wu","year":"2024","journal-title":"Trends Cogn. Sci"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2404.15676","article-title":"Beyond chain-of-thought: a survey of chain-of-X paradigms for LLMS","author":"Xia","year":"2024","journal-title":"arXiv [Preprint]"},{"key":"B31","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1145\/3719341","article-title":"Igniting language intelligence: the hitchhiker's guide from chain-of-thought reasoning to language agents","volume":"57","author":"Zhang","year":"2025","journal-title":"ACM Comp. Surv"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.48550\/arXiv.2509.15207","article-title":"Flowrl: Matching reward distributions for llm reasoning","author":"Zhu","year":"2025","journal-title":"arXiv [Preprint]"}],"container-title":["Frontiers in Computational Neuroscience"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2025.1718778\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,11,24]],"date-time":"2025-11-24T06:30:06Z","timestamp":1763965806000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fncom.2025.1718778\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,11,24]]},"references-count":32,"alternative-id":["10.3389\/fncom.2025.1718778"],"URL":"https:\/\/doi.org\/10.3389\/fncom.2025.1718778","relation":{},"ISSN":["1662-5188"],"issn-type":[{"value":"1662-5188","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,11,24]]},"article-number":"1718778"}}