{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,29]],"date-time":"2026-04-29T00:16:37Z","timestamp":1777421797104,"version":"3.51.4"},"reference-count":122,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2021,2,16]],"date-time":"2021-02-16T00:00:00Z","timestamp":1613433600000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,2,16]],"date-time":"2021-02-16T00:00:00Z","timestamp":1613433600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Brain Inf."],"published-print":{"date-parts":[[2021,12]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The brain is a complex system, due to the heterogeneity of its structure, the diversity of the functions in which it participates and to its reciprocal relationships with the body and the environment. A systemic description of the brain is presented here, as a contribution to developing a brain theory and as a general framework where specific models in computational neuroscience can be integrated and associated with global information flows and cognitive functions. In an enactive view, this framework integrates the fundamental organization of the brain in sensorimotor loops with the internal and the external worlds, answering four fundamental questions (what, why, where and how). Our survival-oriented definition of behavior gives a prominent role to pavlovian and instrumental conditioning, augmented during phylogeny by the specific contribution of other kinds of learning, related to semantic memory in the posterior cortex, episodic memory in the hippocampus and working memory in the frontal cortex. This framework highlights that responses can be prepared in different ways, from pavlovian reflexes and habitual behavior to deliberations for goal-directed planning and reasoning, and explains that these different kinds of responses coexist, collaborate and compete for the control of behavior. It also lays emphasis on the fact that cognition can be described as a dynamical system of interacting memories, some acting to provide information to others, to replace them when they are not efficient enough, or to help for their improvement. Describing the brain as an architecture of learning systems has also strong implications in Machine Learning. Our biologically informed view of pavlovian and instrumental conditioning can be very precious to revisit classical Reinforcement Learning and provide a basis to ensure really autonomous learning.<\/jats:p>","DOI":"10.1186\/s40708-021-00126-4","type":"journal-article","created":{"date-parts":[[2021,2,17]],"date-time":"2021-02-17T12:17:14Z","timestamp":1613564234000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["A global framework for a systemic view of brain modeling"],"prefix":"10.1186","volume":"8","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-6113-1878","authenticated-orcid":false,"given":"Frederic","family":"Alexandre","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2021,2,16]]},"reference":[{"issue":"12","key":"126_CR1","doi-asserted-by":"publisher","first-page":"5718","DOI":"10.1073\/pnas.90.12.5718","volume":"90","author":"M Ahissar","year":"1993","unstructured":"Ahissar M, Hochstein S (1993) Attentional control of early perceptual learning. Proc Natl Acad Sci USA 90(12):5718\u20135722","journal-title":"Proc Natl Acad Sci USA"},{"key":"126_CR2","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1146\/annurev.ne.09.030186.002041","volume":"9","author":"G Alexander","year":"1986","unstructured":"Alexander G, DeLong M, Strick P (1986) Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Ann Rev Neurosci 9:357\u2013381","journal-title":"Ann Rev Neurosci"},{"key":"126_CR3","doi-asserted-by":"publisher","first-page":"324","DOI":"10.1007\/978-3-319-41649-6_33","volume-title":"Artificial general intelligence","author":"F Alexandre","year":"2016","unstructured":"Alexandre F, Carrere M (2016) Modeling neuromodulation as a framework to integrate uncertainty in general cognitive architectures. In: Steunebrink B, Wang P, Goertzel B (eds) Artificial general intelligence. Springer, Berlin, pp 324\u2013333"},{"key":"126_CR4","unstructured":"Alexandre, F. (2020). Creativity explained by Computational Cognitive Neuroscience. In F. A. Cardoso, P. Machado, T. Veale and J. M. Cunha (\u00c9ds.), Int. Conf. on Computational Creativity (p. 374\u2013377)."},{"issue":"5","key":"126_CR5","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1016\/j.tics.2008.02.004","volume":"12","author":"D Badre","year":"2008","unstructured":"Badre D (2008) Cognitive control, hierarchy, and the rostro\u2013caudal organization of the frontal lobes. Trends Cogn Sci 12(5):193\u2013200","journal-title":"Trends Cogn Sci"},{"key":"126_CR6","doi-asserted-by":"publisher","first-page":"47","DOI":"10.3389\/fncom.2014.00047","volume":"8","author":"PP Balasubramani","year":"2014","unstructured":"Balasubramani PP, Chakravarthy VS, Ravindran B, Moustafa AA (2014) An extended reinforcement learning model of basal ganglia to understand the contributions of serotonin and dopamine in risk-based decision making, reward prediction and punishment learning. Front Comput Neurosci 8:47","journal-title":"Front Comput Neurosci"},{"issue":"5","key":"126_CR7","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1016\/j.tins.2006.03.002","volume":"29","author":"BW Balleine","year":"2006","unstructured":"Balleine BW, Killcross S (2006) Parallel incentive processing: an integrated view of amygdala function. Trends Neurosci 29(5):272\u2013279","journal-title":"Trends Neurosci"},{"issue":"1","key":"126_CR8","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.bbr.2008.10.034","volume":"199","author":"BW Balleine","year":"2009","unstructured":"Balleine BW, Liljeholm M, Ostlund SB (2009) The integrative function of the basal ganglia in instrumental conditioning. Behav Brain Res 199(1):43\u201352","journal-title":"Behav Brain Res"},{"issue":"9","key":"126_CR9","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1016\/0166-2236(94)90047-7","volume":"17","author":"R Bandler","year":"1994","unstructured":"Bandler R, Shipley MT (1994) Columnar organization in the midbrain periaqueductal gray: modules for emotional expression? Trends Neurosci 17(9):379\u2013389","journal-title":"Trends Neurosci"},{"issue":"6","key":"126_CR10","doi-asserted-by":"publisher","first-page":"970","DOI":"10.1016\/j.neuron.2007.08.004","volume":"55","author":"MA Belova","year":"2007","unstructured":"Belova MA, Paton JJ, Morrison SE, Salzman CD (2007) Expectation modulates neural responses to pleasant and aversive stimuli in primate amygdala. Neuron 55(6):970\u2013984","journal-title":"Neuron"},{"issue":"1","key":"126_CR11","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1017\/S0140525X00059380","volume":"1","author":"D Bindra","year":"1978","unstructured":"Bindra D (1978) How adaptive behavior is produced: a perceptual-motivational alternative to response reinforcements. Behav Brain Sci 1(1):41\u201352","journal-title":"Behav Brain Sci"},{"key":"126_CR12","doi-asserted-by":"publisher","first-page":"114","DOI":"10.1016\/j.pneurobio.2018.08.003","volume":"171","author":"T Boraud","year":"2018","unstructured":"Boraud T, Leblois A, Rougier NP (2018) A natural history of skills. Prog Neurobiol 171:114\u2013124","journal-title":"Prog Neurobiol"},{"issue":"3","key":"126_CR13","doi-asserted-by":"publisher","first-page":"374","DOI":"10.1016\/j.conb.2011.02.009","volume":"21","author":"AM Bornstein","year":"2011","unstructured":"Bornstein AM, Daw ND (2011) Multiplicity of control in the basal ganglia: computational roles of striatal subregions. Curr Opin Neurobiol 21(3):374\u2013380","journal-title":"Curr Opin Neurobiol"},{"issue":"5","key":"126_CR14","doi-asserted-by":"publisher","first-page":"408","DOI":"10.1016\/j.tics.2019.02.006","volume":"23","author":"M Botvinick","year":"2019","unstructured":"Botvinick M, Ritter S, Wang JX, Kurth-Nelson Z, Blundell C, Hassabis D (2019) Reinforcement learning, fast and slow. Trends Cogn Sci 23(5):408\u2013422","journal-title":"Trends Cogn Sci"},{"key":"126_CR15","first-page":"551","volume-title":"On the control of control: the role of dopamine in regulating prefrontal function and working","author":"TS Braver","year":"2000","unstructured":"Braver TS, Cohen JD (2000) On the control of control: the role of dopamine in regulating prefrontal function and working. MIT Press, Cambridge, pp 551\u2013581"},{"key":"126_CR16","unstructured":"Burnod, Y. (1989). An adaptive neural network : the cerebral cortex. Masson."},{"issue":"3","key":"126_CR17","doi-asserted-by":"publisher","first-page":"321","DOI":"10.1016\/S0149-7634(02)00007-6","volume":"26","author":"RN Cardinal","year":"2002","unstructured":"Cardinal RN, Parkinson JA, Hall J, Everitt BJ (2002) Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci Biobehav Rev 26(3):321\u2013352","journal-title":"Neurosci Biobehav Rev"},{"key":"126_CR18","doi-asserted-by":"crossref","unstructured":"Carrere, M. and Alexandre, F. (2015). A pavlovian model of the amygdala and its influence within the medial temporal lobe. Frontiers in Systems Neuroscience, 9(41).","DOI":"10.3389\/fnsys.2015.00041"},{"issue":"1","key":"126_CR19","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1111\/j.1749-6632.1999.tb09270.x","volume":"877","author":"MD Cassell","year":"1999","unstructured":"Cassell MD, Freedman LJ, Shi C (1999) The intrinsic organization of the central extended amygdala. Ann N Y Acad Sci 877(1):217\u2013241","journal-title":"Ann N Y Acad Sci"},{"issue":"3","key":"126_CR20","doi-asserted-by":"publisher","first-page":"237","DOI":"10.1007\/s00422-010-0401-y","volume":"103","author":"VS Chakravarthy","year":"2010","unstructured":"Chakravarthy VS, Joseph D, Bapi R (2010) What do the basal ganglia do? A modeling perspective. Biol Cybern 103(3):237\u2013253","journal-title":"Biol Cybern"},{"key":"126_CR21","doi-asserted-by":"publisher","first-page":"59","DOI":"10.1038\/nrn2555","volume":"10","author":"A Craig","year":"2009","unstructured":"Craig A (2009) How do you feel\u2013now? The anterior insula and human awareness. Nat Rev Neurosci 10:59\u201370","journal-title":"Nat Rev Neurosci"},{"issue":"4","key":"126_CR22","doi-asserted-by":"publisher","first-page":"500","DOI":"10.1016\/S0959-4388(03)00090-4","volume":"13","author":"AD Craig","year":"2003","unstructured":"Craig AD (2003) Interoception: the sense of the physiological condition of the body. Curr Opin Neurobiol 13(4):500\u2013505","journal-title":"Curr Opin Neurobiol"},{"issue":"2","key":"126_CR23","doi-asserted-by":"publisher","first-page":"143","DOI":"10.1038\/nrn3403","volume":"14","author":"AR Damasio","year":"2013","unstructured":"Damasio AR, Carvalho GB (2013) The nature of feelings: evolutionary and neurobiological origins. Nat Rev Neurosci 14(2):143\u2013152","journal-title":"Nat Rev Neurosci"},{"issue":"12","key":"126_CR24","doi-asserted-by":"publisher","first-page":"1704","DOI":"10.1038\/nn1560","volume":"8","author":"ND Daw","year":"2005","unstructured":"Daw ND, Niv Y, Dayan P (2005) Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat Neurosci 8(12):1704\u20131711","journal-title":"Nat Neurosci"},{"issue":"2","key":"126_CR25","doi-asserted-by":"publisher","first-page":"185","DOI":"10.1016\/j.conb.2008.08.003","volume":"18","author":"P Dayan","year":"2008","unstructured":"Dayan P, Niv Y (2008) Reinforcement learning: the good, the bad and the ugly. Curr Opin Neurobiol 18(2):185\u2013196","journal-title":"Curr Opin Neurobiol"},{"issue":"4","key":"126_CR26","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/0166-2236(89)90052-0","volume":"12","author":"P Dean","year":"1989","unstructured":"Dean P, Redgrave P, Westby GW (1989) Event or emergency? Two response systems in the mammalian superior colliculus. Trends Neurosci 12(4):137\u2013147","journal-title":"Trends Neurosci"},{"key":"126_CR27","doi-asserted-by":"publisher","first-page":"14529","DOI":"10.1073\/pnas.95.24.14529","volume":"95","author":"S Dehaene","year":"1998","unstructured":"Dehaene S, Kergsberg M, Changeux JP (1998) A neuronal model of a global workspace in effortful cognitive tasks. Proc Natl Acad Sci USA 95:14529\u201314534","journal-title":"Proc Natl Acad Sci USA"},{"issue":"9","key":"126_CR28","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1016\/j.tics.2007.08.001","volume":"11","author":"RA Diana","year":"2007","unstructured":"Diana RA, Yonelinas AP, Ranganath C (2007) Imaging recollection and familiarity in the medial temporal lobe: a three-component model. Trends Cogn Sci 11(9):379\u2013386","journal-title":"Trends Cogn Sci"},{"key":"126_CR29","first-page":"497","volume-title":"Stevens\u2019 handbook of experimental psychology, learning, motivation and emotion","author":"A Dickinson","year":"2002","unstructured":"Dickinson A, Balleine BW (2002) The Role of Learning in the Operation of Motivational Systems. In: Pashler H, Gallistel R (eds) Stevens\u2019 handbook of experimental psychology, learning, motivation and emotion, vol 3, 3rd edn. Wiley, New York, pp 497\u2013533","edition":"3"},{"key":"126_CR30","doi-asserted-by":"publisher","first-page":"101","DOI":"10.1016\/j.cobeha.2014.10.007","volume":"1","author":"P Domenech","year":"2015","unstructured":"Domenech P, Koechlin E (2015) Executive control and decision-making in the prefrontal cortex. Curr Opin Behav Sci 1:101\u2013106","journal-title":"Curr Opin Behav Sci"},{"issue":"6191","key":"126_CR31","doi-asserted-by":"publisher","first-page":"1481","DOI":"10.1126\/science.1252254","volume":"344","author":"M Donoso","year":"2014","unstructured":"Donoso M, Collins AG, Koechlin E (2014) Foundations of human reasoning in the prefrontal cortex. Science 344(6191):1481\u20131486","journal-title":"Science"},{"issue":"1","key":"126_CR32","doi-asserted-by":"publisher","first-page":"5826","DOI":"10.1038\/s41467-019-13737-7","volume":"10","author":"HM Dorfman","year":"2019","unstructured":"Dorfman HM, Gershman SJ (2019) Controllability governs the balance between Pavlovian and instrumental action selection. Nat Commun 10(1):5826","journal-title":"Nat Commun"},{"key":"126_CR33","doi-asserted-by":"crossref","unstructured":"Drumond, T. F., Vi\u00e9ville, T., and Alexandre, F. (2019). Bio-inspired Analysis of Deep Learning on Not-So-Big Data Using Data-Prototypes. Frontiers in Computational Neuroscience, 12.","DOI":"10.3389\/fncom.2018.00100"},{"key":"126_CR34","doi-asserted-by":"publisher","first-page":"4","DOI":"10.3389\/fpsyg.2011.00004","volume":"2","author":"GM Edelman","year":"2011","unstructured":"Edelman GM, Gally JA, Baars BJ (2011) Biology of consciousness. Front Psychol 2:4","journal-title":"Front Psychol"},{"issue":"6111","key":"126_CR35","doi-asserted-by":"publisher","first-page":"1202","DOI":"10.1126\/science.1225266","volume":"338","author":"C Eliasmith","year":"2012","unstructured":"Eliasmith C, Stewart TC, Choo X, Bekolay T, DeWolf T, Tang Y, Tang C, Rasmussen D (2012) A large-scale model of the functioning brain. Science 338(6111):1202\u20131205","journal-title":"Science"},{"issue":"1","key":"126_CR36","doi-asserted-by":"publisher","first-page":"7","DOI":"10.1016\/j.neuron.2009.11.031","volume":"65","author":"MS Fanselow","year":"2015","unstructured":"Fanselow MS, Dong H-W (2015) Are the dorsal and ventral hippocampus functionally distinct structures? Neuron 65(1):7\u201319","journal-title":"Neuron"},{"key":"126_CR37","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/s12559-010-9083-y","volume":"3","author":"J Fix","year":"2011","unstructured":"Fix J, Rougier NP, Alexandre F (2011) A dynamic neural field approach to the covert and overt deployment of spatial attention. Cogn Comput 3:279\u2013293","journal-title":"Cogn Comput"},{"issue":"11","key":"126_CR38","doi-asserted-by":"publisher","first-page":"2100","DOI":"10.3390\/e14112100","volume":"14","author":"K Friston","year":"2012","unstructured":"Friston K (2012) A free energy principle for biological systems. Entropy 14(11):2100\u20132121","journal-title":"Entropy"},{"key":"126_CR39","volume-title":"The prefontal cortex. Anatomy, physiology and neurophysiology of the frontal lobe","author":"J Fuster","year":"1989","unstructured":"Fuster J (1989) The prefontal cortex. Anatomy, physiology and neurophysiology of the frontal lobe. Raven Press, New York"},{"issue":"46","key":"126_CR40","doi-asserted-by":"publisher","first-page":"17986","DOI":"10.1523\/JNEUROSCI.1539-13.2013","volume":"33","author":"R Genud-Gabai","year":"2013","unstructured":"Genud-Gabai R, Klavir O, Paz R (2013) Safety signals in the primate amygdala. J Neurosci 33(46):17986\u201317994","journal-title":"J Neurosci"},{"issue":"7626","key":"126_CR41","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1038\/nature20101","volume":"538","author":"A Graves","year":"2016","unstructured":"Graves A, Wayne G, Reynolds M, Harley T, Danihelka I, Grabska-Barwi\u0144ska A, Colmenarejo SGG, Grefenstette E, Ramalho T, Agapiou J, Badia APP, Hermann KMM, Zwols Y, Ostrovski G, Cain A, King H, Summerfield C, Blunsom P, Kavukcuoglu K, Hassabis D (2016) Hybrid computing using a neural network with dynamic external memory. Nature 538(7626):471\u2013476","journal-title":"Nature"},{"key":"126_CR42","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1146\/annurev.neuro.29.051605.112924","volume":"29","author":"M Graziano","year":"2006","unstructured":"Graziano M (2006) The organization of behavioral repertoire in motor cortex. Annu Rev Neurosci 29:105\u2013134","journal-title":"Annu Rev Neurosci"},{"issue":"2","key":"126_CR43","doi-asserted-by":"publisher","first-page":"78","DOI":"10.1007\/s12559-010-9034-7","volume":"2","author":"C Gros","year":"2010","unstructured":"Gros C (2010) Cognition and emotion: perspectives of a closing gap. Cogn Comput 2(2):78\u201385","journal-title":"Cogn Comput"},{"key":"126_CR44","doi-asserted-by":"publisher","first-page":"50","DOI":"10.3389\/fnbeh.2012.00050","volume":"6","author":"AJ Gruber","year":"2012","unstructured":"Gruber AJ, McDonald RJ (2012) Context, emotion, and the strategic pursuit of goals: interactions among multiple brain systems controlling motivated behaviour. Front Behav Neurosci 6:50","journal-title":"Front Behav Neurosci"},{"key":"126_CR45","first-page":"235","volume-title":"Anatomical pathways that link perception and action","author":"RW Guillery","year":"2005","unstructured":"Guillery RW (2005) Anatomical pathways that link perception and action, vol 149. Elsevier, Amsterdam, pp 235\u2013256"},{"issue":"6","key":"126_CR46","doi-asserted-by":"publisher","first-page":"2369","DOI":"10.1523\/JNEUROSCI.20-06-02369.2000","volume":"20","author":"S Haber","year":"2000","unstructured":"Haber S, Fudge J, McFarland N (2000) Striatonigrostriatal pathways in primates form an ascending spiral from the shell to the dorsolateral striatum. J Neurosci 20(6):2369\u20132382","journal-title":"J Neurosci"},{"key":"126_CR47","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.neuron.2017.06.011","volume":"95","author":"D Hassabis","year":"2017","unstructured":"Hassabis D, Kumaran D, Summerfield C, Botvinick MM (2017) Neuroscience-inspired artificial intelligence. Neuron 95:245\u2013258","journal-title":"Neuron"},{"issue":"1","key":"126_CR48","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1016\/j.neuroscience.2005.04.067","volume":"139","author":"TE Hazy","year":"2006","unstructured":"Hazy TE, Frank MJ, O\u2019Reilly RC (2006) Banishing the homunculus: making working memory work. Neuroscience 139(1):105\u2013118","journal-title":"Neuroscience"},{"key":"126_CR49","doi-asserted-by":"publisher","first-page":"123","DOI":"10.1016\/j.cortex.2014.10.011","volume":"64","author":"S H\u00e9lie","year":"2015","unstructured":"H\u00e9lie S, Ell SW, Ashby FG (2015) Learning robust cortico-cortical associations with the basal ganglia: an integrative review. Cortex 64:123\u2013135","journal-title":"Cortex"},{"issue":"2","key":"126_CR50","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1152\/jn.00458.2005","volume":"95","author":"O Hikosaka","year":"2006","unstructured":"Hikosaka O, Nakamura K, Nakahara H (2006) Basal Ganglia orient eyes to reward. J Neurophysiol 95(2):567\u2013584","journal-title":"J Neurophysiol"},{"issue":"25","key":"126_CR51","doi-asserted-by":"publisher","first-page":"6398","DOI":"10.1073\/pnas.1803650115","volume":"115","author":"CB Holroyd","year":"2018","unstructured":"Holroyd CB, Ribas-Fernandes JJF, Shahnazian D, Silvetti M, Verguts T (2018) Human midcingulate cortex encodes distributed representations of task progress. Proc Natl Acad Sci 115(25):6398\u20136403","journal-title":"Proc Natl Acad Sci"},{"issue":"2","key":"126_CR52","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1016\/j.tins.2004.12.001","volume":"28","author":"O Jensen","year":"2005","unstructured":"Jensen O, Lisman JE (2005) Hippocampal sequence-encoding driven by a cortical multi-item working memory buffer. Trends Neurosci 28(2):67\u201372","journal-title":"Trends Neurosci"},{"issue":"4\u20136","key":"126_CR53","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1016\/S0893-6080(02)00047-3","volume":"15","author":"D Joel","year":"2002","unstructured":"Joel D, Niv Y, Ruppin E (2002) Actor\u2013critic models of the basal ganglia: new anatomical and computational perspectives. Neural Netw 15(4\u20136):535\u2013547","journal-title":"Neural Netw"},{"key":"126_CR54","doi-asserted-by":"publisher","first-page":"87","DOI":"10.3389\/fnsys.2015.00087","volume":"9","author":"R Kassab","year":"2015","unstructured":"Kassab R, Alexandre F (2015) Integration of exteroceptive and interoceptive information within the hippocampus: a computational study. Front Syst Neurosci 9:87","journal-title":"Front Syst Neurosci"},{"issue":"6","key":"126_CR55","doi-asserted-by":"publisher","first-page":"2785","DOI":"10.1007\/s00429-018-1659-4","volume":"223","author":"R Kassab","year":"2018","unstructured":"Kassab R, Alexandre F (2018) Pattern separation in the hippocampus: distinct circuits under different conditions. Brain Struct Funct 223(6):2785\u20132808","journal-title":"Brain Struct Funct"},{"issue":"1655","key":"126_CR56","doi-asserted-by":"publisher","first-page":"20130474","DOI":"10.1098\/rstb.2013.0474","volume":"369","author":"E Koechlin","year":"2014","unstructured":"Koechlin E (2014) An evolutionary computational theory of prefrontal executive function in decision-making. Philos Trans Royal Soc London Series B, Biol Sci 369(1655):20130474","journal-title":"Philos Trans Royal Soc London Series B, Biol Sci"},{"issue":"5648","key":"126_CR57","doi-asserted-by":"publisher","first-page":"1181","DOI":"10.1126\/science.1088545","volume":"302","author":"E Koechlin","year":"2003","unstructured":"Koechlin E, Ody C, Kouneiher F (2003) The architecture of cognitive control in the human prefrontal cortex. Science 302(5648):1181\u20131185","journal-title":"Science"},{"issue":"7","key":"126_CR58","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1038\/nn.2321","volume":"12","author":"F Kouneiher","year":"2009","unstructured":"Kouneiher F, Charron S, Koechlin E (2009) Motivation and cognitive control in the human prefrontal cortex. Nat Neurosci 12(7):939\u2013945","journal-title":"Nat Neurosci"},{"issue":"9","key":"126_CR59","doi-asserted-by":"publisher","first-page":"691","DOI":"10.1038\/nrn1747","volume":"6","author":"ML Kringelbach","year":"2005","unstructured":"Kringelbach ML (2005) The human orbitofrontal cortex: linking reward to hedonic experience. Nat Rev Neurosci 6(9):691\u2013702","journal-title":"Nat Rev Neurosci"},{"key":"126_CR60","unstructured":"Laborit, H. (1976). Eloge de la fuite. Folio Essais."},{"issue":"3","key":"126_CR61","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1080\/02724990344000141","volume":"57","author":"ME Le Pelley","year":"2004","unstructured":"Le Pelley ME (2004) The role of associative history in models of associative learning: a selective review and a hybrid model. Q J Exp Psychol 57(3):193\u2013243","journal-title":"Q J Exp Psychol"},{"issue":"20","key":"126_CR62","doi-asserted-by":"publisher","first-page":"R868","DOI":"10.1016\/j.cub.2007.08.005","volume":"17","author":"J LeDoux","year":"2007","unstructured":"LeDoux J (2007) The amygdala. Curr Biol 17(20):R868\u2013R874","journal-title":"Curr Biol"},{"issue":"6162","key":"126_CR63","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1038\/332357a0","volume":"332","author":"C Lee","year":"1988","unstructured":"Lee C, Rohrer WH, Sparks DL (1988) Population coding of saccadic eye movements by neurons in the superior colliculus. Nature 332(6162):357\u2013360","journal-title":"Nature"},{"issue":"3","key":"126_CR64","doi-asserted-by":"publisher","first-page":"521","DOI":"10.1016\/0306-4522(91)90075-Y","volume":"44","author":"RR Llin\u00e1s","year":"1991","unstructured":"Llin\u00e1s RR, Par\u00e9 D (1991) Of dreaming and wakefulness. Neuroscience 44(3):521\u2013535","journal-title":"Neuroscience"},{"key":"126_CR65","doi-asserted-by":"publisher","first-page":"135","DOI":"10.3389\/fnbeh.2013.00135","volume":"7","author":"F Mannella","year":"2013","unstructured":"Mannella F, Gurney K, Baldassarre G (2013) The nucleus accumbens as a nexus between values and goals in goal-directed behavior: a review and a new hypothesis. Front Behav Neurosci 7:135","journal-title":"Front Behav Neurosci"},{"issue":"2","key":"126_CR66","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1007\/s12311-011-0331-9","volume":"11","author":"M Manto","year":"2012","unstructured":"Manto M, Bower JM, Conforto ABB, Delgado-Garcia JM, da Guarda SNFN, Gerwig M, Habas C, Hagura N, Ivry RB, Mari\u00ebn P, Molinari M, Naito E, Nowak DA, Oulad Ben Taib N, Pelisson D, Tesche CD, Tilikete C, Timmann D (2012) Consensus paper: roles of the cerebellum in motor control\u2013the diversity of ideas on cerebellar involvement in movement. Cerebellum 11(2):457\u2013487","journal-title":"Cerebellum"},{"issue":"3","key":"126_CR67","doi-asserted-by":"publisher","first-page":"419","DOI":"10.1037\/0033-295X.102.3.419","volume":"102","author":"JL McClelland","year":"1995","unstructured":"McClelland JL, McNaughton BL, O\u2019Reilly RC (1995) Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. Psychol Rev 102(3):419\u2013457","journal-title":"Psychol Rev"},{"key":"126_CR68","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1007\/978-1-4684-2007-4_39","volume-title":"Hormones and brain function","author":"PD McLean","year":"1973","unstructured":"McLean PD (1973) An evolutionary approach to the investigation of psychoneuro endocrine functions. In: Liss\u00e1k K (ed) Hormones and brain function. Springer, New York, pp 379\u2013389"},{"issue":"8","key":"126_CR69","doi-asserted-by":"publisher","first-page":"401","DOI":"10.1016\/j.tins.2005.06.006","volume":"28","author":"JG McHaffie","year":"2005","unstructured":"McHaffie JG, Stanford TR, Stein BE, Coizet V, Redgrave P (2005) Subcortical loops through the basal ganglia. Trends Neurosci 28(8):401\u2013407","journal-title":"Trends Neurosci"},{"issue":"2","key":"126_CR70","doi-asserted-by":"publisher","first-page":"236","DOI":"10.1016\/S0165-0173(99)00040-5","volume":"31","author":"FA Middleton","year":"2000","unstructured":"Middleton FA, Strick PL (2000) Basal ganglia and cerebellar loops: motor and cognitive circuits. Brain Res Rev 31(2):236\u2013250","journal-title":"Brain Res Rev"},{"key":"126_CR71","volume-title":"Goal-directed decision making","author":"K Miller","year":"2018","unstructured":"Miller K, Ludvig E, Pezzulo G, Shenhav A (2018) Realigning models of habitual and goal-directed decision-making. In: Bornstein A, Morris RW, Shenhav A (eds) Goal-directed decision making. Academic Press, Cambridge"},{"key":"126_CR72","volume-title":"The visual brain in action","author":"A Milner","year":"1995","unstructured":"Milner A, Goodale M (1995) The visual brain in action. Oxford University Press, USA"},{"issue":"1","key":"126_CR73","doi-asserted-by":"publisher","first-page":"29","DOI":"10.1016\/j.bandc.2012.10.005","volume":"81","author":"AA Moustafa","year":"2013","unstructured":"Moustafa AA, Gilbertson MW, Orr SP, Herzallah MM, Servatius RJ, Myers CE (2013) A model of amygdala\u2013hippocampal\u2013prefrontal interaction in fear conditioning and extinction in animals. Brain Cogn 81(1):29\u201343","journal-title":"Brain Cogn"},{"key":"126_CR74","doi-asserted-by":"publisher","DOI":"10.1093\/acprof:oso\/9780199686438.001.0001","volume-title":"The evolution of memory systems: ancestors, anatomy, and adaptations","author":"EA Murray","year":"2016","unstructured":"Murray EA, Wise SP, Graham KS (2016) The evolution of memory systems: ancestors, anatomy, and adaptations. Oxford University Press, Oxford"},{"key":"126_CR75","doi-asserted-by":"crossref","unstructured":"Nallapu, B. T., and Alexandre, F. (2019). Interacting roles of lateral and medial Orbitofrontal cortex in decision-making and learning\u202f: A system-level computational model. BioRxiv, 867515.","DOI":"10.1101\/867515"},{"issue":"1","key":"126_CR76","doi-asserted-by":"publisher","first-page":"357","DOI":"10.1196\/annals.1390.018","volume":"1104","author":"Y Niv","year":"2007","unstructured":"Niv Y (2007) Cost, benefit, tonic, phasic: what do response rates tell us about dopamine and motivation. Ann New York Acad Sci 1104(1):357\u2013376","journal-title":"Ann New York Acad Sci"},{"key":"126_CR77","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1017\/S0140525X0200002X","volume":"25","author":"J Norman","year":"2002","unstructured":"Norman J (2002) Two visual systems and two theories of perception: An attempt to reconcile the constructivist and ecological approaches. Behavioral and Brain Sciences 25:73\u2013144","journal-title":"Behavioral and Brain Sciences"},{"key":"126_CR78","series-title":"Cerebral Cortex","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1007\/978-1-4757-9625-4_5","volume-title":"Extrastriate cortex in primates","author":"LG Nowak","year":"1997","unstructured":"Nowak LG, Bullier J (1997) The timing of information transfer in the visual system. In: Rockland KS, Kaas JH, Peters A (eds) Extrastriate cortex in primates, vol 12. Cerebral Cortex. New York, Plenum, pp 205\u2013241"},{"issue":"5","key":"126_CR79","doi-asserted-by":"publisher","first-page":"939","DOI":"10.1017\/S0140525X01000115","volume":"24","author":"JK O\u2019Regan","year":"2001","unstructured":"O\u2019Regan JK, No\u00eb A (2001) A sensorimotor account of vision and visual consciousness. Behav Brain Sci 24(5):939","journal-title":"Behav Brain Sci"},{"issue":"5796","key":"126_CR80","doi-asserted-by":"publisher","first-page":"91","DOI":"10.1126\/science.1127242","volume":"314","author":"RC O\u2019Reilly","year":"2006","unstructured":"O\u2019Reilly RC (2006) Biologically based computational models of high-level cognition. Science 314(5796):91\u201394","journal-title":"Science"},{"issue":"8","key":"126_CR81","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1016\/j.tins.2010.05.002","volume":"33","author":"RC O\u2019Reilly","year":"2010","unstructured":"O\u2019Reilly RC (2010) The what and how of prefrontal cortical organization. Trends Neurosci 33(8):355\u2013361","journal-title":"Trends Neurosci"},{"key":"126_CR82","unstructured":"O\u2019Reilly, R. C., Hazy, T. E., Mollick, J., Mackie, P., and Herd, S. (2014). Goal-Driven Cognition in the Brain: A computational framework. arXiv:1404.7591"},{"issue":"2","key":"126_CR83","doi-asserted-by":"publisher","first-page":"257","DOI":"10.1016\/j.conb.2010.01.008","volume":"20","author":"RC O\u2019Reilly","year":"2010","unstructured":"O\u2019Reilly RC, Herd SA, Pauli WM (2010) Computational models of cognitive control. Curr Opin Neurobiol 20(2):257","journal-title":"Curr Opin Neurobiol"},{"issue":"2","key":"126_CR84","doi-asserted-by":"publisher","first-page":"311","DOI":"10.1037\/0033-295X.108.2.311","volume":"108","author":"RC O\u2019Reilly","year":"2001","unstructured":"O\u2019Reilly RC, Rudy JW (2001) Conjunctive representations in learning and memory: principles of cortical and hippocampal function. Psychol Rev 108(2):311\u2013345","journal-title":"Psychol Rev"},{"issue":"2","key":"126_CR85","doi-asserted-by":"publisher","first-page":"265","DOI":"10.1109\/TEVC.2006.890271","volume":"11","author":"P-Y Oudeyer","year":"2007","unstructured":"Oudeyer P-Y, Kaplan F, Hafner V (2007) Intrinsic motivation systems for autonomous mental development. IEEE Trans Evol Comput 11(2):265\u2013286","journal-title":"IEEE Trans Evol Comput"},{"issue":"1","key":"126_CR86","doi-asserted-by":"publisher","first-page":"563","DOI":"10.1146\/annurev.neuro.25.112701.142937","volume":"25","author":"MG Packard","year":"2002","unstructured":"Packard MG, Knowlton BJ (2002) Learning and memory functions of the basal ganglia. Annu Rev Neurosci 25(1):563\u2013593","journal-title":"Annu Rev Neurosci"},{"issue":"1","key":"126_CR87","doi-asserted-by":"publisher","first-page":"95","DOI":"10.1038\/nn2020","volume":"11","author":"C Padoa-Schioppa","year":"2008","unstructured":"Padoa-Schioppa C, Assad JA (2008) The representation of economic value in the orbitofrontal cortex is invariant for changes of menu. Nat Neurosci 11(1):95\u2013102","journal-title":"Nat Neurosci"},{"key":"126_CR88","doi-asserted-by":"crossref","unstructured":"Parent, A. and Hazrati, L. N. (1995). Functional anatomy of the basal ganglia. I. The cortico-basal ganglia-thalamo-cortical loop. Brain Res Brain Res Rev, 20(1):91\u2013127.","DOI":"10.1016\/0165-0173(94)00007-C"},{"issue":"8","key":"126_CR89","doi-asserted-by":"publisher","first-page":"354","DOI":"10.1016\/j.tics.2009.04.008","volume":"13","author":"J Parvizi","year":"2009","unstructured":"Parvizi J (2009) Corticocentric myopia: old bias in new cognitive sciences. Trends in Cognitive Sciences 13(8):354\u2013359","journal-title":"Trends in Cognitive Sciences"},{"key":"126_CR90","doi-asserted-by":"publisher","first-page":"43","DOI":"10.1016\/j.brainres.2007.06.097","volume":"1202","author":"WM Pauli","year":"2008","unstructured":"Pauli WM, O\u2019Reilly RC (2008) Attentional control of associative learning\u2013a possible role of the central cholinergic system. Brain Res 1202:43\u201353","journal-title":"Brain Res"},{"issue":"3","key":"126_CR91","doi-asserted-by":"publisher","first-page":"381","DOI":"10.1016\/j.conb.2013.01.008","volume":"23","author":"R Paz","year":"2013","unstructured":"Paz R, Par\u00e9 D (2013) Physiological basis for emotional modulation of memory circuits by the amygdala. Curr Opin Neurobiol 23(3):381\u2013386","journal-title":"Curr Opin Neurobiol"},{"issue":"10","key":"126_CR92","doi-asserted-by":"publisher","first-page":"548","DOI":"10.1016\/j.tins.2011.08.001","volume":"34","author":"CM Pennartz","year":"2011","unstructured":"Pennartz CM, Ito R, Verschure PFMJ, Battaglia FP, Robbins TW (2011) The hippocampal-striatal axis in learning, prediction and goal-directed behavior. Trends Neurosci 34(10):548\u2013559","journal-title":"Trends Neurosci"},{"issue":"1","key":"126_CR93","doi-asserted-by":"publisher","first-page":"96","DOI":"10.1016\/j.pneurobio.2011.08.010","volume":"96","author":"MR Penner","year":"2012","unstructured":"Penner MR, Mizumori SJY (2012) Neural systems analysis of decision making during goal-directed navigation. Prog Neurobiol 96(1):96\u2013135","journal-title":"Prog Neurobiol"},{"issue":"11","key":"126_CR94","doi-asserted-by":"publisher","first-page":"773","DOI":"10.1038\/nrn2920","volume":"11","author":"L Pessoa","year":"2010","unstructured":"Pessoa L, Adolphs R (2010) Emotion processing and the amygdala: from a \u2019low road\u2019 to \u2019many roads\u2019 of evaluating biological significance. Nat Rev Neurosci 11(11):773\u2013783","journal-title":"Nat Rev Neurosci"},{"issue":"4","key":"126_CR95","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1007\/s00426-009-0237-z","volume":"73","author":"G Pezzulo","year":"2009","unstructured":"Pezzulo G, Castelfranchi C (2009) Thinking as the control of imagination: a conceptual framework for goal-directed systems. Psychol Res 73(4):559\u2013577","journal-title":"Psychol Res"},{"issue":"12","key":"126_CR96","doi-asserted-by":"publisher","first-page":"647","DOI":"10.1016\/j.tics.2014.06.011","volume":"18","author":"G Pezzulo","year":"2014","unstructured":"Pezzulo G, Van der Meer MAA, Lansink CS, Pennartz CMA (2014) Internally generated sequences in learning and executing goal-directed behavior. Trends Cogn Sci 18(12):647\u2013657","journal-title":"Trends Cogn Sci"},{"issue":"6","key":"126_CR97","doi-asserted-by":"publisher","first-page":"414","DOI":"10.1016\/j.tics.2016.03.013","volume":"20","author":"G Pezzulo","year":"2016","unstructured":"Pezzulo G, Cisek P (2016) Navigating the affordance landscape: feed-back control as a process model of behavior and cognition. Trends Cogn Sci 20(6):414\u2013424","journal-title":"Trends Cogn Sci"},{"key":"126_CR98","volume-title":"How the body shapes the way we think: a new view of intelligence","author":"R Pfeifer","year":"2007","unstructured":"Pfeifer R, Bongard J, Grand S (2007) How the body shapes the way we think: a new view of intelligence. Bradford Books MIT Press, Cambridge"},{"issue":"6","key":"126_CR99","doi-asserted-by":"publisher","first-page":"1825","DOI":"10.4249\/scholarpedia.1825","volume":"2","author":"P Redgrave","year":"2007","unstructured":"Redgrave P (2007) Basal Ganglia. Scholarpedia 2(6):1825","journal-title":"Scholarpedia"},{"issue":"4","key":"126_CR100","doi-asserted-by":"publisher","first-page":"1009","DOI":"10.1016\/S0306-4522(98)00319-4","volume":"89","author":"P Redgrave","year":"1999","unstructured":"Redgrave P, Prescott TJ, Gurney K (1999) The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89(4):1009\u20131023","journal-title":"Neuroscience"},{"issue":"1A","key":"126_CR101","doi-asserted-by":"publisher","first-page":"31","DOI":"10.1016\/0028-3932(87)90041-8","volume":"25","author":"G Rizzolatti","year":"1987","unstructured":"Rizzolatti G, Riggio L, Dascola I, Umilt\u00e1 C (1987) Reorienting attention across the horizontal and vertical meridians: evidence in favor of a premotor theory of attention. Neuropsychologia 25(1A):31\u201340","journal-title":"Neuropsychologia"},{"issue":"8","key":"126_CR102","doi-asserted-by":"publisher","first-page":"363","DOI":"10.1016\/j.tics.2004.06.003","volume":"8","author":"G Rousselet","year":"2004","unstructured":"Rousselet G, Thorpe S, Fabre-Thorpe M (2004) How parallel is visual processing in the ventral path? Trends Cogn Sci 8(8):363\u2013370","journal-title":"Trends Cogn Sci"},{"issue":"9","key":"126_CR103","doi-asserted-by":"publisher","first-page":"410","DOI":"10.1016\/j.tics.2004.07.009","volume":"8","author":"MFS Rushworth","year":"2004","unstructured":"Rushworth MFS, Walton ME, Kennerley SW, Bannerman DM (2004) Action sets and decisions in the medial frontal cortex. Trends Cogn Sci 8(9):410\u2013417","journal-title":"Trends Cogn Sci"},{"issue":"1","key":"126_CR104","doi-asserted-by":"publisher","first-page":"219","DOI":"10.1146\/annurev.neuro.31.060407.125642","volume":"31","author":"K Sakai","year":"2008","unstructured":"Sakai K (2008) Task set and prefrontal cortex. Annu Rev Neurosci 31(1):219\u2013245","journal-title":"Annu Rev Neurosci"},{"issue":"2","key":"126_CR105","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1016\/j.neuron.2013.07.007","volume":"79","author":"A Shenhav","year":"2013","unstructured":"Shenhav A, Botvinick MM, Cohen JD (2013) The expected value of control: an integrative theory of anterior cingulate cortex function. Neuron 79(2):217\u2013240","journal-title":"Neuron"},{"key":"126_CR106","doi-asserted-by":"publisher","first-page":"417","DOI":"10.1016\/j.conb.2007.07.003","volume":"17","author":"S Sherman","year":"2007","unstructured":"Sherman S (2007) The thalamus is more than just a relay. Curr Opin Neurobiol 17:417\u2013422","journal-title":"Curr Opin Neurobiol"},{"issue":"3","key":"126_CR107","doi-asserted-by":"publisher","first-page":"1381","DOI":"10.1152\/jn.00738.2003","volume":"91","author":"M Sommer","year":"2004","unstructured":"Sommer M, Wurtz R (2004) What the brain stem tells the frontal cortex. I. Oculomotor signals sent from superior colliculus to frontal eye field via mediodorsal thalamus. J Neurophysiol 91(3):1381\u20131402","journal-title":"J Neurophysiol"},{"issue":"4","key":"126_CR108","doi-asserted-by":"publisher","first-page":"160","DOI":"10.1145\/122344.122377","volume":"2","author":"RS Sutton","year":"1991","unstructured":"Sutton RS (1991) Dyna, an integrated architecture for learning, planning, and reacting. ACM SIGART Bull 2(4):160\u2013163","journal-title":"ACM SIGART Bull"},{"key":"126_CR109","first-page":"2528","volume-title":"Advances in neural information processing systems 27","author":"KL Stachenfeld","year":"2014","unstructured":"Stachenfeld KL, Botvinick M, Gershman SJ (2014) Design principles of the hippocampal cognitive map. In: Ghahramani Z, Welling M, Cortes C, Lawrence ND, Weinberger KQ (eds) Advances in neural information processing systems 27. Curran Associates Inc, New York, pp 2528\u20132536"},{"issue":"11","key":"126_CR110","doi-asserted-by":"publisher","first-page":"1643","DOI":"10.1038\/nn.4650","volume":"20","author":"KL Stachenfeld","year":"2017","unstructured":"Stachenfeld KL, Botvinick MM, Gershman SJ (2017) The hippocampus as a predictive map. Nat Neurosci 20(11):1643\u20131653","journal-title":"Nat Neurosci"},{"issue":"3","key":"126_CR111","doi-asserted-by":"publisher","first-page":"496","DOI":"10.1002\/cne.23803","volume":"524","author":"GF Striedter","year":"2016","unstructured":"Striedter GF (2016) Evolution of the hippocampus in reptiles and birds. J Comp Neurol 524(3):496\u2013517","journal-title":"J Comp Neurol"},{"issue":"8","key":"126_CR112","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/S0166-2236(98)01265-X","volume":"21","author":"LW Swanson","year":"1998","unstructured":"Swanson LW, Petrovich GD (1998) What is the amygdala? Trends Neurosci 21(8):323\u2013331","journal-title":"Trends Neurosci"},{"key":"126_CR113","doi-asserted-by":"publisher","first-page":"549","DOI":"10.1007\/s00422-015-0660-8","volume":"109","author":"W Taouali","year":"2015","unstructured":"Taouali W, Goffart L, Alexandre F, Rougier NP (2015) A parsimonious computational model of visual target position encoding in the superior colliculus. Biol Cybern 109:549\u2013559","journal-title":"Biol Cybern"},{"key":"126_CR114","volume-title":"Episodic and semantic memory. Organization of Memory","author":"E Tulving","year":"1972","unstructured":"Tulving E (1972) Episodic and semantic memory. Organization of Memory. Academic Press, Cambridge"},{"key":"126_CR115","first-page":"549","volume-title":"Two cortical visual systems","author":"L Ungerleider","year":"1982","unstructured":"Ungerleider L, Mishkin M (1982) Two cortical visual systems. MIT Press, Cambridge, pp 549\u2013586"},{"issue":"1\u20132","key":"126_CR116","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.bbr.2003.09.028","volume":"146","author":"HBM Uylings","year":"2003","unstructured":"Uylings HBM, Groenewegen HJ, Kolb B (2003) Do rats have a prefrontal cortex? Behav Brain Res 146(1\u20132):3\u201317","journal-title":"Behav Brain Res"},{"key":"126_CR117","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1162\/jocn_a_01595","volume":"32","author":"AR Vaidya","year":"2020","unstructured":"Vaidya AR, Badre D (2020) Neural systems for memory-based value judgment and decision-making. J Cogn Neurosci 32:1\u201328","journal-title":"J Cogn Neurosci"},{"key":"126_CR118","doi-asserted-by":"publisher","DOI":"10.7551\/mitpress\/6730.001.0001","volume-title":"The embodied mind: Cognitive science and human experience","author":"F Varela","year":"1991","unstructured":"Varela F, Thompson E, Rosch E (1991) The embodied mind: Cognitive science and human experience. MIT Press, Cambridge, MA"},{"issue":"1655","key":"126_CR119","doi-asserted-by":"publisher","first-page":"20130483","DOI":"10.1098\/rstb.2013.0483","volume":"369","author":"PFMJ Verschure","year":"2014","unstructured":"Verschure PFMJ, Pennartz CM, Pezzulo G (2014) The why, what, where, when and how of goal-directed choice: neuronal and computational principles. Philos Trans Royal Soc B Biol Sci 369(1655):20130483","journal-title":"Philos Trans Royal Soc B Biol Sci"},{"issue":"8","key":"126_CR120","doi-asserted-by":"publisher","first-page":"468","DOI":"10.1016\/j.tins.2004.06.006","volume":"27","author":"P Voorn","year":"2004","unstructured":"Voorn P, Vanderschuren LJ, Groenewegen HJ, Robbins TW, Pennartz CM (2004) Putting a spin on the dorsal-ventral divide of the striatum. Trends Neurosci 27(8):468\u2013474","journal-title":"Trends Neurosci"},{"issue":"6","key":"126_CR121","doi-asserted-by":"publisher","first-page":"860","DOI":"10.1038\/s41593-018-0147-8","volume":"21","author":"JX Wang","year":"2018","unstructured":"Wang JX, Kurth-Nelson Z, Kumaran D, Tirumala D, Soyer H, Leibo JZ, Hassabis D, Botvinick M (2018) Prefrontal cortex as a meta-reinforcement learning system. Nat Neurosci 21(6):860\u2013868","journal-title":"Nat Neurosci"},{"issue":"8","key":"126_CR122","doi-asserted-by":"publisher","first-page":"1437","DOI":"10.1111\/j.1460-9568.2008.06422.x","volume":"28","author":"HH Yin","year":"2008","unstructured":"Yin HH, Ostlund SB, Balleine BW (2008) Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks. Eur J Neurosci 28(8):1437\u20131448","journal-title":"Eur J Neurosci"}],"container-title":["Brain Informatics"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-021-00126-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1186\/s40708-021-00126-4\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1186\/s40708-021-00126-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,29]],"date-time":"2023-01-29T04:03:09Z","timestamp":1674964989000},"score":1,"resource":{"primary":{"URL":"https:\/\/braininformatics.springeropen.com\/articles\/10.1186\/s40708-021-00126-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,2,16]]},"references-count":122,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2021,12]]}},"alternative-id":["126"],"URL":"https:\/\/doi.org\/10.1186\/s40708-021-00126-4","relation":{"has-preprint":[{"id-type":"doi","id":"10.21203\/rs.3.rs-59619\/v1","asserted-by":"object"}]},"ISSN":["2198-4018","2198-4026"],"issn-type":[{"value":"2198-4018","type":"print"},{"value":"2198-4026","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,2,16]]},"assertion":[{"value":"16 October 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"5 February 2021","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"16 February 2021","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The author declares that he has no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"3"}}