{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,2]],"date-time":"2026-04-02T02:31:51Z","timestamp":1775097111393,"version":"3.50.1"},"reference-count":111,"publisher":"MIT Press - Journals","issue":"2","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2012,2,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Appetitive goal-directed behavior can be associated with a cue-triggered expectancy that it will lead to a particular reward, a process thought to depend on the OFC and basolateral amygdala complex. We developed a biologically informed neural network model of this system to investigate the separable and complementary roles of these areas as the main components of a flexible expectancy system. These areas of interest are part of a neural network with additional subcortical areas, including the central nucleus of amygdala, ventral (limbic) and dorsomedial (associative) striatum. Our simulations are consistent with the view that the amygdala maintains Pavlovian associations through incremental updating of synaptic strength and that the OFC supports flexibility by maintaining an activation-based working memory of the recent reward history. Our model provides a mechanistic explanation for electrophysiological evidence that cue-related firing in OFC neurons is nonselectively early after a contingency change and why this nonselective firing is critical for promoting plasticity in the amygdala. This ambiguous activation results from the simultaneous maintenance of recent outcomes and obsolete Pavlovian contingencies in working memory. Furthermore, at the beginning of reversal, the OFC is critical for supporting responses that are no longer inappropriate. This result is inconsistent with an exclusive inhibitory account of OFC function.<\/jats:p>","DOI":"10.1162\/jocn_a_00155","type":"journal-article","created":{"date-parts":[[2011,10,17]],"date-time":"2011-10-17T13:28:28Z","timestamp":1318858108000},"page":"351-366","update-policy":"https:\/\/doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":28,"title":["Expectancy, Ambiguity, and Behavioral Flexibility: Separable and Complementary Roles of the Orbital Frontal Cortex and Amygdala in Processing Reward Expectancies"],"prefix":"10.1162","volume":"24","author":[{"given":"Wolfgang M.","family":"Pauli","sequence":"first","affiliation":[]},{"given":"Thomas E.","family":"Hazy","sequence":"additional","affiliation":[]},{"given":"Randall C.","family":"O'Reilly","sequence":"additional","affiliation":[]}],"member":"281","published-online":{"date-parts":[[2012,2,1]]},"reference":[{"key":"2021072913183407100_R1","doi-asserted-by":"crossref","first-page":"5879","DOI":"10.1523\/JNEUROSCI.15-09-05879.1995","article-title":"Fear and the human amygdala.","volume":"15","author":"Adolphs","year":"1995","journal-title":"Journal of Neuroscience"},{"key":"2021072913183407100_R2","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1016\/S0306-4522(02)00551-1","article-title":"Independent modulation of basal and feeding-evoked dopamine efflux in the nucleus accumbens and medial prefrontal cortex by the central and basolateral amygdalar nuclei in the rat.","volume":"116","author":"Ahn","year":"2003","journal-title":"Neuroscience"},{"key":"2021072913183407100_R3","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1146\/annurev.ne.09.030186.002041","article-title":"Parallel organization of functionally segregated circuits linking basal ganglia and cortex.","volume":"9","author":"Alexander","year":"1986","journal-title":"Annual Review of Neuroscience"},{"key":"2021072913183407100_R4","doi-asserted-by":"crossref","first-page":"8161","DOI":"10.1523\/JNEUROSCI.1554-07.2007","article-title":"The role of the dorsal striatum in reward and decision-making.","volume":"27","author":"Balleine","year":"2007","journal-title":"The Journal of Neuroscience: The Official Journal of the Society for Neuroscience"},{"key":"2021072913183407100_R5","doi-asserted-by":"crossref","first-page":"108","DOI":"10.1162\/089892998563815","article-title":"A computational model of how the basal ganglia produces sequences.","volume":"10","author":"Berns","year":"1998","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913183407100_R6","doi-asserted-by":"crossref","first-page":"471","DOI":"10.1016\/j.neunet.2003.08.006","article-title":"How laminar frontal cortex and basal ganglia circuits interact to control planned and reactive saccades.","volume":"17","author":"Brown","year":"2004","journal-title":"Neural Networks"},{"key":"2021072913183407100_R7","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/S0149-7634(02)00007-6","article-title":"Emotion and motivation: The role of the amygdala, ventral striatum, and prefrontal cortex.","volume":"26","author":"Cardinal","year":"2002","journal-title":"Neuroscience and Biobehavioral Reviews"},{"key":"2021072913183407100_R8","doi-asserted-by":"crossref","first-page":"1154","DOI":"10.1093\/cercor\/bhl025","article-title":"Rhesus monkeys with orbital prefrontal cortex lesions can learn to inhibit prepotent responses in the reversed reward contingency task.","volume":"17","author":"Chudasama","year":"2007","journal-title":"Cerebral Cortex"},{"key":"2021072913183407100_R9","doi-asserted-by":"crossref","first-page":"1585","DOI":"10.1098\/rstb.2007.2054","article-title":"Cortical mechanisms of action selection: The affordance competition hypothesis.","volume":"362","author":"Cisek","year":"2007","journal-title":"Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences"},{"key":"2021072913183407100_R10","doi-asserted-by":"crossref","first-page":"10972","DOI":"10.1523\/JNEUROSCI.1521-08.2008","article-title":"Lesions of the medial striatum in monkeys produce perseverative impairments during reversal learning similar to those produced by lesions of the orbitofrontal cortex.","volume":"28","author":"Clarke","year":"2008","journal-title":"The Journal of Neuroscience"},{"key":"2021072913183407100_R11","doi-asserted-by":"crossref","first-page":"1286","DOI":"10.1046\/j.1460-9568.2003.02833.x","article-title":"Lesions of mediodorsal thalamus and anterior thalamic nuclei produce dissociable effects on instrumental conditioning in rats.","volume":"18","author":"Corbit","year":"2003","journal-title":"The European Journal of Neuroscience"},{"key":"2021072913183407100_R12","volume-title":"Descartes' error. Emotion, reason and the human brain.","author":"Damasio","year":"1994"},{"key":"2021072913183407100_R13","first-page":"255","article-title":"The role of the amygdala in conditioned fear.","volume-title":"The amygdala: Neurobiological aspects of emotion, memory, and mental dysfunction","author":"Davis","year":"1992","edition":"1st ed."},{"key":"2021072913183407100_R14","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1038\/380069a0","article-title":"Dissociation in prefrontal cortex of affective and attentional shifts.","volume":"380","author":"Dias","year":"1996","journal-title":"Nature"},{"key":"2021072913183407100_R15","first-page":"104","article-title":"Effects of dopaminergic modulation of persistent sodium currents on the excitability of prefrontal cortical neurons: A computational study.","volume":"26","author":"Dilmore","year":"1999","journal-title":"Neurocomputing"},{"key":"2021072913183407100_R16","doi-asserted-by":"crossref","first-page":"311","DOI":"10.1162\/jocn.1995.7.3.311","article-title":"A model of corticostriatal plasticity for learning oculomotor associations and sequences.","volume":"7","author":"Dominey","year":"1995","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913183407100_R17","doi-asserted-by":"crossref","first-page":"1184","DOI":"10.1038\/81460","article-title":"Neurocomputational models of working memory.","volume":"3(Suppl.)","author":"Durstewitz","year":"2000","journal-title":"Nature Neuroscience"},{"key":"2021072913183407100_R18","doi-asserted-by":"crossref","first-page":"178","DOI":"10.1093\/cercor\/bhm044","article-title":"Stop-signal reaction-time task performance: Role of prefrontal cortex and subthalamic nucleus.","volume":"18","author":"Eagle","year":"2008","journal-title":"Cerebral Cortex"},{"key":"2021072913183407100_R19","doi-asserted-by":"crossref","first-page":"308","DOI":"10.1093\/cercor\/10.3.308","article-title":"Dissociable functions in the medial and lateral orbitofrontal cortex: Evidence from human neuroimaging studies.","volume":"10","author":"Elliott","year":"2000","journal-title":"Cerebral Cortex (New York, N.Y.: 1991)"},{"key":"2021072913183407100_R20","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1038\/nn1579","article-title":"Neural systems of reinforcement for drug addiction: From actions to habits to compulsion.","volume":"8","author":"Everitt","year":"2005","journal-title":"Nature Neuroscience"},{"key":"2021072913183407100_R21","doi-asserted-by":"crossref","first-page":"125","DOI":"10.1111\/j.1749-6632.2003.tb07077.x","article-title":"The amygdala fear and memory.","volume":"985","author":"Fanselow","year":"2003","journal-title":"Annals of the New York Academy of Sciences"},{"key":"2021072913183407100_R22","doi-asserted-by":"crossref","first-page":"229","DOI":"10.1016\/S0896-6273(00)80775-8","article-title":"Why we think plasticity underlying Pavlovian fear conditioning occurs in the basolateral amygdala.","volume":"23","author":"Fanselow","year":"1999","journal-title":"Neuron"},{"key":"2021072913183407100_R23","doi-asserted-by":"crossref","first-page":"15","DOI":"10.1016\/S0166-4328(03)00218-3","article-title":"Dorsal striatum and stimulus-response learning: Lesions of the dorsolateral, but not dorsomedial, striatum impair acquisition of a simple discrimination task.","volume":"150","author":"Featherstone","year":"2004","journal-title":"Behavioural Brain Research"},{"key":"2021072913183407100_R24","volume-title":"Functions of the brain.","author":"Ferrier","year":"1886"},{"key":"2021072913183407100_R25","doi-asserted-by":"crossref","first-page":"968","DOI":"10.1038\/nn1103","article-title":"Afferent modulation of dopamine neuron firing differentially regulates tonic and phasic dopamine transmission.","volume":"6","author":"Floresco","year":"2003","journal-title":"Nature Neuroscience"},{"key":"2021072913183407100_R26","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1162\/0898929052880093","article-title":"Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and non-medicated parkinsonism.","volume":"17","author":"Frank","year":"2005","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913183407100_R27","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1037\/0033-295X.113.2.300","article-title":"Anatomy of a decision: Striato-orbitofrontal interactions in reinforcement learning, decision making, and reversal.","volume":"113","author":"Frank","year":"2006","journal-title":"Psychological Review"},{"key":"2021072913183407100_R28","doi-asserted-by":"crossref","first-page":"137","DOI":"10.3758\/CABN.1.2.137","article-title":"Interactions between the frontal cortex and basal ganglia in working memory: A computational model.","volume":"1","author":"Frank","year":"2001","journal-title":"Cognitive, Affective, and Behavioral Neuroscience"},{"key":"2021072913183407100_R29","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1126\/science.1102941","article-title":"By carrot or by stick: Cognitive reinforcement learning in Parkinsonism.","volume":"306","author":"Frank","year":"2004","journal-title":"Science"},{"key":"2021072913183407100_R30","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1016\/S0306-4522(00)00092-0","article-title":"The central nucleus of the amygdala projection to dopamine subpopulations in primates.","volume":"97","author":"Fudge","year":"2000","journal-title":"Neuroscience"},{"key":"2021072913183407100_R31","doi-asserted-by":"crossref","first-page":"S64","DOI":"10.1016\/S1471-1931(00)00019-7","article-title":"Molecular effects of dopamine on striatal-projection pathways.","volume":"23","author":"Gerfen","year":"2001","journal-title":"Trends in Neurosciences"},{"key":"2021072913183407100_R32","doi-asserted-by":"crossref","first-page":"1261","DOI":"10.1016\/S0306-4522(02)00446-3","article-title":"Pathways for emotion: Interactions of prefrontal and anterior temporal pathways in the amygdala of the rhesus monkey.","volume":"115","author":"Ghashghaei","year":"2002","journal-title":"Neuroscience"},{"key":"2021072913183407100_R33","doi-asserted-by":"crossref","first-page":"75","DOI":"10.1152\/jn.2000.84.1.75","article-title":"Dopamine D1\/D5 receptor activation modulates a persistent sodium current in rats prefrontal cortical neurons in vitro.","volume":"84","author":"Gorelova","year":"2000","journal-title":"Journal of Neurophysiology"},{"key":"2021072913183407100_R34","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1126\/science.1087919","article-title":"Encoding predictive reward value in human amygdala and orbitofrontal cortex.","volume":"301","author":"Gottfried","year":"2003","journal-title":"Science (New York, N.Y.)"},{"key":"2021072913183407100_R35","doi-asserted-by":"crossref","first-page":"439","DOI":"10.1111\/j.1749-6632.1999.tb09281.x","article-title":"Functional and anatomical relationships among the amygdala, basal forebrain, ventral striatum, and cortex. An integrative discussion.","volume":"877","author":"Gray","year":"1999","journal-title":"Annals of the New York Academy of Sciences"},{"key":"2021072913183407100_R36","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/PL00007984","article-title":"A computational model of action selection in the basal ganglia: I. A new functional anatomy.","volume":"84","author":"Gurney","year":"2001","journal-title":"Biological Cybernetics"},{"key":"2021072913183407100_R37","doi-asserted-by":"crossref","first-page":"5623","DOI":"10.1523\/JNEUROSCI.1309-08.2008","article-title":"Dissociating the role of the orbitofrontal cortex and the striatum in the computation of goal values and prediction errors.","volume":"28","author":"Hare","year":"2008","journal-title":"The Journal of Neuroscience: The Official Journal of the Society for Neuroscience"},{"key":"2021072913183407100_R38","doi-asserted-by":"crossref","first-page":"5256","DOI":"10.1523\/JNEUROSCI.16-16-05256.1996","article-title":"Neurotoxic lesions of basolateral, but not central, amygdala interfere with Pavlovian second-order conditioning and reinforcer devaluation effects.","volume":"16","author":"Hatfield","year":"1996","journal-title":"Journal of Neuroscience"},{"key":"2021072913183407100_R39","doi-asserted-by":"crossref","first-page":"105","DOI":"10.1016\/j.neuroscience.2005.04.067","article-title":"Banishing the homunculus: Making working memory work.","volume":"139","author":"Hazy","year":"2006","journal-title":"Neuroscience"},{"key":"2021072913183407100_R40","first-page":"105","article-title":"Towards an executive without a homunculus: Computational models of the prefrontal cortex\/basal ganglia system.","volume":"362","author":"Hazy","year":"2007","journal-title":"Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences"},{"key":"2021072913183407100_R41","doi-asserted-by":"crossref","first-page":"701","DOI":"10.1016\/j.neubiorev.2009.11.019","article-title":"Neural mechanisms of acquired phasic dopamine responses in learning.","volume":"34","author":"Hazy","year":"2010","journal-title":"Neuroscience and Biobehavioral Reviews"},{"key":"2021072913183407100_R42","doi-asserted-by":"crossref","first-page":"3334","DOI":"10.1523\/JNEUROSCI.17-09-03334.1997","article-title":"D1 receptor activation enhances evoked discharge in neostriatal medium spiny neurons by modulating an l-type Ca2+ conductance.","volume":"17","author":"Hernandez-Lopez","year":"1997","journal-title":"Journal of Neuroscience"},{"key":"2021072913183407100_R43","doi-asserted-by":"crossref","first-page":"148","DOI":"10.1016\/j.conb.2004.03.007","article-title":"Amygdala-frontal interactions and reward expectancy.","volume":"14","author":"Holland","year":"2004","journal-title":"Current Opinion in Neurobiology"},{"key":"2021072913183407100_R44","first-page":"233","article-title":"A model of how the basal ganglia generate and use neural signals that predict reinforcement.","volume-title":"Models of information processing in the basal ganglia","author":"Houk","year":"1995"},{"key":"2021072913183407100_R45","doi-asserted-by":"crossref","first-page":"1573","DOI":"10.1098\/rstb.2007.2063","article-title":"Action selection and refinement in subcortical loops through basal ganglia and cerebellum.","volume":"362","author":"Houk","year":"2007","journal-title":"Philosophical Transactions of the Royal Society of London, Series B, Biological Sciences"},{"key":"2021072913183407100_R46","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1093\/cercor\/5.2.95","article-title":"Distributed modular architectures linking basal ganglia, cerebellum, and cerebral cortex: Their role in planning and controlling action.","volume":"5","author":"Houk","year":"1995","journal-title":"Cerebral Cortex (New York, N.Y.: 1991)"},{"key":"2021072913183407100_R47","doi-asserted-by":"crossref","first-page":"12921","DOI":"10.1523\/JNEUROSCI.3486-06.2006","article-title":"A physiologically plausible model of action selection and oscillatory activity in the basal ganglia.","volume":"26","author":"Humphries","year":"2006","journal-title":"Journal of Neuroscience"},{"key":"2021072913183407100_R48","doi-asserted-by":"crossref","first-page":"2555","DOI":"10.1152\/jn.1994.72.5.2555","article-title":"Surround inhibition among projection neurons is weak or nonexistent in the rat neostriatum.","volume":"72","author":"Jaeger","year":"1994","journal-title":"Journal of Neurophysiology"},{"key":"2021072913183407100_R49","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/S0306-4522(99)00575-8","article-title":"The connections of the dopaminergic system with the striatum in rats and primates: An analysis with respect to the functional and compartmental organization of the striatum.","volume":"96","author":"Joel","year":"2000","journal-title":"Neuroscience"},{"key":"2021072913183407100_R50","doi-asserted-by":"crossref","first-page":"1683","DOI":"10.1523\/JNEUROSCI.15-03-01683.1995","article-title":"Place and contingency differential responses of monkey septal neurons during conditional place-object discrimination.","volume":"15","author":"Kita","year":"1995","journal-title":"The Journal of Neuroscience: The Official Journal of the Society for Neuroscience"},{"key":"2021072913183407100_R51","first-page":"129","article-title":"Cognitive-emotional interactions: Listen to the brain.","volume-title":"Cognitive neuroscience of emotion","author":"LeDoux","year":"2000"},{"key":"2021072913183407100_R52","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1093\/cercor\/10.12.1168","article-title":"Ventral tegmental area afferents to the prefrontal cortex maintain membrane potential \u201cup\u201d states in pyramidal neurons via d(1) dopamine receptors.","volume":"10","author":"Lewis","year":"2000","journal-title":"Cerebral Cortex (New York, N.Y.: 1991)"},{"key":"2021072913183407100_R53","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1038\/1086","article-title":"A role for nmda-receptor channels in working memory.","volume":"1","author":"Lisman","year":"1999","journal-title":"Nature Neuroscience"},{"key":"2021072913183407100_R54","doi-asserted-by":"crossref","first-page":"503","DOI":"10.1016\/0306-4522(89)90128-0","article-title":"The organization of the projection from the cerebral cortex to the striatum in the rat.","volume":"29","author":"McGeorge","year":"1989","journal-title":"Neuroscience"},{"key":"2021072913183407100_R55","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1006\/brcg.1999.1099","article-title":"Basal ganglia output and cognition: Evidence from anatomical, behavioral, and clinical studies.","volume":"42","author":"Middleton","year":"2000","journal-title":"Brain and Cognition"},{"key":"2021072913183407100_R56","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0301-0082(96)00042-1","article-title":"The basal ganglia: Focused selection and inhibition of competing motor programs.","volume":"50","author":"Mink","year":"1996","journal-title":"Progress in Neurobiology"},{"key":"2021072913183407100_R57","first-page":"219","article-title":"Perseveration of central sets after frontal lesions in monkeys.","volume-title":"The frontal granular cortex and behavior","author":"Mishkin","year":"1964"},{"key":"2021072913183407100_R58","doi-asserted-by":"crossref","first-page":"255","DOI":"10.1002\/dev.10033","article-title":"Active versus latent representations: A neural network model of perseveration and dissociation in early childhood.","volume":"40","author":"Morton","year":"2002","journal-title":"Developmental Psychobiology"},{"key":"2021072913183407100_R59","doi-asserted-by":"crossref","first-page":"489","DOI":"10.1016\/j.tics.2007.08.013","article-title":"The amygdala, reward and emotion.","volume":"11","author":"Murray","year":"2007","journal-title":"Trends in Cognitive Sciences"},{"key":"2021072913183407100_R60","doi-asserted-by":"crossref","first-page":"185","DOI":"10.1146\/annurev.neuro.23.1.185","article-title":"Dopaminergic modulation of neuronal excitability in the striatum and nucleus accumbens.","volume":"23","author":"Nicola","year":"2000","journal-title":"Annual Review of Neuroscience"},{"key":"2021072913183407100_R61","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/s00213-006-0502-4","article-title":"Tonic dopamine: Opportunity costs and the control of response vigor.","volume":"191","author":"Niv","year":"2007","journal-title":"Psychopharmacology"},{"key":"2021072913183407100_R62","doi-asserted-by":"crossref","first-page":"20547","DOI":"10.1073\/pnas.1012246107","article-title":"Separate value comparison and learning mechanisms in macaque medial and lateral orbitofrontal cortex.","volume":"107","author":"Noonan","year":"2010","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021072913183407100_R63","doi-asserted-by":"crossref","first-page":"267","DOI":"10.1007\/BF00275687","article-title":"A simplified neuron model as a principal component analyzer.","volume":"15","author":"Oja","year":"1983","journal-title":"Journal of Mathematical Biology"},{"key":"2021072913183407100_R64","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1002\/cne.10609","article-title":"Architectonic subdivision of the human orbital and medial prefrontal cortex.","volume":"460","author":"Ong\u00fcr","year":"2003","journal-title":"The Journal of Comparative Neurology"},{"key":"2021072913183407100_R65","doi-asserted-by":"crossref","first-page":"206","DOI":"10.1093\/cercor\/10.3.206","article-title":"The organization of networks within the orbital and medial prefrontal cortex of rats, monkeys and humans.","volume":"10","author":"Ong\u00fcr","year":"2000","journal-title":"Cerebral Cortex (New York, N.Y.: 1991)"},{"key":"2021072913183407100_R66","doi-asserted-by":"crossref","first-page":"91","DOI":"10.1126\/science.1127242","article-title":"Biologically based computational models of high-level cognition.","volume":"314","author":"O'Reilly","year":"2006","journal-title":"Science (New York, N.Y.)"},{"key":"2021072913183407100_R67","doi-asserted-by":"crossref","first-page":"895","DOI":"10.1162\/neco.1996.8.5.895","article-title":"Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm.","volume":"8","author":"O'Reilly","year":"1996","journal-title":"Neural Computation"},{"key":"2021072913183407100_R68","unstructured":"O'Reilly, R. C.\n           (1996b). The Leabra model of neural interactions and learning in the neocortex. PhD thesis, Carnegie Mellon University, Pittsburgh, PA."},{"key":"2021072913183407100_R69","doi-asserted-by":"crossref","first-page":"1199","DOI":"10.1162\/08997660152002834","article-title":"Generalization in interactive networks: The benefits of inhibitory competition and Hebbian learning.","volume":"13","author":"O'Reilly","year":"2001","journal-title":"Neural Computation"},{"key":"2021072913183407100_R70","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1162\/089976606775093909","article-title":"Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia.","volume":"18","author":"O'Reilly","year":"2006","journal-title":"Neural Computation"},{"key":"2021072913183407100_R71","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1037\/0735-7044.121.1.31","article-title":"Pvlv: The primary value and learned value Pavlovian learning algorithm.","volume":"121","author":"O'Reilly","year":"2007","journal-title":"Behavioral Neuroscience"},{"key":"2021072913183407100_R72","first-page":"183","article-title":"Discrete representations in working memory: A hypothesis and computational investigations.","volume-title":"The Second International Conference on Cognitive Science","author":"O'Reilly","year":"1999"},{"key":"2021072913183407100_R73","doi-asserted-by":"crossref","DOI":"10.7551\/mitpress\/2014.001.0001","volume-title":"Computational explorations in cognitive neuroscience: Understanding the mind by simulating the brain.","author":"O'Reilly","year":"2000"},{"key":"2021072913183407100_R74","doi-asserted-by":"crossref","first-page":"4819","DOI":"10.1523\/JNEUROSCI.5443-06.2007","article-title":"Orbitofrontal cortex mediates outcome encoding in Pavlovian but not instrumental conditioning.","volume":"27","author":"Ostlund","year":"2007","journal-title":"Journal of Neuroscience"},{"key":"2021072913183407100_R75","doi-asserted-by":"crossref","first-page":"953","DOI":"10.1037\/0735-7044.119.4.953","article-title":"The contribution of nmda receptors in the dorsolateral striatum to egocentric response learning.","volume":"119","author":"Palencia","year":"2005","journal-title":"Behavioral Neuroscience"},{"key":"2021072913183407100_R76","doi-asserted-by":"crossref","first-page":"865","DOI":"10.1038\/nature04490","article-title":"The primate amygdala represents the positive and negative value of visual stimuli during learning.","volume":"439","author":"Paton","year":"2006","journal-title":"Nature"},{"key":"2021072913183407100_R77","first-page":"71","article-title":"Integrating what & how\/where with instrumental and Pavlovian learning: A biologically based computational model.","volume-title":"Cognition and neuropsychology - International perspectives on psychological science","author":"Pauli","year":"2010"},{"key":"2021072913183407100_R78","unstructured":"Pauli, W. M., \n            \n              Hazy, T. E., & \n            \n              O'Reilly, R. C.\n           (2009). Division of labor among multiple parallel cortico - basal ganglia - thalamic loops in Pavlovian and instrumental tasks: A biologically-based computational model, Poster presented at the Multidisciplinary Symposium on Reinforcement Learning."},{"key":"2021072913183407100_R79","doi-asserted-by":"crossref","first-page":"1508","DOI":"10.1093\/cercor\/bhj088","article-title":"Basal ganglia functional connectivity based on a meta-analysis of 126 positron emission tomography and functional magnetic resonance imaging publications.","volume":"16","author":"Postuma","year":"2006","journal-title":"Cerebral Cortex (New York, N.Y.)"},{"key":"2021072913183407100_R80","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1162\/jocn.1995.7.1.1","article-title":"Do rats have prefrontal cortex? The Rose\u2013Woolsey\u2013Akert program reconsidered.","volume":"1","author":"Preuss","year":"1995","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021072913183407100_R81","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1016\/0896-6273(95)90092-6","article-title":"Fear conditioning enhances short-latency auditory responses of lateral amygdala neurons: Parallel recordings in the freely behaving rat.","volume":"15","author":"Quirk","year":"1995","journal-title":"Neuron"},{"key":"2021072913183407100_R82","first-page":"64","article-title":"A theory of Pavlovian conditioning: Variation in the effectiveness of reinforcement and non-reinforcement.","volume-title":"Classical conditioning ii: Theory and research","author":"Rescorla","year":"1972"},{"key":"2021072913183407100_R83","doi-asserted-by":"crossref","first-page":"1433","DOI":"10.1098\/rstb.1996.0128","article-title":"The orbitofrontal cortex.","volume":"351","author":"Rolls","year":"1996","journal-title":"Philosophical Transactions of the Royal Society of London"},{"key":"2021072913183407100_R84","doi-asserted-by":"crossref","first-page":"1982","DOI":"10.1152\/jn.1996.75.5.1982","article-title":"Representation of olfactory information in the primate orbitofrontal cortex.","volume":"75","author":"Rolls","year":"1997","journal-title":"Journal of Neurophysiology"},{"key":"2021072913183407100_R85","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1016\/j.pneurobio.2008.09.001","article-title":"The orbitofrontal cortex and beyond: From affect to decision-making.","volume":"86","author":"Rolls","year":"2008","journal-title":"Progress in Neurobiology"},{"key":"2021072913183407100_R86","doi-asserted-by":"crossref","first-page":"348","DOI":"10.1002\/syn.890210410","article-title":"Effects of electrical stimulation of the central nucleus of the amygdala on the in vivo electrophysiological activity of rat nigral dopaminergic neurons.","volume":"21","author":"Rouillard","year":"1995","journal-title":"Synapse (New York, N.Y.)"},{"key":"2021072913183407100_R87","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.tics.2007.01.004","article-title":"Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour.","volume":"11","author":"Rushworth","year":"2007","journal-title":"Trends in Cognitive Sciences"},{"key":"2021072913183407100_R88","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1038\/nrn2949","article-title":"How does PKM\u03b6 maintain long-term memory?","volume":"12","author":"Sacktor","year":"2011","journal-title":"Nature Reviews"},{"key":"2021072913183407100_R89","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1016\/j.neuron.2005.02.018","article-title":"Rapid associative encoding in basolateral amygdala depends on connections with orbitofrontal cortex.","volume":"46","author":"Saddoris","year":"2005","journal-title":"Neuron"},{"key":"2021072913183407100_R90","doi-asserted-by":"crossref","first-page":"155","DOI":"10.1038\/407","article-title":"Orbitofrontal cortex and basolateral amygdala encode expected outcomes during learning.","volume":"1","author":"Schoenbaum","year":"1998","journal-title":"Nature Neuroscience"},{"key":"2021072913183407100_R91","doi-asserted-by":"crossref","first-page":"1876","DOI":"10.1523\/JNEUROSCI.19-05-01876.1999","article-title":"Neural encoding in orbitofrontal cortex and basolateral amygdala during olfactory discrimination learning.","volume":"19","author":"Schoenbaum","year":"1999","journal-title":"Journal of Neuroscience"},{"key":"2021072913183407100_R92","doi-asserted-by":"crossref","first-page":"633","DOI":"10.1016\/j.neuron.2005.07.018","article-title":"Orbitofrontal cortex, associative learning, and expectancies.","volume":"47","author":"Schoenbaum","year":"2005","journal-title":"Neuron"},{"key":"2021072913183407100_R93","doi-asserted-by":"crossref","first-page":"885","DOI":"10.1038\/nrn2753","article-title":"A new perspective on the role of the orbitofrontal cortex in adaptive behaviour.","volume":"10","author":"Schoenbaum","year":"2009","journal-title":"Nature Reviews"},{"key":"2021072913183407100_R94","doi-asserted-by":"crossref","first-page":"855","DOI":"10.1016\/S0896-6273(03)00474-4","article-title":"Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala.","volume":"39","author":"Schoenbaum","year":"2003","journal-title":"Neuron"},{"key":"2021072913183407100_R95","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1152\/jn.1998.80.1.1","article-title":"Predictive reward signal of dopamine neurons.","volume":"80","author":"Schultz","year":"1998","journal-title":"Journal of Neurophysiology"},{"key":"2021072913183407100_R96","doi-asserted-by":"crossref","first-page":"900","DOI":"10.1523\/JNEUROSCI.13-03-00900.1993","article-title":"Responses of monkey dopamine neurons to reward and conditioned stimuli during successive steps of learning a delayed response task.","volume":"13","author":"Schultz","year":"1993","journal-title":"Journal of Neuroscience"},{"key":"2021072913183407100_R97","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.pneurobio.2004.05.006","article-title":"The principal features and mechanisms of dopamine modulation in the prefrontal cortex.","volume":"74","author":"Seamans","year":"2004","journal-title":"Progress in Neurobiology"},{"key":"2021072913183407100_R98","doi-asserted-by":"crossref","first-page":"387","DOI":"10.1002\/cne.903230307","article-title":"Afferent connections of the laterodorsal and the pedunculopontine tegmental nuclei in the rat: A retro- and antero-grade transport and immunohistochemical study.","volume":"323","author":"Semba","year":"1992","journal-title":"Journal of Comparative Neurology"},{"key":"2021072913183407100_R99","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1126\/science.1160575","article-title":"Dichotomous dopaminergic control of striatal synaptic plasticity.","volume":"321","author":"Shen","year":"2008","journal-title":"Science (New York, N.Y.)"},{"key":"2021072913183407100_R100","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/j.neuron.2007.02.014","article-title":"Basolateral amygdala lesions abolish orbitofrontal-dependent reversal impairments.","volume":"54","author":"Stalnaker","year":"2007","journal-title":"Neuron"},{"key":"2021072913183407100_R101","doi-asserted-by":"crossref","first-page":"2643","DOI":"10.1111\/j.1460-9568.2006.05128.x","article-title":"Abnormal associative encoding in orbitofrontal neurons in cocaine-experienced rats during decision-making.","volume":"24","author":"Stalnaker","year":"2006","journal-title":"The European Journal of Neuroscience"},{"key":"2021072913183407100_R102","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1007\/BF00115009","article-title":"Learning to predict by the method of temporal differences.","volume":"3","author":"Sutton","year":"1988","journal-title":"Machine Learning"},{"key":"2021072913183407100_R103","volume-title":"Reinforcement learning: An introduction.","author":"Sutton","year":"1998"},{"key":"2021072913183407100_R104","doi-asserted-by":"crossref","first-page":"269","DOI":"10.1016\/j.neuron.2009.03.005","article-title":"The orbitofrontal cortex and ventral tegmental area are necessary for learning from unexpected outcomes.","volume":"62","author":"Takahashi","year":"2009","journal-title":"Neuron"},{"key":"2021072913183407100_R105","first-page":"93","article-title":"The orbitofrontal cortex: Neuronal activity in the behaving monkey.","volume":"49","author":"Thorpe","year":"1983","journal-title":"Experimental Brain Research. Experimentelle Hirnforschung. Exprimentation Crbrale"},{"key":"2021072913183407100_R106","doi-asserted-by":"crossref","first-page":"31","DOI":"10.1146\/annurev.neuro.30.051606.094334","article-title":"Orbitofrontal cortex and its contribution to decision-making.","volume":"30","author":"Wallis","year":"2007","journal-title":"Annual Review of Neuroscience"},{"key":"2021072913183407100_R107","doi-asserted-by":"crossref","first-page":"1797","DOI":"10.1046\/j.0953-816x.2001.01546.x","article-title":"Dissociable contributions of the orbitofrontal and lateral prefrontal cortex of the marmoset to performance on a detour reaching task.","volume":"13","author":"Wallis","year":"2001","journal-title":"The European Journal of Neuroscience"},{"key":"2021072913183407100_R108","doi-asserted-by":"crossref","first-page":"9587","DOI":"10.1523\/JNEUROSCI.19-21-09587.1999","article-title":"Synaptic basis of cortical persistent activity: The importance of nmda receptors to working memory.","volume":"19","author":"Wang","year":"1999","journal-title":"The Journal of Neuroscience: The Official Journal of the Society for Neuroscience"},{"key":"2021072913183407100_R109","volume-title":"A theory of the striatum.","author":"Wickens","year":"1993"},{"key":"2021072913183407100_R110","doi-asserted-by":"crossref","first-page":"281","DOI":"10.1002\/syn.890200402","article-title":"Effects of local connectivity on striatal function: Simulation and analysis of a model.","volume":"20","author":"Wickens","year":"1995","journal-title":"Synapse"},{"key":"2021072913183407100_R111","doi-asserted-by":"crossref","first-page":"513","DOI":"10.1111\/j.1460-9568.2005.04218.x","article-title":"The role of the dorsomedial striatum in instrumental conditioning.","volume":"22","author":"Yin","year":"2005","journal-title":"The European Journal of Neuroscience"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/24\/2\/351\/1943435\/jocn_a_00155.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/24\/2\/351\/1943435\/jocn_a_00155.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,29]],"date-time":"2021-07-29T13:29:42Z","timestamp":1627565382000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/24\/2\/351\/27738\/Expectancy-Ambiguity-and-Behavioral-Flexibility"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,2,1]]},"references-count":111,"journal-issue":{"issue":"2","published-online":{"date-parts":[[2012,2,1]]},"published-print":{"date-parts":[[2012,2,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_00155","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2012,2]]},"published":{"date-parts":[[2012,2,1]]}}}