{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T19:22:07Z","timestamp":1762111327764},"reference-count":59,"publisher":"MIT Press - Journals","issue":"5","content-domain":{"domain":["direct.mit.edu"],"crossmark-restriction":true},"short-container-title":[],"published-print":{"date-parts":[[2017,5,1]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>Learning the contingencies between stimulus, action, and outcomes is disrupted in disorders associated with altered dopamine (DA) function in the BG, such as Parkinson disease (PD). Although the role of DA in learning to act has been extensively investigated in PD, the role of DA in \u201clearning to withhold\u201d (or inhibit) action to influence outcomes is not as well understood. The current study investigated the role of DA in learning to act or to withhold action to receive rewarding, or avoid punishing outcomes, in patients with PD tested \u201coff\u201d and \u201con\u201d dopaminergic medication (n = 19) versus healthy controls (n = 30). Participants performed a reward-based learning task that orthogonalized action and outcome valence (action\u2013reward, inaction\u2013reward, action\u2013punishment, inaction\u2013punishment). We tested whether DA would bias learning toward action, toward reward, or to particular action\u2013outcome interactions. All participants demonstrated inherent learning biases preferring action with reward and inaction to avoid punishment, and this was unaffected by medication. Instead, DA produced a complex modulation of learning less natural action\u2013outcome associations. \u201cOff\u201d DA medication, patients demonstrated impairments in learning to withhold action to gain reward, suggesting a difficulty to overcome a bias toward associating inaction with punishment avoidance. On DA medication, these patterns changed, and patients showed a reduced ability to learn to act to avoid punishment, indicating a bias toward action and reward. The current findings suggest that DA in PD has a complex influence on the formation of action\u2013outcome associations, particularly those involving less natural linkages between action and outcome valence.<\/jats:p>","DOI":"10.1162\/jocn_a_01099","type":"journal-article","created":{"date-parts":[[2017,1,27]],"date-time":"2017-01-27T18:21:48Z","timestamp":1485541308000},"page":"816-826","update-policy":"http:\/\/dx.doi.org\/10.1162\/mitpressjournals.corrections.policy","source":"Crossref","is-referenced-by-count":11,"title":["Dopamine Selectively Modulates the Outcome of Learning Unnatural Action\u2013Valence Associations"],"prefix":"10.1162","volume":"29","author":[{"given":"Nelleke C.","family":"Van Wouwe","sequence":"first","affiliation":[]},{"given":"Daniel O.","family":"Claassen","sequence":"additional","affiliation":[]},{"given":"Joseph S.","family":"Neimat","sequence":"additional","affiliation":[]},{"given":"Kristen E.","family":"Kanoff","sequence":"additional","affiliation":[]},{"given":"Scott A.","family":"Wylie","sequence":"additional","affiliation":[]}],"member":"281","published-online":{"date-parts":[[2017,5,1]]},"reference":[{"key":"2021073021072754800_R1","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1146\/annurev.ne.09.030186.002041","article-title":"Parallel organization of functionally segregated circuits linking basal ganglia and cortex","volume":"9","author":"Alexander","year":"1986","journal-title":"Annual Review of Neuroscience"},{"key":"2021073021072754800_R2","doi-asserted-by":"crossref","first-page":"11860","DOI":"10.1523\/JNEUROSCI.3644-07.2007","article-title":"Converging evidence for a fronto-basal-ganglia network for inhibitory control of action and cognition","volume":"27","author":"Aron","year":"2007","journal-title":"Journal of Neuroscience"},{"key":"2021073021072754800_R3","doi-asserted-by":"crossref","first-page":"1747","DOI":"10.1016\/j.celrep.2012.11.014","article-title":"A role for dopamine-mediated learning in the pathophysiology and treatment of Parkinson's disease","volume":"2","author":"Beeler","year":"2012","journal-title":"Cell Reports"},{"key":"2021073021072754800_R4","doi-asserted-by":"crossref","first-page":"2385","DOI":"10.1093\/brain\/awp094","article-title":"Reward-learning and the novelty-seeking personality: A between- and within-subjects study of the effects of dopamine agonists on young Parkinson's patients","volume":"132","author":"B\u00f3di","year":"2009","journal-title":"Brain"},{"key":"2021073021072754800_R5","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1162\/neco.2007.19.2.442","article-title":"The basal ganglia and cortex implement optimal decision making between alternative actions","volume":"19","author":"Bogacz","year":"2007","journal-title":"Neural Computation"},{"key":"2021073021072754800_R6","doi-asserted-by":"crossref","first-page":"542","DOI":"10.1037\/a0018384","article-title":"Adjustments of conflict monitoring in Parkinson's disease","volume":"24","author":"Bonnin","year":"2010","journal-title":"Neuropsychology"},{"key":"2021073021072754800_R7","doi-asserted-by":"crossref","first-page":"8541","DOI":"10.1523\/JNEUROSCI.5754-12.2013","article-title":"Frontal theta overrides Pavlovian learning biases","volume":"33","author":"Cavanagh","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2021073021072754800_R8","doi-asserted-by":"crossref","first-page":"220","DOI":"10.1111\/j.1469-8986.2011.01293.x","article-title":"Theta lingua franca: A common mid-frontal substrate for action monitoring processes","volume":"49","author":"Cavanagh","year":"2012","journal-title":"Psychophysiology"},{"key":"2021073021072754800_R9","doi-asserted-by":"crossref","first-page":"648","DOI":"10.1038\/nn.3364","article-title":"Dopamine restores reward prediction errors in old age","volume":"16","author":"Chowdhury","year":"2013","journal-title":"Nature Neuroscience"},{"key":"2021073021072754800_R10","doi-asserted-by":"crossref","first-page":"2261","DOI":"10.1016\/j.neurobiolaging.2013.03.030","article-title":"Structural integrity of the substantia nigra and subthalamic nucleus predicts flexibility of instrumental learning in older-age individuals","volume":"34","author":"Chowdhury","year":"2013","journal-title":"Neurobiology of Aging"},{"key":"2021073021072754800_R11","doi-asserted-by":"crossref","first-page":"390","DOI":"10.1162\/jocn.2008.21020","article-title":"Oscillatory activity and phase-amplitude coupling in the human medial frontal cortex during decision making","volume":"21","author":"Cohen","year":"2009","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073021072754800_R12","doi-asserted-by":"crossref","first-page":"141","DOI":"10.1016\/j.bbr.2008.09.029","article-title":"Neurocomputational models of basal ganglia function in learning, memory and choice","volume":"199","author":"Cohen","year":"2009","journal-title":"Behavioural Brain Research"},{"key":"2021073021072754800_R13","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.neubiorev.2005.03.024","article-title":"Dopaminergic modulation of cognitive function-implications for L-DOPA treatment in Parkinson's disease","volume":"30","author":"Cools","year":"2006","journal-title":"Neuroscience and Biobehavioral Reviews"},{"key":"2021073021072754800_R14","doi-asserted-by":"crossref","first-page":"1136","DOI":"10.1093\/cercor\/11.12.1136","article-title":"Enhanced or impaired cognitive function in Parkinson's disease as a function of dopaminergic medication and task demands","volume":"11","author":"Cools","year":"2001","journal-title":"Cerebral Cortex"},{"key":"2021073021072754800_R15","doi-asserted-by":"crossref","first-page":"1431","DOI":"10.1016\/S0028-3932(03)00117-9","article-title":"L-Dopa medication remediates cognitive inflexibility, but increases impulsivity in patients with Parkinson's disease","volume":"41","author":"Cools","year":"2003","journal-title":"Neuropsychologia"},{"key":"2021073021072754800_R16","doi-asserted-by":"crossref","first-page":"14331","DOI":"10.1523\/JNEUROSCI.1681-13.2013","article-title":"Dopamine-dependent long-term depression at subthalamo-nigral synapses is lost in experimental Parkinsonism","volume":"33","author":"Dupuis","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2021073021072754800_R17","doi-asserted-by":"crossref","first-page":"556","DOI":"10.1037\/a0033377","article-title":"Dopaminergic medication counteracts conflict adaptation in patients with Parkinson's disease","volume":"27","author":"Duthoo","year":"2013","journal-title":"Neuropsychology"},{"key":"2021073021072754800_R18","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/S0165-0173(01)00088-1","article-title":"The neuropsychological basis of addictive behaviour","volume":"36","author":"Everitt","year":"2001","journal-title":"Brain Research. Brain Research Reviews"},{"key":"2021073021072754800_R19","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1007\/s00221-010-2432-y","article-title":"Impaired conflict monitoring in Parkinson's disease patients during an oculomotor redirect task","volume":"208","author":"Farooqui","year":"2011","journal-title":"Experimental Brain Research"},{"key":"2021073021072754800_R20","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/0022-3956(75)90026-6","article-title":"\u201cMini-mental state.\u201d A practical method for grading the cognitive state of patients for the clinician","volume":"12","author":"Folstein","year":"1975","journal-title":"Journal of Psychiatric Research"},{"key":"2021073021072754800_R21","doi-asserted-by":"crossref","first-page":"9790","DOI":"10.1523\/JNEUROSCI.1465-08.2008","article-title":"Function and structure of the right inferior frontal cortex predict individual differences in response inhibition: A model-based approach","volume":"28","author":"Forstmann","year":"2008","journal-title":"Journal of Neuroscience"},{"key":"2021073021072754800_R22","doi-asserted-by":"crossref","first-page":"370","DOI":"10.1016\/j.neuroimage.2011.12.044","article-title":"Cortico-subthalamic white matter tract strength predicts interindividual efficacy in stopping a motor response","volume":"60","author":"Forstmann","year":"2012","journal-title":"Neuroimage"},{"key":"2021073021072754800_R23","doi-asserted-by":"crossref","first-page":"1854","DOI":"10.1162\/jocn.2008.20122","article-title":"Neural mechanisms, temporal dynamics, and individual differences in interference control","volume":"20","author":"Forstmann","year":"2008","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073021072754800_R24","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1126\/science.1146157","article-title":"Hold your horses: Impulsivity, deep brain stimulation, and medication in Parkinsonism","volume":"318","author":"Frank","year":"2007","journal-title":"Science"},{"key":"2021073021072754800_R25","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1162\/0898929052880093","article-title":"Dynamic dopamine modulation in the basal ganglia: A neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism","volume":"17","author":"Frank","year":"2005","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073021072754800_R26","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.conb.2011.02.013","article-title":"Computational models of motivated action selection in corticostriatal circuits","volume":"21","author":"Frank","year":"2011","journal-title":"Current Opinion in Neurobiology"},{"key":"2021073021072754800_R27","doi-asserted-by":"crossref","first-page":"1940","DOI":"10.1126\/science.1102941","article-title":"By carrot or by stick: Cognitive reinforcement learning in Parkinsonism","volume":"306","author":"Frank","year":"2004","journal-title":"Science"},{"key":"2021073021072754800_R28","doi-asserted-by":"crossref","first-page":"218","DOI":"10.1016\/j.neuropsychologia.2015.01.016","article-title":"Suppressing a motivationally-triggered action tendency engages a response control mechanism that prevents future provocation","volume":"68","author":"Freeman","year":"2015","journal-title":"Neuropsychologia"},{"key":"2021073021072754800_R29","doi-asserted-by":"crossref","first-page":"212","DOI":"10.1016\/j.cub.2013.12.019","article-title":"Top\u2013down response suppression mitigates action tendencies triggered by a motivating stimulus","volume":"24","author":"Freeman","year":"2014","journal-title":"Current Biology"},{"key":"2021073021072754800_R30","doi-asserted-by":"crossref","first-page":"18932","DOI":"10.1523\/JNEUROSCI.2749-13.2013","article-title":"Serotonin and aversive Pavlovian control of instrumental behavior in humans","volume":"33","author":"Geurts","year":"2013","journal-title":"Journal of Neuroscience"},{"key":"2021073021072754800_R31","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1176\/appi.ajp.2011.10071062","article-title":"Disruption in the balance between goal-directed behavior and habit learning in obsessive\u2013compulsive disorder","volume":"168","author":"Gillan","year":"2011","journal-title":"American Journal of Psychiatry"},{"key":"2021073021072754800_R32","doi-asserted-by":"crossref","first-page":"7511","DOI":"10.1073\/pnas.1202229109","article-title":"Action controls dopaminergic enhancement of reward representations","volume":"109","author":"Guitart-Masip","year":"2012","journal-title":"Proceedings of the National Academy of Sciences, U.S.A."},{"key":"2021073021072754800_R33","doi-asserted-by":"crossref","first-page":"955","DOI":"10.1007\/s00213-013-3313-4","article-title":"Differential, but not opponent, effects of L-DOPA and citalopram on action learning with reward and punishment","volume":"231","author":"Guitart-Masip","year":"2014","journal-title":"Psychopharmacology"},{"key":"2021073021072754800_R35","doi-asserted-by":"crossref","first-page":"154","DOI":"10.1016\/j.neuroimage.2012.04.024","article-title":"Go and no-go learning in reward and punishment: Interactions between affect and effect","volume":"62","author":"Guitart-Masip","year":"2012","journal-title":"Neuroimage"},{"key":"2021073021072754800_R61","doi-asserted-by":"crossref","first-page":"427","DOI":"10.1212\/WNL.17.5.427","article-title":"Parkinsonism: Onset, progression and mortality","volume":"17","author":"Hoehn","year":"1967","journal-title":"Neurology"},{"key":"2021073021072754800_R37","doi-asserted-by":"crossref","first-page":"1104","DOI":"10.1002\/mds.25388","article-title":"Selective executive dysfunction but intact risky decision-making in early Huntington's disease","volume":"28","author":"Holl","year":"2013","journal-title":"Movement Disorders"},{"key":"2021073021072754800_R38","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1016\/j.neuroimage.2006.06.012","article-title":"Anterior cingulate and prefrontal cortex activity in an fMRI study of trial-to-trial adjustments on the Simon task","volume":"33","author":"Kerns","year":"2006","journal-title":"Neuroimage"},{"key":"2021073021072754800_R39","first-page":"167","article-title":"Striatal mechanisms underlying movement, reinforcement, and punishment","volume":"27","author":"Kravitz","year":"2012","journal-title":"Physiology (Bethesda)"},{"key":"2021073021072754800_R40","doi-asserted-by":"crossref","first-page":"339","DOI":"10.1016\/S0896-6273(03)00154-5","article-title":"Temporal prediction errors in a passive learning task activate human striatum","volume":"38","author":"McClure","year":"2003","journal-title":"Neuron"},{"key":"2021073021072754800_R41","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/S0301-0082(96)00042-1","article-title":"The basal ganglia: Focused selection and inhibition of competing motor programs","volume":"50","author":"Mink","year":"1996","journal-title":"Progress in Neurobiology"},{"key":"2021073021072754800_R42","doi-asserted-by":"crossref","first-page":"12294","DOI":"10.1523\/JNEUROSCI.3116-08.2008","article-title":"A role for dopamine in temporal decision making and reward maximization in Parkinsonism","volume":"28","author":"Moustafa","year":"2008","journal-title":"Journal of Neuroscience"},{"key":"2021073021072754800_R43","doi-asserted-by":"crossref","first-page":"695","DOI":"10.1111\/j.1532-5415.2005.53221.x","article-title":"The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment","volume":"53","author":"Nasreddine","year":"2005","journal-title":"Journal of the American Geriatrics Society"},{"key":"2021073021072754800_R44","doi-asserted-by":"crossref","first-page":"180","DOI":"10.3389\/fncom.2013.00180","article-title":"Fronto-striatal gray matter contributions to discrimination learning in Parkinson's disease","volume":"7","author":"O'Callaghan","year":"2013","journal-title":"Frontiers in Computational Neuroscience"},{"key":"2021073021072754800_R45","doi-asserted-by":"crossref","first-page":"283","DOI":"10.1162\/089976606775093909","article-title":"Making working memory work: A computational model of learning in the prefrontal cortex and basal ganglia","volume":"18","author":"O'Reilly","year":"2006","journal-title":"Neural Computation"},{"key":"2021073021072754800_R46","doi-asserted-by":"crossref","first-page":"443","DOI":"10.1126\/science.1100301","article-title":"The role of the medial frontal cortex in cognitive control","volume":"306","author":"Ridderinkhof","year":"2004","journal-title":"Science"},{"key":"2021073021072754800_R47","doi-asserted-by":"crossref","first-page":"15104","DOI":"10.1523\/JNEUROSCI.3524-09.2009","article-title":"Dopaminergic drugs modulate learning rates and perseveration in Parkinson's patients in a dynamic foraging task","volume":"29","author":"Rutledge","year":"2009","journal-title":"Journal of Neuroscience"},{"key":"2021073021072754800_R48","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1016\/S0896-6273(02)00967-4","article-title":"Getting formal with dopamine and reward","volume":"36","author":"Schultz","year":"2002","journal-title":"Neuron"},{"key":"2021073021072754800_R49","doi-asserted-by":"crossref","first-page":"848","DOI":"10.1126\/science.1160575","article-title":"Dichotomous dopaminergic control of striatal synaptic plasticity","volume":"321","author":"Shen","year":"2008","journal-title":"Science"},{"key":"2021073021072754800_R50","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1016\/j.neubiorev.2013.11.003","article-title":"From conflict management to reward-based decision making: Actors and critics in primate medial frontal cortex","volume":"46","author":"Silvetti","year":"2014","journal-title":"Neuroscience & Biobehavioral Reviews"},{"key":"2021073021072754800_R51","doi-asserted-by":"crossref","first-page":"596","DOI":"10.1016\/S0028-3932(99)00103-7","article-title":"Probabilistic learning and reversal deficits in patients with Parkinson's disease or frontal or temporal lobe lesions: Possible adverse effects of dopaminergic medication","volume":"38","author":"Swainson","year":"2000","journal-title":"Neuropsychologia"},{"key":"2021073021072754800_R52","doi-asserted-by":"crossref","first-page":"17","DOI":"10.1016\/j.bandc.2015.10.007","article-title":"Easy to learn, hard to suppress: The impact of learned stimulus-outcome associations on subsequent action control","volume":"101","author":"van Wouwe","year":"2015","journal-title":"Brain and Cognition"},{"key":"2021073021072754800_R53","doi-asserted-by":"crossref","first-page":"1541","DOI":"10.1007\/s00415-015-7749-9","article-title":"Deep brain stimulation of the subthalamic nucleus modulates reward processing and action selection in Parkinson patients","volume":"262","author":"Wagenbreth","year":"2015","journal-title":"Journal of Neurology"},{"key":"2021073021072754800_R54","doi-asserted-by":"crossref","first-page":"969","DOI":"10.1001\/archneur.63.7.969","article-title":"Association of dopamine agonist use with impulse control disorders in Parkinson disease","volume":"63","author":"Weintraub","year":"2006","journal-title":"Archives of Neurology"},{"key":"2021073021072754800_R55","doi-asserted-by":"crossref","first-page":"1257","DOI":"10.1001\/archgenpsychiatry.2011.137","article-title":"Reinforcement learning and Gilles de la Tourette syndrome dissociation of clinical phenotypes and pharmacological treatments","volume":"68","author":"Worbe","year":"2011","journal-title":"Archives of General Psychiatry"},{"key":"2021073021072754800_R56","doi-asserted-by":"crossref","first-page":"1709","DOI":"10.1162\/jocn_a_00241","article-title":"Dopamine agonists and the suppression of impulsive motor actions in Parkinson disease","volume":"24","author":"Wylie","year":"2012","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073021072754800_R57","doi-asserted-by":"crossref","first-page":"2058","DOI":"10.1162\/jocn.2009.21326","article-title":"The effect of Parkinson's disease on the dynamics of on-line and proactive cognitive control during action selection","volume":"22","author":"Wylie","year":"2010","journal-title":"Journal of Cognitive Neuroscience"},{"key":"2021073021072754800_R58","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/j.neuropsychologia.2008.08.001","article-title":"The effect of Parkinson's disease on interference control during action selection","volume":"47","author":"Wylie","year":"2009","journal-title":"Neuropsychologia"},{"key":"2021073021072754800_R59","doi-asserted-by":"crossref","first-page":"1844","DOI":"10.1016\/j.neuropsychologia.2009.02.025","article-title":"The effect of speed-accuracy strategy on response interference control in Parkinson's disease","volume":"47","author":"Wylie","year":"2009","journal-title":"Neuropsychologia"},{"key":"2021073021072754800_R60","doi-asserted-by":"crossref","first-page":"931","DOI":"10.1037\/0033-295X.111.4.931","article-title":"The neural basis of error detection: Conflict monitoring and the error-related negativity","volume":"111","author":"Yeung","year":"2004","journal-title":"Psychological Review"}],"container-title":["Journal of Cognitive Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/29\/5\/816\/1952485\/jocn_a_01099.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"http:\/\/direct.mit.edu\/jocn\/article-pdf\/29\/5\/816\/1952485\/jocn_a_01099.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,7,31]],"date-time":"2021-07-31T02:40:01Z","timestamp":1627699201000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/jocn\/article\/29\/5\/816\/28648\/Dopamine-Selectively-Modulates-the-Outcome-of"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,5,1]]},"references-count":59,"journal-issue":{"issue":"5","published-online":{"date-parts":[[2017,5,1]]},"published-print":{"date-parts":[[2017,5,1]]}},"URL":"https:\/\/doi.org\/10.1162\/jocn_a_01099","relation":{},"ISSN":["0898-929X","1530-8898"],"issn-type":[{"value":"0898-929X","type":"print"},{"value":"1530-8898","type":"electronic"}],"subject":[],"published-other":{"date-parts":[[2017,5]]},"published":{"date-parts":[[2017,5,1]]}}}