{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,6]],"date-time":"2026-06-06T11:57:40Z","timestamp":1780747060977,"version":"3.54.1"},"reference-count":61,"publisher":"Frontiers Media SA","license":[{"start":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T00:00:00Z","timestamp":1671494400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["frontiersin.org"],"crossmark-restriction":true},"short-container-title":["Front. Neuroinform."],"abstract":"<jats:p>Reinforcement learning depends upon the integrity of emotional circuitry to establish associations between environmental cues, decisions, and positive or negative outcomes in order to guide behavior through experience. The emotional dysregulation characteristic of major depressive disorder (MDD) may alter activity in frontal and limbic structures that are key to learning. Although reward and decision-making have been examined in MDD, the effects of depression on associative learning is less well studied. We investigated whether depressive symptoms would be related to abnormalities in learning-related brain activity as measured by functional magnetic resonance imaging (fMRI). Also, we explored whether melancholic and atypical features were associated with altered brain activity. We conducted MRI scans on a 4T Varian MRI system in 10 individuals with MDD and 10 healthy subjects. We examined event-related brain activation during feedback-based learning task using Analysis of Functional NeuroImages (AFNI) for image processing and statistical analysis. We observed that MDD patients exhibited reduced activation in visual cortex but increased activation in cingulate and insular regions compared to healthy participants. Also, in relation to features of depressive subtypes, we observed that levels of activation in striatal, thalamic, and precuneus regions were negatively correlated with atypical characteristics. These results suggest that the effects of MDD change the neural circuitry underlying associative learning, and these effects may depend upon subtype features of MDD.<\/jats:p>","DOI":"10.3389\/fninf.2022.1028121","type":"journal-article","created":{"date-parts":[[2022,12,20]],"date-time":"2022-12-20T05:33:01Z","timestamp":1671514381000},"update-policy":"https:\/\/doi.org\/10.3389\/crossmark-policy","source":"Crossref","is-referenced-by-count":8,"title":["Functional MRI study of feedback-based reinforcement learning in depression"],"prefix":"10.3389","volume":"16","author":[{"given":"Almira M.","family":"Kustubayeva","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Erik B.","family":"Nelson","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Michael L.","family":"Smith","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jane B.","family":"Allendorfer","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"James C.","family":"Eliassen","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1965","published-online":{"date-parts":[[2022,12,20]]},"reference":[{"key":"B1","doi-asserted-by":"publisher","first-page":"93","DOI":"10.1016\/j.copsyc.2014.12.017","article-title":"Frontal EEG asymmetry as a promising marker of depression vulnerability: Summary and methodological considerations","volume":"4","author":"Allen","year":"2015","journal-title":"Curr. Opin. Psychol"},{"key":"B2","year":"2000","journal-title":"Diagnostic and statistical manual of mental disorders"},{"key":"B3","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1192\/bjp.178.3.200","article-title":"Cognitive deficits in depression: Possible implications for functional neuropathology.","volume":"178","author":"Austin","year":"2001","journal-title":"Br. J. Psychiatry"},{"key":"B4","doi-asserted-by":"publisher","first-page":"73","DOI":"10.1017\/S0033291798007788","article-title":"Melancholic depression: A pattern of frontal cognitive impairment.","volume":"29","author":"Austin","year":"1999","journal-title":"Psychol. Med."},{"key":"B5","doi-asserted-by":"publisher","first-page":"126","DOI":"10.1016\/j.jad.2011.07.015","article-title":"Meta-review of depressive subtyping models.","volume":"139","author":"Baumeister","year":"2011","journal-title":"J. Affect. Disord."},{"key":"B6","doi-asserted-by":"publisher","first-page":"843","DOI":"10.1097\/01.wnr.0000220132.32091.9f","article-title":"Dysfunction in the neural circuitry of emotional self-regulation in major depressive disorder.","volume":"17","author":"Beauregard","year":"2006","journal-title":"Neuroreport"},{"key":"B7","doi-asserted-by":"publisher","first-page":"143","DOI":"10.2307\/1511272","article-title":"Stress, depression and suicide among students with learning disabilities: Assessing the risk.","volume":"22","author":"Bender","year":"1999","journal-title":"Learn. Disabil. Q."},{"key":"B8","doi-asserted-by":"publisher","first-page":"1113","DOI":"10.1001\/jamapsychiatry.2021.1844","article-title":"Reinforcement learning disruptions in individuals with depression and sensitivity to symptom change following cognitive behavioral therapy.","volume":"78","author":"Brown","year":"2021","journal-title":"JAMA Psychiatry"},{"key":"B9","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1016\/j.neubiorev.2008.09.002","article-title":"Default-mode brain dysfunction in mental disorders: A systematic review.","volume":"33","author":"Broyd","year":"2009","journal-title":"Neurosci. Biobehav. Rev."},{"key":"B10","doi-asserted-by":"publisher","first-page":"178","DOI":"10.1016\/j.neubiorev.2017.04.021","article-title":"Right brain, left brain in depressive disorders: Clinical and theoretical implications of behavioral, electrophysiological and neuroimaging findings","volume":"78","author":"Bruder","year":"2017","journal-title":"Neurosci. Biobehav. Rev"},{"key":"B11","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1016\/j.neubiorev.2015.05.005","article-title":"Reinforcement learning in depression: A review of computational research.","volume":"12","author":"Chen","year":"2015","journal-title":"Neurosci. Biobehav. Rev."},{"key":"B12","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1016\/j.tics.2010.06.007","article-title":"Cognitive theory and therapy of anxiety and depression: Convergence with neurobiological findings.","volume":"14","author":"Clark","year":"2010","journal-title":"Trends Cogn. Sci."},{"key":"B13","doi-asserted-by":"publisher","first-page":"162","DOI":"10.1006\/cbmr.1996.0014","article-title":"AFNI: Software for analysis and visualization of functional magnetic resonance neuroimages.","volume":"29","author":"Cox","year":"1996","journal-title":"Comput. Biomed. Res."},{"key":"B14","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1002\/(SICI)1099-1492(199706\/08)10:4\/5<171::AID-NBM453>3.0.CO;2-L","article-title":"Software tools for analysis and visualization of fMRI data.","volume":"10","author":"Cox","year":"1997","journal-title":"NMR Biomed."},{"key":"B15","doi-asserted-by":"publisher","first-page":"1014","DOI":"10.1002\/(SICI)1522-2594(199912)42:6<1014::AID-MRM4>3.0.CO;2-F","article-title":"Real-time 3D image registration for functional MRI.","volume":"42","author":"Cox","year":"1999","journal-title":"Magn. Res. Med."},{"key":"B16","doi-asserted-by":"publisher","first-page":"607","DOI":"10.1017\/S0048577298000134","article-title":"Anterior electrophysiological asymmetries, emotion, and depression: Conceptual and methodological conundrums","volume":"35","author":"Davidson","year":"1998","journal-title":"Psychophysiology"},{"key":"B17","doi-asserted-by":"publisher","first-page":"1204","DOI":"10.1016\/j.neuron.2011.02.027","article-title":"Model-based influences on humans\u2019 choices and striatal prediction errors.","volume":"69","author":"Daw","year":"2011","journal-title":"Neuron"},{"key":"B18","doi-asserted-by":"publisher","first-page":"141","DOI":"10.1016\/j.jad.2015.01.061","article-title":"Cognitive and emotional biomarkers of melancholic depression: An iSPOT-D report.","volume":"176","author":"Day","year":"2015","journal-title":"J. Affect. Disord."},{"key":"B19","doi-asserted-by":"publisher","first-page":"768","DOI":"10.1136\/jnnp.55.9.768","article-title":"Regional cerebral blood flow abnormalities in depressed patients with cognitive impairment.","volume":"55","author":"Dolan","year":"1992","journal-title":"J. Neurol. Neurosurg. Psychiatry"},{"key":"B20","doi-asserted-by":"publisher","first-page":"56","DOI":"10.1016\/j.brainres.2012.04.010","article-title":"Selective role for striatal and prefrontal regions in processing first trial feedback during single-trial associative learning.","volume":"1458","author":"Eliassen","year":"2012","journal-title":"Brain Res."},{"key":"B21","doi-asserted-by":"publisher","first-page":"10540","DOI":"10.1523\/JNEUROSCI.23-33-10540.2003","article-title":"Experience-dependent activation patterns in human brain during visual\u2013motor associative learning.","volume":"23","author":"Eliassen","year":"2003","journal-title":"J. Neurosci."},{"key":"B22","doi-asserted-by":"publisher","first-page":"931","DOI":"10.1017\/S0033291797005187","article-title":"Prefrontal dysfunction in depressed patients performing a planning task: A study using positron emission tomography.","volume":"27","author":"Elliott","year":"1997","journal-title":"Psychol. Med."},{"key":"B23","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1017\/S0033291798006709","article-title":"Abnormal neural response to feedback on planning and guessing tasks in patients with unipolar depression.","volume":"28","author":"Elliott","year":"1998","journal-title":"Psychol. Med."},{"key":"B24","author":"First","year":"2002","journal-title":"Structured clinical interview for DSM-IV-TR axis I disorders, research version, patient edition (SCID-I\/P)."},{"key":"B25","doi-asserted-by":"publisher","first-page":"64","DOI":"10.1176\/appi.ajp.2008.07081336","article-title":"Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder.","volume":"166","author":"Forbes","year":"2009","journal-title":"Am. J. Psychiatry"},{"key":"B26","doi-asserted-by":"publisher","first-page":"636","DOI":"10.1002\/mrm.1910330508","article-title":"Improved assessment of significant activation in functional magnetic resonance imaging (fMRI): Use of a cluster-size threshold.","volume":"33","author":"Forman","year":"1995","journal-title":"Magn. Reson. Med."},{"key":"B27","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.neuroimage.2014.06.058","article-title":"Reward dysfunction in major depression: Multimodal neuroimaging evidence for refining the melancholic phenotype.","volume":"101","author":"Foti","year":"2014","journal-title":"Neuroimage"},{"key":"B28","doi-asserted-by":"publisher","first-page":"537","DOI":"10.1016\/j.pnpbp.2004.01.006","article-title":"The relationship of regional cerebral blood flow with subtypes of major depression.","volume":"28","author":"Fountoulakis","year":"2004","journal-title":"Prog. Neuropsychopharmacol. Biol. Psychiatry"},{"key":"B29","doi-asserted-by":"publisher","first-page":"210","DOI":"10.1002\/hbm.460010306","article-title":"Assessing the significance of focal activations using their spatial extent.","volume":"1","author":"Friston","year":"1993","journal-title":"Hum. Brain Mapp."},{"key":"B30","doi-asserted-by":"publisher","first-page":"2442","DOI":"10.1523\/JNEUROSCI.2084-17.2018","article-title":"Dynamic flexibility in striatal-cortical circuits supports reinforcement learning.","volume":"38","author":"Gerraty","year":"2018","journal-title":"J. Neurosci."},{"key":"B31","doi-asserted-by":"publisher","first-page":"429","DOI":"10.1016\/j.biopsych.2006.09.020","article-title":"Resting-state functional connectivity in major depression: Abnormally increased contributions from subgenual cingulated cortex and thalamus.","volume":"62","author":"Greicius","year":"2007","journal-title":"Biol. Psychiatry"},{"key":"B32","doi-asserted-by":"publisher","first-page":"587","DOI":"10.1080\/01688639708403745","article-title":"A preliminary profile of neuropsychological deficits associated with major depression.","volume":"19","author":"Hans","year":"1997","journal-title":"J. Clin. Exp. Neuropsychol."},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1009003","article-title":"Effects of subclinical depression on prefrontal-striatal model-based and model-free learning.","volume":"17","author":"Heo","year":"2021","journal-title":"PLoS Comput. Biol."},{"key":"B34","doi-asserted-by":"publisher","first-page":"8877","DOI":"10.1523\/JNEUROSCI.2063-07.2007","article-title":"Failure to regulate: Counterproductive recruitment of top-down prefrontal-subcortical circuitry in major depression.","volume":"33","author":"Johnstone","year":"2007","journal-title":"J. Neurosci."},{"key":"B35","doi-asserted-by":"publisher","first-page":"26","DOI":"10.1097\/YCO.0000000000000378","article-title":"Cognitive dysfunction in major depressive disorder.","volume":"31","author":"Knight","year":"2018","journal-title":"Curr. Opin. Psychiatry"},{"key":"B36","doi-asserted-by":"publisher","first-page":"686","DOI":"10.1016\/j.biopsych.2007.07.023","article-title":"Neural responses to monetary incentives in major depression.","volume":"63","author":"Knutson","year":"2008","journal-title":"Biol. Psychiatry"},{"key":"B37","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1016\/S0006-3223(02)01785-7","article-title":"Neural abnormalities during cognitive generation of affect in treatment resistant depression.","volume":"54","author":"Kumari","year":"2003","journal-title":"Biol. Psychiatry"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.3390\/sym12122118","article-title":"Major depression and brain asymmetry in a decision-making task with negative and positive feedback.","volume":"12","author":"Kustubayeva","year":"2020","journal-title":"Symmetry"},{"key":"B39","doi-asserted-by":"publisher","first-page":"529","DOI":"10.1007\/s11031-011-9270-5","article-title":"Emotion and information search in tactical decision-making: Moderator effects of feedback.","volume":"36","author":"Kustubayeva","year":"2012","journal-title":"Motiv. Emot."},{"key":"B40","doi-asserted-by":"publisher","first-page":"5675","DOI":"10.1073\/pnas.89.12.5675","article-title":"Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation.","volume":"89","author":"Kwong","year":"1992","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"B41","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1002\/1097-0193(200007)10:3<120::AID-HBM30>3.0.CO;2-8","article-title":"Automated Talairach atlas labels for functional brain mapping.","volume":"10","author":"Lancaster","year":"2000","journal-title":"Hum. Brain Mapp."},{"key":"B42","doi-asserted-by":"publisher","first-page":"308","DOI":"10.1002\/mrm.1910340305","article-title":"High contrast and fast three-dimensional magnetic resonance imaging at high fields.","volume":"34","author":"Lee","year":"1995","journal-title":"Magn. Reson. Med."},{"key":"B43","doi-asserted-by":"publisher","first-page":"118","DOI":"10.1016\/j.psyneuen.2014.01.006","article-title":"Associations between depressive symptoms and memory deficits vary as a function of insulin-like growth factor (IGF-1) levels in healthy older adults.","volume":"42","author":"Lin","year":"2014","journal-title":"Psychoneuroendocrinology"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0038115","article-title":"Real-time self-regulation of emotion networks in patients with depression.","volume":"7","author":"Linden","year":"2012","journal-title":"PLoS One"},{"key":"B45","doi-asserted-by":"publisher","first-page":"471","DOI":"10.1176\/jnp.9.3.471","article-title":"Limbic-cortical dysregulation: A proposed model of depression.","volume":"9","author":"Mayberg","year":"1997","journal-title":"J. Neuropsychiatry Clin. Neurosci."},{"key":"B46","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1093\/bmb\/65.1.193","article-title":"Modulating dysfunctional limbic-cortical circuits in depression: Towards development of brain-based algorithms for diagnosis and optimised treatment.","volume":"65","author":"Mayberg","year":"2003","journal-title":"Br. Med. Bull."},{"key":"B47","doi-asserted-by":"publisher","first-page":"5951","DOI":"10.1073\/pnas.89.13.5951","article-title":"Intrinsic signal changes accompanying sensory stimulation: Functional brain mapping with magnetic resonance imaging.","volume":"89","author":"Ogawa","year":"1992","journal-title":"Proc. Natl. Acad. Sci. U.S.A."},{"key":"B48","doi-asserted-by":"publisher","first-page":"634","DOI":"10.1007\/s11920-012-0322-7","article-title":"Where in the brain is depression?","volume":"14","author":"Pandya","year":"2012","journal-title":"Curr. Psyhiatry Rep."},{"key":"B49","doi-asserted-by":"publisher","first-page":"1503","DOI":"10.1017\/S0033291708005072","article-title":"Differential frontal-striatal and paralimbic activity during reversal learning in major depressive disorder and obsessive-compulsive disorder.","volume":"39","author":"Remijnse","year":"2009","journal-title":"Psychol. Med."},{"key":"B50","doi-asserted-by":"publisher","first-page":"217","DOI":"10.1068\/p5117","article-title":"Revisiting Snodgrass and Vanderwart\u2019s object pictorial set: The role of surface detail in basic-level object recognition.","volume":"33","author":"Rossion","year":"2004","journal-title":"Perception"},{"key":"B51","doi-asserted-by":"publisher","first-page":"974","DOI":"10.1016\/j.biopsych.2006.03.024","article-title":"Event-related functional magnetic resonance imaging measures of neural activity to positive social stimuli in pre- and post-treatment depression.","volume":"60","author":"Schaefer","year":"2006","journal-title":"Biol. Psychiatry"},{"key":"B52","doi-asserted-by":"publisher","first-page":"535","DOI":"10.1109\/42.929619","article-title":"Simultaneous correction of ghost and geometric distortion artifacts in EPI using a multiecho reference scan.","volume":"20","author":"Schmithorst","year":"2001","journal-title":"IEEE Trans. Med. Imaging"},{"key":"B53","doi-asserted-by":"publisher","first-page":"69","DOI":"10.1016\/j.jad.2009.01.034","article-title":"fMRI of alterations in reward selection, anticipation, and feedback in major depressive disorder.","volume":"118","author":"Smoski","year":"2009","journal-title":"J. Affect. Disord."},{"key":"B54","doi-asserted-by":"publisher","first-page":"263","DOI":"10.1016\/j.pscychresns.2011.06.012","article-title":"Major depressive disorder is characterized by greater reward network activation to monetary than pleasant image rewards.","volume":"194","author":"Smoski","year":"2011","journal-title":"Psychiatry Res."},{"key":"B55","doi-asserted-by":"publisher","first-page":"81","DOI":"10.1037\/a0028727","article-title":"Major depressive disorder is associated with broad impairments on neuropsychological measures of executive function: A meta-analysis and review.","volume":"139","author":"Snyder","year":"2013","journal-title":"Psychol. Bull."},{"key":"B56","author":"Spitzer","year":"1990","journal-title":"Structured clinical interview for DSM-IV personality disorders (SCID-II)."},{"key":"B57","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1006\/nimg.2001.0978","article-title":"Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain.","volume":"15","author":"Tzourio-Mazoyer","year":"2002","journal-title":"Neuroimage"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.3389\/fpsyt.2020.538333","article-title":"Enhanced functional connectivity within executive function network in remitted or partially remitted MDD patients.","volume":"28","author":"Wang","year":"2021","journal-title":"Front. Psychiatry"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1037\/0021-843X.90.3.187","article-title":"Memory failures in idiopathic dementia.","volume":"90","author":"Weingartner","year":"1981","journal-title":"J. Abnorm. Psychol."},{"key":"B60","doi-asserted-by":"publisher","first-page":"287","DOI":"10.1002\/hbm.460030404","article-title":"Clustered pixels analysis for functional MRI activation studies of the human brain.","volume":"3","author":"Xiong","year":"1995","journal-title":"Hum. Brain Mapp."},{"key":"B61","doi-asserted-by":"publisher","first-page":"531","DOI":"10.1016\/j.jad.2013.06.039","article-title":"The neural correlates of reward-related processing in major depressive disorder: A meta-analysis of functional magnetic resonance imaging studies.","volume":"151","author":"Zhang","year":"2013","journal-title":"J. Affect. Disord."}],"updated-by":[{"DOI":"10.3389\/fninf.2023.1175847","type":"corrigendum","label":"Corrigendum","source":"publisher","updated":{"date-parts":[[2023,3,21]],"date-time":"2023-03-21T00:00:00Z","timestamp":1679356800000}}],"container-title":["Frontiers in Neuroinformatics"],"original-title":[],"link":[{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2022.1028121\/full","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,3,20]],"date-time":"2023-03-20T10:01:39Z","timestamp":1679306499000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.frontiersin.org\/articles\/10.3389\/fninf.2022.1028121\/full"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,12,20]]},"references-count":61,"alternative-id":["10.3389\/fninf.2022.1028121"],"URL":"https:\/\/doi.org\/10.3389\/fninf.2022.1028121","relation":{"corrigendum":[{"id-type":"doi","id":"10.3389\/fninf.2023.1175847","asserted-by":"object"}]},"ISSN":["1662-5196"],"issn-type":[{"value":"1662-5196","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,20]]},"article-number":"1028121"}}