{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,9]],"date-time":"2026-06-09T08:02:02Z","timestamp":1780992122969,"version":"3.54.1"},"reference-count":62,"publisher":"Society for Neuroscience","issue":"17","license":[{"start":{"date-parts":[[2022,10,27]],"date-time":"2022-10-27T00:00:00Z","timestamp":1666828800000},"content-version":"vor","delay-in-days":225,"URL":"https:\/\/creativecommons.org\/licenses\/by-nc-sa\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["FL0992409"],"award-info":[{"award-number":["FL0992409"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["FT100100260"],"award-info":[{"award-number":["FT100100260"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000925","name":"Department of Health | National Health and Medical Research Council","doi-asserted-by":"publisher","award":["GNT1175420"],"award-info":[{"award-number":["GNT1175420"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000925","name":"Department of Health | National Health and Medical Research Council","doi-asserted-by":"publisher","award":["GNT1069487"],"award-info":[{"award-number":["GNT1069487"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100000925","name":"Department of Health | National Health and Medical Research Council","doi-asserted-by":"publisher","award":["GNT1122842"],"award-info":[{"award-number":["GNT1122842"]}],"id":[{"id":"10.13039\/501100000925","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["J. Neurosci."],"published-print":{"date-parts":[[2022,4,27]]},"abstract":"<jats:p>From an associative perspective the acquisition of new goal-directed actions requires the encoding of specific action-outcome (AO) associations and, therefore, sensitivity to the validity of an action as a predictor of a specific outcome relative to other events. Although competitive architectures have been proposed within associative learning theory to achieve this kind of identity-based selection, whether and how these architectures are implemented by the brain is still a matter of conjecture. To investigate this issue, we trained human participants to encode various AO associations while undergoing functional neuroimaging (fMRI). We then degraded one AO contingency by increasing the probability of the outcome in the absence of its associated action while keeping other AO contingencies intact. We found that this treatment selectively reduced performance of the degraded action. Furthermore, when a signal predicted the unpaired outcome, performance of the action was restored, suggesting that the degradation effect reflects competition between the action and the context for prediction of the specific outcome. We used a Kalman filter to model the contribution of different causal variables to AO learning and found that activity in the medial prefrontal cortex (mPFC) and the dorsal anterior cingulate cortex (dACC) tracked changes in the association of the action and context, respectively, with regard to the specific outcome. Furthermore, we found the mPFC participated in a network with the striatum and posterior parietal cortex to segregate the influence of the various competing predictors to establish specific AO associations.<\/jats:p><jats:p><jats:bold>SIGNIFICANCE STATEMENT<\/jats:bold>Humans and other animals learn the consequences of their actions, allowing them to control their environment in a goal-directed manner. Nevertheless, it is unknown how we parse environmental causes from the effects of our own actions to establish these specific action-outcome (AO) relationships. Here, we show that the brain learns the causal structure of the environment by segregating the unique influence of actions from other causes in the medial prefrontal and anterior cingulate cortices and, through a network of structures, including the caudate nucleus and posterior parietal cortex, establishes the distinct causal relationships from which specific AO associations are formed.<\/jats:p>","DOI":"10.1523\/jneurosci.1079-21.2022","type":"journal-article","created":{"date-parts":[[2022,3,16]],"date-time":"2022-03-16T17:50:26Z","timestamp":1647453026000},"page":"3636-3647","source":"Crossref","is-referenced-by-count":24,"title":["The Neural Bases of Action-Outcome Learning in Humans"],"prefix":"10.1523","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-5018-1239","authenticated-orcid":false,"given":"Richard W.","family":"Morris","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Amir","family":"Dezfouli","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kristi R.","family":"Griffiths","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mike E.","family":"Le Pelley","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8618-7950","authenticated-orcid":false,"given":"Bernard W.","family":"Balleine","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"393","published-online":{"date-parts":[[2022,3,16]]},"reference":[{"key":"2023041803513690000_42.17.3636.1","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2921"},{"key":"2023041803513690000_42.17.3636.2","doi-asserted-by":"publisher","DOI":"10.1111\/tops.12307"},{"key":"2023041803513690000_42.17.3636.3","doi-asserted-by":"publisher","DOI":"10.3758\/BF03334492"},{"key":"2023041803513690000_42.17.3636.4","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2019.09.024"},{"key":"2023041803513690000_42.17.3636.5","doi-asserted-by":"publisher","DOI":"10.1016\/S0028-3908(98)00033-1"},{"key":"2023041803513690000_42.17.3636.6","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2009.131"},{"key":"2023041803513690000_42.17.3636.7","doi-asserted-by":"publisher","DOI":"10.1037\/\/0033-295X.104.2.367"},{"key":"2023041803513690000_42.17.3636.8","doi-asserted-by":"crossref","unstructured":"Cheng PW , Buehner M (2012) Causal learning. In: Oxford handbook of thinking and reasoning ( Holyoak KJ , Morrison RG , eds), pp 210\u2013233. New York: Oxford University Press.","DOI":"10.1093\/oxfordhb\/9780199734689.013.0012"},{"key":"2023041803513690000_42.17.3636.9","doi-asserted-by":"crossref","first-page":"55","DOI":"10.1016\/S0079-7421(08)60016-X","article-title":"Associative structures in instrumental learning","volume":"20","author":"Colwill","year":"1986","journal-title":"Psychol Learn Motiv"},{"key":"2023041803513690000_42.17.3636.10","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2003.09.023"},{"key":"2023041803513690000_42.17.3636.11","first-page":"977","article-title":"Model uncertainty in classical conditioning","volume":"16","author":"Courville","year":"2003","journal-title":"Adv Neural Inf Process Syst"},{"key":"2023041803513690000_42.17.3636.12","doi-asserted-by":"crossref","first-page":"294","DOI":"10.1016\/j.tics.2006.05.004","article-title":"The Pearce\u2013Hall model","volume":"7","author":"Courville","year":"2006","journal-title":"Trends Cogn Sci"},{"key":"2023041803513690000_42.17.3636.13","doi-asserted-by":"publisher","DOI":"10.31234\/osf.io\/c83kx"},{"key":"2023041803513690000_42.17.3636.14","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2009.11.062"},{"key":"2023041803513690000_42.17.3636.15","doi-asserted-by":"crossref","unstructured":"Daw ND (2011) Trial-by-trial data analysis using computational models. In: Decision making, affect, and learning: attention and performance XXIII ( Delgado MR , Phelps EA , Robbins TW , eds), pp 3\u201338. New York: Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780199600434.003.0001"},{"key":"2023041803513690000_42.17.3636.16","first-page":"369","article-title":"The rat as particle filter","volume":"20","author":"Daw","year":"2007","journal-title":"Advances in Neural Information Processing Systems"},{"key":"2023041803513690000_42.17.3636.17","doi-asserted-by":"publisher","DOI":"10.1038\/81504"},{"key":"2023041803513690000_42.17.3636.18","doi-asserted-by":"publisher","DOI":"10.1126\/science.1171203"},{"key":"2023041803513690000_42.17.3636.19","doi-asserted-by":"publisher","DOI":"10.1080\/14640748508401177"},{"key":"2023041803513690000_42.17.3636.20","doi-asserted-by":"publisher","DOI":"10.1016\/0376-6357(89)90039-9"},{"key":"2023041803513690000_42.17.3636.21","doi-asserted-by":"publisher","DOI":"10.1080\/713932614"},{"key":"2023041803513690000_42.17.3636.22","doi-asserted-by":"publisher","DOI":"10.1016\/j.conb.2012.08.003"},{"key":"2023041803513690000_42.17.3636.23","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2012.12.002"},{"key":"2023041803513690000_42.17.3636.24","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1004567"},{"key":"2023041803513690000_42.17.3636.25","doi-asserted-by":"publisher","DOI":"10.1038\/s41583-019-0220-7"},{"key":"2023041803513690000_42.17.3636.26","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2010.04.016"},{"key":"2023041803513690000_42.17.3636.27","doi-asserted-by":"publisher","DOI":"10.3389\/fnsys.2014.00101"},{"key":"2023041803513690000_42.17.3636.28","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.21397"},{"key":"2023041803513690000_42.17.3636.29","doi-asserted-by":"publisher","DOI":"10.1901\/jeab.1980.34-297"},{"key":"2023041803513690000_42.17.3636.30","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.psych.121208.131634"},{"key":"2023041803513690000_42.17.3636.31","doi-asserted-by":"publisher","DOI":"10.1002\/wcs.80"},{"key":"2023041803513690000_42.17.3636.32","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.1513619112"},{"key":"2023041803513690000_42.17.3636.33","doi-asserted-by":"publisher","DOI":"10.3758\/LB.36.3.210"},{"key":"2023041803513690000_42.17.3636.34","doi-asserted-by":"publisher","DOI":"10.1016\/j.cub.2015.02.044"},{"key":"2023041803513690000_42.17.3636.35","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3354-10.2011"},{"key":"2023041803513690000_42.17.3636.36","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms5390"},{"key":"2023041803513690000_42.17.3636.37","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2007.07.061"},{"key":"2023041803513690000_42.17.3636.38","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0126255"},{"key":"2023041803513690000_42.17.3636.39","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1234-09.2009"},{"key":"2023041803513690000_42.17.3636.40","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropsychologia.2018.01.021"},{"key":"2023041803513690000_42.17.3636.41","doi-asserted-by":"publisher","DOI":"10.1126\/science.1094285"},{"key":"2023041803513690000_42.17.3636.42","doi-asserted-by":"publisher","DOI":"10.1146\/annurev-psych-010416-044216"},{"key":"2023041803513690000_42.17.3636.43","doi-asserted-by":"crossref","unstructured":"Pearl J (2009) Causality: models, reasoning, and inference, Ed 2. New York: Cambridge University Press.","DOI":"10.1017\/CBO9780511803161"},{"key":"2023041803513690000_42.17.3636.44","doi-asserted-by":"publisher","DOI":"10.1016\/j.jneumeth.2006.11.017"},{"key":"2023041803513690000_42.17.3636.45","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.11.010.2008"},{"key":"2023041803513690000_42.17.3636.46","doi-asserted-by":"publisher","DOI":"10.1037\/rev0000201"},{"key":"2023041803513690000_42.17.3636.47","doi-asserted-by":"publisher","DOI":"10.1038\/nature05051"},{"key":"2023041803513690000_42.17.3636.48","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/awx105"},{"key":"2023041803513690000_42.17.3636.49","unstructured":"Rescorla RA , Wagner AR (1972) A theory of Pavlovian conditioning: variations in the effectiveness of reinforcement and nonreinforcement. In: Classical conditioning II ( Black AH , Prokasy WF , eds), pp 64\u201399. New York: Appleton-Century-Crofts."},{"key":"2023041803513690000_42.17.3636.50","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2013.08.065"},{"key":"2023041803513690000_42.17.3636.51","doi-asserted-by":"publisher","DOI":"10.3758\/BF03197139"},{"key":"2023041803513690000_42.17.3636.52","doi-asserted-by":"publisher","DOI":"10.1111\/j.2044-8295.1993.tb02486.x"},{"key":"2023041803513690000_42.17.3636.53","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroimage.2009.03.025"},{"key":"2023041803513690000_42.17.3636.54","doi-asserted-by":"publisher","DOI":"10.1207\/s15516709cog2703_6"},{"key":"2023041803513690000_42.17.3636.55","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1808-08.2008"},{"key":"2023041803513690000_42.17.3636.56","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00762.2005"},{"key":"2023041803513690000_42.17.3636.57","unstructured":"Vallee-Tourangeau F , Murphy RA (1999) Action-effect contingency judgment tasks foster normative causal reasoning. Proceedings of the twenty first annual conference of the cognitive science society ( Hahn M , Stones SC , eds), pp 820\u2013820). New York: Lawrence Erlbaum Associates."},{"key":"2023041803513690000_42.17.3636.58","first-page":"177","article-title":"Contiguity and the outcome density bias in action-outcome contingency judgements","volume":"58","author":"Vallee-Tourangeau","year":"2005","journal-title":"Q J Exp Psychol B"},{"key":"2023041803513690000_42.17.3636.59","doi-asserted-by":"publisher","DOI":"10.1006\/lmot.1994.1008"},{"key":"2023041803513690000_42.17.3636.60","doi-asserted-by":"publisher","DOI":"10.1016\/0023-9690(83)90025-5"},{"key":"2023041803513690000_42.17.3636.61","doi-asserted-by":"publisher","DOI":"10.1037\/0278-7393.19.1.174"},{"key":"2023041803513690000_42.17.3636.62","unstructured":"Watkins CJCH (1989) Learning from delayed rewards. PhD thesis, University of Cambridge."}],"container-title":["The Journal of Neuroscience"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1523\/JNEUROSCI.1079-21.2022","content-type":"unspecified","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/syndication.highwire.org\/content\/doi\/10.1523\/JNEUROSCI.1079-21.2022","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,4,18]],"date-time":"2023-04-18T12:53:50Z","timestamp":1681822430000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.jneurosci.org\/lookup\/doi\/10.1523\/JNEUROSCI.1079-21.2022"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,16]]},"references-count":62,"journal-issue":{"issue":"17","published-online":{"date-parts":[[2022,4,27]]},"published-print":{"date-parts":[[2022,4,27]]}},"alternative-id":["10.1523\/JNEUROSCI.1079-21.2022"],"URL":"https:\/\/doi.org\/10.1523\/jneurosci.1079-21.2022","relation":{},"ISSN":["0270-6474","1529-2401"],"issn-type":[{"value":"0270-6474","type":"print"},{"value":"1529-2401","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,16]]}}}