{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,23]],"date-time":"2026-04-23T17:10:35Z","timestamp":1776964235254,"version":"3.51.4"},"reference-count":75,"publisher":"Springer Science and Business Media LLC","issue":"8","license":[{"start":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T00:00:00Z","timestamp":1652918400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"},{"start":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T00:00:00Z","timestamp":1652918400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.springer.com\/tdm"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Nat Hum Behav"],"DOI":"10.1038\/s41562-022-01346-2","type":"journal-article","created":{"date-parts":[[2022,5,19]],"date-time":"2022-05-19T12:05:03Z","timestamp":1652961903000},"page":"1126-1141","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Explicit knowledge of task structure is a primary determinant of human model-based action"],"prefix":"10.1038","volume":"6","author":[{"given":"Pedro","family":"Castro-Rodrigues","sequence":"first","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1810-0494","authenticated-orcid":false,"given":"Thomas","family":"Akam","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5979-3151","authenticated-orcid":false,"given":"Ivar","family":"Snorasson","sequence":"additional","affiliation":[]},{"given":"Marta","family":"Camacho","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3722-0747","authenticated-orcid":false,"given":"Vitor","family":"Paix\u00e3o","sequence":"additional","affiliation":[]},{"given":"Ana","family":"Maia","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-8558-3126","authenticated-orcid":false,"given":"J. Bernardo","family":"Barahona-Corr\u00eaa","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3476-1839","authenticated-orcid":false,"given":"Peter","family":"Dayan","sequence":"additional","affiliation":[]},{"given":"H. Blair","family":"Simpson","sequence":"additional","affiliation":[]},{"given":"Rui M.","family":"Costa","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5071-3007","authenticated-orcid":false,"given":"Albino J.","family":"Oliveira-Maia","sequence":"additional","affiliation":[]}],"member":"297","published-online":{"date-parts":[[2022,5,19]]},"reference":[{"key":"1346_CR1","first-page":"67","volume":"308","author":"A Dickinson","year":"1985","unstructured":"Dickinson, A. Actions and habits: the development of behavioural autonomy. Phil. Trans. R. Soc. B 308, 67\u201378 (1985).","journal-title":"Phil. Trans. R. Soc. B"},{"key":"1346_CR2","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1037\/0033-2909.119.1.3","volume":"119","author":"SA Sloman","year":"1996","unstructured":"Sloman, S. A. The empirical case for two systems of reasoning. Psychol. Bull. 119, 3\u201322 (1996).","journal-title":"Psychol. Bull."},{"key":"1346_CR3","first-page":"697","volume":"58","author":"D Kahneman","year":"2003","unstructured":"Kahneman, D. A perspective on judgment and choice: mapping bounded rationality. Behav. Sci. 58, 697\u2013720 (2003).","journal-title":"Behav. Sci."},{"key":"1346_CR4","doi-asserted-by":"publisher","first-page":"1704","DOI":"10.1038\/nn1560","volume":"8","author":"ND Daw","year":"2005","unstructured":"Daw, N. D., Niv, Y. & Dayan, P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704\u20131711 (2005).","journal-title":"Nat. Neurosci."},{"key":"1346_CR5","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1016\/j.neuron.2013.09.007","volume":"80","author":"RJ Dolan","year":"2013","unstructured":"Dolan, R. J. & Dayan, P. Goals and habits in the brain. Neuron 80, 312\u2013325 (2013).","journal-title":"Neuron"},{"key":"1346_CR6","doi-asserted-by":"publisher","first-page":"R1200","DOI":"10.1016\/j.cub.2017.09.060","volume":"27","author":"TW Robbins","year":"2017","unstructured":"Robbins, T. W. & Costa, R. M. Habits. Curr. Biol. 27, R1200\u2013R1206 (2017).","journal-title":"Curr. Biol."},{"key":"1346_CR7","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1080\/14640748108400816","volume":"33","author":"CD Adams","year":"1981","unstructured":"Adams, C. D. & Dickinson, A. Instrumental responding following reinforcer devaluation. Q. J. Exp. Psychol. B 33, 109\u2013121 (1981).","journal-title":"Q. J. Exp. Psychol. B"},{"key":"1346_CR8","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1080\/14640748208400878","volume":"34","author":"CD Adams","year":"1982","unstructured":"Adams, C. D. Variations in the sensitivity of instrumental responding to reinforcer devaluation. Q. J. Exp. Psychol. B 34, 77\u201398 (1982).","journal-title":"Q. J. Exp. Psychol. B"},{"key":"1346_CR9","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1037\/0097-7403.11.1.120","volume":"11","author":"RM Colwill","year":"1985","unstructured":"Colwill, R. M. & Rescorla, R. A. Postconditioning devaluation of a reinforcer affects instrumental responding. J. Exp. Psychol. Anim. Behav. Process. 11, 120\u2013132 (1985).","journal-title":"J. Exp. Psychol. Anim. Behav. Process."},{"key":"1346_CR10","unstructured":"Sutton, R. S. & Barto, A. G. Introduction to Reinforcement Learning Vol. 4 (The MIT Press, 1998)."},{"key":"1346_CR11","doi-asserted-by":"publisher","first-page":"1204","DOI":"10.1016\/j.neuron.2011.02.027","volume":"69","author":"ND Daw","year":"2011","unstructured":"Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P. & Dolan, R. J. Model-based influences on humans\u2019 choices and striatal prediction errors. Neuron 69, 1204\u20131215 (2011).","journal-title":"Neuron"},{"key":"1346_CR12","doi-asserted-by":"publisher","unstructured":"Russek, E. M., Momennejad, I., Botvinick, M. M., Gershman, S. J. & Daw, N. D. Predictive representations can link model-based reinforcement learning to model-free mechanisms. PLoS Comput. Biol. https:\/\/doi.org\/10.1371\/journal.pcbi.1005768 (2017).","DOI":"10.1371\/journal.pcbi.1005768"},{"key":"1346_CR13","doi-asserted-by":"publisher","first-page":"687","DOI":"10.1016\/j.neuron.2013.11.028","volume":"81","author":"S Wan Lee","year":"2014","unstructured":"Wan Lee, S., Shimojo, S. & O\u2019Doherty, J. P. Neural computations underlying arbitration between model-based and model-free learning. Neuron 81, 687\u2013699 (2014).","journal-title":"Neuron"},{"key":"1346_CR14","doi-asserted-by":"publisher","first-page":"273","DOI":"10.1126\/science.aac6076","volume":"349","author":"SJ Gershman","year":"2015","unstructured":"Gershman, S. J., Horvitz, E. J. & Tenenbaum, J. B. Computational rationality: a converging paradigm for intelligence in brains, minds, and machines. Science 349, 273\u2013278 (2015).","journal-title":"Science"},{"key":"1346_CR15","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1016\/j.neuron.2010.04.016","volume":"66","author":"J Gl\u00e4scher","year":"2010","unstructured":"Gl\u00e4scher, J., Daw, N., Dayan, P. & O\u2019Doherty, J. P. States versus rewards: dissociable neural prediction error signals underlying model-based and model-free reinforcement learning. Neuron 66, 585\u2013595 (2010).","journal-title":"Neuron"},{"key":"1346_CR16","doi-asserted-by":"publisher","first-page":"786","DOI":"10.1038\/nn.3068","volume":"15","author":"K Wunderlich","year":"2012","unstructured":"Wunderlich, K., Dayan, P. & Dolan, R. J. Mapping value based planning and extensively trained choice in the human brain. Nat. Neurosci. 15, 786\u2013791 (2012).","journal-title":"Nat. Neurosci."},{"key":"1346_CR17","doi-asserted-by":"publisher","first-page":"20941","DOI":"10.1073\/pnas.1312011110","volume":"110","author":"AR Otto","year":"2013","unstructured":"Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A. & Daw, N. D. Working-memory capacity protects model-based learning from stress. Proc. Natl Acad. Sci. USA 110, 20941\u201320946 (2013).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"1346_CR18","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1038\/mp.2015.46","volume":"21","author":"Y Worbe","year":"2016","unstructured":"Worbe, Y. et al. Valence-dependent influence of serotonin depletion on model-based choice strategy. Mol. Psychiatry 21, 624\u2013629 (2016).","journal-title":"Mol. Psychiatry"},{"key":"1346_CR19","doi-asserted-by":"publisher","first-page":"587","DOI":"10.3389\/fnhum.2014.00587","volume":"8","author":"E Friedel","year":"2014","unstructured":"Friedel, E. et al. Devaluation and sequential decisions: linking goal-directed and model-based behavior. Front. Hum. Neurosci. 8, 587 (2014).","journal-title":"Front. Hum. Neurosci."},{"key":"1346_CR20","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1177\/0956797612463080","volume":"24","author":"AR Otto","year":"2013","unstructured":"Otto, A. R., Gershman, S. J., Markman, A. B. & Daw, N. D. The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol. Sci. 24, 751\u2013761 (2013).","journal-title":"Psychol. Sci."},{"key":"1346_CR21","doi-asserted-by":"publisher","first-page":"525","DOI":"10.3389\/fnhum.2013.00525","volume":"7","author":"A Skatova","year":"2013","unstructured":"Skatova, A., Chan, P. A. & Daw, N. D. Extraversion differentiates between model-based and model-free strategies in a reinforcement learning task. Front. Hum. Neurosci. 7, 525 (2013).","journal-title":"Front. Hum. Neurosci."},{"key":"1346_CR22","doi-asserted-by":"publisher","unstructured":"Eppinger, B., Walter, M., Heekeren, H. R. & Li, S. C. Of goals and habits: age-related and individual differences in goal-directed decision-making. Front. Neurosci. https:\/\/doi.org\/10.3389\/fnins.2013.00253 (2013).","DOI":"10.3389\/fnins.2013.00253"},{"key":"1346_CR23","doi-asserted-by":"publisher","first-page":"914","DOI":"10.1016\/j.neuron.2013.08.009","volume":"80","author":"P Smittenaar","year":"2013","unstructured":"Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D. & Dolan, R. J. Disruption of dorsolateral prefrontal cortex decreases model-based in favor of model-free control in humans. Neuron 80, 914\u2013919 (2013).","journal-title":"Neuron"},{"key":"1346_CR24","doi-asserted-by":"publisher","first-page":"1450","DOI":"10.3389\/fpsyg.2014.01450","volume":"5","author":"DJ Schad","year":"2014","unstructured":"Schad, D. J. et al. Processing speed enhances model-based over model-free reinforcement learning in the presence of high working memory functioning. Front. Psychol. 5, 1450 (2014).","journal-title":"Front. Psychol."},{"key":"1346_CR25","doi-asserted-by":"publisher","first-page":"268","DOI":"10.1016\/j.psyneuen.2014.12.017","volume":"53","author":"C Radenbach","year":"2015","unstructured":"Radenbach, C. et al. The interaction of acute and chronic stress impairs model-based behavioral control. Psychoneuroendocrinology 53, 268\u2013280 (2015).","journal-title":"Psychoneuroendocrinology"},{"key":"1346_CR26","doi-asserted-by":"publisher","first-page":"1595","DOI":"10.1073\/pnas.1417219112","volume":"112","author":"L Deserno","year":"2015","unstructured":"Deserno, L. et al. Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making. Proc. Natl Acad. Sci. USA 112, 1595\u20131600 (2015).","journal-title":"Proc. Natl Acad. Sci. USA"},{"key":"1346_CR27","doi-asserted-by":"publisher","first-page":"e1004463","DOI":"10.1371\/journal.pcbi.1004463","volume":"11","author":"M Economides","year":"2015","unstructured":"Economides, M., Kurth-Nelson, Z., L\u00fcbbert, A., Guitart-Masip, M. & Dolan, R. J. Model-based reasoning in humans becomes automatic with training. PLoS Comput. Biol. 11, e1004463 (2015).","journal-title":"PLoS Comput. Biol."},{"key":"1346_CR28","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1159\/000362840","volume":"70","author":"M Sebold","year":"2014","unstructured":"Sebold, M. et al. Model-based and model-free decisions in alcohol dependence. Neuropsychobiology 70, 122\u2013131 (2014).","journal-title":"Neuropsychobiology"},{"key":"1346_CR29","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1038\/mp.2014.44","volume":"20","author":"V Voon","year":"2015","unstructured":"Voon, V. et al. Disorders of compulsivity: a common bias towards learning habits. Mol. Psychiatry 20, 345\u2013352 (2015).","journal-title":"Mol. Psychiatry"},{"key":"1346_CR30","doi-asserted-by":"publisher","DOI":"10.1038\/tp.2015.165","volume":"5","author":"V Voon","year":"2015","unstructured":"Voon, V. et al. Motivation and value influences in the relative balance of goal-directed and habitual behaviours in obsessive-compulsive disorder. Transl. Psychiatry 5, e670 (2015).","journal-title":"Transl. Psychiatry"},{"key":"1346_CR31","doi-asserted-by":"publisher","first-page":"e11305","DOI":"10.7554\/eLife.11305","volume":"5","author":"CM Gillan","year":"2016","unstructured":"Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A. & Daw, N. D. Characterizing a psychiatric symptom dimension related to deficits in goal-directed control. eLife 5, e11305 (2016).","journal-title":"eLife"},{"key":"1346_CR32","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1037\/abn0000164","volume":"125","author":"AJ Culbreth","year":"2016","unstructured":"Culbreth, A. J., Westbrook, A., Daw, N. D., Botvinick, M. & Barch, D. M. Reduced model-based decision-making in schizophrenia. J. Abnorm. Psychol. 125, 777\u2013787 (2016).","journal-title":"J. Abnorm. Psychol."},{"key":"1346_CR33","doi-asserted-by":"publisher","first-page":"1053","DOI":"10.1038\/s41562-020-0905-y","volume":"4","author":"CF da Silva","year":"2020","unstructured":"da Silva, C. F. & Hare, T. Humans primarily use model-based inference in the two-stage task. Nat. Hum. Behav. 4, 1053\u20131066 (2020).","journal-title":"Nat. Hum. Behav."},{"key":"1346_CR34","first-page":"243","volume":"1","author":"A Kaufman","year":"1966","unstructured":"Kaufman, A., Baron, A. & Kopp, R. E. Some effects of instructions on human operant behavior. Psychon. Monogr. Suppl. 1, 243\u2013250 (1966).","journal-title":"Psychon. Monogr. Suppl."},{"key":"1346_CR35","doi-asserted-by":"publisher","unstructured":"Baron, A., Kaufman, A. & Stauber, K. A. Effects of instructions and reinforcement-feedback on human operant behavior maintained by fixed-interval reinforcement. J. Exp. Anal. Behav. https:\/\/doi.org\/10.1901\/jeab.1969.12-701 (1969).","DOI":"10.1901\/jeab.1969.12-701"},{"key":"1346_CR36","first-page":"495","volume":"33","author":"A Baron","year":"1983","unstructured":"Baron, A. & Galizio, M. Instructional control of human operant behavior. Psychol. Rec. 33, 495 (1983).","journal-title":"Psychol. Rec."},{"key":"1346_CR37","doi-asserted-by":"publisher","first-page":"491","DOI":"10.1037\/h0025540","volume":"76","author":"GD Wilson","year":"1968","unstructured":"Wilson, G. D. Reversal of differential GSR conditioning by instructions. J. Exp. Psychol. 76, 491\u2013493 (1968).","journal-title":"J. Exp. Psychol."},{"key":"1346_CR38","doi-asserted-by":"publisher","unstructured":"Atlas, L. Y., Doll, B. B., Li, J., Daw, N. D. & Phelps, E. A. Instructed knowledge shapes feedback-driven aversive learning in striatum and orbitofrontal cortex, but not the amygdala. eLife https:\/\/doi.org\/10.7554\/elife.15192 (2016).","DOI":"10.7554\/elife.15192"},{"key":"1346_CR39","doi-asserted-by":"publisher","first-page":"74","DOI":"10.1016\/j.brainres.2009.07.007","volume":"1299","author":"BB Doll","year":"2009","unstructured":"Doll, B. B., Jacobs, W. J., Sanfey, A. G. & Frank, M. J. Instructional control of reinforcement learning: a behavioral and neurocomputational investigation. Brain Res. 1299, 74\u201394 (2009).","journal-title":"Brain Res."},{"key":"1346_CR40","doi-asserted-by":"publisher","unstructured":"Biele, G., Rieskamp, J. & Gonzalez, R. Computational models for the combination of advice and individual learning. Cogn. Sci. https:\/\/doi.org\/10.1111\/j.1551-6709.2009.01010.x (2009).","DOI":"10.1111\/j.1551-6709.2009.01010.x"},{"key":"1346_CR41","doi-asserted-by":"publisher","unstructured":"Li, J., Delgado, M. R. & Phelps, E. A. How instructed knowledge modulates the neural systems of reward learning. Proc. Natl Acad. Sci. USA https:\/\/doi.org\/10.1073\/pnas.1014938108 (2011).","DOI":"10.1073\/pnas.1014938108"},{"key":"1346_CR42","doi-asserted-by":"publisher","unstructured":"Hertwig, R. & Erev, I. The description\u2013experience gap in risky choice. Trends Cogn. Sci. https:\/\/doi.org\/10.1016\/j.tics.2009.09.004 (2009).","DOI":"10.1016\/j.tics.2009.09.004"},{"key":"1346_CR43","doi-asserted-by":"publisher","first-page":"e1004648","DOI":"10.1371\/journal.pcbi.1004648","volume":"11","author":"T Akam","year":"2015","unstructured":"Akam, T., Costa, R. & Dayan, P. Simple plans or sophisticated habits? State, transition and learning interactions in the two-step task. PLoS Comput. Biol. 11, e1004648 (2015).","journal-title":"PLoS Comput. Biol."},{"key":"1346_CR44","doi-asserted-by":"publisher","first-page":"e1005090","DOI":"10.1371\/journal.pcbi.1005090","volume":"12","author":"W Kool","year":"2016","unstructured":"Kool, W., Cushman, F. A. & Gershman, S. J. When does model-based control pay off? PLoS Comput. Biol. 12, e1005090 (2016).","journal-title":"PLoS Comput. Biol."},{"key":"1346_CR45","doi-asserted-by":"publisher","first-page":"407","DOI":"10.1016\/S0028-3908(98)00033-1","volume":"37","author":"BW Balleine","year":"1998","unstructured":"Balleine, B. W. & Dickinson, A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407\u2013419 (1998).","journal-title":"Neuropharmacology"},{"key":"1346_CR46","doi-asserted-by":"publisher","unstructured":"Bostan, A. C. & Strick, P. L. The basal ganglia and the cerebellum: nodes in an integrated network. Nat. Rev. Neurosci. https:\/\/doi.org\/10.1038\/s41583-018-0002-7 (2018).","DOI":"10.1038\/s41583-018-0002-7"},{"key":"1346_CR47","first-page":"1","volume":"2","author":"EL Thorndike","year":"1898","unstructured":"Thorndike, E. L. Animal intelligence: an experimental study of the associative processes in animals. Psychol. Rev. 2, 1\u2013107 (1898).","journal-title":"Psychol. Rev."},{"key":"1346_CR48","doi-asserted-by":"publisher","unstructured":"Biele, G., Rieskamp, J., Krugel, L. K. & Heekeren, H. R. The neural basis of following advice. PLoS Biol. https:\/\/doi.org\/10.1371\/journal.pbio.1001089 (2011).","DOI":"10.1371\/journal.pbio.1001089"},{"key":"1346_CR49","doi-asserted-by":"publisher","unstructured":"Gillan, C. M. et al. Comparison of the association between goal-directed planning and self-reported compulsivity vs obsessive-compulsive disorder diagnosis. JAMA Psychiatry https:\/\/doi.org\/10.1001\/jamapsychiatry.2019.2998 (2020).","DOI":"10.1001\/jamapsychiatry.2019.2998"},{"key":"1346_CR50","doi-asserted-by":"publisher","unstructured":"Hirschtritt, M. E., Bloch, M. H. & Mathews, C. A. Obsessive-compulsive disorder advances in diagnosis and treatment. J. Am. Med. Assoc. https:\/\/doi.org\/10.1001\/jama.2017.2200 (2017).","DOI":"10.1001\/jama.2017.2200"},{"key":"1346_CR51","doi-asserted-by":"publisher","unstructured":"Wheaton, M. G., Gillan, C. M. & Simpson, H. B. Does cognitive\u2013behavioral therapy affect goal-directed planning in obsessive-compulsive disorder? Psychiatry Res. https:\/\/doi.org\/10.1016\/j.psychres.2018.12.079 (2019).","DOI":"10.1016\/j.psychres.2018.12.079"},{"key":"1346_CR52","doi-asserted-by":"publisher","unstructured":"Shahar, N. et al. Credit assignment to state-independent task representations and its relationship with model-based decision making. Proc. Natl Acad. Sci. USA https:\/\/doi.org\/10.1073\/pnas.1821647116 (2019).","DOI":"10.1073\/pnas.1821647116"},{"key":"1346_CR53","doi-asserted-by":"publisher","unstructured":"Rushworth, M. F. S., Behrens, T. E. J., Rudebeck, P. H. & Walton, M. E. Contrasting roles for cingulate and orbitofrontal cortex in decisions and social behaviour. Trends Cogn. Sci. https:\/\/doi.org\/10.1016\/j.tics.2007.01.004 (2007).","DOI":"10.1016\/j.tics.2007.01.004"},{"key":"1346_CR54","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/j.neuron.2020.10.013","volume":"109","author":"T Akam","year":"2021","unstructured":"Akam, T. et al. The anterior cingulate cortex predicts future states to mediate model-based action selection. Neuron 109, 149\u2013163 (2021).","journal-title":"Neuron"},{"key":"1346_CR55","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-15696-w","volume":"11","author":"A Konovalov","year":"2020","unstructured":"Konovalov, A. & Krajbich, I. Mouse tracking reveals structure knowledge in the absence of model-based choice. Nat. Commun. 11, 1893 (2020).","journal-title":"Nat. Commun."},{"key":"1346_CR56","doi-asserted-by":"publisher","unstructured":"Gershman, S. J. & Uchida, N. Believing in dopamine. Nat. Rev. Neurosci. https:\/\/doi.org\/10.1038\/s41583-019-0220-7 (2019).","DOI":"10.1038\/s41583-019-0220-7"},{"key":"1346_CR57","doi-asserted-by":"publisher","first-page":"211","DOI":"10.1001\/archpsyc.1987.01800150017003","volume":"44","author":"LR Baxter Jr.","year":"1987","unstructured":"Baxter, L. R. Jr. et al. Local cerebral glucose metabolic rates in obsessive-compulsive disorder: a comparison with rates in unipolar depression and in normal controls. Arch. Gen. Psychiatry 44, 211\u2013218 (1987).","journal-title":"Arch. Gen. Psychiatry"},{"key":"1346_CR58","doi-asserted-by":"publisher","first-page":"525","DOI":"10.1016\/j.neubiorev.2007.09.005","volume":"32","author":"L Menzies","year":"2008","unstructured":"Menzies, L. et al. Integrating evidence from neuroimaging and neuropsychological studies of obsessive-compulsive disorder: the orbitofronto-striatal model revisited. Neurosci. Biobehav. Rev. 32, 525\u2013549 (2008).","journal-title":"Neurosci. Biobehav. Rev."},{"key":"1346_CR59","doi-asserted-by":"publisher","unstructured":"Chamberlain, S. R. et al. Orbitofrontal dysfunction in patients with obsessive-compulsive disorder and their unaffected relatives. Science https:\/\/doi.org\/10.1126\/science.1154433 (2008).","DOI":"10.1126\/science.1154433"},{"key":"1346_CR60","doi-asserted-by":"publisher","unstructured":"Schuck, N. W., Cai, M. B., Wilson, R. C. & Niv, Y. Human orbitofrontal cortex represents a cognitive map of state space. Neuron https:\/\/doi.org\/10.1016\/j.neuron.2016.08.019 (2016).","DOI":"10.1016\/j.neuron.2016.08.019"},{"key":"1346_CR61","doi-asserted-by":"publisher","first-page":"4942","DOI":"10.1038\/s41467-021-25123-3","volume":"12","author":"P Piray","year":"2021","unstructured":"Piray, P. & Daw, N. Linear reinforcement learning: flexible reuse of computation in planning, grid fields, and cognitive control. Nat. Commun. 12, 4942 (2021).","journal-title":"Nat. Commun."},{"key":"1346_CR62","doi-asserted-by":"publisher","unstructured":"Collins, A. G. E. & Cockburn, J. Beyond dichotomies in reinforcement learning. Nat. Rev. Neurosci. https:\/\/doi.org\/10.1038\/s41583-020-0355-6 (2020).","DOI":"10.1038\/s41583-020-0355-6"},{"key":"1346_CR63","doi-asserted-by":"publisher","unstructured":"Farashahi, S., Rowe, K., Aslami, Z., Lee, D. & Soltani, A. Feature-based learning improves adaptability without compromising precision. Nat. Commun. https:\/\/doi.org\/10.1038\/s41467-017-01874-w (2017).","DOI":"10.1038\/s41467-017-01874-w"},{"key":"1346_CR64","doi-asserted-by":"publisher","unstructured":"Farashahi, S., Xu, J., Wu, S. W. & Soltani, A. Learning arbitrary stimulus\u2013reward associations for naturalistic stimuli involves transition from learning about features to learning about objects. Cognition https:\/\/doi.org\/10.1016\/j.cognition.2020.104425 (2020).","DOI":"10.1016\/j.cognition.2020.104425"},{"key":"1346_CR65","doi-asserted-by":"publisher","first-page":"232","DOI":"10.1016\/S0924-9338(97)83297-X","volume":"12","author":"DV Sheehan","year":"1997","unstructured":"Sheehan, D. V. et al. The validity of the Mini International Neuropsychiatric Interview (MINI) according to the SCID-P and its reliability. Eur. Psychiatry 12, 232\u2013241 (1997).","journal-title":"Eur. Psychiatry"},{"key":"1346_CR66","unstructured":"First, M. B., Spitzer, R. L., Gibbon, M. & Williams, J. B. W. Structured Clinical Interview for DSM-IV Axis I Disorders (New York State Psychiatric Institute, 2002)."},{"key":"1346_CR67","doi-asserted-by":"publisher","first-page":"1006","DOI":"10.1001\/archpsyc.1989.01810110048007","volume":"46","author":"WK Goodman","year":"1989","unstructured":"Goodman, W. K. et al. The Yale\u2013Brown Obsessive Compulsive Scale: I. Development, use, and reliability. Arch. Gen. Psychiatry 46, 1006\u20131011 (1989).","journal-title":"Arch. Gen. Psychiatry"},{"key":"1346_CR68","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1037\/a0018492","volume":"22","author":"EA Storch","year":"2010","unstructured":"Storch, E. A. et al. Development and psychometric evaluation of the Yale\u2013Brown Obsessive-Compulsive Scale\u2014second edition. Psychol. Assess. 22, 223\u2013232 (2010).","journal-title":"Psychol. Assess."},{"key":"1346_CR69","doi-asserted-by":"crossref","unstructured":"Spielberger, C. Manual for the State-Trait Anxiety Inventory (STAI) (Consulting Psychologists Press, 1983).","DOI":"10.1037\/t06496-000"},{"key":"1346_CR70","doi-asserted-by":"publisher","unstructured":"Castro-Rodrigues, P. et al. Criterion validity of the Yale\u2013Brown Obsessive-Compulsive Scale second edition for diagnosis of obsessive-compulsive disorder in adults. Front. Psychiatry https:\/\/doi.org\/10.3389\/fpsyt.2018.00397 (2018).","DOI":"10.3389\/fpsyt.2018.00397"},{"key":"1346_CR71","doi-asserted-by":"crossref","unstructured":"Beck, A. T., Steer, R. A. & Brown, G. K. Manual for the Beck Depression Inventory-II (Psychological Corporation, 1996).","DOI":"10.1037\/t00742-000"},{"key":"1346_CR72","doi-asserted-by":"publisher","first-page":"317","DOI":"10.1006\/brcg.1998.1039","volume":"38","author":"DB Berch","year":"1998","unstructured":"Berch, D. B., Krikorian, R. & Huha, E. M. The Corsi block-tapping task: methodological and theoretical considerations. Brain Cogn. 38, 317\u2013338 (1998).","journal-title":"Brain Cogn."},{"key":"1346_CR73","doi-asserted-by":"publisher","first-page":"250","DOI":"10.1016\/j.jneumeth.2013.10.024","volume":"222","author":"ST Mueller","year":"2014","unstructured":"Mueller, S. T. & Piper, B. J. The Psychology Experiment Building Language (PEBL) and PEBL Test Battery. J. Neurosci. Methods 222, 250\u2013259 (2014).","journal-title":"J. Neurosci. Methods"},{"key":"1346_CR74","doi-asserted-by":"publisher","unstructured":"Lovibond, S. H. & Lovibond, P. F. Manual for the Depression Anxiety Stress Scales (Psychology Foundation of Australia, 1995); https:\/\/doi.org\/10.1016\/0005-7967(94)00075-U","DOI":"10.1016\/0005-7967(94)00075-U"},{"key":"1346_CR75","doi-asserted-by":"publisher","first-page":"e1002028","DOI":"10.1371\/journal.pcbi.1002028","volume":"7","author":"QJM Huys","year":"2011","unstructured":"Huys, Q. J. M. et al. Disentangling the roles of approach, activation and valence in instrumental and Pavlovian responding. PLoS Comput. Biol. 7, e1002028 (2011).","journal-title":"PLoS Comput. Biol."}],"container-title":["Nature Human Behaviour"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41562-022-01346-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41562-022-01346-2","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41562-022-01346-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,11,24]],"date-time":"2022-11-24T16:21:28Z","timestamp":1669306888000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41562-022-01346-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,5,19]]},"references-count":75,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2022,8]]}},"alternative-id":["1346"],"URL":"https:\/\/doi.org\/10.1038\/s41562-022-01346-2","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.09.06.20189241","asserted-by":"object"}]},"ISSN":["2397-3374"],"issn-type":[{"value":"2397-3374","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,5,19]]},"assertion":[{"value":"11 September 2020","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 March 2022","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"31 March 2022","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"19 May 2022","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"J.B.B.-C. received honoraria from Janssen-Cilag, Ltd, as a member of a local Advisory Board. H.B.S. has received research support for an industry-sponsored clinical trial from Biohaven Pharmaceuticals, royalties from UpToDate Inc. and a stipend from the American Medical Association for her role as Associate Editor of <i>JAMA Psychiatry<\/i>. A.J.O.-M. was the national coordinator for Portugal of a non-interventional study (EDMS-ERI-143085581, 4.0) to characterize a Treatment-Resistant Depression Cohort in Europe, sponsored by Janssen-Cilag, Ltd (2019\u20132020) and of a trial of psilocybin therapy for treatment-resistant depression, sponsored by Compass Pathways, Ltd (EudraCT nos. 2017-003288-36; 2020\u20132021); is recipient of a grant from Schuhfried GmBH for norming and validation of cognitive tests; and is national coordinator for Portugal of a trial of esketamine for treatment-resistant depression, sponsored by Janssen-Cilag, Ltd (EudraCT no. 2019-002992-33). The remaining authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}]}}