{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,9,27]],"date-time":"2026-09-27T13:32:08Z","timestamp":1790515928352,"version":"4.1.0"},"reference-count":88,"publisher":"eLife Sciences Publications, Ltd","license":[{"start":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T00:00:00Z","timestamp":1626134400000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T00:00:00Z","timestamp":1626134400000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"},{"start":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T00:00:00Z","timestamp":1626134400000},"content-version":"tdm","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100002241","name":"Japan Science and Technology Agency","doi-asserted-by":"publisher","award":["JPMJER1801"],"award-info":[{"award-number":["JPMJER1801"]}],"id":[{"id":"10.13039\/501100002241","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100009619","name":"Japan Agency for Medical Research and Development","doi-asserted-by":"publisher","award":["JP18dm0307008"],"award-info":[{"award-number":["JP18dm0307008"]}],"id":[{"id":"10.13039\/100009619","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Chilean National Agency for Research and Development","award":["72180193"],"award-info":[{"award-number":["72180193"]}]},{"DOI":"10.13039\/100004440","name":"Wellcome Trust","doi-asserted-by":"publisher","award":["102612\/A\/13\/Z"],"award-info":[{"award-number":["102612\/A\/13\/Z"]}],"id":[{"id":"10.13039\/100004440","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["elifesciences.org"],"crossmark-restriction":false},"short-container-title":[],"abstract":"<jats:p>The human brain excels at constructing and using abstractions, such as rules, or concepts. Here, in two fMRI experiments, we demonstrate a mechanism of abstraction built upon the valuation of sensory features. Human volunteers learned novel association rules based on simple visual features. Reinforcement-learning algorithms revealed that, with learning, high-value abstract representations increasingly guided participant behaviour, resulting in better choices and higher subjective confidence. We also found that the brain area computing value signals \u2013 the ventromedial prefrontal cortex \u2013 prioritised and selected latent task elements during abstraction, both locally and through its connection to the visual cortex. Such a coding scheme predicts a causal role for valuation. Hence, in a second experiment, we used multivoxel neural reinforcement to test for the causality of feature valuation in the sensory cortex, as a mechanism of abstraction. Tagging the neural representation of a task feature with rewards evoked abstraction-based decisions. Together, these findings provide a novel interpretation of value as a goal-dependent, key factor in forging abstract representations.<\/jats:p>","DOI":"10.7554\/elife.68943","type":"journal-article","created":{"date-parts":[[2021,7,13]],"date-time":"2021-07-13T08:00:20Z","timestamp":1626163220000},"update-policy":"https:\/\/doi.org\/10.7554\/elife.68943","source":"Crossref","is-referenced-by-count":29,"title":["Value signals guide abstraction during learning"],"prefix":"10.7554","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-4567-0924","authenticated-orcid":true,"given":"Aurelio","family":"Cortese","sequence":"first","affiliation":[{"name":"Computational Neuroscience Labs, ATR Institute International, Kyoto, Japan"},{"name":"Institute of Cognitive Neuroscience, University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Asuka","family":"Yamamoto","sequence":"additional","affiliation":[{"name":"Computational Neuroscience Labs, ATR Institute International, Kyoto, Japan"},{"name":"School of Information Science, Nara Institute of Science and Technology, Nara, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Maryam","family":"Hashemzadeh","sequence":"additional","affiliation":[{"name":"Department of Computing Science, University of Alberta, Edmonton, Canada"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0159-6777","authenticated-orcid":true,"given":"Pradyumna","family":"Sepulveda","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Neuroscience, University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Mitsuo","family":"Kawato","sequence":"additional","affiliation":[{"name":"Computational Neuroscience Labs, ATR Institute International, Kyoto, Japan"},{"name":"RIKEN Center for Artificial Intelligence Project, Kyoto, Japan"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3555-2732","authenticated-orcid":true,"given":"Benedetto","family":"De Martino","sequence":"additional","affiliation":[{"name":"Institute of Cognitive Neuroscience, University College London, London, United Kingdom"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"4374","published-online":{"date-parts":[[2021,7,13]]},"reference":[{"key":"bib1","doi-asserted-by":"publisher","first-page":"1096","DOI":"10.1523\/JNEUROSCI.3159-15.2016","article-title":"Neural Mechanisms of Credit Assignment in a Multicue Environment","volume":"36","author":"Akaishi","year":"2016","journal-title":"Journal of Neuroscience"},{"key":"bib2","doi-asserted-by":"publisher","first-page":"266","DOI":"10.1016\/0166-2236(90)90107-l","article-title":"Functional architecture of basal ganglia circuits: neural substrates of parallel processing","volume":"13","author":"Alexander","year":"1990","journal-title":"Trends in Neurosciences"},{"key":"bib3","doi-asserted-by":"publisher","first-page":"10367","DOI":"10.1073\/pnas.1104047108","article-title":"Value-driven attentional capture","volume":"108","author":"Anderson","year":"2011","journal-title":"PNAS"},{"key":"bib4","doi-asserted-by":"publisher","first-page":"527","DOI":"10.1093\/cercor\/bhr117","article-title":"Mechanisms of hierarchical reinforcement learning in cortico-striatal circuits 2: evidence from fMRI","volume":"22","author":"Badre","year":"2012","journal-title":"Cerebral Cortex"},{"key":"bib5","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1038\/s41586-020-2704-z","article-title":"Value-guided remapping of sensory cortex by lateral orbitofrontal cortex","volume":"585","author":"Banerjee","year":"2020","journal-title":"Nature"},{"key":"bib6","doi-asserted-by":"publisher","first-page":"1545","DOI":"10.1093\/cercor\/bhv352","article-title":"Direct recordings from human anterior insula reveal its leading role within the Error-Monitoring network","volume":"27","author":"Bastin","year":"2017","journal-title":"Cerebral Cortex"},{"key":"bib7","volume-title":"Dynamic Programming","author":"Bellman","year":"1957"},{"key":"bib8","doi-asserted-by":"publisher","first-page":"1929","DOI":"10.1093\/cercor\/bhn222","article-title":"The representation of abstract task rules in the human prefrontal cortex","volume":"19","author":"Bengtsson","year":"2009","journal-title":"Cerebral Cortex"},{"key":"bib9","doi-asserted-by":"publisher","first-page":"16550","DOI":"10.1073\/pnas.1419274111","article-title":"Ventromedial prefrontal cortex supports affective future simulation by integrating distributed knowledge","volume":"111","author":"Benoit","year":"2014","journal-title":"PNAS"},{"key":"bib10","doi-asserted-by":"publisher","first-page":"954","DOI":"10.1016\/j.cell.2020.09.031","article-title":"The geometry of abstraction in the Hippocampus and prefrontal cortex","volume":"183","author":"Bernardi","year":"2020","journal-title":"Cell"},{"key":"bib11","doi-asserted-by":"publisher","first-page":"2605","DOI":"10.1523\/JNEUROSCI.2811-17.2018","article-title":"Abstract memory representations in the ventromedial prefrontal cortex and Hippocampus support concept generalization","volume":"38","author":"Bowman","year":"2018","journal-title":"The Journal of Neuroscience"},{"key":"bib12","doi-asserted-by":"publisher","first-page":"747","DOI":"10.1126\/science.280.5364.747","article-title":"Anterior cingulate cortex, error detection, and the online monitoring of performance","volume":"280","author":"Carter","year":"1998","journal-title":"Science"},{"key":"bib13","doi-asserted-by":"publisher","DOI":"10.1126\/sciadv.abd5363","article-title":"How usefulness shapes neural representations during goal-directed behavior","volume":"7","author":"Castegnetti","year":"2021","journal-title":"Science Advances"},{"key":"bib14","doi-asserted-by":"publisher","first-page":"1464","DOI":"10.1126\/science.aaf0941","article-title":"Organizing conceptual knowledge in humans with a gridlike code","volume":"352","author":"Constantinescu","year":"2016","journal-title":"Science"},{"key":"bib15","doi-asserted-by":"publisher","DOI":"10.1038\/ncomms13669","article-title":"Multivoxel neurofeedback selectively modulates confidence without changing perceptual performance","volume":"7","author":"Cortese","year":"2016","journal-title":"Nature Communications"},{"key":"bib16","doi-asserted-by":"publisher","first-page":"323","DOI":"10.1016\/j.neuroimage.2017.01.069","article-title":"Decoded fMRI neurofeedback can induce bidirectional confidence changes within single participants","volume":"149","author":"Cortese","year":"2017","journal-title":"NeuroImage"},{"key":"bib17","doi-asserted-by":"publisher","first-page":"133","DOI":"10.1016\/j.conb.2019.02.011","article-title":"The neural and cognitive architecture for learning from a small sample","volume":"55","author":"Cortese","year":"2019","journal-title":"Current Opinion in Neurobiology"},{"key":"bib18","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-17828-8","article-title":"Unconscious reinforcement learning of hidden brain states supported by confidence","volume":"11","author":"Cortese","year":"2020","journal-title":"Nature Communications"},{"key":"bib19","article-title":"Cortese_et_al_2021","volume-title":"Software Heritage","author":"Cortese","year":"2021","unstructured":"Cortese A, Yamamoto A, Hashemzadeh M, Sepulveda P. 2021. Cortese_et_al_2021. Software Heritage. swh:1:rev:3ac5090fe0af132364bbf92b9b0dff95919d60ee. https:\/\/archive.softwareheritage.org\/swh:1:dir:88d680896aa54dc52629f4274001a6e529fb78fc;origin=https:\/\/github.com\/BDMLab\/Cortese_et_al_2021;visit=swh:1:snp:d5176536817595f8ae3061e468585b773abc696a;anchor=swh:1:rev:3ac5090fe0af132364bbf92b9b0dff95919d60ee."},{"key":"bib20","doi-asserted-by":"publisher","first-page":"105","DOI":"10.1038\/nn.3279","article-title":"Confidence in value-based choice","volume":"16","author":"De Martino","year":"2013","journal-title":"Nature Neuroscience"},{"key":"bib21","doi-asserted-by":"publisher","first-page":"585","DOI":"10.1093\/cercor\/bhw396","article-title":"The Neuro-Computational architecture of Value-Based selection in the human brain","volume":"28","author":"Domenech","year":"2018","journal-title":"Cerebral Cortex"},{"key":"bib22","doi-asserted-by":"publisher","first-page":"1481","DOI":"10.1126\/science.1252254","article-title":"Human cognition. Foundations of human reasoning in the prefrontal cortex","volume":"344","author":"Donoso","year":"2014","journal-title":"Science"},{"key":"bib23","doi-asserted-by":"publisher","first-page":"1347","DOI":"10.1162\/089976602753712972","article-title":"Multiple model-based reinforcement learning","volume":"14","author":"Doya","year":"2002","journal-title":"Neural Computation"},{"key":"bib24","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-017-01874-w","article-title":"Feature-based learning improves adaptability without compromising precision","volume":"8","author":"Farashahi","year":"2017","journal-title":"Nature Communications"},{"key":"bib25","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0015710","article-title":"Multiplexed echo planar imaging for sub-second whole brain FMRI and fast diffusion imaging","volume":"5","author":"Feinberg","year":"2010","journal-title":"PLOS ONE"},{"key":"bib26","doi-asserted-by":"publisher","first-page":"509","DOI":"10.1093\/cercor\/bhr114","article-title":"Mechanisms of hierarchical reinforcement learning in corticostriatal circuits 1: computational analysis","volume":"22","author":"Frank","year":"2012","journal-title":"Cerebral Cortex"},{"key":"bib27","doi-asserted-by":"publisher","first-page":"218","DOI":"10.1006\/nimg.1997.0291","article-title":"Psychophysiological and modulatory interactions in neuroimaging","volume":"6","author":"Friston","year":"1997","journal-title":"NeuroImage"},{"key":"bib28","doi-asserted-by":"publisher","DOI":"10.7554\/eLife.38293","article-title":"Human VMPFC encodes early signatures of confidence in perceptual decisions","volume":"7","author":"Gherman","year":"2018","journal-title":"eLife"},{"key":"bib29","doi-asserted-by":"publisher","first-page":"618","DOI":"10.1016\/j.tics.2017.04.013","article-title":"Neurobiology of Schemas and Schema-Mediated Memory","volume":"21","author":"Gilboa","year":"2017","journal-title":"Trends in Cognitive Sciences"},{"key":"bib30","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/j.neuroimage.2015.04.004","article-title":"Spatial attention enhances object coding in local and distributed representations of the lateral occipital complex","volume":"116","author":"Guggenmos","year":"2015","journal-title":"NeuroImage"},{"key":"bib31","doi-asserted-by":"publisher","first-page":"1242","DOI":"10.1016\/j.neunet.2006.06.007","article-title":"Heterarchical reinforcement-learning model for integration of multiple cortico-striatal loops: fMRI examination in stimulus-action-reward association learning","volume":"19","author":"Haruno","year":"2006","journal-title":"Neural Networks"},{"key":"bib32","doi-asserted-by":"publisher","first-page":"1635","DOI":"10.1109\/TNNLS.2018.2869978","article-title":"Exploiting generalization in the subspaces for faster Model-Based reinforcement learning","volume":"30","author":"Hashemzadeh","year":"2019","journal-title":"IEEE Transactions on Neural Networks and Learning Systems"},{"key":"bib33","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1016\/j.jneumeth.2014.10.023","article-title":"An empirical solution for over-pruning with a novel ensemble-learning method for fMRI decoding","volume":"239","author":"Hirose","year":"2015","journal-title":"Journal of Neuroscience Methods"},{"key":"bib34","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/j.cobeha.2019.05.001","article-title":"The value of abstraction","volume":"29","author":"Ho","year":"2019","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"bib35","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1162\/neco.1991.3.1.79","article-title":"Adaptive mixtures of local experts","volume":"3","author":"Jacobs","year":"1991","journal-title":"Neural Computation"},{"key":"bib36","doi-asserted-by":"publisher","first-page":"679","DOI":"10.1038\/nn1444","article-title":"Decoding the visual and subjective contents of the human brain","volume":"8","author":"Kamitani","year":"2005","journal-title":"Nature Neuroscience"},{"key":"bib37","doi-asserted-by":"publisher","first-page":"205","DOI":"10.1016\/j.conb.2007.03.004","article-title":"Efficient reinforcement learning: computational theories, neuroscience and robotics","volume":"17","author":"Kawato","year":"2007","journal-title":"Current Opinion in Neurobiology"},{"key":"bib38","doi-asserted-by":"publisher","first-page":"552","DOI":"10.1016\/j.cell.2020.01.014","article-title":"Constant Sub-second cycling between representations of possible futures in the Hippocampus","volume":"180","author":"Kay","year":"2020","journal-title":"Cell"},{"key":"bib39","doi-asserted-by":"publisher","first-page":"4806","DOI":"10.1523\/JNEUROSCI.0642-05.2005","article-title":"Distributed neural representation of expected value","volume":"25","author":"Knutson","year":"2005","journal-title":"Journal of Neuroscience"},{"key":"bib40","doi-asserted-by":"publisher","first-page":"13061","DOI":"10.1073\/pnas.1820145116","article-title":"Common neural code for reward and information value","volume":"116","author":"Kobayashi","year":"2019","journal-title":"PNAS"},{"key":"bib41","doi-asserted-by":"publisher","DOI":"10.1038\/s41562-016-0006","article-title":"Fear reduction without fear through reinforcement of neural activity that bypasses conscious exposure","volume":"1","author":"Koizumi","year":"2016","journal-title":"Nature Human Behaviour"},{"key":"bib42","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.cobeha.2018.11.005","article-title":"On the necessity of abstraction","volume":"29","author":"Konidaris","year":"2019","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"bib43","doi-asserted-by":"publisher","first-page":"457","DOI":"10.1016\/j.tics.2014.05.008","article-title":"Attention as an effect not a cause","volume":"18","author":"Krauzlis","year":"2014","journal-title":"Trends in Cognitive Sciences"},{"key":"bib44","doi-asserted-by":"publisher","first-page":"889","DOI":"10.1016\/j.neuron.2009.07.030","article-title":"Tracking the emergence of conceptual knowledge during human decision making","volume":"63","author":"Kumaran","year":"2009","journal-title":"Neuron"},{"key":"bib45","doi-asserted-by":"publisher","first-page":"1159","DOI":"10.1038\/nn.4064","article-title":"Automatic integration of confidence in the brain valuation signal","volume":"18","author":"Lebreton","year":"2015","journal-title":"Nature Neuroscience"},{"key":"bib46","doi-asserted-by":"publisher","first-page":"897","DOI":"10.1038\/s41562-019-0681-8","article-title":"Assessing inter-individual differences with task-related functional neuroimaging","volume":"3","author":"Lebreton","year":"2019","journal-title":"Nature Human Behaviour"},{"key":"bib47","doi-asserted-by":"publisher","first-page":"127","DOI":"10.1016\/j.conb.2020.03.004","article-title":"Parallel processing streams in the hippocampus","volume":"64","author":"Lee","year":"2020","journal-title":"Current Opinion in Neurobiology"},{"key":"bib48","doi-asserted-by":"publisher","first-page":"451","DOI":"10.1016\/j.neuron.2016.12.040","article-title":"Dynamic interaction between reinforcement learning and attention in multidimensional environments","volume":"93","author":"Leong","year":"2017","journal-title":"Neuron"},{"key":"bib49","doi-asserted-by":"publisher","first-page":"1038","DOI":"10.1126\/science.aag2132","article-title":"Ten-month-old infants infer the value of goals from the costs of actions","volume":"358","author":"Liu","year":"2017","journal-title":"Science"},{"key":"bib50","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-020-16609-7","article-title":"Orbitofrontal control of visual cortex gain promotes visual associative learning","volume":"11","author":"Liu","year":"2020","journal-title":"Nature Communications"},{"key":"bib51","doi-asserted-by":"publisher","first-page":"436","DOI":"10.1038\/s41562-019-0573-y","article-title":"Process-based framework for precise neuromodulation","volume":"3","author":"Lubianiker","year":"2019","journal-title":"Nature Human Behaviour"},{"key":"bib52","doi-asserted-by":"publisher","first-page":"13203","DOI":"10.1073\/pnas.1614048113","article-title":"Dynamic updating of hippocampal object representations reflects new conceptual knowledge","volume":"113","author":"Mack","year":"2016","journal-title":"PNAS"},{"key":"bib53","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-019-13930-8","article-title":"Ventromedial prefrontal cortex compression during concept learning","volume":"11","author":"Mack","year":"2020","journal-title":"Nature Communications"},{"key":"bib54","doi-asserted-by":"publisher","first-page":"202","DOI":"10.1016\/j.neuron.2014.05.019","article-title":"Hippocampal representation of related and opposing memories develop within distinct, hierarchically organized neural schemas","volume":"83","author":"McKenzie","year":"2014","journal-title":"Neuron"},{"key":"bib55","doi-asserted-by":"publisher","first-page":"479","DOI":"10.1038\/nn.3337","article-title":"Category-dependent and category-independent goal-value codes in human ventromedial prefrontal cortex","volume":"16","author":"McNamee","year":"2013","journal-title":"Nature Neuroscience"},{"key":"bib56","doi-asserted-by":"publisher","first-page":"807","DOI":"10.1093\/cercor\/bhs361","article-title":"Encoding of rules by neurons in the human dorsolateral prefrontal cortex","volume":"24","author":"Mian","year":"2014","journal-title":"Cerebral Cortex"},{"key":"bib57","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1016\/j.neubiorev.2020.09.003","article-title":"Delineating implicit and explicit processes in neurofeedback learning","volume":"118","author":"Mu\u00f1oz-Moldes","year":"2020","journal-title":"Neuroscience and Biobehavioral Reviews"},{"key":"bib58","doi-asserted-by":"publisher","first-page":"2695","DOI":"10.1073\/pnas.1410767112","article-title":"Connectivity reveals relationship of brain areas for reward-guided learning and decision making in human and monkey frontal cortex","volume":"112","author":"Neubert","year":"2015","journal-title":"PNAS"},{"key":"bib59","doi-asserted-by":"publisher","first-page":"8145","DOI":"10.1523\/JNEUROSCI.2978-14.2015","article-title":"Reinforcement learning in multidimensional environments relies on attention mechanisms","volume":"35","author":"Niv","year":"2015","journal-title":"Journal of Neuroscience"},{"key":"bib60","doi-asserted-by":"publisher","first-page":"1544","DOI":"10.1038\/s41593-019-0470-8","article-title":"Learning task-state representations","volume":"22","author":"Niv","year":"2019","journal-title":"Nature Neuroscience"},{"key":"bib61","doi-asserted-by":"publisher","DOI":"10.1038\/s41467-018-08184-9","article-title":"Feature-specific prediction errors and surprise across macaque fronto-striatal circuits","volume":"10","author":"Oemisch","year":"2019","journal-title":"Nature Communications"},{"key":"bib62","doi-asserted-by":"publisher","first-page":"223","DOI":"10.1038\/nature04676","article-title":"Neurons in the orbitofrontal cortex encode economic value","volume":"441","author":"Padoa-Schioppa","year":"2006","journal-title":"Nature"},{"key":"bib63","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1016\/j.tics.2017.03.011","article-title":"The Importance of Falsification in Computational Cognitive Modeling","volume":"21","author":"Palminteri","year":"2017","journal-title":"Trends in Cognitive Sciences"},{"key":"bib64","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.11.010.2008","article-title":"Generating stimuli for neuroscience using PsychoPy","volume":"2","author":"Peirce","year":"2008","journal-title":"Frontiers in Neuroinformatics"},{"key":"bib65","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1007043","article-title":"Hierarchical Bayesian inference for concurrent model fitting and comparison for group studies","volume":"15","author":"Piray","year":"2019","journal-title":"PLOS Computational Biology"},{"key":"bib66","doi-asserted-by":"publisher","first-page":"1402","DOI":"10.1016\/j.neuron.2016.08.019","article-title":"Human orbitofrontal cortex represents a cognitive map of state space","volume":"91","author":"Schuck","year":"2016","journal-title":"Neuron"},{"key":"bib67","doi-asserted-by":"publisher","DOI":"10.1126\/science.aaw5181","article-title":"Sequential replay of nonspatial task states in the human Hippocampus","volume":"364","author":"Schuck","year":"2019","journal-title":"Science"},{"key":"bib68","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0225617","article-title":"Subjective value then confidence in human ventromedial prefrontal cortex","volume":"15","author":"Shapiro","year":"2020","journal-title":"PLOS ONE"},{"key":"bib69","doi-asserted-by":"publisher","first-page":"1413","DOI":"10.1126\/science.1212003","article-title":"Perceptual learning incepted by decoded fMRI neurofeedback without stimulus presentation","volume":"334","author":"Shibata","year":"2011","journal-title":"Science"},{"key":"bib70","doi-asserted-by":"publisher","first-page":"539","DOI":"10.1016\/j.neuroimage.2018.12.022","article-title":"Toward a comprehensive understanding of the neural mechanisms of decoded neurofeedback","volume":"188","author":"Shibata","year":"2019","journal-title":"NeuroImage"},{"key":"bib71","doi-asserted-by":"publisher","first-page":"86","DOI":"10.1038\/nrn.2016.164","article-title":"Closed-loop brain training: the science of neurofeedback","volume":"18","author":"Sitaram","year":"2017","journal-title":"Nature Reviews Neuroscience"},{"key":"bib72","doi-asserted-by":"publisher","first-page":"22522","DOI":"10.1073\/pnas.2005993117","article-title":"Multiple timescales of neural dynamics and integration of task-relevant signals across cortex","volume":"117","author":"Spitmaan","year":"2020","journal-title":"PNAS"},{"key":"bib73","doi-asserted-by":"publisher","first-page":"1643","DOI":"10.1038\/nn.4650","article-title":"The Hippocampus as a predictive map","volume":"20","author":"Stachenfeld","year":"2017","journal-title":"Nature Neuroscience"},{"key":"bib74","doi-asserted-by":"publisher","first-page":"577","DOI":"10.1162\/NECO_a_00246","article-title":"MOSAIC for multiple-reward environments","volume":"24","author":"Sugimoto","year":"2012","journal-title":"Neural Computation"},{"key":"bib75","volume-title":"Reinforcement Learning: An Introduction","author":"Sutton","year":"1998"},{"key":"bib76","doi-asserted-by":"publisher","first-page":"3470","DOI":"10.1073\/pnas.1721572115","article-title":"Towards an unconscious neural reinforcement intervention for common fears","volume":"115","author":"Taschereau-Dumouchel","year":"2018","journal-title":"PNAS"},{"key":"bib77","doi-asserted-by":"publisher","first-page":"76","DOI":"10.1126\/science.1135935","article-title":"Schemas and memory consolidation","volume":"316","author":"Tse","year":"2007","journal-title":"Science"},{"key":"bib78","doi-asserted-by":"publisher","first-page":"891","DOI":"10.1126\/science.1205274","article-title":"Schema-dependent gene activation and memory encoding in neocortex","volume":"333","author":"Tse","year":"2011","journal-title":"Science"},{"key":"bib79","doi-asserted-by":"publisher","first-page":"2727","DOI":"10.1523\/JNEUROSCI.1849-19.2020","article-title":"Distance and direction codes underlie navigation of a novel semantic space in the human brain","volume":"40","author":"Vigan\u00f2","year":"2020","journal-title":"The Journal of Neuroscience"},{"key":"bib80","doi-asserted-by":"publisher","first-page":"953","DOI":"10.1038\/35082081","article-title":"Single neurons in prefrontal cortex encode abstract rules","volume":"411","author":"Wallis","year":"2001","journal-title":"Nature"},{"key":"bib81","doi-asserted-by":"publisher","first-page":"3911","DOI":"10.1093\/cercor\/bhu277","article-title":"Probabilistic maps of visual topography in human cortex","volume":"25","author":"Wang","year":"2015","journal-title":"Cerebral Cortex"},{"key":"bib82","doi-asserted-by":"publisher","first-page":"279","DOI":"10.1007\/BF00992698","article-title":"Q-learning","volume":"8","author":"Watkins","year":"1992","journal-title":"Machine Learning"},{"key":"bib83","doi-asserted-by":"publisher","first-page":"513","DOI":"10.1038\/nrn.2016.56","article-title":"Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex","volume":"17","author":"Wikenheiser","year":"2016","journal-title":"Nature Reviews. Neuroscience"},{"key":"bib84","doi-asserted-by":"publisher","first-page":"267","DOI":"10.1016\/j.neuron.2013.11.005","article-title":"Orbitofrontal cortex as a cognitive map of task space","volume":"81","author":"Wilson","year":"2014","journal-title":"Neuron"},{"key":"bib85","doi-asserted-by":"publisher","first-page":"1317","DOI":"10.1016\/S0893-6080(98)00066-5","article-title":"Multiple paired forward and inverse models for motor control","volume":"11","author":"Wolpert","year":"1998","journal-title":"Neural Networks"},{"key":"bib86","doi-asserted-by":"publisher","first-page":"991","DOI":"10.1016\/j.neuroimage.2013.07.055","article-title":"Evaluation of slice accelerations using multiband echo planar imaging at 3 T","volume":"83","author":"Xu","year":"2013","journal-title":"NeuroImage"},{"key":"bib87","doi-asserted-by":"publisher","first-page":"1414","DOI":"10.1016\/j.neuroimage.2008.05.050","article-title":"Sparse estimation automatically selects voxels relevant for the decoding of fMRI activity patterns","volume":"42","author":"Yamashita","year":"2008","journal-title":"NeuroImage"},{"key":"bib88","doi-asserted-by":"publisher","first-page":"8259","DOI":"10.1523\/JNEUROSCI.1166-19.2019","article-title":"Brain Mechanisms of Concept Learning","volume":"39","author":"Zeithamova","year":"2019","journal-title":"Journal of Neuroscience"}],"container-title":["eLife"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/cdn.elifesciences.org\/articles\/68943\/elife-68943-v2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/cdn.elifesciences.org\/articles\/68943\/elife-68943-v2.xml","content-type":"application\/xml","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/elifesciences.org\/articles\/68943","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,10,11]],"date-time":"2023-10-11T21:17:30Z","timestamp":1697059050000},"score":1,"resource":{"primary":{"URL":"https:\/\/elifesciences.org\/articles\/68943"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,7,13]]},"references-count":88,"alternative-id":["10.7554\/eLife.68943"],"URL":"https:\/\/doi.org\/10.7554\/elife.68943","archive":["CLOCKSS"],"relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/2020.10.29.361469","asserted-by":"subject"},{"id-type":"doi","id":"10.1101\/2020.10.29.361469","asserted-by":"object"}],"has-review":[{"id-type":"doi","id":"10.7554\/eLife.68943.sa2","asserted-by":"object"},{"id-type":"doi","id":"10.7554\/eLife.68943.sa1","asserted-by":"object"}]},"ISSN":["2050-084X"],"issn-type":[{"value":"2050-084X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,7,13]]},"assertion":[{"value":"single anonymised","name":"peer_review_transparency","label":"Peer review transparency","group":{"name":"peer_review_taxonomy"}},{"value":"other reviewer(s), editor","name":"peer_review_interaction","label":"Peer review interaction","group":{"name":"peer_review_taxonomy"}},{"value":"review summaries, review reports, author\/editor communication, reviewer identities reviewer opt in, editor identities","name":"peer_review_published","label":"Peer review published","group":{"name":"peer_review_taxonomy"}},{"value":"open (sign in with ORCID iD required)","name":"post_publication_commenting","label":"Post publication commenting","group":{"name":"post_publication_commenting"}}],"article-number":"e68943"}}