{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,1]],"date-time":"2026-02-01T07:05:33Z","timestamp":1769929533321,"version":"3.49.0"},"reference-count":46,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T00:00:00Z","timestamp":1622419200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000874","name":"Brain and Behavior Research Foundation","doi-asserted-by":"publisher","award":["2017 NARSAD young investigator award"],"award-info":[{"award-number":["2017 NARSAD young investigator award"]}],"id":[{"id":"10.13039\/100000874","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003977","name":"Israel Science Foundation","doi-asserted-by":"publisher","award":["#854\/17"],"award-info":[{"award-number":["#854\/17"]}],"id":[{"id":"10.13039\/501100003977","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Brain Sciences"],"abstract":"<jats:p>Shifting between goal-directed and habitual behaviors is essential for daily functioning. An inability to do so is associated with various clinical conditions, such as obsessive\u2013compulsive disorder (OCD). Here we developed a new behavioral model in mice allowing us to produce and examine the development of different behaviors under goal-directed or habitual control. By using overtraining of instrumental associations between two levers and two rewards, and later devaluating one of the rewards, we differentiate and explore the motivational control of behaviors within the task which consequentially promotes what seems like excessive irrational behavior. Using our model, we found that the ability of instrumental behavior, to adapt to a change in the value of a known reward, is a function of practice. Once an instrumental action was practiced extensively it becomes habitual and, thus, under S\u2013R control and could not be amended, not even when resulting in a noxious outcome. However, direct consummatory or Pavlovian actions, such as licking or checking, responds immediately to the change in value. This imbalance could render an instrumental behavior excessive and unresponsive to changes in outcome while the direct change in consumption implies that the change was in fact registered. This could suggest a system that, when out of balance, can create excessive behaviors, not adapting to an acknowledged change.<\/jats:p>","DOI":"10.3390\/brainsci11060732","type":"journal-article","created":{"date-parts":[[2021,5,31]],"date-time":"2021-05-31T21:42:06Z","timestamp":1622497326000},"page":"732","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["The Differential Effects of the Amount of Training on Sensitivity of Distinct Actions to Reward Devaluation"],"prefix":"10.3390","volume":"11","author":[{"given":"Maya","family":"Bar Or","sequence":"first","affiliation":[{"name":"School of Psychological Sciences, The University of Haifa, Haifa 3498838, Israel"},{"name":"The Integrated Brain and Behavior Research Center (IBBRC), The University of Haifa, Haifa 3498838, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Oded","family":"Klavir","sequence":"additional","affiliation":[{"name":"School of Psychological Sciences, The University of Haifa, Haifa 3498838, Israel"},{"name":"The Integrated Brain and Behavior Research Center (IBBRC), The University of Haifa, Haifa 3498838, Israel"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2021,5,31]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Aarts, H., and Elliot, A. (2012). Goal-Directed Behavior, Taylor & Francis.","DOI":"10.4324\/9780203869666"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"464","DOI":"10.1038\/nrn1919","article-title":"The role of the basal ganglia in habit formation","volume":"7","author":"Yin","year":"2006","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"2771","DOI":"10.1523\/JNEUROSCI.3894-04.2005","article-title":"Lesion to the nigrostriatal dopamine system disrupts stimulus-response habit formation","volume":"25","author":"Faure","year":"2005","journal-title":"J. Neurosci."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1016\/j.physbeh.2005.08.061","article-title":"Neural bases of food-seeking: Affect, arousal and reward in corticostriatolimbic circuits","volume":"86","author":"Balleine","year":"2005","journal-title":"Physiol. Behav."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1481","DOI":"10.1038\/nn1579","article-title":"Neural systems of reinforcement for drug addiction: From actions to habits to compulsion","volume":"8","author":"Everitt","year":"2005","journal-title":"Nat. Neurosci."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"718","DOI":"10.1176\/appi.ajp.2011.10071062","article-title":"Disruption in the Balance Between Goal-Directed Behavior and Habit Learning in Obsessive-Compulsive Disorder","volume":"168","author":"Gillan","year":"2011","journal-title":"Am. J. Psychiatry"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1016\/j.neuropharm.2013.05.033","article-title":"Transition from \u2018model-based\u2019to \u2018model-free\u2019behavioral control in addiction: Involvement of the orbitofrontal cortex and dorsolateral striatum","volume":"76","author":"Lucantonio","year":"2014","journal-title":"Neuropharmacology"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1146\/annurev-physiol-021115-105355","article-title":"Cortico-basal ganglia circuit function in psychiatric disease","volume":"78","author":"Gunaydin","year":"2016","journal-title":"Annu. Rev. Physiol."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1016\/S0896-6273(00)00113-6","article-title":"Toward a neurobiology of obsessive-compulsive disorder","volume":"28","author":"Graybiel","year":"2000","journal-title":"Neuron"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"334","DOI":"10.1016\/0010-440X(87)90070-8","article-title":"A cybernetic model of obsessive-compulsive psychopathology","volume":"28","author":"Pitman","year":"1987","journal-title":"Compr. Psychiatry"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1037\/0033-295X.111.1.111","article-title":"Obsessive-compulsive disorder as a disturbance of security motivation","volume":"111","author":"Szechtman","year":"2004","journal-title":"Psychol. Rev."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1016\/S0166-4328(01)00201-7","article-title":"Excessive lever pressing following post-training signal attenuation in rats: A possible animal model of obsessive compulsive disorder?","volume":"123","author":"Joel","year":"2001","journal-title":"Behav. Brain Res."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/j.expneurol.2008.09.017","article-title":"High frequency stimulation and pharmacological inactivation of the subthalamic nucleus reduces \u2018compulsive\u2019lever-pressing in rats","volume":"215","author":"Klavir","year":"2009","journal-title":"Exp. Neurol."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"84","DOI":"10.1016\/j.bbr.2010.07.018","article-title":"High but not low frequency stimulation of both the globus pallidus and the entopeduncular nucleus reduces \u2018compulsive\u2019 lever-pressing in rats","volume":"216","author":"Klavir","year":"2011","journal-title":"Behav. Brain Res."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"241","DOI":"10.1097\/01.fbp.0000132925.81402.0a","article-title":"\u2018Compulsive\u2019 lever-pressing in rats is attenuated by the serotonin re-uptake inhibitors paroxetine and fluvoxamine but not by the tricyclic antidepressant desipramine or the anxiolytic diazepam","volume":"15","author":"Joel","year":"2004","journal-title":"Behav Pharm."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"487","DOI":"10.1007\/s00213-006-0387-2","article-title":"The signal attenuation rat model of obsessive\u2013compulsive disorder: A review","volume":"186","author":"Joel","year":"2006","journal-title":"Psychopharmacology"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1098\/rstb.1985.0010","article-title":"Actions and habits: The development of behavioural autonomy","volume":"308","author":"Dickinson","year":"1985","journal-title":"Philos. Trans. R. Soc. Lond. B Biol. Sci."},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Dickinson, A., and Balleine, B. (2002). The role of learning in the operation of motivational systems. Stevens\u2019 Handbook of Experimental Psychology, John Wiley & Sons.","DOI":"10.1002\/0471214426.pas0312"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"109","DOI":"10.1080\/14640748108400816","article-title":"Instrumental responding following reinforcer devaluation","volume":"33","author":"Adams","year":"1981","journal-title":"Q. J. Exp. Psychol. Sect. B"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"77","DOI":"10.1080\/14640748208400878","article-title":"Variations in the sensitivity of instrumental responding to reinforcer devaluation","volume":"34","author":"Adams","year":"1982","journal-title":"Q. J. Exp. Psychol. Sect. B"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"520","DOI":"10.1037\/0097-7403.11.4.520","article-title":"Instrumental responding remains sensitive to reinforcer devaluation after extensive training","volume":"11","author":"Colwill","year":"1985","journal-title":"J. Exp. Psychol. Anim. Behav. Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1037\/0097-7403.30.2.104","article-title":"Relations between Pavlovian-instrumental transfer and reinforcer devaluation","volume":"30","author":"Holland","year":"2004","journal-title":"J. Exp. Psychol. Anim. Behav. Process."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"464","DOI":"10.3758\/BF03193185","article-title":"Amount of training effects in representationmediated food aversion learning: No evidence of a role for associability changes","volume":"33","author":"Holland","year":"2005","journal-title":"Learn. Behav."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"522","DOI":"10.1016\/j.bbr.2011.08.017","article-title":"Impaired sensitivity to Pavlovian stimulus\u2013outcome learning after excitotoxic lesion of the ventrolateral neostriatum","volume":"225","author":"Lelos","year":"2011","journal-title":"Behav. Brain Res."},{"key":"ref_25","first-page":"811","article-title":"The role of 5-HT2A and 5-HT2C receptors in the signal attenuation rat model of obsessive\u2013compulsive disorder","volume":"11","author":"Klavir","year":"2008","journal-title":"Int. J. Neuropsychopharmacol."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"1026","DOI":"10.1038\/npp.2009.208","article-title":"The role of the striatum in compulsive behavior in intact and orbitofrontal-cortex-lesioned rats: Possible involvement of the serotonergic system","volume":"35","author":"Schilman","year":"2010","journal-title":"Neuropsychopharmacology"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"1902","DOI":"10.1111\/j.1460-9568.2008.06148.x","article-title":"The role of the subthalamic nucleus in \u2018compulsive\u2019 behavior in rats","volume":"27","author":"Winter","year":"2008","journal-title":"Eur. J. Neurosci."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Lederle, L., Weber, S., Wright, T., Feyder, M., Brigman, J.L., Crombag, H.S., Saksida, L.M., Bussey, T.J., and Holmes, A. (2011). Reward-related behavioral paradigms for addiction research in the mouse: Performance of common inbred strains. PLoS ONE, 6.","DOI":"10.1371\/journal.pone.0015536"},{"key":"ref_29","first-page":"1","article-title":"Taste reactivity as a measure of the neural control of palatability","volume":"11","author":"Grill","year":"1985","journal-title":"Prog. Psychobiol. Physiol. Psychol."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"447","DOI":"10.1080\/14640748008401838","article-title":"Post-conditioning devaluation of an instrumental reinforcer has no effect on extinction performance","volume":"32","author":"Adams","year":"1980","journal-title":"Q. J. Exp. Psychol."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"400","DOI":"10.1093\/cercor\/13.4.400","article-title":"Coordination of actions and habits in the medial prefrontal cortex of rats","volume":"13","author":"Killcross","year":"2003","journal-title":"Cereb. Cortex"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1016\/S0028-3908(98)00038-0","article-title":"Amount of training affects associatively-activated event representation","volume":"37","author":"Holland","year":"1998","journal-title":"Neuropharmacology"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"357","DOI":"10.1146\/annurev.ne.09.030186.002041","article-title":"Parallel organization of functionally segregated circuits linking basal ganglia and cortex","volume":"9","author":"Alexander","year":"1986","journal-title":"Annu Rev Neurosci"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/S0079-6123(08)62678-3","article-title":"Basal ganglia-thalamocortical circuits: Parallel substrates for motor, oculomotor, \u201cprefrontal\u201d and \u201cimbic\u201d functions","volume":"85","author":"Alexander","year":"1990","journal-title":"Prog Brain Res"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1146\/annurev.ne.06.030183.000445","article-title":"Speculations on the functional anatomy of basal ganglia disorders","volume":"6","author":"Penney","year":"1983","journal-title":"Annu Rev Neurosci"},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"V1","DOI":"10.1007\/PL00007778","article-title":"Neural circuits and functional organization of the striatum","volume":"247","author":"Nakano","year":"2000","journal-title":"J. Neurol."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"760","DOI":"10.1038\/nrn2915","article-title":"Goal-directed and habitual control in the basal ganglia: Implications for Parkinson\u2019s disease","volume":"11","author":"Redgrave","year":"2010","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"407","DOI":"10.1002\/mds.1096","article-title":"Open interconnected model of basal ganglia-thalamocortical circuitry and its relevance to the clinical syndrome of Huntington\u2019s disease","volume":"16","author":"Joel","year":"2001","journal-title":"Mov Disord"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"363","DOI":"10.1016\/0306-4522(94)90536-3","article-title":"The organization of the basal ganglia-thalamocortical circuits: Open interconnected rather than closed segregated","volume":"63","author":"Joel","year":"1994","journal-title":"Neuroscience"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1007\/PL00007984","article-title":"A computational model of action selection in the basal ganglia. I. A new functional anatomy","volume":"84","author":"Gurney","year":"2001","journal-title":"Biol. Cybern."},{"key":"ref_41","unstructured":"Bunney, C.E.N.W. (1999). Functional imaging of brain systems mediating obsessive-compulsive disorder. Neurobiology of Mental Illness, Oxford University Press."},{"key":"ref_42","unstructured":"Gray, J. (1982). The Neuropsychology of Anxiety: An Enquiry into the Functions of the Septo-Hippocampal System, Oxford University Press."},{"key":"ref_43","unstructured":"Perecman, E. (1987). Frontal lobe dysfunction in obsessive-compulsive disorder. The Frontal Lobes Revisited, Lawrence Erlbaum Associates."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"825","DOI":"10.1016\/S0193-953X(18)30212-0","article-title":"Normal and abnormal information processing. A neuropsychological perspective on obsessive compulsive disorder","volume":"15","author":"Otto","year":"1992","journal-title":"Psychiatr. Clin. N. Am."},{"key":"ref_45","unstructured":"Pitman, R. (1991). Historical Considerations, Springer."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"177","DOI":"10.1192\/bjp.130.2.177","article-title":"Obsessional personality disorder and remembering","volume":"130","author":"Reed","year":"1977","journal-title":"Br. J. Psychiatry"}],"container-title":["Brain Sciences"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2076-3425\/11\/6\/732\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T06:09:28Z","timestamp":1760162968000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2076-3425\/11\/6\/732"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,31]]},"references-count":46,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2021,6]]}},"alternative-id":["brainsci11060732"],"URL":"https:\/\/doi.org\/10.3390\/brainsci11060732","relation":{},"ISSN":["2076-3425"],"issn-type":[{"value":"2076-3425","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,31]]}}}