{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,30]],"date-time":"2026-04-30T04:06:04Z","timestamp":1777521964900,"version":"3.51.4"},"reference-count":95,"publisher":"SAGE Publications","issue":"3-4","license":[{"start":{"date-parts":[[2010,6,1]],"date-time":"2010-06-01T00:00:00Z","timestamp":1275350400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/journals.sagepub.com\/page\/policies\/text-and-data-mining-license"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Adaptive Behavior"],"published-print":{"date-parts":[[2010,6]]},"abstract":"<jats:p>We present a biologically inspired model of the subcortical nuclei of the limbic system that is capable of performing reversal learning in a food-seeking task. In contrast to previous models, the reversal is modeled by the inhibition of the previously learned behavior. This allows for the reinstatement of behavior to recur quickly, as observed in animal behavior. In this model learning is achieved by implementing isotropic sequence order learning and a third factor (ISO-3) that triggers learning at relevant moments. This third factor is modeled by phasic and tonic dopaminergic activity which respectively enable long-term potentiation to occur during acquisition, and long-term depression (LTD) to occur when adjustments in learned behaviors are required. It will be shown how the nucleus accumbens core uses conditioned reinforcers to invigorate instrumental responding while relatively strong LTD in the shell influences the core through a shell-ventral pallido-mediodorsal pathway. This pathway functions as a feed-forward switching mechanism and enables behavioral flexibility.<\/jats:p>","DOI":"10.1177\/1059712309353612","type":"journal-article","created":{"date-parts":[[2010,7,6]],"date-time":"2010-07-06T20:29:04Z","timestamp":1278448144000},"page":"211-236","source":"Crossref","is-referenced-by-count":5,"title":["Learning and Reversal Learning in the Subcortical Limbic System: A Computational Model"],"prefix":"10.1177","volume":"18","author":[{"given":"Adedoyin Maria","family":"Thompson","sequence":"first","affiliation":[{"name":"Department of Electronics & Electrical Engineering, University of Glasgow, UK, mariat@elec.gla.ac.uk"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Bernd","family":"Porr","sequence":"additional","affiliation":[{"name":"Department of Electronics & Electrical Engineering, University of Glasgow, UK, b.porr@elec.gla.ac.uk"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Florentin","family":"W\u00f6rg\u00f6tter","sequence":"additional","affiliation":[{"name":"Bernstein Center of Computational Neuroscience (BCCN), G\u00f6ttingen, Germany,\rworgott@bccn-goettingen.de"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"179","published-online":{"date-parts":[[2017,2,6]]},"reference":[{"key":"atypb1","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainresrev.2007.07.014"},{"key":"atypb2","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4522(88)90217-5"},{"key":"atypb3","doi-asserted-by":"publisher","DOI":"10.1016\/0166-4328(94)90104-X"},{"key":"atypb4","doi-asserted-by":"publisher","DOI":"10.1046\/j.1460-9568.2000.00996.x"},{"key":"atypb5","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.20-11-04320.2000"},{"key":"atypb6","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2008.12.024"},{"key":"atypb7","doi-asserted-by":"publisher","DOI":"10.1016\/S0006-3223(02)01546-9"},{"key":"atypb8","volume-title":"Vehicles: Explorations in synthetic psychology","year":"1984"},{"key":"atypb9","doi-asserted-by":"publisher","DOI":"10.1002\/cne.903380209"},{"key":"atypb10","doi-asserted-by":"publisher","DOI":"10.1016\/0031-9384(91)90575-9"},{"key":"atypb11","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3940(92)90628-K"},{"key":"atypb12","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.12-11-04224.1992"},{"key":"atypb13","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2007.03.001"},{"key":"atypb14","doi-asserted-by":"publisher","DOI":"10.1016\/0166-2236(96)81862-5"},{"key":"atypb15","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-006-0532-y"},{"key":"atypb16","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2008.04.046"},{"key":"atypb17","doi-asserted-by":"publisher","DOI":"10.1016\/S0149-7634(02)00007-6"},{"key":"atypb18","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7044.116.4.553"},{"key":"atypb19","doi-asserted-by":"publisher","DOI":"10.1046\/j.0953-816x.2001.01607.x"},{"key":"atypb20","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1301153"},{"key":"atypb21","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.21-09-03251.2001"},{"key":"atypb22","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2006.01.003"},{"key":"atypb23","first-page":"255","volume":"37","year":"1983","journal-title":"Advances in Biochemical Psychopharmacology"},{"issue":"4","key":"atypb24","first-page":"603","volume":"15","year":"2002","journal-title":"Neural Networks"},{"key":"atypb25","doi-asserted-by":"crossref","unstructured":"Dayan,\nP. ( 2001). Motivated reinforcement learning. In T. K.\nLeen, T. G.\nDietterich & V. TrespAdvances in Neural Information Processing Systems 14. Cambridge, MA: MIT Press (pp. 11-18).","DOI":"10.7551\/mitpress\/1120.003.0006"},{"key":"atypb26","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.21-23-09471.2001"},{"issue":"4","key":"atypb27","first-page":"561","volume":"15","year":"2002","journal-title":"Neural Networks"},{"key":"atypb28","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1300715"},{"key":"atypb29","doi-asserted-by":"publisher","DOI":"10.1126\/science.1077349"},{"key":"atypb30","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2008.04.004"},{"key":"atypb31","doi-asserted-by":"publisher","DOI":"10.1038\/nn1103"},{"key":"atypb32","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1989.61.2.331"},{"key":"atypb33","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-19-07239.2003"},{"key":"atypb34","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.17-15-05972.1997"},{"key":"atypb35","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4522(96)00320-X"},{"key":"atypb36","doi-asserted-by":"publisher","DOI":"10.1038\/nn1471"},{"key":"atypb37","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2008.08.002"},{"key":"atypb38","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4522(91)90196-U"},{"issue":"2","key":"atypb39","first-page":"119","volume":"95","year":"2000","journal-title":"Addiction"},{"key":"atypb40","doi-asserted-by":"publisher","DOI":"10.1016\/j.tins.2007.03.003"},{"key":"atypb41","doi-asserted-by":"publisher","DOI":"10.1016\/S0891-0618(99)00009-5"},{"key":"atypb42","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4522(00)00019-1"},{"key":"atypb43","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2008.06.037"},{"key":"atypb44","doi-asserted-by":"publisher","DOI":"10.1038\/nn1217"},{"key":"atypb45","doi-asserted-by":"publisher","DOI":"10.1111\/j.1749-6632.1999.tb09262.x"},{"key":"atypb46","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2003.11.015"},{"key":"atypb47","doi-asserted-by":"publisher","DOI":"10.1016\/0304-3940(95)11414-R"},{"key":"atypb48","doi-asserted-by":"publisher","DOI":"10.1196\/annals.1300.014"},{"key":"atypb49","doi-asserted-by":"publisher","DOI":"10.1007\/BF00423094"},{"key":"atypb50","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2004.09.012"},{"key":"atypb51","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5312-05.2006"},{"issue":"5","key":"atypb52","first-page":"1247","volume":"100","year":"2007","journal-title":"Journal of Neuro-chemistry"},{"key":"atypb53","doi-asserted-by":"publisher","DOI":"10.1016\/0031-9384(75)90064-5"},{"issue":"2","key":"atypb54","first-page":"69","volume":"14","year":"1980","journal-title":"Progress in Neurobiology"},{"key":"atypb55","doi-asserted-by":"publisher","DOI":"10.1037\/0097-7403.18.2.182"},{"key":"atypb56","doi-asserted-by":"publisher","DOI":"10.1007\/s00441-004-0929-z"},{"key":"atypb57","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-006-0502-4"},{"key":"atypb58","doi-asserted-by":"publisher","DOI":"10.1037\/h0058775"},{"key":"atypb59","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7044.121.1.31"},{"key":"atypb60","doi-asserted-by":"publisher","DOI":"10.1016\/0166-4328(87)90022-2"},{"key":"atypb61","doi-asserted-by":"publisher","DOI":"10.1016\/S0079-6123(00)26019-6"},{"key":"atypb62","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.19-06-02401.1999"},{"key":"atypb63","doi-asserted-by":"publisher","DOI":"10.1037\/0735-7044.114.1.42"},{"key":"atypb64","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/12.12.1254"},{"key":"atypb65","volume-title":"Conditioned reflexes","year":"1927"},{"key":"atypb66","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4402-07.2008"},{"key":"atypb67","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1045-08.2008"},{"key":"atypb68","doi-asserted-by":"publisher","DOI":"10.1016\/0006-8993(75)90998-1"},{"key":"atypb69","doi-asserted-by":"publisher","DOI":"10.1007\/BF02249339"},{"key":"atypb70","doi-asserted-by":"publisher","DOI":"10.1162\/08997660360581921"},{"key":"atypb71","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2007.19.10.2694"},{"key":"atypb72","doi-asserted-by":"publisher","DOI":"10.1016\/j.neunet.2005.06.049"},{"key":"atypb73","unstructured":"Rescorla, R.A. ( 2001). Experimental extinction. In S. B.\nKlein & R. R.\nMowrer (Eds), Handbook of contemporary learning theories (pp. 119-154). Mahwah, NJ : Lawrence Erlbaum Associates."},{"issue":"4","key":"atypb74","first-page":"507","volume":"15","year":"2002","journal-title":"Neural Networks"},{"key":"atypb75","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.21-09-03261.2001"},{"key":"atypb76","doi-asserted-by":"publisher","DOI":"10.1016\/S0959-4388(96)80077-8"},{"key":"atypb77","doi-asserted-by":"publisher","DOI":"10.1016\/0091-3057(77)90084-3"},{"key":"atypb78","doi-asserted-by":"publisher","DOI":"10.1016\/S0149-7634(96)00017-6"},{"key":"atypb79","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropharm.2007.12.012"},{"key":"atypb80","doi-asserted-by":"publisher","DOI":"10.1016\/S0959-4388(97)80007-4"},{"key":"atypb81","doi-asserted-by":"publisher","DOI":"10.1152\/jn.1998.80.1.1"},{"key":"atypb82","doi-asserted-by":"publisher","DOI":"10.1016\/0166-4328(82)90001-8"},{"key":"atypb83","volume-title":"Proceedings of the Ninth Annual Conference of the Cognitive Science Society"},{"key":"atypb84","unstructured":"Sutton, R.S. & Barto, A. ( 1990). Time-derivative models of Pavlovian reinforcement. In M. Gabriel & J. Moore (Eds), Learning and computational neuroscience (pp. 497-537). Cambridge, MA: MIT-press."},{"key":"atypb85","volume-title":"Reinforcement learning: an introduction","year":"1998"},{"key":"atypb86","volume-title":"Proceedings of the Tenth International Conference on Simulation of Adaptive Behavior, SAB, LNAI 5040"},{"key":"atypb87","volume-title":"Proceedings of the Ninth International Conference on Simulation of Adaptive Behavior, SAB, LNAI 4095"},{"key":"atypb88","doi-asserted-by":"publisher","DOI":"10.1038\/nature02024"},{"issue":"1","key":"atypb89","first-page":"13","volume":"51","year":"1998","journal-title":"Drug and Alcohol Dependence"},{"key":"atypb90","doi-asserted-by":"publisher","DOI":"10.1038\/nrn1406"},{"key":"atypb91","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.ps.40.020189.001203"},{"key":"atypb92","doi-asserted-by":"publisher","DOI":"10.1126\/science.566469"},{"key":"atypb93","doi-asserted-by":"publisher","DOI":"10.1016\/S0149-7634(99)00065-2"},{"key":"atypb94","doi-asserted-by":"publisher","DOI":"10.1016\/0306-4522(92)90202-D"},{"key":"atypb95","doi-asserted-by":"publisher","DOI":"10.1002\/cne.903020302"}],"container-title":["Adaptive Behavior"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712309353612","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/journals.sagepub.com\/doi\/pdf\/10.1177\/1059712309353612","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,4,28]],"date-time":"2026-04-28T16:15:55Z","timestamp":1777392955000},"score":1,"resource":{"primary":{"URL":"https:\/\/journals.sagepub.com\/doi\/10.1177\/1059712309353612"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,6]]},"references-count":95,"journal-issue":{"issue":"3-4","published-print":{"date-parts":[[2010,6]]}},"alternative-id":["10.1177\/1059712309353612"],"URL":"https:\/\/doi.org\/10.1177\/1059712309353612","relation":{},"ISSN":["1059-7123","1741-2633"],"issn-type":[{"value":"1059-7123","type":"print"},{"value":"1741-2633","type":"electronic"}],"subject":[],"published":{"date-parts":[[2010,6]]}}}