{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,2]],"date-time":"2025-11-02T19:21:32Z","timestamp":1762111292583,"version":"3.37.3"},"reference-count":143,"publisher":"MIT Press","issue":"9","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Neural Computation"],"published-print":{"date-parts":[[2010,9]]},"abstract":"<jats:p>Clinical and experimental observations show individual differences in the development of addiction. Increasing evidence supports the hypothesis that dopamine receptor availability in the nucleus accumbens (NAc) predisposes drug reinforcement. Here, modeling striatal-midbrain dopaminergic circuit, we propose a reinforcement learning model for addiction based on the actor-critic model of striatum. Modeling dopamine receptors in the NAc as modulators of learning rate for appetitive\u2014but not aversive\u2014stimuli in the critic\u2014but not the actor\u2014we define vulnerability to addiction as a relatively lower learning rate for the appetitive stimuli, compared to aversive stimuli, in the critic. We hypothesize that an imbalance in this learning parameter used by appetitive and aversive learning systems can result in addiction. We elucidate that the interaction between the degree of individual vulnerability and the duration of exposure to drug has two progressive consequences: deterioration of the imbalance and establishment of an abnormal habitual response in the actor. Using computational language, the proposed model describes how development of compulsive behavior can be a function of both degree of drug exposure and individual vulnerability. Moreover, the model describes how involvement of the dorsal striatum in addiction can be augmented progressively. The model also interprets other forms of addiction, such as obesity and pathological gambling, in a common mechanism with drug addiction. Finally, the model provides an answer for the question of why behavioral addictions are triggered in Parkinson's disease patients by D2 dopamine agonist treatments.<\/jats:p>","DOI":"10.1162\/neco_a_00009","type":"journal-article","created":{"date-parts":[[2010,6,23]],"date-time":"2010-06-23T00:07:32Z","timestamp":1277251652000},"page":"2334-2368","source":"Crossref","is-referenced-by-count":32,"title":["Individual Differences in Nucleus Accumbens Dopamine Receptors Predict Development of Addiction-Like Behavior: A Computational Approach"],"prefix":"10.1162","volume":"22","author":[{"given":"Payam","family":"Piray","sequence":"first","affiliation":[{"name":"Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Mohammad Mahdi","family":"Keramati","sequence":"additional","affiliation":[{"name":"School of Management and Economics, Sharif University of Technology, Tehran, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Amir","family":"Dezfouli","sequence":"additional","affiliation":[{"name":"Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Caro","family":"Lucas","sequence":"additional","affiliation":[{"name":"Control and Intelligent Processing Center of Excellence, School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Azarakhsh","family":"Mokri","sequence":"additional","affiliation":[{"name":"Department of Psychiatry, Roozbeh Hospital, Tehran University of Medical Sciences, Tehran, Iran, and Department of Clinical Sciences, Iranian National Center for Addiction Studies, Tehran University of Medical Sciences, Tehran, Iran"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"281","reference":[{"key":"B1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1107071"},{"key":"B2","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X08004731"},{"key":"B3","doi-asserted-by":"publisher","DOI":"10.1126\/science.282.5387.298"},{"key":"B4","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-005-2180-z"},{"key":"B5","volume-title":"Diagnostic and Statistical Manual of Mental Disorders","author":"American Psychiatric Association.","year":"2000","edition":"4"},{"key":"B6","doi-asserted-by":"publisher","DOI":"10.1037\/1064-1297.2.3.244"},{"key":"B7","doi-asserted-by":"publisher","DOI":"10.1038\/nn1817"},{"key":"B8","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-005-0133-1"},{"key":"B9","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1554-07.2007"},{"key":"B10","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2005.05.020"},{"key":"B11","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2007.12.019"},{"key":"B12","doi-asserted-by":"publisher","DOI":"10.1126\/science.1158136"},{"key":"B13","doi-asserted-by":"publisher","DOI":"10.1016\/S0896-6273(00)81056-9"},{"key":"B14","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2008.135"},{"key":"B15","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-20-07569.2003"},{"key":"B16","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0811507106"},{"issue":"1","key":"B17","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1016\/S0022-3565(24)35108-0","volume":"291","author":"Caine S. B.","year":"1999","journal-title":"Journal of Pharmacology and Experimental Therapeutics"},{"key":"B18","doi-asserted-by":"publisher","DOI":"10.1016\/S0149-7634(02)00007-6"},{"key":"B19","doi-asserted-by":"publisher","DOI":"10.1016\/S0031-9384(02)00760-6"},{"key":"B20","doi-asserted-by":"publisher","DOI":"10.1126\/science.277.5327.812"},{"key":"B21","doi-asserted-by":"publisher","DOI":"10.1007\/BF02246095"},{"key":"B22","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.20-05-j0002.2000"},{"key":"B23","doi-asserted-by":"publisher","DOI":"10.1038\/nature06995"},{"key":"B24","doi-asserted-by":"publisher","DOI":"10.1016\/0091-3057(91)90168-2"},{"key":"B25","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2009.01.031"},{"key":"B26","doi-asserted-by":"publisher","DOI":"10.1126\/science.1137073"},{"key":"B27","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-6080(02)00052-7"},{"key":"B28","doi-asserted-by":"publisher","DOI":"10.1038\/nn1560"},{"key":"B29","doi-asserted-by":"publisher","DOI":"10.1055\/s-0028-1124107"},{"key":"B30","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.0040004"},{"key":"B31","doi-asserted-by":"publisher","DOI":"10.1126\/science.1099020"},{"key":"B32","doi-asserted-by":"publisher","DOI":"10.1016\/0376-8716(86)90068-2"},{"key":"B33","doi-asserted-by":"publisher","DOI":"10.1162\/neco.2009.10-08-882"},{"key":"B34","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropharm.2004.06.032"},{"key":"B35","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1301062"},{"key":"B36","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2008.0089"},{"key":"B37","doi-asserted-by":"publisher","DOI":"10.1038\/nn1579"},{"key":"B38","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-006-0415-2"},{"key":"B39","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4331-05.2006"},{"key":"B40","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2342"},{"key":"B41","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0706111104"},{"key":"B42","doi-asserted-by":"publisher","DOI":"10.1126\/science.1102941"},{"key":"B43","doi-asserted-by":"publisher","DOI":"10.1093\/jmcb\/mjp010"},{"key":"B44","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.157.11.1789"},{"key":"B45","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.164.1.43"},{"key":"B46","doi-asserted-by":"publisher","DOI":"10.1038\/nn1471"},{"key":"B47","doi-asserted-by":"publisher","DOI":"10.1073\/pnas.0510220103"},{"key":"B48","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.20-06-02369.2000"},{"key":"B49","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2009.129"},{"key":"B50","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2007.2055"},{"key":"B51","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-12-05079.2003"},{"key":"B52","doi-asserted-by":"publisher","DOI":"10.1176\/appi.ajp.162.8.1414"},{"key":"B53","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.29.051605.113009"},{"key":"B54","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-28-09305.2003"},{"key":"B55","doi-asserted-by":"publisher","DOI":"10.1016\/j.brainresrev.2007.05.004"},{"key":"B56","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.17-21-08580.1997"},{"key":"B57","doi-asserted-by":"publisher","DOI":"10.1016\/S0091-3057(98)00086-0"},{"key":"B58","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0892-05.2005"},{"key":"B59","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.22-22-09895.2002"},{"key":"B60","doi-asserted-by":"publisher","DOI":"10.1124\/jpet.107.120675"},{"key":"B61","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.6157-08.2009"},{"key":"B62","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.22-14-06247.2002"},{"key":"B63","doi-asserted-by":"publisher","DOI":"10.1016\/j.bbr.2004.02.003"},{"key":"B64","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-133X(01)00355-4"},{"key":"B65","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2515"},{"key":"B66","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1301564"},{"key":"B67","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2234"},{"key":"B68","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2728-09.2009"},{"key":"B69","doi-asserted-by":"publisher","DOI":"10.1152\/jn.00310.2007"},{"key":"B70","doi-asserted-by":"publisher","DOI":"10.1126\/science.1145044"},{"key":"B71","doi-asserted-by":"publisher","DOI":"10.1038\/nn1105-1442"},{"key":"B72","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-133X(97)00043-2"},{"key":"B73","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuron.2008.02.021"},{"key":"B74","doi-asserted-by":"publisher","DOI":"10.1038\/nature00892"},{"key":"B75","doi-asserted-by":"publisher","DOI":"10.1016\/S0091-3057(96)00449-2"},{"key":"B76","doi-asserted-by":"publisher","DOI":"10.1038\/nn.2367"},{"key":"B77","doi-asserted-by":"publisher","DOI":"10.1038\/npp.2008.235"},{"key":"B78","doi-asserted-by":"publisher","DOI":"10.1038\/nature08028"},{"key":"B79","doi-asserted-by":"publisher","DOI":"10.1016\/S0166-2236(03)00177-2"},{"key":"B80","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.16-05-01936.1996"},{"key":"B81","doi-asserted-by":"publisher","DOI":"10.1038\/nature03015"},{"key":"B82","doi-asserted-by":"publisher","DOI":"10.1002\/(SICI)1098-2396(199801)28:1<1::AID-SYN1>3.0.CO;2-G"},{"key":"B83","doi-asserted-by":"publisher","DOI":"10.1038\/nn798"},{"key":"B84","doi-asserted-by":"publisher","DOI":"10.1038\/nn1743"},{"key":"B85","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3116-08.2008"},{"key":"B86","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2008.0092"},{"key":"B87","doi-asserted-by":"publisher","DOI":"10.1016\/S0893-133X(01)00427-4"},{"key":"B88","doi-asserted-by":"publisher","DOI":"10.1038\/nn1737"},{"key":"B89","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4305-05.2006"},{"key":"B90","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-006-0510-4"},{"key":"B91","doi-asserted-by":"publisher","DOI":"10.1002\/ajmg.b.10005"},{"key":"B92","first-page":"329","volume-title":"Behavioral Analysis of Drug Dependence","author":"O'Brien C. P.","year":"1986"},{"key":"B93","doi-asserted-by":"publisher","DOI":"10.1126\/science.1094285"},{"key":"B94","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0345-05.2005"},{"key":"B95","doi-asserted-by":"publisher","DOI":"10.1146\/annurev.neuro.25.112701.142937"},{"key":"B96","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3745-06.2007"},{"key":"B97","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2009.07.033"},{"key":"B98","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1301073"},{"key":"B99","doi-asserted-by":"publisher","DOI":"10.1126\/science.2781295"},{"key":"B100","doi-asserted-by":"publisher","DOI":"10.1016\/j.neubiorev.2003.11.013"},{"key":"B101","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.5578-03.2004"},{"key":"B102","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2008.0100"},{"key":"B103","doi-asserted-by":"publisher","DOI":"10.1126\/science.1102384"},{"key":"B104","doi-asserted-by":"publisher","DOI":"10.1017\/S0140525X0800472X"},{"key":"B105","doi-asserted-by":"publisher","DOI":"10.1037\/0033-295X.114.3.784"},{"key":"B106","doi-asserted-by":"publisher","DOI":"10.1196\/annals.1390.014"},{"key":"B107","doi-asserted-by":"publisher","DOI":"10.1016\/0165-0173(93)90013-P"},{"key":"B108","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1300561"},{"key":"B109","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1319-03.2004"},{"key":"B110","doi-asserted-by":"publisher","DOI":"10.1124\/jpet.102.038950"},{"key":"B111","doi-asserted-by":"publisher","DOI":"10.1038\/nn2013"},{"key":"B112","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.2572-09.2009"},{"key":"B113","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.4080-06.2007"},{"key":"B114","doi-asserted-by":"publisher","DOI":"10.1126\/science.1115270"},{"key":"B115","doi-asserted-by":"publisher","DOI":"10.1038\/nrn2753"},{"key":"B116","doi-asserted-by":"publisher","DOI":"10.1111\/j.1460-9568.2004.03274.x"},{"key":"B117","doi-asserted-by":"publisher","DOI":"10.1093\/cercor\/bhh216"},{"key":"B118","doi-asserted-by":"publisher","DOI":"10.1126\/science.275.5306.1593"},{"key":"B119","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuropharm.2004.07.005"},{"key":"B120","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.23-15-06295.2003"},{"key":"B121","doi-asserted-by":"publisher","DOI":"10.1124\/jpet.105.100339"},{"key":"B122","doi-asserted-by":"publisher","DOI":"10.1016\/j.neuroscience.2006.04.040"},{"key":"B123","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-008-1131-x"},{"key":"B124","doi-asserted-by":"publisher","DOI":"10.1007\/s00213-005-0211-4"},{"key":"B125","doi-asserted-by":"publisher","DOI":"10.1093\/brain\/awp054"},{"volume-title":"Reinforcement learning: An introduction","year":"1998","author":"Sutton R. S.","key":"B126"},{"key":"B127","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3975-04.2005"},{"key":"B128","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.07.011.2007"},{"key":"B129","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.01.014.2008"},{"key":"B130","doi-asserted-by":"publisher","DOI":"10.1046\/j.1471-4159.2001.00492.x"},{"key":"B131","doi-asserted-by":"publisher","DOI":"10.3389\/neuro.07.001.2009"},{"key":"B132","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.0925-05.2005"},{"key":"B133","doi-asserted-by":"publisher","DOI":"10.1126\/science.1098975"},{"key":"B134","doi-asserted-by":"publisher","DOI":"10.1038\/sj.mp.4001507"},{"key":"B135","doi-asserted-by":"publisher","DOI":"10.1001\/archpsyc.63.9.999"},{"issue":"9","key":"B136","doi-asserted-by":"crossref","first-page":"1440","DOI":"10.1176\/ajp.156.9.1440","volume":"156","author":"Volkow N. D.","year":"1999","journal-title":"American Journal of Psychiatry"},{"key":"B137","doi-asserted-by":"publisher","DOI":"10.1098\/rstb.2008.0107"},{"key":"B138","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.1544-06.2006"},{"key":"B139","doi-asserted-by":"publisher","DOI":"10.1038\/nn1452"},{"key":"B140","doi-asserted-by":"publisher","DOI":"10.1038\/sj.npp.1301194"},{"key":"B141","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.22-16-07225.2002"},{"key":"B142","doi-asserted-by":"publisher","DOI":"10.1523\/JNEUROSCI.3554-05.2006"},{"key":"B143","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pcbi.1000437"}],"container-title":["Neural Computation"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mitpressjournals.org\/doi\/pdf\/10.1162\/NECO_a_00009","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,2,22]],"date-time":"2025-02-22T05:09:41Z","timestamp":1740200981000},"score":1,"resource":{"primary":{"URL":"https:\/\/direct.mit.edu\/neco\/article\/22\/9\/2334-2368\/7571"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2010,9]]},"references-count":143,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2010,9]]}},"alternative-id":["10.1162\/NECO_a_00009"],"URL":"https:\/\/doi.org\/10.1162\/neco_a_00009","relation":{},"ISSN":["0899-7667","1530-888X"],"issn-type":[{"type":"print","value":"0899-7667"},{"type":"electronic","value":"1530-888X"}],"subject":[],"published":{"date-parts":[[2010,9]]}}}