{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,11,21]],"date-time":"2026-11-21T06:40:37Z","timestamp":1795243237965,"version":"4.10.3"},"reference-count":85,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T00:00:00Z","timestamp":1577059200000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T00:00:00Z","timestamp":1577059200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","award":["PDR T.0146.18"],"award-info":[{"award-number":["PDR T.0146.18"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100002661","name":"Fonds De La Recherche Scientifique - FNRS","doi-asserted-by":"publisher","award":["PDR T.0146.18"],"award-info":[{"award-number":["PDR T.0146.18"]}],"id":[{"id":"10.13039\/501100002661","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100020049","name":"Brugmann Foundation","doi-asserted-by":"crossref","id":[{"id":"10.13039\/501100020049","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>Compulsive behaviors (e.g., addiction) can be viewed as an aberrant decision process where inflexible reactions automatically evoked by stimuli (habit) take control over decision making to the detriment of a more flexible (goal-oriented) behavioral learning system. These behaviors are thought to arise from learning algorithms known as \u201cmodel-based\u201d and \u201cmodel-free\u201d reinforcement learning. Gambling disorder, a form of addiction without the confound of neurotoxic effects of drugs, showed impaired goal-directed control but the way in which problem gamblers (PG) orchestrate model-based and model-free strategies has not been evaluated. Forty-nine PG and 33 healthy participants (CP) completed a two-step sequential choice task for which model-based and model-free learning have distinct and identifiable trial-by-trial learning signatures. The influence of common psychopathological comorbidities on those two forms of learning were investigated. PG showed impaired model-based learning, particularly after unrewarded outcomes. In addition, PG exhibited faster reaction times than CP following unrewarded decisions. Troubled mood, higher impulsivity (i.e., positive and negative urgency) and current and chronic stress reported via questionnaires did not account for those results. These findings demonstrate specific reinforcement learning and decision-making deficits in behavioral addiction that advances our understanding and may be important dimensions for designing effective interventions.<\/jats:p>","DOI":"10.1038\/s41598-019-56161-z","type":"journal-article","created":{"date-parts":[[2019,12,23]],"date-time":"2019-12-23T06:03:17Z","timestamp":1577080997000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":65,"title":["Reduced model-based decision-making in gambling disorder"],"prefix":"10.1038","volume":"9","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4639-600X","authenticated-orcid":false,"given":"Florent","family":"Wyckmans","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"A. Ross","family":"Otto","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-6006-3201","authenticated-orcid":false,"given":"Miriam","family":"Sebold","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nathaniel","family":"Daw","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Antoine","family":"Bechara","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"M\u00e9lanie","family":"Saeremans","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Charles","family":"Kornreich","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Armand","family":"Chatard","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Nemat","family":"Jaafari","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Xavier","family":"No\u00ebl","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2019,12,23]]},"reference":[{"key":"56161_CR1","doi-asserted-by":"publisher","first-page":"1458","DOI":"10.1038\/nn1584","volume":"8","author":"A Bechara","year":"2005","unstructured":"Bechara, A. Decision making, impulse control and loss of willpower to resist drugs: a neurocognitive perspective. Nat. Neurosci. 8, 1458\u20131463 (2005).","journal-title":"Nat. Neurosci."},{"key":"56161_CR2","doi-asserted-by":"publisher","first-page":"1481","DOI":"10.1038\/nn1579","volume":"8","author":"BJ Everitt","year":"2005","unstructured":"Everitt, B. J. & Robbins, T. W. Neural systems of reinforcement for drug addiction: from actions to habits to compulsion. Nat. Neurosci. 8, 1481\u20131489 (2005).","journal-title":"Nat. Neurosci."},{"key":"56161_CR3","doi-asserted-by":"publisher","first-page":"632","DOI":"10.1016\/j.conb.2013.01.018","volume":"23","author":"X No\u00ebl","year":"2013","unstructured":"No\u00ebl, X., Brevers, D. & Bechara, A. A neurocognitive approach to understanding the neurobiology of addiction. Curr. Opin. Neurobiol. 23, 632\u2013638 (2013).","journal-title":"Curr. Opin. Neurobiol."},{"key":"56161_CR4","doi-asserted-by":"publisher","first-page":"3137","DOI":"10.1098\/rstb.2008.0093","volume":"363","author":"TE Robinson","year":"2008","unstructured":"Robinson, T. E. & Berridge, K. C. The incentive sensitization theory of addiction: some current issues. Philos. Trans. R. Soc. B Biol. Sci. 363, 3137\u20133146 (2008).","journal-title":"Philos. Trans. R. Soc. B Biol. Sci."},{"key":"56161_CR5","doi-asserted-by":"publisher","first-page":"886","DOI":"10.1016\/j.neuron.2018.03.048","volume":"98","author":"A Zilverstand","year":"2018","unstructured":"Zilverstand, A., Huang, A. S., Alia-Klein, N. & Goldstein, R. Z. Neuroimaging Impaired Response Inhibition and Salience Attribution in Human Drug Addiction: A Systematic Review. Neuron 98, 886\u2013903 (2018).","journal-title":"Neuron"},{"key":"56161_CR6","doi-asserted-by":"publisher","first-page":"14","DOI":"10.1007\/s11065-019-09402-x","volume":"29","author":"RSC Lee","year":"2019","unstructured":"Lee, R. S. C., Hoppenbrouwers, S. & Franken, I. A Systematic Meta-Review of Impulsivity and Compulsivity in Addictive Behaviors. Neuropsychol. Rev. 29, 14\u201326 (2019).","journal-title":"Neuropsychol. Rev."},{"key":"56161_CR7","doi-asserted-by":"publisher","first-page":"1163","DOI":"10.1016\/j.cpr.2013.09.004","volume":"33","author":"A Abramovitch","year":"2013","unstructured":"Abramovitch, A., Abramowitz, J. S. & Mittelman, A. The neuropsychology of adult obsessive\u2013compulsive disorder: A meta-analysis. Clin. Psychol. Rev. 33, 1163\u20131171 (2013).","journal-title":"Clin. Psychol. Rev."},{"key":"56161_CR8","doi-asserted-by":"publisher","first-page":"27","DOI":"10.1016\/j.neuron.2019.01.046","volume":"102","author":"TW Robbins","year":"2019","unstructured":"Robbins, T. W., Vaghi, M. M. & Banca, P. Obsessive-Compulsive Disorder: Puzzles and Prospects. Neuron 102, 27\u201347 (2019).","journal-title":"Neuron"},{"key":"56161_CR9","unstructured":"Reilly, C. & Smith, N. The evolving definition of pathological gambling in the DSM-5. Washington, Beverly (National Center for responsible gambling (2013)."},{"key":"56161_CR10","doi-asserted-by":"publisher","first-page":"469","DOI":"10.1007\/s00213-011-2550-7","volume":"219","author":"RF Leeman","year":"2012","unstructured":"Leeman, R. F. & Potenza, M. N. Similarities and differences between pathological gambling and substance use disorders: a focus on impulsivity and compulsivity. Psychopharmacology 219, 469\u2013490 (2012).","journal-title":"Psychopharmacology"},{"key":"56161_CR11","doi-asserted-by":"publisher","first-page":"674","DOI":"10.1038\/s41380-018-0230-2","volume":"24","author":"L Clark","year":"2019","unstructured":"Clark, L., Boileau, I. & Zack, M. Neuroimaging of reward mechanisms in Gambling disorder: an integrative review. Mol. Psychiatry 24, 674\u2013693 (2019).","journal-title":"Mol. Psychiatry"},{"key":"56161_CR12","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1016\/j.neubiorev.2007.11.003","volume":"32","author":"A Verdejo-Garc\u00eda","year":"2008","unstructured":"Verdejo-Garc\u00eda, A., Lawrence, A. J. & Clark, L. Impulsivity as a vulnerability marker for substance-use disorders: review of findings from high-risk research, problem gamblers and genetic association studies. Neurosci. Biobehav. Rev. 32, 777\u2013810 (2008).","journal-title":"Neurosci. Biobehav. Rev."},{"key":"56161_CR13","doi-asserted-by":"publisher","first-page":"48","DOI":"10.1038\/npp.2009.131","volume":"35","author":"BW Balleine","year":"2010","unstructured":"Balleine, B. W. & O\u2019Doherty, J. P. Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action. Neuropsychopharmacoly. 35, 48\u201369 (2010).","journal-title":"Neuropsychopharmacoly."},{"key":"56161_CR14","doi-asserted-by":"publisher","first-page":"e1002055","DOI":"10.1371\/journal.pcbi.1002055","volume":"7","author":"M Keramati","year":"2011","unstructured":"Keramati, M., Dezfouli, A. & Piray, P. Speed\/accuracy trade-off between the habitual and the goal-directed processes. PLoS Comput. Biol. 7, e1002055 (2011).","journal-title":"PLoS Comput. Biol."},{"key":"56161_CR15","doi-asserted-by":"publisher","first-page":"67","DOI":"10.1098\/rstb.1985.0010","volume":"308","author":"A Dickinson","year":"1985","unstructured":"Dickinson, A. Actions and Habits: The Development of Behavioural Autonomy. Philos. Trans. R. Soc. Lond. B. Biol. Sci. 308, 67\u201378 (1985).","journal-title":"Philos. Trans. R. Soc. Lond. B. Biol. Sci."},{"key":"56161_CR16","doi-asserted-by":"publisher","first-page":"1704","DOI":"10.1038\/nn1560","volume":"8","author":"ND Daw","year":"2005","unstructured":"Daw, N. D., Niv, Y. & Dayan, P. Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control. Nat. Neurosci. 8, 1704\u20131711 (2005).","journal-title":"Nat. Neurosci."},{"key":"56161_CR17","doi-asserted-by":"publisher","first-page":"312","DOI":"10.1016\/j.neuron.2013.09.007","volume":"80","author":"RJ Dolan","year":"2013","unstructured":"Dolan, R. J. & Dayan, P. Goals and habits in the brain. Neuron 80, 312\u2013325 (2013).","journal-title":"Neuron"},{"key":"56161_CR18","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1016\/j.biopsych.2017.04.006","volume":"82","author":"V Voon","year":"2017","unstructured":"Voon, V., Reiter, A., Sebold, M. & Groman, S. Model-Based Control in Dimensional Psychiatry. Biol. Psychiatry 82, 391\u2013400 (2017).","journal-title":"Biol. Psychiatry"},{"key":"56161_CR19","doi-asserted-by":"crossref","unstructured":"Gillan, C. M., Kosinski, M., Whelan, R., Phelps, E. A. & Daw, N. D. Characterizing a psychiatric symptom dimension related to deficits in goal-directed control. eLife 5 (2016).","DOI":"10.7554\/eLife.11305"},{"key":"56161_CR20","doi-asserted-by":"publisher","first-page":"567","DOI":"10.1038\/19208","volume":"398","author":"TW Robbins","year":"1999","unstructured":"Robbins, T. W. & Everitt, B. J. Drug addiction: bad habits add up. Nature 398, 567\u2013570 (1999).","journal-title":"Nature"},{"key":"56161_CR21","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1146\/annurev-psych-122414-033457","volume":"67","author":"BJ Everitt","year":"2016","unstructured":"Everitt, B. J. & Robbins, T. W. Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On. Annu. Rev. Psychol. 67, 23\u201350 (2016).","journal-title":"Annu. Rev. Psychol."},{"key":"56161_CR22","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1086\/261558","volume":"96","author":"GS Becker","year":"1988","unstructured":"Becker, G. S. & Murphy, K. M. A Theory of Rational Addiction. J. Polit. Econ. 96, 675\u2013700 (1988).","journal-title":"J. Polit. Econ."},{"key":"56161_CR23","doi-asserted-by":"crossref","unstructured":"Hogarth, L. A Critical Review of Habit Theory of Drug Dependence. In The Psychology of Habit (ed. Verplanken, B.) 325\u2013341 (Springer International Publishing, 2018).","DOI":"10.1007\/978-3-319-97529-0_18"},{"key":"56161_CR24","doi-asserted-by":"publisher","first-page":"1259","DOI":"10.1176\/ajp.142.11.1259","volume":"142","author":"EJ Khantzian","year":"1985","unstructured":"Khantzian, E. J. The self-medication hypothesis of addictive disorders: focus on heroin and cocaine dependence. Am. J. Psychiatry 142, 1259\u20131264 (1985).","journal-title":"Am. J. Psychiatry"},{"key":"56161_CR25","doi-asserted-by":"crossref","unstructured":"Furlong, T. M. & Corbit, L. H. Chapter 16 - Drug Addiction: Augmented Habit Learning or Failure of Goal-Directed Control? in Goal-Directed Decision Making (eds. Morris, R., Bornstein, A. & Shenhav, A.) 367\u2013386 (Academic Press, 2018).","DOI":"10.1016\/B978-0-12-812098-9.00016-4"},{"key":"56161_CR26","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1037\/mot0000065","volume":"4","author":"J De Houwer","year":"2018","unstructured":"De Houwer, J., Tanaka, A., Moors, A. & Tibboel, H. Kicking the habit: Why evidence for habits in humans might be overestimated. Motiv. Sci. 4, 50\u201359 (2018).","journal-title":"Motiv. Sci."},{"key":"56161_CR27","doi-asserted-by":"publisher","first-page":"331","DOI":"10.1080\/0272499024400016","volume":"55","author":"A Dickinson","year":"2002","unstructured":"Dickinson, A., Wood, N. & Smith, J. W. Alcohol Seeking by Rats: Action or Habit? Q. J. Exp. Psychol. Sect. B 55, 331\u2013348 (2002).","journal-title":"Q. J. Exp. Psychol. Sect. B"},{"key":"56161_CR28","doi-asserted-by":"publisher","first-page":"1352","DOI":"10.1126\/science.1158136","volume":"320","author":"D Belin","year":"2008","unstructured":"Belin, D., Mar, A. C., Dalley, J. W., Robbins, T. W. & Everitt, B. J. High impulsivity predicts the switch to compulsive cocaine-taking. Science 320, 1352\u20131355 (2008).","journal-title":"Science"},{"key":"56161_CR29","doi-asserted-by":"publisher","first-page":"e337","DOI":"10.1038\/tp.2013.107","volume":"3","author":"Z Sjoerds","year":"2013","unstructured":"Sjoerds, Z. et al. Behavioral and neuroimaging evidence for overreliance on habit learning in alcohol-dependent patients. Transl. Psychiatry 3, e337\u2013e337 (2013).","journal-title":"Transl. Psychiatry"},{"key":"56161_CR30","doi-asserted-by":"publisher","first-page":"1468","DOI":"10.1126\/science.aaf3700","volume":"352","author":"KD Ersche","year":"2016","unstructured":"Ersche, K. D. et al. Carrots and sticks fail to change behavior in cocaine addiction. Science 352, 1468\u20131471 (2016).","journal-title":"Science"},{"key":"56161_CR31","doi-asserted-by":"publisher","first-page":"284","DOI":"10.1176\/appi.ajp.2014.14040525","volume":"172","author":"CM Gillan","year":"2015","unstructured":"Gillan, C. M. et al. Functional Neuroimaging of Avoidance Habits in Obsessive-Compulsive Disorder. Am. J. Psychiatry 172, 284\u2013293 (2015).","journal-title":"Am. J. Psychiatry"},{"key":"56161_CR32","doi-asserted-by":"crossref","unstructured":"Lucantonio, F., Caprioli, D. & Schoenbaum, G. Transition from \u2018model-based\u2019 to \u2018model-free\u2019 behavioral control in addiction: involvement of the orbitofrontal cortex and dorsolateral striatum. Neuropharmacology 76 (2014).","DOI":"10.1016\/j.neuropharm.2013.05.033"},{"key":"56161_CR33","doi-asserted-by":"publisher","first-page":"345","DOI":"10.1038\/mp.2014.44","volume":"20","author":"V Voon","year":"2015","unstructured":"Voon, V. et al. Disorders of compulsivity: a common bias towards learning habits. Mol. Psychiatry 20, 345\u2013352 (2015).","journal-title":"Mol. Psychiatry"},{"key":"56161_CR34","doi-asserted-by":"publisher","first-page":"777","DOI":"10.1037\/abn0000164","volume":"125","author":"AJ Culbreth","year":"2016","unstructured":"Culbreth, A. J., Westbrook, A., Daw, N. D., Botvinick, M. & Barch, D. M. Reduced Model-Based Decision-Making in Schizophrenia. J. Abnorm. Psychol. 125, 777\u2013787 (2016).","journal-title":"J. Abnorm. Psychol."},{"key":"56161_CR35","doi-asserted-by":"publisher","first-page":"122","DOI":"10.1159\/000362840","volume":"70","author":"M Sebold","year":"2014","unstructured":"Sebold, M. et al. Model-Based and Model-Free Decisions in Alcohol Dependence. Neuropsychobiology 70, 122\u2013131 (2014).","journal-title":"Neuropsychobiology"},{"key":"56161_CR36","doi-asserted-by":"publisher","first-page":"847","DOI":"10.1016\/j.biopsych.2017.04.019","volume":"82","author":"M Sebold","year":"2017","unstructured":"Sebold, M. et al. When Habits Are Dangerous: Alcohol Expectancies and Habitual Decision Making Predict Relapse in Alcohol Dependence. Biol. Psychiatry 82, 847\u2013856 (2017).","journal-title":"Biol. Psychiatry"},{"key":"56161_CR37","doi-asserted-by":"publisher","first-page":"515","DOI":"10.1111\/adb.12505","volume":"23","author":"N Do\u00f1amayor","year":"2018","unstructured":"Do\u00f1amayor, N., Strelchuk, D., Baek, K., Banca, P. & Voon, V. The involuntary nature of binge drinking: goal directedness and awareness of intention: Automaticity of binge drinking. Addict. Biol. 23, 515\u2013526 (2018).","journal-title":"Addict. Biol."},{"key":"56161_CR38","doi-asserted-by":"publisher","first-page":"379","DOI":"10.1111\/adb.12490","volume":"23","author":"S Nebe","year":"2018","unstructured":"Nebe, S. et al. No association of goal-directed and habitual control with alcohol consumption in young adults: Alcohol use and learning. Addict. Biol. 23, 379\u2013393 (2018).","journal-title":"Addict. Biol."},{"key":"56161_CR39","doi-asserted-by":"crossref","unstructured":"Reiter, A. M. F., Deserno, L., Wilbertz, T., Heinze, H.-J. & Schlagenhauf, F. Risk Factors for Addiction and Their Association with Model-Based Behavioral Control. Front. Behav. Neurosci. 10 (2016).","DOI":"10.3389\/fnbeh.2016.00026"},{"key":"56161_CR40","doi-asserted-by":"crossref","unstructured":"Gillan, C. M. et al. Comparison of the Association Between Goal-Directed Planning and Self-reported Compulsivity vs Obsessive-Compulsive Disorder Diagnosis. JAMA Psychiatry 1\u201310 (2019).","DOI":"10.1001\/jamapsychiatry.2019.2998"},{"key":"56161_CR41","doi-asserted-by":"publisher","first-page":"1305","DOI":"10.1038\/mp.2013.163","volume":"19","author":"I Boileau","year":"2014","unstructured":"Boileau, I. et al. In vivo evidence for greater amphetamine-induced dopamine release in pathological gambling: a positron emission tomography study with [11C]-(+)-PHNO. Mol. Psychiatry 19, 1305\u20131313 (2014).","journal-title":"Mol. Psychiatry"},{"key":"56161_CR42","doi-asserted-by":"publisher","first-page":"163","DOI":"10.1007\/s00213-009-1645-x","volume":"207","author":"AJ Lawrence","year":"2009","unstructured":"Lawrence, A. J., Luty, J., Bogdan, N. A., Sahakian, B. J. & Clark, L. Impulsivity and response inhibition in alcohol dependence and problem gambling. Psychopharmacology 207, 163\u2013172 (2009).","journal-title":"Psychopharmacology"},{"key":"56161_CR43","doi-asserted-by":"publisher","first-page":"1204","DOI":"10.1016\/j.neuron.2011.02.027","volume":"69","author":"ND Daw","year":"2011","unstructured":"Daw, N. D., Gershman, S. J., Seymour, B., Dayan, P. & Dolan, R. J. Model-Based Influences on Humans\u2019 Choices and Striatal Prediction Errors. Neuron 69, 1204\u20131215 (2011).","journal-title":"Neuron"},{"key":"56161_CR44","doi-asserted-by":"publisher","DOI":"10.1038\/s41598-017-16433-y","volume":"7","author":"A Genauck","year":"2017","unstructured":"Genauck, A. Reduced loss aversion in pathological gambling and alcohol dependence is associated with differential alterations in amygdala and prefrontal functioning. Sci. Rep. 7, 11 (2017).","journal-title":"Sci. Rep."},{"key":"56161_CR45","unstructured":"Lesieur, H. R. The Chase: Career of the Compulsive Gambler (Schenkman Books Inc., 1984)."},{"key":"56161_CR46","doi-asserted-by":"publisher","first-page":"751","DOI":"10.1177\/0956797612463080","volume":"24","author":"AR Otto","year":"2013","unstructured":"Otto, A. R., Gershman, S. J., Markman, A. B. & Daw, N. D. The curse of planning: dissecting multiple reinforcement-learning systems by taxing the central executive. Psychol. Sci. 24, 751\u2013761 (2013).","journal-title":"Psychol. Sci."},{"key":"56161_CR47","doi-asserted-by":"crossref","unstructured":"American Psychiatric Association. American Psychiatric Association. & DSM-5 Task Force. Diagnostic and statistical manual of mental disorders: DSM-5 (2013).","DOI":"10.1176\/appi.books.9780890425596"},{"key":"56161_CR48","doi-asserted-by":"publisher","first-page":"1595","DOI":"10.1073\/pnas.1417219112","volume":"112","author":"L Deserno","year":"2015","unstructured":"Deserno, L. et al. Ventral striatal dopamine reflects behavioral and neural signatures of model-based control during sequential decision making. Proc. Natl. Acad. Sci. USA 112, 1595\u20131600 (2015).","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"56161_CR49","doi-asserted-by":"publisher","first-page":"985","DOI":"10.1162\/jocn_a_00945","volume":"28","author":"M Sebold","year":"2016","unstructured":"Sebold, M. et al. Don\u2019t Think, Just Feel the Music: Individuals with Strong Pavlovian-to-Instrumental Transfer Effects Rely Less on Model-based Reinforcement Learning. J. Cogn. Neurosci. 28, 985\u2013995 (2016).","journal-title":"J. Cogn. Neurosci."},{"key":"56161_CR50","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1348\/000712699161503","volume":"90","author":"PH Delabbro","year":"1999","unstructured":"Delabbro, P. H. & Winefield, A. H. Poker-machine gambling: An analysis of within session characteristics. Br. J. Psychol. 90, 425\u2013439 (1999).","journal-title":"Br. J. Psychol."},{"key":"56161_CR51","doi-asserted-by":"publisher","first-page":"147","DOI":"10.1037\/xhp0000284","volume":"43","author":"F Verbruggen","year":"2017","unstructured":"Verbruggen, F., Chambers, C. D., Lawrence, N. S. & McLaren, I. P. L. Winning and losing: Effects on impulsive action. J. Exp. Psychol. Hum. Percept. Perform. 43, 147\u2013168 (2017).","journal-title":"J. Exp. Psychol. Hum. Percept. Perform."},{"key":"56161_CR52","doi-asserted-by":"publisher","first-page":"415","DOI":"10.1017\/S0140525X0800472X","volume":"31","author":"AD Redish","year":"2008","unstructured":"Redish, A. D., Jensen, S. & Johnson, A. A unified framework for addiction: Vulnerabilities in the decision process. Behav. Brain Sci. 31, 415\u2013487 (2008).","journal-title":"Behav. Brain Sci."},{"key":"56161_CR53","doi-asserted-by":"publisher","first-page":"784","DOI":"10.1037\/0033-295X.114.3.784","volume":"114","author":"AD Redish","year":"2007","unstructured":"Redish, A. D., Jensen, S., Johnson, A. & Kurth-Nelson, Z. Reconciling reinforcement learning models with behavioral extinction and renewal: Implications for addiction, relapse, and problem gambling. Psychol. Rev. 114, 784\u2013805 (2007).","journal-title":"Psychol. Rev."},{"key":"56161_CR54","doi-asserted-by":"publisher","first-page":"1027","DOI":"10.1038\/npp.2008.175","volume":"34","author":"MB de Ruiter","year":"2009","unstructured":"de Ruiter, M. B. et al. Response Perseveration and Ventral Prefrontal Sensitivity to Reward and Punishment in Male Problem Gamblers and Smokers. Neuropsychopharmacology 34, 1027\u20131038 (2009).","journal-title":"Neuropsychopharmacology"},{"key":"56161_CR55","doi-asserted-by":"publisher","first-page":"1940","DOI":"10.1126\/science.1102941","volume":"306","author":"MJ Frank","year":"2004","unstructured":"Frank, M. J., Seeberger, L. C. & O\u2019reilly, R. C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science 306, 1940\u20131943 (2004).","journal-title":"Science"},{"key":"56161_CR56","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1038\/nn.2723","volume":"14","author":"TV Maia","year":"2011","unstructured":"Maia, T. V. & Frank, M. J. From reinforcement learning models to psychiatric and neurological disorders. Nat. Neurosci. 14, 154\u2013162 (2011).","journal-title":"Nat. Neurosci."},{"key":"56161_CR57","doi-asserted-by":"publisher","first-page":"151","DOI":"10.1037\/a0024782","volume":"121","author":"NM Petry","year":"2012","unstructured":"Petry, N. M. Discounting of probabilistic rewards is associated with gambling abstinence in treatment-seeking pathological gamblers. J. Abnorm. Psychol. 121, 151\u2013159 (2012).","journal-title":"J. Abnorm. Psychol."},{"key":"56161_CR58","doi-asserted-by":"publisher","first-page":"425","DOI":"10.1016\/j.biopsych.2018.06.018","volume":"85","author":"EH Patzelt","year":"2019","unstructured":"Patzelt, E. H., Kool, W., Millner, A. J. & Gershman, S. J. Incentives Boost Model-Based Control Across a Range of Severity on Several Psychiatric Constructs. Biol. Psychiatry 85, 425\u2013433 (2019).","journal-title":"Biol. Psychiatry"},{"key":"56161_CR59","doi-asserted-by":"publisher","first-page":"12500","DOI":"10.1523\/JNEUROSCI.3283-07.2007","volume":"27","author":"S Fecteau","year":"2007","unstructured":"Fecteau, S. et al. Diminishing Risk-Taking Behavior by Modulating Activity in the Prefrontal Cortex: A Direct Current Stimulation Study. J. Neurosci. 27, 12500\u201312505 (2007).","journal-title":"J. Neurosci."},{"key":"56161_CR60","doi-asserted-by":"publisher","first-page":"23","DOI":"10.1007\/s00221-005-2334-6","volume":"166","author":"F Fregni","year":"2005","unstructured":"Fregni, F. et al. Anodal transcranial direct current stimulation of prefrontal cortex enhances working memory. Exp. Brain Res. 166, 23\u201330 (2005).","journal-title":"Exp. Brain Res."},{"key":"56161_CR61","doi-asserted-by":"publisher","first-page":"113","DOI":"10.1016\/S0028-3932(03)00124-6","volume":"42","author":"TZ Kincses","year":"2004","unstructured":"Kincses, T. Z., Antal, A., Nitsche, M. A., B\u00e1rtfai, O. & Paulus, W. Facilitation of probabilistic classification learning by transcranial direct current stimulation of the prefrontal cortex in the human. Neuropsychologia 42, 113\u2013117 (2004).","journal-title":"Neuropsychologia"},{"key":"56161_CR62","doi-asserted-by":"crossref","unstructured":"Weissengruber, S., Lee, S. W., O\u2019Doherty, J. P. & Ruff, C. C. Neurostimulation Reveals Context-Dependent Arbitration Between Model-Based and Model-Free Reinforcement Learning. Cereb. Cortex, 1\u201313 (2019).","DOI":"10.1093\/cercor\/bhz019"},{"key":"56161_CR63","doi-asserted-by":"publisher","first-page":"914","DOI":"10.1016\/j.neuron.2013.08.009","volume":"80","author":"P Smittenaar","year":"2013","unstructured":"Smittenaar, P., FitzGerald, T. H. B., Romei, V., Wright, N. D. & Dolan, R. J. Disruption of Dorsolateral Prefrontal Cortex Decreases Model-Based in Favor of Model-free Control in Humans. Neuron 80, 914\u2013919 (2013).","journal-title":"Neuron"},{"key":"56161_CR64","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1038\/npp.2008.121","volume":"34","author":"JR St Onge","year":"2009","unstructured":"St Onge, J. R. & Floresco, S. B. Dopaminergic modulation of risk-based decision making. Neuropsychopharmacoly. 34, 681\u2013697 (2009).","journal-title":"Neuropsychopharmacoly."},{"key":"56161_CR65","doi-asserted-by":"publisher","first-page":"391","DOI":"10.1007\/s00213-006-0578-x","volume":"191","author":"KC Berridge","year":"2007","unstructured":"Berridge, K. C. The debate over dopamine\u2019s role in reward: the case for incentive salience. Psychopharmacology. 191, 391\u2013431 (2007).","journal-title":"Psychopharmacology."},{"key":"56161_CR66","doi-asserted-by":"publisher","first-page":"171","DOI":"10.1023\/B:JOGS.0000022308.27774.2b","volume":"20","author":"J Joukhador","year":"2004","unstructured":"Joukhador, J., Blaszczynski, A. & Maccallum, F. Superstitious Beliefs in Gambling Among Problem and Non-Problem Gamblers: Preliminary Data. J. Gambl. Stud. 20, 171\u2013180 (2004).","journal-title":"J. Gambl. Stud."},{"key":"56161_CR67","doi-asserted-by":"publisher","first-page":"17617","DOI":"10.1523\/JNEUROSCI.3231-13.2013","volume":"33","author":"L Clark","year":"2013","unstructured":"Clark, L. et al. Pathological Choice: The Neuroscience of Gambling and Gambling Addiction. J. Neurosci. 33, 17617\u201317623 (2013).","journal-title":"J. Neurosci."},{"key":"56161_CR68","doi-asserted-by":"publisher","first-page":"1369","DOI":"10.3758\/BF03206327","volume":"32","author":"P Ayton","year":"2004","unstructured":"Ayton, P. & Fischer, I. The hot hand fallacy and the gambler\u2019s fallacy: Two faces of subjective randomness? Mem. Cognit. 32, 1369\u20131378 (2004).","journal-title":"Mem. Cognit."},{"key":"56161_CR69","doi-asserted-by":"crossref","unstructured":"Kool, W., Cushman, F. A. & Gershman, S. J. Competition and Cooperation Between Multiple Reinforcement Learning Systems. in Goal-Directed Decision Making 153\u2013178 (Elsevier, 2018).","DOI":"10.1016\/B978-0-12-812098-9.00007-3"},{"key":"56161_CR70","doi-asserted-by":"publisher","first-page":"700","DOI":"10.1016\/j.tics.2015.08.013","volume":"19","author":"Y-L Boureau","year":"2015","unstructured":"Boureau, Y.-L., Sokol-Hessner, P. & Daw, N. D. Deciding How To Decide: Self-Control and Meta-Decision Making. Trends Cogn. Sci. 19, 700\u2013710 (2015).","journal-title":"Trends Cogn. Sci."},{"key":"56161_CR71","doi-asserted-by":"publisher","first-page":"541","DOI":"10.1111\/j.1360-0443.1993.tb02061.x","volume":"88","author":"KR Coventry","year":"1993","unstructured":"Coventry, K. R. & Brown, R. I. Sensation seeking, gambling and gambling addictions. Addiction 88, 541\u2013554 (1993).","journal-title":"Addiction"},{"key":"56161_CR72","doi-asserted-by":"publisher","first-page":"936","DOI":"10.1016\/j.biopsych.2018.12.017","volume":"11","author":"SM Groman","year":"2019","unstructured":"Groman, S. M., Massi, B., Mathias, S. R., Lee, D. & Taylor, J. R. Model-Free and Model-Based Influences in Addiction-Related Behaviors. Biol. Psychiatry 11, 936\u2013945 (2019).","journal-title":"Biol. Psychiatry"},{"key":"56161_CR73","doi-asserted-by":"publisher","first-page":"849","DOI":"10.1001\/archpsyc.1994.03950110009002","volume":"51","author":"JI Nurnberger","year":"1994","unstructured":"Nurnberger, J. I. et al. Diagnostic interview for genetic studies. Rationale, unique features, and training. NIMH Genetics Initiative. Arch. Gen. Psychiatry 51, 849\u2013859 (1994).","journal-title":"Arch. Gen. Psychiatry"},{"key":"56161_CR74","unstructured":"Ferris, J. & Wynne, H. The Canadian problem gambling index. Final report Ottawa: Canadian Centre on Substance Abuse (2001)."},{"key":"56161_CR75","doi-asserted-by":"publisher","first-page":"769","DOI":"10.3758\/BF03196772","volume":"12","author":"ARA Conway","year":"2005","unstructured":"Conway, A. R. A. et al. Working memory span tasks: A methodological review and user\u2019s guide. Psychon. Bull. Rev. 12, 769\u2013786 (2005).","journal-title":"Psychon. Bull. Rev."},{"key":"56161_CR76","doi-asserted-by":"publisher","first-page":"791","DOI":"10.1111\/j.1360-0443.1993.tb02093.x","volume":"88","author":"JB Saunders","year":"1993","unstructured":"Saunders, J. B., Aasland, O. G., Babor, T. F., De La Fuente, J. R. & Grant, M. Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption-II. Addiction 88, 791\u2013804 (1993).","journal-title":"Addiction"},{"key":"56161_CR77","doi-asserted-by":"publisher","first-page":"2001","DOI":"10.1097\/01.alc.0000187034.58955.64","volume":"29","author":"P Gache","year":"2005","unstructured":"Gache, P. et al. The Alcohol Use Disorders Identification Test (AUDIT) as a Screening Tool for Excessive Drinking in Primary Care: Reliability and Validity of a French Version. Alcohol. Clin. Exp. Res. 29, 2001\u20132007 (2005).","journal-title":"Alcohol. Clin. Exp. Res."},{"key":"56161_CR78","doi-asserted-by":"publisher","first-page":"1119","DOI":"10.1111\/j.1360-0443.1991.tb01879.x","volume":"86","author":"T Heatherton","year":"1991","unstructured":"Heatherton, T., Kozlowski, L., Frecker, R. & Fagerstr\u00f6m, K. O. The Fagerstr\u00f6m test for nicotine dependence: a revision of the Fagerstrom Tolerance Questionnaire. Addiction 86, 1119\u20131127 (1991).","journal-title":"Addiction"},{"key":"56161_CR79","doi-asserted-by":"publisher","first-page":"981","DOI":"10.1002\/1097-4679(197710)33:4<981::AID-JCLP2270330412>3.0.CO;2-0","volume":"33","author":"LB Derogatis","year":"1977","unstructured":"Derogatis, L. B. & Cleary, P. A. Confirmation of the Dimensional Structure of the Scl-90: A Study in Construct Validation. J. Clin. Psychol. 33, 981\u2013989 (1977).","journal-title":"J. Clin. Psychol."},{"key":"56161_CR80","doi-asserted-by":"publisher","first-page":"1063","DOI":"10.1037\/0022-3514.54.6.1063","volume":"54","author":"D Watson","year":"1988","unstructured":"Watson, D., Anna, L. & Tellegen, A. Development and Validation of Brief Measures of Positive and Negative Affect: The PANAS Scales. J. Pers. Soc. Psychol. 54, 1063\u20131070 (1988).","journal-title":"J. Pers. Soc. Psychol."},{"key":"56161_CR81","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1016\/0272-7358(88)90050-5","volume":"8","author":"AT Beck","year":"1988","unstructured":"Beck, A. T., Steer, R. A. & Carbin, M. G. Psychometric properties of the Beck Depression Inventory: Twenty-five years of evaluation. Clin. Psychol. Rev. 8, 77\u2013100 (1988).","journal-title":"Clin. Psychol. Rev."},{"key":"56161_CR82","unstructured":"Spielberger, C. D., Gorsuch, R. L., Lushene, R., Vagg, P. & Jacobs, G. Manual for the State-Trait Anxiety Inventory (Consulting Psychologists Press, 1983)."},{"key":"56161_CR83","doi-asserted-by":"publisher","first-page":"213","DOI":"10.1016\/0022-3999(67)90010-4","volume":"11","author":"TH Holmes","year":"1967","unstructured":"Holmes, T. H. & Rahe, R. H. The social readjustment rating scale. J. Psychosom. Res. 11, 213\u2013218 (1967).","journal-title":"J. Psychosom. Res."},{"key":"56161_CR84","doi-asserted-by":"publisher","first-page":"559","DOI":"10.1002\/per.556","volume":"19","author":"SP Whiteside","year":"2005","unstructured":"Whiteside, S. P., Lynam, D. R., Miller, J. D. & Reynolds, S. K. Validation of the UPPS impulsive behaviour scale: a four\u2010factor model of impulsivity. Eur. J. Personal. 19, 559\u2013574 (2005).","journal-title":"Eur. J. Personal."},{"key":"56161_CR85","doi-asserted-by":"publisher","first-page":"20941","DOI":"10.1073\/pnas.1312011110","volume":"110","author":"AR Otto","year":"2013","unstructured":"Otto, A. R., Raio, C. M., Chiang, A., Phelps, E. A. & Daw, N. D. Working-memory capacity protects model-based learning from stress. Proc. Natl. Acad. Sci. USA 110, 20941\u201320946 (2013).","journal-title":"Proc. Natl. Acad. Sci. USA"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-56161-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-56161-z","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-56161-z.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,17]],"date-time":"2022-12-17T12:48:23Z","timestamp":1671281303000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-019-56161-z"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,12,23]]},"references-count":85,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2019,12]]}},"alternative-id":["56161"],"URL":"https:\/\/doi.org\/10.1038\/s41598-019-56161-z","relation":{},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,12,23]]},"assertion":[{"value":"28 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"2 December 2019","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"23 December 2019","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing interests"}}],"article-number":"19625"}}