{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,1,13]],"date-time":"2026-01-13T16:20:59Z","timestamp":1768321259262,"version":"3.49.0"},"reference-count":40,"publisher":"Royal College of Psychiatrists","issue":"1","license":[{"start":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T00:00:00Z","timestamp":1702252800000},"content-version":"unspecified","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000265","name":"Medical Research Council","doi-asserted-by":"publisher","id":[{"id":"10.13039\/501100000265","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/100018436","name":"Ministerio de Sanidad, Pol\u00edtica Social e Igualdad","doi-asserted-by":"publisher","id":[{"id":"10.13039\/100018436","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["cambridge.org"],"crossmark-restriction":true},"short-container-title":["BJPsych open"],"published-print":{"date-parts":[[2024,1]]},"abstract":"<jats:sec id=\"S2056472423006117_sec_a1\">\n\t    <jats:title>Background<\/jats:title>\n\t    <jats:p>Individuals with cocaine use disorder or gambling disorder demonstrate impairments in cognitive flexibility: the ability to adapt to changes in the environment. Flexibility is commonly assessed in a laboratory setting using probabilistic reversal learning, which involves reinforcement learning, the process by which feedback from the environment is used to adjust behavior.<\/jats:p>\n\t  <\/jats:sec>\n\t  <jats:sec id=\"S2056472423006117_sec_a2\">\n\t    <jats:title>Aims<\/jats:title>\n\t    <jats:p>It is poorly understood whether impairments in flexibility differ between individuals with cocaine use and gambling disorders, and how this is instantiated by the brain. We applied computational modelling methods to gain a deeper mechanistic explanation of the latent processes underlying cognitive flexibility across two disorders of compulsivity.<\/jats:p>\n\t  <\/jats:sec>\n\t  <jats:sec id=\"S2056472423006117_sec_a3\" sec-type=\"methods\">\n\t    <jats:title>Method<\/jats:title>\n\t    <jats:p>We present a re-analysis of probabilistic reversal data from individuals with either gambling disorder (<jats:italic>n<\/jats:italic> = 18) or cocaine use disorder (<jats:italic>n<\/jats:italic> = 20) and control participants (<jats:italic>n<\/jats:italic> = 18), using a hierarchical Bayesian approach. Furthermore, we relate behavioural findings to their underlying neural substrates through an analysis of task-based functional magnetic resonanceimaging (fMRI) data.<\/jats:p>\n\t  <\/jats:sec>\n\t  <jats:sec id=\"S2056472423006117_sec_a4\" sec-type=\"results\">\n\t    <jats:title>Results<\/jats:title>\n\t    <jats:p>We observed lower \u2018stimulus stickiness\u2019 in gambling disorder, and report differences in tracking expected values in individuals with gambling disorder compared to controls, with greater activity during reward expected value tracking in the cingulate gyrus and amygdala. In cocaine use disorder, we observed lower responses to positive punishment prediction errors and greater activity following negative punishment prediction errors in the superior frontal gyrus compared to controls.<\/jats:p>\n\t  <\/jats:sec>\n\t  <jats:sec id=\"S2056472423006117_sec_a5\" sec-type=\"conclusions\">\n\t    <jats:title>Conclusions<\/jats:title>\n\t    <jats:p>Using a computational approach, we show that individuals with gambling disorder and cocaine use disorder differed in their perseverative tendencies and in how they tracked value neurally, which has implications for psychiatric classification.<\/jats:p>\n\t  <\/jats:sec>","DOI":"10.1192\/bjo.2023.611","type":"journal-article","created":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T07:42:56Z","timestamp":1702280576000},"update-policy":"https:\/\/doi.org\/10.1017\/policypage","source":"Crossref","is-referenced-by-count":3,"title":["Computational modelling of reinforcement learning and functional neuroimaging of probabilistic reversal for dissociating compulsive behaviours in gambling and cocaine use disorders"],"prefix":"10.1192","volume":"10","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-8501-4529","authenticated-orcid":false,"given":"Katharina","family":"Z\u00fchlsdorff","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Juan","family":"Verdejo-Rom\u00e1n","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Luke","family":"Clark","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Natalia","family":"Albein-Urios","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Carles","family":"Soriano-Mas","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rudolf N.","family":"Cardinal","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Trevor W.","family":"Robbins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jeffrey W.","family":"Dalley","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Antonio","family":"Verdejo-Garc\u00eda","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jonathan W.","family":"Kanen","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"170","published-online":{"date-parts":[[2023,12,11]]},"reference":[{"key":"S2056472423006117_ref9","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1016\/j.jpsychires.2016.06.010","article-title":"Cognitive flexibility correlates with gambling severity in young adults","volume":"81","author":"Leppink","year":"2016","journal-title":"J Psychiatr Res"},{"key":"S2056472423006117_ref12","doi-asserted-by":"crossref","first-page":"2163","DOI":"10.1038\/s41386-019-0381-0","article-title":"Withdrawal from escalated cocaine self-administration impairs reversal learning by disrupting the effects of negative feedback on reward exploitation: a behavioral and computational analysis","volume":"44","author":"Zhukovsky","year":"2019","journal-title":"Neuropsychopharmacology"},{"key":"S2056472423006117_ref24","doi-asserted-by":"crossref","first-page":"1370","DOI":"10.1006\/nimg.2001.0931","article-title":"Temporal autocorrelation in univariate linear modeling of FMRI data","volume":"14","author":"Woolrich","year":"2001","journal-title":"Neuroimage"},{"key":"S2056472423006117_ref4","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1186\/s40359-020-00482-6","article-title":"Decision-making inflexibility in a reversal learning task is associated with severity of problem gambling symptoms but not with a diagnosis of substance use disorder","volume":"8","author":"Jara-Rizzo","year":"2020","journal-title":"BMC Psychol"},{"key":"S2056472423006117_ref32","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.1556\/2006.2020.00088","article-title":"Gambling disorder is associated with reduced sensitivity to expected value during risky choice","volume":"9","author":"Limbrick-Oldfield","year":"2021","journal-title":"J Behav Addict"},{"key":"S2056472423006117_ref35","doi-asserted-by":"crossref","first-page":"1872","DOI":"10.1523\/JNEUROSCI.2777-14.2015","article-title":"Impaired neural response to negative prediction errors in cocaine addiction","volume":"35","author":"Parvaz","year":"2015","journal-title":"J Neurosci"},{"key":"S2056472423006117_ref40","doi-asserted-by":"crossref","first-page":"1225","DOI":"10.1001\/archpsyc.63.11.1225","article-title":"Reduced orbitofrontal-striatal activity on a reversal learning task in obsessive-compulsive disorder","volume":"63","author":"Remijnse","year":"2006","journal-title":"Arch Gen Psychiatry"},{"key":"S2056472423006117_ref38","doi-asserted-by":"crossref","first-page":"652","DOI":"10.1038\/nrn3119","article-title":"Dysfunction of the prefrontal cortex in addiction: neuroimaging findings and clinical implications","volume":"12","author":"Goldstein","year":"2011","journal-title":"Nat Rev Neurosci"},{"key":"S2056472423006117_ref14","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1176\/ajp.2007.164.1.43","article-title":"Is decreased prefrontal cortical sensitivity to monetary reward associated with impaired motivation and self-control in cocaine addiction?","volume":"164","author":"Goldstein","year":"2007","journal-title":"Am J Psychiatry"},{"key":"S2056472423006117_ref11","doi-asserted-by":"crossref","first-page":"1054","DOI":"10.1109\/TNN.1998.712192","article-title":"Reinforcement learning: an introduction","volume":"9","author":"Sutton","year":"1998","journal-title":"IEEE Trans Neural Netw"},{"key":"S2056472423006117_ref28","doi-asserted-by":"crossref","first-page":"3064","DOI":"10.1093\/cercor\/bhu102","article-title":"Role of central serotonin in anticipation of rewarding and punishing outcomes: effects of selective amygdala or orbitofrontal 5-HT depletion","volume":"25","author":"Rygula","year":"2015","journal-title":"Cereb Cortex"},{"key":"S2056472423006117_ref18","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1007\/s10899-011-9278-5","article-title":"Neural correlates of pathological gamblers preference for immediate rewards during the Iowa gambling task: an fMRI study","volume":"28","author":"Power","year":"2012","journal-title":"J Gambl Stud"},{"key":"S2056472423006117_ref25","doi-asserted-by":"crossref","first-page":"2325","DOI":"10.1007\/s00213-019-05292-2","article-title":"Dopaminergic drug treatment remediates exaggerated cingulate prediction error responses in obsessive-compulsive disorder","volume":"236","author":"Murray","year":"2019","journal-title":"Psychopharmacol"},{"key":"S2056472423006117_ref5","doi-asserted-by":"crossref","first-page":"106534","DOI":"10.1016\/j.addbeh.2020.106534","article-title":"Decision-making (in)flexibility in gambling disorder","volume":"112","author":"Perandr\u00e9s-G\u00f3mez","year":"2021","journal-title":"Addict Behav"},{"key":"S2056472423006117_ref2","doi-asserted-by":"crossref","first-page":"680","DOI":"10.1016\/j.neuron.2011.01.020","article-title":"Impulsivity, compulsivity, and top-down cognitive control","volume":"69","author":"Dalley","year":"2011","journal-title":"Neuron"},{"key":"S2056472423006117_ref22","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1192\/bjp.bp.114.152223","article-title":"Neural substrates of cognitive flexibility in cocaine and gambling addictions","volume":"207","author":"Verdejo-Garcia","year":"2015","journal-title":"Br J Psychiatry"},{"key":"S2056472423006117_ref31","doi-asserted-by":"crossref","first-page":"867","DOI":"10.1093\/ijnp\/pyab041","article-title":"Impaired learning from negative feedback in stimulant use disorder: dopaminergic modulation","volume":"24","author":"Lim","year":"2021","journal-title":"Int J Neuropsychopharmacol"},{"key":"S2056472423006117_ref15","doi-asserted-by":"crossref","first-page":"4563","DOI":"10.1523\/JNEUROSCI.22-11-04563.2002","article-title":"Defining the neural mechanisms of probabilistic reversal learning using event-related functional magnetic resonance imaging","volume":"22","author":"Cools","year":"2002","journal-title":"J Neurosci"},{"key":"S2056472423006117_ref37","doi-asserted-by":"crossref","first-page":"40","DOI":"10.1111\/j.1749-6632.2011.05958.x","article-title":"Cognitive control and right ventrolateral prefrontal cortex: reflexive reorienting, motor inhibition, and action updating","volume":"1224","author":"Levy","year":"2011","journal-title":"Ann N Y Acad Sci"},{"key":"S2056472423006117_ref13","doi-asserted-by":"crossref","first-page":"2337","DOI":"10.1007\/s00213-019-05325-w","article-title":"Computational modelling reveals contrasting effects on reinforcement learning and cognitive flexibility in stimulant use disorder and obsessive-compulsive disorder: remediating effects of dopaminergic D2\/3 receptor agents","volume":"236","author":"Kanen","year":"2019","journal-title":"Psychopharmacology (Berl)"},{"key":"S2056472423006117_ref16","doi-asserted-by":"crossref","first-page":"209","DOI":"10.1192\/bjp.187.3.209","article-title":"Substance use disorders and the orbitofrontal cortex: systematic review of behavioural decision-making and neuroimaging studies","volume":"187","author":"Dom","year":"2005","journal-title":"Br J Psychiatry"},{"key":"S2056472423006117_ref7","doi-asserted-by":"crossref","first-page":"183","DOI":"10.1016\/S0893-133X(01)00355-4","article-title":"Impairments of reversal learning and response perseveration after repeated, intermittent cocaine administrations to monkeys","volume":"26","author":"Jentsch","year":"2002","journal-title":"Neuropsychopharmacology"},{"key":"S2056472423006117_ref8","doi-asserted-by":"crossref","first-page":"1997","DOI":"10.1111\/j.1460-9568.2004.03274.x","article-title":"Cocaine-experienced rats exhibit learning deficits in a task sensitive to orbitofrontal cortex lesions","volume":"19","author":"Schoenbaum","year":"2004","journal-title":"Eur J Neurosci"},{"key":"S2056472423006117_ref23","volume-title":"Stan Modeling Language User's Guide and Reference Manual, Version 2.19.2","year":"2020"},{"key":"S2056472423006117_ref30","doi-asserted-by":"crossref","first-page":"1297","DOI":"10.1016\/j.neubiorev.2013.03.023","article-title":"Prediction error in reinforcement learning: a meta-analysis of neuroimaging studies","volume":"37","author":"Garrison","year":"2013","journal-title":"Neurosci Biobehav Rev"},{"key":"S2056472423006117_ref20","doi-asserted-by":"crossref","first-page":"100507","DOI":"10.1016\/j.ynstr.2022.100507","article-title":"Sex-dependent effects of early life stress on reinforcement learning and limbic cortico-striatal functional connectivity","volume":"22","author":"Z\u00fchlsdorff","year":"2023","journal-title":"Neurobiol Stress"},{"key":"S2056472423006117_ref3","doi-asserted-by":"crossref","first-page":"469","DOI":"10.1007\/s00213-011-2550-7","article-title":"Similarities and differences between pathological gambling and substance use disorders: a focus on impulsivity and compulsivity","volume":"219","author":"Leeman","year":"2012","journal-title":"Psychopharmacology (Berl)"},{"key":"S2056472423006117_ref17","doi-asserted-by":"crossref","first-page":"313","DOI":"10.1901\/jeab.2010.93-313","article-title":"Neurobehavioral evidence for the \u201cnear-miss\u201d effect in pathological gamblers","volume":"93","author":"Habib","year":"2010","journal-title":"J Exp Anal Behav"},{"key":"S2056472423006117_ref34","doi-asserted-by":"crossref","first-page":"1356","DOI":"10.1176\/appi.ajp.2013.12091257","article-title":"Reduced neural tracking of prediction error in substance-dependent individuals","volume":"170","author":"Tanabe","year":"2013","journal-title":"Am J Psychiatry"},{"key":"S2056472423006117_ref33","doi-asserted-by":"crossref","first-page":"741","DOI":"10.1016\/j.biopsych.2011.12.030","article-title":"Distorted expectancy coding in problem gambling: is the addictive in the anticipation?","volume":"71","author":"Van Holst","year":"2012","journal-title":"Biol Psychiatry"},{"key":"S2056472423006117_ref27","doi-asserted-by":"crossref","DOI":"10.1016\/j.neuroimage.2004.07.051","article-title":"Advances in functional and structural MR image analysis and implementation as FSL","volume":"23","author":"Smith","year":"2004","journal-title":"Neuroimage"},{"key":"S2056472423006117_ref29","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1038\/46035","article-title":"Conflict monitoring versus selection for-action in anterior cingulate cortex","volume":"402","author":"Botvinick","year":"1999","journal-title":"Nature"},{"key":"S2056472423006117_ref39","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1016\/j.neubiorev.2020.11.027","article-title":"The neural basis of gambling disorder: an activation likelihood estimation meta-analysis","volume":"120","author":"Raimo","year":"2021","journal-title":"Neurosci Biobehav Rev"},{"key":"S2056472423006117_ref26","doi-asserted-by":"crossref","first-page":"1732","DOI":"10.1016\/j.neuroimage.2003.12.023","article-title":"Multilevel linear modelling for fMRI group analysis using Bayesian inference","volume":"21","author":"Woolrich","year":"2004","journal-title":"Neuroimage"},{"key":"S2056472423006117_ref6","doi-asserted-by":"crossref","first-page":"754","DOI":"10.1016\/j.biopsych.2011.06.033","article-title":"Response perseveration in stimulant dependence is associated with striatal dysfunction and can be ameliorated by a D2\/3 receptor agonist","volume":"70","author":"Ersche","year":"2011","journal-title":"Biol Psychiatry"},{"key":"S2056472423006117_ref36","first-page":"291","article-title":"In cocaine dependence, neural prediction errors during loss avoidance are increased with cocaine deprivation and predict drug use","volume":"4","author":"Wang","year":"2019","journal-title":"Biol Psychiatry Cogn Neurosci Neuroimaging"},{"key":"S2056472423006117_ref10","doi-asserted-by":"crossref","first-page":"204","DOI":"10.1016\/j.neubiorev.2017.11.022","article-title":"Compulsivity-related neurocognitive performance deficits in gambling disorder: a systematic review and meta-analysis","volume":"84","author":"van Timmeren","year":"2018","journal-title":"Neurosci Biobehav Rev"},{"key":"S2056472423006117_ref1","volume-title":"Diagnostic and Statistical Manual of Mental Disorders","year":"2013"},{"key":"S2056472423006117_ref19","doi-asserted-by":"crossref","first-page":"1027","DOI":"10.1038\/npp.2008.175","article-title":"Response perseveration and ventral prefrontal sensitivity to reward and punishment in male problem gamblers and smokers","volume":"34","author":"De Ruiter","year":"2008","journal-title":"Neuropsychopharmacol"},{"key":"S2056472423006117_ref21","unstructured":"21 Zuhlsdorff, K . Investigating reinforcement learning processes in depression and substance use disorder: translational, computational and neuroimaging approaches. DPhil doctoral thesis Department of Psychology, University of Cambridge, 2022."}],"container-title":["BJPsych Open"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.cambridge.org\/core\/services\/aop-cambridge-core\/content\/view\/S2056472423006117","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,12,11]],"date-time":"2023-12-11T07:43:16Z","timestamp":1702280596000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.cambridge.org\/core\/product\/identifier\/S2056472423006117\/type\/journal_article"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,12,11]]},"references-count":40,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2024,1]]}},"alternative-id":["S2056472423006117"],"URL":"https:\/\/doi.org\/10.1192\/bjo.2023.611","relation":{},"ISSN":["2056-4724"],"issn-type":[{"value":"2056-4724","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,12,11]]},"assertion":[{"value":"Copyright \u00a9 The Author(s), 2023. Published by Cambridge University Press on behalf of the Royal College of Psychiatrists","name":"copyright","label":"Copyright","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http:\/\/creativecommons.org\/licenses\/by\/4.0\/), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.","name":"license","label":"License","group":{"name":"copyright_and_licensing","label":"Copyright and Licensing"}},{"value":"This content has been made available to all.","name":"free","label":"Free to read"}],"article-number":"e8"}}