{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,12]],"date-time":"2026-03-12T14:48:11Z","timestamp":1773326891477,"version":"3.50.1"},"reference-count":67,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2017,7,24]],"date-time":"2017-07-24T00:00:00Z","timestamp":1500854400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2017,7,24]],"date-time":"2017-07-24T00:00:00Z","timestamp":1500854400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Sci Rep"],"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:p>The dopamine partial agonist aripiprazole is increasingly used to treat pathologies for which other antipsychotics are indicated because it displays fewer side effects, such as sedation and depression-like symptoms, than other dopamine receptor antagonists. Previously, we showed that aripiprazole may protect motivational function by preserving reinforcement-related signals used to sustain reward-maximization. However, the effect of aripiprazole on more cognitive facets of human reinforcement learning, such as learning from the forgone outcomes of alternative courses of action (i.e., counterfactual learning), is unknown. To test the influence of aripiprazole on counterfactual learning, we administered a reinforcement learning task that involves both direct learning from obtained outcomes and indirect learning from forgone outcomes to two groups of Gilles de la Tourette (GTS) patients, one consisting of patients who were completely unmedicated and the other consisting of patients who were receiving aripiprazole monotherapy, and to healthy subjects. We found that whereas learning performance improved in the presence of counterfactual feedback in both healthy controls and unmedicated GTS patients, this was not the case in aripiprazole-medicated GTS patients. Our results suggest that whereas aripiprazole preserves direct learning of action-outcome associations, it may impair more complex inferential processes, such as counterfactual learning from forgone outcomes, in GTS patients treated with this medication.<\/jats:p>","DOI":"10.1038\/s41598-017-06547-8","type":"journal-article","created":{"date-parts":[[2017,7,18]],"date-time":"2017-07-18T08:00:06Z","timestamp":1500364806000},"update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":11,"title":["Specific effect of a dopamine partial agonist on counterfactual learning: evidence from Gilles de la Tourette syndrome"],"prefix":"10.1038","volume":"7","author":[{"given":"Alexandre","family":"Salvador","sequence":"first","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yulia","family":"Worbe","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"C\u00e9cile","family":"Delorme","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Giorgio","family":"Coricelli","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Rapha\u00ebl","family":"Gaillard","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Trevor W.","family":"Robbins","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Andreas","family":"Hartmann","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-5768-6646","authenticated-orcid":false,"given":"Stefano","family":"Palminteri","sequence":"additional","affiliation":[],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"297","published-online":{"date-parts":[[2017,7,24]]},"reference":[{"key":"6547_CR1","doi-asserted-by":"publisher","first-page":"681","DOI":"10.1001\/archpsyc.60.7.681","volume":"60","author":"SG Potkin","year":"2003","unstructured":"Potkin, S. G. et al. Aripiprazole, an antipsychotic with a novel mechanism of action, and risperidone vs placebo in patients with schizophrenia and schizoaffective disorder. Arch Gen Psychiatry \n                           60, 681\u2013690 (2003).","journal-title":"Arch Gen Psychiatry"},{"key":"6547_CR2","doi-asserted-by":"publisher","first-page":"1048","DOI":"10.4088\/JCP.v64n0910","volume":"64","author":"TA Pigott","year":"2003","unstructured":"Pigott, T. A. et al. Aripiprazole for the prevention of relapse in stabilized patients with chronic schizophrenia: a placebo-controlled 26-week study. J Clin Psychiatry \n                           64, 1048\u20131056 (2003).","journal-title":"J Clin Psychiatry"},{"key":"6547_CR3","doi-asserted-by":"publisher","first-page":"763","DOI":"10.4088\/JCP.v63n0903","volume":"63","author":"JM Kane","year":"2002","unstructured":"Kane, J. M. et al. Efficacy and safety of aripiprazole and haloperidol versus placebo in patients with schizophrenia and schizoaffective disorder. J Clin Psychiatry \n                           63, 763\u2013771 (2002).","journal-title":"J Clin Psychiatry"},{"key":"6547_CR4","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1080\/15622970701762544","volume":"10","author":"W Kawohl","year":"2009","unstructured":"Kawohl, W., Schneider, F., Vernaleken, I. & Neuner, I. Aripiprazole in the pharmacotherapy of Gilles de la Tourette syndrome in adult patients. The world journal of biological psychiatry \n                           10, 827\u2013831 (2009).","journal-title":"The world journal of biological psychiatry"},{"key":"6547_CR5","doi-asserted-by":"publisher","first-page":"364","DOI":"10.1002\/hup.2235","volume":"27","author":"I Neuner","year":"2012","unstructured":"Neuner, I., Nordt, C., Schneider, F. & Kawohl, W. Effectiveness of aripiprazole in the treatment of adult Tourette patients up to 56 months. Hum Psychopharmacol \n                           27, 364\u2013369 (2012).","journal-title":"Hum Psychopharmacol"},{"key":"6547_CR6","doi-asserted-by":"publisher","first-page":"1629","DOI":"10.1185\/03007995.2014.908280","volume":"30","author":"L Citrome","year":"2014","unstructured":"Citrome, L., Kalsekar, I., Baker, R. A. & Hebden, T. A review of real-world data on the effects of aripiprazole on weight and metabolic outcomes in adults. Curr Med Res Opin \n                           30, 1629\u20131641 (2014).","journal-title":"Curr Med Res Opin"},{"key":"6547_CR7","doi-asserted-by":"publisher","first-page":"947","DOI":"10.1176\/appi.ajp.2011.10111609","volume":"168","author":"TS Stroup","year":"2011","unstructured":"Stroup, T. S. et al. A randomized trial examining the effectiveness of switching from olanzapine, quetiapine, or risperidone to aripiprazole to reduce metabolic risk: comparison of antipsychotics for metabolic problems (CAMP). Am J Psychiatry \n                           168, 947\u2013956 (2011).","journal-title":"Am J Psychiatry"},{"key":"6547_CR8","doi-asserted-by":"publisher","first-page":"1157","DOI":"10.1016\/j.neubiorev.2012.10.014","volume":"37","author":"A Hartmann","year":"2013","unstructured":"Hartmann, A. & Worbe, Y. Pharmacological treatment of Gilles de la Tourette syndrome. Neurosci Biobehav Rev \n                           37, 1157\u20131161 (2013).","journal-title":"Neurosci Biobehav Rev"},{"key":"6547_CR9","doi-asserted-by":"publisher","first-page":"1940","DOI":"10.1126\/science.1102941","volume":"306","author":"MJ Frank","year":"2004","unstructured":"Frank, M. J., Seeberger, L. C. & O\u2019reilly, R. C. By carrot or by stick: cognitive reinforcement learning in parkinsonism. Science \n                           306, 1940\u20131943 (2004).","journal-title":"Science"},{"key":"6547_CR10","doi-asserted-by":"publisher","first-page":"2366","DOI":"10.1038\/npp.2014.84","volume":"39","author":"C Eisenegger","year":"2014","unstructured":"Eisenegger, C. et al. Role of dopamine D2 receptors in human reinforcement learning. Neuropsychopharmacology \n                           39, 2366\u20132375 (2014).","journal-title":"Neuropsychopharmacology"},{"key":"6547_CR11","doi-asserted-by":"publisher","first-page":"1042","DOI":"10.1038\/nature05051","volume":"442","author":"M Pessiglione","year":"2006","unstructured":"Pessiglione, M., Seymour, B., Flandin, G., Dolan, R. J. & Frith, C. D. Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans. Nature \n                           442, 1042\u20131045 (2006).","journal-title":"Nature"},{"key":"6547_CR12","doi-asserted-by":"publisher","first-page":"1257","DOI":"10.1001\/archgenpsychiatry.2011.137","volume":"68","author":"Y Worbe","year":"2011","unstructured":"Worbe, Y. et al. Reinforcement learning and Gilles de la Tourette syndrome: dissociation of clinical phenotypes and pharmacological treatments. Arch Gen Psychiatry \n                           68, 1257\u20131266 (2011).","journal-title":"Arch Gen Psychiatry"},{"key":"6547_CR13","doi-asserted-by":"publisher","first-page":"94","DOI":"10.1016\/j.cobeha.2014.10.004","volume":"1","author":"JP O\u2019Doherty","year":"2015","unstructured":"O\u2019Doherty, J. P., Lee, S. W. & McNamee, D. The structure of reinforcement-learning mechanisms in the human brain. Current Opinion in Behavioral Sciences \n                           1, 94\u2013100 (2015).","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"6547_CR14","doi-asserted-by":"publisher","first-page":"241","DOI":"10.1098\/rstb.2009.0159","volume":"365","author":"G Coricelli","year":"2010","unstructured":"Coricelli, G. & Rustichini, A. Counterfactual thinking and emotions: regret and envy learning. Philosophical transactions of the Royal Society of London. Series B, Biological sciences \n                           365, 241\u2013247 (2010).","journal-title":"Series B, Biological sciences"},{"key":"6547_CR15","doi-asserted-by":"publisher","first-page":"258","DOI":"10.1016\/j.tics.2007.04.003","volume":"11","author":"G Coricelli","year":"2007","unstructured":"Coricelli, G., Dolan, R. J. & Sirigu, A. Brain, emotion and decision making: the paradigmatic example of regret. Trends in cognitive sciences \n                           11, 258\u2013265 (2007).","journal-title":"Trends in cognitive sciences"},{"key":"6547_CR16","doi-asserted-by":"publisher","first-page":"e1001093","DOI":"10.1371\/journal.pbio.1001093","volume":"9","author":"ED Boorman","year":"2011","unstructured":"Boorman, E. D., Behrens, T. E. & Rushworth, M. F. Counterfactual choice and learning in a neural network centered on human lateral frontopolar cortex. PLoS biology \n                           9, e1001093 (2011).","journal-title":"PLoS biology"},{"key":"6547_CR17","doi-asserted-by":"publisher","first-page":"1243","DOI":"10.1016\/j.neuron.2013.07.006","volume":"79","author":"AG Fischer","year":"2013","unstructured":"Fischer, A. G. & Ullsperger, M. Real and fictive outcomes are processed differently but converge on a common adaptive mechanism. Neuron \n                           79, 1243\u20131255 (2013).","journal-title":"Neuron"},{"key":"6547_CR18","doi-asserted-by":"crossref","unstructured":"Koechlin, E. An evolutionary computational theory of prefrontal executive function in decision-making. Philosophical transactions of the Royal Society of London. Series B, Biological sciences \n                           369 (2014).","DOI":"10.1098\/rstb.2013.0474"},{"key":"6547_CR19","doi-asserted-by":"publisher","first-page":"200","DOI":"10.1073\/pnas.1513619112","volume":"113","author":"KT Kishida","year":"2016","unstructured":"Kishida, K. T. et al. Subsecond dopamine fluctuations in human striatum encode superposed error signals about actual and counterfactual reward. Proceedings of the National Academy of Sciences of the United States of America \n                           113, 200\u2013205 (2016).","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"key":"6547_CR20","doi-asserted-by":"publisher","first-page":"5504","DOI":"10.1523\/JNEUROSCI.6316-10.2011","volume":"31","author":"J Li","year":"2011","unstructured":"Li, J. & Daw, N. D. Signals in human striatum are appropriate for policy update rather than value prediction. The Journal of neuroscience \n                           31, 5504\u20135511 (2011).","journal-title":"The Journal of neuroscience"},{"key":"6547_CR21","doi-asserted-by":"publisher","first-page":"57","DOI":"10.1016\/j.neuroimage.2013.11.051","volume":"89","author":"MJ Tobia","year":"2014","unstructured":"Tobia, M. J. et al. Neural systems for choice and valuation with counterfactual learning signals. NeuroImage \n                           89, 57\u201369 (2014).","journal-title":"NeuroImage"},{"key":"6547_CR22","doi-asserted-by":"publisher","first-page":"8096","DOI":"10.1038\/ncomms9096","volume":"6","author":"S Palminteri","year":"2015","unstructured":"Palminteri, S., Khamassi, M., Joffily, M. & Coricelli, G. Contextual modulation of value signals in reward and punishment learning. Nat Commun \n                           6, 8096 (2015).","journal-title":"Nat Commun"},{"key":"6547_CR23","doi-asserted-by":"publisher","first-page":"1577","DOI":"10.1016\/S0140-6736(02)11526-1","volume":"360","author":"JF Leckman","year":"2002","unstructured":"Leckman, J. F. Tourette\u2019s syndrome. Lancet \n                           360, 1577\u20131586 (2002).","journal-title":"Lancet"},{"key":"6547_CR24","doi-asserted-by":"publisher","first-page":"149","DOI":"10.1016\/S1474-4422(05)70018-1","volume":"4","author":"HS Singer","year":"2005","unstructured":"Singer, H. S. Tourette\u2019s syndrome: from behaviour to biology. Lancet Neurol \n                           4, 149\u2013159 (2005).","journal-title":"Lancet Neurol"},{"key":"6547_CR25","doi-asserted-by":"publisher","first-page":"13465","DOI":"10.1523\/JNEUROSCI.1500-09.2009","volume":"29","author":"S Palminteri","year":"2009","unstructured":"Palminteri, S., Boraud, T., Lafargue, G., Dubois, B. & Pessiglione, M. Brain hemispheres selectively track the expected value of contralateral options. J Neurosci \n                           29, 13465\u201313472 (2009).","journal-title":"J Neurosci"},{"key":"6547_CR26","doi-asserted-by":"publisher","first-page":"e1004953","DOI":"10.1371\/journal.pcbi.1004953","volume":"12","author":"S Palminteri","year":"2016","unstructured":"Palminteri, S., Kilford, E. J., Coricelli, G. & Blakemore, S.-J. The Computational Development of Reinforcement Learning during Adolescence. PLoS computational biology \n                           12, e1004953 (2016).","journal-title":"PLoS computational biology"},{"key":"6547_CR27","doi-asserted-by":"publisher","first-page":"1797","DOI":"10.1098\/rstb.2004.1549","volume":"359","author":"AA Baird","year":"2004","unstructured":"Baird, A. A. & Fugelsang, J. A. The emergence of consequential thought: evidence from neuroscience. Philosophical transactions of the Royal Society of London. Series B, Biological sciences \n                           359, 1797\u20131804 (2004).","journal-title":"Series B, Biological sciences"},{"key":"6547_CR28","doi-asserted-by":"publisher","first-page":"514","DOI":"10.1038\/nn2067","volume":"11","author":"PH Chiu","year":"2008","unstructured":"Chiu, P. H., Lohrenz, T. M. & Montague, P. R. Smokers\u2019 brains compute, but ignore, a fictive error signal in a sequential investment task. Nature neuroscience \n                           11, 514\u2013520 (2008).","journal-title":"Nature neuroscience"},{"key":"6547_CR29","doi-asserted-by":"publisher","first-page":"1930","DOI":"10.1001\/jamainternmed.2014.5262","volume":"174","author":"TJ Moore","year":"2014","unstructured":"Moore, T. J., Glenmullen, J. & Mattison, D. R. Reports of pathological gambling, hypersexuality, and compulsive shopping associated with dopamine receptor agonist drugs. JAMA internal medicine \n                           174, 1930\u20131933 (2014).","journal-title":"JAMA internal medicine"},{"key":"6547_CR30","doi-asserted-by":"publisher","first-page":"238","DOI":"10.1037\/a0035165","volume":"22","author":"MR Lofwall","year":"2014","unstructured":"Lofwall, M. R., Nuzzo, P. A., Campbell, C. & Walsh, S. L. Aripiprazole effects on self-administration and pharmacodynamics of intravenous cocaine and cigarette smoking in humans. Experimental and clinical psychopharmacology \n                           22, 238\u2013247 (2014).","journal-title":"Experimental and clinical psychopharmacology"},{"key":"6547_CR31","doi-asserted-by":"publisher","first-page":"137","DOI":"10.1016\/S0014-2999(02)01532-7","volume":"441","author":"S Jordan","year":"2002","unstructured":"Jordan, S. et al. The antipsychotic aripiprazole is a potent, partial agonist at the human 5-HT1A receptor. European journal of pharmacology \n                           441, 137\u2013140 (2002).","journal-title":"European journal of pharmacology"},{"key":"6547_CR32","doi-asserted-by":"publisher","first-page":"141","DOI":"10.2174\/1568007024606195","volume":"1","author":"CA Tamminga","year":"2002","unstructured":"Tamminga, C. A. & Carlsson, A. Partial dopamine agonists and dopaminergic stabilizers, in the treatment of psychosis. Current drug targets CNS and neurological disorders \n                           1, 141\u2013147 (2002).","journal-title":"Current drug targets CNS and neurological disorders"},{"key":"6547_CR33","doi-asserted-by":"publisher","first-page":"806","DOI":"10.1177\/0269881111405555","volume":"26","author":"N Yasui-Furukori","year":"2012","unstructured":"Yasui-Furukori, N., Kaneda, A., Sugawara, N., Tomita, T. & Kaneko, S. Effect of adjunctive treatment with aripiprazole to atypical antipsychotics on cognitive function in schizophrenia patients. J Psychopharmacol \n                           26, 806\u2013812 (2012).","journal-title":"J Psychopharmacol"},{"key":"6547_CR34","doi-asserted-by":"publisher","first-page":"189","DOI":"10.1016\/j.schres.2010.01.022","volume":"118","author":"F Schlagenhauf","year":"2010","unstructured":"Schlagenhauf, F. et al. Switching schizophrenia patients from typical neuroleptics to aripiprazole: effects on working memory dependent functional activation. Schizophr Res \n                           118, 189\u2013200 (2010).","journal-title":"Schizophr Res"},{"key":"6547_CR35","doi-asserted-by":"publisher","first-page":"161","DOI":"10.1016\/j.pnpbp.2010.10.021","volume":"35","author":"H Suzuki","year":"2011","unstructured":"Suzuki, H., Gen, K. & Inoue, Y. An unblinded comparison of the clinical and cognitive effects of switching from first-generation antipsychotics to aripiprazole, perospirone or olanzapine in patients with chronic schizophrenia. Prog Neuropsychopharmacol Biol Psychiatry \n                           35, 161\u2013168 (2011).","journal-title":"Prog Neuropsychopharmacol Biol Psychiatry"},{"key":"6547_CR36","doi-asserted-by":"publisher","first-page":"23","DOI":"10.3389\/fnana.2013.00023","volume":"7","author":"C Wang","year":"2013","unstructured":"Wang, C., Zheng, D., Xu, J., Lam, W. & Yew, D. T. Brain damages in ketamine addicts as revealed by magnetic resonance imaging. Front Neuroanat \n                           7, 23 (2013).","journal-title":"Front Neuroanat"},{"key":"6547_CR37","doi-asserted-by":"publisher","first-page":"60","DOI":"10.9758\/cpn.2013.11.2.60","volume":"11","author":"BJ Lee","year":"2013","unstructured":"Lee, B. J. et al. Effect of aripiprazole on cognitive function and hyperprolactinemia in patients with schizophrenia treated with risperidone. Clin Psychopharmacol Neurosci \n                           11, 60\u201366 (2013).","journal-title":"Clin Psychopharmacol Neurosci"},{"key":"6547_CR38","doi-asserted-by":"publisher","first-page":"575","DOI":"10.1016\/j.euroneuro.2013.12.009","volume":"24","author":"A Maat","year":"2014","unstructured":"Maat, A. et al. Open, randomized trial of the effects of aripiprazole versus risperidone on social cognition in schizophrenia. Eur Neuropsychopharmacol \n                           24, 575\u2013584 (2014).","journal-title":"Eur Neuropsychopharmacol"},{"key":"6547_CR39","doi-asserted-by":"publisher","first-page":"219","DOI":"10.3109\/08039488.2013.799228","volume":"68","author":"C-B Yeh","year":"2014","unstructured":"Yeh, C.-B. et al. Neurocognitive effects of aripiprazole in adolescents and young adults with schizophrenia. Nord J Psychiatry \n                           68, 219\u2013224 (2014).","journal-title":"Nord J Psychiatry"},{"key":"6547_CR40","doi-asserted-by":"publisher","first-page":"221","DOI":"10.1007\/s00213-012-2953-0","volume":"227","author":"E Kim","year":"2013","unstructured":"Kim, E. et al. The relationship between antipsychotic D2 occupancy and change in frontal metabolism and working memory: A dual [(11)C]raclopride and [(18)F]FDG imaging study with aripiprazole. Psychopharmacology \n                           227, 221\u2013229 (2013).","journal-title":"Psychopharmacology"},{"key":"6547_CR41","doi-asserted-by":"publisher","first-page":"272","DOI":"10.1002\/hbm.21436","volume":"34","author":"R Handley","year":"2013","unstructured":"Handley, R. et al. Acute effects of single-dose aripiprazole and haloperidol on resting cerebral blood flow (rCBF) in the human brain. Hum Brain Mapp \n                           34, 272\u2013282 (2013).","journal-title":"Hum Brain Mapp"},{"key":"6547_CR42","doi-asserted-by":"publisher","first-page":"296","DOI":"10.3389\/fnhum.2015.00296","volume":"9","author":"I Bolstad","year":"2015","unstructured":"Bolstad, I. et al. No difference in frontal cortical activity during an executive functioning task after acute doses of aripiprazole and haloperidol. Frontiers in human neuroscience \n                           9, 296 (2015).","journal-title":"Frontiers in human neuroscience"},{"key":"6547_CR43","doi-asserted-by":"publisher","first-page":"157","DOI":"10.1016\/j.neulet.2005.06.035","volume":"387","author":"A Zocchi","year":"2005","unstructured":"Zocchi, A., Fabbri, D. & Heidbreder, C. A. Aripiprazole increases dopamine but not noradrenaline and serotonin levels in the mouse prefrontal cortex. Neuroscience letters \n                           387, 157\u2013161 (2005).","journal-title":"Neuroscience letters"},{"key":"6547_CR44","doi-asserted-by":"publisher","first-page":"765","DOI":"10.1016\/j.neuropharm.2011.08.031","volume":"62","author":"S Tanahashi","year":"2012","unstructured":"Tanahashi, S., Yamamura, S., Nakagawa, M., Motomura, E. & Okada, M. Dopamine D2 and serotonin 5-HT1A receptors mediate the actions of aripiprazole in mesocortical and mesoaccumbens transmission. Neuropharmacology \n                           62, 765\u2013774 (2012).","journal-title":"Neuropharmacology"},{"key":"6547_CR45","doi-asserted-by":"publisher","first-page":"418","DOI":"10.1016\/j.neuron.2012.03.042","volume":"75","author":"K Wunderlich","year":"2012","unstructured":"Wunderlich, K., Smittenaar, P. & Dolan, R. J. Dopamine enhances model-based over model-free choice behavior. Neuron \n                           75, 418\u2013424 (2012).","journal-title":"Neuron"},{"key":"6547_CR46","doi-asserted-by":"publisher","first-page":"624","DOI":"10.1038\/mp.2015.46","volume":"21","author":"Y Worbe","year":"2016","unstructured":"Worbe, Y. et al. Valence-dependent influence of serotonin depletion on model-based choice strategy. Molecular psychiatry \n                           21, 624\u2013629 (2016).","journal-title":"Molecular psychiatry"},{"key":"6547_CR47","doi-asserted-by":"publisher","first-page":"1211","DOI":"10.1523\/JNEUROSCI.1901-15.2016","volume":"36","author":"BB Doll","year":"2016","unstructured":"Doll, B. B., Bath, K. G., Daw, N. D. & Frank, M. J. Variability in Dopamine Genes Dissociates Model-Based and Model-Free Reinforcement Learning. The Journal of neuroscience \n                           36, 1211\u20131222 (2016).","journal-title":"The Journal of neuroscience"},{"key":"6547_CR48","doi-asserted-by":"publisher","first-page":"355","DOI":"10.1093\/brain\/awv347","volume":"139","author":"ME Sharp","year":"2016","unstructured":"Sharp, M. E., Foerde, K., Daw, N. D. & Shohamy, D. Dopamine selectively remediates\u2019model-based\u2019 reward learning: a computational approach. Brain \n                           139, 355\u2013364 (2016).","journal-title":"Brain"},{"key":"6547_CR49","doi-asserted-by":"publisher","first-page":"e1333","DOI":"10.1371\/journal.pone.0001333","volume":"2","author":"SC Tanaka","year":"2007","unstructured":"Tanaka, S. C. et al. Serotonin differentially regulates short- and long-term prediction of rewards in the ventral and dorsal striatum. PloS one \n                           2, e1333 (2007).","journal-title":"PloS one"},{"key":"6547_CR50","doi-asserted-by":"publisher","first-page":"745","DOI":"10.1007\/s00213-007-0698-y","volume":"191","author":"A Bortolozzi","year":"2007","unstructured":"Bortolozzi, A., D\u00edaz-Mataix, L., Toth, M., Celada, P. & Artigas, F. In vivo actions of aripiprazole on serotonergic and dopaminergic systems in rodent brain. Psychopharmacology \n                           191, 745\u2013758 (2007).","journal-title":"Psychopharmacology"},{"key":"6547_CR51","first-page":"123","volume":"85","author":"AM Graybiel","year":"2001","unstructured":"Graybiel, A. M. & Canales, J. J. The neurobiology of repetitive behaviors: clues to the neurobiology of Tourette syndrome. Adv Neurol \n                           85, 123\u2013131 (2001).","journal-title":"Adv Neurol"},{"key":"6547_CR52","doi-asserted-by":"publisher","first-page":"175","DOI":"10.1016\/j.tins.2006.01.001","volume":"29","author":"RL Albin","year":"2006","unstructured":"Albin, R. L. & Mink, J. W. Recent advances in Tourette syndrome research. Trends Neurosci \n                           29, 175\u2013182 (2006).","journal-title":"Trends Neurosci"},{"key":"6547_CR53","doi-asserted-by":"publisher","first-page":"1359","DOI":"10.1176\/ajp.152.9.1359","volume":"152","author":"RT Malison","year":"1995","unstructured":"Malison, R. T. et al. [123I]beta-CIT SPECT imaging of striatal dopamine transporter binding in Tourette\u2019s disorder. Am J Psychiatry \n                           152, 1359\u20131361 (1995).","journal-title":"Am J Psychiatry"},{"key":"6547_CR54","doi-asserted-by":"publisher","first-page":"1695","DOI":"10.1212\/01.wnl.0000242733.18534.2c","volume":"67","author":"DL Gilbert","year":"2006","unstructured":"Gilbert, D. L. et al. Altered mesolimbocortical and thalamic dopamine in Tourette syndrome. Neurology \n                           67, 1695\u20131697 (2006).","journal-title":"Neurology"},{"key":"6547_CR55","doi-asserted-by":"publisher","first-page":"1239","DOI":"10.1038\/sj.npp.1301528","volume":"33","author":"DF Wong","year":"2008","unstructured":"Wong, D. F. et al. Mechanisms of dopaminergic and serotonergic neurotransmission in Tourette syndrome: clues from an in vivo neurochemistry study with PET. Neuropsychopharmacology \n                           33, 1239\u20131251 (2008).","journal-title":"Neuropsychopharmacology"},{"key":"6547_CR56","doi-asserted-by":"publisher","first-page":"55","DOI":"10.1016\/j.jns.2003.12.006","volume":"219","author":"K Minzer","year":"2004","unstructured":"Minzer, K., Lee, O., Hong, J. J. & Singer, H. S. Increased prefrontal D2 protein in Tourette syndrome: a postmortem analysis of frontal cortex and striatum. J Neurol Sci \n                           219, 55\u201361 (2004).","journal-title":"J Neurol Sci"},{"key":"6547_CR57","doi-asserted-by":"publisher","first-page":"50","DOI":"10.1016\/j.jns.2007.01.069","volume":"255","author":"DY Yoon","year":"2007","unstructured":"Yoon, D. Y., Gause, C. D., Leckman, J. F. & Singer, H. S. Frontal dopaminergic abnormality in Tourette syndrome: a postmortem analysis. J Neurol Sci \n                           255, 50\u201356 (2007).","journal-title":"J Neurol Sci"},{"key":"6547_CR58","doi-asserted-by":"publisher","first-page":"87","DOI":"10.1111\/appy.12185","volume":"8","author":"L Xu","year":"2016","unstructured":"Xu, L. et al. Lack of genetic association of 5-HTR2A 102 T\/C and -1438A\/G polymorphisms with Tourette syndrome in a family-based association study in a Chinese Han population. Asia-Pacific psychiatry \n                           8, 87\u201391 (2016).","journal-title":"Asia-Pacific psychiatry"},{"key":"6547_CR59","doi-asserted-by":"publisher","DOI":"10.1111\/appy.12196","author":"M Yi","year":"2015","unstructured":"Yi, M., Zhang, Y., Wang, Y., Su, N. & Liu, S. Association between the polymorphism of C861G (rs6296) in the serotonin 1B receptor gene and Tourette syndrome in Han Chinese people. Asia-Pacific psychiatry. doi:10.1111\/appy.12196 (2015).","journal-title":"Asia-Pacific psychiatry"},{"key":"6547_CR60","doi-asserted-by":"publisher","first-page":"131","DOI":"10.1016\/B978-0-12-411546-0.00005-6","volume":"112","author":"S Palminteri","year":"2013","unstructured":"Palminteri, S. & Pessiglione, M. Reinforcement learning and Tourette syndrome. International review of neurobiology \n                           112, 131\u2013153 (2013).","journal-title":"International review of neurobiology"},{"key":"6547_CR61","doi-asserted-by":"publisher","first-page":"154","DOI":"10.1038\/nn.2723","volume":"14","author":"TV Maia","year":"2011","unstructured":"Maia, T. V. & Frank, M. J. From reinforcement learning models to psychiatric and neurological disorders. Nature neuroscience \n                           14, 154\u2013162 (2011).","journal-title":"Nature neuroscience"},{"key":"6547_CR62","doi-asserted-by":"publisher","first-page":"2287","DOI":"10.1093\/brain\/awr147","volume":"134","author":"S Palminteri","year":"2011","unstructured":"Palminteri, S. et al. Dopamine-dependent reinforcement of motor skill learning: evidence from Gilles de la Tourette syndrome. Brain \n                           134, 2287\u20132301 (2011).","journal-title":"Brain"},{"key":"6547_CR63","doi-asserted-by":"publisher","first-page":"19179","DOI":"10.1073\/pnas.0904035106","volume":"106","author":"S Palminteri","year":"2009","unstructured":"Palminteri, S. et al. Pharmacological modulation of subliminal learning in Parkinson\u2019s and Tourette\u2019s syndromes. Proc Natl Acad Sci USA \n                           106, 19179\u201319184 (2009).","journal-title":"Proc Natl Acad Sci USA"},{"key":"6547_CR64","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1016\/j.neuron.2008.07.005","volume":"59","author":"M Pessiglione","year":"2008","unstructured":"Pessiglione, M. et al. Subliminal instrumental conditioning demonstrated in the human brain. Neuron \n                           59, 561\u2013567 (2008).","journal-title":"Neuron"},{"key":"6547_CR65","doi-asserted-by":"publisher","first-page":"605","DOI":"10.1093\/brain\/awv307","volume":"139","author":"C Delorme","year":"2016","unstructured":"Delorme, C. et al. Enhanced habit formation in Gilles de la Tourette syndrome. Brain \n                           139, 605\u2013615 (2016).","journal-title":"Brain"},{"key":"6547_CR66","doi-asserted-by":"publisher","first-page":"566","DOI":"10.1097\/00004583-198907000-00015","volume":"28","author":"JF Leckman","year":"1989","unstructured":"Leckman, J. F. et al. The Yale Global Tic Severity Scale: initial testing of a clinician-rated scale of tic severity. J Am Acad Child Adolesc Psychiatry \n                           28, 566\u2013573 (1989).","journal-title":"J Am Acad Child Adolesc Psychiatry"},{"key":"6547_CR67","doi-asserted-by":"publisher","first-page":"330","DOI":"10.1093\/biomet\/38.3-4.330","volume":"38","author":"B Welch","year":"1951","unstructured":"Welch, B. On the comparison of several mean values: an alternative approach. Biometrika \n                           38, 330\u2013336 (1951).","journal-title":"Biometrika"}],"container-title":["Scientific Reports"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-06547-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-06547-8","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-06547-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2022,12,23]],"date-time":"2022-12-23T02:20:21Z","timestamp":1671762021000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.nature.com\/articles\/s41598-017-06547-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2017,7,24]]},"references-count":67,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2017,12]]}},"alternative-id":["6547"],"URL":"https:\/\/doi.org\/10.1038\/s41598-017-06547-8","relation":{"has-preprint":[{"id-type":"doi","id":"10.1101\/064345","asserted-by":"object"}]},"ISSN":["2045-2322"],"issn-type":[{"value":"2045-2322","type":"electronic"}],"subject":[],"published":{"date-parts":[[2017,7,24]]},"assertion":[{"value":"25 July 2016","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"15 June 2017","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"24 July 2017","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"The authors declare that they have no competing interests.","order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Competing Interests"}}],"article-number":"6292"}}