{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,2,19]],"date-time":"2026-02-19T22:52:51Z","timestamp":1771541571620,"version":"3.50.1"},"update-to":[{"DOI":"10.1371\/journal.pcbi.1010785","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T00:00:00Z","timestamp":1672963200000}}],"reference-count":132,"publisher":"Public Library of Science (PLoS)","issue":"12","license":[{"start":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T00:00:00Z","timestamp":1671667200000},"content-version":"vor","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100001659","name":"Deutsche Forschungsgemeinschaft","doi-asserted-by":"publisher","award":["PE1627\/5-1"],"award-info":[{"award-number":["PE1627\/5-1"]}],"id":[{"id":"10.13039\/501100001659","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>Supplementation with the catecholamine precursor L-Tyrosine might enhance cognitive performance, but overall findings are mixed. Here, we investigate the effect of a single dose of tyrosine (2g) vs. placebo on two catecholamine-dependent trans-diagnostic traits: model-based control during reinforcement learning (2-step task) and temporal discounting, using a double-blind, placebo-controlled, within-subject design (n = 28 healthy male participants). We leveraged drift diffusion models in a hierarchical Bayesian framework to jointly model participants\u2019 choices and response times (RTS) in both tasks. Furthermore, comprehensive autonomic monitoring (heart rate, heart rate variability, pupillometry, spontaneous eye blink rate) was performed both pre- and post-supplementation, to explore potential physiological effects of supplementation. Across tasks, tyrosine consistently reduced participants\u2019 RTs without deteriorating task-performance. Diffusion modeling linked this effect to attenuated decision-thresholds in both tasks and further revealed increased model-based control (2-step task) and (if anything) attenuated temporal discounting. On the physiological level, participants\u2019 pupil dilation was predictive of the individual degree of temporal discounting. Tyrosine supplementation reduced physiological arousal as revealed by increases in pupil dilation variability and reductions in heart rate. Supplementation-related changes in physiological arousal predicted individual changes in temporal discounting. Our findings provide first evidence that tyrosine supplementation might impact psychophysiological parameters, and suggest that modeling approaches based on sequential sampling models can yield novel insights into latent cognitive processes modulated by amino-acid supplementation.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1010785","type":"journal-article","created":{"date-parts":[[2022,12,22]],"date-time":"2022-12-22T18:55:31Z","timestamp":1671735331000},"page":"e1010785","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":17,"title":["The catecholamine precursor Tyrosine reduces autonomic arousal and decreases decision thresholds in reinforcement learning and temporal discounting"],"prefix":"10.1371","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-3411-7867","authenticated-orcid":true,"given":"David","family":"Mathar","sequence":"first","affiliation":[]},{"given":"Mani","family":"Erfanian Abdoust","sequence":"additional","affiliation":[]},{"given":"Tobias","family":"Marrenbach","sequence":"additional","affiliation":[]},{"given":"Deniz","family":"Tuzsus","sequence":"additional","affiliation":[]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0195-5357","authenticated-orcid":true,"given":"Jan","family":"Peters","sequence":"additional","affiliation":[]}],"member":"340","published-online":{"date-parts":[[2022,12,22]]},"reference":[{"key":"pcbi.1010785.ref001","doi-asserted-by":"crossref","first-page":"106001","DOI":"10.1016\/j.phrs.2021.106001","article-title":"The current use and evolving landscape of nutraceuticals","volume":"175","author":"AS Chopra","year":"2022","journal-title":"Pharmacological Research"},{"key":"pcbi.1010785.ref002","doi-asserted-by":"crossref","first-page":"465","DOI":"10.1146\/annurev.bi.40.070171.002341","article-title":"Biochemistry of catecholamines","volume":"40","author":"PB Molinoff","year":"1971","journal-title":"Annu Rev Biochem"},{"key":"pcbi.1010785.ref003","doi-asserted-by":"crossref","first-page":"2389","DOI":"10.1016\/0024-3205(96)00242-1","article-title":"Decrease in plasma phenylalanine and tyrosine after phenylalanine-tyrosine free amino acid solutions in man","volume":"58","author":"EA Moja","year":"1996","journal-title":"Life Sci"},{"key":"pcbi.1010785.ref004","doi-asserted-by":"crossref","first-page":"200","DOI":"10.3389\/fnbeh.2013.00200","article-title":"Working memory reloaded: tyrosine repletes updating in the N-back task.","volume":"7","author":"LS Colzato","year":"2013","journal-title":"Front Behav Neurosci"},{"key":"pcbi.1010785.ref005","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1016\/j.neuropsychologia.2013.12.027","article-title":"Eating to stop: tyrosine supplementation enhances inhibitory control but not response execution.","volume":"62","author":"LS Colzato","year":"2014","journal-title":"Neuropsychologia"},{"key":"pcbi.1010785.ref006","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.pbb.2015.03.008","article-title":"Behavioral and cognitive effects of tyrosine intake in healthy human adults","volume":"133","author":"A Hase","year":"2015","journal-title":"Pharmacology Biochemistry and Behavior"},{"key":"pcbi.1010785.ref007","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1080\/1028415031000120552","article-title":"Effects of tyrosine, phentermine, caffeine D-amphetamine, and placebo on cognitive and motor performance deficits during sleep deprivation.","volume":"6","author":"RA Magill","year":"2003","journal-title":"Nutr Neurosci."},{"key":"pcbi.1010785.ref008","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.neuropsychologia.2015.01.022","article-title":"Tyrosine promotes cognitive flexibility: evidence from proactive vs. reactive control during task switching performance","volume":"69","author":"L Steenbergen","year":"2015","journal-title":"Neuropsychologia"},{"key":"pcbi.1010785.ref009","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.jpsychires.2015.08.014","article-title":"Effect of tyrosine supplementation on clinical and healthy populations under stress or cognitive demands\u2014A review","volume":"70","author":"BJ Jongkees","year":"2015","journal-title":"Journal of Psychiatric Research"},{"key":"pcbi.1010785.ref010","doi-asserted-by":"crossref","first-page":"203","DOI":"10.1016\/S0361-9230(98)00163-4","article-title":"Tyrosine improves cognitive performance and reduces blood pressure in cadets after one week of a combat training course","volume":"48","author":"JB Deijen","year":"1999","journal-title":"Brain Research Bulletin"},{"key":"pcbi.1010785.ref011","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1007\/s00426-017-0957-4","article-title":"Food for thought: association between dietary tyrosine and cognitive performance in younger and older adults.","volume":"83","author":"S K\u00fchn","year":"2019","journal-title":"Psychol Res"},{"key":"pcbi.1010785.ref012","doi-asserted-by":"crossref","first-page":"301","DOI":"10.1016\/j.physbeh.2006.09.027","article-title":"Dietary tyrosine benefits cognitive and psychomotor performance during body cooling","volume":"90","author":"C O\u2019Brien","year":"2007","journal-title":"Physiology & Behavior"},{"key":"pcbi.1010785.ref013","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.1016\/j.neuron.2011.02.027","article-title":"Model-based influences on humans\u2019 choices and striatal prediction errors","volume":"69","author":"ND Daw","year":"2011","journal-title":"Neuron"},{"key":"pcbi.1010785.ref014","article-title":"Characterizing a psychiatric symptom dimension related to deficits in goal-directed control.","author":"CM Gillan","journal-title":"eLife. 5"},{"key":"pcbi.1010785.ref015","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1016\/j.copsyc.2019.01.005","article-title":"Excessive discounting of delayed reinforcers as a trans-disease process: Update on the state of the science","volume":"30","author":"WK Bickel","year":"2019","journal-title":"Curr Opin Psychol"},{"key":"pcbi.1010785.ref016","doi-asserted-by":"crossref","first-page":"190","DOI":"10.1017\/S0033291718001770","article-title":"Can delay discounting deliver on the promise of RDoC?","volume":"49","author":"KM Lempert","year":"2019","journal-title":"Psychol Med"},{"key":"pcbi.1010785.ref017","doi-asserted-by":"crossref","first-page":"227","DOI":"10.1016\/j.tics.2011.03.002","article-title":"The neural mechanisms of inter-temporal decision-making: understanding variability.","volume":"15","author":"J Peters","year":"2011","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1010785.ref018","doi-asserted-by":"crossref","first-page":"1593","DOI":"10.1126\/science.275.5306.1593","article-title":"A neural substrate of prediction and reward","volume":"275","author":"W Schultz","year":"1997","journal-title":"Science"},{"key":"pcbi.1010785.ref019","doi-asserted-by":"crossref","first-page":"129","DOI":"10.1016\/j.neuron.2005.05.020","article-title":"Midbrain dopamine neurons encode a quantitative reward prediction error signal","volume":"47","author":"HM Bayer","year":"2005","journal-title":"Neuron"},{"key":"pcbi.1010785.ref020","doi-asserted-by":"crossref","first-page":"966","DOI":"10.1038\/nn.3413","article-title":"A Causal Link Between Prediction Errors, Dopamine Neurons and Learning","volume":"16","author":"EE Steinberg","year":"2013","journal-title":"Nat Neurosci"},{"key":"pcbi.1010785.ref021","doi-asserted-by":"crossref","first-page":"48","DOI":"10.1038\/npp.2009.131","article-title":"Human and rodent homologies in action control: corticostriatal determinants of goal-directed and habitual action","volume":"35","author":"O Balleine BW","year":"2010","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1010785.ref022","doi-asserted-by":"crossref","first-page":"312","DOI":"10.1016\/j.neuron.2013.09.007","article-title":"Goals and habits in the brain","volume":"80","author":"RJ Dolan","year":"2013","journal-title":"Neuron"},{"key":"pcbi.1010785.ref023","article-title":"Lateral prefrontal model-based signatures are reduced in healthy individuals with high trait impulsivity","volume":"9","author":"L. Deserno","year":"2015","journal-title":"Translational Psychiatry"},{"key":"pcbi.1010785.ref024","doi-asserted-by":"crossref","first-page":"777","DOI":"10.1037\/abn0000164","article-title":"Reduced model-based decision-making in schizophrenia.","volume":"125","author":"AJ Culbreth","year":"2016","journal-title":"J Abnorm Psychol"},{"key":"pcbi.1010785.ref025","doi-asserted-by":"crossref","first-page":"19625","DOI":"10.1038\/s41598-019-56161-z","article-title":"Reduced model-based decision-making in gambling disorder.","volume":"9","author":"F Wyckmans","year":"2019","journal-title":"Sci Rep"},{"key":"pcbi.1010785.ref026","doi-asserted-by":"crossref","first-page":"7015","DOI":"10.1038\/s41598-021-86388-8","article-title":"Reliability assessment of temporal discounting measures in virtual reality environments.","volume":"11","author":"LR Bruder","year":"2021","journal-title":"Sci Rep"},{"key":"pcbi.1010785.ref027","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.neuroimage.2018.10.075","article-title":"L-DOPA reduces model-free control of behavior by attenuating the transfer of value to action.","volume":"186","author":"NB Kroemer","year":"2019","journal-title":"NeuroImage"},{"key":"pcbi.1010785.ref028","doi-asserted-by":"crossref","first-page":"418","DOI":"10.1016\/j.neuron.2012.03.042","article-title":"Dopamine enhances model-based over model-free choice behavior","volume":"75","author":"K Wunderlich","year":"2012","journal-title":"Neuron"},{"key":"pcbi.1010785.ref029","doi-asserted-by":"crossref","first-page":"1176","DOI":"10.1001\/jamapsychiatry.2019.2102","article-title":"Delay Discounting as a Transdiagnostic Process in Psychiatric Disorders: A Meta-analysis.","volume":"76","author":"M Amlung","year":"2019","journal-title":"JAMA Psychiatry"},{"key":"pcbi.1010785.ref030","doi-asserted-by":"crossref","first-page":"5472","DOI":"10.1073\/pnas.1818430116","article-title":"Large-scale analysis of test-retest reliabilities of self-regulation measures","volume":"116","author":"AZ Enkavi","year":"2019","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1010785.ref031","doi-asserted-by":"crossref","first-page":"457","DOI":"10.3758\/PBR.16.3.457","article-title":"One-year temporal stability of delay-discount rates.","volume":"16","author":"KN Kirby","year":"2009","journal-title":"Psychon Bull Rev"},{"key":"pcbi.1010785.ref032","doi-asserted-by":"crossref","first-page":"e491","DOI":"10.1038\/tp.2014.133","article-title":"Dopaminergic function and intertemporal choice.","volume":"5","author":"J Joutsa","year":"2015","journal-title":"Transl Psychiatry"},{"key":"pcbi.1010785.ref033","doi-asserted-by":"crossref","first-page":"657","DOI":"10.1162\/jocn_a_00929","article-title":"Dopamine Modulation of Intertemporal Decision-making: Evidence from Parkinson Disease.","volume":"28","author":"K Foerde","year":"2016","journal-title":"J Cogn Neurosci."},{"key":"pcbi.1010785.ref034","doi-asserted-by":"crossref","first-page":"813","DOI":"10.1016\/S0893-133X(02)00343-3","article-title":"Acute administration of d-amphetamine decreases impulsivity in healthy volunteers","volume":"27","author":"H de Wit","year":"2002","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1010785.ref035","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1037\/1064-1297.16.2.113","article-title":"Bupropion improves attention but does not affect impulsive behavior in healthy young adults.","volume":"16","author":"A Acheson","year":"2008","journal-title":"Exp Clin Psychopharmacol"},{"key":"pcbi.1010785.ref036","doi-asserted-by":"crossref","first-page":"8888","DOI":"10.1523\/JNEUROSCI.6028-09.2010","article-title":"Dopamine, time, and impulsivity in humans","volume":"30","author":"A Pine","year":"2010","journal-title":"J Neurosci"},{"key":"pcbi.1010785.ref037","doi-asserted-by":"crossref","first-page":"5652","DOI":"10.1038\/s41598-019-42124-x","article-title":"Baseline impulsivity may moderate L-DOPA effects on value-based decision-making.","volume":"9","author":"J Petzold","year":"2019","journal-title":"Sci Rep"},{"key":"pcbi.1010785.ref038","doi-asserted-by":"crossref","first-page":"7936","DOI":"10.1523\/JNEUROSCI.0592-20.2020","article-title":"Dopaminergic Modulation of Human Intertemporal Choice: A Diffusion Model Analysis Using the D2-Receptor Antagonist Haloperidol.","volume":"40","author":"B Wagner","year":"2020","journal-title":"J Neurosci"},{"key":"pcbi.1010785.ref039","doi-asserted-by":"crossref","first-page":"1099","DOI":"10.3758\/s13423-018-1554-2","article-title":"A reinforcement learning diffusion decision model for value-based decisions.","volume":"26","author":"L Fontanesi","year":"2019","journal-title":"Psychon Bull Rev"},{"key":"pcbi.1010785.ref040","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.3758\/s13423-016-1199-y","article-title":"The drift diffusion model as the choice rule in reinforcement learning.","volume":"24","author":"ML Pedersen","year":"2017","journal-title":"Psychon Bull Rev"},{"key":"pcbi.1010785.ref041","first-page":"16","article-title":"The drift diffusion model as the choice rule in inter-temporal and risky choice: A case study in medial orbitofrontal cortex lesion patients and controls.","author":"D Peters J","year":"2020","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1010785.ref042","doi-asserted-by":"crossref","first-page":"e1006803","DOI":"10.1371\/journal.pcbi.1006803","article-title":"Improving the reliability of model-based decision-making estimates in the two-stage decision task with reaction-times and drift-diffusion modeling.","volume":"15","author":"N Shahar","year":"2019","journal-title":"PLoS Comput Biol"},{"key":"pcbi.1010785.ref043","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1016\/0361-9230(89)90096-8","article-title":"Treatment with tyrosine, a neurotransmitter precursor, reduces environmental stress in humans","volume":"22","author":"LE Banderet","year":"1989","journal-title":"Brain Res Bull"},{"key":"pcbi.1010785.ref044","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1016\/j.physbeh.2007.05.003","article-title":"Tyrosine supplementation mitigates working memory decrements during cold exposure","volume":"92","author":"CR Mahoney","year":"2007","journal-title":"Physiology & Behavior"},{"key":"pcbi.1010785.ref045","doi-asserted-by":"crossref","first-page":"27","DOI":"10.1515\/REVNEURO.1994.5.1.27","article-title":"Modulation of brain dopamine transmission by sex steroids","volume":"5","author":"T. Di Paolo","year":"1994","journal-title":"Rev Neurosci"},{"key":"pcbi.1010785.ref046","doi-asserted-by":"crossref","first-page":"70","DOI":"10.1016\/j.neuropsychologia.2015.10.016","article-title":"Menstrual cycle phase modulates reward sensitivity and performance monitoring in young women: Preliminary fMRI evidence.","volume":"84","author":"EK Diekhof","year":"2016","journal-title":"Neuropsychologia."},{"key":"pcbi.1010785.ref047","doi-asserted-by":"crossref","first-page":"310","DOI":"10.1038\/sj.npp.1300835","article-title":"Effect of acute tyrosine depletion in using a branched chain amino-acid mixture on dopamine neurotransmission in the rat brain","volume":"31","author":"M Le Masurier","year":"2006","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1010785.ref048","first-page":"595","article-title":"D1 and D2 dopamine receptors independently regulate spontaneous blink rate in the vervet monkey","volume":"259","author":"JD Elsworth","year":"1991","journal-title":"J Pharmacol Exp Ther"},{"key":"pcbi.1010785.ref049","doi-asserted-by":"crossref","first-page":"14443","DOI":"10.1523\/JNEUROSCI.3037-14.2014","article-title":"In the blink of an eye: relating positive-feedback sensitivity to striatal dopamine D2-like receptors through blink rate","volume":"34","author":"SM Groman","year":"2014","journal-title":"J Neurosci"},{"key":"pcbi.1010785.ref050","doi-asserted-by":"crossref","first-page":"11256","DOI":"10.1523\/JNEUROSCI.6218-10.2011","article-title":"Characterizing the Spontaneous Blink Generator: An Animal Model","volume":"31","author":"J Kaminer","year":"2011","journal-title":"J Neurosci"},{"key":"pcbi.1010785.ref051","article-title":"Spontaneous Eye Blink Rate (EBR) Is Uncorrelated with Dopamine D2 Receptor Availability and Unmodulated by Dopamine Agonism in Healthy Adults.","volume":"4","author":"LC Dang","year":"2017","journal-title":"eNeuro"},{"key":"pcbi.1010785.ref052","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1111\/ejn.13895","article-title":"Spontaneous eye blink rate and dopamine synthesis capacity: preliminary evidence for an absence of positive correlation","volume":"47","author":"G Sescousse","year":"2018","journal-title":"Eur J Neurosci"},{"key":"pcbi.1010785.ref053","doi-asserted-by":"crossref","first-page":"623","DOI":"10.1111\/j.1469-8986.1997.tb02140.x","article-title":"Heart rate variability: Origins, methods, and interpretive caveats.","volume":"34","author":"GG Berntson","year":"1997","journal-title":"Psychophysiology."},{"key":"pcbi.1010785.ref054","doi-asserted-by":"crossref","first-page":"602","DOI":"10.1111\/j.1469-8986.2008.00654.x","article-title":"The pupil as a measure of emotional arousal and autonomic activation.","volume":"45","author":"MM Bradley","year":"2008","journal-title":"Psychophysiology"},{"key":"pcbi.1010785.ref055","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1016\/j.neuroimage.2016.06.011","article-title":"Spontaneous pupil dilations during the resting state are associated with activation of the salience network.","volume":"139","author":"M Schneider","year":"2016","journal-title":"NeuroImage"},{"key":"pcbi.1010785.ref056","doi-asserted-by":"crossref","first-page":"204","DOI":"10.4330\/wjc.v7.i4.204","article-title":"Autonomic and endocrine control of cardiovascular function","volume":"7","author":"R Gordan","year":"2015","journal-title":"World J Cardiol"},{"key":"pcbi.1010785.ref057","doi-asserted-by":"crossref","first-page":"4140","DOI":"10.1002\/hbm.22466","article-title":"Pupil diameter covaries with BOLD activity in human locus coeruleus.","volume":"35","author":"O Murphy PR","year":"2014","journal-title":"Human Brain Mapping"},{"key":"pcbi.1010785.ref058","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1007\/s002130000398","article-title":"Comparison of the effects of clonidine and yohimbine on spontaneous pupillary fluctuations in healthy human volunteers.","volume":"150","author":"MA Phillips","year":"2000","journal-title":"Psychopharmacology (Berl)."},{"key":"pcbi.1010785.ref059","first-page":"115","article-title":"Pupil Dilation Signals Surprise: Evidence for Noradrenaline\u2019s Role in Decision Making.","volume":"5","author":"K\u2018t Preuschoff","year":"2011","journal-title":"Front Neurosci"},{"key":"pcbi.1010785.ref060","doi-asserted-by":"crossref","first-page":"145","DOI":"10.1016\/S0165-1781(00)00108-6","article-title":"Diurnal variation in spontaneous eye-blink rate.","volume":"93","author":"G Barbato","year":"2000","journal-title":"Psychiatry Res"},{"key":"pcbi.1010785.ref061","doi-asserted-by":"crossref","first-page":"421","DOI":"10.1111\/j.1475-1313.1997.tb00075.x","article-title":"Some methodological issues in the assessment of the spontaneous eyeblink frequency in man.","volume":"17","author":"ML Zaman","year":"1997","journal-title":"Ophthalmic Physiol Opt"},{"key":"pcbi.1010785.ref062","doi-asserted-by":"crossref","first-page":"39","DOI":"10.1016\/j.cmpb.2010.05.012","article-title":"An open source tool for heart rate variability spectral analysis","volume":"103","author":"L Rodr\u00edguez-Li\u00f1ares","year":"2011","journal-title":"Comput Methods Programs Biomed"},{"key":"pcbi.1010785.ref063","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.ijpsycho.2019.03.007","article-title":"Individual differences in resting-state pupil size: Evidence for association between working memory capacity and pupil size variability","volume":"140","author":"S Aminihajibashi","year":"2019","journal-title":"International Journal of Psychophysiology"},{"key":"pcbi.1010785.ref064","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1007\/BF01245830","article-title":"Mesocortical dopamine neurons: high basal firing frequency predicts tyrosine dependence of dopamine synthesis","volume":"81","author":"SY Tam","year":"1990","journal-title":"J Neural Transm Gen Sect"},{"key":"pcbi.1010785.ref065","doi-asserted-by":"crossref","first-page":"265","DOI":"10.1016\/0024-3205(79)90294-7","article-title":"Elevation of plasma tyrosine after a single oral dose of L-tyrosine","volume":"25","author":"BS Glaeser","year":"1979","journal-title":"Life Sci"},{"key":"pcbi.1010785.ref066","doi-asserted-by":"crossref","first-page":"e1005090","DOI":"10.1371\/journal.pcbi.1005090","article-title":"When Does Model-Based Control Pay Off?","volume":"12","author":"W Kool","year":"2016","journal-title":"PLoS Comput Biol."},{"key":"pcbi.1010785.ref067","doi-asserted-by":"crossref","first-page":"715","DOI":"10.3758\/BF03211314","article-title":"Rate of temporal discounting decreases with amount of reward.","volume":"25","author":"L Green","year":"1997","journal-title":"Mem Cognit."},{"key":"pcbi.1010785.ref068","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/j.pharmthera.2012.02.004","article-title":"Excessive discounting of delayed reinforcers as a trans-disease process contributing to addiction and other disease-related vulnerabilities: Emerging evidence.","volume":"134","author":"WK Bickel","year":"2012","journal-title":"Pharmacology & Therapeutics."},{"key":"pcbi.1010785.ref069","doi-asserted-by":"crossref","first-page":"112665","DOI":"10.1016\/j.psychres.2019.112665","article-title":"Confirmatory factor analysis of the Barratt Impulsiveness Scale-short form (BIS-15) in patients with mental disorders.","volume":"284","author":"A Meule","year":"2020","journal-title":"Psychiatry Res"},{"key":"pcbi.1010785.ref070","doi-asserted-by":"crossref","first-page":"359","DOI":"10.1080\/00207450600588881","article-title":"Normative data and a short form of the Barratt Impulsiveness Scale","volume":"117","author":"M. Spinella","year":"2007","journal-title":"Int J Neurosci"},{"key":"pcbi.1010785.ref071","doi-asserted-by":"crossref","first-page":"216","DOI":"10.1024\/\/0170-1789.22.3.216","article-title":"Eine deutschsprachige Version des BIS\/BAS-Fragebogens von Carver und White. [A German version of Carver and White\u2019s BIS\/BAS scales.].","volume":"22","author":"A Strobel","year":"2001","journal-title":"Zeitschrift f\u00fcr Differentielle und Diagnostische Psychologie"},{"key":"pcbi.1010785.ref072","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1037\/0022-3514.67.2.319","article-title":"Behavioral inhibition, behavioral activation, and affective responses to impending reward and punishment: The BIS\/BAS Scales","volume":"67","author":"CS Carver","year":"1994","journal-title":"Journal of Personality and Social Psychology"},{"key":"pcbi.1010785.ref073","doi-asserted-by":"crossref","first-page":"651","DOI":"10.1007\/s00115-006-2098-7","article-title":"Reliabilit\u00e4t und Validit\u00e4t des revidierten Beck-Depressionsinventars (BDI-II).","volume":"78","author":"C K\u00fchner","year":"2007","journal-title":"Nervenarzt"},{"key":"pcbi.1010785.ref074","doi-asserted-by":"crossref","first-page":"588","DOI":"10.1207\/s15327752jpa6703_13","article-title":"Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients.","volume":"67","author":"AT Beck","year":"1996","journal-title":"J Pers Assess."},{"key":"pcbi.1010785.ref075","doi-asserted-by":"crossref","first-page":"1036","DOI":"10.1093\/ijnp\/pyx056","article-title":"Dopamine System Dysregulation in Major Depressive Disorders.","volume":"20","author":"P Belujon","year":"2017","journal-title":"Int J Neuropsychopharmacol."},{"key":"pcbi.1010785.ref076","doi-asserted-by":"crossref","first-page":"20941","DOI":"10.1073\/pnas.1312011110","article-title":"Working-memory capacity protects model-based learning from stress","volume":"110","author":"AR Otto","year":"2013","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1010785.ref077","doi-asserted-by":"crossref","first-page":"764","DOI":"10.3758\/s13415-017-0511-2","article-title":"A simple computational algorithm of model-based choice preference.","volume":"17","author":"A Toyama","year":"2017","journal-title":"Cogn Affect Behav Neurosci"},{"key":"pcbi.1010785.ref078","doi-asserted-by":"crossref","first-page":"153","DOI":"10.3389\/fnhum.2019.00153","article-title":"Reinforcement Learning With Parsimonious Computation and a Forgetting Process.","volume":"13","author":"A Toyama","year":"2019","journal-title":"Front Hum Neurosci."},{"key":"pcbi.1010785.ref079","volume-title":"Reinforcement Learning: An Introduction","author":"RS Sutton","year":"1998"},{"key":"pcbi.1010785.ref080","doi-asserted-by":"crossref","first-page":"232","DOI":"10.1176\/appi.ajp.2017.17040404","article-title":"Impact of SSRI Therapy on Risk of Conversion From Mild Cognitive Impairment to Alzheimer\u2019s Dementia in Individuals With Previous Depression.","volume":"175","author":"C Bartels","year":"2018","journal-title":"Am J Psychiatry."},{"key":"pcbi.1010785.ref081","first-page":"2021","article-title":"Gambling environment exposure increases temporal discounting but improves model-based control in regular slot-machine gamblers.","author":"B Wagner","year":"2021"},{"key":"pcbi.1010785.ref082","year":"2022","journal-title":"STAN development team"},{"key":"pcbi.1010785.ref083","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","article-title":"Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC.","volume":"27","author":"A Vehtari","year":"2017","journal-title":"Stat Comput."},{"key":"pcbi.1010785.ref084","doi-asserted-by":"crossref","first-page":"2230","DOI":"10.1111\/add.13501","article-title":"Using Bayes factors for testing hypotheses about intervention effectiveness in addictions research.","volume":"111","author":"E Beard","year":"2016","journal-title":"Addiction"},{"key":"pcbi.1010785.ref085","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1162\/jocn_a_00709","article-title":"Cognitive control predicts use of model-based reinforcement learning.","volume":"27","author":"AR Otto","year":"2015","journal-title":"J Cogn Neurosci"},{"key":"pcbi.1010785.ref086","doi-asserted-by":"crossref","first-page":"490","DOI":"10.3758\/s13415-019-00723-1","article-title":"Decomposing the effects of context valence and feedback information on speed and accuracy during reinforcement learning: a meta-analytical approach using diffusion decision modeling.","volume":"19","author":"L Fontanesi","year":"2019","journal-title":"Cogn Affect Behav Neurosci"},{"key":"pcbi.1010785.ref087","doi-asserted-by":"crossref","first-page":"289","DOI":"10.1111\/j.2517-6161.1995.tb02031.x","article-title":"Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing","volume":"57","author":"Y Benjamini","year":"1995","journal-title":"Journal of the Royal Statistical Society Series B (Methodological)."},{"key":"pcbi.1010785.ref088","doi-asserted-by":"crossref","first-page":"1001","DOI":"10.1016\/j.neuint.2012.07.012","article-title":"Increased tyrosine availability increases brain regional DOPA levels in vivo","volume":"61","author":"Z Brodnik","year":"2012","journal-title":"Neurochem Int"},{"key":"pcbi.1010785.ref089","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1016\/0024-3205(82)90596-3","article-title":"Effects of oral L-tyrosine administration on CSF tyrosine and homovanillic acid levels in patients with Parkinson\u2019s disease","volume":"30","author":"JH Growdon","year":"1982","journal-title":"Life Sci"},{"key":"pcbi.1010785.ref090","doi-asserted-by":"crossref","first-page":"324","DOI":"10.1016\/j.bandc.2013.09.005","article-title":"Tyrosine ameliorates heat induced delay in event related potential P300 and contingent negative variation","volume":"83","author":"K Kishore","year":"2013","journal-title":"Brain Cogn"},{"key":"pcbi.1010785.ref091","doi-asserted-by":"crossref","first-page":"3511","DOI":"10.1073\/pnas.76.7.3511","article-title":"Tyrosine administration reduces blood pressure and enhances brain norepinephrine release in spontaneously hypertensive rats","volume":"76","author":"AF Sved","year":"1979","journal-title":"Proc Natl Acad Sci U S A"},{"key":"pcbi.1010785.ref092","doi-asserted-by":"crossref","first-page":"201","DOI":"10.1016\/0014-2999(80)90323-4","article-title":"The hypotensive effect of centrally administered tyrosine","volume":"68","author":"Y Yamori","year":"1980","journal-title":"Eur J Pharmacol"},{"key":"pcbi.1010785.ref093","doi-asserted-by":"crossref","first-page":"1783","DOI":"10.1007\/s00213-018-5160-9","article-title":"The impact of Yohimbine-induced arousal on facets of behavioural impulsivity","volume":"236","author":"AM Herman","year":"2019","journal-title":"Psychopharmacology (Berl)."},{"key":"pcbi.1010785.ref094","doi-asserted-by":"crossref","first-page":"775","DOI":"10.1038\/sj.npp.1300659","article-title":"The subjective and cognitive effects of acute phenylalanine and tyrosine depletion in patients recovered from depression","volume":"30","author":"JP Roiser","year":"2005","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1010785.ref095","doi-asserted-by":"crossref","first-page":"3933","DOI":"10.1162\/jocn_a_00090","article-title":"Vigor in the face of fluctuating rates of reward: an experimental examination.","volume":"23","author":"M Guitart-Masip","year":"2011","journal-title":"J Cogn Neurosci"},{"key":"pcbi.1010785.ref096","article-title":"Effects of average reward rate on vigor as a function of individual variation in striatal dopamine","author":"L Hofmans","year":"2021","journal-title":"Psychopharmacology"},{"key":"pcbi.1010785.ref097","doi-asserted-by":"crossref","first-page":"83","DOI":"10.1007\/s00213-013-3088-7","article-title":"Norepinephrine and impulsivity: effects of acute yohimbine","volume":"229","author":"AC Swann","year":"2013","journal-title":"Psychopharmacology (Berl)."},{"key":"pcbi.1010785.ref098","article-title":"The role of noradrenaline in cognition and cognitive disorders","author":"N Holland","year":"2021","journal-title":"Brain"},{"key":"pcbi.1010785.ref099","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","article-title":"The diffusion decision model: theory and data for two-choice decision tasks.","volume":"20","author":"R Ratcliff","year":"2008","journal-title":"Neural Comput"},{"key":"pcbi.1010785.ref100","doi-asserted-by":"crossref","first-page":"161","DOI":"10.1016\/j.tins.2004.01.006","article-title":"Psychology and neurobiology of simple decisions","volume":"27","author":"PL Smith","year":"2004","journal-title":"Trends Neurosci"},{"key":"pcbi.1010785.ref101","doi-asserted-by":"crossref","first-page":"916","DOI":"10.1016\/j.cub.2016.01.051","article-title":"Neural Correlates of Decision Thresholds in the Human Subthalamic Nucleus","volume":"26","author":"DM Herz","year":"2016","journal-title":"Curr Biol"},{"key":"pcbi.1010785.ref102","doi-asserted-by":"crossref","first-page":"111","DOI":"10.1016\/S0168-0102(02)00027-5","article-title":"Functional significance of the cortico-subthalamo-pallidal \u201chyperdirect\u201d pathway.","volume":"43","author":"A Nambu","year":"2002","journal-title":"Neurosci Res"},{"key":"pcbi.1010785.ref103","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1016\/0006-8993(90)91087-W","article-title":"Afferent connections of the subthalamic nucleus: a combined retrograde and anterograde horseradish peroxidase study in the rat","volume":"513","author":"NS Canteras","year":"1990","journal-title":"Brain Res"},{"key":"pcbi.1010785.ref104","doi-asserted-by":"crossref","first-page":"1788","DOI":"10.1111\/j.1460-9568.2004.03629.x","article-title":"Synaptic release of dopamine in the subthalamic nucleus","volume":"20","author":"SJ Cragg","year":"2004","journal-title":"Eur J Neurosci"},{"key":"pcbi.1010785.ref105","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/0165-0173(94)00008-D","article-title":"Functional anatomy of the basal ganglia. II. The place of subthalamic nucleus and external pallidum in basal ganglia circuitry","volume":"20","author":"A Parent","year":"1995","journal-title":"Brain Res Brain Res Rev"},{"key":"pcbi.1010785.ref106","article-title":"Dopamine regulates decision thresholds in human reinforcement learning.","volume":"2022","author":"K Chakroun","year":"2022","journal-title":"bioRxiv"},{"key":"pcbi.1010785.ref107","doi-asserted-by":"crossref","first-page":"11489","DOI":"10.1523\/JNEUROSCI.2348-16.2016","article-title":"Frontosubthalamic Circuits for Control of Action and Cognition","volume":"36","author":"AR Aron","year":"2016","journal-title":"J Neurosci"},{"key":"pcbi.1010785.ref108","doi-asserted-by":"crossref","first-page":"1846","DOI":"10.1002\/mds.26732","article-title":"Stop-related subthalamic beta activity indexes global motor suppression in Parkinson\u2019s disease","volume":"31","author":"JR Wessel","year":"2016","journal-title":"Mov Disord"},{"key":"pcbi.1010785.ref109","doi-asserted-by":"crossref","first-page":"1309","DOI":"10.1126\/science.1146157","article-title":"Hold your horses: impulsivity, deep brain stimulation, and medication in parkinsonism","volume":"318","author":"MJ Frank","year":"2007","journal-title":"Science"},{"key":"pcbi.1010785.ref110","doi-asserted-by":"crossref","first-page":"1362","DOI":"10.1126\/science.aaz5891","article-title":"Dopamine promotes cognitive effort by biasing the benefits versus costs of cognitive work","volume":"367","author":"A Westbrook","year":"2020","journal-title":"Science"},{"key":"pcbi.1010785.ref111","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1093\/brain\/awv347","article-title":"Dopamine selectively remediates \u2018model-based\u2019 reward learning: a computational approach.","volume":"139","author":"ME Sharp","year":"2016","journal-title":"Brain"},{"key":"pcbi.1010785.ref112","doi-asserted-by":"crossref","first-page":"1075","DOI":"10.1016\/j.conb.2012.08.003","article-title":"The ubiquity of model-based reinforcement learning","volume":"22","author":"BB Doll","year":"2012","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1010785.ref113","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1016\/j.neuron.2019.02.014","article-title":"Hippocampal Contributions to Model-Based Planning and Spatial Memory","volume":"102","author":"OM Vikbladh","year":"2019","journal-title":"Neuron"},{"key":"pcbi.1010785.ref114","doi-asserted-by":"crossref","first-page":"495","DOI":"10.1016\/S0091-3057(99)00094-5","article-title":"Tyrosine improves working memory in a multitasking environment","volume":"64","author":"JR Thomas","year":"1999","journal-title":"Pharmacol Biochem Behav"},{"key":"pcbi.1010785.ref115","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.51260","article-title":"Dopaminergic modulation of the exploration\/exploitation trade-off in human decision-making.","volume":"9","author":"K Chakroun","year":"2020","journal-title":"Elife"},{"key":"pcbi.1010785.ref116","doi-asserted-by":"crossref","first-page":"1708","DOI":"10.1523\/JNEUROSCI.1979-16.2016","article-title":"Dopamine Modulates Adaptive Prediction Error Coding in the Human Midbrain and Striatum","volume":"37","author":"KMJ Diederen","year":"2017","journal-title":"J Neurosci"},{"key":"pcbi.1010785.ref117","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/j.cortex.2016.09.004","article-title":"The role of dopamine in positive and negative prediction error utilization during incidental learning\u2014Insights from Positron Emission Tomography, Parkinson\u2019s disease and Huntington\u2019s disease.","volume":"90","author":"D Mathar","year":"2017","journal-title":"Cortex"},{"key":"pcbi.1010785.ref118","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1038\/nature05051","article-title":"Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans","volume":"442","author":"M Pessiglione","year":"2006","journal-title":"Nature"},{"key":"pcbi.1010785.ref119","doi-asserted-by":"crossref","first-page":"e850","DOI":"10.1038\/tp.2016.113","article-title":"Dopamine D2\/3- and \u03bc-opioid receptor antagonists reduce cue-induced responding and reward impulsivity in humans","volume":"6","author":"SC Weber","year":"2016","journal-title":"Transl Psychiatry"},{"key":"pcbi.1010785.ref120","doi-asserted-by":"crossref","first-page":"e113","DOI":"10.1016\/j.biopsych.2011.03.028","article-title":"Inverted-U-shaped dopamine actions on human working memory and cognitive control","volume":"69","author":"R Cools","year":"2011","journal-title":"Biol Psychiatry"},{"key":"pcbi.1010785.ref121","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1016\/j.neubiorev.2016.08.020","article-title":"Spontaneous eye blink rate as predictor of dopamine-related cognitive function-A review.","volume":"71","author":"BJ Jongkees","year":"2016","journal-title":"Neurosci Biobehav Rev"},{"key":"pcbi.1010785.ref122","doi-asserted-by":"crossref","first-page":"861","DOI":"10.1126\/science.1121218","article-title":"Neurochemical Modulation of Response Inhibition and Probabilistic Learning in Humans","volume":"311","author":"SR Chamberlain","year":"2006","journal-title":"Science"},{"key":"pcbi.1010785.ref123","doi-asserted-by":"crossref","first-page":"1317","DOI":"10.1016\/j.biopsych.2007.04.009","article-title":"The neurobiology of attention-deficit\/hyperactivity disorder","volume":"61","author":"SR Chamberlain","year":"2007","journal-title":"Biol Psychiatry"},{"key":"pcbi.1010785.ref124","doi-asserted-by":"crossref","first-page":"1986","DOI":"10.1093\/brain\/awu117","article-title":"Targeting impulsivity in Parkinson\u2019s disease using atomoxetine","volume":"137","author":"AA Kehagia","year":"2014","journal-title":"Brain"},{"key":"pcbi.1010785.ref125","doi-asserted-by":"crossref","first-page":"366","DOI":"10.1037\/xge0000047","article-title":"Emotional arousal and discount rate in intertemporal choice are reference dependent","volume":"144","author":"KM Lempert","year":"2015","journal-title":"J Exp Psychol Gen"},{"key":"pcbi.1010785.ref126","doi-asserted-by":"crossref","first-page":"647","DOI":"10.1037\/emo0000168","article-title":"Emotional arousal predicts intertemporal choice.","volume":"16","author":"KM Lempert","year":"2016","journal-title":"Emotion"},{"key":"pcbi.1010785.ref127","doi-asserted-by":"crossref","first-page":"498","DOI":"10.1111\/psyp.12032","article-title":"I\u2019m too calm\u2014Let\u2019s take a risk! On the impact of state and trait arousal on risk taking","volume":"50","author":"B Schmidt","year":"2013","journal-title":"Psychophysiology"},{"key":"pcbi.1010785.ref128","first-page":"1074","article-title":"Individual differences in baseline oculometrics: Examining variation in baseline pupil diameter, spontaneous eye blink rate, and fixation stability.","volume":"19","author":"N Unsworth","year":"2019","journal-title":"Cogn Affect Behav Neurosci"},{"key":"pcbi.1010785.ref129","doi-asserted-by":"crossref","first-page":"719","DOI":"10.1093\/brain\/awy341","article-title":"Dopamine restores cognitive motivation in Parkinson\u2019s disease","volume":"142","author":"S McGuigan","year":"2019","journal-title":"Brain"},{"key":"pcbi.1010785.ref130","doi-asserted-by":"crossref","first-page":"1279","DOI":"10.3390\/nu9121279","article-title":"Dose-Dependent Effects of Oral Tyrosine Administration on Plasma Tyrosine Levels and Cognition in Aging.","volume":"9","author":"O van de Rest","year":"2017","journal-title":"Nutrients"},{"key":"pcbi.1010785.ref131","doi-asserted-by":"crossref","first-page":"189","DOI":"10.1080\/19345747.2011.618213","article-title":"Why We (Usually) Don\u2019t Have to Worry About Multiple Comparisons.","volume":"5","author":"A Gelman","year":"2012","journal-title":"Journal of Research on Educational Effectiveness"},{"key":"pcbi.1010785.ref132","article-title":"Baseline-dependent effect of dopamine\u2019s precursor L-tyrosine on working memory gating but not updating.","author":"BJ Jongkees","year":"2020","journal-title":"Cogn Affect Behav Neurosci."}],"updated-by":[{"DOI":"10.1371\/journal.pcbi.1010785","type":"new_version","label":"New version","source":"publisher","updated":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T00:00:00Z","timestamp":1672963200000}}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010785","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2023,1,6]],"date-time":"2023-01-06T19:00:55Z","timestamp":1673031655000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1010785"}},"subtitle":[],"editor":[{"given":"Ulrik R.","family":"Beierholm","sequence":"first","affiliation":[]}],"short-title":[],"issued":{"date-parts":[[2022,12,22]]},"references-count":132,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2022,12,22]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1010785","relation":{"new_version":[{"id-type":"doi","id":"10.1371\/journal.pcbi.1010785","asserted-by":"object"}]},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,12,22]]}}}