{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T18:03:30Z","timestamp":1781201010347,"version":"3.54.1"},"reference-count":103,"publisher":"Public Library of Science (PLoS)","issue":"6","license":[{"start":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T00:00:00Z","timestamp":1781136000000},"content-version":"am","delay-in-days":0,"URL":"http:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":["www.ploscompbiol.org"],"crossmark-restriction":false},"short-container-title":["PLoS Comput Biol"],"abstract":"<jats:p>The catecholamine precursor Tyrosine has been linked to improved cognitive performance, but investigations into decision-making and reinforcement learning processes known to be under catecholamine control are sparse. We examined the impact of a single dose of Tyrosine (2g) on reinforcement learning and exploration in a large (n\u2009=\u200963) gender-balanced sample in a within-subjects preregistered study. Reinforcement learning performance was significantly improved under Tyrosine. Based on previous work, we preregistered the hypotheses that Tyrosine would reduce directed exploration, response times, and physiological arousal. However, neither response times nor physiological arousal revealed the predicted reductions. Computational modelling using an established pre-registered reinforcement learning model revealed that the performance improvement under Tyrosine was due to an increase value-driven exploitation, without affecting directed exploration. Non-preregistered modelling analyses then revealed that accounting for higher-order perseveration substantially improved model fit, and substantiated the observation of increased value-driven exploitation under Tyrosine. Furthermore, it revealed reliable reductions in directed exploration and value-independent perseveration under Tyrosine. Tyrosine thus improved reinforcement learning performance by stabilizing choice patterns in the service of optimizing reward accumulation, modulating several computational mechanisms thought to be under catecholamine control.<\/jats:p>","DOI":"10.1371\/journal.pcbi.1014356","type":"journal-article","created":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T17:45:51Z","timestamp":1781199951000},"page":"e1014356","update-policy":"https:\/\/doi.org\/10.1371\/journal.pcbi.corrections_policy","source":"Crossref","is-referenced-by-count":0,"title":["Catecholamine precursor modulation of human exploration: Evidence from a large gender-balanced sample"],"prefix":"10.1371","volume":"22","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0422-8160","authenticated-orcid":true,"given":"Angela Mariele","family":"Brands","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kilian","family":"Knauth","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-3411-7867","authenticated-orcid":true,"given":"David","family":"Mathar","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tim","family":"Roedder","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Kerstin","family":"Lisner","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0195-5357","authenticated-orcid":true,"given":"Jan","family":"Peters","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"340","published-online":{"date-parts":[[2026,6,11]]},"reference":[{"issue":"6","key":"pcbi.1014356.ref001","doi-asserted-by":"crossref","first-page":"3573","DOI":"10.1093\/cercor\/bhz327","article-title":"Variability in Action Selection Relates to Striatal Dopamine 2\/3 Receptor Availability in Humans: A PET Neuroimaging Study Using Reinforcement Learning and Active Inference Models","volume":"30","author":"RA Adams","year":"2020","journal-title":"Cereb Cortex"},{"issue":"10","key":"pcbi.1014356.ref002","doi-asserted-by":"crossref","first-page":"1931","DOI":"10.1038\/npp.2017.108","article-title":"A Primer on Foraging and the Explore\/Exploit Trade-Off for Psychiatry Research","volume":"42","author":"MA Addicott","year":"2017","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1014356.ref003","doi-asserted-by":"crossref","first-page":"403","DOI":"10.1146\/annurev.neuro.28.061604.135709","article-title":"An integrative theory of locus coeruleus-norepinephrine function: adaptive gain and optimal performance","volume":"28","author":"G Aston-Jones","year":"2005","journal-title":"Annu Rev Neurosci"},{"issue":"7","key":"pcbi.1014356.ref004","doi-asserted-by":"crossref","first-page":"754","DOI":"10.7205\/MILMED-D-14-00594","article-title":"Tyrosine for Mitigating Stress and Enhancing Performance in Healthy Adult Humans, a Rapid Evidence Assessment of the Literature","volume":"180","author":"S Attipoe","year":"2015","journal-title":"Mil Med"},{"issue":"10","key":"pcbi.1014356.ref005","doi-asserted-by":"crossref","first-page":"1116","DOI":"10.1038\/s41562-019-0628-0","article-title":"Altered learning under uncertainty in unmedicated mood and anxiety disorders","volume":"3","author":"J Aylward","year":"2019","journal-title":"Nat Hum Behav"},{"key":"pcbi.1014356.ref006","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-662-57263-4","author":"MF Bear","year":"2018","journal-title":"Neurowissenschaften: Ein grundlegendes Lehrbuch f\u00fcr Biologie, Medizin und Psychologie"},{"key":"pcbi.1014356.ref007","doi-asserted-by":"crossref","first-page":"170","DOI":"10.3389\/fnbeh.2010.00170","article-title":"Tonic dopamine modulates exploitation of reward learning","volume":"4","author":"JA Beeler","year":"2010","journal-title":"Front Behav Neurosci"},{"issue":"2","key":"pcbi.1014356.ref008","doi-asserted-by":"crossref","DOI":"10.1523\/ENEURO.0035-17.2018","article-title":"Neuro-Cognitive Effects of Acute Tyrosine Administration on Reactive and Proactive Response Inhibition in Healthy Older Adults","volume":"5","author":"M Bloemendaal","year":"2018","journal-title":"eNeuro"},{"key":"pcbi.1014356.ref009","article-title":"Multi-plasticities: Distinguishing context-specific habits from complex perseverations","author":"A Bornstein","year":"2023","journal-title":"PsyArXiv"},{"issue":"1","key":"pcbi.1014356.ref010","doi-asserted-by":"crossref","first-page":"39","DOI":"10.5334\/cpsy.101","article-title":"Signatures of Perseveration and Heuristic-Based Directed Exploration in Two-Step Sequential Decision Task Behaviour","volume":"9","author":"AM Brands","year":"2025","journal-title":"Comput Psychiatr"},{"issue":"1","key":"pcbi.1014356.ref011","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1016\/j.tics.2024.10.006","article-title":"Leveraging cognitive neuroscience for making and breaking real-world habits","volume":"29","author":"EK Buabang","year":"2025","journal-title":"Trends Cogn Sci"},{"key":"pcbi.1014356.ref012","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.51260","article-title":"Dopaminergic modulation of the exploration\/exploitation trade-off in human decision-making","volume":"9","author":"K Chakroun","year":"2020","journal-title":"Elife"},{"issue":"1","key":"pcbi.1014356.ref013","doi-asserted-by":"crossref","first-page":"5369","DOI":"10.1038\/s41467-023-41130-y","article-title":"Dopamine regulates decision thresholds in human reinforcement learning in males","volume":"14","author":"K Chakroun","year":"2023","journal-title":"Nat Commun"},{"key":"pcbi.1014356.ref014","article-title":"Dopamine and norepinephrine differentially mediate the exploration-exploitation tradeoff","author":"CS Chen","year":"2023","journal-title":"bioRxiv"},{"issue":"1481","key":"pcbi.1014356.ref015","doi-asserted-by":"crossref","first-page":"933","DOI":"10.1098\/rstb.2007.2098","article-title":"Should I stay or should I go? How the human brain manages the trade-off between exploitation and exploration","volume":"362","author":"JD Cohen","year":"2007","journal-title":"Philos Trans R Soc Lond B Biol Sci"},{"issue":"7","key":"pcbi.1014356.ref016","doi-asserted-by":"crossref","first-page":"1078","DOI":"10.1038\/s41386-022-01517-9","article-title":"Disentangling the roles of dopamine and noradrenaline in the exploration-exploitation tradeoff during human decision-making","volume":"48","author":"A Cremer","year":"2023","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1014356.ref017","doi-asserted-by":"crossref","first-page":"398","DOI":"10.1016\/j.neuropsychologia.2013.12.027","article-title":"Eating to stop: tyrosine supplementation enhances inhibitory control but not response execution","volume":"62","author":"LS Colzato","year":"2014","journal-title":"Neuropsychologia"},{"issue":"5","key":"pcbi.1014356.ref018","article-title":"Spontaneous Eye Blink Rate (EBR) Is Uncorrelated with Dopamine D2 Receptor Availability and Unmodulated by Dopamine Agonism in Healthy Adults","volume":"4","author":"LC Dang","year":"2017","journal-title":"eNeuro"},{"key":"pcbi.1014356.ref019","article-title":"Framing the Exploration-Exploitation Trade-Off: Distinguishing Between Minimizing Losses and Maximizing Gains","volume":"46","author":"L Danwitz","year":"2024","journal-title":"Proceedings of the Annual Meeting of the Cognitive Science Society"},{"issue":"4","key":"pcbi.1014356.ref020","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1007\/s42113-022-00139-0","article-title":"Parameter and Model Recovery of Reinforcement Learning Models for Restless Bandit Problems","volume":"5","author":"L Danwitz","year":"2022","journal-title":"Comput Brain Behav"},{"issue":"6","key":"pcbi.1014356.ref021","doi-asserted-by":"crossref","first-page":"1204","DOI":"10.1016\/j.neuron.2011.02.027","article-title":"Model-based influences on humans\u2019 choices and striatal prediction errors","volume":"69","author":"ND Daw","year":"2011","journal-title":"Neuron"},{"issue":"2","key":"pcbi.1014356.ref022","doi-asserted-by":"crossref","first-page":"290","DOI":"10.1016\/j.brs.2018.12.001","article-title":"Catecholaminergic modulation of indices of cognitive flexibility: A pharmaco-tDCS study","volume":"12","author":"O Dennison","year":"2019","journal-title":"Brain Stimulation"},{"issue":"6507","key":"pcbi.1014356.ref023","doi-asserted-by":"crossref","DOI":"10.1126\/science.abb0184","article-title":"Neural mechanisms resolving exploitation-exploration dilemmas in the medial prefrontal cortex","volume":"369","author":"P Domenech","year":"2020","journal-title":"Science"},{"key":"pcbi.1014356.ref024","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.59907","article-title":"Human complex exploration strategies are enriched by noradrenaline-modulated heuristics","volume":"10","author":"M Dubois","year":"2021","journal-title":"Elife"},{"issue":"1","key":"pcbi.1014356.ref025","doi-asserted-by":"crossref","first-page":"4542","DOI":"10.1038\/s41467-022-31918-9","article-title":"Value-free random exploration is linked to impulsivity","volume":"13","author":"M Dubois","year":"2022","journal-title":"Nat Commun"},{"issue":"1","key":"pcbi.1014356.ref026","doi-asserted-by":"crossref","first-page":"3077","DOI":"10.1038\/s41598-021-82530-8","article-title":"The dynamics of explore-exploit decisions reveal a signal-to-noise mechanism for random exploration","volume":"11","author":"SF Feng","year":"2021","journal-title":"Sci Rep"},{"issue":"5","key":"pcbi.1014356.ref027","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1016\/j.euroneuro.2015.12.003","article-title":"Compulsivity in obsessive-compulsive disorder and addictions","volume":"26","author":"M Figee","year":"2016","journal-title":"Eur Neuropsychopharmacol"},{"issue":"1","key":"pcbi.1014356.ref028","doi-asserted-by":"crossref","first-page":"99","DOI":"10.1038\/s41562-020-00971-z","article-title":"Imprecise neural computations as a source of adaptive behaviour in volatile environments","volume":"5","author":"C Findling","year":"2021","journal-title":"Nat Hum Behav"},{"key":"pcbi.1014356.ref029","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.cobeha.2020.08.004","article-title":"Exploration: from machines to humans","volume":"35","author":"L Fox","year":"2020","journal-title":"Current Opinion in Behavioral Sciences"},{"key":"pcbi.1014356.ref030","doi-asserted-by":"crossref","first-page":"15647","DOI":"10.1073\/pnas.1014269108","article-title":"Understanding dopamine and reinforcement learning: the dopamine reward prediction error hypothesis","author":"PW Glimcher","year":"2011","journal-title":"Proc Natl Acad Sci U S A"},{"issue":"4","key":"pcbi.1014356.ref031","doi-asserted-by":"crossref","first-page":"204","DOI":"10.4330\/wjc.v7.i4.204","article-title":"Autonomic and endocrine control of cardiovascular function","volume":"7","author":"R Gordan","year":"2015","journal-title":"World J Cardiol"},{"key":"pcbi.1014356.ref032","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1002\/mpr.1410","article-title":"Dysfunctions of decision-making and cognitive control as transdiagnostic mechanisms of mental disorders: advances, gaps, and needs in current research","author":"T Goschke","year":"2014","journal-title":"Int J Methods Psychiatr Res"},{"key":"pcbi.1014356.ref033","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.pbb.2015.03.008","article-title":"Behavioral and cognitive effects of tyrosine intake in healthy human adults","volume":"133","author":"A Hase","year":"2015","journal-title":"Pharmacol Biochem Behav"},{"issue":"11","key":"pcbi.1014356.ref034","article-title":"The promise of a model-based psychiatry: building computational models of mental ill health","volume":"4","author":"TU Hauser","year":"2022","journal-title":"Lancet Digit Health"},{"issue":"4","key":"pcbi.1014356.ref035","doi-asserted-by":"crossref","DOI":"10.1111\/adb.13379","article-title":"Does compulsion explain addiction?","volume":"29","author":"A Heinz","year":"2024","journal-title":"Addict Biol"},{"key":"pcbi.1014356.ref036","article-title":"The neurocomputational bases of explore-exploit decision-making","author":"J Hogeveen","year":"2022","journal-title":"Neuron"},{"issue":"2","key":"pcbi.1014356.ref037","doi-asserted-by":"crossref","first-page":"1311","DOI":"10.1007\/s12144-024-07257-x","article-title":"Explore-exploit behavior in humans as a sequential sampling process","volume":"44","author":"TM Houser","year":"2025","journal-title":"Curr Psychol"},{"issue":"1","key":"pcbi.1014356.ref038","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1038\/s41386-020-0746-4","article-title":"Advances in the computational understanding of mental illness","volume":"46","author":"QJM Huys","year":"2021","journal-title":"Neuropsychopharmacology"},{"issue":"3","key":"pcbi.1014356.ref039","doi-asserted-by":"crossref","first-page":"404","DOI":"10.1038\/nn.4238","article-title":"Computational psychiatry as a bridge from neuroscience to clinical applications","volume":"19","author":"QJM Huys","year":"2016","journal-title":"Nat Neurosci"},{"key":"pcbi.1014356.ref040","doi-asserted-by":"crossref","first-page":"1101","DOI":"10.3389\/fpsyg.2014.01101","article-title":"People are different: tyrosine\u2019s modulating effect on cognitive control in healthy humans may depend on individual differences related to dopamine function","volume":"5","author":"BJ Jongkees","year":"2014","journal-title":"Front Psychol"},{"key":"pcbi.1014356.ref041","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.jpsychires.2015.08.014","article-title":"Effect of tyrosine supplementation on clinical and healthy populations under stress or cognitive demands--A review","volume":"70","author":"BJ Jongkees","year":"2015","journal-title":"J Psychiatr Res"},{"issue":"1","key":"pcbi.1014356.ref042","doi-asserted-by":"crossref","first-page":"221","DOI":"10.1016\/j.neuron.2015.11.028","article-title":"Relationships between Pupil Diameter and Neuronal Activity in the Locus Coeruleus, Colliculi, and Cingulate Cortex","volume":"89","author":"S Joshi","year":"2016","journal-title":"Neuron"},{"issue":"2","key":"pcbi.1014356.ref043","doi-asserted-by":"crossref","first-page":"454","DOI":"10.1038\/npp.2014.193","article-title":"Dopamine, locus of control, and the exploration-exploitation tradeoff","volume":"40","author":"AS Kayser","year":"2015","journal-title":"Neuropsychopharmacology"},{"key":"pcbi.1014356.ref044","doi-asserted-by":"crossref","first-page":"113","DOI":"10.1016\/j.neuroimage.2018.10.075","article-title":"L-DOPA reduces model-free control of behavior by attenuating the transfer of value to action","volume":"186","author":"NB Kroemer","year":"2019","journal-title":"Neuroimage"},{"issue":"6","key":"pcbi.1014356.ref045","doi-asserted-by":"crossref","first-page":"1097","DOI":"10.1007\/s00426-017-0957-4","article-title":"Food for thought: association between dietary tyrosine and cognitive performance in younger and older adults","volume":"83","author":"S K\u00fchn","year":"2019","journal-title":"Psychol Res"},{"issue":"13","key":"pcbi.1014356.ref046","doi-asserted-by":"crossref","first-page":"1","DOI":"10.18637\/jss.v082.i13","article-title":"lmerTest Package: Tests in Linear Mixed Effects Models","volume":"82","author":"A Kuznetsova","year":"2017","journal-title":"Journal of Statistical Software"},{"issue":"2","key":"pcbi.1014356.ref047","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1152\/physrev.00042.2006","article-title":"Catecholaminergic systems in stress: Structural and molecular genetic approaches","volume":"89","author":"R Kvetnansky","year":"2009","journal-title":"Physiological Reviews"},{"key":"pcbi.1014356.ref048","volume-title":"On the kinetic and macroscopic fluid descriptions of gases and plasmas (No. TRITA-PFU--84-10)","author":"B Lehnert","year":"1984"},{"issue":"4","key":"pcbi.1014356.ref049","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1080\/1028415031000120552","article-title":"Effects of tyrosine, phentermine, caffeine D-amphetamine, and placebo on cognitive and motor performance deficits during sleep deprivation","volume":"6","author":"RA Magill","year":"2003","journal-title":"Nutr Neurosci"},{"issue":"4","key":"pcbi.1014356.ref050","doi-asserted-by":"crossref","first-page":"1689","DOI":"10.3758\/s13428-020-01516-y","article-title":"NeuroKit2: A Python toolbox for neurophysiological signal processing","volume":"53","author":"D Makowski","year":"2021","journal-title":"Behav Res Methods"},{"issue":"12","key":"pcbi.1014356.ref051","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1010785","article-title":"The catecholamine precursor Tyrosine reduces autonomic arousal and decreases decision thresholds in reinforcement learning and temporal discounting","volume":"18","author":"D Mathar","year":"2022","journal-title":"PLoS Comput Biol"},{"issue":"3","key":"pcbi.1014356.ref052","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1008659","article-title":"Rational inattention and tonic dopamine","volume":"17","author":"JG Mikhael","year":"2021","journal-title":"PLoS Comput Biol"},{"issue":"2","key":"pcbi.1014356.ref053","doi-asserted-by":"crossref","first-page":"292","DOI":"10.1037\/rev0000120","article-title":"Habits without values","volume":"126","author":"KJ Miller","year":"2019","journal-title":"Psychol Rev"},{"issue":"1","key":"pcbi.1014356.ref054","doi-asserted-by":"crossref","first-page":"30","DOI":"10.5334\/cpsy.86","article-title":"Reliability of Decision-Making and Reinforcement Learning Computational Parameters","volume":"7","author":"A Mkrtchian","year":"2023","journal-title":"Comput Psychiatr"},{"issue":"1","key":"pcbi.1014356.ref055","doi-asserted-by":"crossref","first-page":"72","DOI":"10.1016\/j.tics.2011.11.018","article-title":"Computational psychiatry","volume":"16","author":"PR Montague","year":"2012","journal-title":"Trends Cogn Sci"},{"issue":"4","key":"pcbi.1014356.ref056","doi-asserted-by":"crossref","first-page":"940","DOI":"10.1038\/npp.2015.208","article-title":"Biases in the Explore-Exploit Tradeoff in Addictions: The Role of Avoidance of Uncertainty","volume":"41","author":"LS Morris","year":"2016","journal-title":"Neuropsychopharmacology"},{"issue":"3","key":"pcbi.1014356.ref057","doi-asserted-by":"crossref","DOI":"10.1177\/2043808718779431","article-title":"A systematic review of the relationship between rigidity\/flexibility and transdiagnostic cognitive and behavioral processes that maintain psychopathology","volume":"9","author":"L Morris","year":"2018","journal-title":"Journal of Experimental Psychopathology"},{"issue":"8","key":"pcbi.1014356.ref058","doi-asserted-by":"crossref","first-page":"4140","DOI":"10.1002\/hbm.22466","article-title":"Pupil diameter covaries with BOLD activity in human locus coeruleus","volume":"35","author":"PR Murphy","year":"2014","journal-title":"Hum Brain Mapp"},{"key":"pcbi.1014356.ref059","doi-asserted-by":"crossref","first-page":"1039172","DOI":"10.3389\/fpsyg.2022.1039172","article-title":"A practical introduction to using the drift diffusion model of decision-making in cognitive psychology, neuroscience, and health sciences","volume":"13","author":"CE Myers","year":"2022","journal-title":"Front Psychol"},{"key":"pcbi.1014356.ref060","doi-asserted-by":"crossref","first-page":"101443","DOI":"10.1016\/j.cobeha.2024.101443","article-title":"\u201cBut why?\u201d Dopamine and causal learning","volume":"60","author":"VM Namboodiri","year":"2024","journal-title":"Current Opinion in Behavioral Sciences"},{"issue":"1","key":"pcbi.1014356.ref061","doi-asserted-by":"crossref","first-page":"92949","DOI":"10.1525\/collabra.92949","article-title":"Characterizing Human Habits in the Lab","volume":"10","author":"S Nebe","year":"2024","journal-title":"Collabra Psychol"},{"issue":"1","key":"pcbi.1014356.ref062","doi-asserted-by":"crossref","first-page":"78","DOI":"10.1037\/bne0000541","article-title":"Choice-confirmation bias and gradual perseveration in human reinforcement learning","volume":"137","author":"S Palminteri","year":"2023","journal-title":"Behav Neurosci"},{"issue":"4","key":"pcbi.1014356.ref063","doi-asserted-by":"crossref","first-page":"1234","DOI":"10.3758\/s13423-016-1199-y","article-title":"The drift diffusion model as the choice rule in reinforcement learning","volume":"24","author":"ML Pedersen","year":"2017","journal-title":"Psychon Bull Rev"},{"issue":"7106","key":"pcbi.1014356.ref064","doi-asserted-by":"crossref","first-page":"1042","DOI":"10.1038\/nature05051","article-title":"Dopamine-dependent prediction errors underpin reward-seeking behaviour in humans","volume":"442","author":"M Pessiglione","year":"2006","journal-title":"Nature"},{"issue":"4","key":"pcbi.1014356.ref065","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1007615","article-title":"The drift diffusion model as the choice rule in inter-temporal and risky choice: A case study in medial orbitofrontal cortex lesion patients and controls","volume":"16","author":"J Peters","year":"2020","journal-title":"PLoS Computational Biology"},{"key":"pcbi.1014356.ref066","article-title":"Tonic dopamine and biases in value learning linked through a biologically inspired reinforcement learning model (p. 2023.11.10.566580)","author":"SR Pinto","year":"2023","journal-title":"bioRxiv"},{"key":"pcbi.1014356.ref067","unstructured":"Rakuten Insight. Frequency of taking dietary supplements or nutraceuticals in India as of March 2022, by age [Graph]. In Statista. 2022. Retrieved October 05, 2023, from https:\/\/www.statista.com\/statistics\/1182324\/india-frequency-of-taking-dietary-supplements-by-age\/"},{"issue":"4","key":"pcbi.1014356.ref068","doi-asserted-by":"crossref","first-page":"873","DOI":"10.1162\/neco.2008.12-06-420","article-title":"The diffusion decision model: theory and data for two-choice decision tasks","volume":"20","author":"R Ratcliff","year":"2008","journal-title":"Neural Comput"},{"key":"pcbi.1014356.ref069","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1016\/j.jad.2019.09.031","article-title":"Tyrosine negatively affects flexible-like behaviour under cognitively demanding conditions","volume":"260","author":"A Robson","year":"2020","journal-title":"J Affect Disord"},{"key":"pcbi.1014356.ref070","volume-title":"RStudio: Integrated Development for R","author":"RStudio Team","year":"2020"},{"key":"pcbi.1014356.ref071","author":"GA Rummery","year":"1994"},{"issue":"27","key":"pcbi.1014356.ref072","doi-asserted-by":"crossref","first-page":"9811","DOI":"10.1523\/JNEUROSCI.0702-15.2015","article-title":"Dopaminergic Modulation of Decision Making and Subjective Well-Being","volume":"35","author":"RB Rutledge","year":"2015","journal-title":"J Neurosci"},{"key":"pcbi.1014356.ref073","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1016\/j.conb.2018.11.003","article-title":"The algorithmic architecture of exploration in the human brain","volume":"55","author":"E Schulz","year":"2019","journal-title":"Curr Opin Neurobiol"},{"key":"pcbi.1014356.ref074","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.41703","article-title":"Computational mechanisms of curiosity and goal-directed exploration","volume":"8","author":"P Schwartenbeck","year":"2019","journal-title":"Elife"},{"issue":"9","key":"pcbi.1014356.ref075","doi-asserted-by":"crossref","first-page":"1081","DOI":"10.1111\/ejn.13895","article-title":"Spontaneous eye blink rate and dopamine synthesis capacity: preliminary evidence for an absence of positive correlation","volume":"47","author":"G Sescousse","year":"2018","journal-title":"Eur J Neurosci"},{"issue":"8","key":"pcbi.1014356.ref076","doi-asserted-by":"crossref","first-page":"2519","DOI":"10.1093\/brain\/awaa182","article-title":"Dopamine is associated with prioritization of reward-associated memories in Parkinson\u2019s disease","volume":"143","author":"ME Sharp","year":"2020","journal-title":"Brain"},{"key":"pcbi.1014356.ref077","unstructured":"Signal Developers. Signal: Signal processing. 2014. http:\/\/r-forge.r-project.org\/projects\/signal\/"},{"key":"pcbi.1014356.ref078","unstructured":"Spyder Development Team. Spyder (Version 6.1) [Windows 11]. 2025. https:\/\/www.spyder-ide.org\/"},{"key":"pcbi.1014356.ref079","unstructured":"Stan Development Team. Stan User\u2019s Guide, v2.32.1. 2023. https:\/\/mc-stan.org"},{"key":"pcbi.1014356.ref080","unstructured":"Statista. Do you personally take any food supplements like proteins, vitamins, or minerals on a regular basis? [Graph]. In Statista. 2020. Retrieved October 05, 2023, from https:\/\/www.statista.com\/forecasts\/1093545\/regular-intake-of-food-supplements-in-the-us"},{"key":"pcbi.1014356.ref081","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1016\/j.neuropsychologia.2015.01.022","article-title":"Tyrosine promotes cognitive flexibility: evidence from proactive vs. reactive control during task switching performance","volume":"69","author":"L Steenbergen","year":"2015","journal-title":"Neuropsychologia"},{"key":"pcbi.1014356.ref082","volume-title":"Reinforcement learning: An introduction","author":"R Sutton","year":"2018","edition":"2"},{"key":"pcbi.1014356.ref083","doi-asserted-by":"crossref","first-page":"101464","DOI":"10.1016\/j.cobeha.2024.101464","article-title":"Complementary roles of serotonin and dopamine in model-based learning","volume":"61","author":"M Taira","year":"2025","journal-title":"Curr Opin Behav Sci"},{"issue":"3","key":"pcbi.1014356.ref084","doi-asserted-by":"crossref","first-page":"314","DOI":"10.1007\/s42113-024-00202-y","article-title":"Exploration\u2013Exploitation Mechanisms in Recurrent Neural Networks and Human Learners in Restless Bandit Problems","volume":"7","author":"D Tuzsus","year":"2024","journal-title":"Comput Brain Behav"},{"issue":"5","key":"pcbi.1014356.ref085","doi-asserted-by":"crossref","first-page":"1413","DOI":"10.1007\/s11222-016-9696-4","article-title":"Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC","volume":"27","author":"A Vehtari","year":"2016","journal-title":"Stat Comput"},{"issue":"6","key":"pcbi.1014356.ref086","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1016\/j.biopsych.2017.04.006","article-title":"Model-Based Control in Dimensional Psychiatry","volume":"82","author":"V Voon","year":"2017","journal-title":"Biol Psychiatry"},{"issue":"1","key":"pcbi.1014356.ref087","doi-asserted-by":"crossref","first-page":"49","DOI":"10.32614\/RJ-2014-005","article-title":"The RWiener Package: An R Package Providing Distribution Functions for the Wiener Diffusion Model","volume":"6","author":"D Wabersich","year":"2014","journal-title":"The R Journal"},{"issue":"5","key":"pcbi.1014356.ref088","doi-asserted-by":"crossref","first-page":"641","DOI":"10.1080\/09541440802205067","article-title":"Methodological and empirical developments for the Ratcliff diffusion model of response times and accuracy","volume":"21","author":"E-J Wagenmakers","year":"2009","journal-title":"European Journal of Cognitive Psychology"},{"issue":"41","key":"pcbi.1014356.ref089","doi-asserted-by":"crossref","first-page":"7936","DOI":"10.1523\/JNEUROSCI.0592-20.2020","article-title":"Dopaminergic Modulation of Human Intertemporal Choice: A Diffusion Model Analysis Using the D2-Receptor Antagonist Haloperidol","volume":"40","author":"B Wagner","year":"2020","journal-title":"J Neurosci"},{"issue":"4","key":"pcbi.1014356.ref090","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pcbi.1011516","article-title":"Dopamine encoding of novelty facilitates efficient uncertainty-driven exploration","volume":"20","author":"Y Wang","year":"2024","journal-title":"PLoS Comput Biol"},{"issue":"4","key":"pcbi.1014356.ref091","doi-asserted-by":"crossref","DOI":"10.1371\/journal.pone.0176034","article-title":"The effect of atomoxetine on random and directed exploration in humans","volume":"12","author":"CM Warren","year":"2017","journal-title":"PLoS One"},{"key":"pcbi.1014356.ref092","doi-asserted-by":"crossref","first-page":"219","DOI":"10.1016\/B978-0-12-803676-1.00010-6","article-title":"Cognitive, Emotional, and Behavioral Inflexibility and Perseveration in Neuropsychiatric Illness","author":"DS Weisholtz","year":"2017","journal-title":"Executive Functions in Health and Disease. Elsevier"},{"key":"pcbi.1014356.ref093","doi-asserted-by":"crossref","unstructured":"Westbrook A, Van Den Bosch R, Hofmans L, Papadopetraki D, Maatta JI, Collins AGE, et al. Striatal dopamine can enhance learning, both fast and slow, and also make it cheaper. 2024. https:\/\/doi.org\/10.1101\/2024.02.14.580392","DOI":"10.1101\/2024.02.14.580392"},{"key":"pcbi.1014356.ref094","unstructured":"Wickham H, Fran\u00e7ois R, Henry L, M\u00fcller K, Vaughan D. dplyr: A Grammar of Data Manipulation. 2025.R package version 1.1.4,& https:\/\/dplyr.tidyverse.org"},{"issue":"11","key":"pcbi.1014356.ref095","doi-asserted-by":"crossref","first-page":"2512","DOI":"10.1523\/JNEUROSCI.1607-20.2021","article-title":"Attenuated Directed Exploration during Reinforcement Learning in Gambling Disorder","volume":"41","author":"A Wiehler","year":"2021","journal-title":"J Neurosci"},{"key":"pcbi.1014356.ref096","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.cobeha.2020.10.001","article-title":"Balancing exploration and exploitation with information and randomization","volume":"38","author":"RC Wilson","year":"2021","journal-title":"Curr Opin Behav Sci"},{"key":"pcbi.1014356.ref097","doi-asserted-by":"crossref","DOI":"10.7554\/eLife.49547","article-title":"Ten simple rules for the computational modeling of behavioral data","volume":"8","author":"RC Wilson","year":"2019","journal-title":"Elife"},{"issue":"6","key":"pcbi.1014356.ref098","doi-asserted-by":"crossref","first-page":"2074","DOI":"10.1037\/a0038199","article-title":"Humans use directed and random exploration to solve the explore-exploit dilemma","volume":"143","author":"RC Wilson","year":"2014","journal-title":"J Exp Psychol Gen"},{"issue":"8","key":"pcbi.1014356.ref099","doi-asserted-by":"crossref","first-page":"690","DOI":"10.1016\/j.biopsych.2022.09.034","article-title":"Identifying Transdiagnostic Mechanisms in Mental Health Using Computational Factor Modeling","volume":"93","author":"T Wise","year":"2023","journal-title":"Biol Psychiatry"},{"key":"pcbi.1014356.ref100","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.cobeha.2020.10.001","article-title":"Balancing exploration and exploitation with information and randomization","volume":"38","author":"RC Wilson","year":"2021","journal-title":"Curr Opin Behav Sci"},{"issue":"4","key":"pcbi.1014356.ref101","doi-asserted-by":"crossref","first-page":"315","DOI":"10.1016\/S0031-6997(25)06841-3","article-title":"Precursor control of neurotransmitter synthesis","volume":"32","author":"RJ Wurtman","year":"1980","journal-title":"Pharmacol Rev"},{"issue":"3","key":"pcbi.1014356.ref102","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1016\/j.bpsgos.2022.03.011","article-title":"From Computation to Clinic","volume":"3","author":"SW Yip","year":"2022","journal-title":"Biol Psychiatry Glob Open Sci"},{"issue":"6","key":"pcbi.1014356.ref103","doi-asserted-by":"crossref","DOI":"10.18637\/jss.v014.i06","article-title":"zoo \u00a0: S3 Infrastructure for Regular and Irregular Time Series","volume":"14","author":"A Zeileis","year":"2005","journal-title":"J Stat Soft"}],"container-title":["PLOS Computational Biology"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014356","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,6,11]],"date-time":"2026-06-11T17:46:11Z","timestamp":1781199971000},"score":1,"resource":{"primary":{"URL":"https:\/\/dx.plos.org\/10.1371\/journal.pcbi.1014356"}},"subtitle":[],"editor":[{"given":"Bastien","family":"Blain","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"editor"}]}],"short-title":[],"issued":{"date-parts":[[2026,6,11]]},"references-count":103,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2026,6,11]]}},"URL":"https:\/\/doi.org\/10.1371\/journal.pcbi.1014356","relation":{},"ISSN":["1553-7358"],"issn-type":[{"value":"1553-7358","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,6,11]]}}}