{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T14:32:01Z","timestamp":1787841121088,"version":"build-2784847793"},"reference-count":53,"publisher":"Springer Science and Business Media LLC","issue":"9","license":[{"start":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T00:00:00Z","timestamp":1772582400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T00:00:00Z","timestamp":1772582400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100003407","name":"Ministero dell\u2019Istruzione, dell\u2019Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["2022LLCH97"],"award-info":[{"award-number":["2022LLCH97"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100003407","name":"Ministero dell\u2019Istruzione, dell\u2019Universit\u00e0 e della Ricerca","doi-asserted-by":"publisher","award":["1553 11.10.2022"],"award-info":[{"award-number":["1553 11.10.2022"]}],"id":[{"id":"10.13039\/501100003407","id-type":"DOI","asserted-by":"publisher"}]},{"name":"Alma Mater Studiorum - Universit\u00e0 di Bologna"}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Ann Biomed Eng"],"published-print":{"date-parts":[[2026,9]]},"abstract":"<jats:title>Abstract<\/jats:title>\n                  <jats:sec>\n                    <jats:title>Purpose<\/jats:title>\n                    <jats:p>Reinforcement learning with reversal is a paradigm frequently employed in neuropsychology to assess the adaptive capacity and flexibility in individuals in non-stationary environments. Each single behavior, however, depends on the superimposition of multiple factors, which are still not completely understood.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Methods<\/jats:title>\n                    <jats:p>We optimize a neurocomputational model of the Basal Ganglia to simulate the behavior of 18 patients with Parkinson\u2019s disease (both ON and OFF medication) and 14 control subjects during a two-choice probabilistic reversal learning task (with 80\u201320% reward probabilities).<\/jats:p>\n                    <jats:p>The individual behavior (in terms of the cumulative number of correct responses during a 40-trials direct phase and a 40-trial reversal phase) is reproduced by fitting a few model parameters for each individual, representing the tonic dopamine level, Hebbian learning, and the exploratory attitude (noise level).<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Results<\/jats:title>\n                    <jats:p>Results show that very different responses can be explained quite well, ascribing them to the varying combination of the aforementioned individual factors. The tonic dopamine level is significantly different for patients in ON and OFF medication, while the other parameters were not statistically different. A regression analysis reveals that the value of the Hebbian learning rate is correlated with the subject's sensitivity to punishments. In contrast, the noise standard deviation is correlated with exploration, i.e., the tendency to modify the choice even after a reward.<\/jats:p>\n                  <\/jats:sec>\n                  <jats:sec>\n                    <jats:title>Conclusion<\/jats:title>\n                    <jats:p>The results provide a mechanistic explanation of the various factors that affect adaptation and flexibility in reinforcement learning, representing a first step toward characterizing and understanding the diverse behaviors on an individual basis.<\/jats:p>\n                  <\/jats:sec>","DOI":"10.1007\/s10439-026-04038-4","type":"journal-article","created":{"date-parts":[[2026,3,4]],"date-time":"2026-03-04T13:53:13Z","timestamp":1772632393000},"page":"3192-3212","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["A Mechanistic Understanding of the Different Factors Affecting Adaptation and Flexibility During Probabilistic Reversal Learning: A Neurocomputational Study on Patients with Parkinson\u2019s Disease and Control Subjects"],"prefix":"10.1007","volume":"54","author":[{"ORCID":"https:\/\/orcid.org\/0009-0002-2981-7164","authenticated-orcid":false,"given":"Giulia","family":"Piermaria","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0009-8656-3659","authenticated-orcid":false,"given":"Silvana","family":"Pelle","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0004-5772-6731","authenticated-orcid":false,"given":"Alessio","family":"Zizzi","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0001-6009-4350","authenticated-orcid":false,"given":"Carola","family":"Cosentino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-2576-4491","authenticated-orcid":false,"given":"Susanna","family":"Mezzarobba","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9447-3532","authenticated-orcid":false,"given":"Giovanna","family":"Calandra-Buonaura","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-5939-7933","authenticated-orcid":false,"given":"Luisa","family":"Sambati","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0009-0000-9755-5309","authenticated-orcid":false,"given":"Federica","family":"Scarpellini","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-9880-2241","authenticated-orcid":false,"given":"Elisa","family":"Pelosin","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-0911-0308","authenticated-orcid":false,"given":"Mauro","family":"Ursino","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2026,3,4]]},"reference":[{"key":"4038_CR1","unstructured":"Sutton RS, Barto AG. Reinforcement Learning: An Introduction."},{"key":"4038_CR2","doi-asserted-by":"publisher","first-page":"769","DOI":"10.3390\/brainsci11060769","volume":"11","author":"P Feraco","year":"2021","unstructured":"Feraco, P., C. Gagliardo, G. La Tona, E. Bruno, C. D\u2019angelo, M. Marrale, et al. Imaging of Substantia Nigra in Parkinson\u2019s Disease: A Narrative Review. Brain Sciences. 11:769, 2021. https:\/\/doi.org\/10.3390\/brainsci11060769.","journal-title":"Brain Sciences."},{"key":"4038_CR3","doi-asserted-by":"publisher","first-page":"4","DOI":"10.1186\/s40708-023-00215-6","volume":"11","author":"I Gigi","year":"2024","unstructured":"Gigi, I., R. Senatore, and A. Marcelli. The onset of motor learning impairments in Parkinson\u2019s disease: a computational investigation. Brain Inf. 11:4, 2024. https:\/\/doi.org\/10.1186\/s40708-023-00215-6.","journal-title":"Brain Inf."},{"key":"4038_CR4","doi-asserted-by":"publisher","first-page":"79","DOI":"10.1016\/j.neuroimage.2018.11.021","volume":"190","author":"D Meder","year":"2019","unstructured":"Meder, D., D. M. Herz, J. B. Rowe, S. Leh\u00e9ricy, and H. R. Siebner. The role of dopamine in the brain - lessons learned from Parkinson\u2019s disease. NeuroImage. 190:79\u201393, 2019. https:\/\/doi.org\/10.1016\/j.neuroimage.2018.11.021.","journal-title":"NeuroImage."},{"key":"4038_CR5","doi-asserted-by":"publisher","first-page":"1302","DOI":"10.1016\/j.neuron.2018.08.002","volume":"99","author":"S Nonomura","year":"2018","unstructured":"Nonomura, S., K. Nishizawa, Y. Sakai, Y. Kawaguchi, S. Kato, M. Uchigashima, et al. Monitoring and Updating of Action Selection for Goal-Directed Behavior through the Striatal Direct and Indirect Pathways. Neuron. 99:1302-1314.e5, 2018. https:\/\/doi.org\/10.1016\/j.neuron.2018.08.002.","journal-title":"Neuron."},{"key":"4038_CR6","doi-asserted-by":"publisher","first-page":"12","DOI":"10.1016\/j.neuroscience.2016.03.021","volume":"345","author":"A Izquierdo","year":"2017","unstructured":"Izquierdo, A., J. L. Brigman, A. K. Radke, P. H. Rudebeck, and A. Holmes. The neural basis of reversal learning: An updated perspective. Neuroscience. 345:12\u201326, 2017. https:\/\/doi.org\/10.1016\/j.neuroscience.2016.03.021.","journal-title":"Neuroscience."},{"key":"4038_CR7","doi-asserted-by":"publisher","first-page":"15104","DOI":"10.1523\/JNEUROSCI.3524-09.2009","volume":"29","author":"RB Rutledge","year":"2009","unstructured":"Rutledge, R. B., S. C. Lazzaro, B. Lau, C. E. Myers, M. A. Gluck, and P. W. Glimcher. Dopaminergic Drugs Modulate Learning Rates and Perseveration in Parkinson\u2019s Patients in a Dynamic Foraging Task. J Neurosci. 29:15104\u201315114, 2009. https:\/\/doi.org\/10.1523\/JNEUROSCI.3524-09.2009.","journal-title":"J Neurosci."},{"key":"4038_CR8","doi-asserted-by":"publisher","first-page":"2385","DOI":"10.1093\/brain\/awp094","volume":"132","author":"N Bodi","year":"2009","unstructured":"Bodi, N., S. Keri, H. Nagy, A. Moustafa, C. E. Myers, N. Daw, et al. Reward-learning and the novelty-seeking personality: a between- and within-subjects study of the effects of dopamine agonists on young Parkinson\u2019s patients. Brain. 132:2385\u20132395, 2009. https:\/\/doi.org\/10.1093\/brain\/awp094.","journal-title":"Brain."},{"key":"4038_CR9","doi-asserted-by":"publisher","first-page":"1663","DOI":"10.1016\/j.neuropsychologia.2006.03.030","volume":"44","author":"R Cools","year":"2006","unstructured":"Cools, R., L. Altamirano, and M. D\u2019Esposito. Reversal learning in Parkinson\u2019s disease depends on medication status and outcome valence. Neuropsychologia. 44:1663\u20131673, 2006. https:\/\/doi.org\/10.1016\/j.neuropsychologia.2006.03.030.","journal-title":"Neuropsychologia."},{"key":"4038_CR10","doi-asserted-by":"publisher","first-page":"1120","DOI":"10.1016\/j.neunet.2006.03.006","volume":"19","author":"MJ Frank","year":"2006","unstructured":"Frank, M. J. Hold your horses: A dynamic computational role for the subthalamic nucleus in decision making. Neural Networks. 19:1120\u20131136, 2006. https:\/\/doi.org\/10.1016\/j.neunet.2006.03.006.","journal-title":"Neural Networks."},{"key":"4038_CR11","doi-asserted-by":"publisher","first-page":"1940","DOI":"10.1126\/science.1102941","volume":"306","author":"MJ Frank","year":"2004","unstructured":"Frank, M. J., L. C. Seeberger, and R. C. O\u2019Reilly. By Carrot or by Stick: Cognitive Reinforcement Learning in Parkinsonism. Science. 306:1940\u20131943, 2004. https:\/\/doi.org\/10.1126\/science.1102941.","journal-title":"Science."},{"key":"4038_CR12","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2010.00169","author":"S Graef","year":"2010","unstructured":"Graef, S., G. Biele, L. K. Krugel, F. Marzinzik, M. Wahl, J. Wotka, et al. Differential Influence of Levodopa on Reward-Based Learning in Parkinson\u2019s Disease. Front Hum Neurosci. 2010. https:\/\/doi.org\/10.3389\/fnhum.2010.00169.","journal-title":"Front Hum Neurosci"},{"key":"4038_CR13","doi-asserted-by":"publisher","first-page":"3422","DOI":"10.1093\/brain\/awaa335","volume":"143","author":"AJ Van Nuland","year":"2020","unstructured":"Van Nuland, A. J., R. C. Helmich, M. F. Dirkx, H. Zach, I. Toni, R. Cools, et al. Effects of dopamine on reinforcement learning in Parkinson\u2019s disease depend on motor phenotype. Brain. 143:3422\u20133434, 2020. https:\/\/doi.org\/10.1093\/brain\/awaa335.","journal-title":"Brain."},{"key":"4038_CR14","doi-asserted-by":"publisher","first-page":"3144","DOI":"10.1016\/j.neuropsychologia.2008.07.011","volume":"46","author":"AA Moustafa","year":"2008","unstructured":"Moustafa, A. A., S. J. Sherman, and M. J. Frank. A dopaminergic basis for working memory, learning and attentional shifting in Parkinsonism. Neuropsychologia. 46:3144\u20133156, 2008. https:\/\/doi.org\/10.1016\/j.neuropsychologia.2008.07.011.","journal-title":"Neuropsychologia."},{"key":"4038_CR15","doi-asserted-by":"publisher","first-page":"3721","DOI":"10.1093\/brain\/aws273","volume":"135","author":"EJ Coulthard","year":"2012","unstructured":"Coulthard, E. J., R. Bogacz, S. Javed, L. K. Mooney, G. Murphy, S. Keeley, et al. Distinct roles of dopamine and subthalamic nucleus in learning and probabilistic decision making. Brain. 135:3721\u20133734, 2012. https:\/\/doi.org\/10.1093\/brain\/aws273.","journal-title":"Brain."},{"key":"4038_CR16","doi-asserted-by":"publisher","first-page":"e26801","DOI":"10.7554\/eLife.26801","volume":"6","author":"JP Grogan","year":"2017","unstructured":"Grogan, J. P., D. Tsivos, L. Smith, B. E. Knight, R. Bogacz, A. Whone, et al. Effects of dopamine on reinforcement learning and consolidation in Parkinson\u2019s disease. eLife. 6:e26801, 2017. https:\/\/doi.org\/10.7554\/eLife.26801.","journal-title":"eLife"},{"key":"4038_CR17","doi-asserted-by":"crossref","unstructured":"Cools R, Tichelaar JG, Helmich RCG, Bloem BR, Esselink RAJ, Smulders K, et al. Role of dopamine and clinical heterogeneity in cognitive dysfunction in Parkinson\u2019s disease. Prog. Brain Res. pp. 309\u201343, 2022.","DOI":"10.1016\/bs.pbr.2022.01.012"},{"key":"4038_CR18","doi-asserted-by":"publisher","first-page":"970","DOI":"10.1016\/S0140-6736(86)90617-3","volume":"328","author":"A-M Gotham","year":"1986","unstructured":"Gotham, A.-M., R. G. Brown, and C. D. Marsden. Levodopa treatment may benefit or impair 'frontal' function in Parkinson's disease. The Lancet. 328:970\u2013971, 1986. https:\/\/doi.org\/10.1016\/S0140-6736(86)90617-3.","journal-title":"The Lancet."},{"key":"4038_CR19","doi-asserted-by":"publisher","first-page":"1920","DOI":"10.1002\/mds.25687","volume":"28","author":"DE Vaillancourt","year":"2013","unstructured":"Vaillancourt, D. E., D. Schonfeld, Y. Kwak, N. I. Bohnen, and R. Seidler. Dopamine overdose hypothesis: Evidence and clinical implications. Movement Disorders. 28:1920\u20131929, 2013. https:\/\/doi.org\/10.1002\/mds.25687.","journal-title":"Movement Disorders."},{"key":"4038_CR20","doi-asserted-by":"publisher","DOI":"10.3389\/fnins.2012.00009","author":"M Humphries","year":"2012","unstructured":"Humphries, M. Dopaminergic control of the exploration-exploitation trade-off via the basal ganglia. Front Neurosci. 2012. https:\/\/doi.org\/10.3389\/fnins.2012.00009.","journal-title":"Front Neurosci."},{"key":"4038_CR21","doi-asserted-by":"publisher","DOI":"10.1016\/j.nlm.2024.107985","volume":"215","author":"M Ursino","year":"2024","unstructured":"Ursino, M., S. Pelle, F. Nekka, P. Robaey, and M. Schirru. Valence-dependent dopaminergic modulation during reversal learning in Parkinson\u2019s disease: A neurocomputational approach. Neurobiology of Learning and Memory.215:107985, 2024. https:\/\/doi.org\/10.1016\/j.nlm.2024.107985.","journal-title":"Neurobiology of Learning and Memory."},{"key":"4038_CR22","doi-asserted-by":"publisher","first-page":"3452","DOI":"10.3390\/ijms23073452","volume":"23","author":"M Schirru","year":"2022","unstructured":"Schirru, M., F. V\u00e9ronneau-Veilleux, F. Nekka, and M. Ursino. Phasic Dopamine Changes and Hebbian Mechanisms during Probabilistic Reversal Learning in Striatal Circuits: A Computational Study. IJMS. 23:3452, 2022. https:\/\/doi.org\/10.3390\/ijms23073452.","journal-title":"IJMS."},{"key":"4038_CR23","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1155\/2015\/187417","volume":"2015","author":"C Baston","year":"2015","unstructured":"Baston, C., and M. Ursino. A Biologically Inspired Computational Model of Basal Ganglia in Action Selection. Computational Intelligence and Neuroscience. 2015:1\u201324, 2015. https:\/\/doi.org\/10.1155\/2015\/187417.","journal-title":"Computational Intelligence and Neuroscience."},{"key":"4038_CR24","doi-asserted-by":"publisher","first-page":"120","DOI":"10.1016\/j.jmp.2013.08.003","volume":"59","author":"AA Moustafa","year":"2014","unstructured":"Moustafa, A. A., M. M. Herzallah, and M. A. Gluck. A model of reversal learning and working memory in medicated and unmedicated patients with Parkinson\u2019s disease. Journal of Mathematical Psychology. 59:120\u2013131, 2014. https:\/\/doi.org\/10.1016\/j.jmp.2013.08.003.","journal-title":"Journal of Mathematical Psychology."},{"key":"4038_CR25","doi-asserted-by":"publisher","first-page":"77","DOI":"10.1080\/87565649109540545","volume":"9","author":"G Measso","year":"1993","unstructured":"Measso, G., F. Cavarzeran, G. Zappal\u00e0, B. D. Lebowitz, T. H. Crook, F. J. Pirozzolo, et al. The mini-mental state examination: Normative study of an Italian random sample. Developmental Neuropsychology. Informa UK Limited. 9:77\u201385, 1993. https:\/\/doi.org\/10.1080\/87565649109540545.","journal-title":"Developmental Neuropsychology. Informa UK Limited"},{"key":"4038_CR26","doi-asserted-by":"crossref","unstructured":"Santangelo G, M. Siciliano, R. Pedone, C. Vitale, F. Falco, R. Bisogno, et al. Normative data for the montreal cognitive assessment in an Italian population sample. Neurol Sci. 36:585\u201391, 2015.","DOI":"10.1007\/s10072-014-1995-y"},{"key":"4038_CR27","doi-asserted-by":"publisher","first-page":"561","DOI":"10.1001\/archpsyc.1961.01710120031004","volume":"4","author":"AT Beck","year":"1961","unstructured":"Beck, A. T. An inventory for measuring depression. Arch Gen Psychiatry American Medical Association (AMA). 4:561, 1961.","journal-title":"Arch Gen Psychiatry American Medical Association (AMA)"},{"key":"4038_CR28","doi-asserted-by":"publisher","unstructured":"Freeman R, W. Wieling, F. B. Axelrod, D. G. Benditt, E. Benarroch, I. Biaggioni, et al. Consensus statement on the definition of orthostatic hypotension, neurally mediated syncope and the postural tachycardia syndrome. Clin Auton Res. 21:69\u201372, 2011. https:\/\/doi.org\/10.1007\/s10286-011-0119-5","DOI":"10.1007\/s10286-011-0119-5"},{"key":"4038_CR29","doi-asserted-by":"publisher","first-page":"540","DOI":"10.1093\/sleep\/14.6.540","volume":"14","author":"MW Johns","year":"1991","unstructured":"Johns, M. W. A new method for measuring daytime sleepiness: the Epworth sleepiness scale. Sleep. 14:540\u2013545, 1991. https:\/\/doi.org\/10.1093\/sleep\/14.6.540.","journal-title":"Sleep."},{"key":"4038_CR30","doi-asserted-by":"crossref","unstructured":"Vignatelli L, G. Plazzi, A. Barbato, L. Ferini-Strambi, R. Manni, F. Pompei, et al. Italian version of the Epworth sleepiness scale: external validity. Neurol Sci. 23:295\u2013300, 2003.","DOI":"10.1007\/s100720300004"},{"key":"4038_CR31","doi-asserted-by":"publisher","first-page":"485","DOI":"10.7326\/0003-4819-131-7-199910050-00002","volume":"131","author":"NC Netzer","year":"1999","unstructured":"Netzer, N. C., R. A. Stoohs, C. M. Netzer, K. Clark, and K. P. Strohl. Using the Berlin Questionnaire to identify patients at risk for the sleep apnea syndrome. Ann Intern Med. 131:485\u2013491, 1999. https:\/\/doi.org\/10.7326\/0003-4819-131-7-199910050-00002.","journal-title":"Ann Intern Med."},{"key":"4038_CR32","doi-asserted-by":"publisher","first-page":"283","DOI":"10.1007\/s10072-015-2409-5","volume":"37","author":"D Arnaldi","year":"2016","unstructured":"Arnaldi, D., C. Cordano, F. De Carli, J. Accardo, M. Ferrara, A. Picco, et al. Parkinson\u2019s Disease Sleep Scale 2: application in an Italian population. Neurol Sci. 37:283\u2013288, 2016. https:\/\/doi.org\/10.1007\/s10072-015-2409-5.","journal-title":"Neurol Sci."},{"key":"4038_CR33","doi-asserted-by":"publisher","first-page":"1591","DOI":"10.1002\/mds.26424","volume":"30","author":"RB Postuma","year":"2015","unstructured":"Postuma, R. B., D. Berg, M. Stern, W. Poewe, C. W. Olanow, W. Oertel, et al. MDS clinical diagnostic criteria for Parkinson\u2019s disease: MDS-PD Clinical Diagnostic Criteria. Mov Disord. 30:1591\u20131601, 2015. https:\/\/doi.org\/10.1002\/mds.26424.","journal-title":"Mov Disord."},{"key":"4038_CR34","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1212\/wnl.17.5.427","volume":"17","author":"MM Hoehn","year":"1967","unstructured":"Hoehn, M. M., and M. D. Yahr. Parkinsonism: onset, progression, and mortality. Neurology. Ovid Technologies (Wolters Kluwer Health). 17:427\u2013427, 1967. https:\/\/doi.org\/10.1212\/wnl.17.5.427.","journal-title":"Neurology. Ovid Technologies (Wolters Kluwer Health)"},{"key":"4038_CR35","doi-asserted-by":"publisher","first-page":"41","DOI":"10.1002\/mds.21198","volume":"22","author":"CG Goetz","year":"2007","unstructured":"Goetz, C. G., S. Fahn, P. Martinez-Martin, W. Poewe, C. Sampaio, G. T. Stebbins, et al. Movement Disorder Society-sponsored revision of the Unified Parkinson\u2019s Disease Rating Scale (MDS-UPDRS): Process, format, and clinimetric testing plan. Movement Disorders. Wiley. 22:41\u201347, 2007. https:\/\/doi.org\/10.1002\/mds.21198.","journal-title":"Movement Disorders. Wiley"},{"key":"4038_CR36","doi-asserted-by":"crossref","unstructured":"van Albada SJ, P. A. Robinson. Mean-field modeling of the basal ganglia-thalamocortical system. I: firing rates in healthy and parkinsonian states. J. Theor. Biol. 257:642\u201363, 2009.","DOI":"10.1016\/j.jtbi.2008.12.018"},{"key":"4038_CR37","doi-asserted-by":"publisher","first-page":"827","DOI":"10.1080\/10556788.2018.1464570","volume":"34","author":"MA Diniz-Ehrhardt","year":"2019","unstructured":"Diniz-Ehrhardt, M. A., D. G. Ferreira, and S. A. Santos. A pattern search and implicit filtering algorithm for solving linearly constrained minimization problems with noisy objective functions. Optimization Methods and Software. 34:827\u2013852, 2019. https:\/\/doi.org\/10.1080\/10556788.2018.1464570.","journal-title":"Optimization Methods and Software."},{"key":"4038_CR38","doi-asserted-by":"publisher","first-page":"1082","DOI":"10.1137\/S1052623496300507","volume":"9","author":"RM Lewis","year":"1999","unstructured":"Lewis, R. M., and V. Torczon. Pattern Search Algorithms for Bound Constrained Minimization. SIAM J Optim. 9:1082\u20131099, 1999. https:\/\/doi.org\/10.1137\/S1052623496300507.","journal-title":"SIAM J Optim."},{"key":"4038_CR39","doi-asserted-by":"crossref","unstructured":"Chipman J. S. Gauss-Markov Theorem. In: International Encyclopedia of Statistical Science, edited by M. Lovric: Berlin Springer 2011, p. 577\u201382.","DOI":"10.1007\/978-3-642-04898-2_270"},{"key":"4038_CR40","doi-asserted-by":"publisher","unstructured":"Seber G.A.F., C. J. Wild. Nonlinear Regression. 1st ed. Wiley: 1989. https:\/\/doi.org\/10.1002\/0471725315","DOI":"10.1002\/0471725315"},{"key":"4038_CR41","doi-asserted-by":"publisher","first-page":"135","DOI":"10.1037\/0033-295X.88.2.135","volume":"88","author":"RS Sutton","year":"1981","unstructured":"Sutton, R. S., and A. G. Barto. Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review. 88:135\u2013170, 1981. https:\/\/doi.org\/10.1037\/0033-295X.88.2.135.","journal-title":"Psychological Review."},{"key":"4038_CR42","doi-asserted-by":"publisher","unstructured":"Chen X, K. Mohr, J. M. Galea. Predicting explorative motor learning using decision-making and motor noise. Haith AM, editor. PLoS Comput Biol. 13:e1005503, 2017. https:\/\/doi.org\/10.1371\/journal.pcbi.1005503","DOI":"10.1371\/journal.pcbi.1005503"},{"key":"4038_CR43","doi-asserted-by":"publisher","first-page":"586","DOI":"10.1016\/j.cub.2021.12.006","volume":"32","author":"CD Grossman","year":"2022","unstructured":"Grossman, C. D., B. A. Bari, and J. Y. Cohen. Serotonin neurons modulate learning rate through uncertainty. Current Biology. 32:586-599.e7, 2022. https:\/\/doi.org\/10.1016\/j.cub.2021.12.006.","journal-title":"Current Biology."},{"key":"4038_CR44","doi-asserted-by":"publisher","unstructured":"Le N. M., M. Yildirim, Y. Wang, H. Sugihara, M. Jazayeri, M. Sur. Mixtures of strategies underlie rodent behavior during reversal learning. Soltani A, editor. PLoS Comput Biol. 19:e1011430, 2023. https:\/\/doi.org\/10.1371\/journal.pcbi.1011430","DOI":"10.1371\/journal.pcbi.1011430"},{"key":"4038_CR45","doi-asserted-by":"publisher","first-page":"1","DOI":"10.3758\/BF03203630","volume":"28","author":"E Erdfelder","year":"1996","unstructured":"Erdfelder, E., F. Faul, and A. Buchner. GPOWER: A general power analysis program. Behavior Research Methods, Instruments, & Computers. 28:1\u201311, 1996. https:\/\/doi.org\/10.3758\/BF03203630.","journal-title":"Behavior Research Methods, Instruments, & Computers."},{"key":"4038_CR46","doi-asserted-by":"publisher","first-page":"175","DOI":"10.3758\/BF03193146","volume":"39","author":"F Faul","year":"2007","unstructured":"Faul, F., E. Erdfelder, A.-G. Lang, and A. Buchner. G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behavior Research Methods. 39:175\u2013191, 2007. https:\/\/doi.org\/10.3758\/BF03193146.","journal-title":"Behavior Research Methods."},{"key":"4038_CR47","doi-asserted-by":"publisher","DOI":"10.3389\/fnhum.2010.00240","author":"AA Moustafa","year":"2011","unstructured":"Moustafa, A. A. Levodopa Enhances Reward Learning but Impairs Reversal Learning in Parkinson\u2019s Disease Patients. Front Hum Neurosci. 2011. https:\/\/doi.org\/10.3389\/fnhum.2010.00240.","journal-title":"Front Hum Neurosci."},{"key":"4038_CR48","doi-asserted-by":"publisher","unstructured":"Fino, E., Venance, L. Spike-timing dependent plasticity in the striatum. Front. Syna. Neurosci. 2010. https:\/\/doi.org\/10.3389\/fnsyn.2010.00006","DOI":"10.3389\/fnsyn.2010.00006"},{"key":"4038_CR49","doi-asserted-by":"publisher","first-page":"1451","DOI":"10.1016\/j.neuron.2017.02.033","volume":"93","author":"K Lee","year":"2017","unstructured":"Lee, K., S. M. Holley, J. L. Shobe, N. C. Chong, C. Cepeda, M. S. Levine, et al. Parvalbumin Interneurons Modulate Striatal Output and Enhance Performance during Associative Learning. Neuron. 93:1451-1463.e4, 2017. https:\/\/doi.org\/10.1016\/j.neuron.2017.02.033.","journal-title":"Neuron."},{"key":"4038_CR50","doi-asserted-by":"publisher","first-page":"18049","DOI":"10.1073\/pnas.2001348117","volume":"117","author":"K Banaie Boroujeni","year":"2020","unstructured":"Banaie Boroujeni, K., M. Oemisch, S. A. Hassani, and T. Womelsdorf. Fast spiking interneuron activity in primate striatum tracks learning of attention cues. Proc Natl Acad Sci USA. 117:18049\u201318058, 2020. https:\/\/doi.org\/10.1073\/pnas.2001348117.","journal-title":"Proc Natl Acad Sci USA"},{"key":"4038_CR51","doi-asserted-by":"publisher","DOI":"10.1016\/j.celrep.2025.115670","volume":"44","author":"S Rotariu","year":"2025","unstructured":"Rotariu, S., G. Zalcman, N. Badreddine, F. Appaix, S. Sarno, I. Bureau, et al. Somatostatin interneurons select dorsomedial striatal representations of the initial motor learning phase. Cell Reports.44:115670, 2025. https:\/\/doi.org\/10.1016\/j.celrep.2025.115670.","journal-title":"Cell Reports."},{"key":"4038_CR52","doi-asserted-by":"publisher","first-page":"898","DOI":"10.1016\/S0010-9452(08)70689-0","volume":"43","author":"K Werheid","year":"2007","unstructured":"Werheid, K., and L. Clare. Are Faces Special in Alzheimer\u2019s Disease? Cognitive Conceptualisation, Neural Correlates, and Diagnostic Relevance of Impaired Memory for Faces and Names. Cortex. 43:898\u2013906, 2007. https:\/\/doi.org\/10.1016\/S0010-9452(08)70689-0.","journal-title":"Cortex."},{"key":"4038_CR53","doi-asserted-by":"publisher","DOI":"10.1371\/journal.pone.0229729","volume":"15","author":"M Ursino","year":"2020","unstructured":"Ursino M, E. Magosso, G. Lopane, G. Calandra-Buonaura, P. Cortelli, M. Contin. Mathematical modeling and parameter estimation of levodopa motor response in patients with parkinson disease. PLoS ONE. 15:e0229729. 2020. https:\/\/doi.org\/10.1371\/journal.pone.0229729","journal-title":"PLoS ONE."}],"container-title":["Annals of Biomedical Engineering"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10439-026-04038-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10439-026-04038-4","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10439-026-04038-4.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,8,27]],"date-time":"2026-08-27T13:42:46Z","timestamp":1787838166000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10439-026-04038-4"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2026,3,4]]},"references-count":53,"journal-issue":{"issue":"9","published-print":{"date-parts":[[2026,9]]}},"alternative-id":["4038"],"URL":"https:\/\/doi.org\/10.1007\/s10439-026-04038-4","relation":{},"ISSN":["0090-6964","1573-9686"],"issn-type":[{"value":"0090-6964","type":"print"},{"value":"1573-9686","type":"electronic"}],"subject":[],"published":{"date-parts":[[2026,3,4]]},"assertion":[{"value":"25 October 2025","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"12 February 2026","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 March 2026","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}