{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T04:42:28Z","timestamp":1760416948832,"version":"build-2065373602"},"reference-count":92,"publisher":"MDPI AG","issue":"10","license":[{"start":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T00:00:00Z","timestamp":1760140800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/100000002","name":"National Institutes of Health","doi-asserted-by":"crossref","award":["R01 DA047870"],"award-info":[{"award-number":["R01 DA047870"]}],"id":[{"id":"10.13039\/100000002","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Although information theory is widely used in neuroscience, its application has primarily been limited to the analysis of neural activity, with much less emphasis on behavioral data. This is despite the fact that the discrete nature of behavioral variables in many experimental settings\u2014such as choice and reward outcomes\u2014makes them particularly well-suited to information-theoretic analysis. In this study, we provide a framework for how behavioral metrics based on conditional entropy and mutual information can be used to infer an agent\u2019s decision-making and learning strategies under uncertainty. Using simulated reinforcement-learning models as ground truth, we illustrate how information-theoretic metrics can reveal the underlying learning and choice mechanisms. Specifically, we show that these metrics can uncover (1) a positivity bias, reflected in higher learning rates for rewarded compared to unrewarded outcomes; (2) gradual, history-dependent changes in the learning rates indicative of metaplasticity; (3) adjustments in choice strategies driven by reward harvest rate; and (4) the presence of alternative learning strategies and their interaction. Overall, our study highlights how information theory can leverage the discrete, trial-by-trial structure of many cognitive tasks, with the added advantage of being parameter-free as opposed to more traditional methods such as logistic regression. Information theory thus offers a versatile framework for investigating neural and computational mechanisms of learning and choice under uncertainty\u2014with potential for further extension.<\/jats:p>","DOI":"10.3390\/e27101056","type":"journal-article","created":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T08:10:31Z","timestamp":1760343031000},"page":"1056","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":0,"title":["An Information-Theoretic Framework for Understanding Learning and Choice Under Uncertainty"],"prefix":"10.3390","volume":"27","author":[{"ORCID":"https:\/\/orcid.org\/0009-0003-3534-206X","authenticated-orcid":false,"given":"Jae Hyung","family":"Woo","sequence":"first","affiliation":[{"name":"Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH 03755, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Lakshana","family":"Balaji","sequence":"additional","affiliation":[{"name":"Department of Biology, Indian Institute of Science Education and Research Tirupati (IISER T), Tirupati 517619, Andhra Pradesh, India"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-4386-8486","authenticated-orcid":false,"given":"Alireza","family":"Soltani","sequence":"additional","affiliation":[{"name":"Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH 03755, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2025,10,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Lungarella, M., and Sporns, O. (2006). Mapping information flow in sensorimotor networks. PLoS Comput. Biol., 2.","DOI":"10.1371\/journal.pcbi.0020144"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1007\/s10827-010-0236-5","article-title":"Causal relationships between frequency bands of extracellular signals in visual cortex revealed by an information theoretic analysis","volume":"29","author":"Besserve","year":"2010","journal-title":"J. Comput. Neurosci."},{"key":"ref_3","first-page":"64213","article-title":"An information-theoretic quantification of the content of communication between brain regions","volume":"36","author":"Celotto","year":"2023","journal-title":"Adv. Neural Inf. Process. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1014","DOI":"10.1038\/nn.4569","article-title":"Flexible information routing by transient synchrony","volume":"20","author":"Palmigiano","year":"2017","journal-title":"Nat. Neurosci."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"10240","DOI":"10.1073\/pnas.0701519104","article-title":"Network structure of cerebral cortex shapes functional connectivity on multiple time scales","volume":"104","author":"Honey","year":"2007","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"066211","DOI":"10.1103\/PhysRevE.86.066211","article-title":"Expanding the transfer entropy to identify information circuits in complex systems","volume":"86","author":"Stramaglia","year":"2012","journal-title":"Phys. Rev. E"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"827","DOI":"10.1162\/netn_a_00092","article-title":"Large-scale directed network inference with multivariate transfer entropy and hierarchical statistical testing","volume":"3","author":"Novelli","year":"2019","journal-title":"Netw. Neurosci."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s10827-010-0262-3","article-title":"Transfer entropy\u2014A model-free measure of effective connectivity for the neurosciences","volume":"30","author":"Vicente","year":"2011","journal-title":"J. Comput. Neurosci."},{"key":"ref_9","doi-asserted-by":"crossref","unstructured":"Ursino, M., Ricci, G., and Magosso, E. (2020). Transfer Entropy as a Measure of Brain Connectivity: A Critical Analysis With the Help of Neural Mass Models. Front. Comput. Neurosci., 14.","DOI":"10.3389\/fncom.2020.00045"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1103\/PhysRevLett.80.197","article-title":"Entropy and Information in Neural Spike Trains","volume":"80","author":"Strong","year":"1998","journal-title":"Phys. Rev. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2533","DOI":"10.1152\/jn.01106.2006","article-title":"Evaluating Information Transfer Between Auditory Cortical Neurons","volume":"97","author":"Eggermont","year":"2007","journal-title":"J. Neurophysiol."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1038\/nrn2578","article-title":"Extracting information from neuronal populations: Information theory and decoding approaches","volume":"10","author":"Panzeri","year":"2009","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_13","doi-asserted-by":"crossref","unstructured":"Cofr\u00e9, R., and Maldonado, C. (2018). Information Entropy Production of Maximum Entropy Markov Chains from Spike Trains. Entropy, 20.","DOI":"10.20944\/preprints201806.0114.v1"},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Shorten, D.P., Spinney, R.E., and Lizier, J.T. (2021). Estimating Transfer Entropy in Continuous Time Between Neural Spike Trains or Other Event-Based Data. PLoS Comput. Biol., 17.","DOI":"10.1371\/journal.pcbi.1008054"},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"225","DOI":"10.1016\/j.neunet.2004.12.004","article-title":"Information theory, novelty and hippocampal responses: Unpredicted or unpredictable?","volume":"18","author":"Strange","year":"2005","journal-title":"Neural Netw."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"572","DOI":"10.1038\/nrn3289","article-title":"Knowing how much you don\u2019t know: A neural organization of uncertainty estimates","volume":"13","author":"Bach","year":"2012","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Sayood, K. (2018). Information Theory and Cognition: A Review. Entropy, 20.","DOI":"10.3390\/e20090706"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Seiler, J.P.H., Dan, O., T\u00fcscher, O., Loewenstein, Y., and Rumpel, S. (2022). Experienced entropy drives choice behavior in a boring decision-making task. Sci. Rep., 12.","DOI":"10.1038\/s41598-022-06861-w"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1587","DOI":"10.1162\/jocn.2010.21548","article-title":"Pupil diameter predicts changes in the exploration-exploitation trade-off: Evidence for the adaptive gain theory","volume":"23","author":"Jepma","year":"2011","journal-title":"J. Cogn. Neurosci."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.cognition.2019.03.009","article-title":"Monkeys are curious about counterfactual outcomes","volume":"189","author":"Wang","year":"2019","journal-title":"Cognition"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"952","DOI":"10.3758\/s13415-022-00992-3","article-title":"The PRO model accounts for the anterior cingulate cortex role in risky decision-making and monitoring","volume":"22","author":"Woo","year":"2022","journal-title":"Cogn. Affect. Behav. Neurosci."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1016\/j.cogbrainres.2004.07.007","article-title":"Reinforcement learning and decision making in monkeys during a competitive game","volume":"22","author":"Lee","year":"2004","journal-title":"Cogn. Brain Res."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"416","DOI":"10.1016\/j.cogbrainres.2005.07.003","article-title":"Learning and decision making in monkeys during a rock\u2013paper\u2013scissors game","volume":"25","author":"Lee","year":"2005","journal-title":"Cogn. Brain Res."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Takahashi, H., Izuma, K., Matsumoto, M., Matsumoto, K., and Omori, T. (2015). The Anterior Insula Tracks Behavioral Entropy during an Interpersonal Competitive Game. PLoS ONE, 10.","DOI":"10.1371\/journal.pone.0123329"},{"key":"ref_25","unstructured":"Sutton, R.S., and Barto, A.G. (2018). Reinforcement Learning: An Introduction, MIT Press. [2nd ed.]."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"429","DOI":"10.3758\/CABN.8.4.429","article-title":"Decision theory, reinforcement learning, and the brain","volume":"8","author":"Dayan","year":"2008","journal-title":"Cogn. Affect. Behav. Neurosci."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/j.jmp.2008.12.005","article-title":"Reinforcement learning in the brain","volume":"53","author":"Niv","year":"2009","journal-title":"J. Math. Psychol."},{"key":"ref_28","doi-asserted-by":"crossref","unstructured":"Jensen, K.T. (2024). An introduction to reinforcement learning for neuroscience. arXiv.","DOI":"10.51628\/001c.127771"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"128","DOI":"10.1016\/j.cobeha.2021.06.004","article-title":"What do reinforcement learning models measure? Interpreting model parameters in cognition and neuroscience","volume":"41","author":"Eckstein","year":"2021","journal-title":"Curr. Opin. Behav. Sci."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"100733","DOI":"10.1016\/j.dcn.2019.100733","article-title":"Reinforcement learning across development: What insights can we draw from a decade of research?","volume":"40","author":"Nussenbaum","year":"2019","journal-title":"Dev. Cogn. Neurosci."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"1044","DOI":"10.1016\/j.neuron.2020.03.024","article-title":"Prefrontal cortex predicts state switches during reversal learning","volume":"106","author":"Bartolo","year":"2020","journal-title":"Neuron"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"6567","DOI":"10.1038\/s41467-021-26784-w","article-title":"Entropy-based metrics for predicting choice behavior based on local response to reward","volume":"12","author":"Trepka","year":"2021","journal-title":"Nat. Commun."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"586","DOI":"10.1016\/j.cub.2021.12.006","article-title":"Serotonin neurons modulate learning rate through uncertainty","volume":"32","author":"Grossman","year":"2022","journal-title":"Curr. Biol."},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"1811","DOI":"10.1038\/s41467-025-57049-5","article-title":"Striatal arbitration between choice strategies guides few-shot adaptation","volume":"16","author":"Yang","year":"2025","journal-title":"Nat. Commun."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"12366","DOI":"10.1523\/JNEUROSCI.0822-10.2010","article-title":"An Approximately Bayesian Delta-Rule Model Explains the Dynamics of Belief Updating in a Changing Environment","volume":"30","author":"Nassar","year":"2010","journal-title":"J. Neurosci."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"4469","DOI":"10.1111\/ejn.16449","article-title":"Regulation of reinforcement learning parameters captures long-term changes in rat behaviour","volume":"60","author":"Cinotti","year":"2024","journal-title":"Eur. J. Neurosci."},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"3771","DOI":"10.1038\/s41467-020-17343-w","article-title":"Global reward state affects learning and activity in raphe nucleus and anterior insula in monkeys","volume":"11","author":"Wittmann","year":"2020","journal-title":"Nat. Commun."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1016\/j.neuron.2013.11.028","article-title":"Neural computations underlying arbitration between model-based and model-free learning","volume":"81","author":"Lee","year":"2014","journal-title":"Neuron"},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"687","DOI":"10.1016\/j.neuron.2020.02.028","article-title":"A neuro-computational account of arbitration between choice imitation and goal emulation during human observational learning","volume":"106","author":"Charpentier","year":"2020","journal-title":"Neuron"},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Woo, J.H., Costa, V.D., Taswell, C.A., Rothenhoefer, K.M., Averbeck, B.B., and Soltani, A. (2024). Contribution of amygdala to dynamic model arbitration under uncertainty. bioRxiv.","DOI":"10.1101\/2024.09.13.612869"},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"3189","DOI":"10.1038\/s41467-024-47491-2","article-title":"Neurocomputational mechanisms involved in adaptation to fluctuating intentions of others","volume":"15","author":"Philippe","year":"2024","journal-title":"Nat. Commun."},{"key":"ref_42","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1038\/s41386-021-01126-y","article-title":"Advances in modeling learning and decision-making in neuroscience","volume":"47","author":"Collins","year":"2022","journal-title":"Neuropsychopharmacology"},{"key":"ref_43","doi-asserted-by":"crossref","first-page":"600","DOI":"10.3758\/s13415-022-01059-z","article-title":"Mechanisms of adjustments to different types of uncertainty in the reward environment across mice and monkeys","volume":"23","author":"Woo","year":"2023","journal-title":"Cogn. Affect. Behav. Neurosci."},{"key":"ref_44","doi-asserted-by":"crossref","first-page":"67","DOI":"10.1038\/s41562-017-0067","article-title":"Behavioural and neural characterization of optimistic reinforcement learning","volume":"1","author":"Lefebvre","year":"2017","journal-title":"Nat. Hum. Behav."},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Palminteri, S., Lefebvre, G., Kilford, E.J., and Blakemore, S.J. (2017). Confirmation bias in human reinforcement learning: Evidence from counterfactual feedback processing. PLoS Comput. Biol., 13.","DOI":"10.1371\/journal.pcbi.1005684"},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"307","DOI":"10.1162\/neco_a_01455","article-title":"A normative account of confirmation bias during reinforcement learning","volume":"34","author":"Lefebvre","year":"2022","journal-title":"Neural Comput."},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"607","DOI":"10.1016\/j.tics.2022.04.005","article-title":"The computational roots of positivity and confirmation biases in reinforcement learning","volume":"26","author":"Palminteri","year":"2022","journal-title":"Trends Cogn. Sci."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"401","DOI":"10.1016\/j.neuron.2017.03.044","article-title":"Metaplasticity as a Neural Substrate for Adaptive Learning and Choice under Uncertainty","volume":"94","author":"Farashahi","year":"2017","journal-title":"Neuron"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Khorsand, P., and Soltani, A. (2017). Optimal structure of metaplasticity for adaptive learning. PLoS Comput. Biol., 13.","DOI":"10.1101\/129619"},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"507","DOI":"10.1007\/s00213-006-0502-4","article-title":"Tonic dopamine: Opportunity costs and the control of response vigor","volume":"191","author":"Niv","year":"2007","journal-title":"Psychopharmacology"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"638","DOI":"10.1152\/jn.00092.2023","article-title":"Effects of reward and effort history on decision making and movement vigor during foraging","volume":"131","author":"Sukumar","year":"2024","journal-title":"J. Neurophysiol."},{"key":"ref_52","doi-asserted-by":"crossref","first-page":"58","DOI":"10.1038\/s41386-021-01123-1","article-title":"Computational models of adaptive behavior and prefrontal cortex","volume":"47","author":"Soltani","year":"2022","journal-title":"Neuropsychopharmacology"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.neubiorev.2020.10.022","article-title":"Why and how the brain weights contributions from a mixture of experts","volume":"123","author":"Lee","year":"2021","journal-title":"Neurosci. Biobehav. Rev."},{"key":"ref_54","doi-asserted-by":"crossref","first-page":"451","DOI":"10.1016\/j.neuron.2016.12.040","article-title":"Dynamic interaction between reinforcement learning and attention in multidimensional environments","volume":"93","author":"Leong","year":"2017","journal-title":"Neuron"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"1768","DOI":"10.1038\/s41467-017-01874-w","article-title":"Feature-based learning improves adaptability without compromising precision","volume":"8","author":"Farashahi","year":"2017","journal-title":"Nat. Commun."},{"key":"ref_56","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1016\/j.tics.2019.01.010","article-title":"Holistic reinforcement learning: The role of structure and attention","volume":"23","author":"Radulescu","year":"2019","journal-title":"Trends Cogn. Sci."},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"7191","DOI":"10.1038\/s41467-021-27413-2","article-title":"Computational mechanisms of distributed value representations and mixed learning strategies","volume":"12","author":"Farashahi","year":"2021","journal-title":"Nat. Commun."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"e2300232024","DOI":"10.1523\/JNEUROSCI.2300-23.2024","article-title":"Contributions of attention to learning in multidimensional reward environments","volume":"45","author":"Wang","year":"2025","journal-title":"J. Neurosci."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1016\/j.tics.2023.08.016","article-title":"Naturalistic reinforcement learning","volume":"28","author":"Wise","year":"2024","journal-title":"Trends Cogn. Sci."},{"key":"ref_60","doi-asserted-by":"crossref","first-page":"12","DOI":"10.1016\/j.neuroscience.2016.03.021","article-title":"The neural basis of reversal learning: An updated perspective","volume":"345","author":"Izquierdo","year":"2017","journal-title":"Neuroscience"},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"505","DOI":"10.1016\/j.neuron.2016.09.025","article-title":"Amygdala and ventral striatum make distinct contributions to reinforcement learning","volume":"92","author":"Costa","year":"2016","journal-title":"Neuron"},{"key":"ref_62","doi-asserted-by":"crossref","first-page":"922","DOI":"10.1016\/j.neuron.2019.06.001","article-title":"Stable representations of decision variables for flexible behavior","volume":"103","author":"Bari","year":"2019","journal-title":"Neuron"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1038\/nn.4173","article-title":"Mesolimbic dopamine signals the value of work","volume":"19","author":"Hamid","year":"2016","journal-title":"Nat. Neurosci."},{"key":"ref_64","doi-asserted-by":"crossref","first-page":"15104","DOI":"10.1523\/JNEUROSCI.3524-09.2009","article-title":"Dopaminergic Drugs Modulate Learning Rates and Perseveration in Parkinson\u2019s Patients in a Dynamic Foraging Task","volume":"29","author":"Rutledge","year":"2009","journal-title":"J. Neurosci."},{"key":"ref_65","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1088\/0954-898X_10_4_303","article-title":"How to measure the information gained from one symbol","volume":"10","author":"DeWeese","year":"1999","journal-title":"Netw. Comput. Neural Syst."},{"key":"ref_66","unstructured":"Grunwald, P., and Vitanyi, P. (2004). Shannon Information and Kolmogorov Complexity. arXiv."},{"key":"ref_67","doi-asserted-by":"crossref","unstructured":"Wibral, M., Vicente, R., and Lizier, J.T. (2014). Measuring the Dynamics of Information Processing on a Local Scale in Time and Space. Directed Information Measures in Neuroscience, Springer. Understanding Complex Systems.","DOI":"10.1007\/978-3-642-54474-3"},{"key":"ref_68","doi-asserted-by":"crossref","unstructured":"Yao, Y. (2003). Information-theoretic measures for knowledge discovery and data mining. Entropy Measures, Maximum Entropy Principle and Emerging Applications, Springer.","DOI":"10.1007\/978-3-540-36212-8_6"},{"key":"ref_69","doi-asserted-by":"crossref","unstructured":"Kv\u00e5lseth, T.O. (2017). On normalized mutual information: Measure derivations and properties. Entropy, 19.","DOI":"10.3390\/e19110631"},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"579","DOI":"10.1111\/coin.12100","article-title":"Correction for Closeness: Adjusting Normalized Mutual Information Measure for Clustering Comparison","volume":"33","author":"Amelio","year":"2017","journal-title":"Comput. Intell."},{"key":"ref_71","first-page":"25","article-title":"Stochastic evolutionary game dynamics","volume":"Volume 2","author":"Schuster","year":"2009","journal-title":"Reviews of Nonlinear Dynamics and Complexity"},{"key":"ref_72","doi-asserted-by":"crossref","first-page":"11478","DOI":"10.1073\/pnas.0710743106","article-title":"Efficient computation of optimal actions","volume":"106","author":"Todorov","year":"2009","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"6368","DOI":"10.1038\/s41467-024-49711-1","article-title":"Complex behavior from intrinsic motivation to occupy future action-state path space","volume":"15","author":"Grytskyy","year":"2024","journal-title":"Nat. Commun."},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"295","DOI":"10.1038\/nn.3918","article-title":"Dynamic routing of task-relevant signals for decision making in dorsolateral prefrontal cortex","volume":"18","author":"Donahue","year":"2015","journal-title":"Nat. Neurosci."},{"key":"ref_75","doi-asserted-by":"crossref","first-page":"3731","DOI":"10.1523\/JNEUROSCI.5159-05.2006","article-title":"A biophysically based neural model of matching law behavior: Melioration by stochastic synapses","volume":"26","author":"Soltani","year":"2006","journal-title":"J. Neurosci."},{"key":"ref_76","doi-asserted-by":"crossref","first-page":"112","DOI":"10.1038\/nn.2450","article-title":"Synaptic Computation Underlying Probabilistic Inference","volume":"13","author":"Soltani","year":"2010","journal-title":"Nat. Neurosci."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"1215","DOI":"10.1038\/s41562-019-0714-3","article-title":"Flexible combination of reward information across primates","volume":"3","author":"Farashahi","year":"2019","journal-title":"Nat. Hum. Behav."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"711","DOI":"10.1007\/s00422-013-0571-5","article-title":"Adaptive properties of differential learning rates for positive and negative outcomes","volume":"107","year":"2013","journal-title":"Biol. Cybern."},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"e18073","DOI":"10.7554\/eLife.18073","article-title":"Adaptive learning and decision-making under uncertainty by metaplastic synapses guided by a surprise detection system","volume":"5","author":"Iigaya","year":"2016","journal-title":"eLife"},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"49","DOI":"10.1016\/j.cobeha.2016.04.003","article-title":"Taming the beast: Extracting generalizable knowledge from computational models of cognition","volume":"11","author":"Nassar","year":"2016","journal-title":"Curr. Opin. Behav. Sci."},{"key":"ref_81","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/j.tics.2017.03.011","article-title":"The importance of falsification in computational cognitive modeling","volume":"21","author":"Palminteri","year":"2017","journal-title":"Trends Cogn. Sci."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"378","DOI":"10.1007\/s42113-022-00146-1","article-title":"Over-precise Predictions Cannot Identify Good Choice Models","volume":"5","author":"Sifar","year":"2022","journal-title":"Comput. Brain Behav."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"e49547","DOI":"10.7554\/eLife.49547","article-title":"Ten simple rules for the computational modeling of behavioral data","volume":"8","author":"Wilson","year":"2019","journal-title":"eLife"},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"E3859","DOI":"10.1073\/pnas.1615773114","article-title":"Brain networks for confidence weighting and hierarchical inference during probabilistic learning","volume":"114","author":"Meyniel","year":"2017","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"442","DOI":"10.1016\/j.plrev.2024.11.009","article-title":"Kinematic coding: Measuring information in naturalistic behaviour","volume":"51","author":"Becchio","year":"2024","journal-title":"Phys. Life Rev."},{"key":"ref_86","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1103\/PhysRevLett.85.461","article-title":"Measuring Information Transfer","volume":"85","author":"Schreiber","year":"2000","journal-title":"Phys. Rev. Lett."},{"key":"ref_87","doi-asserted-by":"crossref","unstructured":"Bossomaier, T., Barnett, L., Harr\u00e9, M., and Lizier, J.T. (2016). Transfer Entropy. An Introduction to Transfer Entropy: Information Flow in Complex Systems, Springer International Publishing.","DOI":"10.1007\/978-3-319-43222-9"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"066138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_89","unstructured":"Gao, W., Kannan, S., Oh, S., and Viswanath, P. (2017). Estimating Mutual Information for Discrete-Continuous Mixtures. Advances in Neural Information Processing Systems 30 (NIPS 2017), NIPS."},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Ross, B.C. (2014). Mutual Information between Discrete and Continuous Data Sets. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0087357"},{"key":"ref_91","unstructured":"Williams, P.L., and Beer, R.D. (2010). Nonnegative Decomposition of Multivariate Information. arXiv."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"352","DOI":"10.1016\/j.tics.2023.11.005","article-title":"Information decomposition and the informational architecture of the brain","volume":"28","author":"Luppi","year":"2024","journal-title":"Trends Cogn. Sci."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/10\/1056\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T04:19:38Z","timestamp":1760415578000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/27\/10\/1056"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,10,11]]},"references-count":92,"journal-issue":{"issue":"10","published-online":{"date-parts":[[2025,10]]}},"alternative-id":["e27101056"],"URL":"https:\/\/doi.org\/10.3390\/e27101056","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2025,10,11]]}}}