{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,16]],"date-time":"2026-03-16T10:19:40Z","timestamp":1773656380158,"version":"3.50.1"},"reference-count":101,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2019,4,6]],"date-time":"2019-04-06T00:00:00Z","timestamp":1554508800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100000781","name":"European Research Council","doi-asserted-by":"publisher","award":["678082"],"award-info":[{"award-number":["678082"]}],"id":[{"id":"10.13039\/501100000781","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>In its most basic form, decision-making can be viewed as a computational process that progressively eliminates alternatives, thereby reducing uncertainty. Such processes are generally costly, meaning that the amount of uncertainty that can be reduced is limited by the amount of available computational resources. Here, we introduce the notion of elementary computation based on a fundamental principle for probability transfers that reduce uncertainty. Elementary computations can be considered as the inverse of Pigou\u2013Dalton transfers applied to probability distributions, closely related to the concepts of majorization, T-transforms, and generalized entropies that induce a preorder on the space of probability distributions. Consequently, we can define resource cost functions that are order-preserving and therefore monotonic with respect to the uncertainty reduction. This leads to a comprehensive notion of decision-making processes with limited resources. Along the way, we prove several new results on majorization theory, as well as on entropy and divergence measures.<\/jats:p>","DOI":"10.3390\/e21040375","type":"journal-article","created":{"date-parts":[[2019,4,8]],"date-time":"2019-04-08T11:54:52Z","timestamp":1554724492000},"page":"375","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":27,"title":["Bounded Rational Decision-Making from Elementary Computations That Reduce Uncertainty"],"prefix":"10.3390","volume":"21","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-2906-3577","authenticated-orcid":false,"given":"Sebastian","family":"Gottwald","sequence":"first","affiliation":[{"name":"Institute of Neural Information Processing, Ulm University, 89081 Ulm, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-8637-6652","authenticated-orcid":false,"given":"Daniel","family":"Braun","sequence":"additional","affiliation":[{"name":"Institute of Neural Information Processing, Ulm University, 89081 Ulm, Germany"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,4,6]]},"reference":[{"key":"ref_1","unstructured":"Von Neumann, J., and Morgenstern, O. (1944). Theory of Games and Economic Behavior, Princeton University Press."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"99","DOI":"10.2307\/1884852","article-title":"A Behavioral Model of Rational Choice","volume":"69","author":"Simon","year":"1955","journal-title":"Q. J. Econ."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"575","DOI":"10.1613\/jair.133","article-title":"Provably Bounded-optimal Agents","volume":"2","author":"Russell","year":"1995","journal-title":"J. Artif. Intell. Res."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"202","DOI":"10.1006\/game.1995.1030","article-title":"Games with Unique, Mixed Strategy Equilibria: An Experimental Study","volume":"10","author":"Ochs","year":"1995","journal-title":"Games Econ. Behav."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"42","DOI":"10.2307\/136022","article-title":"Information Processing and Bounded Rationality: A Survey","volume":"28","author":"Lipman","year":"1995","journal-title":"Can. J. Econ."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"2","DOI":"10.1006\/game.1997.0585","article-title":"Rationality and Bounded Rationality","volume":"21","author":"Aumann","year":"1997","journal-title":"Games Econ. Behav."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Gigerenzer, G., and Selten, R. (2001). Bounded Rationality: The Adaptive Toolbox, MIT Press.","DOI":"10.7551\/mitpress\/1654.001.0001"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"61","DOI":"10.1016\/S0899-8256(02)00014-3","article-title":"Probabilistic choice and procedurally bounded rationality","volume":"41","author":"Mattsson","year":"2002","journal-title":"Games Econ. Behav."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1093\/jopart\/mug028","article-title":"Bounded Rationality and Political Science: Lessons from Public Administration and Public Policy","volume":"13","author":"Jones","year":"2003","journal-title":"J. Public Adm. Res. Theory"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"665","DOI":"10.1016\/S0304-3932(03)00029-1","article-title":"Implications of rational inattention","volume":"50","author":"Sims","year":"2003","journal-title":"J. Monet. Econ."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Braha, D., Minai, A.A., and Bar-Yam, Y. (2006). Information Theory\u2014The Bridge Connecting Bounded Rational Game Theory and Statistical Physics. Complex Engineered Systems: Science Meets Technology, Springer.","DOI":"10.1007\/3-540-32834-3"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1037\/a0017187","article-title":"Rational adaptation under task and processing constraints: Implications for testing theories of cognition and action","volume":"116","author":"Howes","year":"2009","journal-title":"Psychol. Rev."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"28005","DOI":"10.1209\/0295-5075\/85\/28005","article-title":"Information-theoretic approach to interactive learning","volume":"85","author":"Still","year":"2009","journal-title":"Europhys. Lett."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Cutsuridis, V., Hussain, A., and Taylor, J.G. (2011). Information Theory of Decisions and Actions. Perception-Action Cycle: Models, Architectures, and Hardware, Springer.","DOI":"10.1007\/978-1-4419-1452-1"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Spiegler, R. (2011). Bounded Rationality and Industrial Organization, Oxford University Press.","DOI":"10.1093\/acprof:oso\/9780195398717.001.0001"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"159","DOI":"10.1007\/s10994-012-5278-7","article-title":"Optimal control as a graphical model inference problem","volume":"87","author":"Kappen","year":"2012","journal-title":"Mach. Learn."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1613\/jair.4047","article-title":"Heuristic Search when Time Matters","volume":"47","author":"Burns","year":"2013","journal-title":"J. Artif. Intell. Res."},{"key":"ref_18","first-page":"20120683","article-title":"Thermodynamics as a theory of decision-making with information-processing costs","volume":"469","author":"Ortega","year":"2013","journal-title":"Proc. R. Soc. Lond. A Math. Phys. Eng. Sci."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"279","DOI":"10.1111\/tops.12086","article-title":"Computational Rationality: Linking Mechanism and Behavior through Bounded Utility Maximization","volume":"6","author":"Lewis","year":"2014","journal-title":"Top. Cogn. Sci."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Acerbi, L., Vijayakumar, S., and Wolpert, D.M. (2014). On the Origins of Suboptimality in Human Probabilistic Inference. PLoS Comput. Biol., 10.","DOI":"10.1371\/journal.pcbi.1003661"},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"273","DOI":"10.1126\/science.aac6076","article-title":"Computational rationality: A converging paradigm for intelligence in brains, minds, and machines","volume":"349","author":"Gershman","year":"2015","journal-title":"Science"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A Mathematical Theory of Communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell Syst. Tech. J."},{"key":"ref_23","unstructured":"Renyi, A. On Measures of Entropy and Information. Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability, Volume 1: Contributions to the Theory of Statistics."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/BF01016429","article-title":"Possible generalization of Boltzmann-Gibbs statistics","volume":"52","author":"Tsallis","year":"1988","journal-title":"J. Stat. Phys."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On Information and Sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"348","DOI":"10.2307\/2223525","article-title":"The Measurement of the Inequality of Incomes","volume":"30","author":"Dalton","year":"1920","journal-title":"Econ. J."},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Marshall, A.W., Olkin, I., and Arnold, B.C. (2011). Inequalities: Theory of Majorization and Its Applications, Springer. [2nd ed.].","DOI":"10.1007\/978-0-387-68276-1"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/0022-247X(90)90002-W","article-title":"Majorization and divergence","volume":"148","author":"Joe","year":"1990","journal-title":"J. Math. Anal. Appl."},{"key":"ref_29","unstructured":"Hardy, G.H., Littlewood, J., and P\u00f3lya, G. (1934). Inequalities, Cambridge University Press."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Arnold, B.C. (1987). Majorization and the Lorenz Order: A Brief Introduction, Springer.","DOI":"10.1007\/978-1-4615-7379-1"},{"key":"ref_31","unstructured":"Pe\u010dari\u0107, J.E., Proschan, F., and Tong, Y.L. (1992). Convex Functions, Partial Orderings, and Statistical Applications, Academic Press."},{"key":"ref_32","doi-asserted-by":"crossref","unstructured":"Bhatia, R. (1997). Matrix Analysis, Springer.","DOI":"10.1007\/978-1-4612-0653-8"},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Arnold, B.C., and Sarabia, J.M. (2018). Majorization and the Lorenz Order with Applications in Applied Mathematics and Economics, Springer International Publishing.","DOI":"10.1007\/978-3-319-93773-1"},{"key":"ref_34","first-page":"209","article-title":"Methods of Measuring the Concentration of Wealth","volume":"9","author":"Lorenz","year":"1905","journal-title":"Publ. Am. Stat. Assoc."},{"key":"ref_35","unstructured":"Pigou, A.C. (1912). Wealth and Welfare, Macmillan."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1007\/BF01178071","article-title":"The principle of increasing mixing character and some of its consequences","volume":"41","author":"Ruch","year":"1976","journal-title":"Theor. Chim. Acta"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1016\/j.physleta.2004.01.057","article-title":"Limit temperature for entanglement in generalized statistics","volume":"323","author":"Rossignoli","year":"2004","journal-title":"Phys. Lett."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"144","DOI":"10.1017\/S001309150003460X","article-title":"Some Methods applicable to Identities and Inequalities of Symmetric Algebraic Functions of n Letters","volume":"21","author":"Muirhead","year":"1902","journal-title":"Proc. Edinb. Math. Soc."},{"key":"ref_39","doi-asserted-by":"crossref","first-page":"250404","DOI":"10.1103\/PhysRevLett.111.250404","article-title":"Resource Theory of Quantum States Out of Thermal Equilibrium","volume":"111","author":"Horodecki","year":"2013","journal-title":"Phys. Rev. Lett."},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"2056","DOI":"10.1038\/ncomms3059","article-title":"Fundamental limitations for quantum and nanoscale thermodynamics","volume":"4","author":"Horodecki","year":"2013","journal-title":"Nat. Commun."},{"key":"ref_41","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.physrep.2015.04.003","article-title":"The resource theory of informational nonequilibrium in thermodynamics","volume":"583","author":"Gour","year":"2015","journal-title":"Phys. Rep."},{"key":"ref_42","first-page":"9","article-title":"\u00dcber eine Klasse von Mittelbildungen mit Anwendungen auf die Determinanten-Theorie","volume":"22","author":"Schur","year":"1923","journal-title":"Sitz. Berl. Math. Ges."},{"key":"ref_43","first-page":"145","article-title":"Sur une in\u00e9galit\u00e9 relative aux fonctions convexes","volume":"1","author":"Karamata","year":"1932","journal-title":"Publ. L\u2019Institut Math."},{"key":"ref_44","first-page":"145","article-title":"Some Simple Inequalities Satisfied by Convex Functions","volume":"58","author":"Hardy","year":"1929","journal-title":"Messenger Math."},{"key":"ref_45","doi-asserted-by":"crossref","first-page":"170401","DOI":"10.1103\/PhysRevLett.88.170401","article-title":"Generalized Nonadditive Entropies and Quantum Entanglement","volume":"88","author":"Canosa","year":"2002","journal-title":"Phys. Rev. Lett."},{"key":"ref_46","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.3390\/e12051145","article-title":"Entropy: The Markov Ordering Approach","volume":"12","author":"Gorban","year":"2010","journal-title":"Entropy"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"191","DOI":"10.1007\/BF02018661","article-title":"A class of measures of informativity of observation channels","volume":"2","year":"1972","journal-title":"Period. Math. Hung."},{"key":"ref_48","doi-asserted-by":"crossref","first-page":"4925","DOI":"10.1109\/TIT.2009.2030485","article-title":"\u03b1-Divergence Is Unique, Belonging to Both f-Divergence and Bregman Divergence Classes","volume":"55","author":"Amari","year":"2009","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_49","unstructured":"Khinchin, A.Y. (1957). Mathematical Foundations of Information Theory, Dover Books on Advanced Mathematics, Dover."},{"key":"ref_50","doi-asserted-by":"crossref","first-page":"261","DOI":"10.3390\/e10030261","article-title":"Axiomatic Characterizations of Information Measures","volume":"10","year":"2008","journal-title":"Entropy"},{"key":"ref_51","doi-asserted-by":"crossref","first-page":"131","DOI":"10.2307\/1426210","article-title":"Why the Shannon and Hartley Entropies Are \u2018Natural\u2019","volume":"6","author":"Forte","year":"1974","journal-title":"Adv. Appl. Probab."},{"key":"ref_52","first-page":"227","article-title":"On the concept of entropy of a finite probabilistic scheme","volume":"11","author":"Faddeev","year":"1956","journal-title":"Usp. Mat. Nauk"},{"key":"ref_53","doi-asserted-by":"crossref","first-page":"297","DOI":"10.7146\/math.scand.a-10555","article-title":"A New Derivation of the Information Function","volume":"6","author":"Tverberg","year":"1958","journal-title":"Math. Scand."},{"key":"ref_54","first-page":"225","article-title":"Functional equations in information theory","volume":"2","author":"Kendall","year":"1964","journal-title":"Probab. Theory Relat. Fields"},{"key":"ref_55","doi-asserted-by":"crossref","first-page":"415","DOI":"10.1214\/aoms\/1177703765","article-title":"On the Axioms of Information Theory","volume":"35","author":"Lee","year":"1964","journal-title":"Ann. Math. Stat."},{"key":"ref_56","doi-asserted-by":"crossref","unstructured":"Behara, M., Krickeberg, K., and Wolfowitz, J. (1969). On different characterizations of entropies. Probability and Information Theory, Springer.","DOI":"10.1007\/BFb0079113"},{"key":"ref_57","doi-asserted-by":"crossref","first-page":"547","DOI":"10.1287\/mnsc.17.9.547","article-title":"Least d-Majorized Network Flows with Inventory and Statistical Applications","volume":"17","author":"Veinott","year":"1971","journal-title":"Manag. Sci."},{"key":"ref_58","doi-asserted-by":"crossref","first-page":"386","DOI":"10.1063\/1.436364","article-title":"The mixing distance","volume":"69","author":"Ruch","year":"1978","journal-title":"J. Chem. Phys."},{"key":"ref_59","doi-asserted-by":"crossref","first-page":"383","DOI":"10.1007\/BF01106578","article-title":"A new theorem of information theory","volume":"1","author":"Hobson","year":"1969","journal-title":"J. Stat. Phys."},{"key":"ref_60","unstructured":"Leinster, T. (2017). A short characterization of relative entropy. arXiv."},{"key":"ref_61","doi-asserted-by":"crossref","first-page":"399","DOI":"10.1287\/opre.11.3.399","article-title":"Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources","volume":"11","author":"Everett","year":"1963","journal-title":"Oper. Res."},{"key":"ref_62","doi-asserted-by":"crossref","unstructured":"Ortega, P.A., and Braun, D.A. (2010, January 5\u20138). A conversion between utility and information. Proceedings of the 3rd Conference on Artificial General Intelligence (AGI-2010), Washington, DC, USA.","DOI":"10.2991\/agi.2010.10"},{"key":"ref_63","doi-asserted-by":"crossref","first-page":"27","DOI":"10.3389\/frobt.2015.00027","article-title":"Bounded Rationality, Abstraction, and Hierarchical Decision-Making: An Information-Theoretic Optimality Principle","volume":"2","author":"Genewein","year":"2015","journal-title":"Front. Robot. AI"},{"key":"ref_64","doi-asserted-by":"crossref","unstructured":"Gottwald, S., and Braun, D.A. (2019). Systems of bounded rational agents with information-theoretic constraints. Neural Comput., 1\u201337.","DOI":"10.1162\/neco_a_01153"},{"key":"ref_65","doi-asserted-by":"crossref","unstructured":"Pancioni, L., Schwenker, F., and Trentin, E. (2018). Bounded Rational Decision-Making with Adaptive Neural Network Priors. Artificial Neural Networks in Pattern Recognition, Springer International Publishing.","DOI":"10.1007\/978-3-319-99978-4"},{"key":"ref_66","unstructured":"Leibfried, F., Grau-Moya, J., and Bou-Ammar, H. (2018). An Information-Theoretic Optimality Principle for Deep Reinforcement Learning. arXiv."},{"key":"ref_67","unstructured":"Grau-Moya, J., Leibfried, F., and Vrancx, P. (2019, January 6\u20139). Soft Q-Learning with Mutual-Information Regularization. Proceedings of the International Conference on Learning Representations, New Orleans, LA, USA."},{"key":"ref_68","unstructured":"Ortega, P.A., and Stocker, A. (2016, January 5\u201310). Human Decision-Making under Limited Time. Proceedings of the 30th Conference on Neural Information Processing Systems, Barcelona, Spain."},{"key":"ref_69","doi-asserted-by":"crossref","first-page":"932","DOI":"10.3389\/fnins.2018.00932","article-title":"Quantifying Motor Task Performance by Bounded Rational Decision Theory","volume":"12","author":"Schach","year":"2018","journal-title":"Front. Neurosci."},{"key":"ref_70","doi-asserted-by":"crossref","first-page":"293","DOI":"10.1016\/j.tics.2009.04.005","article-title":"The free-energy principle: A rough guide to the brain?","volume":"13","author":"Friston","year":"2009","journal-title":"Trends Cogn. Sci."},{"key":"ref_71","doi-asserted-by":"crossref","unstructured":"Hinton, G.E., and van Camp, D. (1993, January 26\u201328). Keeping the Neural Networks Simple by Minimizing the Description Length of the Weights. Proceedings of the Sixth Annual Conference on Computational Learning Theory, Santa Cruz, CA, USA.","DOI":"10.1145\/168304.168306"},{"key":"ref_72","doi-asserted-by":"crossref","unstructured":"Kappen, B., and Gielen, S. (1995). Developments in Probabilistic Modelling with Neural Network\u2014Ensemble Learning. Neural Networks: Artificial Intelligence and Industrial Applications, Springer.","DOI":"10.1007\/978-1-4471-3087-1"},{"key":"ref_73","doi-asserted-by":"crossref","first-page":"460","DOI":"10.1109\/TIT.1972.1054855","article-title":"Computation of channel capacity and rate-distortion functions","volume":"18","author":"Blahut","year":"1972","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_74","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1109\/TIT.1972.1054753","article-title":"An algorithm for computing the capacity of arbitrary discrete memoryless channels","volume":"18","author":"Arimoto","year":"1972","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_75","first-page":"205","article-title":"Information geometry and alternating minimization procedures","volume":"1","year":"1984","journal-title":"Stat. Decis. Suppl. Issue"},{"key":"ref_76","first-page":"142","article-title":"Coding theorems for a discrete source with a fidelity criterion","volume":"7","author":"Shannon","year":"1959","journal-title":"IRE Int. Conv. Rec."},{"key":"ref_77","doi-asserted-by":"crossref","first-page":"163","DOI":"10.1016\/0024-3795(89)90580-6","article-title":"Majorization, doubly stochastic matrices, and comparison of eigenvalues","volume":"118","author":"Tsuyoshi","year":"1989","journal-title":"Linear Algebra Its Appl."},{"key":"ref_78","doi-asserted-by":"crossref","first-page":"251","DOI":"10.1090\/conm\/149\/01262","article-title":"Majorization, monotonicity of relative entropy, and stochastic matrices","volume":"Volume 149","author":"Cohen","year":"1993","journal-title":"Doeblin and Modern Probability (Blaubeuren, 1991)"},{"key":"ref_79","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1186\/s13660-017-1472-2","article-title":"Majorization, Csisz\u00e1r divergence and Zipf-Mandelbrot law","volume":"2017","author":"Latif","year":"2017","journal-title":"J. Inequal. Appl."},{"key":"ref_80","doi-asserted-by":"crossref","first-page":"7616","DOI":"10.1109\/TIT.2014.2360184","article-title":"Information Measures: The Curious Case of the Binary Alphabet","volume":"60","author":"Jiao","year":"2014","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_81","first-page":"183","article-title":"Information geometry of divergence functions","volume":"58","author":"Amari","year":"2010","journal-title":"Bull. Pol. Acad. Sci."},{"key":"ref_82","doi-asserted-by":"crossref","first-page":"13","DOI":"10.1007\/s41884-018-0002-8","article-title":"Information geometry connecting Wasserstein distance and Kullback-Leibler divergence via the entropy-relaxed transportation problem","volume":"1","author":"Amari","year":"2018","journal-title":"Inf. Geom."},{"key":"ref_83","doi-asserted-by":"crossref","first-page":"6","DOI":"10.1006\/game.1995.1023","article-title":"Quantal Response Equilibria for Normal Form Games","volume":"10","author":"McKelvey","year":"1995","journal-title":"Games Econ. Behav."},{"key":"ref_84","doi-asserted-by":"crossref","first-page":"11478","DOI":"10.1073\/pnas.0710743106","article-title":"Efficient computation of optimal actions","volume":"106","author":"Todorov","year":"2009","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_85","doi-asserted-by":"crossref","first-page":"599","DOI":"10.1111\/cogs.12101","article-title":"One and Done? Optimal Decisions From Very Few Samples","volume":"38","author":"Vul","year":"2014","journal-title":"Cogn. Sci."},{"key":"ref_86","first-page":"475","article-title":"A Minimum Relative Entropy Principle for Learning and Acting","volume":"38","author":"Ortega","year":"2010","journal-title":"J. Artif. Int. Res."},{"key":"ref_87","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1007\/PL00004100","article-title":"Utility and entropy","volume":"17","author":"Candeal","year":"2001","journal-title":"Econ. Theory"},{"key":"ref_88","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1371\/journal.pcbi.1002055","article-title":"Speed\/Accuracy Trade-Off between the Habitual and the Goal-Directed Processes","volume":"7","author":"Keramati","year":"2011","journal-title":"PLoS Comput. Biol."},{"key":"ref_89","doi-asserted-by":"crossref","first-page":"12868","DOI":"10.1073\/pnas.1609094113","article-title":"Adaptive integration of habits into depth-limited planning defines a habitual-goal\u2013directed spectrum","volume":"113","author":"Keramati","year":"2016","journal-title":"Proc. Natl. Acad. Sci. USA"},{"key":"ref_90","doi-asserted-by":"crossref","unstructured":"Ortega, P.A., Braun, D.A., and Tishby, N. (June, January 31). Monte Carlo methods for exact amp; efficient solution of the generalized optimality equations. Proceedings of the 2014 IEEE International Conference on Robotics and Automation (ICRA), Hong Kong, China.","DOI":"10.1109\/ICRA.2014.6907488"},{"key":"ref_91","unstructured":"Laming, D.R.J. (1968). Information Theory of Choice-Reaction Times, Academic Press."},{"key":"ref_92","doi-asserted-by":"crossref","first-page":"59","DOI":"10.1037\/0033-295X.85.2.59","article-title":"A theory of memory retrieval","volume":"85","author":"Ratcliff","year":"1978","journal-title":"Psychol. Rev."},{"key":"ref_93","unstructured":"Townsend, J., and Ashby, F. (1983). The Stochastic Modeling of Elementary Psychological Processes (Part 2), Cambridge University Press."},{"key":"ref_94","doi-asserted-by":"crossref","first-page":"697","DOI":"10.1037\/a0033152","article-title":"Modeling confidence judgments, response times, and multiple choices in decision making: Recognition memory and motion discrimination","volume":"120","author":"Ratcliff","year":"2013","journal-title":"Psychol. Rev."},{"key":"ref_95","doi-asserted-by":"crossref","unstructured":"Shadlen, M., Hanks, T., Churchland, A.K., Kiani, R., and Yang, T. (2006). The Speed and Accuracy of a Simple Perceptual Decision: A Mathematical Primer. Bayesian Brain: Probabilistic Approaches to Neural Coding, MIT Press.","DOI":"10.7551\/mitpress\/9780262042383.003.0010"},{"key":"ref_96","unstructured":"Frazier, P.I., and Yu, A.J. (2007, January 3\u20136). Sequential Hypothesis Testing Under Stochastic Deadlines. Proceedings of the 20th International Conference on Neural Information Processing Systems, Vancouver, BC, Canada."},{"key":"ref_97","doi-asserted-by":"crossref","first-page":"3612","DOI":"10.1523\/JNEUROSCI.4010-11.2012","article-title":"The cost of accumulating evidence in perceptual decision making","volume":"32","author":"Drugowitsch","year":"2012","journal-title":"J. Neurosci."},{"key":"ref_98","unstructured":"Simon, H.A. (1982). Models of Bounded Rationality, MIT Press."},{"key":"ref_99","doi-asserted-by":"crossref","first-page":"92","DOI":"10.3389\/fpsyg.2013.00092","article-title":"The Mixed Instrumental Controller: Using Value of Information to Combine Habitual Choice and Mental Simulation","volume":"4","author":"Pezzulo","year":"2013","journal-title":"Front. Psychol."},{"key":"ref_100","doi-asserted-by":"crossref","first-page":"225","DOI":"10.3389\/fnbeh.2015.00225","article-title":"Modeling choice and reaction time during arbitrary visuomotor learning through the coordination of adaptive working memory and reinforcement learning","volume":"9","author":"Viejo","year":"2015","journal-title":"Front. Behav. Neurosci."},{"key":"ref_101","unstructured":"Aczel, J., and Daroczy, Z. (1975). On Measures of Information and Their Characterizations, Academic Press."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/4\/375\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T12:43:28Z","timestamp":1760186608000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/4\/375"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,4,6]]},"references-count":101,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2019,4]]}},"alternative-id":["e21040375"],"URL":"https:\/\/doi.org\/10.3390\/e21040375","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2019,4,6]]}}}