{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,4,22]],"date-time":"2026-04-22T22:42:29Z","timestamp":1776897749448,"version":"3.51.2"},"reference-count":34,"publisher":"MDPI AG","issue":"1","license":[{"start":{"date-parts":[[2007,1,20]],"date-time":"2007-01-20T00:00:00Z","timestamp":1169251200000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We review a decision theoretic, i.e., utility-based, motivation for entropy and Kullback-Leibler relative entropy, the natural generalizations that follow, and various properties of thesegeneralized quantities. We then consider these generalized quantities in an easily interpreted spe-cial case. We show that the resulting quantities, share many of the properties of entropy andrelative entropy, such as the data processing inequality and the second law of thermodynamics.We formulate an important statistical learning problem \u2013 probability estimation \u2013 in terms of ageneralized relative entropy. The solution of this problem reflects general risk preferences via theutility function; moreover, the solution is optimal in a sense of robust absolute performance.<\/jats:p>","DOI":"10.3390\/e9010001","type":"journal-article","created":{"date-parts":[[2008,10,25]],"date-time":"2008-10-25T13:44:42Z","timestamp":1224942282000},"page":"1-26","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":19,"title":["A Utility-Based Approach to Some Information Measures"],"prefix":"10.3390","volume":"9","author":[{"given":"Craig","family":"Friedman","sequence":"first","affiliation":[{"name":"Standard & Poor\u2019s, 55 Water Street, 46th Floor, New York, NY 10041, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jinggang","family":"Huang","sequence":"additional","affiliation":[{"name":"Standard & Poor\u2019s, 55 Water Street, 46th Floor, New York, NY 10041, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Sven","family":"Sandow","sequence":"additional","affiliation":[{"name":"Standard & Poor\u2019s, 55 Water Street, 46th Floor, New York, NY 10041, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2007,1,20]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Boyd, S., and Vandenberghe, L. (2004). Convex Optimization.","DOI":"10.1017\/CBO9780511804441"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Brillouin, L. (1962). Science and Information Theory, Academic Press.","DOI":"10.1063\/1.3057866"},{"key":"ref_3","unstructured":"Cover, T., and Thomas, J. (1991). Elements of Information Theory, Wiley."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1016\/0022-0531(81)90020-X","article-title":"Additivity and the entropy concept: An axiomatic approach to inequality measurement","volume":"25","author":"Cowell","year":"1981","journal-title":"Journal of Economic Theory"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1111\/j.2517-6161.1984.tb01318.x","article-title":"Multinomial goodness of fit tests","volume":"46","author":"Cressie","year":"1984","journal-title":"journal of the royal statistical society b"},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"19","DOI":"10.2307\/1403582","article-title":"Pearson\u2019s x2 and the loglikelihood ratio statistic g2: a comparative review","volume":"57","author":"Cressie","year":"1989","journal-title":"International statistical review"},{"key":"ref_7","unstructured":"Csisz\u00e1r, I., and K\u00f6rner, J. (1997). Information theory: Coding Theorems for Discrete Memoryless Systems, Academic Press."},{"key":"ref_8","unstructured":"Duffie, D. (1996). Dynamic Asset Pricing Theory, Princeton University Press."},{"key":"ref_9","first-page":"291","article-title":"Learning probabilistic models: An expected utility maximization approach","volume":"4","author":"Friedman","year":"2003a","journal-title":"Journal of Machine Learning Research"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"355","DOI":"10.1142\/S0219024903001918","article-title":"Model performance measures for expected utility maximizing investors","volume":"6","author":"Friedman","year":"2003b","journal-title":"International Journal of Theoretical and Applied Finance"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"541","DOI":"10.1142\/S0219024904002530","article-title":"Model performance measures for leveraged investors","volume":"7","author":"Friedman","year":"2004","journal-title":"International Journal of Theoretical and Applied Finance"},{"key":"ref_12","unstructured":"Golan, A., Judge, G., and Miller, D. (1996). Maximum Entropy Econometrics, Wiley."},{"key":"ref_13","unstructured":"Group of Statistical Physics (Working Paper, 2006). Nonextensive statistical mechanics and thermodynamics: Bibliography, Working Paper, http:\/\/tsallis.cat.cbpf.br\/TEMUCO.pdf."},{"key":"ref_14","doi-asserted-by":"crossref","unstructured":"Gr\u00fcnwald, P., and Dawid, A. (2002). Game theory, maximum generalized entropy, minimum discrepancy, robust bayes and pythagoras. Proceedings ITW.","DOI":"10.1109\/ITW.2002.1115425"},{"key":"ref_15","first-page":"1367","article-title":"Game theory, maximum generalized entropy, minimum discrepancy, and robust bayesian decision theory","volume":"32","author":"Dawid","year":"2004","journal-title":"Annals of Statistics"},{"key":"ref_16","unstructured":"Ingersoll, J. (1987). Theory of Financial Decision Making, Rowman and Littlefield."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1103\/PhysRev.106.620","article-title":"Information theory and statistical mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Physical Review"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"861","DOI":"10.2307\/2171942","article-title":"An information-theoretic alternative to generalized method of moments","volume":"65","author":"Kitamura","year":"1997","journal-title":"Econometrica"},{"key":"ref_19","unstructured":"Lebanon, G., and Lafferty, J. (Technical Report CMU-CS-01-144 School of Computer Science Carnegie Mellon University, 2001). Boosting and maximum likelihood for exponential models, Technical Report CMU-CS-01-144 School of Computer Science Carnegie Mellon University."},{"key":"ref_20","unstructured":"Liese, F., and Vajda, I. (1987). Convex Statistical Distances."},{"key":"ref_21","unstructured":"Luenberger, D. (1998). Investment Science, Oxford University Press."},{"key":"ref_22","unstructured":"Morningstar The new morningstar ratingTM methodology. http:\/\/www.morningstar.dk\/downloads\/MRARdefined.pdf."},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1036","DOI":"10.1109\/18.256536","article-title":"Statistical information and discrimination","volume":"39","author":"Vajda","year":"1993","journal-title":"IEEE transactions on information theory"},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1590\/S0103-97331999000100005","article-title":"Tsallis entropy and Jaynes\u2019 informnation theory formalism","volume":"29","author":"Plastino","year":"1999","journal-title":"Brazilian Journal of Physics"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell System Technical Journal"},{"key":"ref_26","first-page":"2261","article-title":"Utility maximizing entropy and the second law of thermodynamics","volume":"32","author":"Zastawniak","year":"2004","journal-title":"Annals of Probability"},{"key":"ref_27","first-page":"359","article-title":"On a statistical information measure of diffusion processes","volume":"17","author":"Stummer","year":"1999","journal-title":"statistics and decisions"},{"key":"ref_28","first-page":"289","article-title":"On a statistical information measure for a Samuelson-Black-Scholes model","volume":"19","author":"Stummer","year":"2001","journal-title":"statistics and decisions"},{"key":"ref_29","unstructured":"Stummer, W. (Exponentials, Diffusions, Finance, Entropy and Information, 2004). Exponentials, Diffusions, Finance, Entropy and Information, Shaker."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"367","DOI":"10.1016\/0304-4076(94)01656-K","article-title":"A bayesian approach to diagnosis of asset pricing models","volume":"68","author":"Stutzer","year":"1995","journal-title":"Journal of Econometrics"},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"365","DOI":"10.1016\/S0304-4076(03)00112-X","article-title":"Portfolio choice with endogenous utility: A large deviations approach","volume":"116","author":"Stutzer","year":"2003","journal-title":"Journal of Econometrics"},{"key":"ref_32","first-page":"8","article-title":"Information theoretical optimization techniques","volume":"15","year":"1979","journal-title":"Kybernetika"},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/BF01016429","article-title":"Possible generalization of Boltzmann-Gibbs statistics","volume":"52","author":"Tsallis","year":"1988","journal-title":"Journal of Statistical Physics"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/s00161-004-0174-4","article-title":"Nonextensive statistical mechanics: A brief introduction","volume":"16","author":"Tsallis","year":"2004","journal-title":"Continuum Mechechanics and Thermodynanmics"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/9\/1\/1\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T22:24:10Z","timestamp":1760221450000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/9\/1\/1"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2007,1,20]]},"references-count":34,"journal-issue":{"issue":"1","published-online":{"date-parts":[[2007,3]]}},"alternative-id":["e9010001"],"URL":"https:\/\/doi.org\/10.3390\/e9010001","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2007,1,20]]}}}