{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,6]],"date-time":"2026-03-06T01:16:30Z","timestamp":1772759790725,"version":"3.50.1"},"reference-count":22,"publisher":"MDPI AG","issue":"12","license":[{"start":{"date-parts":[[2012,12,3]],"date-time":"2012-12-03T00:00:00Z","timestamp":1354492800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>To address the unknown nature of probability-sampling models, in this paper we use information theoretic concepts and the Cressie-Read (CR) family of information divergence measures to produce a flexible family of probability distributions, likelihood functions, estimators, and inference procedures. The usual case in statistical modeling is that the noisy indirect data are observed and known and the sampling model-error distribution-probability space, consistent with the data, is unknown. To address the unknown sampling process underlying the data, we consider a convex combination of two or more estimators derived from members of the flexible CR family of divergence measures and optimize that combination to select an estimator that minimizes expected quadratic loss. Sampling experiments are used to illustrate the finite sample properties of the resulting estimator and the nature of the recovered sampling distribution. <\/jats:p>","DOI":"10.3390\/e14122427","type":"journal-article","created":{"date-parts":[[2012,12,4]],"date-time":"2012-12-04T12:53:43Z","timestamp":1354625623000},"page":"2427-2438","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Implications of the Cressie-Read Family of Additive Divergences for Information Recovery"],"prefix":"10.3390","volume":"14","author":[{"given":"George","family":"Judge","sequence":"first","affiliation":[{"name":"Gianinni Hall, University of California, Berkeley, Berkeley, CA 94720, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ron","family":"Mittelhammer","sequence":"additional","affiliation":[{"name":"School of Economic Sciences, Washington State University, Pullman, WA 99164, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2012,12,3]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"440","DOI":"10.1111\/j.2517-6161.1984.tb01318.x","article-title":"Multinomial goodness of fit tests","volume":"B46","author":"Cressie","year":"1984","journal-title":"J. R. Stat. Soc."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Read, T.R., and Cressie, N.A. (1988). Goodness of Fit Statistics for Discrete Multivariate Data, Springer Verlag.","DOI":"10.1007\/978-1-4612-4578-0"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"559","DOI":"10.1007\/s00220-008-0440-6","article-title":"Typical Support and Sanov Large Deviations of Correlated States","volume":"279","author":"Bjelakovic","year":"2008","journal-title":"Commun. Math. Phys."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Ojima, I., and Okamura, K. (2011). Large Deviation Strategy for Inverse Problems, Kyoto Institute, Kyoto University.","DOI":"10.1142\/S1230161212500217"},{"key":"ref_5","unstructured":"Hanel, R., and Thurner, S. (2007). A Comprehensive Classification of Complex Statistical System and Distribution Functions, Sante Fe Institute."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"1145","DOI":"10.3390\/e12051145","article-title":"Entropy: The Markov Ordering Approach","volume":"5","author":"Gorban","year":"2010","journal-title":"Entropy"},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Judge, G.G., and Mittelhammer, R.C. (2012). An Information Theoretic Approach to Econometrics, Cambridge University Press.","DOI":"10.1017\/CBO9781139033848"},{"key":"ref_8","unstructured":"Renyi, A. (July, January 20). On measures of entropy and information. Proceedings of the 4th Berkeley Symposium on Mathematics, Statistics and Probability, Berkeley, CA, USA."},{"key":"ref_9","unstructured":"Renyi, A. (1970). Probability Theory, North-Holland."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"479","DOI":"10.1007\/BF01016429","article-title":"Possible Generalization of Boltzmann-Gibbs Statistics","volume":"52","author":"Tsallis","year":"1988","journal-title":"J. Stat. Phys."},{"key":"ref_11","unstructured":"Osterreicher, F. Available online: http:\/\/www.unisalzburg.at\/pls\/portal\/docs\/1\/246178.PDF, accessed on 21 October 2012."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"639","DOI":"10.1007\/BF02517812","article-title":"A New Class of Metric Divergences on Probability Spaces and its Applicability in Statistics","volume":"55","author":"Osterreicher","year":"2003","journal-title":"Ann. Inst. Stat. Math."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"379","DOI":"10.1002\/j.1538-7305.1948.tb01338.x","article-title":"A mathematical theory of communication","volume":"27","author":"Shannon","year":"1948","journal-title":"Bell System Tech. J."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"535","DOI":"10.1093\/biomet\/85.3.535","article-title":"Empirical likelihood as a goodness of fit measure","volume":"85","author":"Baggerly","year":"1998","journal-title":"Biometrika"},{"key":"ref_15","unstructured":"Mittelhammer, R.M., Judge, G.G., and Miller, D.J. (2000). Econometrics Foundations, Cambridge University Press."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_17","unstructured":"Gorban, A. (1984). Equilibrium Encircling Equations of Chemical Kinetics and Their Thermodynamic Limit, Nauka."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"016104","DOI":"10.1103\/PhysRevE.67.016104","article-title":"Family of Additive Entropy Functions Out of the Thermodynamic Limit","volume":"67","author":"Gorban","year":"2003","journal-title":"Phys. Rev. E"},{"key":"ref_19","unstructured":"Grendar, M., and Grendar, M. (2000). On the Probabilistic Rationale of I Divergence and J Divergence Minimization."},{"key":"ref_20","unstructured":"James, W., and Stein, C. (1961). Proceedings of Fourth Berkeley Symposium on Statistics and Probability, University of California Press."},{"key":"ref_21","unstructured":"Judge, G., and Bock, M.E. (1978). The Statistical Implication of Pre-Test and Stein-Rule Estimators, North Holland."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"237","DOI":"10.1016\/S0165-1765(01)00602-4","article-title":"Notes on Bias in Estimators for Simultaneous Equation Models","volume":"75","author":"Hahn","year":"2002","journal-title":"Econ. Lett."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/12\/2427\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:53:57Z","timestamp":1760219637000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/12\/2427"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,12,3]]},"references-count":22,"journal-issue":{"issue":"12","published-online":{"date-parts":[[2012,12]]}},"alternative-id":["e14122427"],"URL":"https:\/\/doi.org\/10.3390\/e14122427","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2012,12,3]]}}}