{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,4]],"date-time":"2026-06-04T21:20:14Z","timestamp":1780608014657,"version":"3.54.1"},"reference-count":18,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2023,4,4]],"date-time":"2023-04-04T00:00:00Z","timestamp":1680566400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We present an empirical estimator for the squared Hellinger distance between two continuous distributions, which almost surely converges. We show that the divergence estimation problem can be solved directly using the empirical CDF and does not need the intermediate step of estimating the densities. We illustrate the proposed estimator on several one-dimensional probability distributions. Finally, we extend the estimator to a family of estimators for the family of \u03b1-divergences, which almost surely converge as well, and discuss the uniqueness of this result. We demonstrate applications of the proposed Hellinger affinity estimators to approximately bounding the Neyman\u2013Pearson regions.<\/jats:p>","DOI":"10.3390\/e25040612","type":"journal-article","created":{"date-parts":[[2023,4,4]],"date-time":"2023-04-04T04:09:50Z","timestamp":1680581390000},"page":"612","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":12,"title":["Empirical Squared Hellinger Distance Estimator and Generalizations to a Family of \u03b1-Divergence Estimators"],"prefix":"10.3390","volume":"25","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-1624-933X","authenticated-orcid":false,"given":"Rui","family":"Ding","sequence":"first","affiliation":[{"name":"Applied Mathematics and Statistics Department, Stony Brook University, Stony Brook, NY 11794, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Andrew","family":"Mullhaupt","sequence":"additional","affiliation":[{"name":"Applied Mathematics and Statistics Department, Stony Brook University, Stony Brook, NY 11794, USA"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2023,4,4]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Perez-Cruz, F. (2008, January 6\u201311). Kullback\u2013Leibler divergence estimation of continuous distributions. Proceedings of the IEEE International Symposium on Information Theory, Toronto, ON, Canada.","DOI":"10.1109\/ISIT.2008.4595271"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"327","DOI":"10.1007\/s10463-005-0014-8","article-title":"Estimation of Kullback\u2013Leibler divergence by local likelihood","volume":"58","author":"Lee","year":"2006","journal-title":"Ann. Inst. Stat. Math."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"41","DOI":"10.1006\/jmva.1994.1033","article-title":"Two-sample test statistics for measuring discrepancies between two multivariate probability density functions using kernel-based density estimates","volume":"50","author":"Anderson","year":"1994","journal-title":"J. Multivar. Anal."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Nguyen, X., Wainwright, M.J., and Jordan, M.I. (2007, January 24\u201329). Nonparametric estimation of the likelihood ratio and divergence functionals. Proceedings of the IEEE International Symposium on Information Theory, Nice, France.","DOI":"10.1109\/ISIT.2007.4557517"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"3064","DOI":"10.1109\/TIT.2005.853314","article-title":"Divergence estimation of continuous distributions based on data-dependent partitions","volume":"51","author":"Wang","year":"2005","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Wang, Q., Kulkarni, S., and Verd\u00fa, S. (2006, January 9\u201314). A nearest-neighbor approach to estimating divergence between continuous random vectors. Proceedings of the IEEE International Symposium on Information Theory, Seattle, WA, USA.","DOI":"10.1109\/ISIT.2006.261842"},{"key":"ref_7","unstructured":"Yang, G.L., and Le Cam, L. (2000). Asymptotics in Statistics: Some Basic Concepts, Springer."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kulllback","year":"1951","journal-title":"Ann. Math. Stat."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"1532","DOI":"10.3390\/e12061532","article-title":"Families of alpha- beta- and gamma- divergences: Flexible and robust measures of similarities","volume":"12","author":"Cichocki","year":"2010","journal-title":"Entropy"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"4094","DOI":"10.1109\/TIT.2019.2896192","article-title":"A note on reverse Pinsker inequalities","volume":"65","author":"Binette","year":"2019","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"5973","DOI":"10.1109\/TIT.2016.2603151","article-title":"f-divergence inequalities","volume":"62","author":"Sason","year":"2016","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_12","unstructured":"Gilardoni, G.L. (2006). On Pinsker\u2019s type inequalities and Csiszar\u2019s f-divergences, Part I: Second and Fourth-Order Inequalities. arXiv."},{"key":"ref_13","unstructured":"Poczos, B., and Schneider, J. (2011, January 11\u201313). On the Estimation of \u03b1-Divergences. Proceedings of the Fourteenth International Conference on Artificial Intelligence and Statistics, Fort Lauderdale, FL, USA."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"4925","DOI":"10.1109\/TIT.2009.2030485","article-title":"\u03b1-Divergence is unique, belonging to both f-divergence and Bregman divergence classes","volume":"55","author":"Amari","year":"2009","journal-title":"IEEE Trans. Inf. Theory"},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Gilberg, A., and Jain, L. (2017, January 3\u20136). If it ain\u2019t broke, don\u2019t fix it: Sparse metric repair. Proceedings of the 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton), Monticello, IL, USA.","DOI":"10.1109\/ALLERTON.2017.8262793"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"111","DOI":"10.3905\/jfds.2022.1.111","article-title":"Visualizing Structures in Financial Time-Series Datasets through Affinity-Based Diffusion Transition Embedding","volume":"5","author":"Ding","year":"2023","journal-title":"J. Financ. Data Sci."},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"2153","DOI":"10.1214\/07-AOS539","article-title":"A class of R\u00e9nyi information estimators for multidimensional densities","volume":"36","author":"Leonenko","year":"2008","journal-title":"Ann. Stat."},{"key":"ref_18","unstructured":"Lehmann, E.L., and Romano, J.P. (2005). Testing Statistical Hypotheses, Springer."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/4\/612\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,10]],"date-time":"2025-10-10T19:09:41Z","timestamp":1760123381000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/25\/4\/612"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2023,4,4]]},"references-count":18,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2023,4]]}},"alternative-id":["e25040612"],"URL":"https:\/\/doi.org\/10.3390\/e25040612","relation":{},"ISSN":["1099-4300"],"issn-type":[{"value":"1099-4300","type":"electronic"}],"subject":[],"published":{"date-parts":[[2023,4,4]]}}}