{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:54:57Z","timestamp":1774630497240,"version":"3.50.1"},"reference-count":272,"publisher":"Emerald","issue":"3","content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2009,5,27]]},"abstract":"<jats:p>This monograph presents an overview of universal estimation of information measures for continuous-alphabet sources. Special attention is given to the estimation of mutual information and divergence based on independent and identically distributed (i.i.d.) data. Plug-in methods, partitioning-based algorithms, nearest-neighbor algorithms as well as other approaches are reviewed, with particular focus on consistency, speed of convergence and experimental performance.<\/jats:p>","DOI":"10.1561\/0100000021","type":"journal-article","created":{"date-parts":[[2009,6,5]],"date-time":"2009-06-05T03:47:42Z","timestamp":1244173662000},"page":"265-353","source":"Crossref","is-referenced-by-count":34,"title":["Universal Estimation of Information Measures for Analog Sources"],"prefix":"10.1561","volume":"5","author":[{"given":"Qing","family":"Wang","sequence":"first","affiliation":[{"name":"Credit Suisse Group , 11 Madison Avenue, , NY 10010,","place":["New York, USA"]}]},{"given":"Sanjeev R.","family":"Kulkarni","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Princeton University , , NJ 08544,","place":["Princeton, USA"]}]},{"given":"Sergio","family":"Verd\u00fa","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering, Princeton University , , NJ 08544,","place":["Princeton, USA"]}]}],"member":"140","published-online":{"date-parts":[[2009,5,27]]},"reference":[{"key":"2026032712064661200_ref001","doi-asserted-by":"crossref","unstructured":"C.\n              Adami\n            \n          , \u201cInformation theory in molecular biology,\u201d Physics of Life Reviews, vol. 1, pp. 3\u201322, Online. Available: http:\/\/arxiv.org\/abs\/q-bio\/0405004, 2004.","DOI":"10.1016\/j.plrev.2004.01.002"},{"issue":"2","key":"2026032712064661200_ref002","doi-asserted-by":"crossref","first-page":"794","DOI":"10.1214\/aop\/1022855650","article-title":"On density estimation from ergodic processes","volume":"26","author":"Adams","year":"1998","journal-title":"The Annals of Probability"},{"key":"2026032712064661200_ref003","first-page":"411","article-title":"New informationbased clustering method using R\u00e9enyi\u2019s entropy and fuzzy C-means clustering","volume-title":"Proceeding of Signal and Image Processing","author":"Aghagolzadeh","year":"2005"},{"issue":"4","key":"2026032712064661200_ref004","doi-asserted-by":"crossref","first-page":"1121","DOI":"10.1109\/18.243431","article-title":"Common randomness in information theory and cryptography \u2014 Part I: Secrete sharing","volume":"39","author":"Ahlswede","year":"1993","journal-title":"IEEE Transactions on Information Theory"},{"issue":"3","key":"2026032712064661200_ref005","doi-asserted-by":"crossref","first-page":"372","DOI":"10.1109\/TIT.1976.1055550","article-title":"A nonparametric estimation of the entropy for absolutely continuous distributions","volume":"22","author":"Ahmad","year":"1976","journal-title":"IEEE Transactions on Information Theory"},{"issue":"3","key":"2026032712064661200_ref006","doi-asserted-by":"crossref","first-page":"688","DOI":"10.1109\/18.30996","article-title":"Entropy expressions and their estimators for multivariate distributions","volume":"35","author":"Ahmed","year":"1989","journal-title":"IEEE Transactions on Information Theory"},{"issue":"3","key":"2026032712064661200_ref007","article-title":"Identifying statistical dependence in genomic sequences via mutual information estimates","author":"Aktulga","year":"2007","journal-title":"EURASIP Journal on Bioinformatics and Systems Biology"},{"key":"2026032712064661200_ref008","doi-asserted-by":"crossref","first-page":"2676","DOI":"10.1109\/ISIT.2007.4557183","article-title":"Statistical dependence in biological sequences","author":"Aktulga","year":"2007","journal-title":"Proceedings of 2007 International Symposium on Information Theory (ISIT2007)"},{"key":"2026032712064661200_ref009","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1109\/TCOM.1966.1089333","article-title":"Useful approximations to optimum quantization","volume":"14","author":"Algazi","year":"1966","journal-title":"IEEE Transactions on Communications Technology"},{"issue":"1","key":"2026032712064661200_ref010","doi-asserted-by":"crossref","first-page":"131","DOI":"10.1111\/j.2517-6161.1966.tb00626.x","article-title":"A general class of coefficients of divergence of one distribution from another","volume":"28","author":"Ali","year":"1966","journal-title":"Journal of the Royal Statistical Society. Series B (Methodological)"},{"key":"2026032712064661200_ref011","doi-asserted-by":"crossref","first-page":"615","DOI":"10.1016\/0005-1098(78)90051-1","article-title":"Model approximation via prediction error identification","volume":"14","author":"Anderson","year":"1978","journal-title":"Automatica"},{"key":"2026032712064661200_ref012","doi-asserted-by":"crossref","first-page":"581","DOI":"10.1109\/CVPR.2005.151","article-title":"Face recognition with image sets using manifold density divergence","volume":"1","author":"Arandjelovic","year":"2005","journal-title":"Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR\u201905)"},{"key":"2026032712064661200_ref013","doi-asserted-by":"crossref","first-page":"975","DOI":"10.1090\/S0894-0347-04-00459-X","article-title":"Solution of Shannon\u2019s problem on the monotonicity of entropy","volume":"17","author":"Artstein","year":"2004","journal-title":"Journal of the American Mathematical Society"},{"key":"2026032712064661200_ref014","volume-title":"\u201cNearest neighbor searching and applications","author":"Arya","year":"1995"},{"key":"2026032712064661200_ref015","first-page":"200","article-title":"Improving algorithms for boosting","volume-title":"Proceedings of the 13th Annual Conference on Computational Learning Theory","author":"Aslam","year":"2000"},{"issue":"5","key":"2026032712064661200_ref016","doi-asserted-by":"crossref","first-page":"726","DOI":"10.1016\/j.media.2006.07.002","article-title":"Adaptive nonparametric Markov modeling for unsupervised MRI brain-tissue classification","volume":"10","author":"Awate","year":"2006","journal-title":"Medical Image Analysis"},{"issue":"28","key":"2026032712064661200_ref017","first-page":"565","article-title":"R\u00e9nyi entropy based divergence measures for ICA","author":"Bao","year":"2003","journal-title":"Proceedings of 2003 IEEE Workshop on Statistical Signal Processing"},{"key":"2026032712064661200_ref018","first-page":"436","article-title":"Compression-based image registration","volume-title":"Proceedings of the 2006 IEEE International Symposium on Information Theory (ISIT2006)","author":"Bardera","year":"2006"},{"key":"2026032712064661200_ref019","doi-asserted-by":"crossref","first-page":"336","DOI":"10.1214\/aop\/1176992632","article-title":"Entropy and the central limit theorem","volume":"14","author":"Barron","year":"1986","journal-title":"Annals of Probability"},{"issue":"4","key":"2026032712064661200_ref020","doi-asserted-by":"crossref","first-page":"349","DOI":"10.1016\/0165-1684(89)90079-0","article-title":"Distance measures for signal processing and pattern recognition","volume":"18","author":"Basseville","year":"1989","journal-title":"Signal Processing"},{"key":"2026032712064661200_ref021","doi-asserted-by":"crossref","first-page":"753","DOI":"10.1109\/ICASSP.1998.675374","article-title":"A distance measure between collections of distributions and its application to speaker recognition","volume":"2","author":"Beigi","year":"1998","journal-title":"Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP\u201998)"},{"key":"2026032712064661200_ref022","first-page":"27","article-title":"Limit theory for spacing statistics from general univariate distributions","volume":"1","author":"Beirlant","year":"1986","journal-title":"Publications de l\u2019Institut de Statistique de l\u2019Universit\u00e9 de Paris XXXI fasc"},{"issue":"1","key":"2026032712064661200_ref023","first-page":"17","article-title":"Nonparametric entropy estimation: An overview","volume":"6","author":"Beirlant","year":"1997","journal-title":"The International Journal of Mathematics and Statistical Sciences"},{"key":"2026032712064661200_ref024","doi-asserted-by":"crossref","first-page":"300","DOI":"10.1016\/0047-259X(85)90023-5","article-title":"The empirical distribution function and strong laws for functions of order statistics of uniform spacings","volume":"16","author":"Beirlant","year":"1985","journal-title":"Journal of Multivariate Analysis"},{"key":"2026032712064661200_ref025","first-page":"59","article-title":"Information in the holographic universe","volume-title":"Scientific American","author":"Bekenstein","year":"2003"},{"issue":"4","key":"2026032712064661200_ref026","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevLett.88.048702","article-title":"Language trees and zipping","volume":"88","author":"Benedetto","year":"2002","journal-title":"Physical Review Letters"},{"issue":"6","key":"2026032712064661200_ref027","doi-asserted-by":"crossref","first-page":"2724","DOI":"10.1109\/18.720553","article-title":"Quantum information theory","volume":"44","author":"Bennett","year":"1998","journal-title":"IEEE Transactions on Information Theory"},{"issue":"9","key":"2026032712064661200_ref028","doi-asserted-by":"crossref","first-page":"509","DOI":"10.1145\/361002.361007","article-title":"Multidimensional binary search trees used for associative searching","volume":"18","author":"Bentley","year":"1975","journal-title":"Communications of the ACM"},{"key":"2026032712064661200_ref029","doi-asserted-by":"crossref","first-page":"759","DOI":"10.1109\/TIT.1972.1054906","article-title":"Optimum quantizers and permutation codes","volume":"18","author":"Berger","year":"1972","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref030","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1109\/TIT.1982.1056456","article-title":"Minimum entropy quantizers and permutation codes","volume":"28","author":"Berger","year":"1982","journal-title":"IEEE Transactions on Information Theory"},{"issue":"6","key":"2026032712064661200_ref031","doi-asserted-by":"crossref","first-page":"1770","DOI":"10.1214\/aoms\/1177698611","article-title":"Efficient estimation of a shift parameter from grouped data","volume":"38","author":"Bhattacharya","year":"1967","journal-title":"The Annals of Mathematical Statistics"},{"key":"2026032712064661200_ref032","doi-asserted-by":"crossref","first-page":"448","DOI":"10.1109\/TIT.1979.1056075","article-title":"On the capacity of certain additive non-Gaussian channels","volume":"25","author":"Binia","year":"1979","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref033","doi-asserted-by":"crossref","first-page":"1218","DOI":"10.1109\/TIT.2004.842762","article-title":"New bounds on the capacity of certain infinite-dimensional additive non-Gaussian channels","volume":"51","author":"Binia","year":"2005","journal-title":"IEEE Transactions on Information Theory"},{"issue":"3","key":"2026032712064661200_ref034","doi-asserted-by":"crossref","first-page":"1179","DOI":"10.1109\/TIT.2006.890715","article-title":"On divergence-power inequalities","volume":"53","author":"Binia","year":"2007","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref035","volume-title":"Application of Kullback-Leibler metric to speech recognition","author":"Bocharov","year":"2003"},{"key":"2026032712064661200_ref036","doi-asserted-by":"crossref","first-page":"947","DOI":"10.1038\/14731","article-title":"Information theory and neural coding","volume":"2","author":"Borst","year":"1999","journal-title":"Nature Neuroscience"},{"issue":"3","key":"2026032712064661200_ref037","doi-asserted-by":"crossref","first-page":"1076","DOI":"10.1016\/j.jspi.2006.06.026","article-title":"Mutual information in the frequency domain","volume":"137","author":"Brillinger","year":"2007","journal-title":"Journal of Statistical Planning and Inference"},{"key":"2026032712064661200_ref038","doi-asserted-by":"crossref","first-page":"325","DOI":"10.1145\/146370.146374","article-title":"A survey of image registration techniques","volume":"24","author":"Brown","year":"1992","journal-title":"ACM Computing Surveys"},{"key":"2026032712064661200_ref039","doi-asserted-by":"crossref","first-page":"143","DOI":"10.2307\/2331391","article-title":"The maximum entropy eistribution of an asset inferred from option prices","volume":"31","author":"Buchen","year":"1996","journal-title":"The Journal of Financial and Quantitative Analysis"},{"key":"2026032712064661200_ref040","volume-title":"Maximum entropy spectral analysis","author":"Burg","year":"1975"},{"key":"2026032712064661200_ref041","first-page":"415","article-title":"Mutual information relevance networks: Functional genomic clustering using pairwise entropy measurements","volume":"5","author":"Butte","year":"2000","journal-title":"Proceedings of the Pacific Symposium on Biocomputing"},{"key":"2026032712064661200_ref042","doi-asserted-by":"crossref","first-page":"179","DOI":"10.1007\/BF02869528","article-title":"Estimation of a multivariate density","volume":"18","author":"Cacoullus","year":"1966","journal-title":"The Annals of the Institute of Statistical Mathematics"},{"issue":"7","key":"2026032712064661200_ref043","doi-asserted-by":"crossref","first-page":"1551","DOI":"10.1109\/TIT.2004.830771","article-title":"Universal entropy estimation via block sorting","volume":"50","author":"Cai","year":"2004","journal-title":"IEEE Transactions on Information Theory"},{"issue":"8","key":"2026032712064661200_ref044","doi-asserted-by":"crossref","first-page":"3456","DOI":"10.1109\/TIT.2006.878182","article-title":"Universal divergence estimation for finite-alphabet sources","volume":"52","author":"Cai","year":"2006","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref045","first-page":"441","article-title":"Nonparametric entropy estimation based on randomly censored data","volume":"20","author":"Carbonez","year":"1991","journal-title":"Problems of Control and Inforrmation Theory"},{"issue":"11","key":"2026032712064661200_ref046","doi-asserted-by":"crossref","first-page":"2445","DOI":"10.1109\/TGRS.2003.817664","article-title":"Performance of mutual information similarity measure for registration of multi-temporal remote sensing images","volume":"41","author":"Chen","year":"2003","journal-title":"IEEE Transactions on Geoscience and Remote Sensing"},{"key":"2026032712064661200_ref047","first-page":"335","article-title":"Density estimation in strongly dependent non-lineartime series","volume":"1","author":"Cheng","year":"1991","journal-title":"Statistica Sinica"},{"key":"2026032712064661200_ref048","doi-asserted-by":"crossref","first-page":"1094","DOI":"10.1109\/PROC.1984.12981","article-title":"An information-theoretic proof of Burg\u2019s maximum entropy spectrum","volume":"72","author":"Choi","year":"1984","journal-title":"Proceedings of IEEE"},{"issue":"4","key":"2026032712064661200_ref049","doi-asserted-by":"crossref","first-page":"1523","DOI":"10.1109\/TIT.2005.844059","article-title":"Clustering by compression","volume":"51","author":"Cilibrasi","year":"2005","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref050","doi-asserted-by":"crossref","first-page":"287","DOI":"10.1016\/0165-1684(94)90029-9","article-title":"Independent component analysis, a new concept?","volume":"36","author":"Comon","year":"1994","journal-title":"Signal Processing"},{"issue":"4","key":"2026032712064661200_ref051","doi-asserted-by":"crossref","first-page":"413","DOI":"10.1109\/TIT.1978.1055912","article-title":"A convergent gambling estimate of the entropy of English","volume":"24","author":"Cover","year":"1978","journal-title":"IEEE Transactions on Information Theory"},{"issue":"1","key":"2026032712064661200_ref052","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1111\/j.1467-9965.1991.tb00002.x","article-title":"Universal portfolios","volume":"1","author":"Cover","year":"1991","journal-title":"Mathematical Finance"},{"key":"2026032712064661200_ref053","first-page":"10","article-title":"Shannon and investment","author":"Cover","year":"1998","journal-title":"IEEE Information Theory Newsletter (Special Golden Jubilee Issue)"},{"issue":"1","key":"2026032712064661200_ref054","doi-asserted-by":"crossref","first-page":"21","DOI":"10.1109\/TIT.1967.1053964","article-title":"Nearest neighbor pattern classification","volume":"13","author":"Cover","year":"1967","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref055","article-title":"Elements of Information Theory","volume-title":"Wiley Series in Telecommunications","author":"Cover","year":"1991"},{"key":"2026032712064661200_ref056","doi-asserted-by":"crossref","DOI":"10.1002\/047174882X","article-title":"Elements of Information Theory","volume-title":"Wiley Series in Telecommunications, Second ed.","author":"Cover","year":"2005"},{"key":"2026032712064661200_ref057","first-page":"399","article-title":"On some classes of series used in mathematical statistics","author":"Cram\u00e9r,","year":"1925","journal-title":"Proceedings of the 6th Scandinavian Congress of Mathematicians"},{"key":"2026032712064661200_ref058","doi-asserted-by":"crossref","first-page":"343","DOI":"10.1093\/biomet\/63.2.343","article-title":"On the logarithms of higher order spacings","volume":"63","author":"Cressie","year":"1976","journal-title":"Biometrika"},{"key":"2026032712064661200_ref059","first-page":"229","article-title":"Information-type measures of difference of probability distributions and indirect observations","volume":"2","author":"Csisz\u00e1r,","year":"1967","journal-title":"Studia Scientiarum Mathematicarum Hungarica"},{"key":"2026032712064661200_ref060","first-page":"401","article-title":"On generalized entropy","volume":"4","author":"Csisz\u00e1r,","year":"1969","journal-title":"Studia Scientiarum Mathematicarum Hungarica"},{"key":"2026032712064661200_ref061","article-title":"Generalized entropy and quantization problems","volume-title":"Transactions of the 6th Praque Conference on Information Theory, Statistical Decision Functions, Random Processes (Academia, Prague)","author":"Csisz\u00e1r,","year":"1973"},{"issue":"1","key":"2026032712064661200_ref062","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1214\/aop\/1176996454","article-title":"I-divergence geometry of probability distributions and minimization problems","volume":"3","author":"Csisz\u00e1r,","year":"1975","journal-title":"The Annals of Probability"},{"key":"2026032712064661200_ref063","volume-title":"Information Thoery: Coding Theorems for Discrete Memoryless Systems","author":"Csisz\u00e1r","year":"1982"},{"issue":"4","key":"2026032712064661200_ref064","doi-asserted-by":"crossref","first-page":"417","DOI":"10.1561\/0100000004","article-title":"Information theory and statistics: A tutorial","volume":"1","author":"Csisz\u00e1r","year":"2004","journal-title":"Foundations and Trends in Communications and Information Theory"},{"issue":"4","key":"2026032712064661200_ref065","doi-asserted-by":"crossref","first-page":"1315","DOI":"10.1109\/18.761290","article-title":"Estimation of the information by an adaptive partitioning of the observation space","volume":"45","author":"Darbellay","year":"1999","journal-title":"IEEE Transactions on Information Theory"},{"issue":"2","key":"2026032712064661200_ref066","doi-asserted-by":"crossref","first-page":"709","DOI":"10.1109\/18.825848","article-title":"Entropy expressions for multivariate continuous distributions","volume":"46","author":"Darbellay","year":"2000","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref067","article-title":"Nearest Neighbor Pattern Classification Techniques","volume-title":"IEEE Computer Society Press","author":"Dasarathy","year":"1991"},{"key":"2026032712064661200_ref068","volume-title":"An information-theoretic approach to detecting changes in multi-dimensional data streams","author":"Dasu"},{"issue":"6","key":"2026032712064661200_ref069","doi-asserted-by":"crossref","first-page":"1501","DOI":"10.1109\/18.104312","article-title":"Information theoretic inequalities","volume":"37","author":"Dembo","year":"1991","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref070","article-title":"A course in density estimation","volume":"14","author":"Devroye","year":"1987","journal-title":"Progress in Probability and Statistics"},{"key":"2026032712064661200_ref071","article-title":"Nonparametric Density Estimation, the L1 View","volume-title":"Wiley Series in Probability and Mathematical Statistics","author":"Devroye","year":"1985"},{"issue":"3","key":"2026032712064661200_ref072","doi-asserted-by":"crossref","first-page":"1371","DOI":"10.1214\/aos\/1176325633","article-title":"On the strong universal consistency of nearest neighbor regression function estimates","volume":"22","author":"Devroye","year":"1994","journal-title":"The Annals of Statistics"},{"key":"2026032712064661200_ref073","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-0711-5","volume-title":"A Probablistic Theory of Pattern Recognition","author":"Devroye","year":"1996"},{"issue":"3","key":"2026032712064661200_ref074","doi-asserted-by":"crossref","first-page":"536","DOI":"10.1214\/aos\/1176343851","article-title":"The strong uniform consistency of nearest neighbor density estimates","volume":"5","author":"Devroye","year":"1977","journal-title":"The Annals of Statistics"},{"key":"2026032712064661200_ref075","first-page":"1","article-title":"Entropy-based independence test","volume":"44","author":"Menezes","year":"2006","journal-title":"Nonlinear Dynamics"},{"issue":"3","key":"2026032712064661200_ref076","doi-asserted-by":"crossref","first-page":"628","DOI":"10.1137\/1118083","article-title":"On the estimation of functionals of the probability density and its derivatives","volume":"18","author":"Dmitriev","year":"1974","journal-title":"Thoery of Probability and Its Applications"},{"issue":"2","key":"2026032712064661200_ref077","doi-asserted-by":"crossref","first-page":"146","DOI":"10.1109\/83.982822","article-title":"Wavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance","volume":"11","author":"Do","year":"2002","journal-title":"IEEE Transactions on Image Processing"},{"issue":"3","key":"2026032712064661200_ref078","doi-asserted-by":"crossref","first-page":"739","DOI":"10.1111\/j.2517-6161.1992.tb01447.x","article-title":"Testing exponentiality based on Kullback-Leibler information","volume":"54","author":"Ebrahimi","year":"1992","journal-title":"Journal of the Royal Statistical Society. Series B (Methodological)"},{"key":"2026032712064661200_ref079","volume-title":"Information Theory in Analytical Chemistry","author":"Eckschlager","year":"1994"},{"issue":"3","key":"2026032712064661200_ref080","doi-asserted-by":"crossref","first-page":"497","DOI":"10.2307\/2339343","article-title":"The generalised law of error, or law of great numbers","volume":"69","author":"Edgeworth","year":"1906","journal-title":"Journal of the Royal Statistical Society"},{"key":"2026032712064661200_ref081","volume-title":"Protein Bioinformatics: An Algorithmic Approach to Sequence and Structure","author":"Eidhammer","year":"2004"},{"key":"2026032712064661200_ref082","doi-asserted-by":"crossref","first-page":"1518","DOI":"10.1109\/TIT.2002.1003838","article-title":"Hidden Markov process","volume":"48","author":"Ephraim","year":"2002","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref083","doi-asserted-by":"crossref","DOI":"10.1007\/b137845","volume-title":"Statistical Methods in Bioinformatics: An Introduction","author":"Ewens","year":"2005"},{"key":"2026032712064661200_ref084","first-page":"755","article-title":"Shape and radiance estimation from the information divergence of blurred images","volume-title":"Proceedings of the 6th European Conference on Computer Vision \u2014 Part I","author":"Favaro","year":"2000"},{"issue":"6","key":"2026032712064661200_ref085","doi-asserted-by":"crossref","first-page":"1491","DOI":"10.1109\/TIT.2003.811927","article-title":"Refinements of Pinsker\u2019s inequality","volume":"49","author":"Fedotov","year":"2003","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref086","volume-title":"Nonparametric entropy-based tests of independence between stochastic processes","author":"Fernandes","year":"2000"},{"key":"2026032712064661200_ref087","doi-asserted-by":"crossref","DOI":"10.1037\/e471672008-001","article-title":"Discriminatory analysis, nonparametric discrimination: Consistency properties","volume-title":"USAF School of Aviation Medicine, Randolph Field, TX, USA, Technical Report 4, Project Number 21-49-004","author":"Fix","year":"1951"},{"issue":"2","key":"2026032712064661200_ref088","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevA.33.1134","article-title":"Independent coordinates or strange attractors from mutual information","volume":"33","author":"Fraser","year":"1986","journal-title":"Physical Review A"},{"issue":"5","key":"2026032712064661200_ref089","doi-asserted-by":"crossref","first-page":"320","DOI":"10.1109\/TIT.1973.1055003","article-title":"Optimization of k-nearest-neighbor density estimates","volume":"20","author":"Fukunaga","year":"1973","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref090","doi-asserted-by":"crossref","first-page":"750","DOI":"10.1109\/T-C.1975.224297","article-title":"A branch and bound algorithm for computing k-nearest neighbors","volume":"24","author":"Fukunaga","year":"1975","journal-title":"IEEE Transactions on Computers"},{"key":"2026032712064661200_ref091","doi-asserted-by":"crossref","first-page":"373","DOI":"10.1109\/TIT.1979.1056067","article-title":"Asymptotically optimal block quantization","volume":"25","author":"Gersho","year":"1979","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref092","doi-asserted-by":"crossref","first-page":"676","DOI":"10.1109\/TIT.1968.1054193","article-title":"Asymptotically efficient quantizing","volume":"14","author":"Gish","year":"1968","journal-title":"IEEE Transactions on Information Theory"},{"issue":"2","key":"2026032712064661200_ref093","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1109\/TIT.2003.821979","article-title":"Convergence of differential entropies","volume":"50","author":"Godavarti","year":"2004","journal-title":"IEEE Transactions on Information Theory"},{"issue":"2","key":"2026032712064661200_ref094","doi-asserted-by":"crossref","first-page":"158","DOI":"10.1109\/34.982897","article-title":"Information theoretic clustering","volume":"24","author":"Gokcay","year":"2002","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2026032712064661200_ref095","article-title":"Data Structures, Near Neighbor Searches, and Methodology: 5th and 6th DIMACS Implementation Challenge","volume-title":"American Mathematical Society","author":"Goldwasser","year":"2002"},{"issue":"3","key":"2026032712064661200_ref096","doi-asserted-by":"crossref","first-page":"277","DOI":"10.1080\/104852504200026815","article-title":"A new class of random vector entropy estimators and its applications in testing statistical hypotheses","volume":"17","author":"Goria","year":"2005","journal-title":"Journal of Nonparametric Statistics"},{"issue":"4","key":"2026032712064661200_ref097","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1111\/j.1467-9892.1994.tb00200.x","article-title":"Using the mutual information coefficient to identify lags in nonlinear models","volume":"15","author":"Granger","year":"1994","journal-title":"The Journal of Time Series Analysis"},{"key":"2026032712064661200_ref098","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1109\/18.720541","article-title":"Quantization","volume":"44","author":"Gray","year":"1998","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref099","first-page":"1011","volume-title":"Proceedings of 2006 IEEE International Symposium on Information Theory","author":"Guo","year":"2006"},{"key":"2026032712064661200_ref100","doi-asserted-by":"crossref","first-page":"717","DOI":"10.1088\/0954-898X_7_4_006","article-title":"Estimate of mutual information carried by neuronal responses from small data samples","volume":"7","author":"Gurzi","year":"1996","journal-title":"Network: Computation in Neural Systems"},{"key":"2026032712064661200_ref101","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4612-3686-3","volume-title":"Nonparametric Curve Estimation from Time Series","author":"Gy\u00f6rfi","year":"1989"},{"key":"2026032712064661200_ref102","first-page":"29","volume-title":"On the asymptotic optimality of quantizers","author":"Gy\u00f6rfi"},{"issue":"4","key":"2026032712064661200_ref103","doi-asserted-by":"crossref","first-page":"437","DOI":"10.1016\/0167-9473(92)90059-O","article-title":"Kernel density estimation from ergodic sample is not universally consistent","volume":"14","author":"Gy\u00f6rfi","year":"1992","journal-title":"Computational Statistics and Data Analysis"},{"issue":"2","key":"2026032712064661200_ref104","doi-asserted-by":"crossref","first-page":"886","DOI":"10.1109\/18.661540","article-title":"Limits to consistent on-line forecasting for ergodic time series","volume":"44","author":"Gy\u00f6rfi","year":"1998","journal-title":"IEEE Transactions on Information Theory"},{"issue":"4","key":"2026032712064661200_ref105","doi-asserted-by":"crossref","first-page":"425","DOI":"10.1016\/0167-9473(87)90065-X","article-title":"Density-free convergence properties of various estimators of entropy","volume":"5","author":"Gy\u00f6rfi","year":"1987","journal-title":"Computational Statistics and Data Analysis"},{"key":"2026032712064661200_ref106","doi-asserted-by":"crossref","first-page":"517","DOI":"10.1017\/S0305004100062459","article-title":"Limit theorems for sums of general functions of m-spacings","volume":"96","author":"Hall","year":"1984","journal-title":"Mathematical Proceedings of the Cambridge Philosophical Society"},{"key":"2026032712064661200_ref107","doi-asserted-by":"crossref","first-page":"1491","DOI":"10.1214\/aos\/1176350606","article-title":"On Kullback-Leibler loss and density estimation","volume":"15","author":"Hall","year":"1987","journal-title":"The Annals of Statistics"},{"key":"2026032712064661200_ref108","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/BF00773669","article-title":"On the estimation of the entropy","volume":"45","author":"Hall","year":"1993","journal-title":"The Annals of the Institute of Statistical Mathematics"},{"key":"2026032712064661200_ref109","first-page":"481","article-title":"Image registration with minimum spanning tree algorithm","volume":"1","author":"Hero","year":"2000","journal-title":"Proceedings of the 2000 International Conference on Image Processing"},{"issue":"5","key":"2026032712064661200_ref110","doi-asserted-by":"crossref","first-page":"85","DOI":"10.1109\/MSP.2002.1028355","article-title":"Applications of entropic spanning graphs","volume":"19","author":"Hero","year":"2003","journal-title":"Signal Processing Magazine"},{"key":"2026032712064661200_ref111","first-page":"250","volume-title":"Proceedings of Meeting of the International Society for Optical Engineering (SPIE)","author":"Hero","year":"1998"},{"key":"2026032712064661200_ref112","doi-asserted-by":"crossref","volume-title":"Estimation of R\u00e9nyi information divergence via pruned minimal spanning trees","author":"Hero","DOI":"10.1109\/HOST.1999.778739"},{"issue":"6","key":"2026032712064661200_ref113","doi-asserted-by":"crossref","first-page":"1921","DOI":"10.1109\/18.782114","article-title":"Asymptotic theory of greedy approximations to minimal k-point random graphs","volume":"45","author":"Hero","year":"1999","journal-title":"IEEE Transactions on Information Theory"},{"issue":"2","key":"2026032712064661200_ref114","doi-asserted-by":"crossref","first-page":"95","DOI":"10.1111\/1467-9892.00041","article-title":"Non-parametric estimation with strongly dependent time multivariate time series","volume":"18","author":"Hidalgo","year":"1997","journal-title":"Journal of Time Series Analysis"},{"key":"2026032712064661200_ref115","first-page":"506","article-title":"What is the nearest neighbor in high dimensional spaces?","author":"Hinneburg","year":"2000"},{"issue":"2","key":"2026032712064661200_ref116","doi-asserted-by":"crossref","first-page":"149","DOI":"10.1016\/0167-7152(94)00061-C","article-title":"On the strong uniform consistency of density estimation for strongly dependent sequences","volume":"22","author":"Ho","year":"1995","journal-title":"Statistics and Probability Letters"},{"key":"2026032712064661200_ref117","first-page":"273","volume-title":"Advances in Neural Information Processing System (NIPS\u201997)","author":"Hyv\u00e4rinen","year":"1998"},{"key":"2026032712064661200_ref118","doi-asserted-by":"crossref","DOI":"10.1002\/0471221317","volume-title":"Independent Component Analysis","author":"Hyv\u00e4rinen","year":"2001"},{"key":"2026032712064661200_ref119","doi-asserted-by":"crossref","first-page":"34","DOI":"10.1016\/S0019-9958(78)90413-8","article-title":"On the capacity of channels with additive non-Gaussian noise","volume":"37","author":"Ihara","year":"1978","journal-title":"Information and Control"},{"key":"2026032712064661200_ref120","doi-asserted-by":"crossref","first-page":"620","DOI":"10.1103\/PhysRev.106.620","article-title":"Information theory and statistical mechanics","volume":"106","author":"Jaynes","year":"1957","journal-title":"Physical Review"},{"key":"2026032712064661200_ref121","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1103\/PhysRev.108.171","article-title":"Information theory and statistical mechanics ii","volume":"108","author":"Jaynes","year":"1957","journal-title":"Physical Review"},{"key":"2026032712064661200_ref122","first-page":"181","author":"Jaynes","year":"1963"},{"key":"2026032712064661200_ref123","doi-asserted-by":"crossref","first-page":"523","DOI":"10.1109\/IJCNN.2003.1223401","article-title":"Clustering using R\u00e9nyi\u00e9s entropy","volume":"1","author":"Jenssen","year":"2003","journal-title":"Proceeding of the 2003 International Joint Conference on Neural Networks"},{"issue":"4","key":"2026032712064661200_ref124","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1007\/BF00057735","article-title":"On the estimation of entropy and other functionals of a multivariate density","volume":"41","author":"Joe","year":"1989","journal-title":"The Annals of the Institute of Statistical Mathematics"},{"issue":"405","key":"2026032712064661200_ref125","doi-asserted-by":"crossref","first-page":"171","DOI":"10.1080\/01621459.1989.10478751","article-title":"Relative entropy measures of multivariate dependence","volume":"84","author":"Joe","year":"1989","journal-title":"Journal of the American Statistical Association"},{"issue":"1","key":"2026032712064661200_ref126","doi-asserted-by":"crossref","first-page":"47","DOI":"10.1023\/A:1008968010214","article-title":"Information-theoretic analysis of neural coding","volume":"10","author":"Johnson","year":"2001","journal-title":"Journal of Computational Neuroscience"},{"key":"2026032712064661200_ref127","doi-asserted-by":"crossref","first-page":"1","DOI":"10.2307\/2981662","article-title":"What is projection pursuit?","volume":"150","author":"Jones","year":"1987","journal-title":"Journal of the Royal Statistical Society. Series A"},{"key":"2026032712064661200_ref128","doi-asserted-by":"crossref","first-page":"391","DOI":"10.1002\/j.1538-7305.1985.tb00439.x","article-title":"A probabilistic distance measure for hidden Markov models","volume":"64","author":"Juang","year":"1985","journal-title":"AT&T Technical Journal"},{"key":"2026032712064661200_ref129","first-page":"2255","article-title":"Algorithms for estimating information distance with application to bioinformatics and linguistics","volume":"4","author":"Kaltchenko","year":"2004","journal-title":"Proceedings of Canadian Conference on Electrical and Computer Engineering"},{"issue":"5","key":"2026032712064661200_ref130","doi-asserted-by":"crossref","first-page":"950","DOI":"10.1109\/TAC.1980.1102475","article-title":"Spectral distance measures between Gaussian processes","volume":"25","author":"Kazakos","year":"1980","journal-title":"IEEE Transactions on Automatic control"},{"key":"2026032712064661200_ref131","first-page":"62","article-title":"Incorporating spatial priors into an information theoretic approach for fMRI data analysis","author":"Kim","year":"2000","journal-title":"Proceedings of the 3rd International Conference on Medical Image Computing and Computer-Assisted Intervention"},{"key":"2026032712064661200_ref132","first-page":"133","article-title":"Boosting as entropy projection","volume-title":"Proceedings of the 12th Annual Conference on Computational Learning Theory","author":"Kivinen","year":"1999"},{"key":"2026032712064661200_ref133","first-page":"738","article-title":"On the use of mutual information in data analysis: an overview","author":"Kojadinovic","year":"2005","journal-title":"Proceedings of 11th International Symposium on Applied Stochastic Models and Data Analysis (ASMDA\u201905)"},{"issue":"3","key":"2026032712064661200_ref134","doi-asserted-by":"crossref","first-page":"1319","DOI":"10.1109\/18.669425","article-title":"Nonparametric entropy estimation for stationary processes and random fields, with applications to English text","volume":"44","author":"Kontoyiannis","year":"1998","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref135","first-page":"95","article-title":"Sample estimate of the entropy of a random vector","volume":"23","author":"Kozachenko","year":"1987","journal-title":"Problems of Information Transmission"},{"issue":"2","key":"2026032712064661200_ref136","doi-asserted-by":"crossref","first-page":"278","DOI":"10.1209\/epl\/i2004-10483-y","article-title":"Hierarchical clustering using mutual information","volume":"70","author":"Kraskov","year":"2005","journal-title":"Europhysics Letters"},{"key":"2026032712064661200_ref137","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Physical Review E"},{"key":"2026032712064661200_ref138","article-title":"Ecological Methodology","volume-title":"Addison Wesley Longman","author":"Krebs","year":"1999"},{"issue":"2","key":"2026032712064661200_ref139","doi-asserted-by":"crossref","first-page":"199","DOI":"10.1109\/TIT.1981.1056331","article-title":"The performance of universal encoding","volume":"27","author":"Krichevsky","year":"1981","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref140","article-title":"On stationarity in internet measurements through an information-theoretic lens","volume-title":"Proceedings of the 1st IEEE Workshop on Networking and Database","author":"Krishnamurthy","year":"2000"},{"issue":"10","key":"2026032712064661200_ref141","doi-asserted-by":"crossref","first-page":"2785","DOI":"10.1109\/TIT.2002.802611","article-title":"Data-dependent kn-nn and kernel estimators consistent for arbitrary processes","volume":"48","author":"Kulkarni","year":"2002","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref142","volume-title":"Information Theory and Statistics","author":"Kullback","year":"1959"},{"issue":"1","key":"2026032712064661200_ref143","doi-asserted-by":"crossref","first-page":"126","DOI":"10.1109\/TIT.1967.1053968","article-title":"A lower bound for discrimination information in terms of variation (corresp.)","volume":"13","author":"Kullback","year":"1967","journal-title":"IEEE Transactions on Information Theory"},{"issue":"1","key":"2026032712064661200_ref144","doi-asserted-by":"crossref","first-page":"79","DOI":"10.1214\/aoms\/1177729694","article-title":"On information and sufficiency","volume":"22","author":"Kullback","year":"1951","journal-title":"The Annals of Mathematical Statistics"},{"issue":"12","key":"2026032712064661200_ref145","doi-asserted-by":"crossref","DOI":"10.1109\/TPAMI.2002.1114861","article-title":"Input feature selection by mutual information based on Parzen window","volume":"24","author":"Kwak","year":"2002","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"2026032712064661200_ref146","doi-asserted-by":"crossref","first-page":"1779","DOI":"10.1109\/ICIP.2004.1421419","article-title":"High-dimensional mutual information estimation for image registration","volume":"3","author":"Kybic","year":"2004","journal-title":"Proceedings of the 2004 International Conference on Image Processing (ICIP \u201904)"},{"issue":"5","key":"2026032712064661200_ref147","doi-asserted-by":"crossref","first-page":"23","DOI":"10.1063\/1.881299","article-title":"Information is physical","volume":"44","author":"Landauer","year":"1991","journal-title":"Physics Today"},{"issue":"1","key":"2026032712064661200_ref148","doi-asserted-by":"crossref","first-page":"120","DOI":"10.1109\/TIT.1978.1055832","article-title":"On the entropy of continuous probability distributions (corresp.)","volume":"24","author":"Lazo","year":"1978","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref149","first-page":"04","article-title":"Hyperspacings and the estimation of information theoretic quantities","volume-title":"UMass Amherst, Technical Report","author":"Learned-Miller","year":"2004"},{"key":"2026032712064661200_ref150","volume-title":"Maxwells Demon: Entropy, Information, Computing","author":"Leff","year":"2002"},{"key":"2026032712064661200_ref151","volume-title":"Edgeworth expansions of the Kullback-Leibler information","author":"Lin","year":"1999"},{"issue":"18","key":"2026032712064661200_ref152","doi-asserted-by":"crossref","first-page":"I\u2013587","DOI":"10.1109\/CVPR.2003.1211407","article-title":"Kullback-Leibler boosting","volume":"1","author":"Liu","year":"2003","journal-title":"Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition"},{"issue":"11","key":"2026032712064661200_ref153","doi-asserted-by":"crossref","first-page":"1647","DOI":"10.1109\/83.967393","article-title":"Information-theoretic analysis of interscale and intrascale dependencies between image wavelet coefficients","volume":"10","author":"Liu","year":"2001","journal-title":"IEEE Transactions on Image Processing"},{"issue":"3","key":"2026032712064661200_ref154","doi-asserted-by":"crossref","first-page":"1049","DOI":"10.1214\/aoms\/1177700079","article-title":"A nonparametric estimate of a multivariate density function","volume":"36","author":"Loftsgaarden","year":"1965","journal-title":"The Annals of Mathematical Statistics"},{"key":"2026032712064661200_ref155","first-page":"745","article-title":"A music similarity function based on signal analysis","author":"Logan","year":"2001","journal-title":"IEEE International Conference on Multimedia and Expo"},{"key":"2026032712064661200_ref156","doi-asserted-by":"crossref","first-page":"533","DOI":"10.1109\/CVPR.2005.187","article-title":"Infomax boosting","volume":"1","author":"Lyu","year":"2005","journal-title":"Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition"},{"key":"2026032712064661200_ref157","volume-title":"Parametric and non-parametric approaches for multisensor data fusion","author":"Ma","year":"2001"},{"issue":"7","key":"2026032712064661200_ref158","doi-asserted-by":"crossref","first-page":"2317","DOI":"10.1109\/TIT.2007.899484","article-title":"Generalized entropy power inequalities and monotonicity properties of information","volume":"53","author":"Madiman","year":"2007","journal-title":"IEEE Transactions on Information Theory"},{"issue":"7","key":"2026032712064661200_ref159","doi-asserted-by":"crossref","first-page":"2317","DOI":"10.1109\/TIT.2007.899484","article-title":"Generalized entropy power inequalities and monotonicity properties of information","volume":"53","author":"Madiman","year":"2007","journal-title":"IEEE Transactions on Information Theory"},{"issue":"10","key":"2026032712064661200_ref160","doi-asserted-by":"crossref","first-page":"1699","DOI":"10.1109\/JPROC.2003.817864","article-title":"Medical image registration using mutual information","volume":"91","author":"Maes","year":"2003","journal-title":"Proceedings of the IEEE"},{"issue":"3","key":"2026032712064661200_ref161","doi-asserted-by":"crossref","first-page":"619","DOI":"10.1109\/TASSP.1981.1163571","article-title":"Time delay estimation in non-linear systems","volume":"20","author":"Mars","year":"1981","journal-title":"IEEE Transactions on Acoustics, Speech and Signal Processing"},{"issue":"2\u20133","key":"2026032712064661200_ref162","doi-asserted-by":"crossref","first-page":"139","DOI":"10.1016\/0165-1684(82)90017-2","article-title":"Time delay estimation in non-linear systems using average amount of mutual information analysis","volume":"4","author":"Mars","year":"1982","journal-title":"Signal Processing"},{"key":"2026032712064661200_ref163","first-page":"133","article-title":"Texture similarity measure using Kullback-Leibler divergence between Gamma distributions","volume-title":"Proceedings of the 7th European Conference on Computer Vision \u2014 Part III","author":"Mathiassen","year":"2002"},{"key":"2026032712064661200_ref164","first-page":"17","volume-title":"Interactive Image-Guided Neurosurgery","author":"Maurer","year":"1993"},{"issue":"3","key":"2026032712064661200_ref165","doi-asserted-by":"crossref","first-page":"733","DOI":"10.1109\/18.256484","article-title":"Secret key agreement by public discussion","volume":"39","author":"Maurer","year":"1993","journal-title":"IEEE Transactions on Information Theory"},{"issue":"2","key":"2026032712064661200_ref166","doi-asserted-by":"crossref","first-page":"329","DOI":"10.1006\/jmva.1995.1060","article-title":"Divergence-based estimation and testing of statistical models of classification","volume":"54","author":"Menendez","year":"1995","journal-title":"Journal of Multivariate Analysis"},{"key":"2026032712064661200_ref167","doi-asserted-by":"crossref","first-page":"1401","DOI":"10.1109\/18.243456","article-title":"Kullback-Leibler information measure for studying convergence rates of densities and distributions","volume":"39","author":"Meyer","year":"1993","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref168","first-page":"42","article-title":"Cluster analysis and data visualization","volume":"3","author":"Michaels","year":"1989","journal-title":"Proceedings of Pacific Symposium Biocomputing"},{"key":"2026032712064661200_ref169","first-page":"297","article-title":"A new class of entropy estimators for multi-dimensional densities","volume":"3","author":"Miller","year":"2003","journal-title":"Proceedings of 2003 IEEE International Conference on Acoustics, Speech and Signal (ICASSP\u201903)"},{"issue":"3","key":"2026032712064661200_ref170","doi-asserted-by":"crossref","first-page":"233","DOI":"10.1016\/0165-1684(89)90132-1","article-title":"On estimation of entropy and mutual information of continuous distributions","volume":"16","author":"Moddemeijer","year":"1989","journal-title":"Signal Processing"},{"issue":"1","key":"2026032712064661200_ref171","doi-asserted-by":"crossref","first-page":"51","DOI":"10.1016\/S0165-1684(98)00224-2","article-title":"A statistic to estimate the variance of the histogram based mutual information estimator based on dependent pairs of observations","volume":"75","author":"Moddemeijer","year":"1999","journal-title":"Signal Processing"},{"issue":"1","key":"2026032712064661200_ref172","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1109\/18.42194","article-title":"Estimation of the entropy and information of absolutely continuous random variables","volume":"35","author":"Mokkadem","year":"1989","journal-title":"IEEE Transactions on Information Theory"},{"issue":"3","key":"2026032712064661200_ref173","doi-asserted-by":"crossref","first-page":"2318","DOI":"10.1103\/PhysRevE.52.2318","article-title":"Estimation of mutual information using kernel density estimators","volume":"52","author":"Moon","year":"1995","journal-title":"Physical Review E"},{"key":"2026032712064661200_ref174","volume-title":"A Kullback-Leibler divergence based kernel for SVM classification in multimedia applications","author":"Moreno","year":"2004"},{"key":"2026032712064661200_ref175","doi-asserted-by":"crossref","DOI":"10.1109\/ICASSP.2000.859329","volume-title":"Using the Fisher kernel method for web audio classification","author":"Moreno","year":"2000"},{"key":"2026032712064661200_ref176","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevE.69.056111","article-title":"Entropy and information in neural spike trains: Progress on the sampling problem","volume":"69","author":"Nemenman","year":"2004","journal-title":"Physical Review E"},{"key":"2026032712064661200_ref177","volume-title":"Advances in Neural Information Processing Systems","author":"Nemenman","year":"2002"},{"issue":"2","key":"2026032712064661200_ref178","doi-asserted-by":"crossref","first-page":"461","DOI":"10.1109\/18.485716","article-title":"On the asymptotic distribution of the errors in vector quantization","volume":"42","author":"Neuhoff","year":"1996","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref179","volume-title":"Divergence Measures, Surrogate Loss Functions and Experimental Design,\u201d in NIPS","author":"Nguyen","year":"2005"},{"issue":"7","key":"2026032712064661200_ref180","doi-asserted-by":"crossref","first-page":"2330","DOI":"10.1109\/TIT.2007.899533","article-title":"On the estimation of differential entropy from data located on embedded manifolds","volume":"53","author":"Nilsson","year":"1996","journal-title":"IEEE Transactions on Information Theory"},{"issue":"1","key":"2026032712064661200_ref181","doi-asserted-by":"crossref","first-page":"262","DOI":"10.1214\/aos\/1018031110","article-title":"Limits to classification and regression estimation from ergodic processes","volume":"27","author":"Nobel","year":"1999","journal-title":"The Annals of Statistics"},{"key":"2026032712064661200_ref182","article-title":"Spatial Tessellations: Concepts and Applications of Voronoi Diagrams","volume-title":"Wiley Series in Probability and Statistics","author":"Okabe","year":"1992","edition":"Second"},{"key":"2026032712064661200_ref183","article-title":"Csisz\u00e1r\u2019s f-divergences \u2014 basic properties","volume-title":"Austria","author":"Osterreicher","year":"2002"},{"issue":"6","key":"2026032712064661200_ref184","doi-asserted-by":"crossref","first-page":"1191","DOI":"10.1162\/089976603321780272","article-title":"Estimation of entropy and mutual information","volume":"15","author":"Paninski","year":"2003","journal-title":"Neural Computation"},{"key":"2026032712064661200_ref185","doi-asserted-by":"crossref","first-page":"44","DOI":"10.1109\/JRPROC.1951.230419","article-title":"Quantization in pulse-count modulation with nonuniform spacing of levels","volume":"39","author":"Panter","year":"1951","journal-title":"Proceedings of IRE"},{"key":"2026032712064661200_ref186","doi-asserted-by":"crossref","first-page":"87","DOI":"10.1080\/0954898X.1996.11978656","article-title":"Analytical estimates of limited sampling biases in different information measures","volume":"7","author":"Panzeri","year":"1996","journal-title":"Network: Computation in Neural Systems"},{"issue":"3","key":"2026032712064661200_ref187","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.1214\/aoms\/1177704472","article-title":"On estimation of a probability density function and mode","volume":"33","author":"Parzen","year":"1962","journal-title":"The Annals of Mathematical Statistics"},{"key":"2026032712064661200_ref188","unstructured":"W. D.\n              Penny\n            \n          , \u201cKL-divergences of Normal, Gamma, Dirichlet and Wishart densities,\u201d Wellcome department of cognitive neurology, University College London, Technical Report, March 2001. [Online]. Available: www.fil.ion.ucl.ac.uk\/wpenny\/publications\/densities.ps."},{"key":"2026032712064661200_ref189","first-page":"405","article-title":"Sensitivity of channel capacity","volume":"33","author":"Pinsker","year":"1989","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref190","article-title":"Information and Information Stability of Random Variables and Processes","volume-title":"Izd. Akad. Nauk, 1960, translated by A. Feinstein","author":"Pinsker","year":"1964"},{"key":"2026032712064661200_ref191","first-page":"579","article-title":"f-information measures in medical image registration","volume":"4322","author":"Pluim","year":"2001","journal-title":"Proceedings of the Meeting of the International Society Optical Engineering (SPIE)"},{"issue":"8","key":"2026032712064661200_ref192","doi-asserted-by":"crossref","first-page":"986","DOI":"10.1109\/TMI.2003.815867","article-title":"Mutual information based registration of medical images: A survey","volume":"22","author":"Pluim","year":"2003","journal-title":"IEEE Transactions on Medical Imaging"},{"issue":"9","key":"2026032712064661200_ref193","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1109\/TCOM.1977.1093935","article-title":"Applications of Ali-Silvey distance measures in the design of generalized quantizers for binary decision systems","volume":"25","author":"Poor","year":"1977","journal-title":"IEEE Transactions on Communications"},{"key":"2026032712064661200_ref194","first-page":"31","article-title":"Asymptotic behavior of a continuous channel with small additive noise","volume":"4","author":"Prelov","year":"1968","journal-title":"Problems of Information and Transmission"},{"key":"2026032712064661200_ref195","first-page":"40","article-title":"Asymptotic behavior of the capacity of a continuous channel with a large amount of noise","volume":"6","author":"Prelov","year":"1970","journal-title":"Problemy Peredachi Informastsii"},{"key":"2026032712064661200_ref196","doi-asserted-by":"crossref","first-page":"405","DOI":"10.1137\/1133068","article-title":"Communication channel capacity with almost Gaussian noise","volume":"33","author":"Prelov","year":"1989","journal-title":"Theory of Probability and its Applications"},{"issue":"6","key":"2026032712064661200_ref197","doi-asserted-by":"crossref","first-page":"8380","DOI":"10.1103\/PhysRevE.62.8380","article-title":"Kullback-Leibler and renormalized entropies: Applications to electroencephalograms of epilepsy patients","volume":"62","author":"Quiroga","year":"2000","journal-title":"Physical Review E"},{"key":"2026032712064661200_ref198","volume-title":"Nonparametric Functional Estimation","author":"Rao","year":"1983"},{"issue":"1\u20132","key":"2026032712064661200_ref199","doi-asserted-by":"crossref","first-page":"193","DOI":"10.1007\/BF02063299","article-title":"On the dimension and entropy of probability distributions","volume":"10","author":"R\u00e9nyi","year":"1959","journal-title":"Acta Mathematica Academiac Scientiarum Hungaricae"},{"key":"2026032712064661200_ref200","first-page":"547","article-title":"On measures of entropy and information","volume":"1","author":"R\u00e9nyi","year":"1961","journal-title":"Proceedings of the 4th Berkeley Symposium on Mathematics, Statistics and Probability"},{"key":"2026032712064661200_ref201","volume-title":"Spikes: Exploring the Neural Code","author":"Rieke","year":"1999"},{"issue":"3","key":"2026032712064661200_ref202","doi-asserted-by":"crossref","first-page":"437","DOI":"10.2307\/2298005","article-title":"Consistent nonparametric entropy-based testing","volume":"58","author":"Robinson","year":"1991","journal-title":"The Review of Economic Studies, Special Issue: The Econometrics of Financial Markets"},{"key":"2026032712064661200_ref203","doi-asserted-by":"crossref","first-page":"751","DOI":"10.1109\/TIT.1986.1057231","article-title":"Large sample properties of maximum entropy histograms","volume":"32","author":"Rodrigez","year":"1986","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref204","doi-asserted-by":"crossref","first-page":"43","DOI":"10.1073\/pnas.42.1.43","article-title":"A central limit theorem and a strong mixing condition","volume":"42","author":"Rosenblatt","year":"1956","journal-title":"Proceedings of the National Academy of Sciences of the United States of America"},{"issue":"3","key":"2026032712064661200_ref205","doi-asserted-by":"crossref","first-page":"832","DOI":"10.1214\/aoms\/1177728190","article-title":"Remarks on some nonparametric estimates of a density function","volume":"27","author":"Rosenblatt","year":"1956","journal-title":"The Annals of Mathematical Statistics"},{"key":"2026032712064661200_ref206","first-page":"199","volume-title":"Nonparametric Techniques in Statistical Inference","author":"Rosenblatt","year":"1970"},{"issue":"1","key":"2026032712064661200_ref207","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1007\/BF02532233","article-title":"Nonparametric estimation in Markov processes","volume":"21","author":"Roussas","year":"1969","journal-title":"Annals of the Institute of Statistical Mathematics"},{"issue":"4","key":"2026032712064661200_ref208","doi-asserted-by":"crossref","first-page":"1386","DOI":"10.1214\/aoms\/1177697510","article-title":"Nonparametric estimation of the transition distribution function of a Markov process","volume":"40","author":"Roussas","year":"1969","journal-title":"Annals of Mathematical Statistics"},{"key":"2026032712064661200_ref209","doi-asserted-by":"crossref","DOI":"10.1007\/978-3-540-39701-4_14","article-title":"Spatial information in entropy based image registration","volume-title":"Proceedings of the 2003 International Workshop on Biomedical Image Registration","author":"Sabuncu","year":"2003"},{"issue":"5","key":"2026032712064661200_ref210","doi-asserted-by":"crossref","first-page":"788","DOI":"10.1109\/TIP.2008.918951","article-title":"Using spanning graphs for efficient image registration","volume":"17","author":"Sabuncu","year":"2008","journal-title":"IEEE Transactions on Image Processing"},{"issue":"6","key":"2026032712064661200_ref211","doi-asserted-by":"crossref","first-page":"1149","DOI":"10.1016\/j.patcog.2003.10.008","article-title":"A thresholding method based on two dimensional R\u2019nyi\u2019s entropy","volume":"37","author":"Sahoo","year":"2004","journal-title":"Pattern Recognition"},{"key":"2026032712064661200_ref212","first-page":"102","article-title":"Use of information theory in molecular biology","volume-title":"Proceedings of 1992 Workshop on Physics and Computation (PhysComp \u201992)","author":"Schneider","year":"1992"},{"key":"2026032712064661200_ref213","first-page":"197","volume-title":"Advances in Neural Information Processing","author":"Schneidman","year":"2003"},{"key":"2026032712064661200_ref214","doi-asserted-by":"crossref","DOI":"10.1007\/978-1-4020-2834-2","volume-title":"The New Avenues in Bioinformatics","author":"Seckbach","year":"2004"},{"key":"2026032712064661200_ref215","first-page":"851","article-title":"Face recognition from longterm observations","volume-title":"Proceedings of the 7th European Conference on Computer Vision \u2014 Part III","author":"Shakhnarovich","year":"2002"},{"key":"2026032712064661200_ref216","first-page":"379","article-title":"A mathematical theory of communication","volume-title":"Bell System Technical Journal","author":"Shannon","year":"1948"},{"issue":"1","key":"2026032712064661200_ref217","doi-asserted-by":"crossref","first-page":"50","DOI":"10.1002\/j.1538-7305.1951.tb01366.x","article-title":"Prediction and entropy of printed English","volume":"30","author":"Shannon","year":"1951","journal-title":"Bell System Technical Journal"},{"issue":"6","key":"2026032712064661200_ref218","doi-asserted-by":"crossref","first-page":"2079","DOI":"10.1109\/18.720532","article-title":"The interactions between ergodic theory and information theory","volume":"44","author":"Shields","year":"1998","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref219","doi-asserted-by":"crossref","first-page":"26","DOI":"10.1109\/TIT.1980.1056144","article-title":"Axiomatic derivation of the principle of maximum entropy and the principle of minimum cross-entropy","volume":"26","author":"Shore","year":"1980","journal-title":"IEEE Transactions on Information Theory"},{"issue":"348","key":"2026032712064661200_ref220","doi-asserted-by":"crossref","first-page":"948","DOI":"10.1080\/01621459.1974.10480234","article-title":"Linear discriminant functions for stationary time series","volume":"69","author":"Shumway","year":"1974","journal-title":"Journal of the American Statistical Association"},{"key":"2026032712064661200_ref221","doi-asserted-by":"crossref","first-page":"890","DOI":"10.1109\/TSA.2005.858059","article-title":"Average divergence distance as a statistical discrimination measure for hidden Markov models","volume":"14","author":"Silva","year":"2006","journal-title":"IEEE Transactions on Audio, Speech, and Language Processing"},{"key":"2026032712064661200_ref222","first-page":"2299","article-title":"Upper bound Kullback-Leibler divergence for hidden Markov models with application as discrimination measure for speech recognition","volume-title":"Proceedings of 2006 International Symposium on Information Theory (ISIT 2006)","author":"Silva","year":"2006"},{"key":"2026032712064661200_ref223","doi-asserted-by":"crossref","DOI":"10.1109\/ISIT.2007.4557518","article-title":"Universal consistency of data-driven partitions for divergence estimation","volume-title":"Proceedings of 2007 IEEE International Symposium on Information Theory (ISIT2007)","author":"Silva","year":"2007"},{"key":"2026032712064661200_ref224","volume-title":"Density Estimation for Statistics and Data Analysis","author":"Silverman","year":"1986"},{"key":"2026032712064661200_ref225","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1007\/978-1-4899-4515-0_15","volume-title":"Developments in Time Series Analysis","author":"Skaug","year":"1993"},{"key":"2026032712064661200_ref226","volume-title":"Athens Conference on Applied Probability and Time Series","author":"Skaug","year":"1996"},{"key":"2026032712064661200_ref227","doi-asserted-by":"crossref","first-page":"843","DOI":"10.1109\/42.938252","article-title":"A bound on mutual information for image registration","volume":"20","author":"Skouson","year":"1987","journal-title":"IEEE Transactions on Medical Imaging"},{"key":"2026032712064661200_ref228","unstructured":"N.\n              Slonim\n            , G. S.Atwal, G.Tkacik, and W.Bialek, \u201cEstimating mutual information and multi-information in large networks,\u201d [Online]. Available: http:\/\/arxiv.org\/abs\/cs.IT\/0502017, 2005."},{"key":"2026032712064661200_ref229","doi-asserted-by":"crossref","first-page":"101","DOI":"10.1016\/S0019-9958(59)90348-1","article-title":"Some inequalities satisfied by the quantities of information of Fisher and Shannon","volume":"2","author":"Stam","year":"1959","journal-title":"Information and Control"},{"key":"2026032712064661200_ref230","doi-asserted-by":"crossref","first-page":"S231","DOI":"10.1093\/bioinformatics\/18.suppl_2.S231","article-title":"The mutual information: Detecting and evaluating dependencies between variables","volume":"18","author":"Steuer","year":"2002","journal-title":"Bioinformatics"},{"key":"2026032712064661200_ref231","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevE.70.066123","article-title":"Leastdependent-component analysis based on mutual information","volume":"70","author":"St\u00f6gbauer","year":"2004","journal-title":"Physical Review E"},{"issue":"1","key":"2026032712064661200_ref232","doi-asserted-by":"crossref","first-page":"197","DOI":"10.1103\/PhysRevLett.80.197","article-title":"Entropy and information in neural spike trains","volume":"80","author":"Strong","year":"1998","journal-title":"Physical Review Letter"},{"key":"2026032712064661200_ref233","doi-asserted-by":"crossref","first-page":"2052","DOI":"10.1109\/PROC.1968.6784","article-title":"On the evaluation of an unknown probability density function, the direct estimation of the entropy from independent observations of a continuous random variable and the distribution-free entropy test of goodness-of-fit","volume":"56","author":"Tarasenko","year":"1968","journal-title":"Proccedings of IEEE"},{"key":"2026032712064661200_ref234","first-page":"517","article-title":"MRI tissue classification with neighborhood statistics: A nonparametric, entropy-minimizing approach","volume":"3750","author":"Tasdizen","year":"2005","journal-title":"Proceedings of the 2005 International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI2005)"},{"key":"2026032712064661200_ref235","first-page":"145","article-title":"The entropy of the maximum entropy distribution","volume-title":"Economic Letters","author":"Theil","year":"1980"},{"key":"2026032712064661200_ref236","volume-title":"Exploiting Continuity: Maximum Entropy Estimation of Continuous Distributions","author":"Theil","year":"1984"},{"key":"2026032712064661200_ref237","doi-asserted-by":"crossref","first-page":"249","DOI":"10.1080\/02331889708802564","article-title":"Measures and tests of independence: A survey","volume":"28","author":"Tj\u00f8stheim,","year":"1996","journal-title":"Statistics"},{"issue":"4","key":"2026032712064661200_ref238","doi-asserted-by":"crossref","first-page":"1602","DOI":"10.1109\/18.850703","article-title":"Some inequalities for information divergence and related measures of discrimination","volume":"46","author":"Tops\u00f8e,","year":"2000","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref239","first-page":"1415","article-title":"Feature extraction by nonparametric mutual information maximization","volume":"3","author":"Torkkola","year":"2003","journal-title":"Journal of Machine Learning Research"},{"key":"2026032712064661200_ref240","first-page":"473","article-title":"Analysis of functional MRI data using mutual information","volume-title":"Proceedings of the 2nd International Conference on Medical Image Computing and Computer-Assisted Intervention","author":"Tsai","year":"1999"},{"issue":"4","key":"2026032712064661200_ref241","doi-asserted-by":"crossref","first-page":"429","DOI":"10.1016\/j.media.2004.01.003","article-title":"Mutual information in coupled multi-shape model for medical image segmentation","volume":"8","author":"Tsai","year":"2004","journal-title":"Medical Image Analysis"},{"key":"2026032712064661200_ref242","article-title":"Root-n consistent estimators of entropy for densities with unbounded support","author":"Tsybakov","year":"1992"},{"key":"2026032712064661200_ref243","first-page":"75","article-title":"Root-n consistent estimators of entropy for densities with unbounded support","volume":"23","author":"Tsybakov","year":"1996","journal-title":"Scandinavian Journal of Statistics"},{"issue":"9","key":"2026032712064661200_ref244","doi-asserted-by":"crossref","first-page":"4295","DOI":"10.1109\/TIT.2006.880066","article-title":"Monotonic decrease of the non-Gaussianness of the sum of independent random variables: A simple proof","volume":"52","author":"Tulino","year":"2006","journal-title":"IEEE Transactions on Information Theory"},{"issue":"6","key":"2026032712064661200_ref245","doi-asserted-by":"crossref","first-page":"771","DOI":"10.1109\/TIT.1970.1054557","article-title":"Note on discrimination information and variation","volume":"16","author":"Vajda","year":"1970","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref246","doi-asserted-by":"crossref","first-page":"223","DOI":"10.1007\/BF02018663","article-title":"On the f-divergence and singularity of probability measures","volume":"2","author":"Vajda","year":"1972","journal-title":"Periudicu Mathematica Hiingarrricu"},{"key":"2026032712064661200_ref247","volume-title":"Theory of Statistical Inference and Information","author":"Vajda","year":"1989"},{"key":"2026032712064661200_ref248","first-page":"26","article-title":"Medical image matching \u2013 A review with classification","volume-title":"IEEE Engineering in Medicine and Biology Magazine","author":"van den Elsen","year":"1993"},{"key":"2026032712064661200_ref249","first-page":"61","article-title":"Estimating functionals related to a density by a class of statistics based on spacings","volume":"19","author":"Van Es,","year":"1992","journal-title":"Scandinavian Journal of Statistics"},{"key":"2026032712064661200_ref250","doi-asserted-by":"crossref","first-page":"1903","DOI":"10.1162\/0899766054323026","article-title":"Edgeworth approximation of multivariate differential entropy","volume":"17","author":"Van Hulle","year":"2005","journal-title":"Neural Computation"},{"key":"2026032712064661200_ref251","article-title":"The Nature of Statistical Learning Theory","volume-title":"Springer-Verlag","author":"Vapnik","year":"1999"},{"key":"2026032712064661200_ref252","doi-asserted-by":"crossref","first-page":"430","DOI":"10.1007\/978-3-540-24672-5_34","article-title":"The Kullback-Leibler kernel as a framework for discriminant and localized representations for visual recognition","volume-title":"Proceedings of 2004 European Conference on Computer Vision (ECCV 2004)","author":"Vasconcelos","year":"2004"},{"issue":"1","key":"2026032712064661200_ref253","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/j.2517-6161.1976.tb01566.x","article-title":"A test for normality based on sample entropy","volume":"38","author":"Vasicek","year":"1976","journal-title":"Journal of the Royal Statistical Society, Series B"},{"key":"2026032712064661200_ref254","article-title":"Lectures notes on information theory","volume-title":"unpublished","author":"Verd\u00fa"},{"key":"2026032712064661200_ref255","doi-asserted-by":"crossref","first-page":"2057","DOI":"10.1109\/18.720531","article-title":"Fifty years of Shannon theory","volume":"44","author":"Verd\u00fa","year":"1998","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref256","volume-title":"Multiuser Detection","author":"Verd\u00fa","year":"1998"},{"key":"2026032712064661200_ref257","doi-asserted-by":"crossref","DOI":"10.1103\/PhysRevE.66.051903","article-title":"Binless strategies for estimation of information from neural data","volume":"66","author":"Victor","year":"2002","journal-title":"Physical Review E"},{"issue":"2","key":"2026032712064661200_ref258","doi-asserted-by":"crossref","first-page":"117","DOI":"10.1214\/aoms\/1177731118","article-title":"Sequential tests of statistical hypotheses","volume":"16","author":"Wald","year":"1945","journal-title":"Annals of Mathematical Statistics"},{"issue":"3","key":"2026032712064661200_ref259","doi-asserted-by":"crossref","first-page":"635","DOI":"10.1214\/aoms\/1177706528","article-title":"Asymptotic approximations to distributions","volume":"29","author":"Wallace","year":"1958","journal-title":"The Annals of Mathematical Statistics"},{"issue":"9","key":"2026032712064661200_ref260","doi-asserted-by":"crossref","first-page":"3064","DOI":"10.1109\/TIT.2005.853314","article-title":"Divergence estimation of continuous distributions based on data-dependent partitions","volume":"51","author":"Wang","year":"2005","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref261","doi-asserted-by":"crossref","DOI":"10.1109\/ISIT.2006.261842","article-title":"A nearest-neighbor approach to estimating divergence between continuous random vectors","volume-title":"Proceedings of 2006 IEEE International Symposium on Information Theory (ISIT2006)","author":"Wang","year":"2006"},{"issue":"5","key":"2026032712064661200_ref262","doi-asserted-by":"crossref","first-page":"2392","DOI":"10.1109\/TIT.2009.2016060","article-title":"Divergence estimation for multi-dimensional distributions via k-nearest-neighbor distances","volume":"55","author":"Wang","year":"2009","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref263","volume-title":"Cybernetics: Control and Communication in the Animal and the Machine","author":"Wiener","year":"1948"},{"key":"2026032712064661200_ref264","doi-asserted-by":"crossref","first-page":"364","DOI":"10.1109\/TIFS.2007.902666","article-title":"Channel identification: Secret sharing using reciprocity in ultrawideband channels","volume":"2","author":"Wilson","year":"2007","journal-title":"IEEE Transactions on Information Forensics and Security"},{"key":"2026032712064661200_ref265","doi-asserted-by":"crossref","first-page":"6841","DOI":"10.1103\/PhysRevE.52.6841","article-title":"Estimating functions of probability distributions from a finite set of samples","volume":"52","author":"Wolpert","year":"1995","journal-title":"Physical Review E"},{"key":"2026032712064661200_ref266","first-page":"107","article-title":"Image texture classification based on finite Gaussian mixture models","volume-title":"Proceedings of The 3rd International Workshop on Texture Analysis and Synthesis (In Conjunction with ICCV2003)","author":"Wu","year":"2003"},{"issue":"6","key":"2026032712064661200_ref267","doi-asserted-by":"crossref","first-page":"1250","DOI":"10.1109\/18.45281","article-title":"Some asymptotic properties of the entropy of a stationary ergodic data source with applications to data-compression","volume":"35","author":"Wyner","year":"1989","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref268","first-page":"225","article-title":"Relevancy of time-frequency features for phonetic classification measured by mutual information","volume":"1","author":"Yang","year":"1999","journal-title":"Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP\u201999)"},{"key":"2026032712064661200_ref269","first-page":"2593","article-title":"Extracting secrecy from jointly Gaussian random variables","volume-title":"Proceedings of 2006 IEEE International Symposium on Information Theory (ISIT2006)","author":"Ye","year":"2006"},{"key":"2026032712064661200_ref270","volume-title":"Information theory and molecular biology","author":"Yockey","year":"1992"},{"issue":"4","key":"2026032712064661200_ref271","doi-asserted-by":"crossref","first-page":"1270","DOI":"10.1109\/18.243444","article-title":"A measure of relative entropy between individual sequences with application to universal classification","volume":"39","author":"Ziv","year":"1993","journal-title":"IEEE Transactions on Information Theory"},{"key":"2026032712064661200_ref272","doi-asserted-by":"crossref","first-page":"297","DOI":"10.1023\/A:1025128024427","article-title":"R\u00e9nyi extrapolation of Shannon entropy","volume":"10","author":"\u017byczkowski","year":"2003","journal-title":"Open Systems and Information Dynamics"}],"container-title":["Foundations and Trends\u00ae in Communications and Information Theory"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.emerald.com\/ftcit\/article-pdf\/5\/3\/265\/10900981\/0100000021en.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/www.emerald.com\/ftcit\/article-pdf\/5\/3\/265\/10900981\/0100000021en.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2026,3,27]],"date-time":"2026-03-27T16:07:30Z","timestamp":1774627650000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.emerald.com\/ftcit\/article\/5\/3\/265\/1320817\/Universal-Estimation-of-Information-Measures-for"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2009,5,27]]},"references-count":272,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2009,5,27]]}},"URL":"https:\/\/doi.org\/10.1561\/0100000021","relation":{},"ISSN":["1567-2190","1567-2328"],"issn-type":[{"value":"1567-2190","type":"print"},{"value":"1567-2328","type":"electronic"}],"subject":[],"published":{"date-parts":[[2009,5,27]]}}}