{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,12]],"date-time":"2025-10-12T04:34:35Z","timestamp":1760243675028,"version":"build-2065373602"},"reference-count":36,"publisher":"MDPI AG","issue":"7","license":[{"start":{"date-parts":[[2012,7,10]],"date-time":"2012-07-10T00:00:00Z","timestamp":1341878400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>We address the problem of non-parametric estimation of the recently proposed measures of statistical dispersion of positive continuous random variables. The measures are based on the concepts of differential entropy and Fisher information and describe the \u201cspread\u201d or \u201cvariability\u201d of the random variable from a different point of view than the ubiquitously used concept of standard deviation. The maximum penalized likelihood estimation of the probability density function proposed by Good and Gaskins is applied and a complete methodology of how to estimate the dispersion measures with a single algorithm is presented. We illustrate the approach on three standard statistical models describing neuronal activity.<\/jats:p>","DOI":"10.3390\/e14071221","type":"journal-article","created":{"date-parts":[[2012,7,10]],"date-time":"2012-07-10T14:22:16Z","timestamp":1341930136000},"page":"1221-1233","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":9,"title":["Nonparametric Estimation of Information-Based Measures of Statistical Dispersion"],"prefix":"10.3390","volume":"14","author":[{"given":"Lubomir","family":"Kostal","sequence":"first","affiliation":[{"name":"Institute of Physiology, Academy of Sciences of the Czech Republic, Videnska 1083, 142 20 Prague, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Ondrej","family":"Pokora","sequence":"additional","affiliation":[{"name":"Institute of Physiology, Academy of Sciences of the Czech Republic, Videnska 1083, 142 20 Prague, Czech Republic"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2012,7,10]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"2693","DOI":"10.1111\/j.1460-9568.2007.05880.x","article-title":"Review: Neuronal coding and spiking randomness","volume":"26","author":"Kostal","year":"2007","journal-title":"Eur. J. Neurosci."},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Kostal, L., Lansky, P., and Pokora, O. (2011). Variability measures of positive random variables. PLoS One, 6.","DOI":"10.1371\/journal.pone.0021998"},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"3832","DOI":"10.1016\/j.ins.2009.07.013","article-title":"On minimum Fisher information distributions with restricted support and fixed variance","volume":"179","author":"Bercher","year":"2009","journal-title":"Inf. Sci."},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Frieden, B.R. (1998). Physics from Fisher Information: A Unification, Cambridge University Press.","DOI":"10.1017\/CBO9780511622670"},{"key":"ref_5","first-page":"39","article-title":"A maximum entropy approach to natural language processing","volume":"22","author":"Berger","year":"1996","journal-title":"Comput. Linguist."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"380","DOI":"10.1109\/34.588021","article-title":"Inducing features of random fields","volume":"19","author":"Lafferty","year":"1997","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"434","DOI":"10.1239\/jap\/1025131441","article-title":"Entropy-based measure of uncertainty in past lifetime distributions","volume":"39","author":"Longobardi","year":"2002","journal-title":"J. Appl. Probab."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1648","DOI":"10.3390\/e13091648","article-title":"Wavelet Fisher\u2019s information measure of 1\/f\u03b1 signals","volume":"13","year":"2011","journal-title":"Entropy"},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"972","DOI":"10.3390\/e11040972","article-title":"Fisher information and semiclassical treatments","volume":"11","author":"Pennini","year":"2009","journal-title":"Entropy"},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"54","DOI":"10.1111\/j.2517-6161.1976.tb01566.x","article-title":"A test for normality based on sample entropy","volume":"38","author":"Vasicek","year":"1976","journal-title":"J. Roy. Stat. Soc. B"},{"key":"ref_11","first-page":"75","article-title":"Root-n consistent estimators of entropy for densities with unbounded support","volume":"23","author":"Tsybakov","year":"1994","journal-title":"Scand. J. Statist."},{"key":"ref_12","unstructured":"Cover, T.M., and Thomas, J.A. (1991). Elements of Information Theory, John Wiley and Sons, Inc."},{"key":"ref_13","unstructured":"Pitman, E.J.G. (1979). Some Basic Theory for Statistical Inference, John Wiley and Sons, Inc."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"1944","DOI":"10.1162\/NECO_a_00157","article-title":"Firing variability is higher than deduced from the empirical coefficient of variation","volume":"23","author":"Ditlevsen","year":"2011","journal-title":"Neural Comput."},{"key":"ref_15","first-page":"17","article-title":"Nonparametric entropy estimation: An overview","volume":"6","author":"Beirlant","year":"1997","journal-title":"Int. J. Math. Stat. Sci."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"818","DOI":"10.3390\/e12040818","article-title":"Parametric Bayesian estimation of differential entropy and relative entropy","volume":"12","author":"Gupta","year":"2010","journal-title":"Entropy"},{"key":"ref_17","first-page":"95","article-title":"Sample estimate of the entropy of a random vector","volume":"23","author":"Kozachenko","year":"1987","journal-title":"Prob. Inform. Trans."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"66138","DOI":"10.1103\/PhysRevE.69.066138","article-title":"Estimating mutual information","volume":"69","author":"Kraskov","year":"2004","journal-title":"Phys. Rev. E"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"761","DOI":"10.1081\/SAC-100107780","article-title":"Monte Carlo comparison of four normality tests using different entropy estimates","volume":"30","author":"Esteban","year":"2001","journal-title":"Comm. Stat. Simulat. Comput."},{"key":"ref_20","first-page":"1271","article-title":"ICA using spacings estimates of entropy","volume":"4","author":"Miller","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"157","DOI":"10.1007\/s00422-005-0036-6","article-title":"Similarity of interspike interval distributions and information gain in a stationary neuronal firing","volume":"94","author":"Kostal","year":"2006","journal-title":"Biol. Cybern."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Abramowitz, M., and Stegun, I.A. (1965). Handbook of Mathematical Functions, with Formulas, Graphs, and Mathematical Tables, Dover.","DOI":"10.1063\/1.3047921"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"1029","DOI":"10.1214\/aos\/1176342822","article-title":"Fisher information and spline interpolation","volume":"2","author":"Huber","year":"1974","journal-title":"Ann. Stat."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"69","DOI":"10.1007\/BF00773669","article-title":"On the estimation of the entropy","volume":"45","author":"Hall","year":"1993","journal-title":"Ann. Inst. Statist. Math."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1321","DOI":"10.1109\/18.761291","article-title":"Best asymptotic normality of the kernel density entropy estimator for smooth densities","volume":"45","author":"Eggermont","year":"1999","journal-title":"IEEE Trans. Inform. Theor."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"255","DOI":"10.2307\/2334515","article-title":"Nonparametric roughness penalties for probability densities","volume":"58","author":"Good","year":"1971","journal-title":"Biometrika"},{"key":"ref_27","doi-asserted-by":"crossref","unstructured":"Gerstner, W., and Kistler, W.M. (2002). Spiking Neuron Models: Single Neurons, Populations, Plasticity, Cambridge University Press.","DOI":"10.1017\/CBO9780511815706"},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"389","DOI":"10.1038\/nrn1668","article-title":"Neuronal variability: Noise or part of the signal?","volume":"6","author":"Stein","year":"2005","journal-title":"Nat. Rev. Neurosci."},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"2823","DOI":"10.1162\/089976603322518759","article-title":"Differences in spiking patterns among cortical neurons","volume":"15","author":"Shinomoto","year":"2003","journal-title":"Neural Comput."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"353","DOI":"10.1007\/s00221-011-2553-y","article-title":"Nonrenewal spike train statistics: Cause and functional consequences on neural coding","volume":"210","author":"Chacron","year":"2011","journal-title":"Exp. Brain Res."},{"key":"ref_31","doi-asserted-by":"crossref","first-page":"021905","DOI":"10.1103\/PhysRevE.79.021905","article-title":"Serial correlation in neural spike trains: Experimental evidence, stochastic modelling and single neuron variability","volume":"79","author":"Farkhooi","year":"2009","journal-title":"Phys. Rev. E"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"97","DOI":"10.1002\/neu.20177","article-title":"Patterns of spontaneous activity in single rat olfactory receptor neurons are different in normally breathing and tracheotomized animals","volume":"65","author":"Kostal","year":"2005","journal-title":"J. Neurobiol."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"119","DOI":"10.1016\/j.jneumeth.2009.01.037","article-title":"Automatic spike train analysis and report generation. An implementation with R, R2HTML and STAR","volume":"181","author":"Pouzat","year":"2009","journal-title":"J. Neurosci. Meth."},{"key":"ref_34","unstructured":"R Development Core Team (2009). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"374","DOI":"10.1016\/j.jneumeth.2007.10.013","article-title":"Measurement of variability dynamics in cortical spike trains","volume":"169","author":"Nawrot","year":"2008","journal-title":"J. Neurosci. Meth."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"011910","DOI":"10.1103\/PhysRevE.83.011910","article-title":"Distribution of interspike intervals estimated from multiple spike trains observed in a short time window","volume":"83","author":"Pawlas","year":"2011","journal-title":"Phys. Rev. E"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/7\/1221\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T21:51:13Z","timestamp":1760219473000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/14\/7\/1221"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2012,7,10]]},"references-count":36,"journal-issue":{"issue":"7","published-online":{"date-parts":[[2012,7]]}},"alternative-id":["e14071221"],"URL":"https:\/\/doi.org\/10.3390\/e14071221","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2012,7,10]]}}}