{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,28]],"date-time":"2025-10-28T18:20:27Z","timestamp":1761675627269,"version":"build-2065373602"},"reference-count":17,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2008,12,4]],"date-time":"2008-12-04T00:00:00Z","timestamp":1228348800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/3.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>At the heart of many ICA techniques is a nonparametric estimate of an information measure, usually via nonparametric density estimation, for example, kernel density estimation. While not as popular as kernel density estimators, orthogonal functions can be used for nonparametric density estimation (via a truncated series expansion whose coefficients are calculated from the observed data). While such estimators do not necessarily yield a valid density, which kernel density estimators do, they are faster to calculate than kernel density estimators, in particular for a modified version of Renyi's entropy of order 2. In this paper, we compare the performance of ICA using Hermite series based estimates of Shannon's and Renyi's mutual information, to that of Gaussian kernel based estimates. The comparisons also include ICA using the RADICAL estimate of Shannon's entropy and a FastICA estimate of neg-entropy.<\/jats:p>","DOI":"10.3390\/e10040745","type":"journal-article","created":{"date-parts":[[2008,12,5]],"date-time":"2008-12-05T07:11:49Z","timestamp":1228461109000},"page":"745-756","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":6,"title":["An Assessment of Hermite Function Based Approximations of Mutual Information Applied to Independent Component Analysis"],"prefix":"10.3390","volume":"10","author":[{"given":"Julian","family":"Sorensen","sequence":"first","affiliation":[{"name":"C3ID, DSTO, PO Box, Edinburgh, SA 5111, Australia"}]}],"member":"1968","published-online":{"date-parts":[[2008,12,4]]},"reference":[{"key":"ref_1","first-page":"757","article-title":"A new learning algorithm for blind signal separation","volume":"8","author":"Amari","year":"1996","journal-title":"Advances in Neural Information Processing Systems"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1142\/S0129065700000028","article-title":"A fast fixed-point algorithm for independent component analysis of complex-valued signals","volume":"10 (1)","author":"Bingham","year":"2000","journal-title":"Int. J. of Neural Syst."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Boscolo, R., Pan, H., and Roychowdhury, V. P. (2004). Independent component analysis based on nonparametric density estimation. IEEE Trans. Neural Networks., 55\u201365.","DOI":"10.1109\/TNN.2003.820667"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Como, P. (1994). Independent component analysis, A new concept?. Signal Process., 287\u2013314.","DOI":"10.1016\/0165-1684(94)90029-9"},{"key":"ref_5","unstructured":"Erdogmus, D., Hild II, K. E., and Principe, J. C. (4, January July). Independent components analysis using Renyi\u2019s mutual information and Legendre density estimation. Proceedings of International Joint Conference on Neural Networks, USA."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"174","DOI":"10.1109\/97.923043","article-title":"Blind source separation using Renyi\u2019s mutual information","volume":"8","author":"Erdogmus","year":"2001","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"626","DOI":"10.1109\/72.761722","article-title":"Fast and robust fixed-point algorithms for independent component analysis","volume":"10","author":"Hyvarinen","year":"1999","journal-title":"IEEE Trans. Neural Networks."},{"key":"ref_8","unstructured":"Hyvarinen, A., Karhunen, J., and Oja, E. (2001). John Wiley & Sons."},{"key":"ref_9","first-page":"205","article-title":"Recent developments in nonparametric density estimation","volume":"86","author":"Izenman","year":"1991","journal-title":"J. Amer. Statistical Assoc."},{"key":"ref_10","first-page":"1271","article-title":"ICA using spacing estimates of Entropy","volume":"4","year":"2003","journal-title":"J. Mach. Learn. Res."},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Lee, I., and Lee, T. (, January 2007,). Nonparameteric Independent Component Analysis for Circular Complex Variables. Proceedings of IEEE International Conference on Acoustics, Speech and Signal Processing, Honolulu.","DOI":"10.1109\/ICASSP.2007.366323"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Obradovic, D., and Deco, B. (2000). Information maximization and independent component analysis: Is there a difference?. Neural Computat., 2085\u20132101.","DOI":"10.1162\/089976698300016972"},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1065","DOI":"10.1214\/aoms\/1177704472","article-title":"On esimation of a probability density function and mode","volume":"33","author":"Parzen","year":"1962","journal-title":"Ann. Math. Statist."},{"key":"ref_14","unstructured":"Silverman, B. W. (1985). Density Estimation for Statistics and Data Analysis, Chapman and Hall."},{"key":"ref_15","first-page":"1262","article-title":"Estimation of a probability density by an orthogonal series","volume":"38","author":"Schwartz","year":"1966","journal-title":"Ann. Math. Statist."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1258","DOI":"10.1214\/aos\/1176344013","article-title":"Properties of Hermite series estimation of probability density","volume":"5","author":"Walter","year":"1977","journal-title":"Ann. Statist."},{"key":"ref_17","unstructured":"Webb, A. (1999). Statistical Pattern Recognition, Hodder Arnold."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/10\/4\/745\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T22:21:13Z","timestamp":1760221273000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/10\/4\/745"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2008,12,4]]},"references-count":17,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2008,12]]}},"alternative-id":["e10040745"],"URL":"https:\/\/doi.org\/10.3390\/e10040745","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2008,12,4]]}}}