{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,11,7]],"date-time":"2025-11-07T13:23:50Z","timestamp":1762521830378,"version":"build-2065373602"},"reference-count":28,"publisher":"MDPI AG","issue":"9","license":[{"start":{"date-parts":[[2015,8,27]],"date-time":"2015-08-27T00:00:00Z","timestamp":1440633600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"973 Program","doi-asserted-by":"publisher","award":["2015CB351703"],"award-info":[{"award-number":["2015CB351703"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["61372152","61271210"],"award-info":[{"award-number":["61372152","61271210"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Sparse system identification has received a great deal of attention due to its broad applicability. The proportionate normalized least mean square (PNLMS) algorithm, as a popular tool, achieves excellent performance for sparse system identification. In previous studies, most of the cost functions used in proportionate-type sparse adaptive algorithms are based on the mean square error (MSE) criterion, which is optimal only when the measurement noise is Gaussian. However, this condition does not hold in most real-world environments. In this work, we use the minimum error entropy (MEE) criterion, an alternative to the conventional MSE criterion, to develop the proportionate minimum error entropy (PMEE) algorithm for sparse system identification, which may achieve much better performance than the MSE based methods especially in heavy-tailed non-Gaussian situations. Moreover, we analyze the convergence of the proposed algorithm and derive a sufficient condition that ensures the mean square convergence. Simulation results confirm the excellent performance of the new algorithm.<\/jats:p>","DOI":"10.3390\/e17095995","type":"journal-article","created":{"date-parts":[[2015,8,27]],"date-time":"2015-08-27T10:03:37Z","timestamp":1440669817000},"page":"5995-6006","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":23,"title":["Proportionate Minimum Error Entropy Algorithm for Sparse System Identification"],"prefix":"10.3390","volume":"17","author":[{"given":"Zongze","family":"Wu","sequence":"first","affiliation":[{"name":"School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510640, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Siyuan","family":"Peng","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, South China University of Technology, Guangzhou 510640, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-1710-3818","authenticated-orcid":false,"given":"Badong","family":"Chen","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an 710049, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Haiquan","family":"Zhao","sequence":"additional","affiliation":[{"name":"School of Electrical Engineering, Southwest Jiaotong University, Chengdu 610031, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Jose","family":"Principe","sequence":"additional","affiliation":[{"name":"School of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an 710049, China"},{"name":"Department of Electrical and Computer Engineering, University of Florida, Gainesville,  FL 32611, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2015,8,27]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Huang, Y., Benesty, J., and Chen, J. (2006). Acoustic MIMO Signal Processing, Springer.","DOI":"10.1007\/978-3-540-37631-6"},{"key":"ref_2","doi-asserted-by":"crossref","unstructured":"Paleologu, C., Benesty, J., and Ciochina, S. (2010). Sparse Adaptive Filters for Echo Cancellation, Morgan and Claypool.","DOI":"10.1007\/978-3-031-02559-4"},{"key":"ref_3","unstructured":"Sayed, A.H. (2003). Fundamentals of Adaptive Filtering, Wiley."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"508","DOI":"10.1109\/89.861368","article-title":"Proportionate normalized least-mean-squares adaptation in echo cancellers","volume":"8","author":"Duttweiler","year":"2000","journal-title":"IEEE Trans. Speech Audio Process."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"181","DOI":"10.1109\/LSP.2004.842262","article-title":"Improving convergence of the PNLMS algorithm for sparse impulse response identification","volume":"12","author":"Deng","year":"2005","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"337","DOI":"10.1109\/LSP.2008.919812","article-title":"Improved proportionate subband NLMS for acoustic echo cancellation in changing environments","volume":"15","author":"Laska","year":"2008","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"3301","DOI":"10.1109\/TSP.2012.2190407","article-title":"An enhanced IAF-PNLMS adaptive algorithm for sparse impulse response identification","volume":"60","author":"Seara","year":"2012","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"1794","DOI":"10.1109\/TSP.2006.872533","article-title":"Proportionate adaptive algorithms for network echo cancellation","volume":"54","author":"Deng","year":"2006","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"165","DOI":"10.1109\/LSP.2009.2035665","article-title":"An efficient proportionate affine projection algorithm for echo cancellation","volume":"17","author":"Paleologu","year":"2010","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"73","DOI":"10.1049\/el.2010.7937","article-title":"Efficient \u03bc-law improved proportionate affine projection algorithm for echo cancellation","volume":"47","author":"Yang","year":"2010","journal-title":"Electron. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"2273","DOI":"10.1109\/TASL.2011.2125955","article-title":"Proportionate affine projection sign algorithms for network echo cancellation","volume":"19","author":"Yang","year":"2011","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"1047","DOI":"10.1109\/TASLP.2014.2318519","article-title":"Memory proportionate APA with individual activation factors for acoustic echo cancellation","volume":"22","author":"Zhao","year":"2014","journal-title":"IEEE Trans. Audio Speech Lang. Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"207","DOI":"10.1023\/A:1007974400149","article-title":"Nonlinear filtering of non-Gaussian noise","volume":"19","author":"Plataniotis","year":"1997","journal-title":"J. Intell. Robot. Syst."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"2588","DOI":"10.1109\/TSP.2005.849213","article-title":"Nonlinear system identification in impulsive environments","volume":"53","author":"Weng","year":"2005","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Principe, J.C. (2010). Information Theoretic Learning: Renyi\u2019s Entropy and Kernel Perspectives, Springer.","DOI":"10.1007\/978-1-4419-1570-2"},{"key":"ref_16","doi-asserted-by":"crossref","unstructured":"Chen, B., Zhu, Y., Hu, J.C., and Jose Principe, J.C. (2013). System Parameter Identification: Information Criteria and Algorithms, Elsevier.","DOI":"10.1016\/B978-0-12-404574-3.00005-1"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"1780","DOI":"10.1109\/TSP.2002.1011217","article-title":"An error-entropy minimization for supervised training of nonlinear adaptive systems","volume":"50","author":"Erdogmus","year":"2002","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1966","DOI":"10.1109\/TSP.2003.812843","article-title":"Convergence properties and data efficiency of the minimum error entropy criterion in adaline training","volume":"51","author":"Erdogmus","year":"2003","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"1168","DOI":"10.1109\/TNN.2010.2050212","article-title":"Mean-square convergence analysis of ADALINE training with minimum error entropy criterion","volume":"21","author":"Chen","year":"2010","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"941","DOI":"10.1007\/s00034-007-9004-9","article-title":"Stochastic gradient algorithm under (h, phi)-entropy criterion","volume":"26","author":"Chen","year":"2007","journal-title":"Circuit Syst. Signal Process."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"4011","DOI":"10.1109\/TSP.2013.2265221","article-title":"Diffusion information theoretic learning for distributed estimation over network","volume":"61","author":"Li","year":"2013","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"937","DOI":"10.1016\/j.sigpro.2004.11.028","article-title":"Minimum-entropy estimation in semi-parametric models","volume":"85","author":"Wolsztynski","year":"2005","journal-title":"Signal Process."},{"key":"ref_23","first-page":"192","article-title":"Adaptive filters with error nonlinearities: Mean-square analysis and optimum design","volume":"4","author":"Sayed","year":"2001","journal-title":"EURASIP J. Appl. Signal Process."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"966","DOI":"10.3390\/e14050966","article-title":"Some further results on the minimum error entropy estimation","volume":"14","author":"Chen","year":"2012","journal-title":"Entropy"},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"2311","DOI":"10.3390\/e14112311","article-title":"On the Smoothed Minimum Error Entropy Criterion","volume":"14","author":"Chen","year":"2012","journal-title":"Entropy"},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"3419","DOI":"10.3390\/e17053419","article-title":"Minimum Error Entropy Algorithm with Sparsity Penalty Constraints","volume":"17","author":"Wu","year":"2015","journal-title":"Entropy"},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"2588","DOI":"10.1109\/TSP.2005.849213","article-title":"Nonlinear system identification in impulsive environments","volume":"53","author":"Weng","year":"2005","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"1107","DOI":"10.1109\/LCOMM.2011.081011.110813","article-title":"Alpha-stable channel capacity","volume":"15","author":"Wang","year":"2011","journal-title":"IEEE Commun. Lett."}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/9\/5995\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T20:47:28Z","timestamp":1760215648000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/17\/9\/5995"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2015,8,27]]},"references-count":28,"journal-issue":{"issue":"9","published-online":{"date-parts":[[2015,9]]}},"alternative-id":["e17095995"],"URL":"https:\/\/doi.org\/10.3390\/e17095995","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2015,8,27]]}}}