{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,27]],"date-time":"2025-10-27T16:17:43Z","timestamp":1761581863407,"version":"build-2065373602"},"reference-count":45,"publisher":"MDPI AG","issue":"8","license":[{"start":{"date-parts":[[2019,8,11]],"date-time":"2019-08-11T00:00:00Z","timestamp":1565481600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100012166","name":"National Key Research and Development Program of China","doi-asserted-by":"publisher","award":["2018YFC0808306"],"award-info":[{"award-number":["2018YFC0808306"]}],"id":[{"id":"10.13039\/501100012166","id-type":"DOI","asserted-by":"publisher"}]},{"DOI":"10.13039\/501100001809","name":"National Natural Science Foundation of China","doi-asserted-by":"publisher","award":["U1836106","U1736117"],"award-info":[{"award-number":["U1836106","U1736117"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"publisher"}]},{"name":"University of Science and Technology Beijing - National Taipei University of Technology Joint Research Program","award":["TW201705"],"award-info":[{"award-number":["TW201705"]}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Entropy"],"abstract":"<jats:p>Kernel adaptive filtering (KAF) is an effective nonlinear learning algorithm, which has been widely used in time series prediction. The traditional KAF is based on the stochastic gradient descent (SGD) method, which has slow convergence speed and low filtering accuracy. Hence, a kernel conjugate gradient (KCG) algorithm has been proposed with low computational complexity, while achieving comparable performance to some KAF algorithms, e.g., the kernel recursive least squares (KRLS). However, the robust learning performance is unsatisfactory, when using KCG. Meanwhile, correntropy as a local similarity measure defined in kernel space, can address large outliers in robust signal processing. On the basis of correntropy, the mixture correntropy is developed, which uses the mixture of two Gaussian functions as a kernel function to further improve the learning performance. Accordingly, this article proposes a novel KCG algorithm, named the kernel mixture correntropy conjugate gradient (KMCCG), with the help of the mixture correntropy criterion (MCC). The proposed algorithm has less computational complexity and can achieve better performance in non-Gaussian noise environments. To further control the growing radial basis function (RBF) network in this algorithm, we also use a simple sparsification criterion based on the angle between elements in the reproducing kernel Hilbert space (RKHS). The prediction simulation results on a synthetic chaotic time series and a real benchmark dataset show that the proposed algorithm can achieve better computational performance. In addition, the proposed algorithm is also successfully applied to the practical tasks of malware prediction in the field of malware analysis. The results demonstrate that our proposed algorithm not only has a short training time, but also can achieve high prediction accuracy.<\/jats:p>","DOI":"10.3390\/e21080785","type":"journal-article","created":{"date-parts":[[2019,8,13]],"date-time":"2019-08-13T04:31:21Z","timestamp":1565670681000},"page":"785","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":5,"title":["Kernel Mixture Correntropy Conjugate Gradient Algorithm for Time Series Prediction"],"prefix":"10.3390","volume":"21","author":[{"given":"Nan","family":"Xue","sequence":"first","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-1929-8447","authenticated-orcid":false,"given":"Xiong","family":"Luo","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Yang","family":"Gao","sequence":"additional","affiliation":[{"name":"China Information Technology Security Evaluation Center, Beijing 100085, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Weiping","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Long","family":"Wang","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"given":"Chao","family":"Huang","sequence":"additional","affiliation":[{"name":"School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Institute of Artificial Intelligence, University of Science and Technology Beijing, Beijing 100083, China"},{"name":"Beijing Key Laboratory of Knowledge Engineering for Materials Science, Beijing 100083, China"}],"role":[{"role":"author","vocabulary":"crossref"}]},{"ORCID":"https:\/\/orcid.org\/0000-0002-3202-1127","authenticated-orcid":false,"given":"Wenbing","family":"Zhao","sequence":"additional","affiliation":[{"name":"Department of Electrical Engineering and Computer Science, Cleveland State University, Cleveland, OH 44115, USA"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2019,8,11]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Firdausi, I., Lim, C., Erwin, A., and Nugroho, A.S. (2010, January 2\u20133). Analysis of machine learning techniques used in behavior-based malware detection. Proceedings of the Second International Conference on Advances in Computing, Control, and Telecommunication Technologies, Jakarta, Indonesia.","DOI":"10.1109\/ACT.2010.33"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"3979","DOI":"10.1007\/s11042-017-5104-0","article-title":"Android malware detection based on system call sequences and LSTM","volume":"78","author":"Xiao","year":"2019","journal-title":"Multimed. Tools Appl."},{"key":"ref_3","doi-asserted-by":"crossref","first-page":"1023","DOI":"10.1016\/j.future.2018.04.085","article-title":"User behavior prediction in social networks using weighted extreme learning machine with distribution optimization","volume":"93","author":"Luo","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_4","doi-asserted-by":"crossref","first-page":"1160","DOI":"10.1109\/TCYB.2018.2789686","article-title":"Multivariate chaotic time series online prediction based on improved kernel recursive least squares algorithm","volume":"49","author":"Han","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"9","DOI":"10.1145\/3299875","article-title":"Large scale online multiple kernel regression with application to time-series prediction","volume":"13","author":"Sahoo","year":"2019","journal-title":"ACM Trans. Knowl. Discov. Data"},{"key":"ref_6","doi-asserted-by":"crossref","unstructured":"Liu, W., Pr\u00edncipe, J.C., and Haykin, S. (2011). Kernel Adaptive Filtering, Wiley.","DOI":"10.1002\/9780470608593"},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"543","DOI":"10.1109\/TSP.2007.907881","article-title":"The kernel least-mean-square algorithm","volume":"56","author":"Liu","year":"2008","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"2275","DOI":"10.1109\/TSP.2004.830985","article-title":"The kernel recursive least-squares algorithm","volume":"52","author":"Engel","year":"2004","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"127","DOI":"10.1109\/CC.2017.8010964","article-title":"A quantized kernel least mean square scheme with entropy-guided learning for intelligent data analysis","volume":"14","author":"Luo","year":"2017","journal-title":"China Commun."},{"key":"ref_10","doi-asserted-by":"crossref","first-page":"914","DOI":"10.1109\/LSP.2008.2005437","article-title":"A globally convergent stochastic pairwise conjugate gradient-based algorithm for adaptive filtering","volume":"15","author":"Ahmad","year":"2008","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"4377","DOI":"10.1109\/TSP.2018.2853109","article-title":"The kernel conjugate gradient algorithms","volume":"66","author":"Zhang","year":"2018","journal-title":"IEEE Trans. Signal Process."},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1016\/j.sigpro.2008.07.005","article-title":"Correntropy as a novel measure for nonlinearity tests","volume":"89","author":"Gunduz","year":"2009","journal-title":"Signal Process."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"1410","DOI":"10.1109\/JIOT.2018.2856241","article-title":"A novel human activity recognition scheme for smart health using multilayer extreme learning machine","volume":"6","author":"Chen","year":"2019","journal-title":"IEEE Internet Things J."},{"key":"ref_14","unstructured":"Sun, J., Wang, Z., Luo, X., Shi, P., Wang, W., Wang, L., Wang, J.H., and Zhao, W. (2018). A parallel recommender system using a collaborative filtering algorithm with correntropy for social networks. IEEE Trans. Netw. Sci. Eng."},{"key":"ref_15","doi-asserted-by":"crossref","first-page":"318","DOI":"10.1016\/j.patcog.2018.02.010","article-title":"Mixture correntropy for robust learning","volume":"79","author":"Chen","year":"2018","journal-title":"Pattern Recogn."},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"142","DOI":"10.1016\/j.neunet.2013.11.011","article-title":"A linear recurrent kernel online learning algorithm with sparse updates","volume":"50","author":"Fan","year":"2014","journal-title":"Neural Netw."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Platt, J. (1991). A Resource-allocating Network for Function Interpolation, MIT Press.","DOI":"10.1162\/neco.1991.3.2.213"},{"key":"ref_18","doi-asserted-by":"crossref","first-page":"1950","DOI":"10.1109\/TNET.2012.2187923","article-title":"An information theoretic approach of designing sparse kernel adaptive filters","volume":"20","author":"Liu","year":"2009","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"351","DOI":"10.1016\/j.future.2018.11.039","article-title":"A novel code data dissemination scheme for Internet of Things through mobile vehicle of smart cities","volume":"94","author":"Teng","year":"2019","journal-title":"Future Gener. Comput. Syst."},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"578","DOI":"10.1016\/j.cose.2018.05.010","article-title":"Early-stage malware prediction using recurrent neural networks","volume":"77","author":"Rhode","year":"2018","journal-title":"Comput. Secur."},{"key":"ref_21","doi-asserted-by":"crossref","first-page":"14","DOI":"10.1145\/3313391","article-title":"Mamadroid: Detecting android malware by building Markov chains of behavioral models","volume":"22","author":"Onwuzurike","year":"2019","journal-title":"ACM Trans. Priv. Secur."},{"key":"ref_22","doi-asserted-by":"crossref","unstructured":"Pr\u00edncipe, J.C. (2010). Information Theoretic Learning: Renyi\u2019s Entropy and Kernel Perspectives, Springer.","DOI":"10.1007\/978-1-4419-1570-2"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"168","DOI":"10.1016\/j.dsp.2016.11.011","article-title":"A robust correntropy based subspace tracking algorithm in impulsive noise environments","volume":"62","author":"Zhang","year":"2017","journal-title":"Digital Signal Process. Rev. J."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"1945","DOI":"10.1016\/j.jfranklin.2017.08.014","article-title":"Towards enhancing stacked extreme learning machine with sparse autoencoder by correntropy","volume":"355","author":"Luo","year":"2018","journal-title":"J. Franklin Inst."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"1440","DOI":"10.1109\/TCYB.2018.2804326","article-title":"Robust graph-based semisupervised learning for noisy labeled data via maximum correntropy criterion","volume":"49","author":"Du","year":"2019","journal-title":"IEEE Trans. Cybern."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"4963","DOI":"10.1109\/TII.2018.2854549","article-title":"Short-term wind speed forecasting via stacked extreme learning machine with generalized correntropy","volume":"14","author":"Luo","year":"2018","journal-title":"IEEE Trans. Ind. Inf."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"880","DOI":"10.1109\/LSP.2014.2319308","article-title":"Steady-state mean-square error analysis for adaptive filtering under the maximum correntropy criterion","volume":"21","author":"Chen","year":"2014","journal-title":"IEEE Signal Process. Lett."},{"key":"ref_28","doi-asserted-by":"crossref","first-page":"7149","DOI":"10.3390\/e17107149","article-title":"Robust Hammerstein adaptive filtering under maximum correntropy criterion","volume":"17","author":"Wu","year":"2015","journal-title":"Entropy"},{"key":"ref_29","doi-asserted-by":"crossref","first-page":"116","DOI":"10.1016\/j.sigpro.2017.05.009","article-title":"Constrained maximum correntropy adaptive filtering","volume":"140","author":"Peng","year":"2017","journal-title":"Signal Process."},{"key":"ref_30","doi-asserted-by":"crossref","first-page":"180","DOI":"10.1016\/j.ymssp.2016.10.020","article-title":"Active impulsive noise control using maximum correntropy with adaptive kernel size","volume":"87","author":"Lu","year":"2017","journal-title":"Mech. Syst. Signal Process."},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Zhang, Z.Y., Qiu, J.Z., and Ma, W.T. (2019). Adaptive extended Kalman filter with correntropy loss for robust power system state estimation. Entropy, 21.","DOI":"10.3390\/e21030293"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"381","DOI":"10.1016\/j.ins.2018.12.039","article-title":"Maximum correntropy adaptation approach for robust compressive sensing reconstruction","volume":"480","author":"He","year":"2019","journal-title":"Inf. Sci."},{"key":"ref_33","doi-asserted-by":"crossref","unstructured":"Boyd, S., and Vandenberghe, L. (2004). Convex Optimization, Cambridge University Press.","DOI":"10.1017\/CBO9780511804441"},{"key":"ref_34","doi-asserted-by":"crossref","first-page":"22","DOI":"10.1109\/TNNLS.2011.2178446","article-title":"Quantized kernel least mean square algorithm","volume":"23","author":"Chen","year":"2012","journal-title":"IEEE Trans. Neural Netw. Learn. Sys."},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"164","DOI":"10.1016\/j.dsp.2017.01.010","article-title":"Quantized kernel maximum correntropy and its mean square convergence analysis","volume":"63","author":"Wang","year":"2017","journal-title":"Digital Signal Process. Rev. J."},{"key":"ref_36","doi-asserted-by":"crossref","first-page":"319","DOI":"10.1017\/S1350482704001422","article-title":"Long memory behaviour in the daily maximum and minimum temperatures in Melbourne, Australia","volume":"11","year":"2004","journal-title":"Meteorol. Appl."},{"key":"ref_37","unstructured":"FireEye Inc. (2019, July 10). Out of Pocket: A Comprehensive Mobile Threat Assessment of 7 Million iOS and Android Apps. Available online: https:\/\/www.itsecurity-xpert.com\/whitepapers\/1043-out-of-pocket-a-comprehensive-mobile-threat-assessment-of-7-million-ios-and-android-apps."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"21235","DOI":"10.1109\/ACCESS.2019.2896003","article-title":"A combination method for android malware detection based on control flow graphs and machine learning algorithms","volume":"7","author":"Ma","year":"2019","journal-title":"IEEE Access"},{"key":"ref_39","doi-asserted-by":"crossref","unstructured":"Makandar, A., and Patrot, A. (2015, January 21\u201322). Malware analysis and classification using artificial neural network. Proceedings of the International Conference on Trends in Automation, Communication and Computing Technologies, Bangalore, India.","DOI":"10.1109\/ITACT.2015.7492653"},{"key":"ref_40","doi-asserted-by":"crossref","first-page":"361","DOI":"10.1007\/s10207-015-0297-6","article-title":"Malware detection using bilayer behavior abstraction and improved one-class support vector machines","volume":"15","author":"Miao","year":"2016","journal-title":"Int. J. Inf. Secur."},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Tobiyama, S., Yamaguchi, Y., Shimada, H., Ikuse, T., and Yagi, T. (2016, January 10\u201314). Malware detection with deep neural network using process behavior. Proceedings of the IEEE 40th Annual Computer Software and Applications Conference Workshops, Atlanta, GA, USA.","DOI":"10.1109\/COMPSAC.2016.151"},{"key":"ref_42","unstructured":"Xu, W., Qi, Y., and Evans, D. (2016, January 21\u201324). Automatically evading classifiers. Proceedings of the Network and Distributed Systems Symposium, San Diego, CA, USA."},{"key":"ref_43","unstructured":"Biggio, B., Nelson, B., and Laskov, P. (July, January 26). Poisoning attacks against support vector machines. Proceedings of the 29th International Coference on Machine Learning, Edinburgh, Scotland."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Sami, A., Yadegari, B., Rahimi, H., Peiravian, N., Hashemi, S., and Hamze, A. (2010, January 22\u201326). Malware detection based on mining API calls. Proceedings of the ACM Symposium on Applied Computing, Sierre, Switzerland.","DOI":"10.1145\/1774088.1774303"},{"key":"ref_45","doi-asserted-by":"crossref","unstructured":"Qiao, Y., Yang, Y., Ji, L., and He, J. (2013, January 16\u201318). Analyzing malware by abstracting the frequent itemsets in API call sequences. Proceedings of the 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications, Melbourne, VIC, Australia.","DOI":"10.1109\/TrustCom.2013.36"}],"container-title":["Entropy"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/8\/785\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,11]],"date-time":"2025-10-11T13:10:19Z","timestamp":1760188219000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1099-4300\/21\/8\/785"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2019,8,11]]},"references-count":45,"journal-issue":{"issue":"8","published-online":{"date-parts":[[2019,8]]}},"alternative-id":["e21080785"],"URL":"https:\/\/doi.org\/10.3390\/e21080785","relation":{},"ISSN":["1099-4300"],"issn-type":[{"type":"electronic","value":"1099-4300"}],"subject":[],"published":{"date-parts":[[2019,8,11]]}}}