{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,10,14]],"date-time":"2025-10-14T00:41:53Z","timestamp":1760402513565,"version":"build-2065373602"},"reference-count":50,"publisher":"MDPI AG","issue":"4","license":[{"start":{"date-parts":[[2020,4,24]],"date-time":"2020-04-24T00:00:00Z","timestamp":1587686400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"funder":[{"DOI":"10.13039\/501100006378","name":"Universitas Indonesia","doi-asserted-by":"publisher","award":["NKB-0210\/UN2.R3.1\/HKP.05.00\/2019"],"award-info":[{"award-number":["NKB-0210\/UN2.R3.1\/HKP.05.00\/2019"]}],"id":[{"id":"10.13039\/501100006378","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Symmetry"],"abstract":"<jats:p>Classification in multi-modal data is one of the challenges in the machine learning field. The multi-modal data need special treatment as its features are distributed in several areas. This study proposes multi-codebook fuzzy neural networks by using intelligent clustering and dynamic incremental learning for multi-modal data classification. In this study, we utilized intelligent K-means clustering based on anomalous patterns and intelligent K-means clustering based on histogram information. In this study, clustering is used to generate codebook candidates before the training process, while incremental learning is utilized when the condition to generate a new codebook is sufficient. The condition to generate a new codebook in incremental learning is based on the similarity of the winner class and other classes. The proposed method was evaluated in synthetic and benchmark datasets. The experiment results showed that the proposed multi-codebook fuzzy neural networks that use dynamic incremental learning have significant improvements compared to the original fuzzy neural networks. The improvements were 15.65%, 5.31% and 11.42% on the synthetic dataset, the benchmark dataset, and the average of all datasets, respectively, for incremental version 1. The incremental learning version 2 improved by 21.08% 4.63%, and 14.35% on the synthetic dataset, the benchmark dataset, and the average of all datasets, respectively. The multi-codebook fuzzy neural networks that use intelligent clustering also had significant improvements compared to the original fuzzy neural networks, achieving 23.90%, 2.10%, and 15.02% improvements on the synthetic dataset, the benchmark dataset, and the average of all datasets, respectively.<\/jats:p>","DOI":"10.3390\/sym12040679","type":"journal-article","created":{"date-parts":[[2020,4,29]],"date-time":"2020-04-29T01:29:15Z","timestamp":1588123755000},"page":"679","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":2,"title":["Intelligent Clustering and Dynamic Incremental Learning to Generate Multi-Codebook Fuzzy Neural Network for Multi-Modal Data Classification"],"prefix":"10.3390","volume":"12","author":[{"given":"Muhammad Anwar","family":"Ma\u2019sum","sequence":"first","affiliation":[{"name":"Faculty of Computer Science, Universitas Indonesia, Kampus UI, Depok, Jawa Barat 16424, Indonesia"}],"role":[{"role":"author","vocabulary":"crossref"}]}],"member":"1968","published-online":{"date-parts":[[2020,4,24]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","unstructured":"Ma\u2019Sum, M.A., Arrofi, M.K., Jati, G., Arifin, F., Kurniawan, M.N., Mursanto, P., and Jatmiko, W. (2013, January 28\u201329). Simulation of intelligent unmanned aerial vehicle (uav) for military surveillance. Proceedings of the IEEE 2013 International Conference on Advanced Computer Science and Information Systems (ICACSIS), Kuta, Bali.","DOI":"10.1109\/ICACSIS.2013.6761569"},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"915","DOI":"10.1016\/j.robot.2008.08.001","article-title":"Towards semantic maps for mobile robots","volume":"56","author":"Joachim","year":"2008","journal-title":"Robot. Auton. Syst."},{"key":"ref_3","first-page":"334","article-title":"Active policy learning for robot planning and exploration under uncertainty","volume":"Volume 3","author":"Arnaud","year":"2007","journal-title":"Robotics: Science and Systems"},{"key":"ref_4","unstructured":"Baltru\u0161aitis, T., Chaitanya, A., and Louis-Philippe, M. (2018). multi-modal machine learning: A survey and taxonomy. IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"1548","DOI":"10.1109\/TPAMI.2016.2515606","article-title":"Survey on rgb, 3d, thermal, and multimodal approaches for facial expression recognition: History, trends, and affect-related applications","volume":"38","author":"Corneanu","year":"2016","journal-title":"IEEE Trans. Pattern Anal. Mach. Intell."},{"key":"ref_6","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1016\/j.imavis.2017.08.003","article-title":"A survey of multimodal sentiment analysis","volume":"65","author":"Soleymani","year":"2017","journal-title":"Image Vis. Comput."},{"key":"ref_7","doi-asserted-by":"crossref","first-page":"1025","DOI":"10.1007\/s10278-013-9619-2","article-title":"Content-based medical image retrieval: A survey of applications to multidimensional and multimodality data","volume":"26","author":"Kumar","year":"2013","journal-title":"J. Digit. Imaging"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"173","DOI":"10.1007\/s10462-012-9332-4","article-title":"Multimodal feature extraction and fusion for semantic mining of soccer video: A survey","volume":"42","author":"Oskouie","year":"2014","journal-title":"Artif. Intell. Rev."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"7","DOI":"10.1145\/1456650.1456657","article-title":"Survey and analysis of multimodal sensor planning and integration for wide area surveillance","volume":"41","author":"Abidi","year":"2009","journal-title":"ACM Comput. Surv. (CSUR)"},{"key":"ref_10","doi-asserted-by":"crossref","unstructured":"Kiela, D., Grave, E., Joulin, A., and Mikolov, T. (2018, January 2\u20137). Efficient large-scale multi-modal classification. Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, New Orleans, LA, USA.","DOI":"10.1609\/aaai.v32i1.11945"},{"key":"ref_11","doi-asserted-by":"crossref","unstructured":"Vortmann, L.M., Schult, M., Benedek, M., Walcher, S., and Putze, F. (2019, January 14\u201318). Real-Time Multimodal Classification of Internal and External Attention. Proceedings of the Adjunct of the 2019 International Conference on Multimodal Interaction, ACM, Suzhou, China.","DOI":"10.1145\/3351529.3360658"},{"key":"ref_12","doi-asserted-by":"crossref","first-page":"104","DOI":"10.1016\/j.neunet.2014.10.005","article-title":"Towards an intelligent framework for multimodal affective data analysis","volume":"63","author":"Poria","year":"2015","journal-title":"Neural Netw."},{"key":"ref_13","doi-asserted-by":"crossref","first-page":"345","DOI":"10.1007\/s00530-010-0182-0","article-title":"Multimodal fusion for multimedia analysis: A survey","volume":"16","author":"Atrey","year":"2010","journal-title":"Multimed. Syst."},{"key":"ref_14","unstructured":"Ma\u2019sum, M., Sanabila Anwar, H.R., and Jatmiko, W. (2015, January 10\u201311). Multi codebook lvq-based artificial neural networks using clustering approach. Proceedings of the IEEE 2015 International Conference on Advanced Computer Science and Information Systems (ICACSIS), Depok, Indonesia."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"Anwar Ma\u2019sum, M., and Wisnu, J. (2019, January 13\u201315). Multi-codebook Fuzzy Neural Network Using Incremental Learning for Multimodal Data Classification. Proceedings of the IEEE 2019 4th Asia-Pacific Conference on Intelligent Robot Systems (ACIRS), Nagoya, Japan.","DOI":"10.1109\/ACIRS.2019.8935971"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1261","DOI":"10.1016\/j.neucom.2017.06.084","article-title":"Incremental on-line learning: A review and comparison of state of the art algorithms","volume":"275","author":"Losing","year":"2018","journal-title":"Neurocomputing"},{"key":"ref_17","doi-asserted-by":"crossref","first-page":"132","DOI":"10.1016\/j.inffus.2017.02.004","article-title":"Ensemble learning for data stream analysis: A survey","volume":"37","author":"Krawczyk","year":"2017","journal-title":"Inf. Fusion"},{"key":"ref_18","first-page":"100","article-title":"Algorithm AS 136: A k-means clustering algorithm","volume":"28","author":"Hartigan","year":"1979","journal-title":"J. R. Stat. Soc. Ser. C (Appl. Stat.)"},{"key":"ref_19","doi-asserted-by":"crossref","first-page":"803","DOI":"10.2307\/2532201","article-title":"Model-based Gaussian and non-Gaussian clustering","volume":"49","author":"Banfield","year":"1993","journal-title":"Biometrics"},{"key":"ref_20","doi-asserted-by":"crossref","first-page":"3","DOI":"10.1007\/s00357-010-9049-5","article-title":"Intelligent choice of the number of clusters in k-means clustering: An experimental study with different cluster spreads","volume":"27","author":"Chiang","year":"2010","journal-title":"J. Classif."},{"key":"ref_21","doi-asserted-by":"crossref","unstructured":"Anwar Ma\u2019sum, M., Dewa, M.S.A., Indra, H., Wisnu, J., and Adi, N. (2018, January 12\u201313). Multicodebook Neural Network Using Intelligent K-Means Clustering Based on Histogram Information for Multimodal Data Classification. Proceedings of the IEEE 2018 International Workshop on Big Data and Information Security (IWBIS), Jakarta, Indonesia.","DOI":"10.1109\/IWBIS.2018.8471699"},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"660","DOI":"10.1109\/21.97458","article-title":"A survey of decision tree classifier methodology","volume":"21","author":"Safavian","year":"1991","journal-title":"IEEE Trans. Syst. Man Cybern."},{"key":"ref_23","unstructured":"Rish, I. (2001, January 4). An empirical study of the naive Bayes classifier. Proceedings of the IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, Seattle, DC, USA."},{"key":"ref_24","doi-asserted-by":"crossref","first-page":"2643","DOI":"10.1162\/089976603322385108","article-title":"Radius margin bounds for support vector machines with the RBF kernel","volume":"15","author":"Chung","year":"2003","journal-title":"Neural Comput."},{"key":"ref_25","doi-asserted-by":"crossref","first-page":"683","DOI":"10.1109\/72.159058","article-title":"Multilayer perceptron, fuzzy sets, and classification","volume":"3","author":"Pal","year":"1992","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_26","doi-asserted-by":"crossref","first-page":"123","DOI":"10.1007\/BF00058655","article-title":"Bagging predictors","volume":"24","author":"Breiman","year":"1996","journal-title":"Mach. Learn."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Mach. Learn."},{"key":"ref_28","unstructured":"Simonyan, K., and Andrew, Z. (2014). Very deep convolutional networks for large-scale image recognition. arXiv."},{"key":"ref_29","unstructured":"Setiawan, I.M.A., Imah, E.M., and Jatmiko, W. (2011, January 17\u201318). Arrhytmia classification using Fuzzy-Neuro Generalized Learning Vector Quantization. Proceedings of the 2011 International Conference on Advanced Computer Science and Information System (ICACSIS), Jakarta, Indonesia."},{"key":"ref_30","unstructured":"Kohonen, G.T. (1986). Learning Vector Quantization for Pattern Recognition. Report TKK-F-A601, Helsinki University of Technology."},{"key":"ref_31","unstructured":"Sato, A., and Yamada, K. (1998, January 16\u201320). A formulation of learning vector quantization using a new misclassification measure. Proceedings of the IEEE Computer Society 14th International Conference on Pattern Recognition-, ICPR \u201998, Washington, DC, USA."},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"856","DOI":"10.1016\/j.neuroimage.2011.01.008","article-title":"Multimodal classification of Alzheimer\u2019s disease and mild cognitive impairment","volume":"55","author":"Zhang","year":"2011","journal-title":"Neuroimage"},{"key":"ref_33","unstructured":"Cauwenberghs, G., and Tomaso, P. (2001). Incremental and decremental support vector machine learning. Adv. Neural Inf. Process. Syst., 409\u2013415. Available online: http:\/\/papers.nips.cc\/paper\/1814-incremental-and-decremental-support-vector-machine-learning.pdf."},{"key":"ref_34","doi-asserted-by":"crossref","unstructured":"Molina, J.F.G., Zheng, L., Sertdemir, M., Dinter, D.J., Sch\u00f6nberg, S., and R\u00e4dle, M. (2014). Incremental learning with SVM for multimodal classification of prostatic adenocarcinoma. PLoS ONE, 9.","DOI":"10.1371\/journal.pone.0093600"},{"key":"ref_35","doi-asserted-by":"crossref","first-page":"3056","DOI":"10.1016\/j.neucom.2007.02.009","article-title":"Convex incremental extreme learning machine","volume":"70","author":"Huang","year":"2007","journal-title":"Neurocomputing"},{"key":"ref_36","doi-asserted-by":"crossref","unstructured":"Anwar Ma\u2019sum, M., Dewa, M.S.A., Novian, H., and Wisnu, J. (2017, January 23\u201324). Enhance generalized learning vector quantization using unsupervised extreme learning machine and intelligent k-means clustering. Proceedings of the IEEE 2017 International Workshop on Big Data and Information Security (IWBIS), Jakarta, Indonesia.","DOI":"10.1109\/IWBIS.2017.8275106"},{"key":"ref_37","doi-asserted-by":"crossref","first-page":"920","DOI":"10.1016\/j.ejor.2014.10.050","article-title":"Application of fuzzy TOPSIS to scoring the negotiation offers in ill-structured negotiation problems","volume":"242","author":"Roszkowska","year":"2015","journal-title":"Eur. J. Oper. Res."},{"key":"ref_38","doi-asserted-by":"crossref","first-page":"395","DOI":"10.1016\/S0019-0578(07)60097-4","article-title":"Fuzzy-neuro LVQ and its comparison with fuzzy algorithm LVQ in artificial odor discrimination system","volume":"41","author":"Kusumoputro","year":"2002","journal-title":"ISA Trans."},{"key":"ref_39","first-page":"1239","article-title":"Fuzzy learning vector quantization based on particle swarm optimization for artificial odor discrimination system","volume":"8","author":"Jatmiko","year":"2009","journal-title":"WSEAS Trans. Syst."},{"key":"ref_40","doi-asserted-by":"crossref","unstructured":"Imah, E.M., Wisnu, J., and Basaruddin, T. (2012, January 14\u201317). Adaptive Multilayer Generalized Learning Vector Quantization (AMGLVQ) as new algorithm with integrating feature extraction and classification for Arrhythmia heartbeats classification. Proceedings of the 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC),  Seoul, Korea.","DOI":"10.1109\/ICSMC.2012.6377692"},{"key":"ref_41","doi-asserted-by":"crossref","unstructured":"Krizhevsky, A., Ilya, S., and Geoffrey, E.H. (2017). Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst., 1097\u20131105.","DOI":"10.1145\/3065386"},{"key":"ref_42","doi-asserted-by":"crossref","unstructured":"Huang, G., Zhuang, L., Laurens, V.D.M., and Kilian, Q. (2017, January 21\u201326). Weinberger. Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.","DOI":"10.1109\/CVPR.2017.243"},{"key":"ref_43","unstructured":"He, K., Zhang, X., Ren, S., and Sun, J. (July, January 26). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA."},{"key":"ref_44","doi-asserted-by":"crossref","unstructured":"Zoph, B., Vijay, V., Jonathon, S., and Quoc, V.L. (2018, January 18\u201323). Learning transferable architectures for scalable image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition, Salt Lake City, UT, USA.","DOI":"10.1109\/CVPR.2018.00907"},{"key":"ref_45","unstructured":"Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv."},{"key":"ref_46","doi-asserted-by":"crossref","unstructured":"Losing, V., Barbara, H., and Heiko, W. (2015, January 12\u201316). Interactive online learning for obstacle classification on a mobile robot. Proceedings of the IEEE International Joint Conference on Neural Networks (IJCNN), Killarney, Ireland.","DOI":"10.1109\/IJCNN.2015.7280610"},{"key":"ref_47","doi-asserted-by":"crossref","first-page":"1411","DOI":"10.1109\/TNN.2006.880583","article-title":"A fast and accurate online sequential learning algorithm for feedforward networks","volume":"17","author":"Liang","year":"2006","journal-title":"IEEE Trans. Neural Netw."},{"key":"ref_48","doi-asserted-by":"crossref","unstructured":"Saffari, A., Christian, L., Jakob, S., Martin, G., and Horst, B. (October, January 27). On-line random forests. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops, Kyoto, Japan.","DOI":"10.1109\/ICCVW.2009.5457447"},{"key":"ref_49","doi-asserted-by":"crossref","unstructured":"Glarner, T., Patrick, H., Janek, E., and Reinhold, H.-U. (2018, January 2\u20136). Full Bayesian Hidden Markov Model Variational Autoencoder for Acoustic Unit Discovery. Proceedings of the Interspeech, Hyderabad, India.","DOI":"10.21437\/Interspeech.2018-2148"},{"key":"ref_50","unstructured":"Howell, D.C. (2009). Statistical methods for psychology. Wadsworth Cengage Learning, Cengage Wadsworth."}],"container-title":["Symmetry"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/4\/679\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,13]],"date-time":"2025-10-13T13:51:13Z","timestamp":1760363473000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/2073-8994\/12\/4\/679"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,4,24]]},"references-count":50,"journal-issue":{"issue":"4","published-online":{"date-parts":[[2020,4]]}},"alternative-id":["sym12040679"],"URL":"https:\/\/doi.org\/10.3390\/sym12040679","relation":{},"ISSN":["2073-8994"],"issn-type":[{"type":"electronic","value":"2073-8994"}],"subject":[],"published":{"date-parts":[[2020,4,24]]}}}