{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,8,4]],"date-time":"2026-08-04T15:45:33Z","timestamp":1785858333726,"version":"3.56.0"},"reference-count":33,"publisher":"MDPI AG","issue":"6","license":[{"start":{"date-parts":[[2025,5,29]],"date-time":"2025-05-29T00:00:00Z","timestamp":1748476800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0\/"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":["Algorithms"],"abstract":"<jats:p>Fuzzy clustering is a form of unsupervised learning that assigns the elements of a dataset into multiple clusters with varying degrees of membership rather than assigning them to a single cluster. The classical Fuzzy C-Means algorithm operates as an iterative procedure that minimizes an objective function defined based on the weighted distance between each point and the cluster centers. The algorithm operates decently in many datasets but struggles with datasets that exhibit irregularities in overlapping shapes, densities, and sizes of clusters. Meanwhile, there is a growing demand for accurate and scalable clustering techniques, especially in high-dimensional data analysis. This research work aims to address these infirmities of the classical fuzzy clustering algorithm by applying several modification approaches on the objective function of this algorithm. These modifications include several regularization terms aiming to make the algorithm more robust in specific types of datasets. The optimization of the modified objective functions is handled based on several numerical methods: gradient descent, root mean square propagation (RMSprop), and adaptive mean estimation (Adam). These methods are implemented in a Python environment, and extensive experimental studies are conducted, following carefully the steps of dataset selection, algorithm implementation, hyper-parameter tuning, picking the evaluation metrics, and analyzing the results. A comparison of the features of these algorithms on various datasets is carefully summarized.<\/jats:p>","DOI":"10.3390\/a18060327","type":"journal-article","created":{"date-parts":[[2025,5,29]],"date-time":"2025-05-29T06:25:04Z","timestamp":1748499904000},"page":"327","update-policy":"https:\/\/doi.org\/10.3390\/mdpi_crossmark_policy","source":"Crossref","is-referenced-by-count":3,"title":["Fuzzy Clustering Approaches Based on Numerical Optimizations of Modified Objective Functions"],"prefix":"10.3390","volume":"18","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-1107-0165","authenticated-orcid":false,"given":"Erind","family":"Bedalli","sequence":"first","affiliation":[{"name":"Department of Computer Engineering, Epoka University, 1039 Tirana, Albania"},{"name":"Department of Informatics, University of Elbasan \u201cAleksand\u00ebr Xhuvani\u201d, 3001 Elbasan, Albania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Shkelqim","family":"Hajrulla","sequence":"additional","affiliation":[{"name":"Department of Computer Engineering, Epoka University, 1039 Tirana, Albania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Rexhep","family":"Rada","sequence":"additional","affiliation":[{"name":"Department of Informatics, University of Elbasan \u201cAleksand\u00ebr Xhuvani\u201d, 3001 Elbasan, Albania"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Robert","family":"Kosova","sequence":"additional","affiliation":[{"name":"Department of Mathematics, University \u201cAleksander Moisiu\u201d Durres, 2001 Durres, Albania"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"1968","published-online":{"date-parts":[[2025,5,29]]},"reference":[{"key":"ref_1","doi-asserted-by":"crossref","first-page":"104743","DOI":"10.1016\/j.engappai.2022.104743","article-title":"A comprehensive survey of clustering algorithms: State-of-the-art machine learning applications, taxonomy, challenges, and future research prospects","volume":"110","author":"Ezugwu","year":"2022","journal-title":"Eng. Appl. Artif. Intell."},{"key":"ref_2","doi-asserted-by":"crossref","first-page":"120377","DOI":"10.1016\/j.eswa.2023.120377","article-title":"A fuzzy C-means algorithm for optimizing data clustering","volume":"227","author":"Hashemi","year":"2023","journal-title":"Expert Syst. Appl."},{"key":"ref_3","doi-asserted-by":"crossref","unstructured":"Rada, R., Bedalli, E., Shurdhi, S., and \u00c7i\u00e7o, B. (2023, January 6\u201310). A comparative analysis on prototype-based clustering methods. Proceedings of the 12th Mediterranean Conference on Embedded Computing (MECO 2023), Budva, Montenegro.","DOI":"10.1109\/MECO58584.2023.10154917"},{"key":"ref_4","doi-asserted-by":"crossref","unstructured":"Krasnov, D., Davis, D., Malott, K., Chen, Y., Shi, X., and Wong, A. (2023). Fuzzy c-means clustering: A review of applications in breast cancer detection. Entropy, 25.","DOI":"10.3390\/e25071021"},{"key":"ref_5","doi-asserted-by":"crossref","first-page":"100","DOI":"10.1016\/j.procs.2016.03.014","article-title":"Performance analysis of various fuzzy clustering algorithms: A review","volume":"79","author":"Gosain","year":"2016","journal-title":"Procedia Comput. Sci."},{"key":"ref_6","unstructured":"Liu, J., and Xu, M. (2012). Penalty Constraints and Kernelization of M-Estimation Based Fuzzy C-Means. arXiv."},{"key":"ref_7","doi-asserted-by":"crossref","unstructured":"Borgelt, C. (2013). Objective functions for fuzzy clustering. Computational Intelligence in Intelligent Data Analysis, Springer.","DOI":"10.1007\/978-3-642-32378-2_1"},{"key":"ref_8","doi-asserted-by":"crossref","first-page":"309","DOI":"10.1016\/j.dsp.2007.11.005","article-title":"Novel modified fuzzy c-means algorithm with applications","volume":"19","author":"Kang","year":"2009","journal-title":"Digit. Signal Process."},{"key":"ref_9","doi-asserted-by":"crossref","first-page":"758","DOI":"10.1016\/j.asoc.2015.05.038","article-title":"Conditional spatial fuzzy C-means clustering algorithm for segmentation of MRI images","volume":"34","author":"Adhikari","year":"2015","journal-title":"Appl. Soft Comput."},{"key":"ref_10","first-page":"929085","article-title":"Generalized fuzzy C-means clustering with improved fuzzy partitions and shadowed sets","volume":"2012","author":"Zabihi","year":"2012","journal-title":"Int. Sch. Res. Not."},{"key":"ref_11","doi-asserted-by":"crossref","first-page":"199","DOI":"10.22437\/jiituj.v9i1.37049","article-title":"Dynamic processes through the mathematical models and numerical evaluations","volume":"9","author":"Hajrulla","year":"2025","journal-title":"J. Ilm. Ilmu Terap. Univ. Jambi"},{"key":"ref_12","doi-asserted-by":"crossref","unstructured":"Khang, T.D., Vuong, N.D., Tran, M.K., and Fowler, M. (2020). Fuzzy C-means clustering algorithm with multiple fuzzification coefficients. Algorithms, 13.","DOI":"10.3390\/a13070158"},{"key":"ref_13","unstructured":"Bedalli, E., and Ninka, I. (2014, January 18\u201321). Exploring an educational system\u2019s data through fuzzy cluster analysis. Proceedings of the 11th Annual International Conference on Information Technology & Computer Science, Athens, Greece."},{"key":"ref_14","doi-asserted-by":"crossref","first-page":"682","DOI":"10.1109\/TFUZZ.2003.817858","article-title":"A contribution to convergence theory of fuzzy c-means and derivatives","volume":"11","author":"Hoppner","year":"2003","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_15","doi-asserted-by":"crossref","unstructured":"P\u00e9rez-Ortega, J., Roblero-Aguilar, S.S., Almanza-Ortega, N.N., Frausto Sol\u00eds, J., Zavala-D\u00edaz, C., Hern\u00e1ndez, Y., and Landero-N\u00e1jera, V. (2022). Hybrid fuzzy C-means clustering algorithm oriented to big data realms. Axioms, 11.","DOI":"10.3390\/axioms11080377"},{"key":"ref_16","doi-asserted-by":"crossref","first-page":"1357","DOI":"10.1109\/TFUZZ.2021.3058572","article-title":"Weighted multiview possibilistic c-means clustering with L2 regularization","volume":"30","author":"Benjamin","year":"2021","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_17","doi-asserted-by":"crossref","unstructured":"Cardone, B., and Di Martino, F. (2020). A novel fuzzy entropy-based method to improve the performance of the fuzzy C-means algorithm. Electronics, 9.","DOI":"10.3390\/electronics9040554"},{"key":"ref_18","doi-asserted-by":"crossref","unstructured":"Ichihashi, H., Honda, K., Notsu, A., and Hattori, T. (2007, January 1\u20135). Aggregation of standard and entropy based fuzzy c-means clustering by a modified objective function. Proceedings of the 2007 IEEE Symposium on Foundations of Computational Intelligence, Honolulu, HI, USA.","DOI":"10.1109\/FOCI.2007.371510"},{"key":"ref_19","unstructured":"Guillon, A., Lesot, M.J., and Marsala, C. (2019). Sparsity-inducing fuzzy subspace clustering. Archives of Data Science, Series B, Lucius & Lucius Verlagsgesellschaft mbH."},{"key":"ref_20","doi-asserted-by":"crossref","unstructured":"Bonilla, J., V\u00e9lez, D., Montero, J., and Rodr\u00edguez, J.T. (2021). Fuzzy clustering methods with R\u00e9nyi relative entropy and cluster size. Mathematics, 9.","DOI":"10.3390\/math9121423"},{"key":"ref_21","first-page":"17","article-title":"Image segmentation by fuzzy c-means clustering algorithm with a novel penalty term","volume":"26","author":"Yang","year":"2007","journal-title":"Comput. Inform."},{"key":"ref_22","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/s11704-010-0393-8","article-title":"Fuzzy c-means clustering with non-local spatial information for noisy image segmentation","volume":"5","author":"Zhao","year":"2011","journal-title":"Front. Comput. Sci. China"},{"key":"ref_23","doi-asserted-by":"crossref","first-page":"5848","DOI":"10.1016\/j.eswa.2015.03.031","article-title":"Cluster analysis using optimization algorithms with newly designed objective functions","volume":"42","author":"Binu","year":"2015","journal-title":"Expert Syst. Appl."},{"key":"ref_24","doi-asserted-by":"crossref","unstructured":"Wang, X., Yan, L., and Zhang, Q. (2021, January 20\u201326). Research on the application of gradient descent algorithm in machine learning. Proceedings of the 2021 International Conference on Computer network, Electronic and Automation (ICCNEA), Xi\u2019an, China.","DOI":"10.1109\/ICCNEA53019.2021.00014"},{"key":"ref_25","doi-asserted-by":"crossref","unstructured":"Tian, Y., Zhang, Y., and Zhang, H. (2023). Recent advances in stochastic gradient descent in deep learning. Mathematics, 11.","DOI":"10.3390\/math11030682"},{"key":"ref_26","unstructured":"Shi, N., and Li, D. (2021, January 3\u20137). Rmsprop converges with proper hyperparameter. Proceedings of the International Conference on Learning Representation, Vienna, Austria."},{"key":"ref_27","doi-asserted-by":"crossref","first-page":"3227","DOI":"10.1007\/s11571-022-09845-8","article-title":"On hyper-parameter selection for guaranteed convergence of RMSProp","volume":"18","author":"Liu","year":"2024","journal-title":"Cogn. Neurodynamics"},{"key":"ref_28","unstructured":"Khaniki, M.A.L., Hadi, M.B., and Manthouri, M. (2020, January 29\u201330). Feedback error learning controller based on RMSprop and Salp swarm algorithm for automatic voltage regulator system. Proceedings of the 2020 10th International Conference on Computer and Knowledge Engineering (ICCKE), Mashhad, Iran."},{"key":"ref_29","unstructured":"Kingma, D.P., and Ba, J. (2015). Adam: A method for stochastic optimization. arXiv."},{"key":"ref_30","doi-asserted-by":"crossref","unstructured":"Bock, S., and Wei\u00df, M. (2019, January 14\u201319). A proof of local convergence for the Adam optimizer. Proceedings of the 2019 International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.","DOI":"10.1109\/IJCNN.2019.8852239"},{"key":"ref_31","doi-asserted-by":"crossref","unstructured":"Khan, M.M.R., Arif, R.B., Siddique, M.A.B., and Oishe, M.R. (2018, January 26\u201328). Study and observation of the variation of accuracies of KNN, SVM, LMNN, ENN algorithms on eleven different datasets from UCI machine learning repository. Proceedings of the 2018 4th International Conference on Electrical Engineering and Information & Communication Technology (iCEEiCT), Kuala Lumpur, Malaysia.","DOI":"10.1109\/CEEICT.2018.8628041"},{"key":"ref_32","doi-asserted-by":"crossref","first-page":"546","DOI":"10.1109\/TFUZZ.2011.2179303","article-title":"Comparing fuzzy partitions: A generalization of the rand index and related measures","volume":"20","author":"Hullermeier","year":"2011","journal-title":"IEEE Trans. Fuzzy Syst."},{"key":"ref_33","doi-asserted-by":"crossref","first-page":"3395","DOI":"10.1109\/TFUZZ.2021.3114734","article-title":"A novel unsupervised approach to heterogeneous feature selection based on fuzzy mutual information","volume":"30","author":"Yuan","year":"2021","journal-title":"IEEE Trans. Fuzzy Syst."}],"container-title":["Algorithms"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/6\/327\/pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,10,9]],"date-time":"2025-10-09T17:42:59Z","timestamp":1760031779000},"score":1,"resource":{"primary":{"URL":"https:\/\/www.mdpi.com\/1999-4893\/18\/6\/327"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2025,5,29]]},"references-count":33,"journal-issue":{"issue":"6","published-online":{"date-parts":[[2025,6]]}},"alternative-id":["a18060327"],"URL":"https:\/\/doi.org\/10.3390\/a18060327","relation":{},"ISSN":["1999-4893"],"issn-type":[{"value":"1999-4893","type":"electronic"}],"subject":[],"published":{"date-parts":[[2025,5,29]]}}}