{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,13]],"date-time":"2026-10-13T17:16:47Z","timestamp":1791911807421,"version":"4.3.4"},"reference-count":80,"publisher":"Association for Computing Machinery (ACM)","issue":"3","license":[{"start":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T00:00:00Z","timestamp":1648598400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Comput. Surv."],"published-print":{"date-parts":[[2023,3,31]]},"abstract":"<jats:p>Clustering approaches are extensively used by many areas such as IR, Data Integration, Document Classification, Web Mining, Query Processing, and many other domains and disciplines. Nowadays, much literature describes clustering algorithms on multivariate data sets. However, there is limited literature that presented them with exhaustive and extensive theoretical analysis as well as experimental comparisons. This experimental survey paper deals with the basic principle, and techniques used, including important characteristics, application areas, run-time performance, internal, external, and stability validity of cluster quality, etc., on five different data sets of eleven clustering algorithms. This paper analyses how these algorithms behave with five different multivariate data sets in data representation. To answer this question, we compared the efficiency of eleven clustering approaches on five different data sets using three validity metrics-internal, external, and stability and found the optimal score to know the feasible solution of each algorithm. In addition, we have also included four popular and modern clustering algorithms with only their theoretical discussion. Our experimental results for only traditional clustering algorithms showed that different algorithms performed different behavior on different data sets in terms of running time (speed), accuracy and, the size of data set. This study emphasized the need for more adaptive algorithms and a deliberate balance between the running time and accuracy with their theoretical as well as implementation aspects.<\/jats:p>","DOI":"10.1145\/3490384","type":"journal-article","created":{"date-parts":[[2022,3,30]],"date-time":"2022-03-30T05:24:35Z","timestamp":1648617875000},"page":"1-33","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":45,"title":["Experimental Comparisons of Clustering Approaches for Data Representation"],"prefix":"10.1145","volume":"55","author":[{"given":"Sanjay Kumar","family":"Anand","sequence":"first","affiliation":[{"name":"NSUT East Campus (Formerly AIACTR), GGSIP University, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Suresh","family":"Kumar","sequence":"additional","affiliation":[{"name":"NSUT, Main Campus, New Delhi, India"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2022,3,30]]},"reference":[{"issue":"3","key":"e_1_3_1_2_2","article-title":"Comparisons between data clustering algorithms.","volume":"5","author":"Abbas Osama Abu","year":"2008","unstructured":"Osama Abu Abbas. 2008. Comparisons between data clustering algorithms. International Arab Journal of Information Technology (IAJIT) 5, 3 (2008).","journal-title":"International Arab Journal of Information Technology (IAJIT)"},{"key":"e_1_3_1_3_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2020.107522"},{"key":"e_1_3_1_4_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCCNT.2013.6726574"},{"key":"e_1_3_1_5_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2017.06.023"},{"key":"e_1_3_1_6_2","doi-asserted-by":"publisher","DOI":"10.1109\/I2CT.2014.7092112"},{"key":"e_1_3_1_7_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-981-13-1540-4_15"},{"key":"e_1_3_1_8_2","doi-asserted-by":"publisher","DOI":"10.1109\/MP.2006.1635021"},{"key":"e_1_3_1_9_2","doi-asserted-by":"publisher","DOI":"10.3115\/v1\/P14-1005"},{"key":"e_1_3_1_10_2","doi-asserted-by":"publisher","DOI":"10.1145\/3366423.3380214"},{"key":"e_1_3_1_11_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.asoc.2008.03.002"},{"key":"e_1_3_1_12_2","article-title":"clValid, an R package for cluster validation","author":"Brock Guy","year":"2011","unstructured":"Guy Brock, Vasyl Pihur, Susmita Datta, Somnath Datta, et\u00a0al. 2011. clValid, an R package for cluster validation. Journal of Statistical Software (Brock et\u00a0al., March 2008) (2011).","journal-title":"Journal of Statistical Software (Brock et\u00a0al., March 2008)"},{"key":"e_1_3_1_13_2","doi-asserted-by":"publisher","DOI":"10.1111\/bmsp.12136"},{"key":"e_1_3_1_14_2","doi-asserted-by":"publisher","DOI":"10.1109\/I2CT42659.2018.9058098"},{"key":"e_1_3_1_15_2","first-page":"113","volume-title":"Joint Conference on EMNLP and CoNLL-Shared Task","author":"Chang Kai-Wei","year":"2012","unstructured":"Kai-Wei Chang, Rajhans Samdani, Alla Rozovskaya, Mark Sammons, and Dan Roth. 2012. Illinois-Coref: The UI system in the CoNLL-2012 shared task. In Joint Conference on EMNLP and CoNLL-Shared Task. 113\u2013117."},{"key":"e_1_3_1_16_2","article-title":"Improving coreference resolution by learning entity-level distributed representations","author":"Clark Kevin","year":"2016","unstructured":"Kevin Clark and Christopher D. Manning. 2016. Improving coreference resolution by learning entity-level distributed representations. arXiv preprint arXiv:1606.01323 (2016).","journal-title":"arXiv preprint arXiv:1606.01323"},{"key":"e_1_3_1_17_2","doi-asserted-by":"publisher","DOI":"10.1145\/1143844.1143874"},{"key":"e_1_3_1_18_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2016.02.001"},{"key":"e_1_3_1_19_2","article-title":"UCI Machine Learning Repository [http:\/\/archive.ics.uci.edu\/ml]. Irvine, CA: University of California, School of Information and Computer Science, zuletzt abgerufen am: 14.09.2019","author":"Dua D.","year":"2019","unstructured":"D. Dua and C. Graff. 2019. UCI Machine Learning Repository [http:\/\/archive.ics.uci.edu\/ml]. Irvine, CA: University of California, School of Information and Computer Science, zuletzt abgerufen am: 14.09.2019. Google Scholar (2019).","journal-title":"Google Scholar"},{"key":"e_1_3_1_20_2","volume-title":"Cluster Analysis: A Survey","author":"Duran Benjamin S.","year":"2013","unstructured":"Benjamin S. Duran and Patrick L. Odell. 2013. Cluster Analysis: A Survey. Vol. 100. Springer Science & Business Media."},{"key":"e_1_3_1_21_2","doi-asserted-by":"publisher","DOI":"10.5555\/2391181.2391184"},{"key":"e_1_3_1_22_2","doi-asserted-by":"publisher","DOI":"10.1162\/COLI_a_00200"},{"key":"e_1_3_1_23_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2007.05.018"},{"key":"e_1_3_1_24_2","doi-asserted-by":"publisher","DOI":"10.1093\/comjnl\/41.8.578"},{"key":"e_1_3_1_25_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1136800"},{"key":"e_1_3_1_26_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-75171-7_3"},{"key":"e_1_3_1_27_2","doi-asserted-by":"publisher","DOI":"10.1145\/276305.276312"},{"key":"e_1_3_1_28_2","doi-asserted-by":"publisher","DOI":"10.1016\/S0306-4379(00)00022-3"},{"key":"e_1_3_1_29_2","first-page":"335","article-title":"Data Mining Concepts and Techniques, Morgan Kaufmann Publishers","author":"Han Jiawei","year":"2001","unstructured":"Jiawei Han and Micheline Kamber. 2001. Data Mining Concepts and Techniques, Morgan Kaufmann Publishers. San Francisco, CA (2001), 335\u2013391.","journal-title":"San Francisco, CA"},{"key":"e_1_3_1_30_2","volume-title":"Advanced Models of Supervised Structural Clustering","author":"Haponchyk Iryna","year":"2018","unstructured":"Iryna Haponchyk. 2018. Advanced Models of Supervised Structural Clustering. Ph.D. Dissertation. University of Trento."},{"key":"e_1_3_1_31_2","doi-asserted-by":"publisher","DOI":"10.18653\/v1\/2021.naacl-main.263"},{"key":"e_1_3_1_32_2","doi-asserted-by":"publisher","DOI":"10.1093\/bioinformatics\/17.2.126"},{"key":"e_1_3_1_33_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.chemolab.2014.01.017"},{"key":"e_1_3_1_34_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4614-7138-7"},{"key":"e_1_3_1_35_2","doi-asserted-by":"publisher","DOI":"10.1109\/2.781637"},{"key":"e_1_3_1_36_2","volume-title":"Finding Groups in Data: An Introduction to Cluster Analysis","author":"Kaufman Leonard","year":"2009","unstructured":"Leonard Kaufman and Peter J. Rousseeuw. 2009. Finding Groups in Data: An Introduction to Cluster Analysis, Vol. 344. John Wiley & Sons."},{"key":"e_1_3_1_37_2","doi-asserted-by":"publisher","DOI":"10.5555\/1346111.1346125"},{"key":"e_1_3_1_38_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2016.03.008"},{"key":"e_1_3_1_39_2","doi-asserted-by":"publisher","DOI":"10.1093\/bjaceaccp\/mkn041"},{"issue":"5","key":"e_1_3_1_40_2","first-page":"2001","article-title":"The role of frame-based representation on the semantic web","volume":"6","author":"Lassila Ora","year":"2001","unstructured":"Ora Lassila and Deborah McGuinness. 2001. The role of frame-based representation on the semantic web. Link\u00f6ping Electronic Articles in Computer and Information Science 6, 5 (2001), 2001.","journal-title":"Link\u00f6ping Electronic Articles in Computer and Information Science"},{"key":"e_1_3_1_41_2","article-title":"End-to-end neural coreference resolution","author":"Lee Kenton","year":"2017","unstructured":"Kenton Lee, Luheng He, Mike Lewis, and Luke Zettlemoyer. 2017. End-to-end neural coreference resolution. arXiv preprint arXiv:1707.07045 (2017).","journal-title":"arXiv preprint arXiv:1707.07045"},{"key":"e_1_3_1_42_2","doi-asserted-by":"crossref","first-page":"45","DOI":"10.1007\/978-1-4615-3622-2_4","volume-title":"Adaptive Parsing","author":"Lehman Jill Fain","year":"1992","unstructured":"Jill Fain Lehman. 1992. System architecture and knowledge representation. In Adaptive Parsing. Springer, 45\u201366."},{"key":"e_1_3_1_43_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2017.11.020"},{"key":"e_1_3_1_44_2","doi-asserted-by":"crossref","first-page":"321","DOI":"10.1007\/0-387-25465-X_15","article-title":"Clustering methods","author":"Lior Rokach","year":"2005","unstructured":"Rokach Lior and Oded Maimon. 2005. Clustering methods. Data Mining and Knowledge Discovery Handbook (2005), 321\u2013352.","journal-title":"Data Mining and Knowledge Discovery Handbook"},{"key":"e_1_3_1_45_2","first-page":"177","volume-title":"Data Clustering","author":"Liu Jialu","year":"2018","unstructured":"Jialu Liu and Jiawei Han. 2018. Spectral clustering. In Data Clustering. Chapman and Hall\/CRC, 177\u2013200."},{"key":"e_1_3_1_46_2","doi-asserted-by":"publisher","DOI":"10.1201\/b19035"},{"key":"e_1_3_1_47_2","doi-asserted-by":"publisher","DOI":"10.1162\/tacl_a_00147"},{"key":"e_1_3_1_48_2","article-title":"Normalized mutual information to evaluate overlapping community finding algorithms","author":"McDaid Aaron F.","year":"2011","unstructured":"Aaron F. McDaid, Derek Greene, and Neil Hurley. 2011. Normalized mutual information to evaluate overlapping community finding algorithms. arXiv preprint arXiv:1110.2515 (2011).","journal-title":"arXiv preprint arXiv:1110.2515"},{"key":"e_1_3_1_49_2","unstructured":"Donald R. McNeil. 1977. Interactive Data Analysis: A Practical Primer. (1977)."},{"key":"e_1_3_1_50_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-540-45167-9_14"},{"key":"e_1_3_1_51_2","doi-asserted-by":"publisher","DOI":"10.1109\/ACCESS.2018.2855437"},{"key":"e_1_3_1_52_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.ejor.2005.03.039"},{"key":"e_1_3_1_53_2","doi-asserted-by":"publisher","DOI":"10.1590\/s1982-21702018000400027"},{"key":"e_1_3_1_54_2","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.168"},{"key":"e_1_3_1_55_2","doi-asserted-by":"publisher","DOI":"10.5121\/ijcsit.2018.10203"},{"key":"e_1_3_1_56_2","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2008.01.039"},{"key":"e_1_3_1_57_2","doi-asserted-by":"publisher","DOI":"10.5555\/1953048.2078195"},{"key":"e_1_3_1_58_2","doi-asserted-by":"publisher","DOI":"10.1145\/2063576.2063657"},{"key":"e_1_3_1_59_2","doi-asserted-by":"publisher","DOI":"10.1126\/science.1242072"},{"key":"e_1_3_1_60_2","doi-asserted-by":"publisher","DOI":"10.5555\/2011878"},{"key":"e_1_3_1_61_2","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-030-32047-8_16"},{"key":"e_1_3_1_62_2","article-title":"ELKI: A large open-source library for data analysis-ELKI Release 0.7. 5\u201d Heidelberg\u201d","author":"Schubert Erich","year":"2019","unstructured":"Erich Schubert and Arthur Zimek. 2019. ELKI: A large open-source library for data analysis-ELKI Release 0.7. 5\u201d Heidelberg\u201d. arXiv preprint arXiv:1902.03616 (2019).","journal-title":"arXiv preprint arXiv:1902.03616"},{"key":"e_1_3_1_63_2","article-title":"Spectralnet: Spectral clustering using deep neural networks","author":"Shaham Uri","year":"2018","unstructured":"Uri Shaham, Kelly Stanton, Henry Li, Boaz Nadler, Ronen Basri, and Yuval Kluger. 2018. Spectralnet: Spectral clustering using deep neural networks. arXiv preprint arXiv:1801.01587 (2018).","journal-title":"arXiv preprint arXiv:1801.01587"},{"key":"e_1_3_1_64_2","doi-asserted-by":"publisher","DOI":"10.1109\/ISCE.2013.6570150"},{"key":"e_1_3_1_65_2","unstructured":"John F. Sowa. 1987. Semantic Networks. (1987)."},{"key":"e_1_3_1_66_2","doi-asserted-by":"publisher","DOI":"10.1109\/ICCICCT.2014.6993192"},{"key":"e_1_3_1_67_2","doi-asserted-by":"publisher","DOI":"10.1093\/bib\/1.4.398"},{"key":"e_1_3_1_68_2","article-title":"Introduction to data mining, Pearson Education","author":"Tan Pang-Ning","year":"2006","unstructured":"Pang-Ning Tan, Micahel Steinbach, and Vipin Kumar. 2006. Introduction to data mining, Pearson Education. Inc., New Delhi (2006).","journal-title":"Inc., New Delhi"},{"key":"e_1_3_1_69_2","unstructured":"R. Core Team et\u00a0al. 2013. R: A language and environment for statistical computing. (2013)."},{"key":"e_1_3_1_70_2","doi-asserted-by":"crossref","unstructured":"K. M. Ting. 2017. Confusion Matrix Encyclopedia of Machine Learning and Data Mining.","DOI":"10.1007\/978-1-4899-7687-1_50"},{"key":"e_1_3_1_71_2","doi-asserted-by":"publisher","DOI":"10.1109\/IS3C.2012.166"},{"key":"e_1_3_1_72_2","first-page":"1","article-title":"A comparison of spectral clustering algorithms","volume":"1","author":"Verma Deepak","year":"2003","unstructured":"Deepak Verma and Marina Meila. 2003. A comparison of spectral clustering algorithms. University of Washington Tech Rep UWCSE030501 1 (2003), 1\u201318.","journal-title":"University of Washington Tech Rep UWCSE030501"},{"key":"e_1_3_1_73_2","doi-asserted-by":"crossref","first-page":"371","DOI":"10.1007\/978-3-642-01091-0_16","volume-title":"Foundations of Computational Intelligence Volume 6","author":"Visalakshi N. Karthikeyani","year":"2009","unstructured":"N. Karthikeyani Visalakshi and K. Thangavel. 2009. Distributed data clustering: A comparative analysis. In Foundations of Computational Intelligence Volume 6. Springer, 371\u2013397."},{"key":"e_1_3_1_74_2","doi-asserted-by":"publisher","DOI":"10.1007\/s11222-007-9033-z"},{"key":"e_1_3_1_75_2","volume-title":"Comparing clusterings: An overview","author":"Wagner Silke","year":"2007","unstructured":"Silke Wagner and Dorothea Wagner. 2007. Comparing clusterings: An overview. Universit\u00e4t Karlsruhe, Fakult\u00e4t f\u00fcr Informatik Karlsruhe."},{"issue":"3","key":"e_1_3_1_76_2","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1080\/1206212X.2018.1425184","article-title":"Affinity propagation clustering algorithm based on large-scale data-set","volume":"40","author":"Wang Limin","year":"2018","unstructured":"Limin Wang, Kaiyue Zheng, Xing Tao, and Xuming Han. 2018. Affinity propagation clustering algorithm based on large-scale data-set. International Journal of Computers and Applications 40, 3 (2018), 1\u20136.","journal-title":"International Journal of Computers and Applications"},{"key":"e_1_3_1_77_2","first-page":"10\u2013pp","volume-title":"Proceedings of the 33rd Annual Hawaii International Conference on System Sciences","author":"Wei Chih-Ping","year":"2000","unstructured":"Chih-Ping Wei, Yen-Hsien Lee, and Che-Ming Hsu. 2000. Empirical comparison of fast clustering algorithms for large data sets. In Proceedings of the 33rd Annual Hawaii International Conference on System Sciences. IEEE, 10\u2013pp."},{"key":"e_1_3_1_78_2","article-title":"Learning global features for coreference resolution","author":"Wiseman Sam","year":"2016","unstructured":"Sam Wiseman, Alexander M. Rush, and Stuart M. Shieber. 2016. Learning global features for coreference resolution. arXiv preprint arXiv:1604.03035 (2016).","journal-title":"arXiv preprint arXiv:1604.03035"},{"key":"e_1_3_1_79_2","doi-asserted-by":"publisher","DOI":"10.1007\/s40745-015-0040-1"},{"key":"e_1_3_1_80_2","doi-asserted-by":"publisher","DOI":"10.1109\/CVPR42600.2020.00672"},{"key":"e_1_3_1_81_2","article-title":"Neural coreference resolution with deep biaffine attention by joint mention detection and mention clustering","author":"Zhang Rui","year":"2018","unstructured":"Rui Zhang, Cicero Nogueira dos Santos, Michihiro Yasunaga, Bing Xiang, and Dragomir Radev. 2018. Neural coreference resolution with deep biaffine attention by joint mention detection and mention clustering. arXiv preprint arXiv:1805.04893 (2018).","journal-title":"arXiv preprint arXiv:1805.04893"}],"container-title":["ACM Computing Surveys"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3490384","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3490384","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,17]],"date-time":"2025-06-17T15:30:43Z","timestamp":1750174243000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3490384"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2022,3,30]]},"references-count":80,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2023,3,31]]}},"alternative-id":["10.1145\/3490384"],"URL":"https:\/\/doi.org\/10.1145\/3490384","relation":{},"ISSN":["0360-0300","1557-7341"],"issn-type":[{"value":"0360-0300","type":"print"},{"value":"1557-7341","type":"electronic"}],"subject":[],"published":{"date-parts":[[2022,3,30]]},"assertion":[{"value":"2019-12-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2021-10-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2022-03-30","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}