{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,10,8]],"date-time":"2026-10-08T18:37:25Z","timestamp":1791484645725,"version":"4.3.4"},"reference-count":51,"publisher":"Association for Computing Machinery (ACM)","issue":"5","license":[{"start":{"date-parts":[[2018,6,27]],"date-time":"2018-06-27T00:00:00Z","timestamp":1530057600000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/www.acm.org\/publications\/policies\/copyright_policy#Background"}],"funder":[{"DOI":"10.13039\/501100001809","name":"National Natural Science Fund of China","doi-asserted-by":"crossref","award":["61672332, 61322211, 61432011, and U1435212"],"award-info":[{"award-number":["61672332, 61322211, 61432011, and U1435212"]}],"id":[{"id":"10.13039\/501100001809","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Program for the Outstanding Innovative Teams of Higher Learning Institutions of Shanxi"},{"DOI":"10.13039\/501100004602","name":"Program for New Century Excellent Talents in University","doi-asserted-by":"crossref","award":["NCET-12-1031"],"award-info":[{"award-number":["NCET-12-1031"]}],"id":[{"id":"10.13039\/501100004602","id-type":"DOI","asserted-by":"crossref"}]},{"name":"Program for the Young San Jin Scholars of Shanxi"},{"name":"Hong Kong SAR Government","award":["CityU: 101113"],"award-info":[{"award-number":["CityU: 101113"]}]}],"content-domain":{"domain":["dl.acm.org"],"crossmark-restriction":true},"short-container-title":["ACM Trans. Knowl. Discov. Data"],"published-print":{"date-parts":[[2018,10,31]]},"abstract":"<jats:p>Clustering ensemble has drawn much attention in recent years due to its ability to generate a high quality and robust partition result. Weighted clustering ensemble and selective clustering ensemble are two general ways to further improve the performance of a clustering ensemble method. Existing weighted clustering ensemble methods assign the same weight to each cluster in a partition of the ensemble. Since the qualities of the clusters in a partition are different, the clusters should be weighted differently. To address this issue, this article proposes a new measure to calculate the similarity between a cluster and a partition. Theoretically, this measure is effective in handling two problems in measuring the quality of a cluster, which are defined as the symmetric problem and the context meaning problem. In addition, some properties of the proposed measure are analyzed. This measure can be easily expanded to a clustering performance measure that calculates the similarity between two partitions. As a result of this measure, we propose a novel selective clustering ensemble framework, which considers the differences between the objective of the ensemble selection stage and the object of the ensemble integration stage in the selective clustering ensemble. To verify the performance of the new measure, we compare the performance of the measure with the two existing measures in weighting clusters. The experiments show that the proposed measure is more effective. To verify the performance of the novel framework, four existing state-of-the-art selective clustering ensemble frameworks are employed as references. The experiments show that the proposed framework is statistically better than the others on 17 UCI benchmark datasets, 8 document datasets, and the Olivetti Face Database.<\/jats:p>","DOI":"10.1145\/3211872","type":"journal-article","created":{"date-parts":[[2018,6,27]],"date-time":"2018-06-27T12:14:36Z","timestamp":1530101676000},"page":"1-27","update-policy":"https:\/\/doi.org\/10.1145\/crossmark-policy","source":"Crossref","is-referenced-by-count":23,"title":["Cluster\u2019s Quality Evaluation and Selective Clustering Ensemble"],"prefix":"10.1145","volume":"12","author":[{"given":"Feijiang","family":"Li","sequence":"first","affiliation":[{"name":"Shanxi University, Shanxi Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Yuhua","family":"Qian","sequence":"additional","affiliation":[{"name":"Shanxi University, Shanxi Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Jieting","family":"Wang","sequence":"additional","affiliation":[{"name":"Shanxi University, Shanxi Province, China"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Chuangyin","family":"Dang","sequence":"additional","affiliation":[{"name":"City University of Hong Kong, Hong Kong"}],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Bing","family":"Liu","sequence":"additional","affiliation":[{"name":"University of Illinois at Chicago, Chicago, IL"}],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"320","published-online":{"date-parts":[[2018,6,27]]},"reference":[{"key":"e_1_2_1_1_1","doi-asserted-by":"publisher","DOI":"10.1145\/2601435"},{"key":"e_1_2_1_2_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.engappai.2014.12.005"},{"key":"e_1_2_1_3_1","doi-asserted-by":"publisher","DOI":"10.3233\/IDA-140647"},{"key":"e_1_2_1_4_1","volume-title":"Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI).","volume":"9","author":"Azimi Javad","year":"2009","unstructured":"Javad Azimi and Xiaoli Fern . 2009 . Adaptive cluster ensemble selection . In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). Vol. 9 , 992--997. Javad Azimi and Xiaoli Fern. 2009. Adaptive cluster ensemble selection. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI). Vol. 9, 992--997."},{"key":"e_1_2_1_5_1","doi-asserted-by":"publisher","DOI":"10.1016\/S0004-3702(97)00063-5"},{"key":"e_1_2_1_6_1","doi-asserted-by":"publisher","DOI":"10.1109\/WAINA.2010.40"},{"key":"e_1_2_1_7_1","volume-title":"Proceedings of the International Conference on Machine Learning (ICML).","volume":"3","author":"Fern Xiaoli Zhang","unstructured":"Xiaoli Zhang Fern and Carla E. Brodley . 2003. Random projection for high dimensional data clustering: A cluster ensemble approach . In Proceedings of the International Conference on Machine Learning (ICML). Vol. 3 , 186--193. Xiaoli Zhang Fern and Carla E. Brodley. 2003. Random projection for high dimensional data clustering: A cluster ensemble approach. In Proceedings of the International Conference on Machine Learning (ICML). Vol. 3, 186--193."},{"key":"e_1_2_1_8_1","doi-asserted-by":"publisher","DOI":"10.1145\/1015330.1015414"},{"key":"e_1_2_1_9_1","doi-asserted-by":"publisher","DOI":"10.1002\/sam.v1:3"},{"key":"e_1_2_1_10_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2003.1240115"},{"key":"e_1_2_1_11_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.113"},{"key":"e_1_2_1_12_1","volume-title":"Frey and Delbert Dueck","author":"Brendan","year":"2007","unstructured":"Brendan J. Frey and Delbert Dueck . 2007 . Clustering by passing messages between data points. Science 315, 5814 (2007), 972--976. Brendan J. Frey and Delbert Dueck. 2007. Clustering by passing messages between data points. Science 315, 5814 (2007), 972--976."},{"key":"e_1_2_1_13_1","doi-asserted-by":"publisher","DOI":"10.1145\/1217299.1217303"},{"key":"e_1_2_1_14_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.inffus.2005.01.008"},{"key":"e_1_2_1_15_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2008.10.007"},{"key":"e_1_2_1_16_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.08.015"},{"key":"e_1_2_1_17_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2015.03.027"},{"key":"e_1_2_1_18_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF01908075"},{"key":"e_1_2_1_19_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2011.84"},{"key":"e_1_2_1_20_1","doi-asserted-by":"publisher","DOI":"10.1109\/34.824819"},{"key":"e_1_2_1_21_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patrec.2011.04.008"},{"key":"e_1_2_1_22_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.patcog.2015.05.006"},{"key":"e_1_2_1_23_1","doi-asserted-by":"publisher","DOI":"10.1007\/BF02289588"},{"key":"e_1_2_1_24_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2016.01.009"},{"key":"e_1_2_1_25_1","volume-title":"Proceedings of the 2004 IEEE International Conference On Systems, Man and Cybernetics.","volume":"2","author":"Ludmila","unstructured":"Ludmila I. Kuncheva and Stefan Todorov Hadjitodorov. 2004. Using diversity in cluster ensembles . In Proceedings of the 2004 IEEE International Conference On Systems, Man and Cybernetics. Vol. 2 , IEEE, 1214--1219. Ludmila I. Kuncheva and Stefan Todorov Hadjitodorov. 2004. Using diversity in cluster ensembles. In Proceedings of the 2004 IEEE International Conference On Systems, Man and Cybernetics. Vol. 2, IEEE, 1214--1219."},{"key":"e_1_2_1_26_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2006.226"},{"key":"e_1_2_1_27_1","volume-title":"Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR).","volume":"2","author":"Law Martin H. C.","unstructured":"Martin H. C. Law , Alexander P. Topchy , and Anil K. Jain . 2004. Multiobjective data clustering . In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Vol. 2 , IEEE, II--II. Martin H. C. Law, Alexander P. Topchy, and Anil K. Jain. 2004. Multiobjective data clustering. In Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR). Vol. 2, IEEE, II--II."},{"key":"e_1_2_1_28_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.ins.2016.10.008"},{"key":"e_1_2_1_29_1","doi-asserted-by":"publisher","DOI":"10.1137\/1.9781611972788.72"},{"key":"e_1_2_1_30_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2013.01.009"},{"key":"e_1_2_1_31_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10618-012-0290-x"},{"key":"e_1_2_1_32_1","doi-asserted-by":"publisher","DOI":"10.1109\/TNNLS.2015.2451151"},{"key":"e_1_2_1_33_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.artint.2010.04.018"},{"key":"e_1_2_1_34_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2015.2429133"},{"key":"e_1_2_1_35_1","doi-asserted-by":"publisher","DOI":"10.1145\/2808797.2808825"},{"key":"e_1_2_1_36_1","doi-asserted-by":"publisher","DOI":"10.1126\/science.1205438"},{"key":"e_1_2_1_37_1","volume-title":"Proceedings of the 2nd IEEE Workshop on Applications of Computer Vision","author":"Ferdinando","year":"1994","unstructured":"Ferdinando S. Samaria and Andy C. Harter. 1994. Parameterisation of a stochastic model for human face identification . In Proceedings of the 2nd IEEE Workshop on Applications of Computer Vision , 1994 . IEEE, 138--142. Ferdinando S. Samaria and Andy C. Harter. 1994. Parameterisation of a stochastic model for human face identification. In Proceedings of the 2nd IEEE Workshop on Applications of Computer Vision, 1994. IEEE, 138--142."},{"key":"e_1_2_1_38_1","volume-title":"Proceedings of the KDD Workshop on Text Mining.","volume":"400","author":"Steinbach Michael","year":"2000","unstructured":"Michael Steinbach , George Karypis , and Vipin Kumar . 2000 . A comparison of document clustering techniques . In Proceedings of the KDD Workshop on Text Mining. Vol. 400 , Boston, 525--526. Michael Steinbach, George Karypis, and Vipin Kumar. 2000. A comparison of document clustering techniques. In Proceedings of the KDD Workshop on Text Mining. Vol. 400, Boston, 525--526."},{"key":"e_1_2_1_39_1","doi-asserted-by":"publisher","DOI":"10.1162\/153244303321897735"},{"key":"e_1_2_1_40_1","doi-asserted-by":"publisher","DOI":"10.1109\/TPAMI.2005.237"},{"key":"e_1_2_1_41_1","doi-asserted-by":"publisher","DOI":"10.1007\/s10044-013-0341-y"},{"key":"e_1_2_1_42_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2014.2316512"},{"key":"e_1_2_1_43_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.neucom.2016.06.034"},{"key":"e_1_2_1_44_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.eswa.2014.01.028"},{"key":"e_1_2_1_45_1","doi-asserted-by":"publisher","DOI":"10.1023\/A:1009982220290"},{"key":"e_1_2_1_46_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2010.112"},{"key":"e_1_2_1_47_1","doi-asserted-by":"publisher","DOI":"10.1109\/TCYB.2016.2642999"},{"key":"e_1_2_1_48_1","doi-asserted-by":"publisher","DOI":"10.1109\/ICDM.2015.145"},{"key":"e_1_2_1_49_1","doi-asserted-by":"publisher","DOI":"10.1109\/TKDE.2015.2453162"},{"key":"e_1_2_1_50_1","doi-asserted-by":"publisher","DOI":"10.1145\/2611380"},{"key":"e_1_2_1_51_1","doi-asserted-by":"publisher","DOI":"10.1016\/j.knosys.2005.11.003"}],"container-title":["ACM Transactions on Knowledge Discovery from Data"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3211872","content-type":"unspecified","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/dl.acm.org\/doi\/pdf\/10.1145\/3211872","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,6,18]],"date-time":"2025-06-18T22:54:17Z","timestamp":1750287257000},"score":1,"resource":{"primary":{"URL":"https:\/\/dl.acm.org\/doi\/10.1145\/3211872"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2018,6,27]]},"references-count":51,"journal-issue":{"issue":"5","published-print":{"date-parts":[[2018,10,31]]}},"alternative-id":["10.1145\/3211872"],"URL":"https:\/\/doi.org\/10.1145\/3211872","relation":{},"ISSN":["1556-4681","1556-472X"],"issn-type":[{"value":"1556-4681","type":"print"},{"value":"1556-472X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2018,6,27]]},"assertion":[{"value":"2017-10-01","order":0,"name":"received","label":"Received","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-04-01","order":1,"name":"accepted","label":"Accepted","group":{"name":"publication_history","label":"Publication History"}},{"value":"2018-06-27","order":2,"name":"published","label":"Published","group":{"name":"publication_history","label":"Publication History"}}]}}