{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,7,3]],"date-time":"2026-07-03T18:30:32Z","timestamp":1783103432507,"version":"3.54.6"},"reference-count":62,"publisher":"Springer Science and Business Media LLC","issue":"1","license":[{"start":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T00:00:00Z","timestamp":1719532800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T00:00:00Z","timestamp":1719532800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100000923","name":"Australian Research Council","doi-asserted-by":"publisher","award":["ARC DP210100227"],"award-info":[{"award-number":["ARC DP210100227"]}],"id":[{"id":"10.13039\/501100000923","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["J Classif"],"published-print":{"date-parts":[[2025,3]]},"abstract":"<jats:title>Abstract<\/jats:title>\n          <jats:p>There is no, nor will there ever be, single best clustering algorithm. Nevertheless, we would still like to be able to distinguish between methods that work well on certain task types and those that systematically underperform. Clustering algorithms are traditionally evaluated using either internal or external validity measures. Internal measures quantify different aspects of the obtained partitions, e.g., the average degree of cluster compactness or point separability. However, their validity is questionable because the clusterings they endorse can sometimes be meaningless. External measures, on the other hand, compare the algorithms\u2019 outputs to fixed ground truth groupings provided by experts. In this paper, we argue that the commonly used classical partition similarity scores, such as the normalised mutual information, Fowlkes\u2013Mallows, or adjusted Rand index, miss some desirable properties. In particular, they do not identify worst-case scenarios correctly, nor are they easily interpretable. As a consequence, the evaluation of clustering algorithms on diverse benchmark datasets can be difficult. To remedy these issues, we propose and analyse a new measure: a version of the optimal set-matching accuracy, which is normalised, monotonic with respect to some similarity relation, scale-invariant, and corrected for the imbalancedness of cluster sizes (but neither symmetric nor adjusted for chance).<\/jats:p>","DOI":"10.1007\/s00357-024-09482-2","type":"journal-article","created":{"date-parts":[[2024,6,28]],"date-time":"2024-06-28T03:52:10Z","timestamp":1719546730000},"page":"2-30","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":7,"title":["Normalised Clustering Accuracy: An Asymmetric External Cluster Validity Measure"],"prefix":"10.1007","volume":"42","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0637-6028","authenticated-orcid":false,"given":"Marek","family":"Gagolewski","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2024,6,28]]},"reference":[{"key":"9482_CR1","doi-asserted-by":"publisher","first-page":"108152","DOI":"10.1016\/j.patcog.2021.108152","volume":"120","author":"M Ackerman","year":"2021","unstructured":"Ackerman, M., Ben-David, S., Br\u00e2nzei, S., & Loker, D. (2021). Weighted clustering: Towards solving the user\u2019s dilemma. Pattern Recognition, 120, 108152. https:\/\/doi.org\/10.1016\/j.patcog.2021.108152","journal-title":"Pattern Recognition"},{"key":"9482_CR2","doi-asserted-by":"publisher","first-page":"326","DOI":"10.1007\/s00357-021-09407-3","volume":"39","author":"J Andrews","year":"2022","unstructured":"Andrews, J., Browne, R., & Hvingelby, C. (2022). On assessments of agreement between fuzzy partitions. Journal of Classification, 39, 326\u2013342.","journal-title":"Journal of Classification"},{"issue":"1","key":"9482_CR3","doi-asserted-by":"publisher","first-page":"243","DOI":"10.1016\/j.patcog.2012.07.021","volume":"46","author":"O Arbelaitz","year":"2013","unstructured":"Arbelaitz, O., Gurrutxaga, I., Muguerza, J., P\u00e9rez, J. M., & Perona, I. (2013). An extensive comparative study of cluster validity indices. Pattern Recognition, 46(1), 243\u2013256. https:\/\/doi.org\/10.1016\/j.patcog.2012.07.021","journal-title":"Pattern Recognition"},{"key":"9482_CR4","doi-asserted-by":"publisher","first-page":"20255","DOI":"10.1109\/ACCESS.2021.3054621","volume":"9","author":"N Arinik","year":"2021","unstructured":"Arinik, N., Labatut, V., & Figueiredo, R. (2021). Characterizing and comparing external measures for the assessment of cluster analysis and community detection. IEEE Access, 9, 20255\u201320276. https:\/\/doi.org\/10.1109\/ACCESS.2021.3054621","journal-title":"IEEE Access"},{"key":"9482_CR5","doi-asserted-by":"publisher","DOI":"10.1201\/b18141","volume-title":"Pareto distributions","author":"BC Arnold","year":"2015","unstructured":"Arnold, B. C. (2015). Pareto distributions. New York, USA: Chapman and Hall\/CRC. https:\/\/doi.org\/10.1201\/b18141"},{"key":"9482_CR6","volume-title":"Plant sociology","author":"J Braun-Blanquet","year":"1932","unstructured":"Braun-Blanquet, J. (1932). Plant sociology. The study of plant communities: McGraw-Hill."},{"key":"9482_CR7","doi-asserted-by":"publisher","DOI":"10.1007\/978-94-017-0399-4","volume-title":"Handbook of means and their inequalities","author":"P Bullen","year":"2003","unstructured":"Bullen, P. (2003). Handbook of means and their inequalities. Dordrecht: Springer Science+Business Media."},{"issue":"1","key":"9482_CR8","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1080\/03610927408827101","volume":"3","author":"T Cali\u0144ski","year":"1974","unstructured":"Cali\u0144ski, T., & Harabasz, J. (1974). A dendrite method for cluster analysis. Communications in Statistics, 3(1), 1\u201327. https:\/\/doi.org\/10.1080\/03610927408827101","journal-title":"Communications in Statistics"},{"key":"9482_CR9","doi-asserted-by":"publisher","first-page":"70","DOI":"10.1016\/j.ins.2022.11.114","volume":"623","author":"A Campagner","year":"2023","unstructured":"Campagner, A., Ciucci, D., & Denoeux, T. (2023). A general framework for evaluating and comparing soft clusterings. Information Sciences, 623, 70\u201393. https:\/\/doi.org\/10.1016\/j.ins.2022.11.114","journal-title":"Information Sciences"},{"key":"9482_CR10","doi-asserted-by":"publisher","first-page":"203","DOI":"10.1111\/bmsp.12212","volume":"74","author":"J Chac\u00f3n","year":"2021","unstructured":"Chac\u00f3n, J. (2021). A close-up comparison of the misclassification error distance and the adjusted Rand index for external clustering evaluation. British Journal of Mathematical and Statistical Psychology, 74, 203\u2013231.","journal-title":"British Journal of Mathematical and Statistical Psychology"},{"key":"9482_CR11","doi-asserted-by":"publisher","first-page":"125","DOI":"10.1007\/s11634-022-00491-w","volume":"17","author":"J Chac\u00f3n","year":"2023","unstructured":"Chac\u00f3n, J., & Rastrojo, A. (2023). Minimum adjusted Rand index for two clusterings of a given size. Advances in Data Analysis and Classification, 17, 125\u2013133.","journal-title":"Advances in Data Analysis and Classification"},{"key":"9482_CR12","doi-asserted-by":"publisher","first-page":"103","DOI":"10.1007\/s00357-006-0006-2","volume":"23","author":"I Charon","year":"2006","unstructured":"Charon, I., Denoeud, L., Gu\u00e9noche, A., & Hudry, O. (2006). Maximum transfer distance between partitions. Journal of Classification, 23, 103\u2013121.","journal-title":"Journal of Classification"},{"issue":"4","key":"9482_CR13","doi-asserted-by":"publisher","first-page":"1679","DOI":"10.1109\/TAES.2016.140952","volume":"52","author":"D Crouse","year":"2016","unstructured":"Crouse, D. (2016). On implementing 2D rectangular assignment algorithms. IEEE Transactions on Aerospace and Electronic Systems, 52(4), 1679\u20131696. https:\/\/doi.org\/10.1109\/TAES.2016.140952","journal-title":"IEEE Transactions on Aerospace and Electronic Systems"},{"key":"9482_CR14","unstructured":"Dasgupta, S., & Ng, V. (2009). Single data, multiple clusterings. Proc. NIPS workshop: Clustering: Science or art? Towards principled approaches. Retrieved from https:\/\/clusteringtheory.org"},{"key":"9482_CR15","unstructured":"Dua, D., & Graff, C. (2022). UCI Machine Learning Repository. Irvine, CA. (http:\/\/archive.ics.uci.edu\/ml)"},{"issue":"3","key":"9482_CR16","doi-asserted-by":"publisher","first-page":"32","DOI":"10.1080\/01969727308546046","volume":"3","author":"J Dunn","year":"1974","unstructured":"Dunn, J. (1974). A fuzzy relative of the ISODATA process and its use in detecting compact well-separated clusters. Journal of Cybernetics, 3(3), 32\u201357. https:\/\/doi.org\/10.1080\/01969727308546046","journal-title":"Journal of Cybernetics"},{"key":"9482_CR17","doi-asserted-by":"publisher","first-page":"112","DOI":"10.1007\/s00357-020-09367-0","volume":"38","author":"A D\u2019Ambrosio","year":"2021","unstructured":"D\u2019Ambrosio, A., Amodio, S., Iorio, C., Pandolfo, G., & Siciliano, R. (2021). Adjusted Concordance Index: An extension of the adjusted Rand index to fuzzy partitions. Journal of Classification, 38, 112\u2013128.","journal-title":"Journal of Classification"},{"key":"9482_CR18","doi-asserted-by":"publisher","first-page":"303","DOI":"10.1007\/s11634-018-0346-x","volume":"13","author":"A Flynt","year":"2019","unstructured":"Flynt, A., Dean, N., & Nugent, R. (2019). sARI: A soft agreement measure for class partitions incorporating assignment probabilities. Advances in Data Analysis and Classification, 13, 303\u2013323.","journal-title":"Advances in Data Analysis and Classification"},{"issue":"383","key":"9482_CR19","doi-asserted-by":"publisher","first-page":"553","DOI":"10.1080\/01621459.1983.10478008","volume":"78","author":"E Fowlkes","year":"1983","unstructured":"Fowlkes, E., & Mallows, C. (1983). A method for comparing two hierarchical clusterings. Journal of the American Statistical Association, 78(383), 553\u2013569.","journal-title":"Journal of the American Statistical Association"},{"issue":"12","key":"9482_CR20","doi-asserted-by":"publisher","first-page":"4743","DOI":"10.1007\/s10489-018-1238-7","volume":"48","author":"P Fr\u00e4nti","year":"2018","unstructured":"Fr\u00e4nti, P., & Sieranoja, S. (2018). K-means properties on six clustering benchmark datasets. Applied Intelligence, 48(12), 4743\u20134759.","journal-title":"Applied Intelligence"},{"key":"9482_CR21","doi-asserted-by":"publisher","unstructured":"Gagolewski, M. (2021). genieclust: Fast and robust hierarchical clustering. SoftwareX, 15, 100722. Retrieved from https:\/\/genieclust.gagolewski.com, https:\/\/doi.org\/10.1016\/j.softx.2021.100722","DOI":"10.1016\/j.softx.2021.100722"},{"key":"9482_CR22","doi-asserted-by":"publisher","unstructured":"Gagolewski, M. (2022). A framework for benchmarking clustering algorithms. SoftwareX, 20, 101270. Retrieved from https:\/\/clustering-benchmarks.gagolewski.com, https:\/\/doi.org\/10.1016\/j.softx.2022.101270","DOI":"10.1016\/j.softx.2022.101270"},{"key":"9482_CR23","doi-asserted-by":"publisher","first-page":"620","DOI":"10.1016\/j.ins.2021.10.004","volume":"581","author":"M Gagolewski","year":"2021","unstructured":"Gagolewski, M., Bartoszuk, M., & Cena, A. (2021). Are cluster validity measures (in)valid? Information Sciences, 581, 620\u2013636. https:\/\/doi.org\/10.1016\/j.ins.2021.10.004","journal-title":"Information Sciences"},{"key":"9482_CR24","doi-asserted-by":"publisher","unstructured":"Gagolewski, M., et al. (2022). A benchmark suite for clustering algorithms: Version 1.1.0. Retrieved from https:\/\/github.com\/gagolews\/clustering-data-v1\/releases\/tag\/v1.1.0, https:\/\/doi.org\/10.5281\/zenodo.7088171","DOI":"10.5281\/zenodo.7088171"},{"issue":"87","key":"9482_CR25","first-page":"1","volume":"18","author":"A Gates","year":"2017","unstructured":"Gates, A., & Ahn, Y.-Y. (2017). The impact of random models on clustering similarity. Journal of Machine Learning Research, 18(87), 1\u201328.","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"9482_CR26","doi-asserted-by":"publisher","first-page":"8574","DOI":"10.1038\/s41598-019-44892-y","volume":"9","author":"A Gates","year":"2019","unstructured":"Gates, A., Wood, I., Hetrick, W., & Ahn, Y. (2019). Element-centric clustering comparison unifies overlaps and hierarchy. Scientific Reports, 9(1), 8574. https:\/\/doi.org\/10.1038\/s41598-019-44892-y","journal-title":"Scientific Reports"},{"key":"9482_CR27","doi-asserted-by":"publisher","DOI":"10.1007\/978-1-4612-9995-0","volume-title":"Measures of association for cross classifications","author":"L Goodman","year":"1979","unstructured":"Goodman, L., & Kruskal, W. (1979). Measures of association for cross classifications. Springer-Verlag."},{"key":"9482_CR28","doi-asserted-by":"publisher","DOI":"10.1017\/CBO9781139644150","volume-title":"Aggregation functions","author":"M Grabisch","year":"2009","unstructured":"Grabisch, M., Marichal, J.-L., Mesiar, R., & Pap, E. (2009). Aggregation functions. Cambridge University Press."},{"key":"9482_CR29","doi-asserted-by":"publisher","first-page":"522","DOI":"10.1016\/j.fss.2009.10.021","volume":"161","author":"D Graves","year":"2010","unstructured":"Graves, D., & Pedrycz, W. (2010). Kernel-based fuzzy clustering: A comparative experimental study. Fuzzy Sets and Systems, 161, 522\u2013543.","journal-title":"Fuzzy Sets and Systems"},{"key":"9482_CR30","doi-asserted-by":"publisher","first-page":"107","DOI":"10.1023\/A:1012801612483","volume":"17","author":"M Halkidi","year":"2001","unstructured":"Halkidi, M., Batistakis, Y., & Vazirgiannis, M. (2001). On clustering validation techniques. Journal of Intelligent Information Systems, 17, 107\u2013145. https:\/\/doi.org\/10.1023\/A:1012801612483","journal-title":"Journal of Intelligent Information Systems"},{"key":"9482_CR31","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/j.patrec.2015.04.009","volume":"64","author":"C Hennig","year":"2015","unstructured":"Hennig, C. (2015). What are the true clusters? Pattern Recognition Letters, 64, 53\u201362. https:\/\/doi.org\/10.1016\/j.patrec.2015.04.009","journal-title":"Pattern Recognition Letters"},{"key":"9482_CR32","doi-asserted-by":"publisher","unstructured":"Horibe, Y. (1985). Entropy and correlation, SMC-15(5), 641\u2013642. https:\/\/doi.org\/10.1109\/TSMC.1985.6313441","DOI":"10.1109\/TSMC.1985.6313441"},{"issue":"93","key":"9482_CR33","first-page":"2949","volume":"16","author":"D Horta","year":"2015","unstructured":"Horta, D., & Campello, R. (2015). Comparing hard and overlapping clusterings. Journal of Machine Learning Research, 16(93), 2949\u20132997.","journal-title":"Journal of Machine Learning Research"},{"issue":"1","key":"9482_CR34","doi-asserted-by":"publisher","first-page":"193","DOI":"10.1007\/BF01908075","volume":"2","author":"L Hubert","year":"1985","unstructured":"Hubert, L., & Arabie, P. (1985). Comparing partitions. Journal of Classification, 2(1), 193\u2013218. https:\/\/doi.org\/10.1007\/BF01908075","journal-title":"Journal of Classification"},{"issue":"3","key":"9482_CR35","doi-asserted-by":"publisher","first-page":"546","DOI":"10.1109\/TFUZZ.2011.2179303","volume":"20","author":"E H\u00fcllermeier","year":"2012","unstructured":"H\u00fcllermeier, E., Rifqi, M., Henzgen, S., & Senge, R. (2012). Comparing fuzzy partitions: A generalization of the Rand index and related measures. IEEE Transactions on Fuzzy Systems, 20(3), 546\u2013556. https:\/\/doi.org\/10.1109\/TFUZZ.2011.2179303","journal-title":"IEEE Transactions on Fuzzy Systems"},{"issue":"3","key":"9482_CR36","doi-asserted-by":"publisher","first-page":"517","DOI":"10.1109\/TSMC.1987.4309069","volume":"17","author":"T Kvalseth","year":"1987","unstructured":"Kvalseth, T. (1987). Entropy and correlation: Some comments. IEEE Transactions on Systems, Man, and Cybernetics, 17(3), 517\u2013519. https:\/\/doi.org\/10.1109\/TSMC.1987.4309069","journal-title":"IEEE Transactions on Systems, Man, and Cybernetics"},{"key":"9482_CR37","doi-asserted-by":"publisher","first-page":"58","DOI":"10.1016\/j.patcog.2016.12.003","volume":"65","author":"Y Lei","year":"2017","unstructured":"Lei, Y., Bezdek, J., Romano, S., Vinh, N., Chan, J., & Bailey, J. (2017). Ground truth bias in external cluster validity indices. Pattern Recognition, 65, 58\u201370. https:\/\/doi.org\/10.1016\/j.patcog.2016.12.003","journal-title":"Pattern Recognition"},{"key":"9482_CR38","doi-asserted-by":"publisher","first-page":"1","DOI":"10.1016\/j.ins.2019.02.046","volume":"487","author":"J Luna-Romera","year":"2019","unstructured":"Luna-Romera, J., Ballesteros, M., Garc\u00eda-Guti\u00e9rrez, J., & Riquelme, J. (2019). External clustering validity index based on chi-squared statistical test. Information Sciences, 487, 1\u201317. https:\/\/doi.org\/10.1016\/j.ins.2019.02.046","journal-title":"Information Sciences"},{"issue":"12","key":"9482_CR39","doi-asserted-by":"publisher","first-page":"1650","DOI":"10.1109\/TPAMI.2002.1114856","volume":"24","author":"U Maulik","year":"2002","unstructured":"Maulik, U., & Bandyopadhyay, S. (2002). Performance evaluation of some clustering algorithms and validity indices. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(12), 1650\u20131654. https:\/\/doi.org\/10.1109\/TPAMI.2002.1114856","journal-title":"IEEE Transactions on Pattern Analysis and Machine Intelligence"},{"key":"9482_CR40","doi-asserted-by":"publisher","unstructured":"Meil\u0103, M. (2005). Comparing clusterings - an axiomatic view. S. Wrobel & L. De Raedt (Eds.), Proc. Intl. Machine Learning Conference (ICML) (pp. 577-584). https:\/\/doi.org\/10.1145\/1102351.1102424","DOI":"10.1145\/1102351.1102424"},{"key":"9482_CR41","doi-asserted-by":"publisher","first-page":"9","DOI":"10.1023\/A:1007648401407","volume":"42","author":"M Meil\u0103","year":"2001","unstructured":"Meil\u0103, M., & Heckerman, D. (2001). An experimental comparison of modelbased clustering methods. Machine Learning, 42, 9\u201329. https:\/\/doi.org\/10.1023\/A:1007648401407","journal-title":"Machine Learning"},{"issue":"2","key":"9482_CR42","doi-asserted-by":"publisher","first-page":"159","DOI":"10.1007\/BF02294245","volume":"50","author":"GW Milligan","year":"1985","unstructured":"Milligan, G. W., & Cooper, M. C. (1985). An examination of procedures for determining the number of clusters in a data set. Psychometrika, 50(2), 159\u2013179.","journal-title":"Psychometrika"},{"issue":"1","key":"9482_CR43","doi-asserted-by":"publisher","first-page":"33","DOI":"10.1177\/0013164484441003","volume":"44","author":"L Morey","year":"1984","unstructured":"Morey, L., & Agresti, A. (1984). The measurement of classification agreement: An adjustment to the Rand statistic for chance agreement. Educational and Psychological Measurement, 44(1), 33\u201337. https:\/\/doi.org\/10.1177\/0013164484441003","journal-title":"Educational and Psychological Measurement"},{"key":"9482_CR44","unstructured":"M\u00fcllner, D. (2011). Modern hierarchical, agglomerative clustering algorithms. ArXiv:1109.2378."},{"key":"9482_CR45","unstructured":"Pedregosa, F., et al. (2011). Scikit-learn: Machine learning in Python. Journal of Machine Learning Research, 12(85), 2825\u20132830. Retrieved from http:\/\/jmlr.org\/papers\/v12\/pedregosa11a.html"},{"issue":"336","key":"9482_CR46","doi-asserted-by":"publisher","first-page":"846","DOI":"10.2307\/2284239","volume":"66","author":"W Rand","year":"1971","unstructured":"Rand, W. (1971). Objective criteria for the evaluation of clustering methods. Journal of the American Statistical Association, 66(336), 846\u2013850. https:\/\/doi.org\/10.2307\/2284239","journal-title":"Journal of the American Statistical Association"},{"issue":"8","key":"9482_CR47","doi-asserted-by":"publisher","first-page":"2173","DOI":"10.1109\/TKDE.2016.2551240","volume":"28","author":"M Rezaei","year":"2016","unstructured":"Rezaei, M., & Fr\u00e4nti, P. (2016). Set-matching measures for external cluster validity. IEEE Transactions on Knowledge and Data Engineering, 28(8), 2173\u20132186. https:\/\/doi.org\/10.1109\/TKDE.2016.2551240","journal-title":"IEEE Transactions on Knowledge and Data Engineering"},{"key":"9482_CR48","doi-asserted-by":"publisher","first-page":"53","DOI":"10.1016\/0377-0427(87)90125-7","volume":"20","author":"PJ Rousseeuw","year":"1987","unstructured":"Rousseeuw, P. J. (1987). Silhouettes: A graphical aid to the interpretation and validation of cluster analysis. Journal of Computational and Applied Mathematics, 20, 53\u201365. https:\/\/doi.org\/10.1016\/0377-0427(87)90125-7","journal-title":"Journal of Computational and Applied Mathematics"},{"issue":"3","key":"9482_CR49","doi-asserted-by":"publisher","first-page":"386","DOI":"10.1037\/1082-989X.9.3.386","volume":"9","author":"D Steinley","year":"2004","unstructured":"Steinley, D. (2004). Properties of the Hubert-Arabie adjusted Rand index. Psychological Methods, 9(3), 386\u2013396. https:\/\/doi.org\/10.1037\/1082-989X.9.3.386","journal-title":"Psychological Methods"},{"key":"9482_CR50","doi-asserted-by":"publisher","unstructured":"Strobl, C., & Leisch, F. (2022). Against the \u201cone method fits all data sets\u201d philosophy for comparison studies in methodological research. Biometrical Journal. https:\/\/doi.org\/10.1002\/bimj.2022001042","DOI":"10.1002\/bimj.2022001042"},{"key":"9482_CR51","doi-asserted-by":"publisher","first-page":"108223","DOI":"10.1016\/j.patcog.2021.108223","volume":"121","author":"B Tavakkol","year":"2022","unstructured":"Tavakkol, B., Choi, J., Jeong, M., & Albin, S. (2022). Object-based cluster validation with densities. Pattern Recognition, 121, 108223. https:\/\/doi.org\/10.1016\/j.patcog.2021.108223","journal-title":"Pattern Recognition"},{"key":"9482_CR52","doi-asserted-by":"publisher","first-page":"105501","DOI":"10.1016\/j.dib.2020.105501","volume":"30","author":"M Thrun","year":"2020","unstructured":"Thrun, M., & Ultsch, A. (2020). Clustering benchmark datasets exploiting the fundamental clustering problems. Data in Brief, 30, 105501. https:\/\/doi.org\/10.1016\/j.dib.2020.105501","journal-title":"Data in Brief"},{"issue":"3","key":"9482_CR53","doi-asserted-by":"publisher","first-page":"e1444","DOI":"10.1002\/widm.1444","volume":"12","author":"T Ullmann","year":"2022","unstructured":"Ullmann, T., Hennig, C., & Boulesteix, A.-L. (2022). Validation of cluster analysis results on validation data: A systematic framework. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, 12(3), e1444. https:\/\/doi.org\/10.1002\/widm.1444","journal-title":"Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery"},{"key":"9482_CR54","doi-asserted-by":"publisher","first-page":"353","DOI":"10.1007\/s41237-018-0075-7","volume":"46","author":"H van der Hoef","year":"2019","unstructured":"van der Hoef, H., & Warrens, M. (2019). Understanding information theoretic measures for comparing clusterings. Behaviormetrika, 46, 353\u2013370. https:\/\/doi.org\/10.1007\/s41237-018-0075-7","journal-title":"Behaviormetrika"},{"key":"9482_CR55","doi-asserted-by":"publisher","unstructured":"van Mechelen, I., Boulesteix, A.-L., Dangl, R., et al. (2023). A white paper on good research practices in benchmarking: The case of cluster analysis. Wiley Interdisciplinary Reviews: Data Mining and Knowledge Discovery, e1511. https:\/\/doi.org\/10.1002\/widm.1511","DOI":"10.1002\/widm.1511"},{"key":"9482_CR56","first-page":"2837","volume":"11","author":"N Vinh","year":"2010","unstructured":"Vinh, N., Epps, J., & Bailey, J. (2010). Information theoretic measures for clusterings comparison: Variants, properties, normalization and correction for chance. Journal of Machine Learning Research, 11, 2837\u20132854.","journal-title":"Journal of Machine Learning Research"},{"key":"9482_CR57","unstructured":"von Luxburg, U., Williamson, R., & Guyon, I. (2012). Clustering: Science or art? I. Guyon et al. (Eds.), Proc. ICML Workshop on Unsupervised and Transfer Learning (Vol. 27, pp. 65-79)."},{"key":"9482_CR58","unstructured":"Wagner, S., & Wagner, D. (2006). Comparing clusterings - an overview (Tech. Rep. No. 2006-04). Faculty of Informatics, Universit\u00e4t Karlsruhe (TH). Retrieved from https:\/\/i11www.iti.kit.edu\/extra\/publications\/ww-cco-06.pdf"},{"key":"9482_CR59","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1007\/s00357-022-09413-z","volume":"39","author":"M Warrens","year":"2022","unstructured":"Warrens, M., & van der Hoef, H. (2022). Understanding the adjusted Rand index and other partition comparison indices based on counting object pairs. Journal of Classification, 39, 387\u2013509. https:\/\/doi.org\/10.1007\/s00357-022-09413-z","journal-title":"Journal of Classification"},{"key":"9482_CR60","unstructured":"Xiang, Q., et al. (2012). A split-merge framework for comparing clusterings. Proc. Intl. Machine Learning Conference (ICML) (pp. 1259-1266)."},{"key":"9482_CR61","doi-asserted-by":"crossref","unstructured":"Xiong, H., & Li, Z. (2014). Clustering validation measures. C. Aggarwal & C. Reddy (Eds.), Data clustering: Algorithms and applications (pp. 571-606). CRC Press.","DOI":"10.1201\/9781315373515-23"},{"key":"9482_CR62","doi-asserted-by":"publisher","first-page":"113367","DOI":"10.1016\/j.eswa.2020.113367","volume":"151","author":"Q Xu","year":"2020","unstructured":"Xu, Q., Zhang, Q., Liu, J., & Luo, B. (2020). Efficient synthetical clustering validity indexes for hierarchical clustering. Expert Systems with Applications, 151, 113367. https:\/\/doi.org\/10.1016\/j.eswa.2020.113367","journal-title":"Expert Systems with Applications"}],"container-title":["Journal of Classification"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00357-024-09482-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s00357-024-09482-2\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s00357-024-09482-2.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,3,19]],"date-time":"2025-03-19T08:10:44Z","timestamp":1742371844000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s00357-024-09482-2"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,6,28]]},"references-count":62,"journal-issue":{"issue":"1","published-print":{"date-parts":[[2025,3]]}},"alternative-id":["9482"],"URL":"https:\/\/doi.org\/10.1007\/s00357-024-09482-2","relation":{},"ISSN":["0176-4268","1432-1343"],"issn-type":[{"value":"0176-4268","type":"print"},{"value":"1432-1343","type":"electronic"}],"subject":[],"published":{"date-parts":[[2024,6,28]]},"assertion":[{"value":"10 June 2024","order":1,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"28 June 2024","order":2,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}},{"order":1,"name":"Ethics","group":{"name":"EthicsHeading","label":"Declarations"}},{"value":"The author declares no competing interests.","order":2,"name":"Ethics","group":{"name":"EthicsHeading","label":"Conflict of Interest"}}]}}