{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,30]],"date-time":"2026-06-30T15:57:16Z","timestamp":1782835036712,"version":"3.54.5"},"reference-count":35,"publisher":"Springer Science and Business Media LLC","issue":"7","license":[{"start":{"date-parts":[[2021,5,4]],"date-time":"2021-05-04T00:00:00Z","timestamp":1620086400000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2021,5,4]],"date-time":"2021-05-04T00:00:00Z","timestamp":1620086400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"crossref","award":["DEC-2015\/19\/B\/ST6\/02637"],"award-info":[{"award-number":["DEC-2015\/19\/B\/ST6\/02637"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"crossref"}]},{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"crossref","award":["DEC-2015\/19\/B\/ST6\/02637"],"award-info":[{"award-number":["DEC-2015\/19\/B\/ST6\/02637"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"crossref"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Knowl Inf Syst"],"published-print":{"date-parts":[[2021,7]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>There is a certain belief among data science researchers and enthusiasts alike that clustering can be used to improve classification quality. Insofar as this belief is fairly uncontroversial, it is also very general and therefore produces a lot of confusion around the subject. There are many ways of using clustering in classification and it obviously cannot always improve the quality of predictions, so a question arises, in which scenarios exactly does it help? Since we were unable to find a rigorous study addressing this question, in this paper, we try to shed some light on the concept of using clustering for classification. To do so, we first put forward a framework for incorporating clustering as a method of feature extraction for classification. The framework is generic w.r.t. similarity measures, clustering algorithms, classifiers, and datasets and serves as a platform to answer ten essential questions regarding the studied subject. Each answer is formulated based on a separate experiment on 16 publicly available datasets, followed by an appropriate statistical analysis. After performing the experiments and analyzing the results separately, we discuss them from a global perspective and form general conclusions regarding using clustering as feature extraction for classification.\n<\/jats:p>","DOI":"10.1007\/s10115-021-01572-6","type":"journal-article","created":{"date-parts":[[2021,5,4]],"date-time":"2021-05-04T13:03:55Z","timestamp":1620133435000},"page":"1771-1805","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":37,"title":["A study on using data clustering for feature extraction to improve the quality of classification"],"prefix":"10.1007","volume":"63","author":[{"ORCID":"https:\/\/orcid.org\/0000-0001-7281-284X","authenticated-orcid":false,"given":"Maciej","family":"Piernik","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"given":"Tadeusz","family":"Morzy","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2021,5,4]]},"reference":[{"issue":"6","key":"1572_CR1","first-page":"336","volume":"5","author":"YK Alapati","year":"2016","unstructured":"Alapati YK, Sindhu K (2016) Combining clustering with classification a technique to improve classification accuracy bibtex. Int J Comput Sci Eng 5(6):336\u2013338","journal-title":"Int J Comput Sci Eng"},{"key":"1572_CR2","first-page":"614","volume-title":"Progress in pattern recognition","author":"I Bonet","year":"2006","unstructured":"Bonet I, Saeys Y, \u00c1balo RG, Garc\u00eda MM, Sanchez R, Van de Peer Y (2006) Feature extraction using clustering of protein. In: Mart\u00ednez-Trinidad JF, Carrasco Ochoa JA, Kittler J (eds) Progress in pattern recognition. Image analysis and applications, Springer, Berlin, pp 614\u2013623"},{"key":"1572_CR3","doi-asserted-by":"crossref","unstructured":"Chakraborty T (2017) Ec3: Combining clustering and classification for ensemble learning. In: 2017 IEEE international conference on data mining (ICDM), pp 781\u2013786","DOI":"10.1109\/ICDM.2017.92"},{"key":"1572_CR4","doi-asserted-by":"crossref","unstructured":"Cheng H, Yan X, Han J, Hsu CW (2007) Discriminative frequent pattern analysis for effective classification. In: Proceedings of the 2007 IEEE 23rd international conference on data engineering (ICDE \u201907). IEEE Computer Society, Washington, DC, USA, pp 716\u2013725","DOI":"10.1109\/ICDE.2007.367917"},{"key":"1572_CR5","doi-asserted-by":"crossref","unstructured":"Cheng H, Yan X, Han J, Yu PS (2008) Direct discriminative pattern mining for effective classification. In: Proceedings of the 2008 IEEE 24th international conference on data engineering (ICDE \u201908). IEEE Computer Society, Washington, DC, USA, pp 169\u2013178","DOI":"10.1109\/ICDE.2008.4497425"},{"key":"1572_CR6","doi-asserted-by":"publisher","first-page":"131","DOI":"10.3233\/IDA-1997-1302","volume":"1","author":"M Dash","year":"1997","unstructured":"Dash M, Liu H (1997) Feature selection for classification. Intell Data Anal 1:131\u2013156","journal-title":"Intell Data Anal"},{"key":"1572_CR7","doi-asserted-by":"publisher","first-page":"247","DOI":"10.1007\/978-3-642-23957-1_28","volume-title":"Engineering applications of neural networks","author":"S El Ferchichi","year":"2011","unstructured":"El Ferchichi S, Zidi S, Laabidi K, Ksouri M, Maouche S (2011) A new feature extraction method based on clustering for face recognition. In: Iliadis L, Jayne C (eds) Engineering applications of neural networks. Springer, Berlin, pp 247\u2013253"},{"issue":"1","key":"1572_CR8","first-page":"863","volume":"61","author":"A Fern\u00e1ndez","year":"2018","unstructured":"Fern\u00e1ndez A, Garc\u00eda S, Herrera F, Chawla NV (2018) Smote for learning from imbalanced data: progress and challenges, marking the 15-year anniversary. J Artif Int Res 61(1):863\u2013905","journal-title":"J Artif Int Res"},{"key":"1572_CR9","first-page":"3","volume":"1","author":"RA Fisher","year":"1921","unstructured":"Fisher RA (1921) On the probable error of a coefficient of correlation deduced from a small sample. Metron 1:3\u201332","journal-title":"Metron"},{"key":"1572_CR10","doi-asserted-by":"publisher","first-page":"2007","DOI":"10.1126\/science.1136800","volume":"315","author":"BJ Frey","year":"2007","unstructured":"Frey BJ, Dueck D (2007) Clustering by passing messages between data points. Science 315:2007","journal-title":"Science"},{"issue":"200","key":"1572_CR11","doi-asserted-by":"publisher","first-page":"675","DOI":"10.1080\/01621459.1937.10503522","volume":"32","author":"M Friedman","year":"1937","unstructured":"Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(200):675\u2013701","journal-title":"J Am Stat Assoc"},{"key":"1572_CR12","doi-asserted-by":"publisher","first-page":"290","DOI":"10.1016\/j.neucom.2012.08.020","volume":"101","author":"H Gan","year":"2013","unstructured":"Gan H, Sang N, Huang R, Tong X, Dan Z (2013) Using clustering analysis to improve semi-supervised classification. Neurocomputing 101:290\u2013298","journal-title":"Neurocomputing"},{"key":"1572_CR13","doi-asserted-by":"publisher","DOI":"10.1007\/978-0-387-21606-5","volume-title":"The elements of statistical learning","author":"T Hastie","year":"2001","unstructured":"Hastie T, Tibshirani R, Friedman J (2001) The elements of statistical learning. Springer series in statistics, Springer, New York"},{"issue":"1","key":"1572_CR14","doi-asserted-by":"publisher","first-page":"40","DOI":"10.1145\/1007730.1007737","volume":"6","author":"T Jo","year":"2004","unstructured":"Jo T, Japkowicz N (2004) Class imbalances versus small disjuncts. ACM SIGKDD Explor Newslett 6(1):40\u201349","journal-title":"ACM SIGKDD Explor Newslett"},{"key":"1572_CR15","unstructured":"Khan M (2017) Kmeans clustering for classification. https:\/\/towardsdatascience.com\/kmeans-clustering-for-classification-74b992405d0a"},{"key":"1572_CR16","doi-asserted-by":"publisher","DOI":"10.1007\/978-3-642-88163-3","volume-title":"Self-organization and associative memory","author":"T Kohonen","year":"1989","unstructured":"Kohonen T (1989) Self-organization and associative memory, 3rd edn. Springer, Berlin","edition":"3"},{"key":"1572_CR17","unstructured":"Kuhn M (2009) The caret package. http:\/\/topepo.github.io\/caret\/"},{"key":"1572_CR18","unstructured":"Lango M, Brzezinski D, , Stefanowski J (2018) Imweights: Classifying imbalance data using local and neighborhood information. In: Proceedings of the 2nd international workshop on learning with imbalanced domains: theory and applications (LIDTA 2018), Dublin, Ireland, September 10\u201314, 2018"},{"key":"1572_CR19","first-page":"278","volume-title":"Robust tests for equality of variances","author":"H Levene","year":"1960","unstructured":"Levene H (1960) Robust tests for equality of variances. Stanford University Press, Stanford, pp 278\u2013292"},{"key":"1572_CR20","unstructured":"Lichman M (2013) UCI machine learning repository. http:\/\/archive.ics.uci.edu\/ml"},{"key":"1572_CR21","doi-asserted-by":"publisher","first-page":"129","DOI":"10.1109\/TIT.1982.1056489","volume":"28","author":"SP Lloyd","year":"1982","unstructured":"Lloyd SP (1982) Least squares quantization in PCM. IEEE Trans Inf Theory 28:129\u2013137","journal-title":"IEEE Trans Inf Theory"},{"key":"1572_CR22","doi-asserted-by":"publisher","first-page":"107676","DOI":"10.1016\/j.patcog.2020.107676","volume":"111","author":"J Ma","year":"2021","unstructured":"Ma J, Zhang Y, Zhang L (2021) Discriminative subspace matrix factorization for multiview data clustering. Pattern Recogn 111:107676","journal-title":"Pattern Recogn"},{"key":"1572_CR23","unstructured":"Nemenyi P (1963) Distribution-free multiple comparisons. Ph.D. thesis, Princeton University, New Jersey, USA"},{"key":"1572_CR24","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in Python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"key":"1572_CR25","unstructured":"R Development Core Team (2008) R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. http:\/\/www.R-project.org, ISBN 3-900051-07-0"},{"key":"1572_CR26","doi-asserted-by":"publisher","first-page":"1256","DOI":"10.3923\/itj.2009.1256.1262","volume":"8","author":"A Sa","year":"2009","unstructured":"Sa A, Sulaiman N, Mustapha A, Mustapha N (2009) K-means clustering to improve the accuracy of decision tree response classification. Inf Technol J 8:1256\u20131262","journal-title":"Inf Technol J"},{"issue":"3\/4","key":"1572_CR27","doi-asserted-by":"publisher","first-page":"591","DOI":"10.2307\/2333709","volume":"52","author":"SS Shapiro","year":"1965","unstructured":"Shapiro SS, Wilk MB (1965) An analysis of variance test for normality (complete samples). Biometrika 52(3\/4):591\u2013611","journal-title":"Biometrika"},{"issue":"3A","key":"1572_CR28","first-page":"230","volume":"6","author":"KG Srinivasa","year":"2006","unstructured":"Srinivasa KG, Venugopal KR, Patnaik LM (2006) Feature extraction using fuzzy c-means clustering for data mining systems. Int J Comput Sci Netw Secur 6(3A):230\u2013236","journal-title":"Int J Comput Sci Netw Secur"},{"issue":"1","key":"1572_CR29","doi-asserted-by":"publisher","first-page":"1","DOI":"10.2307\/2331554","volume":"6","author":"STUDENT","year":"1908","unstructured":"STUDENT (1908) The probable error of a mean. Biometrika 6(1):1\u201325","journal-title":"Biometrika"},{"key":"1572_CR30","unstructured":"Tang J, Alelyani S, Liu H (2014) Feature selection for classification: a review. CRC Press, pp 37\u201364"},{"issue":"2","key":"1572_CR31","doi-asserted-by":"publisher","first-page":"411","DOI":"10.1111\/1467-9868.00293","volume":"63","author":"R Tibshirani","year":"2001","unstructured":"Tibshirani R, Walther G, Hastie T (2001) Estimating the number of clusters in a dataset via the gap statistic. J R Stat Soc Ser B (Stat Methodol) 63(2):411\u2013423","journal-title":"J R Stat Soc Ser B (Stat Methodol)"},{"key":"1572_CR32","unstructured":"Trivedi S, Pardos ZA, Heffernan NT (2015) The utility of clustering in prediction tasks. CoRR arXiv:1509.06163"},{"key":"1572_CR33","doi-asserted-by":"publisher","first-page":"62","DOI":"10.1186\/1687-6180-2011-62","volume":"1","author":"CF Tsai","year":"2011","unstructured":"Tsai CF, Lin WY, Hong ZF, Hsieh CY (2011) Distance-based features in pattern classification. EURASIP J Adv Signal Process 1:62","journal-title":"EURASIP J Adv Signal Process"},{"issue":"6","key":"1572_CR34","doi-asserted-by":"publisher","first-page":"80","DOI":"10.2307\/3001968","volume":"1","author":"F Wilcoxon","year":"1945","unstructured":"Wilcoxon F (1945) Individual comparisons by ranking methods. Biom Bull 1(6):80\u201383","journal-title":"Biom Bull"},{"issue":"2","key":"1572_CR35","doi-asserted-by":"publisher","first-page":"83","DOI":"10.26599\/BDMA.2018.9020003","volume":"1","author":"Y Yang","year":"2018","unstructured":"Yang Y, Wang H (2018) Multi-view clustering: a survey. Big Data Mini Anal 1(2):83\u2013107","journal-title":"Big Data Mini Anal"}],"container-title":["Knowledge and Information Systems"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10115-021-01572-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/article\/10.1007\/s10115-021-01572-6\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"https:\/\/link.springer.com\/content\/pdf\/10.1007\/s10115-021-01572-6.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,6,18]],"date-time":"2021-06-18T07:05:17Z","timestamp":1623999917000},"score":1,"resource":{"primary":{"URL":"https:\/\/link.springer.com\/10.1007\/s10115-021-01572-6"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2021,5,4]]},"references-count":35,"journal-issue":{"issue":"7","published-print":{"date-parts":[[2021,7]]}},"alternative-id":["1572"],"URL":"https:\/\/doi.org\/10.1007\/s10115-021-01572-6","relation":{},"ISSN":["0219-1377","0219-3116"],"issn-type":[{"value":"0219-1377","type":"print"},{"value":"0219-3116","type":"electronic"}],"subject":[],"published":{"date-parts":[[2021,5,4]]},"assertion":[{"value":"31 July 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"13 April 2021","order":2,"name":"revised","label":"Revised","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"17 April 2021","order":3,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"4 May 2021","order":4,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}