{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2026,6,3]],"date-time":"2026-06-03T04:20:11Z","timestamp":1780460411430,"version":"3.54.1"},"reference-count":33,"publisher":"Springer Science and Business Media LLC","issue":"3","license":[{"start":{"date-parts":[[2020,2,10]],"date-time":"2020-02-10T00:00:00Z","timestamp":1581292800000},"content-version":"tdm","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"},{"start":{"date-parts":[[2020,2,10]],"date-time":"2020-02-10T00:00:00Z","timestamp":1581292800000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/creativecommons.org\/licenses\/by\/4.0"}],"funder":[{"DOI":"10.13039\/501100004281","name":"Narodowe Centrum Nauki","doi-asserted-by":"publisher","award":["2017\/27\/B\/ST6\/01325"],"award-info":[{"award-number":["2017\/27\/B\/ST6\/01325"]}],"id":[{"id":"10.13039\/501100004281","id-type":"DOI","asserted-by":"publisher"}]}],"content-domain":{"domain":["link.springer.com"],"crossmark-restriction":false},"short-container-title":["Pattern Anal Applic"],"published-print":{"date-parts":[[2020,8]]},"abstract":"<jats:title>Abstract<\/jats:title><jats:p>One of the crucial problems of designing a classifier ensemble is the proper choice of the base classifier line-up. Basically, such an ensemble is formed on the basis of individual classifiers, which are trained in such a way to ensure their high diversity or they are chosen on the basis of pruning which reduces the number of predictive models in order to improve efficiency and predictive performance of the ensemble. This work is focusing on clustering-based ensemble pruning, which looks for the group of similar classifiers which are replaced by their representatives. We propose a novel pruning criterion based on well-known diversity measures and describe three algorithms using classifier clustering. The first method selects the model with the best predictive performance from each cluster to form the final ensemble, the second one employs the multistage organization, where instead of removing the classifiers from the ensemble each classifier cluster makes the decision independently, while the third proposition combines multistage organization and sampling with replacement. The proposed approaches were evaluated using 30 datasets with different characteristics. Experimentation results validated through statistical tests confirmed the usefulness of the proposed approaches.<\/jats:p>","DOI":"10.1007\/s10044-020-00867-8","type":"journal-article","created":{"date-parts":[[2020,2,10]],"date-time":"2020-02-10T18:03:05Z","timestamp":1581357785000},"page":"1049-1058","update-policy":"https:\/\/doi.org\/10.1007\/springer_crossmark_policy","source":"Crossref","is-referenced-by-count":21,"title":["Novel clustering-based pruning algorithms"],"prefix":"10.1007","volume":"23","author":[{"ORCID":"https:\/\/orcid.org\/0000-0002-4224-6709","authenticated-orcid":false,"given":"Pawe\u0142","family":"Zyblewski","sequence":"first","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0146-4205","authenticated-orcid":false,"given":"Micha\u0142","family":"Wo\u017aniak","sequence":"additional","affiliation":[],"role":[{"vocabulary":"crossref","role":"author"}]}],"member":"297","published-online":{"date-parts":[[2020,2,10]]},"reference":[{"issue":"2\u20133","key":"867_CR1","first-page":"255","volume":"17","author":"J Alcal\u00e1-Fdez","year":"2011","unstructured":"Alcal\u00e1-Fdez J, Fern\u00e1ndez A, Luengo J, Derrac J, Garc\u00eda S (2011) Keel data-mining software tool: data set repository, integration of algorithms and experimental analysis framework. Mult Valued Log Soft Comput 17(2\u20133):255\u2013287","journal-title":"Mult Valued Log Soft Comput"},{"issue":"2","key":"867_CR2","doi-asserted-by":"publisher","first-page":"261","DOI":"10.1016\/S0893-6080(02)00187-9","volume":"16","author":"B Bakker","year":"2003","unstructured":"Bakker B, Heskes T (2003) Clustering ensembles of neural network models. Neural Netw 16(2):261\u2013269","journal-title":"Neural Netw"},{"issue":"2","key":"867_CR3","doi-asserted-by":"publisher","first-page":"103","DOI":"10.3233\/HIS-2007-4204","volume":"4","author":"S Bian","year":"2007","unstructured":"Bian S, Wang W (2007) On diversity and accuracy of homogeneous and heterogeneous ensembles. Int J Hybrid Intell Syst 4(2):103\u2013128","journal-title":"Int J Hybrid Intell Syst"},{"key":"867_CR4","doi-asserted-by":"publisher","first-page":"109","DOI":"10.1007\/3-540-45164-1_12","volume-title":"Machine learning: ECML 2000","author":"P Cunningham","year":"2000","unstructured":"Cunningham P, Carney J (2000) Diversity versus quality in classification ensembles based on feature selection. In: L\u00f3pez\u00a0de M\u00e1ntaras R, Plaza E (eds) Machine learning: ECML 2000. Springer, Berlin, Heidelberg, pp 109\u2013116"},{"key":"867_CR5","doi-asserted-by":"publisher","first-page":"394","DOI":"10.1016\/j.knosys.2012.08.024","volume":"37","author":"Q Dai","year":"2013","unstructured":"Dai Q (2013) A competitive ensemble pruning approach based on cross-validation technique. Knowl Based Syst 37:394\u2013414","journal-title":"Knowl Based Syst"},{"issue":"2","key":"867_CR6","doi-asserted-by":"publisher","first-page":"139","DOI":"10.1023\/A:1007607513941","volume":"40","author":"TG Dietterich","year":"2000","unstructured":"Dietterich TG (2000) An experimental comparison of three methods for constructing ensembles of decision trees: bagging, boosting, and randomization. Mach Learn 40(2):139\u2013157","journal-title":"Mach Learn"},{"key":"867_CR7","unstructured":"Dua D, Graff C (2017) UCI machine learning repository. http:\/\/archive.ics.uci.edu\/ml. Accessed 23 May 2019"},{"key":"867_CR8","volume-title":"Statistical methods for rates and proportions","author":"JL Fleiss","year":"1981","unstructured":"Fleiss JL (1981) Statistical methods for rates and proportions. Wiley, Hoboken"},{"issue":"5","key":"867_CR9","doi-asserted-by":"publisher","first-page":"387","DOI":"10.1631\/jzus.2005.A0387","volume":"6","author":"Q Fu","year":"2005","unstructured":"Fu Q, SX HU, Zhao S (2005) Clustering-based selective neural network ensemble. J Zhejiang Univ Sci 6(5):387\u2013392","journal-title":"J Zhejiang Univ Sci"},{"key":"867_CR10","doi-asserted-by":"crossref","unstructured":"Giacinto G, Roli F, Fumera G (2000) Design of effective multiple classifier systems by clustering of classifiers. In: 15th International conference on pattern recognition, ICPR 2000","DOI":"10.1109\/ICPR.2000.906039"},{"issue":"8","key":"867_CR11","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1109\/34.709601","volume":"20","author":"TK Ho","year":"1998","unstructured":"Ho TK (1998a) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20(8):832\u2013844","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"867_CR12","doi-asserted-by":"publisher","first-page":"832","DOI":"10.1109\/34.709601","volume":"20","author":"TK Ho","year":"1998","unstructured":"Ho TK (1998b) The random subspace method for constructing decision forests. IEEE Trans Pattern Anal Mach Intell 20:832\u2013844","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"867_CR13","unstructured":"Ho TK (2000) Complexity of classification problems and comparative advantages of combined classifiers. In: Multiple classifier systems. Springer, Berlin Heidelberg, pp 97\u2013106"},{"issue":"1","key":"867_CR14","doi-asserted-by":"publisher","first-page":"66","DOI":"10.1109\/34.273716","volume":"16","author":"TK Ho","year":"1994","unstructured":"Ho TK, Hull JJ, Srihari SN (1994) Decision combination in multiple classifier systems. IEEE Trans Pattern Anal Mach Intell 16(1):66\u201375","journal-title":"IEEE Trans Pattern Anal Mach Intell"},{"key":"867_CR15","unstructured":"Kohavi R, Wolpert D (1996) Bias plus variance decomposition for zero-one loss functions. In: Proceedings of the thirteenth international conference on international conference on machine learning. Morgan Kaufmann Publishers Inc., San Francisco, ICML\u201996, pp 275\u2013283"},{"issue":"2","key":"867_CR16","doi-asserted-by":"publisher","first-page":"427","DOI":"10.1007\/s10044-015-0505-z","volume":"20","author":"B Krawczyk","year":"2017","unstructured":"Krawczyk B, Cyganek B (2017) Selecting locally specialised classifiers for one-class classification ensembles. Pattern Anal Appl 20(2):427\u2013439","journal-title":"Pattern Anal Appl"},{"key":"867_CR17","doi-asserted-by":"publisher","first-page":"274","DOI":"10.1007\/978-3-319-07617-1_25","volume-title":"Hybrid artificial intelligence systems","author":"B Krawczyk","year":"2014","unstructured":"Krawczyk B, Ksieniewicz P, Wo\u017aniak M (2014) Hyperspectral image analysis based on color channels and ensemble classifier. In: Pan JS, Wo\u017aniak M, Quintian H, Corchado E, Polycarpou M, de Carvalho ACPLF (eds) Hybrid artificial intelligence systems. Springer, Cham, pp 274\u2013284"},{"key":"867_CR18","doi-asserted-by":"publisher","first-page":"132","DOI":"10.1016\/j.inffus.2017.02.004","volume":"37","author":"B Krawczyk","year":"2017","unstructured":"Krawczyk B, Minku LL, Gama J, Stefanowski J, Wozniak M (2017) Ensemble learning for data stream analysis: a survey. Inf Fusion 37:132\u2013156","journal-title":"Inf Fusion"},{"key":"867_CR19","doi-asserted-by":"publisher","first-page":"660","DOI":"10.1007\/978-3-030-29859-3_56","volume-title":"Hybrid artificial intelligent systems","author":"P Ksieniewicz","year":"2019","unstructured":"Ksieniewicz P (2019) Combining random subspace approach with smote oversampling for imbalanced data classification. In: P\u00e9rez Garc\u00eda H, S\u00e1nchez Gonz\u00e1lez L, Castej\u00f3n Limas M, Quinti\u00e1n Pardo H, Corchado Rodr\u00edguez E (eds) Hybrid artificial intelligent systems. Springer, Cham, pp 660\u2013673"},{"key":"867_CR20","doi-asserted-by":"publisher","DOI":"10.1002\/0471660264","volume-title":"Combining pattern classifiers: methods and algorithms","author":"LI Kuncheva","year":"2004","unstructured":"Kuncheva LI (2004) Combining pattern classifiers: methods and algorithms. Wiley, Hoboken"},{"issue":"2","key":"867_CR21","doi-asserted-by":"publisher","first-page":"181","DOI":"10.1023\/A:1022859003006","volume":"51","author":"LI Kuncheva","year":"2003","unstructured":"Kuncheva LI, Whitaker CJ (2003) Measures of diversity in classifier ensembles and their relationship with the ensemble accuracy. Mach Learn 51(2):181\u2013207","journal-title":"Mach Learn"},{"key":"867_CR22","doi-asserted-by":"crossref","unstructured":"Lazarevic A, Obradovic Z (2001) The effective pruning of neural network classifiers. In: 2001 IEEE\/INNS international conference on neural networks, IJCNN 2001","DOI":"10.1109\/IJCNN.2001.939461"},{"key":"867_CR23","doi-asserted-by":"publisher","first-page":"245","DOI":"10.1016\/j.ins.2015.10.011","volume":"330","author":"Y Li","year":"2016","unstructured":"Li Y, Bai C, Reddy CK (2016) A distributed ensemble approach for mining healthcare data under privacy constraints. Inf Sci 330:245\u2013259","journal-title":"Inf Sci"},{"key":"867_CR24","unstructured":"Margineantu DD, Dietterich TG (1997) Pruning adaptive boosting. In: Proceedings of the fourteenth international conference on machine learning. Morgan Kaufmann Publishers Inc., San Francisco, ICML \u201997, pp 211\u2013218"},{"key":"867_CR25","first-page":"2825","volume":"12","author":"F Pedregosa","year":"2011","unstructured":"Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, Blondel M, Prettenhofer P, Weiss R, Dubourg V, Vanderplas J, Passos A, Cournapeau D, Brucher M, Perrot M, Duchesnay E (2011) Scikit-learn: machine learning in python. J Mach Learn Res 12:2825\u20132830","journal-title":"J Mach Learn Res"},{"issue":"4","key":"867_CR26","doi-asserted-by":"publisher","first-page":"333","DOI":"10.1007\/s100440200030","volume":"2","author":"D Ruta","year":"2002","unstructured":"Ruta D, Gabrys B (2002) A theoretical analysis of the limits of majority voting errors for multiple classifier systems. Pattern Anal Appl 2(4):333\u2013350","journal-title":"Pattern Anal Appl"},{"issue":"1","key":"867_CR27","doi-asserted-by":"publisher","first-page":"63","DOI":"10.1016\/j.inffus.2004.04.008","volume":"6","author":"D Ruta","year":"2005","unstructured":"Ruta D, Gabrys B (2005) Classifier selection for majority voting. Inf Fusion 6(1):63\u201381","journal-title":"Inf Fusion"},{"key":"867_CR28","volume-title":"Hybrid classifiers: methods of data, knowledge, and classifier combination","author":"M Wozniak","year":"2013","unstructured":"Wozniak M (2013) Hybrid classifiers: methods of data, knowledge, and classifier combination, vol 519. Springer, Berlin"},{"key":"867_CR29","doi-asserted-by":"publisher","first-page":"3","DOI":"10.1016\/j.inffus.2013.04.006","volume":"16","author":"M Wo\u017aniak","year":"2014","unstructured":"Wo\u017aniak M, Gra\u00f1a M (2014) A survey of multiple classifier systems as hybrid systems. Inf Fusion 16:3\u201317","journal-title":"Inf Fusion"},{"issue":"194","key":"867_CR30","first-page":"257","volume":"A","author":"GU Yule","year":"1900","unstructured":"Yule GU (1900) On the association of attributes in statistics. Philos Trans A(194):257\u2013319","journal-title":"Philos Trans"},{"key":"867_CR31","doi-asserted-by":"publisher","first-page":"289","DOI":"10.1016\/j.neucom.2014.02.030","volume":"139","author":"H Zhang","year":"2014","unstructured":"Zhang H, Cao L (2014) A spectral clustering based ensemble pruning approach. Neurocomputing 139:289\u2013297","journal-title":"Neurocomputing"},{"key":"867_CR32","doi-asserted-by":"publisher","DOI":"10.1201\/b12207","volume-title":"Ensemble methods: foundations and algorithms","author":"ZH Zhou","year":"2012","unstructured":"Zhou ZH (2012) Ensemble methods: foundations and algorithms. Chapman & Hall CRC, Boca Raton"},{"issue":"1\u20132","key":"867_CR33","doi-asserted-by":"publisher","first-page":"239","DOI":"10.1016\/S0004-3702(02)00190-X","volume":"137","author":"ZH Zhou","year":"2002","unstructured":"Zhou ZH, Wu J, Tang W (2002) Ensembling neural networks: many could be better than all. Artif Intell 137(1\u20132):239\u2013263","journal-title":"Artif Intell"}],"container-title":["Pattern Analysis and Applications"],"original-title":[],"language":"en","link":[{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-020-00867-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/article\/10.1007\/s10044-020-00867-8\/fulltext.html","content-type":"text\/html","content-version":"vor","intended-application":"text-mining"},{"URL":"http:\/\/link.springer.com\/content\/pdf\/10.1007\/s10044-020-00867-8.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2021,2,10]],"date-time":"2021-02-10T01:00:19Z","timestamp":1612918819000},"score":1,"resource":{"primary":{"URL":"http:\/\/link.springer.com\/10.1007\/s10044-020-00867-8"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2020,2,10]]},"references-count":33,"journal-issue":{"issue":"3","published-print":{"date-parts":[[2020,8]]}},"alternative-id":["867"],"URL":"https:\/\/doi.org\/10.1007\/s10044-020-00867-8","relation":{},"ISSN":["1433-7541","1433-755X"],"issn-type":[{"value":"1433-7541","type":"print"},{"value":"1433-755X","type":"electronic"}],"subject":[],"published":{"date-parts":[[2020,2,10]]},"assertion":[{"value":"1 August 2019","order":1,"name":"received","label":"Received","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"3 February 2020","order":2,"name":"accepted","label":"Accepted","group":{"name":"ArticleHistory","label":"Article History"}},{"value":"10 February 2020","order":3,"name":"first_online","label":"First Online","group":{"name":"ArticleHistory","label":"Article History"}}]}}