{"status":"ok","message-type":"work","message-version":"1.0.0","message":{"indexed":{"date-parts":[[2025,8,2]],"date-time":"2025-08-02T18:35:43Z","timestamp":1754159743887,"version":"3.41.2"},"reference-count":42,"publisher":"Oxford University Press (OUP)","issue":"4","license":[{"start":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T00:00:00Z","timestamp":1725926400000},"content-version":"vor","delay-in-days":0,"URL":"https:\/\/academic.oup.com\/pages\/standard-publication-reuse-rights"}],"content-domain":{"domain":[],"crossmark-restriction":false},"short-container-title":[],"published-print":{"date-parts":[[2025,7,25]]},"abstract":"<jats:title>Abstract<\/jats:title>\n               <jats:p>The use of multi-objective optimization to build classifier ensembles is becoming increasingly popular. This approach optimizes more than one criterion simultaneously and returns a set of solutions. Thus the final solution can be more tailored to the user\u2019s needs. The work proposes the MOONF method using one or two criteria depending on the method\u2019s version. Optimization returns solutions as feature subspaces that are then used to train decision tree models. In this way, the ensemble is created non-randomly, unlike the popular Random Subspace approach (such as the Random Forest classifier). Experiments carried out on many imbalanced datasets compare the proposed methods with state-of-the-art methods and show the advantage of the MOONF method in the multi-objective version.<\/jats:p>","DOI":"10.1093\/jigpal\/jzae110","type":"journal-article","created":{"date-parts":[[2024,9,10]],"date-time":"2024-09-10T21:04:13Z","timestamp":1726002253000},"source":"Crossref","is-referenced-by-count":0,"title":["Using Multi-Objective Optimization to build non-Random Forest"],"prefix":"10.1093","volume":"33","author":[{"ORCID":"https:\/\/orcid.org\/0000-0003-0698-6993","authenticated-orcid":false,"given":"Joanna","family":"Klikowska","sequence":"first","affiliation":[{"name":"Department of Systems and Computer Networks , Wroclaw University of Science and Technology, Faculty of Information and Communication Technology, Wybrzeze Wyspanskiego 27, 50-370 Wroc\u0142aw, , joanna.klikowska@pwr.edu.pl","place":["Poland"]}]},{"ORCID":"https:\/\/orcid.org\/0000-0003-0146-4205","authenticated-orcid":false,"given":"Micha\u0142","family":"Wo\u017aniak","sequence":"additional","affiliation":[{"name":"Department of Systems and Computer Networks , Wroclaw University of Science and Technology, Faculty of Information and Communication Technology, Wybrzeze Wyspanskiego 27, 50-370 Wroc\u0142aw, , michal.wozniak@pwr.edu.pl","place":["Poland"]}]}],"member":"286","published-online":{"date-parts":[[2024,9,10]]},"reference":[{"key":"2025072518362422800_ref1","first-page":"255","article-title":"KEEL data-mining software tool: data set repository, integration of algorithms and experimental analysis framework","volume":"17","author":"Alcal\u00e1-Fdez","year":"2011","journal-title":"Journal of Multiple-Valued Logic & Soft Computing"},{"key":"2025072518362422800_ref2","doi-asserted-by":"crossref","first-page":"113232","DOI":"10.1016\/j.eswa.2020.113232","article-title":"Ensemble learning by means of a multi-objective optimization design approach for dealing with imbalanced data sets","volume":"147","author":"Henrique","year":"2020","journal-title":"Expert Systems with Applications"},{"key":"2025072518362422800_ref3","doi-asserted-by":"crossref","first-page":"368","DOI":"10.1109\/TEVC.2012.2199119","article-title":"Evolving diverse ensembles using genetic programming for classification with unbalanced data","volume":"17","author":"Bhowan","year":"2013","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref4","doi-asserted-by":"crossref","first-page":"893","DOI":"10.1109\/TEVC.2013.2293393","article-title":"Reusing genetic programming for ensemble selection in classification of unbalanced data","volume":"18","author":"Bhowan","year":"2014","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref5","doi-asserted-by":"crossref","first-page":"3007","DOI":"10.1109\/TCYB.2022.3174519","article-title":"Multitask feature learning as multiobjective optimization: a new genetic programming approach to image classification","volume":"53","author":"Bi","year":"2023","journal-title":"IEEE Transactions on Cybernetics"},{"key":"2025072518362422800_ref6","doi-asserted-by":"crossref","first-page":"89497","DOI":"10.1109\/ACCESS.2020.2990567","article-title":"Pymoo: multi-objective optimization in python","volume":"8","author":"Blank","year":"2020","journal-title":"IEEE Access"},{"key":"2025072518362422800_ref7","doi-asserted-by":"crossref","first-page":"5","DOI":"10.1023\/A:1010933404324","article-title":"Random forests","volume":"45","author":"Breiman","year":"2001","journal-title":"Machine Learning"},{"key":"2025072518362422800_ref8","doi-asserted-by":"crossref","DOI":"10.1201\/9781315139470","volume-title":"Classification and Regression Trees","author":"Breiman","year":"2017"},{"key":"2025072518362422800_ref9","doi-asserted-by":"crossref","first-page":"107630","DOI":"10.1016\/j.cie.2021.107630","article-title":"Deep learning-based sewer defect classification for highly imbalanced dataset","volume":"161","author":"Minh Dang","year":"2021","journal-title":"Computers & Industrial Engineering"},{"key":"2025072518362422800_ref10","doi-asserted-by":"crossref","first-page":"4","DOI":"10.1109\/TEVC.2010.2059031","article-title":"Differential evolution: a survey of the state-of-the-art","volume":"15","author":"Das","year":"2011","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref11","first-page":"1","article-title":"Statistical comparisons of classifiers over multiple data sets","volume":"7","author":"Dem\u0161ar","year":"2006","journal-title":"The Journal of Machine learning Research"},{"volume-title":"Multicriteria Optimization","year":"2005","author":"Ehrgott","key":"2025072518362422800_ref12"},{"key":"2025072518362422800_ref13","doi-asserted-by":"crossref","first-page":"1750028","DOI":"10.1142\/S0129065717500289","article-title":"A pareto-based ensemble with feature and instance selection for learning from multi-class imbalanced datasets","volume":"27","author":"Fern\u00e1ndez","year":"2017","journal-title":"International Journal of Neural Systems"},{"key":"2025072518362422800_ref14","doi-asserted-by":"crossref","first-page":"93","DOI":"10.1016\/j.neucom.2020.05.029","article-title":"A non-specialized ensemble classifier using multi-objective optimization","volume":"409","author":"Fletcher","year":"2020","journal-title":"Neurocomputing"},{"key":"2025072518362422800_ref15","doi-asserted-by":"crossref","first-page":"90","DOI":"10.1109\/MCSE.2007.55","article-title":"Matplotlib: a 2d graphics environment","volume":"9","author":"Hunter","year":"2007","journal-title":"Computing in Science & Engineering"},{"key":"2025072518362422800_ref16","first-page":"1","article-title":"A survey on evolutionary multiobjective feature selection in classification: approaches, applications, and challenges","author":"Jiao","year":"2023","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref17","first-page":"1","article-title":"Solving multi-objective feature selection problems in classification via problem reformulation and duplication handling","author":"Jiao","year":"2022","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref18","first-page":"1","article-title":"Imbalanced-learn: a python toolbox to tackle the curse of imbalanced datasets in machine learning","volume":"18","author":"Lema\u00eetre","year":"2017","journal-title":"Journal of Machine Learning Research"},{"key":"2025072518362422800_ref19","doi-asserted-by":"crossref","first-page":"299","DOI":"10.1007\/978-981-15-3425-6_24","article-title":"Ensemble learning based on multimodal multiobjective optimization","volume-title":"Bio-Inspired Computing: Theories and Applications","author":"Liang","year":"2020"},{"key":"2025072518362422800_ref20","first-page":"1","article-title":"A multiform optimization framework for multi-objective feature selection in classification","author":"Liang","year":"2023","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref21","doi-asserted-by":"crossref","first-page":"100925","DOI":"10.1016\/j.swevo.2021.100925","article-title":"An interactive filter-wrapper multi-objective evolutionary algorithm for feature selection","volume":"65","author":"Liu","year":"2021","journal-title":"Swarm and Evolutionary Computation"},{"key":"2025072518362422800_ref22","doi-asserted-by":"crossref","first-page":"6585","DOI":"10.1016\/j.eswa.2011.12.043","article-title":"Analysis of preprocessing vs. cost-sensitive learning for imbalanced classification. Open problems on intrinsic data characteristics","volume":"39","author":"L\u00f3pez","year":"2012","journal-title":"Expert Systems With Applications"},{"key":"2025072518362422800_ref23","first-page":"454","article-title":"Feature extraction and selection for parsimonious classifiers with multiobjective genetic programming","volume":"24","author":"Nag","year":"2020","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref24","doi-asserted-by":"crossref","first-page":"563","DOI":"10.1007\/s10844-015-0368-1","article-title":"Types of minority class examples and their influence on learning classifiers from imbalanced data","volume":"46","author":"Napierala","year":"2016","journal-title":"Journal of Intelligent Information Systems"},{"volume-title":"A Guide to NumPy","year":"2006","author":"Oliphant","key":"2025072518362422800_ref25"},{"key":"2025072518362422800_ref26","doi-asserted-by":"crossref","first-page":"592","DOI":"10.1007\/978-3-540-31880-4_41","article-title":"Multi-objective genetic algorithms to create ensemble of classifiers","volume-title":"Evolutionary Multi-Criterion Optimization","author":"Oliveira","year":"2005"},{"key":"2025072518362422800_ref27","doi-asserted-by":"crossref","first-page":"1","DOI":"10.1016\/j.eswa.2016.06.005","article-title":"A multiobjective weighted voting ensemble classifier based on differential evolution algorithm for text sentiment classification","volume":"62","author":"Onan","year":"2016","journal-title":"Expert Systems With Applications"},{"key":"2025072518362422800_ref28","first-page":"131","article-title":"Multiple criteria decision aid","volume":"136","author":"Papathanasiou","year":"2018","journal-title":"Methods, Examples and Python Implementations"},{"key":"2025072518362422800_ref29","first-page":"2825","article-title":"Scikit-learn: machine learning in Python","volume":"12","author":"Pedregosa","year":"2011","journal-title":"Journal of Machine Learning Research"},{"key":"2025072518362422800_ref30","first-page":"1","article-title":"A survey on unbalanced classification: how can evolutionary computation help","author":"Pei","year":"2023","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref31","doi-asserted-by":"crossref","first-page":"1882","DOI":"10.1145\/3205651.3208219","article-title":"A multi-objective optimization design framework for ensemble generation","volume-title":"Proceedings of the Genetic and Evolutionary Computation Conference Companion, GECCO \u201918","author":"Ribeiro","year":"2018"},{"key":"2025072518362422800_ref32","first-page":"191","article-title":"Computational complexity analysis of decision tree algorithms","volume-title":"Artificial Intelligence XXXV","author":"Sani","year":"2018"},{"key":"2025072518362422800_ref33","doi-asserted-by":"crossref","first-page":"1801","DOI":"10.1016\/j.patcog.2011.01.015","article-title":"A multi-objective optimisation approach for class imbalance learning","volume":"44","author":"Soda","year":"2011","journal-title":"Pattern Recognition"},{"key":"2025072518362422800_ref34","doi-asserted-by":"crossref","first-page":"107219","DOI":"10.1016\/j.asoc.2021.107219","article-title":"How to design the fair experimental classifier evaluation","volume":"104","author":"Sta\u0327por","year":"2021","journal-title":"Applied Soft Computing"},{"key":"2025072518362422800_ref35","doi-asserted-by":"crossref","first-page":"2050043","DOI":"10.1142\/S0129065720500434","article-title":"Improved overlap-based undersampling for imbalanced dataset classification with application to epilepsy and Parkinson\u2019s disease","volume":"30","author":"Vuttipittayamongkol","year":"2020","journal-title":"International Journal of Neural Systems"},{"key":"2025072518362422800_ref36","doi-asserted-by":"crossref","first-page":"296","DOI":"10.1109\/TEVC.2022.3168052","article-title":"Differential evolution-based feature selection: a niching-based multiobjective approach","volume":"27","author":"Wang","year":"2023","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref37","doi-asserted-by":"crossref","first-page":"56","DOI":"10.25080\/Majora-92bf1922-00a","article-title":"Data structures for statistical computing in Python","volume-title":"Proceedings of the 9th Python in Science Conference","author":"McKinney","year":"2010"},{"key":"2025072518362422800_ref38","doi-asserted-by":"crossref","first-page":"16807","DOI":"10.1109\/ACCESS.2022.3149914","article-title":"Multicriteria classifier ensemble learning for imbalanced data","volume":"10","author":"We\u0327gier","year":"2022","journal-title":"IEEE Access"},{"key":"2025072518362422800_ref39","first-page":"444","article-title":"Segmented initialization and offspring modification in evolutionary algorithms for bi-objective feature selection","volume-title":"Proceedings of the 2020 Genetic and Evolutionary Computation Conference, GECCO \u201920","author":"Xu"},{"key":"2025072518362422800_ref40","doi-asserted-by":"crossref","first-page":"712","DOI":"10.1109\/TEVC.2007.892759","article-title":"MOEA\/D: a multiobjective evolutionary algorithm based on decomposition","volume":"11","author":"Zhang","year":"2007","journal-title":"IEEE Transactions on Evolutionary Computation"},{"key":"2025072518362422800_ref41","article-title":"A heterogeneous ensemble learning framework for spam detection in social networks with imbalanced data","volume":"10","author":"Zhao","year":"2020","journal-title":"Applied Sciences"},{"key":"2025072518362422800_ref42","doi-asserted-by":"crossref","first-page":"787","DOI":"10.1109\/TEVC.2022.3222297","article-title":"Region purity-based local feature selection: a multiobjective perspective","volume":"27","author":"Zhou","year":"2023","journal-title":"IEEE Transactions on Evolutionary Computation"}],"container-title":["Logic Journal of the IGPL"],"original-title":[],"language":"en","link":[{"URL":"https:\/\/academic.oup.com\/jigpal\/article-pdf\/33\/4\/jzae110\/59067015\/jzae110.pdf","content-type":"application\/pdf","content-version":"vor","intended-application":"syndication"},{"URL":"https:\/\/academic.oup.com\/jigpal\/article-pdf\/33\/4\/jzae110\/59067015\/jzae110.pdf","content-type":"unspecified","content-version":"vor","intended-application":"similarity-checking"}],"deposited":{"date-parts":[[2025,7,25]],"date-time":"2025-07-25T22:36:36Z","timestamp":1753482996000},"score":1,"resource":{"primary":{"URL":"https:\/\/academic.oup.com\/jigpal\/article\/doi\/10.1093\/jigpal\/jzae110\/7749851"}},"subtitle":[],"short-title":[],"issued":{"date-parts":[[2024,9,10]]},"references-count":42,"journal-issue":{"issue":"4","published-print":{"date-parts":[[2025,7,25]]}},"URL":"https:\/\/doi.org\/10.1093\/jigpal\/jzae110","relation":{},"ISSN":["1367-0751","1368-9894"],"issn-type":[{"type":"print","value":"1367-0751"},{"type":"electronic","value":"1368-9894"}],"subject":[],"published-other":{"date-parts":[[2025,8]]},"published":{"date-parts":[[2024,9,10]]},"article-number":"jzae110"}}